-- Logs begin at Sat 2022-10-29 02:04:08 UTC, end at Sat 2022-10-29 04:32:51 UTC. -- Oct 29 02:34:58.975990 n-d-862964-4 systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 02:34:58.986581 n-d-862964-4 devstack@n-api.service[111207]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 29 02:34:58 2022] *** Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: nodename: n-d-862964-4 Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: machine: x86_64 Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: clock source: unix Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: pcre jit disabled Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: detected number of CPU cores: 4 Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: current working directory: / Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: detected binary path: /usr/bin/uwsgi-core Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: your processes number limit is 47680 Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: your memory page size is 4096 bytes Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: detected max file descriptor number: 2048 Oct 29 02:34:58.988534 n-d-862964-4 devstack@n-api.service[111207]: lock engine: pthread robust mutexes Oct 29 02:34:58.989320 n-d-862964-4 devstack@n-api.service[111207]: thunder lock: enabled Oct 29 02:34:58.989320 n-d-862964-4 devstack@n-api.service[111207]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 02:34:58.989320 n-d-862964-4 devstack@n-api.service[111207]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 29 02:34:59.027744 n-d-862964-4 devstack@n-api.service[111207]: Python main interpreter initialized at 0x560f5abd09c0 Oct 29 02:34:59.027744 n-d-862964-4 devstack@n-api.service[111207]: python threads support enabled Oct 29 02:34:59.027744 n-d-862964-4 devstack@n-api.service[111207]: your server socket listen backlog is limited to 100 connections Oct 29 02:34:59.027744 n-d-862964-4 devstack@n-api.service[111207]: your mercy for graceful operations on workers is 90 seconds Oct 29 02:34:59.028105 n-d-862964-4 devstack@n-api.service[111207]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 02:34:59.028105 n-d-862964-4 devstack@n-api.service[111207]: *** Operational MODE: preforking *** Oct 29 02:34:59.028398 n-d-862964-4 devstack@n-api.service[111207]: *** uWSGI is running in multiple interpreter mode *** Oct 29 02:34:59.028398 n-d-862964-4 devstack@n-api.service[111207]: spawned uWSGI master process (pid: 111207) Oct 29 02:34:59.028590 n-d-862964-4 systemd[1]: Started Devstack devstack@n-api.service. Oct 29 02:34:59.031497 n-d-862964-4 devstack@n-api.service[111207]: spawned uWSGI worker 1 (pid: 111208, cores: 1) Oct 29 02:34:59.031497 n-d-862964-4 devstack@n-api.service[111207]: spawned uWSGI worker 2 (pid: 111209, cores: 1) Oct 29 02:34:59.031497 n-d-862964-4 devstack@n-api.service[111207]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 02:34:59.677355 n-d-862964-4 devstack@n-api.service[111208]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 02:34:59.678017 n-d-862964-4 devstack@n-api.service[111209]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 02:35:00.735517 n-d-862964-4 devstack@n-api.service[111209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:35:00.735517 n-d-862964-4 devstack@n-api.service[111209]: from cryptography.utils import int_from_bytes Oct 29 02:35:00.736224 n-d-862964-4 devstack@n-api.service[111208]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:35:00.736224 n-d-862964-4 devstack@n-api.service[111208]: from cryptography.utils import int_from_bytes Oct 29 02:35:00.736595 n-d-862964-4 devstack@n-api.service[111209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:35:00.736595 n-d-862964-4 devstack@n-api.service[111209]: from cryptography.utils import int_from_bytes Oct 29 02:35:00.736732 n-d-862964-4 devstack@n-api.service[111208]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:35:00.736732 n-d-862964-4 devstack@n-api.service[111208]: from cryptography.utils import int_from_bytes Oct 29 02:35:03.212197 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 02:35:03.212811 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 02:35:03.213050 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 02:35:03.213380 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 02:35:03.213660 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 02:35:03.214061 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.214379 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.214688 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.214834 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 02:35:03.215215 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.215299 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 02:35:03.215375 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.215509 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 02:35:03.215595 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.215884 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.216008 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 02:35:03.216130 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 02:35:03.216292 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.216483 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.216580 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.216790 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.216935 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.217040 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.217129 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.217355 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862964-4 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.217488 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.217645 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.217743 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.217970 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.218067 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.218273 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.218377 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.218579 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.218668 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.218873 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.218963 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.219182 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.219282 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.219478 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.219576 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.219794 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862964-4 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.219964 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.220164 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.221275 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.221433 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.221544 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.221674 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.221829 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.221968 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.222091 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.222212 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.222343 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.222465 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.222595 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.222715 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.222834 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.223011 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.223132 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.223258 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.223391 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.223515 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.223642 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.223769 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.223898 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.224016 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862964-4 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.224137 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.224265 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.224392 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.224518 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.224646 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.224766 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.224892 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.225018 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.225148 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.225277 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.225398 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.225523 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.225765 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862964-4 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.226009 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.226164 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.226286 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.226407 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.226539 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.226666 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.226799 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.227072 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.227209 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.227368 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.227505 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.227680 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.227807 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.227982 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.228107 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.228257 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.228392 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.228572 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.228699 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.228880 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.229016 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.229153 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.229281 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.229455 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.229582 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.229711 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.229850 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.229986 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.230116 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.230304 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.230431 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.230615 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.230743 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.230925 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.231065 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.231187 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.231307 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.231427 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.231557 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.231679 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.231799 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.231994 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.232123 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.232295 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.232431 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.232583 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.232712 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.232891 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.233026 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.233158 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.233279 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.233405 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.233527 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.233709 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.233886 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.234025 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.234156 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.234336 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.234468 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.234636 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.234774 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.234925 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.235059 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.235234 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.235361 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.235530 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.235719 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.235924 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.236101 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.236248 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.236423 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.236571 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.236709 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.236835 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.236955 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.237074 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.237194 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.237381 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.237521 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.237673 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.237829 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.238020 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.238148 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.238334 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.238461 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.238632 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.238760 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.238934 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.239068 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.239198 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.239328 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.239524 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.239653 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.239848 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.239977 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.240136 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.240264 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.240384 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.240504 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.240631 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.240751 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.240944 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.241080 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.241255 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.241383 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.241539 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.241699 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.241944 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.242078 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.242211 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.242335 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.242454 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.242581 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.242768 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.242896 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.243069 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.243203 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.243355 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.243491 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.243665 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.243791 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.243965 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.244092 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.244261 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.244397 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.244518 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.244636 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.244835 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.244961 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.245135 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.245272 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.245398 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.245516 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.245721 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.245877 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.246009 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.246130 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.246336 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.246467 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.246639 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.246779 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.246903 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.247032 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.247210 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.247339 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.247821 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.247951 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.248113 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.248246 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.248422 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.248552 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.248734 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.248856 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.249020 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.249156 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.249310 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.249448 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.249623 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.249751 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.250012 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.250136 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.250255 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.250395 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.250516 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.250670 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.250801 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.250923 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.251072 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.251200 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.251492 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.251661 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.251802 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.251926 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.252053 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.252175 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.252303 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.252425 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.252592 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.252720 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.252896 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.253036 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.253169 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.253303 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.253463 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.253594 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.253764 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.253931 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.254066 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.254197 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.254375 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.254502 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.254683 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.254817 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.254970 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.255106 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.255278 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.255404 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.255573 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.255700 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.255858 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.255996 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.256177 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.256305 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.256485 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.256621 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.256805 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.256933 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.257090 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.257212 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.257392 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.257528 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.257659 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.257781 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.258016 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:03.258145 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.258346 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.258486 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.258623 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.258743 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.258955 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.259083 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.259258 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.259385 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.259567 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.259695 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.259853 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.259981 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.260175 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.260305 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.260483 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.260609 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.260805 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.260932 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.261114 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.261253 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.261395 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.261527 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.261714 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.261863 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.262040 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.262181 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.262341 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.262469 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.262663 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.262792 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.262972 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.263108 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.263299 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.263420 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.263587 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.263714 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.263900 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.264037 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.264190 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.264318 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.264518 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.264646 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.264826 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.264960 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.265140 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.265276 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.265405 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.265526 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.265715 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.265883 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.266074 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.266204 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.266365 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.266494 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.266679 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.266814 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.267025 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.267162 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.267295 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.267496 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.267634 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.267811 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.267939 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.268118 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.268246 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.268454 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.268598 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.268775 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.268903 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.269072 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.269198 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.269382 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.269516 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.269674 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.269841 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.270026 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.270152 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.270339 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.270475 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.270603 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.270723 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.270923 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.271051 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.271230 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.271357 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.271527 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.271657 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.271814 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.271942 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.272145 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.272269 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.272389 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.272523 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.272654 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.272775 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.272971 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.273099 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.273257 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.273385 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.273581 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.273718 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.273898 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.274023 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.274207 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.274335 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.274526 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.274663 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.274793 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.274913 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.275106 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.275234 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.275408 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.275543 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.275696 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.275823 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.276006 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.276126 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.276305 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.276443 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.276604 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.276733 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.276909 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.277048 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.277210 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.277346 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.277519 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.277646 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.277832 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.277961 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.278144 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.278280 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.278433 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.278563 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.278738 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.278867 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.279030 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.279159 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.279340 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.279469 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.279639 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.279765 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.279943 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.280072 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.280247 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.280373 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.280528 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.280665 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.280840 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.280980 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.281131 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.281265 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.281448 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.281584 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.281757 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.281932 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.282053 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.282173 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.282378 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.282524 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.282729 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.282863 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.283048 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.283183 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.283356 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.283496 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.283671 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.283813 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.283935 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.284054 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.284252 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.284380 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.284539 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.284667 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.284849 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.284976 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.285136 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.285264 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.285436 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.285572 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.285792 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.285936 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.286127 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.286256 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.286420 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.286550 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.286730 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.286858 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.287026 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.287149 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.287300 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.287430 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.287605 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.287740 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.287893 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.288019 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.288196 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.288323 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.288506 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.288642 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.288772 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.288893 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.289098 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.289226 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.289402 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.289538 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.289670 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.289843 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.289998 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.290138 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.290297 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.290435 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.290634 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.290760 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.290935 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.291062 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.291199 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.291319 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.291520 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.291648 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.291829 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.291957 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.292135 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.292263 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.292445 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.292573 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.292747 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.292882 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.293042 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.293168 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.293345 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.293468 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.293649 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.293765 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.293968 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.294093 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.294273 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.294396 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.294576 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.294707 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.294889 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.295014 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.295194 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.295318 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.295505 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.295636 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.295806 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.295928 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.296111 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.296246 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.296408 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.296544 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.296710 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.296833 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.297009 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.297140 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.297307 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.297440 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.297615 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.297739 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.297938 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.298063 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.298297 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.298436 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.298612 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.298777 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.298901 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.299034 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.299205 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.299333 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.299510 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.299634 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.299814 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.299949 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.300147 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.300270 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.300421 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.300551 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.300732 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.300869 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.301032 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.301156 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.301336 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.301461 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.301639 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.301762 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.301966 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.302091 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.302263 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.302385 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.302560 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.302692 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.302856 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.302991 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.303152 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.303276 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.303451 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.303583 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.303756 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.303882 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.304055 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.304180 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.304355 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.304491 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.304649 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.304773 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.304953 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.305078 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.305250 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.305387 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.305546 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.305669 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.305866 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.305994 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.306169 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.306296 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.306474 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.306597 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.306772 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.306909 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.307068 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.307192 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.307374 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.307506 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.307666 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.307796 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.307961 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.308084 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.308258 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.308382 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.308554 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.308677 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.308848 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.308972 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.309142 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.309266 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.309436 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.309561 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.309759 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.309925 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.310083 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.310206 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.310374 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.310509 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.310687 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.310820 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.310990 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.311115 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.311291 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.311424 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.311589 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.311720 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.311887 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.312011 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.312204 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.312340 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.312515 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.312638 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.312812 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.312937 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.313107 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.313259 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.313407 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.313532 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.313709 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.313917 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.314102 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.314299 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.314503 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.314634 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.314756 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.314877 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.315008 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.315134 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.315254 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.315408 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.315535 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.315714 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.315847 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.316023 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.316156 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.316337 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.316463 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.316651 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.316926 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.317059 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.317248 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.317373 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.317553 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.317687 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.317884 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.318012 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.318190 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.318315 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.318490 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.318625 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.318798 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.318924 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.319112 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.319236 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.319414 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.319675 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.319809 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.319997 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.320128 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.320293 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.320418 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.320589 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.320732 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.320889 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.321021 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.321184 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.321326 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.321479 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.321603 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.321776 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.321959 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.322082 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.322202 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.322375 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.322500 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.322670 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.322795 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.322969 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.323096 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.323255 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.323384 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.323583 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.323707 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.323826 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.323947 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.324126 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.324259 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.324422 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.324546 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.324736 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.324867 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.325032 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.325165 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.325331 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.325462 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.325622 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.325745 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.325939 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.326074 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.326249 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.326372 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.326552 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.326674 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.326855 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.326986 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.327155 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.327280 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.327479 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.327602 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.327783 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.327915 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.328078 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.328201 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.328374 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.328503 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.328671 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.328796 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.328962 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.329086 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.329259 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.329382 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.329662 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.329786 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.330063 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.330197 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.330357 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.330494 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.330657 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.330790 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.330958 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.331075 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.331267 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.331408 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.331564 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.331688 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.331856 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.331981 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.332154 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.332298 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.332445 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.332569 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.332749 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.332872 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.333043 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.333174 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.333334 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.333456 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.333628 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.333751 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.333952 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.334079 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.334251 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.334377 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.334545 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.334678 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.334843 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.334966 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.335136 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.335267 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.335443 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.335566 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.335735 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.335858 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.336028 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.336153 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.336320 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.336447 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.336617 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.336734 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.336916 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.337051 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.337204 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.337336 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.337505 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.337631 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.337856 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.337985 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.338106 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.338237 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.338403 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.338528 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.338702 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.338832 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.338998 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.339134 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.339289 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.339412 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.339590 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.339714 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.339889 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.340024 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.340194 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.340320 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.340489 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.340613 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.340787 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.340911 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.341081 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.341204 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.341376 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.341501 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.341672 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.341847 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.341992 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.342115 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.342287 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.342422 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.342580 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.342718 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.342871 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.342995 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.343165 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.343290 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.343458 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.343584 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.343756 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.343880 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.344054 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.344185 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.344348 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.344474 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.344642 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.344766 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.344935 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.345108 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.345314 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.345450 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.345629 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.345755 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.345926 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.346063 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.346187 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.346308 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.346519 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.346645 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.346824 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.346958 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.347123 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.347247 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.347422 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.347548 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.347721 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.347855 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.348015 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.348138 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.348321 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.348452 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.348621 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.348754 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.348926 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.349051 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.349219 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.349344 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.349514 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.349638 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.349844 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.349983 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.350151 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.350276 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.350454 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.350579 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.350767 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.350891 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.351080 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.351203 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.351396 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.351519 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.351678 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.351803 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.351976 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.352108 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.352273 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.352396 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.352570 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.352692 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.352872 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.353005 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.353173 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.353297 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.353472 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.353597 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.353775 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.353958 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.354084 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.354204 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.354388 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.354512 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.354685 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.354823 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.354983 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.355100 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.355285 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.355417 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.355582 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.355713 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.355876 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.356000 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.356177 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.356300 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.356474 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.356598 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.356767 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.356894 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.357063 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.357189 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.357357 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.357483 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.357653 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.357776 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.357971 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.358094 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.358274 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.358398 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.358572 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.358696 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.358891 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.359026 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.359194 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.359325 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.359493 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.359618 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.359794 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.359929 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.360093 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.360224 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.360395 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.360518 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.360731 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.360913 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.361143 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.361349 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.361485 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.361615 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.361748 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.361910 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.362056 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.362181 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.362362 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.362487 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.362667 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.362803 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.362974 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.363100 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.363283 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.363407 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.363582 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.363708 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.363877 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.364002 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.364172 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.364296 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.364485 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.364610 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.364782 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.364907 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.365097 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.365214 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.365429 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.365552 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.365735 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.365919 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.366089 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.366223 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.366393 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.366518 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.366691 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.366816 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.366988 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.367121 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.367303 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.367427 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.367600 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.367724 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.367918 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.368056 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.368244 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.368367 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.368548 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.368687 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.368848 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.368987 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.369195 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.369329 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.369453 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.369586 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.369756 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.369910 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.370085 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.370220 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.370379 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.370505 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.370695 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.370820 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.371009 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.371135 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.371316 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.371441 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.371628 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.371753 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.371973 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.372098 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.372290 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.372421 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.372903 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.373029 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.373210 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.373336 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.373509 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.373634 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.373905 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.374036 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.374175 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.374300 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.374420 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.374541 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.374704 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.374838 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.374999 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.375147 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.375321 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.375467 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.375617 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.375771 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.375920 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.376083 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.376208 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.376431 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.376559 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.376732 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.376865 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.377032 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.377150 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.377334 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.377480 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.377633 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.377759 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.377956 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.378083 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.378278 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.378421 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.378579 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.378710 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.378889 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.379014 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.379198 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.379332 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.379501 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.379627 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.379800 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.379924 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.380095 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.380229 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.380389 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.380517 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.380684 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.380824 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.381000 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.381132 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.381295 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.381432 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.381602 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.381727 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.381941 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.382067 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.382242 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.382376 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.382547 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.382671 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.382848 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.382973 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.383147 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.383271 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.383445 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.383571 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.383741 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.383867 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.384047 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.384172 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.384361 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.384485 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.384651 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.384777 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.384942 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.385069 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.385246 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.385389 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.385542 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.385667 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.385854 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.385985 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.386151 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.386290 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.386447 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.386581 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.386738 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.386865 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.387058 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.387197 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.387329 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.387452 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.387619 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.387744 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.387912 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.388050 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.388221 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.388348 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.388527 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.388653 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.388821 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.388947 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.389114 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.389247 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.389406 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.389532 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.389725 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.389862 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.390035 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.390163 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.390328 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.390453 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.390637 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.390763 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.390932 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.391064 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.391247 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.391371 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.391550 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.391676 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.391871 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.392102 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.392252 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.392389 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.392557 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.392705 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.392828 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.392950 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.393081 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.393213 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.393378 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.393502 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.393681 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.393853 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.394008 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.394147 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.394314 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.394439 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.394620 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.394821 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.394946 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.395145 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.395273 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.395457 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.395583 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.395762 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.395900 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.396066 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.396192 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.396372 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.396496 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.396677 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.396811 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.396981 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.397106 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.397282 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.397418 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.397581 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.397791 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.397936 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.398141 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.398267 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.398451 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.398590 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.398762 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.398898 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.399070 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.399195 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.399379 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.399514 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.399688 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.399813 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.399999 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.400125 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.400304 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.400438 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.400611 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.400737 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.400917 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.401043 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.401233 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.401359 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.401539 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.401664 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.401870 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.402000 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.402179 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.402313 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.402482 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.402614 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.402785 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.402910 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.403089 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.403223 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.403396 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.403520 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.403696 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.403829 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.403994 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.404118 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.404297 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.404429 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.404603 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.404738 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.404917 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.405042 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.405227 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.405352 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.405533 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.405661 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.405859 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.405988 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.406167 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.406290 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.406472 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.406598 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.406777 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.406972 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.407097 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.407275 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.407412 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.407617 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.407784 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.407971 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.408187 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.408339 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.408463 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.408585 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.408712 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.408836 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.408957 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.409126 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.409254 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.409422 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.409547 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.409742 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.410015 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.410157 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.410324 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.410455 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.410618 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.410742 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.410929 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.411071 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.411229 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.411355 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.411522 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.411647 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.411854 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.411988 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.412180 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.412305 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.412482 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.412710 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.412849 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.413050 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.413187 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.413358 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.413482 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.413655 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.413788 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.413996 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.414123 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.414310 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.414449 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.414598 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.414736 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.414908 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.415024 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.415209 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.415332 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.415506 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.415727 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.415852 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.416072 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.416197 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.416381 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.416513 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.416677 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.416810 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.416977 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.417110 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.417275 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.417409 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.417570 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.417696 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.417889 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.418017 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.418184 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.418395 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.418520 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.418641 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.418801 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.418924 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.419097 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.419222 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.419391 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.419517 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.419690 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.419813 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.419983 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.420108 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.420278 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.420405 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.420577 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.420702 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.420872 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.421001 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.421168 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.421292 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.421460 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.421583 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.421757 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.421911 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.422077 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.422204 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.422376 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.422510 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.422678 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.422801 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.422978 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.423104 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.423324 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.423501 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.423628 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.423750 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.423909 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.424038 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.424201 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.424343 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.424500 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.424624 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.424799 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.424923 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.425097 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.425229 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.425400 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.425526 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.425698 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.425845 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.426061 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.426187 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.426362 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.426486 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.426681 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.426881 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.427015 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.427209 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.427334 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.427522 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.427640 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.427846 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.427985 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.428161 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.428286 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.428459 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.428589 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.428756 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.428891 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.429053 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.429179 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.429367 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.429498 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.429671 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.429915 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.430054 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.430245 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.430371 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.430560 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.430694 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.430858 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.430983 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.431161 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.431286 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.431461 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.431599 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.431759 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.431888 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.432056 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.432187 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.432352 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.432478 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.432648 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.432773 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.432947 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.433079 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.433245 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.433371 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.433541 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.433666 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.433865 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.433995 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.434169 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.434302 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.434473 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.434607 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.434776 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.434915 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.435076 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.435201 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.435378 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.435507 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.435675 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.435807 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.435975 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.436108 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.436274 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.436400 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.436573 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.436710 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.436876 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.436999 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.437194 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.437320 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.437499 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.437624 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.437794 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.437960 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.438129 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.438440 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.438577 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.438743 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.438888 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.439074 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.439209 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.439379 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.439514 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.439684 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.439801 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.439992 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.440117 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.440314 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.440450 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.440622 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.440746 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.440920 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.441044 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.441221 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.441544 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.441667 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.441896 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.442025 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.442212 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.442349 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.442526 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.442650 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.442823 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.442948 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.443121 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.443259 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.443416 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.443548 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.443715 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.443839 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.444026 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.444151 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.444327 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.444453 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.444623 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.444748 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.444921 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.445047 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.445226 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.445342 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.445521 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.445646 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.445853 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.445994 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.446139 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.446264 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.446437 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.446635 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.446759 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.446890 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.447016 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.447137 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.447302 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.447436 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.447596 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.447721 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.447890 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.448015 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.448184 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.448318 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.448479 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.448612 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.448775 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.448898 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.449068 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.449201 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.449364 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.449488 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.449658 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.449782 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.449978 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.450105 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.450272 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.450397 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.450566 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.450690 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.450863 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.450989 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.451161 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.451286 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.451457 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.451581 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.451758 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.451884 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.452058 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.452184 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.452355 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.452479 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.452651 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.452777 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.452951 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.453077 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.453247 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.453380 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.453545 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.453671 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.453887 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.454017 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.454188 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.454326 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.454568 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.454709 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.454868 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.454994 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.455172 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.455309 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.455473 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.455599 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.455772 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.455897 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.456089 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.456224 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.456395 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.456529 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.456693 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.456825 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.457010 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.457144 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.457311 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.457434 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.457615 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.457741 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.457944 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.458078 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.458247 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.458372 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.458544 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.458668 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.458845 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.458971 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.459145 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.459268 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.459443 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.459582 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.459745 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.459870 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.460049 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.460174 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.460353 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.460491 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.460652 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.460776 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.460954 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.461078 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.461260 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.461396 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.461563 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.461686 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.461901 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.462030 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.462254 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.462388 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.462524 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.462645 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.462801 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.462924 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.463106 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.463231 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.463416 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.463540 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.463722 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.463853 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.464027 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.464152 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.464339 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.464473 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.464646 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.464779 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.464947 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.465070 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.465250 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.465374 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.465495 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 02:35:03.465624 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.465900 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.466226 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.466565 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.466874 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.467207 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.467528 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.467834 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.468139 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.468436 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:03.468674 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 02:35:03.619710 n-d-862964-4 devstack@n-api.service[111209]: INFO dbcounter [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Registered counter for database nova_api Oct 29 02:35:03.621492 n-d-862964-4 devstack@n-api.service[111208]: INFO dbcounter [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Registered counter for database nova_api Oct 29 02:35:03.643642 n-d-862964-4 devstack@n-api.service[111209]: DEBUG oslo_db.sqlalchemy.engines [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:03.645451 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_db.sqlalchemy.engines [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:03.650415 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writer thread running {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:03.652173 n-d-862964-4 devstack@n-api.service[111208]: DEBUG dbcounter [-] [111208] Writer thread running {{(pid=111208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:03.708277 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.context [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) {{(pid=111209) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 02:35:03.709224 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.context [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) {{(pid=111208) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 02:35:03.712338 n-d-862964-4 devstack@n-api.service[111209]: DEBUG oslo_concurrency.lockutils [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:35:03.712741 n-d-862964-4 devstack@n-api.service[111209]: DEBUG oslo_concurrency.lockutils [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:35:03.713124 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:35:03.713592 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:35:03.714333 n-d-862964-4 devstack@n-api.service[111209]: DEBUG oslo_concurrency.lockutils [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:35:03.715120 n-d-862964-4 devstack@n-api.service[111209]: DEBUG oslo_concurrency.lockutils [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:35:03.715254 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:35:03.715557 n-d-862964-4 devstack@n-api.service[111209]: DEBUG oslo_concurrency.lockutils [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:35:03.715882 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:35:03.716312 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:35:03.717523 n-d-862964-4 devstack@n-api.service[111209]: DEBUG oslo_concurrency.lockutils [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:35:03.718340 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:35:03.719527 n-d-862964-4 devstack@n-api.service[111209]: INFO dbcounter [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Registered counter for database nova_cell0 Oct 29 02:35:03.720379 n-d-862964-4 devstack@n-api.service[111208]: INFO dbcounter [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Registered counter for database nova_cell0 Oct 29 02:35:03.723814 n-d-862964-4 devstack@n-api.service[111209]: INFO dbcounter [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Registered counter for database nova_cell1 Oct 29 02:35:03.724442 n-d-862964-4 devstack@n-api.service[111208]: INFO dbcounter [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Registered counter for database nova_cell1 Oct 29 02:35:03.731815 n-d-862964-4 devstack@n-api.service[111209]: DEBUG oslo_db.sqlalchemy.engines [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:03.733044 n-d-862964-4 devstack@n-api.service[111209]: DEBUG oslo_db.sqlalchemy.engines [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:03.734845 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_db.sqlalchemy.engines [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:03.736151 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_db.sqlalchemy.engines [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:03.739322 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writer thread running {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:03.742961 n-d-862964-4 devstack@n-api.service[111208]: DEBUG dbcounter [-] [111208] Writer thread running {{(pid=111208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:03.744427 n-d-862964-4 devstack@n-api.service[111208]: DEBUG dbcounter [-] [111208] Writer thread running {{(pid=111208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:03.745272 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writer thread running {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:03.886193 n-d-862964-4 devstack@n-api.service[111209]: INFO dbcounter [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Registered counter for database nova_cell0 Oct 29 02:35:03.887512 n-d-862964-4 devstack@n-api.service[111208]: INFO dbcounter [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Registered counter for database nova_cell0 Oct 29 02:35:03.894293 n-d-862964-4 devstack@n-api.service[111209]: DEBUG oslo_db.sqlalchemy.engines [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:03.898203 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_db.sqlalchemy.engines [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:03.900177 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writer thread running {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:03.903584 n-d-862964-4 devstack@n-api.service[111208]: DEBUG dbcounter [-] [111208] Writer thread running {{(pid=111208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:04.238103 n-d-862964-4 devstack@n-api.service[111209]: WARNING keystonemiddleware.auth_token [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:35:04.239170 n-d-862964-4 devstack@n-api.service[111208]: WARNING keystonemiddleware.auth_token [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:35:04.245398 n-d-862964-4 devstack@n-api.service[111209]: WARNING keystonemiddleware.auth_token [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:35:04.246344 n-d-862964-4 devstack@n-api.service[111208]: WARNING keystonemiddleware.auth_token [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:35:04.584030 n-d-862964-4 devstack@n-api.service[111209]: WARNING keystonemiddleware.auth_token [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:35:04.584996 n-d-862964-4 devstack@n-api.service[111208]: WARNING keystonemiddleware.auth_token [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:35:04.590185 n-d-862964-4 devstack@n-api.service[111209]: WARNING keystonemiddleware.auth_token [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:35:04.590945 n-d-862964-4 devstack@n-api.service[111208]: WARNING keystonemiddleware.auth_token [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:35:04.595572 n-d-862964-4 devstack@n-api.service[111209]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560f5abd09c0 pid: 111209 (default app) Oct 29 02:35:04.596262 n-d-862964-4 devstack@n-api.service[111208]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560f5abd09c0 pid: 111208 (default app) Oct 29 02:35:04.597647 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:35:04.598886 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-e2431cb1-95aa-4f34-b824-38fa4e4e549b None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001771 Oct 29 02:35:04.599289 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Sat Oct 29 02:35:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:26.307033 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:26.309094 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002884 Oct 29 02:36:26.315475 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:26.328597 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writing DB stats nova_api:SELECT=3 {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:26.330535 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writing DB stats nova_cell1:SELECT=3 {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:26.331732 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writing DB stats nova_cell0:SELECT=3 {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:26.332931 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:27.208644 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-3a8ecd1f-439b-48c6-b4ad-d73f942589e9 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:27.242364 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-3a8ecd1f-439b-48c6-b4ad-d73f942589e9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925069 Oct 29 02:36:27.243290 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Oct 29 02:36:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:29.845251 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:29.846278 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-550a26f0-024f-4467-85b6-61d806569bc0 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 29 02:36:29.849849 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:30.287822 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-68559a69-53e2-4545-9396-6fa54163dee8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:30.336648 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-68559a69-53e2-4545-9396-6fa54163dee8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.483440 Oct 29 02:36:30.337214 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:30.350975 n-d-862964-4 devstack@n-api.service[111208]: DEBUG dbcounter [-] [111208] Writing DB stats nova_api:SELECT=3 {{(pid=111208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:30.351786 n-d-862964-4 devstack@n-api.service[111208]: DEBUG dbcounter [-] [111208] Writing DB stats nova_cell1:SELECT=3 {{(pid=111208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:30.353757 n-d-862964-4 devstack@n-api.service[111208]: DEBUG dbcounter [-] [111208] Writing DB stats nova_cell0:SELECT=3 {{(pid=111208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:30.354507 n-d-862964-4 devstack@n-api.service[111208]: DEBUG dbcounter [-] [111208] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:30.560330 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-cd2474f1-27e8-4095-ab0b-0fe9793ec54c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:30.628854 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-cd2474f1-27e8-4095-ab0b-0fe9793ec54c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283154 Oct 29 02:36:30.629682 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Oct 29 02:36:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:33.232136 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-68559a69-53e2-4545-9396-6fa54163dee8 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:33.233157 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-68559a69-53e2-4545-9396-6fa54163dee8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 29 02:36:33.233862 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:36:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:34.041914 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-2084ae78-00c4-46cb-92a5-f43c0855fd45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:34.098097 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-2084ae78-00c4-46cb-92a5-f43c0855fd45 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.857914 Oct 29 02:36:34.099209 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:34.112203 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-af27c3f3-4d75-4547-864c-02c46c1468b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:34.170251 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-af27c3f3-4d75-4547-864c-02c46c1468b9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062401 Oct 29 02:36:34.176762 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Oct 29 02:36:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:36.930801 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-2084ae78-00c4-46cb-92a5-f43c0855fd45 admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:36.931819 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-2084ae78-00c4-46cb-92a5-f43c0855fd45 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 29 02:36:36.934249 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:36:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:37.638612 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-fb4a13bf-cc3c-49d3-95e2-352e77dbcae9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "disk": 10, "swap": 0, "vcpus": 1}} {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:37.662804 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-fb4a13bf-cc3c-49d3-95e2-352e77dbcae9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.724143 Oct 29 02:36:37.663858 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:37.678430 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-e38fa489-5a14-43a0-9b17-e1ac71bf76b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:37.722289 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-e38fa489-5a14-43a0-9b17-e1ac71bf76b5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047110 Oct 29 02:36:37.723735 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Oct 29 02:36:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:36:40.334083 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-fb4a13bf-cc3c-49d3-95e2-352e77dbcae9 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:40.335669 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-fb4a13bf-cc3c-49d3-95e2-352e77dbcae9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Oct 29 02:36:40.336071 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:36:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:40.788626 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-de192b90-32ee-47f0-8780-5d468bf46e50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:40.813794 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-de192b90-32ee-47f0-8780-5d468bf46e50 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471202 Oct 29 02:36:40.814675 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:40.827922 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-2c06a492-eed7-481d-810d-7694206b104c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:40.859745 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-2c06a492-eed7-481d-810d-7694206b104c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036436 Oct 29 02:36:40.860411 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Oct 29 02:36:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:43.550812 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-de192b90-32ee-47f0-8780-5d468bf46e50 admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:43.552604 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-de192b90-32ee-47f0-8780-5d468bf46e50 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002227 Oct 29 02:36:43.565386 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:36:43 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:44.027448 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-5cce744c-7db4-4750-90a4-1b277752b7f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "vcpus": 4, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:44.049740 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-5cce744c-7db4-4750-90a4-1b277752b7f1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489759 Oct 29 02:36:44.050644 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:44.063356 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-078509ce-c85a-4aaf-9dab-13f69fee6ac4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:44.088854 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-078509ce-c85a-4aaf-9dab-13f69fee6ac4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029236 Oct 29 02:36:44.094168 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Oct 29 02:36:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:46.754073 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-5cce744c-7db4-4750-90a4-1b277752b7f1 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:46.754933 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-5cce744c-7db4-4750-90a4-1b277752b7f1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001854 Oct 29 02:36:46.755747 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:36:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:47.214201 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-26b3ad3c-3bc2-4e20-91ec-4f706c4d45ee admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:47.239999 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-26b3ad3c-3bc2-4e20-91ec-4f706c4d45ee admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.476738 Oct 29 02:36:47.240558 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Oct 29 02:36:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:36:50.066857 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-5cce744c-7db4-4750-90a4-1b277752b7f1 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:50.067979 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-5cce744c-7db4-4750-90a4-1b277752b7f1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Oct 29 02:36:50.068504 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:36:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:50.481117 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-b8b7aca8-e95f-4468-9c9d-fdcfdee1c076 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "id": "1", "ram": 512, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:50.504321 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-b8b7aca8-e95f-4468-9c9d-fdcfdee1c076 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.429019 Oct 29 02:36:50.504913 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:50.517110 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-d7e872c1-ce27-4432-9d75-dddb9810cd68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:50.547807 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-d7e872c1-ce27-4432-9d75-dddb9810cd68 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034329 Oct 29 02:36:50.548459 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Oct 29 02:36:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:53.421545 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-b8b7aca8-e95f-4468-9c9d-fdcfdee1c076 admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:53.422831 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-b8b7aca8-e95f-4468-9c9d-fdcfdee1c076 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 Oct 29 02:36:53.423248 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:36:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:53.862520 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-5ae06ece-103a-465a-949b-bf6c34a54ffd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20}} {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:53.882833 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-5ae06ece-103a-465a-949b-bf6c34a54ffd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453171 Oct 29 02:36:53.883390 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:53.895695 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-7a68e477-ea78-4de1-b810-7bce8147d948 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:53.920975 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-7a68e477-ea78-4de1-b810-7bce8147d948 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028825 Oct 29 02:36:53.921881 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Oct 29 02:36:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:36:56.873524 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-5ae06ece-103a-465a-949b-bf6c34a54ffd admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:56.874753 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-5ae06ece-103a-465a-949b-bf6c34a54ffd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Oct 29 02:36:56.875254 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:36:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:57.282310 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-83e437da-a1e1-441c-9158-659bc3fa786b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "vcpus": 2, "disk": 40}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:57.303398 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-83e437da-a1e1-441c-9158-659bc3fa786b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.421726 Oct 29 02:36:57.303942 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:57.316164 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-cedc97dd-544c-434e-8ed1-ceb193e306ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:57.321044 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:57.348241 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-cedc97dd-544c-434e-8ed1-ceb193e306ac admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035860 Oct 29 02:36:57.348828 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Oct 29 02:36:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:59.922180 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-83e437da-a1e1-441c-9158-659bc3fa786b admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:59.923188 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-83e437da-a1e1-441c-9158-659bc3fa786b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 29 02:36:59.923551 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:36:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:00.345359 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-91bee301-9b9d-4585-9ad8-28962a4c415b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:00.365548 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-91bee301-9b9d-4585-9ad8-28962a4c415b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.435699 Oct 29 02:37:00.366115 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:37:00.378881 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-ee6b550c-9ade-4b1c-aca8-eedb474266ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:00.403438 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-ee6b550c-9ade-4b1c-aca8-eedb474266ce admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028420 Oct 29 02:37:00.404037 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Oct 29 02:37:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:37:03.028098 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-91bee301-9b9d-4585-9ad8-28962a4c415b admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:03.029040 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-91bee301-9b9d-4585-9ad8-28962a4c415b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 29 02:37:03.029707 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:37:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:03.463433 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-f522a3d7-ee06-4a04-b3f7-0c860e4531eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:03.471244 n-d-862964-4 devstack@n-api.service[111208]: DEBUG dbcounter [-] [111208] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:03.486632 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-f522a3d7-ee06-4a04-b3f7-0c860e4531eb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.450899 Oct 29 02:37:03.487183 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Oct 29 02:37:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:37:03.499890 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-90a15547-4637-4d53-8ca6-3d594b728098 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:03.526197 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-90a15547-4637-4d53-8ca6-3d594b728098 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030433 Oct 29 02:37:03.526910 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Oct 29 02:37:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:37:27.335322 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-f522a3d7-ee06-4a04-b3f7-0c860e4531eb admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:27.336282 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-f522a3d7-ee06-4a04-b3f7-0c860e4531eb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002157 Oct 29 02:37:27.336680 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:27.347457 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:27.757235 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-42c81060-af88-4d11-85f5-e8b5f8e1e060 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:27.775571 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-42c81060-af88-4d11-85f5-e8b5f8e1e060 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.432587 Oct 29 02:37:27.776145 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Oct 29 02:37:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:29.098414 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-f522a3d7-ee06-4a04-b3f7-0c860e4531eb admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:29.099422 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-f522a3d7-ee06-4a04-b3f7-0c860e4531eb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Oct 29 02:37:29.099832 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:29.650048 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-7d7d6eb5-c9ec-4c98-bb90-6886b75570b0 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:29.655425 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.wsgi [None req-7d7d6eb5-c9ec-4c98-bb90-6886b75570b0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-7d7d6eb5-c9ec-4c98-bb90-6886b75570b0 admin admin] Request method failure captured: Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: Accept: application/json Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: Accept-Encoding: gzip, deflate Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: Connection: keep-alive Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: Content-Length: 0 Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: Host: 10.222.0.16 Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: Openstack-System-Scope: None Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: User-Agent: python-novaclient Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Auth-Token: gAAAAABjXJHoAB5QCwbKyC7JYsvHzFlWL66A--UJQIHpKzCmFlaVDoPW_uTCLwtztUx-cBrQ14jezhpX052VINDshjhcqbdmbxkz00nHGDqldfCziNkugZdoshLvtMkfTbZ4qO7vSiYfXff8Yay4bflJS5RjFuyVXHWA5LM7MytrJ15VwUqePCA Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Domain-Id: None Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Domain-Name: None Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Identity-Status: Confirmed Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Is-Admin-Project: True Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Domain-Id: default Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Domain-Name: Default Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Name: admin Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Role: member,reader,admin Oct 29 02:37:29.658708 n-d-862964-4 devstack@n-api.service[111209]: X-Roles: member,reader,admin Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/78e88c459a88409388afe930208caca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_78e88c459a88409388afe930208caca8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}] Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: X-Tenant: admin Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: X-Tenant-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: X-Tenant-Name: admin Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: X-User: admin Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: X-User-Domain-Id: default Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: X-User-Domain-Name: Default Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: X-User-Id: 16efc903cbf0459289b5f4c2d93cddb0 Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: X-User-Name: admin Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: method: > Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: exception: Flavor 42 could not be found. Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: action_args: {'id': '42'} Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:29.660339 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:29.661367 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:29.663410 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-7d7d6eb5-c9ec-4c98-bb90-6886b75570b0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:29.665453 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-7d7d6eb5-c9ec-4c98-bb90-6886b75570b0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.416407 Oct 29 02:37:29.665453 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Oct 29 02:37:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:29.669831 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-f6c2ef2d-0f72-4d80-9e70-9b776b3f7702 admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:29.693147 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-f6c2ef2d-0f72-4d80-9e70-9b776b3f7702 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026897 Oct 29 02:37:29.693696 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:29.710090 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-b09939ac-7de3-4783-b67d-ce5e27ba7929 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:29.732124 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-b09939ac-7de3-4783-b67d-ce5e27ba7929 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026926 Oct 29 02:37:29.732650 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:29.742427 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-94b4d8f6-c0b6-4b8a-a1be-9ff7ad1ad927 admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:29.747796 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.wsgi [None req-94b4d8f6-c0b6-4b8a-a1be-9ff7ad1ad927 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-94b4d8f6-c0b6-4b8a-a1be-9ff7ad1ad927 admin admin] Request method failure captured: Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: Accept: application/json Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: Accept-Encoding: gzip, deflate Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: Connection: keep-alive Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: Content-Length: 0 Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: Host: 10.222.0.16 Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: Openstack-System-Scope: None Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: User-Agent: python-novaclient Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Auth-Token: gAAAAABjXJHoAB5QCwbKyC7JYsvHzFlWL66A--UJQIHpKzCmFlaVDoPW_uTCLwtztUx-cBrQ14jezhpX052VINDshjhcqbdmbxkz00nHGDqldfCziNkugZdoshLvtMkfTbZ4qO7vSiYfXff8Yay4bflJS5RjFuyVXHWA5LM7MytrJ15VwUqePCA Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Domain-Id: None Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Domain-Name: None Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Identity-Status: Confirmed Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Is-Admin-Project: True Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Domain-Id: default Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Domain-Name: Default Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Name: admin Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Role: member,reader,admin Oct 29 02:37:29.751394 n-d-862964-4 devstack@n-api.service[111208]: X-Roles: member,reader,admin Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/78e88c459a88409388afe930208caca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_78e88c459a88409388afe930208caca8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}] Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: X-Tenant: admin Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: X-Tenant-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: X-Tenant-Name: admin Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: X-User: admin Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: X-User-Domain-Id: default Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: X-User-Domain-Name: Default Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: X-User-Id: 16efc903cbf0459289b5f4c2d93cddb0 Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: X-User-Name: admin Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: method: > Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: exception: Flavor 42 could not be found. Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: action_args: {'id': '42'} Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:29.752773 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:29.753570 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:29.754888 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-94b4d8f6-c0b6-4b8a-a1be-9ff7ad1ad927 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:29.756083 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-94b4d8f6-c0b6-4b8a-a1be-9ff7ad1ad927 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014295 Oct 29 02:37:29.756083 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Oct 29 02:37:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 29 02:37:30.955811 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-b09939ac-7de3-4783-b67d-ce5e27ba7929 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:30.956813 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-b09939ac-7de3-4783-b67d-ce5e27ba7929 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 29 02:37:30.957203 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:31.509690 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-2a914931-9676-4ed6-9287-afadf04581f7 admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:31.515017 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.wsgi [None req-2a914931-9676-4ed6-9287-afadf04581f7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-2a914931-9676-4ed6-9287-afadf04581f7 admin admin] Request method failure captured: Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: Accept: application/json Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: Accept-Encoding: gzip, deflate Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: Connection: keep-alive Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: Content-Length: 0 Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: Host: 10.222.0.16 Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: Openstack-System-Scope: None Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: User-Agent: python-novaclient Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Auth-Token: gAAAAABjXJHqzoB9leWY31SvLEiGLkOWdiWYPM5eEnb7EPk6i6cP4wq4X1MPJ0AMiU8BJSu24tEtN9NZZ5Z9MYuFnoBd9Le4A-3Pe7NIRWZkqWw8g7BoxqwQ1HkSrLIx0FRhCG665tG7v9L4GB57H8CzENW_zmG-7gWcxO2LRY7l9ZGi53TnQ4s Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Domain-Id: None Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Domain-Name: None Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Identity-Status: Confirmed Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Is-Admin-Project: True Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Domain-Id: default Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Domain-Name: Default Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Name: admin Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Role: member,reader,admin Oct 29 02:37:31.516520 n-d-862964-4 devstack@n-api.service[111208]: X-Roles: member,reader,admin Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/78e88c459a88409388afe930208caca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_78e88c459a88409388afe930208caca8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}] Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: X-Tenant: admin Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: X-Tenant-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: X-Tenant-Name: admin Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: X-User: admin Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: X-User-Domain-Id: default Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: X-User-Domain-Name: Default Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: X-User-Id: 16efc903cbf0459289b5f4c2d93cddb0 Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: X-User-Name: admin Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: method: > Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: exception: Flavor 84 could not be found. Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: action_args: {'id': '84'} Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:31.518035 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:31.518983 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:31.520272 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-2a914931-9676-4ed6-9287-afadf04581f7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:31.521476 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-2a914931-9676-4ed6-9287-afadf04581f7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.425406 Oct 29 02:37:31.521476 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Oct 29 02:37:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:31.527841 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-e594b17b-d917-4f66-90b6-4dac0312f78b admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:31.542864 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-e594b17b-d917-4f66-90b6-4dac0312f78b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018625 Oct 29 02:37:31.543391 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:31.553075 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-d6215b3f-871c-4588-83ba-5b23b018833b admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:31.568867 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-d6215b3f-871c-4588-83ba-5b23b018833b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019347 Oct 29 02:37:31.569619 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:31.581556 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-2158fece-761b-4ca7-848a-0f0c946f3eaf admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:31.589591 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.wsgi [None req-2158fece-761b-4ca7-848a-0f0c946f3eaf admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-2158fece-761b-4ca7-848a-0f0c946f3eaf admin admin] Request method failure captured: Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: Accept: application/json Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: Accept-Encoding: gzip, deflate Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: Connection: keep-alive Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: Content-Length: 0 Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: Host: 10.222.0.16 Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: Openstack-System-Scope: None Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: User-Agent: python-novaclient Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Auth-Token: gAAAAABjXJHqzoB9leWY31SvLEiGLkOWdiWYPM5eEnb7EPk6i6cP4wq4X1MPJ0AMiU8BJSu24tEtN9NZZ5Z9MYuFnoBd9Le4A-3Pe7NIRWZkqWw8g7BoxqwQ1HkSrLIx0FRhCG665tG7v9L4GB57H8CzENW_zmG-7gWcxO2LRY7l9ZGi53TnQ4s Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Domain-Id: None Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Domain-Name: None Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Identity-Status: Confirmed Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Is-Admin-Project: True Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Domain-Id: default Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Domain-Name: Default Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Name: admin Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Role: member,reader,admin Oct 29 02:37:31.592089 n-d-862964-4 devstack@n-api.service[111209]: X-Roles: member,reader,admin Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/78e88c459a88409388afe930208caca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_78e88c459a88409388afe930208caca8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}] Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: X-Tenant: admin Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: X-Tenant-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: X-Tenant-Name: admin Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: X-User: admin Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: X-User-Domain-Id: default Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: X-User-Domain-Name: Default Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: X-User-Id: 16efc903cbf0459289b5f4c2d93cddb0 Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: X-User-Name: admin Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: method: > Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: exception: Flavor 84 could not be found. Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: action_args: {'id': '84'} Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:31.594026 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:31.595107 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:31.597936 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-2158fece-761b-4ca7-848a-0f0c946f3eaf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:31.599175 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-2158fece-761b-4ca7-848a-0f0c946f3eaf admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.017751 Oct 29 02:37:31.599175 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Oct 29 02:37:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:32.810879 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-d6215b3f-871c-4588-83ba-5b23b018833b admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:32.811901 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-d6215b3f-871c-4588-83ba-5b23b018833b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 29 02:37:32.812288 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:33.394040 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-10454871-65bd-410e-ae59-4e8c47af7572 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:33.400327 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.wsgi [None req-10454871-65bd-410e-ae59-4e8c47af7572 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-10454871-65bd-410e-ae59-4e8c47af7572 admin admin] Request method failure captured: Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: Accept: application/json Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: Accept-Encoding: gzip, deflate Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: Connection: keep-alive Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: Content-Length: 0 Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: Host: 10.222.0.16 Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: Openstack-System-Scope: None Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: User-Agent: python-novaclient Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Auth-Token: gAAAAABjXJHsNesvMyhXl-b-EyVuAIwAUFBNa_Hre_fJmW1bOU8PT3ykqy6ljqeB4thv4P1ISDPb8ycHdadr9jJpzOckqHJb2GIIqCnNOt4DM-tivQidClYBU4pVPGxv7feaYYxCCbj-6vOxNUgb3gjMRQae1rKxRyHImKWJ3iJozpKaptYcAg4 Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Domain-Id: None Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Domain-Name: None Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Identity-Status: Confirmed Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Is-Admin-Project: True Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Domain-Id: default Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Domain-Name: Default Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Project-Name: admin Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Role: member,reader,admin Oct 29 02:37:33.401827 n-d-862964-4 devstack@n-api.service[111209]: X-Roles: member,reader,admin Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/78e88c459a88409388afe930208caca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_78e88c459a88409388afe930208caca8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}] Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: X-Tenant: admin Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: X-Tenant-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: X-Tenant-Name: admin Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: X-User: admin Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: X-User-Domain-Id: default Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: X-User-Domain-Name: Default Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: X-User-Id: 16efc903cbf0459289b5f4c2d93cddb0 Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: X-User-Name: admin Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: method: > Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: exception: Flavor 451 could not be found. Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: action_args: {'id': '451'} Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:33.403262 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:33.404323 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: ERROR nova.api.openstack.wsgi Oct 29 02:37:33.406099 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-10454871-65bd-410e-ae59-4e8c47af7572 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:33.407741 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-10454871-65bd-410e-ae59-4e8c47af7572 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.456361 Oct 29 02:37:33.407741 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Oct 29 02:37:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 458 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:33.418605 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-95d802ec-909a-4b1e-8b76-39493e15a6de admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:33.437056 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-95d802ec-909a-4b1e-8b76-39493e15a6de admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.024588 Oct 29 02:37:33.437592 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:33.447029 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:33.462099 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018617 Oct 29 02:37:33.462624 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:33.471793 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-35cff383-dd37-44d4-bb60-7f746c68c72f admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:33.476865 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.wsgi [None req-35cff383-dd37-44d4-bb60-7f746c68c72f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-35cff383-dd37-44d4-bb60-7f746c68c72f admin admin] Request method failure captured: Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: Accept: application/json Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: Accept-Encoding: gzip, deflate Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: Connection: keep-alive Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: Content-Length: 0 Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: Host: 10.222.0.16 Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: Openstack-System-Scope: None Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: User-Agent: python-novaclient Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Auth-Token: gAAAAABjXJHsNesvMyhXl-b-EyVuAIwAUFBNa_Hre_fJmW1bOU8PT3ykqy6ljqeB4thv4P1ISDPb8ycHdadr9jJpzOckqHJb2GIIqCnNOt4DM-tivQidClYBU4pVPGxv7feaYYxCCbj-6vOxNUgb3gjMRQae1rKxRyHImKWJ3iJozpKaptYcAg4 Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Domain-Id: None Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Domain-Name: None Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Identity-Status: Confirmed Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Is-Admin-Project: True Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Domain-Id: default Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Domain-Name: Default Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Project-Name: admin Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Role: member,reader,admin Oct 29 02:37:33.478404 n-d-862964-4 devstack@n-api.service[111208]: X-Roles: member,reader,admin Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/78e88c459a88409388afe930208caca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_78e88c459a88409388afe930208caca8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78e88c459a88409388afe930208caca8"}]}] Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: X-Tenant: admin Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: X-Tenant-Id: 78e88c459a88409388afe930208caca8 Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: X-Tenant-Name: admin Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: X-User: admin Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: X-User-Domain-Id: default Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: X-User-Domain-Name: Default Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: X-User-Id: 16efc903cbf0459289b5f4c2d93cddb0 Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: X-User-Name: admin Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: method: > Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: exception: Flavor 451 could not be found. Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: action_args: {'id': '451'} Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:33.479826 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:33.480603 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: ERROR nova.api.openstack.wsgi Oct 29 02:37:33.481622 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-35cff383-dd37-44d4-bb60-7f746c68c72f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:33.482715 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-35cff383-dd37-44d4-bb60-7f746c68c72f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011484 Oct 29 02:37:33.482715 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Oct 29 02:37:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:34.688966 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:34.690042 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 29 02:37:34.690413 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:35.250048 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-4063f00a-cde6-4aca-a1a2-1cab6043b049 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:35.272909 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-4063f00a-cde6-4aca-a1a2-1cab6043b049 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.447832 Oct 29 02:37:35.273482 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Oct 29 02:37:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:37:36.497502 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:36.498937 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001840 Oct 29 02:37:36.499335 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:37.052030 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-de6fb3bd-333a-4102-968a-75a93abdf8f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:37.076490 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-de6fb3bd-333a-4102-968a-75a93abdf8f1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.437822 Oct 29 02:37:37.077225 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Oct 29 02:37:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:37:38.292626 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:38.293633 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 29 02:37:38.294060 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:38.833468 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-ba485eb0-7b86-400a-b260-fdc91d75fe75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:38.853334 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-ba485eb0-7b86-400a-b260-fdc91d75fe75 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.423037 Oct 29 02:37:38.853887 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Oct 29 02:37:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:37:40.069084 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:40.070606 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002216 Oct 29 02:37:40.071154 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:40.629970 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-3d801cb3-990d-43a0-9203-8029168aba2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:40.650278 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-3d801cb3-990d-43a0-9203-8029168aba2d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.441669 Oct 29 02:37:40.650812 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Oct 29 02:37:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:37:41.859098 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:41.860424 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001821 Oct 29 02:37:41.860829 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:42.417171 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-846cc4a3-9959-4d8d-ab2e-89b913d57cd0 admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:42.437412 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-846cc4a3-9959-4d8d-ab2e-89b913d57cd0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.439318 Oct 29 02:37:42.437963 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Sat Oct 29 02:37:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:38:39.037853 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:39.039063 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-a09a11ae-6a99-469f-9da4-c83793c0bdaf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002364 Oct 29 02:38:39.039677 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 931 bytes} [Sat Oct 29 02:38:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:38:39.057422 n-d-862964-4 devstack@n-api.service[111208]: DEBUG dbcounter [-] [111208] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:39.468722 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-7c340206-3b55-41e6-9f28-f4add0c9b2f7 admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:39.489282 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-7c340206-3b55-41e6-9f28-f4add0c9b2f7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.439721 Oct 29 02:38:39.490013 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Oct 29 02:38:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:38:39.524609 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writing DB stats nova_api:SELECT=14 {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:39.528453 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-e10bba74-a73c-4782-8f18-c878abf9f97b admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:39.535954 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-e10bba74-a73c-4782-8f18-c878abf9f97b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012833 Oct 29 02:38:39.536539 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1283 bytes} [Sat Oct 29 02:38:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:38:39.549932 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-3e60261d-338d-4e68-a0d3-fbf0e6f21b3f admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:39.558382 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-3e60261d-338d-4e68-a0d3-fbf0e6f21b3f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013109 Oct 29 02:38:39.558953 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1286 bytes} [Sat Oct 29 02:38:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:38:39.571065 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-91fac3e0-5fca-4247-935b-de2d1bb43566 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:39.578806 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-91fac3e0-5fca-4247-935b-de2d1bb43566 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011455 Oct 29 02:38:39.579331 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1286 bytes} [Sat Oct 29 02:38:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:38:39.591388 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-8082c095-e601-43a7-b378-f9cc5a66eb07 admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:39.600534 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-8082c095-e601-43a7-b378-f9cc5a66eb07 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012481 Oct 29 02:38:39.601390 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1283 bytes} [Sat Oct 29 02:38:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:43:48.930380 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-91fac3e0-5fca-4247-935b-de2d1bb43566 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:43:48.931372 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-91fac3e0-5fca-4247-935b-de2d1bb43566 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 29 02:43:48.931802 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Oct 29 02:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:43:49.076666 n-d-862964-4 devstack@n-api.service[111208]: DEBUG dbcounter [-] [111208] Writing DB stats nova_api:SELECT=6 {{(pid=111208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:43:49.236522 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-455bdea3-7944-4eb2-bf73-e66da1ced789 admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:43:49.241580 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-455bdea3-7944-4eb2-bf73-e66da1ced789 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:43:49.242075 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-455bdea3-7944-4eb2-bf73-e66da1ced789 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:43:49.242494 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-455bdea3-7944-4eb2-bf73-e66da1ced789 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:43:49.243199 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-455bdea3-7944-4eb2-bf73-e66da1ced789 admin admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:43:49.243633 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-455bdea3-7944-4eb2-bf73-e66da1ced789 admin admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:43:49.244040 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-455bdea3-7944-4eb2-bf73-e66da1ced789 admin admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:43:49.282690 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-455bdea3-7944-4eb2-bf73-e66da1ced789 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.208108 Oct 29 02:43:49.283253 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Oct 29 02:43:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:43:50.337006 n-d-862964-4 devstack@n-api.service[111209]: DEBUG nova.api.openstack.wsgi [None req-91fac3e0-5fca-4247-935b-de2d1bb43566 admin admin] Calling method '>' {{(pid=111209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:43:50.338055 n-d-862964-4 devstack@n-api.service[111209]: INFO nova.api.openstack.requestlog [None req-91fac3e0-5fca-4247-935b-de2d1bb43566 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 29 02:43:50.338453 n-d-862964-4 devstack@n-api.service[111209]: [pid: 111209|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Oct 29 02:43:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:43:50.543577 n-d-862964-4 devstack@n-api.service[111208]: DEBUG nova.api.openstack.wsgi [None req-1dbd77b6-218d-4759-b3fb-57b5f469f61b admin admin] Calling method '>' {{(pid=111208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:43:50.546918 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-1dbd77b6-218d-4759-b3fb-57b5f469f61b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:43:50.547385 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-1dbd77b6-218d-4759-b3fb-57b5f469f61b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:43:50.547796 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-1dbd77b6-218d-4759-b3fb-57b5f469f61b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:43:50.548486 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-1dbd77b6-218d-4759-b3fb-57b5f469f61b admin admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:43:50.549276 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-1dbd77b6-218d-4759-b3fb-57b5f469f61b admin admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:43:50.549681 n-d-862964-4 devstack@n-api.service[111208]: DEBUG oslo_concurrency.lockutils [None req-1dbd77b6-218d-4759-b3fb-57b5f469f61b admin admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=111208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:43:50.572928 n-d-862964-4 devstack@n-api.service[111208]: INFO nova.api.openstack.requestlog [None req-1dbd77b6-218d-4759-b3fb-57b5f469f61b admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.097250 Oct 29 02:43:50.573499 n-d-862964-4 devstack@n-api.service[111208]: [pid: 111208|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Oct 29 02:43:50 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:44:39.729041 n-d-862964-4 devstack@n-api.service[111207]: Sat Oct 29 02:44:39 2022 - graceful shutdown triggered... Oct 29 02:44:39.728521 n-d-862964-4 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 29 02:44:39.730126 n-d-862964-4 devstack@n-api.service[111208]: Gracefully killing worker 1 (pid: 111208)... Oct 29 02:44:39.730617 n-d-862964-4 devstack@n-api.service[111209]: Gracefully killing worker 2 (pid: 111209)... Oct 29 02:44:39.858974 n-d-862964-4 devstack@n-api.service[111209]: DEBUG dbcounter [-] [111209] Writing DB stats nova_api:SELECT=4 {{(pid=111209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:44:40.729660 n-d-862964-4 devstack@n-api.service[111207]: worker 1 buried after 1 seconds Oct 29 02:44:40.729660 n-d-862964-4 devstack@n-api.service[111207]: worker 2 buried after 1 seconds Oct 29 02:44:40.729660 n-d-862964-4 devstack@n-api.service[111207]: goodbye to uWSGI. Oct 29 02:44:40.732248 n-d-862964-4 systemd[1]: devstack@n-api.service: Succeeded. Oct 29 02:44:40.733214 n-d-862964-4 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 29 02:44:40.737490 n-d-862964-4 systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 02:44:40.752963 n-d-862964-4 devstack@n-api.service[127031]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 29 02:44:40 2022] *** Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: nodename: n-d-862964-4 Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: machine: x86_64 Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: clock source: unix Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: pcre jit disabled Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: detected number of CPU cores: 4 Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: current working directory: / Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: detected binary path: /usr/bin/uwsgi-core Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: your processes number limit is 47680 Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: your memory page size is 4096 bytes Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: detected max file descriptor number: 2048 Oct 29 02:44:40.773379 n-d-862964-4 devstack@n-api.service[127031]: lock engine: pthread robust mutexes Oct 29 02:44:40.774678 n-d-862964-4 devstack@n-api.service[127031]: thunder lock: enabled Oct 29 02:44:40.774678 n-d-862964-4 devstack@n-api.service[127031]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 02:44:40.774678 n-d-862964-4 devstack@n-api.service[127031]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 29 02:44:40.814099 n-d-862964-4 devstack@n-api.service[127031]: Python main interpreter initialized at 0x55eb66e1f9c0 Oct 29 02:44:40.814099 n-d-862964-4 devstack@n-api.service[127031]: python threads support enabled Oct 29 02:44:40.814099 n-d-862964-4 devstack@n-api.service[127031]: your server socket listen backlog is limited to 100 connections Oct 29 02:44:40.814099 n-d-862964-4 devstack@n-api.service[127031]: your mercy for graceful operations on workers is 90 seconds Oct 29 02:44:40.814518 n-d-862964-4 devstack@n-api.service[127031]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 02:44:40.814518 n-d-862964-4 devstack@n-api.service[127031]: *** Operational MODE: preforking *** Oct 29 02:44:40.815276 n-d-862964-4 devstack@n-api.service[127031]: *** uWSGI is running in multiple interpreter mode *** Oct 29 02:44:40.815276 n-d-862964-4 devstack@n-api.service[127031]: spawned uWSGI master process (pid: 127031) Oct 29 02:44:40.814935 n-d-862964-4 systemd[1]: Started Devstack devstack@n-api.service. Oct 29 02:44:40.816523 n-d-862964-4 devstack@n-api.service[127031]: spawned uWSGI worker 1 (pid: 127041, cores: 1) Oct 29 02:44:40.816523 n-d-862964-4 devstack@n-api.service[127031]: spawned uWSGI worker 2 (pid: 127042, cores: 1) Oct 29 02:44:40.816523 n-d-862964-4 devstack@n-api.service[127031]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 02:44:41.478888 n-d-862964-4 devstack@n-api.service[127041]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 02:44:41.479458 n-d-862964-4 devstack@n-api.service[127042]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 02:44:42.724132 n-d-862964-4 devstack@n-api.service[127041]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:44:42.724132 n-d-862964-4 devstack@n-api.service[127041]: from cryptography.utils import int_from_bytes Oct 29 02:44:42.724638 n-d-862964-4 devstack@n-api.service[127041]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:44:42.724638 n-d-862964-4 devstack@n-api.service[127041]: from cryptography.utils import int_from_bytes Oct 29 02:44:42.727133 n-d-862964-4 devstack@n-api.service[127042]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:44:42.727133 n-d-862964-4 devstack@n-api.service[127042]: from cryptography.utils import int_from_bytes Oct 29 02:44:42.727581 n-d-862964-4 devstack@n-api.service[127042]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:44:42.727581 n-d-862964-4 devstack@n-api.service[127042]: from cryptography.utils import int_from_bytes Oct 29 02:44:45.164093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 02:44:45.164742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 02:44:45.164742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 02:44:45.165110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 02:44:45.165369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 02:44:45.165762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.166116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.166436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.166762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.167089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.167401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.167716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.168043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.168193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 02:44:45.168569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.168656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 02:44:45.168792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.168941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 02:44:45.169074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.169286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862964-4 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.169413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 02:44:45.169708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.169883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 02:44:45.170012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.170309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.170455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.170589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.170714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.170843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.170977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.171125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.171266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.171402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.171536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.171677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.171891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.172039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.172231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.172339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.172529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.172645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.172800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.172953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.173098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.173271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.173409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862964-4 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.173603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.173848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.174021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.174158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.174312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.174469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.174604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.174766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.174913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.175029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.175182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.175300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.175529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862964-4 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.175689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.175826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.176044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.176193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.176346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.176543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.176746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.176931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.177125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.177317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.177490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.177641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.177861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.178031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.178173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.178339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.178464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.178613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.178749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.178962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.179110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.179244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.179406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.179540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.179666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862964-4 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.179828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.179967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.180099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.180229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.180359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.180489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.180603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.180754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.180854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.181022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.181176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.181295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.181410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.181585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.181719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.181918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.182103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.182197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.182296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.182518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.182631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.182856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.183015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.183110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.183209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.183341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.183465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.183624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.183719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.183942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.184038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.184248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.184340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.184554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.184717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.184945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.185101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.185335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.185439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.185630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.185731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.185960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.186055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.186267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.186358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.186575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.186685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.186891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.186992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.187137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.187236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.187382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.187489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.187696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.187814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.188014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.188118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.188318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.188484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.188625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.188725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.188912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.189026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.189220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.189346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.189523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.189641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.189843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.189986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.190132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.190259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.190436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.190564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.190765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.190906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.191060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.191186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.191376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.191510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.191680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.191825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.191993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.192127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.192317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.192445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.192592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.192811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.192951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.193086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.193211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.193334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.193467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.193600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.193732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.193966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.194106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.194246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.194374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.194521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.194653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.194802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.194931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.195102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.195250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.195405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.195533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.195720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.195845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.196048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.196259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.196385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.196507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.196637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.196766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.196896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.197028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.197153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.197282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.197445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.197580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.197747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.197917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.198076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.198209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.198381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.198513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.198680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.198816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.198985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.199112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.199287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.199415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.199587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.199700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.199888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.200005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.200187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.200285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.200543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.200658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.200843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.201044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.201186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.201362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.201499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.201686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.201866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.202009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.202135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.202315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.202443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.202628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.202758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.202986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.203130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.203256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.203387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.203510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.203640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.203801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.203928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.204104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.204245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.204405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.204531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.204710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.204835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.205010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.205144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.205321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.205482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.205607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.205729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.205918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.206048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.206218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.206354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.206528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.206661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.206825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.206953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.207126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.207251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.207430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.207562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.207730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.207855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.208030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.208158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.208328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.208463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.208626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.208759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.208924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.209050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.209220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.209375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.209570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.209705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.209865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.210032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.210159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.210297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.210435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.210569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.210727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.210885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.211021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.211212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.211339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.211532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.211666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.211846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.211990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:45.212159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.212286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.212480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.212613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.212799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.212934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.213151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.213278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.213432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.213566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.213749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.213919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.214089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.214218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.214396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.214542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.214705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.214831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.215027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.215156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.215339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.215467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.215647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.215781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.216044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.216214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.216420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.216552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.216744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.216902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.217068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.217199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.217382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.217519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.217696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.217878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.218037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.218166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.218349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.218475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.218662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.218797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.218985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.219112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.219296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.219422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.219605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.219726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.219916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.220027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.220238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.220339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.220551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.220653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.220862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.220974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.221171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.221285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.221481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.221628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.221788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.221948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.222118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.222245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.222439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.222565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.222751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.222877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.223063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.223200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.223418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.223555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.223683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.223816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.223977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.224112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.224281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.224418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.224589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.224722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.224895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.225034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.225197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.225322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.225501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.225641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.225856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.226003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.226129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.226264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.226449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.226575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.226758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.226897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.227067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.227205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.227381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.227507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.227688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.227824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.227996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.228126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.228303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.228433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.228604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.228740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.228907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.229040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.229206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.229345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.229513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.229640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.229866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.229995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.230175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.230311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.230456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.230589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.230738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.230873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.231062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.231199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.231463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.231637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.231810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.231947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.232079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.232213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.232348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.232479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.232611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.232734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.232888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.233025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.233198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.233332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.233626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.233761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.233910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.234049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.234181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.234315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.234439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.234568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.234700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.234837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.235005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.235140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.235307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.235436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.235622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.235750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.235932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.236067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.236238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.236372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.236548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.236683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.236858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.236985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.237177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.237312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.237480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.237606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.237786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.237933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.238113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.238258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.238421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.238553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.238728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.238868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.239034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.239186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.239339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.239475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.239651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.239788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.240002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.240140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.240309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.240447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.240579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.240711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.240841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.240982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.241107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.241235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.241403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.241548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.241706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.241867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.242034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.242162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.242339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.242476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.242640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.242776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.242942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.243069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.243264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.243400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.243574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.243702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.243876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.243988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.244178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.244292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.244478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.244580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.244818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.244928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.245123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.245555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.245766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.245910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.246099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.246193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.246427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.246529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.246739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.246829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.247046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.247135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.247409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.247562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.247728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.247899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.248068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.248204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.248402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.248545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.248721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.248853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.249044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.249171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.249358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.249498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.249676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.249796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.250015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.250140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.250314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.250403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.250625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.250726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.250936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.251038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.251255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.251364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.251560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.251656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.251864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.251961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.252175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.252284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.252496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.252603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.252804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.252904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.253112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.253210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.253416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.253522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.253724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.253854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.254065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.254163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.254370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.254471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.254675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.254777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.254989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.255089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.255294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.255387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.255607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.255708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.255911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.256010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.256223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.256326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.256528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.256628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.256830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.256930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.257131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.257235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.257442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.257562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.257753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.257882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.258089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.258200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.258394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.258490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.258702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.258807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.259006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.259097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.259313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.259406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.259619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.259719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.259926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.260023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.260227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.260328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.260531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.260622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.260840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.260930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.261152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.261244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.261455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.261554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.261760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.261885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.262089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.262182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.262399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.262491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.262700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.262799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.263055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.263303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.263402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.263621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.263713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.263961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.264058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.264269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.264359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.264575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.264665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.264889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.264980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.265194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.265286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.265514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.265618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.265902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.266060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.266434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.266523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.266523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.266687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.266773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.266864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.266999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.267088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.267338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.267440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.267646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.267734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.267957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.268063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.268269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.268436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.268579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.268766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.268917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.269075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.269182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.269412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.269518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.269704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.269859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.270091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.270216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.270372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.270462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.270688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.270780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.271001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.271274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.271363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.271609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.271708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.271987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.272170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.272269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.272355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.272645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.272749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.272957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.273076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.273285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.273374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.273607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.273754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.273936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.274032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.274244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.274335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.274555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.274649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.274860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.275120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.275221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.275450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.275555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.275755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.275848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.276065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.276157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.276371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.276477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.276688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.276794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.276990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.277091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.277297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.277391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.277602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.277702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.277945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.278036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.278244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.278366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.278661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.278767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.278972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.279098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.279286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.279399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.279588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.279680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.279892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.279987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.280194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.280295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.280503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.280590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.280804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.280898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.281105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.281205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.281404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.281508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.281706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.281871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.282055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.282157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.282358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.282465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.282667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.282768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.282969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.283071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.283293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.283410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.283600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.283695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.283903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.283995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.284201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.284300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.284496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.284597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.284834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.284934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.285136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.285228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.285450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.285551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.285759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.285882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.286095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.286188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.286405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.286498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.286713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.286804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.287020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.287120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.287323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.287414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.287625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.287727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.287925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.288014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.288224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.288323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.288525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.288637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.288824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.288922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.289131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.289229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.289433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.289537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.289739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.289867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.290063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.290167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.290371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.290474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.290673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.290763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.290971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.291067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.291271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.291372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.291577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.291720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.291878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.291972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.292176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.292268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.292480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.292572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.292783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.292874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.293082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.293175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.293385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.293475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.293680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.293772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.294010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.294169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.294380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.294604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.294704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.294806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.295004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.295106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.295321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.295420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.295625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.295726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.295925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.296018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.296226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.296358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.296531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.296637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.296830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.296929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.297133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.297226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.297432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.297532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.297732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.297845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.298100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.298218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.298363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.298453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.298648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.298741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.298966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.299057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.299268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.299368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.299571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.299663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.299867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.299958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.300165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.300265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.300463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.300553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.300768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.300869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.301064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.301169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.301363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.301456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.301659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.301763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.302012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.302109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.302316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.302417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.302638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.302741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.302945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.303080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.303245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.303353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.303543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.303650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.303840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.303940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.304151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.304242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.304454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.304601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.304777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.304945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.305040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.305133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.305354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.305505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.305664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.305766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.306007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.306103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.306313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.306413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.306625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.306718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.306928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.307034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.307235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.307335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.307540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.307631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.307844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.307950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.308154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.308298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.308446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.308550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.308754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.308857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.309060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.309151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.309366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.309466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.309689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.309847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.310032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.310180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.310339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.310441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.310650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.310745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.310960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.311055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.311264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.311357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.311566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.311667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.311876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.311976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.312176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.312268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.312481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.312576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.312780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.312879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.313086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.313177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.313387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.313479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.313690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.314016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.314116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.314324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.314425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.314630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.314729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.314931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.315024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.315250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.315344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.315555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.315656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.315854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.315948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.316158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.316251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.316457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.316557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.316763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.316862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.317065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.317167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.317467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.317736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.317856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.318080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.318174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.318380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.318473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.318689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.318779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.318996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.319090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.319296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.319397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.319596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.319689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.319900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.319993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.320202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.320300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.320509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.320602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.320830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.320957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.321208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.321308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.321516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.321621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.321849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.321958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.322141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.322263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.322448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.322576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.322768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.322886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.323071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.323208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.323379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.323529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.323682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.323854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.324000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.324160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.324305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.324471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.324621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.324780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.325036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.325138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.325463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.325625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.325770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.325979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.326112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.326809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.326925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.327023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.327111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.327196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.327295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.327389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.327481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.327567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.327651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.327770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.328029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.328124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.328352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.328486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.328662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.328755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.328980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.329079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.329303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.329395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.329606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.329751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.330454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.330559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.330559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.330734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.330734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.330897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.330990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.331071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.331144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.331234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.331415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.331560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.331727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.331822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.332040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.332168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.332348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.332451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.332651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.332746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.332954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.333056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.333276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.333377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.333579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.333671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.333925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.334022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.334229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.334329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.334533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.334634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.334853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.334989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.335160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.335259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.335448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.335553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.335754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.335846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.336052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.336153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.336350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.336448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.336649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.336751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.336970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.337064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.337276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.337376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.337593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.337702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.338000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.338119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.338358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.338491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.338759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.338877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.339039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.339130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.339376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.339502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.339753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.339978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.340073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.340296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.340620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.340971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.341280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.341589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.341925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.342236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.342366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.342534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.342702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.342830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.343093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.343219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.343426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.343662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.343792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.343911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.344060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.344179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.344385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.344512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.345046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.345196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.345288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.345288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.345444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.345650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.345845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.345986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.346117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.346290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.346445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.346639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.346777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.346948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.347114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.347278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.347428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.347591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.347743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.347916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.348063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.348236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.348374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.348554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.348719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.348871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.349101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.349195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.349451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.349571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.349762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.349968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.350095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.350188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.350407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.350521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.350719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.350819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.351028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.351127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.351346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.351492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.351837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.351937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.352174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.352286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.352486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.352590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.352817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.352918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.353142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.353234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.353460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.353560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.353776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.353933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.354114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.354263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.354430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.354573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.354744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.354879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.355059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.355166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.355390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.355492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.355704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.355804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.356020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.356128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.356336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.356431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.356720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.356830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.357035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.357129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.357352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.357454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.357666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.357767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.358053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.358149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.358370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.358601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.358703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.358959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.359101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.359369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.359488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.359581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.359659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.359896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.360031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.360295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.360610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.360924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.361103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.361276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.361436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.361612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.361905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.362088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.362243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.362403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.362561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.362712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.362862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.363020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.363184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.363336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.363492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.363668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.363818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.363992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.364108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.364332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.364515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.364660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.364831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.364979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.365165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.365326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.365540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.365654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.365838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.365994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.366154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.366311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.366477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.366617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.366805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.366932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.367112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.367247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.367420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.367564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.367734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.367874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.368044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.368186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.368350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.368498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.368673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.368807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.368988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.369121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.369295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.369428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.369615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.369770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.370074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.370719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.371048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.371481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.371813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.371924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.372315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.373453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.373545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.373545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.373710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.373710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.373911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.374001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.374114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.374253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.374369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.374464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.374549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.374632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.374715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.374848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.375046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.375163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.375371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.375521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.375689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.375852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.376026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.376180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.376850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.377011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.377169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.377312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.377456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.377596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.377747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.377878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.378028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.378131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.378220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.378312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.378406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.378492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.378590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.378737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.378838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.379048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.379172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.379358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.379553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.379654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.379885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.379990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.380204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.380308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.380520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.380621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.380827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.380933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.381132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.381240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.381438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.381533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.381740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.381865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.382078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.382187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.382388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.382492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.382688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.382780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.382989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.383092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.383300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.383400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.383607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.383707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.383909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.384003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.384217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.384325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.384521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.384638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.384837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.384938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.385137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.385230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.385443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.385535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.385749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.385885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.386081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.386193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.386381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.386480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.386682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.386773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.386986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.387256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.387348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.387584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.387675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.387936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.388033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.388246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.388336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.388546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.388646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.388855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.388954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.389179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.389348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.389505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.389606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.389781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.390041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.390135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.390219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.390410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.390504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.390710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.390804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.391021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.391125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.391329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.391429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.391639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.391765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.391951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.392117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.392267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.392438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.392583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.392784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.392905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.393194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.393504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.393859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.394175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.394270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.394491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.394834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.394935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.395154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.395308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.395453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.395645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.395807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.396126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.396391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.396584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.396775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.396968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.397157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.397345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.397527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.397742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.398003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.398191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.398348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.398504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.398692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.398882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.399054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.399209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.399469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.399733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.399888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.400052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.400331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.400493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.400651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.400799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.400987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.401273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.401476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.401682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.401966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.402124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.402272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.402462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.402462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.402462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.402934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.402934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.403212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.403212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.403614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.403792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.403952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.404098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.404245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.404400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.404545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.404690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.404833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.405004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.405243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.405429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.405725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.405911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.406063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.406208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.406208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.406505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.406651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.406796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.406947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.407093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.407247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.407402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.407559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.407736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.407881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.408070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.408227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.408374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.408552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.408716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.408862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.409018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.409172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.409324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.409487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.409770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.410051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.410269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.410513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.410680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.410835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.410982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.411163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.411438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.411601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.411797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.411973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.412257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.412422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.412578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.412768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.412916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.412916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.413197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.413352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.413505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.413653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.413814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.413969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.414160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.414160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.414472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.414696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.414849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.415032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.415210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.415442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.415622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.415824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.415972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.416118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.416118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.416489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.416687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.416851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.416851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.417137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.417297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.417482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.417646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.417797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.418018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.418165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.418350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.418547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.418695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.418859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.419165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.419320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.419519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.419696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.419696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.420065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.420278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.420278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.420278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.420839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.421985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.422187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.422412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.422412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.422744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.422900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.423083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.423244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.423402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.423576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.423810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.423982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.424131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.424284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.424441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.424586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.424731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.424874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.425019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.425179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.425351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.425511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.425682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.425895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.426060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.426260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.426443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.426590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.426742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.426887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.427053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.427214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.427361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.427562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.427726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.427875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.428032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.428190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.428338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.428492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.428645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.428791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.428950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.429103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.429249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.429394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.429547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.429691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.429869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.430053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.430199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.430381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.430535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.430703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.430866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.431020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.431166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.431310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.431454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.431612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.431757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.431757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 02:44:45.432177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.432177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.432177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.432177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.432177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.432177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.432177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.433146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.433146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.433146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.433633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.433633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.433985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.434269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.434600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.435074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.435420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.435831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.436171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.436494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.436838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.437152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:45.437399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 02:44:45.493434 n-d-862964-4 devstack@n-api.service[127042]: INFO dbcounter [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Registered counter for database nova_api Oct 29 02:44:45.500332 n-d-862964-4 devstack@n-api.service[127041]: INFO dbcounter [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Registered counter for database nova_api Oct 29 02:44:45.514876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:45.520843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_db.sqlalchemy.engines [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:45.522039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writer thread running {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:45.528034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writer thread running {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:45.579885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.context [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) {{(pid=127042) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 02:44:45.584004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:44:45.584480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:44:45.585525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.context [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) {{(pid=127041) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 02:44:45.586258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:44:45.586991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:44:45.587406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:44:45.589490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:44:45.589646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:44:45.590054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:44:45.591719 n-d-862964-4 devstack@n-api.service[127042]: INFO dbcounter [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Registered counter for database nova_cell0 Oct 29 02:44:45.591978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:44:45.592762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:44:45.593213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:44:45.595315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:44:45.596357 n-d-862964-4 devstack@n-api.service[127042]: INFO dbcounter [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Registered counter for database nova_cell1 Oct 29 02:44:45.597384 n-d-862964-4 devstack@n-api.service[127041]: INFO dbcounter [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Registered counter for database nova_cell0 Oct 29 02:44:45.602156 n-d-862964-4 devstack@n-api.service[127041]: INFO dbcounter [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Registered counter for database nova_cell1 Oct 29 02:44:45.603695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:45.609979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_db.sqlalchemy.engines [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:45.611031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_db.sqlalchemy.engines [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:45.611680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:45.614302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writer thread running {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:45.618388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writer thread running {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:45.620830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writer thread running {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:45.755341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writer thread running {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:45.764222 n-d-862964-4 devstack@n-api.service[127042]: INFO dbcounter [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Registered counter for database nova_cell0 Oct 29 02:44:45.769116 n-d-862964-4 devstack@n-api.service[127041]: INFO dbcounter [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Registered counter for database nova_cell0 Oct 29 02:44:45.771682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:45.776509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writer thread running {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:45.778632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_db.sqlalchemy.engines [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:45.784317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writer thread running {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:46.094565 n-d-862964-4 devstack@n-api.service[127042]: WARNING keystonemiddleware.auth_token [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:44:46.101951 n-d-862964-4 devstack@n-api.service[127042]: WARNING keystonemiddleware.auth_token [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:44:46.103394 n-d-862964-4 devstack@n-api.service[127041]: WARNING keystonemiddleware.auth_token [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:44:46.110849 n-d-862964-4 devstack@n-api.service[127041]: WARNING keystonemiddleware.auth_token [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:44:46.440298 n-d-862964-4 devstack@n-api.service[127042]: WARNING keystonemiddleware.auth_token [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:44:46.446389 n-d-862964-4 devstack@n-api.service[127042]: WARNING keystonemiddleware.auth_token [None req-dcb2161b-e825-4ce5-91cf-94e353bfbbf4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:44:46.451495 n-d-862964-4 devstack@n-api.service[127041]: WARNING keystonemiddleware.auth_token [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:44:46.452059 n-d-862964-4 devstack@n-api.service[127042]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eb66e1f9c0 pid: 127042 (default app) Oct 29 02:44:46.457500 n-d-862964-4 devstack@n-api.service[127041]: WARNING keystonemiddleware.auth_token [None req-8281936c-b442-4b60-83b9-a486cf0c8dfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:44:46.463138 n-d-862964-4 devstack@n-api.service[127041]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eb66e1f9c0 pid: 127041 (default app) Oct 29 02:45:26.159411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:26.160502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:26.161427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:26.162469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:27.836631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:27.843700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:27.844666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:27.845742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:27.990981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Calling method '.version_select at 0x7fe1aa46eee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:28.001243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) {{(pid=127042) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 29 02:45:28.002016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.002492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.002912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.031930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.032424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.032854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.046538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.047390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.047975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.089779 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4cc600d9-7d3f-48bd-9220-adfe3ac5e007 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.910304 Oct 29 02:45:28.089779 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1208 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:28.445745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5deffe9a-85af-43ff-bbc8-3ccc26d193c8 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:28.448020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5deffe9a-85af-43ff-bbc8-3ccc26d193c8 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.448500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5deffe9a-85af-43ff-bbc8-3ccc26d193c8 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.449074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5deffe9a-85af-43ff-bbc8-3ccc26d193c8 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.450112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5deffe9a-85af-43ff-bbc8-3ccc26d193c8 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.450697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5deffe9a-85af-43ff-bbc8-3ccc26d193c8 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.451243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5deffe9a-85af-43ff-bbc8-3ccc26d193c8 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.500403 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5deffe9a-85af-43ff-bbc8-3ccc26d193c8 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.411334 Oct 29 02:45:28.500997 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1164 bytes} [Sat Oct 29 02:45:28 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:28.506321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aea3c53c-ee5e-4cdf-ac60-102aafa85e5d tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1122564819"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:28.527609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.aggregate [None req-aea3c53c-ee5e-4cdf-ac60-102aafa85e5d tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Generated uuid 5de6a457-1b68-4271-9dfd-88fc5fc3f66d for aggregate {{(pid=127042) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:28.636654 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aea3c53c-ee5e-4cdf-ac60-102aafa85e5d tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.133092 Oct 29 02:45:28.654151 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3/3] 10.222.0.16 () {62 vars in 1205 bytes} [Sat Oct 29 02:45:28 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:28.743048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4f1d1c34-6c03-4bf8-96f1-9ce5d96b3a3e tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:28.752443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1d1c34-6c03-4bf8-96f1-9ce5d96b3a3e tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.755428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1d1c34-6c03-4bf8-96f1-9ce5d96b3a3e tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.755947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1d1c34-6c03-4bf8-96f1-9ce5d96b3a3e tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.757792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1d1c34-6c03-4bf8-96f1-9ce5d96b3a3e tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.760129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1d1c34-6c03-4bf8-96f1-9ce5d96b3a3e tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.763467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1d1c34-6c03-4bf8-96f1-9ce5d96b3a3e tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.850924 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4f1d1c34-6c03-4bf8-96f1-9ce5d96b3a3e tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.189394 Oct 29 02:45:28.853689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '.version_select at 0x7fe1aa3e9f70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:28.854205 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4/4] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Oct 29 02:45:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:28.880302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) {{(pid=127041) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 29 02:45:28.881042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.881514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.881965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.924012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4dc22218-4a3d-4f67-b690-e26da300e4da tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-980551066", "ram": 512, "vcpus": 1, "disk": 10, "id": 1168122614, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:28.932837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.933533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.934200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.951266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.951757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.952360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.963508 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cd5da255-c0e7-49ef-94d2-9ab168a9a940 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.141495 Oct 29 02:45:28.964444 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1/5] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Oct 29 02:45:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:29.026701 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4dc22218-4a3d-4f67-b690-e26da300e4da tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.171059 Oct 29 02:45:29.027698 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 5/6] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:28 2022] POST /compute/v2.1/flavors => generated 415 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:29.034132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-30258d6c-8962-49b7-b2e4-630387947959 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Calling method '.version_select at 0x7fe1aa40d280>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:29.043777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30258d6c-8962-49b7-b2e4-630387947959 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.046084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30258d6c-8962-49b7-b2e4-630387947959 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.049139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30258d6c-8962-49b7-b2e4-630387947959 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.050253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30258d6c-8962-49b7-b2e4-630387947959 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.052364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30258d6c-8962-49b7-b2e4-630387947959 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.052988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30258d6c-8962-49b7-b2e4-630387947959 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.094824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9f05a388-0a57-4c5a-8da6-f9f7bc7604ff tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Calling method '.version_select at 0x7fe1aa24c8b0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:29.099003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f05a388-0a57-4c5a-8da6-f9f7bc7604ff tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.099949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f05a388-0a57-4c5a-8da6-f9f7bc7604ff tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.100387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f05a388-0a57-4c5a-8da6-f9f7bc7604ff tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.101124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f05a388-0a57-4c5a-8da6-f9f7bc7604ff tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.101571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f05a388-0a57-4c5a-8da6-f9f7bc7604ff tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.106038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f05a388-0a57-4c5a-8da6-f9f7bc7604ff tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.134414 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-30258d6c-8962-49b7-b2e4-630387947959 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.168696 Oct 29 02:45:29.143948 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2/7] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Oct 29 02:45:28 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:29.150111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ade920c-2a10-4028-8395-7cf68995b212 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:29.153055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ade920c-2a10-4028-8395-7cf68995b212 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.153563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ade920c-2a10-4028-8395-7cf68995b212 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.154356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ade920c-2a10-4028-8395-7cf68995b212 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.155949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ade920c-2a10-4028-8395-7cf68995b212 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.157321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ade920c-2a10-4028-8395-7cf68995b212 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.158015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ade920c-2a10-4028-8395-7cf68995b212 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.160619 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9f05a388-0a57-4c5a-8da6-f9f7bc7604ff tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.131572 Oct 29 02:45:29.161236 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 6/8] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Oct 29 02:45:29 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:29.194126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-feb82595-079e-4d0f-92c6-1bdf91ec546d tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-908412986"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:29.198227 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ade920c-2a10-4028-8395-7cf68995b212 tempest-AZAdminV2TestJSON-1615408213 tempest-AZAdminV2TestJSON-1615408213-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.053182 Oct 29 02:45:29.200416 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3/9] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Oct 29 02:45:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:29.209223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-584714e0-835d-46cc-aa0d-835b24a14866 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:29.291804 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-584714e0-835d-46cc-aa0d-835b24a14866 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1168122614/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.089677 Oct 29 02:45:29.292413 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4/10] 10.222.0.16 () {60 vars in 1224 bytes} [Sat Oct 29 02:45:29 2022] POST /compute/v2.1/flavors/1168122614/os-extra_specs => generated 66 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:29.299406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ba19dd0-f93d-47e6-8bdc-27cd1dbc73ba tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Calling method '.version_select at 0x7fe1aa40d280>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:29.303185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ba19dd0-f93d-47e6-8bdc-27cd1dbc73ba tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.303903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ba19dd0-f93d-47e6-8bdc-27cd1dbc73ba tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.304478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ba19dd0-f93d-47e6-8bdc-27cd1dbc73ba tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.305444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ba19dd0-f93d-47e6-8bdc-27cd1dbc73ba tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.306039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ba19dd0-f93d-47e6-8bdc-27cd1dbc73ba tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.306579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ba19dd0-f93d-47e6-8bdc-27cd1dbc73ba tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.340996 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3ba19dd0-f93d-47e6-8bdc-27cd1dbc73ba tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.047353 Oct 29 02:45:29.342193 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1139 bytes} [Sat Oct 29 02:45:29 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:29.373305 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-feb82595-079e-4d0f-92c6-1bdf91ec546d tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.210937 Oct 29 02:45:29.374213 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 7/12] 10.222.0.16 () {62 vars in 1210 bytes} [Sat Oct 29 02:45:29 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:29.528005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-882ba561-c20c-4724-b967-4466d6941db8 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Calling method '.version_select at 0x7fe1aa223a60>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:29.531790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-882ba561-c20c-4724-b967-4466d6941db8 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '13ce3ca31f154e95850d3b4aacca4207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99adc3c9ecb46309e23f220a6cedb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-882ba561-c20c-4724-b967-4466d6941db8 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Request method failure captured: Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPFgDgvAqfbJxadywhiFrKGFroR8ZAoKkLCC8kbrvXKiX_SxbggDdxtlSy6lMq0jtTQ3vxSkM9F3u2yMXcTYbeWpPQ5NIrUFfd4EwF6nfRp8Oi-RcoOH_dW2SVjCzM47_hHpj5889eZq1JMDVH8oHD_EhI9o-ytoZRptghQbiNZLBg Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:29.535585 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c99adc3c9ecb46309e23f220a6cedb49", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}] Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 13ce3ca31f154e95850d3b4aacca4207 Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: action_args: {} Oct 29 02:45:29.536563 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:29.537183 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 02:45:29.538046 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:29.539961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-882ba561-c20c-4724-b967-4466d6941db8 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:29.540101 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-882ba561-c20c-4724-b967-4466d6941db8 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.193421 Oct 29 02:45:29.545396 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Oct 29 02:45:29 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 199 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:29.553319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e194daae-334f-45d8-8f01-fc9737eb0c48 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Calling method '.version_select at 0x7fe1aa1ae310>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:29.572740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e194daae-334f-45d8-8f01-fc9737eb0c48 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.573446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e194daae-334f-45d8-8f01-fc9737eb0c48 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.573898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e194daae-334f-45d8-8f01-fc9737eb0c48 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.574784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e194daae-334f-45d8-8f01-fc9737eb0c48 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.575360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e194daae-334f-45d8-8f01-fc9737eb0c48 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.575920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e194daae-334f-45d8-8f01-fc9737eb0c48 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.603853 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e194daae-334f-45d8-8f01-fc9737eb0c48 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.056927 Oct 29 02:45:29.605009 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 7/14] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Oct 29 02:45:29 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:29.613949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b99d95ea-b2a4-4c8c-85a2-886c427274be tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:29.642737 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b99d95ea-b2a4-4c8c-85a2-886c427274be tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.035948 Oct 29 02:45:29.644239 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 8/15] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Oct 29 02:45:29 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:29.649950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e798a7d7-191e-43f1-bc7f-bae59d000557 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Calling method '.version_select at 0x7fe1aa223700>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:29.654785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e798a7d7-191e-43f1-bc7f-bae59d000557 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '13ce3ca31f154e95850d3b4aacca4207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99adc3c9ecb46309e23f220a6cedb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e798a7d7-191e-43f1-bc7f-bae59d000557 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Request method failure captured: Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-hosts/n-d-862964-4/reboot HTTP/1.1 Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPFgDgvAqfbJxadywhiFrKGFroR8ZAoKkLCC8kbrvXKiX_SxbggDdxtlSy6lMq0jtTQ3vxSkM9F3u2yMXcTYbeWpPQ5NIrUFfd4EwF6nfRp8Oi-RcoOH_dW2SVjCzM47_hHpj5889eZq1JMDVH8oHD_EhI9o-ytoZRptghQbiNZLBg Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:29.657124 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c99adc3c9ecb46309e23f220a6cedb49", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}] Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 13ce3ca31f154e95850d3b4aacca4207 Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'n-d-862964-4'} Oct 29 02:45:29.658470 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:29.659200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 02:45:29.660397 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:29.663416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e798a7d7-191e-43f1-bc7f-bae59d000557 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:29.664426 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e798a7d7-191e-43f1-bc7f-bae59d000557 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862964-4/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018938 Oct 29 02:45:29.665155 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1188 bytes} [Sat Oct 29 02:45:29 2022] GET /compute/v2.1/os-hosts/n-d-862964-4/reboot => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:29.672448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-866cfa07-13c8-4bc6-bbfc-a3172e28d083 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:29.729095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-866cfa07-13c8-4bc6-bbfc-a3172e28d083 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.730330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-866cfa07-13c8-4bc6-bbfc-a3172e28d083 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.732538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-866cfa07-13c8-4bc6-bbfc-a3172e28d083 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.926381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e644ec37-5828-46fb-96de-5a02641d5e35 tempest-FlavorsExtraSpecsTestJSON-1281512062 tempest-FlavorsExtraSpecsTestJSON-1281512062-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:29.954334 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e644ec37-5828-46fb-96de-5a02641d5e35 tempest-FlavorsExtraSpecsTestJSON-1281512062 tempest-FlavorsExtraSpecsTestJSON-1281512062-project] 10.222.0.16 "GET /compute/v2.1/flavors/1168122614/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.578742 Oct 29 02:45:29.955260 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Oct 29 02:45:29 2022] GET /compute/v2.1/flavors/1168122614/os-extra_specs => generated 66 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:29.960819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-47467ecc-8949-45a6-b6d3-571096eeba7d tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Calling method '.version_select at 0x7fe1aa46eee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:29.979651 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-47467ecc-8949-45a6-b6d3-571096eeba7d tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-47467ecc-8949-45a6-b6d3-571096eeba7d tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Request method failure captured: Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPILDMU0oSjzomAiFpn0PJvpKZ4Iz8tc04Jakl2XGKGdnNpatWB6AuiGyp3SlJWmjFfGlVPo5_DNdPkB-jWdZlmCLl4v1Iv5ufbDRy2H9ugUQ9c4ZZ2aTX8epYaQoj2RipbIQAxgYzTLSqo5cwUbR-i0sU219NE-f8uiSoH9CMR6NQ Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:45:29.989505 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d2710b6387f427692528d4cc01560c5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}] Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: e2a6b005e71249f6885e3a7816bdf5f9 Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'nonexistent_hostname'} Oct 29 02:45:29.990901 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:29.996179 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 02:45:29.997173 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-47467ecc-8949-45a6-b6d3-571096eeba7d tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-47467ecc-8949-45a6-b6d3-571096eeba7d tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.034693 Oct 29 02:45:29.998656 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 9/18] 10.222.0.16 () {58 vars in 1212 bytes} [Sat Oct 29 02:45:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:30.000232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-562cd5fe-9bd8-444e-b349-f0bb8bd8abb1 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:30.053027 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-562cd5fe-9bd8-444e-b349-f0bb8bd8abb1 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1168122614/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059811 Oct 29 02:45:30.053731 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 10/19] 10.222.0.16 () {60 vars in 1224 bytes} [Sat Oct 29 02:45:29 2022] POST /compute/v2.1/flavors/1168122614/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:30.059822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-216d5a36-5eda-4878-9e33-65ea93b9f911 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Calling method '.version_select at 0x7fe1a98664c0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.062343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-216d5a36-5eda-4878-9e33-65ea93b9f911 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '13ce3ca31f154e95850d3b4aacca4207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99adc3c9ecb46309e23f220a6cedb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-216d5a36-5eda-4878-9e33-65ea93b9f911 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Request method failure captured: Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hosts/n-d-862964-4 HTTP/1.1 Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPFgDgvAqfbJxadywhiFrKGFroR8ZAoKkLCC8kbrvXKiX_SxbggDdxtlSy6lMq0jtTQ3vxSkM9F3u2yMXcTYbeWpPQ5NIrUFfd4EwF6nfRp8Oi-RcoOH_dW2SVjCzM47_hHpj5889eZq1JMDVH8oHD_EhI9o-ytoZRptghQbiNZLBg Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:45:30.065508 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c99adc3c9ecb46309e23f220a6cedb49", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}] Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 13ce3ca31f154e95850d3b4aacca4207 Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'n-d-862964-4'} Oct 29 02:45:30.066676 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:30.067798 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 02:45:30.068636 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.070604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-216d5a36-5eda-4878-9e33-65ea93b9f911 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:30.071848 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-216d5a36-5eda-4878-9e33-65ea93b9f911 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862964-4" status: 403 len: 109 microversion: 2.1 time: 0.016820 Oct 29 02:45:30.073051 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 11/20] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Oct 29 02:45:30 2022] GET /compute/v2.1/os-hosts/n-d-862964-4 => generated 109 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:30.078785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a4ba5b48-da29-42f3-8411-24ec150a10a4 tempest-FlavorsExtraSpecsTestJSON-1281512062 tempest-FlavorsExtraSpecsTestJSON-1281512062-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.093686 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a4ba5b48-da29-42f3-8411-24ec150a10a4 tempest-FlavorsExtraSpecsTestJSON-1281512062 tempest-FlavorsExtraSpecsTestJSON-1281512062-project] 10.222.0.16 "GET /compute/v2.1/flavors/1168122614/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.019264 Oct 29 02:45:30.094659 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 12/21] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 02:45:30 2022] GET /compute/v2.1/flavors/1168122614/os-extra_specs/hw:numa_nodes => generated 22 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:30.100860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1bac2550-24b3-448c-83b3-bbdd2e31e25c tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Calling method '.version_select at 0x7fe1a9826700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.113102 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-1bac2550-24b3-448c-83b3-bbdd2e31e25c tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1bac2550-24b3-448c-83b3-bbdd2e31e25c tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Request method failure captured: Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPILDMU0oSjzomAiFpn0PJvpKZ4Iz8tc04Jakl2XGKGdnNpatWB6AuiGyp3SlJWmjFfGlVPo5_DNdPkB-jWdZlmCLl4v1Iv5ufbDRy2H9ugUQ9c4ZZ2aTX8epYaQoj2RipbIQAxgYzTLSqo5cwUbR-i0sU219NE-f8uiSoH9CMR6NQ Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:45:30.120587 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d2710b6387f427692528d4cc01560c5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}] Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: e2a6b005e71249f6885e3a7816bdf5f9 Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'nonexistent_hostname'} Oct 29 02:45:30.122137 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.122884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.124005 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.126480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1bac2550-24b3-448c-83b3-bbdd2e31e25c tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:30.127354 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1bac2550-24b3-448c-83b3-bbdd2e31e25c tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.031681 Oct 29 02:45:30.131067 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 13/22] 10.222.0.16 () {58 vars in 1191 bytes} [Sat Oct 29 02:45:30 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:30.138209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b24e790a-59ff-48e7-807c-12e756d1f5e5 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:30.184752 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b24e790a-59ff-48e7-807c-12e756d1f5e5 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1168122614/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052380 Oct 29 02:45:30.185331 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 14/23] 10.222.0.16 () {60 vars in 1224 bytes} [Sat Oct 29 02:45:30 2022] POST /compute/v2.1/flavors/1168122614/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:30.200993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-01f09ece-062e-4f2b-8e53-48838e2101f0 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Calling method '.version_select at 0x7fe1aac56550>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.203355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-01f09ece-062e-4f2b-8e53-48838e2101f0 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '13ce3ca31f154e95850d3b4aacca4207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99adc3c9ecb46309e23f220a6cedb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-01f09ece-062e-4f2b-8e53-48838e2101f0 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Request method failure captured: Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hosts/n-d-862964-4/shutdown HTTP/1.1 Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPFgDgvAqfbJxadywhiFrKGFroR8ZAoKkLCC8kbrvXKiX_SxbggDdxtlSy6lMq0jtTQ3vxSkM9F3u2yMXcTYbeWpPQ5NIrUFfd4EwF6nfRp8Oi-RcoOH_dW2SVjCzM47_hHpj5889eZq1JMDVH8oHD_EhI9o-ytoZRptghQbiNZLBg Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:45:30.204918 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c99adc3c9ecb46309e23f220a6cedb49", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}] Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 13ce3ca31f154e95850d3b4aacca4207 Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'n-d-862964-4'} Oct 29 02:45:30.205925 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:30.206516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 02:45:30.207339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.208503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-01f09ece-062e-4f2b-8e53-48838e2101f0 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:30.208503 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-01f09ece-062e-4f2b-8e53-48838e2101f0 tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862964-4/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.019996 Oct 29 02:45:30.208503 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 15/24] 10.222.0.16 () {58 vars in 1194 bytes} [Sat Oct 29 02:45:30 2022] GET /compute/v2.1/os-hosts/n-d-862964-4/shutdown => generated 113 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:30.216036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0308b670-c5ee-4e41-8b55-59be16f01636 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.225860 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0308b670-c5ee-4e41-8b55-59be16f01636 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1168122614/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017437 Oct 29 02:45:30.226995 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 16/25] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Oct 29 02:45:30 2022] GET /compute/v2.1/flavors/1168122614/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:30.246792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5feb8d8-84e9-437d-8146-9ef10a0d8fc7 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Calling method '.version_select at 0x7fe1a9826790>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.262211 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-b5feb8d8-84e9-437d-8146-9ef10a0d8fc7 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5feb8d8-84e9-437d-8146-9ef10a0d8fc7 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Request method failure captured: Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPILDMU0oSjzomAiFpn0PJvpKZ4Iz8tc04Jakl2XGKGdnNpatWB6AuiGyp3SlJWmjFfGlVPo5_DNdPkB-jWdZlmCLl4v1Iv5ufbDRy2H9ugUQ9c4ZZ2aTX8epYaQoj2RipbIQAxgYzTLSqo5cwUbR-i0sU219NE-f8uiSoH9CMR6NQ Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:45:30.264412 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d2710b6387f427692528d4cc01560c5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}] Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: e2a6b005e71249f6885e3a7816bdf5f9 Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'nonexistent_hostname'} Oct 29 02:45:30.265588 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:30.266335 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 02:45:30.272303 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5feb8d8-84e9-437d-8146-9ef10a0d8fc7 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b5feb8d8-84e9-437d-8146-9ef10a0d8fc7 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.038724 Oct 29 02:45:30.273251 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 17/26] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 02:45:30 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:30.275143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1e8d1b49-46eb-48d1-85f5-9255a90d222e tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:30.321943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1e8d1b49-46eb-48d1-85f5-9255a90d222e tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1168122614/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.053082 Oct 29 02:45:30.322738 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 18/27] 10.222.0.16 () {60 vars in 1265 bytes} [Sat Oct 29 02:45:30 2022] PUT /compute/v2.1/flavors/1168122614/os-extra_specs/hw:numa_nodes => generated 22 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:30.330359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e95bb48-e053-4e86-9fc9-174c327d5afd tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Calling method '.version_select at 0x7fe1a9826a60>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.332146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3e95bb48-e053-4e86-9fc9-174c327d5afd tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '13ce3ca31f154e95850d3b4aacca4207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99adc3c9ecb46309e23f220a6cedb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e95bb48-e053-4e86-9fc9-174c327d5afd tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Request method failure captured: Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hosts/n-d-862964-4/startup HTTP/1.1 Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPFgDgvAqfbJxadywhiFrKGFroR8ZAoKkLCC8kbrvXKiX_SxbggDdxtlSy6lMq0jtTQ3vxSkM9F3u2yMXcTYbeWpPQ5NIrUFfd4EwF6nfRp8Oi-RcoOH_dW2SVjCzM47_hHpj5889eZq1JMDVH8oHD_EhI9o-ytoZRptghQbiNZLBg Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:45:30.333684 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c99adc3c9ecb46309e23f220a6cedb49", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}] Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 13ce3ca31f154e95850d3b4aacca4207 Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'n-d-862964-4'} Oct 29 02:45:30.334759 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:30.335374 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 02:45:30.336239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.337043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e95bb48-e053-4e86-9fc9-174c327d5afd tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:30.337043 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3e95bb48-e053-4e86-9fc9-174c327d5afd tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862964-4/startup" status: 403 len: 110 microversion: 2.1 time: 0.011562 Oct 29 02:45:30.337043 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 19/28] 10.222.0.16 () {58 vars in 1191 bytes} [Sat Oct 29 02:45:30 2022] GET /compute/v2.1/os-hosts/n-d-862964-4/startup => generated 110 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:30.344207 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-866cfa07-13c8-4bc6-bbfc-a3172e28d083 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.677531 Oct 29 02:45:30.345391 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 10/29] 10.222.0.16 () {62 vars in 1232 bytes} [Sat Oct 29 02:45:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:30.346124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f9ae923b-35d4-40a9-b0ba-c58de3d1ce9b tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.350573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c0eea36-d15c-444e-ab06-8a9dd4c433d9 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Calling method '.version_select at 0x7fe1a9921790>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.359017 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f9ae923b-35d4-40a9-b0ba-c58de3d1ce9b tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1168122614/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022466 Oct 29 02:45:30.362610 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 20/30] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Oct 29 02:45:30 2022] GET /compute/v2.1/flavors/1168122614/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:30.373952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c9ba1d4-c93d-4e07-bd9f-d4d322e49a1c tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862964-4"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:30.375371 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-6c0eea36-d15c-444e-ab06-8a9dd4c433d9 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c0eea36-d15c-444e-ab06-8a9dd4c433d9 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Request method failure captured: Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPILDMU0oSjzomAiFpn0PJvpKZ4Iz8tc04Jakl2XGKGdnNpatWB6AuiGyp3SlJWmjFfGlVPo5_DNdPkB-jWdZlmCLl4v1Iv5ufbDRy2H9ugUQ9c4ZZ2aTX8epYaQoj2RipbIQAxgYzTLSqo5cwUbR-i0sU219NE-f8uiSoH9CMR6NQ Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:45:30.381131 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d2710b6387f427692528d4cc01560c5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}] Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: e2a6b005e71249f6885e3a7816bdf5f9 Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'nonexistent_hostname'} Oct 29 02:45:30.382338 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:30.382928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 02:45:30.383773 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c0eea36-d15c-444e-ab06-8a9dd4c433d9 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6c0eea36-d15c-444e-ab06-8a9dd4c433d9 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.036045 Oct 29 02:45:30.384658 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 11/31] 10.222.0.16 () {58 vars in 1215 bytes} [Sat Oct 29 02:45:30 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:30.396699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-367259d1-791c-4485-96f1-16ffda4f7611 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.400118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c9ba1d4-c93d-4e07-bd9f-d4d322e49a1c tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:30.400855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c9ba1d4-c93d-4e07-bd9f-d4d322e49a1c tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:30.401109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c9ba1d4-c93d-4e07-bd9f-d4d322e49a1c tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:30.444841 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-367259d1-791c-4485-96f1-16ffda4f7611 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1168122614/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.059644 Oct 29 02:45:30.445828 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 12/32] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 02:45:30 2022] DELETE /compute/v2.1/flavors/1168122614/os-extra_specs/hw:numa_nodes => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:30.459417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1562cbf3-6ff2-48bb-9dd7-74d703e61450 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a9877f70>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1562cbf3-6ff2-48bb-9dd7-74d703e61450 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Request method failure captured: Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/os-hosts/n-d-862964-4 HTTP/1.1 Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 51 Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPILDMU0oSjzomAiFpn0PJvpKZ4Iz8tc04Jakl2XGKGdnNpatWB6AuiGyp3SlJWmjFfGlVPo5_DNdPkB-jWdZlmCLl4v1Iv5ufbDRy2H9ugUQ9c4ZZ2aTX8epYaQoj2RipbIQAxgYzTLSqo5cwUbR-i0sU219NE-f8uiSoH9CMR6NQ Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:45:30.465468 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d2710b6387f427692528d4cc01560c5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}] Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: e2a6b005e71249f6885e3a7816bdf5f9 Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: {"status": "enable", "maintenance_mode": "invalid"} Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:30.466616 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'n-d-862964-4', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance: Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.467401 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.468718 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.469872 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.469872 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:45:30.469872 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:45:30.469872 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:30.469872 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.469872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1562cbf3-6ff2-48bb-9dd7-74d703e61450 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:30.470705 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1562cbf3-6ff2-48bb-9dd7-74d703e61450 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862964-4" status: 400 len: 199 microversion: 2.1 time: 0.017609 Oct 29 02:45:30.471282 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 13/33] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:30 2022] PUT /compute/v2.1/os-hosts/n-d-862964-4 => generated 199 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:45:30.481138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b66cecbc-693e-42f4-ae62-0478f9996ee5 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.510009 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b66cecbc-693e-42f4-ae62-0478f9996ee5 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1168122614/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.036332 Oct 29 02:45:30.510880 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 14/34] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 02:45:30 2022] DELETE /compute/v2.1/flavors/1168122614/os-extra_specs/hw:cpu_policy => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:30.516746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18646cc5-5b36-4603-a9b4-0578eab05748 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a982b9d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18646cc5-5b36-4603-a9b4-0578eab05748 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Request method failure captured: Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/os-hosts/n-d-862964-4 HTTP/1.1 Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 51 Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPILDMU0oSjzomAiFpn0PJvpKZ4Iz8tc04Jakl2XGKGdnNpatWB6AuiGyp3SlJWmjFfGlVPo5_DNdPkB-jWdZlmCLl4v1Iv5ufbDRy2H9ugUQ9c4ZZ2aTX8epYaQoj2RipbIQAxgYzTLSqo5cwUbR-i0sU219NE-f8uiSoH9CMR6NQ Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:45:30.522120 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d2710b6387f427692528d4cc01560c5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}] Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: e2a6b005e71249f6885e3a7816bdf5f9 Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: {"status": "invalid", "maintenance_mode": "enable"} Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:30.523173 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'n-d-862964-4', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance: Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.523928 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.525076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.526094 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.526094 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:45:30.526094 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:45:30.526094 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:30.526094 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.526094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18646cc5-5b36-4603-a9b4-0578eab05748 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:30.526094 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18646cc5-5b36-4603-a9b4-0578eab05748 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862964-4" status: 400 len: 189 microversion: 2.1 time: 0.011393 Oct 29 02:45:30.526094 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 15/35] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:30 2022] PUT /compute/v2.1/os-hosts/n-d-862964-4 => generated 189 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:45:30.528797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b9e93b8a-8b97-48c9-8a9d-b13b89a2639e tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.540989 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b9e93b8a-8b97-48c9-8a9d-b13b89a2639e tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1168122614/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015982 Oct 29 02:45:30.541541 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 16/36] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Oct 29 02:45:30 2022] GET /compute/v2.1/flavors/1168122614/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:30.552604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-112d6253-9d60-4278-918b-c0fa03e9696f tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Action: 'update', calling method: .version_select at 0x7fe1a9877940>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:30.556561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-112d6253-9d60-4278-918b-c0fa03e9696f tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '13ce3ca31f154e95850d3b4aacca4207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99adc3c9ecb46309e23f220a6cedb49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-112d6253-9d60-4278-918b-c0fa03e9696f tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Request method failure captured: Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/os-hosts/n-d-862964-4 HTTP/1.1 Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 50 Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPFgDgvAqfbJxadywhiFrKGFroR8ZAoKkLCC8kbrvXKiX_SxbggDdxtlSy6lMq0jtTQ3vxSkM9F3u2yMXcTYbeWpPQ5NIrUFfd4EwF6nfRp8Oi-RcoOH_dW2SVjCzM47_hHpj5889eZq1JMDVH8oHD_EhI9o-ytoZRptghQbiNZLBg Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:30.561568 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c99adc3c9ecb46309e23f220a6cedb49", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c99adc3c9ecb46309e23f220a6cedb49"}]}] Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c99adc3c9ecb46309e23f220a6cedb49 Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1250567375 Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 13ce3ca31f154e95850d3b4aacca4207 Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1250567375-project Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: {"status": "enable", "maintenance_mode": "enable"} Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 02:45:30.562675 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'n-d-862964-4', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:30.563366 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 02:45:30.564345 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.565322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-112d6253-9d60-4278-918b-c0fa03e9696f tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:30.565322 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-112d6253-9d60-4278-918b-c0fa03e9696f tempest-HostsAdminNegativeTestJSON-1250567375 tempest-HostsAdminNegativeTestJSON-1250567375-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862964-4" status: 403 len: 111 microversion: 2.1 time: 0.021401 Oct 29 02:45:30.565322 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 17/37] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:30 2022] PUT /compute/v2.1/os-hosts/n-d-862964-4 => generated 111 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:30.570906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-427056ca-3e7d-4c16-be1c-2ea412bd354a tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.616332 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-427056ca-3e7d-4c16-be1c-2ea412bd354a tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1168122614" status: 202 len: 0 microversion: 2.1 time: 0.049707 Oct 29 02:45:30.617041 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 18/38] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:45:30 2022] DELETE /compute/v2.1/flavors/1168122614 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:30.622714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4563d70f-e59a-4f3e-a03a-c2eb2c48791c tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Action: 'update', calling method: .version_select at 0x7fe1aa214e50>, body: {"status": null, "maintenance_mode": null} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4563d70f-e59a-4f3e-a03a-c2eb2c48791c tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Request method failure captured: Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/os-hosts/n-d-862964-4 HTTP/1.1 Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 42 Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPILDMU0oSjzomAiFpn0PJvpKZ4Iz8tc04Jakl2XGKGdnNpatWB6AuiGyp3SlJWmjFfGlVPo5_DNdPkB-jWdZlmCLl4v1Iv5ufbDRy2H9ugUQ9c4ZZ2aTX8epYaQoj2RipbIQAxgYzTLSqo5cwUbR-i0sU219NE-f8uiSoH9CMR6NQ Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:45:30.626970 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d2710b6387f427692528d4cc01560c5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}] Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: e2a6b005e71249f6885e3a7816bdf5f9 Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: {"status": null, "maintenance_mode": null} Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 02:45:30.628345 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'n-d-862964-4', 'body': {'status': None, 'maintenance_mode': None}} Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance: Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi None Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.629161 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.630324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.631222 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:45:30.631222 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:45:30.631222 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 02:45:30.631222 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.631222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4563d70f-e59a-4f3e-a03a-c2eb2c48791c tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:30.631222 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4563d70f-e59a-4f3e-a03a-c2eb2c48791c tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862964-4" status: 400 len: 127 microversion: 2.1 time: 0.010560 Oct 29 02:45:30.631222 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:30 2022] PUT /compute/v2.1/os-hosts/n-d-862964-4 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:45:30.635059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ab40f9dc-2207-4886-92ee-1fb9813b4832 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:30.667148 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ab40f9dc-2207-4886-92ee-1fb9813b4832 tempest-FlavorsExtraSpecsTestJSON-1377556910 tempest-FlavorsExtraSpecsTestJSON-1377556910-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036369 Oct 29 02:45:30.673966 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 20/40] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:30.679399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d78c1b01-62f5-45c5-b3b3-78ca616733e4 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a982b310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:30.683302 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.hosts [None req-d78c1b01-62f5-45c5-b3b3-78ca616733e4 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Enabling host nonexistent_hostname. Oct 29 02:45:30.691053 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-d78c1b01-62f5-45c5-b3b3-78ca616733e4 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d78c1b01-62f5-45c5-b3b3-78ca616733e4 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Request method failure captured: Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 50 Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPILDMU0oSjzomAiFpn0PJvpKZ4Iz8tc04Jakl2XGKGdnNpatWB6AuiGyp3SlJWmjFfGlVPo5_DNdPkB-jWdZlmCLl4v1Iv5ufbDRy2H9ugUQ9c4ZZ2aTX8epYaQoj2RipbIQAxgYzTLSqo5cwUbR-i0sU219NE-f8uiSoH9CMR6NQ Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:45:30.692762 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d2710b6387f427692528d4cc01560c5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d2710b6387f427692528d4cc01560c5"}]}] Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 5d2710b6387f427692528d4cc01560c5 Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-417838801 Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: e2a6b005e71249f6885e3a7816bdf5f9 Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HostsAdminNegativeTestJSON-417838801-project-admin Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: {"status": "enable", "maintenance_mode": "enable"} Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.693850 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:30.694688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:30.695913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:30.696912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d78c1b01-62f5-45c5-b3b3-78ca616733e4 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:30.697641 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d78c1b01-62f5-45c5-b3b3-78ca616733e4 tempest-HostsAdminNegativeTestJSON-417838801 tempest-HostsAdminNegativeTestJSON-417838801-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.018459 Oct 29 02:45:30.697641 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1211 bytes} [Sat Oct 29 02:45:30 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:31.458281 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c9ba1d4-c93d-4e07-bd9f-d4d322e49a1c tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 1.094051 Oct 29 02:45:31.460220 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 21/42] 10.222.0.16 () {62 vars in 1232 bytes} [Sat Oct 29 02:45:30 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:31.475305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b1560ba9-c2ef-4e49-960b-41aeb31b6762 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:31.512782 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b1560ba9-c2ef-4e49-960b-41aeb31b6762 tempest-AggregatesAdminTestV241-1377791242 tempest-AggregatesAdminTestV241-1377791242-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.043059 Oct 29 02:45:31.514297 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 22/43] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Oct 29 02:45:31 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:45:31.524888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-62b55a96-5427-4014-b5ac-80d3e06a671a tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2021855736"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:31.528901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.aggregate [None req-62b55a96-5427-4014-b5ac-80d3e06a671a tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Generated uuid f258e219-56aa-44e2-af59-484e1c773002 for aggregate {{(pid=127042) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:31.564599 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-62b55a96-5427-4014-b5ac-80d3e06a671a tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044840 Oct 29 02:45:31.565208 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:31.578480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b409234-c238-4b3c-a3cf-c83071caa459 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:31.596290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b409234-c238-4b3c-a3cf-c83071caa459 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:31.596784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b409234-c238-4b3c-a3cf-c83071caa459 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:31.597220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b409234-c238-4b3c-a3cf-c83071caa459 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:31.806268 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b409234-c238-4b3c-a3cf-c83071caa459 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.232758 Oct 29 02:45:31.807477 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:31 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:31.826236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-91139522-e7c9-4ea6-a8c5-48752e14afaa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862964-4"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:31.891885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91139522-e7c9-4ea6-a8c5-48752e14afaa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:31.892741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91139522-e7c9-4ea6-a8c5-48752e14afaa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:31.894154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91139522-e7c9-4ea6-a8c5-48752e14afaa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:31.982066 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-91139522-e7c9-4ea6-a8c5-48752e14afaa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h2-862964-4. Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-91139522-e7c9-4ea6-a8c5-48752e14afaa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Request method failure captured: Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 39 Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPHefmrPM_roLibvFmwIOYvUzBOpmZ_1LGFKIT13dWBD6T6vyZuUgMMWjJo3ldkyImZ7rmnXgmHhvRhL_qbdsoWMRR0pBea9FekAwurOAK9y3YBG5p9fo073qq9bdtTJxc7VOAPl-VAVzMPL3WyBWCl6a663V4zILypDNV3dvTaY2k Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:45:32.034237 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a4b3b6cab248409e63a216709fc3ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}] Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 77e6e3697dce4888930c0f1977f2bbb5 Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: {"add_host": {"host": "n-h2-862964-4"}} Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:45:32.035727 n-d-862964-4 devstack@n-api.service[127042]: exception: Aggregate 2 already has host n-h2-862964-4. Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-862964-4'}}} Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result.read() Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:45:32.036508 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-862964-4-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 02:45:32.037709 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 02:45:32.038800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:45:32.039847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result.read() Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-862964-4-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 2, 45, 31, 941101), 'updated_at': None, 'host': 'n-h2-862964-4', 'aggregate_id': 2}] Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:32.040900 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h2-862964-4. Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:32.043538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h2-862964-4. Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:32.045086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:32.047710 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h2-862964-4. Oct 29 02:45:32.047710 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:32.049758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-91139522-e7c9-4ea6-a8c5-48752e14afaa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Returning 409 to user: Aggregate 2 already has host n-h2-862964-4. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:32.049758 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-91139522-e7c9-4ea6-a8c5-48752e14afaa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.233465 Oct 29 02:45:32.049758 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:31 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 235 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 29 02:45:32.059976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b24e3f12-c9d4-4914-a62a-7bb8e138a2ef tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:32.082754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b24e3f12-c9d4-4914-a62a-7bb8e138a2ef tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:32.083425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b24e3f12-c9d4-4914-a62a-7bb8e138a2ef tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:32.084008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b24e3f12-c9d4-4914-a62a-7bb8e138a2ef tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:32.307950 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b24e3f12-c9d4-4914-a62a-7bb8e138a2ef tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.252491 Oct 29 02:45:32.309779 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:32 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:32.322117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-08096084-8733-4274-ad7d-a8e22ef54daf tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:32.355548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:32.379866 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-08096084-8733-4274-ad7d-a8e22ef54daf tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.062682 Oct 29 02:45:32.384172 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:32 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:32.397483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d9e2a712-f336-4ca7-87ce-77f3ef32d84c tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-917385231"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:32.436381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.aggregate [None req-d9e2a712-f336-4ca7-87ce-77f3ef32d84c tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Generated uuid facf15c6-6d9d-4285-9961-5a760593e11a for aggregate {{(pid=127041) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:32.445931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-342684af-cb4d-465d-b369-e384ae35eb94 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-118442674", "name": "tempest-test_aggregate-831667091"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:32.493629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.aggregate [None req-342684af-cb4d-465d-b369-e384ae35eb94 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Generated uuid eab10c8c-fc32-4d66-b7ce-dbc932c83304 for aggregate {{(pid=127042) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:32.503936 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d9e2a712-f336-4ca7-87ce-77f3ef32d84c tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.109056 Oct 29 02:45:32.510697 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:32 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:32.587593 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-342684af-cb4d-465d-b369-e384ae35eb94 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.148678 Oct 29 02:45:32.589451 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1165 bytes} [Sat Oct 29 02:45:32 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:45:32.601154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-56dd86b0-14cc-4487-8308-10e5dd80640d tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:32.636823 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-56dd86b0-14cc-4487-8308-10e5dd80640d tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 513 microversion: 2.1 time: 0.039831 Oct 29 02:45:32.638591 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 26/51] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:45:32 2022] GET /compute/v2.1/os-aggregates => generated 513 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:32.664492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6322783c-e1a9-42b5-8d56-ea3c9735b3d5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862964-4"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:32.694993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6322783c-e1a9-42b5-8d56-ea3c9735b3d5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:32.695584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6322783c-e1a9-42b5-8d56-ea3c9735b3d5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:32.696749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6322783c-e1a9-42b5-8d56-ea3c9735b3d5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:32.932601 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6322783c-e1a9-42b5-8d56-ea3c9735b3d5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 312 microversion: 2.1 time: 0.286591 Oct 29 02:45:32.933533 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:32 2022] POST /compute/v2.1/os-aggregates/4/action => generated 312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:33.263581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c783fb46-01eb-4cbb-b094-d03b37dbc2af tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:33.268788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c783fb46-01eb-4cbb-b094-d03b37dbc2af tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '52e91da7b94f490faf595d5de7818ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a3d738a21746bd996db6a866ff6e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c783fb46-01eb-4cbb-b094-d03b37dbc2af tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Request method failure captured: Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 39 Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPEtGOHzCaAVnuDuhX02GpdM00-srj_U38LzouY0YTwthd-7LyqFOjcmiG9B0jBdOU-6p-F4NcUQZeL0R7gCHn_7nlA6pTWZtbtPkRevDcLiXArjHt1dOXtl2Pgw5F-gypIUDYWnyDYZps8efPMab_PG9W2OUaV8y_c3X-y1lrPa9Q Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:33.273179 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24a3d738a21746bd996db6a866ff6e7b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}] Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 52e91da7b94f490faf595d5de7818ac1 Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: {"add_host": {"host": "n-h2-862964-4"}} Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:45:33.274465 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-862964-4'}}} Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:33.275951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 02:45:33.277676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.279194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c783fb46-01eb-4cbb-b094-d03b37dbc2af tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:33.279194 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c783fb46-01eb-4cbb-b094-d03b37dbc2af tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.765745 Oct 29 02:45:33.280772 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 26/53] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:32 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 769 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:33.289196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7da29ea4-840e-40c8-8fb6-38da59b05b05 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:33.330561 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7da29ea4-840e-40c8-8fb6-38da59b05b05 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.045755 Oct 29 02:45:33.340667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af165f4f-d339-4b67-a220-0d94821b5c51 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-315132121"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:33.349964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.aggregate [None req-af165f4f-d339-4b67-a220-0d94821b5c51 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Generated uuid 5347e116-7950-4cd1-92c9-cc1a6541ef3f for aggregate {{(pid=127041) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:33.354082 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 28/54] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:33 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:33.362513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=81,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3,nova_api:DELETE=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:33.416072 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af165f4f-d339-4b67-a220-0d94821b5c51 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.076541 Oct 29 02:45:33.416718 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 27/55] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:33.429323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94cd6165-8e45-4b24-b85e-11472de4f5fa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-802801022"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:33.461792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94cd6165-8e45-4b24-b85e-11472de4f5fa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:33.462304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94cd6165-8e45-4b24-b85e-11472de4f5fa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:33.464665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94cd6165-8e45-4b24-b85e-11472de4f5fa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:33.484936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94cd6165-8e45-4b24-b85e-11472de4f5fa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:33.487645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94cd6165-8e45-4b24-b85e-11472de4f5fa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:33.488310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94cd6165-8e45-4b24-b85e-11472de4f5fa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:33.508940 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-94cd6165-8e45-4b24-b85e-11472de4f5fa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-802801022 could not be found. Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94cd6165-8e45-4b24-b85e-11472de4f5fa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Request method failure captured: Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 57 Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPHefmrPM_roLibvFmwIOYvUzBOpmZ_1LGFKIT13dWBD6T6vyZuUgMMWjJo3ldkyImZ7rmnXgmHhvRhL_qbdsoWMRR0pBea9FekAwurOAK9y3YBG5p9fo073qq9bdtTJxc7VOAPl-VAVzMPL3WyBWCl6a663V4zILypDNV3dvTaY2k Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:45:33.512723 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a4b3b6cab248409e63a216709fc3ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}] Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 77e6e3697dce4888930c0f1977f2bbb5 Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: {"add_host": {"host": "tempest-nonexist_host-802801022"}} Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:45:33.514281 n-d-862964-4 devstack@n-api.service[127042]: exception: Compute host tempest-nonexist_host-802801022 could not be found. Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-802801022'}}} Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-802801022' is not mapped to any cell Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.515217 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 29 02:45:33.516337 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-802801022 could not be found. Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-802801022 could not be found. Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.517786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.520016 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.520016 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.520016 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.520016 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:33.520016 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:33.520016 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-802801022 could not be found. Oct 29 02:45:33.520016 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.522983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94cd6165-8e45-4b24-b85e-11472de4f5fa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-802801022 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:33.524460 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-94cd6165-8e45-4b24-b85e-11472de4f5fa tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 110 microversion: 2.1 time: 0.099603 Oct 29 02:45:33.528632 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 29/56] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:33 2022] POST /compute/v2.1/os-aggregates/5/action => generated 110 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:33.535904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-41ba5ed6-e3e9-418c-b16e-b66c6da6a8c1 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:33.582494 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-41ba5ed6-e3e9-418c-b16e-b66c6da6a8c1 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.050786 Oct 29 02:45:33.586389 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 28/57] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:33 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:33.595053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-824a0275-a764-4a95-b0bc-00ee2fb9a87f tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-824a0275-a764-4a95-b0bc-00ee2fb9a87f tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Request method failure captured: Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 283 Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPHefmrPM_roLibvFmwIOYvUzBOpmZ_1LGFKIT13dWBD6T6vyZuUgMMWjJo3ldkyImZ7rmnXgmHhvRhL_qbdsoWMRR0pBea9FekAwurOAK9y3YBG5p9fo073qq9bdtTJxc7VOAPl-VAVzMPL3WyBWCl6a663V4zILypDNV3dvTaY2k Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:45:33.603540 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:45:33.604825 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a4b3b6cab248409e63a216709fc3ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}] Oct 29 02:45:33.604825 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.604825 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:33.604825 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.604825 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:33.604825 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:33.604825 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:33.604825 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 77e6e3697dce4888930c0f1977f2bbb5 Oct 29 02:45:33.604825 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:33.604825 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:45:33.605393 n-d-862964-4 devstack@n-api.service[127042]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 02:45:33.605393 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:45:33.605393 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:45:33.605393 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 02:45:33.605393 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:33.605393 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.605393 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:45:33.605393 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:45:33.605393 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:45:33.605393 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:33.606485 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.607415 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.608219 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:45:33.608219 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:45:33.608219 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:45:33.608219 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.610685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-824a0275-a764-4a95-b0bc-00ee2fb9a87f tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:33.614524 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-824a0275-a764-4a95-b0bc-00ee2fb9a87f tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.024771 Oct 29 02:45:33.617044 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 30/58] 10.222.0.16 () {60 vars in 1165 bytes} [Sat Oct 29 02:45:33 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:45:33.629719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95f36549-0a0e-40c6-83b1-2e43ab2c2040 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95f36549-0a0e-40c6-83b1-2e43ab2c2040 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Request method failure captured: Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 27 Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPHefmrPM_roLibvFmwIOYvUzBOpmZ_1LGFKIT13dWBD6T6vyZuUgMMWjJo3ldkyImZ7rmnXgmHhvRhL_qbdsoWMRR0pBea9FekAwurOAK9y3YBG5p9fo073qq9bdtTJxc7VOAPl-VAVzMPL3WyBWCl6a663V4zILypDNV3dvTaY2k Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:45:33.636181 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a4b3b6cab248409e63a216709fc3ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}] Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 77e6e3697dce4888930c0f1977f2bbb5 Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: {"aggregate": {"name": ""}} Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:45:33.637992 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi '' Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:33.638804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:45:33.639980 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.645130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95f36549-0a0e-40c6-83b1-2e43ab2c2040 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:33.648089 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-95f36549-0a0e-40c6-83b1-2e43ab2c2040 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.023289 Oct 29 02:45:33.651487 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 29/59] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:33 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:45:33.677650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-154bfb69-77e1-4f32-9968-e70929d987a6 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-748726685"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:33.704383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-154bfb69-77e1-4f32-9968-e70929d987a6 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '52e91da7b94f490faf595d5de7818ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a3d738a21746bd996db6a866ff6e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-154bfb69-77e1-4f32-9968-e70929d987a6 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Request method failure captured: Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 59 Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPEtGOHzCaAVnuDuhX02GpdM00-srj_U38LzouY0YTwthd-7LyqFOjcmiG9B0jBdOU-6p-F4NcUQZeL0R7gCHn_7nlA6pTWZtbtPkRevDcLiXArjHt1dOXtl2Pgw5F-gypIUDYWnyDYZps8efPMab_PG9W2OUaV8y_c3X-y1lrPa9Q Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:33.706233 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24a3d738a21746bd996db6a866ff6e7b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}] Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 52e91da7b94f490faf595d5de7818ac1 Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: {"aggregate": {"name": "tempest-test_aggregate-748726685"}} Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:45:33.707634 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-748726685'}}} Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:33.708609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:33.709662 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 02:45:33.711476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.713284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-154bfb69-77e1-4f32-9968-e70929d987a6 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:33.715194 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-154bfb69-77e1-4f32-9968-e70929d987a6 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.050321 Oct 29 02:45:33.718535 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 30/60] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:33 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:33.734304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-30f87736-fc2f-436c-a1e3-5e7416ec59a6 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-338367071"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:33.738855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.aggregate [None req-30f87736-fc2f-436c-a1e3-5e7416ec59a6 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Generated uuid c8aa9dd8-0330-49f9-a89d-48a1626e63af for aggregate {{(pid=127041) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:33.792174 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-30f87736-fc2f-436c-a1e3-5e7416ec59a6 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.067991 Oct 29 02:45:33.793322 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:33.805136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-826e8c4e-ed2b-4f06-b439-45ac73e38c4d tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-338367071"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:33.814181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.aggregate [None req-826e8c4e-ed2b-4f06-b439-45ac73e38c4d tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Generated uuid 5288d58e-2766-408b-9022-ca3fdf9a06c7 for aggregate {{(pid=127041) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:33.836029 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-826e8c4e-ed2b-4f06-b439-45ac73e38c4d tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-338367071 already exists. Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-826e8c4e-ed2b-4f06-b439-45ac73e38c4d tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Request method failure captured: Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 59 Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPHefmrPM_roLibvFmwIOYvUzBOpmZ_1LGFKIT13dWBD6T6vyZuUgMMWjJo3ldkyImZ7rmnXgmHhvRhL_qbdsoWMRR0pBea9FekAwurOAK9y3YBG5p9fo073qq9bdtTJxc7VOAPl-VAVzMPL3WyBWCl6a663V4zILypDNV3dvTaY2k Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:45:33.839305 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a4b3b6cab248409e63a216709fc3ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}] Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 77e6e3697dce4888930c0f1977f2bbb5 Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: {"aggregate": {"name": "tempest-test_aggregate-338367071"}} Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:45:33.841837 n-d-862964-4 devstack@n-api.service[127041]: exception: Aggregate tempest-test_aggregate-338367071 already exists. Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-338367071'}}} Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 29 02:45:33.842847 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-338367071 already exists. Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:33.843820 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-338367071 already exists. Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-338367071 already exists. Oct 29 02:45:33.845998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:33.848705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-826e8c4e-ed2b-4f06-b439-45ac73e38c4d tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-338367071 already exists. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:33.850225 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-826e8c4e-ed2b-4f06-b439-45ac73e38c4d tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.049077 Oct 29 02:45:33.851144 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:33 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 02:45:33.866859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b3d656f8-de8e-4400-96dd-f7a8747fa34c tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:33.912140 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b3d656f8-de8e-4400-96dd-f7a8747fa34c tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.053973 Oct 29 02:45:33.915714 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 33/63] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:33 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:33.931854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0589ba89-b4f4-4e68-908e-7471f08f3fe1 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-878385750"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:33.942758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.aggregate [None req-0589ba89-b4f4-4e68-908e-7471f08f3fe1 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Generated uuid 362180d6-84bf-4f6d-93d1-5ce356d63b78 for aggregate {{(pid=127041) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:33.986354 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0589ba89-b4f4-4e68-908e-7471f08f3fe1 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.067541 Oct 29 02:45:33.988445 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 34/64] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:45:34.012020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d00b8307-aa32-42c0-aec0-66f19814f9a8 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.016075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d00b8307-aa32-42c0-aec0-66f19814f9a8 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '52e91da7b94f490faf595d5de7818ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a3d738a21746bd996db6a866ff6e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d00b8307-aa32-42c0-aec0-66f19814f9a8 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Request method failure captured: Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPEtGOHzCaAVnuDuhX02GpdM00-srj_U38LzouY0YTwthd-7LyqFOjcmiG9B0jBdOU-6p-F4NcUQZeL0R7gCHn_7nlA6pTWZtbtPkRevDcLiXArjHt1dOXtl2Pgw5F-gypIUDYWnyDYZps8efPMab_PG9W2OUaV8y_c3X-y1lrPa9Q Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:34.021009 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24a3d738a21746bd996db6a866ff6e7b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}] Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 52e91da7b94f490faf595d5de7818ac1 Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 02:45:34.022251 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '7'} Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:34.022936 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 02:45:34.024012 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.031376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d00b8307-aa32-42c0-aec0-66f19814f9a8 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:34.035287 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d00b8307-aa32-42c0-aec0-66f19814f9a8 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.039026 Oct 29 02:45:34.036100 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 35/65] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:33 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:34.047653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-17767012-7bc9-45b6-901f-3fd22d252c06 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.082375 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-17767012-7bc9-45b6-901f-3fd22d252c06 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.039133 Oct 29 02:45:34.084001 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 36/66] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:34 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 29 02:45:34.094232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-80e64ba2-3e6b-479e-940b-f1f837f79e7c tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.110343 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-80e64ba2-3e6b-479e-940b-f1f837f79e7c tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-80e64ba2-3e6b-479e-940b-f1f837f79e7c tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Request method failure captured: Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPHefmrPM_roLibvFmwIOYvUzBOpmZ_1LGFKIT13dWBD6T6vyZuUgMMWjJo3ldkyImZ7rmnXgmHhvRhL_qbdsoWMRR0pBea9FekAwurOAK9y3YBG5p9fo073qq9bdtTJxc7VOAPl-VAVzMPL3WyBWCl6a663V4zILypDNV3dvTaY2k Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:45:34.112658 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a4b3b6cab248409e63a216709fc3ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}] Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 77e6e3697dce4888930c0f1977f2bbb5 Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: exception: Aggregate -1 could not be found. Oct 29 02:45:34.113963 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '-1'} Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:45:34.114728 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.119676 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.123061 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.123061 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.123061 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:34.123061 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:34.123061 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 29 02:45:34.123061 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.123061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-80e64ba2-3e6b-479e-940b-f1f837f79e7c tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:34.123061 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-80e64ba2-3e6b-479e-940b-f1f837f79e7c tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024931 Oct 29 02:45:34.123061 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 37/67] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:45:34 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:34.126694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e40539a2-1894-4153-aa8d-1e7b0b1211d3 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-763532636"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:34.135771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.aggregate [None req-e40539a2-1894-4153-aa8d-1e7b0b1211d3 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Generated uuid 81d4ee2d-be35-4b63-8a37-a76a60718327 for aggregate {{(pid=127041) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:34.181382 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e40539a2-1894-4153-aa8d-1e7b0b1211d3 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.057164 Oct 29 02:45:34.185160 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 38/68] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:34.197276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-089de5b1-e7fb-4486-807b-9caa261d2a05 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.199084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-089de5b1-e7fb-4486-807b-9caa261d2a05 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '52e91da7b94f490faf595d5de7818ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a3d738a21746bd996db6a866ff6e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-089de5b1-e7fb-4486-807b-9caa261d2a05 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Request method failure captured: Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPEtGOHzCaAVnuDuhX02GpdM00-srj_U38LzouY0YTwthd-7LyqFOjcmiG9B0jBdOU-6p-F4NcUQZeL0R7gCHn_7nlA6pTWZtbtPkRevDcLiXArjHt1dOXtl2Pgw5F-gypIUDYWnyDYZps8efPMab_PG9W2OUaV8y_c3X-y1lrPa9Q Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:34.202852 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24a3d738a21746bd996db6a866ff6e7b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}] Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 52e91da7b94f490faf595d5de7818ac1 Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 02:45:34.204003 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '8'} Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:34.204601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 02:45:34.205521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.210103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-089de5b1-e7fb-4486-807b-9caa261d2a05 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:34.213332 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-089de5b1-e7fb-4486-807b-9caa261d2a05 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.018793 Oct 29 02:45:34.217581 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 39/69] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Oct 29 02:45:34 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:45:34.225784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8050c0b0-8b01-4a2f-aaef-d1a7042f3575 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.278998 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8050c0b0-8b01-4a2f-aaef-d1a7042f3575 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.060074 Oct 29 02:45:34.280627 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 40/70] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:34 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:34.289266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7c42a477-5ab2-4338-b0bb-82fefd3ca574 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.303439 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-7c42a477-5ab2-4338-b0bb-82fefd3ca574 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7c42a477-5ab2-4338-b0bb-82fefd3ca574 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Request method failure captured: Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPHefmrPM_roLibvFmwIOYvUzBOpmZ_1LGFKIT13dWBD6T6vyZuUgMMWjJo3ldkyImZ7rmnXgmHhvRhL_qbdsoWMRR0pBea9FekAwurOAK9y3YBG5p9fo073qq9bdtTJxc7VOAPl-VAVzMPL3WyBWCl6a663V4zILypDNV3dvTaY2k Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:45:34.309830 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a4b3b6cab248409e63a216709fc3ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}] Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 77e6e3697dce4888930c0f1977f2bbb5 Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: exception: Aggregate -1 could not be found. Oct 29 02:45:34.310921 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '-1'} Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.311596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 29 02:45:34.312532 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.316409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7c42a477-5ab2-4338-b0bb-82fefd3ca574 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:34.320704 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7c42a477-5ab2-4338-b0bb-82fefd3ca574 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034768 Oct 29 02:45:34.324745 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 41/71] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:34 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 02:45:34.332894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94d24488-6ba3-4876-90c0-7cdc885a5539 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.336616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-94d24488-6ba3-4876-90c0-7cdc885a5539 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '52e91da7b94f490faf595d5de7818ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a3d738a21746bd996db6a866ff6e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94d24488-6ba3-4876-90c0-7cdc885a5539 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Request method failure captured: Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPEtGOHzCaAVnuDuhX02GpdM00-srj_U38LzouY0YTwthd-7LyqFOjcmiG9B0jBdOU-6p-F4NcUQZeL0R7gCHn_7nlA6pTWZtbtPkRevDcLiXArjHt1dOXtl2Pgw5F-gypIUDYWnyDYZps8efPMab_PG9W2OUaV8y_c3X-y1lrPa9Q Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:34.340300 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24a3d738a21746bd996db6a866ff6e7b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}] Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 52e91da7b94f490faf595d5de7818ac1 Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 02:45:34.341414 n-d-862964-4 devstack@n-api.service[127041]: action_args: {} Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:34.342033 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 02:45:34.342959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.347552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94d24488-6ba3-4876-90c0-7cdc885a5539 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:34.350952 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94d24488-6ba3-4876-90c0-7cdc885a5539 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.023621 Oct 29 02:45:34.353618 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 42/72] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:45:34 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:45:34.361229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2013675556", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "availability_zone": "tempest-test_az-118442674"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:34.390288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:34.391437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:34.392971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:34.394264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:34.394988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:34.397065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:35.547981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:45:35.955996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:45:35.956372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:45:35.957267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:45:35.957848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:45:35.958387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:45:35.984656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:35.985140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:35.985563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:35.987446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:35.988727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:35.989444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:36.058020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Getting quotas for project 67ea773130ed4742915da0d5abf84f3a. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:45:36.069345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Getting quotas for user 255cc5a6e9584a1f94b290b617cad351 and project 67ea773130ed4742915da0d5abf84f3a. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:45:36.091515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:45:36.094491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:45:36.174534 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e1e77e72-621d-4e4c-9935-a05cb4ce3e52 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.516400 Oct 29 02:45:36.175850 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 31/73] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 02:45:36.188455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1f336290-174f-4036-8bd7-837eb3e67131 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:36.190361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1f336290-174f-4036-8bd7-837eb3e67131 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:37.973115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1f336290-174f-4036-8bd7-837eb3e67131 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:37.996926 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1f336290-174f-4036-8bd7-837eb3e67131 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1242 microversion: 2.1 time: 1.809489 Oct 29 02:45:37.997710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1971246542", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:38.012935 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 43/74] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:36 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1242 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:38.110768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:45:38.801983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:45:38.802432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:45:38.803090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:45:38.804200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:45:38.805217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:45:38.839358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:38.840630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:38.841640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:38.843130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:38.846006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:38.847954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:38.901216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Getting quotas for project 7bb0081b81cc46909ff0bae0f6ac30f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:45:38.915850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Getting quotas for user 9c7e462d0e474a3aa94d3a146ae24d21 and project 7bb0081b81cc46909ff0bae0f6ac30f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:45:38.966275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:45:38.968660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:45:39.022522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c47ac6e1-ff14-49fa-9642-e3e7daab1c7d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:39.023357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c47ac6e1-ff14-49fa-9642-e3e7daab1c7d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:39.035567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47ac6e1-ff14-49fa-9642-e3e7daab1c7d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:39.036378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47ac6e1-ff14-49fa-9642-e3e7daab1c7d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:39.037318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47ac6e1-ff14-49fa-9642-e3e7daab1c7d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:39.038664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47ac6e1-ff14-49fa-9642-e3e7daab1c7d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:39.039322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47ac6e1-ff14-49fa-9642-e3e7daab1c7d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:39.039978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47ac6e1-ff14-49fa-9642-e3e7daab1c7d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:39.120043 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79cd6e80-de94-454e-a599-4c06a5c23141 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.614548 Oct 29 02:45:39.121328 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 32/75] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:45:39.141389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-421ee317-1412-43d8-bc53-35c5894d40f9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:39.143506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-421ee317-1412-43d8-bc53-35c5894d40f9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:39.316503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c47ac6e1-ff14-49fa-9642-e3e7daab1c7d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:39.336617 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c47ac6e1-ff14-49fa-9642-e3e7daab1c7d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1290 microversion: 2.1 time: 0.316962 Oct 29 02:45:39.338218 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 44/76] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:39 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1290 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:39.429623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-421ee317-1412-43d8-bc53-35c5894d40f9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:39.457499 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-421ee317-1412-43d8-bc53-35c5894d40f9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1220 microversion: 2.1 time: 0.326884 Oct 29 02:45:39.458452 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 33/77] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:39 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1220 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:40.361059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-099bd02c-5dc4-41d0-b7ea-66b60739b938 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:40.362369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-099bd02c-5dc4-41d0-b7ea-66b60739b938 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:40.368461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:40.376245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-099bd02c-5dc4-41d0-b7ea-66b60739b938 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:40.376750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-099bd02c-5dc4-41d0-b7ea-66b60739b938 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:40.377199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-099bd02c-5dc4-41d0-b7ea-66b60739b938 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:40.377990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-099bd02c-5dc4-41d0-b7ea-66b60739b938 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:40.385536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-099bd02c-5dc4-41d0-b7ea-66b60739b938 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:40.386040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-099bd02c-5dc4-41d0-b7ea-66b60739b938 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:40.532623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-099bd02c-5dc4-41d0-b7ea-66b60739b938 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:40.549748 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-099bd02c-5dc4-41d0-b7ea-66b60739b938 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1296 microversion: 2.1 time: 0.191758 Oct 29 02:45:40.551039 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 45/78] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:40 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1296 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:40.831040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-baf2b709-d030-4ce0-a5f3-7d9bed3022e1 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Calling method '.version_select at 0x7fe1a9522ca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:40.834003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-baf2b709-d030-4ce0-a5f3-7d9bed3022e1 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:40.834668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-baf2b709-d030-4ce0-a5f3-7d9bed3022e1 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:40.835162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-baf2b709-d030-4ce0-a5f3-7d9bed3022e1 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:40.859060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-baf2b709-d030-4ce0-a5f3-7d9bed3022e1 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:40.859633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-baf2b709-d030-4ce0-a5f3-7d9bed3022e1 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:40.860123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-baf2b709-d030-4ce0-a5f3-7d9bed3022e1 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:40.872148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-baf2b709-d030-4ce0-a5f3-7d9bed3022e1 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:40.872728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-baf2b709-d030-4ce0-a5f3-7d9bed3022e1 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:40.873236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-baf2b709-d030-4ce0-a5f3-7d9bed3022e1 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:40.880236 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-baf2b709-d030-4ce0-a5f3-7d9bed3022e1 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.516347 Oct 29 02:45:40.887777 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 34/79] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:40.892813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6b487075-5d4e-47e0-9a8c-d51c5c9602df tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:40.893597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6b487075-5d4e-47e0-9a8c-d51c5c9602df tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:40.900713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b487075-5d4e-47e0-9a8c-d51c5c9602df tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:40.901339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b487075-5d4e-47e0-9a8c-d51c5c9602df tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:40.901924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b487075-5d4e-47e0-9a8c-d51c5c9602df tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:40.902820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b487075-5d4e-47e0-9a8c-d51c5c9602df tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:40.903399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b487075-5d4e-47e0-9a8c-d51c5c9602df tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:40.903914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b487075-5d4e-47e0-9a8c-d51c5c9602df tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:41.060224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-039e165f-c830-4b13-8468-1e0e20c7aa3d tempest-AZAdminNegativeTestJSON-1794097458 tempest-AZAdminNegativeTestJSON-1794097458-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:41.061989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-039e165f-c830-4b13-8468-1e0e20c7aa3d tempest-AZAdminNegativeTestJSON-1794097458 tempest-AZAdminNegativeTestJSON-1794097458-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '3adcd4a96faf40539344ab022d1016e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db7a038e0864d498b7fb80426229db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-039e165f-c830-4b13-8468-1e0e20c7aa3d tempest-AZAdminNegativeTestJSON-1794097458 tempest-AZAdminNegativeTestJSON-1794097458-project] Request method failure captured: Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPSMv9yTQ3EbB7gkrxcnTuj8Njx5sovpgJ63-o290fxpc4xNM8kzehMGLXqgN_TB4x9mft0ROFqfBa4BnXESrL-83EUnM3O-WwODxG2ArFg0wW5olT6gcMedXDYCKmossVWUwigtSCyqhQJCLM5n7vlU_uL7CdMlRL3JAkSB-gRMdw Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6db7a038e0864d498b7fb80426229db6 Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1794097458 Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:41.063895 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6db7a038e0864d498b7fb80426229db6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6db7a038e0864d498b7fb80426229db6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6db7a038e0864d498b7fb80426229db6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6db7a038e0864d498b7fb80426229db6"}]}] Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AZAdminNegativeTestJSON-1794097458 Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6db7a038e0864d498b7fb80426229db6 Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1794097458 Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AZAdminNegativeTestJSON-1794097458-project Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3adcd4a96faf40539344ab022d1016e3 Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AZAdminNegativeTestJSON-1794097458-project Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 02:45:41.065018 n-d-862964-4 devstack@n-api.service[127041]: action_args: {} Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:41.065672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:41.067759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-039e165f-c830-4b13-8468-1e0e20c7aa3d tempest-AZAdminNegativeTestJSON-1794097458 tempest-AZAdminNegativeTestJSON-1794097458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:41.068578 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-039e165f-c830-4b13-8468-1e0e20c7aa3d tempest-AZAdminNegativeTestJSON-1794097458 tempest-AZAdminNegativeTestJSON-1794097458-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.515039 Oct 29 02:45:41.074537 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 46/80] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Oct 29 02:45:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 522 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:41.194389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6b487075-5d4e-47e0-9a8c-d51c5c9602df tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:41.241495 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6b487075-5d4e-47e0-9a8c-d51c5c9602df tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1216 microversion: 2.1 time: 0.352360 Oct 29 02:45:41.243217 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 35/81] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:40 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1216 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:41.368497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-394d7602-70e7-4916-a26c-fb89c685511c tempest-FlavorsV261TestJSON-1152743530 tempest-FlavorsV261TestJSON-1152743530-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-500675603", "id": 570538798, "os-flavor-access:is_public": "True"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:41.458681 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-394d7602-70e7-4916-a26c-fb89c685511c tempest-FlavorsV261TestJSON-1152743530 tempest-FlavorsV261TestJSON-1152743530-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.380664 Oct 29 02:45:41.461351 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 47/82] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:45:41 2022] POST /compute/v2.1/flavors => generated 464 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:41.482322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8268c969-fd05-4cdd-ac83-619c730ec808 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Calling method '.version_select at 0x7fe1a96f1790>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:41.488357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8268c969-fd05-4cdd-ac83-619c730ec808 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:41.492233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8268c969-fd05-4cdd-ac83-619c730ec808 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:41.496401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8268c969-fd05-4cdd-ac83-619c730ec808 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:41.578639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8268c969-fd05-4cdd-ac83-619c730ec808 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:41.593498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d5bde7e-4106-4274-84e6-a2eddb671e8c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:41.601159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8268c969-fd05-4cdd-ac83-619c730ec808 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:41.601623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8268c969-fd05-4cdd-ac83-619c730ec808 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:41.627651 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9d5bde7e-4106-4274-84e6-a2eddb671e8c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.380277 Oct 29 02:45:41.628536 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 36/83] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:45:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:41.634431 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8268c969-fd05-4cdd-ac83-619c730ec808 tempest-HypervisorAdminV228Test-1366936054 tempest-HypervisorAdminV228Test-1366936054-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.171576 Oct 29 02:45:41.635384 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 48/84] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Oct 29 02:45:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:41.647030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e07da67-9e1c-4001-8b7a-b70bbaeaef54 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:41.647878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e07da67-9e1c-4001-8b7a-b70bbaeaef54 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:41.657360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e07da67-9e1c-4001-8b7a-b70bbaeaef54 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:41.664443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e07da67-9e1c-4001-8b7a-b70bbaeaef54 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:41.665122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e07da67-9e1c-4001-8b7a-b70bbaeaef54 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:41.667112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e07da67-9e1c-4001-8b7a-b70bbaeaef54 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:41.671442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e07da67-9e1c-4001-8b7a-b70bbaeaef54 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:41.672383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e07da67-9e1c-4001-8b7a-b70bbaeaef54 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:42.075287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1e07da67-9e1c-4001-8b7a-b70bbaeaef54 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:42.099197 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1e07da67-9e1c-4001-8b7a-b70bbaeaef54 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1296 microversion: 2.1 time: 0.459364 Oct 29 02:45:42.102433 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 49/85] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:41 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1296 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:42.153342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cbe2f59c-3071-4908-8caa-37dd5b1bbc53 tempest-FlavorsV261TestJSON-370583657 tempest-FlavorsV261TestJSON-370583657-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:42.186455 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cbe2f59c-3071-4908-8caa-37dd5b1bbc53 tempest-FlavorsV261TestJSON-370583657 tempest-FlavorsV261TestJSON-370583657-project] 10.222.0.16 "GET /compute/v2.1/flavors/570538798" status: 200 len: 464 microversion: 2.61 time: 0.549692 Oct 29 02:45:42.187374 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 37/86] 10.222.0.16 () {60 vars in 1196 bytes} [Sat Oct 29 02:45:41 2022] GET /compute/v2.1/flavors/570538798 => generated 464 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:42.214552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-634fa4c5-f43f-49e2-a04b-53dcaf855635 tempest-FlavorsV261TestJSON-1152743530 tempest-FlavorsV261TestJSON-1152743530-project-admin] Action: 'update', calling method: .version_select at 0x7fe1aa7bdb80>, body: {"flavor": {"description": "new"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:42.418775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-634fa4c5-f43f-49e2-a04b-53dcaf855635 tempest-FlavorsV261TestJSON-1152743530 tempest-FlavorsV261TestJSON-1152743530-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/570538798" status: 200 len: 465 microversion: 2.61 time: 0.214337 Oct 29 02:45:42.421275 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 38/87] 10.222.0.16 () {62 vars in 1216 bytes} [Sat Oct 29 02:45:42 2022] PUT /compute/v2.1/flavors/570538798 => generated 465 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:42.445542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f0125ea0-e40c-4dce-9ffe-af0eccec638e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:42.446378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f0125ea0-e40c-4dce-9ffe-af0eccec638e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:42.474495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0125ea0-e40c-4dce-9ffe-af0eccec638e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:42.478030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0125ea0-e40c-4dce-9ffe-af0eccec638e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:42.481480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0125ea0-e40c-4dce-9ffe-af0eccec638e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:42.482635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0125ea0-e40c-4dce-9ffe-af0eccec638e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:42.484490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0125ea0-e40c-4dce-9ffe-af0eccec638e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:42.486210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0125ea0-e40c-4dce-9ffe-af0eccec638e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:42.761949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f0125ea0-e40c-4dce-9ffe-af0eccec638e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:42.776542 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f0125ea0-e40c-4dce-9ffe-af0eccec638e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1278 microversion: 2.1 time: 0.347075 Oct 29 02:45:42.783285 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 39/88] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:42 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1278 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:42.789126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c7c2b69-3655-4f2b-afba-91b2f51eba75 tempest-FlavorsV261TestJSON-370583657 tempest-FlavorsV261TestJSON-370583657-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:42.875631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4c7c2b69-3655-4f2b-afba-91b2f51eba75 tempest-FlavorsV261TestJSON-370583657 tempest-FlavorsV261TestJSON-370583657-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.090062 Oct 29 02:45:42.876879 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 40/89] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:42 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:42.907966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-93bf1a6f-1198-49e7-a375-4f71bd757e94 tempest-FlavorsV261TestJSON-370583657 tempest-FlavorsV261TestJSON-370583657-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:42.965475 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-93bf1a6f-1198-49e7-a375-4f71bd757e94 tempest-FlavorsV261TestJSON-370583657 tempest-FlavorsV261TestJSON-370583657-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.063927 Oct 29 02:45:42.973112 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 41/90] 10.222.0.16 () {60 vars in 1166 bytes} [Sat Oct 29 02:45:42 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:42.994041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-954d4950-303c-4a11-bbac-ef575d3d2947 tempest-FlavorsV261TestJSON-1152743530 tempest-FlavorsV261TestJSON-1152743530-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:43.029871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ec91fa1-f34f-44e6-9724-ce0a49c22eb2 tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1874560397", "id": 2007017018, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:43.097193 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ec91fa1-f34f-44e6-9724-ce0a49c22eb2 tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.993458 Oct 29 02:45:43.105214 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 50/91] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:42 2022] POST /compute/v2.1/flavors => generated 425 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:43.110008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a457d275-844a-4045-a5e5-4967375a9e02 tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:43.114885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=83,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:43.129000 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-954d4950-303c-4a11-bbac-ef575d3d2947 tempest-FlavorsV261TestJSON-1152743530 tempest-FlavorsV261TestJSON-1152743530-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/570538798" status: 202 len: 0 microversion: 2.61 time: 0.131341 Oct 29 02:45:43.135750 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 42/92] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Oct 29 02:45:42 2022] DELETE /compute/v2.1/flavors/570538798 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:45:43.139191 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a457d275-844a-4045-a5e5-4967375a9e02 tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032768 Oct 29 02:45:43.152746 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 51/93] 10.222.0.16 () {58 vars in 1182 bytes} [Sat Oct 29 02:45:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:43.157548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d07cd3f4-d438-47d6-bbe6-7c05a0918d53 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:43.158999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d07cd3f4-d438-47d6-bbe6-7c05a0918d53 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:43.164286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ff6ce4fb-a840-4c5d-a169-cca929572288 tempest-FlavorsV261TestJSON-1152743530 tempest-FlavorsV261TestJSON-1152743530-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:43.175359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07cd3f4-d438-47d6-bbe6-7c05a0918d53 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:43.177876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07cd3f4-d438-47d6-bbe6-7c05a0918d53 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:43.178784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07cd3f4-d438-47d6-bbe6-7c05a0918d53 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:43.181107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07cd3f4-d438-47d6-bbe6-7c05a0918d53 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:43.183088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07cd3f4-d438-47d6-bbe6-7c05a0918d53 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:43.183911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07cd3f4-d438-47d6-bbe6-7c05a0918d53 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:43.253790 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ff6ce4fb-a840-4c5d-a169-cca929572288 tempest-FlavorsV261TestJSON-1152743530 tempest-FlavorsV261TestJSON-1152743530-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.099560 Oct 29 02:45:43.254408 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 52/94] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:43 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:43.266765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7c4969a9-6a2f-4a40-96df-93bd02aa018c tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-852401573", "id": 669330603, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:43.349548 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7c4969a9-6a2f-4a40-96df-93bd02aa018c tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.074384 Oct 29 02:45:43.354237 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 53/95] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:43 2022] POST /compute/v2.1/flavors => generated 421 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:43.370524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90f4ee51-ba74-497f-9be6-8ed8d0519fda tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:43.406568 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-90f4ee51-ba74-497f-9be6-8ed8d0519fda tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040995 Oct 29 02:45:43.410328 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 54/96] 10.222.0.16 () {58 vars in 1182 bytes} [Sat Oct 29 02:45:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:43.424401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25d4e9ef-d3a4-4ed6-bd3f-345a08d85a2f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Action: 'create', calling method: .version_select at 0x7fe1a97085e0>, body: {"keypair": {"name": "tempest-keypair-1853074295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHFRPBzIvfMnME3H5sRjhtyAfP0LrOvG7Ph2Xl6tYBT301y6skucANq2mYunQ2CObCp04RYvHTD1DaIfH1LC1+giwgqFWYmLDvXpjw6pykBuPcF2mTHAxzEi2ILssXZEA=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:43.562860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-25d4e9ef-d3a4-4ed6-bd3f-345a08d85a2f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Getting quotas for project 013e7f18496749fb9525e0303e688964. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:45:43.602956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-25d4e9ef-d3a4-4ed6-bd3f-345a08d85a2f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Getting quotas for user 1e835f57621f46719369731607bebb1f and project 013e7f18496749fb9525e0303e688964. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:45:43.706544 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25d4e9ef-d3a4-4ed6-bd3f-345a08d85a2f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.286414 Oct 29 02:45:43.708165 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 55/97] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:45:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:43.805027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a0ec4b4-6d84-4fa5-b1ee-5f34a53a5553 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:43.807524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5a0ec4b4-6d84-4fa5-b1ee-5f34a53a5553 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:43.834425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0ec4b4-6d84-4fa5-b1ee-5f34a53a5553 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:43.841787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0ec4b4-6d84-4fa5-b1ee-5f34a53a5553 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:43.843152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0ec4b4-6d84-4fa5-b1ee-5f34a53a5553 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:43.846339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0ec4b4-6d84-4fa5-b1ee-5f34a53a5553 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:43.847366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0ec4b4-6d84-4fa5-b1ee-5f34a53a5553 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:43.848244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0ec4b4-6d84-4fa5-b1ee-5f34a53a5553 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:44.308192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d07cd3f4-d438-47d6-bbe6-7c05a0918d53 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:44.331556 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d07cd3f4-d438-47d6-bbe6-7c05a0918d53 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 1.190250 Oct 29 02:45:44.333311 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 43/98] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:43 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:44.608077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5a0ec4b4-6d84-4fa5-b1ee-5f34a53a5553 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:44.620721 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5a0ec4b4-6d84-4fa5-b1ee-5f34a53a5553 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1278 microversion: 2.1 time: 0.818935 Oct 29 02:45:44.624066 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 56/99] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:43 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1278 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:45.359358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb6768a3-5661-4c61-aa26-b51d94dd1c7b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:45.360057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fb6768a3-5661-4c61-aa26-b51d94dd1c7b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:45.378928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb6768a3-5661-4c61-aa26-b51d94dd1c7b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:45.383801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb6768a3-5661-4c61-aa26-b51d94dd1c7b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:45.384632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb6768a3-5661-4c61-aa26-b51d94dd1c7b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:45.387491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb6768a3-5661-4c61-aa26-b51d94dd1c7b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:45.388272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb6768a3-5661-4c61-aa26-b51d94dd1c7b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:45.391560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb6768a3-5661-4c61-aa26-b51d94dd1c7b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:45.648625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b748a52-8115-4439-bfd4-fe5e77da1823 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:45.666203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7b748a52-8115-4439-bfd4-fe5e77da1823 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:45.666203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b748a52-8115-4439-bfd4-fe5e77da1823 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:45.666203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b748a52-8115-4439-bfd4-fe5e77da1823 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:45.666203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b748a52-8115-4439-bfd4-fe5e77da1823 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:45.666755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b748a52-8115-4439-bfd4-fe5e77da1823 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:45.680726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b748a52-8115-4439-bfd4-fe5e77da1823 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:45.681629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b748a52-8115-4439-bfd4-fe5e77da1823 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:45.958227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7b748a52-8115-4439-bfd4-fe5e77da1823 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:45.986901 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7b748a52-8115-4439-bfd4-fe5e77da1823 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1278 microversion: 2.1 time: 0.324446 Oct 29 02:45:45.991624 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 57/100] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:45 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1278 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:46.506993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fb6768a3-5661-4c61-aa26-b51d94dd1c7b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:46.521291 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fb6768a3-5661-4c61-aa26-b51d94dd1c7b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 1.166421 Oct 29 02:45:46.524192 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 44/101] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:45 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:47.015571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5473a881-d824-4015-bcec-00b1ebde76a1 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:47.016986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5473a881-d824-4015-bcec-00b1ebde76a1 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:47.029099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5473a881-d824-4015-bcec-00b1ebde76a1 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:47.034700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5473a881-d824-4015-bcec-00b1ebde76a1 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:47.037005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5473a881-d824-4015-bcec-00b1ebde76a1 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:47.042334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5473a881-d824-4015-bcec-00b1ebde76a1 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:47.043180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5473a881-d824-4015-bcec-00b1ebde76a1 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:47.044534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5473a881-d824-4015-bcec-00b1ebde76a1 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:47.547949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-875da922-df29-47c4-8b2b-d25f979e178d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:47.548553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-875da922-df29-47c4-8b2b-d25f979e178d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:47.561231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-875da922-df29-47c4-8b2b-d25f979e178d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:47.561715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-875da922-df29-47c4-8b2b-d25f979e178d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:47.562157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-875da922-df29-47c4-8b2b-d25f979e178d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:47.574524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-875da922-df29-47c4-8b2b-d25f979e178d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:47.582742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-875da922-df29-47c4-8b2b-d25f979e178d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:47.583527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-875da922-df29-47c4-8b2b-d25f979e178d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:48.106017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5473a881-d824-4015-bcec-00b1ebde76a1 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:48.118926 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5473a881-d824-4015-bcec-00b1ebde76a1 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1320 microversion: 2.1 time: 1.104612 Oct 29 02:45:48.120972 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 58/102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:47 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1320 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:48.193748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-875da922-df29-47c4-8b2b-d25f979e178d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:48.204984 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-875da922-df29-47c4-8b2b-d25f979e178d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.660750 Oct 29 02:45:48.210419 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 45/103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:47 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:49.143790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-92ec2415-31d4-4de8-b68f-a28c109808e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.144575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-92ec2415-31d4-4de8-b68f-a28c109808e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:49.161547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92ec2415-31d4-4de8-b68f-a28c109808e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.163054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92ec2415-31d4-4de8-b68f-a28c109808e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.163495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92ec2415-31d4-4de8-b68f-a28c109808e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.166729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92ec2415-31d4-4de8-b68f-a28c109808e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.167189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92ec2415-31d4-4de8-b68f-a28c109808e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.167645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92ec2415-31d4-4de8-b68f-a28c109808e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.238498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-337729e8-21bd-49e9-9190-3fc56fff6768 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.239076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-337729e8-21bd-49e9-9190-3fc56fff6768 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:49.241038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=14 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:49.267644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-337729e8-21bd-49e9-9190-3fc56fff6768 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.273914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-337729e8-21bd-49e9-9190-3fc56fff6768 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.274793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-337729e8-21bd-49e9-9190-3fc56fff6768 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.275558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-337729e8-21bd-49e9-9190-3fc56fff6768 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.276250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-337729e8-21bd-49e9-9190-3fc56fff6768 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.277103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-337729e8-21bd-49e9-9190-3fc56fff6768 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.452417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=14 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:50.328151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-337729e8-21bd-49e9-9190-3fc56fff6768 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:50.344181 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-337729e8-21bd-49e9-9190-3fc56fff6768 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 1.105781 Oct 29 02:45:50.346168 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 46/104] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:49 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:50.517581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-92ec2415-31d4-4de8-b68f-a28c109808e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:50.537750 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-92ec2415-31d4-4de8-b68f-a28c109808e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1320 microversion: 2.1 time: 1.397511 Oct 29 02:45:50.543042 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 59/105] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:49 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1320 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:51.254033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-68c1dfda-ca0b-41ad-94f7-142d545694b9 req-abeb90e0-9d93-4263-9f58-dd7b955a5cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d968c73-0802-46ee-8972-e48ba3168aa6", "tag": "59b2502f-f81c-47a5-bc83-41d4db39aec4"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:51.293823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-68c1dfda-ca0b-41ad-94f7-142d545694b9 req-abeb90e0-9d93-4263-9f58-dd7b955a5cb7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:51.299493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-68c1dfda-ca0b-41ad-94f7-142d545694b9 req-abeb90e0-9d93-4263-9f58-dd7b955a5cb7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:51.305131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-68c1dfda-ca0b-41ad-94f7-142d545694b9 req-abeb90e0-9d93-4263-9f58-dd7b955a5cb7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:51.365355 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-68c1dfda-ca0b-41ad-94f7-142d545694b9 req-abeb90e0-9d93-4263-9f58-dd7b955a5cb7 service nova] Creating event network-changed:59b2502f-f81c-47a5-bc83-41d4db39aec4 for instance 8d968c73-0802-46ee-8972-e48ba3168aa6 on n-h2-862964-4 Oct 29 02:45:51.366742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-68c1dfda-ca0b-41ad-94f7-142d545694b9 req-abeb90e0-9d93-4263-9f58-dd7b955a5cb7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:45:51.367393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-68c1dfda-ca0b-41ad-94f7-142d545694b9 req-abeb90e0-9d93-4263-9f58-dd7b955a5cb7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:45:51.371088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c6be61-c7fb-42bf-8ec7-9214bcaaad65 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:51.373157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c6be61-c7fb-42bf-8ec7-9214bcaaad65 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:51.373888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c6be61-c7fb-42bf-8ec7-9214bcaaad65 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:51.375097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-306a60a7-2f80-4580-92ff-47aeef7a99d0 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:51.375714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-306a60a7-2f80-4580-92ff-47aeef7a99d0 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:51.376215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c6be61-c7fb-42bf-8ec7-9214bcaaad65 None None] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:51.376897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c6be61-c7fb-42bf-8ec7-9214bcaaad65 None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:51.377746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c6be61-c7fb-42bf-8ec7-9214bcaaad65 None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:51.390485 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.compute.rpcapi [None req-27c6be61-c7fb-42bf-8ec7-9214bcaaad65 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 29 02:45:51.391764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c6be61-c7fb-42bf-8ec7-9214bcaaad65 None None] Releasing lock "compute-rpcapi-router" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:45:51.393113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306a60a7-2f80-4580-92ff-47aeef7a99d0 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:51.393703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306a60a7-2f80-4580-92ff-47aeef7a99d0 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:51.394174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306a60a7-2f80-4580-92ff-47aeef7a99d0 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:51.394915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306a60a7-2f80-4580-92ff-47aeef7a99d0 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:51.395366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306a60a7-2f80-4580-92ff-47aeef7a99d0 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:51.395782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306a60a7-2f80-4580-92ff-47aeef7a99d0 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:51.417857 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-27c6be61-c7fb-42bf-8ec7-9214bcaaad65 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522015 Oct 29 02:45:51.420333 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 47/106] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:51.782426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-306a60a7-2f80-4580-92ff-47aeef7a99d0 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:51.794328 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-306a60a7-2f80-4580-92ff-47aeef7a99d0 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.426821 Oct 29 02:45:51.807251 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 60/107] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:51 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:51.822301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2f06ae39-9c7c-406e-89a6-94012e719f87 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:51.824837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2f06ae39-9c7c-406e-89a6-94012e719f87 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:51.837825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f06ae39-9c7c-406e-89a6-94012e719f87 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:51.838600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f06ae39-9c7c-406e-89a6-94012e719f87 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:51.839705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f06ae39-9c7c-406e-89a6-94012e719f87 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:51.840792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f06ae39-9c7c-406e-89a6-94012e719f87 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:51.841576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f06ae39-9c7c-406e-89a6-94012e719f87 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:51.842226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f06ae39-9c7c-406e-89a6-94012e719f87 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:51.906614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e0936894-e674-4923-8ef0-d8a1906647bb req-c1656f7b-464a-43eb-a8a3-53a00cab7a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "333ee108-8b64-4be0-a8f8-5e6a558d81a4", "tag": "360018c1-5fa9-450f-800f-0d5e36d2f29e"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:51.933421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e0936894-e674-4923-8ef0-d8a1906647bb req-c1656f7b-464a-43eb-a8a3-53a00cab7a7f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:51.935317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e0936894-e674-4923-8ef0-d8a1906647bb req-c1656f7b-464a-43eb-a8a3-53a00cab7a7f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:51.935758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e0936894-e674-4923-8ef0-d8a1906647bb req-c1656f7b-464a-43eb-a8a3-53a00cab7a7f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:51.958572 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e0936894-e674-4923-8ef0-d8a1906647bb req-c1656f7b-464a-43eb-a8a3-53a00cab7a7f service nova] Creating event network-changed:360018c1-5fa9-450f-800f-0d5e36d2f29e for instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 on n-h1-862964-4 Oct 29 02:45:51.980449 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e0936894-e674-4923-8ef0-d8a1906647bb req-c1656f7b-464a-43eb-a8a3-53a00cab7a7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.461378 Oct 29 02:45:51.986558 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 48/108] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:52.014989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-185713390", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "669330603", "adminPass": "***", "networks": [{"uuid": "6ca57a7d-099c-4d87-959a-49f4a585deab"}], "security_groups": [{"name": "tempest-securitygroup--1762564065"}], "key_name": "tempest-keypair-1853074295", "user_data": "}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:52.523998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2f06ae39-9c7c-406e-89a6-94012e719f87 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:52.538801 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2f06ae39-9c7c-406e-89a6-94012e719f87 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1320 microversion: 2.1 time: 0.722910 Oct 29 02:45:52.542323 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 61/109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:51 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1320 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:52.819438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8e480d49-fd70-4b7c-b72e-402766c3a484 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:52.820097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8e480d49-fd70-4b7c-b72e-402766c3a484 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:52.835901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=84,nova_api:DELETE=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:52.849828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e480d49-fd70-4b7c-b72e-402766c3a484 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:52.854278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e480d49-fd70-4b7c-b72e-402766c3a484 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:52.854915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e480d49-fd70-4b7c-b72e-402766c3a484 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:52.859084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e480d49-fd70-4b7c-b72e-402766c3a484 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:52.859612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e480d49-fd70-4b7c-b72e-402766c3a484 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:52.860040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e480d49-fd70-4b7c-b72e-402766c3a484 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:53.215128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e480d49-fd70-4b7c-b72e-402766c3a484 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:53.231067 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8e480d49-fd70-4b7c-b72e-402766c3a484 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.413822 Oct 29 02:45:53.234156 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 62/110] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:52 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:53.651450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:53.929618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1734044295", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:55.119279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:45:55.184011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] validate_networks() for [('6ca57a7d-099c-4d87-959a-49f4a585deab', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:45:55.373296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:45:55.373623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:45:55.374375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:45:55.375003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:45:55.375526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:45:55.392343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:55.393168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:55.393835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:55.394761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:55.396679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:55.397297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:55.434254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Getting quotas for project 95e80c722df94993b9231f5b17ee4c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:45:55.438965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Getting quotas for user de04aa74bc1f403ea9818dcbcaba7b63 and project 95e80c722df94993b9231f5b17ee4c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:45:55.455504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:45:55.458827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:45:55.545292 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-88e7ecac-7d91-4835-a96f-5f9e32aee393 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.106422 Oct 29 02:45:55.547360 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 63/111] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:45:55.801060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-07705ddd-a84b-4a77-85cf-e181dc4c6fc4 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Calling method '.version_select at 0x7fe1a9673ca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:55.802930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07705ddd-a84b-4a77-85cf-e181dc4c6fc4 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:55.803421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07705ddd-a84b-4a77-85cf-e181dc4c6fc4 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:55.803857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07705ddd-a84b-4a77-85cf-e181dc4c6fc4 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:55.847822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07705ddd-a84b-4a77-85cf-e181dc4c6fc4 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:55.848332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07705ddd-a84b-4a77-85cf-e181dc4c6fc4 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:55.848765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07705ddd-a84b-4a77-85cf-e181dc4c6fc4 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:55.894238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07705ddd-a84b-4a77-85cf-e181dc4c6fc4 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:55.896780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07705ddd-a84b-4a77-85cf-e181dc4c6fc4 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:55.898147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07705ddd-a84b-4a77-85cf-e181dc4c6fc4 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:55.914077 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-07705ddd-a84b-4a77-85cf-e181dc4c6fc4 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.365258 Oct 29 02:45:55.916765 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 64/112] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:55.928332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a0f3b684-2c2f-41a9-b3ad-8cf74e9caa20 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:55.929033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a0f3b684-2c2f-41a9-b3ad-8cf74e9caa20 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:55.938675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f3b684-2c2f-41a9-b3ad-8cf74e9caa20 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:55.939253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f3b684-2c2f-41a9-b3ad-8cf74e9caa20 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:55.939924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f3b684-2c2f-41a9-b3ad-8cf74e9caa20 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:55.941036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f3b684-2c2f-41a9-b3ad-8cf74e9caa20 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:55.941730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f3b684-2c2f-41a9-b3ad-8cf74e9caa20 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:55.942485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f3b684-2c2f-41a9-b3ad-8cf74e9caa20 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:55.947264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:56.115277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a0f3b684-2c2f-41a9-b3ad-8cf74e9caa20 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:56.128873 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a0f3b684-2c2f-41a9-b3ad-8cf74e9caa20 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1320 microversion: 2.1 time: 0.211089 Oct 29 02:45:56.138201 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 65/113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:55 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:56.209235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:45:56.209888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:45:56.210207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:45:56.210770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:45:56.211392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:45:56.226448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.227062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.227534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.228388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.228870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.229282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.237321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=79 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:56.249667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Getting quotas for project 013e7f18496749fb9525e0303e688964. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:45:56.254994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Getting quotas for user 1e835f57621f46719369731607bebb1f and project 013e7f18496749fb9525e0303e688964. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:45:56.272228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:45:56.275970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:45:56.315112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0490799-57b1-4577-a64b-401621fde1bc tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Calling method '.version_select at 0x7fe1a95f2a60>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.324905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0490799-57b1-4577-a64b-401621fde1bc tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'cfcf745cf2ea4c88b724b34ff179beca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4a4c1ee62949eca8e063748bea9e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0490799-57b1-4577-a64b-401621fde1bc tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Request method failure captured: Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPfXVRLn20mXtW6Nb86sAycP9_7-SnllE17QAUwUbj0m_urH99M3JD0DOs0iD01tcLWD9BzTXtw6lXOECOlTpgyufrIba-Gm6Bo0pTs27fOcMbpwN5NPMQCjCx8xzN-I7sF3eikeE4MVoJNSD3chNJsDEzElmvuiod4Rb0_jMBpXG0 Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 0f4a4c1ee62949eca8e063748bea9e33 Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:56.329035 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f4a4c1ee62949eca8e063748bea9e33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4a4c1ee62949eca8e063748bea9e33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f4a4c1ee62949eca8e063748bea9e33", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4a4c1ee62949eca8e063748bea9e33"}]}] Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 0f4a4c1ee62949eca8e063748bea9e33 Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HypervisorAdminNegativeTestJSON-836676319-project Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cfcf745cf2ea4c88b724b34ff179beca Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-836676319-project Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: action_args: {} Oct 29 02:45:56.330962 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:56.331830 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 02:45:56.333293 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.337604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0490799-57b1-4577-a64b-401621fde1bc tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:56.340715 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d0490799-57b1-4577-a64b-401621fde1bc tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.201038 Oct 29 02:45:56.341285 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 66/114] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 202 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:56.362756 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-28aa8759-e4bb-4563-a5be-d51b2cacb962 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.372731 Oct 29 02:45:56.364789 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 49/115] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 4377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:45:56.366474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3bd7bae8-74dd-468e-9317-dfb5b4a562e1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.371611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3bd7bae8-74dd-468e-9317-dfb5b4a562e1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:56.377648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-294914da-4709-4ce0-9aa4-1b04e3d11eb9 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.378695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-294914da-4709-4ce0-9aa4-1b04e3d11eb9 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:56.390398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bd7bae8-74dd-468e-9317-dfb5b4a562e1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.390809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bd7bae8-74dd-468e-9317-dfb5b4a562e1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.391243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bd7bae8-74dd-468e-9317-dfb5b4a562e1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.391951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bd7bae8-74dd-468e-9317-dfb5b4a562e1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.392400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bd7bae8-74dd-468e-9317-dfb5b4a562e1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.392819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bd7bae8-74dd-468e-9317-dfb5b4a562e1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.528668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-294914da-4709-4ce0-9aa4-1b04e3d11eb9 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:56.550100 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-294914da-4709-4ce0-9aa4-1b04e3d11eb9 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1219 microversion: 2.1 time: 0.181073 Oct 29 02:45:56.554213 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 50/116] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:56.571341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bf3fd6c2-d937-43a1-942d-8f2134ad2230 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Calling method '.version_select at 0x7fe1a93aa820>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.573242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf3fd6c2-d937-43a1-942d-8f2134ad2230 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.573752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf3fd6c2-d937-43a1-942d-8f2134ad2230 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.574244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf3fd6c2-d937-43a1-942d-8f2134ad2230 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.628026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf3fd6c2-d937-43a1-942d-8f2134ad2230 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.628661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf3fd6c2-d937-43a1-942d-8f2134ad2230 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.629091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf3fd6c2-d937-43a1-942d-8f2134ad2230 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.635365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3bd7bae8-74dd-468e-9317-dfb5b4a562e1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:56.645608 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3bd7bae8-74dd-468e-9317-dfb5b4a562e1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.297839 Oct 29 02:45:56.646656 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 67/117] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:56.651737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c60f40f9-ca48-432a-bb5e-7d37416bea07 tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Calling method '.version_select at 0x7fe1a95f2b80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.654164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c60f40f9-ca48-432a-bb5e-7d37416bea07 tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'cfcf745cf2ea4c88b724b34ff179beca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4a4c1ee62949eca8e063748bea9e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c60f40f9-ca48-432a-bb5e-7d37416bea07 tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Request method failure captured: Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPfXVRLn20mXtW6Nb86sAycP9_7-SnllE17QAUwUbj0m_urH99M3JD0DOs0iD01tcLWD9BzTXtw6lXOECOlTpgyufrIba-Gm6Bo0pTs27fOcMbpwN5NPMQCjCx8xzN-I7sF3eikeE4MVoJNSD3chNJsDEzElmvuiod4Rb0_jMBpXG0 Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 0f4a4c1ee62949eca8e063748bea9e33 Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:56.655847 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f4a4c1ee62949eca8e063748bea9e33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4a4c1ee62949eca8e063748bea9e33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f4a4c1ee62949eca8e063748bea9e33", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4a4c1ee62949eca8e063748bea9e33"}]}] Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 0f4a4c1ee62949eca8e063748bea9e33 Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HypervisorAdminNegativeTestJSON-836676319-project Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cfcf745cf2ea4c88b724b34ff179beca Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-836676319-project Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: action_args: {} Oct 29 02:45:56.657170 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:56.658020 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 02:45:56.659230 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.660638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c60f40f9-ca48-432a-bb5e-7d37416bea07 tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:56.661589 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c60f40f9-ca48-432a-bb5e-7d37416bea07 tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.013903 Oct 29 02:45:56.666653 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 68/118] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:56.675368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-55b1f8bb-0238-4e3d-9e87-d5450e0dbd72 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.675979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-55b1f8bb-0238-4e3d-9e87-d5450e0dbd72 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:56.712501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf3fd6c2-d937-43a1-942d-8f2134ad2230 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.713151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf3fd6c2-d937-43a1-942d-8f2134ad2230 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.713614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf3fd6c2-d937-43a1-942d-8f2134ad2230 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.723012 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bf3fd6c2-d937-43a1-942d-8f2134ad2230 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h2-862964-4/servers" status: 200 len: 196 microversion: 2.1 time: 0.167165 Oct 29 02:45:56.738388 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 51/119] 10.222.0.16 () {58 vars in 1212 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/os-hypervisors/n-h2-862964-4/servers => generated 196 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:56.743902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2fd28c8-b57e-4052-9c19-7f1fc787a152 tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Calling method '.version_select at 0x7fe1a93c9e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.746373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2fd28c8-b57e-4052-9c19-7f1fc787a152 tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'cfcf745cf2ea4c88b724b34ff179beca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4a4c1ee62949eca8e063748bea9e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2fd28c8-b57e-4052-9c19-7f1fc787a152 tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Request method failure captured: Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPfXVRLn20mXtW6Nb86sAycP9_7-SnllE17QAUwUbj0m_urH99M3JD0DOs0iD01tcLWD9BzTXtw6lXOECOlTpgyufrIba-Gm6Bo0pTs27fOcMbpwN5NPMQCjCx8xzN-I7sF3eikeE4MVoJNSD3chNJsDEzElmvuiod4Rb0_jMBpXG0 Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 0f4a4c1ee62949eca8e063748bea9e33 Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:45:56.748686 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f4a4c1ee62949eca8e063748bea9e33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4a4c1ee62949eca8e063748bea9e33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f4a4c1ee62949eca8e063748bea9e33", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4a4c1ee62949eca8e063748bea9e33"}]}] Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 0f4a4c1ee62949eca8e063748bea9e33 Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HypervisorAdminNegativeTestJSON-836676319-project Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cfcf745cf2ea4c88b724b34ff179beca Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-836676319-project Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: action_args: {} Oct 29 02:45:56.749901 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:56.750674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 02:45:56.751794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.753964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2fd28c8-b57e-4052-9c19-7f1fc787a152 tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:56.754987 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b2fd28c8-b57e-4052-9c19-7f1fc787a152 tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015332 Oct 29 02:45:56.756013 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 52/120] 10.222.0.16 () {58 vars in 1179 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:56.764285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-55b1f8bb-0238-4e3d-9e87-d5450e0dbd72 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:56.765329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3d5e9e86-ffbf-4d4c-a90b-23db5328b53a tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Calling method '.version_select at 0x7fe1a93929d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.767416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d5e9e86-ffbf-4d4c-a90b-23db5328b53a tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.768222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d5e9e86-ffbf-4d4c-a90b-23db5328b53a tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.768960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d5e9e86-ffbf-4d4c-a90b-23db5328b53a tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.774439 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-55b1f8bb-0238-4e3d-9e87-d5450e0dbd72 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1262 microversion: 2.1 time: 0.105853 Oct 29 02:45:56.775096 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 69/121] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1262 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:56.797329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d5e9e86-ffbf-4d4c-a90b-23db5328b53a tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.797840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d5e9e86-ffbf-4d4c-a90b-23db5328b53a tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.801195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d5e9e86-ffbf-4d4c-a90b-23db5328b53a tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.816211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d5e9e86-ffbf-4d4c-a90b-23db5328b53a tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.816763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d5e9e86-ffbf-4d4c-a90b-23db5328b53a tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.817106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d5e9e86-ffbf-4d4c-a90b-23db5328b53a tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.832337 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3d5e9e86-ffbf-4d4c-a90b-23db5328b53a tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.074939 Oct 29 02:45:56.832934 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 53/122] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:56.847730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ab9edc37-38fb-491b-8fe9-866c12fd61e3 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Calling method '.version_select at 0x7fe1a93f4f70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.850254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab9edc37-38fb-491b-8fe9-866c12fd61e3 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.850724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab9edc37-38fb-491b-8fe9-866c12fd61e3 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.851346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab9edc37-38fb-491b-8fe9-866c12fd61e3 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.867139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab9edc37-38fb-491b-8fe9-866c12fd61e3 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.868039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab9edc37-38fb-491b-8fe9-866c12fd61e3 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.868533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1b4b7561-183e-4c13-ba2c-3e34a99783cd tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Calling method '.version_select at 0x7fe1a9634c10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.868804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab9edc37-38fb-491b-8fe9-866c12fd61e3 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.870842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b4b7561-183e-4c13-ba2c-3e34a99783cd tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.871570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b4b7561-183e-4c13-ba2c-3e34a99783cd tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.872381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b4b7561-183e-4c13-ba2c-3e34a99783cd tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.878308 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ab9edc37-38fb-491b-8fe9-866c12fd61e3 tempest-HypervisorAdminUnderV252Test-831652491 tempest-HypervisorAdminUnderV252Test-831652491-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h2-862964-4/search" status: 200 len: 104 microversion: 2.1 time: 0.034569 Oct 29 02:45:56.886930 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 54/123] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/os-hypervisors/n-h2-862964-4/search => generated 104 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:56.930045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b4b7561-183e-4c13-ba2c-3e34a99783cd tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.931818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b4b7561-183e-4c13-ba2c-3e34a99783cd tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.933034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b4b7561-183e-4c13-ba2c-3e34a99783cd tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.959874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b4b7561-183e-4c13-ba2c-3e34a99783cd tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.960350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b4b7561-183e-4c13-ba2c-3e34a99783cd tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.960944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b4b7561-183e-4c13-ba2c-3e34a99783cd tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.972812 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1b4b7561-183e-4c13-ba2c-3e34a99783cd tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.191923 Oct 29 02:45:56.973991 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 70/124] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:56.986854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b76a57f-d260-4701-97b6-f35d7078015e tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Calling method '.version_select at 0x7fe1a93921f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.989737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b76a57f-d260-4701-97b6-f35d7078015e tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'cfcf745cf2ea4c88b724b34ff179beca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4a4c1ee62949eca8e063748bea9e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b76a57f-d260-4701-97b6-f35d7078015e tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Request method failure captured: Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPfXVRLn20mXtW6Nb86sAycP9_7-SnllE17QAUwUbj0m_urH99M3JD0DOs0iD01tcLWD9BzTXtw6lXOECOlTpgyufrIba-Gm6Bo0pTs27fOcMbpwN5NPMQCjCx8xzN-I7sF3eikeE4MVoJNSD3chNJsDEzElmvuiod4Rb0_jMBpXG0 Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 0f4a4c1ee62949eca8e063748bea9e33 Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:45:56.992952 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f4a4c1ee62949eca8e063748bea9e33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4a4c1ee62949eca8e063748bea9e33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f4a4c1ee62949eca8e063748bea9e33", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4a4c1ee62949eca8e063748bea9e33"}]}] Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 0f4a4c1ee62949eca8e063748bea9e33 Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HypervisorAdminNegativeTestJSON-836676319-project Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cfcf745cf2ea4c88b724b34ff179beca Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-836676319-project Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1'} Oct 29 02:45:56.994094 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:56.994884 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 02:45:56.996177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:56.998269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b76a57f-d260-4701-97b6-f35d7078015e tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:57.000023 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b76a57f-d260-4701-97b6-f35d7078015e tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018788 Oct 29 02:45:57.001195 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 55/125] 10.222.0.16 () {58 vars in 1173 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:45:57.011543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95e19cb0-36c6-4276-bca8-9cb377733f69 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Calling method '.version_select at 0x7fe1a96345e0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:57.015033 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-95e19cb0-36c6-4276-bca8-9cb377733f69 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] HTTP exception thrown: Hypervisor with ID '347cecaa-d553-43d9-ab8f-78032862138f' could not be found. Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95e19cb0-36c6-4276-bca8-9cb377733f69 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Request method failure captured: Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-hypervisors/347cecaa-d553-43d9-ab8f-78032862138f/uptime HTTP/1.1 Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPhwEydXnMx9nHhwiYTfAuSi6ptdpG_Riu81WMcwQxR5T9txjNZ5hoqMQhGUtA7zy-62JozLLn5fg40VtQ_ASTFMgPqt9ih64UhlTPOF-RNtsr6vl5IOYgvtMBgD-52sbO5twDcRkHBQAie4h6i58ZPyW7Yq5W-PSVyM9UqFLIHg28 Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b1549f1fa70846c58b639a628684668d Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-306508292 Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:45:57.026360 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b1549f1fa70846c58b639a628684668d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b1549f1fa70846c58b639a628684668d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b1549f1fa70846c58b639a628684668d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b1549f1fa70846c58b639a628684668d"}]}] Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-306508292 Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b1549f1fa70846c58b639a628684668d Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-306508292 Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9cd65497589949e6a8513d7410740a15 Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: exception: Hypervisor with ID '347cecaa-d553-43d9-ab8f-78032862138f' could not be found. Oct 29 02:45:57.027541 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '347cecaa-d553-43d9-ab8f-78032862138f'} Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '347cecaa-d553-43d9-ab8f-78032862138f' Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 29 02:45:57.028399 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '347cecaa-d553-43d9-ab8f-78032862138f' could not be found. Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:57.029505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.030605 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.030605 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:57.030605 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:57.030605 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:57.030605 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:57.030605 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '347cecaa-d553-43d9-ab8f-78032862138f' could not be found. Oct 29 02:45:57.030605 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.030605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95e19cb0-36c6-4276-bca8-9cb377733f69 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Returning 404 to user: Hypervisor with ID '347cecaa-d553-43d9-ab8f-78032862138f' could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:57.030605 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-95e19cb0-36c6-4276-bca8-9cb377733f69 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/347cecaa-d553-43d9-ab8f-78032862138f/uptime" status: 404 len: 123 microversion: 2.1 time: 0.021418 Oct 29 02:45:57.030605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 71/126] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Oct 29 02:45:57 2022] GET /compute/v2.1/os-hypervisors/347cecaa-d553-43d9-ab8f-78032862138f/uptime => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:57.038555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d8171fed-07c6-47a9-8140-fe3f2f6ab4b2 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Calling method '.version_select at 0x7fe1a9342160>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:57.040460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8171fed-07c6-47a9-8140-fe3f2f6ab4b2 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.040977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8171fed-07c6-47a9-8140-fe3f2f6ab4b2 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.041401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8171fed-07c6-47a9-8140-fe3f2f6ab4b2 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.065390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8171fed-07c6-47a9-8140-fe3f2f6ab4b2 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.066331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8171fed-07c6-47a9-8140-fe3f2f6ab4b2 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.066909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8171fed-07c6-47a9-8140-fe3f2f6ab4b2 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.079764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8171fed-07c6-47a9-8140-fe3f2f6ab4b2 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.080454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8171fed-07c6-47a9-8140-fe3f2f6ab4b2 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.081027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8171fed-07c6-47a9-8140-fe3f2f6ab4b2 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.088914 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d8171fed-07c6-47a9-8140-fe3f2f6ab4b2 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053783 Oct 29 02:45:57.089922 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 56/127] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:57.101722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-096b92bc-e9cf-4485-b478-8b4c8c2702ab tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Calling method '.version_select at 0x7fe1a95f2ee0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:57.103764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-096b92bc-e9cf-4485-b478-8b4c8c2702ab tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'cfcf745cf2ea4c88b724b34ff179beca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4a4c1ee62949eca8e063748bea9e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-096b92bc-e9cf-4485-b478-8b4c8c2702ab tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Request method failure captured: Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPfXVRLn20mXtW6Nb86sAycP9_7-SnllE17QAUwUbj0m_urH99M3JD0DOs0iD01tcLWD9BzTXtw6lXOECOlTpgyufrIba-Gm6Bo0pTs27fOcMbpwN5NPMQCjCx8xzN-I7sF3eikeE4MVoJNSD3chNJsDEzElmvuiod4Rb0_jMBpXG0 Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 0f4a4c1ee62949eca8e063748bea9e33 Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:45:57.105505 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f4a4c1ee62949eca8e063748bea9e33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4a4c1ee62949eca8e063748bea9e33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f4a4c1ee62949eca8e063748bea9e33", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4a4c1ee62949eca8e063748bea9e33"}]}] Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 0f4a4c1ee62949eca8e063748bea9e33 Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-836676319 Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HypervisorAdminNegativeTestJSON-836676319-project Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cfcf745cf2ea4c88b724b34ff179beca Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-836676319-project Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1'} Oct 29 02:45:57.106818 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:57.107476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 02:45:57.108422 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.109377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-096b92bc-e9cf-4485-b478-8b4c8c2702ab tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:57.109377 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-096b92bc-e9cf-4485-b478-8b4c8c2702ab tempest-HypervisorAdminNegativeTestJSON-836676319 tempest-HypervisorAdminNegativeTestJSON-836676319-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009296 Oct 29 02:45:57.111657 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 72/128] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:57.117168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6dbe989f-f658-48aa-b867-cf1f1c4e8624 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Calling method '.version_select at 0x7fe1a95e8d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:57.118838 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-6dbe989f-f658-48aa-b867-cf1f1c4e8624 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] HTTP exception thrown: Hypervisor with ID '10d62172-1fbe-417f-9cb2-62b4f991dfdb' could not be found. Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6dbe989f-f658-48aa-b867-cf1f1c4e8624 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Request method failure captured: Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hypervisors/10d62172-1fbe-417f-9cb2-62b4f991dfdb HTTP/1.1 Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPhwEydXnMx9nHhwiYTfAuSi6ptdpG_Riu81WMcwQxR5T9txjNZ5hoqMQhGUtA7zy-62JozLLn5fg40VtQ_ASTFMgPqt9ih64UhlTPOF-RNtsr6vl5IOYgvtMBgD-52sbO5twDcRkHBQAie4h6i58ZPyW7Yq5W-PSVyM9UqFLIHg28 Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b1549f1fa70846c58b639a628684668d Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-306508292 Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:45:57.121754 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b1549f1fa70846c58b639a628684668d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b1549f1fa70846c58b639a628684668d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b1549f1fa70846c58b639a628684668d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b1549f1fa70846c58b639a628684668d"}]}] Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-306508292 Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b1549f1fa70846c58b639a628684668d Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-306508292 Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9cd65497589949e6a8513d7410740a15 Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: exception: Hypervisor with ID '10d62172-1fbe-417f-9cb2-62b4f991dfdb' could not be found. Oct 29 02:45:57.123342 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '10d62172-1fbe-417f-9cb2-62b4f991dfdb'} Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '10d62172-1fbe-417f-9cb2-62b4f991dfdb' Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 29 02:45:57.124035 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:45:57.125208 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '10d62172-1fbe-417f-9cb2-62b4f991dfdb' could not be found. Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '10d62172-1fbe-417f-9cb2-62b4f991dfdb' could not be found. Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6dbe989f-f658-48aa-b867-cf1f1c4e8624 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] Returning 404 to user: Hypervisor with ID '10d62172-1fbe-417f-9cb2-62b4f991dfdb' could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6dbe989f-f658-48aa-b867-cf1f1c4e8624 tempest-HypervisorAdminNegativeTestJSON-306508292 tempest-HypervisorAdminNegativeTestJSON-306508292-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/10d62172-1fbe-417f-9cb2-62b4f991dfdb" status: 404 len: 123 microversion: 2.1 time: 0.010106 Oct 29 02:45:57.126240 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 57/129] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Oct 29 02:45:57 2022] GET /compute/v2.1/os-hypervisors/10d62172-1fbe-417f-9cb2-62b4f991dfdb => generated 123 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:57.160965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ed9d28f-4771-4149-9816-5b61efa634e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:57.161453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ed9d28f-4771-4149-9816-5b61efa634e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:57.167286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ed9d28f-4771-4149-9816-5b61efa634e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.167825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ed9d28f-4771-4149-9816-5b61efa634e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.168267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ed9d28f-4771-4149-9816-5b61efa634e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.168982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ed9d28f-4771-4149-9816-5b61efa634e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.169424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ed9d28f-4771-4149-9816-5b61efa634e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.169834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ed9d28f-4771-4149-9816-5b61efa634e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.321207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ed9d28f-4771-4149-9816-5b61efa634e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:57.332582 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ed9d28f-4771-4149-9816-5b61efa634e5 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1320 microversion: 2.1 time: 0.176291 Oct 29 02:45:57.333504 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 73/130] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:57 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:57.572810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1e09f935-a9e0-4111-a6db-3d8dc36c2bd1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:57.573400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1e09f935-a9e0-4111-a6db-3d8dc36c2bd1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:57.580563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09f935-a9e0-4111-a6db-3d8dc36c2bd1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.581413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09f935-a9e0-4111-a6db-3d8dc36c2bd1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.581942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09f935-a9e0-4111-a6db-3d8dc36c2bd1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.582711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09f935-a9e0-4111-a6db-3d8dc36c2bd1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.583205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09f935-a9e0-4111-a6db-3d8dc36c2bd1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.583833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09f935-a9e0-4111-a6db-3d8dc36c2bd1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.667152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1e09f935-a9e0-4111-a6db-3d8dc36c2bd1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:57.676653 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1e09f935-a9e0-4111-a6db-3d8dc36c2bd1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1236 microversion: 2.1 time: 0.107577 Oct 29 02:45:57.677612 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 58/131] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:57 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1236 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:57.680683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b37a987e-39b8-4097-9cf8-05595514c149 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:57.683342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b37a987e-39b8-4097-9cf8-05595514c149 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:57.691725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b37a987e-39b8-4097-9cf8-05595514c149 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.692479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b37a987e-39b8-4097-9cf8-05595514c149 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.693127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b37a987e-39b8-4097-9cf8-05595514c149 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.694112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b37a987e-39b8-4097-9cf8-05595514c149 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.694886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b37a987e-39b8-4097-9cf8-05595514c149 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.695340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b37a987e-39b8-4097-9cf8-05595514c149 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.801559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ab2783fd-3e93-4b07-95b1-ef9b4234c1c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:57.802551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ab2783fd-3e93-4b07-95b1-ef9b4234c1c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:57.809090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab2783fd-3e93-4b07-95b1-ef9b4234c1c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.809790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab2783fd-3e93-4b07-95b1-ef9b4234c1c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.810428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab2783fd-3e93-4b07-95b1-ef9b4234c1c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.811356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab2783fd-3e93-4b07-95b1-ef9b4234c1c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.812514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab2783fd-3e93-4b07-95b1-ef9b4234c1c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.813277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab2783fd-3e93-4b07-95b1-ef9b4234c1c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.868629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b37a987e-39b8-4097-9cf8-05595514c149 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:57.877795 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b37a987e-39b8-4097-9cf8-05595514c149 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.209002 Oct 29 02:45:57.878660 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 74/132] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:57 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:57.898173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ab2783fd-3e93-4b07-95b1-ef9b4234c1c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:57.912005 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ab2783fd-3e93-4b07-95b1-ef9b4234c1c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1335 microversion: 2.1 time: 0.115159 Oct 29 02:45:57.916964 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 59/133] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:57 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:58.355947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a8f696b4-7690-4aad-b33b-ac2631bb366a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:58.356555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a8f696b4-7690-4aad-b33b-ac2631bb366a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:58.362981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f696b4-7690-4aad-b33b-ac2631bb366a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:58.363671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f696b4-7690-4aad-b33b-ac2631bb366a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:58.364268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f696b4-7690-4aad-b33b-ac2631bb366a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:58.365139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f696b4-7690-4aad-b33b-ac2631bb366a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:58.365588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f696b4-7690-4aad-b33b-ac2631bb366a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:58.366034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f696b4-7690-4aad-b33b-ac2631bb366a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:58.554963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a8f696b4-7690-4aad-b33b-ac2631bb366a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:58.566149 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a8f696b4-7690-4aad-b33b-ac2631bb366a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1320 microversion: 2.1 time: 0.214057 Oct 29 02:45:58.566839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 75/134] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:58 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:58.702883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d1736ada-e66e-468d-9dd9-d3f82271d0fb tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:58.704134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d1736ada-e66e-468d-9dd9-d3f82271d0fb tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:58.711180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1736ada-e66e-468d-9dd9-d3f82271d0fb tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:58.712110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1736ada-e66e-468d-9dd9-d3f82271d0fb tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:58.712545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1736ada-e66e-468d-9dd9-d3f82271d0fb tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:58.713412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1736ada-e66e-468d-9dd9-d3f82271d0fb tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:58.713887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1736ada-e66e-468d-9dd9-d3f82271d0fb tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:58.714794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1736ada-e66e-468d-9dd9-d3f82271d0fb tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:58.903301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e4205541-63eb-426f-b190-a39b0d4b23ae tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:58.904196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e4205541-63eb-426f-b190-a39b0d4b23ae tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:58.912858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4205541-63eb-426f-b190-a39b0d4b23ae tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:58.914127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4205541-63eb-426f-b190-a39b0d4b23ae tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:58.915033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4205541-63eb-426f-b190-a39b0d4b23ae tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:58.916420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4205541-63eb-426f-b190-a39b0d4b23ae tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:58.918336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4205541-63eb-426f-b190-a39b0d4b23ae tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:58.920063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4205541-63eb-426f-b190-a39b0d4b23ae tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:58.920358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1736ada-e66e-468d-9dd9-d3f82271d0fb tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:58.930072 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d1736ada-e66e-468d-9dd9-d3f82271d0fb tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1236 microversion: 2.1 time: 0.232686 Oct 29 02:45:58.941826 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 60/135] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:58 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1236 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:58.941826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a91e1de1-950c-4560-9abe-438adb69ae78 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:58.941826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a91e1de1-950c-4560-9abe-438adb69ae78 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:58.950589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a91e1de1-950c-4560-9abe-438adb69ae78 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:58.951295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a91e1de1-950c-4560-9abe-438adb69ae78 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:58.952321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a91e1de1-950c-4560-9abe-438adb69ae78 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:58.953718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a91e1de1-950c-4560-9abe-438adb69ae78 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:58.955301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a91e1de1-950c-4560-9abe-438adb69ae78 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:58.956309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a91e1de1-950c-4560-9abe-438adb69ae78 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.034507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a91e1de1-950c-4560-9abe-438adb69ae78 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:59.044240 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a91e1de1-950c-4560-9abe-438adb69ae78 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1335 microversion: 2.1 time: 0.108095 Oct 29 02:45:59.045546 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 61/136] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:58 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:59.078271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e4205541-63eb-426f-b190-a39b0d4b23ae tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:59.086208 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e4205541-63eb-426f-b190-a39b0d4b23ae tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.188883 Oct 29 02:45:59.086769 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 76/137] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:58 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:59.594387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-748dcdba-dbea-4ea9-af5d-80a6d3ee10db tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:59.595318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-748dcdba-dbea-4ea9-af5d-80a6d3ee10db tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:59.602668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-748dcdba-dbea-4ea9-af5d-80a6d3ee10db tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.603568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-748dcdba-dbea-4ea9-af5d-80a6d3ee10db tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.604278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-748dcdba-dbea-4ea9-af5d-80a6d3ee10db tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.617619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-748dcdba-dbea-4ea9-af5d-80a6d3ee10db tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.618371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-748dcdba-dbea-4ea9-af5d-80a6d3ee10db tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.618801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-748dcdba-dbea-4ea9-af5d-80a6d3ee10db tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.889851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-748dcdba-dbea-4ea9-af5d-80a6d3ee10db tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:59.898251 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-748dcdba-dbea-4ea9-af5d-80a6d3ee10db tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1320 microversion: 2.1 time: 0.309364 Oct 29 02:45:59.913827 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 62/138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:59 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1320 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:59.954660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cb85be2c-c83c-4546-a2c7-f97c270d7133 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:59.955564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cb85be2c-c83c-4546-a2c7-f97c270d7133 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:59.962598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb85be2c-c83c-4546-a2c7-f97c270d7133 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.963311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb85be2c-c83c-4546-a2c7-f97c270d7133 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.963939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb85be2c-c83c-4546-a2c7-f97c270d7133 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.964927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb85be2c-c83c-4546-a2c7-f97c270d7133 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.965443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb85be2c-c83c-4546-a2c7-f97c270d7133 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.966187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb85be2c-c83c-4546-a2c7-f97c270d7133 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.056131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cb85be2c-c83c-4546-a2c7-f97c270d7133 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:00.065095 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cb85be2c-c83c-4546-a2c7-f97c270d7133 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1292 microversion: 2.1 time: 0.114429 Oct 29 02:46:00.065682 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 77/139] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:59 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1292 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:00.068731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f5a397e-0b48-40d0-aa80-b88a384974fc tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:00.069689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1f5a397e-0b48-40d0-aa80-b88a384974fc tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:00.076918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5a397e-0b48-40d0-aa80-b88a384974fc tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.078972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5a397e-0b48-40d0-aa80-b88a384974fc tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.080066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5a397e-0b48-40d0-aa80-b88a384974fc tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.082026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5a397e-0b48-40d0-aa80-b88a384974fc tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.082481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5a397e-0b48-40d0-aa80-b88a384974fc tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.084917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5a397e-0b48-40d0-aa80-b88a384974fc tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.111999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-336af13b-9ab8-410c-87bb-928fb1197058 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:00.112621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-336af13b-9ab8-410c-87bb-928fb1197058 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:00.121672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336af13b-9ab8-410c-87bb-928fb1197058 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.122318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336af13b-9ab8-410c-87bb-928fb1197058 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.122748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336af13b-9ab8-410c-87bb-928fb1197058 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.123444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336af13b-9ab8-410c-87bb-928fb1197058 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.123882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336af13b-9ab8-410c-87bb-928fb1197058 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.124290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336af13b-9ab8-410c-87bb-928fb1197058 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.168337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1f5a397e-0b48-40d0-aa80-b88a384974fc tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:00.179200 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1f5a397e-0b48-40d0-aa80-b88a384974fc tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1341 microversion: 2.1 time: 0.114197 Oct 29 02:46:00.180370 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 63/140] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:00 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1341 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:00.407356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-336af13b-9ab8-410c-87bb-928fb1197058 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:00.417170 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-336af13b-9ab8-410c-87bb-928fb1197058 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.311531 Oct 29 02:46:00.430128 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 78/141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:00 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:00.803827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Calling method '.version_select at 0x7fe1a94451f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:00.807692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.810594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.811041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.832260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ed528fe4-31da-43b0-a301-875cb06b2fd9 tempest-NetworksTest-1303509946 tempest-NetworksTest-1303509946-project-admin] Calling method '.version_select at 0x7fe1a96d5f70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:00.843982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.844643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.845306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.875858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.876950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.878156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.892819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.894005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.894969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.921003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.921963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.922582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.930711 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-67dc0422-f36a-422e-a4c8-c01a9027348c tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.471979 Oct 29 02:46:00.932455 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 64/142] 10.222.0.16 () {60 vars in 1243 bytes} [Sat Oct 29 02:46:00 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:00.937729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f11bbf8c-2dbe-44dd-b920-289db625d25b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:00.938525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f11bbf8c-2dbe-44dd-b920-289db625d25b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:00.944634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f11bbf8c-2dbe-44dd-b920-289db625d25b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.945267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f11bbf8c-2dbe-44dd-b920-289db625d25b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.945853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f11bbf8c-2dbe-44dd-b920-289db625d25b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.946685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f11bbf8c-2dbe-44dd-b920-289db625d25b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.947272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f11bbf8c-2dbe-44dd-b920-289db625d25b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.947852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f11bbf8c-2dbe-44dd-b920-289db625d25b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.234030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f11bbf8c-2dbe-44dd-b920-289db625d25b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:01.258279 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f11bbf8c-2dbe-44dd-b920-289db625d25b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1320 microversion: 2.1 time: 0.323709 Oct 29 02:46:01.262263 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 65/143] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:00 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:01.277191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Calling method '.version_select at 0x7fe1a93aaca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:01.295374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.297290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.297738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.321578 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ed528fe4-31da-43b0-a301-875cb06b2fd9 tempest-NetworksTest-1303509946 tempest-NetworksTest-1303509946-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.596626 Oct 29 02:46:01.323294 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 79/144] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:46:00 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:01.328906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7f1b2e8-4ba7-4088-92cd-b070f2e8be31 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:01.329878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7f1b2e8-4ba7-4088-92cd-b070f2e8be31 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:01.330435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.330932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.331364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.341227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7f1b2e8-4ba7-4088-92cd-b070f2e8be31 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.347087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7f1b2e8-4ba7-4088-92cd-b070f2e8be31 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.347686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7f1b2e8-4ba7-4088-92cd-b070f2e8be31 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.348572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7f1b2e8-4ba7-4088-92cd-b070f2e8be31 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.349166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7f1b2e8-4ba7-4088-92cd-b070f2e8be31 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.349755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7f1b2e8-4ba7-4088-92cd-b070f2e8be31 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.386046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.386683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.387366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.413590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.414119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.414548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.457504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.458297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.458887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.466122 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5781df17-3f33-4c35-80ac-539989993f2d tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.202679 Oct 29 02:46:01.467283 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 66/145] 10.222.0.16 () {60 vars in 1222 bytes} [Sat Oct 29 02:46:01 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:01.472304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c7baf956-3436-4bca-95fb-7efc4d3a2e04 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:01.473086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c7baf956-3436-4bca-95fb-7efc4d3a2e04 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:01.479267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7baf956-3436-4bca-95fb-7efc4d3a2e04 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.480390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7baf956-3436-4bca-95fb-7efc4d3a2e04 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.480986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7baf956-3436-4bca-95fb-7efc4d3a2e04 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.481873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7baf956-3436-4bca-95fb-7efc4d3a2e04 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.482843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7baf956-3436-4bca-95fb-7efc4d3a2e04 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.483415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7baf956-3436-4bca-95fb-7efc4d3a2e04 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.498264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c7f1b2e8-4ba7-4088-92cd-b070f2e8be31 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:01.507694 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7f1b2e8-4ba7-4088-92cd-b070f2e8be31 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1298 microversion: 2.1 time: 0.183110 Oct 29 02:46:01.508490 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 80/146] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:01 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1298 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:01.513258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ddac32ff-ec54-4e40-b1db-205ef0a06947 tempest-NetworksTest-1303509946 tempest-NetworksTest-1303509946-project-admin] Calling method '.version_select at 0x7fe1a9673700>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:01.750695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c7baf956-3436-4bca-95fb-7efc4d3a2e04 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:01.752964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:01.760944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c7baf956-3436-4bca-95fb-7efc4d3a2e04 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1409 microversion: 2.1 time: 0.292467 Oct 29 02:46:01.774910 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ddac32ff-ec54-4e40-b1db-205ef0a06947 tempest-NetworksTest-1303509946 tempest-NetworksTest-1303509946-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/33d3c2b4-c2e6-474a-853d-aec58c82b226" status: 200 len: 652 microversion: 2.1 time: 0.265228 Oct 29 02:46:01.780209 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 81/147] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 02:46:01 2022] GET /compute/v2.1/os-networks/33d3c2b4-c2e6-474a-853d-aec58c82b226 => generated 652 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:01.795356 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 67/148] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:01 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1409 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:01.797216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8895017b-cd63-4d29-8383-a4e0cb77d65d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:01.798004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8895017b-cd63-4d29-8383-a4e0cb77d65d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:01.800986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b419d35-f1fe-456e-a2cb-2aa29002f10e tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Calling method '.version_select at 0x7fe1a9392700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:01.804724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b419d35-f1fe-456e-a2cb-2aa29002f10e tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.805398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b419d35-f1fe-456e-a2cb-2aa29002f10e tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.806018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b419d35-f1fe-456e-a2cb-2aa29002f10e tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.826535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b419d35-f1fe-456e-a2cb-2aa29002f10e tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.827334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b419d35-f1fe-456e-a2cb-2aa29002f10e tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.828090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8895017b-cd63-4d29-8383-a4e0cb77d65d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.828569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b419d35-f1fe-456e-a2cb-2aa29002f10e tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.828849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8895017b-cd63-4d29-8383-a4e0cb77d65d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.829511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8895017b-cd63-4d29-8383-a4e0cb77d65d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.830502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8895017b-cd63-4d29-8383-a4e0cb77d65d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.831275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8895017b-cd63-4d29-8383-a4e0cb77d65d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.831917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8895017b-cd63-4d29-8383-a4e0cb77d65d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.837438 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b419d35-f1fe-456e-a2cb-2aa29002f10e tempest-HypervisorAdminV253TestBase-102739302 tempest-HypervisorAdminV253TestBase-102739302-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/f3c284c6-58c0-4824-b865-1dd078ec00c6" status: 200 len: 792 microversion: 2.53 time: 0.040669 Oct 29 02:46:01.840280 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 68/149] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Oct 29 02:46:01 2022] GET /compute/v2.1/os-hypervisors/f3c284c6-58c0-4824-b865-1dd078ec00c6 => generated 792 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:01.844972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83717b74-daec-4bb9-a1d6-e2e58025f2fb tempest-NetworksTest-1303509946 tempest-NetworksTest-1303509946-project-admin] Calling method '.version_select at 0x7fe1a93aa700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.108344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8895017b-cd63-4d29-8383-a4e0cb77d65d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:02.117733 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8895017b-cd63-4d29-8383-a4e0cb77d65d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.336115 Oct 29 02:46:02.122384 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 82/150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:01 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:02.201334 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-83717b74-daec-4bb9-a1d6-e2e58025f2fb tempest-NetworksTest-1303509946 tempest-NetworksTest-1303509946-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.359776 Oct 29 02:46:02.203675 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 69/151] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:46:01 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:02.283315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a4b31c9b-2f35-432c-87a7-7301d5c3d413 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.284400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a4b31c9b-2f35-432c-87a7-7301d5c3d413 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:02.297068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4b31c9b-2f35-432c-87a7-7301d5c3d413 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.299087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4b31c9b-2f35-432c-87a7-7301d5c3d413 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.300421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4b31c9b-2f35-432c-87a7-7301d5c3d413 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.302610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4b31c9b-2f35-432c-87a7-7301d5c3d413 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.304103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4b31c9b-2f35-432c-87a7-7301d5c3d413 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.307072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4b31c9b-2f35-432c-87a7-7301d5c3d413 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.332029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-522d8d5b-648c-47de-aa77-b1c52366033d req-33bc40a6-76c9-47eb-b4f5-b9db694dda6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e905f88b-7b01-4091-946f-fa0e0abdab0d", "tag": "363f1891-2fd3-41b7-8910-0ec693798817"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:02.361054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-522d8d5b-648c-47de-aa77-b1c52366033d req-33bc40a6-76c9-47eb-b4f5-b9db694dda6c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.365782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-522d8d5b-648c-47de-aa77-b1c52366033d req-33bc40a6-76c9-47eb-b4f5-b9db694dda6c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.366442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-522d8d5b-648c-47de-aa77-b1c52366033d req-33bc40a6-76c9-47eb-b4f5-b9db694dda6c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.406726 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-522d8d5b-648c-47de-aa77-b1c52366033d req-33bc40a6-76c9-47eb-b4f5-b9db694dda6c service nova] Creating event network-changed:363f1891-2fd3-41b7-8910-0ec693798817 for instance e905f88b-7b01-4091-946f-fa0e0abdab0d on n-h2-862964-4 Oct 29 02:46:02.420781 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-522d8d5b-648c-47de-aa77-b1c52366033d req-33bc40a6-76c9-47eb-b4f5-b9db694dda6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092839 Oct 29 02:46:02.421711 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 70/152] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:02.541705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa4daaf3-0cf6-444d-a52f-f43ecb1a50a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.547430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fa4daaf3-0cf6-444d-a52f-f43ecb1a50a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:02.566718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4daaf3-0cf6-444d-a52f-f43ecb1a50a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.567445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4daaf3-0cf6-444d-a52f-f43ecb1a50a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.568041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4daaf3-0cf6-444d-a52f-f43ecb1a50a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.568913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4daaf3-0cf6-444d-a52f-f43ecb1a50a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.570334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4daaf3-0cf6-444d-a52f-f43ecb1a50a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.570764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4daaf3-0cf6-444d-a52f-f43ecb1a50a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.619534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a4b31c9b-2f35-432c-87a7-7301d5c3d413 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:02.632108 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a4b31c9b-2f35-432c-87a7-7301d5c3d413 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1320 microversion: 2.1 time: 0.353170 Oct 29 02:46:02.633528 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 83/153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:02 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:02.853754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fa4daaf3-0cf6-444d-a52f-f43ecb1a50a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:02.861589 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fa4daaf3-0cf6-444d-a52f-f43ecb1a50a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1340 microversion: 2.1 time: 0.333090 Oct 29 02:46:02.864757 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 71/154] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:02 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1340 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:02.870571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ba6d5042-6f6b-4378-9514-a15b3a81a566 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.873331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ba6d5042-6f6b-4378-9514-a15b3a81a566 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:02.889347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba6d5042-6f6b-4378-9514-a15b3a81a566 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.889865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba6d5042-6f6b-4378-9514-a15b3a81a566 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.890293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba6d5042-6f6b-4378-9514-a15b3a81a566 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.890984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba6d5042-6f6b-4378-9514-a15b3a81a566 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.891422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba6d5042-6f6b-4378-9514-a15b3a81a566 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.891840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba6d5042-6f6b-4378-9514-a15b3a81a566 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.954264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-cd5f9e84-5ed6-4aaf-8ab5-0451cd5684a2 req-3437ad8e-15dd-40d1-8147-8d4dd7685d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333ee108-8b64-4be0-a8f8-5e6a558d81a4", "name": "network-vif-plugged", "status": "completed", "tag": "360018c1-5fa9-450f-800f-0d5e36d2f29e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:02.980200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cd5f9e84-5ed6-4aaf-8ab5-0451cd5684a2 req-3437ad8e-15dd-40d1-8147-8d4dd7685d7f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.982541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cd5f9e84-5ed6-4aaf-8ab5-0451cd5684a2 req-3437ad8e-15dd-40d1-8147-8d4dd7685d7f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.985003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cd5f9e84-5ed6-4aaf-8ab5-0451cd5684a2 req-3437ad8e-15dd-40d1-8147-8d4dd7685d7f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.011395 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-cd5f9e84-5ed6-4aaf-8ab5-0451cd5684a2 req-3437ad8e-15dd-40d1-8147-8d4dd7685d7f service nova] Creating event network-vif-plugged:360018c1-5fa9-450f-800f-0d5e36d2f29e for instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 on n-h1-862964-4 Oct 29 02:46:03.012167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cd5f9e84-5ed6-4aaf-8ab5-0451cd5684a2 req-3437ad8e-15dd-40d1-8147-8d4dd7685d7f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:46:03.012622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cd5f9e84-5ed6-4aaf-8ab5-0451cd5684a2 req-3437ad8e-15dd-40d1-8147-8d4dd7685d7f service nova] Acquired lock "compute-rpcapi-router" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:46:03.013854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a2d89c-0481-49fb-8da4-0eec4a74c2b0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.014312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a2d89c-0481-49fb-8da4-0eec4a74c2b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.014748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a2d89c-0481-49fb-8da4-0eec4a74c2b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.015462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a2d89c-0481-49fb-8da4-0eec4a74c2b0 None None] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.015897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a2d89c-0481-49fb-8da4-0eec4a74c2b0 None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.016295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a2d89c-0481-49fb-8da4-0eec4a74c2b0 None None] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.025714 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.compute.rpcapi [None req-05a2d89c-0481-49fb-8da4-0eec4a74c2b0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 29 02:46:03.026944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a2d89c-0481-49fb-8da4-0eec4a74c2b0 None None] Releasing lock "compute-rpcapi-router" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:46:03.046445 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-05a2d89c-0481-49fb-8da4-0eec4a74c2b0 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.410794 Oct 29 02:46:03.047679 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 84/155] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:03.143309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38d2a2b3-6e7b-4649-801c-47362d17d3dc tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:03.144994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-38d2a2b3-6e7b-4649-801c-47362d17d3dc tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:03.156828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38d2a2b3-6e7b-4649-801c-47362d17d3dc tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.157740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38d2a2b3-6e7b-4649-801c-47362d17d3dc tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.159841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38d2a2b3-6e7b-4649-801c-47362d17d3dc tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.160558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38d2a2b3-6e7b-4649-801c-47362d17d3dc tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.161284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38d2a2b3-6e7b-4649-801c-47362d17d3dc tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.161412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38d2a2b3-6e7b-4649-801c-47362d17d3dc tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.341194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ba6d5042-6f6b-4378-9514-a15b3a81a566 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:03.350349 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ba6d5042-6f6b-4378-9514-a15b3a81a566 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1409 microversion: 2.1 time: 0.483634 Oct 29 02:46:03.351214 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 72/156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:02 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1409 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:03.355967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f8ef7950-e4d9-4ad2-974e-4447cc670fd1 req-bc8fe8ff-79af-4a54-9539-6d8ec831f00e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bec03293-594f-445f-8d70-7072771a2366", "tag": "2abbbf39-789a-4939-9e8e-44c7d7925ce7"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:03.365786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f8ef7950-e4d9-4ad2-974e-4447cc670fd1 req-bc8fe8ff-79af-4a54-9539-6d8ec831f00e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.366317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f8ef7950-e4d9-4ad2-974e-4447cc670fd1 req-bc8fe8ff-79af-4a54-9539-6d8ec831f00e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.366778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f8ef7950-e4d9-4ad2-974e-4447cc670fd1 req-bc8fe8ff-79af-4a54-9539-6d8ec831f00e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.380639 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f8ef7950-e4d9-4ad2-974e-4447cc670fd1 req-bc8fe8ff-79af-4a54-9539-6d8ec831f00e service nova] Creating event network-changed:2abbbf39-789a-4939-9e8e-44c7d7925ce7 for instance bec03293-594f-445f-8d70-7072771a2366 on n-h2-862964-4 Oct 29 02:46:03.388521 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f8ef7950-e4d9-4ad2-974e-4447cc670fd1 req-bc8fe8ff-79af-4a54-9539-6d8ec831f00e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035873 Oct 29 02:46:03.388709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-38d2a2b3-6e7b-4649-801c-47362d17d3dc tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:03.389138 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 73/157] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:03.399094 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-38d2a2b3-6e7b-4649-801c-47362d17d3dc tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.261527 Oct 29 02:46:03.399878 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 85/158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:03 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:03.656208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e386f203-6cc4-4383-8b00-55f3d1d6716b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:03.656906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e386f203-6cc4-4383-8b00-55f3d1d6716b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:03.666292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e386f203-6cc4-4383-8b00-55f3d1d6716b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.666783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e386f203-6cc4-4383-8b00-55f3d1d6716b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.667361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e386f203-6cc4-4383-8b00-55f3d1d6716b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.668125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e386f203-6cc4-4383-8b00-55f3d1d6716b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.671107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e386f203-6cc4-4383-8b00-55f3d1d6716b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.672647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e386f203-6cc4-4383-8b00-55f3d1d6716b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.838437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e386f203-6cc4-4383-8b00-55f3d1d6716b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:03.847435 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e386f203-6cc4-4383-8b00-55f3d1d6716b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1320 microversion: 2.1 time: 0.195478 Oct 29 02:46:03.848476 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 74/159] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:03 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:03.887793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-55348b2b-4c2f-4166-8121-c748b6ead184 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:03.888651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-55348b2b-4c2f-4166-8121-c748b6ead184 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:03.895348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55348b2b-4c2f-4166-8121-c748b6ead184 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.896011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55348b2b-4c2f-4166-8121-c748b6ead184 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.896645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55348b2b-4c2f-4166-8121-c748b6ead184 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.897481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55348b2b-4c2f-4166-8121-c748b6ead184 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.898014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55348b2b-4c2f-4166-8121-c748b6ead184 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.898726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55348b2b-4c2f-4166-8121-c748b6ead184 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.040299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-55348b2b-4c2f-4166-8121-c748b6ead184 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:04.048517 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-55348b2b-4c2f-4166-8121-c748b6ead184 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1340 microversion: 2.1 time: 0.164806 Oct 29 02:46:04.049366 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 86/160] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:03 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1340 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:04.373716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7982dce5-9249-4af6-a2b0-e1d692747d46 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:04.375534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7982dce5-9249-4af6-a2b0-e1d692747d46 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:04.388208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7982dce5-9249-4af6-a2b0-e1d692747d46 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.389647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7982dce5-9249-4af6-a2b0-e1d692747d46 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.392242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7982dce5-9249-4af6-a2b0-e1d692747d46 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.393859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7982dce5-9249-4af6-a2b0-e1d692747d46 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.394676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7982dce5-9249-4af6-a2b0-e1d692747d46 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.396236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7982dce5-9249-4af6-a2b0-e1d692747d46 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.423909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5ae0414-9eef-449f-979d-da76209b4a60 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:04.424701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f5ae0414-9eef-449f-979d-da76209b4a60 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:04.434337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ae0414-9eef-449f-979d-da76209b4a60 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.436347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ae0414-9eef-449f-979d-da76209b4a60 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.438064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ae0414-9eef-449f-979d-da76209b4a60 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.438962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ae0414-9eef-449f-979d-da76209b4a60 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.440794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ae0414-9eef-449f-979d-da76209b4a60 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.442691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ae0414-9eef-449f-979d-da76209b4a60 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.638956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7982dce5-9249-4af6-a2b0-e1d692747d46 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:04.648835 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7982dce5-9249-4af6-a2b0-e1d692747d46 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1409 microversion: 2.1 time: 0.279594 Oct 29 02:46:04.662225 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 75/161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:04 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1409 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:04.724303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f5ae0414-9eef-449f-979d-da76209b4a60 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:04.735721 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5ae0414-9eef-449f-979d-da76209b4a60 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.315406 Oct 29 02:46:04.737101 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 87/162] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:04 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:04.870982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7c9b0aa5-3d01-455d-9f03-891c86c2e5da tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:04.871938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7c9b0aa5-3d01-455d-9f03-891c86c2e5da tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:04.880895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c9b0aa5-3d01-455d-9f03-891c86c2e5da tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.883336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c9b0aa5-3d01-455d-9f03-891c86c2e5da tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.883849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c9b0aa5-3d01-455d-9f03-891c86c2e5da tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.884781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c9b0aa5-3d01-455d-9f03-891c86c2e5da tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.888789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c9b0aa5-3d01-455d-9f03-891c86c2e5da tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.889722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c9b0aa5-3d01-455d-9f03-891c86c2e5da tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.071003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-41618be7-9d91-4c7f-9aa5-21ebfebc3397 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:05.071535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-41618be7-9d91-4c7f-9aa5-21ebfebc3397 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:05.081550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41618be7-9d91-4c7f-9aa5-21ebfebc3397 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.082205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41618be7-9d91-4c7f-9aa5-21ebfebc3397 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.082641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41618be7-9d91-4c7f-9aa5-21ebfebc3397 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.083352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41618be7-9d91-4c7f-9aa5-21ebfebc3397 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.083996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41618be7-9d91-4c7f-9aa5-21ebfebc3397 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.084507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41618be7-9d91-4c7f-9aa5-21ebfebc3397 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.147866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7c9b0aa5-3d01-455d-9f03-891c86c2e5da tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:05.156968 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7c9b0aa5-3d01-455d-9f03-891c86c2e5da tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1320 microversion: 2.1 time: 0.290711 Oct 29 02:46:05.158108 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 76/163] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:04 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:05.163841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-37c62a20-2eb6-4231-be7e-d478dcb4257c req-ba7d66c1-2f04-4f11-aabf-ac6c53d5abca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d968c73-0802-46ee-8972-e48ba3168aa6", "name": "network-vif-plugged", "status": "completed", "tag": "59b2502f-f81c-47a5-bc83-41d4db39aec4"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:05.173414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-37c62a20-2eb6-4231-be7e-d478dcb4257c req-ba7d66c1-2f04-4f11-aabf-ac6c53d5abca service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.174367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-37c62a20-2eb6-4231-be7e-d478dcb4257c req-ba7d66c1-2f04-4f11-aabf-ac6c53d5abca service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.174992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-37c62a20-2eb6-4231-be7e-d478dcb4257c req-ba7d66c1-2f04-4f11-aabf-ac6c53d5abca service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.191529 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-37c62a20-2eb6-4231-be7e-d478dcb4257c req-ba7d66c1-2f04-4f11-aabf-ac6c53d5abca service nova] Creating event network-vif-plugged:59b2502f-f81c-47a5-bc83-41d4db39aec4 for instance 8d968c73-0802-46ee-8972-e48ba3168aa6 on n-h2-862964-4 Oct 29 02:46:05.202014 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-37c62a20-2eb6-4231-be7e-d478dcb4257c req-ba7d66c1-2f04-4f11-aabf-ac6c53d5abca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042066 Oct 29 02:46:05.202631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 77/164] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:05.270762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-41618be7-9d91-4c7f-9aa5-21ebfebc3397 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:05.281867 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-41618be7-9d91-4c7f-9aa5-21ebfebc3397 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1340 microversion: 2.1 time: 0.211878 Oct 29 02:46:05.286197 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 88/165] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:05 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1340 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:05.675517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2d7f0fbb-ca4c-4d18-8697-a18a6c342902 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:05.677626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2d7f0fbb-ca4c-4d18-8697-a18a6c342902 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:05.680782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:05.684961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f0fbb-ca4c-4d18-8697-a18a6c342902 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.685768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f0fbb-ca4c-4d18-8697-a18a6c342902 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.686422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f0fbb-ca4c-4d18-8697-a18a6c342902 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.687643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f0fbb-ca4c-4d18-8697-a18a6c342902 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.688600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f0fbb-ca4c-4d18-8697-a18a6c342902 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.689199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f0fbb-ca4c-4d18-8697-a18a6c342902 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.762947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ce9f49d-ae0e-45fd-a88c-6ab3b5324f82 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:05.764036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3ce9f49d-ae0e-45fd-a88c-6ab3b5324f82 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:05.772111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ce9f49d-ae0e-45fd-a88c-6ab3b5324f82 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.772951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ce9f49d-ae0e-45fd-a88c-6ab3b5324f82 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.774676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ce9f49d-ae0e-45fd-a88c-6ab3b5324f82 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.775804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ce9f49d-ae0e-45fd-a88c-6ab3b5324f82 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.776755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ce9f49d-ae0e-45fd-a88c-6ab3b5324f82 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.777378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ce9f49d-ae0e-45fd-a88c-6ab3b5324f82 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.783473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:05.889784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d7f0fbb-ca4c-4d18-8697-a18a6c342902 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:05.901189 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2d7f0fbb-ca4c-4d18-8697-a18a6c342902 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1409 microversion: 2.1 time: 0.228472 Oct 29 02:46:05.901871 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 78/166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:05 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1409 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:05.997603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3ce9f49d-ae0e-45fd-a88c-6ab3b5324f82 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:06.007365 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3ce9f49d-ae0e-45fd-a88c-6ab3b5324f82 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.250717 Oct 29 02:46:06.008342 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 89/167] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:05 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:06.182748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-758355ea-7184-45a4-b802-e1fd28cedd19 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:06.183622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-758355ea-7184-45a4-b802-e1fd28cedd19 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:06.189668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758355ea-7184-45a4-b802-e1fd28cedd19 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.190420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758355ea-7184-45a4-b802-e1fd28cedd19 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.191027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758355ea-7184-45a4-b802-e1fd28cedd19 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.191886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758355ea-7184-45a4-b802-e1fd28cedd19 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.192480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758355ea-7184-45a4-b802-e1fd28cedd19 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.193044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758355ea-7184-45a4-b802-e1fd28cedd19 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.238282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:06.370552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-758355ea-7184-45a4-b802-e1fd28cedd19 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:06.378613 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-758355ea-7184-45a4-b802-e1fd28cedd19 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1470 microversion: 2.1 time: 0.199771 Oct 29 02:46:06.379320 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 90/168] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:06 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:06.384744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51f2c1d7-5a3e-49fe-b58e-f3066f646b76 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:06.385379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-51f2c1d7-5a3e-49fe-b58e-f3066f646b76 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:06.391143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f2c1d7-5a3e-49fe-b58e-f3066f646b76 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.391680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f2c1d7-5a3e-49fe-b58e-f3066f646b76 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.392748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f2c1d7-5a3e-49fe-b58e-f3066f646b76 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.393500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f2c1d7-5a3e-49fe-b58e-f3066f646b76 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.393981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f2c1d7-5a3e-49fe-b58e-f3066f646b76 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.394466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f2c1d7-5a3e-49fe-b58e-f3066f646b76 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.405096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1dbc3b61-acc2-4e01-b7b8-6ba6a962bb97 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Calling method '.version_select at 0x7fe1a9445670>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:06.469844 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1dbc3b61-acc2-4e01-b7b8-6ba6a962bb97 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/04e32cf324f34b2f83a492bc113da37f" status: 200 len: 371 microversion: 2.1 time: 0.405220 Oct 29 02:46:06.470562 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 79/169] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 02:46:06 2022] GET /compute/v2.1/os-quota-sets/04e32cf324f34b2f83a492bc113da37f => generated 371 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:06.525316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-830061911", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": "none"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:06.531587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-51f2c1d7-5a3e-49fe-b58e-f3066f646b76 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:06.539786 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-51f2c1d7-5a3e-49fe-b58e-f3066f646b76 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1340 microversion: 2.1 time: 0.159405 Oct 29 02:46:06.540343 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 91/170] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:06 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1340 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:06.596345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:06.596813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:06.597277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:06.597937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:06.598331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:06.608295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.609187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.609625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.610361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.611106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.611524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.629752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Getting quotas for project fa0ee86db58d4231a356e54307ccf6f2. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:06.633686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Getting quotas for user 5a3d655324ed4f23909beda9ceff0123 and project fa0ee86db58d4231a356e54307ccf6f2. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:06.646994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:06.649310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:06.675599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0b8a20fb-8238-4abc-8b19-72feb6587d7f tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:06.676219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0b8a20fb-8238-4abc-8b19-72feb6587d7f tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:06.683576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8a20fb-8238-4abc-8b19-72feb6587d7f tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.684143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8a20fb-8238-4abc-8b19-72feb6587d7f tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.684770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8a20fb-8238-4abc-8b19-72feb6587d7f tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.685796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8a20fb-8238-4abc-8b19-72feb6587d7f tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.686417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8a20fb-8238-4abc-8b19-72feb6587d7f tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.686980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8a20fb-8238-4abc-8b19-72feb6587d7f tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.698710 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0852aab3-4952-4060-93f9-d26df5da78bf tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.226874 Oct 29 02:46:06.699659 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 80/171] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:46:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 228 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:46:06.704399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-42a2a246-1802-4c5f-af0e-5c34646385a2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a93f4670>, body: {"quota_set": {"ram": "5120"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:06.766032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0b8a20fb-8238-4abc-8b19-72feb6587d7f tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:46:06.784440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:06.789648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42a2a246-1802-4c5f-af0e-5c34646385a2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.790224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42a2a246-1802-4c5f-af0e-5c34646385a2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.790771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42a2a246-1802-4c5f-af0e-5c34646385a2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.791560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42a2a246-1802-4c5f-af0e-5c34646385a2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.792222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42a2a246-1802-4c5f-af0e-5c34646385a2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.792650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42a2a246-1802-4c5f-af0e-5c34646385a2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.888286 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-42a2a246-1802-4c5f-af0e-5c34646385a2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/04e32cf324f34b2f83a492bc113da37f" status: 200 len: 328 microversion: 2.1 time: 0.187367 Oct 29 02:46:06.891050 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 81/172] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Oct 29 02:46:06 2022] PUT /compute/v2.1/os-quota-sets/04e32cf324f34b2f83a492bc113da37f => generated 328 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:06.902346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f378762-1efe-4fc7-a532-2b721f34c9bb tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:06.905719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5f378762-1efe-4fc7-a532-2b721f34c9bb tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:06.999331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5f378762-1efe-4fc7-a532-2b721f34c9bb tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.016241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5f378762-1efe-4fc7-a532-2b721f34c9bb tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.019329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5f378762-1efe-4fc7-a532-2b721f34c9bb tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.029887 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f378762-1efe-4fc7-a532-2b721f34c9bb tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "PUT /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1358 microversion: 2.75 time: 0.131747 Oct 29 02:46:07.030868 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 82/173] 10.222.0.16 () {62 vars in 1297 bytes} [Sat Oct 29 02:46:06 2022] PUT /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1358 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:07.038687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0dfc009d-5aec-4a76-a03b-a254700884ef tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:07.063452 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0dfc009d-5aec-4a76-a03b-a254700884ef tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/04e32cf324f34b2f83a492bc113da37f" status: 202 len: 0 microversion: 2.1 time: 0.028873 Oct 29 02:46:07.064668 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 83/174] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 02:46:07 2022] DELETE /compute/v2.1/os-quota-sets/04e32cf324f34b2f83a492bc113da37f => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:07.070194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ccc76bb7-a5c9-4601-bf6a-839c95aa2491 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:07.071309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ccc76bb7-a5c9-4601-bf6a-839c95aa2491 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:07.084134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccc76bb7-a5c9-4601-bf6a-839c95aa2491 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.085433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccc76bb7-a5c9-4601-bf6a-839c95aa2491 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.086484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccc76bb7-a5c9-4601-bf6a-839c95aa2491 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.087580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccc76bb7-a5c9-4601-bf6a-839c95aa2491 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.088335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccc76bb7-a5c9-4601-bf6a-839c95aa2491 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.089412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccc76bb7-a5c9-4601-bf6a-839c95aa2491 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.193834 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0b8a20fb-8238-4abc-8b19-72feb6587d7f tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 204 len: 0 microversion: 2.1 time: 0.652131 Oct 29 02:46:07.194567 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 92/175] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:06 2022] DELETE /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:07.200837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2547745f-f943-4f3a-b254-c390bec40c0a tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:07.202053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2547745f-f943-4f3a-b254-c390bec40c0a tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:07.209137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2547745f-f943-4f3a-b254-c390bec40c0a tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.209618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2547745f-f943-4f3a-b254-c390bec40c0a tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.210265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2547745f-f943-4f3a-b254-c390bec40c0a tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.211020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2547745f-f943-4f3a-b254-c390bec40c0a tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.211648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2547745f-f943-4f3a-b254-c390bec40c0a tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.212063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2547745f-f943-4f3a-b254-c390bec40c0a tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.247695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ccc76bb7-a5c9-4601-bf6a-839c95aa2491 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.256908 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ccc76bb7-a5c9-4601-bf6a-839c95aa2491 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1409 microversion: 2.1 time: 0.190823 Oct 29 02:46:07.257489 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 84/176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:07 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1409 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:07.263455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8afa8f4f-1e60-4454-a6cb-99df26756abe tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:07.264063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8afa8f4f-1e60-4454-a6cb-99df26756abe tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:07.322964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8afa8f4f-1e60-4454-a6cb-99df26756abe tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.333651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8afa8f4f-1e60-4454-a6cb-99df26756abe tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.335131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8afa8f4f-1e60-4454-a6cb-99df26756abe tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.350662 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8afa8f4f-1e60-4454-a6cb-99df26756abe tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1358 microversion: 2.75 time: 0.092031 Oct 29 02:46:07.351717 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 85/177] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:07 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1358 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:07.356258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-101f11ff-b16c-4c61-b09d-db67bf522c83 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Calling method '.version_select at 0x7fe1a933b700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:07.361630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2547745f-f943-4f3a-b254-c390bec40c0a tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.374426 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2547745f-f943-4f3a-b254-c390bec40c0a tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1338 microversion: 2.1 time: 0.177386 Oct 29 02:46:07.377861 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 93/178] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:07 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1338 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:07.380215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cdf35963-57b1-4de8-ba10-1d1f10832fe9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:07.380542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cdf35963-57b1-4de8-ba10-1d1f10832fe9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:07.390662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdf35963-57b1-4de8-ba10-1d1f10832fe9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.391359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdf35963-57b1-4de8-ba10-1d1f10832fe9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.391785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdf35963-57b1-4de8-ba10-1d1f10832fe9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.392531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdf35963-57b1-4de8-ba10-1d1f10832fe9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.392972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdf35963-57b1-4de8-ba10-1d1f10832fe9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.393382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdf35963-57b1-4de8-ba10-1d1f10832fe9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.436222 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-101f11ff-b16c-4c61-b09d-db67bf522c83 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/04e32cf324f34b2f83a492bc113da37f" status: 200 len: 371 microversion: 2.1 time: 0.083881 Oct 29 02:46:07.437046 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 86/179] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 02:46:07 2022] GET /compute/v2.1/os-quota-sets/04e32cf324f34b2f83a492bc113da37f => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:07.531759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cdf35963-57b1-4de8-ba10-1d1f10832fe9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.539993 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cdf35963-57b1-4de8-ba10-1d1f10832fe9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1476 microversion: 2.1 time: 0.163846 Oct 29 02:46:07.540614 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 94/180] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:07 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1476 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:07.560696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9dee318b-f0a6-44dd-b74b-b391d8131c04 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Calling method '.version_select at 0x7fe1a933bca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:07.568354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-451e7350-e35a-40f0-a132-c43b972f99cd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:07.568961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-451e7350-e35a-40f0-a132-c43b972f99cd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:07.575166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-451e7350-e35a-40f0-a132-c43b972f99cd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.575639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-451e7350-e35a-40f0-a132-c43b972f99cd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.576082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-451e7350-e35a-40f0-a132-c43b972f99cd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.576770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-451e7350-e35a-40f0-a132-c43b972f99cd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.577215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-451e7350-e35a-40f0-a132-c43b972f99cd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.577622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-451e7350-e35a-40f0-a132-c43b972f99cd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.710720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-451e7350-e35a-40f0-a132-c43b972f99cd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.719352 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-451e7350-e35a-40f0-a132-c43b972f99cd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1340 microversion: 2.1 time: 0.154819 Oct 29 02:46:07.720123 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 95/181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:07 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1340 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:07.749411 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9dee318b-f0a6-44dd-b74b-b391d8131c04 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/6972fcf9d354490d9cb20c76fdcea364/defaults" status: 200 len: 371 microversion: 2.1 time: 0.192543 Oct 29 02:46:07.750202 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 87/182] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:46:07 2022] GET /compute/v2.1/os-quota-sets/6972fcf9d354490d9cb20c76fdcea364/defaults => generated 371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:07.966110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7f3b0ebd-d906-4b0d-b5d0-25300a2b1dc0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a9544dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:08.098324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f3b0ebd-d906-4b0d-b5d0-25300a2b1dc0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.098789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f3b0ebd-d906-4b0d-b5d0-25300a2b1dc0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.099206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f3b0ebd-d906-4b0d-b5d0-25300a2b1dc0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.099915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f3b0ebd-d906-4b0d-b5d0-25300a2b1dc0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.100348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f3b0ebd-d906-4b0d-b5d0-25300a2b1dc0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.100751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f3b0ebd-d906-4b0d-b5d0-25300a2b1dc0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.159322 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7f3b0ebd-d906-4b0d-b5d0-25300a2b1dc0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/bd9490652a874247866b4298f9f090a6" status: 200 len: 328 microversion: 2.1 time: 0.198703 Oct 29 02:46:08.159980 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 96/183] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Oct 29 02:46:07 2022] PUT /compute/v2.1/os-quota-sets/bd9490652a874247866b4298f9f090a6 => generated 328 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:08.171815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4d7e7e38-1590-496d-ba36-005c8de6e49d tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Calling method '.version_select at 0x7fe1a933b8b0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:08.235503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d7e7e38-1590-496d-ba36-005c8de6e49d tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.235989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d7e7e38-1590-496d-ba36-005c8de6e49d tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.236434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d7e7e38-1590-496d-ba36-005c8de6e49d tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.237160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d7e7e38-1590-496d-ba36-005c8de6e49d tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.237593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d7e7e38-1590-496d-ba36-005c8de6e49d tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.238031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d7e7e38-1590-496d-ba36-005c8de6e49d tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.256043 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4d7e7e38-1590-496d-ba36-005c8de6e49d tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/bd9490652a874247866b4298f9f090a6/detail" status: 200 len: 916 microversion: 2.1 time: 0.087972 Oct 29 02:46:08.256657 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 88/184] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 02:46:08 2022] GET /compute/v2.1/os-quota-sets/bd9490652a874247866b4298f9f090a6/detail => generated 916 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:08.279473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1b31cbd1-ac95-4a52-9b70-d790c352a41b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:08.280690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1b31cbd1-ac95-4a52-9b70-d790c352a41b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:08.288839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b31cbd1-ac95-4a52-9b70-d790c352a41b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.289337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b31cbd1-ac95-4a52-9b70-d790c352a41b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.289848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b31cbd1-ac95-4a52-9b70-d790c352a41b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.290644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b31cbd1-ac95-4a52-9b70-d790c352a41b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.291125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b31cbd1-ac95-4a52-9b70-d790c352a41b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.291528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b31cbd1-ac95-4a52-9b70-d790c352a41b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.380633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:08.381228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:08.388066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.388513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.388958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.390003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.390865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.391651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.457495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b31cbd1-ac95-4a52-9b70-d790c352a41b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:08.465515 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1b31cbd1-ac95-4a52-9b70-d790c352a41b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1409 microversion: 2.1 time: 0.189899 Oct 29 02:46:08.469283 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 97/185] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:08 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1409 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:08.476032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e65f1fdc-43d4-42c3-a0bf-d9b0e951cd4d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:08.476998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e65f1fdc-43d4-42c3-a0bf-d9b0e951cd4d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:08.483344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e65f1fdc-43d4-42c3-a0bf-d9b0e951cd4d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.483822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e65f1fdc-43d4-42c3-a0bf-d9b0e951cd4d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.484244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e65f1fdc-43d4-42c3-a0bf-d9b0e951cd4d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.484938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e65f1fdc-43d4-42c3-a0bf-d9b0e951cd4d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.485375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e65f1fdc-43d4-42c3-a0bf-d9b0e951cd4d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.485790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e65f1fdc-43d4-42c3-a0bf-d9b0e951cd4d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.509649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:08.518379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:08.519810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:08.524714 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c6698e62-add5-4e14-84c1-0029ee645354 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1354 microversion: 2.75 time: 0.147972 Oct 29 02:46:08.525278 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 89/186] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:08 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1354 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:08.529867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a929d3a0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:08.605497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.606011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.606428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.607422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.607861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.608268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.641879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e65f1fdc-43d4-42c3-a0bf-d9b0e951cd4d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:08.646504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.646974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.647394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.648525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.648975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.649379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.651196 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e65f1fdc-43d4-42c3-a0bf-d9b0e951cd4d tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1487 microversion: 2.1 time: 0.180637 Oct 29 02:46:08.652162 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 98/187] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:08 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1487 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:08.659079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3f0fde90-6e93-48e9-9b64-eb318cf85244 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:08.659677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3f0fde90-6e93-48e9-9b64-eb318cf85244 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:08.664526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:08.671480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0fde90-6e93-48e9-9b64-eb318cf85244 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.671978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0fde90-6e93-48e9-9b64-eb318cf85244 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.672411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0fde90-6e93-48e9-9b64-eb318cf85244 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.673263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0fde90-6e93-48e9-9b64-eb318cf85244 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.673943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0fde90-6e93-48e9-9b64-eb318cf85244 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.674153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0fde90-6e93-48e9-9b64-eb318cf85244 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.717498 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8edf7efa-6fcf-402e-9b29-2a3985a521df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/bd9490652a874247866b4298f9f090a6?user_id=39beef93f4184945aefbfc0b489719e6" status: 200 len: 328 microversion: 2.1 time: 0.191149 Oct 29 02:46:08.724820 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 90/188] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 02:46:08 2022] PUT /compute/v2.1/os-quota-sets/bd9490652a874247866b4298f9f090a6?user_id=39beef93f4184945aefbfc0b489719e6 => generated 328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:08.724820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-27a55a50-0171-490b-a1a6-971c27ccae72 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:08.724820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-27a55a50-0171-490b-a1a6-971c27ccae72 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:08.733362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27a55a50-0171-490b-a1a6-971c27ccae72 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.733835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27a55a50-0171-490b-a1a6-971c27ccae72 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.734268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27a55a50-0171-490b-a1a6-971c27ccae72 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.734978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27a55a50-0171-490b-a1a6-971c27ccae72 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.735442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27a55a50-0171-490b-a1a6-971c27ccae72 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.735846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27a55a50-0171-490b-a1a6-971c27ccae72 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.843971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3f0fde90-6e93-48e9-9b64-eb318cf85244 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:08.853197 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3f0fde90-6e93-48e9-9b64-eb318cf85244 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1476 microversion: 2.1 time: 0.199221 Oct 29 02:46:08.855378 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 99/189] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:08 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1476 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:08.862047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0a20223f-017b-4d97-beca-b7f108351b1e tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Calling method '.version_select at 0x7fe1a979faf0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:08.955594 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0a20223f-017b-4d97-beca-b7f108351b1e tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/bd9490652a874247866b4298f9f090a6?user_id=39beef93f4184945aefbfc0b489719e6" status: 200 len: 370 microversion: 2.1 time: 0.099041 Oct 29 02:46:08.956389 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 100/190] 10.222.0.16 () {58 vars in 1323 bytes} [Sat Oct 29 02:46:08 2022] GET /compute/v2.1/os-quota-sets/bd9490652a874247866b4298f9f090a6?user_id=39beef93f4184945aefbfc0b489719e6 => generated 370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:08.962955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ad256e30-dfb5-4d55-8eb5-ac3bdc9670a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:08.965781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ad256e30-dfb5-4d55-8eb5-ac3bdc9670a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:08.974421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad256e30-dfb5-4d55-8eb5-ac3bdc9670a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.975245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad256e30-dfb5-4d55-8eb5-ac3bdc9670a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.976422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad256e30-dfb5-4d55-8eb5-ac3bdc9670a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.977417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad256e30-dfb5-4d55-8eb5-ac3bdc9670a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.978105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad256e30-dfb5-4d55-8eb5-ac3bdc9670a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.979058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad256e30-dfb5-4d55-8eb5-ac3bdc9670a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.228552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ad256e30-dfb5-4d55-8eb5-ac3bdc9670a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:09.238882 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ad256e30-dfb5-4d55-8eb5-ac3bdc9670a5 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1340 microversion: 2.1 time: 0.281637 Oct 29 02:46:09.239477 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 101/191] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:08 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1340 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:09.254293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-14e145c3-6d0c-4397-9301-256625c40a35 req-8d891a82-5cd0-49f3-8657-6ad9ad79dcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e905f88b-7b01-4091-946f-fa0e0abdab0d", "name": "network-vif-plugged", "status": "completed", "tag": "363f1891-2fd3-41b7-8910-0ec693798817"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:09.277726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-14e145c3-6d0c-4397-9301-256625c40a35 req-8d891a82-5cd0-49f3-8657-6ad9ad79dcd5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.278786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-14e145c3-6d0c-4397-9301-256625c40a35 req-8d891a82-5cd0-49f3-8657-6ad9ad79dcd5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.279417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-14e145c3-6d0c-4397-9301-256625c40a35 req-8d891a82-5cd0-49f3-8657-6ad9ad79dcd5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.306023 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-27a55a50-0171-490b-a1a6-971c27ccae72 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1638 microversion: 2.1 time: 0.586743 Oct 29 02:46:09.306613 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 91/192] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:08 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1638 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:09.320835 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-14e145c3-6d0c-4397-9301-256625c40a35 req-8d891a82-5cd0-49f3-8657-6ad9ad79dcd5 service nova] Creating event network-vif-plugged:363f1891-2fd3-41b7-8910-0ec693798817 for instance e905f88b-7b01-4091-946f-fa0e0abdab0d on n-h2-862964-4 Oct 29 02:46:09.326421 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-14e145c3-6d0c-4397-9301-256625c40a35 req-8d891a82-5cd0-49f3-8657-6ad9ad79dcd5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085099 Oct 29 02:46:09.327512 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 102/193] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:09.333023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f9ba94aa-b435-4f87-b775-15e3718328a6 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:09.334672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f9ba94aa-b435-4f87-b775-15e3718328a6 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:09.363944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9ba94aa-b435-4f87-b775-15e3718328a6 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.364432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9ba94aa-b435-4f87-b775-15e3718328a6 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.374042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9ba94aa-b435-4f87-b775-15e3718328a6 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.377178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9ba94aa-b435-4f87-b775-15e3718328a6 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.378465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9ba94aa-b435-4f87-b775-15e3718328a6 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.378909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9ba94aa-b435-4f87-b775-15e3718328a6 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.434789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f9ba94aa-b435-4f87-b775-15e3718328a6 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:46:09.466824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-98249a8e-cdd9-4fe2-bf06-cb39c3e2d4f3 req-679ab673-32a0-4076-b267-762e7f51509c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333ee108-8b64-4be0-a8f8-5e6a558d81a4", "name": "network-vif-deleted", "tag": "360018c1-5fa9-450f-800f-0d5e36d2f29e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:09.486468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-98249a8e-cdd9-4fe2-bf06-cb39c3e2d4f3 req-679ab673-32a0-4076-b267-762e7f51509c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.491317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-98249a8e-cdd9-4fe2-bf06-cb39c3e2d4f3 req-679ab673-32a0-4076-b267-762e7f51509c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.491317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-98249a8e-cdd9-4fe2-bf06-cb39c3e2d4f3 req-679ab673-32a0-4076-b267-762e7f51509c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.519810 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-98249a8e-cdd9-4fe2-bf06-cb39c3e2d4f3 req-679ab673-32a0-4076-b267-762e7f51509c service nova] Creating event network-vif-deleted:360018c1-5fa9-450f-800f-0d5e36d2f29e for instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 on n-h1-862964-4 Oct 29 02:46:09.535795 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-98249a8e-cdd9-4fe2-bf06-cb39c3e2d4f3 req-679ab673-32a0-4076-b267-762e7f51509c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074179 Oct 29 02:46:09.542155 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 103/194] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:09.558220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b2ab70a0-f06a-43a9-94f4-a0ad8b650c3e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:09.559121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b2ab70a0-f06a-43a9-94f4-a0ad8b650c3e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:09.568658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2ab70a0-f06a-43a9-94f4-a0ad8b650c3e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.569222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2ab70a0-f06a-43a9-94f4-a0ad8b650c3e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.569687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2ab70a0-f06a-43a9-94f4-a0ad8b650c3e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.570437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2ab70a0-f06a-43a9-94f4-a0ad8b650c3e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.570884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2ab70a0-f06a-43a9-94f4-a0ad8b650c3e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.571308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2ab70a0-f06a-43a9-94f4-a0ad8b650c3e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.659872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:09.679450 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f9ba94aa-b435-4f87-b775-15e3718328a6 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 204 len: 0 microversion: 2.1 time: 0.349999 Oct 29 02:46:09.683586 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 92/195] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:09 2022] DELETE /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:09.688937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-213f7478-8b81-449a-9416-e4a8b3e17750 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Calling method '.version_select at 0x7fe1a93aae50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:09.763259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b2ab70a0-f06a-43a9-94f4-a0ad8b650c3e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:09.771049 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b2ab70a0-f06a-43a9-94f4-a0ad8b650c3e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1409 microversion: 2.1 time: 0.228793 Oct 29 02:46:09.771642 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 104/196] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:09 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1409 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:09.776399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:09.777073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:09.782968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.783434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.783861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.784545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.784997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.785411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.875346 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-213f7478-8b81-449a-9416-e4a8b3e17750 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/6972fcf9d354490d9cb20c76fdcea364/defaults" status: 200 len: 371 microversion: 2.1 time: 0.190437 Oct 29 02:46:09.875939 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 93/197] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:46:09 2022] GET /compute/v2.1/os-quota-sets/6972fcf9d354490d9cb20c76fdcea364/defaults => generated 371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:09.880500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-abcd3e3f-499f-4624-9f2c-d540388b4d81 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:09.881215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-abcd3e3f-499f-4624-9f2c-d540388b4d81 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:09.887549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abcd3e3f-499f-4624-9f2c-d540388b4d81 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.888068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abcd3e3f-499f-4624-9f2c-d540388b4d81 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.888473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abcd3e3f-499f-4624-9f2c-d540388b4d81 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.889175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abcd3e3f-499f-4624-9f2c-d540388b4d81 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.889849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abcd3e3f-499f-4624-9f2c-d540388b4d81 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.890264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abcd3e3f-499f-4624-9f2c-d540388b4d81 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.900506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:09.908964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:09.910438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:09.917190 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6f481ab4-82f9-401f-ba1d-5358c0da49be tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1416 microversion: 2.75 time: 0.144566 Oct 29 02:46:09.917767 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 105/198] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:09 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1416 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:09.922217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:09.922811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:09.928651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.929125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.929548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.930253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.930699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.931112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.963265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.963738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.964185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.964610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lazy-loading 'fault' on Instance uuid 333ee108-8b64-4be0-a8f8-5e6a558d81a4 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:10.008209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:10.012166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:10.017284 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b9f35cba-da9a-4363-9d2f-40cfe993f30c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1310 microversion: 2.1 time: 0.098528 Oct 29 02:46:10.017887 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 106/199] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:09 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:10.024253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-22c87c5c-3d04-4470-ba30-6bc261c01473 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a979faf0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:10.026316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-abcd3e3f-499f-4624-9f2c-d540388b4d81 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:10.034706 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-abcd3e3f-499f-4624-9f2c-d540388b4d81 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1493 microversion: 2.1 time: 0.157760 Oct 29 02:46:10.035332 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 94/200] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:09 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1493 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:10.094183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22c87c5c-3d04-4470-ba30-6bc261c01473 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.094651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22c87c5c-3d04-4470-ba30-6bc261c01473 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.095098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22c87c5c-3d04-4470-ba30-6bc261c01473 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.095806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22c87c5c-3d04-4470-ba30-6bc261c01473 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.096246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22c87c5c-3d04-4470-ba30-6bc261c01473 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.096729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22c87c5c-3d04-4470-ba30-6bc261c01473 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.266802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1208ef6d-4ca2-434f-a6c0-10a2809ac7ff tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:10.267463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1208ef6d-4ca2-434f-a6c0-10a2809ac7ff tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:10.273669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1208ef6d-4ca2-434f-a6c0-10a2809ac7ff tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.274183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1208ef6d-4ca2-434f-a6c0-10a2809ac7ff tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.274596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1208ef6d-4ca2-434f-a6c0-10a2809ac7ff tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.275282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1208ef6d-4ca2-434f-a6c0-10a2809ac7ff tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.275721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1208ef6d-4ca2-434f-a6c0-10a2809ac7ff tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.276130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1208ef6d-4ca2-434f-a6c0-10a2809ac7ff tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.280795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:10.294599 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-22c87c5c-3d04-4470-ba30-6bc261c01473 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/6972fcf9d354490d9cb20c76fdcea364" status: 200 len: 329 microversion: 2.1 time: 0.274947 Oct 29 02:46:10.302363 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 107/201] 10.222.0.16 () {60 vars in 1263 bytes} [Sat Oct 29 02:46:10 2022] PUT /compute/v2.1/os-quota-sets/6972fcf9d354490d9cb20c76fdcea364 => generated 329 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:10.307360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-75382af8-6e71-4836-a0f6-530790a5842c tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a9431dc0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:10.377627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75382af8-6e71-4836-a0f6-530790a5842c tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.378332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75382af8-6e71-4836-a0f6-530790a5842c tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.379017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75382af8-6e71-4836-a0f6-530790a5842c tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.379251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75382af8-6e71-4836-a0f6-530790a5842c tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.379781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75382af8-6e71-4836-a0f6-530790a5842c tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.380220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75382af8-6e71-4836-a0f6-530790a5842c tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.413462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1208ef6d-4ca2-434f-a6c0-10a2809ac7ff tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:10.423376 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1208ef6d-4ca2-434f-a6c0-10a2809ac7ff tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1340 microversion: 2.1 time: 0.159431 Oct 29 02:46:10.424306 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 95/202] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:10 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1340 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:10.553560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=22,nova_api:UPDATE=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:10.678213 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-75382af8-6e71-4836-a0f6-530790a5842c tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/6972fcf9d354490d9cb20c76fdcea364" status: 200 len: 329 microversion: 2.1 time: 0.374397 Oct 29 02:46:10.678794 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 108/203] 10.222.0.16 () {60 vars in 1263 bytes} [Sat Oct 29 02:46:10 2022] PUT /compute/v2.1/os-quota-sets/6972fcf9d354490d9cb20c76fdcea364 => generated 329 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:10.793964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-471c5f99-5164-4d02-bfe4-b5446a2208ac tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:10.795092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-471c5f99-5164-4d02-bfe4-b5446a2208ac tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:10.803231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-471c5f99-5164-4d02-bfe4-b5446a2208ac tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.803701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-471c5f99-5164-4d02-bfe4-b5446a2208ac tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.804111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-471c5f99-5164-4d02-bfe4-b5446a2208ac tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.805054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-471c5f99-5164-4d02-bfe4-b5446a2208ac tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.805673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-471c5f99-5164-4d02-bfe4-b5446a2208ac tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.806149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-471c5f99-5164-4d02-bfe4-b5446a2208ac tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.948870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:10.949818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:10.960567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-471c5f99-5164-4d02-bfe4-b5446a2208ac tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:10.962596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.963194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.964185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.967653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.968307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.969263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.969838 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-471c5f99-5164-4d02-bfe4-b5446a2208ac tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1409 microversion: 2.1 time: 0.179754 Oct 29 02:46:10.970693 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 96/204] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:10 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1409 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:11.040720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:11.041441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:11.047591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:11.047896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.048371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.048782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.049463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.050083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.050494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.058009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:11.059449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:11.064980 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-71e0e605-cb86-4b2d-9c4b-0968b7968130 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1416 microversion: 2.75 time: 0.122527 Oct 29 02:46:11.070180 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 109/205] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:10 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1416 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:11.077339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8f737be-ae79-47f3-b91e-ab3bf0fffa8e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:11.078407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8f737be-ae79-47f3-b91e-ab3bf0fffa8e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:11.083783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.084145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.084900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.085353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lazy-loading 'fault' on Instance uuid 333ee108-8b64-4be0-a8f8-5e6a558d81a4 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:11.089908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f737be-ae79-47f3-b91e-ab3bf0fffa8e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.090696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f737be-ae79-47f3-b91e-ab3bf0fffa8e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.091265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f737be-ae79-47f3-b91e-ab3bf0fffa8e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.092543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f737be-ae79-47f3-b91e-ab3bf0fffa8e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.093093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f737be-ae79-47f3-b91e-ab3bf0fffa8e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.093613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f737be-ae79-47f3-b91e-ab3bf0fffa8e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.130793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:11.138708 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-480755b3-e472-479b-8876-67707be8cc33 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 200 len: 1310 microversion: 2.1 time: 0.102334 Oct 29 02:46:11.139270 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 97/206] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:11 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 1310 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:11.270310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8f737be-ae79-47f3-b91e-ab3bf0fffa8e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:11.281876 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8f737be-ae79-47f3-b91e-ab3bf0fffa8e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1493 microversion: 2.1 time: 0.209809 Oct 29 02:46:11.288936 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 110/207] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:11 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1493 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:11.343545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4d6733ed-6dca-4454-993a-380d1a30eb50 req-94f17937-f304-4efb-bc89-e33409f4f90c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bec03293-594f-445f-8d70-7072771a2366", "name": "network-vif-plugged", "status": "completed", "tag": "2abbbf39-789a-4939-9e8e-44c7d7925ce7"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:11.355269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4d6733ed-6dca-4454-993a-380d1a30eb50 req-94f17937-f304-4efb-bc89-e33409f4f90c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.355862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4d6733ed-6dca-4454-993a-380d1a30eb50 req-94f17937-f304-4efb-bc89-e33409f4f90c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.356361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4d6733ed-6dca-4454-993a-380d1a30eb50 req-94f17937-f304-4efb-bc89-e33409f4f90c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.367960 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4d6733ed-6dca-4454-993a-380d1a30eb50 req-94f17937-f304-4efb-bc89-e33409f4f90c service nova] Creating event network-vif-plugged:2abbbf39-789a-4939-9e8e-44c7d7925ce7 for instance bec03293-594f-445f-8d70-7072771a2366 on n-h2-862964-4 Oct 29 02:46:11.374610 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4d6733ed-6dca-4454-993a-380d1a30eb50 req-94f17937-f304-4efb-bc89-e33409f4f90c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034676 Oct 29 02:46:11.374610 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 98/208] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:11.447355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a748f542-65b8-4091-8a7b-d3e4f7ad8b43 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:11.448007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a748f542-65b8-4091-8a7b-d3e4f7ad8b43 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:11.454770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a748f542-65b8-4091-8a7b-d3e4f7ad8b43 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.455288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a748f542-65b8-4091-8a7b-d3e4f7ad8b43 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.455750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a748f542-65b8-4091-8a7b-d3e4f7ad8b43 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.456557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a748f542-65b8-4091-8a7b-d3e4f7ad8b43 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.457015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a748f542-65b8-4091-8a7b-d3e4f7ad8b43 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.457429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a748f542-65b8-4091-8a7b-d3e4f7ad8b43 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.609174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a748f542-65b8-4091-8a7b-d3e4f7ad8b43 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:11.616993 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a748f542-65b8-4091-8a7b-d3e4f7ad8b43 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1340 microversion: 2.1 time: 0.173848 Oct 29 02:46:11.617560 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 111/209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:11 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1340 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:11.995572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-86063294-340e-4952-92ed-b04a15916f7e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:11.997253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86063294-340e-4952-92ed-b04a15916f7e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:12.003722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86063294-340e-4952-92ed-b04a15916f7e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.004309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86063294-340e-4952-92ed-b04a15916f7e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.004967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86063294-340e-4952-92ed-b04a15916f7e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.005852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86063294-340e-4952-92ed-b04a15916f7e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.006449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86063294-340e-4952-92ed-b04a15916f7e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.007024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86063294-340e-4952-92ed-b04a15916f7e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.093831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:12.094456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:12.101317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.101925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.102369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.103074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.103525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.103936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.169500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-86063294-340e-4952-92ed-b04a15916f7e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.178295 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-86063294-340e-4952-92ed-b04a15916f7e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1409 microversion: 2.1 time: 0.187324 Oct 29 02:46:12.179415 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 99/210] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:11 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:12.184429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:12.185030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:12.185859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.190846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.191568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.192165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.192991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.193577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.194162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.194562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.196123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.201754 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-500a5882-94e1-4194-8d10-61c32c55a65e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1437 microversion: 2.75 time: 0.111816 Oct 29 02:46:12.202742 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 112/211] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:12 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1437 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:12.210263 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] HTTP exception thrown: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Request method failure captured: Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 HTTP/1.1 Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPOQqMlu7DbyF8PFIHmz7nECXgI3hX19ptnLKD_qejqlyDQWhm7mOlf_CR9NigPW6CBDF3iavVKH4EsGzk9nEZ0ixsT6wxIZfEZttNF4HJ5LlnzY7oofs5310SD_t--FGgbALpE4hPKlcBG5X1mk_C7sDO4HJ5O_aV4XzO3iZ_cvMc Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:46:12.213505 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7bb0081b81cc46909ff0bae0f6ac30f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}] Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9c7e462d0e474a3aa94d3a146ae24d21 Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:12.214912 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '333ee108-8b64-4be0-a8f8-5e6a558d81a4'} Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:12.215796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:12.216862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:12.217777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Returning 404 to user: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:12.217777 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ba5081d3-ff40-4a19-98c0-524516aabc32 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 404 len: 111 microversion: 2.1 time: 0.034411 Oct 29 02:46:12.217777 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 100/212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:12 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:12.230511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:12.233374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:12.240447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.240932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.241361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.242094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.242691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.243318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.309540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b9eb341c-7ec4-4f6c-ae03-79f2928aefe1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:12.310502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b9eb341c-7ec4-4f6c-ae03-79f2928aefe1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:12.323256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eb341c-7ec4-4f6c-ae03-79f2928aefe1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.324224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eb341c-7ec4-4f6c-ae03-79f2928aefe1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.324839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eb341c-7ec4-4f6c-ae03-79f2928aefe1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.326846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eb341c-7ec4-4f6c-ae03-79f2928aefe1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.327663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eb341c-7ec4-4f6c-ae03-79f2928aefe1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.328235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eb341c-7ec4-4f6c-ae03-79f2928aefe1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.353485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:12.354058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:12.354877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:12.355342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:12.355843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:12.537053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:12.550139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.550815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.551386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.552361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.552940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.553653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.597762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b9eb341c-7ec4-4f6c-ae03-79f2928aefe1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.614676 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b9eb341c-7ec4-4f6c-ae03-79f2928aefe1 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1493 microversion: 2.1 time: 0.308842 Oct 29 02:46:12.626643 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 101/213] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:12 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1493 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:12.630073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2017791583", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:12.699269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:12.720691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.735252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.736980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.748926 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5ee09da8-6bf8-4caa-9dce-bc19dea6e071 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "POST /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea/action" status: 202 len: 1494 microversion: 2.75 time: 0.522730 Oct 29 02:46:12.756260 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 113/214] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:46:12 2022] POST /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea/action => generated 1494 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 29 02:46:12.760988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-01803fbe-6359-4bd3-851a-3f0d4355a52b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:12.761891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-01803fbe-6359-4bd3-851a-3f0d4355a52b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:12.779458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01803fbe-6359-4bd3-851a-3f0d4355a52b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.779952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01803fbe-6359-4bd3-851a-3f0d4355a52b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.780382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01803fbe-6359-4bd3-851a-3f0d4355a52b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.781091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01803fbe-6359-4bd3-851a-3f0d4355a52b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.781534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01803fbe-6359-4bd3-851a-3f0d4355a52b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.781985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01803fbe-6359-4bd3-851a-3f0d4355a52b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.989972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:12.990682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:12.991389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:12.992140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:12.992940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:13.004492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.005606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.006256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.007189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.007849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.008452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.026673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Getting quotas for project 7bb0081b81cc46909ff0bae0f6ac30f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:13.031047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Getting quotas for user 9c7e462d0e474a3aa94d3a146ae24d21 and project 7bb0081b81cc46909ff0bae0f6ac30f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:13.042977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:13.045541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:13.046022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-01803fbe-6359-4bd3-851a-3f0d4355a52b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:13.058265 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-01803fbe-6359-4bd3-851a-3f0d4355a52b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1340 microversion: 2.1 time: 0.300832 Oct 29 02:46:13.061050 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 114/215] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:12 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1340 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:13.074769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:13.075642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:13.082370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.083227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.083796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.084629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.085211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.086002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.110791 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-618768d2-d53c-415b-ab25-534e285d8ef4 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493111 Oct 29 02:46:13.112134 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 102/216] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:46:13.132256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51ea2601-062b-415e-8341-d041d780c210 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:13.133012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-51ea2601-062b-415e-8341-d041d780c210 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:13.207376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-51ea2601-062b-415e-8341-d041d780c210 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:13.215742 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-51ea2601-062b-415e-8341-d041d780c210 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1220 microversion: 2.1 time: 0.093359 Oct 29 02:46:13.216511 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 103/217] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:13 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:13.221683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d30d310c-f02e-4052-baf1-a9cbbcfa89df tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:13.222466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d30d310c-f02e-4052-baf1-a9cbbcfa89df tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:13.228808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d30d310c-f02e-4052-baf1-a9cbbcfa89df tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.229447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d30d310c-f02e-4052-baf1-a9cbbcfa89df tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.230146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d30d310c-f02e-4052-baf1-a9cbbcfa89df tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.231880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d30d310c-f02e-4052-baf1-a9cbbcfa89df tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.232475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d30d310c-f02e-4052-baf1-a9cbbcfa89df tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.233054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d30d310c-f02e-4052-baf1-a9cbbcfa89df tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.233606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:13.242307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:13.243996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:13.249937 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c77f430d-6115-4565-ac6a-71e710758a44 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.183124 Oct 29 02:46:13.251031 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 115/218] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:13 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:13.391778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d30d310c-f02e-4052-baf1-a9cbbcfa89df tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:13.421097 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d30d310c-f02e-4052-baf1-a9cbbcfa89df tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1608 microversion: 2.1 time: 0.203058 Oct 29 02:46:13.432900 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 104/219] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:13 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1608 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:13.451789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bc4f42d1-c629-400b-95fb-f2757dad7812 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:13.452482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bc4f42d1-c629-400b-95fb-f2757dad7812 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:13.459584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4f42d1-c629-400b-95fb-f2757dad7812 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.464506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4f42d1-c629-400b-95fb-f2757dad7812 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.466402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4f42d1-c629-400b-95fb-f2757dad7812 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.469894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4f42d1-c629-400b-95fb-f2757dad7812 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.471142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4f42d1-c629-400b-95fb-f2757dad7812 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.471704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4f42d1-c629-400b-95fb-f2757dad7812 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.630951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-3e8a66c6-beea-44cf-ad54-be4934e52051 req-0d06ec3f-c79d-4e30-8f75-db9114e38a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d968c73-0802-46ee-8972-e48ba3168aa6", "name": "network-vif-deleted", "tag": "59b2502f-f81c-47a5-bc83-41d4db39aec4"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:13.645444 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bc4f42d1-c629-400b-95fb-f2757dad7812 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.198050 Oct 29 02:46:13.646636 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 116/220] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 02:46:13 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:13.650227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3e8a66c6-beea-44cf-ad54-be4934e52051 req-0d06ec3f-c79d-4e30-8f75-db9114e38a65 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.650863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3e8a66c6-beea-44cf-ad54-be4934e52051 req-0d06ec3f-c79d-4e30-8f75-db9114e38a65 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.651432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3e8a66c6-beea-44cf-ad54-be4934e52051 req-0d06ec3f-c79d-4e30-8f75-db9114e38a65 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.653257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7e72bb98-c738-4446-b5d1-dcbcb6180852 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:13.654243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7e72bb98-c738-4446-b5d1-dcbcb6180852 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:13.663092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e72bb98-c738-4446-b5d1-dcbcb6180852 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.664333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e72bb98-c738-4446-b5d1-dcbcb6180852 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.665153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e72bb98-c738-4446-b5d1-dcbcb6180852 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.666061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e72bb98-c738-4446-b5d1-dcbcb6180852 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.666693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e72bb98-c738-4446-b5d1-dcbcb6180852 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.667790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e72bb98-c738-4446-b5d1-dcbcb6180852 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.692612 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-3e8a66c6-beea-44cf-ad54-be4934e52051 req-0d06ec3f-c79d-4e30-8f75-db9114e38a65 service nova] Creating event network-vif-deleted:59b2502f-f81c-47a5-bc83-41d4db39aec4 for instance 8d968c73-0802-46ee-8972-e48ba3168aa6 on n-h2-862964-4 Oct 29 02:46:13.706614 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-3e8a66c6-beea-44cf-ad54-be4934e52051 req-0d06ec3f-c79d-4e30-8f75-db9114e38a65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075942 Oct 29 02:46:13.707799 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 105/221] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:13.809953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7e72bb98-c738-4446-b5d1-dcbcb6180852 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:13.820477 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7e72bb98-c738-4446-b5d1-dcbcb6180852 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1451 microversion: 2.1 time: 0.171899 Oct 29 02:46:13.821401 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 117/222] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:13 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:14.085062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0665a38a-05cf-4ea0-a006-6c1ee69fc12f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.085669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0665a38a-05cf-4ea0-a006-6c1ee69fc12f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:14.095333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0665a38a-05cf-4ea0-a006-6c1ee69fc12f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.095820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0665a38a-05cf-4ea0-a006-6c1ee69fc12f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.102730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0665a38a-05cf-4ea0-a006-6c1ee69fc12f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.105902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0665a38a-05cf-4ea0-a006-6c1ee69fc12f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.106679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0665a38a-05cf-4ea0-a006-6c1ee69fc12f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.107168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0665a38a-05cf-4ea0-a006-6c1ee69fc12f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.222188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8568d0f9-eff9-4576-8e56-a92de8608302 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a9145280>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:14.225670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8568d0f9-eff9-4576-8e56-a92de8608302 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.226172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8568d0f9-eff9-4576-8e56-a92de8608302 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.226601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8568d0f9-eff9-4576-8e56-a92de8608302 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.234586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8568d0f9-eff9-4576-8e56-a92de8608302 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.235087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8568d0f9-eff9-4576-8e56-a92de8608302 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.235510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8568d0f9-eff9-4576-8e56-a92de8608302 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.243246 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-8568d0f9-eff9-4576-8e56-a92de8608302 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] HTTP exception thrown: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8568d0f9-eff9-4576-8e56-a92de8608302 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Request method failure captured: Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: request: PUT /compute/v2.1/os-services/cd7e86c9-0520-4142-b7b2-d547e30d3936 HTTP/1.1 Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 56 Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJP188Uvh9IzRbpTvQ0Xe7z-SY4vjPwbOXMKpokY11yPFG4t2XJyVGE-YH_IKR0kxCw-KzaXCm9c0o-sf9TPa7bekFW6UdM-XHXcOgkMV4NWMQxhKdsaIh5xzLsTiKM2ew1ot3Eenuby-EPGIEBYLk_AbjFlZtYq0UGcztp6VwboBe4 Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 997fdb4006314146b75d01581def6b3f Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1429888939 Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:14.245718 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/997fdb4006314146b75d01581def6b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/997fdb4006314146b75d01581def6b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_997fdb4006314146b75d01581def6b3f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/997fdb4006314146b75d01581def6b3f"}]}] Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1429888939 Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 997fdb4006314146b75d01581def6b3f Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1429888939 Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 954b6011ae8643229b6fd3c72a4fa892 Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:46:14.247217 n-d-862964-4 devstack@n-api.service[127042]: exception: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cd7e86c9-0520-4142-b7b2-d547e30d3936', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.248112 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:14.249159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:14.250251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:14.250251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.250251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.250251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8568d0f9-eff9-4576-8e56-a92de8608302 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Returning 404 to user: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:14.250251 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8568d0f9-eff9-4576-8e56-a92de8608302 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/cd7e86c9-0520-4142-b7b2-d547e30d3936" status: 404 len: 110 microversion: 2.53 time: 0.210020 Oct 29 02:46:14.250251 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 106/223] 10.222.0.16 () {62 vars in 1309 bytes} [Sat Oct 29 02:46:14 2022] PUT /compute/v2.1/os-services/cd7e86c9-0520-4142-b7b2-d547e30d3936 => generated 110 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:46:14.252222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c35edeaf-6663-41b8-b4db-e922fa53e0dd tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.252963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c35edeaf-6663-41b8-b4db-e922fa53e0dd tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:14.259260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c35edeaf-6663-41b8-b4db-e922fa53e0dd tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.259728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c35edeaf-6663-41b8-b4db-e922fa53e0dd tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.260146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c35edeaf-6663-41b8-b4db-e922fa53e0dd tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.260970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c35edeaf-6663-41b8-b4db-e922fa53e0dd tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.261408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c35edeaf-6663-41b8-b4db-e922fa53e0dd tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.261824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c35edeaf-6663-41b8-b4db-e922fa53e0dd tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.330665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c35edeaf-6663-41b8-b4db-e922fa53e0dd tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:14.338567 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c35edeaf-6663-41b8-b4db-e922fa53e0dd tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1272 microversion: 2.1 time: 0.089813 Oct 29 02:46:14.339207 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 107/224] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:14.343860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09cca373-59b0-47b3-a58f-29aeac45966e tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a9145670>, body: {"status": "disabled"} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:14.347502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09cca373-59b0-47b3-a58f-29aeac45966e tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.347981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09cca373-59b0-47b3-a58f-29aeac45966e tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.348407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09cca373-59b0-47b3-a58f-29aeac45966e tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.353939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09cca373-59b0-47b3-a58f-29aeac45966e tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.354673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09cca373-59b0-47b3-a58f-29aeac45966e tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.355358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09cca373-59b0-47b3-a58f-29aeac45966e tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.360408 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-09cca373-59b0-47b3-a58f-29aeac45966e tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] HTTP exception thrown: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09cca373-59b0-47b3-a58f-29aeac45966e tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Request method failure captured: Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: request: PUT /compute/v2.1/os-services/cd7e86c9-0520-4142-b7b2-d547e30d3936 HTTP/1.1 Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 22 Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJP188Uvh9IzRbpTvQ0Xe7z-SY4vjPwbOXMKpokY11yPFG4t2XJyVGE-YH_IKR0kxCw-KzaXCm9c0o-sf9TPa7bekFW6UdM-XHXcOgkMV4NWMQxhKdsaIh5xzLsTiKM2ew1ot3Eenuby-EPGIEBYLk_AbjFlZtYq0UGcztp6VwboBe4 Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 997fdb4006314146b75d01581def6b3f Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1429888939 Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:14.362072 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/997fdb4006314146b75d01581def6b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/997fdb4006314146b75d01581def6b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_997fdb4006314146b75d01581def6b3f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/997fdb4006314146b75d01581def6b3f"}]}] Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1429888939 Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 997fdb4006314146b75d01581def6b3f Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1429888939 Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 954b6011ae8643229b6fd3c72a4fa892 Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: {"status": "disabled"} Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: exception: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.363379 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cd7e86c9-0520-4142-b7b2-d547e30d3936', 'body': {'status': 'disabled'}} Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.371982 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:14.373127 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:14.374160 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.374160 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.374160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09cca373-59b0-47b3-a58f-29aeac45966e tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Returning 404 to user: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:14.374160 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-09cca373-59b0-47b3-a58f-29aeac45966e tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/cd7e86c9-0520-4142-b7b2-d547e30d3936" status: 404 len: 110 microversion: 2.53 time: 0.023187 Oct 29 02:46:14.374160 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 108/225] 10.222.0.16 () {62 vars in 1309 bytes} [Sat Oct 29 02:46:14 2022] PUT /compute/v2.1/os-services/cd7e86c9-0520-4142-b7b2-d547e30d3936 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:46:14.374160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.374501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:14.376588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.377069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.377494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.378276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.378722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.379136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.443367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:14.452661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:14.454193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:14.459352 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-893c1990-c54f-4d8a-8f32-7ab7c8a9581c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.094068 Oct 29 02:46:14.465843 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 109/226] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:14.466020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0665a38a-05cf-4ea0-a006-6c1ee69fc12f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:14.466117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3720f166-e154-46d6-a4d7-696894b43aa2 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a920ec10>, body: {"status": "enabled"} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:14.468460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3720f166-e154-46d6-a4d7-696894b43aa2 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.469085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3720f166-e154-46d6-a4d7-696894b43aa2 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.469543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3720f166-e154-46d6-a4d7-696894b43aa2 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.472466 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0665a38a-05cf-4ea0-a006-6c1ee69fc12f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1490 microversion: 2.1 time: 0.393027 Oct 29 02:46:14.473522 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 118/227] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1490 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:14.482079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3720f166-e154-46d6-a4d7-696894b43aa2 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.484020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3720f166-e154-46d6-a4d7-696894b43aa2 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.484927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3720f166-e154-46d6-a4d7-696894b43aa2 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.491047 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-3720f166-e154-46d6-a4d7-696894b43aa2 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] HTTP exception thrown: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3720f166-e154-46d6-a4d7-696894b43aa2 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Request method failure captured: Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: request: PUT /compute/v2.1/os-services/cd7e86c9-0520-4142-b7b2-d547e30d3936 HTTP/1.1 Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 21 Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJP188Uvh9IzRbpTvQ0Xe7z-SY4vjPwbOXMKpokY11yPFG4t2XJyVGE-YH_IKR0kxCw-KzaXCm9c0o-sf9TPa7bekFW6UdM-XHXcOgkMV4NWMQxhKdsaIh5xzLsTiKM2ew1ot3Eenuby-EPGIEBYLk_AbjFlZtYq0UGcztp6VwboBe4 Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 997fdb4006314146b75d01581def6b3f Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1429888939 Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:14.492918 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/997fdb4006314146b75d01581def6b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/997fdb4006314146b75d01581def6b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_997fdb4006314146b75d01581def6b3f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/997fdb4006314146b75d01581def6b3f"}]}] Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1429888939 Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 997fdb4006314146b75d01581def6b3f Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1429888939 Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 954b6011ae8643229b6fd3c72a4fa892 Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: {"status": "enabled"} Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: exception: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.494549 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cd7e86c9-0520-4142-b7b2-d547e30d3936', 'body': {'status': 'enabled'}} Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.495761 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:14.497291 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:14.498678 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. Oct 29 02:46:14.498678 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:14.500506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3720f166-e154-46d6-a4d7-696894b43aa2 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Returning 404 to user: Service cd7e86c9-0520-4142-b7b2-d547e30d3936 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:14.501702 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3720f166-e154-46d6-a4d7-696894b43aa2 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/cd7e86c9-0520-4142-b7b2-d547e30d3936" status: 404 len: 110 microversion: 2.53 time: 0.040673 Oct 29 02:46:14.502710 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 110/228] 10.222.0.16 () {62 vars in 1309 bytes} [Sat Oct 29 02:46:14 2022] PUT /compute/v2.1/os-services/cd7e86c9-0520-4142-b7b2-d547e30d3936 => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:46:14.511195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-26eb3308-156c-4ced-95de-a7f5659303bb tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.515823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26eb3308-156c-4ced-95de-a7f5659303bb tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.516481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26eb3308-156c-4ced-95de-a7f5659303bb tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.516950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26eb3308-156c-4ced-95de-a7f5659303bb tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.517829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26eb3308-156c-4ced-95de-a7f5659303bb tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.518622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26eb3308-156c-4ced-95de-a7f5659303bb tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.519083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26eb3308-156c-4ced-95de-a7f5659303bb tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.546187 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-26eb3308-156c-4ced-95de-a7f5659303bb tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1260 microversion: 2.53 time: 0.038544 Oct 29 02:46:14.556481 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 111/229] 10.222.0.16 () {60 vars in 1178 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/os-services => generated 1260 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:14.564389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-97adaeb4-1953-4ae2-83e3-f66626f4f9d0 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.570716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97adaeb4-1953-4ae2-83e3-f66626f4f9d0 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.571590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97adaeb4-1953-4ae2-83e3-f66626f4f9d0 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.572195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97adaeb4-1953-4ae2-83e3-f66626f4f9d0 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.573080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97adaeb4-1953-4ae2-83e3-f66626f4f9d0 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.573699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97adaeb4-1953-4ae2-83e3-f66626f4f9d0 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.574290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97adaeb4-1953-4ae2-83e3-f66626f4f9d0 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.638012 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-97adaeb4-1953-4ae2-83e3-f66626f4f9d0 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1260 microversion: 2.53 time: 0.078697 Oct 29 02:46:14.641950 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 112/230] 10.222.0.16 () {60 vars in 1211 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1260 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:14.661059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5110acb3-e2f5-49ad-8a61-eb1bf8c15a96 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.678509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5110acb3-e2f5-49ad-8a61-eb1bf8c15a96 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.681761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5110acb3-e2f5-49ad-8a61-eb1bf8c15a96 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.682835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5110acb3-e2f5-49ad-8a61-eb1bf8c15a96 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.687384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5110acb3-e2f5-49ad-8a61-eb1bf8c15a96 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.688710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5110acb3-e2f5-49ad-8a61-eb1bf8c15a96 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.689398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5110acb3-e2f5-49ad-8a61-eb1bf8c15a96 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.723724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1016483249", "block_migration": true, "disk_over_commit": false}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:14.728970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:14.731415 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5110acb3-e2f5-49ad-8a61-eb1bf8c15a96 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1260 microversion: 2.53 time: 0.074922 Oct 29 02:46:14.740586 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 113/231] 10.222.0.16 () {60 vars in 1178 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/os-services => generated 1260 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:14.745922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-318268b6-0601-48ac-8ae5-4507af4cf765 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.748069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.748569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.749001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.749706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.750185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.750602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.752215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-318268b6-0601-48ac-8ae5-4507af4cf765 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.754131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-318268b6-0601-48ac-8ae5-4507af4cf765 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.755405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-318268b6-0601-48ac-8ae5-4507af4cf765 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.762709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-318268b6-0601-48ac-8ae5-4507af4cf765 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.763451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-318268b6-0601-48ac-8ae5-4507af4cf765 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.764069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-318268b6-0601-48ac-8ae5-4507af4cf765 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.822305 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-318268b6-0601-48ac-8ae5-4507af4cf765 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-862964-4&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.080435 Oct 29 02:46:14.830438 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 114/232] 10.222.0.16 () {60 vars in 1235 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/os-services?host=n-d-862964-4&binary=xxx => generated 16 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:14.835152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fdf5d1a4-9e60-4a07-82ab-c75dbf756148 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.838817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdf5d1a4-9e60-4a07-82ab-c75dbf756148 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.839363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdf5d1a4-9e60-4a07-82ab-c75dbf756148 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.839952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdf5d1a4-9e60-4a07-82ab-c75dbf756148 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.841093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdf5d1a4-9e60-4a07-82ab-c75dbf756148 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.841698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdf5d1a4-9e60-4a07-82ab-c75dbf756148 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.842278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdf5d1a4-9e60-4a07-82ab-c75dbf756148 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.868169 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fdf5d1a4-9e60-4a07-82ab-c75dbf756148 tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1260 microversion: 2.53 time: 0.036608 Oct 29 02:46:14.868774 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 115/233] 10.222.0.16 () {60 vars in 1178 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/os-services => generated 1260 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:14.878907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.879498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:14.885626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.886235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.886649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.887454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.887923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.888446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.942128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.942868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.946345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.947035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lazy-loading 'fault' on Instance uuid 8d968c73-0802-46ee-8972-e48ba3168aa6 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:14.999177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255cc5a6e9584a1f94b290b617cad351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea773130ed4742915da0d5abf84f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:15.009274 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79d8891e-a148-4f67-9c16-ed56bfd7c31b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 200 len: 1328 microversion: 2.1 time: 0.134318 Oct 29 02:46:15.013854 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 116/234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 1328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:15.015100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-80043536-7fc0-40ac-ab3d-3febc11d699f tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:15.019128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80043536-7fc0-40ac-ab3d-3febc11d699f tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.019653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80043536-7fc0-40ac-ab3d-3febc11d699f tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.020107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80043536-7fc0-40ac-ab3d-3febc11d699f tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.020843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80043536-7fc0-40ac-ab3d-3febc11d699f tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.021449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80043536-7fc0-40ac-ab3d-3febc11d699f tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.021763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80043536-7fc0-40ac-ab3d-3febc11d699f tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.032293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lazy-loading 'flavor' on Instance uuid bec03293-594f-445f-8d70-7072771a2366 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:15.048713 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-80043536-7fc0-40ac-ab3d-3febc11d699f tempest-ServicesAdminNegativeV253TestJSON-1429888939 tempest-ServicesAdminNegativeV253TestJSON-1429888939-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.037433 Oct 29 02:46:15.049625 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 117/235] 10.222.0.16 () {60 vars in 1239 bytes} [Sat Oct 29 02:46:15 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:15.095696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] [instance: bec03293-594f-445f-8d70-7072771a2366] Going to try to live migrate instance to tempest-host-1016483249 {{(pid=127041) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:46:15.103520 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] HTTP exception thrown: Compute host tempest-host-1016483249 could not be found. Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Request method failure captured: Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366/action HTTP/1.1 Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 107 Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPg-vutFH2RpvVjqr49LggtpGpMiup_xjPT1RvAy22hXXlOjdZEBUqDKxeCbTAaiTj3Bm6wpjlEudnzwhOAfcjXTzyxe22vwkiVyOUyixntYimdYsw10LPOsvFOQSzcdIysDxn9XyYugkveEf7CVL9xlhKhVsIEVquN4jg5Qvw1EVM Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 30dfe0aa5f804f7080e8d026ff0bcd92 Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-LiveMigrationNegativeTest-1271877306 Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:46:15.108559 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30dfe0aa5f804f7080e8d026ff0bcd92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30dfe0aa5f804f7080e8d026ff0bcd92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30dfe0aa5f804f7080e8d026ff0bcd92", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30dfe0aa5f804f7080e8d026ff0bcd92"}]}] Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-LiveMigrationNegativeTest-1271877306 Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 30dfe0aa5f804f7080e8d026ff0bcd92 Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1271877306 Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-LiveMigrationNegativeTest-1271877306-project-admin Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: c5a9c291f290489caa0a328d923c3488 Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-LiveMigrationNegativeTest-1271877306-project-admin Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: {"os-migrateLive": {"host": "tempest-host-1016483249", "block_migration": true, "disk_over_commit": false}} Oct 29 02:46:15.109747 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: exception: Compute host tempest-host-1016483249 could not be found. Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'bec03293-594f-445f-8d70-7072771a2366', 'body': {'os-migrateLive': {'host': 'tempest-host-1016483249', 'block_migration': True, 'disk_over_commit': False}}} Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:46:15.110653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1016483249 could not be found. Oct 29 02:46:15.111645 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1016483249 could not be found. Oct 29 02:46:15.112650 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:15.113658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:15.113658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:15.113658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:15.113658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:15.113658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:15.113658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:15.113658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:15.113658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1016483249 could not be found. Oct 29 02:46:15.113658 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:15.113658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Returning 400 to user: Compute host tempest-host-1016483249 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:15.113658 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-984f64dc-0968-4c08-ae80-98adcaf35eee tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366/action" status: 400 len: 100 microversion: 2.1 time: 0.613456 Oct 29 02:46:15.118849 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 119/236] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Oct 29 02:46:14 2022] POST /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366/action => generated 100 bytes in 619 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:46:15.129249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-03c62a2c-dfe5-4887-91a9-9d7ff44faecd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:15.130039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-03c62a2c-dfe5-4887-91a9-9d7ff44faecd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:15.140725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c62a2c-dfe5-4887-91a9-9d7ff44faecd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.141831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c62a2c-dfe5-4887-91a9-9d7ff44faecd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.143045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c62a2c-dfe5-4887-91a9-9d7ff44faecd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.144770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c62a2c-dfe5-4887-91a9-9d7ff44faecd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.145477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c62a2c-dfe5-4887-91a9-9d7ff44faecd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.146381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c62a2c-dfe5-4887-91a9-9d7ff44faecd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.296277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6317fdb6-4be2-4172-8da1-f829db354adf tempest-ServicesAdminNegativeV253TestJSON-1390888960 tempest-ServicesAdminNegativeV253TestJSON-1390888960-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:15.302366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6317fdb6-4be2-4172-8da1-f829db354adf tempest-ServicesAdminNegativeV253TestJSON-1390888960 tempest-ServicesAdminNegativeV253TestJSON-1390888960-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '379b9151d1c04a008a54b5cd20d27c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a163557c7c794c75bffb275e370b8c03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6317fdb6-4be2-4172-8da1-f829db354adf tempest-ServicesAdminNegativeV253TestJSON-1390888960 tempest-ServicesAdminNegativeV253TestJSON-1390888960-project] Request method failure captured: Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJP1Hq0DtCHa7HqPURW1UECm04s0qDiBfOkAhainmV0zeziaabcMGOLnDzmRO2C4owUOQ7r-Vwk2UhWVURNc_Gnukz879UQZMLZbwIOhbGW2QTix5EqDql_dKjEGNpDSXpYc4QeAZudBh4xGDUdxIBWnXd29NuOV_bSsDPX-BelhC5k Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: a163557c7c794c75bffb275e370b8c03 Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1390888960 Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:46:15.304451 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a163557c7c794c75bffb275e370b8c03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a163557c7c794c75bffb275e370b8c03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a163557c7c794c75bffb275e370b8c03", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a163557c7c794c75bffb275e370b8c03"}]}] Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1390888960 Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: a163557c7c794c75bffb275e370b8c03 Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1390888960 Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1390888960-project Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 379b9151d1c04a008a54b5cd20d27c92 Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1390888960-project Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 02:46:15.305683 n-d-862964-4 devstack@n-api.service[127042]: action_args: {} Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:15.306350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 02:46:15.307858 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:15.310373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6317fdb6-4be2-4172-8da1-f829db354adf tempest-ServicesAdminNegativeV253TestJSON-1390888960 tempest-ServicesAdminNegativeV253TestJSON-1390888960-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:15.310373 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6317fdb6-4be2-4172-8da1-f829db354adf tempest-ServicesAdminNegativeV253TestJSON-1390888960 tempest-ServicesAdminNegativeV253TestJSON-1390888960-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.244536 Oct 29 02:46:15.311051 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 118/237] 10.222.0.16 () {60 vars in 1178 bytes} [Sat Oct 29 02:46:15 2022] GET /compute/v2.1/os-services => generated 112 bytes in 251 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:46:15.362347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-11dec88b-743f-4530-8504-3839af762a0d tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:15.362957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-11dec88b-743f-4530-8504-3839af762a0d tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:15.375922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11dec88b-743f-4530-8504-3839af762a0d tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.377556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11dec88b-743f-4530-8504-3839af762a0d tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.378192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11dec88b-743f-4530-8504-3839af762a0d tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.378299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-03c62a2c-dfe5-4887-91a9-9d7ff44faecd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:15.379187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11dec88b-743f-4530-8504-3839af762a0d tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.379855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11dec88b-743f-4530-8504-3839af762a0d tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.380477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11dec88b-743f-4530-8504-3839af762a0d tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.386309 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-03c62a2c-dfe5-4887-91a9-9d7ff44faecd tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1490 microversion: 2.1 time: 0.262727 Oct 29 02:46:15.386888 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 120/238] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:15 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1490 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:15.490769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:15.491712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:15.500405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.501202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.502012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.502909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.503548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.504153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.514326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-11dec88b-743f-4530-8504-3839af762a0d tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:15.524456 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-11dec88b-743f-4530-8504-3839af762a0d tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1278 microversion: 2.1 time: 0.165133 Oct 29 02:46:15.542187 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 119/239] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:15 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:15.577280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5422e6bd-480d-4084-aa6e-1d26485abdaf tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:15.578326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5422e6bd-480d-4084-aa6e-1d26485abdaf tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:15.591602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5422e6bd-480d-4084-aa6e-1d26485abdaf tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.594367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5422e6bd-480d-4084-aa6e-1d26485abdaf tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.594997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5422e6bd-480d-4084-aa6e-1d26485abdaf tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.595884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5422e6bd-480d-4084-aa6e-1d26485abdaf tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.596736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5422e6bd-480d-4084-aa6e-1d26485abdaf tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.600467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5422e6bd-480d-4084-aa6e-1d26485abdaf tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.673059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:15.682010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:15.683507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:15.692600 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b39e1a5e-f794-4745-b2f4-59db1e940009 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.208259 Oct 29 02:46:15.693502 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 121/240] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:15 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:15.698828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1323684917", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:15.785550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:15.935613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5422e6bd-480d-4084-aa6e-1d26485abdaf tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:15.944705 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5422e6bd-480d-4084-aa6e-1d26485abdaf tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 200 len: 1608 microversion: 2.1 time: 0.371409 Oct 29 02:46:15.947199 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 120/241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:15 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 1608 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:15.962631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-293a7bb5-9de4-4068-8aa6-72dde2e12c21 req-28e41277-aecc-4988-a6ed-89158391a0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e905f88b-7b01-4091-946f-fa0e0abdab0d", "tag": "363f1891-2fd3-41b7-8910-0ec693798817"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:15.984283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-293a7bb5-9de4-4068-8aa6-72dde2e12c21 req-28e41277-aecc-4988-a6ed-89158391a0ff service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.984963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-293a7bb5-9de4-4068-8aa6-72dde2e12c21 req-28e41277-aecc-4988-a6ed-89158391a0ff service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.985550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-293a7bb5-9de4-4068-8aa6-72dde2e12c21 req-28e41277-aecc-4988-a6ed-89158391a0ff service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.007556 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-293a7bb5-9de4-4068-8aa6-72dde2e12c21 req-28e41277-aecc-4988-a6ed-89158391a0ff service nova] Creating event network-changed:363f1891-2fd3-41b7-8910-0ec693798817 for instance e905f88b-7b01-4091-946f-fa0e0abdab0d on n-h2-862964-4 Oct 29 02:46:16.027960 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-293a7bb5-9de4-4068-8aa6-72dde2e12c21 req-28e41277-aecc-4988-a6ed-89158391a0ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076686 Oct 29 02:46:16.029130 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 121/242] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:16.034364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.035265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:16.052431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.053091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.053780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.054733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.055354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.055926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.077178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] HTTP exception thrown: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Request method failure captured: Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 HTTP/1.1 Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPE0Iy6NYxUY_GnPzyPmP6roBcByXJyVPzIqA7OnjDxSirQRzbNh3ZRdoRL7JzvktFfm10DfCWiriVlTowUKz7KJNuN4gbVbQ-nCQyB9o72twqEA4DIgU3pKQRWjDBGRLbFeDRWcdb4kWz_g1CR9NdGMdw_ZYfjtdQDaLVOhpI-eN0 Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 67ea773130ed4742915da0d5abf84f3a Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AggregatesAdminTestJSON-1553973375 Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:46:16.083135 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67ea773130ed4742915da0d5abf84f3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67ea773130ed4742915da0d5abf84f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67ea773130ed4742915da0d5abf84f3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67ea773130ed4742915da0d5abf84f3a"}]}] Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AggregatesAdminTestJSON-1553973375 Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 67ea773130ed4742915da0d5abf84f3a Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1553973375 Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AggregatesAdminTestJSON-1553973375-project Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 255cc5a6e9584a1f94b290b617cad351 Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AggregatesAdminTestJSON-1553973375-project Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:16.084298 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '8d968c73-0802-46ee-8972-e48ba3168aa6'} Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:16.084937 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:16.085952 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:16.088436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Returning 404 to user: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:16.089952 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-209a77fa-8dfb-414f-9248-ab23ea37d74e tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 404 len: 111 microversion: 2.1 time: 0.059534 Oct 29 02:46:16.094323 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 122/243] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:16 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:16.101026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b10d36bd-e94c-47e5-a80c-fcef95877026 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862964-4"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:16.115721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b10d36bd-e94c-47e5-a80c-fcef95877026 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.116524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b10d36bd-e94c-47e5-a80c-fcef95877026 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.117136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b10d36bd-e94c-47e5-a80c-fcef95877026 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.123273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:16.262331 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b10d36bd-e94c-47e5-a80c-fcef95877026 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 297 microversion: 2.1 time: 0.164874 Oct 29 02:46:16.264144 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 123/244] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Oct 29 02:46:16 2022] POST /compute/v2.1/os-aggregates/4/action => generated 297 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:16.279948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6427b3aa-3612-4f4b-bd17-a7027593fb15 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.280137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:16.280419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:16.280825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:16.281223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:16.281620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:16.291133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:16.300270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.302053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.304434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.305373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.306347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.308125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.350796 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6427b3aa-3612-4f4b-bd17-a7027593fb15 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.077456 Oct 29 02:46:16.366071 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 124/245] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:16 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 29 02:46:16.366158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Getting quotas for project 95e80c722df94993b9231f5b17ee4c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:16.376715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Getting quotas for user de04aa74bc1f403ea9818dcbcaba7b63 and project 95e80c722df94993b9231f5b17ee4c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:16.380168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d000f05d-7758-4898-994e-2d2ca0c9f3d4 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Calling method '.version_select at 0x7fe1a9466f70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.384956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d000f05d-7758-4898-994e-2d2ca0c9f3d4 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.385532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d000f05d-7758-4898-994e-2d2ca0c9f3d4 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.386065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d000f05d-7758-4898-994e-2d2ca0c9f3d4 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.386875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d000f05d-7758-4898-994e-2d2ca0c9f3d4 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.387374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d000f05d-7758-4898-994e-2d2ca0c9f3d4 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.387978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d000f05d-7758-4898-994e-2d2ca0c9f3d4 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.409383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:16.416002 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d000f05d-7758-4898-994e-2d2ca0c9f3d4 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.044132 Oct 29 02:46:16.417050 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 125/246] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Oct 29 02:46:16 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:16.417887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:16.427732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cfe19ea8-25e8-485f-b86d-e062e68a0be1 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Calling method '.version_select at 0x7fe1a918f5e0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.431598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfe19ea8-25e8-485f-b86d-e062e68a0be1 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.432129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfe19ea8-25e8-485f-b86d-e062e68a0be1 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.432724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfe19ea8-25e8-485f-b86d-e062e68a0be1 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.433711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfe19ea8-25e8-485f-b86d-e062e68a0be1 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.434210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfe19ea8-25e8-485f-b86d-e062e68a0be1 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.434693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfe19ea8-25e8-485f-b86d-e062e68a0be1 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.463347 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cfe19ea8-25e8-485f-b86d-e062e68a0be1 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.038495 Oct 29 02:46:16.464678 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 126/247] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:16 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:16.478261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f12a986f-e371-46bc-a324-ab9c1ed6dcd7 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Calling method '.version_select at 0x7fe1a929d820>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.484352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f12a986f-e371-46bc-a324-ab9c1ed6dcd7 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.484861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f12a986f-e371-46bc-a324-ab9c1ed6dcd7 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.485350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f12a986f-e371-46bc-a324-ab9c1ed6dcd7 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.486365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f12a986f-e371-46bc-a324-ab9c1ed6dcd7 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.486968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f12a986f-e371-46bc-a324-ab9c1ed6dcd7 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.487446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f12a986f-e371-46bc-a324-ab9c1ed6dcd7 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.519479 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f12a986f-e371-46bc-a324-ab9c1ed6dcd7 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.044819 Oct 29 02:46:16.520728 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 127/248] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Oct 29 02:46:16 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:16.525605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5e5a560f-cc55-4252-a7c6-374ed6d81ef6 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2121681978"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:16.528894 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54311e0b-4bf3-4809-b79f-9a279b96ecc1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833894 Oct 29 02:46:16.529561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.aggregate [None req-5e5a560f-cc55-4252-a7c6-374ed6d81ef6 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Generated uuid bd9155bd-4a55-492f-abe9-945e4de38632 for aggregate {{(pid=127042) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:16.532745 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 122/249] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:46:16.549563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90831d87-c002-4311-8c71-6c5dac78a811 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Calling method '.version_select at 0x7fe1a919d4c0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.572977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90831d87-c002-4311-8c71-6c5dac78a811 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.573398 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5e5a560f-cc55-4252-a7c6-374ed6d81ef6 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050999 Oct 29 02:46:16.574644 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 128/250] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:16.575044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90831d87-c002-4311-8c71-6c5dac78a811 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.575768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90831d87-c002-4311-8c71-6c5dac78a811 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.581175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-30fb3c9f-f011-4066-b788-e4173bcacdf0 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.582796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-30fb3c9f-f011-4066-b788-e4173bcacdf0 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:16.587425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:16.611544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90831d87-c002-4311-8c71-6c5dac78a811 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.612386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90831d87-c002-4311-8c71-6c5dac78a811 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.613056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90831d87-c002-4311-8c71-6c5dac78a811 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.655131 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-90831d87-c002-4311-8c71-6c5dac78a811 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h2-862964-4" status: 200 len: 598 microversion: 2.1 time: 0.118845 Oct 29 02:46:16.661864 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 123/251] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Oct 29 02:46:16 2022] GET /compute/v2.1/os-hosts/n-h2-862964-4 => generated 598 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:16.669835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2d9ebd5a-70cf-4e2a-ba6b-c7358a1b8cf8 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.672782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2d9ebd5a-70cf-4e2a-ba6b-c7358a1b8cf8 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:16.686914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9ebd5a-70cf-4e2a-ba6b-c7358a1b8cf8 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.689235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9ebd5a-70cf-4e2a-ba6b-c7358a1b8cf8 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.690837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9ebd5a-70cf-4e2a-ba6b-c7358a1b8cf8 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.693352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9ebd5a-70cf-4e2a-ba6b-c7358a1b8cf8 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.695553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9ebd5a-70cf-4e2a-ba6b-c7358a1b8cf8 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.696174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9ebd5a-70cf-4e2a-ba6b-c7358a1b8cf8 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.715314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-30fb3c9f-f011-4066-b788-e4173bcacdf0 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:16.735991 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-30fb3c9f-f011-4066-b788-e4173bcacdf0 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1219 microversion: 2.1 time: 0.156588 Oct 29 02:46:16.749829 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 129/252] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:16 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:16.749829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9cc0fd9b-5f31-46f5-83b9-0ec99a309d3d tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862964-4"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:16.767612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9cc0fd9b-5f31-46f5-83b9-0ec99a309d3d tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.770837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9cc0fd9b-5f31-46f5-83b9-0ec99a309d3d tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.771339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9cc0fd9b-5f31-46f5-83b9-0ec99a309d3d tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.016677 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9cc0fd9b-5f31-46f5-83b9-0ec99a309d3d tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.278568 Oct 29 02:46:17.018091 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 130/253] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Oct 29 02:46:16 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:17.022784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d85abff-228b-4a4f-bf02-e62604494706 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Calling method '.version_select at 0x7fe1a91f2790>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:17.045509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d85abff-228b-4a4f-bf02-e62604494706 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.045744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d85abff-228b-4a4f-bf02-e62604494706 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.046196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d85abff-228b-4a4f-bf02-e62604494706 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.072060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d85abff-228b-4a4f-bf02-e62604494706 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.072541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d85abff-228b-4a4f-bf02-e62604494706 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.072979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d85abff-228b-4a4f-bf02-e62604494706 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.094962 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d85abff-228b-4a4f-bf02-e62604494706 tempest-HostsAdminTestJSON-1569718999 tempest-HostsAdminTestJSON-1569718999-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h1-862964-4" status: 200 len: 598 microversion: 2.1 time: 0.075730 Oct 29 02:46:17.095947 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 131/254] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Oct 29 02:46:17 2022] GET /compute/v2.1/os-hosts/n-h1-862964-4 => generated 598 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:17.101004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:17.101610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:17.108804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.109418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.109714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.110454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.110905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.111321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.187502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2d9ebd5a-70cf-4e2a-ba6b-c7358a1b8cf8 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:17.200639 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2d9ebd5a-70cf-4e2a-ba6b-c7358a1b8cf8 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1320 microversion: 2.1 time: 0.540370 Oct 29 02:46:17.201856 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 124/255] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:16 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1320 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:17.206981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ad88ff58-1edd-4e05-9c7f-66191a39a739 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:17.210300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ad88ff58-1edd-4e05-9c7f-66191a39a739 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '52e91da7b94f490faf595d5de7818ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a3d738a21746bd996db6a866ff6e7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ad88ff58-1edd-4e05-9c7f-66191a39a739 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Request method failure captured: Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 42 Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPEtGOHzCaAVnuDuhX02GpdM00-srj_U38LzouY0YTwthd-7LyqFOjcmiG9B0jBdOU-6p-F4NcUQZeL0R7gCHn_7nlA6pTWZtbtPkRevDcLiXArjHt1dOXtl2Pgw5F-gypIUDYWnyDYZps8efPMab_PG9W2OUaV8y_c3X-y1lrPa9Q Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:46:17.212034 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24a3d738a21746bd996db6a866ff6e7b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24a3d738a21746bd996db6a866ff6e7b"}]}] Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 24a3d738a21746bd996db6a866ff6e7b Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-304777606 Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 52e91da7b94f490faf595d5de7818ac1 Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-304777606-project Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: {"remove_host": {"host": "n-h2-862964-4"}} Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:17.213480 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '9', 'body': {'remove_host': {'host': 'n-h2-862964-4'}}} Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:17.214646 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 02:46:17.215843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.218014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ad88ff58-1edd-4e05-9c7f-66191a39a739 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:17.219044 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ad88ff58-1edd-4e05-9c7f-66191a39a739 tempest-AggregatesAdminNegativeTestJSON-304777606 tempest-AggregatesAdminNegativeTestJSON-304777606-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 121 microversion: 2.1 time: 0.016112 Oct 29 02:46:17.220089 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 125/256] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Oct 29 02:46:17 2022] POST /compute/v2.1/os-aggregates/9/action => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:17.228031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6d7c9fce-97dc-40bd-a64f-4ca3c26a0f77 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:17.255850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:17.266499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d7c9fce-97dc-40bd-a64f-4ca3c26a0f77 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.268174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d7c9fce-97dc-40bd-a64f-4ca3c26a0f77 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.268766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d7c9fce-97dc-40bd-a64f-4ca3c26a0f77 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.274058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:17.275677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:17.290378 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8594ea8e-93a6-49a5-b24c-7c85fb1b3fa3 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.192944 Oct 29 02:46:17.291256 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 132/257] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:17 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:17.472755 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6d7c9fce-97dc-40bd-a64f-4ca3c26a0f77 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.248204 Oct 29 02:46:17.474580 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 126/258] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Oct 29 02:46:17 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:17.486467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-342a5de1-4d8c-47b1-aa9b-8b7d4cbc5323 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:17.526945 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-342a5de1-4d8c-47b1-aa9b-8b7d4cbc5323 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.044610 Oct 29 02:46:17.531375 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 133/259] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:17 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:17.546957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ccc55ffc-4b7c-4212-9d0b-90bb52997d38 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1291441584"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:17.549133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.aggregate [None req-ccc55ffc-4b7c-4212-9d0b-90bb52997d38 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Generated uuid d6ae2681-c718-4fb0-9fb8-848912e81a5f for aggregate {{(pid=127041) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:17.587706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=7,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:17.599835 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ccc55ffc-4b7c-4212-9d0b-90bb52997d38 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062790 Oct 29 02:46:17.609074 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 127/260] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:17.615182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:17.628273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0ba33f1a-f24a-4e05-b9f1-b926fd250ae6 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-537304705"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:17.639419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.aggregate [None req-0ba33f1a-f24a-4e05-b9f1-b926fd250ae6 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Generated uuid df89ce74-db1d-45f3-8992-fa39c43418e4 for aggregate {{(pid=127041) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:17.640230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.640940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.645053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.662321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.665598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.668172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.693442 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.compute.aggregates [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Failed to remove host nonexist_host from aggregate 10. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 29 02:46:17.696078 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 10 Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Request method failure captured: Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 42 Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPHefmrPM_roLibvFmwIOYvUzBOpmZ_1LGFKIT13dWBD6T6vyZuUgMMWjJo3ldkyImZ7rmnXgmHhvRhL_qbdsoWMRR0pBea9FekAwurOAK9y3YBG5p9fo073qq9bdtTJxc7VOAPl-VAVzMPL3WyBWCl6a663V4zILypDNV3dvTaY2k Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:17.710885 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a4b3b6cab248409e63a216709fc3ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a4b3b6cab248409e63a216709fc3ff"}]}] Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b7a4b3b6cab248409e63a216709fc3ff Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-780151512 Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 77e6e3697dce4888930c0f1977f2bbb5 Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: {"remove_host": {"host": "nonexist_host"}} Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:17.712146 n-d-862964-4 devstack@n-api.service[127042]: exception: Cannot remove host nonexist_host in aggregate 10 Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '10', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 29 02:46:17.712845 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 29 02:46:17.714012 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 10 Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.715576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:17.717750 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:17.717750 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:17.717750 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:17.717750 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:17.717750 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 10 Oct 29 02:46:17.717750 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:17.718597 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0ba33f1a-f24a-4e05-b9f1-b926fd250ae6 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.088451 Oct 29 02:46:17.726620 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 128/261] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:17.734788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-34762b2a-f8c1-4215-bfa6-86f2e83e374b tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:17.744143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 10 {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:17.751337 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a18c6294-965a-4210-a04a-515970c50146 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 94 microversion: 2.1 time: 0.140613 Oct 29 02:46:17.753059 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 134/262] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:17 2022] POST /compute/v2.1/os-aggregates/10/action => generated 94 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:17.764490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34762b2a-f8c1-4215-bfa6-86f2e83e374b tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.765128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34762b2a-f8c1-4215-bfa6-86f2e83e374b tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.765559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34762b2a-f8c1-4215-bfa6-86f2e83e374b tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.767720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63814f37-9904-48f0-a3e3-906b8923be34 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:17.784646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-63814f37-9904-48f0-a3e3-906b8923be34 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:17.809479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63814f37-9904-48f0-a3e3-906b8923be34 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.809779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63814f37-9904-48f0-a3e3-906b8923be34 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.810253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63814f37-9904-48f0-a3e3-906b8923be34 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.810969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63814f37-9904-48f0-a3e3-906b8923be34 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.811383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63814f37-9904-48f0-a3e3-906b8923be34 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.811801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63814f37-9904-48f0-a3e3-906b8923be34 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.959871 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-34762b2a-f8c1-4215-bfa6-86f2e83e374b tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.231644 Oct 29 02:46:17.961071 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 129/263] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:17 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:17.966135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b8406f8c-28bd-47af-bd67-42b29dea73b2 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:17.994025 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b8406f8c-28bd-47af-bd67-42b29dea73b2 tempest-AggregatesAdminNegativeTestJSON-780151512 tempest-AggregatesAdminNegativeTestJSON-780151512-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.031452 Oct 29 02:46:17.999995 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 130/264] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:17 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:18.008870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d83b0109-2d66-4e9e-b9ff-62e982cfd644 req-f967eb94-98d6-498c-abdd-eae64156c61a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30418c29-fcfc-4ba8-9660-93ca7329a30f", "tag": "bb5e9c70-51d2-4672-90c8-0debb6dda7f5"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:18.021036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d83b0109-2d66-4e9e-b9ff-62e982cfd644 req-f967eb94-98d6-498c-abdd-eae64156c61a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.021943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d83b0109-2d66-4e9e-b9ff-62e982cfd644 req-f967eb94-98d6-498c-abdd-eae64156c61a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.022617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d83b0109-2d66-4e9e-b9ff-62e982cfd644 req-f967eb94-98d6-498c-abdd-eae64156c61a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.028480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-63814f37-9904-48f0-a3e3-906b8923be34 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:18.041096 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-63814f37-9904-48f0-a3e3-906b8923be34 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1215 microversion: 2.1 time: 0.283673 Oct 29 02:46:18.042919 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 135/265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:17 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1215 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:18.051618 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d83b0109-2d66-4e9e-b9ff-62e982cfd644 req-f967eb94-98d6-498c-abdd-eae64156c61a service nova] Creating event network-changed:bb5e9c70-51d2-4672-90c8-0debb6dda7f5 for instance 30418c29-fcfc-4ba8-9660-93ca7329a30f on n-h1-862964-4 Oct 29 02:46:18.062877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-31c3f316-63af-40d1-a555-5b2ab0ab79b5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:18.085031 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d83b0109-2d66-4e9e-b9ff-62e982cfd644 req-f967eb94-98d6-498c-abdd-eae64156c61a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081232 Oct 29 02:46:18.089434 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-31c3f316-63af-40d1-a555-5b2ab0ab79b5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 242 microversion: 2.1 time: 0.044939 Oct 29 02:46:18.089712 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 131/266] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:18.091119 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 136/267] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:18 2022] GET /compute/v2.1/os-aggregates/11 => generated 242 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:18.108606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bbb6e487-2111-44d1-9b7a-22d80b6925a9 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:18.123322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbb6e487-2111-44d1-9b7a-22d80b6925a9 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.124100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbb6e487-2111-44d1-9b7a-22d80b6925a9 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.124761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbb6e487-2111-44d1-9b7a-22d80b6925a9 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.227521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f682cee4-4826-4e5a-92b4-5fcaded1c1ea tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:18.229096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f682cee4-4826-4e5a-92b4-5fcaded1c1ea tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:18.251480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f682cee4-4826-4e5a-92b4-5fcaded1c1ea tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.255653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f682cee4-4826-4e5a-92b4-5fcaded1c1ea tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.259399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f682cee4-4826-4e5a-92b4-5fcaded1c1ea tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.265721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f682cee4-4826-4e5a-92b4-5fcaded1c1ea tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.267581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f682cee4-4826-4e5a-92b4-5fcaded1c1ea tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.270909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f682cee4-4826-4e5a-92b4-5fcaded1c1ea tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.325868 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bbb6e487-2111-44d1-9b7a-22d80b6925a9 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.226282 Oct 29 02:46:18.332842 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 132/268] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:18 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:18.333435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:18.334308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:18.342135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.342688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.343317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.344594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.345289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.346468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.443434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:18.452819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:18.455941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:18.461616 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8029a890-23c0-4c37-b4b1-11a4c21f3361 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.133406 Oct 29 02:46:18.462855 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 133/269] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:18 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:18.473475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d9fa445-e893-44df-a298-b525e50cecb8 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:18.499333 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d9fa445-e893-44df-a298-b525e50cecb8 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.035183 Oct 29 02:46:18.500293 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 134/270] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:18 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:18.512023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5f21e8ad-fec9-42ad-a197-b62bbcd76ca6 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1137372318"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:18.516072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.aggregate [None req-5f21e8ad-fec9-42ad-a197-b62bbcd76ca6 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Generated uuid fab94d9f-9a90-4c19-b03c-9fd51af76223 for aggregate {{(pid=127041) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:18.545358 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5f21e8ad-fec9-42ad-a197-b62bbcd76ca6 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.037857 Oct 29 02:46:18.558769 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 135/271] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:18.563276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aa864bc4-72d2-468d-855c-189073f66fd0 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:18.576493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa864bc4-72d2-468d-855c-189073f66fd0 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.576986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa864bc4-72d2-468d-855c-189073f66fd0 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.577415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa864bc4-72d2-468d-855c-189073f66fd0 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.703331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f682cee4-4826-4e5a-92b4-5fcaded1c1ea tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:18.712514 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f682cee4-4826-4e5a-92b4-5fcaded1c1ea tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1320 microversion: 2.1 time: 0.489524 Oct 29 02:46:18.715684 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 137/272] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:18 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1320 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:18.775420 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aa864bc4-72d2-468d-855c-189073f66fd0 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.215718 Oct 29 02:46:18.776979 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 136/273] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:18 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:18.788383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-065f653a-7ba8-479f-a3c8-1c6172094c6f tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:18.799444 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-065f653a-7ba8-479f-a3c8-1c6172094c6f tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.015344 Oct 29 02:46:18.800064 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 138/274] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:46:18 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:18.812486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4cc6f273-7f5f-409a-a78e-4637ec7e4a61 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:18.825853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cc6f273-7f5f-409a-a78e-4637ec7e4a61 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.826702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cc6f273-7f5f-409a-a78e-4637ec7e4a61 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.827927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cc6f273-7f5f-409a-a78e-4637ec7e4a61 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.987242 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4cc6f273-7f5f-409a-a78e-4637ec7e4a61 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.179085 Oct 29 02:46:18.987853 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 137/275] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:18 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:19.003516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-01aa45c7-9e5c-4d24-a06e-688700fb5ab2 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.064636 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-01aa45c7-9e5c-4d24-a06e-688700fb5ab2 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.069115 Oct 29 02:46:19.072035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e55c193c-440b-4e89-a1f8-9460f3fc1b6d tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.072739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e55c193c-440b-4e89-a1f8-9460f3fc1b6d tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:19.083437 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 139/276] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:18 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:19.088596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e55c193c-440b-4e89-a1f8-9460f3fc1b6d tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.092056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-103ad0c0-ee0b-48a1-bca5-dc0fbf4f4fea tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1131717856"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:19.093709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e55c193c-440b-4e89-a1f8-9460f3fc1b6d tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.094264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e55c193c-440b-4e89-a1f8-9460f3fc1b6d tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.095058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e55c193c-440b-4e89-a1f8-9460f3fc1b6d tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.095523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e55c193c-440b-4e89-a1f8-9460f3fc1b6d tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.098607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e55c193c-440b-4e89-a1f8-9460f3fc1b6d tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.107129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.aggregate [None req-103ad0c0-ee0b-48a1-bca5-dc0fbf4f4fea tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Generated uuid 5ee3eab1-a7b7-4571-9ed9-6538ff81583a for aggregate {{(pid=127042) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:19.152192 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-103ad0c0-ee0b-48a1-bca5-dc0fbf4f4fea tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067155 Oct 29 02:46:19.153148 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 140/277] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:19 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:19.169817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d82cbed-ec1b-48d6-9d74-da9aef28c3fb tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862964-4"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:19.200906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d82cbed-ec1b-48d6-9d74-da9aef28c3fb tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.201300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d82cbed-ec1b-48d6-9d74-da9aef28c3fb tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.203138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d82cbed-ec1b-48d6-9d74-da9aef28c3fb tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.294746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e55c193c-440b-4e89-a1f8-9460f3fc1b6d tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:19.309238 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e55c193c-440b-4e89-a1f8-9460f3fc1b6d tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1277 microversion: 2.1 time: 0.242013 Oct 29 02:46:19.329211 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 138/278] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:19 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1277 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:19.460349 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d82cbed-ec1b-48d6-9d74-da9aef28c3fb tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.297130 Oct 29 02:46:19.468813 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 141/279] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:19 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:19.473138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7215db4b-f1ee-4194-a3e6-e65cb675fdfa tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:19.488492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7215db4b-f1ee-4194-a3e6-e65cb675fdfa tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.489335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7215db4b-f1ee-4194-a3e6-e65cb675fdfa tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.490252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7215db4b-f1ee-4194-a3e6-e65cb675fdfa tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.492662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.493275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:19.510432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.511642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.513263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.517117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.519350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.520063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.624912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:19.647433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:19.652500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:19.656125 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7215db4b-f1ee-4194-a3e6-e65cb675fdfa tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.186998 Oct 29 02:46:19.659711 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 139/280] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:19 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:19.662483 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d15677d0-80a4-489a-91ff-dcd01a9fc618 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.175410 Oct 29 02:46:19.666071 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 142/281] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:19 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:19.668683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50e39c6c-286a-436b-84b8-313598b9184a tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.691061 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50e39c6c-286a-436b-84b8-313598b9184a tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.026423 Oct 29 02:46:19.692686 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 140/282] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:19 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:19.701876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-277b3972-2624-4df9-81c9-0b429ca7bfeb tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-348187366"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:19.705735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.aggregate [None req-277b3972-2624-4df9-81c9-0b429ca7bfeb tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Generated uuid bbb72a62-3101-4f89-aa38-940c2d5b5879 for aggregate {{(pid=127042) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:19.731162 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-277b3972-2624-4df9-81c9-0b429ca7bfeb tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.033484 Oct 29 02:46:19.732065 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 143/283] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:19.739304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0a6780b3-3d4b-4b01-8eb3-7aaefacdd2b7 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.740056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0a6780b3-3d4b-4b01-8eb3-7aaefacdd2b7 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:19.747130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e082e25c-d6c7-409a-aac7-a1e4aa9d6a3a tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.747778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a6780b3-3d4b-4b01-8eb3-7aaefacdd2b7 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.748272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a6780b3-3d4b-4b01-8eb3-7aaefacdd2b7 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.748691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a6780b3-3d4b-4b01-8eb3-7aaefacdd2b7 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.749555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a6780b3-3d4b-4b01-8eb3-7aaefacdd2b7 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.750268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a6780b3-3d4b-4b01-8eb3-7aaefacdd2b7 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.750829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a6780b3-3d4b-4b01-8eb3-7aaefacdd2b7 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.778356 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e082e25c-d6c7-409a-aac7-a1e4aa9d6a3a tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.037158 Oct 29 02:46:19.779776 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 144/284] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:19 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 29 02:46:19.794584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3256d9f-ace6-4ce9-9a3b-89a133c19993 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.806405 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d3256d9f-ace6-4ce9-9a3b-89a133c19993 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3256d9f-ace6-4ce9-9a3b-89a133c19993 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Request method failure captured: Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPHiyWOsCS8D60lvqQgsc9UD__tg4uCNyBK398OyzRoX0AaU4xz5ji5m2JNfvEM-0rO2_-tiwYi3Ox51c1LQKrUgQyba2R3MfuUjqQz2Bvu_U8xZPcLLsdGzZ5laq2emSJkt7pqGosgmTPcn4HQjr2ykDHa0B1Ouj_HH3SnYK21CF4 Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: f3840f5c35db47659944b73ab0df3be5 Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:19.810964 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3840f5c35db47659944b73ab0df3be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3840f5c35db47659944b73ab0df3be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3840f5c35db47659944b73ab0df3be5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3840f5c35db47659944b73ab0df3be5"}]}] Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: f3840f5c35db47659944b73ab0df3be5 Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AggregatesAdminTestJSON-1694349044-project-admin Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a4405e8819df40f9adae5640f7d48794 Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AggregatesAdminTestJSON-1694349044-project-admin Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: exception: Aggregate 14 could not be found. Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '14'} Oct 29 02:46:19.812169 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:19.812863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 29 02:46:19.813907 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.814825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3256d9f-ace6-4ce9-9a3b-89a133c19993 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:19.814825 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3256d9f-ace6-4ce9-9a3b-89a133c19993 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.027711 Oct 29 02:46:19.818339 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 145/285] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:19 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:19.823750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98fc463a-9319-47ce-b6b3-be7a1b1ec6a5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.839813 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-98fc463a-9319-47ce-b6b3-be7a1b1ec6a5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98fc463a-9319-47ce-b6b3-be7a1b1ec6a5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Request method failure captured: Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPHiyWOsCS8D60lvqQgsc9UD__tg4uCNyBK398OyzRoX0AaU4xz5ji5m2JNfvEM-0rO2_-tiwYi3Ox51c1LQKrUgQyba2R3MfuUjqQz2Bvu_U8xZPcLLsdGzZ5laq2emSJkt7pqGosgmTPcn4HQjr2ykDHa0B1Ouj_HH3SnYK21CF4 Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: f3840f5c35db47659944b73ab0df3be5 Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:19.840781 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3840f5c35db47659944b73ab0df3be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3840f5c35db47659944b73ab0df3be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3840f5c35db47659944b73ab0df3be5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3840f5c35db47659944b73ab0df3be5"}]}] Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: f3840f5c35db47659944b73ab0df3be5 Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AggregatesAdminTestJSON-1694349044-project-admin Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a4405e8819df40f9adae5640f7d48794 Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AggregatesAdminTestJSON-1694349044-project-admin Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: exception: Aggregate 14 could not be found. Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '14'} Oct 29 02:46:19.842262 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:19.842979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:19.844076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:19.845143 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:19.845143 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:19.845143 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:19.845143 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 29 02:46:19.845143 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.845143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98fc463a-9319-47ce-b6b3-be7a1b1ec6a5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:19.845143 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-98fc463a-9319-47ce-b6b3-be7a1b1ec6a5 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.023385 Oct 29 02:46:19.845143 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 146/286] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:19 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:19.855999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9770666d-f50e-42ae-befb-9e81e8079242 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-669987367", "name": "tempest-test_aggregate-2064776789"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:19.862629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.aggregate [None req-9770666d-f50e-42ae-befb-9e81e8079242 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Generated uuid 8c71a872-e0a1-4f1c-adbe-4cc3d77bec26 for aggregate {{(pid=127042) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:19.907293 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9770666d-f50e-42ae-befb-9e81e8079242 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.055298 Oct 29 02:46:19.908374 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 147/287] 10.222.0.16 () {60 vars in 1165 bytes} [Sat Oct 29 02:46:19 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:19.920257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6da8a99-bfe8-4862-b2fc-f5e9fcd761ac tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.927981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=7 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:19.959353 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c6da8a99-bfe8-4862-b2fc-f5e9fcd761ac tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.042945 Oct 29 02:46:19.960615 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 148/288] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:19 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:19.978018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79f935f6-9398-4713-b458-6bbd3354e5c1 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.998845 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-79f935f6-9398-4713-b458-6bbd3354e5c1 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79f935f6-9398-4713-b458-6bbd3354e5c1 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Request method failure captured: Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPHiyWOsCS8D60lvqQgsc9UD__tg4uCNyBK398OyzRoX0AaU4xz5ji5m2JNfvEM-0rO2_-tiwYi3Ox51c1LQKrUgQyba2R3MfuUjqQz2Bvu_U8xZPcLLsdGzZ5laq2emSJkt7pqGosgmTPcn4HQjr2ykDHa0B1Ouj_HH3SnYK21CF4 Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: f3840f5c35db47659944b73ab0df3be5 Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:20.002774 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3840f5c35db47659944b73ab0df3be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3840f5c35db47659944b73ab0df3be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3840f5c35db47659944b73ab0df3be5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3840f5c35db47659944b73ab0df3be5"}]}] Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: f3840f5c35db47659944b73ab0df3be5 Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AggregatesAdminTestJSON-1694349044-project-admin Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a4405e8819df40f9adae5640f7d48794 Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AggregatesAdminTestJSON-1694349044-project-admin Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: exception: Aggregate 15 could not be found. Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '15'} Oct 29 02:46:20.003864 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.005350 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 29 02:46:20.006961 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.008220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79f935f6-9398-4713-b458-6bbd3354e5c1 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:20.008220 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79f935f6-9398-4713-b458-6bbd3354e5c1 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.038347 Oct 29 02:46:20.008220 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 149/289] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:19 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:20.024156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ebe374d7-84c9-41c4-88e4-ed6126cb0f63 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.043863 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-ebe374d7-84c9-41c4-88e4-ed6126cb0f63 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ebe374d7-84c9-41c4-88e4-ed6126cb0f63 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Request method failure captured: Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPHiyWOsCS8D60lvqQgsc9UD__tg4uCNyBK398OyzRoX0AaU4xz5ji5m2JNfvEM-0rO2_-tiwYi3Ox51c1LQKrUgQyba2R3MfuUjqQz2Bvu_U8xZPcLLsdGzZ5laq2emSJkt7pqGosgmTPcn4HQjr2ykDHa0B1Ouj_HH3SnYK21CF4 Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: f3840f5c35db47659944b73ab0df3be5 Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:20.046045 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3840f5c35db47659944b73ab0df3be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3840f5c35db47659944b73ab0df3be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3840f5c35db47659944b73ab0df3be5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3840f5c35db47659944b73ab0df3be5"}]}] Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: f3840f5c35db47659944b73ab0df3be5 Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1694349044 Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AggregatesAdminTestJSON-1694349044-project-admin Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a4405e8819df40f9adae5640f7d48794 Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AggregatesAdminTestJSON-1694349044-project-admin Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: exception: Aggregate 15 could not be found. Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '15'} Oct 29 02:46:20.047264 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:20.047979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.049098 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:20.051327 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:20.051327 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:20.051327 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:20.051327 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 29 02:46:20.051327 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.052075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ebe374d7-84c9-41c4-88e4-ed6126cb0f63 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:20.054015 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ebe374d7-84c9-41c4-88e4-ed6126cb0f63 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.042158 Oct 29 02:46:20.055386 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 150/290] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:20 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:20.064872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21aa22a7-09b1-4408-b4cc-60cb64d37860 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1203328129"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:20.069665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.aggregate [None req-21aa22a7-09b1-4408-b4cc-60cb64d37860 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Generated uuid 161ccde9-c9c8-4b63-92fa-aa3fd76fe5ae for aggregate {{(pid=127042) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:20.092773 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-21aa22a7-09b1-4408-b4cc-60cb64d37860 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.031894 Oct 29 02:46:20.094656 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 151/291] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:20 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:20.102390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0a6780b3-3d4b-4b01-8eb3-7aaefacdd2b7 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:20.119747 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0a6780b3-3d4b-4b01-8eb3-7aaefacdd2b7 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1320 microversion: 2.1 time: 0.383691 Oct 29 02:46:20.120955 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 141/292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:19 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1320 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:20.122080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-89960891-8374-4ee7-b157-145269835f15 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.131442 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-89960891-8374-4ee7-b157-145269835f15 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.020064 Oct 29 02:46:20.132647 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 152/293] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:20.144672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f7e37af3-f43f-418d-8d75-fdfa0abb48a8 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:20.187574 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f7e37af3-f43f-418d-8d75-fdfa0abb48a8 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.046557 Oct 29 02:46:20.194379 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 142/294] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:20 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:20.199826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-556617f7-0e0a-4362-b93b-a866b4de2891 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.215126 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-556617f7-0e0a-4362-b93b-a866b4de2891 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.018999 Oct 29 02:46:20.216318 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 153/295] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:20.227836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d92c1d17-6f8a-43d2-b770-1c9d7e887a43 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.260987 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d92c1d17-6f8a-43d2-b770-1c9d7e887a43 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.036819 Oct 29 02:46:20.261923 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 143/296] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:20 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:20.273840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8b877dc2-2d1c-46b2-a021-6da0767a9376 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-258201247", "availability_zone": "tempest-test_az-819535843"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:20.278084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.aggregate [None req-8b877dc2-2d1c-46b2-a021-6da0767a9376 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Generated uuid 6277411a-d5b8-46c0-bc3a-5ef0b61db4fe for aggregate {{(pid=127042) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:20.328743 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8b877dc2-2d1c-46b2-a021-6da0767a9376 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.058603 Oct 29 02:46:20.329654 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 154/297] 10.222.0.16 () {60 vars in 1165 bytes} [Sat Oct 29 02:46:20 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:20.336700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b6aae5f-8ebe-4b5b-9714-2540322d7c03 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.337321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8b6aae5f-8ebe-4b5b-9714-2540322d7c03 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:20.356721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6aae5f-8ebe-4b5b-9714-2540322d7c03 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.357589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6aae5f-8ebe-4b5b-9714-2540322d7c03 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.358297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6aae5f-8ebe-4b5b-9714-2540322d7c03 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.359218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6aae5f-8ebe-4b5b-9714-2540322d7c03 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.359893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6aae5f-8ebe-4b5b-9714-2540322d7c03 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.360263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ea87b1c-d325-45b0-99ff-a548aeb6859b tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-258201247_new", "availability_zone": "tempest-test_az-819535843_new"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:20.361004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6aae5f-8ebe-4b5b-9714-2540322d7c03 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.457982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ea87b1c-d325-45b0-99ff-a548aeb6859b tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.458600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ea87b1c-d325-45b0-99ff-a548aeb6859b tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.459039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ea87b1c-d325-45b0-99ff-a548aeb6859b tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.541164 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ea87b1c-d325-45b0-99ff-a548aeb6859b tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 334 microversion: 2.1 time: 0.198452 Oct 29 02:46:20.544245 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 155/298] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Oct 29 02:46:20 2022] PUT /compute/v2.1/os-aggregates/17 => generated 334 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:20.554046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fdf05754-7ff8-464c-b6cc-fe530af56dcf tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.576816 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fdf05754-7ff8-464c-b6cc-fe530af56dcf tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.026316 Oct 29 02:46:20.579643 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 156/299] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:20.592595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-07f2f29f-81d3-4599-ac5a-c8cae2bdd121 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.636342 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-07f2f29f-81d3-4599-ac5a-c8cae2bdd121 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.047660 Oct 29 02:46:20.641078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8b6aae5f-8ebe-4b5b-9714-2540322d7c03 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:20.641445 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 157/300] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:20 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:20.649394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db4243f8-5616-47ac-8974-f075103b1ddf tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-853965627"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:20.651370 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b6aae5f-8ebe-4b5b-9714-2540322d7c03 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1319 microversion: 2.1 time: 0.319389 Oct 29 02:46:20.653598 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 144/301] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:20.656880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.aggregate [None req-db4243f8-5616-47ac-8974-f075103b1ddf tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Generated uuid e624df90-ce3e-4ab5-8899-8b29b9628287 for aggregate {{(pid=127042) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:20.693258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.695076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:20.709039 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-db4243f8-5616-47ac-8974-f075103b1ddf tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065042 Oct 29 02:46:20.710883 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 158/302] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:20.716392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.718680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.719624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.721358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.724401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4718f4a5-e31a-432e-86c6-ba75cdd91cb4 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.725284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.726793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.737594 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4718f4a5-e31a-432e-86c6-ba75cdd91cb4 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.015618 Oct 29 02:46:20.738886 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 159/303] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:20.754337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da7507f7-58d1-4531-ad1b-2b17e91feae9 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.794314 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-da7507f7-58d1-4531-ad1b-2b17e91feae9 tempest-AggregatesAdminTestJSON-1694349044 tempest-AggregatesAdminTestJSON-1694349044-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.043398 Oct 29 02:46:20.796830 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 160/304] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:20 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:20.805413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.810170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:20.820697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.821315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.821915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.822721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.823483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.830560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.837884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:20.852835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:20.854534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:20.860844 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81109ea0-8e17-43ed-b82a-89efee015bfd tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.173258 Oct 29 02:46:20.872566 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 145/305] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] HTTP exception thrown: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Request method failure captured: Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 HTTP/1.1 Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPE0Iy6NYxUY_GnPzyPmP6roBcByXJyVPzIqA7OnjDxSirQRzbNh3ZRdoRL7JzvktFfm10DfCWiriVlTowUKz7KJNuN4gbVbQ-nCQyB9o72twqEA4DIgU3pKQRWjDBGRLbFeDRWcdb4kWz_g1CR9NdGMdw_ZYfjtdQDaLVOhpI-eN0 Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 67ea773130ed4742915da0d5abf84f3a Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AggregatesAdminTestJSON-1553973375 Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:46:20.872997 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67ea773130ed4742915da0d5abf84f3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67ea773130ed4742915da0d5abf84f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67ea773130ed4742915da0d5abf84f3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67ea773130ed4742915da0d5abf84f3a"}]}] Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AggregatesAdminTestJSON-1553973375 Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 67ea773130ed4742915da0d5abf84f3a Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1553973375 Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AggregatesAdminTestJSON-1553973375-project Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 255cc5a6e9584a1f94b290b617cad351 Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AggregatesAdminTestJSON-1553973375-project Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:20.874529 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '8d968c73-0802-46ee-8972-e48ba3168aa6'} Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:20.875298 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:20.876538 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.877657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Returning 404 to user: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:20.877657 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d548d06d-40dd-4853-8a7b-562b6e29ba19 tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 404 len: 111 microversion: 2.1 time: 0.070963 Oct 29 02:46:20.877657 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 161/306] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:20 2022] DELETE /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:46:20.887531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.887531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] [instance: 8d968c73-0802-46ee-8972-e48ba3168aa6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:20.893362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.893757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.894287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.895057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.895577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.896069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.914362 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] HTTP exception thrown: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Request method failure captured: Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 HTTP/1.1 Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPE0Iy6NYxUY_GnPzyPmP6roBcByXJyVPzIqA7OnjDxSirQRzbNh3ZRdoRL7JzvktFfm10DfCWiriVlTowUKz7KJNuN4gbVbQ-nCQyB9o72twqEA4DIgU3pKQRWjDBGRLbFeDRWcdb4kWz_g1CR9NdGMdw_ZYfjtdQDaLVOhpI-eN0 Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 67ea773130ed4742915da0d5abf84f3a Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AggregatesAdminTestJSON-1553973375 Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:46:20.918626 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67ea773130ed4742915da0d5abf84f3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67ea773130ed4742915da0d5abf84f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67ea773130ed4742915da0d5abf84f3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67ea773130ed4742915da0d5abf84f3a"}]}] Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AggregatesAdminTestJSON-1553973375 Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 67ea773130ed4742915da0d5abf84f3a Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1553973375 Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AggregatesAdminTestJSON-1553973375-project Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 255cc5a6e9584a1f94b290b617cad351 Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AggregatesAdminTestJSON-1553973375-project Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:20.920143 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '8d968c73-0802-46ee-8972-e48ba3168aa6'} Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:20.920918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. Oct 29 02:46:20.922139 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:20.923345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] Returning 404 to user: Instance 8d968c73-0802-46ee-8972-e48ba3168aa6 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:20.924500 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bf8f343b-ac2b-42d3-929a-f54301098e8b tempest-AggregatesAdminTestJSON-1553973375 tempest-AggregatesAdminTestJSON-1553973375-project] 10.222.0.16 "GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6" status: 404 len: 111 microversion: 2.1 time: 0.043470 Oct 29 02:46:20.924987 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 146/307] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/servers/8d968c73-0802-46ee-8972-e48ba3168aa6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:21.145862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f97bf6ba-43d2-4105-9769-3b662bb11d10 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.145862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f97bf6ba-43d2-4105-9769-3b662bb11d10 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:21.153480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f97bf6ba-43d2-4105-9769-3b662bb11d10 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.154005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f97bf6ba-43d2-4105-9769-3b662bb11d10 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.154436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f97bf6ba-43d2-4105-9769-3b662bb11d10 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.155134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f97bf6ba-43d2-4105-9769-3b662bb11d10 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.159979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f97bf6ba-43d2-4105-9769-3b662bb11d10 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.160394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f97bf6ba-43d2-4105-9769-3b662bb11d10 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.677940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-de6de08a-fd33-4b6c-aee9-14b8135dfa63 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.678553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-de6de08a-fd33-4b6c-aee9-14b8135dfa63 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:21.690067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de6de08a-fd33-4b6c-aee9-14b8135dfa63 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.690631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de6de08a-fd33-4b6c-aee9-14b8135dfa63 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.691078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de6de08a-fd33-4b6c-aee9-14b8135dfa63 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.691831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de6de08a-fd33-4b6c-aee9-14b8135dfa63 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.692282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de6de08a-fd33-4b6c-aee9-14b8135dfa63 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.692703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de6de08a-fd33-4b6c-aee9-14b8135dfa63 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.849600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f97bf6ba-43d2-4105-9769-3b662bb11d10 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:21.857679 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f97bf6ba-43d2-4105-9769-3b662bb11d10 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1320 microversion: 2.1 time: 0.717596 Oct 29 02:46:21.861238 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 162/308] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:21 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1320 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:21.896550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.897597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:21.904340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.910674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.915641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.916609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.917665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.918412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:22.136458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:22.137067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de6de08a-fd33-4b6c-aee9-14b8135dfa63 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:22.150896 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-de6de08a-fd33-4b6c-aee9-14b8135dfa63 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1319 microversion: 2.1 time: 0.476675 Oct 29 02:46:22.153527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:22.154906 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 147/309] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:21 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:22.163991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:22.182799 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b3134d8c-b793-422c-8815-6ba0493d887b tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.289868 Oct 29 02:46:22.184868 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 163/310] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:21 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:22.781265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b358af03-aac5-461b-a8c4-668887161943 req-16134cd8-0008-4961-a206-36bc230f5afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f06196e-cc3e-474d-91c0-b3a4f280c400", "tag": "4cdb7e5d-cd3c-4c8c-9423-113d17d0e0a2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:22.802554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b358af03-aac5-461b-a8c4-668887161943 req-16134cd8-0008-4961-a206-36bc230f5afe service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:22.808135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b358af03-aac5-461b-a8c4-668887161943 req-16134cd8-0008-4961-a206-36bc230f5afe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:22.809129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b358af03-aac5-461b-a8c4-668887161943 req-16134cd8-0008-4961-a206-36bc230f5afe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:22.851499 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b358af03-aac5-461b-a8c4-668887161943 req-16134cd8-0008-4961-a206-36bc230f5afe service nova] Creating event network-changed:4cdb7e5d-cd3c-4c8c-9423-113d17d0e0a2 for instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 on n-h2-862964-4 Oct 29 02:46:22.863485 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b358af03-aac5-461b-a8c4-668887161943 req-16134cd8-0008-4961-a206-36bc230f5afe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090444 Oct 29 02:46:22.864502 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 148/311] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:22.886080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9086cbb7-39ee-489e-b5e1-79dd4bbc2092 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:22.887564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9086cbb7-39ee-489e-b5e1-79dd4bbc2092 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:22.907716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9086cbb7-39ee-489e-b5e1-79dd4bbc2092 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:22.919978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9086cbb7-39ee-489e-b5e1-79dd4bbc2092 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:22.922386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9086cbb7-39ee-489e-b5e1-79dd4bbc2092 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:22.923780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9086cbb7-39ee-489e-b5e1-79dd4bbc2092 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:22.924493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9086cbb7-39ee-489e-b5e1-79dd4bbc2092 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:22.925198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9086cbb7-39ee-489e-b5e1-79dd4bbc2092 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.184636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-28f4e2fa-fe21-4ddd-895b-80a771ab1094 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:23.185469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-28f4e2fa-fe21-4ddd-895b-80a771ab1094 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:23.196360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28f4e2fa-fe21-4ddd-895b-80a771ab1094 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.197032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28f4e2fa-fe21-4ddd-895b-80a771ab1094 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.197556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28f4e2fa-fe21-4ddd-895b-80a771ab1094 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.198565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28f4e2fa-fe21-4ddd-895b-80a771ab1094 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.206405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28f4e2fa-fe21-4ddd-895b-80a771ab1094 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.206943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28f4e2fa-fe21-4ddd-895b-80a771ab1094 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.482050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9086cbb7-39ee-489e-b5e1-79dd4bbc2092 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:23.492397 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9086cbb7-39ee-489e-b5e1-79dd4bbc2092 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1320 microversion: 2.1 time: 0.611801 Oct 29 02:46:23.496313 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 164/312] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:22 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1320 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:23.497794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-28f4e2fa-fe21-4ddd-895b-80a771ab1094 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:23.508197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:23.509326 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-28f4e2fa-fe21-4ddd-895b-80a771ab1094 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1319 microversion: 2.1 time: 0.329341 Oct 29 02:46:23.510143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:23.519787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.520726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.521361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.522306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.523006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.523588 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 149/313] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:23 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:23.524126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.709956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:23.720101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:23.721528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:23.740894 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-12b61d0c-0f7d-4790-a153-a3186cc1e16a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.242624 Oct 29 02:46:23.741485 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 165/314] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:23 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:24.314797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1461806285", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:24.334052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=11 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:24.377042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-54705c46-6b31-4fe4-a736-e0f8d5dca6ca req-1dafe2b3-cd04-4e0e-8ab4-8d3c98640a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30418c29-fcfc-4ba8-9660-93ca7329a30f", "name": "network-vif-plugged", "status": "completed", "tag": "bb5e9c70-51d2-4672-90c8-0debb6dda7f5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:24.390847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-54705c46-6b31-4fe4-a736-e0f8d5dca6ca req-1dafe2b3-cd04-4e0e-8ab4-8d3c98640a42 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:24.394186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-54705c46-6b31-4fe4-a736-e0f8d5dca6ca req-1dafe2b3-cd04-4e0e-8ab4-8d3c98640a42 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:24.395882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-54705c46-6b31-4fe4-a736-e0f8d5dca6ca req-1dafe2b3-cd04-4e0e-8ab4-8d3c98640a42 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:24.422944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:24.438172 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-54705c46-6b31-4fe4-a736-e0f8d5dca6ca req-1dafe2b3-cd04-4e0e-8ab4-8d3c98640a42 service nova] Creating event network-vif-plugged:bb5e9c70-51d2-4672-90c8-0debb6dda7f5 for instance 30418c29-fcfc-4ba8-9660-93ca7329a30f on n-h1-862964-4 Oct 29 02:46:24.451810 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-54705c46-6b31-4fe4-a736-e0f8d5dca6ca req-1dafe2b3-cd04-4e0e-8ab4-8d3c98640a42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078907 Oct 29 02:46:24.455692 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 166/315] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:24.519394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e92e6a12-727f-451b-90c2-48a5f9f24381 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:24.520083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e92e6a12-727f-451b-90c2-48a5f9f24381 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:24.530568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92e6a12-727f-451b-90c2-48a5f9f24381 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:24.531050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92e6a12-727f-451b-90c2-48a5f9f24381 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:24.531469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92e6a12-727f-451b-90c2-48a5f9f24381 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:24.532200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92e6a12-727f-451b-90c2-48a5f9f24381 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:24.534067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92e6a12-727f-451b-90c2-48a5f9f24381 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:24.534512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92e6a12-727f-451b-90c2-48a5f9f24381 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:24.746522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:24.746522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:24.746522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:24.746522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:24.746858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:24.759428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:24.759999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:24.760622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:24.761687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:24.762280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:24.764352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:24.772611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=13 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:24.787867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for project bb5aec15c4e844b2872c9eab52f69482. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:24.793140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for user efecedc77d3048c4a0ec0fe6701f9ccc and project bb5aec15c4e844b2872c9eab52f69482. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:24.807743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:24.814788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:24.880195 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-82f45c71-510a-4aaf-8321-583b1bf86d18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064508 Oct 29 02:46:24.882121 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 150/316] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:46:24.892610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-747fa81b-c356-4b58-bacb-49a1f34b99d1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:24.893506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-747fa81b-c356-4b58-bacb-49a1f34b99d1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:24.900781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-747fa81b-c356-4b58-bacb-49a1f34b99d1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:24.901420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-747fa81b-c356-4b58-bacb-49a1f34b99d1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:24.902096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-747fa81b-c356-4b58-bacb-49a1f34b99d1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:24.903276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-747fa81b-c356-4b58-bacb-49a1f34b99d1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:24.903935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-747fa81b-c356-4b58-bacb-49a1f34b99d1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:24.905877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-747fa81b-c356-4b58-bacb-49a1f34b99d1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:24.971131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e92e6a12-727f-451b-90c2-48a5f9f24381 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:24.985405 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e92e6a12-727f-451b-90c2-48a5f9f24381 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1320 microversion: 2.1 time: 0.470248 Oct 29 02:46:24.988346 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 167/317] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:24 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1320 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:25.164939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-747fa81b-c356-4b58-bacb-49a1f34b99d1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:25.175788 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-747fa81b-c356-4b58-bacb-49a1f34b99d1 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1319 microversion: 2.1 time: 0.292385 Oct 29 02:46:25.190418 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 151/318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:24 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:25.196913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:25.197525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:25.204117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:25.204657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:25.205215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:25.206230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:25.206695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:25.207283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:25.314164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:25.328026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:25.332183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:25.342844 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dc698230-6cac-4bce-80f6-e0bf747a1b9a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.150468 Oct 29 02:46:25.346971 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 152/319] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:25 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:25.355206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-beafc63c-28bb-48ab-8c84-8a844b6f070e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:25.358884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-beafc63c-28bb-48ab-8c84-8a844b6f070e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:25.384510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4640b549-3433-49ca-8377-d05119b3f0a6 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1105930155", "id": 875225929, "os-flavor-access:is_public": "False"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:25.416471 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4640b549-3433-49ca-8377-d05119b3f0a6 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.425537 Oct 29 02:46:25.417445 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 168/320] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:24 2022] POST /compute/v2.1/flavors => generated 428 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:25.430375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0aa2eb9f-7f20-47d9-bfdf-895a80b80403 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "72426021319b4d52b8d526d27e8339e8"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:25.444630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-beafc63c-28bb-48ab-8c84-8a844b6f070e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:25.456824 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-beafc63c-28bb-48ab-8c84-8a844b6f070e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1213 microversion: 2.1 time: 0.107780 Oct 29 02:46:25.462778 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 153/321] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:25 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:25.579943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0aa2eb9f-7f20-47d9-bfdf-895a80b80403 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/875225929/action" status: 200 len: 96 microversion: 2.1 time: 0.153315 Oct 29 02:46:25.583841 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 169/322] 10.222.0.16 () {60 vars in 1197 bytes} [Sat Oct 29 02:46:25 2022] POST /compute/v2.1/flavors/875225929/action => generated 96 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:25.882109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-20499985-f20a-4758-b716-b350619d6aa0 tempest-FlavorsAccessTestJSON-340117549 tempest-FlavorsAccessTestJSON-340117549-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:25.945513 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-20499985-f20a-4758-b716-b350619d6aa0 tempest-FlavorsAccessTestJSON-340117549 tempest-FlavorsAccessTestJSON-340117549-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.354932 Oct 29 02:46:25.947049 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 154/323] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:25 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:25.967202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-307f6be9-34b7-46eb-9866-4b466ea7be1a tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "72426021319b4d52b8d526d27e8339e8"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:26.015181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-689d834c-6b66-4661-bb2f-689f773d424b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.016045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-689d834c-6b66-4661-bb2f-689f773d424b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:26.022638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-689d834c-6b66-4661-bb2f-689f773d424b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.023362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-689d834c-6b66-4661-bb2f-689f773d424b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.023970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-689d834c-6b66-4661-bb2f-689f773d424b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.024833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-689d834c-6b66-4661-bb2f-689f773d424b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.025427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-689d834c-6b66-4661-bb2f-689f773d424b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.026125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-689d834c-6b66-4661-bb2f-689f773d424b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.048305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:26.110662 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-307f6be9-34b7-46eb-9866-4b466ea7be1a tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/875225929/action" status: 200 len: 21 microversion: 2.1 time: 0.147471 Oct 29 02:46:26.111271 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 170/324] 10.222.0.16 () {60 vars in 1197 bytes} [Sat Oct 29 02:46:25 2022] POST /compute/v2.1/flavors/875225929/action => generated 21 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:26.123394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5dd87f76-c57a-49da-a7cb-56d76e4ab080 tempest-FlavorsAccessTestJSON-340117549 tempest-FlavorsAccessTestJSON-340117549-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.151274 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5dd87f76-c57a-49da-a7cb-56d76e4ab080 tempest-FlavorsAccessTestJSON-340117549 tempest-FlavorsAccessTestJSON-340117549-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.033840 Oct 29 02:46:26.152082 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 171/325] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:26 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:26.177364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fe675293-a0d3-47fe-bcdb-132fe80398f7 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.200910 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fe675293-a0d3-47fe-bcdb-132fe80398f7 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/875225929" status: 202 len: 0 microversion: 2.1 time: 0.026856 Oct 29 02:46:26.202583 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 172/326] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:46:26 2022] DELETE /compute/v2.1/flavors/875225929 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:26.209101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9585fd38-21f9-4616-9f50-d993fa3dfd9b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.209954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9585fd38-21f9-4616-9f50-d993fa3dfd9b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:26.225391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9585fd38-21f9-4616-9f50-d993fa3dfd9b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.226389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9585fd38-21f9-4616-9f50-d993fa3dfd9b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.229605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9585fd38-21f9-4616-9f50-d993fa3dfd9b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.230819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9585fd38-21f9-4616-9f50-d993fa3dfd9b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.231729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9585fd38-21f9-4616-9f50-d993fa3dfd9b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.232340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9585fd38-21f9-4616-9f50-d993fa3dfd9b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.253568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-689d834c-6b66-4661-bb2f-689f773d424b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:26.263033 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-689d834c-6b66-4661-bb2f-689f773d424b tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1320 microversion: 2.1 time: 0.251629 Oct 29 02:46:26.274900 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 155/327] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:26 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:26.298901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-67e792d4-d7c6-4c83-9761-5339ec612224 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.340945 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-67e792d4-d7c6-4c83-9761-5339ec612224 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.064371 Oct 29 02:46:26.366272 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 156/328] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:26 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:26.374556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29dc78f2-115f-45b8-879d-62554d1e551b tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-386091688", "id": 1269539683, "os-flavor-access:is_public": "False"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:26.398355 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29dc78f2-115f-45b8-879d-62554d1e551b tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.030281 Oct 29 02:46:26.407415 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 157/329] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:26 2022] POST /compute/v2.1/flavors => generated 430 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:26.413043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.414108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:26.421574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.422533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.423204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.424118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.424811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.425426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.525402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9585fd38-21f9-4616-9f50-d993fa3dfd9b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:26.534942 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9585fd38-21f9-4616-9f50-d993fa3dfd9b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1319 microversion: 2.1 time: 0.331070 Oct 29 02:46:26.535526 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 173/330] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:26 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:26.550407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f52847de-88be-403d-b14e-2ad5ceec763f tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.550407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:26.565836 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f52847de-88be-403d-b14e-2ad5ceec763f tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1269539683/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.029016 Oct 29 02:46:26.566812 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 174/331] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Oct 29 02:46:26 2022] GET /compute/v2.1/flavors/1269539683/os-flavor-access => generated 21 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:26.573989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-644d49e2-0de2-475d-a667-cba539adab21 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.574614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-644d49e2-0de2-475d-a667-cba539adab21 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:26.582326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644d49e2-0de2-475d-a667-cba539adab21 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.582921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:26.583307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644d49e2-0de2-475d-a667-cba539adab21 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.583433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644d49e2-0de2-475d-a667-cba539adab21 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.584188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644d49e2-0de2-475d-a667-cba539adab21 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.584639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644d49e2-0de2-475d-a667-cba539adab21 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.585261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644d49e2-0de2-475d-a667-cba539adab21 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.598489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:26.606599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:26.623441 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-637c2282-d692-46f9-bfc5-e29b6a2f7807 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.214339 Oct 29 02:46:26.639565 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 158/332] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:26 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:26.645177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3d0a169c-5821-4cd9-b3c4-91827c807057 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.673913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-644d49e2-0de2-475d-a667-cba539adab21 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:26.684511 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3d0a169c-5821-4cd9-b3c4-91827c807057 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1269539683" status: 202 len: 0 microversion: 2.1 time: 0.042489 Oct 29 02:46:26.684511 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 159/333] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:46:26 2022] DELETE /compute/v2.1/flavors/1269539683 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:26.697344 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-644d49e2-0de2-475d-a667-cba539adab21 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1265 microversion: 2.1 time: 0.124077 Oct 29 02:46:26.698437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f0366d87-2557-42d3-b8ce-b56569e47fb6 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.699462 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 175/334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:26 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:26.778633 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f0366d87-2557-42d3-b8ce-b56569e47fb6 tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.089897 Oct 29 02:46:26.790735 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 160/335] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:26 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:27.296744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a176684e-fdf6-4073-af71-8c3d037a8a0e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:27.297916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a176684e-fdf6-4073-af71-8c3d037a8a0e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:27.302792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=54 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:27.312184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176684e-fdf6-4073-af71-8c3d037a8a0e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.316617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176684e-fdf6-4073-af71-8c3d037a8a0e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.317310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176684e-fdf6-4073-af71-8c3d037a8a0e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:27.318282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176684e-fdf6-4073-af71-8c3d037a8a0e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.321149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176684e-fdf6-4073-af71-8c3d037a8a0e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.321914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176684e-fdf6-4073-af71-8c3d037a8a0e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:27.372637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:27.571316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0b36c67a-623c-45d2-a9bc-2516e9f63516 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:27.575316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0b36c67a-623c-45d2-a9bc-2516e9f63516 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:27.596338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b36c67a-623c-45d2-a9bc-2516e9f63516 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.597348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b36c67a-623c-45d2-a9bc-2516e9f63516 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.599149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b36c67a-623c-45d2-a9bc-2516e9f63516 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:27.600638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b36c67a-623c-45d2-a9bc-2516e9f63516 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.602324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b36c67a-623c-45d2-a9bc-2516e9f63516 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.602916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b36c67a-623c-45d2-a9bc-2516e9f63516 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:27.656421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=39 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:27.686318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a176684e-fdf6-4073-af71-8c3d037a8a0e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:27.698644 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a176684e-fdf6-4073-af71-8c3d037a8a0e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1470 microversion: 2.1 time: 0.408117 Oct 29 02:46:27.715094 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 176/336] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:27 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1470 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:27.726441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:27.727874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:27.735681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.736434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.737038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:27.738182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.739063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.739922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:27.865015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:27.881507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:27.883430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:27.898447 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c8d4856-ae2c-4d3d-bee5-8a1e067689bc tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.181692 Oct 29 02:46:27.900538 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 177/337] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:27 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:27.911880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e787196-be29-46ab-9363-765d236ead2f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:27.913484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4e787196-be29-46ab-9363-765d236ead2f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:27.920255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e787196-be29-46ab-9363-765d236ead2f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.921109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e787196-be29-46ab-9363-765d236ead2f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.921752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e787196-be29-46ab-9363-765d236ead2f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:27.922686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e787196-be29-46ab-9363-765d236ead2f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.923422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e787196-be29-46ab-9363-765d236ead2f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.924096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e787196-be29-46ab-9363-765d236ead2f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.002369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4e787196-be29-46ab-9363-765d236ead2f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:28.010209 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4e787196-be29-46ab-9363-765d236ead2f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1271 microversion: 2.1 time: 0.107497 Oct 29 02:46:28.010861 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 178/338] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:27 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:28.015598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7723377a-6f61-4464-8e1a-314685daa083 tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:28.018718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7723377a-6f61-4464-8e1a-314685daa083 tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:28.026694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7723377a-6f61-4464-8e1a-314685daa083 tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.027641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7723377a-6f61-4464-8e1a-314685daa083 tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.028473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7723377a-6f61-4464-8e1a-314685daa083 tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.029256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7723377a-6f61-4464-8e1a-314685daa083 tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.029773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7723377a-6f61-4464-8e1a-314685daa083 tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.030450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7723377a-6f61-4464-8e1a-314685daa083 tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.079214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0b36c67a-623c-45d2-a9bc-2516e9f63516 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:28.092600 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0b36c67a-623c-45d2-a9bc-2516e9f63516 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1319 microversion: 2.1 time: 0.527406 Oct 29 02:46:28.093892 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 161/339] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:27 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:28.185022 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7723377a-6f61-4464-8e1a-314685daa083 tempest-DeleteServersAdminTestJSON-1987031529 tempest-DeleteServersAdminTestJSON-1987031529-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f/action" status: 202 len: 0 microversion: 2.1 time: 0.172767 Oct 29 02:46:28.193848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 179/340] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:46:28 2022] POST /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:28.196014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:28.197102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:28.207459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.208173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.209245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.210679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.211350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.212005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.260845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.261586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.262205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.262800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lazy-loading 'fault' on Instance uuid 30418c29-fcfc-4ba8-9660-93ca7329a30f {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:28.645939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:28.660615 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ed33bf2a-78f4-407b-a4e6-8854bbaf4692 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1453 microversion: 2.1 time: 0.468293 Oct 29 02:46:28.662604 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 162/341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:28 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1453 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:28.691512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4236cc67-6f5d-494a-9671-756d1abaf3d9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:28.692197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4236cc67-6f5d-494a-9671-756d1abaf3d9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:28.705846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4236cc67-6f5d-494a-9671-756d1abaf3d9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.707646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4236cc67-6f5d-494a-9671-756d1abaf3d9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.709888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4236cc67-6f5d-494a-9671-756d1abaf3d9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.711986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4236cc67-6f5d-494a-9671-756d1abaf3d9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.713018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4236cc67-6f5d-494a-9671-756d1abaf3d9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.714093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4236cc67-6f5d-494a-9671-756d1abaf3d9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.779631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4236cc67-6f5d-494a-9671-756d1abaf3d9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:46:28.937393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:28.940415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:28.958864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.959424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.959966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.966225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.966225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.966225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.016171 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4236cc67-6f5d-494a-9671-756d1abaf3d9 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 204 len: 0 microversion: 2.1 time: 0.330145 Oct 29 02:46:29.019286 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 180/342] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:28 2022] DELETE /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:29.037510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:29.040577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:29.048487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.052337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.054158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.056898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.057840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.058465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.111185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.111185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.111599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.113095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lazy-loading 'fault' on Instance uuid 30418c29-fcfc-4ba8-9660-93ca7329a30f {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:29.246209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:29.255021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:29.269829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:29.275416 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8a54cc4-1a5f-409f-b4bb-e7d14d202af0 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.345533 Oct 29 02:46:29.278062 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 163/343] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:28 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:29.284772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a6888564-64c8-448f-a8d1-7e00f160bd66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:29.285868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a6888564-64c8-448f-a8d1-7e00f160bd66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:29.305816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:29.313275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6888564-64c8-448f-a8d1-7e00f160bd66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.314576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6888564-64c8-448f-a8d1-7e00f160bd66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.315555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6888564-64c8-448f-a8d1-7e00f160bd66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.316535 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dd76a0a4-5282-4909-9ee7-dbda8f8b8c5c tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1459 microversion: 2.1 time: 0.287575 Oct 29 02:46:29.316933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6888564-64c8-448f-a8d1-7e00f160bd66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.318172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6888564-64c8-448f-a8d1-7e00f160bd66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.318665 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 181/344] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:29 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1459 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:29.319258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6888564-64c8-448f-a8d1-7e00f160bd66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.327047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd977edf-9803-4f23-9be3-6ca211fd4938 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:29.327658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cd977edf-9803-4f23-9be3-6ca211fd4938 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:29.343346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd977edf-9803-4f23-9be3-6ca211fd4938 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.343929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd977edf-9803-4f23-9be3-6ca211fd4938 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.344982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd977edf-9803-4f23-9be3-6ca211fd4938 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.348078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd977edf-9803-4f23-9be3-6ca211fd4938 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.348546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd977edf-9803-4f23-9be3-6ca211fd4938 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.348969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd977edf-9803-4f23-9be3-6ca211fd4938 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.594549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd977edf-9803-4f23-9be3-6ca211fd4938 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:29.607336 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd977edf-9803-4f23-9be3-6ca211fd4938 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1319 microversion: 2.1 time: 0.285005 Oct 29 02:46:29.608309 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 182/345] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:29 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:29.614270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-7691c0e4-868a-4039-82ee-631f0e5fbbf9 req-3d87fa92-d662-4d2e-a152-c22b897a84fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f06196e-cc3e-474d-91c0-b3a4f280c400", "name": "network-vif-plugged", "status": "completed", "tag": "4cdb7e5d-cd3c-4c8c-9423-113d17d0e0a2"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:29.646555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7691c0e4-868a-4039-82ee-631f0e5fbbf9 req-3d87fa92-d662-4d2e-a152-c22b897a84fe service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.647918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7691c0e4-868a-4039-82ee-631f0e5fbbf9 req-3d87fa92-d662-4d2e-a152-c22b897a84fe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.648594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7691c0e4-868a-4039-82ee-631f0e5fbbf9 req-3d87fa92-d662-4d2e-a152-c22b897a84fe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.691453 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-7691c0e4-868a-4039-82ee-631f0e5fbbf9 req-3d87fa92-d662-4d2e-a152-c22b897a84fe service nova] Creating event network-vif-plugged:4cdb7e5d-cd3c-4c8c-9423-113d17d0e0a2 for instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 on n-h2-862964-4 Oct 29 02:46:29.699039 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-7691c0e4-868a-4039-82ee-631f0e5fbbf9 req-3d87fa92-d662-4d2e-a152-c22b897a84fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088499 Oct 29 02:46:29.700115 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 183/346] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:30.018070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a6888564-64c8-448f-a8d1-7e00f160bd66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:30.027074 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a6888564-64c8-448f-a8d1-7e00f160bd66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1313 microversion: 2.1 time: 0.747659 Oct 29 02:46:30.028064 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 164/347] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:29 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1313 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:30.310401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:30.311281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:30.318740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.319518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.320160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:30.321080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.321676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.322512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:30.506275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f8b3806-4f76-40eb-ad94-3f0caa7e19e8 tempest-FlavorMetadataValidation-1110663471 tempest-FlavorMetadataValidation-1110663471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-124168209", "id": 1800269557, "os-flavor-access:is_public": "True"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:30.530183 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f8b3806-4f76-40eb-ad94-3f0caa7e19e8 tempest-FlavorMetadataValidation-1110663471 tempest-FlavorMetadataValidation-1110663471-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.260815 Oct 29 02:46:30.538456 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 184/348] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:46:30 2022] POST /compute/v2.1/flavors => generated 470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:30.546755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:30.547853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:30.559403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.561412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.561831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:30.563011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:30.564095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.564548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.564961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:30.574218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:30.576195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:30.583756 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b409cc25-68df-42d3-b96f-6b293234b1ec tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.277704 Oct 29 02:46:30.606797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.607538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.607655 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 165/349] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:30 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:30.608232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:30.608854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lazy-loading 'fault' on Instance uuid 30418c29-fcfc-4ba8-9660-93ca7329a30f {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:30.624422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a840a39f-79f5-4e25-8d0d-03002ca64afc tempest-FlavorMetadataValidation-1110663471 tempest-FlavorMetadataValidation-1110663471-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:30.873224 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a840a39f-79f5-4e25-8d0d-03002ca64afc tempest-FlavorMetadataValidation-1110663471 tempest-FlavorMetadataValidation-1110663471-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1800269557/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.258700 Oct 29 02:46:30.876651 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 166/350] 10.222.0.16 () {62 vars in 1265 bytes} [Sat Oct 29 02:46:30 2022] POST /compute/v2.1/flavors/1800269557/os-extra_specs => generated 62 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:30.892315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-05d59bb3-1b41-4387-982a-c2c764395f5e tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:30.892935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-05d59bb3-1b41-4387-982a-c2c764395f5e tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:30.908920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d59bb3-1b41-4387-982a-c2c764395f5e tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.910148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d59bb3-1b41-4387-982a-c2c764395f5e tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.912412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d59bb3-1b41-4387-982a-c2c764395f5e tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:30.913149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d59bb3-1b41-4387-982a-c2c764395f5e tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.913911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d59bb3-1b41-4387-982a-c2c764395f5e tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.917861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d59bb3-1b41-4387-982a-c2c764395f5e tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:31.001881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:31.017762 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d77921e3-4584-4a16-9f0f-0b7beeac95e6 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1459 microversion: 2.1 time: 0.477165 Oct 29 02:46:31.019175 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 185/351] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:30 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1459 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:31.024384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6e6bd8dc-44eb-494b-ab74-4caa3985a5fc tempest-FlavorMetadataValidation-1110663471 tempest-FlavorMetadataValidation-1110663471-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:31.071050 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6e6bd8dc-44eb-494b-ab74-4caa3985a5fc tempest-FlavorMetadataValidation-1110663471 tempest-FlavorMetadataValidation-1110663471-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1800269557" status: 202 len: 0 microversion: 2.86 time: 0.050576 Oct 29 02:46:31.074765 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 186/352] 10.222.0.16 () {60 vars in 1202 bytes} [Sat Oct 29 02:46:31 2022] DELETE /compute/v2.1/flavors/1800269557 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:31.083850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cf2a9b85-6e8b-4be5-b36a-86e156cac519 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:31.088648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cf2a9b85-6e8b-4be5-b36a-86e156cac519 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:31.103704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf2a9b85-6e8b-4be5-b36a-86e156cac519 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:31.104472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf2a9b85-6e8b-4be5-b36a-86e156cac519 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:31.105059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf2a9b85-6e8b-4be5-b36a-86e156cac519 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:31.106284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf2a9b85-6e8b-4be5-b36a-86e156cac519 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:31.106882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf2a9b85-6e8b-4be5-b36a-86e156cac519 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:31.107471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf2a9b85-6e8b-4be5-b36a-86e156cac519 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:31.335892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-05d59bb3-1b41-4387-982a-c2c764395f5e tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:31.346191 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-05d59bb3-1b41-4387-982a-c2c764395f5e tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1319 microversion: 2.1 time: 0.465677 Oct 29 02:46:31.350098 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 167/353] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:30 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:31.360290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cb68a452-dcf1-4826-bf9a-05ed981d979e tempest-FlavorMetadataValidation-1110663471 tempest-FlavorMetadataValidation-1110663471-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:31.406090 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cb68a452-dcf1-4826-bf9a-05ed981d979e tempest-FlavorMetadataValidation-1110663471 tempest-FlavorMetadataValidation-1110663471-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6681 microversion: 2.86 time: 0.054601 Oct 29 02:46:31.415016 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 168/354] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Oct 29 02:46:31 2022] GET /compute/v2.1/flavors/detail => generated 6681 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:31.565877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-0bfac28c-04a5-4a44-b15b-2d951f3cedc4 req-610838e7-a2eb-4d19-abe9-f4b1f770bd5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fec365b-4f49-47e5-85b9-281a3f583dd4", "tag": "babba213-6f2e-4317-8a56-6f03e53d177d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:31.585838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0bfac28c-04a5-4a44-b15b-2d951f3cedc4 req-610838e7-a2eb-4d19-abe9-f4b1f770bd5c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:31.586356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0bfac28c-04a5-4a44-b15b-2d951f3cedc4 req-610838e7-a2eb-4d19-abe9-f4b1f770bd5c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:31.586939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0bfac28c-04a5-4a44-b15b-2d951f3cedc4 req-610838e7-a2eb-4d19-abe9-f4b1f770bd5c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:31.609933 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-0bfac28c-04a5-4a44-b15b-2d951f3cedc4 req-610838e7-a2eb-4d19-abe9-f4b1f770bd5c service nova] Creating event network-changed:babba213-6f2e-4317-8a56-6f03e53d177d for instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 on n-h2-862964-4 Oct 29 02:46:31.622064 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-0bfac28c-04a5-4a44-b15b-2d951f3cedc4 req-610838e7-a2eb-4d19-abe9-f4b1f770bd5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059694 Oct 29 02:46:31.622862 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 169/355] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:31.628195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:31.633624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:31.646909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:31.647700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:31.648431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:31.651249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:31.652088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:31.653054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:31.745018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cf2a9b85-6e8b-4be5-b36a-86e156cac519 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:31.759551 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cf2a9b85-6e8b-4be5-b36a-86e156cac519 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1313 microversion: 2.1 time: 0.678150 Oct 29 02:46:31.760842 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 187/356] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:31 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:31.794747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:31.809706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:31.817555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:31.833397 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bead483e-a473-4237-aa2c-b6a71c584654 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.209136 Oct 29 02:46:31.846385 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 170/357] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:31 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:32.042618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:32.043820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:32.053047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9b0345cf-d37c-402c-be3f-1936f22b18ae req-259f934c-f0ce-4fea-99b3-240025ac2826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30418c29-fcfc-4ba8-9660-93ca7329a30f", "name": "network-vif-deleted", "tag": "bb5e9c70-51d2-4672-90c8-0debb6dda7f5"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:32.058085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.058825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.059495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:32.060688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.061334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.061980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:32.084289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9b0345cf-d37c-402c-be3f-1936f22b18ae req-259f934c-f0ce-4fea-99b3-240025ac2826 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.084777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9b0345cf-d37c-402c-be3f-1936f22b18ae req-259f934c-f0ce-4fea-99b3-240025ac2826 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.085201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9b0345cf-d37c-402c-be3f-1936f22b18ae req-259f934c-f0ce-4fea-99b3-240025ac2826 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:32.115643 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9b0345cf-d37c-402c-be3f-1936f22b18ae req-259f934c-f0ce-4fea-99b3-240025ac2826 service nova] Creating event network-vif-deleted:bb5e9c70-51d2-4672-90c8-0debb6dda7f5 for instance 30418c29-fcfc-4ba8-9660-93ca7329a30f on n-h1-862964-4 Oct 29 02:46:32.127861 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9b0345cf-d37c-402c-be3f-1936f22b18ae req-259f934c-f0ce-4fea-99b3-240025ac2826 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078802 Oct 29 02:46:32.133602 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 171/358] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:32.168997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.169992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.170764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:32.172181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lazy-loading 'fault' on Instance uuid 30418c29-fcfc-4ba8-9660-93ca7329a30f {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:32.233931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7e462d0e474a3aa94d3a146ae24d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb0081b81cc46909ff0bae0f6ac30f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:32.247089 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-386f1025-1b4d-4cdc-bb9a-18e7a3550149 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 200 len: 1288 microversion: 2.1 time: 0.209265 Oct 29 02:46:32.248872 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 188/359] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:32 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 1288 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:32.373929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a98d7aac-a12c-4cb8-890d-ebf2b199f362 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:32.375353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a98d7aac-a12c-4cb8-890d-ebf2b199f362 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:32.384514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a98d7aac-a12c-4cb8-890d-ebf2b199f362 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.385690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a98d7aac-a12c-4cb8-890d-ebf2b199f362 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.386377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a98d7aac-a12c-4cb8-890d-ebf2b199f362 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:32.387546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a98d7aac-a12c-4cb8-890d-ebf2b199f362 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.388202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a98d7aac-a12c-4cb8-890d-ebf2b199f362 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.388855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a98d7aac-a12c-4cb8-890d-ebf2b199f362 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:32.699060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a98d7aac-a12c-4cb8-890d-ebf2b199f362 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:32.711737 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a98d7aac-a12c-4cb8-890d-ebf2b199f362 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1468 microversion: 2.1 time: 0.342456 Oct 29 02:46:32.726010 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 172/360] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:32 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1468 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:32.736083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bd71d9aa-308a-4566-aaef-1deb0dae8e9c tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:32.737330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bd71d9aa-308a-4566-aaef-1deb0dae8e9c tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:32.744056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd71d9aa-308a-4566-aaef-1deb0dae8e9c tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.745748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd71d9aa-308a-4566-aaef-1deb0dae8e9c tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.746455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd71d9aa-308a-4566-aaef-1deb0dae8e9c tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:32.748294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd71d9aa-308a-4566-aaef-1deb0dae8e9c tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.749022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd71d9aa-308a-4566-aaef-1deb0dae8e9c tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.750097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd71d9aa-308a-4566-aaef-1deb0dae8e9c tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:32.785361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5bd8ca1a-1567-48e9-a489-6ea082b844ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:32.785959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-bd71d9aa-308a-4566-aaef-1deb0dae8e9c tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lazy-loading 'flavor' on Instance uuid 8f06196e-cc3e-474d-91c0-b3a4f280c400 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:32.786116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5bd8ca1a-1567-48e9-a489-6ea082b844ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:32.795587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bd8ca1a-1567-48e9-a489-6ea082b844ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.796079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bd8ca1a-1567-48e9-a489-6ea082b844ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.796508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bd8ca1a-1567-48e9-a489-6ea082b844ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:32.797279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bd8ca1a-1567-48e9-a489-6ea082b844ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.797651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bd8ca1a-1567-48e9-a489-6ea082b844ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.807563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bd8ca1a-1567-48e9-a489-6ea082b844ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.014922 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bd71d9aa-308a-4566-aaef-1deb0dae8e9c tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400/action" status: 202 len: 0 microversion: 2.1 time: 0.283232 Oct 29 02:46:33.023418 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 189/361] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:46:32 2022] POST /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:33.038088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:33.038987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:33.052696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.054357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.058168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.059275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.059884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.060438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.075177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5bd8ca1a-1567-48e9-a489-6ea082b844ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:33.075495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:33.089157 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5bd8ca1a-1567-48e9-a489-6ea082b844ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1313 microversion: 2.1 time: 0.305232 Oct 29 02:46:33.090678 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 173/362] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:32 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:33.096696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-748b0b99-c52e-4e0e-8d59-af23fec0730b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:33.097480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-748b0b99-c52e-4e0e-8d59-af23fec0730b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:33.104960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-748b0b99-c52e-4e0e-8d59-af23fec0730b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.106532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-748b0b99-c52e-4e0e-8d59-af23fec0730b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.107367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-748b0b99-c52e-4e0e-8d59-af23fec0730b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.108081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-748b0b99-c52e-4e0e-8d59-af23fec0730b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.108529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-748b0b99-c52e-4e0e-8d59-af23fec0730b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.109284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-748b0b99-c52e-4e0e-8d59-af23fec0730b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.199565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:33.209384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:33.211665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:33.220265 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d7058b7-155d-4a79-a265-6df1470372ea tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.195512 Oct 29 02:46:33.221570 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 190/363] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:33 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:33.274545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:33.275163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:33.291037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.291649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.294223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.296339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.299419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.300025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.350977 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] HTTP exception thrown: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Request method failure captured: Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f HTTP/1.1 Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPOQqMlu7DbyF8PFIHmz7nECXgI3hX19ptnLKD_qejqlyDQWhm7mOlf_CR9NigPW6CBDF3iavVKH4EsGzk9nEZ0ixsT6wxIZfEZttNF4HJ5LlnzY7oofs5310SD_t--FGgbALpE4hPKlcBG5X1mk_C7sDO4HJ5O_aV4XzO3iZ_cvMc Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:46:33.356480 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7bb0081b81cc46909ff0bae0f6ac30f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}] Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9c7e462d0e474a3aa94d3a146ae24d21 Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.357854 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '30418c29-fcfc-4ba8-9660-93ca7329a30f'} Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:33.358613 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.359765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.367227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Returning 404 to user: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:33.372543 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-790aeeac-2dbb-47c7-9d64-e2e538aca52e tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 404 len: 111 microversion: 2.1 time: 0.102409 Oct 29 02:46:33.378889 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 191/364] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:33 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:33.386130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-748b0b99-c52e-4e0e-8d59-af23fec0730b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:33.389193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:33.389756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:33.398661 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-748b0b99-c52e-4e0e-8d59-af23fec0730b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1476 microversion: 2.1 time: 0.305232 Oct 29 02:46:33.400419 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 174/365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:33 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1476 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:33.418682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.419275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.419547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.420797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.422382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.424797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.444039 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] HTTP exception thrown: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Request method failure captured: Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f HTTP/1.1 Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPOQqMlu7DbyF8PFIHmz7nECXgI3hX19ptnLKD_qejqlyDQWhm7mOlf_CR9NigPW6CBDF3iavVKH4EsGzk9nEZ0ixsT6wxIZfEZttNF4HJ5LlnzY7oofs5310SD_t--FGgbALpE4hPKlcBG5X1mk_C7sDO4HJ5O_aV4XzO3iZ_cvMc Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:46:33.460883 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7bb0081b81cc46909ff0bae0f6ac30f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}] Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9c7e462d0e474a3aa94d3a146ae24d21 Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.462352 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '30418c29-fcfc-4ba8-9660-93ca7329a30f'} Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:33.463095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.465061 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.466225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Returning 404 to user: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:33.466225 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dfb08bb1-9ff3-472c-ba07-cdad24a86a4a tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 404 len: 111 microversion: 2.1 time: 0.082396 Oct 29 02:46:33.466225 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 192/366] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:33 2022] DELETE /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:33.472570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:33.473173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 30418c29-fcfc-4ba8-9660-93ca7329a30f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:33.480463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.481032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.481461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.482191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.482857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.483553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.517418 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] HTTP exception thrown: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Request method failure captured: Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f HTTP/1.1 Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPOQqMlu7DbyF8PFIHmz7nECXgI3hX19ptnLKD_qejqlyDQWhm7mOlf_CR9NigPW6CBDF3iavVKH4EsGzk9nEZ0ixsT6wxIZfEZttNF4HJ5LlnzY7oofs5310SD_t--FGgbALpE4hPKlcBG5X1mk_C7sDO4HJ5O_aV4XzO3iZ_cvMc Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:46:33.519570 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7bb0081b81cc46909ff0bae0f6ac30f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}] Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9c7e462d0e474a3aa94d3a146ae24d21 Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.520790 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '30418c29-fcfc-4ba8-9660-93ca7329a30f'} Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:33.522306 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. Oct 29 02:46:33.523359 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.528397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Returning 404 to user: Instance 30418c29-fcfc-4ba8-9660-93ca7329a30f could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:33.528397 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2fd32f72-76a3-43eb-b4da-6d7874f2535f tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f" status: 404 len: 111 microversion: 2.1 time: 0.053530 Oct 29 02:46:33.528397 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 175/367] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:33 2022] GET /compute/v2.1/servers/30418c29-fcfc-4ba8-9660-93ca7329a30f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:33.554637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:33.557050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:33.568927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.569578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.579172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.580229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.580713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.581144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.608538 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] HTTP exception thrown: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Request method failure captured: Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 HTTP/1.1 Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPOQqMlu7DbyF8PFIHmz7nECXgI3hX19ptnLKD_qejqlyDQWhm7mOlf_CR9NigPW6CBDF3iavVKH4EsGzk9nEZ0ixsT6wxIZfEZttNF4HJ5LlnzY7oofs5310SD_t--FGgbALpE4hPKlcBG5X1mk_C7sDO4HJ5O_aV4XzO3iZ_cvMc Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:46:33.612651 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7bb0081b81cc46909ff0bae0f6ac30f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}] Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9c7e462d0e474a3aa94d3a146ae24d21 Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:33.613953 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '333ee108-8b64-4be0-a8f8-5e6a558d81a4'} Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:33.614623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:33.615723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.617260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Returning 404 to user: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:33.617260 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-83b838bb-d03b-4b9f-ae0d-18ce93c7da91 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 404 len: 111 microversion: 2.1 time: 0.075862 Oct 29 02:46:33.617260 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 193/368] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:33 2022] DELETE /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:33.620459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:33.621098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] [instance: 333ee108-8b64-4be0-a8f8-5e6a558d81a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:33.629042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.629535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.634642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.635509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.636832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.637793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.658600 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] HTTP exception thrown: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Request method failure captured: Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 HTTP/1.1 Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPOQqMlu7DbyF8PFIHmz7nECXgI3hX19ptnLKD_qejqlyDQWhm7mOlf_CR9NigPW6CBDF3iavVKH4EsGzk9nEZ0ixsT6wxIZfEZttNF4HJ5LlnzY7oofs5310SD_t--FGgbALpE4hPKlcBG5X1mk_C7sDO4HJ5O_aV4XzO3iZ_cvMc Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:46:33.660442 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7bb0081b81cc46909ff0bae0f6ac30f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7bb0081b81cc46909ff0bae0f6ac30f7"}]}] Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 7bb0081b81cc46909ff0bae0f6ac30f7 Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-177309686 Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9c7e462d0e474a3aa94d3a146ae24d21 Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-DeleteServersAdminTestJSON-177309686-project Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:33.661947 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '333ee108-8b64-4be0-a8f8-5e6a558d81a4'} Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:33.662583 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. Oct 29 02:46:33.664691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.667620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] Returning 404 to user: Instance 333ee108-8b64-4be0-a8f8-5e6a558d81a4 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:33.668762 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d92371d7-6c91-4aa2-91b5-207f617f2362 tempest-DeleteServersAdminTestJSON-177309686 tempest-DeleteServersAdminTestJSON-177309686-project] 10.222.0.16 "GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4" status: 404 len: 111 microversion: 2.1 time: 0.052675 Oct 29 02:46:33.670322 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 176/369] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:33 2022] GET /compute/v2.1/servers/333ee108-8b64-4be0-a8f8-5e6a558d81a4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:34.113614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b1d76e00-0152-441a-9306-915dfb999298 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:34.114513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b1d76e00-0152-441a-9306-915dfb999298 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:34.127480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1d76e00-0152-441a-9306-915dfb999298 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.128594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1d76e00-0152-441a-9306-915dfb999298 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.131605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1d76e00-0152-441a-9306-915dfb999298 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.134186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1d76e00-0152-441a-9306-915dfb999298 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.135301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1d76e00-0152-441a-9306-915dfb999298 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.137946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1d76e00-0152-441a-9306-915dfb999298 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.250212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:34.250885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:34.262014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.262746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.263243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.265851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.266485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.266982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.481495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:34.491675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:34.494736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:34.503074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:34.505554 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0973f0fa-2f4e-4a79-934b-05cde7906138 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.260949 Oct 29 02:46:34.507889 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 177/370] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:34 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:34.516921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-db03502e-3ad9-4375-8968-982bd071dfae tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:34.517950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db03502e-3ad9-4375-8968-982bd071dfae tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:34.543339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db03502e-3ad9-4375-8968-982bd071dfae tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.544618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db03502e-3ad9-4375-8968-982bd071dfae tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.546113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db03502e-3ad9-4375-8968-982bd071dfae tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.553621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db03502e-3ad9-4375-8968-982bd071dfae tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.554818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db03502e-3ad9-4375-8968-982bd071dfae tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.555381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db03502e-3ad9-4375-8968-982bd071dfae tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.706454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b1d76e00-0152-441a-9306-915dfb999298 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:34.715817 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b1d76e00-0152-441a-9306-915dfb999298 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1313 microversion: 2.1 time: 0.605726 Oct 29 02:46:34.717101 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 194/371] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:34 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:34.777784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:34.957837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-db03502e-3ad9-4375-8968-982bd071dfae tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:34.976587 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-db03502e-3ad9-4375-8968-982bd071dfae tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1476 microversion: 2.1 time: 0.465356 Oct 29 02:46:34.979542 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 178/372] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:34 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:35.230456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bd5d135d-3301-4bcc-946e-6706c6392eb7 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-858578729", "id": 1534005042, "os-flavor-access:is_public": "False"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:35.262303 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bd5d135d-3301-4bcc-946e-6706c6392eb7 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.542517 Oct 29 02:46:35.267067 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 195/373] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:34 2022] POST /compute/v2.1/flavors => generated 438 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:35.280440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-12283c44-b7cc-4be6-9de8-f33983ed9996 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9c448ad9eb5d439eb7cd762216e53086"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:35.451249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=94 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:35.542428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:35.543235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:35.555107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:35.556094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:35.556824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:35.557844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:35.559386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:35.563043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:35.666347 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-12283c44-b7cc-4be6-9de8-f33983ed9996 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1534005042/action" status: 200 len: 97 microversion: 2.1 time: 0.387010 Oct 29 02:46:35.671265 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 179/374] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Oct 29 02:46:35 2022] POST /compute/v2.1/flavors/1534005042/action => generated 97 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:35.680249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-66324748-6aab-486d-8bb0-e561652d3ee7 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9c448ad9eb5d439eb7cd762216e53086"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:35.759739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:35.779486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:35.783763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:35.800791 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e900df5f-6f64-4699-8e47-20157ef31e98 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.263312 Oct 29 02:46:35.803364 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 196/375] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:35 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:35.814953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e96f6499-8e00-468b-9eab-1d5b3b5e3686 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:35.816243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e96f6499-8e00-468b-9eab-1d5b3b5e3686 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:35.825438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e96f6499-8e00-468b-9eab-1d5b3b5e3686 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:35.826411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e96f6499-8e00-468b-9eab-1d5b3b5e3686 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:35.827063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e96f6499-8e00-468b-9eab-1d5b3b5e3686 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:35.827928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e96f6499-8e00-468b-9eab-1d5b3b5e3686 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:35.828392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e96f6499-8e00-468b-9eab-1d5b3b5e3686 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:35.831168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e96f6499-8e00-468b-9eab-1d5b3b5e3686 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:36.202305 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-66324748-6aab-486d-8bb0-e561652d3ee7 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] HTTP exception thrown: Flavor access already exists for flavor 22 and project 9c448ad9eb5d439eb7cd762216e53086 combination. Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-66324748-6aab-486d-8bb0-e561652d3ee7 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Request method failure captured: Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/flavors/1534005042/action HTTP/1.1 Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 67 Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQJYhsicdzQ8ItbUPi-Oan13Dc6uQv0EYlBn9Pcpe1Lm9tNiSo1pv92Lc8zaEowvPey2X6s4c87JMl1XSnYsQfXqJ0m0ZYrgqEarfQWOuSwVIYQ9hqWUg0njXO6KVg2K3i1joBWL6grNXaMl5BJrWjDTF8M-ynbYsoKHwZIij61g-A Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 5faacb88ba934a498d3b7724d75d11aa Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1189508126 Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:46:36.220598 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5faacb88ba934a498d3b7724d75d11aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5faacb88ba934a498d3b7724d75d11aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5faacb88ba934a498d3b7724d75d11aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5faacb88ba934a498d3b7724d75d11aa"}]}] Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1189508126 Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 5faacb88ba934a498d3b7724d75d11aa Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1189508126 Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 8cd96c1a751642c2b60625e72d2551d6 Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: {"addTenantAccess": {"tenant": "9c448ad9eb5d439eb7cd762216e53086"}} Oct 29 02:46:36.222072 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: exception: Flavor access already exists for flavor 22 and project 9c448ad9eb5d439eb7cd762216e53086 combination. Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1534005042', 'body': {'addTenantAccess': {'tenant': '9c448ad9eb5d439eb7cd762216e53086'}}} Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result.read() Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:46:36.222757 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '22-9c448ad9eb5d439eb7cd762216e53086' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 02:46:36.223721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 02:46:36.227325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:46:36.230914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result.read() Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '22-9c448ad9eb5d439eb7cd762216e53086' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 2, 46, 36, 197198), 'updated_at': None, 'flavor_id': 22, 'project_id': '9c448ad9eb5d439eb7cd762216e53086'}] Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:36.232964 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 22 and project 9c448ad9eb5d439eb7cd762216e53086 combination. Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:36.237044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 22 and project 9c448ad9eb5d439eb7cd762216e53086 combination. Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:36.240298 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:36.243504 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 22 and project 9c448ad9eb5d439eb7cd762216e53086 combination. Oct 29 02:46:36.243504 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.243504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-66324748-6aab-486d-8bb0-e561652d3ee7 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Returning 409 to user: Flavor access already exists for flavor 22 and project 9c448ad9eb5d439eb7cd762216e53086 combination. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:36.243504 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-66324748-6aab-486d-8bb0-e561652d3ee7 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1534005042/action" status: 409 len: 152 microversion: 2.1 time: 0.546703 Oct 29 02:46:36.243504 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 180/376] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Oct 29 02:46:35 2022] POST /compute/v2.1/flavors/1534005042/action => generated 152 bytes in 548 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 02:46:36.253524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2784abb9-bf4c-4922-98f6-a162f28d99ad tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:36.254244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2784abb9-bf4c-4922-98f6-a162f28d99ad tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:36.261175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2784abb9-bf4c-4922-98f6-a162f28d99ad tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:36.261668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2784abb9-bf4c-4922-98f6-a162f28d99ad tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:36.262197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2784abb9-bf4c-4922-98f6-a162f28d99ad tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:36.263673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2784abb9-bf4c-4922-98f6-a162f28d99ad tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:36.264165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2784abb9-bf4c-4922-98f6-a162f28d99ad tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:36.265006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2784abb9-bf4c-4922-98f6-a162f28d99ad tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:36.271382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e96f6499-8e00-468b-9eab-1d5b3b5e3686 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:36.281319 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e96f6499-8e00-468b-9eab-1d5b3b5e3686 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1313 microversion: 2.1 time: 0.476853 Oct 29 02:46:36.293858 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 197/377] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:35 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:36.293858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-38c584fc-82e9-4f52-9916-868ed3448789 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9c448ad9eb5d439eb7cd762216e53086"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:36.478858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2784abb9-bf4c-4922-98f6-a162f28d99ad tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:36.490465 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2784abb9-bf4c-4922-98f6-a162f28d99ad tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1459 microversion: 2.1 time: 0.265000 Oct 29 02:46:36.492005 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 181/378] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:36 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1459 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:36.518439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c173d06e-f198-400c-9288-01ba76ecd9d9 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:36.519836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c173d06e-f198-400c-9288-01ba76ecd9d9 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:36.527984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c173d06e-f198-400c-9288-01ba76ecd9d9 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:36.528931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c173d06e-f198-400c-9288-01ba76ecd9d9 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:36.529832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c173d06e-f198-400c-9288-01ba76ecd9d9 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:36.530743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c173d06e-f198-400c-9288-01ba76ecd9d9 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:36.531364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c173d06e-f198-400c-9288-01ba76ecd9d9 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:36.532137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c173d06e-f198-400c-9288-01ba76ecd9d9 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:36.570910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:36.669684 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-38c584fc-82e9-4f52-9916-868ed3448789 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1534005042/action" status: 200 len: 21 microversion: 2.1 time: 0.382218 Oct 29 02:46:36.670315 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 198/379] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Oct 29 02:46:36 2022] POST /compute/v2.1/flavors/1534005042/action => generated 21 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:36.681249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-27588e5c-859e-406c-99a9-8253d791278e tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:36.707028 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-27588e5c-859e-406c-99a9-8253d791278e tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1534005042" status: 202 len: 0 microversion: 2.1 time: 0.029675 Oct 29 02:46:36.712860 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 199/380] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:46:36 2022] DELETE /compute/v2.1/flavors/1534005042 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:36.718934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b297afe5-383c-4fb8-9fc4-d09aba477a65 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:36.751373 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b297afe5-383c-4fb8-9fc4-d09aba477a65 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.036243 Oct 29 02:46:36.766363 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 200/381] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:36 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:36.776074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3674dedf-8db7-4258-823d-65b243259c3a tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2081625620", "id": 1178831579, "os-flavor-access:is_public": "True"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:36.800696 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3674dedf-8db7-4258-823d-65b243259c3a tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.030471 Oct 29 02:46:36.804881 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 201/382] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:36 2022] POST /compute/v2.1/flavors => generated 438 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:36.827940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b13d2a72-d7c4-4da9-acc6-c16e148c6874 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:36.847496 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-b13d2a72-d7c4-4da9-acc6-c16e148c6874 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b13d2a72-d7c4-4da9-acc6-c16e148c6874 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Request method failure captured: Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/flavors/1178831579/os-flavor-access HTTP/1.1 Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQJYhsicdzQ8ItbUPi-Oan13Dc6uQv0EYlBn9Pcpe1Lm9tNiSo1pv92Lc8zaEowvPey2X6s4c87JMl1XSnYsQfXqJ0m0ZYrgqEarfQWOuSwVIYQ9hqWUg0njXO6KVg2K3i1joBWL6grNXaMl5BJrWjDTF8M-ynbYsoKHwZIij61g-A Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 5faacb88ba934a498d3b7724d75d11aa Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1189508126 Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:36.851867 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5faacb88ba934a498d3b7724d75d11aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5faacb88ba934a498d3b7724d75d11aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5faacb88ba934a498d3b7724d75d11aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5faacb88ba934a498d3b7724d75d11aa"}]}] Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1189508126 Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 5faacb88ba934a498d3b7724d75d11aa Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1189508126 Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 8cd96c1a751642c2b60625e72d2551d6 Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: exception: Access list not available for public flavors. Oct 29 02:46:36.853066 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'flavor_id': '1178831579'} Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 29 02:46:36.854339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:36.857132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b13d2a72-d7c4-4da9-acc6-c16e148c6874 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:36.861848 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b13d2a72-d7c4-4da9-acc6-c16e148c6874 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1178831579/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.043250 Oct 29 02:46:36.864123 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 202/383] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Oct 29 02:46:36 2022] GET /compute/v2.1/flavors/1178831579/os-flavor-access => generated 91 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:36.877093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:36.878083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:36.887031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:36.887752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:36.888379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:36.889291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:36.889963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:36.890576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.023126 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c173d06e-f198-400c-9288-01ba76ecd9d9 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1610 microversion: 2.1 time: 0.508292 Oct 29 02:46:37.025709 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 182/384] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:36 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1610 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:37.036105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-79ebc2f4-9610-4c6b-ab3e-fc20887c660e tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:37.077648 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-79ebc2f4-9610-4c6b-ab3e-fc20887c660e tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1178831579" status: 202 len: 0 microversion: 2.1 time: 0.050391 Oct 29 02:46:37.078685 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 183/385] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:46:37 2022] DELETE /compute/v2.1/flavors/1178831579 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:37.083261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a30f5e7f-de8a-47cd-a52e-f2003e80d684 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:37.095943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a30f5e7f-de8a-47cd-a52e-f2003e80d684 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.096411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a30f5e7f-de8a-47cd-a52e-f2003e80d684 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.097317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a30f5e7f-de8a-47cd-a52e-f2003e80d684 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.098299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a30f5e7f-de8a-47cd-a52e-f2003e80d684 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.099829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a30f5e7f-de8a-47cd-a52e-f2003e80d684 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.100426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a30f5e7f-de8a-47cd-a52e-f2003e80d684 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.116080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:37.125103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:37.138705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:37.148376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=7 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:37.156999 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-46dc2328-837f-46f7-ac47-0f80ccb1f59a tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.291375 Oct 29 02:46:37.159970 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 203/386] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:36 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:37.165130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-04eb099d-0e45-4862-b0c1-3b722d00fde7 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:37.198795 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a30f5e7f-de8a-47cd-a52e-f2003e80d684 tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.118130 Oct 29 02:46:37.217473 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 184/387] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Oct 29 02:46:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:37.217898 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-04eb099d-0e45-4862-b0c1-3b722d00fde7 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.056590 Oct 29 02:46:37.225991 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 204/388] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:37 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:37.232812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862964-4", "block_migration": true, "disk_over_commit": false}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:37.240509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2e7ae737-c9e3-43df-8c72-690f1613c0df tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1369598316", "id": 411800062, "os-flavor-access:is_public": "False"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:37.241419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:37.250893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.252175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.252786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.254422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.255038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.256396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.270142 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2e7ae737-c9e3-43df-8c72-690f1613c0df tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.033319 Oct 29 02:46:37.270736 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 205/389] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:37 2022] POST /compute/v2.1/flavors => generated 436 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:37.322013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Lazy-loading 'flavor' on Instance uuid 8f06196e-cc3e-474d-91c0-b3a4f280c400 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:37.338774 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 while it is in vm_state suspended Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Request method failure captured: Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400/action HTTP/1.1 Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 97 Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPg-vutFH2RpvVjqr49LggtpGpMiup_xjPT1RvAy22hXXlOjdZEBUqDKxeCbTAaiTj3Bm6wpjlEudnzwhOAfcjXTzyxe22vwkiVyOUyixntYimdYsw10LPOsvFOQSzcdIysDxn9XyYugkveEf7CVL9xlhKhVsIEVquN4jg5Qvw1EVM Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 30dfe0aa5f804f7080e8d026ff0bcd92 Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-LiveMigrationNegativeTest-1271877306 Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:46:37.341314 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30dfe0aa5f804f7080e8d026ff0bcd92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30dfe0aa5f804f7080e8d026ff0bcd92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30dfe0aa5f804f7080e8d026ff0bcd92", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30dfe0aa5f804f7080e8d026ff0bcd92"}]}] Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-LiveMigrationNegativeTest-1271877306 Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 30dfe0aa5f804f7080e8d026ff0bcd92 Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1271877306 Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-LiveMigrationNegativeTest-1271877306-project-admin Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: c5a9c291f290489caa0a328d923c3488 Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-LiveMigrationNegativeTest-1271877306-project-admin Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: {"os-migrateLive": {"host": "n-h1-862964-4", "block_migration": true, "disk_over_commit": false}} Oct 29 02:46:37.342784 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: exception: Cannot 'os-migrateLive' instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 while it is in vm_state suspended Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '8f06196e-cc3e-474d-91c0-b3a4f280c400', 'body': {'os-migrateLive': {'host': 'n-h1-862964-4', 'block_migration': True, 'disk_over_commit': False}}} Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 02:46:37.343601 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:37.344745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 while it is in vm_state suspended Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 while it is in vm_state suspended Oct 29 02:46:37.346024 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.348145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 while it is in vm_state suspended {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:37.349174 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ec3f0f5c-21ff-43c1-9cdd-722e097c99ec tempest-LiveMigrationNegativeTest-1271877306 tempest-LiveMigrationNegativeTest-1271877306-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400/action" status: 409 len: 155 microversion: 2.1 time: 0.130617 Oct 29 02:46:37.349923 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 185/390] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:46:37 2022] POST /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400/action => generated 155 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:37.355261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6e82c268-eb3c-472e-9a99-c25780f9dbd0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:37.356092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6e82c268-eb3c-472e-9a99-c25780f9dbd0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:37.363328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e82c268-eb3c-472e-9a99-c25780f9dbd0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.364021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e82c268-eb3c-472e-9a99-c25780f9dbd0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.364592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e82c268-eb3c-472e-9a99-c25780f9dbd0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.365462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e82c268-eb3c-472e-9a99-c25780f9dbd0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.366131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e82c268-eb3c-472e-9a99-c25780f9dbd0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.366831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e82c268-eb3c-472e-9a99-c25780f9dbd0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.672611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6e82c268-eb3c-472e-9a99-c25780f9dbd0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:37.685522 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6e82c268-eb3c-472e-9a99-c25780f9dbd0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1313 microversion: 2.1 time: 0.333225 Oct 29 02:46:37.686338 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 186/391] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:37 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:37.698889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f28b7971-0d5d-46bb-8b9a-df88e7a4232b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:37.708807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f28b7971-0d5d-46bb-8b9a-df88e7a4232b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:37.730897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f28b7971-0d5d-46bb-8b9a-df88e7a4232b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.731288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f28b7971-0d5d-46bb-8b9a-df88e7a4232b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.731721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f28b7971-0d5d-46bb-8b9a-df88e7a4232b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.732425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f28b7971-0d5d-46bb-8b9a-df88e7a4232b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.732881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f28b7971-0d5d-46bb-8b9a-df88e7a4232b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.733279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f28b7971-0d5d-46bb-8b9a-df88e7a4232b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.801816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f28b7971-0d5d-46bb-8b9a-df88e7a4232b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:46:37.848364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b24c36ab-484c-416d-9b2e-2749551c4013 tempest-FlavorsAccessNegativeTestJSON-379048314 tempest-FlavorsAccessNegativeTestJSON-379048314-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9c448ad9eb5d439eb7cd762216e53086"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:37.851792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b24c36ab-484c-416d-9b2e-2749551c4013 tempest-FlavorsAccessNegativeTestJSON-379048314 tempest-FlavorsAccessNegativeTestJSON-379048314-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'eb138b2c90fd4c9ea2fdce09df43ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448ad9eb5d439eb7cd762216e53086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b24c36ab-484c-416d-9b2e-2749551c4013 tempest-FlavorsAccessNegativeTestJSON-379048314 tempest-FlavorsAccessNegativeTestJSON-379048314-project] Request method failure captured: Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/flavors/411800062/action HTTP/1.1 Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 67 Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQItTepaoZP1R3HD7epaHPcwRbocMxr61vqWACrErLJyj0Ew9jBx2VYu62hArA7s7YgcNqQWqZVRgmlspC0KEfC9cKp6nqbURBzGlPZKZP1t2llyBcoVDZr9S-tDFd-cgaUoSccTMUL0xjsItaeHtllp6Zc0tMMxLZgc36gQPrW46E Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 9c448ad9eb5d439eb7cd762216e53086 Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-379048314 Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:46:37.853413 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c448ad9eb5d439eb7cd762216e53086"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c448ad9eb5d439eb7cd762216e53086"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c448ad9eb5d439eb7cd762216e53086", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c448ad9eb5d439eb7cd762216e53086"}]}] Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-379048314 Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 9c448ad9eb5d439eb7cd762216e53086 Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-379048314 Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-FlavorsAccessNegativeTestJSON-379048314-project Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: eb138b2c90fd4c9ea2fdce09df43ecb3 Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-379048314-project Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: {"addTenantAccess": {"tenant": "9c448ad9eb5d439eb7cd762216e53086"}} Oct 29 02:46:37.855532 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '411800062', 'body': {'addTenantAccess': {'tenant': '9c448ad9eb5d439eb7cd762216e53086'}}} Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:37.856207 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 02:46:37.857229 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.860960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b24c36ab-484c-416d-9b2e-2749551c4013 tempest-FlavorsAccessNegativeTestJSON-379048314 tempest-FlavorsAccessNegativeTestJSON-379048314-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:37.863222 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b24c36ab-484c-416d-9b2e-2749551c4013 tempest-FlavorsAccessNegativeTestJSON-379048314 tempest-FlavorsAccessNegativeTestJSON-379048314-project] 10.222.0.16 "POST /compute/v2.1/flavors/411800062/action" status: 403 len: 130 microversion: 2.1 time: 0.579969 Oct 29 02:46:37.866286 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 206/392] 10.222.0.16 () {60 vars in 1197 bytes} [Sat Oct 29 02:46:37 2022] POST /compute/v2.1/flavors/411800062/action => generated 130 bytes in 583 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:37.874173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f23f36e9-7b82-4f59-9ac1-bc32d7b5eb07 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:37.912168 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f23f36e9-7b82-4f59-9ac1-bc32d7b5eb07 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/411800062" status: 202 len: 0 microversion: 2.1 time: 0.043445 Oct 29 02:46:37.918609 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 207/393] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:46:37 2022] DELETE /compute/v2.1/flavors/411800062 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:37.930458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f0e452e4-2cc3-416f-9637-d308f9bbd97a tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:37.987281 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f28b7971-0d5d-46bb-8b9a-df88e7a4232b tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 204 len: 0 microversion: 2.1 time: 0.296338 Oct 29 02:46:37.989344 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 187/394] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:37 2022] DELETE /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:37.990709 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f0e452e4-2cc3-416f-9637-d308f9bbd97a tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.052878 Oct 29 02:46:37.994318 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 208/395] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:37 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:38.006112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-981a8ac0-486a-43db-8269-bedb2d14e5de tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:38.006834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-981a8ac0-486a-43db-8269-bedb2d14e5de tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:38.018190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b655c499-14f4-4387-b156-40cd92348169 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1243592104", "id": 770666088, "os-flavor-access:is_public": "False"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:38.021932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-981a8ac0-486a-43db-8269-bedb2d14e5de tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.022829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-981a8ac0-486a-43db-8269-bedb2d14e5de tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.025576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-981a8ac0-486a-43db-8269-bedb2d14e5de tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.032834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-981a8ac0-486a-43db-8269-bedb2d14e5de tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.033973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-981a8ac0-486a-43db-8269-bedb2d14e5de tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.035689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-981a8ac0-486a-43db-8269-bedb2d14e5de tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.057128 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b655c499-14f4-4387-b156-40cd92348169 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.042645 Oct 29 02:46:38.067351 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 209/396] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:38 2022] POST /compute/v2.1/flavors => generated 436 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:38.081064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6224c493-8408-4742-9a89-a64202283ee9 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9c448ad9eb5d439eb7cd762216e53086"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:38.481263 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6224c493-8408-4742-9a89-a64202283ee9 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/770666088/action" status: 200 len: 96 microversion: 2.1 time: 0.404976 Oct 29 02:46:38.485289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-981a8ac0-486a-43db-8269-bedb2d14e5de tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:38.488002 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 210/397] 10.222.0.16 () {60 vars in 1197 bytes} [Sat Oct 29 02:46:38 2022] POST /compute/v2.1/flavors/770666088/action => generated 96 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:38.495975 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-981a8ac0-486a-43db-8269-bedb2d14e5de tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1465 microversion: 2.1 time: 0.501078 Oct 29 02:46:38.497700 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 188/398] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:37 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1465 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:38.503541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:38.504429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:38.518610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.522602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.528496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.529251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.529714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.530155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.768133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:38.783594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:38.786922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:38.803534 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-11351366-9c49-4b2d-9bb4-8823e8ec4924 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1446 microversion: 2.75 time: 0.303104 Oct 29 02:46:38.806783 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 189/399] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:38 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1446 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:38.822285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb74e42c-3e82-4e9b-af61-04ddd725446c tempest-FlavorsAccessNegativeTestJSON-379048314 tempest-FlavorsAccessNegativeTestJSON-379048314-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9c448ad9eb5d439eb7cd762216e53086"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:38.828656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e4fabbee-2a32-480e-817d-08f3e2f3cb28 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Calling method '.version_select at 0x7fe1a90381f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:38.834193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eb74e42c-3e82-4e9b-af61-04ddd725446c tempest-FlavorsAccessNegativeTestJSON-379048314 tempest-FlavorsAccessNegativeTestJSON-379048314-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'eb138b2c90fd4c9ea2fdce09df43ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448ad9eb5d439eb7cd762216e53086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:38.835507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4fabbee-2a32-480e-817d-08f3e2f3cb28 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.836034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4fabbee-2a32-480e-817d-08f3e2f3cb28 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.836535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4fabbee-2a32-480e-817d-08f3e2f3cb28 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb74e42c-3e82-4e9b-af61-04ddd725446c tempest-FlavorsAccessNegativeTestJSON-379048314 tempest-FlavorsAccessNegativeTestJSON-379048314-project] Request method failure captured: Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/flavors/770666088/action HTTP/1.1 Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 70 Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQItTepaoZP1R3HD7epaHPcwRbocMxr61vqWACrErLJyj0Ew9jBx2VYu62hArA7s7YgcNqQWqZVRgmlspC0KEfC9cKp6nqbURBzGlPZKZP1t2llyBcoVDZr9S-tDFd-cgaUoSccTMUL0xjsItaeHtllp6Zc0tMMxLZgc36gQPrW46E Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9c448ad9eb5d439eb7cd762216e53086 Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-379048314 Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:46:38.842686 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c448ad9eb5d439eb7cd762216e53086"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c448ad9eb5d439eb7cd762216e53086"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c448ad9eb5d439eb7cd762216e53086", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c448ad9eb5d439eb7cd762216e53086"}]}] Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-379048314 Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9c448ad9eb5d439eb7cd762216e53086 Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-379048314 Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FlavorsAccessNegativeTestJSON-379048314-project Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: eb138b2c90fd4c9ea2fdce09df43ecb3 Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-379048314-project Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: {"removeTenantAccess": {"tenant": "9c448ad9eb5d439eb7cd762216e53086"}} Oct 29 02:46:38.844141 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '770666088', 'body': {'removeTenantAccess': {'tenant': '9c448ad9eb5d439eb7cd762216e53086'}}} Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can( Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:38.844930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 02:46:38.846220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.847995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb74e42c-3e82-4e9b-af61-04ddd725446c tempest-FlavorsAccessNegativeTestJSON-379048314 tempest-FlavorsAccessNegativeTestJSON-379048314-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:38.850493 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eb74e42c-3e82-4e9b-af61-04ddd725446c tempest-FlavorsAccessNegativeTestJSON-379048314 tempest-FlavorsAccessNegativeTestJSON-379048314-project] 10.222.0.16 "POST /compute/v2.1/flavors/770666088/action" status: 403 len: 133 microversion: 2.1 time: 0.039444 Oct 29 02:46:38.858661 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 190/400] 10.222.0.16 () {60 vars in 1197 bytes} [Sat Oct 29 02:46:38 2022] POST /compute/v2.1/flavors/770666088/action => generated 133 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:38.868037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cf84b282-383d-4232-a419-1cc2ca299236 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:38.873759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cf84b282-383d-4232-a419-1cc2ca299236 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:38.886335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4fabbee-2a32-480e-817d-08f3e2f3cb28 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.888880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4fabbee-2a32-480e-817d-08f3e2f3cb28 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.888880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4fabbee-2a32-480e-817d-08f3e2f3cb28 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.890214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf84b282-383d-4232-a419-1cc2ca299236 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.890743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf84b282-383d-4232-a419-1cc2ca299236 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.893110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf84b282-383d-4232-a419-1cc2ca299236 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.895939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf84b282-383d-4232-a419-1cc2ca299236 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.896715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf84b282-383d-4232-a419-1cc2ca299236 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.897339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf84b282-383d-4232-a419-1cc2ca299236 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.935236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4fabbee-2a32-480e-817d-08f3e2f3cb28 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.940905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4fabbee-2a32-480e-817d-08f3e2f3cb28 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.941539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4fabbee-2a32-480e-817d-08f3e2f3cb28 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.955723 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e4fabbee-2a32-480e-817d-08f3e2f3cb28 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.466597 Oct 29 02:46:38.967186 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 211/401] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:38.979342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-481975f4-2778-45e6-8c46-704fb008db5a tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9c448ad9eb5d439eb7cd762216e53086"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:39.245691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cf84b282-383d-4232-a419-1cc2ca299236 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:39.257355 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cf84b282-383d-4232-a419-1cc2ca299236 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1313 microversion: 2.1 time: 0.397321 Oct 29 02:46:39.260902 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 191/402] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:38 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:39.266973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b1541ca1-0b98-43bc-8225-1206c12de4af tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Calling method '.version_select at 0x7fe1a8e9ad30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:39.274534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1541ca1-0b98-43bc-8225-1206c12de4af tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.275247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1541ca1-0b98-43bc-8225-1206c12de4af tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.277923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1541ca1-0b98-43bc-8225-1206c12de4af tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.307691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1541ca1-0b98-43bc-8225-1206c12de4af tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.308183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1541ca1-0b98-43bc-8225-1206c12de4af tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.308779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1541ca1-0b98-43bc-8225-1206c12de4af tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.347352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1541ca1-0b98-43bc-8225-1206c12de4af tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.348795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1541ca1-0b98-43bc-8225-1206c12de4af tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.349422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1541ca1-0b98-43bc-8225-1206c12de4af tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.359917 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b1541ca1-0b98-43bc-8225-1206c12de4af tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.097724 Oct 29 02:46:39.360948 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 192/403] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Oct 29 02:46:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:39.421950 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-481975f4-2778-45e6-8c46-704fb008db5a tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/770666088/action" status: 200 len: 21 microversion: 2.1 time: 0.451611 Oct 29 02:46:39.422571 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 212/404] 10.222.0.16 () {60 vars in 1197 bytes} [Sat Oct 29 02:46:38 2022] POST /compute/v2.1/flavors/770666088/action => generated 21 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:39.440168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bedf081d-e754-4f35-b6e9-3e56280acfc8 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Calling method '.version_select at 0x7fe1a918f700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:39.446172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bedf081d-e754-4f35-b6e9-3e56280acfc8 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.446909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bedf081d-e754-4f35-b6e9-3e56280acfc8 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.449757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bedf081d-e754-4f35-b6e9-3e56280acfc8 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.472643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bedf081d-e754-4f35-b6e9-3e56280acfc8 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.473541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bedf081d-e754-4f35-b6e9-3e56280acfc8 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.474013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bedf081d-e754-4f35-b6e9-3e56280acfc8 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.494453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bedf081d-e754-4f35-b6e9-3e56280acfc8 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.496560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bedf081d-e754-4f35-b6e9-3e56280acfc8 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.497172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bedf081d-e754-4f35-b6e9-3e56280acfc8 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.504447 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bedf081d-e754-4f35-b6e9-3e56280acfc8 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.079652 Oct 29 02:46:39.506018 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 213/405] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:39.511029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4da27796-71ba-4c62-8357-d6c3602c4fa2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:39.562754 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4da27796-71ba-4c62-8357-d6c3602c4fa2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/770666088" status: 202 len: 0 microversion: 2.1 time: 0.053093 Oct 29 02:46:39.563355 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 214/406] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:46:39 2022] DELETE /compute/v2.1/flavors/770666088 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:39.587206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ee58d22e-4e9b-4736-8a01-e01843117164 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Calling method '.version_select at 0x7fe1a939cdc0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:39.591841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee58d22e-4e9b-4736-8a01-e01843117164 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.592460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee58d22e-4e9b-4736-8a01-e01843117164 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.595415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee58d22e-4e9b-4736-8a01-e01843117164 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.616816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f3c14cb7-81fd-472c-b0c3-942f359939bc tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2055492158", "ram": 512, "vcpus": 1, "disk": 10, "id": 1250207922, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:39.622280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee58d22e-4e9b-4736-8a01-e01843117164 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.623255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee58d22e-4e9b-4736-8a01-e01843117164 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.624056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee58d22e-4e9b-4736-8a01-e01843117164 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.633529 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ee58d22e-4e9b-4736-8a01-e01843117164 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.064543 Oct 29 02:46:39.634399 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 215/407] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:39.640850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1730c83a-b985-4304-805f-91af176badca tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:39.641792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1730c83a-b985-4304-805f-91af176badca tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:39.653423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1730c83a-b985-4304-805f-91af176badca tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.654426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1730c83a-b985-4304-805f-91af176badca tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.655301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1730c83a-b985-4304-805f-91af176badca tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.656411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1730c83a-b985-4304-805f-91af176badca tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.657324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1730c83a-b985-4304-805f-91af176badca tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.657983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1730c83a-b985-4304-805f-91af176badca tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.714647 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f3c14cb7-81fd-472c-b0c3-942f359939bc tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.352325 Oct 29 02:46:39.715850 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 193/408] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:39 2022] POST /compute/v2.1/flavors => generated 416 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:39.728137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-74fe2e3d-eeaa-4361-81e7-4d0afd8fa6d4 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:39.758479 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-74fe2e3d-eeaa-4361-81e7-4d0afd8fa6d4 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.041463 Oct 29 02:46:39.759910 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 194/409] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:39 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:39.782120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54a5dc34-652b-4723-bbeb-3eaeb1da2f5d tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Calling method '.version_select at 0x7fe1a920d8b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:39.786055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54a5dc34-652b-4723-bbeb-3eaeb1da2f5d tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.793303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54a5dc34-652b-4723-bbeb-3eaeb1da2f5d tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.794165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54a5dc34-652b-4723-bbeb-3eaeb1da2f5d tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.844140 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54a5dc34-652b-4723-bbeb-3eaeb1da2f5d tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.082451 Oct 29 02:46:39.845142 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 195/410] 10.222.0.16 () {58 vars in 1179 bytes} [Sat Oct 29 02:46:39 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:39.894534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1730c83a-b985-4304-805f-91af176badca tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:39.907240 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1730c83a-b985-4304-805f-91af176badca tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1465 microversion: 2.1 time: 0.271369 Oct 29 02:46:39.908350 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 216/411] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:39 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1465 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:39.914016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef69b58d-3039-426f-8359-97c3920d27e2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1493606356", "id": 2121340214, "os-flavor-access:is_public": "False"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:39.939751 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ef69b58d-3039-426f-8359-97c3920d27e2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.030313 Oct 29 02:46:39.941136 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 217/412] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:39 2022] POST /compute/v2.1/flavors => generated 439 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:39.945598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:39.946593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:39.954280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.955123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.955733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.958316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.958775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.959191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.049737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:40.060985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:40.062651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:40.063421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-107f97ab-1d33-47e2-821d-bdd46c0cce46 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.073207 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-abb0aedd-e7e9-404b-b447-00024172d59c tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1452 microversion: 2.75 time: 0.131366 Oct 29 02:46:40.074204 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 218/413] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:39 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:40.081140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40379cfe-62fb-4045-8ed6-4740b2dab7cb tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Calling method '.version_select at 0x7fe1a8f9c5e0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.083013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40379cfe-62fb-4045-8ed6-4740b2dab7cb tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.083489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40379cfe-62fb-4045-8ed6-4740b2dab7cb tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.083919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40379cfe-62fb-4045-8ed6-4740b2dab7cb tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.090839 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-107f97ab-1d33-47e2-821d-bdd46c0cce46 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] HTTP exception thrown: Flavor 1250207922 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-107f97ab-1d33-47e2-821d-bdd46c0cce46 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Request method failure captured: Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/flavors/1250207922/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQOKOVZ74Cab7vw-7-lcxHQ59MXbp85TMPX0Z3hoJ6Df9_x_XCXIlpwRT9bHWhMeoJJJaESkCbGH5hk-nhLYykoWBSli2YuQ1AOwzTs33PswiG1Xj_Fcmas6L0uky9XqqVfkMlVKWjVuZ0rV0pwE0KrEoZSvbbu3GqoitGJJy4ChZQ Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c7b37add6b344f4ea758f3b64d6d0d33 Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:46:40.094157 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:46:40.095332 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7b37add6b344f4ea758f3b64d6d0d33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7b37add6b344f4ea758f3b64d6d0d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7b37add6b344f4ea758f3b64d6d0d33", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7b37add6b344f4ea758f3b64d6d0d33"}]}] Oct 29 02:46:40.095332 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.095332 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c7b37add6b344f4ea758f3b64d6d0d33 Oct 29 02:46:40.095332 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.095332 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project Oct 29 02:46:40.095332 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:40.095332 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:40.095332 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: c43a781399fc4e7798a7acb16cc980e6 Oct 29 02:46:40.095332 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project Oct 29 02:46:40.095332 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:40.095332 n-d-862964-4 devstack@n-api.service[127041]: exception: Flavor 1250207922 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'flavor_id': '1250207922', 'id': 'hw:cpu_thread_policy'} Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1250207922 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.095971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.097108 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.097108 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.097108 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.097108 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:40.097108 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:40.097108 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1250207922 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:40.097108 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.098579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40379cfe-62fb-4045-8ed6-4740b2dab7cb tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.099069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40379cfe-62fb-4045-8ed6-4740b2dab7cb tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.099417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-107f97ab-1d33-47e2-821d-bdd46c0cce46 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Returning 404 to user: Flavor 1250207922 has no extra specs with key hw:cpu_thread_policy. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:40.099528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40379cfe-62fb-4045-8ed6-4740b2dab7cb tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.100508 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-107f97ab-1d33-47e2-821d-bdd46c0cce46 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] 10.222.0.16 "GET /compute/v2.1/flavors/1250207922/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.254294 Oct 29 02:46:40.101207 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 196/414] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 02:46:39 2022] GET /compute/v2.1/flavors/1250207922/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:40.107912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b6a0243e-b319-4b18-9875-75f308ff0588 req-57adc964-2882-4b9a-a764-34d50d932019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fec365b-4f49-47e5-85b9-281a3f583dd4", "name": "network-vif-plugged", "status": "completed", "tag": "babba213-6f2e-4317-8a56-6f03e53d177d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:40.114991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40379cfe-62fb-4045-8ed6-4740b2dab7cb tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.115593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40379cfe-62fb-4045-8ed6-4740b2dab7cb tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.115910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40379cfe-62fb-4045-8ed6-4740b2dab7cb tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.124131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b6a0243e-b319-4b18-9875-75f308ff0588 req-57adc964-2882-4b9a-a764-34d50d932019 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.124911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b6a0243e-b319-4b18-9875-75f308ff0588 req-57adc964-2882-4b9a-a764-34d50d932019 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.125585 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40379cfe-62fb-4045-8ed6-4740b2dab7cb tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050323 Oct 29 02:46:40.126009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b6a0243e-b319-4b18-9875-75f308ff0588 req-57adc964-2882-4b9a-a764-34d50d932019 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.126585 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 219/415] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:40.132970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac9f86ad-6d3c-414d-9db4-7c860fec0b60 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "afd7266de3634dc7930933a51f0ccd0b"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:40.139482 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b6a0243e-b319-4b18-9875-75f308ff0588 req-57adc964-2882-4b9a-a764-34d50d932019 service nova] Creating event network-vif-plugged:babba213-6f2e-4317-8a56-6f03e53d177d for instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 on n-h2-862964-4 Oct 29 02:46:40.146626 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b6a0243e-b319-4b18-9875-75f308ff0588 req-57adc964-2882-4b9a-a764-34d50d932019 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042497 Oct 29 02:46:40.148429 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 197/416] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:40.156454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54d06ff5-ced7-4354-ba49-58582aa56bee tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:40.161292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-54d06ff5-ced7-4354-ba49-58582aa56bee tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c43a781399fc4e7798a7acb16cc980e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b37add6b344f4ea758f3b64d6d0d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54d06ff5-ced7-4354-ba49-58582aa56bee tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Request method failure captured: Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/flavors/1250207922/os-extra_specs HTTP/1.1 Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 66 Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQOKOVZ74Cab7vw-7-lcxHQ59MXbp85TMPX0Z3hoJ6Df9_x_XCXIlpwRT9bHWhMeoJJJaESkCbGH5hk-nhLYykoWBSli2YuQ1AOwzTs33PswiG1Xj_Fcmas6L0uky9XqqVfkMlVKWjVuZ0rV0pwE0KrEoZSvbbu3GqoitGJJy4ChZQ Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c7b37add6b344f4ea758f3b64d6d0d33 Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:46:40.163737 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7b37add6b344f4ea758f3b64d6d0d33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7b37add6b344f4ea758f3b64d6d0d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7b37add6b344f4ea758f3b64d6d0d33", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7b37add6b344f4ea758f3b64d6d0d33"}]}] Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c7b37add6b344f4ea758f3b64d6d0d33 Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: c43a781399fc4e7798a7acb16cc980e6 Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 29 02:46:40.165010 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'flavor_id': '1250207922', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:40.165638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 02:46:40.166695 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.170056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54d06ff5-ced7-4354-ba49-58582aa56bee tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:40.171310 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54d06ff5-ced7-4354-ba49-58582aa56bee tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] 10.222.0.16 "POST /compute/v2.1/flavors/1250207922/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.021459 Oct 29 02:46:40.183789 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 198/417] 10.222.0.16 () {60 vars in 1224 bytes} [Sat Oct 29 02:46:40 2022] POST /compute/v2.1/flavors/1250207922/os-extra_specs => generated 124 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:40.193696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ea140ba1-d0f2-4327-b80c-faa5bdcb60bd tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Calling method '.version_select at 0x7fe1a8e63700>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.197284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea140ba1-d0f2-4327-b80c-faa5bdcb60bd tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.198164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea140ba1-d0f2-4327-b80c-faa5bdcb60bd tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.198913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea140ba1-d0f2-4327-b80c-faa5bdcb60bd tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.217574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea140ba1-d0f2-4327-b80c-faa5bdcb60bd tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.218399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea140ba1-d0f2-4327-b80c-faa5bdcb60bd tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.219017 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-ac9f86ad-6d3c-414d-9db4-7c860fec0b60 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] HTTP exception thrown: Flavor access not found for 27 / afd7266de3634dc7930933a51f0ccd0b combination. Oct 29 02:46:40.219219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea140ba1-d0f2-4327-b80c-faa5bdcb60bd tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac9f86ad-6d3c-414d-9db4-7c860fec0b60 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Request method failure captured: Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/flavors/2121340214/action HTTP/1.1 Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 70 Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQJYhsicdzQ8ItbUPi-Oan13Dc6uQv0EYlBn9Pcpe1Lm9tNiSo1pv92Lc8zaEowvPey2X6s4c87JMl1XSnYsQfXqJ0m0ZYrgqEarfQWOuSwVIYQ9hqWUg0njXO6KVg2K3i1joBWL6grNXaMl5BJrWjDTF8M-ynbYsoKHwZIij61g-A Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 5faacb88ba934a498d3b7724d75d11aa Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1189508126 Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:40.221232 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5faacb88ba934a498d3b7724d75d11aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5faacb88ba934a498d3b7724d75d11aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5faacb88ba934a498d3b7724d75d11aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5faacb88ba934a498d3b7724d75d11aa"}]}] Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1189508126 Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 5faacb88ba934a498d3b7724d75d11aa Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1189508126 Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 8cd96c1a751642c2b60625e72d2551d6 Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: {"removeTenantAccess": {"tenant": "afd7266de3634dc7930933a51f0ccd0b"}} Oct 29 02:46:40.222471 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: exception: Flavor access not found for 27 / afd7266de3634dc7930933a51f0ccd0b combination. Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2121340214', 'body': {'removeTenantAccess': {'tenant': 'afd7266de3634dc7930933a51f0ccd0b'}}} Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 29 02:46:40.223136 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 27 / afd7266de3634dc7930933a51f0ccd0b combination. Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 27 / afd7266de3634dc7930933a51f0ccd0b combination. Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.224126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.225174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.225174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.225174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:40.225174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:40.225174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 27 / afd7266de3634dc7930933a51f0ccd0b combination. Oct 29 02:46:40.225174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.225174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac9f86ad-6d3c-414d-9db4-7c860fec0b60 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Returning 404 to user: Flavor access not found for 27 / afd7266de3634dc7930933a51f0ccd0b combination. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:40.225174 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ac9f86ad-6d3c-414d-9db4-7c860fec0b60 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2121340214/action" status: 404 len: 124 microversion: 2.1 time: 0.095048 Oct 29 02:46:40.225174 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 220/418] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Oct 29 02:46:40 2022] POST /compute/v2.1/flavors/2121340214/action => generated 124 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:40.234740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dddf7abd-f490-418e-b3ff-3ad39efb4709 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:40.238369 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ea140ba1-d0f2-4327-b80c-faa5bdcb60bd tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.052361 Oct 29 02:46:40.239566 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 199/419] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:40.253259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b1b1c51-b288-4742-a655-256dc583e053 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.305572 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b1b1c51-b288-4742-a655-256dc583e053 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2121340214" status: 202 len: 0 microversion: 2.1 time: 0.064561 Oct 29 02:46:40.306921 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 200/420] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:46:40 2022] DELETE /compute/v2.1/flavors/2121340214 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:40.316694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-52944a3c-c2a2-4224-8d4c-c88551f44324 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Calling method '.version_select at 0x7fe1a91cd0d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.320405 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dddf7abd-f490-418e-b3ff-3ad39efb4709 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1250207922/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.095508 Oct 29 02:46:40.320918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52944a3c-c2a2-4224-8d4c-c88551f44324 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.321040 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 221/421] 10.222.0.16 () {60 vars in 1224 bytes} [Sat Oct 29 02:46:40 2022] POST /compute/v2.1/flavors/1250207922/os-extra_specs => generated 66 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:40.322140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52944a3c-c2a2-4224-8d4c-c88551f44324 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.331315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52944a3c-c2a2-4224-8d4c-c88551f44324 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.346955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3fc12bc9-306f-406f-9edd-ac42c33d82d5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.347587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3fc12bc9-306f-406f-9edd-ac42c33d82d5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:40.353028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52944a3c-c2a2-4224-8d4c-c88551f44324 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.354431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52944a3c-c2a2-4224-8d4c-c88551f44324 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.354855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52944a3c-c2a2-4224-8d4c-c88551f44324 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.363282 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-52944a3c-c2a2-4224-8d4c-c88551f44324 tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.054512 Oct 29 02:46:40.364400 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 201/422] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:40 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:40.371178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc12bc9-306f-406f-9edd-ac42c33d82d5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.372102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc12bc9-306f-406f-9edd-ac42c33d82d5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.372846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc12bc9-306f-406f-9edd-ac42c33d82d5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.374292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc12bc9-306f-406f-9edd-ac42c33d82d5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.377516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc12bc9-306f-406f-9edd-ac42c33d82d5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.378159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc12bc9-306f-406f-9edd-ac42c33d82d5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.378797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-69126c11-b57d-4491-91dd-216166971f09 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.443881 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-69126c11-b57d-4491-91dd-216166971f09 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.077686 Oct 29 02:46:40.450309 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 202/423] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:40 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:40.474126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d24e454f-d3c2-4680-9a90-a9e1a1901ec6 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.475913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d24e454f-d3c2-4680-9a90-a9e1a1901ec6 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c43a781399fc4e7798a7acb16cc980e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b37add6b344f4ea758f3b64d6d0d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d24e454f-d3c2-4680-9a90-a9e1a1901ec6 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Request method failure captured: Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQOKOVZ74Cab7vw-7-lcxHQ59MXbp85TMPX0Z3hoJ6Df9_x_XCXIlpwRT9bHWhMeoJJJaESkCbGH5hk-nhLYykoWBSli2YuQ1AOwzTs33PswiG1Xj_Fcmas6L0uky9XqqVfkMlVKWjVuZ0rV0pwE0KrEoZSvbbu3GqoitGJJy4ChZQ Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c7b37add6b344f4ea758f3b64d6d0d33 Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:46:40.478678 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:46:40.479994 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7b37add6b344f4ea758f3b64d6d0d33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7b37add6b344f4ea758f3b64d6d0d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7b37add6b344f4ea758f3b64d6d0d33", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7b37add6b344f4ea758f3b64d6d0d33"}]}] Oct 29 02:46:40.479994 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.479994 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c7b37add6b344f4ea758f3b64d6d0d33 Oct 29 02:46:40.479994 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.479994 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project Oct 29 02:46:40.479994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:40.479994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:40.479994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: c43a781399fc4e7798a7acb16cc980e6 Oct 29 02:46:40.479994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project Oct 29 02:46:40.479994 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:40.479994 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'flavor_id': '1250207922', 'id': 'hw:numa_nodes'} Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:40.480574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.481760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d24e454f-d3c2-4680-9a90-a9e1a1901ec6 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:40.482707 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d24e454f-d3c2-4680-9a90-a9e1a1901ec6 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.028811 Oct 29 02:46:40.482707 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 203/424] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 02:46:40 2022] DELETE /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:40.488185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ef2909d-28ff-4a80-b05a-98b8d03c0fdc tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Calling method '.version_select at 0x7fe1a90df670>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.490162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ef2909d-28ff-4a80-b05a-98b8d03c0fdc tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.490636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ef2909d-28ff-4a80-b05a-98b8d03c0fdc tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.491062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ef2909d-28ff-4a80-b05a-98b8d03c0fdc tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.526177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ef2909d-28ff-4a80-b05a-98b8d03c0fdc tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.526674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ef2909d-28ff-4a80-b05a-98b8d03c0fdc tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.528325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ef2909d-28ff-4a80-b05a-98b8d03c0fdc tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.548700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ef2909d-28ff-4a80-b05a-98b8d03c0fdc tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.549144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ef2909d-28ff-4a80-b05a-98b8d03c0fdc tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.550218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ef2909d-28ff-4a80-b05a-98b8d03c0fdc tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.670248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3fc12bc9-306f-406f-9edd-ac42c33d82d5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:40.690120 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3fc12bc9-306f-406f-9edd-ac42c33d82d5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1313 microversion: 2.1 time: 0.353883 Oct 29 02:46:40.692699 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 222/425] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:40 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:40.717256 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ef2909d-28ff-4a80-b05a-98b8d03c0fdc tempest-HypervisorAdminTestJSON-1542982458 tempest-HypervisorAdminTestJSON-1542982458-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.235154 Oct 29 02:46:40.724889 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 204/426] 10.222.0.16 () {58 vars in 1173 bytes} [Sat Oct 29 02:46:40 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:40.727373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-24d837f2-38ba-47f4-847c-c773788af9d1 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:40.814256 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-24d837f2-38ba-47f4-847c-c773788af9d1 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1250207922/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.120101 Oct 29 02:46:40.824752 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 223/427] 10.222.0.16 () {60 vars in 1224 bytes} [Sat Oct 29 02:46:40 2022] POST /compute/v2.1/flavors/1250207922/os-extra_specs => generated 66 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:40.839409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-df24d77f-9a67-4c74-ad6c-499d0c33a2f3 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:40.842816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-df24d77f-9a67-4c74-ad6c-499d0c33a2f3 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c43a781399fc4e7798a7acb16cc980e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b37add6b344f4ea758f3b64d6d0d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-df24d77f-9a67-4c74-ad6c-499d0c33a2f3 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Request method failure captured: Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 22 Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQOKOVZ74Cab7vw-7-lcxHQ59MXbp85TMPX0Z3hoJ6Df9_x_XCXIlpwRT9bHWhMeoJJJaESkCbGH5hk-nhLYykoWBSli2YuQ1AOwzTs33PswiG1Xj_Fcmas6L0uky9XqqVfkMlVKWjVuZ0rV0pwE0KrEoZSvbbu3GqoitGJJy4ChZQ Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c7b37add6b344f4ea758f3b64d6d0d33 Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:46:40.844735 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7b37add6b344f4ea758f3b64d6d0d33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7b37add6b344f4ea758f3b64d6d0d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7b37add6b344f4ea758f3b64d6d0d33", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7b37add6b344f4ea758f3b64d6d0d33"}]}] Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c7b37add6b344f4ea758f3b64d6d0d33 Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: c43a781399fc4e7798a7acb16cc980e6 Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: {"hw:numa_nodes": "1"} Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:40.846706 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'flavor_id': '1250207922', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:40.847390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 02:46:40.848373 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.849384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-df24d77f-9a67-4c74-ad6c-499d0c33a2f3 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:40.862935 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-df24d77f-9a67-4c74-ad6c-499d0c33a2f3 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984 tempest-FlavorsExtraSpecsNegativeTestJSON-107868984-project] 10.222.0.16 "PUT /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.011761 Oct 29 02:46:40.865625 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 205/428] 10.222.0.16 () {60 vars in 1265 bytes} [Sat Oct 29 02:46:40 2022] PUT /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:40.880726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64655ba4-c1b5-4b9f-af83-b9e9a813d013 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.895230 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-64655ba4-c1b5-4b9f-af83-b9e9a813d013 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] HTTP exception thrown: Flavor 1250207922 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64655ba4-c1b5-4b9f-af83-b9e9a813d013 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Request method failure captured: Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/flavors/1250207922/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQPqIPoylOyBrjpkbn0lDjJz6Ldo4rMRlKiaBm07WushSYlWq-Oi-18bx5ulYYmh0bVuRxqvBpcvPe7w517xi-wWJ01pymrl37VBzBB1txi0AUIeY-ijUUFll4qqyF3NY_GwGTadPYv9s83NkrgCrp9n1Q33jMyqV5qP5PSIygGPdw Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 227454c954934f0eb16185f740510957 Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:40.898267 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:40.899474 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/227454c954934f0eb16185f740510957"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227454c954934f0eb16185f740510957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_227454c954934f0eb16185f740510957", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227454c954934f0eb16185f740510957"}]}] Oct 29 02:46:40.899474 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 Oct 29 02:46:40.899474 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 227454c954934f0eb16185f740510957 Oct 29 02:46:40.899474 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 Oct 29 02:46:40.899474 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin Oct 29 02:46:40.899474 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:40.899474 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:40.899474 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 1285be221cc84102b3de2bc25c6d1f3b Oct 29 02:46:40.899474 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin Oct 29 02:46:40.899474 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:40.899474 n-d-862964-4 devstack@n-api.service[127042]: exception: Flavor 1250207922 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'flavor_id': '1250207922', 'id': 'hw:cpu_thread_policy'} Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1250207922 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.900097 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.901376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.901376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.901376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.901376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:40.901376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:40.901376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1250207922 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:40.901376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.905018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64655ba4-c1b5-4b9f-af83-b9e9a813d013 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Returning 404 to user: Flavor 1250207922 has no extra specs with key hw:cpu_thread_policy. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:40.906847 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-64655ba4-c1b5-4b9f-af83-b9e9a813d013 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1250207922/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.034252 Oct 29 02:46:40.908668 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 224/429] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:46:40 2022] DELETE /compute/v2.1/flavors/1250207922/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:46:40.921137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-956694c6-45af-4186-8cbe-9ddc774c0ab6 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:40.925562 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-956694c6-45af-4186-8cbe-9ddc774c0ab6 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-956694c6-45af-4186-8cbe-9ddc774c0ab6 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Request method failure captured: Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 27 Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQPqIPoylOyBrjpkbn0lDjJz6Ldo4rMRlKiaBm07WushSYlWq-Oi-18bx5ulYYmh0bVuRxqvBpcvPe7w517xi-wWJ01pymrl37VBzBB1txi0AUIeY-ijUUFll4qqyF3NY_GwGTadPYv9s83NkrgCrp9n1Q33jMyqV5qP5PSIygGPdw Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 227454c954934f0eb16185f740510957 Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:46:40.927130 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/227454c954934f0eb16185f740510957"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227454c954934f0eb16185f740510957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_227454c954934f0eb16185f740510957", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227454c954934f0eb16185f740510957"}]}] Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 227454c954934f0eb16185f740510957 Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 1285be221cc84102b3de2bc25c6d1f3b Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: {"hw:cpu_policy": "shared"} Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:40.929915 n-d-862964-4 devstack@n-api.service[127041]: exception: Request body and URI mismatch Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'flavor_id': '1250207922', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.930700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.931745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:40.931745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:40.931745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 29 02:46:40.931745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.941053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-956694c6-45af-4186-8cbe-9ddc774c0ab6 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:40.944853 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-956694c6-45af-4186-8cbe-9ddc774c0ab6 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.028839 Oct 29 02:46:40.946004 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 206/430] 10.222.0.16 () {60 vars in 1265 bytes} [Sat Oct 29 02:46:40 2022] PUT /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes => generated 73 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:40.947330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b9071ac-d0da-4640-b0c7-1f6cc22f9c6c tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.948289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b9071ac-d0da-4640-b0c7-1f6cc22f9c6c tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:40.957457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b5e7962e-60e0-48cc-b612-9eecc8fe7f5b tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:40.966894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b9071ac-d0da-4640-b0c7-1f6cc22f9c6c tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b5e7962e-60e0-48cc-b612-9eecc8fe7f5b tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Request method failure captured: Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 49 Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQPqIPoylOyBrjpkbn0lDjJz6Ldo4rMRlKiaBm07WushSYlWq-Oi-18bx5ulYYmh0bVuRxqvBpcvPe7w517xi-wWJ01pymrl37VBzBB1txi0AUIeY-ijUUFll4qqyF3NY_GwGTadPYv9s83NkrgCrp9n1Q33jMyqV5qP5PSIygGPdw Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 227454c954934f0eb16185f740510957 Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:46:40.976504 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/227454c954934f0eb16185f740510957"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227454c954934f0eb16185f740510957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_227454c954934f0eb16185f740510957", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/227454c954934f0eb16185f740510957"}]}] Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 227454c954934f0eb16185f740510957 Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 1285be221cc84102b3de2bc25c6d1f3b Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 29 02:46:40.977686 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'flavor_id': '1250207922', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance: Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 29 02:46:40.978398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.979901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:40.980982 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:40.980982 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:40.980982 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:46:40.980982 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:46:40.980982 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 02:46:40.980982 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:40.982456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b9071ac-d0da-4640-b0c7-1f6cc22f9c6c tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.982996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b9071ac-d0da-4640-b0c7-1f6cc22f9c6c tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.984147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b5e7962e-60e0-48cc-b612-9eecc8fe7f5b tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:40.985706 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b5e7962e-60e0-48cc-b612-9eecc8fe7f5b tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.032729 Oct 29 02:46:40.986757 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 207/431] 10.222.0.16 () {60 vars in 1265 bytes} [Sat Oct 29 02:46:40 2022] PUT /compute/v2.1/flavors/1250207922/os-extra_specs/hw:numa_nodes => generated 117 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:46:40.992650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b9071ac-d0da-4640-b0c7-1f6cc22f9c6c tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.996283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b9071ac-d0da-4640-b0c7-1f6cc22f9c6c tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.997794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b9071ac-d0da-4640-b0c7-1f6cc22f9c6c tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:41.000328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a604d1cb-0c2f-4fb8-aab5-8c20e794988e tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:41.046261 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a604d1cb-0c2f-4fb8-aab5-8c20e794988e tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1250207922" status: 202 len: 0 microversion: 2.1 time: 0.053130 Oct 29 02:46:41.047475 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 208/432] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:46:40 2022] DELETE /compute/v2.1/flavors/1250207922 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:41.055278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a327487d-b99c-4421-83b6-1a29f36cd13a tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:41.096519 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a327487d-b99c-4421-83b6-1a29f36cd13a tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489 tempest-FlavorsExtraSpecsNegativeTestJSON-1864583489-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.044870 Oct 29 02:46:41.109248 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 209/433] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:41 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:41.127868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:41.128644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:41.160176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:41.160611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:41.169254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:41.172277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:41.183921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:41.185068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:41.327585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2b9071ac-d0da-4640-b0c7-1f6cc22f9c6c tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:41.337521 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b9071ac-d0da-4640-b0c7-1f6cc22f9c6c tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1465 microversion: 2.1 time: 0.401441 Oct 29 02:46:41.338134 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 225/434] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:40 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1465 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:41.411746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:41.425176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:41.431759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:41.443511 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-36efceb3-4a16-4907-b5fe-631194a15313 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1452 microversion: 2.75 time: 0.327590 Oct 29 02:46:41.446934 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 210/435] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:41 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1452 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:41.507280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-888e9297-9cd5-4205-bbfa-0c5c7cc3402a req-8a5e587e-0916-4745-80f7-67b25045650f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f06196e-cc3e-474d-91c0-b3a4f280c400", "name": "network-vif-deleted", "tag": "4cdb7e5d-cd3c-4c8c-9423-113d17d0e0a2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:41.530438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-888e9297-9cd5-4205-bbfa-0c5c7cc3402a req-8a5e587e-0916-4745-80f7-67b25045650f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:41.538485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-888e9297-9cd5-4205-bbfa-0c5c7cc3402a req-8a5e587e-0916-4745-80f7-67b25045650f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:41.539338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-888e9297-9cd5-4205-bbfa-0c5c7cc3402a req-8a5e587e-0916-4745-80f7-67b25045650f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:41.568263 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-888e9297-9cd5-4205-bbfa-0c5c7cc3402a req-8a5e587e-0916-4745-80f7-67b25045650f service nova] Creating event network-vif-deleted:4cdb7e5d-cd3c-4c8c-9423-113d17d0e0a2 for instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 on n-h2-862964-4 Oct 29 02:46:41.581617 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-888e9297-9cd5-4205-bbfa-0c5c7cc3402a req-8a5e587e-0916-4745-80f7-67b25045650f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077968 Oct 29 02:46:41.582681 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 211/436] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:41.716385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9d44b4b-1ca8-4d8d-ade4-9d9c1ffa8af6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:41.717250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c9d44b4b-1ca8-4d8d-ade4-9d9c1ffa8af6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:41.730207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9d44b4b-1ca8-4d8d-ade4-9d9c1ffa8af6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:41.730956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9d44b4b-1ca8-4d8d-ade4-9d9c1ffa8af6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:41.732377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9d44b4b-1ca8-4d8d-ade4-9d9c1ffa8af6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:41.733346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9d44b4b-1ca8-4d8d-ade4-9d9c1ffa8af6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:41.736613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9d44b4b-1ca8-4d8d-ade4-9d9c1ffa8af6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:41.737247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9d44b4b-1ca8-4d8d-ade4-9d9c1ffa8af6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:42.232707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ba4dcc8-e4fd-4efe-8a89-e6f74cfd86a8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Action: 'create', calling method: .version_select at 0x7fe1a8f9c4c0>, body: {"keypair": {"name": "tempest-keypair-961123784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKKxjc0xcoOke2fqrjiiz6zPYPC+nkEswjVEICbMZMVtXYGMTiXi8jx0HH3U5U+L1I4AoNubugIUL+56TNGpRPesawJd0JDvnxO1cDTr7Y1DAUuizPcIY4cgFwzl1QqdQ=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:42.284591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-4ba4dcc8-e4fd-4efe-8a89-e6f74cfd86a8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Getting quotas for project f76e01279e6d47c0aa4fb03206db8050. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:42.301049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:DELETE=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:42.302495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-4ba4dcc8-e4fd-4efe-8a89-e6f74cfd86a8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Getting quotas for user 1486b01e2a39475dab72aa7f36816c1a and project f76e01279e6d47c0aa4fb03206db8050. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:42.329685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c9d44b4b-1ca8-4d8d-ade4-9d9c1ffa8af6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:42.343365 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c9d44b4b-1ca8-4d8d-ade4-9d9c1ffa8af6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1313 microversion: 2.1 time: 0.631589 Oct 29 02:46:42.360079 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 212/437] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:41 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:42.374012 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ba4dcc8-e4fd-4efe-8a89-e6f74cfd86a8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.016115 Oct 29 02:46:42.375020 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 226/438] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:46:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:42.378255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:42.380121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:42.391977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:42.392787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:42.393650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:42.395763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:42.396434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:42.397069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:42.470842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:42.478739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:42.479711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:42.496988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:42.499336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:42.499911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:42.500714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:42.503308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:42.504070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:42.504783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:42.505310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lazy-loading 'fault' on Instance uuid 8f06196e-cc3e-474d-91c0-b3a4f280c400 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:42.505901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:42.508604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:42.676577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:42.692639 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02fe7f34-ea88-4336-b706-33f5e8cfc515 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 200 len: 1309 microversion: 2.1 time: 0.326469 Oct 29 02:46:42.699022 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 213/439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:42 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 1309 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:42.831085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:42.865690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:42.872820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:42.880708 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2e590b7-f758-4cb8-a7d6-7fb44f2cd4e9 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1437 microversion: 2.75 time: 0.406611 Oct 29 02:46:42.894924 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 227/440] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:42 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1437 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:43.385627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be34cde6-1d56-4884-a19c-6030f8b409fd tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:43.387707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-be34cde6-1d56-4884-a19c-6030f8b409fd tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:43.396435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be34cde6-1d56-4884-a19c-6030f8b409fd tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:43.397225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be34cde6-1d56-4884-a19c-6030f8b409fd tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:43.401223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be34cde6-1d56-4884-a19c-6030f8b409fd tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:43.402321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be34cde6-1d56-4884-a19c-6030f8b409fd tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:43.403026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be34cde6-1d56-4884-a19c-6030f8b409fd tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:43.407772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be34cde6-1d56-4884-a19c-6030f8b409fd tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:43.592243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:43.595223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:43.611040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:43.611621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:43.612062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:43.612793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:43.614591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:43.618886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:43.662485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:43.777585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-be34cde6-1d56-4884-a19c-6030f8b409fd tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:43.797862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:43.798412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:43.799643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:43.800670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:43.802164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:43.804087 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be34cde6-1d56-4884-a19c-6030f8b409fd tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1463 microversion: 2.1 time: 0.432869 Oct 29 02:46:43.806178 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 228/441] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:43 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1463 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:43.825918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:43.829934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: 8f06196e-cc3e-474d-91c0-b3a4f280c400] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:43.850672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:43.854677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:43.855369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:43.857342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:43.858838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:43.859843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:43.900631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] HTTP exception thrown: Instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 could not be found. Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Request method failure captured: Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 HTTP/1.1 Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPeTzGSE23CFWD_Yl98QXjlHhqKhgGRgI4q9Ep1lElC2VT4sFLp_QeLnHGlFwh9ob90x8ZWAGGhZo_9s6iWLGZWhbcgAacFDtff-BRDT2-1UJfhwNujjKYuqIOWUE4VsI3LoP8QnnH37zPCdlsD1N9C3bUg_K5wLSwgWMMa07NZvyk Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 95e80c722df94993b9231f5b17ee4c3d Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-LiveMigrationNegativeTest-1263101461 Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:46:43.903345 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95e80c722df94993b9231f5b17ee4c3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95e80c722df94993b9231f5b17ee4c3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95e80c722df94993b9231f5b17ee4c3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95e80c722df94993b9231f5b17ee4c3d"}]}] Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-LiveMigrationNegativeTest-1263101461 Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 95e80c722df94993b9231f5b17ee4c3d Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1263101461 Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-LiveMigrationNegativeTest-1263101461-project Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: de04aa74bc1f403ea9818dcbcaba7b63 Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-LiveMigrationNegativeTest-1263101461-project Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 could not be found. Oct 29 02:46:43.904631 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '8f06196e-cc3e-474d-91c0-b3a4f280c400'} Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 could not be found. Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:43.905383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 could not be found. Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 could not be found. Oct 29 02:46:43.906450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:43.907374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Returning 404 to user: Instance 8f06196e-cc3e-474d-91c0-b3a4f280c400 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:43.908160 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c240a034-c966-4aac-b7b6-dc058f8f3438 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400" status: 404 len: 111 microversion: 2.1 time: 0.099965 Oct 29 02:46:43.910112 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 229/442] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:43 2022] GET /compute/v2.1/servers/8f06196e-cc3e-474d-91c0-b3a4f280c400 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:43.945514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:43.961628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:43.962170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:43.962596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:43.963375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:43.964105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:43.964605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.297304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:44.404120 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9442acf-f3b9-4abe-8920-482538e5f56a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea/action" status: 202 len: 1940 microversion: 2.75 time: 1.496988 Oct 29 02:46:44.418637 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 214/443] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:46:42 2022] POST /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea/action => generated 1940 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 02:46:44.422912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5fc9b416-9d03-4d2a-ae3c-7907a4bb0c77 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:44.426690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5fc9b416-9d03-4d2a-ae3c-7907a4bb0c77 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:44.438596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5fc9b416-9d03-4d2a-ae3c-7907a4bb0c77 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.439941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5fc9b416-9d03-4d2a-ae3c-7907a4bb0c77 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.440580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5fc9b416-9d03-4d2a-ae3c-7907a4bb0c77 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.443565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5fc9b416-9d03-4d2a-ae3c-7907a4bb0c77 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.449725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5fc9b416-9d03-4d2a-ae3c-7907a4bb0c77 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.450659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5fc9b416-9d03-4d2a-ae3c-7907a4bb0c77 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.457931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d01d11f5-bc2e-4f14-9fe5-9c111c8529a7 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:44.460873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d01d11f5-bc2e-4f14-9fe5-9c111c8529a7 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:44.476838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d01d11f5-bc2e-4f14-9fe5-9c111c8529a7 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.480685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d01d11f5-bc2e-4f14-9fe5-9c111c8529a7 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.481172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d01d11f5-bc2e-4f14-9fe5-9c111c8529a7 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.483461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d01d11f5-bc2e-4f14-9fe5-9c111c8529a7 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.486376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d01d11f5-bc2e-4f14-9fe5-9c111c8529a7 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.489353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d01d11f5-bc2e-4f14-9fe5-9c111c8529a7 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.562574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5fc9b416-9d03-4d2a-ae3c-7907a4bb0c77 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:46:44.718400 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5fc9b416-9d03-4d2a-ae3c-7907a4bb0c77 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 204 len: 0 microversion: 2.1 time: 0.306106 Oct 29 02:46:44.719645 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 215/444] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:44 2022] DELETE /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:44.727908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89020915-db70-45b1-9c65-f20973de9400 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:44.728787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89020915-db70-45b1-9c65-f20973de9400 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:44.735513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89020915-db70-45b1-9c65-f20973de9400 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.736004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89020915-db70-45b1-9c65-f20973de9400 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.736429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89020915-db70-45b1-9c65-f20973de9400 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.737133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89020915-db70-45b1-9c65-f20973de9400 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.737606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89020915-db70-45b1-9c65-f20973de9400 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.738051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89020915-db70-45b1-9c65-f20973de9400 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.911940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-89020915-db70-45b1-9c65-f20973de9400 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:44.951185 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89020915-db70-45b1-9c65-f20973de9400 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.229529 Oct 29 02:46:44.962541 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 216/445] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:44 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:44.970649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e46f82f6-766b-47d1-99a2-de33d6c82e19 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:44.970649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e46f82f6-766b-47d1-99a2-de33d6c82e19 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:44.983004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e46f82f6-766b-47d1-99a2-de33d6c82e19 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.983549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e46f82f6-766b-47d1-99a2-de33d6c82e19 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.983996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e46f82f6-766b-47d1-99a2-de33d6c82e19 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.989063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e46f82f6-766b-47d1-99a2-de33d6c82e19 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.989629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e46f82f6-766b-47d1-99a2-de33d6c82e19 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.990123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e46f82f6-766b-47d1-99a2-de33d6c82e19 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.312727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e46f82f6-766b-47d1-99a2-de33d6c82e19 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:45.323528 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e46f82f6-766b-47d1-99a2-de33d6c82e19 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1475 microversion: 2.1 time: 0.366877 Oct 29 02:46:45.327412 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 217/446] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:44 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:45.371558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:45.395511 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d01d11f5-bc2e-4f14-9fe5-9c111c8529a7 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1614 microversion: 2.1 time: 1.480681 Oct 29 02:46:45.398197 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 230/447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:43 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1614 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:45.423179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:45.424508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:45.444410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.446185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.448394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.449753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.451684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.452801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.626556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '13849b751a7141e9900d3999a3693b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f22d73ce564906bfcb14f79df2912e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:45.627559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] flavor_id is None. Assuming migration. {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 02:46:45.628216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 02:46:45.822868 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b987b9d4-cad4-4f7d-beb4-ca6b51e8cda2 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4/action" status: 202 len: 0 microversion: 2.1 time: 0.405860 Oct 29 02:46:45.823921 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 218/448] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:46:45 2022] POST /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:45.833033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f9001624-33d7-4a63-98bb-4e774373d144 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:45.834153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f9001624-33d7-4a63-98bb-4e774373d144 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:45.843186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9001624-33d7-4a63-98bb-4e774373d144 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.843750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9001624-33d7-4a63-98bb-4e774373d144 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.844438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9001624-33d7-4a63-98bb-4e774373d144 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.845542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9001624-33d7-4a63-98bb-4e774373d144 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.846189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9001624-33d7-4a63-98bb-4e774373d144 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.847254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9001624-33d7-4a63-98bb-4e774373d144 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.862125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-296643581", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "66bf80a4-da1c-49b5-be6c-eead11b1d332"}], "security_groups": [{"name": "tempest-securitygroup--1328129073"}], "key_name": "tempest-keypair-961123784", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:46.088969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f9001624-33d7-4a63-98bb-4e774373d144 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:46.098554 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f9001624-33d7-4a63-98bb-4e774373d144 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1472 microversion: 2.1 time: 0.270625 Oct 29 02:46:46.100980 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 231/449] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:45 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:46.107334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5925efe-d76b-4a8e-8c65-6ae31b5777cb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:46.108204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b5925efe-d76b-4a8e-8c65-6ae31b5777cb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:46.115841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5925efe-d76b-4a8e-8c65-6ae31b5777cb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:46.116772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5925efe-d76b-4a8e-8c65-6ae31b5777cb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:46.117615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5925efe-d76b-4a8e-8c65-6ae31b5777cb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:46.118515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5925efe-d76b-4a8e-8c65-6ae31b5777cb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:46.119113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5925efe-d76b-4a8e-8c65-6ae31b5777cb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:46.120411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5925efe-d76b-4a8e-8c65-6ae31b5777cb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:46.143202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] validate_networks() for [('66bf80a4-da1c-49b5-be6c-eead11b1d332', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:46.309604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-b5925efe-d76b-4a8e-8c65-6ae31b5777cb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:46.443705 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b5925efe-d76b-4a8e-8c65-6ae31b5777cb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.341418 Oct 29 02:46:46.444827 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 232/450] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:46 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:46.449922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9e87feeb-652c-4a48-a901-c94f35d0b260 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:46.450535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9e87feeb-652c-4a48-a901-c94f35d0b260 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:46.456953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e87feeb-652c-4a48-a901-c94f35d0b260 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:46.458889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e87feeb-652c-4a48-a901-c94f35d0b260 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:46.459898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e87feeb-652c-4a48-a901-c94f35d0b260 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:46.460791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e87feeb-652c-4a48-a901-c94f35d0b260 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:46.462650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e87feeb-652c-4a48-a901-c94f35d0b260 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:46.463295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e87feeb-652c-4a48-a901-c94f35d0b260 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:46.727654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9e87feeb-652c-4a48-a901-c94f35d0b260 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:46.737109 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9e87feeb-652c-4a48-a901-c94f35d0b260 tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1475 microversion: 2.1 time: 0.291232 Oct 29 02:46:46.737942 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 233/451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:46 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1475 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:46.755118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:46.755533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:46.755999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:46.756552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:46.756980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:46.766952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:46.767578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:46.768011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:46.768742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:46.769185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:46.769625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:46.792646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Getting quotas for project f76e01279e6d47c0aa4fb03206db8050. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:46.798447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Getting quotas for user 1486b01e2a39475dab72aa7f36816c1a and project f76e01279e6d47c0aa4fb03206db8050. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:46.810701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:46.813358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:46.864787 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8305f6fb-e2e2-4014-9925-1396fe4f9ff2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.007684 Oct 29 02:46:46.871978 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 219/452] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:46:46.877277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9f864551-ab76-472c-9964-a2717da04a13 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:46.878023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9f864551-ab76-472c-9964-a2717da04a13 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:47.028961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9f864551-ab76-472c-9964-a2717da04a13 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:47.036576 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9f864551-ab76-472c-9964-a2717da04a13 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1240 microversion: 2.1 time: 0.163280 Oct 29 02:46:47.043141 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 234/453] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:46 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1240 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:47.136093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ddf00a61-e7af-4eb7-a226-137675b3c945 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:47.136943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ddf00a61-e7af-4eb7-a226-137675b3c945 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:47.153857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddf00a61-e7af-4eb7-a226-137675b3c945 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:47.154356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddf00a61-e7af-4eb7-a226-137675b3c945 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:47.158779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddf00a61-e7af-4eb7-a226-137675b3c945 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:47.159969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddf00a61-e7af-4eb7-a226-137675b3c945 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:47.160629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddf00a61-e7af-4eb7-a226-137675b3c945 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:47.161285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddf00a61-e7af-4eb7-a226-137675b3c945 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:47.481439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6013bbac-8b38-43db-bfbb-f715b44d6008 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:47.482114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6013bbac-8b38-43db-bfbb-f715b44d6008 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:47.487943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ddf00a61-e7af-4eb7-a226-137675b3c945 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:47.491049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6013bbac-8b38-43db-bfbb-f715b44d6008 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:47.494280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6013bbac-8b38-43db-bfbb-f715b44d6008 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:47.494791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6013bbac-8b38-43db-bfbb-f715b44d6008 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:47.495806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6013bbac-8b38-43db-bfbb-f715b44d6008 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:47.497695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6013bbac-8b38-43db-bfbb-f715b44d6008 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:47.498850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6013bbac-8b38-43db-bfbb-f715b44d6008 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:47.513188 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ddf00a61-e7af-4eb7-a226-137675b3c945 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1472 microversion: 2.1 time: 0.380384 Oct 29 02:46:47.530405 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 220/454] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:47 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1472 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:47.610405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-6013bbac-8b38-43db-bfbb-f715b44d6008 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:47.638188 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6013bbac-8b38-43db-bfbb-f715b44d6008 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.160355 Oct 29 02:46:47.639246 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 235/455] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:47 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:47.762135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-34744fbf-5963-4fda-8d89-ed6736ffb4ed tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:47.763132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-34744fbf-5963-4fda-8d89-ed6736ffb4ed tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:47.774865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34744fbf-5963-4fda-8d89-ed6736ffb4ed tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:47.776611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34744fbf-5963-4fda-8d89-ed6736ffb4ed tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:47.777761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34744fbf-5963-4fda-8d89-ed6736ffb4ed tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:47.780588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34744fbf-5963-4fda-8d89-ed6736ffb4ed tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:47.781366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34744fbf-5963-4fda-8d89-ed6736ffb4ed tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:47.782400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34744fbf-5963-4fda-8d89-ed6736ffb4ed tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:47.905277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34744fbf-5963-4fda-8d89-ed6736ffb4ed tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de04aa74bc1f403ea9818dcbcaba7b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e80c722df94993b9231f5b17ee4c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:47.919028 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-34744fbf-5963-4fda-8d89-ed6736ffb4ed tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 200 len: 1433 microversion: 2.1 time: 0.161933 Oct 29 02:46:47.919824 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 221/456] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:47 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 1433 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:47.987719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4b79d9ee-7302-4170-bd35-70b1b0087d4d req-b189271f-2b9f-47d5-b5eb-91289222c968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bec03293-594f-445f-8d70-7072771a2366", "name": "network-vif-deleted", "tag": "2abbbf39-789a-4939-9e8e-44c7d7925ce7"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:48.002080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4b79d9ee-7302-4170-bd35-70b1b0087d4d req-b189271f-2b9f-47d5-b5eb-91289222c968 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.003054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4b79d9ee-7302-4170-bd35-70b1b0087d4d req-b189271f-2b9f-47d5-b5eb-91289222c968 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.003619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4b79d9ee-7302-4170-bd35-70b1b0087d4d req-b189271f-2b9f-47d5-b5eb-91289222c968 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.022659 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4b79d9ee-7302-4170-bd35-70b1b0087d4d req-b189271f-2b9f-47d5-b5eb-91289222c968 service nova] Creating event network-vif-deleted:2abbbf39-789a-4939-9e8e-44c7d7925ce7 for instance bec03293-594f-445f-8d70-7072771a2366 on n-h2-862964-4 Oct 29 02:46:48.030444 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4b79d9ee-7302-4170-bd35-70b1b0087d4d req-b189271f-2b9f-47d5-b5eb-91289222c968 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047006 Oct 29 02:46:48.031555 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 236/457] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:48.065859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-30e1e893-2abd-4f58-9786-ac1f8c588818 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:48.066473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-30e1e893-2abd-4f58-9786-ac1f8c588818 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:48.080665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e1e893-2abd-4f58-9786-ac1f8c588818 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.081450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e1e893-2abd-4f58-9786-ac1f8c588818 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.082591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e1e893-2abd-4f58-9786-ac1f8c588818 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.085742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e1e893-2abd-4f58-9786-ac1f8c588818 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.086614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e1e893-2abd-4f58-9786-ac1f8c588818 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.087238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e1e893-2abd-4f58-9786-ac1f8c588818 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.191429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-30e1e893-2abd-4f58-9786-ac1f8c588818 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:48.203632 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-30e1e893-2abd-4f58-9786-ac1f8c588818 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1292 microversion: 2.1 time: 0.143522 Oct 29 02:46:48.204381 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 222/458] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:48 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1292 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:48.538835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-da5a4cf5-dab1-45f8-9ee7-9ac2e097be78 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:48.539536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-da5a4cf5-dab1-45f8-9ee7-9ac2e097be78 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:48.548064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5a4cf5-dab1-45f8-9ee7-9ac2e097be78 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.548343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5a4cf5-dab1-45f8-9ee7-9ac2e097be78 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.549044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5a4cf5-dab1-45f8-9ee7-9ac2e097be78 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.550008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5a4cf5-dab1-45f8-9ee7-9ac2e097be78 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.550568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5a4cf5-dab1-45f8-9ee7-9ac2e097be78 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.551180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5a4cf5-dab1-45f8-9ee7-9ac2e097be78 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.722484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-da5a4cf5-dab1-45f8-9ee7-9ac2e097be78 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:48.743906 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-da5a4cf5-dab1-45f8-9ee7-9ac2e097be78 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1472 microversion: 2.1 time: 0.210084 Oct 29 02:46:48.751874 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 223/459] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:48 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1472 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:48.756879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-903f40e0-b9c7-496b-af8c-9512c7d6af2e tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:48.757674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-903f40e0-b9c7-496b-af8c-9512c7d6af2e tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:48.765466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903f40e0-b9c7-496b-af8c-9512c7d6af2e tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.766349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903f40e0-b9c7-496b-af8c-9512c7d6af2e tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.767011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903f40e0-b9c7-496b-af8c-9512c7d6af2e tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.767947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903f40e0-b9c7-496b-af8c-9512c7d6af2e tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.768675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903f40e0-b9c7-496b-af8c-9512c7d6af2e tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.769305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903f40e0-b9c7-496b-af8c-9512c7d6af2e tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.876856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-903f40e0-b9c7-496b-af8c-9512c7d6af2e tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:48.924171 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-903f40e0-b9c7-496b-af8c-9512c7d6af2e tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.170853 Oct 29 02:46:48.924769 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 224/460] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:48 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:48.947078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:48.947501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] [instance: bec03293-594f-445f-8d70-7072771a2366] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:48.960760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.961252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.961902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.962932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.963758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.964551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.971489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:48.977673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-df0716d9-b937-4276-bf92-88dab9c895b2 tempest-FlavorsV255TestJSON-1784870415 tempest-FlavorsV255TestJSON-1784870415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-946771480", "id": 2132363212, "os-flavor-access:is_public": "True"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:48.985348 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] HTTP exception thrown: Instance bec03293-594f-445f-8d70-7072771a2366 could not be found. Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Request method failure captured: Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 HTTP/1.1 Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPeTzGSE23CFWD_Yl98QXjlHhqKhgGRgI4q9Ep1lElC2VT4sFLp_QeLnHGlFwh9ob90x8ZWAGGhZo_9s6iWLGZWhbcgAacFDtff-BRDT2-1UJfhwNujjKYuqIOWUE4VsI3LoP8QnnH37zPCdlsD1N9C3bUg_K5wLSwgWMMa07NZvyk Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 95e80c722df94993b9231f5b17ee4c3d Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-LiveMigrationNegativeTest-1263101461 Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:46:48.987355 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95e80c722df94993b9231f5b17ee4c3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95e80c722df94993b9231f5b17ee4c3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95e80c722df94993b9231f5b17ee4c3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95e80c722df94993b9231f5b17ee4c3d"}]}] Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-LiveMigrationNegativeTest-1263101461 Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 95e80c722df94993b9231f5b17ee4c3d Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1263101461 Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-LiveMigrationNegativeTest-1263101461-project Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: de04aa74bc1f403ea9818dcbcaba7b63 Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-LiveMigrationNegativeTest-1263101461-project Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance bec03293-594f-445f-8d70-7072771a2366 could not be found. Oct 29 02:46:48.988536 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'bec03293-594f-445f-8d70-7072771a2366'} Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bec03293-594f-445f-8d70-7072771a2366 could not be found. Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:48.989362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bec03293-594f-445f-8d70-7072771a2366 could not be found. Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bec03293-594f-445f-8d70-7072771a2366 could not be found. Oct 29 02:46:48.990595 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:48.992925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] Returning 404 to user: Instance bec03293-594f-445f-8d70-7072771a2366 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:48.994042 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1658bbff-8b13-4450-98fa-a074b049145f tempest-LiveMigrationNegativeTest-1263101461 tempest-LiveMigrationNegativeTest-1263101461-project] 10.222.0.16 "GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366" status: 404 len: 111 microversion: 2.1 time: 0.051157 Oct 29 02:46:48.995427 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 225/461] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:48 2022] GET /compute/v2.1/servers/bec03293-594f-445f-8d70-7072771a2366 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:49.008887 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-df0716d9-b937-4276-bf92-88dab9c895b2 tempest-FlavorsV255TestJSON-1784870415 tempest-FlavorsV255TestJSON-1784870415-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.555539 Oct 29 02:46:49.009490 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 237/462] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:46:48 2022] POST /compute/v2.1/flavors => generated 448 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:49.229181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-10c83cb7-c5af-4ca3-82b8-ae2679702828 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:49.231646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-10c83cb7-c5af-4ca3-82b8-ae2679702828 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:49.248098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c83cb7-c5af-4ca3-82b8-ae2679702828 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.248586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c83cb7-c5af-4ca3-82b8-ae2679702828 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.249014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c83cb7-c5af-4ca3-82b8-ae2679702828 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.249743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c83cb7-c5af-4ca3-82b8-ae2679702828 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.250205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c83cb7-c5af-4ca3-82b8-ae2679702828 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.250618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c83cb7-c5af-4ca3-82b8-ae2679702828 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.351921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-10c83cb7-c5af-4ca3-82b8-ae2679702828 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:49.361018 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-10c83cb7-c5af-4ca3-82b8-ae2679702828 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1298 microversion: 2.1 time: 0.137249 Oct 29 02:46:49.361403 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 238/463] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:49 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:49.572341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-825f5d0d-ae30-4621-9c11-499888593546 tempest-FlavorsV255TestJSON-1528733996 tempest-FlavorsV255TestJSON-1528733996-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:49.584598 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-825f5d0d-ae30-4621-9c11-499888593546 tempest-FlavorsV255TestJSON-1528733996 tempest-FlavorsV255TestJSON-1528733996-project] 10.222.0.16 "GET /compute/v2.1/flavors/2132363212" status: 200 len: 448 microversion: 2.55 time: 0.564427 Oct 29 02:46:49.586311 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 226/464] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Oct 29 02:46:49 2022] GET /compute/v2.1/flavors/2132363212 => generated 448 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:49.604580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c6d5c00d-3033-4f4e-accd-4b55ae867a65 tempest-FlavorsV255TestJSON-1784870415 tempest-FlavorsV255TestJSON-1784870415-project-admin] Action: 'update', calling method: .version_select at 0x7fe1aa7bcd30>, body: {"flavor": {"description": "new"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:49.625302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5bb8faac-a695-4195-9c59-46534e58e708 tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265 tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:49.628714 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-5bb8faac-a695-4195-9c59-46534e58e708 tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265 tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5bb8faac-a695-4195-9c59-46534e58e708 tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265 tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265-project-admin] Request method failure captured: Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQZB8_CARZCyFsxHSdUcaw14S28pGdKy1eYBfY7-mygZ4DwJKb6LmDp5UfWedJgA6z7KHqRIigzzq8h89_QWrAO0FT16i-UmZeDAxv7tg_q8MkjypDFUZxW83ivNRGPm5cFV1PZJAlWcuOaFw9i7brp2Zo8HqZtTiuq0HUaDHSqRXE Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 2cd290d9e267437b922234fab5b1278e Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265 Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:46:49.642111 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:46:49.643671 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2cd290d9e267437b922234fab5b1278e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cd290d9e267437b922234fab5b1278e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2cd290d9e267437b922234fab5b1278e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cd290d9e267437b922234fab5b1278e"}]}] Oct 29 02:46:49.643671 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265 Oct 29 02:46:49.643671 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 2cd290d9e267437b922234fab5b1278e Oct 29 02:46:49.643671 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265 Oct 29 02:46:49.643671 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265-project-admin Oct 29 02:46:49.643671 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:49.643671 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:49.643671 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 28eccb43c1414ad8809c9d384b3d76a2 Oct 29 02:46:49.643671 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265-project-admin Oct 29 02:46:49.643671 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:49.643671 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid timestamp for date invalid_time Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'invalid_time'} Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:49.644451 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 29 02:46:49.645744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:49.647899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5bb8faac-a695-4195-9c59-46534e58e708 tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265 tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:49.649196 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5bb8faac-a695-4195-9c59-46534e58e708 tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265 tempest-InstanceUsageAuditLogNegativeTestJSON-1919893265-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.273439 Oct 29 02:46:49.650035 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 239/465] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:49.666017 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c6d5c00d-3033-4f4e-accd-4b55ae867a65 tempest-FlavorsV255TestJSON-1784870415 tempest-FlavorsV255TestJSON-1784870415-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/2132363212" status: 200 len: 449 microversion: 2.55 time: 0.069723 Oct 29 02:46:49.667186 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 227/466] 10.222.0.16 () {62 vars in 1219 bytes} [Sat Oct 29 02:46:49 2022] PUT /compute/v2.1/flavors/2132363212 => generated 449 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:49.681470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e8f4aa66-1b50-4921-8d37-55c1bc290c84 tempest-FlavorsV255TestJSON-1528733996 tempest-FlavorsV255TestJSON-1528733996-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:49.710015 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e8f4aa66-1b50-4921-8d37-55c1bc290c84 tempest-FlavorsV255TestJSON-1528733996 tempest-FlavorsV255TestJSON-1528733996-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6592 microversion: 2.55 time: 0.033632 Oct 29 02:46:49.711132 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 228/467] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Oct 29 02:46:49 2022] GET /compute/v2.1/flavors/detail => generated 6592 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:49.735072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5d78a378-2062-49d3-9b1b-cde502f556c9 tempest-FlavorsV255TestJSON-1528733996 tempest-FlavorsV255TestJSON-1528733996-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:49.762669 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5d78a378-2062-49d3-9b1b-cde502f556c9 tempest-FlavorsV255TestJSON-1528733996 tempest-FlavorsV255TestJSON-1528733996-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.55 time: 0.031626 Oct 29 02:46:49.764689 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 229/468] 10.222.0.16 () {60 vars in 1166 bytes} [Sat Oct 29 02:46:49 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:49.781579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-101134ac-b3a6-4479-96a8-9ce6dac6b055 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:49.785210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-101134ac-b3a6-4479-96a8-9ce6dac6b055 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:49.793837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-101134ac-b3a6-4479-96a8-9ce6dac6b055 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.794584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-101134ac-b3a6-4479-96a8-9ce6dac6b055 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.795441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-101134ac-b3a6-4479-96a8-9ce6dac6b055 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.796229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-101134ac-b3a6-4479-96a8-9ce6dac6b055 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.796681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-101134ac-b3a6-4479-96a8-9ce6dac6b055 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.797134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-101134ac-b3a6-4479-96a8-9ce6dac6b055 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:50.044400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d195795b-31fd-41db-86aa-7cc54cb72d0d tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:50.046885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d195795b-31fd-41db-86aa-7cc54cb72d0d tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '8e6478c845e84f2dbf66826f632372e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf185db7458546f8af11d535235c6fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d195795b-31fd-41db-86aa-7cc54cb72d0d tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project] Request method failure captured: Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQXrUNbZotHvoBYe-bsTjCqmXMx6g5k-Ih3MckEYhtDfapWT6OKTBPi597Pm8QiH7PkGYYUulcoTPbhJ0ivZe5RxBHcRSHZlCDfhzuqyIiPWAXUcjJ53lXQlsEnMoq69mLC0Pcj_a-Fjb_V-y1Y9qgQDYd1rReMVV2neKsNIzlftIs Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: cf185db7458546f8af11d535235c6fb9 Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:46:50.050928 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:46:50.052214 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf185db7458546f8af11d535235c6fb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf185db7458546f8af11d535235c6fb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf185db7458546f8af11d535235c6fb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf185db7458546f8af11d535235c6fb9"}]}] Oct 29 02:46:50.052214 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 Oct 29 02:46:50.052214 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: cf185db7458546f8af11d535235c6fb9 Oct 29 02:46:50.052214 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 Oct 29 02:46:50.052214 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project Oct 29 02:46:50.052214 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:46:50.052214 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:46:50.052214 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 8e6478c845e84f2dbf66826f632372e9 Oct 29 02:46:50.052214 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project Oct 29 02:46:50.052214 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: action_args: {} Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:50.052771 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 02:46:50.053862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:46:50.054757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d195795b-31fd-41db-86aa-7cc54cb72d0d tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:50.054757 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d195795b-31fd-41db-86aa-7cc54cb72d0d tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.396972 Oct 29 02:46:50.054757 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 240/469] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Oct 29 02:46:49 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 399 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:50.065679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8149f888-9610-4d4d-abfb-9757bb2d75be tempest-FlavorsV255TestJSON-1784870415 tempest-FlavorsV255TestJSON-1784870415-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:50.103626 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8149f888-9610-4d4d-abfb-9757bb2d75be tempest-FlavorsV255TestJSON-1784870415 tempest-FlavorsV255TestJSON-1784870415-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2132363212" status: 202 len: 0 microversion: 2.55 time: 0.048334 Oct 29 02:46:50.104478 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 241/470] 10.222.0.16 () {60 vars in 1202 bytes} [Sat Oct 29 02:46:50 2022] DELETE /compute/v2.1/flavors/2132363212 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:50.111124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-59097035-b372-4c40-8be4-964c5efd4f18 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:50.114536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-59097035-b372-4c40-8be4-964c5efd4f18 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:50.128542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59097035-b372-4c40-8be4-964c5efd4f18 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:50.129428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59097035-b372-4c40-8be4-964c5efd4f18 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:50.133654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59097035-b372-4c40-8be4-964c5efd4f18 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:50.134457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59097035-b372-4c40-8be4-964c5efd4f18 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:50.134983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59097035-b372-4c40-8be4-964c5efd4f18 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:50.135594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59097035-b372-4c40-8be4-964c5efd4f18 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:50.180965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-101134ac-b3a6-4479-96a8-9ce6dac6b055 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.189031 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-101134ac-b3a6-4479-96a8-9ce6dac6b055 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1472 microversion: 2.1 time: 0.417057 Oct 29 02:46:50.189628 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 230/471] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:49 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1472 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:50.197768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c616865c-f8d0-494d-a426-2c74c1411b91 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:50.200248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c616865c-f8d0-494d-a426-2c74c1411b91 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '8e6478c845e84f2dbf66826f632372e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf185db7458546f8af11d535235c6fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c616865c-f8d0-494d-a426-2c74c1411b91 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project] Request method failure captured: Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2002:46:50 HTTP/1.1 Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQXrUNbZotHvoBYe-bsTjCqmXMx6g5k-Ih3MckEYhtDfapWT6OKTBPi597Pm8QiH7PkGYYUulcoTPbhJ0ivZe5RxBHcRSHZlCDfhzuqyIiPWAXUcjJ53lXQlsEnMoq69mLC0Pcj_a-Fjb_V-y1Y9qgQDYd1rReMVV2neKsNIzlftIs Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: cf185db7458546f8af11d535235c6fb9 Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:46:50.202515 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:46:50.203715 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf185db7458546f8af11d535235c6fb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf185db7458546f8af11d535235c6fb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf185db7458546f8af11d535235c6fb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf185db7458546f8af11d535235c6fb9"}]}] Oct 29 02:46:50.203715 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 Oct 29 02:46:50.203715 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: cf185db7458546f8af11d535235c6fb9 Oct 29 02:46:50.203715 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 Oct 29 02:46:50.203715 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project Oct 29 02:46:50.203715 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:46:50.203715 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:46:50.203715 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 8e6478c845e84f2dbf66826f632372e9 Oct 29 02:46:50.203715 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project Oct 29 02:46:50.203715 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2022-10-29 02:46:50'} Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:50.204275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 02:46:50.205304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:46:50.208018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c616865c-f8d0-494d-a426-2c74c1411b91 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:50.209225 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c616865c-f8d0-494d-a426-2c74c1411b91 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711 tempest-InstanceUsageAuditLogNegativeTestJSON-486963711-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29 02:46:50" status: 403 len: 128 microversion: 2.1 time: 0.018663 Oct 29 02:46:50.210301 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 231/472] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 02:46:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2002%3A46%3A50 => generated 128 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:50.219490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-57f39f5a-d061-492b-ada8-85adab5376ae tempest-FlavorsV255TestJSON-1784870415 tempest-FlavorsV255TestJSON-1784870415-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:50.245057 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-57f39f5a-d061-492b-ada8-85adab5376ae tempest-FlavorsV255TestJSON-1784870415 tempest-FlavorsV255TestJSON-1784870415-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6153 microversion: 2.55 time: 0.032894 Oct 29 02:46:50.246706 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 232/473] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Oct 29 02:46:50 2022] GET /compute/v2.1/flavors/detail => generated 6153 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:50.418370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-27aee4b9-8775-4782-b401-82a7e0d28f01 tempest-InstanceUsageAuditLogTestJSON-313667601 tempest-InstanceUsageAuditLogTestJSON-313667601-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:50.440121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-59097035-b372-4c40-8be4-964c5efd4f18 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:50.496095 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-59097035-b372-4c40-8be4-964c5efd4f18 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.388683 Oct 29 02:46:50.496263 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-27aee4b9-8775-4782-b401-82a7e0d28f01 tempest-InstanceUsageAuditLogTestJSON-313667601 tempest-InstanceUsageAuditLogTestJSON-313667601-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29 02:46:50" status: 200 len: 318 microversion: 2.1 time: 0.245576 Oct 29 02:46:50.496263 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 233/474] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 02:46:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2002%3A46%3A50 => generated 318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:50.500616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e11b8544-3c4a-43f5-ac4d-f41b3ea75eaf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:50.501468 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 242/475] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:50 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:50.508756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e11b8544-3c4a-43f5-ac4d-f41b3ea75eaf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:50.525958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11b8544-3c4a-43f5-ac4d-f41b3ea75eaf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:50.527069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11b8544-3c4a-43f5-ac4d-f41b3ea75eaf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:50.527575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11b8544-3c4a-43f5-ac4d-f41b3ea75eaf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:50.528507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11b8544-3c4a-43f5-ac4d-f41b3ea75eaf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:50.529161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11b8544-3c4a-43f5-ac4d-f41b3ea75eaf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:50.529766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11b8544-3c4a-43f5-ac4d-f41b3ea75eaf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:50.533221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a0390d23-8ac9-48b3-91f5-caf7be604828 tempest-InstanceUsageAuditLogTestJSON-313667601 tempest-InstanceUsageAuditLogTestJSON-313667601-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:50.585312 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a0390d23-8ac9-48b3-91f5-caf7be604828 tempest-InstanceUsageAuditLogTestJSON-313667601 tempest-InstanceUsageAuditLogTestJSON-313667601-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.058738 Oct 29 02:46:50.586586 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 243/476] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Oct 29 02:46:50 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:50.843327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e11b8544-3c4a-43f5-ac4d-f41b3ea75eaf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.857108 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e11b8544-3c4a-43f5-ac4d-f41b3ea75eaf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1366 microversion: 2.1 time: 0.359262 Oct 29 02:46:50.871359 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 234/477] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:50 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:51.032643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d564a3ad-1fa6-4354-8b2f-981c698395f2 req-146572c9-b38b-47ea-890f-0a7a642f35a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc4c73c4-725e-415c-a814-c828ec74c554", "tag": "e3e2ab26-126a-4fda-998d-3c38435343e3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:51.053260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d564a3ad-1fa6-4354-8b2f-981c698395f2 req-146572c9-b38b-47ea-890f-0a7a642f35a8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.053920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d564a3ad-1fa6-4354-8b2f-981c698395f2 req-146572c9-b38b-47ea-890f-0a7a642f35a8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.054649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d564a3ad-1fa6-4354-8b2f-981c698395f2 req-146572c9-b38b-47ea-890f-0a7a642f35a8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.069708 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d564a3ad-1fa6-4354-8b2f-981c698395f2 req-146572c9-b38b-47ea-890f-0a7a642f35a8 service nova] Creating event network-changed:e3e2ab26-126a-4fda-998d-3c38435343e3 for instance bc4c73c4-725e-415c-a814-c828ec74c554 on n-h1-862964-4 Oct 29 02:46:51.076643 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d564a3ad-1fa6-4354-8b2f-981c698395f2 req-146572c9-b38b-47ea-890f-0a7a642f35a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048527 Oct 29 02:46:51.079210 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 244/478] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:51.212848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-14c310ba-7ed5-4d97-986e-9c06ae021c7d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:51.213620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-14c310ba-7ed5-4d97-986e-9c06ae021c7d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:51.224584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14c310ba-7ed5-4d97-986e-9c06ae021c7d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.225069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14c310ba-7ed5-4d97-986e-9c06ae021c7d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.225496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14c310ba-7ed5-4d97-986e-9c06ae021c7d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.228663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14c310ba-7ed5-4d97-986e-9c06ae021c7d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.233720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14c310ba-7ed5-4d97-986e-9c06ae021c7d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.234182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14c310ba-7ed5-4d97-986e-9c06ae021c7d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.538875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-74ecaf96-2b9e-45a0-9dd2-32da9612d52c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:51.539898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-74ecaf96-2b9e-45a0-9dd2-32da9612d52c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:51.565530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ecaf96-2b9e-45a0-9dd2-32da9612d52c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.567884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ecaf96-2b9e-45a0-9dd2-32da9612d52c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.569566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ecaf96-2b9e-45a0-9dd2-32da9612d52c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.571267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ecaf96-2b9e-45a0-9dd2-32da9612d52c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.573733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ecaf96-2b9e-45a0-9dd2-32da9612d52c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.575418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ecaf96-2b9e-45a0-9dd2-32da9612d52c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.588243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-14c310ba-7ed5-4d97-986e-9c06ae021c7d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:51.613410 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-14c310ba-7ed5-4d97-986e-9c06ae021c7d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.404981 Oct 29 02:46:51.614698 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 235/479] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:51 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:51.721354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-74ecaf96-2b9e-45a0-9dd2-32da9612d52c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:51.758972 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-74ecaf96-2b9e-45a0-9dd2-32da9612d52c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.224737 Oct 29 02:46:51.760152 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 245/480] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:51 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:51.887538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-372efca7-93e9-41c1-8770-59c4d36a65c3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:51.888746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-372efca7-93e9-41c1-8770-59c4d36a65c3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:51.896485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-372efca7-93e9-41c1-8770-59c4d36a65c3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.896965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-372efca7-93e9-41c1-8770-59c4d36a65c3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.897401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-372efca7-93e9-41c1-8770-59c4d36a65c3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.898140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-372efca7-93e9-41c1-8770-59c4d36a65c3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.898991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-372efca7-93e9-41c1-8770-59c4d36a65c3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.899794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-372efca7-93e9-41c1-8770-59c4d36a65c3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:52.103770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-372efca7-93e9-41c1-8770-59c4d36a65c3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:52.112314 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-372efca7-93e9-41c1-8770-59c4d36a65c3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1366 microversion: 2.1 time: 0.232113 Oct 29 02:46:52.113007 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 236/481] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:51 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:52.637860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-73db91db-80e1-4c40-8164-92c368280135 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:52.638634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-73db91db-80e1-4c40-8164-92c368280135 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:52.646359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73db91db-80e1-4c40-8164-92c368280135 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:52.647739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73db91db-80e1-4c40-8164-92c368280135 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:52.648386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73db91db-80e1-4c40-8164-92c368280135 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:52.649293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73db91db-80e1-4c40-8164-92c368280135 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:52.650104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73db91db-80e1-4c40-8164-92c368280135 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:52.650780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73db91db-80e1-4c40-8164-92c368280135 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:52.790898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3123de10-9776-4829-9e19-6bede9b9b39c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:52.791650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3123de10-9776-4829-9e19-6bede9b9b39c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:52.798753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3123de10-9776-4829-9e19-6bede9b9b39c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:52.799534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3123de10-9776-4829-9e19-6bede9b9b39c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:52.800965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3123de10-9776-4829-9e19-6bede9b9b39c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:52.802141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3123de10-9776-4829-9e19-6bede9b9b39c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:52.803031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3123de10-9776-4829-9e19-6bede9b9b39c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:52.803739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3123de10-9776-4829-9e19-6bede9b9b39c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:52.939910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-3123de10-9776-4829-9e19-6bede9b9b39c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:52.973694 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3123de10-9776-4829-9e19-6bede9b9b39c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.186351 Oct 29 02:46:52.975136 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 237/482] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:52 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:53.010346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-73db91db-80e1-4c40-8164-92c368280135 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:53.022756 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-73db91db-80e1-4c40-8164-92c368280135 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.389062 Oct 29 02:46:53.023755 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 246/483] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:52 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:53.135441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02ace5a6-ebfd-44b1-84ed-d898663c736f tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:53.136212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-02ace5a6-ebfd-44b1-84ed-d898663c736f tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:53.144013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ace5a6-ebfd-44b1-84ed-d898663c736f tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:53.144814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ace5a6-ebfd-44b1-84ed-d898663c736f tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:53.145470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ace5a6-ebfd-44b1-84ed-d898663c736f tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:53.146438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ace5a6-ebfd-44b1-84ed-d898663c736f tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:53.147096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ace5a6-ebfd-44b1-84ed-d898663c736f tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:53.147721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ace5a6-ebfd-44b1-84ed-d898663c736f tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:53.404463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02ace5a6-ebfd-44b1-84ed-d898663c736f tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:53.414617 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02ace5a6-ebfd-44b1-84ed-d898663c736f tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1366 microversion: 2.1 time: 0.282806 Oct 29 02:46:53.431066 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 238/484] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:53 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:54.005065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-177cb57f-bd1f-4723-bde9-cb62b5dcd103 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:54.005065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-177cb57f-bd1f-4723-bde9-cb62b5dcd103 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:54.010390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-177cb57f-bd1f-4723-bde9-cb62b5dcd103 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:54.010898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-177cb57f-bd1f-4723-bde9-cb62b5dcd103 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:54.011326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-177cb57f-bd1f-4723-bde9-cb62b5dcd103 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:54.012015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-177cb57f-bd1f-4723-bde9-cb62b5dcd103 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:54.012651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-177cb57f-bd1f-4723-bde9-cb62b5dcd103 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:54.013062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-177cb57f-bd1f-4723-bde9-cb62b5dcd103 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:54.046165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-79daf0fb-58b4-4524-9ff2-868f5c611153 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:54.047485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-79daf0fb-58b4-4524-9ff2-868f5c611153 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:54.055032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79daf0fb-58b4-4524-9ff2-868f5c611153 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:54.055641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79daf0fb-58b4-4524-9ff2-868f5c611153 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:54.056291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79daf0fb-58b4-4524-9ff2-868f5c611153 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:54.057205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79daf0fb-58b4-4524-9ff2-868f5c611153 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:54.057906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79daf0fb-58b4-4524-9ff2-868f5c611153 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:54.058261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79daf0fb-58b4-4524-9ff2-868f5c611153 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:54.107213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-177cb57f-bd1f-4723-bde9-cb62b5dcd103 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:54.131167 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-177cb57f-bd1f-4723-bde9-cb62b5dcd103 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.132423 Oct 29 02:46:54.145397 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 247/485] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:53 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:54.219559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-79daf0fb-58b4-4524-9ff2-868f5c611153 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:54.229364 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-79daf0fb-58b4-4524-9ff2-868f5c611153 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.187298 Oct 29 02:46:54.230361 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 239/486] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:54 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:54.445087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-840363eb-032b-4366-8bfb-23a12f97c2ed tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:54.447237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-840363eb-032b-4366-8bfb-23a12f97c2ed tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:54.456912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-840363eb-032b-4366-8bfb-23a12f97c2ed tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:54.457868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-840363eb-032b-4366-8bfb-23a12f97c2ed tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:54.459181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-840363eb-032b-4366-8bfb-23a12f97c2ed tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:54.460204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-840363eb-032b-4366-8bfb-23a12f97c2ed tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:54.460976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-840363eb-032b-4366-8bfb-23a12f97c2ed tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:54.461761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-840363eb-032b-4366-8bfb-23a12f97c2ed tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:54.568263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1738194908", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:54.624045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-840363eb-032b-4366-8bfb-23a12f97c2ed tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:54.635571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:54.639064 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-840363eb-032b-4366-8bfb-23a12f97c2ed tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1366 microversion: 2.1 time: 0.203106 Oct 29 02:46:54.642927 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 240/487] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:54 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:54.876631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:54.877053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:54.877513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:54.877941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:54.878592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:54.887748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:54.888537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:54.888982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:54.889872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:54.890319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:54.890732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:54.907604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:54.911576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:54.923325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:54.926043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:54.977654 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fc13dcc1-80cf-4060-a38d-7c5cbc3c57e0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812548 Oct 29 02:46:54.978611 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 248/488] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:46:54.994692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-180c714f-08b0-4a40-9dab-8dbf45e5a1f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:54.997153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-180c714f-08b0-4a40-9dab-8dbf45e5a1f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:55.069354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-180c714f-08b0-4a40-9dab-8dbf45e5a1f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:55.080058 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-180c714f-08b0-4a40-9dab-8dbf45e5a1f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1217 microversion: 2.1 time: 0.093795 Oct 29 02:46:55.080891 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 241/489] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:54 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:55.159260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac5f67f2-9d61-4efb-89a0-cca4dd6ace89 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:55.160373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ac5f67f2-9d61-4efb-89a0-cca4dd6ace89 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:55.169709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f67f2-9d61-4efb-89a0-cca4dd6ace89 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:55.170454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f67f2-9d61-4efb-89a0-cca4dd6ace89 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:55.171098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f67f2-9d61-4efb-89a0-cca4dd6ace89 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:55.172598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f67f2-9d61-4efb-89a0-cca4dd6ace89 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:55.173440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f67f2-9d61-4efb-89a0-cca4dd6ace89 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:55.174119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f67f2-9d61-4efb-89a0-cca4dd6ace89 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:55.252358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:55.257558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:55.259884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:55.271488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:55.272015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:55.272479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:55.273185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:55.273633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:55.276234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:55.290196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-ac5f67f2-9d61-4efb-89a0-cca4dd6ace89 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:55.313337 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ac5f67f2-9d61-4efb-89a0-cca4dd6ace89 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.158095 Oct 29 02:46:55.314542 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 249/490] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:55 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:55.568568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:55.578205 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.328789 Oct 29 02:46:55.582115 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 242/491] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:55 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:55.664354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09411c73-2ad5-4552-801e-75bf049e45cf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:55.665015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-09411c73-2ad5-4552-801e-75bf049e45cf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:55.683391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09411c73-2ad5-4552-801e-75bf049e45cf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:55.683885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09411c73-2ad5-4552-801e-75bf049e45cf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:55.686421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09411c73-2ad5-4552-801e-75bf049e45cf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:55.691608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09411c73-2ad5-4552-801e-75bf049e45cf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:55.692187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09411c73-2ad5-4552-801e-75bf049e45cf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:55.692620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09411c73-2ad5-4552-801e-75bf049e45cf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:55.858654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:55.859878 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a04f8ff9-7bfd-4d38-ac65-7d2c75f2237e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001592 Oct 29 02:46:55.860461 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 243/492] 10.222.0.16 () {56 vars in 886 bytes} [Sat Oct 29 02:46:55 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 02:46:56.104806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2bb2d689-6e06-455d-a69a-a1e7adff0ee4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:56.106243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2bb2d689-6e06-455d-a69a-a1e7adff0ee4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:56.115836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bb2d689-6e06-455d-a69a-a1e7adff0ee4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.118078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bb2d689-6e06-455d-a69a-a1e7adff0ee4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.118907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bb2d689-6e06-455d-a69a-a1e7adff0ee4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.122182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bb2d689-6e06-455d-a69a-a1e7adff0ee4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.123362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bb2d689-6e06-455d-a69a-a1e7adff0ee4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.123947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bb2d689-6e06-455d-a69a-a1e7adff0ee4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.139836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-09411c73-2ad5-4552-801e-75bf049e45cf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:56.150942 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-09411c73-2ad5-4552-801e-75bf049e45cf tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1366 microversion: 2.1 time: 0.490944 Oct 29 02:46:56.152255 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 250/493] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:55 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:56.255168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2bb2d689-6e06-455d-a69a-a1e7adff0ee4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:56.264660 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2bb2d689-6e06-455d-a69a-a1e7adff0ee4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1269 microversion: 2.1 time: 0.164407 Oct 29 02:46:56.266181 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 244/494] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:56 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:56.347925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cae35271-07d5-431e-95b8-69757a43176c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:56.348650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cae35271-07d5-431e-95b8-69757a43176c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:56.361847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae35271-07d5-431e-95b8-69757a43176c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.362467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae35271-07d5-431e-95b8-69757a43176c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.363295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae35271-07d5-431e-95b8-69757a43176c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.365101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae35271-07d5-431e-95b8-69757a43176c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.367266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae35271-07d5-431e-95b8-69757a43176c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.369335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae35271-07d5-431e-95b8-69757a43176c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.504368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-cae35271-07d5-431e-95b8-69757a43176c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:56.526736 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cae35271-07d5-431e-95b8-69757a43176c tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.185443 Oct 29 02:46:56.528139 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 251/495] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:56 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:56.607762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9257fe85-b9d5-4694-bf2c-f4770b4363b4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:56.607762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9257fe85-b9d5-4694-bf2c-f4770b4363b4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:56.624800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9257fe85-b9d5-4694-bf2c-f4770b4363b4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.625330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9257fe85-b9d5-4694-bf2c-f4770b4363b4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.625767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9257fe85-b9d5-4694-bf2c-f4770b4363b4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.626511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9257fe85-b9d5-4694-bf2c-f4770b4363b4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.630181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9257fe85-b9d5-4694-bf2c-f4770b4363b4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.630619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9257fe85-b9d5-4694-bf2c-f4770b4363b4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.758486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-726996a0-6d03-4d90-a666-324cc6f7ba94 req-c1853ad8-fdd8-4521-ab92-1e3b0fbe471c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc4c73c4-725e-415c-a814-c828ec74c554", "name": "network-vif-plugged", "status": "completed", "tag": "e3e2ab26-126a-4fda-998d-3c38435343e3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:56.779754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:56.781773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-726996a0-6d03-4d90-a666-324cc6f7ba94 req-c1853ad8-fdd8-4521-ab92-1e3b0fbe471c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.783130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-726996a0-6d03-4d90-a666-324cc6f7ba94 req-c1853ad8-fdd8-4521-ab92-1e3b0fbe471c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.784464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-726996a0-6d03-4d90-a666-324cc6f7ba94 req-c1853ad8-fdd8-4521-ab92-1e3b0fbe471c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.805146 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-726996a0-6d03-4d90-a666-324cc6f7ba94 req-c1853ad8-fdd8-4521-ab92-1e3b0fbe471c service nova] Creating event network-vif-plugged:e3e2ab26-126a-4fda-998d-3c38435343e3 for instance bc4c73c4-725e-415c-a814-c828ec74c554 on n-h1-862964-4 Oct 29 02:46:56.824901 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-726996a0-6d03-4d90-a666-324cc6f7ba94 req-c1853ad8-fdd8-4521-ab92-1e3b0fbe471c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069909 Oct 29 02:46:56.827566 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 252/496] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:57.074004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9257fe85-b9d5-4694-bf2c-f4770b4363b4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:57.084999 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9257fe85-b9d5-4694-bf2c-f4770b4363b4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.483637 Oct 29 02:46:57.099403 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 245/497] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:56 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:57.199429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f1ba80d-43c9-4269-8de6-aaa96805d7df tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:57.200587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f1ba80d-43c9-4269-8de6-aaa96805d7df tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:57.211802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f1ba80d-43c9-4269-8de6-aaa96805d7df tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:57.215453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f1ba80d-43c9-4269-8de6-aaa96805d7df tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:57.215968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f1ba80d-43c9-4269-8de6-aaa96805d7df tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:57.219489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f1ba80d-43c9-4269-8de6-aaa96805d7df tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:57.220045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f1ba80d-43c9-4269-8de6-aaa96805d7df tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:57.221707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f1ba80d-43c9-4269-8de6-aaa96805d7df tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:57.288424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c0ac0810-5c75-4fa8-ab88-3fcc00c45713 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:57.289691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c0ac0810-5c75-4fa8-ab88-3fcc00c45713 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:57.297118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ac0810-5c75-4fa8-ab88-3fcc00c45713 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:57.297948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ac0810-5c75-4fa8-ab88-3fcc00c45713 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:57.298663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ac0810-5c75-4fa8-ab88-3fcc00c45713 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:57.299617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ac0810-5c75-4fa8-ab88-3fcc00c45713 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:57.300320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ac0810-5c75-4fa8-ab88-3fcc00c45713 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:57.300968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ac0810-5c75-4fa8-ab88-3fcc00c45713 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:57.443800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c0ac0810-5c75-4fa8-ab88-3fcc00c45713 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:57.465058 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c0ac0810-5c75-4fa8-ab88-3fcc00c45713 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1275 microversion: 2.1 time: 0.180363 Oct 29 02:46:57.465659 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 246/498] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:57 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1275 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:57.561040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-68d7d940-9f91-4154-8676-ebd5b6517982 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:57.562103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-68d7d940-9f91-4154-8676-ebd5b6517982 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:57.572385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d7d940-9f91-4154-8676-ebd5b6517982 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:57.574426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d7d940-9f91-4154-8676-ebd5b6517982 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:57.575069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d7d940-9f91-4154-8676-ebd5b6517982 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:57.577757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d7d940-9f91-4154-8676-ebd5b6517982 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:57.578465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d7d940-9f91-4154-8676-ebd5b6517982 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:57.578898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d7d940-9f91-4154-8676-ebd5b6517982 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:57.580412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f1ba80d-43c9-4269-8de6-aaa96805d7df tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:57.582793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:57.590431 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f1ba80d-43c9-4269-8de6-aaa96805d7df tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1366 microversion: 2.1 time: 0.409157 Oct 29 02:46:57.591676 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 253/499] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:57 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1366 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:57.798748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-68d7d940-9f91-4154-8676-ebd5b6517982 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:57.859836 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-68d7d940-9f91-4154-8676-ebd5b6517982 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.302255 Oct 29 02:46:57.865717 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 247/500] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:57 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:58.112064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a789ba2b-4996-4668-9550-72902adfdee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:58.112926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a789ba2b-4996-4668-9550-72902adfdee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:58.135396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a789ba2b-4996-4668-9550-72902adfdee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.136624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a789ba2b-4996-4668-9550-72902adfdee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.137991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a789ba2b-4996-4668-9550-72902adfdee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.139698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a789ba2b-4996-4668-9550-72902adfdee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.142859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a789ba2b-4996-4668-9550-72902adfdee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.145121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a789ba2b-4996-4668-9550-72902adfdee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.492898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5e3742eb-57c8-41d0-9eec-cdcb664eb12a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:58.493561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5e3742eb-57c8-41d0-9eec-cdcb664eb12a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:58.508724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3742eb-57c8-41d0-9eec-cdcb664eb12a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.509685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3742eb-57c8-41d0-9eec-cdcb664eb12a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.511746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3742eb-57c8-41d0-9eec-cdcb664eb12a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.514294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3742eb-57c8-41d0-9eec-cdcb664eb12a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.516668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3742eb-57c8-41d0-9eec-cdcb664eb12a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.517707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3742eb-57c8-41d0-9eec-cdcb664eb12a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.585647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a789ba2b-4996-4668-9550-72902adfdee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:58.595061 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a789ba2b-4996-4668-9550-72902adfdee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.488049 Oct 29 02:46:58.596775 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 254/501] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:58 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:58.627616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-408320a4-2011-4e69-80dd-6ddf7437051c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:58.631828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-408320a4-2011-4e69-80dd-6ddf7437051c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:58.642711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:58.649156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408320a4-2011-4e69-80dd-6ddf7437051c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.649709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408320a4-2011-4e69-80dd-6ddf7437051c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.650221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408320a4-2011-4e69-80dd-6ddf7437051c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.651184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408320a4-2011-4e69-80dd-6ddf7437051c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.651651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408320a4-2011-4e69-80dd-6ddf7437051c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.652431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408320a4-2011-4e69-80dd-6ddf7437051c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.684057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5e3742eb-57c8-41d0-9eec-cdcb664eb12a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:58.692714 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5e3742eb-57c8-41d0-9eec-cdcb664eb12a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1275 microversion: 2.1 time: 0.208132 Oct 29 02:46:58.698144 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 248/502] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:58 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:58.893929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5b603747-a285-44a6-b0bc-98c94a4ad4bb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:58.894318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-408320a4-2011-4e69-80dd-6ddf7437051c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:58.895154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5b603747-a285-44a6-b0bc-98c94a4ad4bb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:58.913104 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-408320a4-2011-4e69-80dd-6ddf7437051c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1557 microversion: 2.1 time: 0.295123 Oct 29 02:46:58.914398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b603747-a285-44a6-b0bc-98c94a4ad4bb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.915215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b603747-a285-44a6-b0bc-98c94a4ad4bb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.915850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b603747-a285-44a6-b0bc-98c94a4ad4bb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.916312 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 255/503] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:58 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1557 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:58.917400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b603747-a285-44a6-b0bc-98c94a4ad4bb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.918033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b603747-a285-44a6-b0bc-98c94a4ad4bb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.918607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b603747-a285-44a6-b0bc-98c94a4ad4bb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.941555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ffe7af75-664b-4b6b-89c9-3758d40a3038 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:58.942449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ffe7af75-664b-4b6b-89c9-3758d40a3038 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:58.955897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe7af75-664b-4b6b-89c9-3758d40a3038 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.959086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe7af75-664b-4b6b-89c9-3758d40a3038 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.960133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe7af75-664b-4b6b-89c9-3758d40a3038 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.962597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe7af75-664b-4b6b-89c9-3758d40a3038 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.963270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe7af75-664b-4b6b-89c9-3758d40a3038 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.966179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe7af75-664b-4b6b-89c9-3758d40a3038 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.176749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-5b603747-a285-44a6-b0bc-98c94a4ad4bb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:59.199659 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ffe7af75-664b-4b6b-89c9-3758d40a3038 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.262217 Oct 29 02:46:59.200463 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 256/504] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 02:46:58 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-interface => generated 285 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:59.250804 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5b603747-a285-44a6-b0bc-98c94a4ad4bb tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.360955 Oct 29 02:46:59.258627 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 249/505] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:58 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:59.621124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7115ee0-5331-4c8d-916f-c5fc09ea3ee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:59.622402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f7115ee0-5331-4c8d-916f-c5fc09ea3ee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:59.632719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7115ee0-5331-4c8d-916f-c5fc09ea3ee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:59.634535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7115ee0-5331-4c8d-916f-c5fc09ea3ee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:59.643408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7115ee0-5331-4c8d-916f-c5fc09ea3ee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.644446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7115ee0-5331-4c8d-916f-c5fc09ea3ee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:59.645203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7115ee0-5331-4c8d-916f-c5fc09ea3ee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:59.645976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7115ee0-5331-4c8d-916f-c5fc09ea3ee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.720187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ffb950c-efa1-4c37-8945-d8f2739de0ae tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:59.721454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ffb950c-efa1-4c37-8945-d8f2739de0ae tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:59.735954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ffb950c-efa1-4c37-8945-d8f2739de0ae tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:59.738858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ffb950c-efa1-4c37-8945-d8f2739de0ae tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:59.740008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ffb950c-efa1-4c37-8945-d8f2739de0ae tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.742121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ffb950c-efa1-4c37-8945-d8f2739de0ae tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:59.742588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ffb950c-efa1-4c37-8945-d8f2739de0ae tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:59.742995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ffb950c-efa1-4c37-8945-d8f2739de0ae tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.796702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:00.102108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f7115ee0-5331-4c8d-916f-c5fc09ea3ee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:00.125128 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f7115ee0-5331-4c8d-916f-c5fc09ea3ee7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.508476 Oct 29 02:47:00.128926 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 257/506] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:59 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:00.296297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ecc20287-c129-41c5-beb9-9ef79ee2df51 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:00.297317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ecc20287-c129-41c5-beb9-9ef79ee2df51 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:00.305442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ecc20287-c129-41c5-beb9-9ef79ee2df51 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:00.309729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ecc20287-c129-41c5-beb9-9ef79ee2df51 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:00.310429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ecc20287-c129-41c5-beb9-9ef79ee2df51 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:00.312739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ecc20287-c129-41c5-beb9-9ef79ee2df51 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:00.313599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ecc20287-c129-41c5-beb9-9ef79ee2df51 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:00.314434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ecc20287-c129-41c5-beb9-9ef79ee2df51 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:00.481620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-ecc20287-c129-41c5-beb9-9ef79ee2df51 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:00.517414 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ecc20287-c129-41c5-beb9-9ef79ee2df51 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.225948 Oct 29 02:47:00.520542 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 258/507] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:00 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:47:00.930010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ffb950c-efa1-4c37-8945-d8f2739de0ae tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:00.942102 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ffb950c-efa1-4c37-8945-d8f2739de0ae tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1317 microversion: 2.1 time: 1.227756 Oct 29 02:47:00.943041 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 250/508] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:59 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1317 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:01.150245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-31290ba0-86ab-4342-be7c-1d72a70d57db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:01.151696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-31290ba0-86ab-4342-be7c-1d72a70d57db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:01.160116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31290ba0-86ab-4342-be7c-1d72a70d57db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:01.160765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31290ba0-86ab-4342-be7c-1d72a70d57db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:01.161326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31290ba0-86ab-4342-be7c-1d72a70d57db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:01.162221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31290ba0-86ab-4342-be7c-1d72a70d57db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:01.162806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31290ba0-86ab-4342-be7c-1d72a70d57db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:01.163362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31290ba0-86ab-4342-be7c-1d72a70d57db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:01.567683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29befc3d-2755-4cc0-a9c4-b6bceda9af23 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:01.576353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29befc3d-2755-4cc0-a9c4-b6bceda9af23 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:01.591767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29befc3d-2755-4cc0-a9c4-b6bceda9af23 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:01.592651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29befc3d-2755-4cc0-a9c4-b6bceda9af23 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:01.593448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29befc3d-2755-4cc0-a9c4-b6bceda9af23 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:01.595154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29befc3d-2755-4cc0-a9c4-b6bceda9af23 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:01.596542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29befc3d-2755-4cc0-a9c4-b6bceda9af23 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:01.601541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29befc3d-2755-4cc0-a9c4-b6bceda9af23 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:01.650030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-31290ba0-86ab-4342-be7c-1d72a70d57db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:01.660603 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-31290ba0-86ab-4342-be7c-1d72a70d57db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.514170 Oct 29 02:47:01.666551 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 259/509] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:01 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:01.970364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b1e95d50-b6cc-4ac7-a642-f62e35bc0576 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:01.971216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b1e95d50-b6cc-4ac7-a642-f62e35bc0576 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:01.979414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1e95d50-b6cc-4ac7-a642-f62e35bc0576 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:01.982787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1e95d50-b6cc-4ac7-a642-f62e35bc0576 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:01.983223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1e95d50-b6cc-4ac7-a642-f62e35bc0576 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:01.983941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1e95d50-b6cc-4ac7-a642-f62e35bc0576 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:01.984380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1e95d50-b6cc-4ac7-a642-f62e35bc0576 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:01.986301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1e95d50-b6cc-4ac7-a642-f62e35bc0576 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:02.079219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-29befc3d-2755-4cc0-a9c4-b6bceda9af23 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:02.106804 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29befc3d-2755-4cc0-a9c4-b6bceda9af23 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.544592 Oct 29 02:47:02.108893 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 251/510] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:01 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:02.434014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b1e95d50-b6cc-4ac7-a642-f62e35bc0576 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:02.443775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b1e95d50-b6cc-4ac7-a642-f62e35bc0576 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1317 microversion: 2.1 time: 0.481624 Oct 29 02:47:02.446888 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 260/511] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:01 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:02.558785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e2780b6-b0a5-46fc-9055-88e556185aad tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Action: 'create', calling method: .version_select at 0x7fe1a8e67ca0>, body: {"keypair": {"name": "tempest-keypair-1938869958", "type": "ssh", "user_id": "678818d3f09148c48c835baa8f4ff918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMibXDwMRMGzyAV7zgSRuT2y17TAx4RvgDbOUf2FnVpWPoAVYpZVDxfxSesaVJMrSMlEcfa0FscK5YzXSceXIibkaF6qAcraSOEXav09Lx65osbbeXCUdYI16bXmSd4vkw=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:02.588445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-1e2780b6-b0a5-46fc-9055-88e556185aad tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Getting quotas for project 5b0161b448734affb39490e5343595d4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:02.597646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-1e2780b6-b0a5-46fc-9055-88e556185aad tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Getting quotas for user 6b5147ae175942b5a653bb84a1d9bcf0 and project 5b0161b448734affb39490e5343595d4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:02.633146 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1e2780b6-b0a5-46fc-9055-88e556185aad tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.238973 Oct 29 02:47:02.642152 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 252/512] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Oct 29 02:47:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 241 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:47:02.647256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a21b2c89-d8b3-42e6-bdb5-6f96db5595ab tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Action: 'create', calling method: .version_select at 0x7fe1a8e93790>, body: {"keypair": {"name": "tempest-keypair-891513678", "type": "ssh", "user_id": "678818d3f09148c48c835baa8f4ff918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU5eUtOXI6kkdEdcBiFVn7bmPwUsfstv/L48Px+92TlaBoWv6YgNI65SnnSTYk6DYch1av8skX+gTiOSej8dbE2oFwq7I5n73qRVJ/T05TVDlEjMJ+mRg8p/Mj9bGEQkA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:02.669870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a21b2c89-d8b3-42e6-bdb5-6f96db5595ab tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Getting quotas for project 5b0161b448734affb39490e5343595d4. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:02.675265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a21b2c89-d8b3-42e6-bdb5-6f96db5595ab tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Getting quotas for user 6b5147ae175942b5a653bb84a1d9bcf0 and project 5b0161b448734affb39490e5343595d4. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:02.690455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a029e98e-a697-4dad-9ab5-3a1f15266896 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:02.691052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a029e98e-a697-4dad-9ab5-3a1f15266896 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:02.701946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a029e98e-a697-4dad-9ab5-3a1f15266896 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:02.702433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a029e98e-a697-4dad-9ab5-3a1f15266896 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:02.702855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a029e98e-a697-4dad-9ab5-3a1f15266896 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:02.704945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a029e98e-a697-4dad-9ab5-3a1f15266896 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:02.708038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a029e98e-a697-4dad-9ab5-3a1f15266896 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:02.708706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a029e98e-a697-4dad-9ab5-3a1f15266896 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:02.725753 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a21b2c89-d8b3-42e6-bdb5-6f96db5595ab tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.081002 Oct 29 02:47:02.727121 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 261/513] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Oct 29 02:47:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:47:02.737858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d9e29af-78a2-4200-8357-b0d84573f6d1 tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Calling method '.version_select at 0x7fe1a8e93d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:02.751228 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d9e29af-78a2-4200-8357-b0d84573f6d1 tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1938869958?user_id=678818d3f09148c48c835baa8f4ff918" status: 200 len: 512 microversion: 2.10 time: 0.017179 Oct 29 02:47:02.752367 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 262/514] 10.222.0.16 () {60 vars in 1340 bytes} [Sat Oct 29 02:47:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1938869958?user_id=678818d3f09148c48c835baa8f4ff918 => generated 512 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:47:02.766798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c688ab49-69ad-488b-a7d7-fc5ba680bee9 tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Action: 'create', calling method: .version_select at 0x7fe1a9008ee0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-736407987", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzwCnjZoh8V6+JcCCT8RIBxz0YHdVYgyLZJVlKT1wKHoAhsxbi9JDcXjkbz2+4dPGjJbLfbtQMTJl7hRoE/UdRSUM1UytnzrezEWBniWnv+52rJvwhRzRxkrG63rXje6Q=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:02.789098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c688ab49-69ad-488b-a7d7-fc5ba680bee9 tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Getting quotas for project 5b0161b448734affb39490e5343595d4. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:02.793565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c688ab49-69ad-488b-a7d7-fc5ba680bee9 tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Getting quotas for user 6b5147ae175942b5a653bb84a1d9bcf0 and project 5b0161b448734affb39490e5343595d4. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:02.822012 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c688ab49-69ad-488b-a7d7-fc5ba680bee9 tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.059751 Oct 29 02:47:02.822872 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 263/515] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Oct 29 02:47:02 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 29 02:47:02.833457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce10c8a7-c54d-4d0e-b07b-09c6114c366e tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Calling method '.version_select at 0x7fe1a8e56e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:02.837862 n-d-862964-4 devstack@n-api.service[127042]: WARNING oslo_db.sqlalchemy.utils [None req-ce10c8a7-c54d-4d0e-b07b-09c6114c366e tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 02:47:02.845525 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ce10c8a7-c54d-4d0e-b07b-09c6114c366e tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=678818d3f09148c48c835baa8f4ff918" status: 200 len: 725 microversion: 2.10 time: 0.015686 Oct 29 02:47:02.846471 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 264/516] 10.222.0.16 () {60 vars in 1259 bytes} [Sat Oct 29 02:47:02 2022] GET /compute/v2.1/os-keypairs?user_id=678818d3f09148c48c835baa8f4ff918 => generated 725 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:47:02.864907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-30e3d8a4-9bb7-4d17-9f8e-aca8759ab35a tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Calling method '.version_select at 0x7fe1a9145d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:02.887944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-30e3d8a4-9bb7-4d17-9f8e-aca8759ab35a tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-736407987" status: 204 len: 0 microversion: 2.10 time: 0.034363 Oct 29 02:47:02.889098 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 265/517] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Oct 29 02:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-736407987 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:47:02.901038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ae03137-0122-4875-8208-361b378cff98 tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Calling method '.version_select at 0x7fe1a8e930d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:02.950272 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ae03137-0122-4875-8208-361b378cff98 tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-891513678?user_id=678818d3f09148c48c835baa8f4ff918" status: 204 len: 0 microversion: 2.10 time: 0.052876 Oct 29 02:47:02.950760 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 266/518] 10.222.0.16 () {60 vars in 1340 bytes} [Sat Oct 29 02:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-891513678?user_id=678818d3f09148c48c835baa8f4ff918 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:47:02.962180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7a37ccb4-cf00-4ef5-90a1-23739eda74f0 tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] Calling method '.version_select at 0x7fe1a8f9cca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:02.993657 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7a37ccb4-cf00-4ef5-90a1-23739eda74f0 tempest-KeyPairsV210TestJSON-1251073914 tempest-KeyPairsV210TestJSON-1251073914-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938869958?user_id=678818d3f09148c48c835baa8f4ff918" status: 204 len: 0 microversion: 2.10 time: 0.035992 Oct 29 02:47:02.996510 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 267/519] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 02:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938869958?user_id=678818d3f09148c48c835baa8f4ff918 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:47:03.071625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-002d7719-0302-4af5-b3c6-f91f0fc5774f req-183bf2f1-ba6b-4591-91c2-bee723957ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc4c73c4-725e-415c-a814-c828ec74c554", "tag": "e3e2ab26-126a-4fda-998d-3c38435343e3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:03.097271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a029e98e-a697-4dad-9ab5-3a1f15266896 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:03.103000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-002d7719-0302-4af5-b3c6-f91f0fc5774f req-183bf2f1-ba6b-4591-91c2-bee723957ee4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.106838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-002d7719-0302-4af5-b3c6-f91f0fc5774f req-183bf2f1-ba6b-4591-91c2-bee723957ee4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.107978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-002d7719-0302-4af5-b3c6-f91f0fc5774f req-183bf2f1-ba6b-4591-91c2-bee723957ee4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.110538 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a029e98e-a697-4dad-9ab5-3a1f15266896 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.423800 Oct 29 02:47:03.113699 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 253/520] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:02 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:03.145098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-497613fc-b3dc-4f1e-8977-aa94215f5f72 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:03.145960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-497613fc-b3dc-4f1e-8977-aa94215f5f72 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:03.167306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-497613fc-b3dc-4f1e-8977-aa94215f5f72 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.168001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-497613fc-b3dc-4f1e-8977-aa94215f5f72 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.168626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-497613fc-b3dc-4f1e-8977-aa94215f5f72 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.169917 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-002d7719-0302-4af5-b3c6-f91f0fc5774f req-183bf2f1-ba6b-4591-91c2-bee723957ee4 service nova] Creating event network-changed:e3e2ab26-126a-4fda-998d-3c38435343e3 for instance bc4c73c4-725e-415c-a814-c828ec74c554 on n-h1-862964-4 Oct 29 02:47:03.170448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-497613fc-b3dc-4f1e-8977-aa94215f5f72 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.171439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-497613fc-b3dc-4f1e-8977-aa94215f5f72 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.172369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-497613fc-b3dc-4f1e-8977-aa94215f5f72 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.176204 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-002d7719-0302-4af5-b3c6-f91f0fc5774f req-183bf2f1-ba6b-4591-91c2-bee723957ee4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113354 Oct 29 02:47:03.180280 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 268/521] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:47:03.418185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40b73ebe-fde5-4947-b78a-f29e0456a28c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:03.419037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40b73ebe-fde5-4947-b78a-f29e0456a28c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:03.426146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40b73ebe-fde5-4947-b78a-f29e0456a28c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.437707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40b73ebe-fde5-4947-b78a-f29e0456a28c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.440720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40b73ebe-fde5-4947-b78a-f29e0456a28c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.441677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40b73ebe-fde5-4947-b78a-f29e0456a28c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.442331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40b73ebe-fde5-4947-b78a-f29e0456a28c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.442751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40b73ebe-fde5-4947-b78a-f29e0456a28c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.472573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-497613fc-b3dc-4f1e-8977-aa94215f5f72 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:03.509631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40b73ebe-fde5-4947-b78a-f29e0456a28c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:47:03.517683 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-497613fc-b3dc-4f1e-8977-aa94215f5f72 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.380665 Oct 29 02:47:03.532873 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 254/522] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:03 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:03.538808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8c451f24-3c30-4799-85fe-44df8b33140b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:03.540365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8c451f24-3c30-4799-85fe-44df8b33140b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:03.553051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c451f24-3c30-4799-85fe-44df8b33140b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.556432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c451f24-3c30-4799-85fe-44df8b33140b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.557350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c451f24-3c30-4799-85fe-44df8b33140b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.558394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c451f24-3c30-4799-85fe-44df8b33140b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.559029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c451f24-3c30-4799-85fe-44df8b33140b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.559648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c451f24-3c30-4799-85fe-44df8b33140b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.684999 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40b73ebe-fde5-4947-b78a-f29e0456a28c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 204 len: 0 microversion: 2.1 time: 0.271155 Oct 29 02:47:03.686448 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 269/523] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:47:03 2022] DELETE /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:47:04.007619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1522664849", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "2007017018", "adminPass": "***", "networks": [{"uuid": "6ca57a7d-099c-4d87-959a-49f4a585deab"}], "security_groups": [{"name": "tempest-securitygroup--1762564065"}], "key_name": "tempest-keypair-1853074295", "user_data": "}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:04.201080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c451f24-3c30-4799-85fe-44df8b33140b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:04.222710 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8c451f24-3c30-4799-85fe-44df8b33140b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1317 microversion: 2.1 time: 0.693749 Oct 29 02:47:04.226455 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 255/524] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:03 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:04.238945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-43287505-b163-4f5b-96d0-03b5313ba8df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:04.240432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-43287505-b163-4f5b-96d0-03b5313ba8df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:04.257253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43287505-b163-4f5b-96d0-03b5313ba8df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:04.259133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43287505-b163-4f5b-96d0-03b5313ba8df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:04.261202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43287505-b163-4f5b-96d0-03b5313ba8df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:04.263328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43287505-b163-4f5b-96d0-03b5313ba8df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:04.264173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43287505-b163-4f5b-96d0-03b5313ba8df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:04.267293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43287505-b163-4f5b-96d0-03b5313ba8df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:04.278283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] validate_networks() for [('6ca57a7d-099c-4d87-959a-49f4a585deab', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:04.898755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:05.132261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-43287505-b163-4f5b-96d0-03b5313ba8df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:05.154360 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-43287505-b163-4f5b-96d0-03b5313ba8df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.924989 Oct 29 02:47:05.185229 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 256/525] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:04 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:05.209261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8fc4843b-8255-4fde-9539-214500d497f9 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:05.210000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8fc4843b-8255-4fde-9539-214500d497f9 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:05.219627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc4843b-8255-4fde-9539-214500d497f9 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.220851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc4843b-8255-4fde-9539-214500d497f9 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.221377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc4843b-8255-4fde-9539-214500d497f9 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.222887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc4843b-8255-4fde-9539-214500d497f9 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.233619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc4843b-8255-4fde-9539-214500d497f9 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.234387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc4843b-8255-4fde-9539-214500d497f9 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.350798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-8fc4843b-8255-4fde-9539-214500d497f9 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:05.404778 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8fc4843b-8255-4fde-9539-214500d497f9 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.214003 Oct 29 02:47:05.405385 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 257/526] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:05 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:05.422698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ff7d5084-3915-4418-94a1-dd2bfd27e282 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:05.423415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ff7d5084-3915-4418-94a1-dd2bfd27e282 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:05.433483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff7d5084-3915-4418-94a1-dd2bfd27e282 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.434056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff7d5084-3915-4418-94a1-dd2bfd27e282 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.434484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff7d5084-3915-4418-94a1-dd2bfd27e282 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.435933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff7d5084-3915-4418-94a1-dd2bfd27e282 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.436432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff7d5084-3915-4418-94a1-dd2bfd27e282 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.436944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff7d5084-3915-4418-94a1-dd2bfd27e282 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.774583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:05.774992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:05.775517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:05.775905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:05.776363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:05.789303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.793967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.794410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.795203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.795648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.796061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.837935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Getting quotas for project 013e7f18496749fb9525e0303e688964. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:05.844291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Getting quotas for user 1e835f57621f46719369731607bebb1f and project 013e7f18496749fb9525e0303e688964. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:05.893537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:05.897248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:05.969557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ff7d5084-3915-4418-94a1-dd2bfd27e282 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:05.981692 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ff7d5084-3915-4418-94a1-dd2bfd27e282 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1317 microversion: 2.1 time: 0.574385 Oct 29 02:47:06.002620 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 258/527] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:05 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1317 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:06.022040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3c50507c-87b9-48ad-b96f-dd453bf43b63 req-2de8f871-4d2d-44c8-83e4-b886c959de09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9", "tag": "70b52719-e140-4fae-8687-982ee5af6aad"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:06.037332 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3dd4ceb2-ab57-4635-9a3d-d60a6ffbbd25 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.035424 Oct 29 02:47:06.049015 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 270/528] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 02:47:06.054273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-54c1e15d-7585-48c9-ba43-c03622fd9391 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:06.056766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-54c1e15d-7585-48c9-ba43-c03622fd9391 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:06.065862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c50507c-87b9-48ad-b96f-dd453bf43b63 req-2de8f871-4d2d-44c8-83e4-b886c959de09 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.066359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c50507c-87b9-48ad-b96f-dd453bf43b63 req-2de8f871-4d2d-44c8-83e4-b886c959de09 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.070431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c50507c-87b9-48ad-b96f-dd453bf43b63 req-2de8f871-4d2d-44c8-83e4-b886c959de09 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.119518 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3c50507c-87b9-48ad-b96f-dd453bf43b63 req-2de8f871-4d2d-44c8-83e4-b886c959de09 service nova] Creating event network-changed:70b52719-e140-4fae-8687-982ee5af6aad for instance b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 on n-h2-862964-4 Oct 29 02:47:06.140747 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3c50507c-87b9-48ad-b96f-dd453bf43b63 req-2de8f871-4d2d-44c8-83e4-b886c959de09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131872 Oct 29 02:47:06.141768 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 259/529] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:06.187229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a6170b87-fe06-4216-acd0-687ad7797ae2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:06.188179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a6170b87-fe06-4216-acd0-687ad7797ae2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:06.191963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-54c1e15d-7585-48c9-ba43-c03622fd9391 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:06.200911 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-54c1e15d-7585-48c9-ba43-c03622fd9391 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1265 microversion: 2.1 time: 0.150374 Oct 29 02:47:06.217114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6170b87-fe06-4216-acd0-687ad7797ae2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.217114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6170b87-fe06-4216-acd0-687ad7797ae2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.217114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6170b87-fe06-4216-acd0-687ad7797ae2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.217114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6170b87-fe06-4216-acd0-687ad7797ae2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.217946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6170b87-fe06-4216-acd0-687ad7797ae2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.217946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6170b87-fe06-4216-acd0-687ad7797ae2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.221951 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 271/530] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:06 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:06.442239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aa7a4859-b141-4e4a-ad4c-360d550f14fa tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:06.444006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aa7a4859-b141-4e4a-ad4c-360d550f14fa tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:06.471201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa7a4859-b141-4e4a-ad4c-360d550f14fa tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.471777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa7a4859-b141-4e4a-ad4c-360d550f14fa tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.475111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa7a4859-b141-4e4a-ad4c-360d550f14fa tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.476639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa7a4859-b141-4e4a-ad4c-360d550f14fa tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.477361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa7a4859-b141-4e4a-ad4c-360d550f14fa tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.478520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa7a4859-b141-4e4a-ad4c-360d550f14fa tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.634455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a6170b87-fe06-4216-acd0-687ad7797ae2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:06.643807 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a6170b87-fe06-4216-acd0-687ad7797ae2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.462671 Oct 29 02:47:06.647602 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 260/531] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:06 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:06.690401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-aa7a4859-b141-4e4a-ad4c-360d550f14fa tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:06.732227 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aa7a4859-b141-4e4a-ad4c-360d550f14fa tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.300430 Oct 29 02:47:06.741839 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 272/532] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:06 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:07.007385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37e68331-39c0-4170-9827-28c039d5a831 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:07.008005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37e68331-39c0-4170-9827-28c039d5a831 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:07.020302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37e68331-39c0-4170-9827-28c039d5a831 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.020906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37e68331-39c0-4170-9827-28c039d5a831 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.021181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37e68331-39c0-4170-9827-28c039d5a831 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.023969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37e68331-39c0-4170-9827-28c039d5a831 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.026624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37e68331-39c0-4170-9827-28c039d5a831 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.027455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37e68331-39c0-4170-9827-28c039d5a831 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.224650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d73a3e60-3886-49b8-bcac-91ce6a02eaa8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:07.228412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d73a3e60-3886-49b8-bcac-91ce6a02eaa8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:07.242599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d73a3e60-3886-49b8-bcac-91ce6a02eaa8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.258460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d73a3e60-3886-49b8-bcac-91ce6a02eaa8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.259013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d73a3e60-3886-49b8-bcac-91ce6a02eaa8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.259999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d73a3e60-3886-49b8-bcac-91ce6a02eaa8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.260845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d73a3e60-3886-49b8-bcac-91ce6a02eaa8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.261423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d73a3e60-3886-49b8-bcac-91ce6a02eaa8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.423517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37e68331-39c0-4170-9827-28c039d5a831 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:07.434349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37e68331-39c0-4170-9827-28c039d5a831 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1317 microversion: 2.1 time: 0.431078 Oct 29 02:47:07.435883 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 261/533] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:07 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:07.477436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d73a3e60-3886-49b8-bcac-91ce6a02eaa8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:07.491144 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d73a3e60-3886-49b8-bcac-91ce6a02eaa8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1261 microversion: 2.1 time: 0.270338 Oct 29 02:47:07.497388 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 273/534] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:07 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1261 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:07.672654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-721b6b00-0d85-4ea8-bd1e-be5151fde115 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:07.678843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-721b6b00-0d85-4ea8-bd1e-be5151fde115 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:07.686397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-721b6b00-0d85-4ea8-bd1e-be5151fde115 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.687325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-721b6b00-0d85-4ea8-bd1e-be5151fde115 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.688184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-721b6b00-0d85-4ea8-bd1e-be5151fde115 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.689053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-721b6b00-0d85-4ea8-bd1e-be5151fde115 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.693067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-721b6b00-0d85-4ea8-bd1e-be5151fde115 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.693727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-721b6b00-0d85-4ea8-bd1e-be5151fde115 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.771889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-000dda85-44f8-489d-b2e1-985ab4792366 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:07.773075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-000dda85-44f8-489d-b2e1-985ab4792366 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:07.792412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-000dda85-44f8-489d-b2e1-985ab4792366 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.792912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-000dda85-44f8-489d-b2e1-985ab4792366 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.795583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-000dda85-44f8-489d-b2e1-985ab4792366 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.796479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-000dda85-44f8-489d-b2e1-985ab4792366 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.799495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-000dda85-44f8-489d-b2e1-985ab4792366 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.799975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-000dda85-44f8-489d-b2e1-985ab4792366 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.989638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-000dda85-44f8-489d-b2e1-985ab4792366 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:08.027095 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-000dda85-44f8-489d-b2e1-985ab4792366 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.265636 Oct 29 02:47:08.031813 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 274/535] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:07 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:08.459104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-364ec425-0de4-4dae-85a7-ac97eebcd1db tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:08.459889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-364ec425-0de4-4dae-85a7-ac97eebcd1db tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:08.472627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-364ec425-0de4-4dae-85a7-ac97eebcd1db tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:08.473290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-364ec425-0de4-4dae-85a7-ac97eebcd1db tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:08.474499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-364ec425-0de4-4dae-85a7-ac97eebcd1db tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:08.480380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-364ec425-0de4-4dae-85a7-ac97eebcd1db tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:08.480832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-364ec425-0de4-4dae-85a7-ac97eebcd1db tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:08.484805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-364ec425-0de4-4dae-85a7-ac97eebcd1db tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:08.705947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-721b6b00-0d85-4ea8-bd1e-be5151fde115 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:08.716770 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-721b6b00-0d85-4ea8-bd1e-be5151fde115 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 1.047975 Oct 29 02:47:08.719876 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 262/536] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:07 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:08.724705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8e8b7502-cf48-4834-b1d2-457da03fbf2a tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:08.732745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8e8b7502-cf48-4834-b1d2-457da03fbf2a tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:08.746743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e8b7502-cf48-4834-b1d2-457da03fbf2a tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:08.748100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e8b7502-cf48-4834-b1d2-457da03fbf2a tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:08.751356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e8b7502-cf48-4834-b1d2-457da03fbf2a tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:08.752430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e8b7502-cf48-4834-b1d2-457da03fbf2a tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:08.753051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e8b7502-cf48-4834-b1d2-457da03fbf2a tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:08.753641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e8b7502-cf48-4834-b1d2-457da03fbf2a tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:09.209673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e8b7502-cf48-4834-b1d2-457da03fbf2a tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:09.221515 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8e8b7502-cf48-4834-b1d2-457da03fbf2a tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1323 microversion: 2.1 time: 0.500311 Oct 29 02:47:09.231933 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 263/537] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:08 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1323 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:09.250079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4d5379e7-c313-45a1-a444-fa35c3763bd0 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:09.258213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4d5379e7-c313-45a1-a444-fa35c3763bd0 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:09.275382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d5379e7-c313-45a1-a444-fa35c3763bd0 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:09.279970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d5379e7-c313-45a1-a444-fa35c3763bd0 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:09.282695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d5379e7-c313-45a1-a444-fa35c3763bd0 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:09.284441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d5379e7-c313-45a1-a444-fa35c3763bd0 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:09.290479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d5379e7-c313-45a1-a444-fa35c3763bd0 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:09.291820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d5379e7-c313-45a1-a444-fa35c3763bd0 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:09.775932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-4d5379e7-c313-45a1-a444-fa35c3763bd0 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:09.829066 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4d5379e7-c313-45a1-a444-fa35c3763bd0 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.595590 Oct 29 02:47:09.829664 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 264/538] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:09 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:09.849680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ae514db-7845-412c-b120-282d096c7b62 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:09.850706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3ae514db-7845-412c-b120-282d096c7b62 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:09.857122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae514db-7845-412c-b120-282d096c7b62 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:09.861562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae514db-7845-412c-b120-282d096c7b62 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:09.862284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae514db-7845-412c-b120-282d096c7b62 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:09.863503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae514db-7845-412c-b120-282d096c7b62 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:09.865307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae514db-7845-412c-b120-282d096c7b62 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:09.866532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae514db-7845-412c-b120-282d096c7b62 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.048109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-364ec425-0de4-4dae-85a7-ac97eebcd1db tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:10.061850 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-364ec425-0de4-4dae-85a7-ac97eebcd1db tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1317 microversion: 2.1 time: 1.603019 Oct 29 02:47:10.063775 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 275/539] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:08 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1317 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:10.262327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9a815afe-41f9-4e68-b211-3d35e7567709 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:10.263737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a815afe-41f9-4e68-b211-3d35e7567709 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:10.275562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a815afe-41f9-4e68-b211-3d35e7567709 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.276565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a815afe-41f9-4e68-b211-3d35e7567709 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.280872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a815afe-41f9-4e68-b211-3d35e7567709 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.293236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a815afe-41f9-4e68-b211-3d35e7567709 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.294687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a815afe-41f9-4e68-b211-3d35e7567709 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.298367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a815afe-41f9-4e68-b211-3d35e7567709 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.309211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3ae514db-7845-412c-b120-282d096c7b62 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:10.319580 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3ae514db-7845-412c-b120-282d096c7b62 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.488296 Oct 29 02:47:10.323518 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 265/540] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:09 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:10.524853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4f4e978a-fc71-4aba-96f0-1fd2fe9fc94c req-0ccce0af-2e6d-41e7-8808-1a437295463d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e905f88b-7b01-4091-946f-fa0e0abdab0d", "name": "network-vif-deleted", "tag": "363f1891-2fd3-41b7-8910-0ec693798817"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:10.543915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4f4e978a-fc71-4aba-96f0-1fd2fe9fc94c req-0ccce0af-2e6d-41e7-8808-1a437295463d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.553830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4f4e978a-fc71-4aba-96f0-1fd2fe9fc94c req-0ccce0af-2e6d-41e7-8808-1a437295463d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.554580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4f4e978a-fc71-4aba-96f0-1fd2fe9fc94c req-0ccce0af-2e6d-41e7-8808-1a437295463d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.577391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9a815afe-41f9-4e68-b211-3d35e7567709 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:10.584925 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4f4e978a-fc71-4aba-96f0-1fd2fe9fc94c req-0ccce0af-2e6d-41e7-8808-1a437295463d service nova] Creating event network-vif-deleted:363f1891-2fd3-41b7-8910-0ec693798817 for instance e905f88b-7b01-4091-946f-fa0e0abdab0d on n-h2-862964-4 Oct 29 02:47:10.587773 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9a815afe-41f9-4e68-b211-3d35e7567709 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1323 microversion: 2.1 time: 0.330393 Oct 29 02:47:10.593451 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4f4e978a-fc71-4aba-96f0-1fd2fe9fc94c req-0ccce0af-2e6d-41e7-8808-1a437295463d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072893 Oct 29 02:47:10.594901 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 266/541] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:47:10.612859 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 276/542] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:10 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:10.865115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e41f83c-0b2d-49b3-a52d-fd43ea2428b6 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:10.866779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e41f83c-0b2d-49b3-a52d-fd43ea2428b6 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:10.888926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e41f83c-0b2d-49b3-a52d-fd43ea2428b6 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.889417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e41f83c-0b2d-49b3-a52d-fd43ea2428b6 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.889861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e41f83c-0b2d-49b3-a52d-fd43ea2428b6 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.890578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e41f83c-0b2d-49b3-a52d-fd43ea2428b6 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.891036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e41f83c-0b2d-49b3-a52d-fd43ea2428b6 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.901216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e41f83c-0b2d-49b3-a52d-fd43ea2428b6 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.087646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-80fbbbfc-62c0-476a-aa6d-4c7798133e00 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:11.090098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-80fbbbfc-62c0-476a-aa6d-4c7798133e00 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:11.099444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:11.106702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fbbbfc-62c0-476a-aa6d-4c7798133e00 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.107431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fbbbfc-62c0-476a-aa6d-4c7798133e00 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.108014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fbbbfc-62c0-476a-aa6d-4c7798133e00 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.109557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fbbbfc-62c0-476a-aa6d-4c7798133e00 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.111601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fbbbfc-62c0-476a-aa6d-4c7798133e00 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.113773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fbbbfc-62c0-476a-aa6d-4c7798133e00 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.122521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-2e41f83c-0b2d-49b3-a52d-fd43ea2428b6 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:11.133143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:11.153033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:11.170161 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e41f83c-0b2d-49b3-a52d-fd43ea2428b6 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1927 microversion: 2.75 time: 0.309759 Oct 29 02:47:11.174048 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 267/543] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:10 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1927 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:11.350898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-573cecc8-7e34-47b2-85e7-4a84a1e2310b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:11.351874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-573cecc8-7e34-47b2-85e7-4a84a1e2310b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:11.367339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573cecc8-7e34-47b2-85e7-4a84a1e2310b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.370698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573cecc8-7e34-47b2-85e7-4a84a1e2310b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.371966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573cecc8-7e34-47b2-85e7-4a84a1e2310b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.374543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573cecc8-7e34-47b2-85e7-4a84a1e2310b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.376987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573cecc8-7e34-47b2-85e7-4a84a1e2310b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.391655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573cecc8-7e34-47b2-85e7-4a84a1e2310b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.802101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-573cecc8-7e34-47b2-85e7-4a84a1e2310b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:11.832520 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-573cecc8-7e34-47b2-85e7-4a84a1e2310b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.477419 Oct 29 02:47:11.833705 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 268/544] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:11 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:11.859250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-12085b68-de8f-462e-a6ff-a13959e1512f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:11.861824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-12085b68-de8f-462e-a6ff-a13959e1512f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:11.892628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12085b68-de8f-462e-a6ff-a13959e1512f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.893240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12085b68-de8f-462e-a6ff-a13959e1512f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.893575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12085b68-de8f-462e-a6ff-a13959e1512f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.902092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12085b68-de8f-462e-a6ff-a13959e1512f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.902767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12085b68-de8f-462e-a6ff-a13959e1512f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.903218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12085b68-de8f-462e-a6ff-a13959e1512f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.963713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-80fbbbfc-62c0-476a-aa6d-4c7798133e00 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:11.979386 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-80fbbbfc-62c0-476a-aa6d-4c7798133e00 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1317 microversion: 2.1 time: 0.894621 Oct 29 02:47:11.987473 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 277/545] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:11 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1317 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:12.090774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-12085b68-de8f-462e-a6ff-a13959e1512f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:12.105567 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-12085b68-de8f-462e-a6ff-a13959e1512f tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1323 microversion: 2.1 time: 0.269173 Oct 29 02:47:12.106301 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 269/546] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:11 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1323 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:12.207635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d6cb2ebb-a350-4b86-9009-c3d210a3da42 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:12.208304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d6cb2ebb-a350-4b86-9009-c3d210a3da42 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:12.218284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6cb2ebb-a350-4b86-9009-c3d210a3da42 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.221049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6cb2ebb-a350-4b86-9009-c3d210a3da42 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.221767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6cb2ebb-a350-4b86-9009-c3d210a3da42 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:12.223065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6cb2ebb-a350-4b86-9009-c3d210a3da42 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.226106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6cb2ebb-a350-4b86-9009-c3d210a3da42 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.226838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6cb2ebb-a350-4b86-9009-c3d210a3da42 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:12.524504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-d6cb2ebb-a350-4b86-9009-c3d210a3da42 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:12.565845 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d6cb2ebb-a350-4b86-9009-c3d210a3da42 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1933 microversion: 2.75 time: 0.362509 Oct 29 02:47:12.574359 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 278/547] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:12 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1933 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:12.862564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d8770d19-5e01-4d48-a267-e3ffabd134cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:12.863385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d8770d19-5e01-4d48-a267-e3ffabd134cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:12.865975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=16 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:12.879603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8770d19-5e01-4d48-a267-e3ffabd134cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.880092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8770d19-5e01-4d48-a267-e3ffabd134cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.880517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8770d19-5e01-4d48-a267-e3ffabd134cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:12.881222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8770d19-5e01-4d48-a267-e3ffabd134cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.881664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8770d19-5e01-4d48-a267-e3ffabd134cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.882102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8770d19-5e01-4d48-a267-e3ffabd134cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:13.017702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-80371968-bcda-4631-940b-0f9ee6eebf2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:13.018737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-80371968-bcda-4631-940b-0f9ee6eebf2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:13.047136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80371968-bcda-4631-940b-0f9ee6eebf2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:13.048468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80371968-bcda-4631-940b-0f9ee6eebf2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:13.050888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80371968-bcda-4631-940b-0f9ee6eebf2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:13.052012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80371968-bcda-4631-940b-0f9ee6eebf2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:13.053989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80371968-bcda-4631-940b-0f9ee6eebf2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:13.055204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80371968-bcda-4631-940b-0f9ee6eebf2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:13.180801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d8770d19-5e01-4d48-a267-e3ffabd134cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:13.206040 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d8770d19-5e01-4d48-a267-e3ffabd134cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.348007 Oct 29 02:47:13.213326 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 270/548] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:12 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:13.220727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-592b63ea-1718-4008-bf52-08d67dac2457 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:13.237609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-592b63ea-1718-4008-bf52-08d67dac2457 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:13.246604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-592b63ea-1718-4008-bf52-08d67dac2457 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:13.247562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-592b63ea-1718-4008-bf52-08d67dac2457 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:13.248497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-592b63ea-1718-4008-bf52-08d67dac2457 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:13.249492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-592b63ea-1718-4008-bf52-08d67dac2457 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:13.250205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-592b63ea-1718-4008-bf52-08d67dac2457 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:13.250844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-592b63ea-1718-4008-bf52-08d67dac2457 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:13.508257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-592b63ea-1718-4008-bf52-08d67dac2457 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:13.520435 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-592b63ea-1718-4008-bf52-08d67dac2457 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1391 microversion: 2.1 time: 0.304742 Oct 29 02:47:13.521896 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 271/549] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:13 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1391 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:13.612726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-edd1fb52-4e5b-4950-9f52-73e828fa429a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:13.614727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-edd1fb52-4e5b-4950-9f52-73e828fa429a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:13.623419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-edd1fb52-4e5b-4950-9f52-73e828fa429a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:13.642887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-edd1fb52-4e5b-4950-9f52-73e828fa429a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:13.644714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-edd1fb52-4e5b-4950-9f52-73e828fa429a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:13.648743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-edd1fb52-4e5b-4950-9f52-73e828fa429a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:13.649413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-edd1fb52-4e5b-4950-9f52-73e828fa429a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:13.651272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-edd1fb52-4e5b-4950-9f52-73e828fa429a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:13.975788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-80371968-bcda-4631-940b-0f9ee6eebf2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:13.988211 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-80371968-bcda-4631-940b-0f9ee6eebf2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1317 microversion: 2.1 time: 0.976352 Oct 29 02:47:13.997895 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 279/550] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:13 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1317 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:14.239068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa4a5f9e-1540-40c2-b8fa-306b706c1c2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:14.239957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fa4a5f9e-1540-40c2-b8fa-306b706c1c2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:14.254177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4a5f9e-1540-40c2-b8fa-306b706c1c2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.254765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4a5f9e-1540-40c2-b8fa-306b706c1c2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.256415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4a5f9e-1540-40c2-b8fa-306b706c1c2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.260732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4a5f9e-1540-40c2-b8fa-306b706c1c2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.266284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4a5f9e-1540-40c2-b8fa-306b706c1c2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.271650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4a5f9e-1540-40c2-b8fa-306b706c1c2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.443636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-edd1fb52-4e5b-4950-9f52-73e828fa429a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:14.473220 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-edd1fb52-4e5b-4950-9f52-73e828fa429a tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1933 microversion: 2.75 time: 0.867195 Oct 29 02:47:14.474762 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 272/551] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:13 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1933 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:14.544859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8ceb1ff0-a80d-4214-b760-0f4ff72a2bb8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:14.545820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8ceb1ff0-a80d-4214-b760-0f4ff72a2bb8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:14.561252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ceb1ff0-a80d-4214-b760-0f4ff72a2bb8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.561706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ceb1ff0-a80d-4214-b760-0f4ff72a2bb8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.562455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ceb1ff0-a80d-4214-b760-0f4ff72a2bb8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.563188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ceb1ff0-a80d-4214-b760-0f4ff72a2bb8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.563636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ceb1ff0-a80d-4214-b760-0f4ff72a2bb8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.569723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ceb1ff0-a80d-4214-b760-0f4ff72a2bb8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.990968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fa4a5f9e-1540-40c2-b8fa-306b706c1c2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:15.003588 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fa4a5f9e-1540-40c2-b8fa-306b706c1c2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.768503 Oct 29 02:47:15.010041 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 280/552] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:14 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:15.038763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ff95d570-563b-4191-a5b0-3488a9b31422 req-b734f1cc-4320-450e-9612-f60af9a4b729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9", "name": "network-vif-plugged", "status": "completed", "tag": "70b52719-e140-4fae-8687-982ee5af6aad"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:15.066337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ff95d570-563b-4191-a5b0-3488a9b31422 req-b734f1cc-4320-450e-9612-f60af9a4b729 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.069995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ff95d570-563b-4191-a5b0-3488a9b31422 req-b734f1cc-4320-450e-9612-f60af9a4b729 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.071177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ff95d570-563b-4191-a5b0-3488a9b31422 req-b734f1cc-4320-450e-9612-f60af9a4b729 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.106401 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ff95d570-563b-4191-a5b0-3488a9b31422 req-b734f1cc-4320-450e-9612-f60af9a4b729 service nova] Creating event network-vif-plugged:70b52719-e140-4fae-8687-982ee5af6aad for instance b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 on n-h2-862964-4 Oct 29 02:47:15.122629 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ff95d570-563b-4191-a5b0-3488a9b31422 req-b734f1cc-4320-450e-9612-f60af9a4b729 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109092 Oct 29 02:47:15.126303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 281/553] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:15.138228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40df08bf-1bbe-490b-ba71-b90651f362f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:15.140268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40df08bf-1bbe-490b-ba71-b90651f362f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:15.158181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40df08bf-1bbe-490b-ba71-b90651f362f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.158698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40df08bf-1bbe-490b-ba71-b90651f362f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.161865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40df08bf-1bbe-490b-ba71-b90651f362f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.163912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40df08bf-1bbe-490b-ba71-b90651f362f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.164540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40df08bf-1bbe-490b-ba71-b90651f362f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.166545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40df08bf-1bbe-490b-ba71-b90651f362f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.358789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8ceb1ff0-a80d-4214-b760-0f4ff72a2bb8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:15.372291 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8ceb1ff0-a80d-4214-b760-0f4ff72a2bb8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1391 microversion: 2.1 time: 0.831332 Oct 29 02:47:15.372936 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 273/554] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:14 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1391 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:15.506639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-09340085-9820-4512-ab0e-82304a7460a7 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:15.507380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-09340085-9820-4512-ab0e-82304a7460a7 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:15.520834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09340085-9820-4512-ab0e-82304a7460a7 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.521604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09340085-9820-4512-ab0e-82304a7460a7 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.522152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09340085-9820-4512-ab0e-82304a7460a7 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.522959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09340085-9820-4512-ab0e-82304a7460a7 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.523539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09340085-9820-4512-ab0e-82304a7460a7 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.524114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09340085-9820-4512-ab0e-82304a7460a7 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.816412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:15.849683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-09340085-9820-4512-ab0e-82304a7460a7 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] Lazy-loading 'services' on Instance uuid db796bca-21a7-421a-a6fb-bc1bee6f51ea {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:15.900201 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-09340085-9820-4512-ab0e-82304a7460a7 tempest-ServersAdmin275Test-1232741602 tempest-ServersAdmin275Test-1232741602-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1918 microversion: 2.75 time: 0.398015 Oct 29 02:47:15.901150 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 274/555] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:15 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1918 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:47:15.941061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37ed8d84-61a7-4b0f-8477-195255280df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:15.941956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37ed8d84-61a7-4b0f-8477-195255280df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:15.949564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ed8d84-61a7-4b0f-8477-195255280df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.952789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ed8d84-61a7-4b0f-8477-195255280df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.954354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ed8d84-61a7-4b0f-8477-195255280df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.955256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ed8d84-61a7-4b0f-8477-195255280df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.957330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ed8d84-61a7-4b0f-8477-195255280df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.957961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ed8d84-61a7-4b0f-8477-195255280df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.001482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37ed8d84-61a7-4b0f-8477-195255280df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:47:16.199550 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37ed8d84-61a7-4b0f-8477-195255280df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 204 len: 0 microversion: 2.75 time: 0.264110 Oct 29 02:47:16.204485 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 275/556] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:47:15 2022] DELETE /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:47:16.204682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=32 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:16.211658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d459fd19-6bed-42f3-a5e2-606930ebf8c0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:16.212366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d459fd19-6bed-42f3-a5e2-606930ebf8c0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:16.214699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:16.232145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d459fd19-6bed-42f3-a5e2-606930ebf8c0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.232526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d459fd19-6bed-42f3-a5e2-606930ebf8c0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.232956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d459fd19-6bed-42f3-a5e2-606930ebf8c0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.234236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d459fd19-6bed-42f3-a5e2-606930ebf8c0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.234701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d459fd19-6bed-42f3-a5e2-606930ebf8c0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.235123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d459fd19-6bed-42f3-a5e2-606930ebf8c0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.311471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40df08bf-1bbe-490b-ba71-b90651f362f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.320434 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40df08bf-1bbe-490b-ba71-b90651f362f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1317 microversion: 2.1 time: 1.192722 Oct 29 02:47:16.339203 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 282/557] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:15 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1317 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:16.350922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:16.351673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:16.363199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.364059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.365769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.366896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.367691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.368306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.533844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d459fd19-6bed-42f3-a5e2-606930ebf8c0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.537641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.544740 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d459fd19-6bed-42f3-a5e2-606930ebf8c0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.342975 Oct 29 02:47:16.545342 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 276/558] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:16 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:16.558914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0a52bc38-576b-4d8a-91ba-e3168d1a3796 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:16.570041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.571632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.574129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0a52bc38-576b-4d8a-91ba-e3168d1a3796 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:16.588224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a52bc38-576b-4d8a-91ba-e3168d1a3796 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.588944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a52bc38-576b-4d8a-91ba-e3168d1a3796 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.589535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a52bc38-576b-4d8a-91ba-e3168d1a3796 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.590525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a52bc38-576b-4d8a-91ba-e3168d1a3796 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.591749 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-76b05c0f-5ede-4869-ba8f-9cc20b774df2 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1443 microversion: 2.75 time: 0.246648 Oct 29 02:47:16.592160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a52bc38-576b-4d8a-91ba-e3168d1a3796 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.592742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a52bc38-576b-4d8a-91ba-e3168d1a3796 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.595643 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 283/559] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:16 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1443 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:16.608684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d7d58281-fad9-41ac-aed8-62d272076c55 req-6dc6c1a5-11a0-4b70-8b23-2c85bd0af65e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209b0e5a-13ee-4803-94fc-e9d05298ae49", "tag": "9db2669a-4596-46d6-ae92-4b31a0a6fdfd"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:16.664427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7d58281-fad9-41ac-aed8-62d272076c55 req-6dc6c1a5-11a0-4b70-8b23-2c85bd0af65e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.672867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7d58281-fad9-41ac-aed8-62d272076c55 req-6dc6c1a5-11a0-4b70-8b23-2c85bd0af65e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.673373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7d58281-fad9-41ac-aed8-62d272076c55 req-6dc6c1a5-11a0-4b70-8b23-2c85bd0af65e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.713813 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d7d58281-fad9-41ac-aed8-62d272076c55 req-6dc6c1a5-11a0-4b70-8b23-2c85bd0af65e service nova] Creating event network-changed:9db2669a-4596-46d6-ae92-4b31a0a6fdfd for instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 on n-h1-862964-4 Oct 29 02:47:16.721460 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d7d58281-fad9-41ac-aed8-62d272076c55 req-6dc6c1a5-11a0-4b70-8b23-2c85bd0af65e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124349 Oct 29 02:47:16.722484 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 284/560] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:16.984955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0a52bc38-576b-4d8a-91ba-e3168d1a3796 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:17.001740 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0a52bc38-576b-4d8a-91ba-e3168d1a3796 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1391 microversion: 2.1 time: 0.455213 Oct 29 02:47:17.003670 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 277/561] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:16 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1391 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:17.352631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f92b24d-65a5-4130-80c5-e90f00179211 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:17.353572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5f92b24d-65a5-4130-80c5-e90f00179211 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:17.375209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f92b24d-65a5-4130-80c5-e90f00179211 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.380415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f92b24d-65a5-4130-80c5-e90f00179211 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.381099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f92b24d-65a5-4130-80c5-e90f00179211 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:17.382034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f92b24d-65a5-4130-80c5-e90f00179211 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.382489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f92b24d-65a5-4130-80c5-e90f00179211 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.382905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f92b24d-65a5-4130-80c5-e90f00179211 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:17.574666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c8b0c55-d46d-4a11-924a-9fbcde8d9f92 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:17.575270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c8b0c55-d46d-4a11-924a-9fbcde8d9f92 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:17.586552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c8b0c55-d46d-4a11-924a-9fbcde8d9f92 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.587307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c8b0c55-d46d-4a11-924a-9fbcde8d9f92 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.588172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c8b0c55-d46d-4a11-924a-9fbcde8d9f92 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:17.596785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c8b0c55-d46d-4a11-924a-9fbcde8d9f92 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.599192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c8b0c55-d46d-4a11-924a-9fbcde8d9f92 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.599816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c8b0c55-d46d-4a11-924a-9fbcde8d9f92 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.040366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5c8b0c55-d46d-4a11-924a-9fbcde8d9f92 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:18.051921 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c8b0c55-d46d-4a11-924a-9fbcde8d9f92 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 0.482094 Oct 29 02:47:18.054155 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 278/562] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:17 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:18.060356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:18.060952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:18.087598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.088176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.088618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.089356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.090585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.091006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.214550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5f92b24d-65a5-4130-80c5-e90f00179211 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:18.226777 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f92b24d-65a5-4130-80c5-e90f00179211 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1467 microversion: 2.1 time: 0.878612 Oct 29 02:47:18.230170 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 285/563] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:17 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1467 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:18.241776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98255505-b662-4c31-a245-e445886a2af6 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:18.242758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-98255505-b662-4c31-a245-e445886a2af6 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:18.256464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:18.256657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98255505-b662-4c31-a245-e445886a2af6 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.258145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98255505-b662-4c31-a245-e445886a2af6 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.260405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98255505-b662-4c31-a245-e445886a2af6 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.261188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98255505-b662-4c31-a245-e445886a2af6 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.261644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98255505-b662-4c31-a245-e445886a2af6 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.262094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98255505-b662-4c31-a245-e445886a2af6 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.275955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:18.280780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:18.287796 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b689003b-b950-4463-bf0c-becac019393e tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1443 microversion: 2.75 time: 0.232546 Oct 29 02:47:18.288694 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 279/564] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:18 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1443 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:18.714283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-736c8ddd-3db1-4a56-83ac-6937ead5e81d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:18.714986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-736c8ddd-3db1-4a56-83ac-6937ead5e81d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:18.725595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736c8ddd-3db1-4a56-83ac-6937ead5e81d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.726130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736c8ddd-3db1-4a56-83ac-6937ead5e81d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.726548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736c8ddd-3db1-4a56-83ac-6937ead5e81d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.727254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736c8ddd-3db1-4a56-83ac-6937ead5e81d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.727692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736c8ddd-3db1-4a56-83ac-6937ead5e81d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.728163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736c8ddd-3db1-4a56-83ac-6937ead5e81d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.301500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-98255505-b662-4c31-a245-e445886a2af6 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:19.336239 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-98255505-b662-4c31-a245-e445886a2af6 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1391 microversion: 2.1 time: 1.104233 Oct 29 02:47:19.340471 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 286/565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:18 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1391 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:19.362917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c8ce5b0-35dd-4222-aa78-42e590c20766 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:19.363795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c8ce5b0-35dd-4222-aa78-42e590c20766 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:19.374679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c8ce5b0-35dd-4222-aa78-42e590c20766 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.375469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c8ce5b0-35dd-4222-aa78-42e590c20766 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.377996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c8ce5b0-35dd-4222-aa78-42e590c20766 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.379323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c8ce5b0-35dd-4222-aa78-42e590c20766 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.380152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c8ce5b0-35dd-4222-aa78-42e590c20766 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.380733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c8ce5b0-35dd-4222-aa78-42e590c20766 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.402732 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-736c8ddd-3db1-4a56-83ac-6937ead5e81d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1618 microversion: 2.1 time: 1.112727 Oct 29 02:47:19.406523 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 280/566] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:18 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1618 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:19.421587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:19.422538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:19.429284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.433966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.434562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.435288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.435734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.436147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.538215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:19.565366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:19.566813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a3d655324ed4f23909beda9ceff0123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0ee86db58d4231a356e54307ccf6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:19.573108 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9cb752d-ab99-4dc0-8460-4f5802ce3235 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 200 len: 1443 microversion: 2.75 time: 0.165297 Oct 29 02:47:19.574754 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 281/567] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:19 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:19.580580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-07fc591f-523d-4bc6-8b8c-4f72fbf7e1c3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Action: 'create', calling method: .version_select at 0x7fe1a8c9cb80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1291921600", "policies": ["affinity"]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:19.624950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-07fc591f-523d-4bc6-8b8c-4f72fbf7e1c3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:19.635253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-07fc591f-523d-4bc6-8b8c-4f72fbf7e1c3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:19.738945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-07fc591f-523d-4bc6-8b8c-4f72fbf7e1c3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:19.750373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-07fc591f-523d-4bc6-8b8c-4f72fbf7e1c3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:19.780419 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-07fc591f-523d-4bc6-8b8c-4f72fbf7e1c3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.203799 Oct 29 02:47:19.780922 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 282/568] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Oct 29 02:47:19 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:20.045680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-551810687", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "493015c5-e33b-49ac-b057-228eb0d71581"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:20.157340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:20.419155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c8ce5b0-35dd-4222-aa78-42e590c20766 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:20.433162 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c8ce5b0-35dd-4222-aa78-42e590c20766 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1477 microversion: 2.1 time: 1.091188 Oct 29 02:47:20.434077 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 287/569] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:19 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1477 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:20.450574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da1db8a8-7931-488a-acff-221b6b4d8dc4 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:20.451429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-da1db8a8-7931-488a-acff-221b6b4d8dc4 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:20.461630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1db8a8-7931-488a-acff-221b6b4d8dc4 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:20.462182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1db8a8-7931-488a-acff-221b6b4d8dc4 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:20.462714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1db8a8-7931-488a-acff-221b6b4d8dc4 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:20.463500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1db8a8-7931-488a-acff-221b6b4d8dc4 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:20.464016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1db8a8-7931-488a-acff-221b6b4d8dc4 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:20.464373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1db8a8-7931-488a-acff-221b6b4d8dc4 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:20.602279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:20.602691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:20.604493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:20.604493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:20.604637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:20.682126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:20.684024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:20.685788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:20.687994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:20.688708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:20.692276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:20.716183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:20.743841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:20.751521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:20.769497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Going to run 2 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:20.774494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:20.824989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127041) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 29 02:47:20.853879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:20.859909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:20.982125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:20.994655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:21.027409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=283e7c95-2e30-4537-9163-3b933b0bc381,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:21.133057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:21.145234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:21.173120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:21.243427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:21.249127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:21.301746 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3b82df38-59b3-4d0f-947d-7b408965a726 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.261895 Oct 29 02:47:21.304879 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 283/570] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 1265 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:47:21.327715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:21.328665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] [instance: db796bca-21a7-421a-a6fb-bc1bee6f51ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:21.478578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-da1db8a8-7931-488a-acff-221b6b4d8dc4 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:21.496746 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-da1db8a8-7931-488a-acff-221b6b4d8dc4 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1391 microversion: 2.1 time: 1.059393 Oct 29 02:47:21.500696 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 288/571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:20 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1391 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:21.510916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-62cf27a8-e2ff-4a4d-afce-107dcf6fa32e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:21.527655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-62cf27a8-e2ff-4a4d-afce-107dcf6fa32e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:21.540037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-62cf27a8-e2ff-4a4d-afce-107dcf6fa32e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Searching by: {'deleted': False, 'project_id': '1031cc111cc747098bbc8a428c1cfad6'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:47:21.588300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf27a8-e2ff-4a4d-afce-107dcf6fa32e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:21.588957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf27a8-e2ff-4a4d-afce-107dcf6fa32e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:21.589400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf27a8-e2ff-4a4d-afce-107dcf6fa32e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:21.592828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf27a8-e2ff-4a4d-afce-107dcf6fa32e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:21.593539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf27a8-e2ff-4a4d-afce-107dcf6fa32e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:21.594637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf27a8-e2ff-4a4d-afce-107dcf6fa32e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:21.771951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-62cf27a8-e2ff-4a4d-afce-107dcf6fa32e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:47:21.776168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:21.776705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:21.777077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:21.777791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:21.778267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:21.778685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:21.818504 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] HTTP exception thrown: Instance db796bca-21a7-421a-a6fb-bc1bee6f51ea could not be found. Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Request method failure captured: Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea HTTP/1.1 Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPtePYDAXd9RbwIkp4eDhaehHF9P1wDocCtEUnzXiz1rorbGV3ziNJDRLKMqsjY8_gJbZDCuoTYbKfvgE3WBRithNJIpjh_uA61rn2ebn0rvoU8hHGdNdd6Bs56OJJKe2FGt1rUGcQRAmnk8-ttG06oJrEZrKF8yHFkJUBaenCNqwM Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.75 Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: fa0ee86db58d4231a356e54307ccf6f2 Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersAdmin275Test-570518713 Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:47:21.820201 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fa0ee86db58d4231a356e54307ccf6f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa0ee86db58d4231a356e54307ccf6f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fa0ee86db58d4231a356e54307ccf6f2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa0ee86db58d4231a356e54307ccf6f2"}]}] Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersAdmin275Test-570518713 Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: fa0ee86db58d4231a356e54307ccf6f2 Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersAdmin275Test-570518713 Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersAdmin275Test-570518713-project Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 5a3d655324ed4f23909beda9ceff0123 Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersAdmin275Test-570518713-project Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance db796bca-21a7-421a-a6fb-bc1bee6f51ea could not be found. Oct 29 02:47:21.821959 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'db796bca-21a7-421a-a6fb-bc1bee6f51ea'} Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db796bca-21a7-421a-a6fb-bc1bee6f51ea could not be found. Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:47:21.823090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db796bca-21a7-421a-a6fb-bc1bee6f51ea could not be found. Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db796bca-21a7-421a-a6fb-bc1bee6f51ea could not be found. Oct 29 02:47:21.824545 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:47:21.825924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] Returning 404 to user: Instance db796bca-21a7-421a-a6fb-bc1bee6f51ea could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:47:21.825924 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54478c56-c6b4-44fa-9955-9ee1d4ddef61 tempest-ServersAdmin275Test-570518713 tempest-ServersAdmin275Test-570518713-project] 10.222.0.16 "GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea" status: 404 len: 111 microversion: 2.75 time: 0.515475 Oct 29 02:47:21.839517 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 284/572] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:21 2022] GET /compute/v2.1/servers/db796bca-21a7-421a-a6fb-bc1bee6f51ea => generated 111 bytes in 534 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:47:21.845977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b4993dac-0366-49d8-b591-55c92da02a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:21.846587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b4993dac-0366-49d8-b591-55c92da02a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:21.877479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4993dac-0366-49d8-b591-55c92da02a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:21.878527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4993dac-0366-49d8-b591-55c92da02a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:21.880683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4993dac-0366-49d8-b591-55c92da02a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:21.881962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4993dac-0366-49d8-b591-55c92da02a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:21.884413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4993dac-0366-49d8-b591-55c92da02a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:21.884940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4993dac-0366-49d8-b591-55c92da02a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.021035 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-62cf27a8-e2ff-4a4d-afce-107dcf6fa32e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.518039 Oct 29 02:47:22.023733 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 289/573] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 02:47:21 2022] GET /compute/v2.1/servers => generated 1002 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:22.035140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d303ac80-300e-4a72-9245-34ad96bddae7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:22.041925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d303ac80-300e-4a72-9245-34ad96bddae7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:22.350462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b4993dac-0366-49d8-b591-55c92da02a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:22.369175 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b4993dac-0366-49d8-b591-55c92da02a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1476 microversion: 2.1 time: 0.526939 Oct 29 02:47:22.371320 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 285/574] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:21 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1476 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:22.475087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d303ac80-300e-4a72-9245-34ad96bddae7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:22.487599 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d303ac80-300e-4a72-9245-34ad96bddae7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1218 microversion: 2.1 time: 0.455524 Oct 29 02:47:22.503146 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 290/575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:22 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1218 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:22.536889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-41991157-8566-496e-9d2c-9c22908f982d tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:22.538085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-41991157-8566-496e-9d2c-9c22908f982d tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:22.545570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41991157-8566-496e-9d2c-9c22908f982d tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:22.546389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41991157-8566-496e-9d2c-9c22908f982d tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:22.547596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41991157-8566-496e-9d2c-9c22908f982d tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.548661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41991157-8566-496e-9d2c-9c22908f982d tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:22.549253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41991157-8566-496e-9d2c-9c22908f982d tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:22.549939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41991157-8566-496e-9d2c-9c22908f982d tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:23.054495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-41991157-8566-496e-9d2c-9c22908f982d tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:23.064084 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-41991157-8566-496e-9d2c-9c22908f982d tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1391 microversion: 2.1 time: 0.547144 Oct 29 02:47:23.066818 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 286/576] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:22 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1391 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:23.396263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b389054-de2d-4844-a2d4-9e74a8c43852 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:23.397023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b389054-de2d-4844-a2d4-9e74a8c43852 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:23.409946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b389054-de2d-4844-a2d4-9e74a8c43852 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:23.410817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b389054-de2d-4844-a2d4-9e74a8c43852 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:23.411265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b389054-de2d-4844-a2d4-9e74a8c43852 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:23.414291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b389054-de2d-4844-a2d4-9e74a8c43852 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:23.417396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b389054-de2d-4844-a2d4-9e74a8c43852 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:23.418431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b389054-de2d-4844-a2d4-9e74a8c43852 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:23.524030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d6e8fbbb-e1aa-4d6a-8e90-04705102c558 req-08e77da5-303a-4c77-8889-b4349753d84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fec365b-4f49-47e5-85b9-281a3f583dd4", "name": "network-vif-unplugged", "status": "completed", "tag": "babba213-6f2e-4317-8a56-6f03e53d177d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:23.555672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d6e8fbbb-e1aa-4d6a-8e90-04705102c558 req-08e77da5-303a-4c77-8889-b4349753d84f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:23.556748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d6e8fbbb-e1aa-4d6a-8e90-04705102c558 req-08e77da5-303a-4c77-8889-b4349753d84f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:23.557417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d6e8fbbb-e1aa-4d6a-8e90-04705102c558 req-08e77da5-303a-4c77-8889-b4349753d84f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:23.588832 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d6e8fbbb-e1aa-4d6a-8e90-04705102c558 req-08e77da5-303a-4c77-8889-b4349753d84f service nova] Creating event network-vif-unplugged:babba213-6f2e-4317-8a56-6f03e53d177d for instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 on n-h1-862964-4 Oct 29 02:47:23.624893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-d6e8fbbb-e1aa-4d6a-8e90-04705102c558 req-08e77da5-303a-4c77-8889-b4349753d84f service nova] Instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:47:23.666227 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d6e8fbbb-e1aa-4d6a-8e90-04705102c558 req-08e77da5-303a-4c77-8889-b4349753d84f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159065 Oct 29 02:47:23.672325 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 287/577] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:23.686874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce43978d-3b9b-440e-8746-fbd43762b77f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:23.687592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce43978d-3b9b-440e-8746-fbd43762b77f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:23.710609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43978d-3b9b-440e-8746-fbd43762b77f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:23.722530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43978d-3b9b-440e-8746-fbd43762b77f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:23.724494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43978d-3b9b-440e-8746-fbd43762b77f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:23.725641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43978d-3b9b-440e-8746-fbd43762b77f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:23.726406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43978d-3b9b-440e-8746-fbd43762b77f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:23.727334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43978d-3b9b-440e-8746-fbd43762b77f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:23.850701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce43978d-3b9b-440e-8746-fbd43762b77f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:23.860434 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce43978d-3b9b-440e-8746-fbd43762b77f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1270 microversion: 2.1 time: 0.186460 Oct 29 02:47:23.866686 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 288/578] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:23 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1270 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:23.950670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2b389054-de2d-4844-a2d4-9e74a8c43852 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:23.970682 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b389054-de2d-4844-a2d4-9e74a8c43852 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1476 microversion: 2.1 time: 0.577188 Oct 29 02:47:23.976099 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 291/579] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:23 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1476 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:24.088307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9860aab-3b6e-4ca4-b4ea-0f0bd7c7a384 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:24.088938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f9860aab-3b6e-4ca4-b4ea-0f0bd7c7a384 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:24.103609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9860aab-3b6e-4ca4-b4ea-0f0bd7c7a384 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:24.107439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9860aab-3b6e-4ca4-b4ea-0f0bd7c7a384 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:24.109331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9860aab-3b6e-4ca4-b4ea-0f0bd7c7a384 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:24.110281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9860aab-3b6e-4ca4-b4ea-0f0bd7c7a384 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:24.114547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9860aab-3b6e-4ca4-b4ea-0f0bd7c7a384 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:24.115002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9860aab-3b6e-4ca4-b4ea-0f0bd7c7a384 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:24.893463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2eaee4c-c311-4daa-b651-dbaa2e34be42 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:24.894148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2eaee4c-c311-4daa-b651-dbaa2e34be42 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:24.913538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2eaee4c-c311-4daa-b651-dbaa2e34be42 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:24.914067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2eaee4c-c311-4daa-b651-dbaa2e34be42 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:24.917301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2eaee4c-c311-4daa-b651-dbaa2e34be42 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:24.918346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2eaee4c-c311-4daa-b651-dbaa2e34be42 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:24.919035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2eaee4c-c311-4daa-b651-dbaa2e34be42 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:24.921500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2eaee4c-c311-4daa-b651-dbaa2e34be42 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.033662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f9860aab-3b6e-4ca4-b4ea-0f0bd7c7a384 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:25.046357 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f9860aab-3b6e-4ca4-b4ea-0f0bd7c7a384 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1391 microversion: 2.1 time: 0.962565 Oct 29 02:47:25.050142 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 289/580] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:24 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1391 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:25.055074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f283cc15-3c1a-4823-a456-a2063a7d837b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:25.066811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f283cc15-3c1a-4823-a456-a2063a7d837b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:25.077435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f283cc15-3c1a-4823-a456-a2063a7d837b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:25.078211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f283cc15-3c1a-4823-a456-a2063a7d837b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:25.078807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f283cc15-3c1a-4823-a456-a2063a7d837b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.080741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f283cc15-3c1a-4823-a456-a2063a7d837b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:25.081436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f283cc15-3c1a-4823-a456-a2063a7d837b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:25.094625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f283cc15-3c1a-4823-a456-a2063a7d837b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.413081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2eaee4c-c311-4daa-b651-dbaa2e34be42 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:25.428281 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2eaee4c-c311-4daa-b651-dbaa2e34be42 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1278 microversion: 2.1 time: 0.538377 Oct 29 02:47:25.430831 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 292/581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:24 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1278 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:25.822073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-edc0c636-a516-4397-afe4-7908b72a8e04 req-aeabb292-7c4e-43f8-a223-6078e3b9fc5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fec365b-4f49-47e5-85b9-281a3f583dd4", "tag": "babba213-6f2e-4317-8a56-6f03e53d177d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:25.838806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-edc0c636-a516-4397-afe4-7908b72a8e04 req-aeabb292-7c4e-43f8-a223-6078e3b9fc5e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:25.843452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-edc0c636-a516-4397-afe4-7908b72a8e04 req-aeabb292-7c4e-43f8-a223-6078e3b9fc5e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:25.844422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-edc0c636-a516-4397-afe4-7908b72a8e04 req-aeabb292-7c4e-43f8-a223-6078e3b9fc5e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.877779 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-edc0c636-a516-4397-afe4-7908b72a8e04 req-aeabb292-7c4e-43f8-a223-6078e3b9fc5e service nova] Creating event network-changed:babba213-6f2e-4317-8a56-6f03e53d177d for instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 on n-h1-862964-4 Oct 29 02:47:25.913980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-edc0c636-a516-4397-afe4-7908b72a8e04 req-aeabb292-7c4e-43f8-a223-6078e3b9fc5e service nova] Instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:47:25.941153 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-edc0c636-a516-4397-afe4-7908b72a8e04 req-aeabb292-7c4e-43f8-a223-6078e3b9fc5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121240 Oct 29 02:47:25.944146 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 293/582] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:26.073837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a6b5ee05-78c8-42b8-80d8-3a603271b794 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:26.075007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a6b5ee05-78c8-42b8-80d8-3a603271b794 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:26.088841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6b5ee05-78c8-42b8-80d8-3a603271b794 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:26.091064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6b5ee05-78c8-42b8-80d8-3a603271b794 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:26.092931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6b5ee05-78c8-42b8-80d8-3a603271b794 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:26.094102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6b5ee05-78c8-42b8-80d8-3a603271b794 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:26.096009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6b5ee05-78c8-42b8-80d8-3a603271b794 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:26.098046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6b5ee05-78c8-42b8-80d8-3a603271b794 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:26.960337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f283cc15-3c1a-4823-a456-a2063a7d837b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:26.968703 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f283cc15-3c1a-4823-a456-a2063a7d837b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1476 microversion: 2.1 time: 1.917249 Oct 29 02:47:26.974751 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 290/583] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:25 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1476 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:26.986453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7c0d2710-3ca5-4257-84e0-3b2e0157b914 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:26.987073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7c0d2710-3ca5-4257-84e0-3b2e0157b914 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:26.996807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6b5ee05-78c8-42b8-80d8-3a603271b794 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:27.005125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c0d2710-3ca5-4257-84e0-3b2e0157b914 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.005635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c0d2710-3ca5-4257-84e0-3b2e0157b914 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.006102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c0d2710-3ca5-4257-84e0-3b2e0157b914 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:27.006834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c0d2710-3ca5-4257-84e0-3b2e0157b914 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.007287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c0d2710-3ca5-4257-84e0-3b2e0157b914 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.007708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c0d2710-3ca5-4257-84e0-3b2e0157b914 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:27.013310 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a6b5ee05-78c8-42b8-80d8-3a603271b794 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1391 microversion: 2.1 time: 0.939029 Oct 29 02:47:27.018052 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 294/584] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:26 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1391 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:27.148423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7c0d2710-3ca5-4257-84e0-3b2e0157b914 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:27.157457 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7c0d2710-3ca5-4257-84e0-3b2e0157b914 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1276 microversion: 2.1 time: 0.181359 Oct 29 02:47:27.158372 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 291/585] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:26 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:27.999375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b5dd0f9-66c5-4b51-9f48-1ce08aec01e3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:28.002369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b5dd0f9-66c5-4b51-9f48-1ce08aec01e3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:28.024589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5dd0f9-66c5-4b51-9f48-1ce08aec01e3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:28.025734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5dd0f9-66c5-4b51-9f48-1ce08aec01e3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:28.026590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5dd0f9-66c5-4b51-9f48-1ce08aec01e3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:28.027534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5dd0f9-66c5-4b51-9f48-1ce08aec01e3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:28.028203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5dd0f9-66c5-4b51-9f48-1ce08aec01e3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:28.028834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5dd0f9-66c5-4b51-9f48-1ce08aec01e3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:28.047819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7a40ba0f-4834-4d09-8942-888657365569 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:28.049179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7a40ba0f-4834-4d09-8942-888657365569 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:28.130329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a40ba0f-4834-4d09-8942-888657365569 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:28.130827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a40ba0f-4834-4d09-8942-888657365569 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:28.131264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a40ba0f-4834-4d09-8942-888657365569 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:28.141541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a40ba0f-4834-4d09-8942-888657365569 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:28.142072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a40ba0f-4834-4d09-8942-888657365569 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:28.142517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a40ba0f-4834-4d09-8942-888657365569 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:29.043632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7a40ba0f-4834-4d09-8942-888657365569 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:29.069518 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7a40ba0f-4834-4d09-8942-888657365569 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1391 microversion: 2.1 time: 1.027525 Oct 29 02:47:29.094042 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 292/586] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:28 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1391 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:29.134982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-27969afc-248f-4205-bdb1-a58794d8d090 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:29.136265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-27969afc-248f-4205-bdb1-a58794d8d090 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:29.161779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27969afc-248f-4205-bdb1-a58794d8d090 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:29.162308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27969afc-248f-4205-bdb1-a58794d8d090 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:29.164109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27969afc-248f-4205-bdb1-a58794d8d090 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:29.180385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27969afc-248f-4205-bdb1-a58794d8d090 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:29.183008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27969afc-248f-4205-bdb1-a58794d8d090 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:29.185225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27969afc-248f-4205-bdb1-a58794d8d090 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:29.465055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2b5dd0f9-66c5-4b51-9f48-1ce08aec01e3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:29.479779 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b5dd0f9-66c5-4b51-9f48-1ce08aec01e3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1476 microversion: 2.1 time: 1.485153 Oct 29 02:47:29.480596 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 295/587] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:27 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1476 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:29.677690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-27969afc-248f-4205-bdb1-a58794d8d090 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:29.694558 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-27969afc-248f-4205-bdb1-a58794d8d090 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1276 microversion: 2.1 time: 0.599187 Oct 29 02:47:29.696224 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 293/588] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:29 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1276 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:30.106191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cca6b067-fd66-491e-903c-f7be19578bf8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:30.107057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cca6b067-fd66-491e-903c-f7be19578bf8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:30.120871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca6b067-fd66-491e-903c-f7be19578bf8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:30.129153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca6b067-fd66-491e-903c-f7be19578bf8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:30.134892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca6b067-fd66-491e-903c-f7be19578bf8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:30.137079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca6b067-fd66-491e-903c-f7be19578bf8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:30.138468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca6b067-fd66-491e-903c-f7be19578bf8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:30.139007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca6b067-fd66-491e-903c-f7be19578bf8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:30.160245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:30.714008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1346168783", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:30.730052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:30.843287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:30.952206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cca6b067-fd66-491e-903c-f7be19578bf8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:30.965595 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cca6b067-fd66-491e-903c-f7be19578bf8 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1391 microversion: 2.1 time: 0.862705 Oct 29 02:47:30.967008 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 296/589] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:30 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1391 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:31.002372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-36740a2f-5382-4bba-b3dc-495512b88fa3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:31.005406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-36740a2f-5382-4bba-b3dc-495512b88fa3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:31.023108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36740a2f-5382-4bba-b3dc-495512b88fa3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:31.023640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36740a2f-5382-4bba-b3dc-495512b88fa3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:31.024120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36740a2f-5382-4bba-b3dc-495512b88fa3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:31.029042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36740a2f-5382-4bba-b3dc-495512b88fa3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:31.029774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36740a2f-5382-4bba-b3dc-495512b88fa3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:31.030429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36740a2f-5382-4bba-b3dc-495512b88fa3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:31.259402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=30 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:31.710118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:31.756392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:31.758632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:31.760732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:31.761153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:31.761782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:31.787506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:31.790502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:31.793231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:31.794539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:31.799746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:31.803191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:31.860353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Getting quotas for project 4ba4b121877b458092bfd5cadec5aa3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:31.889639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Getting quotas for user 68cdeea2722e49e09ccf0b4f892906d4 and project 4ba4b121877b458092bfd5cadec5aa3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:31.927947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:31.935955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:31.992005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-36740a2f-5382-4bba-b3dc-495512b88fa3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:32.015959 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-36740a2f-5382-4bba-b3dc-495512b88fa3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1474 microversion: 2.1 time: 1.045463 Oct 29 02:47:32.031882 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 297/590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:30 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1474 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:32.064939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4bd19cac-20f9-4ea6-87c6-55c0ad85a689 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:32.065569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4bd19cac-20f9-4ea6-87c6-55c0ad85a689 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:32.084771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bd19cac-20f9-4ea6-87c6-55c0ad85a689 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.085272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bd19cac-20f9-4ea6-87c6-55c0ad85a689 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.085699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bd19cac-20f9-4ea6-87c6-55c0ad85a689 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.088560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bd19cac-20f9-4ea6-87c6-55c0ad85a689 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.089026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bd19cac-20f9-4ea6-87c6-55c0ad85a689 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.089481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bd19cac-20f9-4ea6-87c6-55c0ad85a689 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.131810 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-70040944-0198-46ec-9465-0e35eb051f28 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679899 Oct 29 02:47:32.138126 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 294/591] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 02:47:32.154919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-819172e0-2571-424c-8808-91175a1815e6 req-ba1cf5a9-397f-4f9c-8a71-e55f562a7316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209b0e5a-13ee-4803-94fc-e9d05298ae49", "name": "network-vif-plugged", "status": "completed", "tag": "9db2669a-4596-46d6-ae92-4b31a0a6fdfd"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:32.177839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-819172e0-2571-424c-8808-91175a1815e6 req-ba1cf5a9-397f-4f9c-8a71-e55f562a7316 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.187607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-819172e0-2571-424c-8808-91175a1815e6 req-ba1cf5a9-397f-4f9c-8a71-e55f562a7316 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.198666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-819172e0-2571-424c-8808-91175a1815e6 req-ba1cf5a9-397f-4f9c-8a71-e55f562a7316 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.225625 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-819172e0-2571-424c-8808-91175a1815e6 req-ba1cf5a9-397f-4f9c-8a71-e55f562a7316 service nova] Creating event network-vif-plugged:9db2669a-4596-46d6-ae92-4b31a0a6fdfd for instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 on n-h1-862964-4 Oct 29 02:47:32.244016 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-819172e0-2571-424c-8808-91175a1815e6 req-ba1cf5a9-397f-4f9c-8a71-e55f562a7316 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104039 Oct 29 02:47:32.244945 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 295/592] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:32.258107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-df84c593-1c3c-4e20-aeed-40c933d08799 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:32.258829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-df84c593-1c3c-4e20-aeed-40c933d08799 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:32.272726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df84c593-1c3c-4e20-aeed-40c933d08799 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.273213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df84c593-1c3c-4e20-aeed-40c933d08799 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.285152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df84c593-1c3c-4e20-aeed-40c933d08799 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.287731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df84c593-1c3c-4e20-aeed-40c933d08799 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.287731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df84c593-1c3c-4e20-aeed-40c933d08799 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.287731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df84c593-1c3c-4e20-aeed-40c933d08799 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.482784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:32.831698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4bd19cac-20f9-4ea6-87c6-55c0ad85a689 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:32.846776 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4bd19cac-20f9-4ea6-87c6-55c0ad85a689 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1318 microversion: 2.1 time: 0.805752 Oct 29 02:47:32.860938 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 298/593] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:32 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1318 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:32.874895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8742adc0-46c5-4cd9-af2d-c2a878ef2975 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:32.875504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8742adc0-46c5-4cd9-af2d-c2a878ef2975 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:32.887453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8742adc0-46c5-4cd9-af2d-c2a878ef2975 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.887946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8742adc0-46c5-4cd9-af2d-c2a878ef2975 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.888377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8742adc0-46c5-4cd9-af2d-c2a878ef2975 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.893337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8742adc0-46c5-4cd9-af2d-c2a878ef2975 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.893866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8742adc0-46c5-4cd9-af2d-c2a878ef2975 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.894282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8742adc0-46c5-4cd9-af2d-c2a878ef2975 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.090209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8742adc0-46c5-4cd9-af2d-c2a878ef2975 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:33.107680 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8742adc0-46c5-4cd9-af2d-c2a878ef2975 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1221 microversion: 2.1 time: 0.243848 Oct 29 02:47:33.110073 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 299/594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:32 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1221 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:33.157370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c8988022-4e39-4df6-9ee1-74d2e07b7bd7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:33.164805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c8988022-4e39-4df6-9ee1-74d2e07b7bd7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:33.187199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8988022-4e39-4df6-9ee1-74d2e07b7bd7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.189163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8988022-4e39-4df6-9ee1-74d2e07b7bd7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.193888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8988022-4e39-4df6-9ee1-74d2e07b7bd7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.194901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8988022-4e39-4df6-9ee1-74d2e07b7bd7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.199009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8988022-4e39-4df6-9ee1-74d2e07b7bd7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.200960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8988022-4e39-4df6-9ee1-74d2e07b7bd7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.341614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-df84c593-1c3c-4e20-aeed-40c933d08799 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:33.378662 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-df84c593-1c3c-4e20-aeed-40c933d08799 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1391 microversion: 2.1 time: 1.132081 Oct 29 02:47:33.380792 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 296/595] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:32 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1391 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:33.408247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-a1de88bd-86a6-4b87-b99f-a8672ae0b141 req-6f9bfd57-e913-420c-9895-6c33ae8fbfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283e7c95-2e30-4537-9163-3b933b0bc381", "tag": "8efa80a2-a5c8-431e-ac67-14abfbedc06e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:33.423604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a1de88bd-86a6-4b87-b99f-a8672ae0b141 req-6f9bfd57-e913-420c-9895-6c33ae8fbfe2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.424361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a1de88bd-86a6-4b87-b99f-a8672ae0b141 req-6f9bfd57-e913-420c-9895-6c33ae8fbfe2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.424943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a1de88bd-86a6-4b87-b99f-a8672ae0b141 req-6f9bfd57-e913-420c-9895-6c33ae8fbfe2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.442494 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-a1de88bd-86a6-4b87-b99f-a8672ae0b141 req-6f9bfd57-e913-420c-9895-6c33ae8fbfe2 service nova] Creating event network-changed:8efa80a2-a5c8-431e-ac67-14abfbedc06e for instance 283e7c95-2e30-4537-9163-3b933b0bc381 on n-h2-862964-4 Oct 29 02:47:33.450008 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-a1de88bd-86a6-4b87-b99f-a8672ae0b141 req-6f9bfd57-e913-420c-9895-6c33ae8fbfe2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065481 Oct 29 02:47:33.450642 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 297/596] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:33.872721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2869ec87-bcea-4f45-8455-a87794ab9c21 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:33.873757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2869ec87-bcea-4f45-8455-a87794ab9c21 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:33.885854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2869ec87-bcea-4f45-8455-a87794ab9c21 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.892197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2869ec87-bcea-4f45-8455-a87794ab9c21 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.892980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2869ec87-bcea-4f45-8455-a87794ab9c21 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.893980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2869ec87-bcea-4f45-8455-a87794ab9c21 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.894621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2869ec87-bcea-4f45-8455-a87794ab9c21 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.895238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2869ec87-bcea-4f45-8455-a87794ab9c21 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.078958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c8988022-4e39-4df6-9ee1-74d2e07b7bd7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:34.095088 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c8988022-4e39-4df6-9ee1-74d2e07b7bd7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1471 microversion: 2.1 time: 0.981622 Oct 29 02:47:34.097904 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 300/597] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:33 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1471 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:34.131044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-70f3c124-92eb-417e-8620-d983ddd9e73b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:34.135605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-70f3c124-92eb-417e-8620-d983ddd9e73b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:34.171907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70f3c124-92eb-417e-8620-d983ddd9e73b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.182946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70f3c124-92eb-417e-8620-d983ddd9e73b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.183813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70f3c124-92eb-417e-8620-d983ddd9e73b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.187050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70f3c124-92eb-417e-8620-d983ddd9e73b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.189319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70f3c124-92eb-417e-8620-d983ddd9e73b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.190010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70f3c124-92eb-417e-8620-d983ddd9e73b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.334084 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-70f3c124-92eb-417e-8620-d983ddd9e73b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "POST /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4/action" status: 204 len: 0 microversion: 2.1 time: 0.206439 Oct 29 02:47:34.341421 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 301/598] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:47:34 2022] POST /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4/action => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:47:34.356597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e99b1b0f-0aa8-4261-b0fa-a3f65eb2f3f0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:34.357299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e99b1b0f-0aa8-4261-b0fa-a3f65eb2f3f0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:34.392962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e99b1b0f-0aa8-4261-b0fa-a3f65eb2f3f0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.393474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e99b1b0f-0aa8-4261-b0fa-a3f65eb2f3f0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.393966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e99b1b0f-0aa8-4261-b0fa-a3f65eb2f3f0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.394686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e99b1b0f-0aa8-4261-b0fa-a3f65eb2f3f0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.395137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e99b1b0f-0aa8-4261-b0fa-a3f65eb2f3f0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.395565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e99b1b0f-0aa8-4261-b0fa-a3f65eb2f3f0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.624712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e99b1b0f-0aa8-4261-b0fa-a3f65eb2f3f0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:34.635728 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e99b1b0f-0aa8-4261-b0fa-a3f65eb2f3f0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1269 microversion: 2.1 time: 0.291763 Oct 29 02:47:34.636661 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 302/599] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:34 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1269 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:34.647779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64405130-10ba-4b13-b4e5-90a085caffc6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:34.650820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-64405130-10ba-4b13-b4e5-90a085caffc6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:34.666621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64405130-10ba-4b13-b4e5-90a085caffc6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.667482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64405130-10ba-4b13-b4e5-90a085caffc6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.668163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64405130-10ba-4b13-b4e5-90a085caffc6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.669104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64405130-10ba-4b13-b4e5-90a085caffc6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.672408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64405130-10ba-4b13-b4e5-90a085caffc6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.672941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64405130-10ba-4b13-b4e5-90a085caffc6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.880021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2869ec87-bcea-4f45-8455-a87794ab9c21 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:34.895129 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2869ec87-bcea-4f45-8455-a87794ab9c21 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1318 microversion: 2.1 time: 1.027921 Oct 29 02:47:34.896136 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 298/600] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:33 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1318 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:34.907683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9c631be1-ac7b-4e4f-ad38-dbdc6e5cfc07 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:34.911259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9c631be1-ac7b-4e4f-ad38-dbdc6e5cfc07 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:34.930685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c631be1-ac7b-4e4f-ad38-dbdc6e5cfc07 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.933276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c631be1-ac7b-4e4f-ad38-dbdc6e5cfc07 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.942803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c631be1-ac7b-4e4f-ad38-dbdc6e5cfc07 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.943801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c631be1-ac7b-4e4f-ad38-dbdc6e5cfc07 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.944492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c631be1-ac7b-4e4f-ad38-dbdc6e5cfc07 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.945111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c631be1-ac7b-4e4f-ad38-dbdc6e5cfc07 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:35.156053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-64405130-10ba-4b13-b4e5-90a085caffc6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:35.165738 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-64405130-10ba-4b13-b4e5-90a085caffc6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1471 microversion: 2.1 time: 0.527762 Oct 29 02:47:35.178173 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 303/601] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:34 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1471 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:35.183316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d0b95e8b-1a3a-4c28-95d8-c8764f8cbdf1 req-33ba94e0-45e6-4294-8cd7-3d745e2b1626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c375224-e74e-4e93-934a-e38f06c2a47f", "tag": "020f55b9-e5ef-4544-8e6b-f7fe204c8723"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:35.200582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d0b95e8b-1a3a-4c28-95d8-c8764f8cbdf1 req-33ba94e0-45e6-4294-8cd7-3d745e2b1626 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:35.201123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d0b95e8b-1a3a-4c28-95d8-c8764f8cbdf1 req-33ba94e0-45e6-4294-8cd7-3d745e2b1626 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:35.201569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d0b95e8b-1a3a-4c28-95d8-c8764f8cbdf1 req-33ba94e0-45e6-4294-8cd7-3d745e2b1626 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:35.215842 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d0b95e8b-1a3a-4c28-95d8-c8764f8cbdf1 req-33ba94e0-45e6-4294-8cd7-3d745e2b1626 service nova] Creating event network-changed:020f55b9-e5ef-4544-8e6b-f7fe204c8723 for instance 9c375224-e74e-4e93-934a-e38f06c2a47f on n-h2-862964-4 Oct 29 02:47:35.243145 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d0b95e8b-1a3a-4c28-95d8-c8764f8cbdf1 req-33ba94e0-45e6-4294-8cd7-3d745e2b1626 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063353 Oct 29 02:47:35.254275 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 304/602] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:35.509974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9c631be1-ac7b-4e4f-ad38-dbdc6e5cfc07 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:35.530548 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9c631be1-ac7b-4e4f-ad38-dbdc6e5cfc07 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1590 microversion: 2.1 time: 0.633261 Oct 29 02:47:35.531707 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 299/603] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:34 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1590 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:35.563651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a1528d21-2d43-4a49-856f-101a70577c81 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:35.565069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a1528d21-2d43-4a49-856f-101a70577c81 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:35.594247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1528d21-2d43-4a49-856f-101a70577c81 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:35.599406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1528d21-2d43-4a49-856f-101a70577c81 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:35.601416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1528d21-2d43-4a49-856f-101a70577c81 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:35.604063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1528d21-2d43-4a49-856f-101a70577c81 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:35.606488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1528d21-2d43-4a49-856f-101a70577c81 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:35.608913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1528d21-2d43-4a49-856f-101a70577c81 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:35.670133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-526e3be3-ab08-4e5f-aea1-22290025e556 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:35.671398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-526e3be3-ab08-4e5f-aea1-22290025e556 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:35.687731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-526e3be3-ab08-4e5f-aea1-22290025e556 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:35.700405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-526e3be3-ab08-4e5f-aea1-22290025e556 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:35.701002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-526e3be3-ab08-4e5f-aea1-22290025e556 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:35.701933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-526e3be3-ab08-4e5f-aea1-22290025e556 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:35.702495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-526e3be3-ab08-4e5f-aea1-22290025e556 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:35.703016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-526e3be3-ab08-4e5f-aea1-22290025e556 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.015899 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a1528d21-2d43-4a49-856f-101a70577c81 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.460924 Oct 29 02:47:36.016911 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 305/604] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 02:47:35 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49/os-interface => generated 285 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:36.161065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-110877926", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "77bc85c7-1f7e-4553-b485-501ac324775e"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:36.296384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] validate_networks() for [('77bc85c7-1f7e-4553-b485-501ac324775e', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:36.412532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-526e3be3-ab08-4e5f-aea1-22290025e556 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:36.439528 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-526e3be3-ab08-4e5f-aea1-22290025e556 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1275 microversion: 2.1 time: 0.779429 Oct 29 02:47:36.464018 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 300/605] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:35 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1275 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:36.487838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8760b40f-de3a-4a7b-9e2b-992e5f7af8bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:36.488623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8760b40f-de3a-4a7b-9e2b-992e5f7af8bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:36.507797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8760b40f-de3a-4a7b-9e2b-992e5f7af8bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.508580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8760b40f-de3a-4a7b-9e2b-992e5f7af8bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.509220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8760b40f-de3a-4a7b-9e2b-992e5f7af8bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.510157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8760b40f-de3a-4a7b-9e2b-992e5f7af8bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.511187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8760b40f-de3a-4a7b-9e2b-992e5f7af8bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.511772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8760b40f-de3a-4a7b-9e2b-992e5f7af8bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:37.390932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8760b40f-de3a-4a7b-9e2b-992e5f7af8bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:37.404082 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8760b40f-de3a-4a7b-9e2b-992e5f7af8bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1318 microversion: 2.1 time: 0.936919 Oct 29 02:47:37.406240 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 301/606] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:36 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1318 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:37.419994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-014895bc-1de7-4958-ba05-bb0e5cde2f0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:37.421562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-014895bc-1de7-4958-ba05-bb0e5cde2f0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:37.435735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-014895bc-1de7-4958-ba05-bb0e5cde2f0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:37.438629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-014895bc-1de7-4958-ba05-bb0e5cde2f0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:37.439311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-014895bc-1de7-4958-ba05-bb0e5cde2f0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:37.448883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-014895bc-1de7-4958-ba05-bb0e5cde2f0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:37.451920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-014895bc-1de7-4958-ba05-bb0e5cde2f0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:37.452627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-014895bc-1de7-4958-ba05-bb0e5cde2f0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.151050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-014895bc-1de7-4958-ba05-bb0e5cde2f0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:38.172073 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-014895bc-1de7-4958-ba05-bb0e5cde2f0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1471 microversion: 2.1 time: 0.760956 Oct 29 02:47:38.178293 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 302/607] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:37 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1471 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:38.188562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-397a6516-03b1-4d96-88e5-a749504119c7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:38.189461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-397a6516-03b1-4d96-88e5-a749504119c7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:38.213833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397a6516-03b1-4d96-88e5-a749504119c7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.214055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397a6516-03b1-4d96-88e5-a749504119c7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.216719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397a6516-03b1-4d96-88e5-a749504119c7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.217738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397a6516-03b1-4d96-88e5-a749504119c7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.219089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397a6516-03b1-4d96-88e5-a749504119c7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.220881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397a6516-03b1-4d96-88e5-a749504119c7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.273789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:38.667621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-397a6516-03b1-4d96-88e5-a749504119c7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:38.702729 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-397a6516-03b1-4d96-88e5-a749504119c7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1275 microversion: 2.1 time: 0.522009 Oct 29 02:47:38.733870 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 303/608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:38 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1275 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:38.743334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b2002408-1da0-4903-85ae-fce195cfaa46 req-90144ddf-70d2-4b4f-a649-dbadb1ce6c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fec365b-4f49-47e5-85b9-281a3f583dd4", "name": "network-vif-plugged", "status": "completed", "tag": "babba213-6f2e-4317-8a56-6f03e53d177d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:38.758843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b2002408-1da0-4903-85ae-fce195cfaa46 req-90144ddf-70d2-4b4f-a649-dbadb1ce6c08 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.759531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b2002408-1da0-4903-85ae-fce195cfaa46 req-90144ddf-70d2-4b4f-a649-dbadb1ce6c08 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.761663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b2002408-1da0-4903-85ae-fce195cfaa46 req-90144ddf-70d2-4b4f-a649-dbadb1ce6c08 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.776014 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b2002408-1da0-4903-85ae-fce195cfaa46 req-90144ddf-70d2-4b4f-a649-dbadb1ce6c08 service nova] Creating event network-vif-plugged:babba213-6f2e-4317-8a56-6f03e53d177d for instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 on n-h1-862964-4 Oct 29 02:47:38.782927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-b2002408-1da0-4903-85ae-fce195cfaa46 req-90144ddf-70d2-4b4f-a649-dbadb1ce6c08 service nova] Instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:47:38.798382 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b2002408-1da0-4903-85ae-fce195cfaa46 req-90144ddf-70d2-4b4f-a649-dbadb1ce6c08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060635 Oct 29 02:47:38.799391 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 304/609] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:38.812139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c420c323-3006-4b42-8075-4e5f9a40b17b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:38.813049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c420c323-3006-4b42-8075-4e5f9a40b17b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:38.823316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c420c323-3006-4b42-8075-4e5f9a40b17b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.825428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c420c323-3006-4b42-8075-4e5f9a40b17b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.826143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c420c323-3006-4b42-8075-4e5f9a40b17b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.829068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c420c323-3006-4b42-8075-4e5f9a40b17b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.830188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c420c323-3006-4b42-8075-4e5f9a40b17b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.832595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c420c323-3006-4b42-8075-4e5f9a40b17b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.222431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c420c323-3006-4b42-8075-4e5f9a40b17b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:39.236704 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c420c323-3006-4b42-8075-4e5f9a40b17b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1318 microversion: 2.1 time: 0.435169 Oct 29 02:47:39.237989 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 305/610] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:38 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:39.244381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bcb6ae30-d025-4954-8c89-c7ec03882b49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:39.247636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bcb6ae30-d025-4954-8c89-c7ec03882b49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:39.259189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb6ae30-d025-4954-8c89-c7ec03882b49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.262591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb6ae30-d025-4954-8c89-c7ec03882b49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.263443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb6ae30-d025-4954-8c89-c7ec03882b49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.264430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb6ae30-d025-4954-8c89-c7ec03882b49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.268520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb6ae30-d025-4954-8c89-c7ec03882b49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.269212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb6ae30-d025-4954-8c89-c7ec03882b49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.840414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bcb6ae30-d025-4954-8c89-c7ec03882b49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:39.852327 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bcb6ae30-d025-4954-8c89-c7ec03882b49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1471 microversion: 2.1 time: 0.610721 Oct 29 02:47:39.855135 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 306/611] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:39 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1471 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:39.865231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aa3d4fb1-752e-46ba-8c5a-9d9b7582590c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:39.867764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aa3d4fb1-752e-46ba-8c5a-9d9b7582590c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:39.884435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa3d4fb1-752e-46ba-8c5a-9d9b7582590c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.885867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa3d4fb1-752e-46ba-8c5a-9d9b7582590c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.886678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa3d4fb1-752e-46ba-8c5a-9d9b7582590c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.887750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa3d4fb1-752e-46ba-8c5a-9d9b7582590c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.888359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa3d4fb1-752e-46ba-8c5a-9d9b7582590c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.888934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa3d4fb1-752e-46ba-8c5a-9d9b7582590c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.136515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:40.137161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:40.137364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:40.137719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:40.138495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:40.185625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.186134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.191137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.204794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.206614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.208020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.275346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Getting quotas for project 60896479fb0c4357ad5fb03016470283. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:40.296265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Getting quotas for user f0ea28d9bb3544bca1a3c90d983fe8e4 and project 60896479fb0c4357ad5fb03016470283. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:40.331916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aa3d4fb1-752e-46ba-8c5a-9d9b7582590c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:40.337201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:40.342316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:40.348490 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aa3d4fb1-752e-46ba-8c5a-9d9b7582590c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1317 microversion: 2.1 time: 0.492000 Oct 29 02:47:40.349094 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 307/612] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:39 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:40.466808 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-db6412be-1de1-4383-a525-4a49a3585686 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.447609 Oct 29 02:47:40.466808 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 306/613] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:47:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 4449 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:47:40.480530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ffe96eeb-c0fc-4f8d-9cb6-cca58abad358 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:40.481137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ffe96eeb-c0fc-4f8d-9cb6-cca58abad358 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:40.490315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe96eeb-c0fc-4f8d-9cb6-cca58abad358 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.490808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe96eeb-c0fc-4f8d-9cb6-cca58abad358 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.491238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe96eeb-c0fc-4f8d-9cb6-cca58abad358 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.491942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe96eeb-c0fc-4f8d-9cb6-cca58abad358 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.492387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe96eeb-c0fc-4f8d-9cb6-cca58abad358 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.492804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffe96eeb-c0fc-4f8d-9cb6-cca58abad358 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.502800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-986880752", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "2525c91e-f8df-4369-b3fa-9ce9342c6d85"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:40.654712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] validate_networks() for [('2525c91e-f8df-4369-b3fa-9ce9342c6d85', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:41.826690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:41.842434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ffe96eeb-c0fc-4f8d-9cb6-cca58abad358 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:41.857202 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ffe96eeb-c0fc-4f8d-9cb6-cca58abad358 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1318 microversion: 2.1 time: 1.381668 Oct 29 02:47:41.857920 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 307/614] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:40 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1318 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:41.869740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:41.871117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:41.883231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:41.888984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:41.891622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:41.893553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:41.898074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:41.898753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:41.899346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:41.913898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:42.186475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:42.206071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:42.210703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:42.211960 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f567b90c-59e5-4210-ac55-edbb773df319 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1313 microversion: 2.25 time: 0.353025 Oct 29 02:47:42.212814 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 308/615] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:41 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:42.247763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b03e630-a29b-4059-8d54-b1a92b02263b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85e5613f-ea9f-4234-b261-2d30ceab66ef"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:42.250738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3b03e630-a29b-4059-8d54-b1a92b02263b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:42.273249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b03e630-a29b-4059-8d54-b1a92b02263b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:42.273733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b03e630-a29b-4059-8d54-b1a92b02263b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:42.277324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b03e630-a29b-4059-8d54-b1a92b02263b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:42.278140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b03e630-a29b-4059-8d54-b1a92b02263b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:42.278610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b03e630-a29b-4059-8d54-b1a92b02263b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:42.279036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b03e630-a29b-4059-8d54-b1a92b02263b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:42.657464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:42.658130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:42.658910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:42.659618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:42.660340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:42.699827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:42.704360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:42.705009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:42.709621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:42.711407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:42.714394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:42.788886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Getting quotas for project a1287e36822b48f9a9020375bd0da2ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:42.801015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Getting quotas for user 6c2aa25bffe3421e8a75d88388dd5441 and project a1287e36822b48f9a9020375bd0da2ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:42.847052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:42.854536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:42.980559 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54d65cb8-7b07-4802-a196-35744c7da4d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.630331 Oct 29 02:47:42.983889 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 308/616] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:47:42.994496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4372ea99-e44a-4e94-a35e-3c4d3031cd7b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:43.007926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4372ea99-e44a-4e94-a35e-3c4d3031cd7b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:43.044853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4372ea99-e44a-4e94-a35e-3c4d3031cd7b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.045347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4372ea99-e44a-4e94-a35e-3c4d3031cd7b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.045784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4372ea99-e44a-4e94-a35e-3c4d3031cd7b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.046527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4372ea99-e44a-4e94-a35e-3c4d3031cd7b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.046988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4372ea99-e44a-4e94-a35e-3c4d3031cd7b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.047413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4372ea99-e44a-4e94-a35e-3c4d3031cd7b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.110546 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3b03e630-a29b-4059-8d54-b1a92b02263b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "POST /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895821 Oct 29 02:47:43.121141 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 309/617] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 02:47:42 2022] POST /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments => generated 194 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:43.134058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6f5c6759-5903-4079-bcbd-05928a91878c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:43.145888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6f5c6759-5903-4079-bcbd-05928a91878c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:43.168732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5c6759-5903-4079-bcbd-05928a91878c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.169267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5c6759-5903-4079-bcbd-05928a91878c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.170047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5c6759-5903-4079-bcbd-05928a91878c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.172517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5c6759-5903-4079-bcbd-05928a91878c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.173156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5c6759-5903-4079-bcbd-05928a91878c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.176616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5c6759-5903-4079-bcbd-05928a91878c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.717667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4372ea99-e44a-4e94-a35e-3c4d3031cd7b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:43.734253 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4372ea99-e44a-4e94-a35e-3c4d3031cd7b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1463 microversion: 2.1 time: 0.745842 Oct 29 02:47:43.737014 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 309/618] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:42 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1463 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:43.755918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18a2ad41-b62e-4148-8fc6-22fd1c14a454 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:43.758014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18a2ad41-b62e-4148-8fc6-22fd1c14a454 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:43.768771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a2ad41-b62e-4148-8fc6-22fd1c14a454 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.769272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a2ad41-b62e-4148-8fc6-22fd1c14a454 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.769995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a2ad41-b62e-4148-8fc6-22fd1c14a454 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.770760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a2ad41-b62e-4148-8fc6-22fd1c14a454 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.771223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a2ad41-b62e-4148-8fc6-22fd1c14a454 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.771649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a2ad41-b62e-4148-8fc6-22fd1c14a454 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.210039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18a2ad41-b62e-4148-8fc6-22fd1c14a454 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:44.220815 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18a2ad41-b62e-4148-8fc6-22fd1c14a454 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1590 microversion: 2.1 time: 0.481552 Oct 29 02:47:44.221412 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 310/619] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:43 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1590 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:44.255012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-79d8152a-e4aa-4c38-ae17-21f72fad5529 req-be4a6c11-fed5-42b1-aeca-1cfafee5dc24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209b0e5a-13ee-4803-94fc-e9d05298ae49", "tag": "9db2669a-4596-46d6-ae92-4b31a0a6fdfd"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:44.296209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-79d8152a-e4aa-4c38-ae17-21f72fad5529 req-be4a6c11-fed5-42b1-aeca-1cfafee5dc24 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.296694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-79d8152a-e4aa-4c38-ae17-21f72fad5529 req-be4a6c11-fed5-42b1-aeca-1cfafee5dc24 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.297128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-79d8152a-e4aa-4c38-ae17-21f72fad5529 req-be4a6c11-fed5-42b1-aeca-1cfafee5dc24 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.340307 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-79d8152a-e4aa-4c38-ae17-21f72fad5529 req-be4a6c11-fed5-42b1-aeca-1cfafee5dc24 service nova] Creating event network-changed:9db2669a-4596-46d6-ae92-4b31a0a6fdfd for instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 on n-h1-862964-4 Oct 29 02:47:44.345696 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-79d8152a-e4aa-4c38-ae17-21f72fad5529 req-be4a6c11-fed5-42b1-aeca-1cfafee5dc24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098503 Oct 29 02:47:44.346723 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 311/620] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:44.354036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-74f14f95-2df8-4567-a577-3ed6475a0080 req-e485dbfe-d5e8-45ca-9064-bf61734894af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283e7c95-2e30-4537-9163-3b933b0bc381", "name": "network-vif-plugged", "status": "completed", "tag": "8efa80a2-a5c8-431e-ac67-14abfbedc06e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:44.376235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:44.380626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-74f14f95-2df8-4567-a577-3ed6475a0080 req-e485dbfe-d5e8-45ca-9064-bf61734894af service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.381125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-74f14f95-2df8-4567-a577-3ed6475a0080 req-e485dbfe-d5e8-45ca-9064-bf61734894af service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.383185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-74f14f95-2df8-4567-a577-3ed6475a0080 req-e485dbfe-d5e8-45ca-9064-bf61734894af service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.404392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f5c6759-5903-4079-bcbd-05928a91878c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:44.413559 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6f5c6759-5903-4079-bcbd-05928a91878c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1317 microversion: 2.1 time: 1.290677 Oct 29 02:47:44.432791 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 310/621] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:43 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1317 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:44.440661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0b8c6f7-ce6c-485d-89d8-64295e9e8ec7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:44.447771 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-74f14f95-2df8-4567-a577-3ed6475a0080 req-e485dbfe-d5e8-45ca-9064-bf61734894af service nova] Creating event network-vif-plugged:8efa80a2-a5c8-431e-ac67-14abfbedc06e for instance 283e7c95-2e30-4537-9163-3b933b0bc381 on n-h2-862964-4 Oct 29 02:47:44.451691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0b8c6f7-ce6c-485d-89d8-64295e9e8ec7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:44.459107 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-74f14f95-2df8-4567-a577-3ed6475a0080 req-e485dbfe-d5e8-45ca-9064-bf61734894af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110789 Oct 29 02:47:44.459728 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 312/622] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:44.477173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-166ec95d-51cb-4b3c-9f5b-62699fa94878 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:44.477847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b8c6f7-ce6c-485d-89d8-64295e9e8ec7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.478861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b8c6f7-ce6c-485d-89d8-64295e9e8ec7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.479494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b8c6f7-ce6c-485d-89d8-64295e9e8ec7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.480428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b8c6f7-ce6c-485d-89d8-64295e9e8ec7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.481084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b8c6f7-ce6c-485d-89d8-64295e9e8ec7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.481687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b8c6f7-ce6c-485d-89d8-64295e9e8ec7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.488909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-166ec95d-51cb-4b3c-9f5b-62699fa94878 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:44.516021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166ec95d-51cb-4b3c-9f5b-62699fa94878 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.518557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166ec95d-51cb-4b3c-9f5b-62699fa94878 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.519238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166ec95d-51cb-4b3c-9f5b-62699fa94878 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.520168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166ec95d-51cb-4b3c-9f5b-62699fa94878 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.526570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166ec95d-51cb-4b3c-9f5b-62699fa94878 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.527334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166ec95d-51cb-4b3c-9f5b-62699fa94878 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.763918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-166ec95d-51cb-4b3c-9f5b-62699fa94878 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:44.778577 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-166ec95d-51cb-4b3c-9f5b-62699fa94878 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1262 microversion: 2.1 time: 0.305787 Oct 29 02:47:44.779352 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 313/623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:44 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1262 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:44.794022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:44.794022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:44.818673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.821612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.823938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.827785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.828348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.829414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:45.061607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:45.099152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:45.104380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:45.108068 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b279da9-57bf-422b-98be-5b53edea32b9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1319 microversion: 2.25 time: 0.321673 Oct 29 02:47:45.109292 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 314/624] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:44 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:45.119675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f183a250-7984-469e-96d7-6638d1272138 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:45.121056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f183a250-7984-469e-96d7-6638d1272138 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:45.138149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f183a250-7984-469e-96d7-6638d1272138 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:45.138938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f183a250-7984-469e-96d7-6638d1272138 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:45.141747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f183a250-7984-469e-96d7-6638d1272138 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:45.143122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f183a250-7984-469e-96d7-6638d1272138 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:45.144953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f183a250-7984-469e-96d7-6638d1272138 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:45.146020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f183a250-7984-469e-96d7-6638d1272138 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:45.148363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d0b8c6f7-ce6c-485d-89d8-64295e9e8ec7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:45.155227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:45.167107 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d0b8c6f7-ce6c-485d-89d8-64295e9e8ec7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1318 microversion: 2.1 time: 0.732643 Oct 29 02:47:45.173237 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 311/625] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:44 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1318 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:45.460657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c4978bc5-a964-496c-bc62-93645dca639b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:45.461928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c4978bc5-a964-496c-bc62-93645dca639b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:45.512930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4978bc5-a964-496c-bc62-93645dca639b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:45.513678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4978bc5-a964-496c-bc62-93645dca639b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:45.516905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4978bc5-a964-496c-bc62-93645dca639b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:45.519302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4978bc5-a964-496c-bc62-93645dca639b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:45.521235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4978bc5-a964-496c-bc62-93645dca639b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:45.525329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4978bc5-a964-496c-bc62-93645dca639b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:45.673609 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f183a250-7984-469e-96d7-6638d1272138 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1614 microversion: 2.1 time: 0.562527 Oct 29 02:47:45.695379 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 315/626] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:45 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1614 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:45.705567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2d052fbd-c3e3-425b-b7b5-4bdcc5fb11e4 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Calling method '.version_select at 0x7fe1a8eb6dc0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:45.716740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d052fbd-c3e3-425b-b7b5-4bdcc5fb11e4 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:45.724313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d052fbd-c3e3-425b-b7b5-4bdcc5fb11e4 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:45.725349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d052fbd-c3e3-425b-b7b5-4bdcc5fb11e4 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:45.753716 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2d052fbd-c3e3-425b-b7b5-4bdcc5fb11e4 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.051678 Oct 29 02:47:45.771293 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 316/627] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:47:45 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:45.801199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25ab5a31-625a-4bfb-9f13-945bfd4f4093 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:45.801831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25ab5a31-625a-4bfb-9f13-945bfd4f4093 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:45.830462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25ab5a31-625a-4bfb-9f13-945bfd4f4093 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:45.830998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25ab5a31-625a-4bfb-9f13-945bfd4f4093 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:45.831447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25ab5a31-625a-4bfb-9f13-945bfd4f4093 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:45.832196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25ab5a31-625a-4bfb-9f13-945bfd4f4093 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:45.832655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25ab5a31-625a-4bfb-9f13-945bfd4f4093 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:45.833077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25ab5a31-625a-4bfb-9f13-945bfd4f4093 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.060014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25ab5a31-625a-4bfb-9f13-945bfd4f4093 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:46.076513 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25ab5a31-625a-4bfb-9f13-945bfd4f4093 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1268 microversion: 2.1 time: 0.279751 Oct 29 02:47:46.085857 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 317/628] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:45 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1268 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:46.087212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-982916603", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:46.227561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:46.985909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c4978bc5-a964-496c-bc62-93645dca639b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:46.997889 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c4978bc5-a964-496c-bc62-93645dca639b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1317 microversion: 2.1 time: 1.541492 Oct 29 02:47:47.022485 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 312/629] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:45 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1317 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:47.031986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:47.032901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:47.043655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.044677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.045599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.049280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.050276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.051022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.552266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:47.563623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:47.567458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:47.571003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f7052b88-aae0-4177-adb4-41454dee9b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1361 microversion: 2.25 time: 0.543548 Oct 29 02:47:47.573258 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 313/630] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:47 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1361 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:47.608921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-329f8268-9e63-4227-8ccc-04ff533e94df tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:47.609718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-329f8268-9e63-4227-8ccc-04ff533e94df tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:47.624877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329f8268-9e63-4227-8ccc-04ff533e94df tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.626996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329f8268-9e63-4227-8ccc-04ff533e94df tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.628273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329f8268-9e63-4227-8ccc-04ff533e94df tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.630641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329f8268-9e63-4227-8ccc-04ff533e94df tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.631264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329f8268-9e63-4227-8ccc-04ff533e94df tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.634042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329f8268-9e63-4227-8ccc-04ff533e94df tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.769439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:47.769996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:47.770370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:47.770781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:47.771193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:47.786520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.793075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.793819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.794789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.795414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.796016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.835147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for project bb5aec15c4e844b2872c9eab52f69482. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:47.839895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for user efecedc77d3048c4a0ec0fe6701f9ccc and project bb5aec15c4e844b2872c9eab52f69482. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:47.867636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:47.870757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:47.929556 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a7082b93-9ab0-4cde-aed1-b98ddad4dd16 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.846128 Oct 29 02:47:47.939945 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 318/631] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:47:47.945192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-65392bb3-1280-4d3c-bda2-bed3d6f3af2d req-f262b035-8919-42d7-ac93-ab8888e05aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a17fee50-82f1-461d-9889-b0f25961ae1b", "tag": "37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:47.964012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-65392bb3-1280-4d3c-bda2-bed3d6f3af2d req-f262b035-8919-42d7-ac93-ab8888e05aea service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.964665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-65392bb3-1280-4d3c-bda2-bed3d6f3af2d req-f262b035-8919-42d7-ac93-ab8888e05aea service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.965557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-65392bb3-1280-4d3c-bda2-bed3d6f3af2d req-f262b035-8919-42d7-ac93-ab8888e05aea service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.977413 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-65392bb3-1280-4d3c-bda2-bed3d6f3af2d req-f262b035-8919-42d7-ac93-ab8888e05aea service nova] Creating event network-changed:37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1 for instance a17fee50-82f1-461d-9889-b0f25961ae1b on n-h1-862964-4 Oct 29 02:47:47.983551 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-65392bb3-1280-4d3c-bda2-bed3d6f3af2d req-f262b035-8919-42d7-ac93-ab8888e05aea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041972 Oct 29 02:47:47.985447 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 319/632] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:47.990745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0f819c13-66fa-49b8-ba53-240bde53e25f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:47.991657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0f819c13-66fa-49b8-ba53-240bde53e25f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:47.999151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f819c13-66fa-49b8-ba53-240bde53e25f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.999886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f819c13-66fa-49b8-ba53-240bde53e25f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:48.000477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f819c13-66fa-49b8-ba53-240bde53e25f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:48.001582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f819c13-66fa-49b8-ba53-240bde53e25f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:48.002225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f819c13-66fa-49b8-ba53-240bde53e25f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:48.002963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f819c13-66fa-49b8-ba53-240bde53e25f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:48.140935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0f819c13-66fa-49b8-ba53-240bde53e25f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:48.152092 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0f819c13-66fa-49b8-ba53-240bde53e25f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1268 microversion: 2.1 time: 0.165383 Oct 29 02:47:48.159522 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 320/633] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:47 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:48.167705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-85e98f5b-b822-449d-94e4-7e34cb24453b req-5aae989e-88a6-44d7-ab04-4cfe3564d26b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c375224-e74e-4e93-934a-e38f06c2a47f", "name": "network-vif-plugged", "status": "completed", "tag": "020f55b9-e5ef-4544-8e6b-f7fe204c8723"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:48.188626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-85e98f5b-b822-449d-94e4-7e34cb24453b req-5aae989e-88a6-44d7-ab04-4cfe3564d26b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:48.191630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-85e98f5b-b822-449d-94e4-7e34cb24453b req-5aae989e-88a6-44d7-ab04-4cfe3564d26b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:48.194021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-85e98f5b-b822-449d-94e4-7e34cb24453b req-5aae989e-88a6-44d7-ab04-4cfe3564d26b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:48.221095 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-85e98f5b-b822-449d-94e4-7e34cb24453b req-5aae989e-88a6-44d7-ab04-4cfe3564d26b service nova] Creating event network-vif-plugged:020f55b9-e5ef-4544-8e6b-f7fe204c8723 for instance 9c375224-e74e-4e93-934a-e38f06c2a47f on n-h2-862964-4 Oct 29 02:47:48.229478 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-85e98f5b-b822-449d-94e4-7e34cb24453b req-5aae989e-88a6-44d7-ab04-4cfe3564d26b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068373 Oct 29 02:47:48.231057 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 321/634] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:48.239026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15e3a81f-7686-4240-80a2-1994faacb6a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:48.260569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-15e3a81f-7686-4240-80a2-1994faacb6a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:48.392365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15e3a81f-7686-4240-80a2-1994faacb6a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:48.401062 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-15e3a81f-7686-4240-80a2-1994faacb6a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1212 microversion: 2.1 time: 0.168502 Oct 29 02:47:48.403982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 322/635] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:48 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1212 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:48.411991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-713640fa-03ef-4611-afa2-1e639a0e779b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:48.418261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-713640fa-03ef-4611-afa2-1e639a0e779b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:48.438372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-713640fa-03ef-4611-afa2-1e639a0e779b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:48.441634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-713640fa-03ef-4611-afa2-1e639a0e779b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:48.442705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-713640fa-03ef-4611-afa2-1e639a0e779b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:48.445115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-713640fa-03ef-4611-afa2-1e639a0e779b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:48.449717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-713640fa-03ef-4611-afa2-1e639a0e779b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:48.450222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-713640fa-03ef-4611-afa2-1e639a0e779b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:48.475551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-329f8268-9e63-4227-8ccc-04ff533e94df tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:48.484642 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-329f8268-9e63-4227-8ccc-04ff533e94df tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1318 microversion: 2.1 time: 0.893089 Oct 29 02:47:48.499523 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 314/636] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:47 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1318 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:48.600488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:48.602509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:48.614665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:48.616842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:48.617414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:48.623903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:48.625840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:48.627145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:48.803742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-713640fa-03ef-4611-afa2-1e639a0e779b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:48.832539 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-713640fa-03ef-4611-afa2-1e639a0e779b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1317 microversion: 2.1 time: 0.425405 Oct 29 02:47:48.834489 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 323/637] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:48 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:49.186351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b7d4484-5c36-42a2-8d58-db3b26ca79b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:49.187198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7b7d4484-5c36-42a2-8d58-db3b26ca79b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:49.195145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b7d4484-5c36-42a2-8d58-db3b26ca79b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:49.195631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b7d4484-5c36-42a2-8d58-db3b26ca79b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:49.209654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b7d4484-5c36-42a2-8d58-db3b26ca79b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:49.210845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b7d4484-5c36-42a2-8d58-db3b26ca79b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:49.214753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b7d4484-5c36-42a2-8d58-db3b26ca79b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:49.215139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b7d4484-5c36-42a2-8d58-db3b26ca79b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:49.339441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:49.359973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:49.362183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:49.363715 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3ba5e9f3-4d45-429e-b9d8-7a565edcfeb2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1361 microversion: 2.25 time: 0.769107 Oct 29 02:47:49.364738 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 315/638] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:48 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1361 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:47:49.428312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7b98b6be-d6ef-4660-8318-0080fa35a1db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:49.429348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7b98b6be-d6ef-4660-8318-0080fa35a1db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:49.438299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b98b6be-d6ef-4660-8318-0080fa35a1db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:49.439184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b98b6be-d6ef-4660-8318-0080fa35a1db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:49.439891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b98b6be-d6ef-4660-8318-0080fa35a1db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:49.442214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b98b6be-d6ef-4660-8318-0080fa35a1db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:49.443017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b98b6be-d6ef-4660-8318-0080fa35a1db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:49.443661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b98b6be-d6ef-4660-8318-0080fa35a1db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:49.465561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7b7d4484-5c36-42a2-8d58-db3b26ca79b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:49.475716 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7b7d4484-5c36-42a2-8d58-db3b26ca79b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1310 microversion: 2.1 time: 0.294432 Oct 29 02:47:49.476618 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 324/639] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:49 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1310 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:49.516370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ccb8d426-1203-4792-a411-a3bfa10998d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:49.517441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ccb8d426-1203-4792-a411-a3bfa10998d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:49.524915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccb8d426-1203-4792-a411-a3bfa10998d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:49.526187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccb8d426-1203-4792-a411-a3bfa10998d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:49.526869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccb8d426-1203-4792-a411-a3bfa10998d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:49.528072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccb8d426-1203-4792-a411-a3bfa10998d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:49.528743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccb8d426-1203-4792-a411-a3bfa10998d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:49.529696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccb8d426-1203-4792-a411-a3bfa10998d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:49.590631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b98b6be-d6ef-4660-8318-0080fa35a1db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:49.608926 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7b98b6be-d6ef-4660-8318-0080fa35a1db tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1264 microversion: 2.1 time: 0.185522 Oct 29 02:47:49.610840 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 316/640] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:49 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:49.698114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ccb8d426-1203-4792-a411-a3bfa10998d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:49.707110 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ccb8d426-1203-4792-a411-a3bfa10998d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1318 microversion: 2.1 time: 0.198275 Oct 29 02:47:49.708418 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 325/641] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:49 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:49.858559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a4141a53-0b5e-4611-ad61-e9acb37fc530 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:49.859297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a4141a53-0b5e-4611-ad61-e9acb37fc530 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:49.874666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4141a53-0b5e-4611-ad61-e9acb37fc530 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:49.876484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4141a53-0b5e-4611-ad61-e9acb37fc530 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:49.877937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4141a53-0b5e-4611-ad61-e9acb37fc530 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:49.892456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4141a53-0b5e-4611-ad61-e9acb37fc530 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:49.892959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4141a53-0b5e-4611-ad61-e9acb37fc530 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:49.893395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4141a53-0b5e-4611-ad61-e9acb37fc530 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.228217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a4141a53-0b5e-4611-ad61-e9acb37fc530 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:50.237581 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a4141a53-0b5e-4611-ad61-e9acb37fc530 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1317 microversion: 2.1 time: 0.384472 Oct 29 02:47:50.241296 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 317/642] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:49 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:50.393324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:50.393939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:50.405569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:50.406045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:50.406468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.407181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:50.407634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:50.408050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.465890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:50.500546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1af50367-6eb0-4feb-9bea-1b267f377b3a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:50.501157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1af50367-6eb0-4feb-9bea-1b267f377b3a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:50.513612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:50.514559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:50.516989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1af50367-6eb0-4feb-9bea-1b267f377b3a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:50.517606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1af50367-6eb0-4feb-9bea-1b267f377b3a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:50.518260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1af50367-6eb0-4feb-9bea-1b267f377b3a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.523797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1af50367-6eb0-4feb-9bea-1b267f377b3a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:50.523797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1af50367-6eb0-4feb-9bea-1b267f377b3a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:50.523797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1af50367-6eb0-4feb-9bea-1b267f377b3a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.730826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:50.739442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:50.740903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:50.749304 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-899e75e9-d61c-4937-bdd2-33f2438002ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1361 microversion: 2.25 time: 0.360620 Oct 29 02:47:50.749947 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 326/643] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:50 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:50.786904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-a574ec76-f17f-4ab6-a432-47f58acf5594 req-49bb15f4-2bfc-4630-99bc-1589817801b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981cdc70-e4e6-4431-a243-068d39d4160d", "tag": "1861c328-f726-4893-80d7-4debdd4d709b"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:50.800968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a574ec76-f17f-4ab6-a432-47f58acf5594 req-49bb15f4-2bfc-4630-99bc-1589817801b5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:50.801497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a574ec76-f17f-4ab6-a432-47f58acf5594 req-49bb15f4-2bfc-4630-99bc-1589817801b5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:50.802495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a574ec76-f17f-4ab6-a432-47f58acf5594 req-49bb15f4-2bfc-4630-99bc-1589817801b5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.848773 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-a574ec76-f17f-4ab6-a432-47f58acf5594 req-49bb15f4-2bfc-4630-99bc-1589817801b5 service nova] Creating event network-changed:1861c328-f726-4893-80d7-4debdd4d709b for instance 981cdc70-e4e6-4431-a243-068d39d4160d on n-h1-862964-4 Oct 29 02:47:50.857451 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-a574ec76-f17f-4ab6-a432-47f58acf5594 req-49bb15f4-2bfc-4630-99bc-1589817801b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082074 Oct 29 02:47:50.858469 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 327/644] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:50.870869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b6f0e43d-0a44-4596-b632-904b4966a51a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:50.874476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b6f0e43d-0a44-4596-b632-904b4966a51a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:50.884460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f0e43d-0a44-4596-b632-904b4966a51a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:50.885243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f0e43d-0a44-4596-b632-904b4966a51a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:50.885874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f0e43d-0a44-4596-b632-904b4966a51a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.886826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f0e43d-0a44-4596-b632-904b4966a51a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:50.887426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f0e43d-0a44-4596-b632-904b4966a51a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:50.887985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f0e43d-0a44-4596-b632-904b4966a51a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.986744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b6f0e43d-0a44-4596-b632-904b4966a51a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:50.993890 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b6f0e43d-0a44-4596-b632-904b4966a51a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1270 microversion: 2.1 time: 0.134199 Oct 29 02:47:50.995035 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 328/645] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:50 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:51.000499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8dc2c7fd-3b0f-420f-b137-08831d140bfa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:51.001276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8dc2c7fd-3b0f-420f-b137-08831d140bfa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:51.007730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dc2c7fd-3b0f-420f-b137-08831d140bfa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.011607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dc2c7fd-3b0f-420f-b137-08831d140bfa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.015459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dc2c7fd-3b0f-420f-b137-08831d140bfa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.016216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dc2c7fd-3b0f-420f-b137-08831d140bfa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.016707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dc2c7fd-3b0f-420f-b137-08831d140bfa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.017118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dc2c7fd-3b0f-420f-b137-08831d140bfa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.197093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1af50367-6eb0-4feb-9bea-1b267f377b3a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:51.226646 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1af50367-6eb0-4feb-9bea-1b267f377b3a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1310 microversion: 2.1 time: 0.728260 Oct 29 02:47:51.230651 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 318/646] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:50 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1310 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:51.265336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90f44fce-d873-47b8-b03c-9d63a26e9b3d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:51.266698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-90f44fce-d873-47b8-b03c-9d63a26e9b3d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:51.279445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90f44fce-d873-47b8-b03c-9d63a26e9b3d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.281465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90f44fce-d873-47b8-b03c-9d63a26e9b3d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.284390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90f44fce-d873-47b8-b03c-9d63a26e9b3d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.285877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90f44fce-d873-47b8-b03c-9d63a26e9b3d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.286369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90f44fce-d873-47b8-b03c-9d63a26e9b3d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.287824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90f44fce-d873-47b8-b03c-9d63a26e9b3d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.342869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8dc2c7fd-3b0f-420f-b137-08831d140bfa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:51.358941 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8dc2c7fd-3b0f-420f-b137-08831d140bfa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1468 microversion: 2.1 time: 0.362241 Oct 29 02:47:51.360119 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 329/647] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:50 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1468 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:51.384492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fa3fa888-a4dd-403d-a1e6-6da11ead21b1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:51.385332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fa3fa888-a4dd-403d-a1e6-6da11ead21b1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:51.403249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa3fa888-a4dd-403d-a1e6-6da11ead21b1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.403903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa3fa888-a4dd-403d-a1e6-6da11ead21b1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.404413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa3fa888-a4dd-403d-a1e6-6da11ead21b1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.405228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa3fa888-a4dd-403d-a1e6-6da11ead21b1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.405954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa3fa888-a4dd-403d-a1e6-6da11ead21b1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.406596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa3fa888-a4dd-403d-a1e6-6da11ead21b1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.631161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-90f44fce-d873-47b8-b03c-9d63a26e9b3d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:51.647064 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90f44fce-d873-47b8-b03c-9d63a26e9b3d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1317 microversion: 2.1 time: 0.386474 Oct 29 02:47:51.654498 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 319/648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:51 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:51.780153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:51.781087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:51.789135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.789977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.790839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.794523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.795263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.795860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.992733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fa3fa888-a4dd-403d-a1e6-6da11ead21b1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:52.003352 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fa3fa888-a4dd-403d-a1e6-6da11ead21b1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381" status: 200 len: 1468 microversion: 2.1 time: 0.622600 Oct 29 02:47:52.004548 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 330/649] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:51 2022] GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381 => generated 1468 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:52.024128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1622a25a-6ec6-4a22-b41b-9b171e4602aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:52.025127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1622a25a-6ec6-4a22-b41b-9b171e4602aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:52.033118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1622a25a-6ec6-4a22-b41b-9b171e4602aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.033910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1622a25a-6ec6-4a22-b41b-9b171e4602aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.034500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1622a25a-6ec6-4a22-b41b-9b171e4602aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.035368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1622a25a-6ec6-4a22-b41b-9b171e4602aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.035975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1622a25a-6ec6-4a22-b41b-9b171e4602aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.036555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1622a25a-6ec6-4a22-b41b-9b171e4602aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.350523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1622a25a-6ec6-4a22-b41b-9b171e4602aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:52.364012 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1622a25a-6ec6-4a22-b41b-9b171e4602aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1312 microversion: 2.1 time: 0.348027 Oct 29 02:47:52.365598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:52.367519 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 331/650] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:52 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1312 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:52.386637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:52.402952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:52.404771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:52.408587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:52.410153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Searching by: {'reservation_id': 'r-7gvdbh9i', 'deleted': False, 'project_id': '1031cc111cc747098bbc8a428c1cfad6'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:47:52.421953 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-38b2cf90-0cf2-4ac3-9be6-2c212794cb68 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1361 microversion: 2.25 time: 0.638951 Oct 29 02:47:52.422955 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 320/651] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:51 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1361 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:47:52.428166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-12c4fba1-b83c-45ef-b658-9fe518fa17a2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:52.432913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-12c4fba1-b83c-45ef-b658-9fe518fa17a2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:52.435540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.436640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.439430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.440528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.442726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.444545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.453421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12c4fba1-b83c-45ef-b658-9fe518fa17a2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.453960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12c4fba1-b83c-45ef-b658-9fe518fa17a2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.454446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12c4fba1-b83c-45ef-b658-9fe518fa17a2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.464561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12c4fba1-b83c-45ef-b658-9fe518fa17a2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.465264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12c4fba1-b83c-45ef-b658-9fe518fa17a2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.474493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12c4fba1-b83c-45ef-b658-9fe518fa17a2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.656189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:47:52.817367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:52.827229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.828184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.828915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.856922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-12c4fba1-b83c-45ef-b658-9fe518fa17a2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:52.866764 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-12c4fba1-b83c-45ef-b658-9fe518fa17a2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1310 microversion: 2.1 time: 0.442347 Oct 29 02:47:52.868577 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 321/652] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:52 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1310 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:52.874903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be65d4b9-fa1c-4088-80d4-e86893623fad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:52.875815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-be65d4b9-fa1c-4088-80d4-e86893623fad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:52.885857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be65d4b9-fa1c-4088-80d4-e86893623fad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.887474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be65d4b9-fa1c-4088-80d4-e86893623fad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.887914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be65d4b9-fa1c-4088-80d4-e86893623fad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.888625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be65d4b9-fa1c-4088-80d4-e86893623fad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.889846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be65d4b9-fa1c-4088-80d4-e86893623fad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.890267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be65d4b9-fa1c-4088-80d4-e86893623fad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.982658 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0dfe2ddf-be2b-4f25-a8eb-01cf77f9eef4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-7gvdbh9i" status: 200 len: 2929 microversion: 2.1 time: 0.610865 Oct 29 02:47:52.983297 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 332/653] 10.222.0.16 () {58 vars in 1197 bytes} [Sat Oct 29 02:47:52 2022] GET /compute/v2.1/servers/detail?reservation_id=r-7gvdbh9i => generated 2929 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:52.987862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c2bcb6b7-c963-49ae-a132-317b4ca53997 req-5b394075-9ac0-481b-a19a-947895b3d0dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17fee50-82f1-461d-9889-b0f25961ae1b", "name": "network-vif-plugged", "status": "completed", "tag": "37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:52.998616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c2bcb6b7-c963-49ae-a132-317b4ca53997 req-5b394075-9ac0-481b-a19a-947895b3d0dc service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.999088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c2bcb6b7-c963-49ae-a132-317b4ca53997 req-5b394075-9ac0-481b-a19a-947895b3d0dc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.999507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c2bcb6b7-c963-49ae-a132-317b4ca53997 req-5b394075-9ac0-481b-a19a-947895b3d0dc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.010412 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c2bcb6b7-c963-49ae-a132-317b4ca53997 req-5b394075-9ac0-481b-a19a-947895b3d0dc service nova] Creating event network-vif-plugged:37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1 for instance a17fee50-82f1-461d-9889-b0f25961ae1b on n-h1-862964-4 Oct 29 02:47:53.015478 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c2bcb6b7-c963-49ae-a132-317b4ca53997 req-5b394075-9ac0-481b-a19a-947895b3d0dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031025 Oct 29 02:47:53.016504 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 333/654] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:53.022047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-390faf14-fd9c-4407-939b-4aeecb1e4ccd req-edd8d905-8c54-4724-9f9e-77cbe4f7a7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c953eb9c-9ad8-471d-95d6-f95740b8b7f2", "tag": "ac90b439-6117-4e0a-8668-61ae3bc23afb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:53.032493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-390faf14-fd9c-4407-939b-4aeecb1e4ccd req-edd8d905-8c54-4724-9f9e-77cbe4f7a7c1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.032969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-390faf14-fd9c-4407-939b-4aeecb1e4ccd req-edd8d905-8c54-4724-9f9e-77cbe4f7a7c1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.033395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-390faf14-fd9c-4407-939b-4aeecb1e4ccd req-edd8d905-8c54-4724-9f9e-77cbe4f7a7c1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.044817 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-390faf14-fd9c-4407-939b-4aeecb1e4ccd req-edd8d905-8c54-4724-9f9e-77cbe4f7a7c1 service nova] Creating event network-changed:ac90b439-6117-4e0a-8668-61ae3bc23afb for instance c953eb9c-9ad8-471d-95d6-f95740b8b7f2 on n-h2-862964-4 Oct 29 02:47:53.049664 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-390faf14-fd9c-4407-939b-4aeecb1e4ccd req-edd8d905-8c54-4724-9f9e-77cbe4f7a7c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031759 Oct 29 02:47:53.050335 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 334/655] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:53.055236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-680cad33-d30d-4acf-84c3-5739ca9f3316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:53.070672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.compute.server_groups [None req-680cad33-d30d-4acf-84c3-5739ca9f3316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Querying cell 6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) for 2 instances {{(pid=127041) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 02:47:53.071493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-680cad33-d30d-4acf-84c3-5739ca9f3316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.072238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-680cad33-d30d-4acf-84c3-5739ca9f3316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.072675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-680cad33-d30d-4acf-84c3-5739ca9f3316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.086263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-be65d4b9-fa1c-4088-80d4-e86893623fad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:53.095192 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be65d4b9-fa1c-4088-80d4-e86893623fad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1317 microversion: 2.1 time: 0.225236 Oct 29 02:47:53.104631 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-680cad33-d30d-4acf-84c3-5739ca9f3316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/493015c5-e33b-49ac-b057-228eb0d71581" status: 200 len: 266 microversion: 2.1 time: 0.052624 Oct 29 02:47:53.104812 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 322/656] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:52 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:53.105014 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 335/657] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 02:47:53 2022] GET /compute/v2.1/os-server-groups/493015c5-e33b-49ac-b057-228eb0d71581 => generated 266 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:53.115663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5531295c-ba5b-4805-aebd-6b615bf67db9 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:53.116323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5531295c-ba5b-4805-aebd-6b615bf67db9 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:53.122876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5531295c-ba5b-4805-aebd-6b615bf67db9 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.123473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5531295c-ba5b-4805-aebd-6b615bf67db9 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.123973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5531295c-ba5b-4805-aebd-6b615bf67db9 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.124784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5531295c-ba5b-4805-aebd-6b615bf67db9 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.125295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5531295c-ba5b-4805-aebd-6b615bf67db9 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.125779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5531295c-ba5b-4805-aebd-6b615bf67db9 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.267325 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5531295c-ba5b-4805-aebd-6b615bf67db9 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 200 len: 1619 microversion: 2.1 time: 0.155191 Oct 29 02:47:53.267914 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 323/658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:53 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 1619 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:53.288961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a4608233-179e-47a6-a553-bc19f76099cb tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:53.289693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a4608233-179e-47a6-a553-bc19f76099cb tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:53.295818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4608233-179e-47a6-a553-bc19f76099cb tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.296301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4608233-179e-47a6-a553-bc19f76099cb tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.296914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4608233-179e-47a6-a553-bc19f76099cb tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.297618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4608233-179e-47a6-a553-bc19f76099cb tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.298095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4608233-179e-47a6-a553-bc19f76099cb tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.298682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4608233-179e-47a6-a553-bc19f76099cb tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.394805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa4e012c-e748-4ae0-a1b1-5d74e4d70475 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:53.395413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fa4e012c-e748-4ae0-a1b1-5d74e4d70475 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:53.401668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4e012c-e748-4ae0-a1b1-5d74e4d70475 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.402174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4e012c-e748-4ae0-a1b1-5d74e4d70475 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.402602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4e012c-e748-4ae0-a1b1-5d74e4d70475 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.403297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4e012c-e748-4ae0-a1b1-5d74e4d70475 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.403744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4e012c-e748-4ae0-a1b1-5d74e4d70475 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.404157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa4e012c-e748-4ae0-a1b1-5d74e4d70475 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.459710 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a4608233-179e-47a6-a553-bc19f76099cb tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381" status: 200 len: 1619 microversion: 2.1 time: 0.174345 Oct 29 02:47:53.460462 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 336/659] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:53 2022] GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381 => generated 1619 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:53.466102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:53.466703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:53.472434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.472907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.473370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.474080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.474527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.474970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.618732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fa4e012c-e748-4ae0-a1b1-5d74e4d70475 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:53.630535 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fa4e012c-e748-4ae0-a1b1-5d74e4d70475 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1312 microversion: 2.1 time: 0.239592 Oct 29 02:47:53.633683 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 324/660] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:53 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:53.638846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a39781f1-54b4-4a38-9a8e-9b53b4670e73 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Action: 'create', calling method: .version_select at 0x7fe1a8c73af0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2080155547", "policies": ["anti-affinity"]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:53.660714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a39781f1-54b4-4a38-9a8e-9b53b4670e73 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:53.665649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a39781f1-54b4-4a38-9a8e-9b53b4670e73 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:53.735575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a39781f1-54b4-4a38-9a8e-9b53b4670e73 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:53.740410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a39781f1-54b4-4a38-9a8e-9b53b4670e73 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:53.741395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:53.754184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:53.755686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:53.756807 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29eb43e0-7e90-4931-b646-5fc400b9efc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1361 microversion: 2.25 time: 0.295277 Oct 29 02:47:53.761635 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 337/661] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:53 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1361 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:53.767767 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a39781f1-54b4-4a38-9a8e-9b53b4670e73 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.132658 Oct 29 02:47:53.770342 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 325/662] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Oct 29 02:47:53 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:53.895439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6c0985a8-89b4-4958-b87a-3446b5bb6022 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:53.896265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6c0985a8-89b4-4958-b87a-3446b5bb6022 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:53.900265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-578132238", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "731c01cd-87d0-4608-800c-5f6c8c707a9e"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:53.910220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0985a8-89b4-4958-b87a-3446b5bb6022 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.910717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0985a8-89b4-4958-b87a-3446b5bb6022 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.911146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0985a8-89b4-4958-b87a-3446b5bb6022 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.911856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0985a8-89b4-4958-b87a-3446b5bb6022 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.912303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0985a8-89b4-4958-b87a-3446b5bb6022 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.912717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0985a8-89b4-4958-b87a-3446b5bb6022 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.980852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:54.083455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6c0985a8-89b4-4958-b87a-3446b5bb6022 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:54.092126 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6c0985a8-89b4-4958-b87a-3446b5bb6022 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1310 microversion: 2.1 time: 0.201318 Oct 29 02:47:54.092788 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 326/663] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:53 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1310 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:54.118742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e4b51d28-a4a4-4e70-9922-f7d9b013ed91 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:54.119518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e4b51d28-a4a4-4e70-9922-f7d9b013ed91 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:54.126077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4b51d28-a4a4-4e70-9922-f7d9b013ed91 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:54.126742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4b51d28-a4a4-4e70-9922-f7d9b013ed91 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:54.127219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4b51d28-a4a4-4e70-9922-f7d9b013ed91 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:54.127861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4b51d28-a4a4-4e70-9922-f7d9b013ed91 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:54.128458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4b51d28-a4a4-4e70-9922-f7d9b013ed91 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:54.128895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4b51d28-a4a4-4e70-9922-f7d9b013ed91 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:54.298753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e4b51d28-a4a4-4e70-9922-f7d9b013ed91 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:54.311110 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e4b51d28-a4a4-4e70-9922-f7d9b013ed91 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1317 microversion: 2.1 time: 0.194899 Oct 29 02:47:54.313148 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 327/664] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:54 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:54.358754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:54.359405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:54.359873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:54.360275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:54.360681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:54.377464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:54.378294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:54.378906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:54.380319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:54.380959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:54.381528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:54.402035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:54.408446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:54.428113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Going to run 2 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:54.431758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: e28d98f2-e795-480d-974a-094260081964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:54.495572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:54.501273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:54.520066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:54.561130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:54.575622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:54.593038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=e28d98f2-e795-480d-974a-094260081964,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:54.655081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:54.656608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-770e5f0f-7784-4286-9f7d-17f1b058aba4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:54.657207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-770e5f0f-7784-4286-9f7d-17f1b058aba4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:54.662088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:54.669909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770e5f0f-7784-4286-9f7d-17f1b058aba4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:54.670643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770e5f0f-7784-4286-9f7d-17f1b058aba4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:54.671222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770e5f0f-7784-4286-9f7d-17f1b058aba4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:54.672573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770e5f0f-7784-4286-9f7d-17f1b058aba4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:54.674567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770e5f0f-7784-4286-9f7d-17f1b058aba4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:54.675153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770e5f0f-7784-4286-9f7d-17f1b058aba4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:54.741950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:54.748734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:54.821519 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2dbbd1af-a809-432f-b015-2e5c52dd6482 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.930555 Oct 29 02:47:54.825586 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 338/665] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 935 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:47:54.835920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8eee1b13-e946-441d-8c70-571b6f53a900 req-3bd50f62-d385-42fe-a3f5-2375d7ca92e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39", "tag": "2aee52dc-63e0-47de-821b-34b98b339294"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:54.848242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8eee1b13-e946-441d-8c70-571b6f53a900 req-3bd50f62-d385-42fe-a3f5-2375d7ca92e7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:54.848874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8eee1b13-e946-441d-8c70-571b6f53a900 req-3bd50f62-d385-42fe-a3f5-2375d7ca92e7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:54.849654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8eee1b13-e946-441d-8c70-571b6f53a900 req-3bd50f62-d385-42fe-a3f5-2375d7ca92e7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:54.874338 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8eee1b13-e946-441d-8c70-571b6f53a900 req-3bd50f62-d385-42fe-a3f5-2375d7ca92e7 service nova] Creating event network-changed:2aee52dc-63e0-47de-821b-34b98b339294 for instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 on n-h1-862964-4 Oct 29 02:47:54.880567 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8eee1b13-e946-441d-8c70-571b6f53a900 req-3bd50f62-d385-42fe-a3f5-2375d7ca92e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053208 Oct 29 02:47:54.881782 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 339/666] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:54.888503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:54.889345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:54.897946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:54.898265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:54.898833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:54.899985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:54.900541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:54.901066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.090423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-770e5f0f-7784-4286-9f7d-17f1b058aba4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:55.099226 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-770e5f0f-7784-4286-9f7d-17f1b058aba4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1312 microversion: 2.1 time: 0.446883 Oct 29 02:47:55.100707 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 328/667] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:54 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1312 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:55.107103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bc5cb16d-5bd1-4a8d-859c-4159e898befb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:55.112722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bc5cb16d-5bd1-4a8d-859c-4159e898befb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:55.113706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bc5cb16d-5bd1-4a8d-859c-4159e898befb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Searching by: {'deleted': False, 'project_id': '1031cc111cc747098bbc8a428c1cfad6'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:47:55.135052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc5cb16d-5bd1-4a8d-859c-4159e898befb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.135749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc5cb16d-5bd1-4a8d-859c-4159e898befb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.136505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc5cb16d-5bd1-4a8d-859c-4159e898befb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.137536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc5cb16d-5bd1-4a8d-859c-4159e898befb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.138557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc5cb16d-5bd1-4a8d-859c-4159e898befb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.139265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc5cb16d-5bd1-4a8d-859c-4159e898befb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.146143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:55.157933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:55.159733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:55.161096 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-16201019-d3f7-4904-8fb1-3741dca38c19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1361 microversion: 2.25 time: 0.278167 Oct 29 02:47:55.185546 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 340/668] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:54 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:55.202167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-74a26b58-07eb-4ff2-bbf6-5830adcba01e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:55.202777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-74a26b58-07eb-4ff2-bbf6-5830adcba01e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:55.214251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-bc5cb16d-5bd1-4a8d-859c-4159e898befb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:47:55.219531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74a26b58-07eb-4ff2-bbf6-5830adcba01e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.222280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74a26b58-07eb-4ff2-bbf6-5830adcba01e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.222922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74a26b58-07eb-4ff2-bbf6-5830adcba01e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.224439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:55.225555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74a26b58-07eb-4ff2-bbf6-5830adcba01e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.226215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74a26b58-07eb-4ff2-bbf6-5830adcba01e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.228386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74a26b58-07eb-4ff2-bbf6-5830adcba01e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.277608 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bc5cb16d-5bd1-4a8d-859c-4159e898befb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.175173 Oct 29 02:47:55.280276 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 329/669] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 02:47:55 2022] GET /compute/v2.1/servers => generated 1662 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:55.291135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-01de2170-7eff-4749-aef3-8f871ce78018 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:55.294625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-01de2170-7eff-4749-aef3-8f871ce78018 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:55.388761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-01de2170-7eff-4749-aef3-8f871ce78018 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:55.398336 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-01de2170-7eff-4749-aef3-8f871ce78018 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1218 microversion: 2.1 time: 0.111150 Oct 29 02:47:55.402544 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 330/670] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:55 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:55.411325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db7cc18d-ce34-443e-bce3-d386db28280e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:55.412068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-db7cc18d-ce34-443e-bce3-d386db28280e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:55.420602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db7cc18d-ce34-443e-bce3-d386db28280e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.424951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db7cc18d-ce34-443e-bce3-d386db28280e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.433124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db7cc18d-ce34-443e-bce3-d386db28280e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.434932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db7cc18d-ce34-443e-bce3-d386db28280e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.438016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db7cc18d-ce34-443e-bce3-d386db28280e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.438768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db7cc18d-ce34-443e-bce3-d386db28280e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.530515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-74a26b58-07eb-4ff2-bbf6-5830adcba01e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:55.539294 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-74a26b58-07eb-4ff2-bbf6-5830adcba01e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1310 microversion: 2.1 time: 0.350420 Oct 29 02:47:55.554785 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 341/671] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:55 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1310 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:55.670829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-db7cc18d-ce34-443e-bce3-d386db28280e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:55.680360 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-db7cc18d-ce34-443e-bce3-d386db28280e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1466 microversion: 2.1 time: 0.276237 Oct 29 02:47:55.694568 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 331/672] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:55 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1466 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:55.706297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ae7e35ed-2fe8-4d07-aef0-46ea34f44210 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1525518730", "metadata": {"image_type": "test"}}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:55.709727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ae7e35ed-2fe8-4d07-aef0-46ea34f44210 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:55.716703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae7e35ed-2fe8-4d07-aef0-46ea34f44210 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.717404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae7e35ed-2fe8-4d07-aef0-46ea34f44210 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.718039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae7e35ed-2fe8-4d07-aef0-46ea34f44210 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.719098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae7e35ed-2fe8-4d07-aef0-46ea34f44210 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.720112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae7e35ed-2fe8-4d07-aef0-46ea34f44210 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.720752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae7e35ed-2fe8-4d07-aef0-46ea34f44210 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.761780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-ae7e35ed-2fe8-4d07-aef0-46ea34f44210 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Getting quotas for project 4ba4b121877b458092bfd5cadec5aa3d. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:55.766156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-ae7e35ed-2fe8-4d07-aef0-46ea34f44210 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Getting quotas for user 68cdeea2722e49e09ccf0b4f892906d4 and project 4ba4b121877b458092bfd5cadec5aa3d. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:55.768524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-434f3272-e5fd-4fb4-a223-6ab031945e55 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a93649d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:55.838055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-434f3272-e5fd-4fb4-a223-6ab031945e55 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.838578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-434f3272-e5fd-4fb4-a223-6ab031945e55 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.839192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-434f3272-e5fd-4fb4-a223-6ab031945e55 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.840297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-434f3272-e5fd-4fb4-a223-6ab031945e55 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.840838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-434f3272-e5fd-4fb4-a223-6ab031945e55 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.841590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-434f3272-e5fd-4fb4-a223-6ab031945e55 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.906947 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-434f3272-e5fd-4fb4-a223-6ab031945e55 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/05d87be3c6704e5aba7b381da9a28914" status: 200 len: 148 microversion: 2.57 time: 0.350798 Oct 29 02:47:55.907981 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 342/673] 10.222.0.16 () {62 vars in 1303 bytes} [Sat Oct 29 02:47:55 2022] PUT /compute/v2.1/os-quota-sets/05d87be3c6704e5aba7b381da9a28914 => generated 148 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:47:55.926470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1f654e61-5c50-4783-bb85-389be1596bac tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Calling method '.version_select at 0x7fe1a8c9c790>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:56.011523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f654e61-5c50-4783-bb85-389be1596bac tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.012257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f654e61-5c50-4783-bb85-389be1596bac tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.012746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f654e61-5c50-4783-bb85-389be1596bac tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.013700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f654e61-5c50-4783-bb85-389be1596bac tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.014374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f654e61-5c50-4783-bb85-389be1596bac tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.014812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f654e61-5c50-4783-bb85-389be1596bac tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.023653 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ae7e35ed-2fe8-4d07-aef0-46ea34f44210 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "POST /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b/action" status: 202 len: 0 microversion: 2.1 time: 0.321531 Oct 29 02:47:56.024424 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 332/674] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:47:55 2022] POST /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 29 02:47:56.033680 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1f654e61-5c50-4783-bb85-389be1596bac tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/05d87be3c6704e5aba7b381da9a28914/detail" status: 200 len: 463 microversion: 2.57 time: 0.110983 Oct 29 02:47:56.034344 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 343/675] 10.222.0.16 () {60 vars in 1304 bytes} [Sat Oct 29 02:47:55 2022] GET /compute/v2.1/os-quota-sets/05d87be3c6704e5aba7b381da9a28914/detail => generated 463 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:47:56.042971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-28bbbf97-06c1-4c8b-96d6-53f1ece0d16e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a9145940>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:56.089454 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-28bbbf97-06c1-4c8b-96d6-53f1ece0d16e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.050833 Oct 29 02:47:56.090382 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 333/676] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:56 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:56.131962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d9e6e42c-1c81-4e1c-a029-78153844532a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:56.131962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d9e6e42c-1c81-4e1c-a029-78153844532a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:56.137682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6e42c-1c81-4e1c-a029-78153844532a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.138258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6e42c-1c81-4e1c-a029-78153844532a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.138934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6e42c-1c81-4e1c-a029-78153844532a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.139689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6e42c-1c81-4e1c-a029-78153844532a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.140850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6e42c-1c81-4e1c-a029-78153844532a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.141691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6e42c-1c81-4e1c-a029-78153844532a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.177061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a8c991f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:56.247746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.248458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.248888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.249605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.250239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.250684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.282809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.283204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.283633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.284350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.284796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.285215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.292963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d9e6e42c-1c81-4e1c-a029-78153844532a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:56.301049 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d9e6e42c-1c81-4e1c-a029-78153844532a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1312 microversion: 2.1 time: 0.176666 Oct 29 02:47:56.301620 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 344/677] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:56 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:56.306312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:56.306918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:56.313031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.313579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:56.314401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.314911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.316610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.317291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.317833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.342166 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d34640c5-1ee6-4432-bfe2-9a06b521375f tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/05d87be3c6704e5aba7b381da9a28914?user_id=4da50047afff4f3ea8e2ff79edd53d8e" status: 200 len: 148 microversion: 2.57 time: 0.168901 Oct 29 02:47:56.348736 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 334/678] 10.222.0.16 () {62 vars in 1384 bytes} [Sat Oct 29 02:47:56 2022] PUT /compute/v2.1/os-quota-sets/05d87be3c6704e5aba7b381da9a28914?user_id=4da50047afff4f3ea8e2ff79edd53d8e => generated 148 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:47:56.353846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e6898f28-4965-4dd7-a812-fd4e42360d49 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Calling method '.version_select at 0x7fe1a8c1d430>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:56.446160 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e6898f28-4965-4dd7-a812-fd4e42360d49 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/05d87be3c6704e5aba7b381da9a28914?user_id=4da50047afff4f3ea8e2ff79edd53d8e" status: 200 len: 190 microversion: 2.57 time: 0.095960 Oct 29 02:47:56.447191 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 335/679] 10.222.0.16 () {60 vars in 1364 bytes} [Sat Oct 29 02:47:56 2022] GET /compute/v2.1/os-quota-sets/05d87be3c6704e5aba7b381da9a28914?user_id=4da50047afff4f3ea8e2ff79edd53d8e => generated 190 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:47:56.452163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b10aa158-46fa-4b7e-8b6b-aedc116e9fbd tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:56.457175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b10aa158-46fa-4b7e-8b6b-aedc116e9fbd tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:56.474612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b10aa158-46fa-4b7e-8b6b-aedc116e9fbd tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.475108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b10aa158-46fa-4b7e-8b6b-aedc116e9fbd tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.475539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b10aa158-46fa-4b7e-8b6b-aedc116e9fbd tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.476305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b10aa158-46fa-4b7e-8b6b-aedc116e9fbd tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.476765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b10aa158-46fa-4b7e-8b6b-aedc116e9fbd tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.477210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b10aa158-46fa-4b7e-8b6b-aedc116e9fbd tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.481747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:56.492872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:56.495467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:56.496819 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dbafabd2-2f3d-43a3-89b4-f052cfff4294 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1361 microversion: 2.25 time: 0.194108 Oct 29 02:47:56.497611 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 345/680] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:56 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:56.572187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b10aa158-46fa-4b7e-8b6b-aedc116e9fbd tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:56.585396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6915b63f-0529-4430-b666-08ac8fa82b00 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:56.586392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6915b63f-0529-4430-b666-08ac8fa82b00 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:56.597346 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b10aa158-46fa-4b7e-8b6b-aedc116e9fbd tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1222 microversion: 2.1 time: 0.149009 Oct 29 02:47:56.599376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6915b63f-0529-4430-b666-08ac8fa82b00 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.599869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6915b63f-0529-4430-b666-08ac8fa82b00 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.600525 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 336/681] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:56 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:56.600764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6915b63f-0529-4430-b666-08ac8fa82b00 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.601538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6915b63f-0529-4430-b666-08ac8fa82b00 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.602050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6915b63f-0529-4430-b666-08ac8fa82b00 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.602502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6915b63f-0529-4430-b666-08ac8fa82b00 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.759233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6915b63f-0529-4430-b666-08ac8fa82b00 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:56.771809 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6915b63f-0529-4430-b666-08ac8fa82b00 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1310 microversion: 2.1 time: 0.191562 Oct 29 02:47:56.773362 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 346/682] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:56 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1310 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:56.891341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-861418cd-ae67-4305-89f2-b43000170f34 req-05d33d50-a410-4224-b3ae-ca7718580500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c953eb9c-9ad8-471d-95d6-f95740b8b7f2", "name": "network-vif-plugged", "status": "completed", "tag": "ac90b439-6117-4e0a-8668-61ae3bc23afb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:56.905107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-861418cd-ae67-4305-89f2-b43000170f34 req-05d33d50-a410-4224-b3ae-ca7718580500 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.905513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-861418cd-ae67-4305-89f2-b43000170f34 req-05d33d50-a410-4224-b3ae-ca7718580500 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.905991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-861418cd-ae67-4305-89f2-b43000170f34 req-05d33d50-a410-4224-b3ae-ca7718580500 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.918823 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-861418cd-ae67-4305-89f2-b43000170f34 req-05d33d50-a410-4224-b3ae-ca7718580500 service nova] Creating event network-vif-plugged:ac90b439-6117-4e0a-8668-61ae3bc23afb for instance c953eb9c-9ad8-471d-95d6-f95740b8b7f2 on n-h2-862964-4 Oct 29 02:47:56.925420 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-861418cd-ae67-4305-89f2-b43000170f34 req-05d33d50-a410-4224-b3ae-ca7718580500 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037784 Oct 29 02:47:56.926465 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 337/683] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:57.107736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ca8bf736-053e-4e7e-b765-48486f56907c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c7e3a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:57.162372 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ca8bf736-053e-4e7e-b765-48486f56907c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.060633 Oct 29 02:47:57.163480 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 347/684] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:57 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:57.331462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-27441a82-1ba5-4cd7-a223-72161e9ae68e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:57.332210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-27441a82-1ba5-4cd7-a223-72161e9ae68e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:57.345238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27441a82-1ba5-4cd7-a223-72161e9ae68e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:57.345746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27441a82-1ba5-4cd7-a223-72161e9ae68e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:57.347944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27441a82-1ba5-4cd7-a223-72161e9ae68e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:57.348874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27441a82-1ba5-4cd7-a223-72161e9ae68e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:57.351163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27441a82-1ba5-4cd7-a223-72161e9ae68e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:57.352453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27441a82-1ba5-4cd7-a223-72161e9ae68e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:57.522600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:57.524296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:57.530807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:57.531289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:57.532505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:57.533452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:57.533963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:57.534396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:57.538843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:57.596822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-27441a82-1ba5-4cd7-a223-72161e9ae68e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:57.605381 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-27441a82-1ba5-4cd7-a223-72161e9ae68e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1312 microversion: 2.1 time: 0.278997 Oct 29 02:47:57.606154 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 338/685] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:57 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:57.630876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49d1da0f-56a0-49f6-afec-4fa917848ab5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:57.631784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49d1da0f-56a0-49f6-afec-4fa917848ab5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:57.641301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49d1da0f-56a0-49f6-afec-4fa917848ab5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:57.641901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49d1da0f-56a0-49f6-afec-4fa917848ab5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:57.642404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49d1da0f-56a0-49f6-afec-4fa917848ab5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:57.643337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49d1da0f-56a0-49f6-afec-4fa917848ab5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:57.644059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49d1da0f-56a0-49f6-afec-4fa917848ab5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:57.644499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49d1da0f-56a0-49f6-afec-4fa917848ab5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:57.778567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-49d1da0f-56a0-49f6-afec-4fa917848ab5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:57.793275 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-49d1da0f-56a0-49f6-afec-4fa917848ab5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1214 microversion: 2.1 time: 0.170170 Oct 29 02:47:57.805841 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 339/686] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:57 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:57.805841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5988c785-45f6-4a49-9e67-54515673f99b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:57.805841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5988c785-45f6-4a49-9e67-54515673f99b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:57.805841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5988c785-45f6-4a49-9e67-54515673f99b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:57.806319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5988c785-45f6-4a49-9e67-54515673f99b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:57.806520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5988c785-45f6-4a49-9e67-54515673f99b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:57.807398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5988c785-45f6-4a49-9e67-54515673f99b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:57.808002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5988c785-45f6-4a49-9e67-54515673f99b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:57.808574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5988c785-45f6-4a49-9e67-54515673f99b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:57.818533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:57.829021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:57.830711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:57.833316 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2cb5b76d-9a67-41d9-8b63-9f221fc20a11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1361 microversion: 2.25 time: 0.313583 Oct 29 02:47:57.846919 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 348/687] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:57 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:47:58.069170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5988c785-45f6-4a49-9e67-54515673f99b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:58.078293 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5988c785-45f6-4a49-9e67-54515673f99b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1310 microversion: 2.1 time: 0.282805 Oct 29 02:47:58.078874 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 340/688] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:57 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1310 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:58.178627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c98562eb-de3e-4489-b725-a1c8e45f860c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8e739d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:58.245940 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c98562eb-de3e-4489-b725-a1c8e45f860c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.071032 Oct 29 02:47:58.251875 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 349/689] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:58 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:58.640495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7a23878-d516-4ce5-84bb-9251b0ae1265 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:58.643081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f7a23878-d516-4ce5-84bb-9251b0ae1265 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:58.660773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a23878-d516-4ce5-84bb-9251b0ae1265 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.661262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a23878-d516-4ce5-84bb-9251b0ae1265 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.664882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a23878-d516-4ce5-84bb-9251b0ae1265 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.667799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a23878-d516-4ce5-84bb-9251b0ae1265 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.668285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a23878-d516-4ce5-84bb-9251b0ae1265 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.669934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a23878-d516-4ce5-84bb-9251b0ae1265 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.821086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d854b8b8-3b4f-4dfe-9bac-f5281037ebc6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:58.822432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d854b8b8-3b4f-4dfe-9bac-f5281037ebc6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:58.833052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d854b8b8-3b4f-4dfe-9bac-f5281037ebc6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.836471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d854b8b8-3b4f-4dfe-9bac-f5281037ebc6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.840661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d854b8b8-3b4f-4dfe-9bac-f5281037ebc6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.842207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d854b8b8-3b4f-4dfe-9bac-f5281037ebc6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.849729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d854b8b8-3b4f-4dfe-9bac-f5281037ebc6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.850414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d854b8b8-3b4f-4dfe-9bac-f5281037ebc6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.958320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d854b8b8-3b4f-4dfe-9bac-f5281037ebc6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:58.969211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f7a23878-d516-4ce5-84bb-9251b0ae1265 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:58.970643 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d854b8b8-3b4f-4dfe-9bac-f5281037ebc6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1270 microversion: 2.1 time: 0.153985 Oct 29 02:47:58.971762 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 350/690] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:58 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:58.977689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:58.977998 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f7a23878-d516-4ce5-84bb-9251b0ae1265 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1312 microversion: 2.1 time: 0.350461 Oct 29 02:47:58.979081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:58.982477 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 341/691] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:58 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1312 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:58.991056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.991550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.992026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.993241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.994174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.995065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.103282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e195631-9546-4c1f-8efd-f52b5cfc27ef tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:59.104125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e195631-9546-4c1f-8efd-f52b5cfc27ef tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:59.113679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e195631-9546-4c1f-8efd-f52b5cfc27ef tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.118714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e195631-9546-4c1f-8efd-f52b5cfc27ef tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.119356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e195631-9546-4c1f-8efd-f52b5cfc27ef tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.120592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e195631-9546-4c1f-8efd-f52b5cfc27ef tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.121351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e195631-9546-4c1f-8efd-f52b5cfc27ef tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.121774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e195631-9546-4c1f-8efd-f52b5cfc27ef tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.233923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:59.244253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:59.247096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:59.249353 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3ffde351-6bf1-499f-8d9a-044d2fc1a0fe tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1361 microversion: 2.25 time: 0.276053 Oct 29 02:47:59.251433 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 351/692] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:58 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:59.256291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-30a74bc5-bee8-4a70-9ed0-e64ec57cd45c req-e95e6c47-f59a-4712-b4dd-7c4894b4f115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981cdc70-e4e6-4431-a243-068d39d4160d", "name": "network-vif-plugged", "status": "completed", "tag": "1861c328-f726-4893-80d7-4debdd4d709b"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:59.272636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-30a74bc5-bee8-4a70-9ed0-e64ec57cd45c req-e95e6c47-f59a-4712-b4dd-7c4894b4f115 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.273108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-30a74bc5-bee8-4a70-9ed0-e64ec57cd45c req-e95e6c47-f59a-4712-b4dd-7c4894b4f115 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.273529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-30a74bc5-bee8-4a70-9ed0-e64ec57cd45c req-e95e6c47-f59a-4712-b4dd-7c4894b4f115 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.287085 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-30a74bc5-bee8-4a70-9ed0-e64ec57cd45c req-e95e6c47-f59a-4712-b4dd-7c4894b4f115 service nova] Creating event network-vif-plugged:1861c328-f726-4893-80d7-4debdd4d709b for instance 981cdc70-e4e6-4431-a243-068d39d4160d on n-h1-862964-4 Oct 29 02:47:59.294759 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-30a74bc5-bee8-4a70-9ed0-e64ec57cd45c req-e95e6c47-f59a-4712-b4dd-7c4894b4f115 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041471 Oct 29 02:47:59.295704 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 352/693] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:59.302726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-560b2dcf-c5fe-4319-83f6-ce85b11d6480 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c33ee0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:59.361672 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-560b2dcf-c5fe-4319-83f6-ce85b11d6480 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.064429 Oct 29 02:47:59.362292 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 353/694] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:59 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:59.387073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3e195631-9546-4c1f-8efd-f52b5cfc27ef tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:59.397283 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3e195631-9546-4c1f-8efd-f52b5cfc27ef tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1492 microversion: 2.1 time: 0.297880 Oct 29 02:47:59.399963 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 342/695] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:59 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1492 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:59.459742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-641cfc88-e999-4e5e-a0e2-5fd18333079b req-bfc629e3-3b26-4837-ae75-73dce5bc04d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e28d98f2-e795-480d-974a-094260081964", "tag": "fdf72c9a-20ac-4e21-94e2-4bf07361d5ff"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:59.474789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-641cfc88-e999-4e5e-a0e2-5fd18333079b req-bfc629e3-3b26-4837-ae75-73dce5bc04d5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.475940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-641cfc88-e999-4e5e-a0e2-5fd18333079b req-bfc629e3-3b26-4837-ae75-73dce5bc04d5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.477024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-641cfc88-e999-4e5e-a0e2-5fd18333079b req-bfc629e3-3b26-4837-ae75-73dce5bc04d5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.499120 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-641cfc88-e999-4e5e-a0e2-5fd18333079b req-bfc629e3-3b26-4837-ae75-73dce5bc04d5 service nova] Creating event network-changed:fdf72c9a-20ac-4e21-94e2-4bf07361d5ff for instance e28d98f2-e795-480d-974a-094260081964 on n-h2-862964-4 Oct 29 02:47:59.506741 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-641cfc88-e999-4e5e-a0e2-5fd18333079b req-bfc629e3-3b26-4837-ae75-73dce5bc04d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051735 Oct 29 02:47:59.508030 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 343/696] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:47:59.716992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-737a2414-68a6-4cd2-840a-45ee44e515c2 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:59.717715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-737a2414-68a6-4cd2-840a-45ee44e515c2 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:59.724718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737a2414-68a6-4cd2-840a-45ee44e515c2 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.725195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737a2414-68a6-4cd2-840a-45ee44e515c2 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.725619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737a2414-68a6-4cd2-840a-45ee44e515c2 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.726357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737a2414-68a6-4cd2-840a-45ee44e515c2 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.726800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737a2414-68a6-4cd2-840a-45ee44e515c2 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.727246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737a2414-68a6-4cd2-840a-45ee44e515c2 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.872566 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-737a2414-68a6-4cd2-840a-45ee44e515c2 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1643 microversion: 2.1 time: 0.453643 Oct 29 02:47:59.873219 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 354/697] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:59 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1643 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:59.897418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-917e125f-bce7-409a-bfbb-16a91f69acd0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:59.898894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-917e125f-bce7-409a-bfbb-16a91f69acd0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:59.909790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-917e125f-bce7-409a-bfbb-16a91f69acd0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.911582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-917e125f-bce7-409a-bfbb-16a91f69acd0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.912011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-917e125f-bce7-409a-bfbb-16a91f69acd0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.912722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-917e125f-bce7-409a-bfbb-16a91f69acd0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.915007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-917e125f-bce7-409a-bfbb-16a91f69acd0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.915596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-917e125f-bce7-409a-bfbb-16a91f69acd0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.993441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8c59934-6414-4f4a-9e6c-abf1bbddab43 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:59.994460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8c59934-6414-4f4a-9e6c-abf1bbddab43 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:00.004096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8c59934-6414-4f4a-9e6c-abf1bbddab43 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.005216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8c59934-6414-4f4a-9e6c-abf1bbddab43 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.005992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8c59934-6414-4f4a-9e6c-abf1bbddab43 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.006945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8c59934-6414-4f4a-9e6c-abf1bbddab43 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.007629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8c59934-6414-4f4a-9e6c-abf1bbddab43 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.008276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8c59934-6414-4f4a-9e6c-abf1bbddab43 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.086017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8c59934-6414-4f4a-9e6c-abf1bbddab43 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:00.097112 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8c59934-6414-4f4a-9e6c-abf1bbddab43 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1270 microversion: 2.1 time: 0.107941 Oct 29 02:48:00.097927 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 355/698] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:59 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:00.102891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-881cee3b-14cf-4dac-8d98-34aae89f22b1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:00.103529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-881cee3b-14cf-4dac-8d98-34aae89f22b1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:00.117686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-881cee3b-14cf-4dac-8d98-34aae89f22b1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.118276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-881cee3b-14cf-4dac-8d98-34aae89f22b1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.118709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-881cee3b-14cf-4dac-8d98-34aae89f22b1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.119419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-881cee3b-14cf-4dac-8d98-34aae89f22b1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.119907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-881cee3b-14cf-4dac-8d98-34aae89f22b1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.120704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-881cee3b-14cf-4dac-8d98-34aae89f22b1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.265546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-881cee3b-14cf-4dac-8d98-34aae89f22b1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:00.278680 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-881cee3b-14cf-4dac-8d98-34aae89f22b1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1312 microversion: 2.1 time: 0.179453 Oct 29 02:48:00.286326 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 356/699] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:00 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:00.292451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:00.294341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:00.301947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.302407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.302922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.303556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.304011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.304433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.362308 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-917e125f-bce7-409a-bfbb-16a91f69acd0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1643 microversion: 2.1 time: 0.468874 Oct 29 02:48:00.362894 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 344/700] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:59 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1643 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:00.377149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3ff955b1-a2a0-49f4-a66d-2af14013fc80 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c991f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:00.428775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3ff955b1-a2a0-49f4-a66d-2af14013fc80 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.055434 Oct 29 02:48:00.429472 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 345/701] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:00 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:00.435132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f765d14c-dd5d-4b95-9e90-4f89625cd163 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:00.439194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f765d14c-dd5d-4b95-9e90-4f89625cd163 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.439742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f765d14c-dd5d-4b95-9e90-4f89625cd163 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.440368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f765d14c-dd5d-4b95-9e90-4f89625cd163 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.441196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f765d14c-dd5d-4b95-9e90-4f89625cd163 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.441705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f765d14c-dd5d-4b95-9e90-4f89625cd163 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.442198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f765d14c-dd5d-4b95-9e90-4f89625cd163 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.465795 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f765d14c-dd5d-4b95-9e90-4f89625cd163 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034772 Oct 29 02:48:00.466517 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 346/702] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Oct 29 02:48:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:00.478736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:00.479307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dd0cd91d-8778-4946-a6d7-1a10c2567d51 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862964-4", "block_migration": true, "disk_over_commit": false}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:00.481796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd0cd91d-8778-4946-a6d7-1a10c2567d51 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:00.487618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:00.487857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd0cd91d-8778-4946-a6d7-1a10c2567d51 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.488329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd0cd91d-8778-4946-a6d7-1a10c2567d51 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.488752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd0cd91d-8778-4946-a6d7-1a10c2567d51 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.489407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:00.489542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd0cd91d-8778-4946-a6d7-1a10c2567d51 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.489965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd0cd91d-8778-4946-a6d7-1a10c2567d51 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.490378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd0cd91d-8778-4946-a6d7-1a10c2567d51 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.490557 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a046df98-2673-42f0-9a51-431c425b12f0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1361 microversion: 2.25 time: 0.203221 Oct 29 02:48:00.491117 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 357/703] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:00 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:00.569889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-dd0cd91d-8778-4946-a6d7-1a10c2567d51 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lazy-loading 'flavor' on Instance uuid c953eb9c-9ad8-471d-95d6-f95740b8b7f2 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:00.582584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd0cd91d-8778-4946-a6d7-1a10c2567d51 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Going to try to live migrate instance to n-h1-862964-4 {{(pid=127042) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:48:00.739679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1326081082", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": "none"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:00.795274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:00.795684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:00.796174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:00.796568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:00.796966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:00.805727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.806277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.806698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.807409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.807850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.808255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.826731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Getting quotas for project 7f9d23d263bb44b7a600166d113bf63b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:00.831453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Getting quotas for user e1dbe55d773a4e60b7ad0f0589cbc9e8 and project 7f9d23d263bb44b7a600166d113bf63b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:00.842995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:00.845287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:00.857452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:00.893999 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0111920c-43fe-4e82-adb4-4d3aadd4ded0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.269068 Oct 29 02:48:00.895802 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 358/704] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 271 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 29 02:48:00.914173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3e93f809-a2d8-4f75-92e6-604c598a309e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:00.914943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3e93f809-a2d8-4f75-92e6-604c598a309e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:01.015089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3e93f809-a2d8-4f75-92e6-604c598a309e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.031998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3e93f809-a2d8-4f75-92e6-604c598a309e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.036723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3e93f809-a2d8-4f75-92e6-604c598a309e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.069129 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3e93f809-a2d8-4f75-92e6-604c598a309e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1454 microversion: 2.91 time: 0.162946 Oct 29 02:48:01.077618 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 359/705] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:00 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:01.121983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e305bf48-0db4-41c8-8df6-d17d76d17389 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:01.122610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e305bf48-0db4-41c8-8df6-d17d76d17389 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:01.138558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e305bf48-0db4-41c8-8df6-d17d76d17389 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.139476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e305bf48-0db4-41c8-8df6-d17d76d17389 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.139939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e305bf48-0db4-41c8-8df6-d17d76d17389 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.140997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e305bf48-0db4-41c8-8df6-d17d76d17389 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.141397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e305bf48-0db4-41c8-8df6-d17d76d17389 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.141921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e305bf48-0db4-41c8-8df6-d17d76d17389 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.300421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e305bf48-0db4-41c8-8df6-d17d76d17389 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.310493 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e305bf48-0db4-41c8-8df6-d17d76d17389 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1278 microversion: 2.1 time: 0.194322 Oct 29 02:48:01.311749 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 360/706] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:01 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:01.317365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-412d6d02-9b4e-4cfd-aa76-f9ab61c31ffb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:01.318178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-412d6d02-9b4e-4cfd-aa76-f9ab61c31ffb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:01.325475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-412d6d02-9b4e-4cfd-aa76-f9ab61c31ffb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.326222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-412d6d02-9b4e-4cfd-aa76-f9ab61c31ffb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.326818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-412d6d02-9b4e-4cfd-aa76-f9ab61c31ffb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.327663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-412d6d02-9b4e-4cfd-aa76-f9ab61c31ffb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.328292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-412d6d02-9b4e-4cfd-aa76-f9ab61c31ffb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.329053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-412d6d02-9b4e-4cfd-aa76-f9ab61c31ffb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.492823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-412d6d02-9b4e-4cfd-aa76-f9ab61c31ffb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.502877 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-412d6d02-9b4e-4cfd-aa76-f9ab61c31ffb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1312 microversion: 2.1 time: 0.189320 Oct 29 02:48:01.506946 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 361/707] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:01 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:01.514685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c8fe8204-1a1f-48c3-9489-30eb76a43be7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c23b80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:01.574919 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c8fe8204-1a1f-48c3-9489-30eb76a43be7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.066629 Oct 29 02:48:01.576034 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 362/708] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:01 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:01.580753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-a2a53f57-93c0-41c7-808b-5a7815b7c9be req-136626de-dce2-46e2-b5dd-6f9b19bf11fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39", "name": "network-vif-plugged", "status": "completed", "tag": "2aee52dc-63e0-47de-821b-34b98b339294"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:01.594261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a2a53f57-93c0-41c7-808b-5a7815b7c9be req-136626de-dce2-46e2-b5dd-6f9b19bf11fa service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.595034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a2a53f57-93c0-41c7-808b-5a7815b7c9be req-136626de-dce2-46e2-b5dd-6f9b19bf11fa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.595875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a2a53f57-93c0-41c7-808b-5a7815b7c9be req-136626de-dce2-46e2-b5dd-6f9b19bf11fa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.622055 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-a2a53f57-93c0-41c7-808b-5a7815b7c9be req-136626de-dce2-46e2-b5dd-6f9b19bf11fa service nova] Creating event network-vif-plugged:2aee52dc-63e0-47de-821b-34b98b339294 for instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 on n-h1-862964-4 Oct 29 02:48:01.628221 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-a2a53f57-93c0-41c7-808b-5a7815b7c9be req-136626de-dce2-46e2-b5dd-6f9b19bf11fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050792 Oct 29 02:48:01.630592 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 363/709] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:01.640800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:01.641779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:01.649225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.650500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.651133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.652708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.653360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.653992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.809745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.820938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.822840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.823978 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1999e1dd-d2c4-431c-a067-a80616db9ef2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1361 microversion: 2.25 time: 0.191210 Oct 29 02:48:01.824760 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 364/710] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:01 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:02.111106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:02.112562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:02.121320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.122236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.122895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:02.123905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.124582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.125221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:02.227162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:02.241229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:02.244055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:02.251780 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8936a7e6-b2aa-4270-b2cd-a83c91652253 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1506 microversion: 2.91 time: 0.148013 Oct 29 02:48:02.263153 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 365/711] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:02 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:02.335217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ee68d5a5-eecf-41c0-bfd5-d6abc1acc09a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:02.336080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ee68d5a5-eecf-41c0-bfd5-d6abc1acc09a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:02.367910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee68d5a5-eecf-41c0-bfd5-d6abc1acc09a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.370516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee68d5a5-eecf-41c0-bfd5-d6abc1acc09a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.371880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee68d5a5-eecf-41c0-bfd5-d6abc1acc09a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:02.381619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee68d5a5-eecf-41c0-bfd5-d6abc1acc09a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.384300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee68d5a5-eecf-41c0-bfd5-d6abc1acc09a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.385475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee68d5a5-eecf-41c0-bfd5-d6abc1acc09a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:02.630348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ee68d5a5-eecf-41c0-bfd5-d6abc1acc09a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:02.638475 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ee68d5a5-eecf-41c0-bfd5-d6abc1acc09a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1318 microversion: 2.1 time: 0.307221 Oct 29 02:48:02.640137 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 366/712] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:02 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:02.759742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "06cee749-4748-4d54-8e88-b52de9f6a2d8"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:02.762887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:02.775537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.776479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.777650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:02.778607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.779238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.779835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.090083 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] HTTP exception thrown: Volume 06cee749-4748-4d54-8e88-b52de9f6a2d8 could not be found. Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Request method failure captured: Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments/85e5613f-ea9f-4234-b261-2d30ceab66ef HTTP/1.1 Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 74 Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQRu2l0otB-wLAj3NK20xFJ1iobhP1EbMnBwCn2pdsBjYNvZRT9NI3JbovW77iqaRfyQkdKNKf-3fO0_RFVvf-pHsBtqMHXRLEeapVcWqwuy9lkpkB_6VBrvPTn5zwNGUsjlk7U_LJITBmJMJ0590rK4JrIpueiWTCttisFwkeqf_8 Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 89bff91261ea40b6855ac96a9db6c878 Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesAdminNegativeTest-1202794250 Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:48:03.096880 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/89bff91261ea40b6855ac96a9db6c878"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/89bff91261ea40b6855ac96a9db6c878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_89bff91261ea40b6855ac96a9db6c878", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/89bff91261ea40b6855ac96a9db6c878"}]}] Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesAdminNegativeTest-1202794250 Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 89bff91261ea40b6855ac96a9db6c878 Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1202794250 Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesAdminNegativeTest-1202794250-project-admin Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3c866ee9d2744a73b55d1be2b3d69dc5 Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesAdminNegativeTest-1202794250-project-admin Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: {"volumeAttachment": {"volumeId": "06cee749-4748-4d54-8e88-b52de9f6a2d8"}} Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:48:03.098372 n-d-862964-4 devstack@n-api.service[127041]: exception: Volume 06cee749-4748-4d54-8e88-b52de9f6a2d8 could not be found. Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'server_id': 'bc4c73c4-725e-415c-a814-c828ec74c554', 'id': '85e5613f-ea9f-4234-b261-2d30ceab66ef', 'body': {'volumeAttachment': {'volumeId': '06cee749-4748-4d54-8e88-b52de9f6a2d8'}}} Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 02:48:03.099210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06cee749-4748-4d54-8e88-b52de9f6a2d8 could not be found. (HTTP 404) (Request-ID: req-de23b5e8-19f5-4c12-9802-a549e923336f) Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 02:48:03.100242 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06cee749-4748-4d54-8e88-b52de9f6a2d8 could not be found. Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:03.101340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 06cee749-4748-4d54-8e88-b52de9f6a2d8 could not be found. Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06cee749-4748-4d54-8e88-b52de9f6a2d8 could not be found. Oct 29 02:48:03.102568 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:03.103707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Returning 400 to user: Volume 06cee749-4748-4d54-8e88-b52de9f6a2d8 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:03.103707 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-069766ca-ac40-47ce-af22-e60ea182d375 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments/85e5613f-ea9f-4234-b261-2d30ceab66ef" status: 400 len: 107 microversion: 2.1 time: 0.456962 Oct 29 02:48:03.106232 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 367/713] 10.222.0.16 () {60 vars in 1433 bytes} [Sat Oct 29 02:48:02 2022] PUT /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments/85e5613f-ea9f-4234-b261-2d30ceab66ef => generated 107 bytes in 462 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:48:03.134123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e3b67a9a-2961-4771-9b9d-2f784b29580d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:03.138914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e3b67a9a-2961-4771-9b9d-2f784b29580d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:03.148584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b67a9a-2961-4771-9b9d-2f784b29580d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.152716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b67a9a-2961-4771-9b9d-2f784b29580d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.155161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b67a9a-2961-4771-9b9d-2f784b29580d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.156449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b67a9a-2961-4771-9b9d-2f784b29580d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.160074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b67a9a-2961-4771-9b9d-2f784b29580d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.160885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b67a9a-2961-4771-9b9d-2f784b29580d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.363545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e3b67a9a-2961-4771-9b9d-2f784b29580d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.374584 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e3b67a9a-2961-4771-9b9d-2f784b29580d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1312 microversion: 2.1 time: 0.257621 Oct 29 02:48:03.375396 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 368/714] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:03 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:03.384117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d59bbf2a-c338-4f05-bfaa-6f1da51597d3 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8a8ef70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:03.437102 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d59bbf2a-c338-4f05-bfaa-6f1da51597d3 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.058429 Oct 29 02:48:03.440157 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 369/715] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:03 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:03.452337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:03.454550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:03.461144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.461682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.462147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.462901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.463474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.464027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.603878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.612305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.613739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.614925 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ace45d0b-6e46-42b5-a323-79cda4819749 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1557 microversion: 2.25 time: 0.173526 Oct 29 02:48:03.615468 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 370/716] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:03 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:03.620413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-19b8cf43-90f5-451b-bd39-222d984c277c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:03.620904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-19b8cf43-90f5-451b-bd39-222d984c277c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:03.626766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b8cf43-90f5-451b-bd39-222d984c277c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.627196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b8cf43-90f5-451b-bd39-222d984c277c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.627625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b8cf43-90f5-451b-bd39-222d984c277c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.628315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b8cf43-90f5-451b-bd39-222d984c277c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.628762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b8cf43-90f5-451b-bd39-222d984c277c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.629179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b8cf43-90f5-451b-bd39-222d984c277c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.761322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-19b8cf43-90f5-451b-bd39-222d984c277c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lazy-loading 'services' on Instance uuid bc4c73c4-725e-415c-a814-c828ec74c554 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:03.791736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:03.877690 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-19b8cf43-90f5-451b-bd39-222d984c277c tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments/85e5613f-ea9f-4234-b261-2d30ceab66ef" status: 202 len: 0 microversion: 2.1 time: 0.260625 Oct 29 02:48:03.878611 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 371/717] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 02:48:03 2022] DELETE /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments/85e5613f-ea9f-4234-b261-2d30ceab66ef => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:48:03.884246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:03.884936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:03.890995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.891470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.891896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.892580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.893030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.893447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.968894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.978671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.980105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.985507 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-882b45f4-a5d2-438f-b82c-5fc0d5794a67 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1512 microversion: 2.91 time: 0.105766 Oct 29 02:48:03.993845 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 372/718] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:03 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1512 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:03.993845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-91a5305d-ed7f-45ac-8416-c3bbe45ad593 req-e7eefb79-c20f-41e5-b62c-9e26b68b978e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b4a8c5-c08f-4c33-a57c-f2ac1a910f98", "tag": "5717cd64-fb65-441b-8c4c-6aa355302be8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:04.006095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-91a5305d-ed7f-45ac-8416-c3bbe45ad593 req-e7eefb79-c20f-41e5-b62c-9e26b68b978e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.013937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-91a5305d-ed7f-45ac-8416-c3bbe45ad593 req-e7eefb79-c20f-41e5-b62c-9e26b68b978e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.014712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-91a5305d-ed7f-45ac-8416-c3bbe45ad593 req-e7eefb79-c20f-41e5-b62c-9e26b68b978e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.026798 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-91a5305d-ed7f-45ac-8416-c3bbe45ad593 req-e7eefb79-c20f-41e5-b62c-9e26b68b978e service nova] Creating event network-changed:5717cd64-fb65-441b-8c4c-6aa355302be8 for instance 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 on n-h1-862964-4 Oct 29 02:48:04.033381 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-91a5305d-ed7f-45ac-8416-c3bbe45ad593 req-e7eefb79-c20f-41e5-b62c-9e26b68b978e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045770 Oct 29 02:48:04.034342 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 373/719] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:04.206501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-636e7c1f-b67c-42d0-a439-2c7d8a73d502 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:04.207194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-636e7c1f-b67c-42d0-a439-2c7d8a73d502 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:04.213653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-636e7c1f-b67c-42d0-a439-2c7d8a73d502 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.214161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-636e7c1f-b67c-42d0-a439-2c7d8a73d502 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.214617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-636e7c1f-b67c-42d0-a439-2c7d8a73d502 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.215310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-636e7c1f-b67c-42d0-a439-2c7d8a73d502 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.215752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-636e7c1f-b67c-42d0-a439-2c7d8a73d502 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.216165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-636e7c1f-b67c-42d0-a439-2c7d8a73d502 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.371737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-636e7c1f-b67c-42d0-a439-2c7d8a73d502 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid 981cdc70-e4e6-4431-a243-068d39d4160d {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:04.385923 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-636e7c1f-b67c-42d0-a439-2c7d8a73d502 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 2049 microversion: 2.25 time: 0.350150 Oct 29 02:48:04.386636 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 374/720] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:04 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 2049 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:04.391334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-45a52adc-2884-40e5-bf4b-66e050b6ad19 req-d1e19a62-0ed8-4ad6-8768-95fe1c30e79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17fee50-82f1-461d-9889-b0f25961ae1b", "name": "network-vif-plugged", "status": "completed", "tag": "37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:04.402126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-45a52adc-2884-40e5-bf4b-66e050b6ad19 req-d1e19a62-0ed8-4ad6-8768-95fe1c30e79f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.402804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-45a52adc-2884-40e5-bf4b-66e050b6ad19 req-d1e19a62-0ed8-4ad6-8768-95fe1c30e79f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.403376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-45a52adc-2884-40e5-bf4b-66e050b6ad19 req-d1e19a62-0ed8-4ad6-8768-95fe1c30e79f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.422506 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-45a52adc-2884-40e5-bf4b-66e050b6ad19 req-d1e19a62-0ed8-4ad6-8768-95fe1c30e79f service nova] Creating event network-vif-plugged:37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1 for instance a17fee50-82f1-461d-9889-b0f25961ae1b on n-h1-862964-4 Oct 29 02:48:04.428029 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-45a52adc-2884-40e5-bf4b-66e050b6ad19 req-d1e19a62-0ed8-4ad6-8768-95fe1c30e79f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039891 Oct 29 02:48:04.428890 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 375/721] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:04.434710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c86b34de-a06f-4b1c-b837-6b29247e55af tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:04.435494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c86b34de-a06f-4b1c-b837-6b29247e55af tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:04.441971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c86b34de-a06f-4b1c-b837-6b29247e55af tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.442614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c86b34de-a06f-4b1c-b837-6b29247e55af tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.443440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c86b34de-a06f-4b1c-b837-6b29247e55af tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.444282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c86b34de-a06f-4b1c-b837-6b29247e55af tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.445113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c86b34de-a06f-4b1c-b837-6b29247e55af tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.446023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c86b34de-a06f-4b1c-b837-6b29247e55af tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.615151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c86b34de-a06f-4b1c-b837-6b29247e55af tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:04.624365 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c86b34de-a06f-4b1c-b837-6b29247e55af tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1318 microversion: 2.1 time: 0.194427 Oct 29 02:48:04.624959 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 376/722] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:04 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:04.650183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-303bc9c0-44c1-4251-a520-88886c72042a tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:04.652399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-303bc9c0-44c1-4251-a520-88886c72042a tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:04.658660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303bc9c0-44c1-4251-a520-88886c72042a tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.659140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303bc9c0-44c1-4251-a520-88886c72042a tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.659572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303bc9c0-44c1-4251-a520-88886c72042a tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.660273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303bc9c0-44c1-4251-a520-88886c72042a tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.660722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303bc9c0-44c1-4251-a520-88886c72042a tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.661141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303bc9c0-44c1-4251-a520-88886c72042a tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.706558 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-303bc9c0-44c1-4251-a520-88886c72042a tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080371 Oct 29 02:48:04.707156 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 377/723] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:48:04 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:04.714048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c3f7f2e3-534f-4a78-9bc4-4208ccf50166 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:04.714666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c3f7f2e3-534f-4a78-9bc4-4208ccf50166 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:04.721601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7f2e3-534f-4a78-9bc4-4208ccf50166 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.722114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7f2e3-534f-4a78-9bc4-4208ccf50166 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.722609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7f2e3-534f-4a78-9bc4-4208ccf50166 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.724193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7f2e3-534f-4a78-9bc4-4208ccf50166 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.724851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7f2e3-534f-4a78-9bc4-4208ccf50166 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.725910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7f2e3-534f-4a78-9bc4-4208ccf50166 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.874918 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dd0cd91d-8778-4946-a6d7-1a10c2567d51 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2/action" status: 202 len: 0 microversion: 2.1 time: 4.374464 Oct 29 02:48:04.886374 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 347/724] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:48:00 2022] POST /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2/action => generated 0 bytes in 4412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:48:04.893842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef450c6e-d1a8-4d8a-85cd-69a105721a8d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:04.894847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ef450c6e-d1a8-4d8a-85cd-69a105721a8d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:04.903639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef450c6e-d1a8-4d8a-85cd-69a105721a8d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.904464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef450c6e-d1a8-4d8a-85cd-69a105721a8d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.905132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef450c6e-d1a8-4d8a-85cd-69a105721a8d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.906604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef450c6e-d1a8-4d8a-85cd-69a105721a8d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.907236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef450c6e-d1a8-4d8a-85cd-69a105721a8d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.907828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef450c6e-d1a8-4d8a-85cd-69a105721a8d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.918793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c3f7f2e3-534f-4a78-9bc4-4208ccf50166 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:04.927534 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c3f7f2e3-534f-4a78-9bc4-4208ccf50166 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1462 microversion: 2.1 time: 0.218827 Oct 29 02:48:04.928357 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 378/725] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:04 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1462 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:04.942048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:04.951565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4fd900d6-c24e-4cb5-857b-df82042ecbfb tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8a243a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:05.025275 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4fd900d6-c24e-4cb5-857b-df82042ecbfb tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.081651 Oct 29 02:48:05.025920 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 379/726] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:04 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:05.034046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3f8f1eca-2571-48be-90a7-15ac44d81d31 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:05.034046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3f8f1eca-2571-48be-90a7-15ac44d81d31 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:05.054310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f8f1eca-2571-48be-90a7-15ac44d81d31 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.055380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f8f1eca-2571-48be-90a7-15ac44d81d31 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.056196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f8f1eca-2571-48be-90a7-15ac44d81d31 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.057837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f8f1eca-2571-48be-90a7-15ac44d81d31 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.058588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f8f1eca-2571-48be-90a7-15ac44d81d31 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.059337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f8f1eca-2571-48be-90a7-15ac44d81d31 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.268021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3f8f1eca-2571-48be-90a7-15ac44d81d31 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.276698 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3f8f1eca-2571-48be-90a7-15ac44d81d31 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.248572 Oct 29 02:48:05.277285 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 380/727] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:05 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:05.287629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:05.303130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:05.322255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.322929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.323531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.324395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.325032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.325655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.335267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-ef450c6e-d1a8-4d8a-85cd-69a105721a8d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid 981cdc70-e4e6-4431-a243-068d39d4160d {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:05.356864 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ef450c6e-d1a8-4d8a-85cd-69a105721a8d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 2049 microversion: 2.25 time: 0.468882 Oct 29 02:48:05.357628 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 348/728] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:04 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 2049 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:05.397955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:05.398488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:05.417047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.419725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.420944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.422361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.422361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.422795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.576528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.584946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.586475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.593061 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bca865ac-5e06-4290-8c8e-f218e58f4539 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1512 microversion: 2.91 time: 0.209344 Oct 29 02:48:05.594337 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 349/729] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:05 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:05.614369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-538afe4b-3951-4a5f-af71-449a5627321a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:05.623749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-538afe4b-3951-4a5f-af71-449a5627321a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.624963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-538afe4b-3951-4a5f-af71-449a5627321a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.626240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-538afe4b-3951-4a5f-af71-449a5627321a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.627371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-538afe4b-3951-4a5f-af71-449a5627321a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.628577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-538afe4b-3951-4a5f-af71-449a5627321a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.629175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-538afe4b-3951-4a5f-af71-449a5627321a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.651008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.657584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Old instance type m1.heat2, new instance type m1.heat {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 02:48:05.673472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:05.676852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:05.677719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:05.678298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:05.679049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:05.719400 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-538afe4b-3951-4a5f-af71-449a5627321a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.123719 Oct 29 02:48:05.727753 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 350/730] 10.222.0.16 () {60 vars in 1217 bytes} [Sat Oct 29 02:48:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:48:05.732927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-442f7986-a3ca-47e7-9b77-a69e775a278a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:05.733541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-442f7986-a3ca-47e7-9b77-a69e775a278a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:05.754107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-442f7986-a3ca-47e7-9b77-a69e775a278a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.754653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-442f7986-a3ca-47e7-9b77-a69e775a278a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.757914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-442f7986-a3ca-47e7-9b77-a69e775a278a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.761063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-442f7986-a3ca-47e7-9b77-a69e775a278a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.761752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-442f7986-a3ca-47e7-9b77-a69e775a278a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.762395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-442f7986-a3ca-47e7-9b77-a69e775a278a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.912346 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a77c2278-b9de-4a5d-970c-ad522199890f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "POST /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39/action" status: 202 len: 0 microversion: 2.1 time: 0.628429 Oct 29 02:48:05.916794 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 381/731] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:48:05 2022] POST /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:48:05.922655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8a5bd19-c6dc-4fa6-99ff-cd6082007d05 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:05.924955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8a5bd19-c6dc-4fa6-99ff-cd6082007d05 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:05.941844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd19-c6dc-4fa6-99ff-cd6082007d05 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.941844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd19-c6dc-4fa6-99ff-cd6082007d05 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.941844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd19-c6dc-4fa6-99ff-cd6082007d05 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.942529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd19-c6dc-4fa6-99ff-cd6082007d05 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.943274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd19-c6dc-4fa6-99ff-cd6082007d05 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.943634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd19-c6dc-4fa6-99ff-cd6082007d05 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.981343 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8a5bd19-c6dc-4fa6-99ff-cd6082007d05 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062712 Oct 29 02:48:05.982042 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 382/732] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:48:05 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:05.987227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dc8af790-913d-4dbf-8f84-a8c998271f1e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-4", "block_migration": "auto"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:05.990239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dc8af790-913d-4dbf-8f84-a8c998271f1e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:05.997846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc8af790-913d-4dbf-8f84-a8c998271f1e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.001326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc8af790-913d-4dbf-8f84-a8c998271f1e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.001835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc8af790-913d-4dbf-8f84-a8c998271f1e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.002828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc8af790-913d-4dbf-8f84-a8c998271f1e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.003426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc8af790-913d-4dbf-8f84-a8c998271f1e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.003852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc8af790-913d-4dbf-8f84-a8c998271f1e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.044379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-dc8af790-913d-4dbf-8f84-a8c998271f1e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'flavor' on Instance uuid 981cdc70-e4e6-4431-a243-068d39d4160d {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:06.079372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-442f7986-a3ca-47e7-9b77-a69e775a278a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:06.088137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dc8af790-913d-4dbf-8f84-a8c998271f1e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Going to try to live migrate instance to n-h2-862964-4 {{(pid=127041) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:48:06.091036 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-442f7986-a3ca-47e7-9b77-a69e775a278a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1318 microversion: 2.1 time: 0.362018 Oct 29 02:48:06.107439 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 351/733] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:05 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:06.119540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-10dbcce4-c910-49d7-a700-0420b6003fd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:06.121706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-10dbcce4-c910-49d7-a700-0420b6003fd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:06.135492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10dbcce4-c910-49d7-a700-0420b6003fd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.139105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10dbcce4-c910-49d7-a700-0420b6003fd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.139546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10dbcce4-c910-49d7-a700-0420b6003fd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.141359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10dbcce4-c910-49d7-a700-0420b6003fd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.146389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10dbcce4-c910-49d7-a700-0420b6003fd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.147194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10dbcce4-c910-49d7-a700-0420b6003fd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.415356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-10dbcce4-c910-49d7-a700-0420b6003fd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:06.427012 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-10dbcce4-c910-49d7-a700-0420b6003fd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1471 microversion: 2.1 time: 0.317898 Oct 29 02:48:06.431066 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 352/734] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:06 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:06.437059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a700f701-693c-4427-a883-e9825b2dbce7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c0b280>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:06.458045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=26 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:06.542787 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a700f701-693c-4427-a883-e9825b2dbce7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.110200 Oct 29 02:48:06.551283 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 353/735] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:06 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:06.556620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d25424e1-8f6d-436e-9eaf-d9dca6a8d0e8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:06.557286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d25424e1-8f6d-436e-9eaf-d9dca6a8d0e8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:06.564004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d25424e1-8f6d-436e-9eaf-d9dca6a8d0e8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.564499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d25424e1-8f6d-436e-9eaf-d9dca6a8d0e8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.564980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d25424e1-8f6d-436e-9eaf-d9dca6a8d0e8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.565893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d25424e1-8f6d-436e-9eaf-d9dca6a8d0e8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.566357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d25424e1-8f6d-436e-9eaf-d9dca6a8d0e8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.566781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d25424e1-8f6d-436e-9eaf-d9dca6a8d0e8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.859097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d25424e1-8f6d-436e-9eaf-d9dca6a8d0e8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:06.867526 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d25424e1-8f6d-436e-9eaf-d9dca6a8d0e8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.315124 Oct 29 02:48:06.871099 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 354/736] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:06 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:06.898418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-fc4ff6a8-2e30-4e92-83b7-c552c0f34f95 req-cf7f4742-907e-42c8-9520-7b0bfea79d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28d98f2-e795-480d-974a-094260081964", "name": "network-vif-plugged", "status": "completed", "tag": "fdf72c9a-20ac-4e21-94e2-4bf07361d5ff"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:06.910090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fc4ff6a8-2e30-4e92-83b7-c552c0f34f95 req-cf7f4742-907e-42c8-9520-7b0bfea79d2e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.911030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fc4ff6a8-2e30-4e92-83b7-c552c0f34f95 req-cf7f4742-907e-42c8-9520-7b0bfea79d2e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.911839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fc4ff6a8-2e30-4e92-83b7-c552c0f34f95 req-cf7f4742-907e-42c8-9520-7b0bfea79d2e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.927066 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-fc4ff6a8-2e30-4e92-83b7-c552c0f34f95 req-cf7f4742-907e-42c8-9520-7b0bfea79d2e service nova] Creating event network-vif-plugged:fdf72c9a-20ac-4e21-94e2-4bf07361d5ff for instance e28d98f2-e795-480d-974a-094260081964 on n-h2-862964-4 Oct 29 02:48:06.934363 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-fc4ff6a8-2e30-4e92-83b7-c552c0f34f95 req-cf7f4742-907e-42c8-9520-7b0bfea79d2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060835 Oct 29 02:48:06.935665 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 355/737] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:06.966361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:06.967570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:06.976217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.977076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.977947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.978955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.980305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.981046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.150352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:07.192511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:07.203071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:07.214934 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b97a0025-e2c0-4f7d-87b9-3597fb348223 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1533 microversion: 2.91 time: 0.276733 Oct 29 02:48:07.216534 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 356/738] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:06 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1533 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:07.267434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-27bd0983-74aa-4b24-ba54-f1ab2bafb3d2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:07.279939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-27bd0983-74aa-4b24-ba54-f1ab2bafb3d2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:07.308625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27bd0983-74aa-4b24-ba54-f1ab2bafb3d2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:07.309927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27bd0983-74aa-4b24-ba54-f1ab2bafb3d2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:07.310724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27bd0983-74aa-4b24-ba54-f1ab2bafb3d2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.312103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27bd0983-74aa-4b24-ba54-f1ab2bafb3d2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:07.314103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27bd0983-74aa-4b24-ba54-f1ab2bafb3d2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:07.317604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27bd0983-74aa-4b24-ba54-f1ab2bafb3d2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.398561 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-27bd0983-74aa-4b24-ba54-f1ab2bafb3d2 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180488 Oct 29 02:48:07.401451 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 357/739] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:48:07 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:07.412145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-11df991e-0c7e-4eb7-9e66-a8dafc455957 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:07.413040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-11df991e-0c7e-4eb7-9e66-a8dafc455957 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:07.420517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11df991e-0c7e-4eb7-9e66-a8dafc455957 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:07.421336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11df991e-0c7e-4eb7-9e66-a8dafc455957 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:07.422084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11df991e-0c7e-4eb7-9e66-a8dafc455957 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.423050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11df991e-0c7e-4eb7-9e66-a8dafc455957 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:07.423753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11df991e-0c7e-4eb7-9e66-a8dafc455957 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:07.424327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11df991e-0c7e-4eb7-9e66-a8dafc455957 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.697489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-11df991e-0c7e-4eb7-9e66-a8dafc455957 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:07.708450 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-11df991e-0c7e-4eb7-9e66-a8dafc455957 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1318 microversion: 2.1 time: 0.305662 Oct 29 02:48:07.709142 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 358/740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:07 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:07.810384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d59fbe6f-ce28-4e02-879c-a5cdfaaec32a tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:07.811311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d59fbe6f-ce28-4e02-879c-a5cdfaaec32a tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:07.818568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d59fbe6f-ce28-4e02-879c-a5cdfaaec32a tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:07.819374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d59fbe6f-ce28-4e02-879c-a5cdfaaec32a tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:07.820072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d59fbe6f-ce28-4e02-879c-a5cdfaaec32a tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.821212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d59fbe6f-ce28-4e02-879c-a5cdfaaec32a tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:07.822211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d59fbe6f-ce28-4e02-879c-a5cdfaaec32a tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:07.822858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d59fbe6f-ce28-4e02-879c-a5cdfaaec32a tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.977500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-d59fbe6f-ce28-4e02-879c-a5cdfaaec32a tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lazy-loading 'services' on Instance uuid c50495a0-6a28-4904-a856-768d30c4a6ec {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:08.003944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d59fbe6f-ce28-4e02-879c-a5cdfaaec32a tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1938 microversion: 2.91 time: 0.293552 Oct 29 02:48:08.004825 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 359/741] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:07 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1938 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:08.028425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d9399d0-b422-4740-badf-3fefc07af27a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:08.029064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d9399d0-b422-4740-badf-3fefc07af27a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:08.046334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9399d0-b422-4740-badf-3fefc07af27a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:08.047018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9399d0-b422-4740-badf-3fefc07af27a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:08.047774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9399d0-b422-4740-badf-3fefc07af27a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:08.051123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9399d0-b422-4740-badf-3fefc07af27a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:08.053254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9399d0-b422-4740-badf-3fefc07af27a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:08.053743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9399d0-b422-4740-badf-3fefc07af27a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:08.390789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d9399d0-b422-4740-badf-3fefc07af27a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:08.400378 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d9399d0-b422-4740-badf-3fefc07af27a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1471 microversion: 2.1 time: 0.385601 Oct 29 02:48:08.400767 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 360/742] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:08 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1471 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:08.410258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-53d0372b-ef61-4335-8f33-ba8d64fa942d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c80310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:08.493283 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-53d0372b-ef61-4335-8f33-ba8d64fa942d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.086453 Oct 29 02:48:08.501667 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 361/743] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:08 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:08.506935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f952c7b2-815f-4aaf-9935-9a2e6d5fc9f3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:08.507545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f952c7b2-815f-4aaf-9935-9a2e6d5fc9f3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:08.540956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f952c7b2-815f-4aaf-9935-9a2e6d5fc9f3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:08.543791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f952c7b2-815f-4aaf-9935-9a2e6d5fc9f3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:08.544767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f952c7b2-815f-4aaf-9935-9a2e6d5fc9f3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:08.545543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f952c7b2-815f-4aaf-9935-9a2e6d5fc9f3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:08.546043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f952c7b2-815f-4aaf-9935-9a2e6d5fc9f3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:08.546470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f952c7b2-815f-4aaf-9935-9a2e6d5fc9f3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:08.773495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f952c7b2-815f-4aaf-9935-9a2e6d5fc9f3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:08.784355 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f952c7b2-815f-4aaf-9935-9a2e6d5fc9f3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.287387 Oct 29 02:48:08.784970 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 362/744] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:08 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:08.791632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9211dd40-9b1c-424b-b9d9-e6c24f50bddb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:08.799697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9211dd40-9b1c-424b-b9d9-e6c24f50bddb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:08.814178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9211dd40-9b1c-424b-b9d9-e6c24f50bddb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:08.814767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9211dd40-9b1c-424b-b9d9-e6c24f50bddb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:08.815096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9211dd40-9b1c-424b-b9d9-e6c24f50bddb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:08.815806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9211dd40-9b1c-424b-b9d9-e6c24f50bddb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:08.816253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9211dd40-9b1c-424b-b9d9-e6c24f50bddb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:08.816671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9211dd40-9b1c-424b-b9d9-e6c24f50bddb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:08.920255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-9211dd40-9b1c-424b-b9d9-e6c24f50bddb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lazy-loading 'services' on Instance uuid c50495a0-6a28-4904-a856-768d30c4a6ec {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:08.944507 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9211dd40-9b1c-424b-b9d9-e6c24f50bddb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1938 microversion: 2.91 time: 0.156418 Oct 29 02:48:08.946939 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 363/745] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:08 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1938 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:08.954879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7c000f22-372e-4c81-8224-7ad67b77a0b1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:08.958032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7c000f22-372e-4c81-8224-7ad67b77a0b1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:08.967727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c000f22-372e-4c81-8224-7ad67b77a0b1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:08.968240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c000f22-372e-4c81-8224-7ad67b77a0b1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:08.968652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c000f22-372e-4c81-8224-7ad67b77a0b1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:08.969332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c000f22-372e-4c81-8224-7ad67b77a0b1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:08.969876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c000f22-372e-4c81-8224-7ad67b77a0b1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:08.970448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c000f22-372e-4c81-8224-7ad67b77a0b1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.043764 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7c000f22-372e-4c81-8224-7ad67b77a0b1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095604 Oct 29 02:48:09.053872 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 364/746] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:48:08 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:09.066371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ba952481-7124-459d-a3e2-7ab826f2c717 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:09.067437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ba952481-7124-459d-a3e2-7ab826f2c717 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:09.082403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba952481-7124-459d-a3e2-7ab826f2c717 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.082892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba952481-7124-459d-a3e2-7ab826f2c717 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.083318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba952481-7124-459d-a3e2-7ab826f2c717 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.085986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba952481-7124-459d-a3e2-7ab826f2c717 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.086543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba952481-7124-459d-a3e2-7ab826f2c717 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.086968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba952481-7124-459d-a3e2-7ab826f2c717 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.628604 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dc8af790-913d-4dbf-8f84-a8c998271f1e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d/action" status: 202 len: 0 microversion: 2.25 time: 3.645344 Oct 29 02:48:09.629996 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 383/747] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:48:05 2022] POST /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d/action => generated 0 bytes in 3647 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:09.636367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-52bf92ec-e51c-4210-bc05-7ed3ee0b50e7 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:09.644735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52bf92ec-e51c-4210-bc05-7ed3ee0b50e7 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.645221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52bf92ec-e51c-4210-bc05-7ed3ee0b50e7 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.651874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52bf92ec-e51c-4210-bc05-7ed3ee0b50e7 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.652991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52bf92ec-e51c-4210-bc05-7ed3ee0b50e7 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.653462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52bf92ec-e51c-4210-bc05-7ed3ee0b50e7 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.653925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52bf92ec-e51c-4210-bc05-7ed3ee0b50e7 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.711855 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-52bf92ec-e51c-4210-bc05-7ed3ee0b50e7 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.080661 Oct 29 02:48:09.719375 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 384/748] 10.222.0.16 () {60 vars in 1217 bytes} [Sat Oct 29 02:48:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:48:09.725271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f47fb770-0a0f-4199-b7f9-1ecab3b35ee9 req-f35d6516-b403-4cb6-b413-6f79b6e43608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c953eb9c-9ad8-471d-95d6-f95740b8b7f2", "name": "network-vif-unplugged", "status": "completed", "tag": "ac90b439-6117-4e0a-8668-61ae3bc23afb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:09.736177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f47fb770-0a0f-4199-b7f9-1ecab3b35ee9 req-f35d6516-b403-4cb6-b413-6f79b6e43608 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.736667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f47fb770-0a0f-4199-b7f9-1ecab3b35ee9 req-f35d6516-b403-4cb6-b413-6f79b6e43608 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.737070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f47fb770-0a0f-4199-b7f9-1ecab3b35ee9 req-f35d6516-b403-4cb6-b413-6f79b6e43608 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.750337 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f47fb770-0a0f-4199-b7f9-1ecab3b35ee9 req-f35d6516-b403-4cb6-b413-6f79b6e43608 service nova] Creating event network-vif-unplugged:ac90b439-6117-4e0a-8668-61ae3bc23afb for instance c953eb9c-9ad8-471d-95d6-f95740b8b7f2 on n-h2-862964-4 Oct 29 02:48:09.755842 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f47fb770-0a0f-4199-b7f9-1ecab3b35ee9 req-f35d6516-b403-4cb6-b413-6f79b6e43608 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035372 Oct 29 02:48:09.756648 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 385/749] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:09.762225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1695dc99-edc6-4129-bb42-8c610c74026a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:09.762930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1695dc99-edc6-4129-bb42-8c610c74026a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:09.770190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1695dc99-edc6-4129-bb42-8c610c74026a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.770678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1695dc99-edc6-4129-bb42-8c610c74026a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.771108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1695dc99-edc6-4129-bb42-8c610c74026a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.771828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1695dc99-edc6-4129-bb42-8c610c74026a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.772401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1695dc99-edc6-4129-bb42-8c610c74026a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.772833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1695dc99-edc6-4129-bb42-8c610c74026a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.219408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1695dc99-edc6-4129-bb42-8c610c74026a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:10.228203 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1695dc99-edc6-4129-bb42-8c610c74026a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1471 microversion: 2.1 time: 0.470357 Oct 29 02:48:10.246425 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 386/750] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:09 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1471 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:10.251701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3d3ad19b-dbb0-4160-8446-f44f638eeb5e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a88b8670>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:10.271954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ba952481-7124-459d-a3e2-7ab826f2c717 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:10.284216 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ba952481-7124-459d-a3e2-7ab826f2c717 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1318 microversion: 2.1 time: 1.229165 Oct 29 02:48:10.303544 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 365/751] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:09 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1318 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:10.312097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:10.312791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:10.319843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.320435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.321025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.329288 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3d3ad19b-dbb0-4160-8446-f44f638eeb5e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.082334 Oct 29 02:48:10.330272 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 387/752] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:10 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:10.332585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.334415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.334959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.340583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ea3eceec-df48-4b62-a8aa-34952b96467e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:10.343508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ea3eceec-df48-4b62-a8aa-34952b96467e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:10.357574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea3eceec-df48-4b62-a8aa-34952b96467e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.363155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea3eceec-df48-4b62-a8aa-34952b96467e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.365015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea3eceec-df48-4b62-a8aa-34952b96467e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.367323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea3eceec-df48-4b62-a8aa-34952b96467e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.368095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea3eceec-df48-4b62-a8aa-34952b96467e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.369571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea3eceec-df48-4b62-a8aa-34952b96467e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.422479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-ea3eceec-df48-4b62-a8aa-34952b96467e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lazy-loading 'flavor' on Instance uuid c50495a0-6a28-4904-a856-768d30c4a6ec {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:10.562919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:10.771554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:10.783159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:10.784799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:10.790537 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f07fe1d5-1ca4-4a78-aa6b-c614141a4b20 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.485587 Oct 29 02:48:10.791815 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 366/753] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:10 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:10.796937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4a691453-8a31-4bc4-aaff-c0b40fbc1b37 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:10.797685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4a691453-8a31-4bc4-aaff-c0b40fbc1b37 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:10.831668 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ea3eceec-df48-4b62-a8aa-34952b96467e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "POST /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec/action" status: 202 len: 0 microversion: 2.91 time: 0.499868 Oct 29 02:48:10.832791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a691453-8a31-4bc4-aaff-c0b40fbc1b37 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.833456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a691453-8a31-4bc4-aaff-c0b40fbc1b37 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.834029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a691453-8a31-4bc4-aaff-c0b40fbc1b37 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.834883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a691453-8a31-4bc4-aaff-c0b40fbc1b37 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.835579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a691453-8a31-4bc4-aaff-c0b40fbc1b37 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.836093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a691453-8a31-4bc4-aaff-c0b40fbc1b37 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.836377 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 388/754] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:48:10 2022] POST /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:10.840054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:10.894105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ed737f2-5350-4325-aff2-0a54026c5098 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:10.896381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3ed737f2-5350-4325-aff2-0a54026c5098 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:10.912881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ed737f2-5350-4325-aff2-0a54026c5098 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.913550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ed737f2-5350-4325-aff2-0a54026c5098 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.914274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ed737f2-5350-4325-aff2-0a54026c5098 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.915323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ed737f2-5350-4325-aff2-0a54026c5098 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.915909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ed737f2-5350-4325-aff2-0a54026c5098 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.925852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ed737f2-5350-4325-aff2-0a54026c5098 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.975582 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3ed737f2-5350-4325-aff2-0a54026c5098 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136860 Oct 29 02:48:10.980693 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 389/755] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:48:10 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:10.985589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:10.986301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:10.998507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.998914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.999354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:11.000069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:11.000521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:11.003628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:11.053594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=56 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:11.119143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:11.130171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:11.131678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:11.138522 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-de4a44aa-0404-4ce2-bef6-5d75181c1016 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.160775 Oct 29 02:48:11.139511 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 390/756] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:10 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:11.254019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a39ba62-a945-4d80-8e14-fefb962348e0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:11.254957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6a39ba62-a945-4d80-8e14-fefb962348e0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:11.267796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4a691453-8a31-4bc4-aaff-c0b40fbc1b37 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:11.269445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a39ba62-a945-4d80-8e14-fefb962348e0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:11.270141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a39ba62-a945-4d80-8e14-fefb962348e0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:11.270725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a39ba62-a945-4d80-8e14-fefb962348e0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:11.271589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a39ba62-a945-4d80-8e14-fefb962348e0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:11.272216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a39ba62-a945-4d80-8e14-fefb962348e0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:11.272785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a39ba62-a945-4d80-8e14-fefb962348e0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:11.277401 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4a691453-8a31-4bc4-aaff-c0b40fbc1b37 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.484361 Oct 29 02:48:11.281578 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 367/757] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:10 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:11.308817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de9a64a4-228d-4490-8921-c997b60ee5d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:11.309713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-de9a64a4-228d-4490-8921-c997b60ee5d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:11.318832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9a64a4-228d-4490-8921-c997b60ee5d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:11.319669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9a64a4-228d-4490-8921-c997b60ee5d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:11.320256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9a64a4-228d-4490-8921-c997b60ee5d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:11.322062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9a64a4-228d-4490-8921-c997b60ee5d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:11.322673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9a64a4-228d-4490-8921-c997b60ee5d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:11.323607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9a64a4-228d-4490-8921-c997b60ee5d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:11.516742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a39ba62-a945-4d80-8e14-fefb962348e0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:11.525076 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a39ba62-a945-4d80-8e14-fefb962348e0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.274997 Oct 29 02:48:11.538050 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 391/758] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:11 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:11.538050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb68699c-abe9-48b6-9ce9-62eea53173d5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a88bfdc0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:11.665993 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eb68699c-abe9-48b6-9ce9-62eea53173d5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.134461 Oct 29 02:48:11.668745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de9a64a4-228d-4490-8921-c997b60ee5d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:11.669484 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 392/759] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:11 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:11.687143 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de9a64a4-228d-4490-8921-c997b60ee5d5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1318 microversion: 2.1 time: 0.381547 Oct 29 02:48:11.687143 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 368/760] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:11 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:11.779161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-cb6d11d2-6786-4a6d-a6dd-e849232c374e req-5affef48-3b47-4b26-a1d0-3699c35f4eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b4a8c5-c08f-4c33-a57c-f2ac1a910f98", "name": "network-vif-plugged", "status": "completed", "tag": "5717cd64-fb65-441b-8c4c-6aa355302be8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:11.794497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e4b50cae-a080-4367-bb11-452d3408b1ae req-cbfd1e52-a0c4-46b1-ac0d-4ac1cb56cbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c953eb9c-9ad8-471d-95d6-f95740b8b7f2", "tag": "ac90b439-6117-4e0a-8668-61ae3bc23afb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:11.816498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cb6d11d2-6786-4a6d-a6dd-e849232c374e req-5affef48-3b47-4b26-a1d0-3699c35f4eb4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:11.816987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cb6d11d2-6786-4a6d-a6dd-e849232c374e req-5affef48-3b47-4b26-a1d0-3699c35f4eb4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:11.817418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cb6d11d2-6786-4a6d-a6dd-e849232c374e req-5affef48-3b47-4b26-a1d0-3699c35f4eb4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:11.824354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e4b50cae-a080-4367-bb11-452d3408b1ae req-cbfd1e52-a0c4-46b1-ac0d-4ac1cb56cbd6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:11.825281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e4b50cae-a080-4367-bb11-452d3408b1ae req-cbfd1e52-a0c4-46b1-ac0d-4ac1cb56cbd6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:11.829066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e4b50cae-a080-4367-bb11-452d3408b1ae req-cbfd1e52-a0c4-46b1-ac0d-4ac1cb56cbd6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:11.845960 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-cb6d11d2-6786-4a6d-a6dd-e849232c374e req-5affef48-3b47-4b26-a1d0-3699c35f4eb4 service nova] Creating event network-vif-plugged:5717cd64-fb65-441b-8c4c-6aa355302be8 for instance 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 on n-h1-862964-4 Oct 29 02:48:11.852318 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-cb6d11d2-6786-4a6d-a6dd-e849232c374e req-5affef48-3b47-4b26-a1d0-3699c35f4eb4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088828 Oct 29 02:48:11.853251 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 393/761] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:11.861243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:11.862326 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e4b50cae-a080-4367-bb11-452d3408b1ae req-cbfd1e52-a0c4-46b1-ac0d-4ac1cb56cbd6 service nova] Creating event network-changed:ac90b439-6117-4e0a-8668-61ae3bc23afb for instance c953eb9c-9ad8-471d-95d6-f95740b8b7f2 on n-h2-862964-4 Oct 29 02:48:11.863347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:11.874047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:11.874545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:11.874979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:11.875579 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e4b50cae-a080-4367-bb11-452d3408b1ae req-cbfd1e52-a0c4-46b1-ac0d-4ac1cb56cbd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089917 Oct 29 02:48:11.875716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:11.876128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:11.876549 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 369/762] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:11.880069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:11.989408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-62bfd7c4-6837-48b2-a2db-aa8a0d15d5f8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:11.992079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-62bfd7c4-6837-48b2-a2db-aa8a0d15d5f8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:12.010989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62bfd7c4-6837-48b2-a2db-aa8a0d15d5f8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.011689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62bfd7c4-6837-48b2-a2db-aa8a0d15d5f8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.012011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62bfd7c4-6837-48b2-a2db-aa8a0d15d5f8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.012724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62bfd7c4-6837-48b2-a2db-aa8a0d15d5f8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.013221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62bfd7c4-6837-48b2-a2db-aa8a0d15d5f8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.013840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62bfd7c4-6837-48b2-a2db-aa8a0d15d5f8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.068372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.079822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.081475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.082812 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-afb8b083-5616-4a5a-bf88-feeb8e5f9b94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.228414 Oct 29 02:48:12.083797 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 394/763] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:11 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:12.092854 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-62bfd7c4-6837-48b2-a2db-aa8a0d15d5f8 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107980 Oct 29 02:48:12.097932 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 370/764] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:48:11 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 02:48:12.179212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:12.179816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:12.185925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.186413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.186834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.187540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.187987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.188410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.263651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.273971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.275639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.281713 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-34827394-ee99-48f9-ade2-4e6c7f7640b3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.113787 Oct 29 02:48:12.282574 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 395/765] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:12 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:12.310060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8017be80-b368-4c5f-85ca-08105c6430a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:12.310794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8017be80-b368-4c5f-85ca-08105c6430a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:12.315825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1607390184", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "66bf80a4-da1c-49b5-be6c-eead11b1d332"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:12.327929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8017be80-b368-4c5f-85ca-08105c6430a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.331593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8017be80-b368-4c5f-85ca-08105c6430a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.332707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8017be80-b368-4c5f-85ca-08105c6430a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.334164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8017be80-b368-4c5f-85ca-08105c6430a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.334802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8017be80-b368-4c5f-85ca-08105c6430a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.335397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8017be80-b368-4c5f-85ca-08105c6430a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.394931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] validate_networks() for [('66bf80a4-da1c-49b5-be6c-eead11b1d332', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:12.755348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8017be80-b368-4c5f-85ca-08105c6430a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.768161 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8017be80-b368-4c5f-85ca-08105c6430a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.461136 Oct 29 02:48:12.769899 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 371/766] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:12 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:12.786353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83292267-580f-4d30-8461-afbe935a5253 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:12.787328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-83292267-580f-4d30-8461-afbe935a5253 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:12.803078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83292267-580f-4d30-8461-afbe935a5253 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.804435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83292267-580f-4d30-8461-afbe935a5253 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.805315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83292267-580f-4d30-8461-afbe935a5253 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.806760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83292267-580f-4d30-8461-afbe935a5253 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.807452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83292267-580f-4d30-8461-afbe935a5253 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.808073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83292267-580f-4d30-8461-afbe935a5253 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.014253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:13.014712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:13.014975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:13.015373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:13.015777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:13.030354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.030852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.031293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.032033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.032487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.032904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.044340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=17 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:13.055869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Getting quotas for project f76e01279e6d47c0aa4fb03206db8050. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:13.060238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Getting quotas for user 1486b01e2a39475dab72aa7f36816c1a and project f76e01279e6d47c0aa4fb03206db8050. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:13.077265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:13.080025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:13.092788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:13.147181 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b66f7b6e-7c85-4ad1-aec3-000ea7f35bcd tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835417 Oct 29 02:48:13.148071 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 396/767] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 02:48:13.159737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b97d759-f849-4fad-b89e-a6dc1f8a1413 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8858af0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:13.222979 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4b97d759-f849-4fad-b89e-a6dc1f8a1413 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.067976 Oct 29 02:48:13.223785 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 397/768] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:13 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:13.236661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5d7ae759-5231-4eea-9b44-bf81e1d5bbf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:13.237401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-83292267-580f-4d30-8461-afbe935a5253 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.244991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5d7ae759-5231-4eea-9b44-bf81e1d5bbf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:13.254509 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-83292267-580f-4d30-8461-afbe935a5253 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.483268 Oct 29 02:48:13.258619 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 372/769] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:12 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:13.271009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d7ae759-5231-4eea-9b44-bf81e1d5bbf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.271497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:13.272116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:13.280072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d7ae759-5231-4eea-9b44-bf81e1d5bbf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.280635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d7ae759-5231-4eea-9b44-bf81e1d5bbf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.281478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d7ae759-5231-4eea-9b44-bf81e1d5bbf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.282093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d7ae759-5231-4eea-9b44-bf81e1d5bbf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.282620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d7ae759-5231-4eea-9b44-bf81e1d5bbf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.284735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.287685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.288186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.288912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.289420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.298789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.574154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5d7ae759-5231-4eea-9b44-bf81e1d5bbf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.596633 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5d7ae759-5231-4eea-9b44-bf81e1d5bbf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1318 microversion: 2.1 time: 0.363700 Oct 29 02:48:13.601168 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 398/770] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:13 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:13.612649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f18f3964-2ba0-43de-a809-1adbb51bb701 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:13.613615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f18f3964-2ba0-43de-a809-1adbb51bb701 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:13.710333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f18f3964-2ba0-43de-a809-1adbb51bb701 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.724529 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f18f3964-2ba0-43de-a809-1adbb51bb701 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1218 microversion: 2.1 time: 0.116238 Oct 29 02:48:13.725707 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 399/771] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:13 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:13.738259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-915b7604-e0f9-4203-8f5c-9b17785ae506 req-e22d2e90-65de-456b-999a-630732391a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981cdc70-e4e6-4431-a243-068d39d4160d", "name": "network-vif-unplugged", "status": "completed", "tag": "1861c328-f726-4893-80d7-4debdd4d709b"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:13.756150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-915b7604-e0f9-4203-8f5c-9b17785ae506 req-e22d2e90-65de-456b-999a-630732391a36 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.756830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-915b7604-e0f9-4203-8f5c-9b17785ae506 req-e22d2e90-65de-456b-999a-630732391a36 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.760063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-915b7604-e0f9-4203-8f5c-9b17785ae506 req-e22d2e90-65de-456b-999a-630732391a36 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.774412 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-915b7604-e0f9-4203-8f5c-9b17785ae506 req-e22d2e90-65de-456b-999a-630732391a36 service nova] Creating event network-vif-unplugged:1861c328-f726-4893-80d7-4debdd4d709b for instance 981cdc70-e4e6-4431-a243-068d39d4160d on n-h1-862964-4 Oct 29 02:48:13.781743 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-915b7604-e0f9-4203-8f5c-9b17785ae506 req-e22d2e90-65de-456b-999a-630732391a36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054221 Oct 29 02:48:13.782999 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 400/772] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:13.792131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:13.793130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:13.803194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.803904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.804509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.805668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.806305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.806887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.832042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.845103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.846821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.853157 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c562b39-5f68-48d1-a44b-6ab3e170321b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.592503 Oct 29 02:48:13.853760 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 373/773] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:13 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:13.865069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cecfa334-1329-48a4-b5c0-4f25ca7a9335 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:13.870472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cecfa334-1329-48a4-b5c0-4f25ca7a9335 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:13.879974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cecfa334-1329-48a4-b5c0-4f25ca7a9335 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.880477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cecfa334-1329-48a4-b5c0-4f25ca7a9335 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.884730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cecfa334-1329-48a4-b5c0-4f25ca7a9335 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.886908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cecfa334-1329-48a4-b5c0-4f25ca7a9335 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.887863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cecfa334-1329-48a4-b5c0-4f25ca7a9335 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.888161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cecfa334-1329-48a4-b5c0-4f25ca7a9335 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.920818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.941612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.943145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.966695 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-214c7f33-e25b-4476-8c79-cb1effef8ae3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.178816 Oct 29 02:48:13.967354 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 401/774] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:13 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:14.198524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cecfa334-1329-48a4-b5c0-4f25ca7a9335 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:14.208324 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cecfa334-1329-48a4-b5c0-4f25ca7a9335 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.352172 Oct 29 02:48:14.209478 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 374/775] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:13 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:14.239077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-697712f5-a06a-4330-867a-5086c70d39ca tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a88bf940>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:14.282981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-05088867-4675-4d9a-818e-0ffe45dbca65 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:14.283589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-05088867-4675-4d9a-818e-0ffe45dbca65 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:14.292014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:14.293420 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-697712f5-a06a-4330-867a-5086c70d39ca tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.058037 Oct 29 02:48:14.302027 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 402/776] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:14 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:14.303105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05088867-4675-4d9a-818e-0ffe45dbca65 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.303643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05088867-4675-4d9a-818e-0ffe45dbca65 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.304090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05088867-4675-4d9a-818e-0ffe45dbca65 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.304829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05088867-4675-4d9a-818e-0ffe45dbca65 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.305538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05088867-4675-4d9a-818e-0ffe45dbca65 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.306023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05088867-4675-4d9a-818e-0ffe45dbca65 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.509464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05088867-4675-4d9a-818e-0ffe45dbca65 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:14.518497 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-05088867-4675-4d9a-818e-0ffe45dbca65 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.239328 Oct 29 02:48:14.534609 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 375/777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:14 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:14.627530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-917d9c0c-0c97-452b-a759-c6eb3b386fcf tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:14.628994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-917d9c0c-0c97-452b-a759-c6eb3b386fcf tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:14.637766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-917d9c0c-0c97-452b-a759-c6eb3b386fcf tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.638416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-917d9c0c-0c97-452b-a759-c6eb3b386fcf tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.638854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-917d9c0c-0c97-452b-a759-c6eb3b386fcf tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.639581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-917d9c0c-0c97-452b-a759-c6eb3b386fcf tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.640213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-917d9c0c-0c97-452b-a759-c6eb3b386fcf tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.640675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-917d9c0c-0c97-452b-a759-c6eb3b386fcf tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.748902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-efd399c0-f096-4d65-908b-85d5c856f227 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:14.749689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-efd399c0-f096-4d65-908b-85d5c856f227 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:14.756563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efd399c0-f096-4d65-908b-85d5c856f227 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.757318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efd399c0-f096-4d65-908b-85d5c856f227 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.758154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efd399c0-f096-4d65-908b-85d5c856f227 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.759304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efd399c0-f096-4d65-908b-85d5c856f227 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.759863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efd399c0-f096-4d65-908b-85d5c856f227 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.760383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efd399c0-f096-4d65-908b-85d5c856f227 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.795631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-917d9c0c-0c97-452b-a759-c6eb3b386fcf tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:14.810445 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-917d9c0c-0c97-452b-a759-c6eb3b386fcf tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1467 microversion: 2.1 time: 0.191748 Oct 29 02:48:14.827958 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 403/778] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:14 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1467 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:14.836512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c2e0a80e-9089-4cab-823f-06d90f735ce8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:14.836865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-efd399c0-f096-4d65-908b-85d5c856f227 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:14.837525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c2e0a80e-9089-4cab-823f-06d90f735ce8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: e28d98f2-e795-480d-974a-094260081964] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:14.844126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e0a80e-9089-4cab-823f-06d90f735ce8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.844608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e0a80e-9089-4cab-823f-06d90f735ce8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.845035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e0a80e-9089-4cab-823f-06d90f735ce8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.845735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e0a80e-9089-4cab-823f-06d90f735ce8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.846224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e0a80e-9089-4cab-823f-06d90f735ce8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.846642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e0a80e-9089-4cab-823f-06d90f735ce8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.847393 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-efd399c0-f096-4d65-908b-85d5c856f227 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1214 microversion: 2.1 time: 0.103235 Oct 29 02:48:14.857897 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 376/779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:14 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:14.881654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:14.882399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:14.889469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.890087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.890623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.891492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.892006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.892493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.999583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c2e0a80e-9089-4cab-823f-06d90f735ce8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.008288 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c2e0a80e-9089-4cab-823f-06d90f735ce8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964" status: 200 len: 1468 microversion: 2.1 time: 0.176568 Oct 29 02:48:15.009338 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 404/780] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:14 2022] GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964 => generated 1468 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:15.022326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:15.022932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:15.034617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.035109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.035681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.036393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.036834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.037268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.072230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.083618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.085094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.086338 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4137b542-17b6-43f4-8010-ab137d44d78b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.209173 Oct 29 02:48:15.104992 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 377/781] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:14 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:15.113377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:15.116662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.118703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.120621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Searching by: {'reservation_id': 'r-nk2bixas', 'deleted': False, 'project_id': '1031cc111cc747098bbc8a428c1cfad6'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:48:15.126048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.127493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.127950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.128093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.128380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.130927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.130927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.130927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.136472 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6fdec789-d32b-4e71-b9de-3d51a3cb93c2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.125879 Oct 29 02:48:15.145961 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 405/782] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:15 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:15.228565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:48:15.233268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6490a220-826e-401a-917f-6981f80d1b35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:15.233994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6490a220-826e-401a-917f-6981f80d1b35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:15.245621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6490a220-826e-401a-917f-6981f80d1b35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.246369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6490a220-826e-401a-917f-6981f80d1b35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.246593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6490a220-826e-401a-917f-6981f80d1b35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.247334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6490a220-826e-401a-917f-6981f80d1b35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.247731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6490a220-826e-401a-917f-6981f80d1b35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.248194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6490a220-826e-401a-917f-6981f80d1b35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.320809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.333010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.333412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.333942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.414966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6490a220-826e-401a-917f-6981f80d1b35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.427342 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6490a220-826e-401a-917f-6981f80d1b35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.199039 Oct 29 02:48:15.434891 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 406/783] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:15 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:15.439981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-31a6d243-f485-4cb2-8f16-884cbe731db7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a88bfb80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:15.492407 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-31a6d243-f485-4cb2-8f16-884cbe731db7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.056098 Oct 29 02:48:15.505200 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 407/784] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:15 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:15.508148 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-018a7c97-0319-42ba-b12d-043c0ed40ea7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-nk2bixas" status: 200 len: 2928 microversion: 2.1 time: 0.401488 Oct 29 02:48:15.509531 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 378/785] 10.222.0.16 () {58 vars in 1197 bytes} [Sat Oct 29 02:48:15 2022] GET /compute/v2.1/servers/detail?reservation_id=r-nk2bixas => generated 2928 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:15.535364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8a840921-0151-4683-9ac4-d41a1bfbb04e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:15.545585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cf5c5f4e-9cc4-4f8d-a364-f6c5413714e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:15.546409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cf5c5f4e-9cc4-4f8d-a364-f6c5413714e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:15.562120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf5c5f4e-9cc4-4f8d-a364-f6c5413714e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.562836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf5c5f4e-9cc4-4f8d-a364-f6c5413714e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.564074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf5c5f4e-9cc4-4f8d-a364-f6c5413714e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.564957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf5c5f4e-9cc4-4f8d-a364-f6c5413714e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.566443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf5c5f4e-9cc4-4f8d-a364-f6c5413714e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.568532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf5c5f4e-9cc4-4f8d-a364-f6c5413714e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.581757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.compute.server_groups [None req-8a840921-0151-4683-9ac4-d41a1bfbb04e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Querying cell 6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) for 2 instances {{(pid=127041) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 02:48:15.582512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a840921-0151-4683-9ac4-d41a1bfbb04e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.582987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a840921-0151-4683-9ac4-d41a1bfbb04e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.583410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a840921-0151-4683-9ac4-d41a1bfbb04e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.614788 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8a840921-0151-4683-9ac4-d41a1bfbb04e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/731c01cd-87d0-4608-800c-5f6c8c707a9e" status: 200 len: 271 microversion: 2.1 time: 0.083800 Oct 29 02:48:15.615694 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 408/786] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 02:48:15 2022] GET /compute/v2.1/os-server-groups/731c01cd-87d0-4608-800c-5f6c8c707a9e => generated 271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:15.629462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8f045ba-2188-43cd-bfb7-57ecca5fbb2d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:15.630477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8f045ba-2188-43cd-bfb7-57ecca5fbb2d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:15.638328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f045ba-2188-43cd-bfb7-57ecca5fbb2d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.638921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f045ba-2188-43cd-bfb7-57ecca5fbb2d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.639426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f045ba-2188-43cd-bfb7-57ecca5fbb2d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.640237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f045ba-2188-43cd-bfb7-57ecca5fbb2d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.640790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f045ba-2188-43cd-bfb7-57ecca5fbb2d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.641373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f045ba-2188-43cd-bfb7-57ecca5fbb2d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.744811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cf5c5f4e-9cc4-4f8d-a364-f6c5413714e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.754600 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cf5c5f4e-9cc4-4f8d-a364-f6c5413714e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.214985 Oct 29 02:48:15.755110 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 379/787] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:15 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:15.809465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4dfaca74-51d8-4b86-b780-092612d23e9c req-18c9ba87-714e-4c9d-86bc-9abd3ef7a780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981cdc70-e4e6-4431-a243-068d39d4160d", "tag": "1861c328-f726-4893-80d7-4debdd4d709b"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:15.819971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4dfaca74-51d8-4b86-b780-092612d23e9c req-18c9ba87-714e-4c9d-86bc-9abd3ef7a780 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.820840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4dfaca74-51d8-4b86-b780-092612d23e9c req-18c9ba87-714e-4c9d-86bc-9abd3ef7a780 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.821411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4dfaca74-51d8-4b86-b780-092612d23e9c req-18c9ba87-714e-4c9d-86bc-9abd3ef7a780 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.833869 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8f045ba-2188-43cd-bfb7-57ecca5fbb2d tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 200 len: 1618 microversion: 2.1 time: 0.208616 Oct 29 02:48:15.835256 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4dfaca74-51d8-4b86-b780-092612d23e9c req-18c9ba87-714e-4c9d-86bc-9abd3ef7a780 service nova] Creating event network-changed:1861c328-f726-4893-80d7-4debdd4d709b for instance 981cdc70-e4e6-4431-a243-068d39d4160d on n-h1-862964-4 Oct 29 02:48:15.848559 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4dfaca74-51d8-4b86-b780-092612d23e9c req-18c9ba87-714e-4c9d-86bc-9abd3ef7a780 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042768 Oct 29 02:48:15.853573 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 380/788] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:48:15.856305 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 409/789] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:15 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 1618 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:15.861337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c9bd8ac1-9c85-4ab3-ab9c-19be3ebe53a2 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:15.862083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c9bd8ac1-9c85-4ab3-ab9c-19be3ebe53a2 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] [instance: e28d98f2-e795-480d-974a-094260081964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:15.868998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9bd8ac1-9c85-4ab3-ab9c-19be3ebe53a2 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.869552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9bd8ac1-9c85-4ab3-ab9c-19be3ebe53a2 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.870005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9bd8ac1-9c85-4ab3-ab9c-19be3ebe53a2 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.871001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9bd8ac1-9c85-4ab3-ab9c-19be3ebe53a2 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.871457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9bd8ac1-9c85-4ab3-ab9c-19be3ebe53a2 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.871866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9bd8ac1-9c85-4ab3-ab9c-19be3ebe53a2 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.874466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4183332d-d5e7-4021-8816-a0d1fc0837f1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:15.875091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4183332d-d5e7-4021-8816-a0d1fc0837f1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:15.882256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4183332d-d5e7-4021-8816-a0d1fc0837f1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.882746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4183332d-d5e7-4021-8816-a0d1fc0837f1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.883266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4183332d-d5e7-4021-8816-a0d1fc0837f1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.884377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4183332d-d5e7-4021-8816-a0d1fc0837f1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.884840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4183332d-d5e7-4021-8816-a0d1fc0837f1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.885265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4183332d-d5e7-4021-8816-a0d1fc0837f1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.983526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4183332d-d5e7-4021-8816-a0d1fc0837f1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.991813 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4183332d-d5e7-4021-8816-a0d1fc0837f1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1270 microversion: 2.1 time: 0.124312 Oct 29 02:48:15.996366 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 410/790] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:15 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:16.074217 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c9bd8ac1-9c85-4ab3-ab9c-19be3ebe53a2 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964" status: 200 len: 1619 microversion: 2.1 time: 0.216854 Oct 29 02:48:16.074812 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 381/791] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:15 2022] GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964 => generated 1619 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:16.119091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:16.119721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:16.134221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.134739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.139361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.142439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.142925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.143359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.150781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:16.166204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:16.167143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:16.188483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.192512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.193174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.194098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.194719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.196993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.349999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.366577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.369486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.374782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.376815 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-effa1115-fde1-403d-ac6f-2059596f5b89 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.214721 Oct 29 02:48:16.377947 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 382/792] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:16 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:16.383772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2118411651", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:16.385025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.386469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.387621 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac37536f-2372-4d93-ac22-4dc97b0880af tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.273833 Oct 29 02:48:16.396835 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 411/793] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:16 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:16.451362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1173951f-12a7-47a4-acec-6ba1387fc27a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:16.452176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1173951f-12a7-47a4-acec-6ba1387fc27a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:16.455727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:16.465646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1173951f-12a7-47a4-acec-6ba1387fc27a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.466208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1173951f-12a7-47a4-acec-6ba1387fc27a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.469640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1173951f-12a7-47a4-acec-6ba1387fc27a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.470433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1173951f-12a7-47a4-acec-6ba1387fc27a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.470892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1173951f-12a7-47a4-acec-6ba1387fc27a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.471313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1173951f-12a7-47a4-acec-6ba1387fc27a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.653405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1173951f-12a7-47a4-acec-6ba1387fc27a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.665420 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1173951f-12a7-47a4-acec-6ba1387fc27a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.217837 Oct 29 02:48:16.676822 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 412/794] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:16 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:16.676822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec0fb0db-290d-4ef0-9824-5bff49f28da3 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a88bee50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:16.725539 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ec0fb0db-290d-4ef0-9824-5bff49f28da3 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.058071 Oct 29 02:48:16.735136 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 413/795] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:16 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:16.780979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-60fe290a-8e83-4a10-b6d3-0275e4d5a158 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:16.781594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-60fe290a-8e83-4a10-b6d3-0275e4d5a158 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:16.792872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60fe290a-8e83-4a10-b6d3-0275e4d5a158 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.794030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60fe290a-8e83-4a10-b6d3-0275e4d5a158 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.797022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60fe290a-8e83-4a10-b6d3-0275e4d5a158 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.799841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60fe290a-8e83-4a10-b6d3-0275e4d5a158 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.800334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60fe290a-8e83-4a10-b6d3-0275e4d5a158 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.803973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60fe290a-8e83-4a10-b6d3-0275e4d5a158 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.972248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-60fe290a-8e83-4a10-b6d3-0275e4d5a158 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.981495 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-60fe290a-8e83-4a10-b6d3-0275e4d5a158 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.206530 Oct 29 02:48:16.982529 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 414/796] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:16 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:17.020723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0bc3e2a0-ee43-407f-9cb6-9216ada5a2ff tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:17.023072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0bc3e2a0-ee43-407f-9cb6-9216ada5a2ff tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:17.030098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bc3e2a0-ee43-407f-9cb6-9216ada5a2ff tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.030733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bc3e2a0-ee43-407f-9cb6-9216ada5a2ff tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.031259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bc3e2a0-ee43-407f-9cb6-9216ada5a2ff tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.032142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bc3e2a0-ee43-407f-9cb6-9216ada5a2ff tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.034207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bc3e2a0-ee43-407f-9cb6-9216ada5a2ff tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.034838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bc3e2a0-ee43-407f-9cb6-9216ada5a2ff tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.107070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0bc3e2a0-ee43-407f-9cb6-9216ada5a2ff tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.115557 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0bc3e2a0-ee43-407f-9cb6-9216ada5a2ff tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1270 microversion: 2.1 time: 0.100114 Oct 29 02:48:17.129868 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 415/797] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:17 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:17.232923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:17.234062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:17.234719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:17.235282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:17.235857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:17.252343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.259252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.259954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.260913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.261600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.262226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.310831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:17.315616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:17.339801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:17.344545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:17.410329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:17.411494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:17.421021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.425092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.426176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.426930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.427398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.427821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.432103 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-abb2073a-f914-4fee-b4b3-ca8b342c0ad0 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052058 Oct 29 02:48:17.440039 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 383/798] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:17.448397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:17.449380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:17.456638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.457993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.458610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.459805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.460425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.461002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.651323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.661598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.663288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.670903 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f6f26683-7a23-4997-bdd0-f0a06fe34fcb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.266903 Oct 29 02:48:17.694160 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 416/799] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:17 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:17.715675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e62a05d-8ddb-4e20-a2be-ac8c03f6ebf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:17.716720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e62a05d-8ddb-4e20-a2be-ac8c03f6ebf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:17.779573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2e62a05d-8ddb-4e20-a2be-ac8c03f6ebf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.787881 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e62a05d-8ddb-4e20-a2be-ac8c03f6ebf9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1217 microversion: 2.1 time: 0.082812 Oct 29 02:48:17.793859 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 417/800] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:17 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:17.807296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94e02017-0480-465a-8b7d-ed2368715c2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:17.808111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-94e02017-0480-465a-8b7d-ed2368715c2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:17.817455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e02017-0480-465a-8b7d-ed2368715c2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.819361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e02017-0480-465a-8b7d-ed2368715c2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.819839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e02017-0480-465a-8b7d-ed2368715c2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.821412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e02017-0480-465a-8b7d-ed2368715c2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.822139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e02017-0480-465a-8b7d-ed2368715c2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.822804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e02017-0480-465a-8b7d-ed2368715c2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.863530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.874845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.878758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.881160 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e75335be-7c31-416a-a144-8e32749a863a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.439817 Oct 29 02:48:17.900181 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 384/801] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:17 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:17.900181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09ed37b9-ff5e-4979-800e-6211e35ccbba tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c0b040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:17.961164 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-09ed37b9-ff5e-4979-800e-6211e35ccbba tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.074636 Oct 29 02:48:17.962261 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 385/802] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:17 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:18.011737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-535f40cf-d664-4773-8919-ef173bd63a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:18.012606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-535f40cf-d664-4773-8919-ef173bd63a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:18.027548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535f40cf-d664-4773-8919-ef173bd63a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.028045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535f40cf-d664-4773-8919-ef173bd63a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.028478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535f40cf-d664-4773-8919-ef173bd63a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.029186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535f40cf-d664-4773-8919-ef173bd63a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.029678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535f40cf-d664-4773-8919-ef173bd63a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.030069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535f40cf-d664-4773-8919-ef173bd63a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.034777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:18.336003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-94e02017-0480-465a-8b7d-ed2368715c2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:18.352139 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94e02017-0480-465a-8b7d-ed2368715c2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.555373 Oct 29 02:48:18.361621 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 418/803] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:17 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:18.361867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4d1aec0f-bf82-4edf-89e6-996f8250ef52 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:18.362495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4d1aec0f-bf82-4edf-89e6-996f8250ef52 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:18.369294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d1aec0f-bf82-4edf-89e6-996f8250ef52 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.369778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d1aec0f-bf82-4edf-89e6-996f8250ef52 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.374863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d1aec0f-bf82-4edf-89e6-996f8250ef52 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.379844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d1aec0f-bf82-4edf-89e6-996f8250ef52 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.380364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d1aec0f-bf82-4edf-89e6-996f8250ef52 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.380807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d1aec0f-bf82-4edf-89e6-996f8250ef52 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.467177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-535f40cf-d664-4773-8919-ef173bd63a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:18.475991 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-535f40cf-d664-4773-8919-ef173bd63a46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.468270 Oct 29 02:48:18.501027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4d1aec0f-bf82-4edf-89e6-996f8250ef52 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:18.501979 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 386/804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:18 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:18.509189 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4d1aec0f-bf82-4edf-89e6-996f8250ef52 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1276 microversion: 2.1 time: 0.153726 Oct 29 02:48:18.511487 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 419/805] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:18 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:18.700046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:18.700656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:18.711145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.711945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.712547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.719107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.719849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.720577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.816556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b05a0197-6641-4184-94ab-11d151bc764c tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:18.818050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b05a0197-6641-4184-94ab-11d151bc764c tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:18.833613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b05a0197-6641-4184-94ab-11d151bc764c tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.834471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b05a0197-6641-4184-94ab-11d151bc764c tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.835077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b05a0197-6641-4184-94ab-11d151bc764c tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.836395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b05a0197-6641-4184-94ab-11d151bc764c tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.837483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b05a0197-6641-4184-94ab-11d151bc764c tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.838445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b05a0197-6641-4184-94ab-11d151bc764c tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.898466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:18.909612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:18.911143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:18.934301 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-25721080-add9-4876-9170-7ca35b6df293 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.237456 Oct 29 02:48:18.938093 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 387/806] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:18 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:18.949931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:18.955765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:18.967256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.967753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.968185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.979147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.980240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.980770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.025672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b05a0197-6641-4184-94ab-11d151bc764c tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:19.053843 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b05a0197-6641-4184-94ab-11d151bc764c tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1269 microversion: 2.1 time: 0.240390 Oct 29 02:48:19.066903 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 420/807] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:18 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1269 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:19.082164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ffba078a-20d4-4ba6-b60b-da88fe2cdfbd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a88bf5e0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:19.172591 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ffba078a-20d4-4ba6-b60b-da88fe2cdfbd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.103108 Oct 29 02:48:19.173626 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 421/808] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:19 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:19.379904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-22357f89-572e-4365-af6d-6aea25720c5b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:19.380510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-22357f89-572e-4365-af6d-6aea25720c5b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:19.396377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22357f89-572e-4365-af6d-6aea25720c5b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.396880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22357f89-572e-4365-af6d-6aea25720c5b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.397311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22357f89-572e-4365-af6d-6aea25720c5b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.398044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22357f89-572e-4365-af6d-6aea25720c5b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.398496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22357f89-572e-4365-af6d-6aea25720c5b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.399897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22357f89-572e-4365-af6d-6aea25720c5b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.451592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:19.462485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:19.469192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:19.471968 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6f142b33-8652-4f37-99a4-638f70450014 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.532604 Oct 29 02:48:19.473007 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 388/809] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:18 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:19.512731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b106b558-f3c4-45e6-a454-7f27eed60aac tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:19.516642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b106b558-f3c4-45e6-a454-7f27eed60aac tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:19.530849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b106b558-f3c4-45e6-a454-7f27eed60aac tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.532128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b106b558-f3c4-45e6-a454-7f27eed60aac tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.543464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b106b558-f3c4-45e6-a454-7f27eed60aac tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.544719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b106b558-f3c4-45e6-a454-7f27eed60aac tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.545355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b106b558-f3c4-45e6-a454-7f27eed60aac tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.549477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b106b558-f3c4-45e6-a454-7f27eed60aac tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.758964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b106b558-f3c4-45e6-a454-7f27eed60aac tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:19.764564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-22357f89-572e-4365-af6d-6aea25720c5b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:19.773890 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-22357f89-572e-4365-af6d-6aea25720c5b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.397940 Oct 29 02:48:19.776696 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b106b558-f3c4-45e6-a454-7f27eed60aac tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.268757 Oct 29 02:48:19.779762 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 389/810] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:19 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:19.786074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bcdcdbb-d84a-476b-afdb-c3e91b3f5189 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:19.787004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bcdcdbb-d84a-476b-afdb-c3e91b3f5189 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:19.796176 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 422/811] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:19 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:19.812554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcdcdbb-d84a-476b-afdb-c3e91b3f5189 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.814236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcdcdbb-d84a-476b-afdb-c3e91b3f5189 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.814944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcdcdbb-d84a-476b-afdb-c3e91b3f5189 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.815807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcdcdbb-d84a-476b-afdb-c3e91b3f5189 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.817461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcdcdbb-d84a-476b-afdb-c3e91b3f5189 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.818327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcdcdbb-d84a-476b-afdb-c3e91b3f5189 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.970124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:19.970958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:19.988727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.989407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.989993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.991080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.992056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.992951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.041454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9bcdcdbb-d84a-476b-afdb-c3e91b3f5189 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:20.056613 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9bcdcdbb-d84a-476b-afdb-c3e91b3f5189 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1318 microversion: 2.1 time: 0.275343 Oct 29 02:48:20.075816 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 390/812] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:19 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:20.099456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-68362462-5876-483b-baef-5925b8af1dfb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:20.102304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-68362462-5876-483b-baef-5925b8af1dfb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:20.109217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:20.127673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68362462-5876-483b-baef-5925b8af1dfb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.128183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68362462-5876-483b-baef-5925b8af1dfb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.128619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68362462-5876-483b-baef-5925b8af1dfb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.129346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68362462-5876-483b-baef-5925b8af1dfb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.132336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:20.135489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:20.140694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68362462-5876-483b-baef-5925b8af1dfb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.141794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68362462-5876-483b-baef-5925b8af1dfb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.159912 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c0589cf8-4fc1-47dd-8f76-85c674820303 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.194558 Oct 29 02:48:20.161333 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 423/813] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:19 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:20.190495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1ac7db1a-13d9-4166-b3c5-ccfc913e76a1 req-7bb64c72-3b27-4932-9b21-27221135dba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28f938c7-da78-4178-a53b-839924fa802f", "tag": "598eb911-ac3c-4b84-8804-7de01ad4a3a8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:20.213470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1ac7db1a-13d9-4166-b3c5-ccfc913e76a1 req-7bb64c72-3b27-4932-9b21-27221135dba0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.214015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1ac7db1a-13d9-4166-b3c5-ccfc913e76a1 req-7bb64c72-3b27-4932-9b21-27221135dba0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.214453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1ac7db1a-13d9-4166-b3c5-ccfc913e76a1 req-7bb64c72-3b27-4932-9b21-27221135dba0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.280779 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1ac7db1a-13d9-4166-b3c5-ccfc913e76a1 req-7bb64c72-3b27-4932-9b21-27221135dba0 service nova] Creating event network-changed:598eb911-ac3c-4b84-8804-7de01ad4a3a8 for instance 28f938c7-da78-4178-a53b-839924fa802f on n-h1-862964-4 Oct 29 02:48:20.298994 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1ac7db1a-13d9-4166-b3c5-ccfc913e76a1 req-7bb64c72-3b27-4932-9b21-27221135dba0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115996 Oct 29 02:48:20.300059 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 424/814] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:48:20.310013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95dd7327-ef1b-4b52-b8db-afc16c086565 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8858dc0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:20.310654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-68362462-5876-483b-baef-5925b8af1dfb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:20.327087 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-68362462-5876-483b-baef-5925b8af1dfb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1269 microversion: 2.1 time: 0.248327 Oct 29 02:48:20.328252 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 391/815] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:20 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1269 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:20.375961 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-95dd7327-ef1b-4b52-b8db-afc16c086565 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1424 microversion: 2.1 time: 0.074007 Oct 29 02:48:20.376539 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 425/816] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:20 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:20.499725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:20.500481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:20.507881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.508697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.509290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.510122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.510772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.511253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.810523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59157d20-fa07-489b-9621-d24db20c9cd4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:20.812133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59157d20-fa07-489b-9621-d24db20c9cd4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:20.820154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157d20-fa07-489b-9621-d24db20c9cd4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.821320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157d20-fa07-489b-9621-d24db20c9cd4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.822140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157d20-fa07-489b-9621-d24db20c9cd4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.823441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157d20-fa07-489b-9621-d24db20c9cd4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.824207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157d20-fa07-489b-9621-d24db20c9cd4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.824897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157d20-fa07-489b-9621-d24db20c9cd4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.892370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:20.910798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:20.912869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:20.914503 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7de9fa84-06c9-48b8-9ead-3842c742fb5d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.419347 Oct 29 02:48:20.927084 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 392/817] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:20 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:20.948414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f4c48d39-ee62-4d23-ba54-5f5bf144b02c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:20.949330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f4c48d39-ee62-4d23-ba54-5f5bf144b02c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:20.956168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4c48d39-ee62-4d23-ba54-5f5bf144b02c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.956519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4c48d39-ee62-4d23-ba54-5f5bf144b02c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.957161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4c48d39-ee62-4d23-ba54-5f5bf144b02c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.958004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4c48d39-ee62-4d23-ba54-5f5bf144b02c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.958564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4c48d39-ee62-4d23-ba54-5f5bf144b02c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.960075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4c48d39-ee62-4d23-ba54-5f5bf144b02c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.059033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59157d20-fa07-489b-9621-d24db20c9cd4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.068024 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59157d20-fa07-489b-9621-d24db20c9cd4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.261889 Oct 29 02:48:21.068843 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 426/818] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:20 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:21.095733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-464263be-c8ee-4eb3-930d-d3a32366b4d3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:21.096631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-464263be-c8ee-4eb3-930d-d3a32366b4d3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:21.104323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-464263be-c8ee-4eb3-930d-d3a32366b4d3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.105123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-464263be-c8ee-4eb3-930d-d3a32366b4d3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.105794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-464263be-c8ee-4eb3-930d-d3a32366b4d3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.107231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-464263be-c8ee-4eb3-930d-d3a32366b4d3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.109041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-464263be-c8ee-4eb3-930d-d3a32366b4d3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.110848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-464263be-c8ee-4eb3-930d-d3a32366b4d3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.200821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f4c48d39-ee62-4d23-ba54-5f5bf144b02c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.211314 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f4c48d39-ee62-4d23-ba54-5f5bf144b02c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.267511 Oct 29 02:48:21.212883 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 393/819] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:20 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:21.218093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:21.219140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:21.228239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.228729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.229157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.229894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.230345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.230762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.279839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-464263be-c8ee-4eb3-930d-d3a32366b4d3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.288038 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-464263be-c8ee-4eb3-930d-d3a32366b4d3 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1318 microversion: 2.1 time: 0.198840 Oct 29 02:48:21.288637 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 427/820] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:21 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:21.325993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.335815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.337637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.343122 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eb7ec143-2a8f-4e6c-9751-5923573da55c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.128928 Oct 29 02:48:21.344790 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 394/821] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:21 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:21.360380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-03e8f5df-5830-4819-8dae-9345cfcaefb9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:21.361026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-03e8f5df-5830-4819-8dae-9345cfcaefb9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:21.367449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03e8f5df-5830-4819-8dae-9345cfcaefb9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.367947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03e8f5df-5830-4819-8dae-9345cfcaefb9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.368618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03e8f5df-5830-4819-8dae-9345cfcaefb9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.369364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03e8f5df-5830-4819-8dae-9345cfcaefb9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.369844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03e8f5df-5830-4819-8dae-9345cfcaefb9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.370580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03e8f5df-5830-4819-8dae-9345cfcaefb9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.392649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d968dcbb-8961-4d14-a6b3-52644e550b02 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c0bd30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:21.443931 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d968dcbb-8961-4d14-a6b3-52644e550b02 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1433 microversion: 2.1 time: 0.055290 Oct 29 02:48:21.445117 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 395/822] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:21 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1433 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:21.462705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9516a817-7a07-4f4b-becd-186bfccc784f tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c0b700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:21.469437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-03e8f5df-5830-4819-8dae-9345cfcaefb9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.482484 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-03e8f5df-5830-4819-8dae-9345cfcaefb9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1275 microversion: 2.1 time: 0.126073 Oct 29 02:48:21.483095 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 428/823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:21 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:21.522284 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9516a817-7a07-4f4b-becd-186bfccc784f tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 200 len: 1433 microversion: 2.1 time: 0.062786 Oct 29 02:48:21.523182 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 396/824] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:21 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 1433 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:21.537417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-41f9d421-2f28-4333-b237-70cdc53e695b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:21.538088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-41f9d421-2f28-4333-b237-70cdc53e695b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:21.544618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41f9d421-2f28-4333-b237-70cdc53e695b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.545108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41f9d421-2f28-4333-b237-70cdc53e695b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.545540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41f9d421-2f28-4333-b237-70cdc53e695b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.546285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41f9d421-2f28-4333-b237-70cdc53e695b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.546736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41f9d421-2f28-4333-b237-70cdc53e695b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.547153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41f9d421-2f28-4333-b237-70cdc53e695b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.703172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-41f9d421-2f28-4333-b237-70cdc53e695b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.713272 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-41f9d421-2f28-4333-b237-70cdc53e695b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1479 microversion: 2.1 time: 0.179821 Oct 29 02:48:21.739326 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 429/825] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:21 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1479 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:21.948518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:21.949120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:21.960372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.961510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.961978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.962747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.963205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.963676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.098629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8465367a-d2ec-4d7a-8ff7-d32bf66237d0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:22.099527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8465367a-d2ec-4d7a-8ff7-d32bf66237d0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:22.103238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.107305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8465367a-d2ec-4d7a-8ff7-d32bf66237d0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.108101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8465367a-d2ec-4d7a-8ff7-d32bf66237d0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.108598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8465367a-d2ec-4d7a-8ff7-d32bf66237d0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.109371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8465367a-d2ec-4d7a-8ff7-d32bf66237d0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.110234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8465367a-d2ec-4d7a-8ff7-d32bf66237d0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.110750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8465367a-d2ec-4d7a-8ff7-d32bf66237d0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.112206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.113897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.115313 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-315abc08-e2d7-4f43-b013-18f6f8b4262d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.170783 Oct 29 02:48:22.115877 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 397/826] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:21 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:22.236113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f25f7812-3e45-4ba1-b5c1-134626f4de06 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:22.236634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f25f7812-3e45-4ba1-b5c1-134626f4de06 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:22.246407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8465367a-d2ec-4d7a-8ff7-d32bf66237d0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.249737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25f7812-3e45-4ba1-b5c1-134626f4de06 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.250392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25f7812-3e45-4ba1-b5c1-134626f4de06 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.250827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25f7812-3e45-4ba1-b5c1-134626f4de06 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.251547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25f7812-3e45-4ba1-b5c1-134626f4de06 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.251994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25f7812-3e45-4ba1-b5c1-134626f4de06 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.252412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25f7812-3e45-4ba1-b5c1-134626f4de06 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.260524 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8465367a-d2ec-4d7a-8ff7-d32bf66237d0 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.166910 Oct 29 02:48:22.261119 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 430/827] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:22 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:22.312162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c642ef99-5637-42df-8c01-d65d35698fe7 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:22.312902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c642ef99-5637-42df-8c01-d65d35698fe7 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:22.319234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c642ef99-5637-42df-8c01-d65d35698fe7 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.319802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c642ef99-5637-42df-8c01-d65d35698fe7 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.320301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c642ef99-5637-42df-8c01-d65d35698fe7 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.321214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c642ef99-5637-42df-8c01-d65d35698fe7 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.321734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c642ef99-5637-42df-8c01-d65d35698fe7 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.322244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c642ef99-5637-42df-8c01-d65d35698fe7 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.402106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f25f7812-3e45-4ba1-b5c1-134626f4de06 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.410289 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f25f7812-3e45-4ba1-b5c1-134626f4de06 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.178329 Oct 29 02:48:22.410970 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 398/828] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:22 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:22.415634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:22.416502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:22.422806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.423378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.423874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.424776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.425307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.426130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.464156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c642ef99-5637-42df-8c01-d65d35698fe7 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.472676 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c642ef99-5637-42df-8c01-d65d35698fe7 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1318 microversion: 2.1 time: 0.164345 Oct 29 02:48:22.473705 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 431/829] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:22 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:22.496999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.505204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.506689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.507427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6ed91e46-79f2-48b4-9730-62e7998ed0dc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:22.508120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6ed91e46-79f2-48b4-9730-62e7998ed0dc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:22.511895 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f32f68a7-32b5-42a9-b7e9-6c2e78d8d950 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.099900 Oct 29 02:48:22.512468 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 399/830] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:22 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:22.515171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ed91e46-79f2-48b4-9730-62e7998ed0dc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.515650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ed91e46-79f2-48b4-9730-62e7998ed0dc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.516082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ed91e46-79f2-48b4-9730-62e7998ed0dc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.516774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ed91e46-79f2-48b4-9730-62e7998ed0dc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.517221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ed91e46-79f2-48b4-9730-62e7998ed0dc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.517665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ed91e46-79f2-48b4-9730-62e7998ed0dc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.537501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:22.648071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6ed91e46-79f2-48b4-9730-62e7998ed0dc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.656067 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6ed91e46-79f2-48b4-9730-62e7998ed0dc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1317 microversion: 2.1 time: 0.152603 Oct 29 02:48:22.656636 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 432/831] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:22 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:22.744635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a1c67536-9c39-4516-b550-dfdd24f127f6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:22.745955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a1c67536-9c39-4516-b550-dfdd24f127f6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:22.755950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1c67536-9c39-4516-b550-dfdd24f127f6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.756717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1c67536-9c39-4516-b550-dfdd24f127f6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.757476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1c67536-9c39-4516-b550-dfdd24f127f6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.758571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1c67536-9c39-4516-b550-dfdd24f127f6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.759022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1c67536-9c39-4516-b550-dfdd24f127f6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.759440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1c67536-9c39-4516-b550-dfdd24f127f6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.892099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a1c67536-9c39-4516-b550-dfdd24f127f6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.900260 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a1c67536-9c39-4516-b550-dfdd24f127f6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1466 microversion: 2.1 time: 0.162264 Oct 29 02:48:22.900832 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 400/832] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:22 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1466 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:22.923606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-109f7abc-fc83-4ce8-b806-621c3053ee9f tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a88bf700>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:22.967024 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-109f7abc-fc83-4ce8-b806-621c3053ee9f tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/c6777954-04bd-4ae1-b363-bbcd09a3f6ab" status: 200 len: 784 microversion: 2.1 time: 0.047995 Oct 29 02:48:22.967586 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 433/833] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:22 2022] GET /compute/v2.1/images/c6777954-04bd-4ae1-b363-bbcd09a3f6ab => generated 784 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:22.981308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f9aca324-c064-41a0-9ac1-64f1899b1eff tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:22.989639 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f9aca324-c064-41a0-9ac1-64f1899b1eff tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012343 Oct 29 02:48:22.990214 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 401/834] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:48:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:23.002694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cf18df1b-ae44-4aee-b0e6-5d4658ddcecc tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a889cca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:23.051975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:23.140473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:23.141076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:23.148504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.149007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.149478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:23.150329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.150782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.151196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:23.289005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:23.299472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:23.301101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:23.302297 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d8d39ec6-3b65-4fb0-a380-3539f10cc2a0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.165748 Oct 29 02:48:23.303180 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 402/835] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:23 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:23.307749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5dbae23d-3506-4c48-82dd-6b93bc272f87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:23.308326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5dbae23d-3506-4c48-82dd-6b93bc272f87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:23.314644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dbae23d-3506-4c48-82dd-6b93bc272f87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.314967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dbae23d-3506-4c48-82dd-6b93bc272f87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.315498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dbae23d-3506-4c48-82dd-6b93bc272f87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:23.317018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dbae23d-3506-4c48-82dd-6b93bc272f87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.317760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dbae23d-3506-4c48-82dd-6b93bc272f87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.318012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dbae23d-3506-4c48-82dd-6b93bc272f87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:23.483477 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cf18df1b-ae44-4aee-b0e6-5d4658ddcecc tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "DELETE /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 204 len: 0 microversion: 2.1 time: 0.484673 Oct 29 02:48:23.484122 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 434/836] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:22 2022] DELETE /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:48:23.492657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1be35016-f08e-4a8e-a11f-12c4c99ed785 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a882fb80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:23.517386 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-1be35016-f08e-4a8e-a11f-12c4c99ed785 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] HTTP exception thrown: Image not found. Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1be35016-f08e-4a8e-a11f-12c4c99ed785 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Request method failure captured: Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 HTTP/1.1 Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJRCJ6pmgMrk3OGaaT0WEwtmijKRoZz8NMQuW4fU_VbUWw5-vq19ILq5I0R6A1mA32JNQQ5XHvAKW7yLesjBFzDA39Br5e5jaGha66RQZ6SsDJFAHrmf7K1-OZ5eTlEbMegf0YcvJ2uZiAhDec7mpyaevintm5jmBrq1DuH9--wsyWU Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4ba4b121877b458092bfd5cadec5aa3d Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesOneServerTestJSON-2084405278 Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:48:23.532082 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4ba4b121877b458092bfd5cadec5aa3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ba4b121877b458092bfd5cadec5aa3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4ba4b121877b458092bfd5cadec5aa3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ba4b121877b458092bfd5cadec5aa3d"}]}] Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesOneServerTestJSON-2084405278 Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4ba4b121877b458092bfd5cadec5aa3d Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2084405278 Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesOneServerTestJSON-2084405278-project Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 68cdeea2722e49e09ccf0b4f892906d4 Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesOneServerTestJSON-2084405278-project Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: exception: Image not found. Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '4d56b996-fb21-4530-b4f3-90868dbb2072'} Oct 29 02:48:23.533731 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:48:23.534783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4d56b996-fb21-4530-b4f3-90868dbb2072 Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:48:23.536195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4d56b996-fb21-4530-b4f3-90868dbb2072 could not be found. Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:48:23.537603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1be35016-f08e-4a8e-a11f-12c4c99ed785 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Returning 404 to user: Image not found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:23.542882 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1be35016-f08e-4a8e-a11f-12c4c99ed785 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 404 len: 62 microversion: 2.1 time: 0.047484 Oct 29 02:48:23.544199 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 435/837] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:23 2022] GET /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 02:48:23.548919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5c8d580-487d-451b-94e6-06f0c3ea065e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:23.549603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d5c8d580-487d-451b-94e6-06f0c3ea065e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:23.556686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5c8d580-487d-451b-94e6-06f0c3ea065e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.557249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5c8d580-487d-451b-94e6-06f0c3ea065e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.557779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5c8d580-487d-451b-94e6-06f0c3ea065e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:23.558612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5c8d580-487d-451b-94e6-06f0c3ea065e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.559113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5c8d580-487d-451b-94e6-06f0c3ea065e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.559596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5c8d580-487d-451b-94e6-06f0c3ea065e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:23.605372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5dbae23d-3506-4c48-82dd-6b93bc272f87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:23.613868 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5dbae23d-3506-4c48-82dd-6b93bc272f87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.309855 Oct 29 02:48:23.614442 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 403/838] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:23 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:23.619289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b9387f83-943c-4a7c-a269-d31daff9a734 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:23.620957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b9387f83-943c-4a7c-a269-d31daff9a734 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:23.627060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9387f83-943c-4a7c-a269-d31daff9a734 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.627729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9387f83-943c-4a7c-a269-d31daff9a734 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.628316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9387f83-943c-4a7c-a269-d31daff9a734 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:23.629192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9387f83-943c-4a7c-a269-d31daff9a734 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.629769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9387f83-943c-4a7c-a269-d31daff9a734 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.630346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9387f83-943c-4a7c-a269-d31daff9a734 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.228458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b9387f83-943c-4a7c-a269-d31daff9a734 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:24.240181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5c8d580-487d-451b-94e6-06f0c3ea065e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:24.241963 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b9387f83-943c-4a7c-a269-d31daff9a734 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1318 microversion: 2.1 time: 0.626100 Oct 29 02:48:24.243203 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 404/839] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:23 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:24.248449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:24.249222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:24.258251 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5c8d580-487d-451b-94e6-06f0c3ea065e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.717788 Oct 29 02:48:24.259106 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 436/840] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:23 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:24.266502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1186bb0e-09da-49a6-b6ad-8f73efe6f892 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-768413140"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:24.272049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1186bb0e-09da-49a6-b6ad-8f73efe6f892 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:24.279539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.280215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.281282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.282078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186bb0e-09da-49a6-b6ad-8f73efe6f892 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.282352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.282938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.283383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186bb0e-09da-49a6-b6ad-8f73efe6f892 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.283702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.284276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186bb0e-09da-49a6-b6ad-8f73efe6f892 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.285905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186bb0e-09da-49a6-b6ad-8f73efe6f892 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.286806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186bb0e-09da-49a6-b6ad-8f73efe6f892 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.287352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186bb0e-09da-49a6-b6ad-8f73efe6f892 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.417514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:24.419722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:24.432348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:24.433862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:24.445224 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fb3c5a9a-f546-471b-afc9-cf277c3e3f57 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.200689 Oct 29 02:48:24.457826 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 405/841] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:24 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:24.457826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-605f9bc6-6670-4f25-8207-9fa8886cb23b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:24.457826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-605f9bc6-6670-4f25-8207-9fa8886cb23b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:24.466266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605f9bc6-6670-4f25-8207-9fa8886cb23b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.466266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605f9bc6-6670-4f25-8207-9fa8886cb23b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.467234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605f9bc6-6670-4f25-8207-9fa8886cb23b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.467967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605f9bc6-6670-4f25-8207-9fa8886cb23b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.470154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605f9bc6-6670-4f25-8207-9fa8886cb23b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.472296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605f9bc6-6670-4f25-8207-9fa8886cb23b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.563408 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1186bb0e-09da-49a6-b6ad-8f73efe6f892 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "POST /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b/action" status: 202 len: 0 microversion: 2.1 time: 0.302693 Oct 29 02:48:24.570022 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 437/842] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:48:24 2022] POST /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:48:24.575917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:24.576889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:24.584302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.585057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.585763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.586869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.587516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.588140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.822854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-605f9bc6-6670-4f25-8207-9fa8886cb23b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:24.832824 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-605f9bc6-6670-4f25-8207-9fa8886cb23b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1317 microversion: 2.1 time: 0.385075 Oct 29 02:48:24.833726 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 406/843] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:24 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:24.838995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-18733f20-ff88-42d5-990c-dd30e2349a44 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c1d280>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:24.886021 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-18733f20-ff88-42d5-990c-dd30e2349a44 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.050958 Oct 29 02:48:24.886815 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 407/844] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:24 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:24.891548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-73382c90-bdd7-4bc6-9c2a-02523d49212a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:24.892310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-73382c90-bdd7-4bc6-9c2a-02523d49212a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:24.898380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73382c90-bdd7-4bc6-9c2a-02523d49212a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.899100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73382c90-bdd7-4bc6-9c2a-02523d49212a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.899718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73382c90-bdd7-4bc6-9c2a-02523d49212a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.900428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73382c90-bdd7-4bc6-9c2a-02523d49212a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.900878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73382c90-bdd7-4bc6-9c2a-02523d49212a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.901294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73382c90-bdd7-4bc6-9c2a-02523d49212a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.050137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:25.059862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:25.061597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:25.062979 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0d4a8592-f010-45fb-b70d-8eeefe7d962d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.491334 Oct 29 02:48:25.063652 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 438/845] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:24 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:25.168374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-cd9b6433-f675-4da0-8912-7992951e2c29 req-549c7df7-821e-4441-8acd-701b0ec17e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e695df-8d05-4202-9636-54600d730b15", "tag": "0cc0ffef-76b5-4409-84ae-b6014aa47a4c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:25.183717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cd9b6433-f675-4da0-8912-7992951e2c29 req-549c7df7-821e-4441-8acd-701b0ec17e80 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.184605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cd9b6433-f675-4da0-8912-7992951e2c29 req-549c7df7-821e-4441-8acd-701b0ec17e80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.185738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cd9b6433-f675-4da0-8912-7992951e2c29 req-549c7df7-821e-4441-8acd-701b0ec17e80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.196262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-73382c90-bdd7-4bc6-9c2a-02523d49212a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:25.202519 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-cd9b6433-f675-4da0-8912-7992951e2c29 req-549c7df7-821e-4441-8acd-701b0ec17e80 service nova] Creating event network-changed:0cc0ffef-76b5-4409-84ae-b6014aa47a4c for instance d6e695df-8d05-4202-9636-54600d730b15 on n-h1-862964-4 Oct 29 02:48:25.217972 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-73382c90-bdd7-4bc6-9c2a-02523d49212a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.329587 Oct 29 02:48:25.218959 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 408/846] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:24 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:25.220309 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-cd9b6433-f675-4da0-8912-7992951e2c29 req-549c7df7-821e-4441-8acd-701b0ec17e80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058879 Oct 29 02:48:25.221163 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 439/847] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:25.266264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6dd1fc0-5488-491e-a342-6644030f12a1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:25.267843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b6dd1fc0-5488-491e-a342-6644030f12a1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:25.277420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6dd1fc0-5488-491e-a342-6644030f12a1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.277918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6dd1fc0-5488-491e-a342-6644030f12a1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.278352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6dd1fc0-5488-491e-a342-6644030f12a1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.279055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6dd1fc0-5488-491e-a342-6644030f12a1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.279493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6dd1fc0-5488-491e-a342-6644030f12a1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.287029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-034656fc-b924-48ca-8e1b-dbb43e6989bf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:25.287726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-034656fc-b924-48ca-8e1b-dbb43e6989bf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:25.291175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6dd1fc0-5488-491e-a342-6644030f12a1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.297434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-034656fc-b924-48ca-8e1b-dbb43e6989bf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.297940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-034656fc-b924-48ca-8e1b-dbb43e6989bf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.298575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-034656fc-b924-48ca-8e1b-dbb43e6989bf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.299421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-034656fc-b924-48ca-8e1b-dbb43e6989bf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.301402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-034656fc-b924-48ca-8e1b-dbb43e6989bf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.302020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-034656fc-b924-48ca-8e1b-dbb43e6989bf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.456584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b6dd1fc0-5488-491e-a342-6644030f12a1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:25.464191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-034656fc-b924-48ca-8e1b-dbb43e6989bf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:25.467642 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6dd1fc0-5488-491e-a342-6644030f12a1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1318 microversion: 2.1 time: 0.206532 Oct 29 02:48:25.468409 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 409/848] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:25 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:25.478230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:25.479296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:25.486285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.487479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.488102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.490488 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-034656fc-b924-48ca-8e1b-dbb43e6989bf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1502 microversion: 2.1 time: 0.207235 Oct 29 02:48:25.490656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.490656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.490858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.499561 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 440/849] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:25 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:25.565168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:25.573387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:25.574840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:25.579627 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9a6e580c-35a4-4a34-b9c8-96bdfe7a2483 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.105545 Oct 29 02:48:25.580197 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 410/850] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:25 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:25.837575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b019aea9-cf4a-4be1-8329-3f9bff07d6e9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:25.838149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b019aea9-cf4a-4be1-8329-3f9bff07d6e9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:25.844188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b019aea9-cf4a-4be1-8329-3f9bff07d6e9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.844745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b019aea9-cf4a-4be1-8329-3f9bff07d6e9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.845231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b019aea9-cf4a-4be1-8329-3f9bff07d6e9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.846192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b019aea9-cf4a-4be1-8329-3f9bff07d6e9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.846796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b019aea9-cf4a-4be1-8329-3f9bff07d6e9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.847212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b019aea9-cf4a-4be1-8329-3f9bff07d6e9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.858169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9f4e89ff-4fd2-499b-9ed4-e3e3cb11b4fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:25.858768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9f4e89ff-4fd2-499b-9ed4-e3e3cb11b4fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:25.864655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4e89ff-4fd2-499b-9ed4-e3e3cb11b4fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.865339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4e89ff-4fd2-499b-9ed4-e3e3cb11b4fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.865963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4e89ff-4fd2-499b-9ed4-e3e3cb11b4fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.866795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4e89ff-4fd2-499b-9ed4-e3e3cb11b4fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.867439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4e89ff-4fd2-499b-9ed4-e3e3cb11b4fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.868039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4e89ff-4fd2-499b-9ed4-e3e3cb11b4fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.890628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b019aea9-cf4a-4be1-8329-3f9bff07d6e9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:48:25.993033 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b019aea9-cf4a-4be1-8329-3f9bff07d6e9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 204 len: 0 microversion: 2.1 time: 0.159217 Oct 29 02:48:25.994216 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 441/851] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:48:25 2022] DELETE /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:26.005259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-09f2013b-3d35-40ca-9470-c39e62619cc4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a89c9700>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:26.066668 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-09f2013b-3d35-40ca-9470-c39e62619cc4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.071157 Oct 29 02:48:26.067287 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 442/852] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:25 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:26.071893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d7c325bd-b0fc-4581-9a3f-5f771e8ad13b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:26.072736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d7c325bd-b0fc-4581-9a3f-5f771e8ad13b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:26.079536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d7c325bd-b0fc-4581-9a3f-5f771e8ad13b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.080017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d7c325bd-b0fc-4581-9a3f-5f771e8ad13b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.080442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d7c325bd-b0fc-4581-9a3f-5f771e8ad13b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.081137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d7c325bd-b0fc-4581-9a3f-5f771e8ad13b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.081585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d7c325bd-b0fc-4581-9a3f-5f771e8ad13b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.082025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d7c325bd-b0fc-4581-9a3f-5f771e8ad13b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.113698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9f4e89ff-4fd2-499b-9ed4-e3e3cb11b4fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.123674 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9f4e89ff-4fd2-499b-9ed4-e3e3cb11b4fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1317 microversion: 2.1 time: 0.271774 Oct 29 02:48:26.124594 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 411/853] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:25 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:26.134364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:26.135314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:26.142550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.143168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.143879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.144831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.145380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.146123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.222783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d7c325bd-b0fc-4581-9a3f-5f771e8ad13b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.231556 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d7c325bd-b0fc-4581-9a3f-5f771e8ad13b tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1715 microversion: 2.1 time: 0.163165 Oct 29 02:48:26.232140 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 443/854] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:26 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:26.253414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-83104da0-2ea5-4986-918d-f3f0fdfa22e4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:26.254146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-83104da0-2ea5-4986-918d-f3f0fdfa22e4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:26.260563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83104da0-2ea5-4986-918d-f3f0fdfa22e4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.261084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83104da0-2ea5-4986-918d-f3f0fdfa22e4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.261516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83104da0-2ea5-4986-918d-f3f0fdfa22e4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.262483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83104da0-2ea5-4986-918d-f3f0fdfa22e4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.262937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83104da0-2ea5-4986-918d-f3f0fdfa22e4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.263352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83104da0-2ea5-4986-918d-f3f0fdfa22e4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.367702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.379210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.380901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.382148 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cfa50fcd-8c5c-47ab-b047-97286af6b3b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1567 microversion: 2.25 time: 0.256158 Oct 29 02:48:26.394414 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 412/855] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:26 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:26.411552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-83104da0-2ea5-4986-918d-f3f0fdfa22e4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.421027 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-83104da0-2ea5-4986-918d-f3f0fdfa22e4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.172041 Oct 29 02:48:26.421865 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 444/856] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:26 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:26.491563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7b41776-27f9-49aa-9ea3-9861c7c1fcbb tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:26.492197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f7b41776-27f9-49aa-9ea3-9861c7c1fcbb tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:26.498733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b41776-27f9-49aa-9ea3-9861c7c1fcbb tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.499207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b41776-27f9-49aa-9ea3-9861c7c1fcbb tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.499630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b41776-27f9-49aa-9ea3-9861c7c1fcbb tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.500345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b41776-27f9-49aa-9ea3-9861c7c1fcbb tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.500784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b41776-27f9-49aa-9ea3-9861c7c1fcbb tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.501198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b41776-27f9-49aa-9ea3-9861c7c1fcbb tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.512376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b6538aac-0c58-4786-b2c4-2a8440992be5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:26.513251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b6538aac-0c58-4786-b2c4-2a8440992be5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:26.516471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:26.520032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6538aac-0c58-4786-b2c4-2a8440992be5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.520713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6538aac-0c58-4786-b2c4-2a8440992be5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.521324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6538aac-0c58-4786-b2c4-2a8440992be5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.522175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6538aac-0c58-4786-b2c4-2a8440992be5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.522732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6538aac-0c58-4786-b2c4-2a8440992be5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.523324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6538aac-0c58-4786-b2c4-2a8440992be5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.658443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b6538aac-0c58-4786-b2c4-2a8440992be5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.666608 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b6538aac-0c58-4786-b2c4-2a8440992be5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1492 microversion: 2.1 time: 0.158113 Oct 29 02:48:26.667189 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 445/857] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:26 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1492 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:26.668147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f7b41776-27f9-49aa-9ea3-9861c7c1fcbb tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.675939 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f7b41776-27f9-49aa-9ea3-9861c7c1fcbb tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1318 microversion: 2.1 time: 0.188282 Oct 29 02:48:26.676496 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 413/858] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:26 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:26.686283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:26.686991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:26.688421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79eea5a4-628d-435c-b170-f428f4bd8fb5 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '.version_select at 0x7fe1a8abbf70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:26.691823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79eea5a4-628d-435c-b170-f428f4bd8fb5 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.692301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79eea5a4-628d-435c-b170-f428f4bd8fb5 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.692902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79eea5a4-628d-435c-b170-f428f4bd8fb5 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.693764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.694274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.694704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.695871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.696418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.696836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.705627 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79eea5a4-628d-435c-b170-f428f4bd8fb5 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.020689 Oct 29 02:48:26.706453 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 414/859] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:48:26 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:26.720070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9a16411b-cdf7-4741-88a7-da2876202fcc tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:26.720669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a16411b-cdf7-4741-88a7-da2876202fcc tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:26.726596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a16411b-cdf7-4741-88a7-da2876202fcc tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.727011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a16411b-cdf7-4741-88a7-da2876202fcc tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.727440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a16411b-cdf7-4741-88a7-da2876202fcc tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.728124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a16411b-cdf7-4741-88a7-da2876202fcc tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.728569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a16411b-cdf7-4741-88a7-da2876202fcc tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.728984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a16411b-cdf7-4741-88a7-da2876202fcc tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.767195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.775696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.777221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.782362 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d1c672f0-d05f-4e55-9037-ee8520b465bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.099905 Oct 29 02:48:26.783017 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 446/860] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:26 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:26.857602 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9a16411b-cdf7-4741-88a7-da2876202fcc tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1643 microversion: 2.1 time: 0.140854 Oct 29 02:48:26.858140 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 415/861] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:26 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1643 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:26.980892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1911281400", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "2525c91e-f8df-4369-b3fa-9ce9342c6d85"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:27.035214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] validate_networks() for [('2525c91e-f8df-4369-b3fa-9ce9342c6d85', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:27.083122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6c308e6f-6902-48c8-a303-887d236c94e5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c0b9d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:27.133598 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6c308e6f-6902-48c8-a303-887d236c94e5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.054292 Oct 29 02:48:27.134219 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 416/862] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:27 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:27.147077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-441a0064-4940-4bf2-a53c-720421703f30 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:27.147699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-441a0064-4940-4bf2-a53c-720421703f30 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:27.149592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:27.155442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a0064-4940-4bf2-a53c-720421703f30 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.155920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a0064-4940-4bf2-a53c-720421703f30 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.156347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a0064-4940-4bf2-a53c-720421703f30 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.157035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a0064-4940-4bf2-a53c-720421703f30 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.157476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a0064-4940-4bf2-a53c-720421703f30 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.158387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a0064-4940-4bf2-a53c-720421703f30 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.278693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=15 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:27.287911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-441a0064-4940-4bf2-a53c-720421703f30 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:27.295919 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-441a0064-4940-4bf2-a53c-720421703f30 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1317 microversion: 2.1 time: 0.152634 Oct 29 02:48:27.296537 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 417/863] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:27 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:27.300990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1291dc08-fb67-4172-87a1-dfbce3f541cd tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:27.301585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1291dc08-fb67-4172-87a1-dfbce3f541cd tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:27.307635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1291dc08-fb67-4172-87a1-dfbce3f541cd tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.308134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1291dc08-fb67-4172-87a1-dfbce3f541cd tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.308743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1291dc08-fb67-4172-87a1-dfbce3f541cd tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.309438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1291dc08-fb67-4172-87a1-dfbce3f541cd tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.309913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1291dc08-fb67-4172-87a1-dfbce3f541cd tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.310340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1291dc08-fb67-4172-87a1-dfbce3f541cd tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.325282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:27.430088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:27.430533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:27.430994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:27.431534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:27.431937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:27.440946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.441414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.441832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.442577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.443002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.443408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.447084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1291dc08-fb67-4172-87a1-dfbce3f541cd tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:27.455382 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1291dc08-fb67-4172-87a1-dfbce3f541cd tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1715 microversion: 2.1 time: 0.157879 Oct 29 02:48:27.455935 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 418/864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:27 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:27.460125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Getting quotas for project a1287e36822b48f9a9020375bd0da2ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:27.460484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:27.461257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:27.464266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Getting quotas for user 6c2aa25bffe3421e8a75d88388dd5441 and project a1287e36822b48f9a9020375bd0da2ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:27.467187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.467600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.468031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.468725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.469172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.469589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.475545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:27.477906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:27.530736 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fc301e01-3a7c-4f8e-934f-62b42d8ac0f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554181 Oct 29 02:48:27.531738 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 447/865] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:27.543555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-191073ed-5a5b-4bec-90c0-8254644427c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:27.544434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-191073ed-5a5b-4bec-90c0-8254644427c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:27.568239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-191073ed-5a5b-4bec-90c0-8254644427c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.568799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-191073ed-5a5b-4bec-90c0-8254644427c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.569289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-191073ed-5a5b-4bec-90c0-8254644427c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.570204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-191073ed-5a5b-4bec-90c0-8254644427c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.570716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-191073ed-5a5b-4bec-90c0-8254644427c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.571134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-191073ed-5a5b-4bec-90c0-8254644427c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.623196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:27.634657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:27.636233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:27.637676 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eba53230-90ae-4b70-ac0a-09eff8197498 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1557 microversion: 2.25 time: 0.180665 Oct 29 02:48:27.638621 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 419/866] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:27 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1557 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:27.663267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-07ce0180-fec5-4ca5-b996-89ff44d33000 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:27.665202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-07ce0180-fec5-4ca5-b996-89ff44d33000 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:27.731703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-191073ed-5a5b-4bec-90c0-8254644427c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:27.739837 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-191073ed-5a5b-4bec-90c0-8254644427c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.200736 Oct 29 02:48:27.740411 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 448/867] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:27 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:27.743838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-07ce0180-fec5-4ca5-b996-89ff44d33000 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:27.746660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c9598c6-34d2-438b-b60b-6e5418585bf4 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '.version_select at 0x7fe1a89c9280>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:27.750329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c9598c6-34d2-438b-b60b-6e5418585bf4 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.750985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c9598c6-34d2-438b-b60b-6e5418585bf4 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.751584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c9598c6-34d2-438b-b60b-6e5418585bf4 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.760865 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-07ce0180-fec5-4ca5-b996-89ff44d33000 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1211 microversion: 2.1 time: 0.103077 Oct 29 02:48:27.761943 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 420/868] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:27 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1211 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:27.764140 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1c9598c6-34d2-438b-b60b-6e5418585bf4 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2189 microversion: 2.25 time: 0.021506 Oct 29 02:48:27.765001 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 449/869] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Oct 29 02:48:27 2022] GET /compute/v2.1/os-migrations => generated 2189 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:27.769294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fd97d7f1-1481-4815-9288-a729d5b6be0b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:27.770115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fd97d7f1-1481-4815-9288-a729d5b6be0b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:27.777550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd97d7f1-1481-4815-9288-a729d5b6be0b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.778180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd97d7f1-1481-4815-9288-a729d5b6be0b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.778700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd97d7f1-1481-4815-9288-a729d5b6be0b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.779609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd97d7f1-1481-4815-9288-a729d5b6be0b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.780269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd97d7f1-1481-4815-9288-a729d5b6be0b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.781073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd97d7f1-1481-4815-9288-a729d5b6be0b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.781701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-40cefe32-0fd2-46bf-9d84-bc8e824fde53 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:27.782438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-40cefe32-0fd2-46bf-9d84-bc8e824fde53 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:27.789358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40cefe32-0fd2-46bf-9d84-bc8e824fde53 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.789883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40cefe32-0fd2-46bf-9d84-bc8e824fde53 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.790388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40cefe32-0fd2-46bf-9d84-bc8e824fde53 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.791099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40cefe32-0fd2-46bf-9d84-bc8e824fde53 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.791971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40cefe32-0fd2-46bf-9d84-bc8e824fde53 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.792293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40cefe32-0fd2-46bf-9d84-bc8e824fde53 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.956923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fd97d7f1-1481-4815-9288-a729d5b6be0b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:27.961037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-40cefe32-0fd2-46bf-9d84-bc8e824fde53 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid 981cdc70-e4e6-4431-a243-068d39d4160d {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:27.970041 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fd97d7f1-1481-4815-9288-a729d5b6be0b tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1318 microversion: 2.1 time: 0.205510 Oct 29 02:48:27.970644 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 421/870] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:27 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:27.975495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:27.976085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:27.982620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.983223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.983652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.984343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.984782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.985195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.991558 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-40cefe32-0fd2-46bf-9d84-bc8e824fde53 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 2049 microversion: 2.25 time: 0.213047 Oct 29 02:48:28.006639 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 450/871] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:27 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 2049 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:28.020275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ceb879a9-d02a-4965-80aa-fbe70880f167 req-d8de051e-c152-4afd-9cd6-86755b1f90fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28f938c7-da78-4178-a53b-839924fa802f", "name": "network-vif-plugged", "status": "completed", "tag": "598eb911-ac3c-4b84-8804-7de01ad4a3a8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:28.044778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ceb879a9-d02a-4965-80aa-fbe70880f167 req-d8de051e-c152-4afd-9cd6-86755b1f90fb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.045404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ceb879a9-d02a-4965-80aa-fbe70880f167 req-d8de051e-c152-4afd-9cd6-86755b1f90fb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.045633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ceb879a9-d02a-4965-80aa-fbe70880f167 req-d8de051e-c152-4afd-9cd6-86755b1f90fb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.075891 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ceb879a9-d02a-4965-80aa-fbe70880f167 req-d8de051e-c152-4afd-9cd6-86755b1f90fb service nova] Creating event network-vif-plugged:598eb911-ac3c-4b84-8804-7de01ad4a3a8 for instance 28f938c7-da78-4178-a53b-839924fa802f on n-h1-862964-4 Oct 29 02:48:28.081531 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ceb879a9-d02a-4965-80aa-fbe70880f167 req-d8de051e-c152-4afd-9cd6-86755b1f90fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072470 Oct 29 02:48:28.082834 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 451/872] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:28.091327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.104360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.106045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.111451 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0842301c-2974-4d70-9aaa-3c42608257f0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.139810 Oct 29 02:48:28.112389 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 422/873] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:27 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:28.150950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-41141201-216f-4b0c-955a-50303955920e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a87ba5e0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:28.153062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1410801296", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "77bc85c7-1f7e-4553-b485-501ac324775e"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:28.213171 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-41141201-216f-4b0c-955a-50303955920e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.067171 Oct 29 02:48:28.215277 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 452/874] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:28 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:28.223251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] validate_networks() for [('77bc85c7-1f7e-4553-b485-501ac324775e', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:28.319776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a89c6c1-c0a1-4106-8c6a-126f28a07732 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:28.321056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a89c6c1-c0a1-4106-8c6a-126f28a07732 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:28.332868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a89c6c1-c0a1-4106-8c6a-126f28a07732 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.333740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a89c6c1-c0a1-4106-8c6a-126f28a07732 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.334298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a89c6c1-c0a1-4106-8c6a-126f28a07732 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.335222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a89c6c1-c0a1-4106-8c6a-126f28a07732 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.335765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a89c6c1-c0a1-4106-8c6a-126f28a07732 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.336356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a89c6c1-c0a1-4106-8c6a-126f28a07732 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.361549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:28.532128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2a89c6c1-c0a1-4106-8c6a-126f28a07732 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.545013 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a89c6c1-c0a1-4106-8c6a-126f28a07732 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1317 microversion: 2.1 time: 0.229038 Oct 29 02:48:28.547319 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 453/875] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:28 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:28.552394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-19ef9d05-554a-4eb5-9314-e51e487e613c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:28.558681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-19ef9d05-554a-4eb5-9314-e51e487e613c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:28.565427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19ef9d05-554a-4eb5-9314-e51e487e613c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.565944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19ef9d05-554a-4eb5-9314-e51e487e613c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.566376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19ef9d05-554a-4eb5-9314-e51e487e613c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.567070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19ef9d05-554a-4eb5-9314-e51e487e613c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.567514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19ef9d05-554a-4eb5-9314-e51e487e613c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.567928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19ef9d05-554a-4eb5-9314-e51e487e613c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.689506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:28.690075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:28.690321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:28.690729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:28.691139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:28.701475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.702027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.702455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.703333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.703789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.704213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.724521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Getting quotas for project 60896479fb0c4357ad5fb03016470283. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:28.728838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Getting quotas for user f0ea28d9bb3544bca1a3c90d983fe8e4 and project 60896479fb0c4357ad5fb03016470283. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:28.740815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:28.743405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:28.793323 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-008a5cbd-5ea6-45d8-81eb-6dd7860b02e4 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.644756 Oct 29 02:48:28.794258 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 423/876] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:48:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:48:28.799053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7b194ac-9dfe-4b5b-b454-a4c00d913581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:28.799821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7b194ac-9dfe-4b5b-b454-a4c00d913581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:28.807522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b194ac-9dfe-4b5b-b454-a4c00d913581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.808017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b194ac-9dfe-4b5b-b454-a4c00d913581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.808441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b194ac-9dfe-4b5b-b454-a4c00d913581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.809152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b194ac-9dfe-4b5b-b454-a4c00d913581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.809601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b194ac-9dfe-4b5b-b454-a4c00d913581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.810050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b194ac-9dfe-4b5b-b454-a4c00d913581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.937691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-19ef9d05-554a-4eb5-9314-e51e487e613c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.951892 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-19ef9d05-554a-4eb5-9314-e51e487e613c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1715 microversion: 2.1 time: 0.400833 Oct 29 02:48:28.961862 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 454/877] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:28 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1715 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:28.964535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-71f550ce-d20e-4162-8927-5e44991430a7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:28.965761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-71f550ce-d20e-4162-8927-5e44991430a7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:28.973022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71f550ce-d20e-4162-8927-5e44991430a7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.973593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71f550ce-d20e-4162-8927-5e44991430a7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.974067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71f550ce-d20e-4162-8927-5e44991430a7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.974968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71f550ce-d20e-4162-8927-5e44991430a7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.975326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71f550ce-d20e-4162-8927-5e44991430a7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.975748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71f550ce-d20e-4162-8927-5e44991430a7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.976390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a7b194ac-9dfe-4b5b-b454-a4c00d913581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.984700 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7b194ac-9dfe-4b5b-b454-a4c00d913581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.189125 Oct 29 02:48:28.990472 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 424/878] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:28 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:28.991135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d15266b-a170-42a5-ad65-da7695c1ba35 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:28.991747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9d15266b-a170-42a5-ad65-da7695c1ba35 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:29.046145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9d15266b-a170-42a5-ad65-da7695c1ba35 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:29.049087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-71f550ce-d20e-4162-8927-5e44991430a7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:29.054226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9d15266b-a170-42a5-ad65-da7695c1ba35 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:29.055871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9d15266b-a170-42a5-ad65-da7695c1ba35 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:29.057150 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9d15266b-a170-42a5-ad65-da7695c1ba35 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1262 microversion: 2.25 time: 0.070261 Oct 29 02:48:29.057364 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-71f550ce-d20e-4162-8927-5e44991430a7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1263 microversion: 2.1 time: 0.102284 Oct 29 02:48:29.057881 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 425/879] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:28 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:29.058003 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 455/880] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:28 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1263 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:29.062654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-48c0cb6b-57ce-4454-825f-0a802f07f802 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:29.063254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-48c0cb6b-57ce-4454-825f-0a802f07f802 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:29.069017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48c0cb6b-57ce-4454-825f-0a802f07f802 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.069499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48c0cb6b-57ce-4454-825f-0a802f07f802 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.069979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48c0cb6b-57ce-4454-825f-0a802f07f802 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.070852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48c0cb6b-57ce-4454-825f-0a802f07f802 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.071667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48c0cb6b-57ce-4454-825f-0a802f07f802 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.071923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48c0cb6b-57ce-4454-825f-0a802f07f802 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.140587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:29.141555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:29.150557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.151395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.152934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.153840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.154656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.155272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.227131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:29.236420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:29.237862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:29.243384 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-163e2563-6b50-4889-b84b-137748c8d348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.107861 Oct 29 02:48:29.244449 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 426/881] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:29 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:29.249906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-895157d0-4e83-41a1-8dce-4fb42679f1ad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8a750d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:29.301062 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-895157d0-4e83-41a1-8dce-4fb42679f1ad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.055111 Oct 29 02:48:29.301644 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 427/882] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:29 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:29.378507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-48c0cb6b-57ce-4454-825f-0a802f07f802 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:29.388953 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-48c0cb6b-57ce-4454-825f-0a802f07f802 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1318 microversion: 2.1 time: 0.329844 Oct 29 02:48:29.389576 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 456/883] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:29 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:29.568759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8500ca1d-1bcc-4b47-86c9-4730be5a00bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:29.569349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8500ca1d-1bcc-4b47-86c9-4730be5a00bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:29.576039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8500ca1d-1bcc-4b47-86c9-4730be5a00bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.576519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8500ca1d-1bcc-4b47-86c9-4730be5a00bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.576962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8500ca1d-1bcc-4b47-86c9-4730be5a00bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.577661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8500ca1d-1bcc-4b47-86c9-4730be5a00bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.578136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8500ca1d-1bcc-4b47-86c9-4730be5a00bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.578548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8500ca1d-1bcc-4b47-86c9-4730be5a00bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.723535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8500ca1d-1bcc-4b47-86c9-4730be5a00bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:29.725848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:29.733689 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8500ca1d-1bcc-4b47-86c9-4730be5a00bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1317 microversion: 2.1 time: 0.168841 Oct 29 02:48:29.734313 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 428/884] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:29 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:29.979423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c060887a-2b9b-49ad-8e67-2adb087255c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:29.980143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c060887a-2b9b-49ad-8e67-2adb087255c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:29.986507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060887a-2b9b-49ad-8e67-2adb087255c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.987385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060887a-2b9b-49ad-8e67-2adb087255c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.987887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060887a-2b9b-49ad-8e67-2adb087255c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.988857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060887a-2b9b-49ad-8e67-2adb087255c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.989379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060887a-2b9b-49ad-8e67-2adb087255c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.989901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060887a-2b9b-49ad-8e67-2adb087255c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.012053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63057f25-5a82-46a9-9bc5-0db57a28a481 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:30.013032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-63057f25-5a82-46a9-9bc5-0db57a28a481 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:30.024245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63057f25-5a82-46a9-9bc5-0db57a28a481 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.036845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63057f25-5a82-46a9-9bc5-0db57a28a481 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.039928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63057f25-5a82-46a9-9bc5-0db57a28a481 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.041930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63057f25-5a82-46a9-9bc5-0db57a28a481 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.043258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63057f25-5a82-46a9-9bc5-0db57a28a481 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.046811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63057f25-5a82-46a9-9bc5-0db57a28a481 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.247148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c060887a-2b9b-49ad-8e67-2adb087255c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.257203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-63057f25-5a82-46a9-9bc5-0db57a28a481 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.258135 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c060887a-2b9b-49ad-8e67-2adb087255c9 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1647 microversion: 2.1 time: 0.282887 Oct 29 02:48:30.261864 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 457/885] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:29 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1647 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:30.270689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-329f2b6b-e647-4884-96d4-79663861552a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:30.271286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-329f2b6b-e647-4884-96d4-79663861552a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:30.287073 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-63057f25-5a82-46a9-9bc5-0db57a28a481 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.278670 Oct 29 02:48:30.288642 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 429/886] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:30 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:30.298784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:30.300075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:30.309900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-329f2b6b-e647-4884-96d4-79663861552a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.310503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-329f2b6b-e647-4884-96d4-79663861552a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.310946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-329f2b6b-e647-4884-96d4-79663861552a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.313456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-329f2b6b-e647-4884-96d4-79663861552a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.313942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.314437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.314867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.315556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.316259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-329f2b6b-e647-4884-96d4-79663861552a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.316898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-329f2b6b-e647-4884-96d4-79663861552a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.318245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.318712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.416946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-329f2b6b-e647-4884-96d4-79663861552a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.429967 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-329f2b6b-e647-4884-96d4-79663861552a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1269 microversion: 2.1 time: 0.166779 Oct 29 02:48:30.431078 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 458/887] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:30 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:30.442640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-487befe2-b5c9-4227-9560-ed666b6070af req-98320179-2d50-4f92-9391-9ffd99fafd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17fee50-82f1-461d-9889-b0f25961ae1b", "name": "network-vif-unplugged", "status": "completed", "tag": "37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:30.454873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-487befe2-b5c9-4227-9560-ed666b6070af req-98320179-2d50-4f92-9391-9ffd99fafd9c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.455347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-487befe2-b5c9-4227-9560-ed666b6070af req-98320179-2d50-4f92-9391-9ffd99fafd9c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.455935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-487befe2-b5c9-4227-9560-ed666b6070af req-98320179-2d50-4f92-9391-9ffd99fafd9c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.476096 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-487befe2-b5c9-4227-9560-ed666b6070af req-98320179-2d50-4f92-9391-9ffd99fafd9c service nova] Creating event network-vif-unplugged:37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1 for instance a17fee50-82f1-461d-9889-b0f25961ae1b on n-h1-862964-4 Oct 29 02:48:30.478422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.490864 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-487befe2-b5c9-4227-9560-ed666b6070af req-98320179-2d50-4f92-9391-9ffd99fafd9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058249 Oct 29 02:48:30.492171 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 459/888] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:30.500021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:30.500826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.502041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:30.503014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.504749 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bbff631b-253f-4b7a-b24b-f6980a2dadba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1258 microversion: 2.25 time: 0.214218 Oct 29 02:48:30.506647 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 430/889] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:30 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1258 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:30.509679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.510197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.511069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.511782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.512377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.512809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.513076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-81e1928a-1720-4a84-b9b9-4d2430800b62 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8a943a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:30.577520 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-81e1928a-1720-4a84-b9b9-4d2430800b62 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.069389 Oct 29 02:48:30.578859 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 431/890] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:30 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:30.583887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-505737dd-c2f6-43dc-a913-3bad863ac597 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:30.584724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-505737dd-c2f6-43dc-a913-3bad863ac597 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:30.592836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-505737dd-c2f6-43dc-a913-3bad863ac597 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.593417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-505737dd-c2f6-43dc-a913-3bad863ac597 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.593948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-505737dd-c2f6-43dc-a913-3bad863ac597 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.594716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-505737dd-c2f6-43dc-a913-3bad863ac597 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.595389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-505737dd-c2f6-43dc-a913-3bad863ac597 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.595995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-505737dd-c2f6-43dc-a913-3bad863ac597 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.625752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.637365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.638830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.644657 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c217f237-d6aa-4857-b8c2-a6cebe923f21 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.150744 Oct 29 02:48:30.645552 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 460/891] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:30 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:30.700522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-0ec93766-e1e8-4807-aa41-e1ad0b8d0bda req-7758f42e-b786-463a-be3c-4b58650ecd44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209b0e5a-13ee-4803-94fc-e9d05298ae49", "name": "network-vif-deleted", "tag": "9db2669a-4596-46d6-ae92-4b31a0a6fdfd"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:30.709737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0ec93766-e1e8-4807-aa41-e1ad0b8d0bda req-7758f42e-b786-463a-be3c-4b58650ecd44 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.710241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0ec93766-e1e8-4807-aa41-e1ad0b8d0bda req-7758f42e-b786-463a-be3c-4b58650ecd44 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.710666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0ec93766-e1e8-4807-aa41-e1ad0b8d0bda req-7758f42e-b786-463a-be3c-4b58650ecd44 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.722605 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-0ec93766-e1e8-4807-aa41-e1ad0b8d0bda req-7758f42e-b786-463a-be3c-4b58650ecd44 service nova] Creating event network-vif-deleted:9db2669a-4596-46d6-ae92-4b31a0a6fdfd for instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 on n-h1-862964-4 Oct 29 02:48:30.728852 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-0ec93766-e1e8-4807-aa41-e1ad0b8d0bda req-7758f42e-b786-463a-be3c-4b58650ecd44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031904 Oct 29 02:48:30.729675 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 461/892] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:48:30.757125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e23b4b2f-aa9a-4231-95c3-fdaa45cee67a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:30.758100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e23b4b2f-aa9a-4231-95c3-fdaa45cee67a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:30.764917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e23b4b2f-aa9a-4231-95c3-fdaa45cee67a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.765403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e23b4b2f-aa9a-4231-95c3-fdaa45cee67a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.766329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e23b4b2f-aa9a-4231-95c3-fdaa45cee67a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.766554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e23b4b2f-aa9a-4231-95c3-fdaa45cee67a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.767006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e23b4b2f-aa9a-4231-95c3-fdaa45cee67a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.767418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e23b4b2f-aa9a-4231-95c3-fdaa45cee67a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.847664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-505737dd-c2f6-43dc-a913-3bad863ac597 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.856116 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-505737dd-c2f6-43dc-a913-3bad863ac597 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1318 microversion: 2.1 time: 0.275914 Oct 29 02:48:30.856786 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 432/893] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:30 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:30.928601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e23b4b2f-aa9a-4231-95c3-fdaa45cee67a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.938774 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e23b4b2f-aa9a-4231-95c3-fdaa45cee67a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1317 microversion: 2.1 time: 0.185887 Oct 29 02:48:30.950245 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 462/894] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:30 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:31.288604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c8610a59-657b-4814-a343-58f9cea489c1 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.289376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c8610a59-657b-4814-a343-58f9cea489c1 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:31.300180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8610a59-657b-4814-a343-58f9cea489c1 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.301834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8610a59-657b-4814-a343-58f9cea489c1 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.303873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8610a59-657b-4814-a343-58f9cea489c1 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.307032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8610a59-657b-4814-a343-58f9cea489c1 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.307630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8610a59-657b-4814-a343-58f9cea489c1 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.308442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8610a59-657b-4814-a343-58f9cea489c1 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.315081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-000b4c01-835b-40af-a7e1-924c6fc85973 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.315814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-000b4c01-835b-40af-a7e1-924c6fc85973 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:31.328139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000b4c01-835b-40af-a7e1-924c6fc85973 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.333910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000b4c01-835b-40af-a7e1-924c6fc85973 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.337053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000b4c01-835b-40af-a7e1-924c6fc85973 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.341004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000b4c01-835b-40af-a7e1-924c6fc85973 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.344441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000b4c01-835b-40af-a7e1-924c6fc85973 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.345012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000b4c01-835b-40af-a7e1-924c6fc85973 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.484997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c8610a59-657b-4814-a343-58f9cea489c1 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.494297 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c8610a59-657b-4814-a343-58f9cea489c1 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1350 microversion: 2.1 time: 0.210790 Oct 29 02:48:31.494886 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 433/895] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1350 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:31.499909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64bdbf99-14b9-4c30-9bcb-b558ad87030a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.500798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-64bdbf99-14b9-4c30-9bcb-b558ad87030a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:31.507005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64bdbf99-14b9-4c30-9bcb-b558ad87030a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.507830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64bdbf99-14b9-4c30-9bcb-b558ad87030a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.508175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-000b4c01-835b-40af-a7e1-924c6fc85973 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.508710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64bdbf99-14b9-4c30-9bcb-b558ad87030a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.516285 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-000b4c01-835b-40af-a7e1-924c6fc85973 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.205046 Oct 29 02:48:31.516862 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 463/896] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:31.534103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.534571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:31.539766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64bdbf99-14b9-4c30-9bcb-b558ad87030a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.540379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64bdbf99-14b9-4c30-9bcb-b558ad87030a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.540887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64bdbf99-14b9-4c30-9bcb-b558ad87030a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.550277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.550879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.551330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.552077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.552532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.562092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.637083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.660326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.662304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.663640 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-231eb158-a004-4bb2-b5a8-a921d31da792 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1314 microversion: 2.25 time: 0.133698 Oct 29 02:48:31.664319 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 464/897] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1314 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:31.671595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5f9edf00-b0f0-4e47-9047-00f01affb2b5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a87b5f70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.738939 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5f9edf00-b0f0-4e47-9047-00f01affb2b5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.073368 Oct 29 02:48:31.740002 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 465/898] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:31.756219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.756921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:31.768243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.769451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.773546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.776081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.776553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.776985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.788773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-64bdbf99-14b9-4c30-9bcb-b558ad87030a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.808876 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-64bdbf99-14b9-4c30-9bcb-b558ad87030a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1311 microversion: 2.1 time: 0.310426 Oct 29 02:48:31.809498 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 434/899] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1311 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:31.880575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-980d8e1b-691c-41d9-ae3d-ced27cee3516 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.881448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-980d8e1b-691c-41d9-ae3d-ced27cee3516 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:31.893603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-980d8e1b-691c-41d9-ae3d-ced27cee3516 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.894127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-980d8e1b-691c-41d9-ae3d-ced27cee3516 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.894563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-980d8e1b-691c-41d9-ae3d-ced27cee3516 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.899915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-980d8e1b-691c-41d9-ae3d-ced27cee3516 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.900552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-980d8e1b-691c-41d9-ae3d-ced27cee3516 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.901733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-980d8e1b-691c-41d9-ae3d-ced27cee3516 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.908596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.921665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.926731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.938078 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-12cf5650-1046-4af9-a8a4-ae8f29963328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.196676 Oct 29 02:48:31.940946 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 466/900] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:31.965915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dcb0adc0-743b-4a6a-9fd9-0da6df5ccc29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.968754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dcb0adc0-743b-4a6a-9fd9-0da6df5ccc29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:31.979392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcb0adc0-743b-4a6a-9fd9-0da6df5ccc29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.980082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcb0adc0-743b-4a6a-9fd9-0da6df5ccc29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.980512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcb0adc0-743b-4a6a-9fd9-0da6df5ccc29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.981221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcb0adc0-743b-4a6a-9fd9-0da6df5ccc29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.981661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcb0adc0-743b-4a6a-9fd9-0da6df5ccc29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.982372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcb0adc0-743b-4a6a-9fd9-0da6df5ccc29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.219217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dcb0adc0-743b-4a6a-9fd9-0da6df5ccc29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.230420 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dcb0adc0-743b-4a6a-9fd9-0da6df5ccc29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1317 microversion: 2.1 time: 0.270504 Oct 29 02:48:32.243734 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 467/901] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:32.506243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-253771cb-21db-408b-9e70-89cf564c7677 req-62054820-694d-4e90-8a84-d9a62389ecf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17fee50-82f1-461d-9889-b0f25961ae1b", "name": "network-vif-plugged", "status": "completed", "tag": "37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:32.526610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-253771cb-21db-408b-9e70-89cf564c7677 req-62054820-694d-4e90-8a84-d9a62389ecf5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.529275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-253771cb-21db-408b-9e70-89cf564c7677 req-62054820-694d-4e90-8a84-d9a62389ecf5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.529715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-253771cb-21db-408b-9e70-89cf564c7677 req-62054820-694d-4e90-8a84-d9a62389ecf5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.561170 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-253771cb-21db-408b-9e70-89cf564c7677 req-62054820-694d-4e90-8a84-d9a62389ecf5 service nova] Creating event network-vif-plugged:37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1 for instance a17fee50-82f1-461d-9889-b0f25961ae1b on n-h1-862964-4 Oct 29 02:48:32.567449 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-253771cb-21db-408b-9e70-89cf564c7677 req-62054820-694d-4e90-8a84-d9a62389ecf5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064747 Oct 29 02:48:32.571640 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 468/902] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:48:32.585422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:32.586552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:32.605717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.606336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.606790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.607797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.608258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.608831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.616651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-980d8e1b-691c-41d9-ae3d-ced27cee3516 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.625785 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-980d8e1b-691c-41d9-ae3d-ced27cee3516 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1318 microversion: 2.1 time: 0.750073 Oct 29 02:48:32.626514 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 435/903] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1318 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:32.631593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90b582c3-978c-4fcb-b6eb-86eb8fda9210 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:32.632387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-90b582c3-978c-4fcb-b6eb-86eb8fda9210 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:32.638812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90b582c3-978c-4fcb-b6eb-86eb8fda9210 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.639638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90b582c3-978c-4fcb-b6eb-86eb8fda9210 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.640217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90b582c3-978c-4fcb-b6eb-86eb8fda9210 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.641057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90b582c3-978c-4fcb-b6eb-86eb8fda9210 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.641754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90b582c3-978c-4fcb-b6eb-86eb8fda9210 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.642408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90b582c3-978c-4fcb-b6eb-86eb8fda9210 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.646327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.646810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.647231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.647669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lazy-loading 'fault' on Instance uuid 209b0e5a-13ee-4803-94fc-e9d05298ae49 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:32.717592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.732793 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b48304bb-7b3c-4afe-b4f9-0736bdb86061 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1355 microversion: 2.1 time: 0.157883 Oct 29 02:48:32.735069 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 469/904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:32 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1355 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:32.745472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:32.746005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:32.768716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.772479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.773646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.774806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.775919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.776503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.928448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.939663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.941287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.942563 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cdd65230-353e-401c-987f-3f50b884bc32 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1320 microversion: 2.25 time: 0.206457 Oct 29 02:48:32.943549 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 470/905] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:32 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:32.948256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eca483bd-b341-46f3-aa60-2d5a29352f9c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a877e3a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:33.018746 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eca483bd-b341-46f3-aa60-2d5a29352f9c tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.074042 Oct 29 02:48:33.019335 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 471/906] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:32 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:33.023874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1ac25fea-8486-4256-aa51-757e22e3f5d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:33.024495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1ac25fea-8486-4256-aa51-757e22e3f5d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:33.025458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-90b582c3-978c-4fcb-b6eb-86eb8fda9210 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:33.031964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ac25fea-8486-4256-aa51-757e22e3f5d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.032708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ac25fea-8486-4256-aa51-757e22e3f5d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.032877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ac25fea-8486-4256-aa51-757e22e3f5d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.033549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ac25fea-8486-4256-aa51-757e22e3f5d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.034095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ac25fea-8486-4256-aa51-757e22e3f5d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.034479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ac25fea-8486-4256-aa51-757e22e3f5d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.039658 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90b582c3-978c-4fcb-b6eb-86eb8fda9210 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.411387 Oct 29 02:48:33.040785 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 436/907] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:32 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:33.047813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:33.048603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:33.057913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.058563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.059143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.060301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.060894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.061465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.199393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1ac25fea-8486-4256-aa51-757e22e3f5d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:33.213560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:33.219809 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1ac25fea-8486-4256-aa51-757e22e3f5d6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1311 microversion: 2.1 time: 0.199239 Oct 29 02:48:33.221090 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 472/908] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:33 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1311 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:33.226255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:33.230928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:33.234461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8f3bdd39-f717-413e-a498-376965e78c20 req-29ca464d-78ea-4dd7-9cff-2060e140116f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e22e9e45-c266-455e-8aff-da1aed5519ab", "tag": "675d097b-03fe-4cf0-9756-d0e175fce642"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:33.237643 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-347cd5d7-5ac4-478c-8e86-cd4a1e0c27bd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.194269 Oct 29 02:48:33.240951 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 437/909] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:33 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:33.254707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8f3bdd39-f717-413e-a498-376965e78c20 req-29ca464d-78ea-4dd7-9cff-2060e140116f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.255366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8f3bdd39-f717-413e-a498-376965e78c20 req-29ca464d-78ea-4dd7-9cff-2060e140116f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.256089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8f3bdd39-f717-413e-a498-376965e78c20 req-29ca464d-78ea-4dd7-9cff-2060e140116f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.260647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d7af1ee6-dca9-4b02-a85f-b76695bbf1d4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:33.261790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d7af1ee6-dca9-4b02-a85f-b76695bbf1d4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:33.268975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7af1ee6-dca9-4b02-a85f-b76695bbf1d4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.269506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7af1ee6-dca9-4b02-a85f-b76695bbf1d4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.269959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7af1ee6-dca9-4b02-a85f-b76695bbf1d4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.270649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7af1ee6-dca9-4b02-a85f-b76695bbf1d4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.271083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7af1ee6-dca9-4b02-a85f-b76695bbf1d4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.271540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7af1ee6-dca9-4b02-a85f-b76695bbf1d4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.288778 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8f3bdd39-f717-413e-a498-376965e78c20 req-29ca464d-78ea-4dd7-9cff-2060e140116f service nova] Creating event network-changed:675d097b-03fe-4cf0-9756-d0e175fce642 for instance e22e9e45-c266-455e-8aff-da1aed5519ab on n-h2-862964-4 Oct 29 02:48:33.294282 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8f3bdd39-f717-413e-a498-376965e78c20 req-29ca464d-78ea-4dd7-9cff-2060e140116f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072160 Oct 29 02:48:33.295776 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 473/910] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:33.585624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d7af1ee6-dca9-4b02-a85f-b76695bbf1d4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:33.598756 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d7af1ee6-dca9-4b02-a85f-b76695bbf1d4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1317 microversion: 2.1 time: 0.348473 Oct 29 02:48:33.600207 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 438/911] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:33 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:33.650263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4fad010e-22ae-41f7-a8ef-e0e9bf0d0c17 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:33.651865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4fad010e-22ae-41f7-a8ef-e0e9bf0d0c17 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:33.663548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fad010e-22ae-41f7-a8ef-e0e9bf0d0c17 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.664272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fad010e-22ae-41f7-a8ef-e0e9bf0d0c17 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.664770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fad010e-22ae-41f7-a8ef-e0e9bf0d0c17 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.665719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fad010e-22ae-41f7-a8ef-e0e9bf0d0c17 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.666288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fad010e-22ae-41f7-a8ef-e0e9bf0d0c17 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.666996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fad010e-22ae-41f7-a8ef-e0e9bf0d0c17 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.694432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:33.756239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:33.756948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:33.772275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.775572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.776266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.779101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.779870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.782315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.856000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.859945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.860266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.862264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lazy-loading 'fault' on Instance uuid 209b0e5a-13ee-4803-94fc-e9d05298ae49 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:33.893614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4fad010e-22ae-41f7-a8ef-e0e9bf0d0c17 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:33.902882 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4fad010e-22ae-41f7-a8ef-e0e9bf0d0c17 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1508 microversion: 2.1 time: 0.257558 Oct 29 02:48:33.904811 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 474/912] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:33 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:33.972504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e835f57621f46719369731607bebb1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013e7f18496749fb9525e0303e688964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:33.979598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:33.982382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:34.003054 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ee6ea3a2-ac6f-4440-b934-1eb756575311 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 200 len: 1355 microversion: 2.1 time: 0.249143 Oct 29 02:48:34.019118 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 439/913] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:33 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 1355 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:34.019524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.019524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.019524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.019524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.019904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.019904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.036131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-32f098a9-46e2-4688-8bb3-63754e8f2728 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8a309d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:34.136867 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-32f098a9-46e2-4688-8bb3-63754e8f2728 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.105552 Oct 29 02:48:34.141266 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 440/914] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:34 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:34.155897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-366d1e6e-54c4-4b8f-966f-a3c5aa626e58 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:34.160573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-366d1e6e-54c4-4b8f-966f-a3c5aa626e58 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:34.175860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366d1e6e-54c4-4b8f-966f-a3c5aa626e58 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.176970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366d1e6e-54c4-4b8f-966f-a3c5aa626e58 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.179051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366d1e6e-54c4-4b8f-966f-a3c5aa626e58 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.180497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366d1e6e-54c4-4b8f-966f-a3c5aa626e58 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.186514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366d1e6e-54c4-4b8f-966f-a3c5aa626e58 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.186982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366d1e6e-54c4-4b8f-966f-a3c5aa626e58 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.358591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:34.381271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:34.383286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:34.385275 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-472738e1-ed15-4a13-a9d5-7bc8ccee4fd5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1362 microversion: 2.25 time: 0.419328 Oct 29 02:48:34.386355 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 475/915] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:33 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:34.413966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c20bb1c1-0ceb-40f6-8dd5-6fa99a8872d4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:34.414869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c20bb1c1-0ceb-40f6-8dd5-6fa99a8872d4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:34.423023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c20bb1c1-0ceb-40f6-8dd5-6fa99a8872d4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.423864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c20bb1c1-0ceb-40f6-8dd5-6fa99a8872d4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.424457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c20bb1c1-0ceb-40f6-8dd5-6fa99a8872d4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.425437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c20bb1c1-0ceb-40f6-8dd5-6fa99a8872d4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.426060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c20bb1c1-0ceb-40f6-8dd5-6fa99a8872d4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.426842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c20bb1c1-0ceb-40f6-8dd5-6fa99a8872d4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.490227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-366d1e6e-54c4-4b8f-966f-a3c5aa626e58 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:34.500875 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-366d1e6e-54c4-4b8f-966f-a3c5aa626e58 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.357868 Oct 29 02:48:34.517013 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 441/916] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:34 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:34.525964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:34.527270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:34.539944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.540667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.542452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.543511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.544102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.544661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.646667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c20bb1c1-0ceb-40f6-8dd5-6fa99a8872d4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:34.663489 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c20bb1c1-0ceb-40f6-8dd5-6fa99a8872d4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1311 microversion: 2.1 time: 0.269931 Oct 29 02:48:34.665484 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 476/917] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:34 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1311 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:34.678516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e4142eb7-48c5-4504-81ea-b7681a3d0bfc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:34.679137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e4142eb7-48c5-4504-81ea-b7681a3d0bfc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:34.691319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4142eb7-48c5-4504-81ea-b7681a3d0bfc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.692094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4142eb7-48c5-4504-81ea-b7681a3d0bfc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.692687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4142eb7-48c5-4504-81ea-b7681a3d0bfc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.693552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4142eb7-48c5-4504-81ea-b7681a3d0bfc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.694180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4142eb7-48c5-4504-81ea-b7681a3d0bfc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.694812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4142eb7-48c5-4504-81ea-b7681a3d0bfc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.713105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:34.724041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:34.732681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:34.761540 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8ae85b80-fe03-454b-9f03-1a2cede91e23 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.242937 Oct 29 02:48:34.770899 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 442/918] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:34 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:34.787991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-5ee6fc50-6b8a-4b8e-a497-7e8dca71255f req-5a750fb3-917a-4594-8974-f55947628815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e695df-8d05-4202-9636-54600d730b15", "name": "network-vif-plugged", "status": "completed", "tag": "0cc0ffef-76b5-4409-84ae-b6014aa47a4c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:34.798504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5ee6fc50-6b8a-4b8e-a497-7e8dca71255f req-5a750fb3-917a-4594-8974-f55947628815 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.799495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5ee6fc50-6b8a-4b8e-a497-7e8dca71255f req-5a750fb3-917a-4594-8974-f55947628815 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.800103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5ee6fc50-6b8a-4b8e-a497-7e8dca71255f req-5a750fb3-917a-4594-8974-f55947628815 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.815272 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-5ee6fc50-6b8a-4b8e-a497-7e8dca71255f req-5a750fb3-917a-4594-8974-f55947628815 service nova] Creating event network-vif-plugged:0cc0ffef-76b5-4409-84ae-b6014aa47a4c for instance d6e695df-8d05-4202-9636-54600d730b15 on n-h1-862964-4 Oct 29 02:48:34.823043 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-5ee6fc50-6b8a-4b8e-a497-7e8dca71255f req-5a750fb3-917a-4594-8974-f55947628815 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050821 Oct 29 02:48:34.824667 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 443/919] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:35.009040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e4142eb7-48c5-4504-81ea-b7681a3d0bfc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:35.023349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e4142eb7-48c5-4504-81ea-b7681a3d0bfc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1317 microversion: 2.1 time: 0.356075 Oct 29 02:48:35.028733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:35.029440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:35.038455 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 477/920] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:34 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:35.043077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.043577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.044047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.044763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.045210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.045893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.063146 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] HTTP exception thrown: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Request method failure captured: Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 HTTP/1.1 Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPKYK0vRxpR6iV_qyHBb6BZI3ksK7audc3X8poa6_l0pQbwIrG21mbayAGHE9heC43PVCmGeOZjHdPXUsbJbhSe6xSfINhRCUElVFTvsJjGr7XqNrDpvnIL_MShP4RuCdvWBuCAwaMoa1tQb1MDQhfGB7VKGuJ8LJTr49fuIt2CCu4 Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:48:35.064925 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/013e7f18496749fb9525e0303e688964"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_013e7f18496749fb9525e0303e688964", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}] Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 1e835f57621f46719369731607bebb1f Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:35.066219 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '209b0e5a-13ee-4803-94fc-e9d05298ae49'} Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:35.066940 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:35.068087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.069148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Returning 404 to user: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:35.069148 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6a5542ed-a157-4035-876d-b18618f02a44 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 404 len: 111 microversion: 2.1 time: 0.043269 Oct 29 02:48:35.069148 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 444/921] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:35 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:48:35.077395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:35.078377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:35.090542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.091233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.091852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.092742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.093689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.094567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.121264 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] HTTP exception thrown: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Request method failure captured: Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d HTTP/1.1 Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPKYK0vRxpR6iV_qyHBb6BZI3ksK7audc3X8poa6_l0pQbwIrG21mbayAGHE9heC43PVCmGeOZjHdPXUsbJbhSe6xSfINhRCUElVFTvsJjGr7XqNrDpvnIL_MShP4RuCdvWBuCAwaMoa1tQb1MDQhfGB7VKGuJ8LJTr49fuIt2CCu4 Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:48:35.123418 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/013e7f18496749fb9525e0303e688964"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_013e7f18496749fb9525e0303e688964", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}] Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 1e835f57621f46719369731607bebb1f Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:35.124967 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'e905f88b-7b01-4091-946f-fa0e0abdab0d'} Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:35.125862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:35.127084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.128268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Returning 404 to user: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:35.128268 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c9200be1-8776-44f2-ae11-1b0cf1892227 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 404 len: 111 microversion: 2.1 time: 0.054789 Oct 29 02:48:35.128268 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 478/922] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:48:35 2022] DELETE /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:48:35.137042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:35.137655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:35.144394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.144985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.145479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.146311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.146986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.147406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.158108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02226bb8-038f-4247-a051-f16b6c347f52 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8789e50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:35.164794 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] HTTP exception thrown: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Request method failure captured: Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d HTTP/1.1 Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPKYK0vRxpR6iV_qyHBb6BZI3ksK7audc3X8poa6_l0pQbwIrG21mbayAGHE9heC43PVCmGeOZjHdPXUsbJbhSe6xSfINhRCUElVFTvsJjGr7XqNrDpvnIL_MShP4RuCdvWBuCAwaMoa1tQb1MDQhfGB7VKGuJ8LJTr49fuIt2CCu4 Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:48:35.179088 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/013e7f18496749fb9525e0303e688964"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_013e7f18496749fb9525e0303e688964", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}] Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 1e835f57621f46719369731607bebb1f Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:35.180623 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'e905f88b-7b01-4091-946f-fa0e0abdab0d'} Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:35.181385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:35.185076 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:35.187279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Returning 404 to user: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:35.190791 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f40ca859-7af3-4c55-b9dc-d3833f79219c tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 404 len: 111 microversion: 2.1 time: 0.056611 Oct 29 02:48:35.192562 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 445/923] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:35 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:48:35.202886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-335ca350-8000-4a50-976c-9ac18028ed05 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '.version_select at 0x7fe1aa92ff70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:35.231412 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02226bb8-038f-4247-a051-f16b6c347f52 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.079677 Oct 29 02:48:35.233381 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 479/924] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:35 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:35.250964 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-335ca350-8000-4a50-976c-9ac18028ed05 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853074295" status: 202 len: 0 microversion: 2.1 time: 0.053927 Oct 29 02:48:35.252033 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 446/925] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 02:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853074295 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:48:35.419677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:35.422487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:35.435139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.436056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.436833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.437862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.438507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.439317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.534882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9433a910-1c85-458b-84e8-3bc6f1944c4d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:35.535587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9433a910-1c85-458b-84e8-3bc6f1944c4d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:35.551703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9433a910-1c85-458b-84e8-3bc6f1944c4d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.556462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9433a910-1c85-458b-84e8-3bc6f1944c4d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.557900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9433a910-1c85-458b-84e8-3bc6f1944c4d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.559516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9433a910-1c85-458b-84e8-3bc6f1944c4d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.560483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9433a910-1c85-458b-84e8-3bc6f1944c4d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.561149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9433a910-1c85-458b-84e8-3bc6f1944c4d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.917406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9433a910-1c85-458b-84e8-3bc6f1944c4d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:35.943626 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9433a910-1c85-458b-84e8-3bc6f1944c4d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.414884 Oct 29 02:48:35.970949 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 447/926] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:35 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:35.980428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d18b3d55-3179-405b-83b0-1b4a5090bec4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:35.982876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d18b3d55-3179-405b-83b0-1b4a5090bec4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:35.992088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d18b3d55-3179-405b-83b0-1b4a5090bec4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.992984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d18b3d55-3179-405b-83b0-1b4a5090bec4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.993643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d18b3d55-3179-405b-83b0-1b4a5090bec4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.994625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d18b3d55-3179-405b-83b0-1b4a5090bec4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.995620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d18b3d55-3179-405b-83b0-1b4a5090bec4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.996246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d18b3d55-3179-405b-83b0-1b4a5090bec4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.141641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:36.154806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:36.158855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:36.163870 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d2aec8ec-2cb1-4a69-8d51-53aa439b602d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1362 microversion: 2.25 time: 0.746179 Oct 29 02:48:36.167131 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 480/927] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:35 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1362 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:36.176328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.180763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:36.190840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.191169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.192170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.193775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.194484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.195480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.276088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d18b3d55-3179-405b-83b0-1b4a5090bec4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:36.283987 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d18b3d55-3179-405b-83b0-1b4a5090bec4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1311 microversion: 2.1 time: 0.307400 Oct 29 02:48:36.291408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:36.302432 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 448/928] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:35 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1311 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:36.307837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f14edb18-1e86-417b-8c02-861c890b4379 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.308449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f14edb18-1e86-417b-8c02-861c890b4379 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:36.312863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:36.314491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:36.315644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f14edb18-1e86-417b-8c02-861c890b4379 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.316134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f14edb18-1e86-417b-8c02-861c890b4379 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.316561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f14edb18-1e86-417b-8c02-861c890b4379 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.317259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f14edb18-1e86-417b-8c02-861c890b4379 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.317704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f14edb18-1e86-417b-8c02-861c890b4379 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.318146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f14edb18-1e86-417b-8c02-861c890b4379 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.322497 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2c96a0d7-df9c-49df-be5c-bdd82cb5e6bc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.153303 Oct 29 02:48:36.332218 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 481/929] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:36 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:36.357930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0d2c7cc9-6f1d-49f8-a0d8-15850a24c687 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8766310>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.436732 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0d2c7cc9-6f1d-49f8-a0d8-15850a24c687 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.094131 Oct 29 02:48:36.437324 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 482/930] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:36 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:36.520981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0afd891b-ac6a-410e-97ce-1df11d29b58e tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.550614 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0afd891b-ac6a-410e-97ce-1df11d29b58e tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/669330603" status: 202 len: 0 microversion: 2.1 time: 0.033243 Oct 29 02:48:36.554561 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 483/931] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:48:36 2022] DELETE /compute/v2.1/flavors/669330603 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:48:36.574601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-00ba351c-4656-47d2-9e86-43fddc8bed12 tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.610765 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-00ba351c-4656-47d2-9e86-43fddc8bed12 tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.052231 Oct 29 02:48:36.612039 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 484/932] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:48:36 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:36.642207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-372d712e-7f37-403e-94e7-34de945268d0 tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.657453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=5 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:36.663086 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-372d712e-7f37-403e-94e7-34de945268d0 tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2007017018" status: 202 len: 0 microversion: 2.1 time: 0.029174 Oct 29 02:48:36.664071 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 485/933] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:48:36 2022] DELETE /compute/v2.1/flavors/2007017018 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:48:36.676252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7fd149f3-7de0-46ce-a802-acca66ce9acc tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.701447 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7fd149f3-7de0-46ce-a802-acca66ce9acc tempest-ServersWithSpecificFlavorTestJSON-1797005765 tempest-ServersWithSpecificFlavorTestJSON-1797005765-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032771 Oct 29 02:48:36.702411 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 486/934] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:48:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:36.730923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.731580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:36.741575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.742185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.742630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.743350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.743807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.744343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.761014 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] HTTP exception thrown: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Request method failure captured: Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 HTTP/1.1 Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPKYK0vRxpR6iV_qyHBb6BZI3ksK7audc3X8poa6_l0pQbwIrG21mbayAGHE9heC43PVCmGeOZjHdPXUsbJbhSe6xSfINhRCUElVFTvsJjGr7XqNrDpvnIL_MShP4RuCdvWBuCAwaMoa1tQb1MDQhfGB7VKGuJ8LJTr49fuIt2CCu4 Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:48:36.765174 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/013e7f18496749fb9525e0303e688964"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_013e7f18496749fb9525e0303e688964", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}] Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 1e835f57621f46719369731607bebb1f Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:36.766694 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '209b0e5a-13ee-4803-94fc-e9d05298ae49'} Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:36.767463 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:36.768699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.771054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Returning 404 to user: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:36.772149 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-156dd1fd-2cd2-428e-b797-06d8d2170874 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 404 len: 111 microversion: 2.1 time: 0.045094 Oct 29 02:48:36.773465 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 487/935] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:48:36 2022] DELETE /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:48:36.784430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f14edb18-1e86-417b-8c02-861c890b4379 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:36.785166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.786101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: 209b0e5a-13ee-4803-94fc-e9d05298ae49] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:36.793689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.794627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.794761 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f14edb18-1e86-417b-8c02-861c890b4379 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1317 microversion: 2.1 time: 0.490880 Oct 29 02:48:36.795682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.796737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.797411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.798178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.801764 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 449/936] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:36 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:36.819496 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] HTTP exception thrown: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Request method failure captured: Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 HTTP/1.1 Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPKYK0vRxpR6iV_qyHBb6BZI3ksK7audc3X8poa6_l0pQbwIrG21mbayAGHE9heC43PVCmGeOZjHdPXUsbJbhSe6xSfINhRCUElVFTvsJjGr7XqNrDpvnIL_MShP4RuCdvWBuCAwaMoa1tQb1MDQhfGB7VKGuJ8LJTr49fuIt2CCu4 Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:48:36.823065 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/013e7f18496749fb9525e0303e688964"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_013e7f18496749fb9525e0303e688964", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}] Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 1e835f57621f46719369731607bebb1f Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:36.824429 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '209b0e5a-13ee-4803-94fc-e9d05298ae49'} Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:36.825146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. Oct 29 02:48:36.826784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.830787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Returning 404 to user: Instance 209b0e5a-13ee-4803-94fc-e9d05298ae49 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:36.830787 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-73ba2fc7-3c0d-42fa-8c27-bb8eedbb5a30 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49" status: 404 len: 111 microversion: 2.1 time: 0.048499 Oct 29 02:48:36.830787 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 488/937] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:36 2022] GET /compute/v2.1/servers/209b0e5a-13ee-4803-94fc-e9d05298ae49 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:48:36.840264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.840764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:36.847751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.848234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.848670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.849555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.850098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.850521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.858001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:36.870577 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] HTTP exception thrown: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Request method failure captured: Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d HTTP/1.1 Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJPKYK0vRxpR6iV_qyHBb6BZI3ksK7audc3X8poa6_l0pQbwIrG21mbayAGHE9heC43PVCmGeOZjHdPXUsbJbhSe6xSfINhRCUElVFTvsJjGr7XqNrDpvnIL_MShP4RuCdvWBuCAwaMoa1tQb1MDQhfGB7VKGuJ8LJTr49fuIt2CCu4 Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:48:36.872536 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/013e7f18496749fb9525e0303e688964"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_013e7f18496749fb9525e0303e688964", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}] Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 1e835f57621f46719369731607bebb1f Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:36.874052 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'e905f88b-7b01-4091-946f-fa0e0abdab0d'} Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:36.874816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:36.875990 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.878919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Returning 404 to user: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:36.879882 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3face2a3-569e-4847-9ded-ef6fb959bc2e tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 404 len: 111 microversion: 2.1 time: 0.044169 Oct 29 02:48:36.882848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 450/938] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:48:36 2022] DELETE /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:48:36.891652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.892344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] [instance: e905f88b-7b01-4091-946f-fa0e0abdab0d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:36.899953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.901108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.901985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.903090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.903775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.904657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.927347 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] HTTP exception thrown: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Request method failure captured: Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d HTTP/1.1 Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJPKYK0vRxpR6iV_qyHBb6BZI3ksK7audc3X8poa6_l0pQbwIrG21mbayAGHE9heC43PVCmGeOZjHdPXUsbJbhSe6xSfINhRCUElVFTvsJjGr7XqNrDpvnIL_MShP4RuCdvWBuCAwaMoa1tQb1MDQhfGB7VKGuJ8LJTr49fuIt2CCu4 Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:48:36.931296 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/013e7f18496749fb9525e0303e688964"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_013e7f18496749fb9525e0303e688964", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/013e7f18496749fb9525e0303e688964"}]}] Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 013e7f18496749fb9525e0303e688964 Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440 Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 1e835f57621f46719369731607bebb1f Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-576643440-project Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:36.933220 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'e905f88b-7b01-4091-946f-fa0e0abdab0d'} Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:36.934065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. Oct 29 02:48:36.935262 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:36.939278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] Returning 404 to user: Instance e905f88b-7b01-4091-946f-fa0e0abdab0d could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:36.940382 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ddc1c1ac-7ee0-42af-a3a0-b9a186a91286 tempest-ServersWithSpecificFlavorTestJSON-576643440 tempest-ServersWithSpecificFlavorTestJSON-576643440-project] 10.222.0.16 "GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d" status: 404 len: 111 microversion: 2.1 time: 0.053194 Oct 29 02:48:36.941667 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 489/939] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:36 2022] GET /compute/v2.1/servers/e905f88b-7b01-4091-946f-fa0e0abdab0d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:48:36.981748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8163795e-d0e2-44b9-88e8-415455db9581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.982447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8163795e-d0e2-44b9-88e8-415455db9581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:36.988546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8163795e-d0e2-44b9-88e8-415455db9581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.989582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8163795e-d0e2-44b9-88e8-415455db9581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.990371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8163795e-d0e2-44b9-88e8-415455db9581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.991356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8163795e-d0e2-44b9-88e8-415455db9581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.992049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8163795e-d0e2-44b9-88e8-415455db9581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.992630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8163795e-d0e2-44b9-88e8-415455db9581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.141387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b02f0432-e8a2-4c80-a174-17c7d1ff533e"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:37.142566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:37.149213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.149730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.150305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.150914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.151368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.151792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.211997 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] HTTP exception thrown: Volume 8ec9ea55-3701-4309-998a-443973f937ea could not be found. Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Request method failure captured: Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f/os-volume_attachments/8ec9ea55-3701-4309-998a-443973f937ea HTTP/1.1 Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 74 Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQRu2l0otB-wLAj3NK20xFJ1iobhP1EbMnBwCn2pdsBjYNvZRT9NI3JbovW77iqaRfyQkdKNKf-3fO0_RFVvf-pHsBtqMHXRLEeapVcWqwuy9lkpkB_6VBrvPTn5zwNGUsjlk7U_LJITBmJMJ0590rK4JrIpueiWTCttisFwkeqf_8 Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 89bff91261ea40b6855ac96a9db6c878 Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesAdminNegativeTest-1202794250 Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:48:37.214434 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/89bff91261ea40b6855ac96a9db6c878"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/89bff91261ea40b6855ac96a9db6c878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_89bff91261ea40b6855ac96a9db6c878", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/89bff91261ea40b6855ac96a9db6c878"}]}] Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesAdminNegativeTest-1202794250 Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 89bff91261ea40b6855ac96a9db6c878 Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1202794250 Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesAdminNegativeTest-1202794250-project-admin Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3c866ee9d2744a73b55d1be2b3d69dc5 Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesAdminNegativeTest-1202794250-project-admin Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: {"volumeAttachment": {"volumeId": "b02f0432-e8a2-4c80-a174-17c7d1ff533e"}} Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:48:37.215762 n-d-862964-4 devstack@n-api.service[127041]: exception: Volume 8ec9ea55-3701-4309-998a-443973f937ea could not be found. Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'server_id': '28f938c7-da78-4178-a53b-839924fa802f', 'id': '8ec9ea55-3701-4309-998a-443973f937ea', 'body': {'volumeAttachment': {'volumeId': 'b02f0432-e8a2-4c80-a174-17c7d1ff533e'}}} Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 02:48:37.216567 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ec9ea55-3701-4309-998a-443973f937ea could not be found. (HTTP 404) (Request-ID: req-85b4e5f2-4ab1-4729-892d-3f4d7eca4b3f) Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 02:48:37.217557 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ec9ea55-3701-4309-998a-443973f937ea could not be found. Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:37.218807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ec9ea55-3701-4309-998a-443973f937ea could not be found. Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ec9ea55-3701-4309-998a-443973f937ea could not be found. Oct 29 02:48:37.219929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:48:37.223490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] Returning 404 to user: Volume 8ec9ea55-3701-4309-998a-443973f937ea could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:37.224594 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-003cc84d-a6cf-4315-9ed1-7ad33ee0fd68 tempest-VolumesAdminNegativeTest-1202794250 tempest-VolumesAdminNegativeTest-1202794250-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f/os-volume_attachments/8ec9ea55-3701-4309-998a-443973f937ea" status: 404 len: 109 microversion: 2.1 time: 0.088382 Oct 29 02:48:37.254669 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 490/940] 10.222.0.16 () {60 vars in 1433 bytes} [Sat Oct 29 02:48:37 2022] PUT /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f/os-volume_attachments/8ec9ea55-3701-4309-998a-443973f937ea => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:48:37.266047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:37.266866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:37.300304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.300724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.301297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.303302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.303302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.303302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.456453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:37.471600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=16 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:37.506895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8163795e-d0e2-44b9-88e8-415455db9581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:37.536664 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8163795e-d0e2-44b9-88e8-415455db9581 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.559833 Oct 29 02:48:37.537363 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 451/941] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:36 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:37.579353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:37.579617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d8a84c50-212a-419f-8a82-7f5c5410c9c3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:37.582481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d8a84c50-212a-419f-8a82-7f5c5410c9c3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:37.592414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:37.593041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:37.597390 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-061fc755-b5f2-414f-a169-8f419ab670b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1362 microversion: 2.25 time: 0.338316 Oct 29 02:48:37.598059 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 491/942] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:37 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:37.615620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:37.616243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:37.632239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8a84c50-212a-419f-8a82-7f5c5410c9c3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.639795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8a84c50-212a-419f-8a82-7f5c5410c9c3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.640486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.641042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.641298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8a84c50-212a-419f-8a82-7f5c5410c9c3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.642197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.642678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.643245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.643669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.646640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8a84c50-212a-419f-8a82-7f5c5410c9c3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.647919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8a84c50-212a-419f-8a82-7f5c5410c9c3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.649682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8a84c50-212a-419f-8a82-7f5c5410c9c3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.950797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:37.961570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:37.963033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:37.977624 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3fe40ed2-3efb-48e4-92ad-c3a01cf02c95 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.378455 Oct 29 02:48:37.994217 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 492/943] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:37 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:38.004035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2af1a851-62a3-483c-886c-9832722cc05e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8789040>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:38.062549 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2af1a851-62a3-483c-886c-9832722cc05e tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.066486 Oct 29 02:48:38.071704 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 493/944] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:37 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:38.076863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c187d52b-225e-4431-9881-c0a35bd0e688 req-59eeae29-fec8-480b-8aa5-ead975f98a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d4d5fa-ae6a-43c5-970e-a6ab2610133d", "tag": "8588516f-6e55-45e6-a304-2834e66e1413"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:38.103311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c187d52b-225e-4431-9881-c0a35bd0e688 req-59eeae29-fec8-480b-8aa5-ead975f98a29 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.105470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c187d52b-225e-4431-9881-c0a35bd0e688 req-59eeae29-fec8-480b-8aa5-ead975f98a29 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.107288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c187d52b-225e-4431-9881-c0a35bd0e688 req-59eeae29-fec8-480b-8aa5-ead975f98a29 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:38.128164 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c187d52b-225e-4431-9881-c0a35bd0e688 req-59eeae29-fec8-480b-8aa5-ead975f98a29 service nova] Creating event network-changed:8588516f-6e55-45e6-a304-2834e66e1413 for instance a6d4d5fa-ae6a-43c5-970e-a6ab2610133d on n-h2-862964-4 Oct 29 02:48:38.152998 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c187d52b-225e-4431-9881-c0a35bd0e688 req-59eeae29-fec8-480b-8aa5-ead975f98a29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073409 Oct 29 02:48:38.156239 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 494/945] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:38.161665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ef42938c-d156-43f4-b100-a60f943a3615 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:38.174741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ef42938c-d156-43f4-b100-a60f943a3615 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:38.201226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef42938c-d156-43f4-b100-a60f943a3615 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.203060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef42938c-d156-43f4-b100-a60f943a3615 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.209458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef42938c-d156-43f4-b100-a60f943a3615 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:38.210528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef42938c-d156-43f4-b100-a60f943a3615 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.211426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef42938c-d156-43f4-b100-a60f943a3615 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.211960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef42938c-d156-43f4-b100-a60f943a3615 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:38.298097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d8a84c50-212a-419f-8a82-7f5c5410c9c3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:38.312829 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d8a84c50-212a-419f-8a82-7f5c5410c9c3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1311 microversion: 2.1 time: 0.773541 Oct 29 02:48:38.335786 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 452/946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:37 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1311 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:38.486356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ef42938c-d156-43f4-b100-a60f943a3615 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:38.494905 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ef42938c-d156-43f4-b100-a60f943a3615 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1466 microversion: 2.1 time: 0.337245 Oct 29 02:48:38.496094 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 495/947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:38 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1466 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:38.523262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8a7500ef-9e9d-47c1-aaed-225fc87dc56a tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:38.533528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8a7500ef-9e9d-47c1-aaed-225fc87dc56a tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:38.564945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d242e189-2eac-4bc9-9b41-c045f8ff690c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:38.565654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d242e189-2eac-4bc9-9b41-c045f8ff690c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:38.568582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a7500ef-9e9d-47c1-aaed-225fc87dc56a tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.569087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a7500ef-9e9d-47c1-aaed-225fc87dc56a tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.576262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a7500ef-9e9d-47c1-aaed-225fc87dc56a tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:38.576484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d242e189-2eac-4bc9-9b41-c045f8ff690c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.577025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d242e189-2eac-4bc9-9b41-c045f8ff690c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.577576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a7500ef-9e9d-47c1-aaed-225fc87dc56a tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.578145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d242e189-2eac-4bc9-9b41-c045f8ff690c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:38.578413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a7500ef-9e9d-47c1-aaed-225fc87dc56a tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.578983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a7500ef-9e9d-47c1-aaed-225fc87dc56a tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:38.581267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d242e189-2eac-4bc9-9b41-c045f8ff690c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.582185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d242e189-2eac-4bc9-9b41-c045f8ff690c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.582723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d242e189-2eac-4bc9-9b41-c045f8ff690c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:38.712536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:38.933642 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8a7500ef-9e9d-47c1-aaed-225fc87dc56a tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1617 microversion: 2.1 time: 0.414193 Oct 29 02:48:38.951000 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 453/948] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:38 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1617 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:38.965161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:38.966729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:38.973981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.974799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.975439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:38.976670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.979564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.985356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.051931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=10 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:39.212465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.224213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.226074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.227531 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-da94124f-151f-4542-9582-e4574852a9d5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1362 microversion: 2.25 time: 0.275365 Oct 29 02:48:39.228631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 454/949] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:38 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:39.237099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:39.241708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:39.258960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:39.260804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:39.261514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:39.262196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.270029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:39.270818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:39.271456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.386126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.401956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.404251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.410250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d242e189-2eac-4bc9-9b41-c045f8ff690c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.413282 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2dabb5e5-f4fc-42b0-9fde-076480a4fd90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.182946 Oct 29 02:48:39.414156 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 455/950] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:39 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:39.426102 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d242e189-2eac-4bc9-9b41-c045f8ff690c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.861487 Oct 29 02:48:39.437339 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 496/951] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:38 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:39.439850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1219753480", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9"]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:39.443918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f4bd9d2e-b624-4c7e-aa90-611f0a73f4d7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a87b5160>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:39.509468 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f4bd9d2e-b624-4c7e-aa90-611f0a73f4d7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.074038 Oct 29 02:48:39.510401 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 497/952] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:39 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:39.515173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-df9884c2-0e89-45ce-9958-3917a4f9a47e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:39.516186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-df9884c2-0e89-45ce-9958-3917a4f9a47e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:39.523414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df9884c2-0e89-45ce-9958-3917a4f9a47e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:39.524105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df9884c2-0e89-45ce-9958-3917a4f9a47e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:39.524769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df9884c2-0e89-45ce-9958-3917a4f9a47e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.525644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df9884c2-0e89-45ce-9958-3917a4f9a47e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:39.526287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df9884c2-0e89-45ce-9958-3917a4f9a47e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:39.526860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df9884c2-0e89-45ce-9958-3917a4f9a47e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.562778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:39.777538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-df9884c2-0e89-45ce-9958-3917a4f9a47e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.787582 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-df9884c2-0e89-45ce-9958-3917a4f9a47e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1311 microversion: 2.1 time: 0.275814 Oct 29 02:48:39.793304 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 498/953] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:39 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1311 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:40.168400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:40.168400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:40.168658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:40.169434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:40.169968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:40.182661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:40.183143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:40.183569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:40.184281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:40.184723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:40.185906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:40.205726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:40.210067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:40.222879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:40.225488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:40.256569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:40.257083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:40.269340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:40.269852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:40.274695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:40.275721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:40.276351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:40.276939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:40.290517 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ed66958-f563-4c81-bd57-69708f751bbe tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862395 Oct 29 02:48:40.291168 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 456/954] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:40.305132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-416c0a4e-0fdf-4d28-9b83-ba7d60884745 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:40.306480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-416c0a4e-0fdf-4d28-9b83-ba7d60884745 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:40.381360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-416c0a4e-0fdf-4d28-9b83-ba7d60884745 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:40.405300 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-416c0a4e-0fdf-4d28-9b83-ba7d60884745 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1217 microversion: 2.1 time: 0.104946 Oct 29 02:48:40.418821 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 457/955] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:40 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:40.445627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:40.446628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:40.456924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:40.469499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:40.474487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:40.476767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:40.484236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:40.485731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:40.665705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:40.684089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:40.687550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:40.703369 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f29cd5b-af21-4296-8e87-1c89012a57f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.260741 Oct 29 02:48:40.705883 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 458/956] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:40 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:40.721405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-656b77f0-92bf-4d04-aa24-c2b80bb039df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:40.727449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-656b77f0-92bf-4d04-aa24-c2b80bb039df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:40.746566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-656b77f0-92bf-4d04-aa24-c2b80bb039df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:40.747299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-656b77f0-92bf-4d04-aa24-c2b80bb039df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:40.747675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-656b77f0-92bf-4d04-aa24-c2b80bb039df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:40.748395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-656b77f0-92bf-4d04-aa24-c2b80bb039df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:40.748852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-656b77f0-92bf-4d04-aa24-c2b80bb039df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:40.749247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-656b77f0-92bf-4d04-aa24-c2b80bb039df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:40.869434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:40.878535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:40.879979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:40.901515 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d68f0356-f045-4409-9689-48bb328f2c53 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1362 microversion: 2.25 time: 0.648665 Oct 29 02:48:40.914382 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 499/957] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:40 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1362 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:40.925167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-24c0e554-6eec-46a0-acf4-84531f0a5651 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8793e50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:41.041444 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-24c0e554-6eec-46a0-acf4-84531f0a5651 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.125599 Oct 29 02:48:41.054348 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 500/958] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:40 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:41.060306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1b806404-64ea-4c20-9023-fe30c2241e30 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:41.060917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1b806404-64ea-4c20-9023-fe30c2241e30 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:41.094680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b806404-64ea-4c20-9023-fe30c2241e30 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.095212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b806404-64ea-4c20-9023-fe30c2241e30 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.095640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b806404-64ea-4c20-9023-fe30c2241e30 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.096359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b806404-64ea-4c20-9023-fe30c2241e30 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.096814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b806404-64ea-4c20-9023-fe30c2241e30 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.097238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b806404-64ea-4c20-9023-fe30c2241e30 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.670030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-656b77f0-92bf-4d04-aa24-c2b80bb039df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:41.686079 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-656b77f0-92bf-4d04-aa24-c2b80bb039df tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.969787 Oct 29 02:48:41.687227 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 459/959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:40 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:41.696859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-02405c09-2ac8-4fe9-a9f1-4f546be78b94 req-4b85f329-cfc4-4e3e-9e70-e10888810f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22e9e45-c266-455e-8aff-da1aed5519ab", "name": "network-vif-plugged", "status": "completed", "tag": "675d097b-03fe-4cf0-9756-d0e175fce642"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:41.716133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-02405c09-2ac8-4fe9-a9f1-4f546be78b94 req-4b85f329-cfc4-4e3e-9e70-e10888810f4b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.721643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-02405c09-2ac8-4fe9-a9f1-4f546be78b94 req-4b85f329-cfc4-4e3e-9e70-e10888810f4b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.722403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-02405c09-2ac8-4fe9-a9f1-4f546be78b94 req-4b85f329-cfc4-4e3e-9e70-e10888810f4b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.741396 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-02405c09-2ac8-4fe9-a9f1-4f546be78b94 req-4b85f329-cfc4-4e3e-9e70-e10888810f4b service nova] Creating event network-vif-plugged:675d097b-03fe-4cf0-9756-d0e175fce642 for instance e22e9e45-c266-455e-8aff-da1aed5519ab on n-h2-862964-4 Oct 29 02:48:41.756852 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-02405c09-2ac8-4fe9-a9f1-4f546be78b94 req-4b85f329-cfc4-4e3e-9e70-e10888810f4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067940 Oct 29 02:48:41.758165 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 460/960] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:41.766786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d78545df-3f74-4da2-b9a5-0794ce87f8fa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:41.767664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d78545df-3f74-4da2-b9a5-0794ce87f8fa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:41.774404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78545df-3f74-4da2-b9a5-0794ce87f8fa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.775163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78545df-3f74-4da2-b9a5-0794ce87f8fa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.775999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78545df-3f74-4da2-b9a5-0794ce87f8fa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.776859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78545df-3f74-4da2-b9a5-0794ce87f8fa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.777467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78545df-3f74-4da2-b9a5-0794ce87f8fa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.778072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78545df-3f74-4da2-b9a5-0794ce87f8fa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.009341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b806404-64ea-4c20-9023-fe30c2241e30 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.024001 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1b806404-64ea-4c20-9023-fe30c2241e30 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1311 microversion: 2.1 time: 0.974993 Oct 29 02:48:42.046992 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 501/961] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:41 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1311 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:42.072552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:42.075227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:42.091735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.092502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.094255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.095147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.097617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.099301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.264289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d78545df-3f74-4da2-b9a5-0794ce87f8fa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.278370 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d78545df-3f74-4da2-b9a5-0794ce87f8fa tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1221 microversion: 2.1 time: 0.513544 Oct 29 02:48:42.281963 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 461/962] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:41 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1221 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:42.297968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:42.306210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:42.322989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.334478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.335968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.337594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.339530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.342106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.343628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.364961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.369105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.385845 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e65ad12-bbd8-467f-9651-cb69dbd5c885 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.337595 Oct 29 02:48:42.386438 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 502/963] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:42 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:42.407354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c5b09a7b-7c65-4dcc-a67a-f247f9d21cf6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a88be040>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:42.548195 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c5b09a7b-7c65-4dcc-a67a-f247f9d21cf6 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.150792 Oct 29 02:48:42.554800 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 503/964] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:42 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:42.568689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2f7c608e-05e4-45c6-9db1-4a08f293021e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:42.572236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2f7c608e-05e4-45c6-9db1-4a08f293021e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:42.602681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f7c608e-05e4-45c6-9db1-4a08f293021e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.603199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f7c608e-05e4-45c6-9db1-4a08f293021e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.607082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f7c608e-05e4-45c6-9db1-4a08f293021e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.611348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f7c608e-05e4-45c6-9db1-4a08f293021e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.613968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f7c608e-05e4-45c6-9db1-4a08f293021e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.614623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f7c608e-05e4-45c6-9db1-4a08f293021e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.704385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2f7c608e-05e4-45c6-9db1-4a08f293021e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:48:42.715826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:42.892146 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2f7c608e-05e4-45c6-9db1-4a08f293021e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 204 len: 0 microversion: 2.1 time: 0.333737 Oct 29 02:48:42.893981 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 504/965] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:48:42 2022] DELETE /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:42.907217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9fb564e-3281-47d3-a790-d8a528d1f9a8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:42.914856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9fb564e-3281-47d3-a790-d8a528d1f9a8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:42.936624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9fb564e-3281-47d3-a790-d8a528d1f9a8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.937134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9fb564e-3281-47d3-a790-d8a528d1f9a8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.937571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9fb564e-3281-47d3-a790-d8a528d1f9a8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.944445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9fb564e-3281-47d3-a790-d8a528d1f9a8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.945022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9fb564e-3281-47d3-a790-d8a528d1f9a8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.945711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9fb564e-3281-47d3-a790-d8a528d1f9a8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.953688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.971314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.977624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.983298 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c11aa1f3-7a2f-4535-b5bf-bf986434cd9e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1362 microversion: 2.25 time: 0.698246 Oct 29 02:48:42.986056 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 462/966] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:42 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1362 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:43.018760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-33e45158-b7b4-43f2-bb22-c77655f6cbd1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:43.019429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-33e45158-b7b4-43f2-bb22-c77655f6cbd1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:43.026519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33e45158-b7b4-43f2-bb22-c77655f6cbd1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.027147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33e45158-b7b4-43f2-bb22-c77655f6cbd1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.027584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33e45158-b7b4-43f2-bb22-c77655f6cbd1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.028283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33e45158-b7b4-43f2-bb22-c77655f6cbd1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.028728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33e45158-b7b4-43f2-bb22-c77655f6cbd1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.029145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33e45158-b7b4-43f2-bb22-c77655f6cbd1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.252617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-33e45158-b7b4-43f2-bb22-c77655f6cbd1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.265534 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-33e45158-b7b4-43f2-bb22-c77655f6cbd1 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1514 microversion: 2.1 time: 0.258152 Oct 29 02:48:43.266767 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 463/967] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:43 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:43.297093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-66751d24-2d5b-4ce6-a8c1-d14666c185ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:43.297948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-66751d24-2d5b-4ce6-a8c1-d14666c185ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:43.313243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66751d24-2d5b-4ce6-a8c1-d14666c185ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.316446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66751d24-2d5b-4ce6-a8c1-d14666c185ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.319830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66751d24-2d5b-4ce6-a8c1-d14666c185ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.320792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66751d24-2d5b-4ce6-a8c1-d14666c185ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.321410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66751d24-2d5b-4ce6-a8c1-d14666c185ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.322023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66751d24-2d5b-4ce6-a8c1-d14666c185ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.478796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a9fb564e-3281-47d3-a790-d8a528d1f9a8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.494059 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9fb564e-3281-47d3-a790-d8a528d1f9a8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.595356 Oct 29 02:48:43.494688 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 505/968] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:42 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:43.515983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-da6efc5e-aa5e-4477-b280-11865b9bc423 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:43.516815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-da6efc5e-aa5e-4477-b280-11865b9bc423 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:43.539597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da6efc5e-aa5e-4477-b280-11865b9bc423 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.540551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da6efc5e-aa5e-4477-b280-11865b9bc423 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.541162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da6efc5e-aa5e-4477-b280-11865b9bc423 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.542745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da6efc5e-aa5e-4477-b280-11865b9bc423 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.543368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da6efc5e-aa5e-4477-b280-11865b9bc423 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.544056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da6efc5e-aa5e-4477-b280-11865b9bc423 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.660357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-da6efc5e-aa5e-4477-b280-11865b9bc423 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.680334 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-da6efc5e-aa5e-4477-b280-11865b9bc423 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1269 microversion: 2.1 time: 0.166976 Oct 29 02:48:43.681147 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 506/969] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:43 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1269 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:43.694600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:43.698723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:43.711355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.717859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.719112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.720148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.720754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.723071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.826359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.843713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.853948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.861833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-66751d24-2d5b-4ce6-a8c1-d14666c185ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.863702 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f14b3191-d77a-42ee-a66b-50185103a331 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.180505 Oct 29 02:48:43.868318 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 507/970] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:43 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:43.878493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac8610b5-8892-4ba2-a4aa-5289c65283d8 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a877d1f0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:43.890403 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-66751d24-2d5b-4ce6-a8c1-d14666c185ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1311 microversion: 2.1 time: 0.605829 Oct 29 02:48:43.908447 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 464/971] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:43 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1311 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:43.981077 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac8610b5-8892-4ba2-a4aa-5289c65283d8 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.111395 Oct 29 02:48:43.985400 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 508/972] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:43 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:44.015145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:44.016402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:44.023233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.024290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.024950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.027588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.028363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.029022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.290370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bd1e97b7-ea9a-43e4-83c3-447398df38ba tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:44.292205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bd1e97b7-ea9a-43e4-83c3-447398df38ba tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:44.306427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1e97b7-ea9a-43e4-83c3-447398df38ba tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.307312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1e97b7-ea9a-43e4-83c3-447398df38ba tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.308227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1e97b7-ea9a-43e4-83c3-447398df38ba tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.309790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1e97b7-ea9a-43e4-83c3-447398df38ba tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.310496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1e97b7-ea9a-43e4-83c3-447398df38ba tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.311645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1e97b7-ea9a-43e4-83c3-447398df38ba tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.338410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:44.351620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:44.353358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:44.355016 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-61e51309-10d0-4d00-b8fb-d9d5ee08859f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1362 microversion: 2.25 time: 0.343824 Oct 29 02:48:44.356130 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 465/973] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:44 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:44.525561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c9a196f4-a771-4eab-8b0f-da0fb9b78e28 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:44.526385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c9a196f4-a771-4eab-8b0f-da0fb9b78e28 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:44.538646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9a196f4-a771-4eab-8b0f-da0fb9b78e28 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.540011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9a196f4-a771-4eab-8b0f-da0fb9b78e28 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.541060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9a196f4-a771-4eab-8b0f-da0fb9b78e28 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.549651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9a196f4-a771-4eab-8b0f-da0fb9b78e28 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.550563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9a196f4-a771-4eab-8b0f-da0fb9b78e28 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.551378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9a196f4-a771-4eab-8b0f-da0fb9b78e28 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.654820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bd1e97b7-ea9a-43e4-83c3-447398df38ba tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:44.666788 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bd1e97b7-ea9a-43e4-83c3-447398df38ba tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1514 microversion: 2.1 time: 0.380709 Oct 29 02:48:44.667768 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 509/974] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:44 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1514 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:44.708890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-032cad7a-9756-4ebc-98b2-3fed9bafdff2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:44.710469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-032cad7a-9756-4ebc-98b2-3fed9bafdff2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:44.724003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032cad7a-9756-4ebc-98b2-3fed9bafdff2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.727180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032cad7a-9756-4ebc-98b2-3fed9bafdff2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.731842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032cad7a-9756-4ebc-98b2-3fed9bafdff2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.733607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032cad7a-9756-4ebc-98b2-3fed9bafdff2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.734278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032cad7a-9756-4ebc-98b2-3fed9bafdff2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.734998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032cad7a-9756-4ebc-98b2-3fed9bafdff2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.784401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c9a196f4-a771-4eab-8b0f-da0fb9b78e28 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:44.795789 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c9a196f4-a771-4eab-8b0f-da0fb9b78e28 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.276389 Oct 29 02:48:44.797078 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 466/975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:44 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:44.885192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-032cad7a-9756-4ebc-98b2-3fed9bafdff2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:44.900026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:44.900924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:44.904427 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-032cad7a-9756-4ebc-98b2-3fed9bafdff2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1269 microversion: 2.1 time: 0.199658 Oct 29 02:48:44.906412 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 510/976] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:44 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1269 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:44.917236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.930422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.939320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.940551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.942544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-141c9eab-098e-46e4-a84f-7bb56bdd7a58 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:44.943361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.944184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.947991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-141c9eab-098e-46e4-a84f-7bb56bdd7a58 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:44.962345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-141c9eab-098e-46e4-a84f-7bb56bdd7a58 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.965919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-141c9eab-098e-46e4-a84f-7bb56bdd7a58 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.971458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-141c9eab-098e-46e4-a84f-7bb56bdd7a58 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.972496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-141c9eab-098e-46e4-a84f-7bb56bdd7a58 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.973560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-141c9eab-098e-46e4-a84f-7bb56bdd7a58 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.974183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-141c9eab-098e-46e4-a84f-7bb56bdd7a58 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.079613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.098662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.100710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.107656 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-62cf40df-dbad-41df-9955-f2b560570a05 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.211833 Oct 29 02:48:45.121894 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 467/977] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:44 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:45.121894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-00647a2f-fb8d-4b08-bea2-315f82334c11 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8c07940>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:45.219849 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-00647a2f-fb8d-4b08-bea2-315f82334c11 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.110086 Oct 29 02:48:45.221047 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 468/978] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:45 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:45.386541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:45.387466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:45.406047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.409251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.409783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.410493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.416912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.418238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.422425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-141c9eab-098e-46e4-a84f-7bb56bdd7a58 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.432333 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-141c9eab-098e-46e4-a84f-7bb56bdd7a58 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1494 microversion: 2.1 time: 0.519316 Oct 29 02:48:45.435133 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 511/979] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:44 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1494 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:45.455445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-72a33573-8d17-4b36-831c-1904918bca5e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:45.456431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-72a33573-8d17-4b36-831c-1904918bca5e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:45.463246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72a33573-8d17-4b36-831c-1904918bca5e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.464077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72a33573-8d17-4b36-831c-1904918bca5e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.464795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72a33573-8d17-4b36-831c-1904918bca5e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.465744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72a33573-8d17-4b36-831c-1904918bca5e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.466441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72a33573-8d17-4b36-831c-1904918bca5e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.467074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72a33573-8d17-4b36-831c-1904918bca5e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.808056 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-72a33573-8d17-4b36-831c-1904918bca5e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1645 microversion: 2.1 time: 0.356418 Oct 29 02:48:45.837840 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 512/980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:45 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1645 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:45.837840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8d0a8215-04fb-49b9-afe5-e9c6f2dbad2d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:45.837840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8d0a8215-04fb-49b9-afe5-e9c6f2dbad2d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:45.844620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d0a8215-04fb-49b9-afe5-e9c6f2dbad2d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.846364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d0a8215-04fb-49b9-afe5-e9c6f2dbad2d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.849164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d0a8215-04fb-49b9-afe5-e9c6f2dbad2d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.850091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d0a8215-04fb-49b9-afe5-e9c6f2dbad2d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.850700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d0a8215-04fb-49b9-afe5-e9c6f2dbad2d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.854598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d0a8215-04fb-49b9-afe5-e9c6f2dbad2d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.891466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.913891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.916137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.917705 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3b068485-b2d0-4b65-ba61-30b461711412 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1362 microversion: 2.25 time: 0.536910 Oct 29 02:48:45.919397 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 469/981] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:45 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1362 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:45.924873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f5940ea7-30ac-44b2-bd3e-b91ab721a892 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:45.927279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f5940ea7-30ac-44b2-bd3e-b91ab721a892 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:45.941021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5940ea7-30ac-44b2-bd3e-b91ab721a892 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.945989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5940ea7-30ac-44b2-bd3e-b91ab721a892 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.946864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5940ea7-30ac-44b2-bd3e-b91ab721a892 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.949264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5940ea7-30ac-44b2-bd3e-b91ab721a892 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.951513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5940ea7-30ac-44b2-bd3e-b91ab721a892 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.952328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5940ea7-30ac-44b2-bd3e-b91ab721a892 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.302516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8d0a8215-04fb-49b9-afe5-e9c6f2dbad2d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:46.311163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f5940ea7-30ac-44b2-bd3e-b91ab721a892 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:46.318472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:46.328128 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8d0a8215-04fb-49b9-afe5-e9c6f2dbad2d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1514 microversion: 2.1 time: 0.503600 Oct 29 02:48:46.330294 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 513/982] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:45 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1514 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:46.336262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ace5dc1-7187-4109-b074-19d0be6b938c tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:46.337300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ace5dc1-7187-4109-b074-19d0be6b938c tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:46.354431 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f5940ea7-30ac-44b2-bd3e-b91ab721a892 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.433619 Oct 29 02:48:46.356082 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 470/983] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:45 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:46.359275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ace5dc1-7187-4109-b074-19d0be6b938c tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.378431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ace5dc1-7187-4109-b074-19d0be6b938c tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.378881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ace5dc1-7187-4109-b074-19d0be6b938c tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.379630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ace5dc1-7187-4109-b074-19d0be6b938c tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.380274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ace5dc1-7187-4109-b074-19d0be6b938c tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.380699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ace5dc1-7187-4109-b074-19d0be6b938c tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.384109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ebe31c64-7f1d-4e65-abdb-49cd43dd04ee tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:46.385073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ebe31c64-7f1d-4e65-abdb-49cd43dd04ee tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:46.404439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebe31c64-7f1d-4e65-abdb-49cd43dd04ee tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.405270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebe31c64-7f1d-4e65-abdb-49cd43dd04ee tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.405787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebe31c64-7f1d-4e65-abdb-49cd43dd04ee tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.406667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebe31c64-7f1d-4e65-abdb-49cd43dd04ee tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.407138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebe31c64-7f1d-4e65-abdb-49cd43dd04ee tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.407589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebe31c64-7f1d-4e65-abdb-49cd43dd04ee tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.553451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ebe31c64-7f1d-4e65-abdb-49cd43dd04ee tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:46.582732 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ebe31c64-7f1d-4e65-abdb-49cd43dd04ee tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1275 microversion: 2.1 time: 0.222898 Oct 29 02:48:46.584359 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 471/984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:46 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1275 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:46.607274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-05ee6144-1340-4736-aa41-60f5ae99edce req-a78356f2-2f5a-46a9-be14-0eb950082185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d4d5fa-ae6a-43c5-970e-a6ab2610133d", "name": "network-vif-plugged", "status": "completed", "tag": "8588516f-6e55-45e6-a304-2834e66e1413"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:46.633423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-05ee6144-1340-4736-aa41-60f5ae99edce req-a78356f2-2f5a-46a9-be14-0eb950082185 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.634024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-05ee6144-1340-4736-aa41-60f5ae99edce req-a78356f2-2f5a-46a9-be14-0eb950082185 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.634467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-05ee6144-1340-4736-aa41-60f5ae99edce req-a78356f2-2f5a-46a9-be14-0eb950082185 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.692597 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-05ee6144-1340-4736-aa41-60f5ae99edce req-a78356f2-2f5a-46a9-be14-0eb950082185 service nova] Creating event network-vif-plugged:8588516f-6e55-45e6-a304-2834e66e1413 for instance a6d4d5fa-ae6a-43c5-970e-a6ab2610133d on n-h2-862964-4 Oct 29 02:48:46.704078 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-05ee6144-1340-4736-aa41-60f5ae99edce req-a78356f2-2f5a-46a9-be14-0eb950082185 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116605 Oct 29 02:48:46.713541 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 472/985] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:46.722096 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ace5dc1-7187-4109-b074-19d0be6b938c tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1645 microversion: 2.1 time: 0.389721 Oct 29 02:48:46.723310 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 514/986] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:46 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1645 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:46.733842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0bcaddd7-0237-4600-b0e3-53cf61dbc63f tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8766940>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:46.742455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:46.743174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:46.762755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.763256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.763685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.764379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.764832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.765254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.825568 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0bcaddd7-0237-4600-b0e3-53cf61dbc63f tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.100839 Oct 29 02:48:46.828702 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 515/987] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:46 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:46.834098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ae24d5b2-64de-45a8-8849-e62e605c0a34 req-5932fb0e-a86e-4eac-9611-9c2a0124f781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28f938c7-da78-4178-a53b-839924fa802f", "name": "network-vif-deleted", "tag": "598eb911-ac3c-4b84-8804-7de01ad4a3a8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:46.880187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ae24d5b2-64de-45a8-8849-e62e605c0a34 req-5932fb0e-a86e-4eac-9611-9c2a0124f781 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.882203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ae24d5b2-64de-45a8-8849-e62e605c0a34 req-5932fb0e-a86e-4eac-9611-9c2a0124f781 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.886068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ae24d5b2-64de-45a8-8849-e62e605c0a34 req-5932fb0e-a86e-4eac-9611-9c2a0124f781 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.909549 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ae24d5b2-64de-45a8-8849-e62e605c0a34 req-5932fb0e-a86e-4eac-9611-9c2a0124f781 service nova] Creating event network-vif-deleted:598eb911-ac3c-4b84-8804-7de01ad4a3a8 for instance 28f938c7-da78-4178-a53b-839924fa802f on n-h1-862964-4 Oct 29 02:48:46.917357 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ae24d5b2-64de-45a8-8849-e62e605c0a34 req-5932fb0e-a86e-4eac-9611-9c2a0124f781 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085549 Oct 29 02:48:46.918685 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 516/988] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:46.924362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-83ad4a5c-df8c-4de7-aff0-264535965909 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:46.928581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83ad4a5c-df8c-4de7-aff0-264535965909 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.929418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83ad4a5c-df8c-4de7-aff0-264535965909 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.930310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83ad4a5c-df8c-4de7-aff0-264535965909 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.931706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83ad4a5c-df8c-4de7-aff0-264535965909 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.933286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83ad4a5c-df8c-4de7-aff0-264535965909 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.933965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83ad4a5c-df8c-4de7-aff0-264535965909 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.962964 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-83ad4a5c-df8c-4de7-aff0-264535965909 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042845 Oct 29 02:48:46.964245 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 517/989] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Oct 29 02:48:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:46.970092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:46.970927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:46.982021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.983624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.984284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.986517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.987194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.987838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.987975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:46.999035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:47.008587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:47.027142 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-88fbb9fd-94ec-4334-a27d-8bff7e256929 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.312105 Oct 29 02:48:47.042867 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 473/990] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:46 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:47.053714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-22a3e3a2-24fc-419c-bd32-d6f11f0e7d1a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:47.054332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-22a3e3a2-24fc-419c-bd32-d6f11f0e7d1a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:47.060979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22a3e3a2-24fc-419c-bd32-d6f11f0e7d1a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.061448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22a3e3a2-24fc-419c-bd32-d6f11f0e7d1a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.061908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22a3e3a2-24fc-419c-bd32-d6f11f0e7d1a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.062674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22a3e3a2-24fc-419c-bd32-d6f11f0e7d1a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.063273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22a3e3a2-24fc-419c-bd32-d6f11f0e7d1a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.063690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22a3e3a2-24fc-419c-bd32-d6f11f0e7d1a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.168440 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-22a3e3a2-24fc-419c-bd32-d6f11f0e7d1a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab/action" status: 202 len: 0 microversion: 2.1 time: 0.123822 Oct 29 02:48:47.169960 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 474/991] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:48:47 2022] POST /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:48:47.180185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c239af8-6ba3-4a84-97c2-735f60d54387 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:47.184102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4c239af8-6ba3-4a84-97c2-735f60d54387 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:47.193533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c239af8-6ba3-4a84-97c2-735f60d54387 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.193982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c239af8-6ba3-4a84-97c2-735f60d54387 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.194457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c239af8-6ba3-4a84-97c2-735f60d54387 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.195221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c239af8-6ba3-4a84-97c2-735f60d54387 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.195674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c239af8-6ba3-4a84-97c2-735f60d54387 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.196494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c239af8-6ba3-4a84-97c2-735f60d54387 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.401043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:47.410349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:47.413361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:47.418857 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f7761b91-62b7-4c57-9639-8a2e79b39ace tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1362 microversion: 2.25 time: 0.453071 Oct 29 02:48:47.434713 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 518/992] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:46 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:47.443686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:47.444535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:47.453350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.454074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.454656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.455527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.456160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.456736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.495511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.496443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.497145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.497787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lazy-loading 'fault' on Instance uuid 28f938c7-da78-4178-a53b-839924fa802f {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:47.578184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:47.589782 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-efb2a6f9-000a-4e50-9248-d47c24be6f95 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 200 len: 1308 microversion: 2.1 time: 0.153539 Oct 29 02:48:47.590385 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 519/993] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:47 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 1308 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:47.592731 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4c239af8-6ba3-4a84-97c2-735f60d54387 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1650 microversion: 2.1 time: 0.418496 Oct 29 02:48:47.602028 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 475/994] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:47 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1650 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:47.607481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0574d288-6f30-4d77-8fbd-f760d4e28bdb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:47.608239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0574d288-6f30-4d77-8fbd-f760d4e28bdb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:47.614380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0574d288-6f30-4d77-8fbd-f760d4e28bdb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.615053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0574d288-6f30-4d77-8fbd-f760d4e28bdb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.615652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0574d288-6f30-4d77-8fbd-f760d4e28bdb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.616494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0574d288-6f30-4d77-8fbd-f760d4e28bdb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.617354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0574d288-6f30-4d77-8fbd-f760d4e28bdb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.617948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0574d288-6f30-4d77-8fbd-f760d4e28bdb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.625667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-586ee992-315d-4cbe-9a6c-d5712642f332 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:47.626411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-586ee992-315d-4cbe-9a6c-d5712642f332 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:47.640594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-586ee992-315d-4cbe-9a6c-d5712642f332 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.641083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-586ee992-315d-4cbe-9a6c-d5712642f332 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.641512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-586ee992-315d-4cbe-9a6c-d5712642f332 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.644847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-586ee992-315d-4cbe-9a6c-d5712642f332 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.645405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-586ee992-315d-4cbe-9a6c-d5712642f332 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.645863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-586ee992-315d-4cbe-9a6c-d5712642f332 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.141464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0574d288-6f30-4d77-8fbd-f760d4e28bdb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:48.149762 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0574d288-6f30-4d77-8fbd-f760d4e28bdb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1317 microversion: 2.1 time: 0.546404 Oct 29 02:48:48.153796 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 476/995] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:47 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:48.169172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f624de57-cac2-4a60-aaf6-a764be687beb tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a89f2e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:48.266563 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f624de57-cac2-4a60-aaf6-a764be687beb tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.111457 Oct 29 02:48:48.266765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-586ee992-315d-4cbe-9a6c-d5712642f332 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:48.277051 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 477/996] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:48 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:48.277492 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-586ee992-315d-4cbe-9a6c-d5712642f332 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.666575 Oct 29 02:48:48.278085 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 520/997] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:47 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:48.302640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:48.303265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:48.310223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:48.310706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:48.311156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.311845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:48.312911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:48.314139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.436968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:48.451323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:48.452337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:48.456573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:48.459013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:48.470756 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a25fe3a9-6c1d-4d9f-9a9d-aac65a6330bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.192515 Oct 29 02:48:48.481894 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 478/998] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:48 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:48.483110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:48.483797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:48.489946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.497579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:48.497579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:48.504455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.619125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:48.620640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: 28f938c7-da78-4178-a53b-839924fa802f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:48.628206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:48.628881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:48.629470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.630381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:48.631181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:48.631754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.650976 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] HTTP exception thrown: Instance 28f938c7-da78-4178-a53b-839924fa802f could not be found. Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Request method failure captured: Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f HTTP/1.1 Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQGJc-U_gX8nCyk0IUGIp3C1L5y2SUvSY4DtchTPhY9MpwP6HUn2UklS4-9xuaZmlPneVv6lHExE3pH2hDNFjviwJuBxaA_cQEYxf7cQkrXQZhn0a-uyNJSlwArDzCeyMLygXSo0mKXEPrwDtgvqfjFZBgYEreAYPlG7_7KOQxUF3A Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: f76e01279e6d47c0aa4fb03206db8050 Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-VolumesAdminNegativeTest-1185402186 Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:48:48.655685 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f76e01279e6d47c0aa4fb03206db8050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f76e01279e6d47c0aa4fb03206db8050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f76e01279e6d47c0aa4fb03206db8050", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f76e01279e6d47c0aa4fb03206db8050"}]}] Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-VolumesAdminNegativeTest-1185402186 Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: f76e01279e6d47c0aa4fb03206db8050 Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1185402186 Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-VolumesAdminNegativeTest-1185402186-project Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 1486b01e2a39475dab72aa7f36816c1a Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-VolumesAdminNegativeTest-1185402186-project Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 28f938c7-da78-4178-a53b-839924fa802f could not be found. Oct 29 02:48:48.657380 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '28f938c7-da78-4178-a53b-839924fa802f'} Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28f938c7-da78-4178-a53b-839924fa802f could not be found. Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:48.658342 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28f938c7-da78-4178-a53b-839924fa802f could not be found. Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28f938c7-da78-4178-a53b-839924fa802f could not be found. Oct 29 02:48:48.659870 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:48.664809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Returning 404 to user: Instance 28f938c7-da78-4178-a53b-839924fa802f could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:48.665934 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d9e0c291-9026-41ea-8730-0495aac4b358 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f" status: 404 len: 111 microversion: 2.1 time: 0.054935 Oct 29 02:48:48.666676 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 479/999] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:48 2022] GET /compute/v2.1/servers/28f938c7-da78-4178-a53b-839924fa802f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:48:48.678801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-43345ec1-c669-46ab-a65b-da0799b66ae7 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:48.679633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-43345ec1-c669-46ab-a65b-da0799b66ae7 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:48.693708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43345ec1-c669-46ab-a65b-da0799b66ae7 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:48.694476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43345ec1-c669-46ab-a65b-da0799b66ae7 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:48.696527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43345ec1-c669-46ab-a65b-da0799b66ae7 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.697459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43345ec1-c669-46ab-a65b-da0799b66ae7 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:48.701903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43345ec1-c669-46ab-a65b-da0799b66ae7 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:48.702673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43345ec1-c669-46ab-a65b-da0799b66ae7 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.888807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:48.900761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:48.905646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:48.926721 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-82702ac0-c447-4b29-8ccf-11d579b25c2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1362 microversion: 2.25 time: 0.463621 Oct 29 02:48:48.927423 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 521/1000] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:48 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1362 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:49.179118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8297aec0-6d24-4dde-8048-05df35c5e6fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:49.179405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8297aec0-6d24-4dde-8048-05df35c5e6fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:49.191740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8297aec0-6d24-4dde-8048-05df35c5e6fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.191740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8297aec0-6d24-4dde-8048-05df35c5e6fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.192204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8297aec0-6d24-4dde-8048-05df35c5e6fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.192944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8297aec0-6d24-4dde-8048-05df35c5e6fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.203682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8297aec0-6d24-4dde-8048-05df35c5e6fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.204334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8297aec0-6d24-4dde-8048-05df35c5e6fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.663279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8297aec0-6d24-4dde-8048-05df35c5e6fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:49.667346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:49.684444 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8297aec0-6d24-4dde-8048-05df35c5e6fc tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1317 microversion: 2.1 time: 0.508943 Oct 29 02:48:49.697845 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 522/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:49 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:49.697845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-420cb6d6-d0f4-4ae3-8b79-437619f40d33 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8728af0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:49.729999 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-43345ec1-c669-46ab-a65b-da0799b66ae7 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1630 microversion: 2.1 time: 1.058215 Oct 29 02:48:49.755433 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 480/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:48 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1630 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:49.769320 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-420cb6d6-d0f4-4ae3-8b79-437619f40d33 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.082693 Oct 29 02:48:49.770709 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 523/1003] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:49 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:49.777361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:49.778340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:49.781529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bb59def-9ec3-49a1-8eb5-c4949af6414f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:49.784638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bb59def-9ec3-49a1-8eb5-c4949af6414f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:49.787890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.788727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.789369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.790900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.791596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.792219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.809906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bb59def-9ec3-49a1-8eb5-c4949af6414f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.810406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bb59def-9ec3-49a1-8eb5-c4949af6414f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.810833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bb59def-9ec3-49a1-8eb5-c4949af6414f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.811653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bb59def-9ec3-49a1-8eb5-c4949af6414f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.811986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bb59def-9ec3-49a1-8eb5-c4949af6414f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.812582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bb59def-9ec3-49a1-8eb5-c4949af6414f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.093250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9bb59def-9ec3-49a1-8eb5-c4949af6414f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.102777 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9bb59def-9ec3-49a1-8eb5-c4949af6414f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.345832 Oct 29 02:48:50.103750 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 481/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:49 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:50.131366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41769df5-2677-4b6d-9857-a403c45354c9 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862964-4", "block_migration": true, "disk_over_commit": false}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:50.136338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-41769df5-2677-4b6d-9857-a403c45354c9 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:50.142558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41769df5-2677-4b6d-9857-a403c45354c9 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.143044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41769df5-2677-4b6d-9857-a403c45354c9 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.143472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41769df5-2677-4b6d-9857-a403c45354c9 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.144179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41769df5-2677-4b6d-9857-a403c45354c9 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.144623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41769df5-2677-4b6d-9857-a403c45354c9 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.145100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41769df5-2677-4b6d-9857-a403c45354c9 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.165173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.176145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.182076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.197252 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-61940cfa-fa78-46c2-8e57-43b0f77f69ac tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.424947 Oct 29 02:48:50.197505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-41769df5-2677-4b6d-9857-a403c45354c9 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lazy-loading 'flavor' on Instance uuid e22e9e45-c266-455e-8aff-da1aed5519ab {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:50.198627 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 524/1005] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:49 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:50.206101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:50.208058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c48e8b7d-16a9-4a92-b7bb-3877e40523de req-58f01ea0-77e3-4e0f-8b3c-ad47e90bdd0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49192f24-c094-4830-9245-aaf0fc79a197", "tag": "e49d1e2e-7a45-4ba0-9082-ae77df060e71"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:50.231435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-41769df5-2677-4b6d-9857-a403c45354c9 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Going to try to live migrate instance to n-h1-862964-4 {{(pid=127042) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:48:50.233939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c48e8b7d-16a9-4a92-b7bb-3877e40523de req-58f01ea0-77e3-4e0f-8b3c-ad47e90bdd0a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.234598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c48e8b7d-16a9-4a92-b7bb-3877e40523de req-58f01ea0-77e3-4e0f-8b3c-ad47e90bdd0a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.239871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c48e8b7d-16a9-4a92-b7bb-3877e40523de req-58f01ea0-77e3-4e0f-8b3c-ad47e90bdd0a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.262849 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c48e8b7d-16a9-4a92-b7bb-3877e40523de req-58f01ea0-77e3-4e0f-8b3c-ad47e90bdd0a service nova] Creating event network-changed:e49d1e2e-7a45-4ba0-9082-ae77df060e71 for instance 49192f24-c094-4830-9245-aaf0fc79a197 on n-h1-862964-4 Oct 29 02:48:50.274227 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c48e8b7d-16a9-4a92-b7bb-3877e40523de req-58f01ea0-77e3-4e0f-8b3c-ad47e90bdd0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073848 Oct 29 02:48:50.277141 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 525/1006] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:50.292304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:50.294299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:50.313896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.316786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.317241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.320449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.321030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.321466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.409783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:50.850820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.865912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.871963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.873180 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a8f29b0a-d2fa-43c7-ac1a-5cf65201c42f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1558 microversion: 2.25 time: 0.593318 Oct 29 02:48:50.897240 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 526/1007] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:50 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1558 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:50.909585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95bdf2bc-8293-425b-86bd-a0c1fc1c0582 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:50.910237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-95bdf2bc-8293-425b-86bd-a0c1fc1c0582 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:50.927680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95bdf2bc-8293-425b-86bd-a0c1fc1c0582 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.928090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95bdf2bc-8293-425b-86bd-a0c1fc1c0582 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.928526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95bdf2bc-8293-425b-86bd-a0c1fc1c0582 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.929359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95bdf2bc-8293-425b-86bd-a0c1fc1c0582 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.929858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95bdf2bc-8293-425b-86bd-a0c1fc1c0582 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.930363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95bdf2bc-8293-425b-86bd-a0c1fc1c0582 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:51.852815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-95bdf2bc-8293-425b-86bd-a0c1fc1c0582 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:51.875805 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-95bdf2bc-8293-425b-86bd-a0c1fc1c0582 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1317 microversion: 2.1 time: 0.966559 Oct 29 02:48:51.878346 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 527/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:50 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1317 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:51.890803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7e5a5edc-f632-4930-9b34-65692b580c23 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8788550>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:51.967855 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7e5a5edc-f632-4930-9b34-65692b580c23 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.088165 Oct 29 02:48:51.973352 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 528/1009] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:51 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:51.982765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5b54e5e6-c0d8-4297-8405-0fefb090bdf3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:51.983384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5b54e5e6-c0d8-4297-8405-0fefb090bdf3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:52.001527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b54e5e6-c0d8-4297-8405-0fefb090bdf3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:52.002046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b54e5e6-c0d8-4297-8405-0fefb090bdf3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:52.002479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b54e5e6-c0d8-4297-8405-0fefb090bdf3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:52.003197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b54e5e6-c0d8-4297-8405-0fefb090bdf3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:52.003650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b54e5e6-c0d8-4297-8405-0fefb090bdf3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:52.004070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b54e5e6-c0d8-4297-8405-0fefb090bdf3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:52.569193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-5b54e5e6-c0d8-4297-8405-0fefb090bdf3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid a6d4d5fa-ae6a-43c5-970e-a6ab2610133d {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:52.608251 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5b54e5e6-c0d8-4297-8405-0fefb090bdf3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 2051 microversion: 2.25 time: 0.633383 Oct 29 02:48:52.632149 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 529/1010] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:51 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 2051 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:52.637853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a4f0281-0392-401c-8f31-bc8a0c3d40aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:52.641791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a4f0281-0392-401c-8f31-bc8a0c3d40aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:52.656804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a4f0281-0392-401c-8f31-bc8a0c3d40aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:52.657764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a4f0281-0392-401c-8f31-bc8a0c3d40aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:52.658621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a4f0281-0392-401c-8f31-bc8a0c3d40aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:52.659580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a4f0281-0392-401c-8f31-bc8a0c3d40aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:52.660246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a4f0281-0392-401c-8f31-bc8a0c3d40aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:52.660946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a4f0281-0392-401c-8f31-bc8a0c3d40aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:52.986878 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-41769df5-2677-4b6d-9857-a403c45354c9 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab/action" status: 202 len: 0 microversion: 2.1 time: 2.870763 Oct 29 02:48:52.987488 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 482/1011] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:48:50 2022] POST /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab/action => generated 0 bytes in 2884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:48:52.993152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:52.998518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:53.006969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2a4f0281-0392-401c-8f31-bc8a0c3d40aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:53.017608 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a4f0281-0392-401c-8f31-bc8a0c3d40aa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.383712 Oct 29 02:48:53.024199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.024719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.025155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.027328 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 530/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:52 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:53.041233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4600e094-899f-4e48-9162-c5ccf3cbc5b1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:53.042118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.042622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.043058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.049342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4600e094-899f-4e48-9162-c5ccf3cbc5b1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:53.078843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4600e094-899f-4e48-9162-c5ccf3cbc5b1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.083986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4600e094-899f-4e48-9162-c5ccf3cbc5b1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.085268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4600e094-899f-4e48-9162-c5ccf3cbc5b1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.087886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4600e094-899f-4e48-9162-c5ccf3cbc5b1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.090746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4600e094-899f-4e48-9162-c5ccf3cbc5b1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.091426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4600e094-899f-4e48-9162-c5ccf3cbc5b1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.163557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:53.174179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:53.179558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:53.192509 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d0601751-e7fe-4201-9265-5f5f39f22a8f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.203867 Oct 29 02:48:53.195881 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 483/1013] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:52 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:53.205499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-671c5168-1b98-4392-8760-4c3e4e50ed3b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:53.207299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-671c5168-1b98-4392-8760-4c3e4e50ed3b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:53.221926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-671c5168-1b98-4392-8760-4c3e4e50ed3b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.225279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-671c5168-1b98-4392-8760-4c3e4e50ed3b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.226142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-671c5168-1b98-4392-8760-4c3e4e50ed3b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.227825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-671c5168-1b98-4392-8760-4c3e4e50ed3b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.231538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-671c5168-1b98-4392-8760-4c3e4e50ed3b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.232305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-671c5168-1b98-4392-8760-4c3e4e50ed3b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.367905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-4600e094-899f-4e48-9162-c5ccf3cbc5b1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid a6d4d5fa-ae6a-43c5-970e-a6ab2610133d {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:53.419702 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4600e094-899f-4e48-9162-c5ccf3cbc5b1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 2051 microversion: 2.25 time: 0.390038 Oct 29 02:48:53.426708 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 531/1014] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:53 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 2051 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:53.443651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-990f1f27-9ee7-47b2-b3a3-8ddfcff90b80 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a889c1f0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:53.517075 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-990f1f27-9ee7-47b2-b3a3-8ddfcff90b80 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1428 microversion: 2.1 time: 0.087171 Oct 29 02:48:53.517965 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 532/1015] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:53 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:53.530282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-abbefe24-311f-48e5-ae71-7ffc2303089a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:53.531599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-abbefe24-311f-48e5-ae71-7ffc2303089a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:53.539799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abbefe24-311f-48e5-ae71-7ffc2303089a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.540453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abbefe24-311f-48e5-ae71-7ffc2303089a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.566306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abbefe24-311f-48e5-ae71-7ffc2303089a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.569909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abbefe24-311f-48e5-ae71-7ffc2303089a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.570650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abbefe24-311f-48e5-ae71-7ffc2303089a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.571293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abbefe24-311f-48e5-ae71-7ffc2303089a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.658387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-671c5168-1b98-4392-8760-4c3e4e50ed3b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:53.677440 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-671c5168-1b98-4392-8760-4c3e4e50ed3b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1317 microversion: 2.1 time: 0.480059 Oct 29 02:48:53.686654 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 484/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:53 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:53.691686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9ab11ebd-67be-43fa-8248-dd66690d48af tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:53.694835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9ab11ebd-67be-43fa-8248-dd66690d48af tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:53.717368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ab11ebd-67be-43fa-8248-dd66690d48af tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.717923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ab11ebd-67be-43fa-8248-dd66690d48af tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.722499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ab11ebd-67be-43fa-8248-dd66690d48af tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.723614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ab11ebd-67be-43fa-8248-dd66690d48af tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.724249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ab11ebd-67be-43fa-8248-dd66690d48af tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.726156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ab11ebd-67be-43fa-8248-dd66690d48af tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.787065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9ab11ebd-67be-43fa-8248-dd66690d48af tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:48:53.837644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:53.920082 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9ab11ebd-67be-43fa-8248-dd66690d48af tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 204 len: 0 microversion: 2.1 time: 0.231672 Oct 29 02:48:53.925037 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 485/1017] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:48:53 2022] DELETE /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:53.930082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-abbefe24-311f-48e5-ae71-7ffc2303089a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:53.934497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1e9dc36a-7338-4c74-9a9b-a1571ed1eac3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:53.939581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e9dc36a-7338-4c74-9a9b-a1571ed1eac3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.940277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e9dc36a-7338-4c74-9a9b-a1571ed1eac3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.940877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e9dc36a-7338-4c74-9a9b-a1571ed1eac3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.941885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e9dc36a-7338-4c74-9a9b-a1571ed1eac3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.942042 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-abbefe24-311f-48e5-ae71-7ffc2303089a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.422145 Oct 29 02:48:53.942308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e9dc36a-7338-4c74-9a9b-a1571ed1eac3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.942893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e9dc36a-7338-4c74-9a9b-a1571ed1eac3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.946123 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 533/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:53 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:53.960396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9f9b247d-3add-4c59-9513-bfa3ed7300f9 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:53.961044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9f9b247d-3add-4c59-9513-bfa3ed7300f9 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:53.975335 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1e9dc36a-7338-4c74-9a9b-a1571ed1eac3 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048365 Oct 29 02:48:53.975678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:53.984410 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 486/1019] 10.222.0.16 () {60 vars in 1217 bytes} [Sat Oct 29 02:48:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:48:53.984643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f9b247d-3add-4c59-9513-bfa3ed7300f9 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.984643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f9b247d-3add-4c59-9513-bfa3ed7300f9 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.984643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f9b247d-3add-4c59-9513-bfa3ed7300f9 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.985570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f9b247d-3add-4c59-9513-bfa3ed7300f9 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.986895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f9b247d-3add-4c59-9513-bfa3ed7300f9 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.989276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f9b247d-3add-4c59-9513-bfa3ed7300f9 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.990496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2aeaf9db-4fdb-4bb3-9e4b-04e948e60c96 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:53.993998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2aeaf9db-4fdb-4bb3-9e4b-04e948e60c96 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:54.004239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aeaf9db-4fdb-4bb3-9e4b-04e948e60c96 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.007113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aeaf9db-4fdb-4bb3-9e4b-04e948e60c96 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.007632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aeaf9db-4fdb-4bb3-9e4b-04e948e60c96 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.009871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aeaf9db-4fdb-4bb3-9e4b-04e948e60c96 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.010341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aeaf9db-4fdb-4bb3-9e4b-04e948e60c96 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.010761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aeaf9db-4fdb-4bb3-9e4b-04e948e60c96 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.125955 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2aeaf9db-4fdb-4bb3-9e4b-04e948e60c96 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d/action" status: 202 len: 0 microversion: 2.25 time: 0.139462 Oct 29 02:48:54.127140 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 487/1020] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:48:53 2022] POST /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:54.134263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c939ea47-9e88-454b-9330-a09732ce2ff1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:54.135035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c939ea47-9e88-454b-9330-a09732ce2ff1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:54.137541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:54.146428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c939ea47-9e88-454b-9330-a09732ce2ff1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.146808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c939ea47-9e88-454b-9330-a09732ce2ff1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.147268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c939ea47-9e88-454b-9330-a09732ce2ff1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.148450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c939ea47-9e88-454b-9330-a09732ce2ff1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.148710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c939ea47-9e88-454b-9330-a09732ce2ff1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.149143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c939ea47-9e88-454b-9330-a09732ce2ff1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.325445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c939ea47-9e88-454b-9330-a09732ce2ff1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:54.333949 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c939ea47-9e88-454b-9330-a09732ce2ff1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.205518 Oct 29 02:48:54.339983 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 488/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:54 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:54.350238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce27ae47-a627-4c36-b6b1-9e61cc5d1733 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:54.351160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ce27ae47-a627-4c36-b6b1-9e61cc5d1733 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:54.359609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce27ae47-a627-4c36-b6b1-9e61cc5d1733 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.360176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce27ae47-a627-4c36-b6b1-9e61cc5d1733 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.360624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce27ae47-a627-4c36-b6b1-9e61cc5d1733 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.361353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce27ae47-a627-4c36-b6b1-9e61cc5d1733 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.361839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce27ae47-a627-4c36-b6b1-9e61cc5d1733 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.362255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce27ae47-a627-4c36-b6b1-9e61cc5d1733 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.523337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-ce27ae47-a627-4c36-b6b1-9e61cc5d1733 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid a6d4d5fa-ae6a-43c5-970e-a6ab2610133d {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:54.538411 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ce27ae47-a627-4c36-b6b1-9e61cc5d1733 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 2056 microversion: 2.25 time: 0.196369 Oct 29 02:48:54.539666 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 489/1022] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:54 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 2056 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:54.559624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:54.560838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:54.568085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.568821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.569938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.571871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.572563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.573215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.601400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9f9b247d-3add-4c59-9513-bfa3ed7300f9 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:54.614313 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9f9b247d-3add-4c59-9513-bfa3ed7300f9 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1682 microversion: 2.1 time: 0.665295 Oct 29 02:48:54.615353 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 534/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:53 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1682 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:54.620610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-05301a81-99f5-4035-973e-7567fc53dbd0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8722af0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:54.680847 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-05301a81-99f5-4035-973e-7567fc53dbd0 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1437 microversion: 2.1 time: 0.064211 Oct 29 02:48:54.681989 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 535/1024] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:54 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1437 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:54.692306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:54.695761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-245b01cd-1a8c-44e7-b9c5-a45985e96b6b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a87b5430>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:54.713696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:54.715456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:54.724443 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-52df93bd-2eab-4ae2-a50f-47a3cb94179a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.183575 Oct 29 02:48:54.729008 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 490/1025] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:54 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:54.748783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-acb291fe-6b55-4872-84b2-73cf670ddac1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:54.752289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-acb291fe-6b55-4872-84b2-73cf670ddac1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:54.755940 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-245b01cd-1a8c-44e7-b9c5-a45985e96b6b tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 200 len: 1437 microversion: 2.1 time: 0.063286 Oct 29 02:48:54.771664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acb291fe-6b55-4872-84b2-73cf670ddac1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.772012 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 536/1026] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:54 2022] GET /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 1437 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:54.772276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acb291fe-6b55-4872-84b2-73cf670ddac1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.772785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acb291fe-6b55-4872-84b2-73cf670ddac1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.773666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acb291fe-6b55-4872-84b2-73cf670ddac1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.774147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acb291fe-6b55-4872-84b2-73cf670ddac1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.774562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acb291fe-6b55-4872-84b2-73cf670ddac1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.778082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4fe5a74a-9cc6-45e8-a351-d8042cf24319 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:54.784088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4fe5a74a-9cc6-45e8-a351-d8042cf24319 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:54.794139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe5a74a-9cc6-45e8-a351-d8042cf24319 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.794699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe5a74a-9cc6-45e8-a351-d8042cf24319 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.795220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe5a74a-9cc6-45e8-a351-d8042cf24319 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.796021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe5a74a-9cc6-45e8-a351-d8042cf24319 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.796741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe5a74a-9cc6-45e8-a351-d8042cf24319 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.797227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe5a74a-9cc6-45e8-a351-d8042cf24319 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.063622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-acb291fe-6b55-4872-84b2-73cf670ddac1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.072441 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-acb291fe-6b55-4872-84b2-73cf670ddac1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1317 microversion: 2.1 time: 0.342304 Oct 29 02:48:55.091307 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 491/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:54 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:55.102975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4855ae5a-deb4-4c6a-9d20-b1698ac618a1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:55.103592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4855ae5a-deb4-4c6a-9d20-b1698ac618a1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:55.111726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4855ae5a-deb4-4c6a-9d20-b1698ac618a1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.112213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4855ae5a-deb4-4c6a-9d20-b1698ac618a1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.112636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4855ae5a-deb4-4c6a-9d20-b1698ac618a1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.113332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4855ae5a-deb4-4c6a-9d20-b1698ac618a1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.113936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4855ae5a-deb4-4c6a-9d20-b1698ac618a1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.114556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4855ae5a-deb4-4c6a-9d20-b1698ac618a1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.125352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4fe5a74a-9cc6-45e8-a351-d8042cf24319 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.152749 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4fe5a74a-9cc6-45e8-a351-d8042cf24319 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1479 microversion: 2.1 time: 0.375884 Oct 29 02:48:55.169129 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 537/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:54 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1479 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:55.292407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4855ae5a-deb4-4c6a-9d20-b1698ac618a1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.300286 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4855ae5a-deb4-4c6a-9d20-b1698ac618a1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.207823 Oct 29 02:48:55.300835 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 492/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:55 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:55.358735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3fc20f8b-6220-4d06-9f0d-eb840ee12d76 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:55.359475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3fc20f8b-6220-4d06-9f0d-eb840ee12d76 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:55.365881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fc20f8b-6220-4d06-9f0d-eb840ee12d76 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.366397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fc20f8b-6220-4d06-9f0d-eb840ee12d76 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.366903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fc20f8b-6220-4d06-9f0d-eb840ee12d76 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.367603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fc20f8b-6220-4d06-9f0d-eb840ee12d76 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.368043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fc20f8b-6220-4d06-9f0d-eb840ee12d76 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.368453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fc20f8b-6220-4d06-9f0d-eb840ee12d76 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.526659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3fc20f8b-6220-4d06-9f0d-eb840ee12d76 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.536969 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3fc20f8b-6220-4d06-9f0d-eb840ee12d76 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.182306 Oct 29 02:48:55.537562 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 538/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:55 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:55.563982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f845445-4033-4252-bf45-02e241471cd1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:55.564722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f845445-4033-4252-bf45-02e241471cd1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:55.571103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f845445-4033-4252-bf45-02e241471cd1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.571581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f845445-4033-4252-bf45-02e241471cd1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.572009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f845445-4033-4252-bf45-02e241471cd1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.572698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f845445-4033-4252-bf45-02e241471cd1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.573135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f845445-4033-4252-bf45-02e241471cd1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.573540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f845445-4033-4252-bf45-02e241471cd1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.642506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ee1c97ac-ad07-4993-878b-21e99a2ba529 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:55.643318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ee1c97ac-ad07-4993-878b-21e99a2ba529 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:55.650359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1c97ac-ad07-4993-878b-21e99a2ba529 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.650924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1c97ac-ad07-4993-878b-21e99a2ba529 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.651429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1c97ac-ad07-4993-878b-21e99a2ba529 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.652256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1c97ac-ad07-4993-878b-21e99a2ba529 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.652787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1c97ac-ad07-4993-878b-21e99a2ba529 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.653272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1c97ac-ad07-4993-878b-21e99a2ba529 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.754384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-8f845445-4033-4252-bf45-02e241471cd1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid a6d4d5fa-ae6a-43c5-970e-a6ab2610133d {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:55.776143 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f845445-4033-4252-bf45-02e241471cd1 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 2036 microversion: 2.25 time: 0.215468 Oct 29 02:48:55.785898 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 493/1031] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:55 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 2036 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:55.785898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:55.785898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:55.790634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.791226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.791972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.793029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.793760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.794634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.857626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ee1c97ac-ad07-4993-878b-21e99a2ba529 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.865399 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ee1c97ac-ad07-4993-878b-21e99a2ba529 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1682 microversion: 2.1 time: 0.227571 Oct 29 02:48:55.878721 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 539/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:55 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:55.878942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.883729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0962e77b-87ae-4fe2-a255-df8ba6bb19f8 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862964-4", "block_migration": "auto"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:55.886519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0962e77b-87ae-4fe2-a255-df8ba6bb19f8 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:55.886963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.888578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.893536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0962e77b-87ae-4fe2-a255-df8ba6bb19f8 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.894056 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e7fce505-8808-45f0-b5c7-4e79e9a1b359 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.115291 Oct 29 02:48:55.894216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0962e77b-87ae-4fe2-a255-df8ba6bb19f8 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.894482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0962e77b-87ae-4fe2-a255-df8ba6bb19f8 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.894823 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 494/1033] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:55 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:55.899282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0962e77b-87ae-4fe2-a255-df8ba6bb19f8 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.899890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0962e77b-87ae-4fe2-a255-df8ba6bb19f8 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.900326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0962e77b-87ae-4fe2-a255-df8ba6bb19f8 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.929590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-0962e77b-87ae-4fe2-a255-df8ba6bb19f8 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'flavor' on Instance uuid a6d4d5fa-ae6a-43c5-970e-a6ab2610133d {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:55.943324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0962e77b-87ae-4fe2-a255-df8ba6bb19f8 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Going to try to live migrate instance to n-h1-862964-4 {{(pid=127041) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:48:56.106001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d35396d-9f90-4c99-a4cc-beedfafb82d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:56.107053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9d35396d-9f90-4c99-a4cc-beedfafb82d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:56.114614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d35396d-9f90-4c99-a4cc-beedfafb82d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.115093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d35396d-9f90-4c99-a4cc-beedfafb82d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.115531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d35396d-9f90-4c99-a4cc-beedfafb82d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.116408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d35396d-9f90-4c99-a4cc-beedfafb82d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.116931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d35396d-9f90-4c99-a4cc-beedfafb82d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.117320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d35396d-9f90-4c99-a4cc-beedfafb82d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.269270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9d35396d-9f90-4c99-a4cc-beedfafb82d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:56.278155 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9d35396d-9f90-4c99-a4cc-beedfafb82d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1317 microversion: 2.1 time: 0.176671 Oct 29 02:48:56.278758 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 495/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:56 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:56.284177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f4d47ac2-e699-491f-8329-8cd57db2d5f2 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:56.284854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f4d47ac2-e699-491f-8329-8cd57db2d5f2 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:56.291314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4d47ac2-e699-491f-8329-8cd57db2d5f2 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.291881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4d47ac2-e699-491f-8329-8cd57db2d5f2 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.292338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4d47ac2-e699-491f-8329-8cd57db2d5f2 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.293156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4d47ac2-e699-491f-8329-8cd57db2d5f2 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.293610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4d47ac2-e699-491f-8329-8cd57db2d5f2 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.294093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4d47ac2-e699-491f-8329-8cd57db2d5f2 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.464420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f4d47ac2-e699-491f-8329-8cd57db2d5f2 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:56.472544 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f4d47ac2-e699-491f-8329-8cd57db2d5f2 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1479 microversion: 2.1 time: 0.192331 Oct 29 02:48:56.473135 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 496/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:56 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1479 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:56.478029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f559560f-3b46-435c-adac-5db60abb8b11 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:56.478623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f559560f-3b46-435c-adac-5db60abb8b11 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:56.484796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f559560f-3b46-435c-adac-5db60abb8b11 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.485297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f559560f-3b46-435c-adac-5db60abb8b11 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.485763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f559560f-3b46-435c-adac-5db60abb8b11 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.486451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f559560f-3b46-435c-adac-5db60abb8b11 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.486980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f559560f-3b46-435c-adac-5db60abb8b11 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.487289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f559560f-3b46-435c-adac-5db60abb8b11 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.626573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f559560f-3b46-435c-adac-5db60abb8b11 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:56.635316 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f559560f-3b46-435c-adac-5db60abb8b11 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.161170 Oct 29 02:48:56.636200 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 497/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:56 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:56.640765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8af9ddfd-1b0f-48d4-bee6-07cfe1e69753 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:56.641288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8af9ddfd-1b0f-48d4-bee6-07cfe1e69753 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:56.649676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af9ddfd-1b0f-48d4-bee6-07cfe1e69753 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.650458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af9ddfd-1b0f-48d4-bee6-07cfe1e69753 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.651015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af9ddfd-1b0f-48d4-bee6-07cfe1e69753 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.651725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af9ddfd-1b0f-48d4-bee6-07cfe1e69753 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.652173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af9ddfd-1b0f-48d4-bee6-07cfe1e69753 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.652592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af9ddfd-1b0f-48d4-bee6-07cfe1e69753 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.809078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8af9ddfd-1b0f-48d4-bee6-07cfe1e69753 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:56.822060 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8af9ddfd-1b0f-48d4-bee6-07cfe1e69753 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1476 microversion: 2.1 time: 0.181307 Oct 29 02:48:56.836974 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 498/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:56 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1476 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:56.894431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-378c931a-5708-4314-9a21-fc796667479d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:56.895417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-378c931a-5708-4314-9a21-fc796667479d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:56.902601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-378c931a-5708-4314-9a21-fc796667479d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.903473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-378c931a-5708-4314-9a21-fc796667479d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.904166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-378c931a-5708-4314-9a21-fc796667479d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.905085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-378c931a-5708-4314-9a21-fc796667479d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.905652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-378c931a-5708-4314-9a21-fc796667479d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.906930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-378c931a-5708-4314-9a21-fc796667479d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.943431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:57.059918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-378c931a-5708-4314-9a21-fc796667479d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:57.068087 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-378c931a-5708-4314-9a21-fc796667479d tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1682 microversion: 2.1 time: 0.177810 Oct 29 02:48:57.068672 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 499/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:56 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:57.089128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:57.089731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:57.098001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.098499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.098947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.099635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.100088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.100508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.179184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:57.186671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:57.189515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:57.191056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:57.197854 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3927cc6f-6caf-43e0-be5e-02e2e8f16377 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.112093 Oct 29 02:48:57.197854 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 500/1039] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:57 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:57.206869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-3355bf6f-12fd-4787-9765-5d5cf07de73c req-af18c6f6-b663-4420-bfbb-3e4d4b5e6da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49192f24-c094-4830-9245-aaf0fc79a197", "name": "network-vif-plugged", "status": "completed", "tag": "e49d1e2e-7a45-4ba0-9082-ae77df060e71"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:57.224160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3355bf6f-12fd-4787-9765-5d5cf07de73c req-af18c6f6-b663-4420-bfbb-3e4d4b5e6da4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.225039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3355bf6f-12fd-4787-9765-5d5cf07de73c req-af18c6f6-b663-4420-bfbb-3e4d4b5e6da4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.226279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3355bf6f-12fd-4787-9765-5d5cf07de73c req-af18c6f6-b663-4420-bfbb-3e4d4b5e6da4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.242867 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-3355bf6f-12fd-4787-9765-5d5cf07de73c req-af18c6f6-b663-4420-bfbb-3e4d4b5e6da4 service nova] Creating event network-vif-plugged:e49d1e2e-7a45-4ba0-9082-ae77df060e71 for instance 49192f24-c094-4830-9245-aaf0fc79a197 on n-h1-862964-4 Oct 29 02:48:57.248769 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-3355bf6f-12fd-4787-9765-5d5cf07de73c req-af18c6f6-b663-4420-bfbb-3e4d4b5e6da4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049776 Oct 29 02:48:57.253963 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 501/1040] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:57.301242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3c1a05c5-ac3d-4419-a42a-48d2e4db2215 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:57.301982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3c1a05c5-ac3d-4419-a42a-48d2e4db2215 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:57.311104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c1a05c5-ac3d-4419-a42a-48d2e4db2215 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.311769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c1a05c5-ac3d-4419-a42a-48d2e4db2215 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.312422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c1a05c5-ac3d-4419-a42a-48d2e4db2215 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.313427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c1a05c5-ac3d-4419-a42a-48d2e4db2215 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.314072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c1a05c5-ac3d-4419-a42a-48d2e4db2215 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.314647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c1a05c5-ac3d-4419-a42a-48d2e4db2215 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.492347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3c1a05c5-ac3d-4419-a42a-48d2e4db2215 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:57.502612 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3c1a05c5-ac3d-4419-a42a-48d2e4db2215 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1317 microversion: 2.1 time: 0.205497 Oct 29 02:48:57.503215 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 502/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:57 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:57.507786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-28ab5ede-f2c0-4a04-bbfb-e22e758bdb5d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:57.516718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-28ab5ede-f2c0-4a04-bbfb-e22e758bdb5d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:57.535467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28ab5ede-f2c0-4a04-bbfb-e22e758bdb5d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.535967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28ab5ede-f2c0-4a04-bbfb-e22e758bdb5d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.536646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28ab5ede-f2c0-4a04-bbfb-e22e758bdb5d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.537417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28ab5ede-f2c0-4a04-bbfb-e22e758bdb5d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.537778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28ab5ede-f2c0-4a04-bbfb-e22e758bdb5d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.538464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28ab5ede-f2c0-4a04-bbfb-e22e758bdb5d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.969536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-28ab5ede-f2c0-4a04-bbfb-e22e758bdb5d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:57.981155 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-28ab5ede-f2c0-4a04-bbfb-e22e758bdb5d tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1466 microversion: 2.1 time: 0.476870 Oct 29 02:48:57.981747 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 503/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:57 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1466 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:57.988403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82976bcf-a9c8-47a6-ab4e-4ec1a121feb3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:57.989270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-82976bcf-a9c8-47a6-ab4e-4ec1a121feb3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:57.996200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82976bcf-a9c8-47a6-ab4e-4ec1a121feb3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.996683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82976bcf-a9c8-47a6-ab4e-4ec1a121feb3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.997113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82976bcf-a9c8-47a6-ab4e-4ec1a121feb3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.997843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82976bcf-a9c8-47a6-ab4e-4ec1a121feb3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.998471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82976bcf-a9c8-47a6-ab4e-4ec1a121feb3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.998889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82976bcf-a9c8-47a6-ab4e-4ec1a121feb3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.196636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-82976bcf-a9c8-47a6-ab4e-4ec1a121feb3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:58.204902 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-82976bcf-a9c8-47a6-ab4e-4ec1a121feb3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.221544 Oct 29 02:48:58.205727 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 504/1043] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:57 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:58.210943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a983e383-e490-4072-aed7-51b678b570f7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:58.211564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a983e383-e490-4072-aed7-51b678b570f7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:58.218383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a983e383-e490-4072-aed7-51b678b570f7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.219502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a983e383-e490-4072-aed7-51b678b570f7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.220107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a983e383-e490-4072-aed7-51b678b570f7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.221114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a983e383-e490-4072-aed7-51b678b570f7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.221556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a983e383-e490-4072-aed7-51b678b570f7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.222030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a983e383-e490-4072-aed7-51b678b570f7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.426805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a983e383-e490-4072-aed7-51b678b570f7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:58.435830 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a983e383-e490-4072-aed7-51b678b570f7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1475 microversion: 2.1 time: 0.228885 Oct 29 02:48:58.436420 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 505/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:58 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1475 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:58.482549 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0962e77b-87ae-4fe2-a255-df8ba6bb19f8 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d/action" status: 202 len: 0 microversion: 2.25 time: 2.614412 Oct 29 02:48:58.488584 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 540/1045] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:48:55 2022] POST /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d/action => generated 0 bytes in 2621 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:58.495654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c94cabae-a31e-4647-89d4-e9e459a927ad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a874a9d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:58.590230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd99f085-f9c4-4a19-9eee-30f3a25b71b8 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1046186320", "id": 920200443, "os-flavor-access:is_public": "True"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:58.612878 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd99f085-f9c4-4a19-9eee-30f3a25b71b8 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.175209 Oct 29 02:48:58.614252 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 506/1046] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:58 2022] POST /compute/v2.1/flavors => generated 427 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:58.618517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1b852638-bee2-45a1-a0eb-c7eb16fa1d65 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:58.619339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b852638-bee2-45a1-a0eb-c7eb16fa1d65 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:58.628459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b852638-bee2-45a1-a0eb-c7eb16fa1d65 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.628962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b852638-bee2-45a1-a0eb-c7eb16fa1d65 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.629391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b852638-bee2-45a1-a0eb-c7eb16fa1d65 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.630130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b852638-bee2-45a1-a0eb-c7eb16fa1d65 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.630757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b852638-bee2-45a1-a0eb-c7eb16fa1d65 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.631337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b852638-bee2-45a1-a0eb-c7eb16fa1d65 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.719211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b852638-bee2-45a1-a0eb-c7eb16fa1d65 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:58.728896 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1b852638-bee2-45a1-a0eb-c7eb16fa1d65 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1614 microversion: 2.1 time: 0.113941 Oct 29 02:48:58.731030 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 507/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:58 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1614 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:58.736303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:58.737156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:58.743484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.744330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.744982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.746194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.746849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.747462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.834262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:58.844937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:58.850578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:58.864389 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6e9d1b15-7d05-4090-8ab5-40b59d95b53a tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1560 microversion: 2.91 time: 0.131636 Oct 29 02:48:58.870895 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 508/1048] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:58 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1560 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:58.877234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:58.885825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:58.898091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.899273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.899872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.901560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.903112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.904816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.291852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:59.304479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:59.306360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:59.307957 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-249be2d5-21a6-4f93-ad79-096ccbc2a342 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.434576 Oct 29 02:48:59.309127 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 509/1049] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:58 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:59.314780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-afa4ee26-6807-4db8-979b-d34982a68316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:59.315563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-afa4ee26-6807-4db8-979b-d34982a68316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:59.332680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa4ee26-6807-4db8-979b-d34982a68316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.338954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa4ee26-6807-4db8-979b-d34982a68316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.339750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa4ee26-6807-4db8-979b-d34982a68316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.343004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa4ee26-6807-4db8-979b-d34982a68316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.344274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa4ee26-6807-4db8-979b-d34982a68316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.345271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa4ee26-6807-4db8-979b-d34982a68316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.444776 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c94cabae-a31e-4647-89d4-e9e459a927ad tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "DELETE /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd" status: 204 len: 0 microversion: 2.1 time: 0.954605 Oct 29 02:48:59.447033 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 541/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:58 2022] DELETE /compute/v2.1/images/11cce4cc-2eff-4e59-9929-4857090b15fd => generated 0 bytes in 958 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:59.456543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9b7b237f-acc8-4c85-b9e9-d7836e3f2d2f tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:59.484848 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9b7b237f-acc8-4c85-b9e9-d7836e3f2d2f tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/920200443" status: 202 len: 0 microversion: 2.1 time: 0.036122 Oct 29 02:48:59.486766 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 542/1051] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:48:59 2022] DELETE /compute/v2.1/flavors/920200443 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:48:59.493149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-051d422b-e6ba-4129-9f76-da654cc79004 req-5d085fac-83a9-4e9b-bf38-990593d701c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc4c73c4-725e-415c-a814-c828ec74c554", "name": "network-vif-deleted", "tag": "e3e2ab26-126a-4fda-998d-3c38435343e3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:59.505247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-051d422b-e6ba-4129-9f76-da654cc79004 req-5d085fac-83a9-4e9b-bf38-990593d701c8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.506061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-051d422b-e6ba-4129-9f76-da654cc79004 req-5d085fac-83a9-4e9b-bf38-990593d701c8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.506563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-051d422b-e6ba-4129-9f76-da654cc79004 req-5d085fac-83a9-4e9b-bf38-990593d701c8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.520651 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-051d422b-e6ba-4129-9f76-da654cc79004 req-5d085fac-83a9-4e9b-bf38-990593d701c8 service nova] Creating event network-vif-deleted:e3e2ab26-126a-4fda-998d-3c38435343e3 for instance bc4c73c4-725e-415c-a814-c828ec74c554 on n-h1-862964-4 Oct 29 02:48:59.534547 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-051d422b-e6ba-4129-9f76-da654cc79004 req-5d085fac-83a9-4e9b-bf38-990593d701c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045805 Oct 29 02:48:59.536671 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 543/1052] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:59.574850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cc882660-7a58-4357-8400-2b4705c74cf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:59.576039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cc882660-7a58-4357-8400-2b4705c74cf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:59.595796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc882660-7a58-4357-8400-2b4705c74cf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.596523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc882660-7a58-4357-8400-2b4705c74cf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.597183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc882660-7a58-4357-8400-2b4705c74cf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.598164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc882660-7a58-4357-8400-2b4705c74cf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.599071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc882660-7a58-4357-8400-2b4705c74cf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.599705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc882660-7a58-4357-8400-2b4705c74cf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.651870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-afa4ee26-6807-4db8-979b-d34982a68316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:59.665664 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-afa4ee26-6807-4db8-979b-d34982a68316 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1317 microversion: 2.1 time: 0.354499 Oct 29 02:48:59.666349 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 510/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:59 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:59.687135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-de3ce0ac-0485-4e33-a6c9-1f7e766eb579 req-573a4a0a-2936-47e9-bacd-30351ed70aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39", "name": "network-vif-unplugged", "status": "completed", "tag": "2aee52dc-63e0-47de-821b-34b98b339294"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:59.699758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-de3ce0ac-0485-4e33-a6c9-1f7e766eb579 req-573a4a0a-2936-47e9-bacd-30351ed70aa5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.700517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-de3ce0ac-0485-4e33-a6c9-1f7e766eb579 req-573a4a0a-2936-47e9-bacd-30351ed70aa5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.701112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-de3ce0ac-0485-4e33-a6c9-1f7e766eb579 req-573a4a0a-2936-47e9-bacd-30351ed70aa5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.719440 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-de3ce0ac-0485-4e33-a6c9-1f7e766eb579 req-573a4a0a-2936-47e9-bacd-30351ed70aa5 service nova] Creating event network-vif-unplugged:2aee52dc-63e0-47de-821b-34b98b339294 for instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 on n-h1-862964-4 Oct 29 02:48:59.729856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-de3ce0ac-0485-4e33-a6c9-1f7e766eb579 req-573a4a0a-2936-47e9-bacd-30351ed70aa5 service nova] Instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:48:59.738294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-de3ce0ac-0485-4e33-a6c9-1f7e766eb579 req-573a4a0a-2936-47e9-bacd-30351ed70aa5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058388 Oct 29 02:48:59.744528 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 511/1054] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:59.752664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2a055c1-1a72-4a8c-86b2-dd2224258f96 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '.version_select at 0x7fe1a8aaa040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:59.815149 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f2a055c1-1a72-4a8c-86b2-dd2224258f96 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] HTTP exception thrown: Image not found. Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2a055c1-1a72-4a8c-86b2-dd2224258f96 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Request method failure captured: Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 HTTP/1.1 Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJRCJ6pmgMrk3OGaaT0WEwtmijKRoZz8NMQuW4fU_VbUWw5-vq19ILq5I0R6A1mA32JNQQ5XHvAKW7yLesjBFzDA39Br5e5jaGha66RQZ6SsDJFAHrmf7K1-OZ5eTlEbMegf0YcvJ2uZiAhDec7mpyaevintm5jmBrq1DuH9--wsyWU Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4ba4b121877b458092bfd5cadec5aa3d Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesOneServerTestJSON-2084405278 Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:48:59.820791 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4ba4b121877b458092bfd5cadec5aa3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ba4b121877b458092bfd5cadec5aa3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4ba4b121877b458092bfd5cadec5aa3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ba4b121877b458092bfd5cadec5aa3d"}]}] Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesOneServerTestJSON-2084405278 Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4ba4b121877b458092bfd5cadec5aa3d Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2084405278 Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesOneServerTestJSON-2084405278-project Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 68cdeea2722e49e09ccf0b4f892906d4 Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesOneServerTestJSON-2084405278-project Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '4d56b996-fb21-4530-b4f3-90868dbb2072'} Oct 29 02:48:59.822301 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4d56b996-fb21-4530-b4f3-90868dbb2072 to delete Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:59.823120 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4d56b996-fb21-4530-b4f3-90868dbb2072 could not be found. Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:59.825286 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:48:59.827515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:48:59.831711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2a055c1-1a72-4a8c-86b2-dd2224258f96 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:59.833122 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f2a055c1-1a72-4a8c-86b2-dd2224258f96 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "DELETE /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072" status: 404 len: 62 microversion: 2.1 time: 0.086562 Oct 29 02:48:59.833997 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 512/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:59 2022] DELETE /compute/v2.1/images/4d56b996-fb21-4530-b4f3-90868dbb2072 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:48:59.841342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94ea230a-a684-4bac-a94b-89764b485e7f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:59.842363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-94ea230a-a684-4bac-a94b-89764b485e7f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:59.849794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ea230a-a684-4bac-a94b-89764b485e7f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.852047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ea230a-a684-4bac-a94b-89764b485e7f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.852760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ea230a-a684-4bac-a94b-89764b485e7f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.853744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ea230a-a684-4bac-a94b-89764b485e7f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.854406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ea230a-a684-4bac-a94b-89764b485e7f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.855053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ea230a-a684-4bac-a94b-89764b485e7f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.891914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc882660-7a58-4357-8400-2b4705c74cf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:59.906356 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cc882660-7a58-4357-8400-2b4705c74cf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.363718 Oct 29 02:48:59.907930 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 544/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:59 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:59.914884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7dcadd59-fcf2-407e-856c-2a1b83b6b950 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:59.947397 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7dcadd59-fcf2-407e-856c-2a1b83b6b950 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037965 Oct 29 02:48:59.948592 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 545/1057] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:48:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:59.953611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:59.954457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:59.972450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.972953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.973383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.974136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.975214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.975745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.003244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:00.028748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.029450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.030058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.030814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lazy-loading 'fault' on Instance uuid bc4c73c4-725e-415c-a814-c828ec74c554 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:00.089418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-94ea230a-a684-4bac-a94b-89764b485e7f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:00.099837 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-94ea230a-a684-4bac-a94b-89764b485e7f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1475 microversion: 2.1 time: 0.262618 Oct 29 02:49:00.105349 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 513/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:59 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1475 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:00.114200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-11be418a-4e02-40b6-9c64-69b7489252fd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.116538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-11be418a-4e02-40b6-9c64-69b7489252fd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:00.121546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:00.131757 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-90e7bedc-37f0-412f-9010-04255b88a593 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1330 microversion: 2.1 time: 0.181878 Oct 29 02:49:00.132396 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 546/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:59 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1330 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:00.136950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11be418a-4e02-40b6-9c64-69b7489252fd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.137538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11be418a-4e02-40b6-9c64-69b7489252fd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.138103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11be418a-4e02-40b6-9c64-69b7489252fd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.138903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11be418a-4e02-40b6-9c64-69b7489252fd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.139458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11be418a-4e02-40b6-9c64-69b7489252fd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.140004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11be418a-4e02-40b6-9c64-69b7489252fd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.143621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.146942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:00.161408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.162002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.162440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.163220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.163796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.164223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.172693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-11be418a-4e02-40b6-9c64-69b7489252fd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:00.252961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:00.266173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:00.268217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:00.275434 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e749f7bd-e5ab-4e01-a0b5-151f335cd4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.136763 Oct 29 02:49:00.276467 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 547/1060] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:00 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:00.286448 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-11be418a-4e02-40b6-9c64-69b7489252fd tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 204 len: 0 microversion: 2.1 time: 0.179368 Oct 29 02:49:00.290023 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 514/1061] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:00 2022] DELETE /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:00.294274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e90f5a7d-bbdf-42a7-bbd2-8e4a1d1978a8 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-43165222", "id": 357407699, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:00.296976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b9ca214-117b-4162-ade1-d2cfe0fb9971 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.297676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b9ca214-117b-4162-ade1-d2cfe0fb9971 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:00.306130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9ca214-117b-4162-ade1-d2cfe0fb9971 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.306629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9ca214-117b-4162-ade1-d2cfe0fb9971 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.307052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9ca214-117b-4162-ade1-d2cfe0fb9971 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.307762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9ca214-117b-4162-ade1-d2cfe0fb9971 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.308209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9ca214-117b-4162-ade1-d2cfe0fb9971 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.308676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9ca214-117b-4162-ade1-d2cfe0fb9971 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.329644 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e90f5a7d-bbdf-42a7-bbd2-8e4a1d1978a8 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.051647 Oct 29 02:49:00.330587 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 548/1062] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:00 2022] POST /compute/v2.1/flavors => generated 412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:00.340997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.341980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:00.351633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.352491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.353110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.354553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.355360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.355787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.542256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9b9ca214-117b-4162-ade1-d2cfe0fb9971 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:00.555599 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b9ca214-117b-4162-ade1-d2cfe0fb9971 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1472 microversion: 2.1 time: 0.263092 Oct 29 02:49:00.560329 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 515/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:00 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:00.567212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:00.580043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-04c530c3-5d8b-4d65-b413-ca810bc481d4 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.583354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:00.585516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:00.587869 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5daa80c3-a4da-47c9-8b0c-afd55df83751 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.252765 Oct 29 02:49:00.589158 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 549/1064] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:00 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:00.627138 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-04c530c3-5d8b-4d65-b413-ca810bc481d4 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.051998 Oct 29 02:49:00.628519 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 516/1065] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:00 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:00.654636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d37b4180-fc48-4f43-b0c5-9450266b12c0 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.682649 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d37b4180-fc48-4f43-b0c5-9450266b12c0 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/357407699" status: 202 len: 0 microversion: 2.1 time: 0.032071 Oct 29 02:49:00.682649 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 550/1066] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:49:00 2022] DELETE /compute/v2.1/flavors/357407699 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:00.691877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a49560df-a1a2-4cba-9fb7-cacad54b8049 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.714265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0a94c3cb-43bd-4539-b2f9-d56a0d41a5c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.714940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0a94c3cb-43bd-4539-b2f9-d56a0d41a5c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:00.748729 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a49560df-a1a2-4cba-9fb7-cacad54b8049 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060525 Oct 29 02:49:00.749538 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 517/1067] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:00.751455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a94c3cb-43bd-4539-b2f9-d56a0d41a5c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.751951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a94c3cb-43bd-4539-b2f9-d56a0d41a5c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.752441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a94c3cb-43bd-4539-b2f9-d56a0d41a5c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.753096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a94c3cb-43bd-4539-b2f9-d56a0d41a5c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.753545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a94c3cb-43bd-4539-b2f9-d56a0d41a5c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.766392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a94c3cb-43bd-4539-b2f9-d56a0d41a5c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.777513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-349a1c63-13f7-45e7-b04c-e67553580a70 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-182768248", "id": 1368156252, "os-flavor-access:is_public": "True"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:00.814193 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-349a1c63-13f7-45e7-b04c-e67553580a70 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.042961 Oct 29 02:49:00.816496 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 518/1068] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:00 2022] POST /compute/v2.1/flavors => generated 428 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:00.828061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be225d52-64c5-4b53-a780-a0783018ebe6 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.884802 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be225d52-64c5-4b53-a780-a0783018ebe6 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1368156252" status: 202 len: 0 microversion: 2.1 time: 0.060396 Oct 29 02:49:00.885792 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 519/1069] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:49:00 2022] DELETE /compute/v2.1/flavors/1368156252 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:00.893631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-329ce6c0-b639-4f10-9ec1-11fc8843f7ba tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.920697 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-329ce6c0-b639-4f10-9ec1-11fc8843f7ba tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030814 Oct 29 02:49:00.921310 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 520/1070] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:00.936105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e29d1235-109c-4f03-9179-45257c757d96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.939065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e29d1235-109c-4f03-9179-45257c757d96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:00.956453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29d1235-109c-4f03-9179-45257c757d96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.956953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29d1235-109c-4f03-9179-45257c757d96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.957387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29d1235-109c-4f03-9179-45257c757d96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.958127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29d1235-109c-4f03-9179-45257c757d96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.959188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29d1235-109c-4f03-9179-45257c757d96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.959621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29d1235-109c-4f03-9179-45257c757d96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.024657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0a94c3cb-43bd-4539-b2f9-d56a0d41a5c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.037922 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0a94c3cb-43bd-4539-b2f9-d56a0d41a5c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1466 microversion: 2.1 time: 0.338486 Oct 29 02:49:01.038626 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 551/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:00 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1466 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:01.044995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a12da54-7a88-45c4-8586-4a4421212c1c tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1454993031", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:01.095134 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a12da54-7a88-45c4-8586-4a4421212c1c tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.055378 Oct 29 02:49:01.095739 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 552/1072] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:01 2022] POST /compute/v2.1/flavors => generated 507 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:01.109780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b2a0b045-6c38-4e2f-9d3e-fc04ce95094f tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:01.110649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b2a0b045-6c38-4e2f-9d3e-fc04ce95094f tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:01.130365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a0b045-6c38-4e2f-9d3e-fc04ce95094f tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.130874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a0b045-6c38-4e2f-9d3e-fc04ce95094f tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.133467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a0b045-6c38-4e2f-9d3e-fc04ce95094f tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.134886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a0b045-6c38-4e2f-9d3e-fc04ce95094f tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.135505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a0b045-6c38-4e2f-9d3e-fc04ce95094f tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.139409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a0b045-6c38-4e2f-9d3e-fc04ce95094f tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.164694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e29d1235-109c-4f03-9179-45257c757d96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.174611 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e29d1235-109c-4f03-9179-45257c757d96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.242711 Oct 29 02:49:01.175907 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 521/1073] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:00 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:01.181389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c45cab08-28eb-46ef-a5b7-d049129408a9 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:01.213486 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c45cab08-28eb-46ef-a5b7-d049129408a9 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/5e1c9b1a-2fb5-47ed-a509-79111cca987b" status: 202 len: 0 microversion: 2.1 time: 0.034942 Oct 29 02:49:01.215562 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 522/1074] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:01 2022] DELETE /compute/v2.1/flavors/5e1c9b1a-2fb5-47ed-a509-79111cca987b => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:01.234398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-71b1e790-b407-4343-98e4-3d0820434c18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:01.236003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-71b1e790-b407-4343-98e4-3d0820434c18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:01.246993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71b1e790-b407-4343-98e4-3d0820434c18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.247491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71b1e790-b407-4343-98e4-3d0820434c18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.247912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71b1e790-b407-4343-98e4-3d0820434c18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.253992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71b1e790-b407-4343-98e4-3d0820434c18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.254749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71b1e790-b407-4343-98e4-3d0820434c18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.255348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71b1e790-b407-4343-98e4-3d0820434c18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.443844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-71b1e790-b407-4343-98e4-3d0820434c18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.456994 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-71b1e790-b407-4343-98e4-3d0820434c18 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1473 microversion: 2.1 time: 0.233579 Oct 29 02:49:01.457589 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 523/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:01 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1473 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:01.467997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:01.468871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:01.479693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.480470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.481335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.482271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.482915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.483511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.519826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:01.522703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.523403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.523838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.524438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lazy-loading 'fault' on Instance uuid bc4c73c4-725e-415c-a814-c828ec74c554 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:01.527695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:01.597321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.614362 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-91e02a5e-c7be-44dc-80b2-c1ef8fc95568 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1330 microversion: 2.1 time: 0.155658 Oct 29 02:49:01.618607 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 524/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:01 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1330 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:01.619835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7cdc8875-8ce1-42ea-916d-ca236e0044e8 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:01.641735 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7cdc8875-8ce1-42ea-916d-ca236e0044e8 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025375 Oct 29 02:49:01.642382 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 525/1077] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:01.646929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:01.647521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:01.654123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.654607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.655035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.655727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.656173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.656582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.670186 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b2a0b045-6c38-4e2f-9d3e-fc04ce95094f tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1617 microversion: 2.1 time: 0.570968 Oct 29 02:49:01.686719 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 553/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:01 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1617 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:01.704108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cf323cb0-6bdb-4492-aa30-a6fff55366a5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:01.705494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cf323cb0-6bdb-4492-aa30-a6fff55366a5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:01.715613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf323cb0-6bdb-4492-aa30-a6fff55366a5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.716426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf323cb0-6bdb-4492-aa30-a6fff55366a5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.717030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf323cb0-6bdb-4492-aa30-a6fff55366a5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.718042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf323cb0-6bdb-4492-aa30-a6fff55366a5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.718650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf323cb0-6bdb-4492-aa30-a6fff55366a5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.719334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf323cb0-6bdb-4492-aa30-a6fff55366a5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.729754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.738662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.740236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.747447 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-820524f5-747d-4bd0-9ae4-13958e5c51a0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.104049 Oct 29 02:49:01.748348 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 526/1079] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:01 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:01.757881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-7563ce84-6986-478c-90cb-38ad8399f61d req-22101196-bda4-45b8-818f-d97136f0a463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22e9e45-c266-455e-8aff-da1aed5519ab", "name": "network-vif-unplugged", "status": "completed", "tag": "675d097b-03fe-4cf0-9756-d0e175fce642"}, {"name": "network-changed", "server_uuid": "e22e9e45-c266-455e-8aff-da1aed5519ab", "tag": "675d097b-03fe-4cf0-9756-d0e175fce642"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:01.780353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7563ce84-6986-478c-90cb-38ad8399f61d req-22101196-bda4-45b8-818f-d97136f0a463 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.781049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7563ce84-6986-478c-90cb-38ad8399f61d req-22101196-bda4-45b8-818f-d97136f0a463 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.781479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7563ce84-6986-478c-90cb-38ad8399f61d req-22101196-bda4-45b8-818f-d97136f0a463 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.793775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-7563ce84-6986-478c-90cb-38ad8399f61d req-22101196-bda4-45b8-818f-d97136f0a463 service nova] Creating event network-vif-unplugged:675d097b-03fe-4cf0-9756-d0e175fce642 for instance e22e9e45-c266-455e-8aff-da1aed5519ab on n-h2-862964-4 Oct 29 02:49:01.794311 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-7563ce84-6986-478c-90cb-38ad8399f61d req-22101196-bda4-45b8-818f-d97136f0a463 service nova] Creating event network-changed:675d097b-03fe-4cf0-9756-d0e175fce642 for instance e22e9e45-c266-455e-8aff-da1aed5519ab on n-h2-862964-4 Oct 29 02:49:01.799602 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-7563ce84-6986-478c-90cb-38ad8399f61d req-22101196-bda4-45b8-818f-d97136f0a463 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.049881 Oct 29 02:49:01.804077 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 527/1080] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:01.813172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:01.814790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:01.826400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.826889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.827316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.828259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.828751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.829258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.897960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cf323cb0-6bdb-4492-aa30-a6fff55366a5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.906863 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cf323cb0-6bdb-4492-aa30-a6fff55366a5 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1472 microversion: 2.1 time: 0.218323 Oct 29 02:49:01.920683 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 554/1081] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:01 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:01.928332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-732af1e1-2326-467b-8fa0-ab2be04595de tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-593856751", "id": "34d77a90-1895-4695-af55-752c7cc62e71", "os-flavor-access:is_public": "True"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:01.960813 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-732af1e1-2326-467b-8fa0-ab2be04595de tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.036232 Oct 29 02:49:01.961444 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 555/1082] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:01 2022] POST /compute/v2.1/flavors => generated 506 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:01.966407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-72a1ec52-5f17-44e7-9374-b14b5380d2e0 req-b12b5996-80fd-4d4f-a3be-fac7c3e206b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17fee50-82f1-461d-9889-b0f25961ae1b", "name": "network-vif-unplugged", "status": "completed", "tag": "37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:01.976564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-72a1ec52-5f17-44e7-9374-b14b5380d2e0 req-b12b5996-80fd-4d4f-a3be-fac7c3e206b3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.977679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-72a1ec52-5f17-44e7-9374-b14b5380d2e0 req-b12b5996-80fd-4d4f-a3be-fac7c3e206b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.978155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-72a1ec52-5f17-44e7-9374-b14b5380d2e0 req-b12b5996-80fd-4d4f-a3be-fac7c3e206b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.990561 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-72a1ec52-5f17-44e7-9374-b14b5380d2e0 req-b12b5996-80fd-4d4f-a3be-fac7c3e206b3 service nova] Creating event network-vif-unplugged:37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1 for instance a17fee50-82f1-461d-9889-b0f25961ae1b on n-h1-862964-4 Oct 29 02:49:01.996898 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-72a1ec52-5f17-44e7-9374-b14b5380d2e0 req-b12b5996-80fd-4d4f-a3be-fac7c3e206b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033731 Oct 29 02:49:01.997576 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 556/1083] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:02.004220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-930836923", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:02.029978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:02.039806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:02.043344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:02.044759 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b7bedbf9-2891-4c13-b713-b5f39643bb36 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.238278 Oct 29 02:49:02.045830 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 528/1084] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:01 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:02.065311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0468f9a0-40d8-4b81-b691-114dbdbad4f4 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:02.088407 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0468f9a0-40d8-4b81-b691-114dbdbad4f4 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/34d77a90-1895-4695-af55-752c7cc62e71" status: 202 len: 0 microversion: 2.1 time: 0.041138 Oct 29 02:49:02.089374 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 529/1085] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:02 2022] DELETE /compute/v2.1/flavors/34d77a90-1895-4695-af55-752c7cc62e71 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:02.097754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:49:02.099508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94b59cda-9ea7-4e36-8924-aef52f2150db tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:02.147019 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-94b59cda-9ea7-4e36-8924-aef52f2150db tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053090 Oct 29 02:49:02.151375 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 530/1086] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:02.170908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0080d4c0-eb9f-4f25-8ff4-a1875111a4cd tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-409101328", "id": 1426939101, "os-flavor-access:is_public": "True"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:02.192429 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0080d4c0-eb9f-4f25-8ff4-a1875111a4cd tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.028352 Oct 29 02:49:02.193466 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 531/1087] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:02 2022] POST /compute/v2.1/flavors => generated 413 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:49:02.206274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1fdf47e8-7aac-49e1-bdfb-777e5121eddc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:02.207203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1fdf47e8-7aac-49e1-bdfb-777e5121eddc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:02.214143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1fdf47e8-7aac-49e1-bdfb-777e5121eddc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.214903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1fdf47e8-7aac-49e1-bdfb-777e5121eddc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.215538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1fdf47e8-7aac-49e1-bdfb-777e5121eddc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.216248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1fdf47e8-7aac-49e1-bdfb-777e5121eddc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.216692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1fdf47e8-7aac-49e1-bdfb-777e5121eddc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.217132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1fdf47e8-7aac-49e1-bdfb-777e5121eddc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.447071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:02.447612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:02.448145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:02.448624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:02.449097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:02.458817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.459381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.459896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.460744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.461415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.461935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.473027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1fdf47e8-7aac-49e1-bdfb-777e5121eddc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:02.484151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:02.488466 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1fdf47e8-7aac-49e1-bdfb-777e5121eddc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.289158 Oct 29 02:49:02.506239 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 532/1088] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:02 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:02.506443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Getting quotas for user fa30f68a081646d6b452d1cdf6e0181c and project 1031cc111cc747098bbc8a428c1cfad6. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:02.506534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-286162e2-f1d7-4620-98cb-38a9227f5223 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:02.506534 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-286162e2-f1d7-4620-98cb-38a9227f5223 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1426939101" status: 200 len: 413 microversion: 2.1 time: 0.011155 Oct 29 02:49:02.521376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:49:02.522323 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 533/1089] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:49:02 2022] GET /compute/v2.1/flavors/1426939101 => generated 413 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:02.524128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:49:02.535095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-30e1706d-9a6e-48c8-b6d1-4ef3ca39a28a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:02.536297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-30e1706d-9a6e-48c8-b6d1-4ef3ca39a28a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:02.555632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30e1706d-9a6e-48c8-b6d1-4ef3ca39a28a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.556124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30e1706d-9a6e-48c8-b6d1-4ef3ca39a28a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.556559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30e1706d-9a6e-48c8-b6d1-4ef3ca39a28a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.557266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30e1706d-9a6e-48c8-b6d1-4ef3ca39a28a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.557715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30e1706d-9a6e-48c8-b6d1-4ef3ca39a28a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.558159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30e1706d-9a6e-48c8-b6d1-4ef3ca39a28a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.582387 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e5bb76b0-7ac1-48f0-9890-b93f2a17f848 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583295 Oct 29 02:49:02.583207 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 557/1090] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:49:02.783075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-91b32182-8dc9-4193-8876-28896a46d3e2 tempest-FlavorsAdminTestJSON-2019643932 tempest-FlavorsAdminTestJSON-2019643932-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:02.812256 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-91b32182-8dc9-4193-8876-28896a46d3e2 tempest-FlavorsAdminTestJSON-2019643932 tempest-FlavorsAdminTestJSON-2019643932-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.228131 Oct 29 02:49:02.813167 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 558/1091] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:02 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:02.817983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1f28b73b-23e6-4c18-9442-2d68fe1179c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:02.818588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1f28b73b-23e6-4c18-9442-2d68fe1179c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:02.883618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1f28b73b-23e6-4c18-9442-2d68fe1179c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:02.892201 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1f28b73b-23e6-4c18-9442-2d68fe1179c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1216 microversion: 2.1 time: 0.077870 Oct 29 02:49:02.893526 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 559/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:02 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1216 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:02.898425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:02.899346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:02.908325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.909233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.910503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.911548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.912320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.913042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.967054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-30e1706d-9a6e-48c8-b6d1-4ef3ca39a28a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:02.977521 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-30e1706d-9a6e-48c8-b6d1-4ef3ca39a28a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1473 microversion: 2.1 time: 0.454006 Oct 29 02:49:02.990583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.993277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.995388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.997360 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 534/1093] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:02 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1473 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:02.998288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lazy-loading 'fault' on Instance uuid bc4c73c4-725e-415c-a814-c828ec74c554 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:03.002280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.002887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:03.018234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.018723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.019149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.019847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.020284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.020706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.092552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.102856 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cd07d421-4696-4818-9d76-3ebf334d0a84 tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1330 microversion: 2.1 time: 0.208247 Oct 29 02:49:03.103783 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 560/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:02 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1330 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:03.108859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a98b245a-951a-4af3-bc6c-b2f669fab9ef tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.131133 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a98b245a-951a-4af3-bc6c-b2f669fab9ef tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1426939101" status: 202 len: 0 microversion: 2.1 time: 0.025598 Oct 29 02:49:03.133196 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 561/1095] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:49:03 2022] DELETE /compute/v2.1/flavors/1426939101 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:03.140086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5f993e9a-7014-44c0-8fec-d1cbb93cfb07 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.141085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5f993e9a-7014-44c0-8fec-d1cbb93cfb07 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:03.159914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f993e9a-7014-44c0-8fec-d1cbb93cfb07 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.160784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f993e9a-7014-44c0-8fec-d1cbb93cfb07 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.161555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f993e9a-7014-44c0-8fec-d1cbb93cfb07 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.164645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f993e9a-7014-44c0-8fec-d1cbb93cfb07 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.170367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f993e9a-7014-44c0-8fec-d1cbb93cfb07 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.170974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f993e9a-7014-44c0-8fec-d1cbb93cfb07 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.214340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.223455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.229054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.234859 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ca1a5a4e-2d30-4c8a-b75d-c944a19f116e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.236356 Oct 29 02:49:03.250373 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 535/1096] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:02 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:03.261462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.262405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:03.271805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.272735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.273354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.274820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.275451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.276101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.459037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5f993e9a-7014-44c0-8fec-d1cbb93cfb07 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.468627 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5f993e9a-7014-44c0-8fec-d1cbb93cfb07 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1472 microversion: 2.1 time: 0.334108 Oct 29 02:49:03.469216 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 562/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:03.486560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0aeba65e-fb76-4010-a996-3cafd80d02e9 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.520616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.531316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.532708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.534358 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-81246473-909b-4ee4-aabf-9545d3430f12 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.282595 Oct 29 02:49:03.535440 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 536/1098] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:03.540176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7ff67a0-eca8-443d-a804-c79f7d60380d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.540770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7ff67a0-eca8-443d-a804-c79f7d60380d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:03.544207 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0aeba65e-fb76-4010-a996-3cafd80d02e9 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072315 Oct 29 02:49:03.549709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7ff67a0-eca8-443d-a804-c79f7d60380d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.550261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7ff67a0-eca8-443d-a804-c79f7d60380d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.565379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7ff67a0-eca8-443d-a804-c79f7d60380d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.565997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7ff67a0-eca8-443d-a804-c79f7d60380d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.566467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7ff67a0-eca8-443d-a804-c79f7d60380d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.566893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7ff67a0-eca8-443d-a804-c79f7d60380d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.567051 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 563/1099] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:03.584319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cb36f211-186f-4b74-95c2-5e796162f651 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1523846995", "id": 358373081, "os-flavor-access:is_public": "False"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:03.603602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:03.617958 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cb36f211-186f-4b74-95c2-5e796162f651 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.047738 Oct 29 02:49:03.626821 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 564/1100] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:03 2022] POST /compute/v2.1/flavors => generated 427 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:03.632637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e92b94a5-0e41-4293-baec-379451833da1 tempest-FlavorsAdminTestJSON-2019643932 tempest-FlavorsAdminTestJSON-2019643932-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "358373081"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:03.646576 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-e92b94a5-0e41-4293-baec-379451833da1 tempest-FlavorsAdminTestJSON-2019643932 tempest-FlavorsAdminTestJSON-2019643932-project] HTTP exception thrown: Flavor 358373081 could not be found. Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e92b94a5-0e41-4293-baec-379451833da1 tempest-FlavorsAdminTestJSON-2019643932 tempest-FlavorsAdminTestJSON-2019643932-project] Request method failure captured: Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 106 Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJSY-QpEnV06z9dMWxF5O5-tTtMq178cDxycTcQB7LdmRV17pnD2NdGdn3DndjWGsR9a-1GYyU-6OjKmuYqynd4DH209GX7bMbbYKKb90hTtOyv0v7wvcfIcSckor5Z5JHWE5ZUygKq3x5uthkpaafmR297_VHrH9KQGMiPLLubUyho Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6e76aef622b647aebc0b203d42990b6d Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FlavorsAdminTestJSON-2019643932 Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:03.650231 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e76aef622b647aebc0b203d42990b6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e76aef622b647aebc0b203d42990b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e76aef622b647aebc0b203d42990b6d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e76aef622b647aebc0b203d42990b6d"}]}] Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FlavorsAdminTestJSON-2019643932 Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6e76aef622b647aebc0b203d42990b6d Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2019643932 Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FlavorsAdminTestJSON-2019643932-project Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 35a63b52bc4944b68dbfc96908d1dbf8 Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FlavorsAdminTestJSON-2019643932-project Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: {"server": {"name": "test", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "358373081"}} Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:49:03.651791 n-d-862964-4 devstack@n-api.service[127041]: exception: Flavor 358373081 could not be found. Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '358373081'}}} Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 358373081 could not be found. Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:03.652711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 358373081 could not be found. Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:03.653920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:03.655136 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:03.655136 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:03.655136 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:03.655136 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 358373081 could not be found. Oct 29 02:49:03.655136 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:03.655136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e92b94a5-0e41-4293-baec-379451833da1 tempest-FlavorsAdminTestJSON-2019643932 tempest-FlavorsAdminTestJSON-2019643932-project] Returning 400 to user: Flavor 358373081 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:03.655136 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e92b94a5-0e41-4293-baec-379451833da1 tempest-FlavorsAdminTestJSON-2019643932 tempest-FlavorsAdminTestJSON-2019643932-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.023846 Oct 29 02:49:03.656217 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 565/1101] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:03 2022] POST /compute/v2.1/servers => generated 80 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:03.661188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c0b3dd69-7d7b-47c1-9cb9-c222289793ae tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.684629 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c0b3dd69-7d7b-47c1-9cb9-c222289793ae tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/358373081" status: 202 len: 0 microversion: 2.1 time: 0.027513 Oct 29 02:49:03.688822 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 566/1102] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:49:03 2022] DELETE /compute/v2.1/flavors/358373081 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:03.693902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-553507c2-3da4-49c5-9472-ea47f2178f26 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.721758 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-553507c2-3da4-49c5-9472-ea47f2178f26 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031656 Oct 29 02:49:03.722394 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 567/1103] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:03.750446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-68e8b098-efde-4d60-8dfd-b61ff7a3cf4b tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2105881415", "id": 116042944, "os-flavor-access:is_public": "False"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:03.777359 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-68e8b098-efde-4d60-8dfd-b61ff7a3cf4b tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.037959 Oct 29 02:49:03.786541 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 568/1104] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:03 2022] POST /compute/v2.1/flavors => generated 412 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:03.798808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bdf71797-fa3c-4b97-b479-7618a3e2cee9 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1304443901", "id": 1467923551, "os-flavor-access:is_public": "True"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:03.820334 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bdf71797-fa3c-4b97-b479-7618a3e2cee9 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.026195 Oct 29 02:49:03.821264 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 569/1105] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:03 2022] POST /compute/v2.1/flavors => generated 414 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:03.834223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7fe0ac77-c60b-4fbc-bcd8-617a3b595ff0 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.849774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a7ff67a0-eca8-443d-a804-c79f7d60380d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.861312 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7fe0ac77-c60b-4fbc-bcd8-617a3b595ff0 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.031236 Oct 29 02:49:03.863022 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7ff67a0-eca8-443d-a804-c79f7d60380d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.326465 Oct 29 02:49:03.879923 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 537/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:03.880285 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 570/1107] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:03.881323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e443e0c-403f-41fb-98c0-75ca66612588 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.925678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8ac46a32-9c16-406d-a485-dfbba93b7586 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.926655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8ac46a32-9c16-406d-a485-dfbba93b7586 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:03.936951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ac46a32-9c16-406d-a485-dfbba93b7586 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.939374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ac46a32-9c16-406d-a485-dfbba93b7586 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.940210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ac46a32-9c16-406d-a485-dfbba93b7586 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.944877 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4e443e0c-403f-41fb-98c0-75ca66612588 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.067781 Oct 29 02:49:03.954923 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 538/1108] 10.222.0.16 () {58 vars in 1177 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:03.956178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ac46a32-9c16-406d-a485-dfbba93b7586 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.957680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ac46a32-9c16-406d-a485-dfbba93b7586 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.959962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ac46a32-9c16-406d-a485-dfbba93b7586 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.971265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bd7f50aa-7594-4349-9c77-d8ebeeb2866c tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.982892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:04.000603 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bd7f50aa-7594-4349-9c77-d8ebeeb2866c tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.041354 Oct 29 02:49:04.009174 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 539/1109] 10.222.0.16 () {58 vars in 1171 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:04.009174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-649420cd-19e2-4c0b-98e9-f2b2ce116e35 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.009174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-649420cd-19e2-4c0b-98e9-f2b2ce116e35 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.025896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-649420cd-19e2-4c0b-98e9-f2b2ce116e35 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.029984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-649420cd-19e2-4c0b-98e9-f2b2ce116e35 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.030687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-649420cd-19e2-4c0b-98e9-f2b2ce116e35 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.031825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-649420cd-19e2-4c0b-98e9-f2b2ce116e35 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.032590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-649420cd-19e2-4c0b-98e9-f2b2ce116e35 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.033437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-649420cd-19e2-4c0b-98e9-f2b2ce116e35 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.060186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8ac46a32-9c16-406d-a485-dfbba93b7586 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.070187 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8ac46a32-9c16-406d-a485-dfbba93b7586 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1268 microversion: 2.1 time: 0.156962 Oct 29 02:49:04.086327 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 571/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.095068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1b4bc9d7-dd11-47bf-a4cb-e6290af1f503 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.107464 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1b4bc9d7-dd11-47bf-a4cb-e6290af1f503 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.019478 Oct 29 02:49:04.108863 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 572/1111] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:04.121699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a72b23ac-b43c-477a-850f-47e21e840b71 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.146765 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a72b23ac-b43c-477a-850f-47e21e840b71 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.028941 Oct 29 02:49:04.147860 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 573/1112] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:04.147860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.147860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.166750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.167544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.167985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.168706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.169259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.169684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.215367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-649420cd-19e2-4c0b-98e9-f2b2ce116e35 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.225116 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-649420cd-19e2-4c0b-98e9-f2b2ce116e35 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1470 microversion: 2.1 time: 0.222238 Oct 29 02:49:04.225858 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 540/1113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.230968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6762a536-41a3-433f-842e-331f55be5b85 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.244580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.245382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.248758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.253232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lazy-loading 'fault' on Instance uuid bc4c73c4-725e-415c-a814-c828ec74c554 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:04.258136 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6762a536-41a3-433f-842e-331f55be5b85 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.030855 Oct 29 02:49:04.261309 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 541/1114] 10.222.0.16 () {58 vars in 1175 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.285145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5fa8af1a-9f49-481b-8233-a0ecec78676c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:04.286235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5fa8af1a-9f49-481b-8233-a0ecec78676c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.293708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fa8af1a-9f49-481b-8233-a0ecec78676c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.294565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fa8af1a-9f49-481b-8233-a0ecec78676c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.295203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fa8af1a-9f49-481b-8233-a0ecec78676c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.296124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fa8af1a-9f49-481b-8233-a0ecec78676c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.296780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fa8af1a-9f49-481b-8233-a0ecec78676c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.297417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fa8af1a-9f49-481b-8233-a0ecec78676c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.310248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486b01e2a39475dab72aa7f36816c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76e01279e6d47c0aa4fb03206db8050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.323936 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dcfb592d-2620-4b71-8931-aaf43501001e tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 200 len: 1330 microversion: 2.1 time: 0.172295 Oct 29 02:49:04.329937 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 574/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 1330 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.329937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.333084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.342382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.342878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.343316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.344025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.344662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.345093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.377043 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5fa8af1a-9f49-481b-8233-a0ecec78676c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "POST /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39/action" status: 204 len: 0 microversion: 2.1 time: 0.114110 Oct 29 02:49:04.378042 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 542/1116] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:49:04 2022] POST /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39/action => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:04.383808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a28b1957-b9e0-4df6-b1ef-f9735293187f tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.409560 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a28b1957-b9e0-4df6-b1ef-f9735293187f tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.030075 Oct 29 02:49:04.417928 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 543/1117] 10.222.0.16 () {58 vars in 1173 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.417928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b603ddbc-a1f0-4b63-9711-3615f221eb0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.417928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b603ddbc-a1f0-4b63-9711-3615f221eb0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.424417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b603ddbc-a1f0-4b63-9711-3615f221eb0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.425138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b603ddbc-a1f0-4b63-9711-3615f221eb0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.426019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b603ddbc-a1f0-4b63-9711-3615f221eb0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.427030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b603ddbc-a1f0-4b63-9711-3615f221eb0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.427639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b603ddbc-a1f0-4b63-9711-3615f221eb0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.428418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b603ddbc-a1f0-4b63-9711-3615f221eb0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.436952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.446104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.447235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.452775 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3fdf86a4-4d05-4829-bf81-02a2490e45cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.126700 Oct 29 02:49:04.453720 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 575/1118] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:04.458627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02c8e758-af1e-423c-8fe4-c8f6c22ca65c tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.487233 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02c8e758-af1e-423c-8fe4-c8f6c22ca65c tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.032209 Oct 29 02:49:04.488151 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 576/1119] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.501134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e29ce7a4-ba1e-4784-865b-0d84853506f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.502944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e29ce7a4-ba1e-4784-865b-0d84853506f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.509819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e29ce7a4-ba1e-4784-865b-0d84853506f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.510392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e29ce7a4-ba1e-4784-865b-0d84853506f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.510829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e29ce7a4-ba1e-4784-865b-0d84853506f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.511594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e29ce7a4-ba1e-4784-865b-0d84853506f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.512208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e29ce7a4-ba1e-4784-865b-0d84853506f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.512635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e29ce7a4-ba1e-4784-865b-0d84853506f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.658415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b603ddbc-a1f0-4b63-9711-3615f221eb0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.670781 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b603ddbc-a1f0-4b63-9711-3615f221eb0f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1470 microversion: 2.1 time: 0.259517 Oct 29 02:49:04.671818 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 544/1120] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.676771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c0b3083c-4460-4460-91e9-d820414f09de tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.697625 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c0b3083c-4460-4460-91e9-d820414f09de tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1467923551" status: 202 len: 0 microversion: 2.1 time: 0.024851 Oct 29 02:49:04.699186 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 545/1121] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:49:04 2022] DELETE /compute/v2.1/flavors/1467923551 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:04.701744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e29ce7a4-ba1e-4784-865b-0d84853506f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.707652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.708293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.715086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.715451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.715870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.716602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.717065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.717490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.719663 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e29ce7a4-ba1e-4784-865b-0d84853506f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1472 microversion: 2.1 time: 0.226617 Oct 29 02:49:04.728029 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 577/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.728029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9816e388-7c72-4a2d-81cb-0d3af0bb79fb tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.773762 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9816e388-7c72-4a2d-81cb-0d3af0bb79fb tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050976 Oct 29 02:49:04.775569 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 578/1123] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.809394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-06bdf213-cc47-4b01-a6b3-9267406f179c tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.833388 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-06bdf213-cc47-4b01-a6b3-9267406f179c tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/116042944" status: 202 len: 0 microversion: 2.1 time: 0.033071 Oct 29 02:49:04.834468 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 579/1124] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:49:04 2022] DELETE /compute/v2.1/flavors/116042944 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:04.843157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3114db25-88d7-4c87-b53a-77b5b2c97ec3 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.867064 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3114db25-88d7-4c87-b53a-77b5b2c97ec3 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028286 Oct 29 02:49:04.867966 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 580/1125] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:04.892734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-287e3517-32f7-40c3-9560-631c5c868ecc tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-637539119", "id": 1791312953, "os-flavor-access:is_public": "False"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:04.942165 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-287e3517-32f7-40c3-9560-631c5c868ecc tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.054494 Oct 29 02:49:04.943055 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 581/1126] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:04 2022] POST /compute/v2.1/flavors => generated 414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:04.957381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.962935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f7f8a9af-3f18-44c2-8298-7c2e5aec2427 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.963926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f7f8a9af-3f18-44c2-8298-7c2e5aec2427 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.967358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.969182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.971123 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-83f82e3f-b9b3-42a8-8bb0-c6c96d331260 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.270728 Oct 29 02:49:04.971927 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 546/1127] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:04.985922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7f8a9af-3f18-44c2-8298-7c2e5aec2427 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.987804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7f8a9af-3f18-44c2-8298-7c2e5aec2427 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.988803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7f8a9af-3f18-44c2-8298-7c2e5aec2427 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.993757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb4695a3-65bc-468a-8aef-03676ae1462f tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.994135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7f8a9af-3f18-44c2-8298-7c2e5aec2427 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.994940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7f8a9af-3f18-44c2-8298-7c2e5aec2427 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.995966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7f8a9af-3f18-44c2-8298-7c2e5aec2427 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.033902 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb4695a3-65bc-468a-8aef-03676ae1462f tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060858 Oct 29 02:49:05.043546 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 547/1128] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:05.060196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-86395c28-2fa2-4109-b5d7-1f614d314b0f tempest-FlavorsAdminTestJSON-2019643932 tempest-FlavorsAdminTestJSON-2019643932-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.108669 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-86395c28-2fa2-4109-b5d7-1f614d314b0f tempest-FlavorsAdminTestJSON-2019643932 tempest-FlavorsAdminTestJSON-2019643932-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052695 Oct 29 02:49:05.129201 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 548/1129] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:05.140998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6d84798-0532-447b-9f65-c4ddf8a506f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.142301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c6d84798-0532-447b-9f65-c4ddf8a506f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:05.164509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d84798-0532-447b-9f65-c4ddf8a506f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.167277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d84798-0532-447b-9f65-c4ddf8a506f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.167923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d84798-0532-447b-9f65-c4ddf8a506f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.168839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d84798-0532-447b-9f65-c4ddf8a506f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.173707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d84798-0532-447b-9f65-c4ddf8a506f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.174318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d84798-0532-447b-9f65-c4ddf8a506f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.451457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7f8a9af-3f18-44c2-8298-7c2e5aec2427 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:05.465334 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f7f8a9af-3f18-44c2-8298-7c2e5aec2427 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.520415 Oct 29 02:49:05.482614 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 582/1130] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:05.494523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b13a366-c287-4cf2-87da-25776e2a3ddf tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.542737 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7b13a366-c287-4cf2-87da-25776e2a3ddf tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1791312953" status: 202 len: 0 microversion: 2.1 time: 0.058349 Oct 29 02:49:05.544547 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 583/1131] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:49:05 2022] DELETE /compute/v2.1/flavors/1791312953 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:05.546887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c6d84798-0532-447b-9f65-c4ddf8a506f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:05.551882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.554496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] [instance: bc4c73c4-725e-415c-a814-c828ec74c554] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:05.559366 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c6d84798-0532-447b-9f65-c4ddf8a506f6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1286 microversion: 2.1 time: 0.424135 Oct 29 02:49:05.566984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.567800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.568595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.569585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.570592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.574629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.580801 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 549/1132] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:05 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1286 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:05.587601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.588383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:05.600313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.601095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.601698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.607361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.607958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.608571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.622035 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] HTTP exception thrown: Instance bc4c73c4-725e-415c-a814-c828ec74c554 could not be found. Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Request method failure captured: Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 HTTP/1.1 Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQGJc-U_gX8nCyk0IUGIp3C1L5y2SUvSY4DtchTPhY9MpwP6HUn2UklS4-9xuaZmlPneVv6lHExE3pH2hDNFjviwJuBxaA_cQEYxf7cQkrXQZhn0a-uyNJSlwArDzCeyMLygXSo0mKXEPrwDtgvqfjFZBgYEreAYPlG7_7KOQxUF3A Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: f76e01279e6d47c0aa4fb03206db8050 Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesAdminNegativeTest-1185402186 Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:05.624361 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f76e01279e6d47c0aa4fb03206db8050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f76e01279e6d47c0aa4fb03206db8050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f76e01279e6d47c0aa4fb03206db8050", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f76e01279e6d47c0aa4fb03206db8050"}]}] Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesAdminNegativeTest-1185402186 Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: f76e01279e6d47c0aa4fb03206db8050 Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1185402186 Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesAdminNegativeTest-1185402186-project Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 1486b01e2a39475dab72aa7f36816c1a Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesAdminNegativeTest-1185402186-project Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance bc4c73c4-725e-415c-a814-c828ec74c554 could not be found. Oct 29 02:49:05.625752 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'bc4c73c4-725e-415c-a814-c828ec74c554'} Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc4c73c4-725e-415c-a814-c828ec74c554 could not be found. Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:05.626580 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc4c73c4-725e-415c-a814-c828ec74c554 could not be found. Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc4c73c4-725e-415c-a814-c828ec74c554 could not be found. Oct 29 02:49:05.627779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:05.637476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Returning 404 to user: Instance bc4c73c4-725e-415c-a814-c828ec74c554 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:05.639275 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7a630bb-2b74-49ab-b3fe-e574fe0808db tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554" status: 404 len: 111 microversion: 2.1 time: 0.093019 Oct 29 02:49:05.640795 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 584/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:05 2022] GET /compute/v2.1/servers/bc4c73c4-725e-415c-a814-c828ec74c554 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:05.651011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ad35e86e-79b7-4628-9378-8501754d4048 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.709849 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ad35e86e-79b7-4628-9378-8501754d4048 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067601 Oct 29 02:49:05.712306 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 585/1134] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:05.717466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e50e6c1d-db8e-4b9e-9111-53b632f09cfe tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] Calling method '.version_select at 0x7fe1a874a940>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.761702 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e50e6c1d-db8e-4b9e-9111-53b632f09cfe tempest-VolumesAdminNegativeTest-1185402186 tempest-VolumesAdminNegativeTest-1185402186-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-961123784" status: 202 len: 0 microversion: 2.1 time: 0.048676 Oct 29 02:49:05.762792 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 586/1135] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 02:49:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-961123784 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:05.772559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a4265122-5e3d-4554-b769-54581c122ece tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.773213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a4265122-5e3d-4554-b769-54581c122ece tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:05.798028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4265122-5e3d-4554-b769-54581c122ece tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.798641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4265122-5e3d-4554-b769-54581c122ece tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.799092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4265122-5e3d-4554-b769-54581c122ece tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.799849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4265122-5e3d-4554-b769-54581c122ece tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.800300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4265122-5e3d-4554-b769-54581c122ece tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.802707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4265122-5e3d-4554-b769-54581c122ece tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.878891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:05.900687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:05.908970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:05.922541 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ea659dee-25f3-42f6-a1e7-5b47dd44e4b5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.339011 Oct 29 02:49:05.926851 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 550/1136] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:05 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:05.932562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-18f52e30-0271-46b2-81de-2c448e1bf126 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1841250788", "id": 839922236, "os-flavor-access:is_public": "True"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:05.962207 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-18f52e30-0271-46b2-81de-2c448e1bf126 tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.033694 Oct 29 02:49:05.964234 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 551/1137] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:05 2022] POST /compute/v2.1/flavors => generated 411 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:05.980559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e357eb3b-22e6-4b2e-9049-05e14d48c5ee tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.983774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e357eb3b-22e6-4b2e-9049-05e14d48c5ee tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:05.992870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e357eb3b-22e6-4b2e-9049-05e14d48c5ee tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.993614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e357eb3b-22e6-4b2e-9049-05e14d48c5ee tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.994351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e357eb3b-22e6-4b2e-9049-05e14d48c5ee tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.995705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e357eb3b-22e6-4b2e-9049-05e14d48c5ee tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.996352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e357eb3b-22e6-4b2e-9049-05e14d48c5ee tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.997322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e357eb3b-22e6-4b2e-9049-05e14d48c5ee tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.241575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a4265122-5e3d-4554-b769-54581c122ece tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:06.256941 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a4265122-5e3d-4554-b769-54581c122ece tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1470 microversion: 2.1 time: 0.492853 Oct 29 02:49:06.257968 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 587/1138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:05 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1470 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:06.262728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-aa2d2ffd-bb7e-4f26-9add-63b6dc299e02 req-bdd1656a-dab2-4942-af42-42eb42a810f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39", "name": "network-vif-plugged", "status": "completed", "tag": "2aee52dc-63e0-47de-821b-34b98b339294"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:06.290431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-aa2d2ffd-bb7e-4f26-9add-63b6dc299e02 req-bdd1656a-dab2-4942-af42-42eb42a810f0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.291176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-aa2d2ffd-bb7e-4f26-9add-63b6dc299e02 req-bdd1656a-dab2-4942-af42-42eb42a810f0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.291797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-aa2d2ffd-bb7e-4f26-9add-63b6dc299e02 req-bdd1656a-dab2-4942-af42-42eb42a810f0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.317113 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-aa2d2ffd-bb7e-4f26-9add-63b6dc299e02 req-bdd1656a-dab2-4942-af42-42eb42a810f0 service nova] Creating event network-vif-plugged:2aee52dc-63e0-47de-821b-34b98b339294 for instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 on n-h1-862964-4 Oct 29 02:49:06.337245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-aa2d2ffd-bb7e-4f26-9add-63b6dc299e02 req-bdd1656a-dab2-4942-af42-42eb42a810f0 service nova] Instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:49:06.360596 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-aa2d2ffd-bb7e-4f26-9add-63b6dc299e02 req-bdd1656a-dab2-4942-af42-42eb42a810f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101114 Oct 29 02:49:06.361571 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 588/1139] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:06.373043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-28a9eda3-7792-4f5a-87d5-60666a350816 tempest-FlavorsAdminTestJSON-2019643932 tempest-FlavorsAdminTestJSON-2019643932-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:06.420073 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-28a9eda3-7792-4f5a-87d5-60666a350816 tempest-FlavorsAdminTestJSON-2019643932 tempest-FlavorsAdminTestJSON-2019643932-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.053253 Oct 29 02:49:06.421483 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 589/1140] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:06 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:06.426650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:06.428776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:06.442225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.443055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.443618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.444425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.445080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.445569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.531720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:06.836993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e357eb3b-22e6-4b2e-9049-05e14d48c5ee tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:06.846590 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e357eb3b-22e6-4b2e-9049-05e14d48c5ee tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1472 microversion: 2.1 time: 0.880253 Oct 29 02:49:06.855234 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 552/1141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:05 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1472 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:06.860153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9815afe9-f428-4901-9a63-5a531a6b56fa tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:06.901735 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9815afe9-f428-4901-9a63-5a531a6b56fa tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/839922236" status: 202 len: 0 microversion: 2.1 time: 0.045197 Oct 29 02:49:06.905772 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 553/1142] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:49:06 2022] DELETE /compute/v2.1/flavors/839922236 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:06.911423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b03daa6-efc5-4b2c-bcf5-73992f057dcd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:06.912033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0b03daa6-efc5-4b2c-bcf5-73992f057dcd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:06.929316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b03daa6-efc5-4b2c-bcf5-73992f057dcd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.929885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b03daa6-efc5-4b2c-bcf5-73992f057dcd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.930273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b03daa6-efc5-4b2c-bcf5-73992f057dcd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.930983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b03daa6-efc5-4b2c-bcf5-73992f057dcd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.932309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:06.938197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b03daa6-efc5-4b2c-bcf5-73992f057dcd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.938733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b03daa6-efc5-4b2c-bcf5-73992f057dcd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.949057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:06.964152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:06.973697 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-062e6593-ca18-40ab-b8a7-033b13df83ff tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.549828 Oct 29 02:49:06.990982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 590/1143] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:06 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:06.994893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:07.009842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-078780ef-53c1-4cf0-b50c-ee4c48976270 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:07.010802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-078780ef-53c1-4cf0-b50c-ee4c48976270 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:07.019376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-078780ef-53c1-4cf0-b50c-ee4c48976270 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.020081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-078780ef-53c1-4cf0-b50c-ee4c48976270 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.020673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-078780ef-53c1-4cf0-b50c-ee4c48976270 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.021538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-078780ef-53c1-4cf0-b50c-ee4c48976270 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.022704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-078780ef-53c1-4cf0-b50c-ee4c48976270 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.023682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-078780ef-53c1-4cf0-b50c-ee4c48976270 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.185190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-078780ef-53c1-4cf0-b50c-ee4c48976270 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:07.198490 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-078780ef-53c1-4cf0-b50c-ee4c48976270 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1274 microversion: 2.1 time: 0.196229 Oct 29 02:49:07.202408 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 591/1144] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:06 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:07.210191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f56a9660-1d93-45b4-85d3-456630d2368d req-817c088e-7857-44fc-a18a-0ea253c9dd9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17fee50-82f1-461d-9889-b0f25961ae1b", "name": "network-vif-deleted", "tag": "37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:07.221712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f56a9660-1d93-45b4-85d3-456630d2368d req-817c088e-7857-44fc-a18a-0ea253c9dd9e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.222619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f56a9660-1d93-45b4-85d3-456630d2368d req-817c088e-7857-44fc-a18a-0ea253c9dd9e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.223113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f56a9660-1d93-45b4-85d3-456630d2368d req-817c088e-7857-44fc-a18a-0ea253c9dd9e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.242171 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f56a9660-1d93-45b4-85d3-456630d2368d req-817c088e-7857-44fc-a18a-0ea253c9dd9e service nova] Creating event network-vif-deleted:37ba5db7-f2ae-46fc-bdb7-7d3f24b585d1 for instance a17fee50-82f1-461d-9889-b0f25961ae1b on n-h1-862964-4 Oct 29 02:49:07.250069 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f56a9660-1d93-45b4-85d3-456630d2368d req-817c088e-7857-44fc-a18a-0ea253c9dd9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045742 Oct 29 02:49:07.254668 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 592/1145] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:07.264049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7e4b021-83df-446c-bfe9-ce20b062025a tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:07.303444 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7e4b021-83df-446c-bfe9-ce20b062025a tempest-FlavorsAdminTestJSON-1350260917 tempest-FlavorsAdminTestJSON-1350260917-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047217 Oct 29 02:49:07.304145 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 593/1146] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:07.309260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:07.310665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:07.330317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.335701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.338131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.339949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.341960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.345122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.494545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:07.501958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b03daa6-efc5-4b2c-bcf5-73992f057dcd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:07.506279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:07.508742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:07.513912 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b03daa6-efc5-4b2c-bcf5-73992f057dcd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.604496 Oct 29 02:49:07.515818 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 554/1147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:06 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:07.532349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7a4223f2-fc1d-4b89-97e3-ed1048fd48e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.226834 Oct 29 02:49:07.533996 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 594/1148] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:07 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:07.551810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d3647b9-7104-48bc-b316-4a1e4c0c3689 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:07.552701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d3647b9-7104-48bc-b316-4a1e4c0c3689 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:07.577988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d3647b9-7104-48bc-b316-4a1e4c0c3689 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.578490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d3647b9-7104-48bc-b316-4a1e4c0c3689 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.578920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d3647b9-7104-48bc-b316-4a1e4c0c3689 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.579646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d3647b9-7104-48bc-b316-4a1e4c0c3689 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.580082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d3647b9-7104-48bc-b316-4a1e4c0c3689 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.581963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d3647b9-7104-48bc-b316-4a1e4c0c3689 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.883871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:07.885432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:07.906829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.911714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.914510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.918787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.922144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.925910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.083294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.084724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.091669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.093458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lazy-loading 'fault' on Instance uuid a17fee50-82f1-461d-9889-b0f25961ae1b {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:08.127440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d3647b9-7104-48bc-b316-4a1e4c0c3689 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.141362 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d3647b9-7104-48bc-b316-4a1e4c0c3689 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1470 microversion: 2.1 time: 0.624146 Oct 29 02:49:08.142233 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 555/1149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:07 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1470 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:08.149986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:08.155177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:08.167744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.174930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.175656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.178461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.183182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.183771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.224436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68cdeea2722e49e09ccf0b4f892906d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba4b121877b458092bfd5cadec5aa3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.241311 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-51497a8c-e69c-4a97-836c-0aa9a806f8f7 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 200 len: 1307 microversion: 2.1 time: 0.363373 Oct 29 02:49:08.242262 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 595/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:07 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 1307 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:08.302765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f30f945f-379c-4f39-872a-fc858fc7e48d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:08.304307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f30f945f-379c-4f39-872a-fc858fc7e48d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:08.331872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f30f945f-379c-4f39-872a-fc858fc7e48d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.334296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f30f945f-379c-4f39-872a-fc858fc7e48d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.336707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f30f945f-379c-4f39-872a-fc858fc7e48d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.340632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f30f945f-379c-4f39-872a-fc858fc7e48d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.351809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f30f945f-379c-4f39-872a-fc858fc7e48d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.355650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f30f945f-379c-4f39-872a-fc858fc7e48d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.855161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.868772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.887198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.891634 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d64177a-b7a7-4046-8ef2-8b7ebde200c8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.745101 Oct 29 02:49:08.906384 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 556/1151] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:08 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:08.912854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c8b7c1c6-9d57-4145-99c3-126cb47ad53f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:08.914979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c8b7c1c6-9d57-4145-99c3-126cb47ad53f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:08.927793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8b7c1c6-9d57-4145-99c3-126cb47ad53f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.930753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8b7c1c6-9d57-4145-99c3-126cb47ad53f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.931214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8b7c1c6-9d57-4145-99c3-126cb47ad53f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.934802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8b7c1c6-9d57-4145-99c3-126cb47ad53f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.935506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8b7c1c6-9d57-4145-99c3-126cb47ad53f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.936749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8b7c1c6-9d57-4145-99c3-126cb47ad53f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.180512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f30f945f-379c-4f39-872a-fc858fc7e48d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:09.207729 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f30f945f-379c-4f39-872a-fc858fc7e48d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1316 microversion: 2.1 time: 0.952046 Oct 29 02:49:09.216635 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 596/1152] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:08 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1316 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:09.227568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:09.228593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:09.248763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.250167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.251259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.252346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.253041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.253682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.358302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c8b7c1c6-9d57-4145-99c3-126cb47ad53f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:09.365474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:09.369357 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c8b7c1c6-9d57-4145-99c3-126cb47ad53f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.472209 Oct 29 02:49:09.371000 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 557/1153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:08 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:09.379397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-224762d1-96bb-4c19-8d15-e48bc95e2012 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:09.380014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-224762d1-96bb-4c19-8d15-e48bc95e2012 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:09.392448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:09.394288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:09.397269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-224762d1-96bb-4c19-8d15-e48bc95e2012 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.399182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-224762d1-96bb-4c19-8d15-e48bc95e2012 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.399640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-224762d1-96bb-4c19-8d15-e48bc95e2012 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.400322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=10,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:09.402691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-224762d1-96bb-4c19-8d15-e48bc95e2012 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.403226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-224762d1-96bb-4c19-8d15-e48bc95e2012 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.404183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-224762d1-96bb-4c19-8d15-e48bc95e2012 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.405921 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-df5e0b91-b81e-44a4-a1a7-47f5c72a3fa7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.187351 Oct 29 02:49:09.422310 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 597/1154] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:09 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:09.432724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:09.433637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] [instance: a17fee50-82f1-461d-9889-b0f25961ae1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:09.459118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.460583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.461493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.462489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.464169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.465390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.489760 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] HTTP exception thrown: Instance a17fee50-82f1-461d-9889-b0f25961ae1b could not be found. Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Request method failure captured: Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b HTTP/1.1 Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJRCJ6pmgMrk3OGaaT0WEwtmijKRoZz8NMQuW4fU_VbUWw5-vq19ILq5I0R6A1mA32JNQQ5XHvAKW7yLesjBFzDA39Br5e5jaGha66RQZ6SsDJFAHrmf7K1-OZ5eTlEbMegf0YcvJ2uZiAhDec7mpyaevintm5jmBrq1DuH9--wsyWU Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4ba4b121877b458092bfd5cadec5aa3d Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesOneServerTestJSON-2084405278 Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:09.496555 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4ba4b121877b458092bfd5cadec5aa3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ba4b121877b458092bfd5cadec5aa3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4ba4b121877b458092bfd5cadec5aa3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ba4b121877b458092bfd5cadec5aa3d"}]}] Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesOneServerTestJSON-2084405278 Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4ba4b121877b458092bfd5cadec5aa3d Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2084405278 Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesOneServerTestJSON-2084405278-project Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 68cdeea2722e49e09ccf0b4f892906d4 Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesOneServerTestJSON-2084405278-project Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance a17fee50-82f1-461d-9889-b0f25961ae1b could not be found. Oct 29 02:49:09.498259 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'a17fee50-82f1-461d-9889-b0f25961ae1b'} Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17fee50-82f1-461d-9889-b0f25961ae1b could not be found. Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:09.499036 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17fee50-82f1-461d-9889-b0f25961ae1b could not be found. Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17fee50-82f1-461d-9889-b0f25961ae1b could not be found. Oct 29 02:49:09.500211 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:09.502862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] Returning 404 to user: Instance a17fee50-82f1-461d-9889-b0f25961ae1b could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:09.504869 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f59e4c6a-7c2d-4859-921c-5c574daf11c4 tempest-ImagesOneServerTestJSON-2084405278 tempest-ImagesOneServerTestJSON-2084405278-project] 10.222.0.16 "GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b" status: 404 len: 111 microversion: 2.1 time: 0.081239 Oct 29 02:49:09.508777 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 598/1155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:09 2022] GET /compute/v2.1/servers/a17fee50-82f1-461d-9889-b0f25961ae1b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:09.919292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:09.919892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:09.930754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-224762d1-96bb-4c19-8d15-e48bc95e2012 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:09.938904 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-224762d1-96bb-4c19-8d15-e48bc95e2012 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1470 microversion: 2.1 time: 0.566663 Oct 29 02:49:09.939486 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 558/1156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:09 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1470 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:09.942079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.946800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.947486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.948382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.948980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.949606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.238917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8464a90f-5e2e-49dc-9696-4fbb9a7a1a29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:10.240057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8464a90f-5e2e-49dc-9696-4fbb9a7a1a29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:10.253949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8464a90f-5e2e-49dc-9696-4fbb9a7a1a29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.254732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8464a90f-5e2e-49dc-9696-4fbb9a7a1a29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.255348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8464a90f-5e2e-49dc-9696-4fbb9a7a1a29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.259566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8464a90f-5e2e-49dc-9696-4fbb9a7a1a29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.261710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8464a90f-5e2e-49dc-9696-4fbb9a7a1a29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.262941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8464a90f-5e2e-49dc-9696-4fbb9a7a1a29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.436297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:10.452018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:10.453475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:10.454698 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-127714f9-638b-4a01-8848-16db550d6a75 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.539337 Oct 29 02:49:10.477694 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 599/1157] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:09 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:49:10.482652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-303f8e2a-3a10-4c9c-a083-e237f9534ee6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:10.490711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-303f8e2a-3a10-4c9c-a083-e237f9534ee6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:10.508870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303f8e2a-3a10-4c9c-a083-e237f9534ee6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.509375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303f8e2a-3a10-4c9c-a083-e237f9534ee6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.509825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303f8e2a-3a10-4c9c-a083-e237f9534ee6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.510550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303f8e2a-3a10-4c9c-a083-e237f9534ee6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.511024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303f8e2a-3a10-4c9c-a083-e237f9534ee6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.511990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-303f8e2a-3a10-4c9c-a083-e237f9534ee6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.755472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8464a90f-5e2e-49dc-9696-4fbb9a7a1a29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:10.767139 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8464a90f-5e2e-49dc-9696-4fbb9a7a1a29 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1316 microversion: 2.1 time: 0.532394 Oct 29 02:49:10.770533 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 559/1158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:10 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:10.781153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:10.783812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:10.802391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.804012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.807096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.808622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.811787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.817308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.053229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-303f8e2a-3a10-4c9c-a083-e237f9534ee6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:11.063275 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-303f8e2a-3a10-4c9c-a083-e237f9534ee6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1504 microversion: 2.1 time: 0.584350 Oct 29 02:49:11.069826 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 600/1159] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:10 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1504 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:11.079038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3ae50167-b820-4336-b0c8-dffcdc0e7397 req-d26ae22b-a126-474a-a30b-d63b2edd9aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c727c0d-2872-4ea2-b11c-64992077779c", "tag": "7a157939-10b2-4975-9408-c5f8c8de766e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:11.096215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3ae50167-b820-4336-b0c8-dffcdc0e7397 req-d26ae22b-a126-474a-a30b-d63b2edd9aa2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:11.097781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3ae50167-b820-4336-b0c8-dffcdc0e7397 req-d26ae22b-a126-474a-a30b-d63b2edd9aa2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:11.098472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3ae50167-b820-4336-b0c8-dffcdc0e7397 req-d26ae22b-a126-474a-a30b-d63b2edd9aa2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.118506 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3ae50167-b820-4336-b0c8-dffcdc0e7397 req-d26ae22b-a126-474a-a30b-d63b2edd9aa2 service nova] Creating event network-changed:7a157939-10b2-4975-9408-c5f8c8de766e for instance 3c727c0d-2872-4ea2-b11c-64992077779c on n-h2-862964-4 Oct 29 02:49:11.125177 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3ae50167-b820-4336-b0c8-dffcdc0e7397 req-d26ae22b-a126-474a-a30b-d63b2edd9aa2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053550 Oct 29 02:49:11.126768 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 601/1160] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:11.134573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f6aa11b7-5334-4bef-8d97-c85d0cc727b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:11.136747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f6aa11b7-5334-4bef-8d97-c85d0cc727b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:11.145847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6aa11b7-5334-4bef-8d97-c85d0cc727b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:11.146807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6aa11b7-5334-4bef-8d97-c85d0cc727b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:11.148044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6aa11b7-5334-4bef-8d97-c85d0cc727b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.149609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6aa11b7-5334-4bef-8d97-c85d0cc727b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:11.150573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6aa11b7-5334-4bef-8d97-c85d0cc727b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:11.151295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6aa11b7-5334-4bef-8d97-c85d0cc727b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.345256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:11.357145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:11.358674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:11.373855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=9,nova_api:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:11.376869 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-95f72ff1-a093-48d9-b366-e627122e7793 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.604841 Oct 29 02:49:11.377691 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 560/1161] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:10 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:11.486934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:11.488273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:11.500619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:11.501221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:11.502255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.504043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:11.504731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:11.505604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.719669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f6aa11b7-5334-4bef-8d97-c85d0cc727b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:11.738775 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f6aa11b7-5334-4bef-8d97-c85d0cc727b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1462 microversion: 2.1 time: 0.610225 Oct 29 02:49:11.740987 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 602/1162] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:11 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1462 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:11.768237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9756aa1-2f6d-4834-8a8d-df03aad543e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:11.769384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c9756aa1-2f6d-4834-8a8d-df03aad543e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:11.780199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9756aa1-2f6d-4834-8a8d-df03aad543e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:11.785265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9756aa1-2f6d-4834-8a8d-df03aad543e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:11.785964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9756aa1-2f6d-4834-8a8d-df03aad543e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.788666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9756aa1-2f6d-4834-8a8d-df03aad543e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:11.789687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9756aa1-2f6d-4834-8a8d-df03aad543e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:11.790701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9756aa1-2f6d-4834-8a8d-df03aad543e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.082797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:12.096342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:12.097846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:12.099025 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-024c8831-c622-4a0e-b07e-803094982480 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.618058 Oct 29 02:49:12.099608 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 561/1163] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:11 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:12.133701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6ad4a659-af30-45f9-a6ed-76f9f1baada1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:12.134343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6ad4a659-af30-45f9-a6ed-76f9f1baada1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:12.155784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ad4a659-af30-45f9-a6ed-76f9f1baada1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.156282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ad4a659-af30-45f9-a6ed-76f9f1baada1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.156716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ad4a659-af30-45f9-a6ed-76f9f1baada1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.157432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ad4a659-af30-45f9-a6ed-76f9f1baada1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.157908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ad4a659-af30-45f9-a6ed-76f9f1baada1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.158330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ad4a659-af30-45f9-a6ed-76f9f1baada1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.474279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:12.634725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6ad4a659-af30-45f9-a6ed-76f9f1baada1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:12.651643 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6ad4a659-af30-45f9-a6ed-76f9f1baada1 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1316 microversion: 2.1 time: 0.520540 Oct 29 02:49:12.655497 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 562/1164] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:12 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:12.662648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8a461e6a-3ffa-4b16-b3f5-eb52d5181d8a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:12.663430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8a461e6a-3ffa-4b16-b3f5-eb52d5181d8a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:12.673106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a461e6a-3ffa-4b16-b3f5-eb52d5181d8a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.674679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a461e6a-3ffa-4b16-b3f5-eb52d5181d8a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.677303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a461e6a-3ffa-4b16-b3f5-eb52d5181d8a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.678465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a461e6a-3ffa-4b16-b3f5-eb52d5181d8a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.680184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a461e6a-3ffa-4b16-b3f5-eb52d5181d8a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.681101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a461e6a-3ffa-4b16-b3f5-eb52d5181d8a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.798386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c9756aa1-2f6d-4834-8a8d-df03aad543e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:12.811384 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c9756aa1-2f6d-4834-8a8d-df03aad543e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1462 microversion: 2.1 time: 1.048443 Oct 29 02:49:12.830967 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 603/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:11 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1462 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:12.854721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:12.859933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:12.875080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.875593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.876036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.877098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.877218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.877619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.898643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:12.981185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8a461e6a-3ffa-4b16-b3f5-eb52d5181d8a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:12.991955 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8a461e6a-3ffa-4b16-b3f5-eb52d5181d8a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1479 microversion: 2.1 time: 0.334676 Oct 29 02:49:13.005197 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 563/1166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:12 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1479 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:13.014932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:13.018158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5d212b3c-d316-4cfa-a452-8e4a0c5d5abb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Action: 'create', calling method: .version_select at 0x7fe1a8993940>, body: {"keypair": {"name": "tempest-keypair-1998564294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlrQ/Bk57lyhDRhB6DgvsEyK8mHYf4x9XkEJmu1zWajetih0fTLZmQKwFGwJfDEsAtkUI209YxTWYR7lNimdN4q4awQk+nmAA7WTugMZgNVtIuZR5DG1fmiXnMeWgHc6A=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:13.031265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:13.034863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:13.045111 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-98fb004e-acbf-4c81-9e49-8effd517571b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.197471 Oct 29 02:49:13.072820 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 604/1167] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:12 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:13.077119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5d212b3c-d316-4cfa-a452-8e4a0c5d5abb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for project bb5aec15c4e844b2872c9eab52f69482. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:13.081488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7f7a97f8-641e-41c0-8fb1-811d2eee66a1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '.version_select at 0x7fe1a86ebdc0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:13.083144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5d212b3c-d316-4cfa-a452-8e4a0c5d5abb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for user efecedc77d3048c4a0ec0fe6701f9ccc and project bb5aec15c4e844b2872c9eab52f69482. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:13.096275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f7a97f8-641e-41c0-8fb1-811d2eee66a1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:13.098314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f7a97f8-641e-41c0-8fb1-811d2eee66a1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:13.098807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f7a97f8-641e-41c0-8fb1-811d2eee66a1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:13.122156 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7f7a97f8-641e-41c0-8fb1-811d2eee66a1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2333 microversion: 2.1 time: 0.047578 Oct 29 02:49:13.131806 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 605/1168] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:49:13 2022] GET /compute/v2.1/os-migrations => generated 2333 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:13.144413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:13.158906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:13.175740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:13.179165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:13.179852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:13.182105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:13.182750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:13.183428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:13.193624 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5d212b3c-d316-4cfa-a452-8e4a0c5d5abb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.187068 Oct 29 02:49:13.204498 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 564/1169] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:13.225627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2086acfc-89b2-43c8-b7c3-1e04189e7fa0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:13.233743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2086acfc-89b2-43c8-b7c3-1e04189e7fa0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:13.270648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2086acfc-89b2-43c8-b7c3-1e04189e7fa0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:13.273066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2086acfc-89b2-43c8-b7c3-1e04189e7fa0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:13.274106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2086acfc-89b2-43c8-b7c3-1e04189e7fa0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:13.274858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2086acfc-89b2-43c8-b7c3-1e04189e7fa0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:13.279290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2086acfc-89b2-43c8-b7c3-1e04189e7fa0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:13.279810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2086acfc-89b2-43c8-b7c3-1e04189e7fa0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:13.701148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:13.716825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:13.722475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:13.726314 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9bda4cb2-8983-40b5-b8d7-5fcf5c323fb1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.593245 Oct 29 02:49:13.736184 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 606/1170] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:13 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:13.820886 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2086acfc-89b2-43c8-b7c3-1e04189e7fa0 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1630 microversion: 2.1 time: 0.618405 Oct 29 02:49:13.822576 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 565/1171] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:13 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1630 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:13.845841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9ce053e1-ad12-444b-8fa4-f25cc1c6fdba tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:13.850181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9ce053e1-ad12-444b-8fa4-f25cc1c6fdba tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:13.876349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ce053e1-ad12-444b-8fa4-f25cc1c6fdba tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:13.877179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ce053e1-ad12-444b-8fa4-f25cc1c6fdba tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:13.878354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ce053e1-ad12-444b-8fa4-f25cc1c6fdba tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:13.879766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ce053e1-ad12-444b-8fa4-f25cc1c6fdba tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:13.881572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ce053e1-ad12-444b-8fa4-f25cc1c6fdba tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:13.882981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ce053e1-ad12-444b-8fa4-f25cc1c6fdba tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.035710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37ced79f-a7eb-4835-af4b-185303437d70 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Action: 'create', calling method: .version_select at 0x7fe1a86fe790>, body: {"keypair": {"name": "tempest-keypair-1647949406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAF0groW4fCE60/jNNX/253C8jqIf+wDI6FDwiDp9SZM/MKBy5xBZVyENZY4RiUp1rGZ/uvy/XcKP8ezZ5BsHw65GOCAl10nLPmUYAKcO+YPAvuftV58PPJxeAsN1aWVw=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:14.079878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-37ced79f-a7eb-4835-af4b-185303437d70 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:14.091008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-37ced79f-a7eb-4835-af4b-185303437d70 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for user 0bf25302f8b84de2ac6ead21f7d23d40 and project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:14.139414 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37ced79f-a7eb-4835-af4b-185303437d70 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.400227 Oct 29 02:49:14.146804 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 607/1172] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:14.158438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e8dd0da4-2bd7-4057-8a3a-5f9e6bd80135 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Action: 'create', calling method: .version_select at 0x7fe1a86a7ca0>, body: {"keypair": {"name": "tempest-keypair-1743298275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsw3M+6qhtxJLs2lnpN7E/Tk4iCkpRnnkfGS+t3N2bcZ3MmLtHPo/WW/T7vmKfyd1F19PSZ1A8aoBDAS2k99226U0rALZKHfmyAEawNIN+s5ZQOEZMX2CmOhFP5yLj0oQ=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:14.202839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-e8dd0da4-2bd7-4057-8a3a-5f9e6bd80135 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Getting quotas for project a1287e36822b48f9a9020375bd0da2ab. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:14.218592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-e8dd0da4-2bd7-4057-8a3a-5f9e6bd80135 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Getting quotas for user 6c2aa25bffe3421e8a75d88388dd5441 and project a1287e36822b48f9a9020375bd0da2ab. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:14.256190 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e8dd0da4-2bd7-4057-8a3a-5f9e6bd80135 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107878 Oct 29 02:49:14.256855 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 608/1173] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:14.268604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:14.270369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:14.283588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.284081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.284511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.285224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.285676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.286123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.359651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9ce053e1-ad12-444b-8fa4-f25cc1c6fdba tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:14.376641 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9ce053e1-ad12-444b-8fa4-f25cc1c6fdba tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1316 microversion: 2.1 time: 0.551857 Oct 29 02:49:14.378455 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 566/1174] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:13 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:14.388874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fcde36f6-a7ab-4f46-a873-fdcd6918aebe tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Calling method '.version_select at 0x7fe1a8927310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:14.406807 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fcde36f6-a7ab-4f46-a873-fdcd6918aebe tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1647949406" status: 200 len: 497 microversion: 2.1 time: 0.027211 Oct 29 02:49:14.407403 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 567/1175] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 02:49:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1647949406 => generated 497 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:14.425655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a537e847-b70b-4734-b851-c4729a6964c2 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Calling method '.version_select at 0x7fe1a89465e0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:14.466422 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a537e847-b70b-4734-b851-c4729a6964c2 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647949406" status: 202 len: 0 microversion: 2.1 time: 0.045319 Oct 29 02:49:14.476588 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 568/1176] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 02:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647949406 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:14.481944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0cdda51a-32a6-4219-9d13-cbf798fb94da tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Action: 'create', calling method: .version_select at 0x7fe1a88fab80>, body: {"keypair": {"name": "tempest-keypair-467791240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOJAIjxJfMRhY8d23Tw1/vTsNXaJoJwUHjHnQefvPuMjOgH+oAYRggj0Pa0nmLGi1MfKXYBHzNsu9ZzkEr1LN1XJGjpEpBfSm0lI4GeQJsZmtYpLSDebKO6ZrdZ+8G4/Q=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:14.500184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0cdda51a-32a6-4219-9d13-cbf798fb94da tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:14.505056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0cdda51a-32a6-4219-9d13-cbf798fb94da tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for user 0bf25302f8b84de2ac6ead21f7d23d40 and project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:14.569913 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0cdda51a-32a6-4219-9d13-cbf798fb94da tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.091787 Oct 29 02:49:14.570728 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 569/1177] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:14.591088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85ad095d-39ca-4fcc-8c65-d68fe8a46169 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Calling method '.version_select at 0x7fe1a88fac10>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:14.633081 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-85ad095d-39ca-4fcc-8c65-d68fe8a46169 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467791240" status: 202 len: 0 microversion: 2.1 time: 0.053071 Oct 29 02:49:14.636701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:14.640644 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 570/1178] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 02:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467791240 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:14.654578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e59155c7-22cc-4174-be44-c5938b3aacc4 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Action: 'create', calling method: .version_select at 0x7fe1a8946280>, body: {"keypair": {"name": "tempest-keypair-1368625990", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:14.682990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:14.686724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e59155c7-22cc-4174-be44-c5938b3aacc4 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:14.694919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e59155c7-22cc-4174-be44-c5938b3aacc4 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for user 0bf25302f8b84de2ac6ead21f7d23d40 and project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:14.701131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:14.720795 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8ed385e5-f78e-4ec9-8a30-24cfe8f4f794 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.462681 Oct 29 02:49:14.721393 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 609/1179] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:14 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:14.750986 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e59155c7-22cc-4174-be44-c5938b3aacc4 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.108777 Oct 29 02:49:14.751476 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 571/1180] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:14 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:14.758536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:14.759152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:14.768640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd9b4686-2c2b-4097-b82f-b331254137bb tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Calling method '.version_select at 0x7fe1a88e0310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:14.776297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.776801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.777242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.778046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.778507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.779038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.828428 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd9b4686-2c2b-4097-b82f-b331254137bb tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368625990" status: 202 len: 0 microversion: 2.1 time: 0.067335 Oct 29 02:49:14.836114 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 572/1181] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 02:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368625990 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:14.843656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0dc4d3a5-3ea8-4d43-b0c8-1f911024736c tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Action: 'create', calling method: .version_select at 0x7fe1a88ee8b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1620547131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHy3qTHqZvxRsXgPR4+/sr6RXqI1ID6ysKapOtPMnUd1QLyPbjC6D4wcFl0soOyoV7ZVmLoDfH2V6MmczDSsqu1Ro77X0c+12taOMCq7as9AUC2Sv1Sn4dEl19T7ETePxg=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:14.873973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0dc4d3a5-3ea8-4d43-b0c8-1f911024736c tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:14.878369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0dc4d3a5-3ea8-4d43-b0c8-1f911024736c tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for user 0bf25302f8b84de2ac6ead21f7d23d40 and project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:14.914454 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0dc4d3a5-3ea8-4d43-b0c8-1f911024736c tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.076494 Oct 29 02:49:14.924128 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 573/1182] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:14 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:14.930783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cb8ee488-b8b1-432a-8e07-f82861d2d0f6 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Action: 'create', calling method: .version_select at 0x7fe1a88f4d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-665908609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb02UQPXiwVkDgwasueL1a87I6gbAl9FzD+tptNxI5GQFgv9VJLJ7fqePEXsua9jpiMKUhRq1+8iYsXA8mSNjO70YkWEmzAqJLiGQbF83NdB5M31tMQ3yDJR7ATG87YSw=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:14.953427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cb8ee488-b8b1-432a-8e07-f82861d2d0f6 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:14.970053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cb8ee488-b8b1-432a-8e07-f82861d2d0f6 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for user 0bf25302f8b84de2ac6ead21f7d23d40 and project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:15.019324 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cb8ee488-b8b1-432a-8e07-f82861d2d0f6 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.093731 Oct 29 02:49:15.031793 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 574/1183] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:14 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:15.038775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9584e3f6-26df-4151-bf04-c3d0b970be4a tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Action: 'create', calling method: .version_select at 0x7fe1a898aa60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-270784420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKP3uNfaWFPuZplQ1U864Cz5ucL88E3S/3urYD29p7wR+dIOq14PFLu8RTBgxpS0zXtJmiENLckZjnqYs3sab1mftVpkg5I3tUGCr3W1b4SJp78mcPvqZxWqpfWZdS+Mg=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:15.088220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9584e3f6-26df-4151-bf04-c3d0b970be4a tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:15.104313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9584e3f6-26df-4151-bf04-c3d0b970be4a tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Getting quotas for user 0bf25302f8b84de2ac6ead21f7d23d40 and project 1aa758093b4b4cc6a7c4c82c788fb8ee. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:15.155046 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9584e3f6-26df-4151-bf04-c3d0b970be4a tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.121722 Oct 29 02:49:15.175303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 575/1184] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:15 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:15.187170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-72a9eba8-0d6a-4fda-8863-adcd5749bb7c tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Calling method '.version_select at 0x7fe1a89e1280>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.206071 n-d-862964-4 devstack@n-api.service[127042]: WARNING oslo_db.sqlalchemy.utils [None req-72a9eba8-0d6a-4fda-8863-adcd5749bb7c tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 02:49:15.218330 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-72a9eba8-0d6a-4fda-8863-adcd5749bb7c tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.041811 Oct 29 02:49:15.232835 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 576/1185] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:49:15 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:15.238349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:15.247438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b8a85b65-cc64-48ab-bd56-1405dbce5642 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Calling method '.version_select at 0x7fe1a8a75c10>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.264582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:15.268547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:15.271013 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ade6876-ca96-471b-91a6-e6f81744a699 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.518962 Oct 29 02:49:15.271545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:15.274102 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 610/1186] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:14 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:15.291615 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b8a85b65-cc64-48ab-bd56-1405dbce5642 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-270784420" status: 202 len: 0 microversion: 2.1 time: 0.056647 Oct 29 02:49:15.296279 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 577/1187] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 02:49:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-270784420 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:15.324290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6f97befd-70c3-4531-a198-020c9c1894ec tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Calling method '.version_select at 0x7fe1a86a7af0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.400007 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6f97befd-70c3-4531-a198-020c9c1894ec tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-665908609" status: 202 len: 0 microversion: 2.1 time: 0.085427 Oct 29 02:49:15.402766 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 611/1188] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 02:49:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-665908609 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:15.408857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0701f42-94bb-4c1f-81eb-12dcee1b425a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.409563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0701f42-94bb-4c1f-81eb-12dcee1b425a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:15.417591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a641cf4-903a-4932-8e0f-0aa01c43f991 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] Calling method '.version_select at 0x7fe1a86ebca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.426275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0701f42-94bb-4c1f-81eb-12dcee1b425a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.428173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0701f42-94bb-4c1f-81eb-12dcee1b425a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.431701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0701f42-94bb-4c1f-81eb-12dcee1b425a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.437227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0701f42-94bb-4c1f-81eb-12dcee1b425a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.437835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0701f42-94bb-4c1f-81eb-12dcee1b425a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.440633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0701f42-94bb-4c1f-81eb-12dcee1b425a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.460843 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a641cf4-903a-4932-8e0f-0aa01c43f991 tempest-KeyPairsV2TestJSON-756002439 tempest-KeyPairsV2TestJSON-756002439-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1620547131" status: 202 len: 0 microversion: 2.1 time: 0.053485 Oct 29 02:49:15.462088 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 612/1189] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Oct 29 02:49:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1620547131 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:15.751626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.752235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:15.771609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.776796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.779497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.785831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.790017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.791783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.013843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.029034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.031170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.037181 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4b9663b6-3ecd-43b9-8469-c4f0bed1e7e3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.290377 Oct 29 02:49:16.055966 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 613/1190] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:15 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:16.302963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:16.304777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:16.320128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.328179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.328874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.329794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.330508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.331079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.346924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:16.529227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d0701f42-94bb-4c1f-81eb-12dcee1b425a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.552217 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d0701f42-94bb-4c1f-81eb-12dcee1b425a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1316 microversion: 2.1 time: 1.151233 Oct 29 02:49:16.552823 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 578/1191] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:15 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1316 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:16.859728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bf22e2af-1fee-4886-a04c-09f10481cb7b tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Calling method '.version_select at 0x7fe1a898adc0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:16.862547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf22e2af-1fee-4886-a04c-09f10481cb7b tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.863379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf22e2af-1fee-4886-a04c-09f10481cb7b tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.863679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf22e2af-1fee-4886-a04c-09f10481cb7b tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.912758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf22e2af-1fee-4886-a04c-09f10481cb7b tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.914642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf22e2af-1fee-4886-a04c-09f10481cb7b tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.915240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf22e2af-1fee-4886-a04c-09f10481cb7b tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.966269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf22e2af-1fee-4886-a04c-09f10481cb7b tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.967648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf22e2af-1fee-4886-a04c-09f10481cb7b tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.970358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf22e2af-1fee-4886-a04c-09f10481cb7b tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.986036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.991794 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bf22e2af-1fee-4886-a04c-09f10481cb7b tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.435527 Oct 29 02:49:16.993554 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 579/1192] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:16.996687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.001188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.008676 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7e1e248-f97b-49ee-9efb-fca0ab61d110 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.709852 Oct 29 02:49:17.010256 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 614/1193] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:16 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:17.086041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.087982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:17.100252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.100945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.101543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.102438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.108785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.113231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.202589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-91f51aaa-cf6b-4468-8a54-b2863e2effc0 tempest-HypervisorAdminNegativeUnderV252Test-569818193 tempest-HypervisorAdminNegativeUnderV252Test-569818193-project] Calling method '.version_select at 0x7fe1a898a940>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.204399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-91f51aaa-cf6b-4468-8a54-b2863e2effc0 tempest-HypervisorAdminNegativeUnderV252Test-569818193 tempest-HypervisorAdminNegativeUnderV252Test-569818193-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '740b5a7d816a442ba6bc1d3485d19651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055a9687dc4e43f09eb779a2153b0665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-91f51aaa-cf6b-4468-8a54-b2863e2effc0 tempest-HypervisorAdminNegativeUnderV252Test-569818193 tempest-HypervisorAdminNegativeUnderV252Test-569818193-project] Request method failure captured: Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hypervisors/n-h2-862964-4/search HTTP/1.1 Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJSq0HCBci_ZB8RV5GxTPm0ri87sC1W7uJ2nqjpg4dDj4kg2RfdKOKr2WY2Hmw421kdYpTdl6apfJf_aPn4nnFim88dEGsyuk-_BstLMkKjwxJQzj2ka7yxh8C27DrV0D6LvwoHm-PGH2Jb_YdPTvbKtHrD5c2R-jrd10cM9irswSDs Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 055a9687dc4e43f09eb779a2153b0665 Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-569818193 Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:49:17.206151 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/055a9687dc4e43f09eb779a2153b0665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/055a9687dc4e43f09eb779a2153b0665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_055a9687dc4e43f09eb779a2153b0665", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/055a9687dc4e43f09eb779a2153b0665"}]}] Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-569818193 Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 055a9687dc4e43f09eb779a2153b0665 Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-569818193 Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-569818193-project Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 740b5a7d816a442ba6bc1d3485d19651 Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-569818193-project Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 02:49:17.207720 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'n-h2-862964-4'} Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:49:17.208609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 02:49:17.210089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.211178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-91f51aaa-cf6b-4468-8a54-b2863e2effc0 tempest-HypervisorAdminNegativeUnderV252Test-569818193 tempest-HypervisorAdminNegativeUnderV252Test-569818193-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:17.211178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-91f51aaa-cf6b-4468-8a54-b2863e2effc0 tempest-HypervisorAdminNegativeUnderV252Test-569818193 tempest-HypervisorAdminNegativeUnderV252Test-569818193-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h2-862964-4/search" status: 403 len: 117 microversion: 2.1 time: 0.206964 Oct 29 02:49:17.211178 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 580/1194] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Oct 29 02:49:16 2022] GET /compute/v2.1/os-hypervisors/n-h2-862964-4/search => generated 117 bytes in 208 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:49:17.219074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f0da73b-bfd1-406c-acf2-bd730fcb64eb tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Calling method '.version_select at 0x7fe1a8947940>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.222711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f0da73b-bfd1-406c-acf2-bd730fcb64eb tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.223394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f0da73b-bfd1-406c-acf2-bd730fcb64eb tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.224066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f0da73b-bfd1-406c-acf2-bd730fcb64eb tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.251003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-0f0da73b-bfd1-406c-acf2-bd730fcb64eb tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f0da73b-bfd1-406c-acf2-bd730fcb64eb tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Request method failure captured: Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJSslKIEnVcKT4YbsPTaAhkPxhyO4jlt0ACgRnTLk4aJfhIY4zafcvn2nCohvmDTCAyu81R669vjlAH9koFM5-BuDnBJwPDBoA0yABUukuzmokjkuugWlHuZoKzvR77lGnqztqFOK9_uGz7KKmkiWtQMQI9ZSFJXzKNvFXPDU02zj2s Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: cff2e93dd71c4a1cbe60bd5230c23f39 Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1917979080 Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:49:17.257607 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cff2e93dd71c4a1cbe60bd5230c23f39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cff2e93dd71c4a1cbe60bd5230c23f39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cff2e93dd71c4a1cbe60bd5230c23f39", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cff2e93dd71c4a1cbe60bd5230c23f39"}]}] Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1917979080 Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: cff2e93dd71c4a1cbe60bd5230c23f39 Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1917979080 Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 11b7b38e35ea4e6ab4e50dcacc4cfd66 Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 02:49:17.259155 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.259921 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.264731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.264731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:17.264731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:17.264731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 02:49:17.264731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.266963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f0da73b-bfd1-406c-acf2-bd730fcb64eb tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:17.270247 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f0da73b-bfd1-406c-acf2-bd730fcb64eb tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.055150 Oct 29 02:49:17.271342 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 581/1195] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 02:49:17 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:17.281204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-61e6f840-11db-4ed2-ab42-011a317d60dd tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Calling method '.version_select at 0x7fe1a8a08790>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.283472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e6f840-11db-4ed2-ab42-011a317d60dd tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.284203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e6f840-11db-4ed2-ab42-011a317d60dd tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.284867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e6f840-11db-4ed2-ab42-011a317d60dd tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.313592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.319393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e6f840-11db-4ed2-ab42-011a317d60dd tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.320537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e6f840-11db-4ed2-ab42-011a317d60dd tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.327998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e6f840-11db-4ed2-ab42-011a317d60dd tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.329003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.330467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.352265 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3923c5e8-88eb-401b-af63-7805ef628e45 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.270473 Oct 29 02:49:17.363855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e6f840-11db-4ed2-ab42-011a317d60dd tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.367614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e6f840-11db-4ed2-ab42-011a317d60dd tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.371149 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 615/1196] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:17 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:17.371759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61e6f840-11db-4ed2-ab42-011a317d60dd tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.385632 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-61e6f840-11db-4ed2-ab42-011a317d60dd tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.109283 Oct 29 02:49:17.394171 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 582/1197] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:49:17.409080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ae69b798-10c4-4391-a42f-38d88c4d7c65 tempest-HypervisorAdminNegativeUnderV252Test-569818193 tempest-HypervisorAdminNegativeUnderV252Test-569818193-project] Calling method '.version_select at 0x7fe1a87931f0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.411835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ae69b798-10c4-4391-a42f-38d88c4d7c65 tempest-HypervisorAdminNegativeUnderV252Test-569818193 tempest-HypervisorAdminNegativeUnderV252Test-569818193-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '740b5a7d816a442ba6bc1d3485d19651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055a9687dc4e43f09eb779a2153b0665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ae69b798-10c4-4391-a42f-38d88c4d7c65 tempest-HypervisorAdminNegativeUnderV252Test-569818193 tempest-HypervisorAdminNegativeUnderV252Test-569818193-project] Request method failure captured: Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJSq0HCBci_ZB8RV5GxTPm0ri87sC1W7uJ2nqjpg4dDj4kg2RfdKOKr2WY2Hmw421kdYpTdl6apfJf_aPn4nnFim88dEGsyuk-_BstLMkKjwxJQzj2ka7yxh8C27DrV0D6LvwoHm-PGH2Jb_YdPTvbKtHrD5c2R-jrd10cM9irswSDs Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 055a9687dc4e43f09eb779a2153b0665 Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-569818193 Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:17.413852 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/055a9687dc4e43f09eb779a2153b0665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/055a9687dc4e43f09eb779a2153b0665"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_055a9687dc4e43f09eb779a2153b0665", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/055a9687dc4e43f09eb779a2153b0665"}]}] Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-569818193 Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 055a9687dc4e43f09eb779a2153b0665 Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-569818193 Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-569818193-project Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 740b5a7d816a442ba6bc1d3485d19651 Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-569818193-project Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 02:49:17.415545 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1'} Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:49:17.416312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 02:49:17.417682 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.419080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ae69b798-10c4-4391-a42f-38d88c4d7c65 tempest-HypervisorAdminNegativeUnderV252Test-569818193 tempest-HypervisorAdminNegativeUnderV252Test-569818193-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:17.419847 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ae69b798-10c4-4391-a42f-38d88c4d7c65 tempest-HypervisorAdminNegativeUnderV252Test-569818193 tempest-HypervisorAdminNegativeUnderV252Test-569818193-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.018236 Oct 29 02:49:17.421358 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 616/1198] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Oct 29 02:49:17 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:17.432136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be128555-990f-408e-8c4b-b1c04fc6e90e tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Calling method '.version_select at 0x7fe1a8c0bf70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.436444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be128555-990f-408e-8c4b-b1c04fc6e90e tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.437586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be128555-990f-408e-8c4b-b1c04fc6e90e tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.440203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be128555-990f-408e-8c4b-b1c04fc6e90e tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.452657 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-be128555-990f-408e-8c4b-b1c04fc6e90e tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] HTTP exception thrown: No hypervisor matching '8071e927-45e7-4568-87a0-f3f6d9910016' could be found. Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be128555-990f-408e-8c4b-b1c04fc6e90e tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Request method failure captured: Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-hypervisors/8071e927-45e7-4568-87a0-f3f6d9910016/servers HTTP/1.1 Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJSslKIEnVcKT4YbsPTaAhkPxhyO4jlt0ACgRnTLk4aJfhIY4zafcvn2nCohvmDTCAyu81R669vjlAH9koFM5-BuDnBJwPDBoA0yABUukuzmokjkuugWlHuZoKzvR77lGnqztqFOK9_uGz7KKmkiWtQMQI9ZSFJXzKNvFXPDU02zj2s Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: cff2e93dd71c4a1cbe60bd5230c23f39 Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1917979080 Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 02:49:17.455253 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cff2e93dd71c4a1cbe60bd5230c23f39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cff2e93dd71c4a1cbe60bd5230c23f39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cff2e93dd71c4a1cbe60bd5230c23f39", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cff2e93dd71c4a1cbe60bd5230c23f39"}]}] Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1917979080 Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: cff2e93dd71c4a1cbe60bd5230c23f39 Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1917979080 Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 11b7b38e35ea4e6ab4e50dcacc4cfd66 Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: exception: No hypervisor matching '8071e927-45e7-4568-87a0-f3f6d9910016' could be found. Oct 29 02:49:17.456849 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '8071e927-45e7-4568-87a0-f3f6d9910016'} Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '8071e927-45e7-4568-87a0-f3f6d9910016' could be found. Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.457723 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.459159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.459159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.459159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:17.459159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:17.459159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '8071e927-45e7-4568-87a0-f3f6d9910016' could be found. Oct 29 02:49:17.459159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.460804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be128555-990f-408e-8c4b-b1c04fc6e90e tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] Returning 404 to user: No hypervisor matching '8071e927-45e7-4568-87a0-f3f6d9910016' could be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:17.461969 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be128555-990f-408e-8c4b-b1c04fc6e90e tempest-HypervisorAdminNegativeUnderV252Test-1917979080 tempest-HypervisorAdminNegativeUnderV252Test-1917979080-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/8071e927-45e7-4568-87a0-f3f6d9910016/servers" status: 404 len: 123 microversion: 2.1 time: 0.034788 Oct 29 02:49:17.463023 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 583/1199] 10.222.0.16 () {58 vars in 1281 bytes} [Sat Oct 29 02:49:17 2022] GET /compute/v2.1/os-hypervisors/8071e927-45e7-4568-87a0-f3f6d9910016/servers => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:17.596382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fbba74c8-fe82-4598-8bce-248e8ad460e5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.598824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fbba74c8-fe82-4598-8bce-248e8ad460e5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:17.629246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbba74c8-fe82-4598-8bce-248e8ad460e5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.639274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbba74c8-fe82-4598-8bce-248e8ad460e5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.644180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbba74c8-fe82-4598-8bce-248e8ad460e5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.646812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbba74c8-fe82-4598-8bce-248e8ad460e5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.649039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbba74c8-fe82-4598-8bce-248e8ad460e5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.652083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbba74c8-fe82-4598-8bce-248e8ad460e5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.941276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fbba74c8-fe82-4598-8bce-248e8ad460e5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.953096 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fbba74c8-fe82-4598-8bce-248e8ad460e5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1316 microversion: 2.1 time: 0.380054 Oct 29 02:49:17.963106 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 617/1200] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:17 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:18.020608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-662027202", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "2525c91e-f8df-4369-b3fa-9ce9342c6d85"}], "security_groups": [{"name": "tempest-securitygroup--34484326"}], "key_name": "tempest-keypair-1743298275", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:18.040287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.041387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:18.071692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.074803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.075983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.077103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.077744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.078934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.331784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.346534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.348631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.350132 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f0f6e4e2-54a9-4515-8dfe-62ffe14661ba tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.316027 Oct 29 02:49:18.351228 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 618/1201] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:49:18.356538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a4132fea-476b-4ad1-93d4-e162464b47c0 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Calling method '.version_select at 0x7fe1a86f81f0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.361056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4132fea-476b-4ad1-93d4-e162464b47c0 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.361829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4132fea-476b-4ad1-93d4-e162464b47c0 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.362475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4132fea-476b-4ad1-93d4-e162464b47c0 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.396916 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a4132fea-476b-4ad1-93d4-e162464b47c0 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.043717 Oct 29 02:49:18.400904 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 619/1202] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:18.421079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.432530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:18.439169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.439951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.440615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.441422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.441963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.442623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.503473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] validate_networks() for [('2525c91e-f8df-4369-b3fa-9ce9342c6d85', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:49:18.643479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.661457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.666400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.680337 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02de64a8-8ef5-44f0-8180-7b4c08621eba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.276874 Oct 29 02:49:18.697762 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 620/1203] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:18.697762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-88f29788-2a81-4283-8c86-2a1b695049d0 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.708767 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-88f29788-2a81-4283-8c86-2a1b695049d0 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023519 Oct 29 02:49:18.709435 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 621/1204] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:18.729162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-65c469ab-89bd-44ae-a05a-dd88682a924e tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1363039196", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:18.809191 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-65c469ab-89bd-44ae-a05a-dd88682a924e tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.086061 Oct 29 02:49:18.814998 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 622/1205] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Oct 29 02:49:18 2022] POST /compute/v2.1/flavors => generated 499 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:18.829017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cf494946-db4f-45d0-85cf-1ba1dfe37c69 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.872121 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cf494946-db4f-45d0-85cf-1ba1dfe37c69 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.044480 Oct 29 02:49:18.874531 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 623/1206] 10.222.0.16 () {58 vars in 1182 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:49:18.981515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-47292ed2-5277-4110-ad99-d56ef062f9ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.983504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-47292ed2-5277-4110-ad99-d56ef062f9ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:19.004105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47292ed2-5277-4110-ad99-d56ef062f9ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.004606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47292ed2-5277-4110-ad99-d56ef062f9ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.009214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47292ed2-5277-4110-ad99-d56ef062f9ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.016847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47292ed2-5277-4110-ad99-d56ef062f9ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.022768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47292ed2-5277-4110-ad99-d56ef062f9ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.025104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47292ed2-5277-4110-ad99-d56ef062f9ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.504513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-47292ed2-5277-4110-ad99-d56ef062f9ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:19.520177 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-47292ed2-5277-4110-ad99-d56ef062f9ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1316 microversion: 2.1 time: 0.545789 Oct 29 02:49:19.522630 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 624/1207] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1316 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:19.539960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f307d37e-0421-47bb-b682-8002be8ceb1c req-14b3ff0e-0f0e-4089-844f-a135752237f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c727c0d-2872-4ea2-b11c-64992077779c", "name": "network-vif-plugged", "status": "completed", "tag": "7a157939-10b2-4975-9408-c5f8c8de766e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:19.592214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f307d37e-0421-47bb-b682-8002be8ceb1c req-14b3ff0e-0f0e-4089-844f-a135752237f8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.592894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f307d37e-0421-47bb-b682-8002be8ceb1c req-14b3ff0e-0f0e-4089-844f-a135752237f8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.593820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f307d37e-0421-47bb-b682-8002be8ceb1c req-14b3ff0e-0f0e-4089-844f-a135752237f8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.625441 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f307d37e-0421-47bb-b682-8002be8ceb1c req-14b3ff0e-0f0e-4089-844f-a135752237f8 service nova] Creating event network-vif-plugged:7a157939-10b2-4975-9408-c5f8c8de766e for instance 3c727c0d-2872-4ea2-b11c-64992077779c on n-h2-862964-4 Oct 29 02:49:19.638605 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f307d37e-0421-47bb-b682-8002be8ceb1c req-14b3ff0e-0f0e-4089-844f-a135752237f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110309 Oct 29 02:49:19.643197 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 625/1208] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:19.662047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1170101057", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "ed145074-692f-45c8-91b5-a9951c6dac1a"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:19.827217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:49:20.318682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:20.320219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:20.321192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:20.321992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:20.322877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:20.344050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.344555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.345225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.346277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.347054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.347256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.389573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for project bb5aec15c4e844b2872c9eab52f69482. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:20.396027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for user efecedc77d3048c4a0ec0fe6701f9ccc and project bb5aec15c4e844b2872c9eab52f69482. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:20.411916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:49:20.414520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:49:20.428941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:20.471879 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-599b7069-332a-477b-a26f-57ad730e9217 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827086 Oct 29 02:49:20.472903 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 626/1209] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:49:20.491145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:20.491747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:20.510929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.511541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.511894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.512750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.513197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.513620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.912091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:20.931282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:20.934052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:20.935741 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9bd718a0-6ce6-449b-b523-0e69484f332d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.461618 Oct 29 02:49:20.939105 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 627/1210] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:20 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:20.949690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:20.951656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:20.966395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.967402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.968387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.970858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.972163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.973196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.088183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:21.088754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:21.090381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:21.091107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:21.091689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:21.103788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:21.115284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:21.117255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.117778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.118256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.119080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.119516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.122353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.123646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:21.133123 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-15d17b78-570d-4e25-8a2e-124853529a60 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.191085 Oct 29 02:49:21.134019 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 628/1211] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:20 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:21.146457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cec3b5dc-737d-4285-9ee9-4b7ea39d2518 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:21.147088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cec3b5dc-737d-4285-9ee9-4b7ea39d2518 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:21.154394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Getting quotas for project a1287e36822b48f9a9020375bd0da2ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:21.172585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Getting quotas for user 6c2aa25bffe3421e8a75d88388dd5441 and project a1287e36822b48f9a9020375bd0da2ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:21.195583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:49:21.211655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:49:21.273862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cec3b5dc-737d-4285-9ee9-4b7ea39d2518 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:21.309880 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cec3b5dc-737d-4285-9ee9-4b7ea39d2518 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1279 microversion: 2.1 time: 0.173249 Oct 29 02:49:21.311379 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5c1bf70f-aa6d-4c50-ae50-1947d3001559 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.292856 Oct 29 02:49:21.312949 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 629/1212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:21 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:21.320090 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 584/1213] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:18 2022] POST /compute/v2.1/servers => generated 404 bytes in 3304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:49:21.325406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29bdb864-d1ab-410c-bcb3-7d15b9d3277d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:21.325824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3725fbd5-8816-4a34-8908-2e1d2503fb92 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:21.326202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29bdb864-d1ab-410c-bcb3-7d15b9d3277d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:21.328240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3725fbd5-8816-4a34-8908-2e1d2503fb92 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:21.335488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29bdb864-d1ab-410c-bcb3-7d15b9d3277d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.336108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29bdb864-d1ab-410c-bcb3-7d15b9d3277d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.352357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29bdb864-d1ab-410c-bcb3-7d15b9d3277d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.353271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29bdb864-d1ab-410c-bcb3-7d15b9d3277d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.357065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29bdb864-d1ab-410c-bcb3-7d15b9d3277d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.357567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29bdb864-d1ab-410c-bcb3-7d15b9d3277d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.481757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3725fbd5-8816-4a34-8908-2e1d2503fb92 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:21.489560 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3725fbd5-8816-4a34-8908-2e1d2503fb92 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1234 microversion: 2.1 time: 0.167953 Oct 29 02:49:21.494439 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 585/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:21 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1234 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:21.507978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e87bf4c6-cfff-47d2-9777-9832604ea568 req-41885c79-216b-4b33-82c9-8d3c4a2aa3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d4d5fa-ae6a-43c5-970e-a6ab2610133d", "name": "network-vif-unplugged", "status": "completed", "tag": "8588516f-6e55-45e6-a304-2834e66e1413"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:21.521795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e87bf4c6-cfff-47d2-9777-9832604ea568 req-41885c79-216b-4b33-82c9-8d3c4a2aa3a2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.525256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e87bf4c6-cfff-47d2-9777-9832604ea568 req-41885c79-216b-4b33-82c9-8d3c4a2aa3a2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.525796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e87bf4c6-cfff-47d2-9777-9832604ea568 req-41885c79-216b-4b33-82c9-8d3c4a2aa3a2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.552390 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e87bf4c6-cfff-47d2-9777-9832604ea568 req-41885c79-216b-4b33-82c9-8d3c4a2aa3a2 service nova] Creating event network-vif-unplugged:8588516f-6e55-45e6-a304-2834e66e1413 for instance a6d4d5fa-ae6a-43c5-970e-a6ab2610133d on n-h2-862964-4 Oct 29 02:49:21.566296 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e87bf4c6-cfff-47d2-9777-9832604ea568 req-41885c79-216b-4b33-82c9-8d3c4a2aa3a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069521 Oct 29 02:49:21.569540 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 586/1215] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:21.700904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29bdb864-d1ab-410c-bcb3-7d15b9d3277d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:21.712609 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29bdb864-d1ab-410c-bcb3-7d15b9d3277d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1316 microversion: 2.1 time: 0.397031 Oct 29 02:49:21.727848 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 630/1216] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:21 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:21.972284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:21.974586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:21.986317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.992556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.994413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.000222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.003378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.005910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.167616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:22.168663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:22.177773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.178710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.179682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.180662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.181371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.182017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.412309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:22.436448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:22.442562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:22.451695 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3d60e47-671a-4595-939b-aa23e19a2275 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1537 microversion: 2.91 time: 0.290319 Oct 29 02:49:22.467608 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 631/1217] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:22 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1537 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:49:22.483018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-531675eb-c760-4d5c-ac29-65e8dcbc210f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:22.483773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-531675eb-c760-4d5c-ac29-65e8dcbc210f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:22.492918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531675eb-c760-4d5c-ac29-65e8dcbc210f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.493982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531675eb-c760-4d5c-ac29-65e8dcbc210f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.494660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531675eb-c760-4d5c-ac29-65e8dcbc210f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.496591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531675eb-c760-4d5c-ac29-65e8dcbc210f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.497468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531675eb-c760-4d5c-ac29-65e8dcbc210f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.498708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531675eb-c760-4d5c-ac29-65e8dcbc210f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.639651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-531675eb-c760-4d5c-ac29-65e8dcbc210f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:22.649714 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-531675eb-c760-4d5c-ac29-65e8dcbc210f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1331 microversion: 2.1 time: 0.180773 Oct 29 02:49:22.658127 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 632/1218] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:22 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1331 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:22.663612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eec65119-b78e-4bb8-a7c6-7da5ef127247 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:22.664225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eec65119-b78e-4bb8-a7c6-7da5ef127247 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:22.683960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec65119-b78e-4bb8-a7c6-7da5ef127247 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.684649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec65119-b78e-4bb8-a7c6-7da5ef127247 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.687235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec65119-b78e-4bb8-a7c6-7da5ef127247 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.688280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec65119-b78e-4bb8-a7c6-7da5ef127247 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.690914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec65119-b78e-4bb8-a7c6-7da5ef127247 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.691437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec65119-b78e-4bb8-a7c6-7da5ef127247 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.916929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eec65119-b78e-4bb8-a7c6-7da5ef127247 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:22.932850 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eec65119-b78e-4bb8-a7c6-7da5ef127247 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1230 microversion: 2.1 time: 0.273049 Oct 29 02:49:22.933582 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 633/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:22 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1230 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:22.959966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4efe9895-77ec-41f1-9a9c-18b1eb2806cb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:22.960615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4efe9895-77ec-41f1-9a9c-18b1eb2806cb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:22.967079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4efe9895-77ec-41f1-9a9c-18b1eb2806cb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.967584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4efe9895-77ec-41f1-9a9c-18b1eb2806cb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.968363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4efe9895-77ec-41f1-9a9c-18b1eb2806cb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.968758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4efe9895-77ec-41f1-9a9c-18b1eb2806cb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.969162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4efe9895-77ec-41f1-9a9c-18b1eb2806cb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.969587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4efe9895-77ec-41f1-9a9c-18b1eb2806cb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.224077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4efe9895-77ec-41f1-9a9c-18b1eb2806cb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:23.236656 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4efe9895-77ec-41f1-9a9c-18b1eb2806cb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1464 microversion: 2.1 time: 0.288778 Oct 29 02:49:23.255496 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 634/1220] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:22 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1464 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:23.265463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-531b76d1-3432-4d48-98db-0ac326ddf0e1 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:23.266423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-531b76d1-3432-4d48-98db-0ac326ddf0e1 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:23.268592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:23.293706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531b76d1-3432-4d48-98db-0ac326ddf0e1 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.295653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:23.295918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531b76d1-3432-4d48-98db-0ac326ddf0e1 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.297210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531b76d1-3432-4d48-98db-0ac326ddf0e1 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.298449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531b76d1-3432-4d48-98db-0ac326ddf0e1 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.300114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531b76d1-3432-4d48-98db-0ac326ddf0e1 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.301624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-531b76d1-3432-4d48-98db-0ac326ddf0e1 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.330978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:23.332404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:23.333568 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1cd2b7ff-f914-416d-8b59-afead61b1244 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 1.365735 Oct 29 02:49:23.359191 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 587/1221] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:21 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:23.490147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:23.491034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:23.510056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.512541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.512989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.514663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.515296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.516222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.798815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:23.813378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:23.817058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:23.825112 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-92570ca7-78ce-46d4-8e61-0844890ffa6e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1537 microversion: 2.91 time: 0.344000 Oct 29 02:49:23.838825 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 588/1222] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:23 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1537 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:23.854508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d9ce0272-456b-49b7-a4ab-d3a42e72a138 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:23.855373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d9ce0272-456b-49b7-a4ab-d3a42e72a138 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:23.861448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9ce0272-456b-49b7-a4ab-d3a42e72a138 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.862268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9ce0272-456b-49b7-a4ab-d3a42e72a138 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.862865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9ce0272-456b-49b7-a4ab-d3a42e72a138 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.863711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9ce0272-456b-49b7-a4ab-d3a42e72a138 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.864315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9ce0272-456b-49b7-a4ab-d3a42e72a138 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.864883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9ce0272-456b-49b7-a4ab-d3a42e72a138 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.095799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d9ce0272-456b-49b7-a4ab-d3a42e72a138 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:24.111810 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d9ce0272-456b-49b7-a4ab-d3a42e72a138 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1337 microversion: 2.1 time: 0.271460 Oct 29 02:49:24.115297 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 589/1223] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:23 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1337 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:24.201369 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-531b76d1-3432-4d48-98db-0ac326ddf0e1 tempest-ServersOnMultiNodesTest-415092441 tempest-ServersOnMultiNodesTest-415092441-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1615 microversion: 2.1 time: 0.944405 Oct 29 02:49:24.202123 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 635/1224] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:23 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1615 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:24.216177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a294df3f-3ab2-447e-9e49-b29eb5d160f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:24.217930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a294df3f-3ab2-447e-9e49-b29eb5d160f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:24.235665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a294df3f-3ab2-447e-9e49-b29eb5d160f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.238292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a294df3f-3ab2-447e-9e49-b29eb5d160f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.241144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a294df3f-3ab2-447e-9e49-b29eb5d160f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.243318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a294df3f-3ab2-447e-9e49-b29eb5d160f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.246677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a294df3f-3ab2-447e-9e49-b29eb5d160f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.247670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a294df3f-3ab2-447e-9e49-b29eb5d160f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.365408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d656352-9fda-42f7-88c9-33c9e594f797 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Calling method '.version_select at 0x7fe1a8947550>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:24.369459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a294df3f-3ab2-447e-9e49-b29eb5d160f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:24.384353 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a294df3f-3ab2-447e-9e49-b29eb5d160f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1286 microversion: 2.1 time: 0.178210 Oct 29 02:49:24.385431 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 636/1225] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:24 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:24.399397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c2afe334-78f2-44a8-b566-8560eba7949b req-cd2c6721-71e4-422f-bcf3-5b36df61268a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d4d5fa-ae6a-43c5-970e-a6ab2610133d", "tag": "8588516f-6e55-45e6-a304-2834e66e1413"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:24.426720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c2afe334-78f2-44a8-b566-8560eba7949b req-cd2c6721-71e4-422f-bcf3-5b36df61268a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.428160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c2afe334-78f2-44a8-b566-8560eba7949b req-cd2c6721-71e4-422f-bcf3-5b36df61268a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.429350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c2afe334-78f2-44a8-b566-8560eba7949b req-cd2c6721-71e4-422f-bcf3-5b36df61268a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.446030 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c2afe334-78f2-44a8-b566-8560eba7949b req-cd2c6721-71e4-422f-bcf3-5b36df61268a service nova] Creating event network-changed:8588516f-6e55-45e6-a304-2834e66e1413 for instance a6d4d5fa-ae6a-43c5-970e-a6ab2610133d on n-h2-862964-4 Oct 29 02:49:24.464278 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c2afe334-78f2-44a8-b566-8560eba7949b req-cd2c6721-71e4-422f-bcf3-5b36df61268a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076342 Oct 29 02:49:24.465084 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 637/1226] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:24.471396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8d4ce777-ee0a-4c89-b8a4-12251ae9d601 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:24.472041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8d4ce777-ee0a-4c89-b8a4-12251ae9d601 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:24.479450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d4ce777-ee0a-4c89-b8a4-12251ae9d601 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.480047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d4ce777-ee0a-4c89-b8a4-12251ae9d601 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.480670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d4ce777-ee0a-4c89-b8a4-12251ae9d601 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.481708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d4ce777-ee0a-4c89-b8a4-12251ae9d601 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.482337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d4ce777-ee0a-4c89-b8a4-12251ae9d601 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.482898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d4ce777-ee0a-4c89-b8a4-12251ae9d601 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.494756 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d656352-9fda-42f7-88c9-33c9e594f797 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686" status: 200 len: 371 microversion: 2.1 time: 0.378086 Oct 29 02:49:24.496007 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 590/1227] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 02:49:24 2022] GET /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686 => generated 371 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:24.507044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:24.507811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:24.508926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:24.515326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8d4ce777-ee0a-4c89-b8a4-12251ae9d601 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:24.533291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.533786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.534278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.535156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.536832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.537445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.652537 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8d4ce777-ee0a-4c89-b8a4-12251ae9d601 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 204 len: 0 microversion: 2.1 time: 0.185741 Oct 29 02:49:24.653560 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 638/1228] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:24 2022] DELETE /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:24.660291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ee1f8765-a8a9-4d49-91fd-600d697f6eba tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a87b5940>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:24.776292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1f8765-a8a9-4d49-91fd-600d697f6eba tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.776949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1f8765-a8a9-4d49-91fd-600d697f6eba tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.777560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1f8765-a8a9-4d49-91fd-600d697f6eba tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.779267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1f8765-a8a9-4d49-91fd-600d697f6eba tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.779912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1f8765-a8a9-4d49-91fd-600d697f6eba tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.780494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee1f8765-a8a9-4d49-91fd-600d697f6eba tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.868876 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ee1f8765-a8a9-4d49-91fd-600d697f6eba tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686" status: 200 len: 328 microversion: 2.1 time: 0.213577 Oct 29 02:49:24.884974 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 639/1229] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Oct 29 02:49:24 2022] PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686 => generated 328 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:24.890422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-699cf700-7e22-436b-9a35-a3858f5e3b45 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:24.891490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-699cf700-7e22-436b-9a35-a3858f5e3b45 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:24.900500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-699cf700-7e22-436b-9a35-a3858f5e3b45 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.901158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-699cf700-7e22-436b-9a35-a3858f5e3b45 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.901716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-699cf700-7e22-436b-9a35-a3858f5e3b45 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.902559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-699cf700-7e22-436b-9a35-a3858f5e3b45 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.903112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-699cf700-7e22-436b-9a35-a3858f5e3b45 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.903808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-699cf700-7e22-436b-9a35-a3858f5e3b45 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.953884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:24.964378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:24.968274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:24.971463 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0d6aab0a-92e2-4bbf-b66f-ec96075483e8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.474400 Oct 29 02:49:24.973400 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 591/1230] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:24 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:24.984964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:24.985862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:24.995719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.999104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.001854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.003740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.005622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.006080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.137788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:25.154964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:25.157160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:25.163682 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0341c5b6-989b-4b8d-b4af-d6caa3ed1cf9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1537 microversion: 2.91 time: 0.189039 Oct 29 02:49:25.173899 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 592/1231] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:24 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1537 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:25.215087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-699cf700-7e22-436b-9a35-a3858f5e3b45 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:25.225232 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-699cf700-7e22-436b-9a35-a3858f5e3b45 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1470 microversion: 2.1 time: 0.338998 Oct 29 02:49:25.242241 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 640/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:24 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:25.247453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e4438ce-ed93-4c09-9012-9bf8ac2c593c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:25.248270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e4438ce-ed93-4c09-9012-9bf8ac2c593c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:25.254677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e4438ce-ed93-4c09-9012-9bf8ac2c593c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.255416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e4438ce-ed93-4c09-9012-9bf8ac2c593c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.256424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e4438ce-ed93-4c09-9012-9bf8ac2c593c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.259186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e4438ce-ed93-4c09-9012-9bf8ac2c593c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.260960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e4438ce-ed93-4c09-9012-9bf8ac2c593c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.261692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e4438ce-ed93-4c09-9012-9bf8ac2c593c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.272636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1359793326", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:25.342162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:49:25.360846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2e4438ce-ed93-4c09-9012-9bf8ac2c593c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:25.383853 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e4438ce-ed93-4c09-9012-9bf8ac2c593c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1337 microversion: 2.1 time: 0.140342 Oct 29 02:49:25.403747 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 641/1233] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:25 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1337 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:25.416709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5262a4da-13ef-4cc7-af1d-fd8bb0bd49b1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:25.417322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5262a4da-13ef-4cc7-af1d-fd8bb0bd49b1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:25.433201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5262a4da-13ef-4cc7-af1d-fd8bb0bd49b1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.434022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5262a4da-13ef-4cc7-af1d-fd8bb0bd49b1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.434902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5262a4da-13ef-4cc7-af1d-fd8bb0bd49b1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.435829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5262a4da-13ef-4cc7-af1d-fd8bb0bd49b1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.436430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5262a4da-13ef-4cc7-af1d-fd8bb0bd49b1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.437253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5262a4da-13ef-4cc7-af1d-fd8bb0bd49b1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.517660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5262a4da-13ef-4cc7-af1d-fd8bb0bd49b1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:25.528547 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5262a4da-13ef-4cc7-af1d-fd8bb0bd49b1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1286 microversion: 2.1 time: 0.121165 Oct 29 02:49:25.529737 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 642/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:25 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:25.913695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:25.914358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:25.914545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:25.915155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:25.915706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:25.932839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.933491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.934104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.939342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.939977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.940565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.981422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Getting quotas for project 4f17887fd59d46d9b1cb91fafb9b6686. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:25.985829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Getting quotas for user 26101a06e33249dab84e17021a4a1fdc and project 4f17887fd59d46d9b1cb91fafb9b6686. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:26.001061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:26.002014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:26.012085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.012724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.014076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.016535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.018791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.utils [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] cores quota exceeded for 4f17887fd59d46d9b1cb91fafb9b6686, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127042) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 02:49:26.019569 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 02:49:26.020307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.020463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Request method failure captured: Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 145 Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJSyGgLEH1VI_YTUu8ylgyGiTvkJmVJ743JHCB2gyRCMluskyloRnD4mhijaGF96h2BTUdczt_ZQc3SPfWFoxU1q7x6VdDgmPDuSRl62g0Rd85bltUF-7hiByuYNtAg59Cf6MB_mUp5fbkLF8cIW4dfclNFfgEuDOfuO_UWWM7jVDdE Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4f17887fd59d46d9b1cb91fafb9b6686 Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:49:26.023316 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f17887fd59d46d9b1cb91fafb9b6686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f17887fd59d46d9b1cb91fafb9b6686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f17887fd59d46d9b1cb91fafb9b6686", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f17887fd59d46d9b1cb91fafb9b6686"}]}] Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4f17887fd59d46d9b1cb91fafb9b6686 Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-QuotasAdminNegativeTest-1098369246-project Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 26101a06e33249dab84e17021a4a1fdc Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-QuotasAdminNegativeTest-1098369246-project Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1359793326", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} Oct 29 02:49:26.024964 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1359793326', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452'}}} Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 02:49:26.025890 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:26.028716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:26.030770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:26.033308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:26.033308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:26.033308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:26.033308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:26.033308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 02:49:26.033308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:26.033308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:26.033308 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-663a8797-1ac1-4df1-a02e-d7c9449d5ff2 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.849023 Oct 29 02:49:26.038252 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 593/1235] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:25 2022] POST /compute/v2.1/servers => generated 111 bytes in 863 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:26.043054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a0b7ca85-070a-4fe0-ad87-b69609895534 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a8927a60>, body: {"quota_set": {"cores": 20}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:26.170149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0b7ca85-070a-4fe0-ad87-b69609895534 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.170880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0b7ca85-070a-4fe0-ad87-b69609895534 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.171478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0b7ca85-070a-4fe0-ad87-b69609895534 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.177902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0b7ca85-070a-4fe0-ad87-b69609895534 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.178742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0b7ca85-070a-4fe0-ad87-b69609895534 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.179323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0b7ca85-070a-4fe0-ad87-b69609895534 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.297832 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a0b7ca85-070a-4fe0-ad87-b69609895534 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686" status: 200 len: 329 microversion: 2.1 time: 0.258325 Oct 29 02:49:26.306465 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 594/1236] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Oct 29 02:49:26 2022] PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686 => generated 329 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:26.318112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:26.319199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:26.335640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.336130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.336559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.337302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.337718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.338159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.455409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.475891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.481621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.486348 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-46a3f67a-c30a-4675-8b44-62a6d4e554f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.488710 Oct 29 02:49:26.489900 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 643/1237] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:25 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:49:26.504759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-91a9b50c-533e-4325-a3bf-8227d8ca1369 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:26.509107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-91a9b50c-533e-4325-a3bf-8227d8ca1369 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:26.530867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91a9b50c-533e-4325-a3bf-8227d8ca1369 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.532698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91a9b50c-533e-4325-a3bf-8227d8ca1369 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.534701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91a9b50c-533e-4325-a3bf-8227d8ca1369 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.537873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91a9b50c-533e-4325-a3bf-8227d8ca1369 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.538692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91a9b50c-533e-4325-a3bf-8227d8ca1369 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.539912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91a9b50c-533e-4325-a3bf-8227d8ca1369 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.794110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-91a9b50c-533e-4325-a3bf-8227d8ca1369 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.807557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.814160 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-91a9b50c-533e-4325-a3bf-8227d8ca1369 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1470 microversion: 2.1 time: 0.314593 Oct 29 02:49:26.818152 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 644/1238] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:26 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1470 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:26.830953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af93619e-e8ea-4502-894f-c86f4bf91e81 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Calling method '.version_select at 0x7fe1a86a71f0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:26.841119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.873056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.892763 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ecb4a3b-cd76-494c-a714-bb5dabddd5af tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1537 microversion: 2.91 time: 0.584655 Oct 29 02:49:26.893370 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 595/1239] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:26 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1537 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:26.912804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f64e5e4c-cb88-465b-8e3a-baa595913122 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:26.913673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f64e5e4c-cb88-465b-8e3a-baa595913122 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:26.941925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f64e5e4c-cb88-465b-8e3a-baa595913122 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.945727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f64e5e4c-cb88-465b-8e3a-baa595913122 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.946355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f64e5e4c-cb88-465b-8e3a-baa595913122 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.947259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f64e5e4c-cb88-465b-8e3a-baa595913122 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.948779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f64e5e4c-cb88-465b-8e3a-baa595913122 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.949275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f64e5e4c-cb88-465b-8e3a-baa595913122 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.034724 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af93619e-e8ea-4502-894f-c86f4bf91e81 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686" status: 200 len: 371 microversion: 2.1 time: 0.215121 Oct 29 02:49:27.035231 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 645/1240] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 02:49:26 2022] GET /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686 => generated 371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:27.040325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9fb8d616-0e73-4744-9a04-bbfa617a74f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:27.054082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9fb8d616-0e73-4744-9a04-bbfa617a74f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:27.060870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb8d616-0e73-4744-9a04-bbfa617a74f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:27.061363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb8d616-0e73-4744-9a04-bbfa617a74f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:27.078540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb8d616-0e73-4744-9a04-bbfa617a74f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.079408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb8d616-0e73-4744-9a04-bbfa617a74f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:27.079893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb8d616-0e73-4744-9a04-bbfa617a74f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:27.080649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb8d616-0e73-4744-9a04-bbfa617a74f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.208233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f64e5e4c-cb88-465b-8e3a-baa595913122 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:27.208832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9fb8d616-0e73-4744-9a04-bbfa617a74f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:27.221072 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9fb8d616-0e73-4744-9a04-bbfa617a74f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1286 microversion: 2.1 time: 0.184317 Oct 29 02:49:27.222481 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f64e5e4c-cb88-465b-8e3a-baa595913122 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1337 microversion: 2.1 time: 0.323328 Oct 29 02:49:27.223329 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 596/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:26 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1337 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:27.234234 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 646/1242] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:27 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:27.238467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-288d6b79-1b4e-49da-af26-a28dd482aac3 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a8864310>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:27.382505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-288d6b79-1b4e-49da-af26-a28dd482aac3 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:27.386172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-288d6b79-1b4e-49da-af26-a28dd482aac3 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:27.387688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-288d6b79-1b4e-49da-af26-a28dd482aac3 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.388661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-288d6b79-1b4e-49da-af26-a28dd482aac3 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:27.389141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-288d6b79-1b4e-49da-af26-a28dd482aac3 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:27.394362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-288d6b79-1b4e-49da-af26-a28dd482aac3 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.514007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:27.515525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:27.528535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:27.529857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:27.532003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.534569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:27.535570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:27.537476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.575479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:27.601872 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-288d6b79-1b4e-49da-af26-a28dd482aac3 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686" status: 200 len: 328 microversion: 2.1 time: 0.377082 Oct 29 02:49:27.606707 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 597/1243] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Oct 29 02:49:27 2022] PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686 => generated 328 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:27.721287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2129566183", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:27.812094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:49:27.989498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.014108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.015979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.018711 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b8085dec-7630-4baa-addb-ea7c1c38dd65 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.510332 Oct 29 02:49:28.041090 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 647/1244] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:27 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:49:28.046401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-277f3780-565c-4ae7-bfa2-8cda0fd7e796 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:28.051552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-277f3780-565c-4ae7-bfa2-8cda0fd7e796 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:28.060557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-277f3780-565c-4ae7-bfa2-8cda0fd7e796 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:28.061276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-277f3780-565c-4ae7-bfa2-8cda0fd7e796 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:28.061882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-277f3780-565c-4ae7-bfa2-8cda0fd7e796 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:28.062739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-277f3780-565c-4ae7-bfa2-8cda0fd7e796 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:28.063349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-277f3780-565c-4ae7-bfa2-8cda0fd7e796 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:28.063919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-277f3780-565c-4ae7-bfa2-8cda0fd7e796 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:28.519634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-277f3780-565c-4ae7-bfa2-8cda0fd7e796 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.540258 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-277f3780-565c-4ae7-bfa2-8cda0fd7e796 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1470 microversion: 2.1 time: 0.491276 Oct 29 02:49:28.542066 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 648/1245] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:28 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1470 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:28.562988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:28.566565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:28.578102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:28.578840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:28.579514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:28.581236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:28.581751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:28.582451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:28.786074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.825487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.828826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.836180 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7647dd03-2500-43b8-b4b0-81d9dbd7451d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1540 microversion: 2.91 time: 0.292036 Oct 29 02:49:28.838224 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 649/1246] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:28 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1540 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:28.843354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1d3ca71f-73a6-4294-b34e-0e6be3ef75c7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:28.844214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1d3ca71f-73a6-4294-b34e-0e6be3ef75c7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:28.859122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d3ca71f-73a6-4294-b34e-0e6be3ef75c7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:28.859684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d3ca71f-73a6-4294-b34e-0e6be3ef75c7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:28.860224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d3ca71f-73a6-4294-b34e-0e6be3ef75c7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:28.861200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d3ca71f-73a6-4294-b34e-0e6be3ef75c7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:28.861736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d3ca71f-73a6-4294-b34e-0e6be3ef75c7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:28.862256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d3ca71f-73a6-4294-b34e-0e6be3ef75c7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.087789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:29.093900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:29.094671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:29.094978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:29.096568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:29.138229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.139607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.140484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.142028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.142780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.144007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.194392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Getting quotas for project 4f17887fd59d46d9b1cb91fafb9b6686. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:29.202354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Getting quotas for user 26101a06e33249dab84e17021a4a1fdc and project 4f17887fd59d46d9b1cb91fafb9b6686. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:29.246041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.utils [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] instances quota exceeded for 4f17887fd59d46d9b1cb91fafb9b6686, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127042) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 02:49:29.246989 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Request method failure captured: Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 145 Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJSyGgLEH1VI_YTUu8ylgyGiTvkJmVJ743JHCB2gyRCMluskyloRnD4mhijaGF96h2BTUdczt_ZQc3SPfWFoxU1q7x6VdDgmPDuSRl62g0Rd85bltUF-7hiByuYNtAg59Cf6MB_mUp5fbkLF8cIW4dfclNFfgEuDOfuO_UWWM7jVDdE Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4f17887fd59d46d9b1cb91fafb9b6686 Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:49:29.249209 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f17887fd59d46d9b1cb91fafb9b6686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f17887fd59d46d9b1cb91fafb9b6686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f17887fd59d46d9b1cb91fafb9b6686", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f17887fd59d46d9b1cb91fafb9b6686"}]}] Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4f17887fd59d46d9b1cb91fafb9b6686 Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-QuotasAdminNegativeTest-1098369246-project Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 26101a06e33249dab84e17021a4a1fdc Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-QuotasAdminNegativeTest-1098369246-project Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2129566183", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} Oct 29 02:49:29.250558 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2129566183', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452'}}} Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 02:49:29.251307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:29.252371 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:29.253576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:29.255057 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:29.255057 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:29.255057 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:29.255057 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:29.255057 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 02:49:29.255057 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:29.259959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:29.262016 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0cc93a3d-da05-4dd0-be34-d5ad08fce121 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.545104 Oct 29 02:49:29.264286 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 598/1247] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:27 2022] POST /compute/v2.1/servers => generated 119 bytes in 1548 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:49:29.278713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-58c1c4d8-8413-4d39-8939-0e0d5afbcdf2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:29.280877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-58c1c4d8-8413-4d39-8939-0e0d5afbcdf2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:29.299096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c1c4d8-8413-4d39-8939-0e0d5afbcdf2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.299673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c1c4d8-8413-4d39-8939-0e0d5afbcdf2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.300172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c1c4d8-8413-4d39-8939-0e0d5afbcdf2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.301626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c1c4d8-8413-4d39-8939-0e0d5afbcdf2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.302327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c1c4d8-8413-4d39-8939-0e0d5afbcdf2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.302865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c1c4d8-8413-4d39-8939-0e0d5afbcdf2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.581548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1d3ca71f-73a6-4294-b34e-0e6be3ef75c7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:29.597675 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1d3ca71f-73a6-4294-b34e-0e6be3ef75c7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1292 microversion: 2.1 time: 0.757983 Oct 29 02:49:29.599166 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 650/1248] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:28 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1292 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:29.604948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-53ef99c9-4b7c-4ef1-bb6f-a4f381226184 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:29.607777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-53ef99c9-4b7c-4ef1-bb6f-a4f381226184 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:29.615410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ef99c9-4b7c-4ef1-bb6f-a4f381226184 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.616134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ef99c9-4b7c-4ef1-bb6f-a4f381226184 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.616731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ef99c9-4b7c-4ef1-bb6f-a4f381226184 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.617612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ef99c9-4b7c-4ef1-bb6f-a4f381226184 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.618238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ef99c9-4b7c-4ef1-bb6f-a4f381226184 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.619126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ef99c9-4b7c-4ef1-bb6f-a4f381226184 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.731412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-53ef99c9-4b7c-4ef1-bb6f-a4f381226184 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-862964-4". {{(pid=127041) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 02:49:29.888303 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-53ef99c9-4b7c-4ef1-bb6f-a4f381226184 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec/action" status: 202 len: 0 microversion: 2.91 time: 0.285478 Oct 29 02:49:29.892806 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 651/1249] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:49:29 2022] POST /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:29.919543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:29.921362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:29.952449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.955329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.958866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.959866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.962196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.962762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.093016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-58c1c4d8-8413-4d39-8939-0e0d5afbcdf2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.104621 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-58c1c4d8-8413-4d39-8939-0e0d5afbcdf2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1379 microversion: 2.1 time: 0.838323 Oct 29 02:49:30.107156 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 599/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:29 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1379 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:30.133368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-14bfd3ca-431a-4e1f-b2db-21f8c6f909ae tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a8858670>, body: {"quota_set": {"instances": 10}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:30.332847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bfd3ca-431a-4e1f-b2db-21f8c6f909ae tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.333336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bfd3ca-431a-4e1f-b2db-21f8c6f909ae tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.333766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bfd3ca-431a-4e1f-b2db-21f8c6f909ae tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.341994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bfd3ca-431a-4e1f-b2db-21f8c6f909ae tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.342487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bfd3ca-431a-4e1f-b2db-21f8c6f909ae tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.342944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bfd3ca-431a-4e1f-b2db-21f8c6f909ae tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.395726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.432233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.436296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.453134 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-34a64f4c-ace4-4588-9759-defb8770253c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.556818 Oct 29 02:49:30.461858 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 652/1251] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:29 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:30.469824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:30.473651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:30.495424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.497571 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-14bfd3ca-431a-4e1f-b2db-21f8c6f909ae tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686" status: 200 len: 329 microversion: 2.1 time: 0.387043 Oct 29 02:49:30.508023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.508023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.508023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.510206 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 600/1252] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Oct 29 02:49:30 2022] PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686 => generated 329 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:30.511345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.511345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.524014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:30.535176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:30.562240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.562930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.568996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.571399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.574303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.577171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.608636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.609920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.611527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.612239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lazy-loading 'fault' on Instance uuid 3c727c0d-2872-4ea2-b11c-64992077779c {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:30.618032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:30.702228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.712002 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-173236b0-6096-4f34-8511-0e2e7e972ed2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 200 len: 1306 microversion: 2.1 time: 0.253047 Oct 29 02:49:30.714230 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 653/1253] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:30 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 1306 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:30.720592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-762d27cd-69a5-46ad-a8b0-87365f51bff2 req-c8a02636-e926-4388-b730-e0bb93c86332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c727c0d-2872-4ea2-b11c-64992077779c", "name": "network-vif-deleted", "tag": "7a157939-10b2-4975-9408-c5f8c8de766e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:30.737495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-762d27cd-69a5-46ad-a8b0-87365f51bff2 req-c8a02636-e926-4388-b730-e0bb93c86332 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.744090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-762d27cd-69a5-46ad-a8b0-87365f51bff2 req-c8a02636-e926-4388-b730-e0bb93c86332 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.744915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-762d27cd-69a5-46ad-a8b0-87365f51bff2 req-c8a02636-e926-4388-b730-e0bb93c86332 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.774629 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-762d27cd-69a5-46ad-a8b0-87365f51bff2 req-c8a02636-e926-4388-b730-e0bb93c86332 service nova] Creating event network-vif-deleted:7a157939-10b2-4975-9408-c5f8c8de766e for instance 3c727c0d-2872-4ea2-b11c-64992077779c on n-h2-862964-4 Oct 29 02:49:30.781763 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-762d27cd-69a5-46ad-a8b0-87365f51bff2 req-c8a02636-e926-4388-b730-e0bb93c86332 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065042 Oct 29 02:49:30.790538 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 654/1254] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:30.806181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e3214e8a-c6e0-4ecb-a664-b0c4fc31c878 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Calling method '.version_select at 0x7fe1a86fe790>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:30.851476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.870733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.877036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.889450 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2892d1db-6131-46f9-bf73-974b555b5204 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1488 microversion: 2.91 time: 0.374195 Oct 29 02:49:30.907339 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 601/1255] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:30 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1488 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:30.926136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e1368a60-4b65-4bea-ad6a-08fac908958b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:30.927546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e1368a60-4b65-4bea-ad6a-08fac908958b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:30.946231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1368a60-4b65-4bea-ad6a-08fac908958b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.946726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1368a60-4b65-4bea-ad6a-08fac908958b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.947159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1368a60-4b65-4bea-ad6a-08fac908958b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.947911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1368a60-4b65-4bea-ad6a-08fac908958b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.948360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1368a60-4b65-4bea-ad6a-08fac908958b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.949142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1368a60-4b65-4bea-ad6a-08fac908958b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.968118 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e3214e8a-c6e0-4ecb-a664-b0c4fc31c878 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686" status: 200 len: 371 microversion: 2.1 time: 0.175712 Oct 29 02:49:30.984757 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 655/1256] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 02:49:30 2022] GET /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686 => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:31.064363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ff87dc93-3414-458e-ab64-d57805c2cf15 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a87b5310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-680958770", "description": "tempest-description-775520363"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:31.280866 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ff87dc93-3414-458e-ab64-d57805c2cf15 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.294805 Oct 29 02:49:31.286378 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 656/1257] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:49:30 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:31.298407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c8fdf710-747b-468b-b833-2e55b68d1a7d tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a86f8c10>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:31.395799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8fdf710-747b-468b-b833-2e55b68d1a7d tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:31.396377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8fdf710-747b-468b-b833-2e55b68d1a7d tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:31.398064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8fdf710-747b-468b-b833-2e55b68d1a7d tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:31.399245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8fdf710-747b-468b-b833-2e55b68d1a7d tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:31.399796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8fdf710-747b-468b-b833-2e55b68d1a7d tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:31.400290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8fdf710-747b-468b-b833-2e55b68d1a7d tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:31.417361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:31.524047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e1368a60-4b65-4bea-ad6a-08fac908958b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:31.534060 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e1368a60-4b65-4bea-ad6a-08fac908958b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1292 microversion: 2.1 time: 0.624487 Oct 29 02:49:31.535887 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c8fdf710-747b-468b-b833-2e55b68d1a7d tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686" status: 200 len: 325 microversion: 2.1 time: 0.247982 Oct 29 02:49:31.553418 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 602/1258] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:30 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1292 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:31.563109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-188c1819-a662-4b86-afdd-2198caddaf8b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:31.563721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-188c1819-a662-4b86-afdd-2198caddaf8b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:31.566354 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 657/1259] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Oct 29 02:49:31 2022] PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686 => generated 325 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:31.581733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-188c1819-a662-4b86-afdd-2198caddaf8b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:31.583540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-188c1819-a662-4b86-afdd-2198caddaf8b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:31.583992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02196ce4-7b3a-44d1-b50d-87f774b6e82a tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a87b5940>, body: {"security_group_rule": {"parent_group_id": "f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:31.585210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-188c1819-a662-4b86-afdd-2198caddaf8b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:31.588305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-188c1819-a662-4b86-afdd-2198caddaf8b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:31.589002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-188c1819-a662-4b86-afdd-2198caddaf8b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:31.591510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-188c1819-a662-4b86-afdd-2198caddaf8b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.075795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-188c1819-a662-4b86-afdd-2198caddaf8b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.083768 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-188c1819-a662-4b86-afdd-2198caddaf8b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1379 microversion: 2.1 time: 0.529145 Oct 29 02:49:32.084368 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 603/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:31 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1379 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:32.102375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:32.103045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:32.119008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.119878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.120981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.121891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.123298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.124718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.233471 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02196ce4-7b3a-44d1-b50d-87f774b6e82a tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.661433 Oct 29 02:49:32.242248 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 658/1261] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:49:31 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:32.247459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1037582861", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:32.348711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:49:32.529986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.551000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.552589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.554668 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d77d4ed2-c760-4569-81aa-29351f1cb067 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.468668 Oct 29 02:49:32.556219 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 604/1262] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:32 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:32.561457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:32.562293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 3c727c0d-2872-4ea2-b11c-64992077779c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:32.583135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.589102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.589903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.590936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.591661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.592294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.624762 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] HTTP exception thrown: Instance 3c727c0d-2872-4ea2-b11c-64992077779c could not be found. Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Request method failure captured: Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c HTTP/1.1 Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQcdpT8JB8GrvvAJ61Yxe1jlfCECOh5sugNg5m64KLROk1GsYWS0LZYnuqGvCgF6T5ipecgpuIJ1pa8J_NGPz1f8AEuzcC4jHyMs4ppIRkZE4j2YKuif_5zJmkugQyuc0qpZy_xKmnOmxvJsusF0EbAIU9HMx6aOM6uQ5Gkn2pdf9w Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:49:32.626504 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1031cc111cc747098bbc8a428c1cfad6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}] Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fa30f68a081646d6b452d1cdf6e0181c Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3c727c0d-2872-4ea2-b11c-64992077779c could not be found. Oct 29 02:49:32.627819 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3c727c0d-2872-4ea2-b11c-64992077779c'} Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c727c0d-2872-4ea2-b11c-64992077779c could not be found. Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:32.628588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c727c0d-2872-4ea2-b11c-64992077779c could not be found. Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c727c0d-2872-4ea2-b11c-64992077779c could not be found. Oct 29 02:49:32.629979 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:32.632780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Returning 404 to user: Instance 3c727c0d-2872-4ea2-b11c-64992077779c could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:32.632780 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90db5a5d-d901-4180-872f-17af99c4027d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c" status: 404 len: 111 microversion: 2.1 time: 0.071860 Oct 29 02:49:32.642238 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 605/1263] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:32 2022] GET /compute/v2.1/servers/3c727c0d-2872-4ea2-b11c-64992077779c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:32.647558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:32.649521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:32.658634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.659212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.659707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.660728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.661585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.662491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.807504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.858767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.875201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.890806 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-41cbc760-2215-4d88-b30a-79f11a46617b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.246722 Oct 29 02:49:32.908444 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 606/1264] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:32 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:32.908444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-62c2719c-3abf-4cfe-80d5-72c49764e342 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a88e6e50>, body: {"security_group_rule": {"parent_group_id": "f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:32.973570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:32.974077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:32.974601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:32.975350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:32.976001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:32.995822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.996606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.999366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.000367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.003148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.003773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.048387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Getting quotas for project 4f17887fd59d46d9b1cb91fafb9b6686. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:33.062570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Getting quotas for user 26101a06e33249dab84e17021a4a1fdc and project 4f17887fd59d46d9b1cb91fafb9b6686. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:33.076937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.utils [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] ram quota exceeded for 4f17887fd59d46d9b1cb91fafb9b6686, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127041) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 02:49:33.077767 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Request method failure captured: Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 145 Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJSyGgLEH1VI_YTUu8ylgyGiTvkJmVJ743JHCB2gyRCMluskyloRnD4mhijaGF96h2BTUdczt_ZQc3SPfWFoxU1q7x6VdDgmPDuSRl62g0Rd85bltUF-7hiByuYNtAg59Cf6MB_mUp5fbkLF8cIW4dfclNFfgEuDOfuO_UWWM7jVDdE Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4f17887fd59d46d9b1cb91fafb9b6686 Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:33.081686 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f17887fd59d46d9b1cb91fafb9b6686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f17887fd59d46d9b1cb91fafb9b6686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f17887fd59d46d9b1cb91fafb9b6686", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f17887fd59d46d9b1cb91fafb9b6686"}]}] Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4f17887fd59d46d9b1cb91fafb9b6686 Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-QuotasAdminNegativeTest-1098369246-project Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 26101a06e33249dab84e17021a4a1fdc Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-QuotasAdminNegativeTest-1098369246-project Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1037582861", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} Oct 29 02:49:33.083435 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1037582861', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452'}}} Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 02:49:33.084307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:33.086004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.088565 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:33.091109 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:33.091109 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:33.091109 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:33.091109 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:33.091109 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 02:49:33.091109 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.091109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:33.091999 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ba6c725e-7851-4edb-a6b1-23891efac108 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.851571 Oct 29 02:49:33.093526 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 659/1265] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:32 2022] POST /compute/v2.1/servers => generated 110 bytes in 854 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:33.106087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d2c8bf6e-ea8f-4f30-be59-8093b3760745 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.109432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d2c8bf6e-ea8f-4f30-be59-8093b3760745 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:33.130580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf6e-ea8f-4f30-be59-8093b3760745 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.131154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf6e-ea8f-4f30-be59-8093b3760745 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.131860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf6e-ea8f-4f30-be59-8093b3760745 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.132809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf6e-ea8f-4f30-be59-8093b3760745 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.133669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf6e-ea8f-4f30-be59-8093b3760745 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.134263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf6e-ea8f-4f30-be59-8093b3760745 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.278097 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-62c2719c-3abf-4cfe-80d5-72c49764e342 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] HTTP exception thrown: This rule already exists in group f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47 Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-62c2719c-3abf-4cfe-80d5-72c49764e342 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Request method failure captured: Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 138 Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJS6Flve33mwglP6GNYw_sa1_Xz2UZ-iaA5RlQ3qZZTHgG65cA23dlM1Adna5uvawIOJN7cXeaTmH1PMfADj1JFlzyWHQiwV_4kNltuFu9X9HYTXVdhY5oZT9VB5_B5ZqPZErH-9GT6_JJoCVDkGHSj8MvPgy0GjJBf5UIbqYrpQxPc Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:49:33.282931 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4e6814941f64857a662c3ddc0ec9ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}] Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 10d0adc7068a4f82828a344e3f18d2db Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: {"security_group_rule": {"parent_group_id": "f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 02:49:33.284623 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: exception: This rule already exists in group f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47 Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47 Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:33.285537 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47 Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47 Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:33.287026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-62c2719c-3abf-4cfe-80d5-72c49764e342 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Returning 400 to user: This rule already exists in group f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47 {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:33.288179 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-62c2719c-3abf-4cfe-80d5-72c49764e342 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.389596 Oct 29 02:49:33.289691 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 607/1266] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:49:32 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 393 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:49:33.295144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-680d8fd7-92e4-46e7-83c3-1cb422b5c01a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.295749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-680d8fd7-92e4-46e7-83c3-1cb422b5c01a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:33.306128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680d8fd7-92e4-46e7-83c3-1cb422b5c01a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.306696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680d8fd7-92e4-46e7-83c3-1cb422b5c01a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.307195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680d8fd7-92e4-46e7-83c3-1cb422b5c01a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.308033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680d8fd7-92e4-46e7-83c3-1cb422b5c01a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.308553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680d8fd7-92e4-46e7-83c3-1cb422b5c01a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.309040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680d8fd7-92e4-46e7-83c3-1cb422b5c01a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.346030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-680d8fd7-92e4-46e7-83c3-1cb422b5c01a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:33.364517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d2c8bf6e-ea8f-4f30-be59-8093b3760745 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:33.376025 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d2c8bf6e-ea8f-4f30-be59-8093b3760745 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1358 microversion: 2.1 time: 0.276934 Oct 29 02:49:33.376627 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 660/1267] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:33 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:33.398785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-205abf02-1ed7-4a60-b47a-2152e8dca0cf tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a8655b80>, body: {"quota_set": {"ram": 51200}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:33.461686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:33.500851 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-680d8fd7-92e4-46e7-83c3-1cb422b5c01a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 204 len: 0 microversion: 2.1 time: 0.209477 Oct 29 02:49:33.502197 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 608/1268] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:33 2022] DELETE /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:33.510059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1baecba6-1397-4c1f-b579-eefca620136d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.511157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1baecba6-1397-4c1f-b579-eefca620136d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:33.518543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1baecba6-1397-4c1f-b579-eefca620136d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.519331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1baecba6-1397-4c1f-b579-eefca620136d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.519986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1baecba6-1397-4c1f-b579-eefca620136d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.520899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1baecba6-1397-4c1f-b579-eefca620136d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.521521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1baecba6-1397-4c1f-b579-eefca620136d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.522288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1baecba6-1397-4c1f-b579-eefca620136d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.832783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-205abf02-1ed7-4a60-b47a-2152e8dca0cf tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.833448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-205abf02-1ed7-4a60-b47a-2152e8dca0cf tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.834812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-205abf02-1ed7-4a60-b47a-2152e8dca0cf tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.838089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-205abf02-1ed7-4a60-b47a-2152e8dca0cf tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.839027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-205abf02-1ed7-4a60-b47a-2152e8dca0cf tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.844797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-205abf02-1ed7-4a60-b47a-2152e8dca0cf tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.965508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1baecba6-1397-4c1f-b579-eefca620136d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:33.976397 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1baecba6-1397-4c1f-b579-eefca620136d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1379 microversion: 2.1 time: 0.472599 Oct 29 02:49:33.976994 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 609/1269] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:33 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1379 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:34.004714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-53e98702-4654-47f6-bd4d-1c6ba8e03dbc tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Calling method '.version_select at 0x7fe1a8952310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:34.504646 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-205abf02-1ed7-4a60-b47a-2152e8dca0cf tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686" status: 200 len: 329 microversion: 2.1 time: 1.125159 Oct 29 02:49:34.514314 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 661/1270] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Oct 29 02:49:33 2022] PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686 => generated 329 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:34.514314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-55e41b99-44d6-4db8-bbf1-8742457c19a6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:34.518182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-55e41b99-44d6-4db8-bbf1-8742457c19a6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:34.558505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55e41b99-44d6-4db8-bbf1-8742457c19a6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:34.560363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55e41b99-44d6-4db8-bbf1-8742457c19a6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:34.560993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55e41b99-44d6-4db8-bbf1-8742457c19a6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:34.565345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55e41b99-44d6-4db8-bbf1-8742457c19a6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:34.567872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55e41b99-44d6-4db8-bbf1-8742457c19a6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:34.568919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55e41b99-44d6-4db8-bbf1-8742457c19a6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:34.923504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-55e41b99-44d6-4db8-bbf1-8742457c19a6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:34.934049 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-55e41b99-44d6-4db8-bbf1-8742457c19a6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1472 microversion: 2.1 time: 0.425340 Oct 29 02:49:34.940615 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 662/1271] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:34 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1472 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:34.959063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:34.967363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:34.988080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:34.989833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:34.993981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:34.995810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.003399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.004643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.125910 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-53e98702-4654-47f6-bd4d-1c6ba8e03dbc tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/621eb2b6-7399-4a0e-b7fe-439d414cb282" status: 202 len: 0 microversion: 2.1 time: 1.130201 Oct 29 02:49:35.126980 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 610/1272] 10.222.0.16 () {58 vars in 1287 bytes} [Sat Oct 29 02:49:33 2022] DELETE /compute/v2.1/os-security-group-rules/621eb2b6-7399-4a0e-b7fe-439d414cb282 => generated 0 bytes in 1149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:35.132355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:35.133047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:35.152309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.155379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.156095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.161014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.165013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.165841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.378789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:35.394645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:35.400144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:35.418521 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1eece67a-a1f3-4109-9c33-e8053c154ad3 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.287692 Oct 29 02:49:35.421124 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 611/1273] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:35 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:35.431729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-293879ba-5fe9-41ac-ae6c-9271ad191c4a req-e6358b76-9b54-4b85-94c5-488da475be10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ce5a89-9c05-4459-9e6f-a94249149f0e", "tag": "55f158e4-c02f-4621-aef5-0df1f9eb6596"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:35.463868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-293879ba-5fe9-41ac-ae6c-9271ad191c4a req-e6358b76-9b54-4b85-94c5-488da475be10 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.464377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-293879ba-5fe9-41ac-ae6c-9271ad191c4a req-e6358b76-9b54-4b85-94c5-488da475be10 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.478350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-293879ba-5fe9-41ac-ae6c-9271ad191c4a req-e6358b76-9b54-4b85-94c5-488da475be10 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.511441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:35.527442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:35.529231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:35.532203 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-173a3a57-0233-40d6-a5d8-59851cf01497 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.590063 Oct 29 02:49:35.534707 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 663/1274] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:34 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:35.538149 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-293879ba-5fe9-41ac-ae6c-9271ad191c4a req-e6358b76-9b54-4b85-94c5-488da475be10 service nova] Creating event network-changed:55f158e4-c02f-4621-aef5-0df1f9eb6596 for instance 86ce5a89-9c05-4459-9e6f-a94249149f0e on n-h2-862964-4 Oct 29 02:49:35.541385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f21e155c-5879-4b72-9df6-650b277b00a8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:35.547010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f21e155c-5879-4b72-9df6-650b277b00a8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:35.553622 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-293879ba-5fe9-41ac-ae6c-9271ad191c4a req-e6358b76-9b54-4b85-94c5-488da475be10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129669 Oct 29 02:49:35.563063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f21e155c-5879-4b72-9df6-650b277b00a8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.563206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f21e155c-5879-4b72-9df6-650b277b00a8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.566274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f21e155c-5879-4b72-9df6-650b277b00a8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.570169 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 612/1275] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:35.571477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f21e155c-5879-4b72-9df6-650b277b00a8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.571998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f21e155c-5879-4b72-9df6-650b277b00a8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.572447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f21e155c-5879-4b72-9df6-650b277b00a8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.585782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85def9c9-f0c3-4728-b766-2e84b1cbc676 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Action: 'update', calling method: .version_select at 0x7fe1a8944310>, body: {"quota_set": {"ram": 0}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:35.597671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-85def9c9-f0c3-4728-b766-2e84b1cbc676 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '26101a06e33249dab84e17021a4a1fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17887fd59d46d9b1cb91fafb9b6686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85def9c9-f0c3-4728-b766-2e84b1cbc676 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Request method failure captured: Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: request: PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686 HTTP/1.1 Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 25 Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJSyGgLEH1VI_YTUu8ylgyGiTvkJmVJ743JHCB2gyRCMluskyloRnD4mhijaGF96h2BTUdczt_ZQc3SPfWFoxU1q7x6VdDgmPDuSRl62g0Rd85bltUF-7hiByuYNtAg59Cf6MB_mUp5fbkLF8cIW4dfclNFfgEuDOfuO_UWWM7jVDdE Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4f17887fd59d46d9b1cb91fafb9b6686 Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:49:35.607035 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f17887fd59d46d9b1cb91fafb9b6686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f17887fd59d46d9b1cb91fafb9b6686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f17887fd59d46d9b1cb91fafb9b6686", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f17887fd59d46d9b1cb91fafb9b6686"}]}] Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4f17887fd59d46d9b1cb91fafb9b6686 Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1098369246 Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-QuotasAdminNegativeTest-1098369246-project Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 26101a06e33249dab84e17021a4a1fdc Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-QuotasAdminNegativeTest-1098369246-project Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: {"quota_set": {"ram": 0}} Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 02:49:35.608913 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '4f17887fd59d46d9b1cb91fafb9b6686', 'body': {'quota_set': {'ram': 0}}} Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:35.610134 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:35.611721 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:35.613326 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:35.613326 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:35.613326 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:49:35.613326 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:49:35.613326 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 02:49:35.613326 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:35.615348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85def9c9-f0c3-4728-b766-2e84b1cbc676 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:35.616898 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-85def9c9-f0c3-4728-b766-2e84b1cbc676 tempest-QuotasAdminNegativeTest-1098369246 tempest-QuotasAdminNegativeTest-1098369246-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686" status: 403 len: 116 microversion: 2.1 time: 0.042301 Oct 29 02:49:35.620986 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 613/1276] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Oct 29 02:49:35 2022] PUT /compute/v2.1/os-quota-sets/4f17887fd59d46d9b1cb91fafb9b6686 => generated 116 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:35.633310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-89e05eff-58fa-4522-8261-ff35fdfabf34 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:35.637176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-89e05eff-58fa-4522-8261-ff35fdfabf34 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:35.660458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89e05eff-58fa-4522-8261-ff35fdfabf34 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.661226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89e05eff-58fa-4522-8261-ff35fdfabf34 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.661845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89e05eff-58fa-4522-8261-ff35fdfabf34 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.662786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89e05eff-58fa-4522-8261-ff35fdfabf34 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.663419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89e05eff-58fa-4522-8261-ff35fdfabf34 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.664651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89e05eff-58fa-4522-8261-ff35fdfabf34 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:36.937567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f21e155c-5879-4b72-9df6-650b277b00a8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:36.955181 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f21e155c-5879-4b72-9df6-650b277b00a8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1358 microversion: 2.1 time: 1.414232 Oct 29 02:49:36.957781 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 664/1277] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:35 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1358 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:36.978592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2631d156-ba35-455b-a20c-61eb88eef322 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a87880d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-808883738", "description": "tempest-description-1352078786"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:37.432761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-89e05eff-58fa-4522-8261-ff35fdfabf34 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:37.453495 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-89e05eff-58fa-4522-8261-ff35fdfabf34 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1379 microversion: 2.1 time: 1.828016 Oct 29 02:49:37.466327 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 614/1278] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:35 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1379 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:37.481907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:37.492920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:37.518052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.518465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.518901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.519614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.520064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.539765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.653074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.653574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.654041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.654501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lazy-loading 'fault' on Instance uuid 49192f24-c094-4830-9245-aaf0fc79a197 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:37.915609 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2631d156-ba35-455b-a20c-61eb88eef322 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.956455 Oct 29 02:49:37.917498 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 665/1279] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:49:36 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:37.923232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:37.926621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:37.946761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.947477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.947582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.948279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.948731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.963885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.102458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:38.115055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:38.121268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:38.155556 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d25ddd6-779f-4f19-90a3-0f0edb02aac4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.233231 Oct 29 02:49:38.185354 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 666/1280] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:37 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:38.193509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:38.196330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:38.208549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.212188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.213727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.217425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.218515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.223591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.387927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:38.398976 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-828ab2bd-8f7a-405e-a1ae-d6bca31de11d tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 200 len: 1307 microversion: 2.1 time: 0.929240 Oct 29 02:49:38.400029 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 615/1281] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:37 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 1307 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:38.406427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-40110992-b3e0-4088-83c4-212b7bf9d62c req-19cfff86-a07c-4a7a-84ff-630fe7a827cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49192f24-c094-4830-9245-aaf0fc79a197", "name": "network-vif-deleted", "tag": "e49d1e2e-7a45-4ba0-9082-ae77df060e71"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:38.435669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-40110992-b3e0-4088-83c4-212b7bf9d62c req-19cfff86-a07c-4a7a-84ff-630fe7a827cf service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.436505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-40110992-b3e0-4088-83c4-212b7bf9d62c req-19cfff86-a07c-4a7a-84ff-630fe7a827cf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.436928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-40110992-b3e0-4088-83c4-212b7bf9d62c req-19cfff86-a07c-4a7a-84ff-630fe7a827cf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.458012 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-40110992-b3e0-4088-83c4-212b7bf9d62c req-19cfff86-a07c-4a7a-84ff-630fe7a827cf service nova] Creating event network-vif-deleted:e49d1e2e-7a45-4ba0-9082-ae77df060e71 for instance 49192f24-c094-4830-9245-aaf0fc79a197 on n-h1-862964-4 Oct 29 02:49:38.464173 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-40110992-b3e0-4088-83c4-212b7bf9d62c req-19cfff86-a07c-4a7a-84ff-630fe7a827cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061240 Oct 29 02:49:38.465113 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 616/1282] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:38.471249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-3774c631-83cf-4998-9a1d-b334af678fcf req-c3024b79-4321-430a-86e1-0678a604fb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239b8047-ca96-48bc-8950-57a0b6f0d537", "tag": "a5042009-6ba4-421a-b724-be960ba5a87f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:38.485940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3774c631-83cf-4998-9a1d-b334af678fcf req-c3024b79-4321-430a-86e1-0678a604fb02 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.486486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3774c631-83cf-4998-9a1d-b334af678fcf req-c3024b79-4321-430a-86e1-0678a604fb02 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.487642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3774c631-83cf-4998-9a1d-b334af678fcf req-c3024b79-4321-430a-86e1-0678a604fb02 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.502128 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-3774c631-83cf-4998-9a1d-b334af678fcf req-c3024b79-4321-430a-86e1-0678a604fb02 service nova] Creating event network-changed:a5042009-6ba4-421a-b724-be960ba5a87f for instance 239b8047-ca96-48bc-8950-57a0b6f0d537 on n-h2-862964-4 Oct 29 02:49:38.508589 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-3774c631-83cf-4998-9a1d-b334af678fcf req-c3024b79-4321-430a-86e1-0678a604fb02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041592 Oct 29 02:49:38.509194 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 617/1283] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:38.515599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c71ec2fc-662e-47a2-a7ab-e2ffdba10c76 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a88d7670>, body: {"security_group_rule": {"parent_group_id": "68d5034f-1fd7-424b-9668-34e177b2ccf9", "ip_protocol": "tcp", "from_port": 1028107877, "to_port": 22}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:38.525045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:38.534897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:38.536520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:38.538014 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce1aa558-750f-4b9e-a142-2aeea92c0dc5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1568 microversion: 2.25 time: 0.350506 Oct 29 02:49:38.538717 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 667/1284] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:38 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:38.545931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e92a4da-4237-46c5-9736-d09dbe5d3777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:38.546790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9e92a4da-4237-46c5-9736-d09dbe5d3777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:38.554932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e92a4da-4237-46c5-9736-d09dbe5d3777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.555732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e92a4da-4237-46c5-9736-d09dbe5d3777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.556327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e92a4da-4237-46c5-9736-d09dbe5d3777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.557304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e92a4da-4237-46c5-9736-d09dbe5d3777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.558293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e92a4da-4237-46c5-9736-d09dbe5d3777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.558881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e92a4da-4237-46c5-9736-d09dbe5d3777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.717938 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c71ec2fc-662e-47a2-a7ab-e2ffdba10c76 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] HTTP exception thrown: Invalid port range 1028107877:22. Former value cannot be greater than the later Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c71ec2fc-662e-47a2-a7ab-e2ffdba10c76 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Request method failure captured: Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 146 Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJS6Flve33mwglP6GNYw_sa1_Xz2UZ-iaA5RlQ3qZZTHgG65cA23dlM1Adna5uvawIOJN7cXeaTmH1PMfADj1JFlzyWHQiwV_4kNltuFu9X9HYTXVdhY5oZT9VB5_B5ZqPZErH-9GT6_JJoCVDkGHSj8MvPgy0GjJBf5UIbqYrpQxPc Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:49:38.722686 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4e6814941f64857a662c3ddc0ec9ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}] Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 10d0adc7068a4f82828a344e3f18d2db Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: {"security_group_rule": {"parent_group_id": "68d5034f-1fd7-424b-9668-34e177b2ccf9", "ip_protocol": "tcp", "from_port": 1028107877, "to_port": 22}} Oct 29 02:49:38.724340 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid port range 1028107877:22. Former value cannot be greater than the later Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'security_group_rule': {'parent_group_id': '68d5034f-1fd7-424b-9668-34e177b2ccf9', 'ip_protocol': 'tcp', 'from_port': 1028107877, 'to_port': 22}}} Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1028107877:22. Former value cannot be greater than the later Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:38.725233 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1028107877:22. Former value cannot be greater than the later Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1028107877:22. Former value cannot be greater than the later Oct 29 02:49:38.726942 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:38.728412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c71ec2fc-662e-47a2-a7ab-e2ffdba10c76 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Returning 400 to user: Invalid port range 1028107877:22. Former value cannot be greater than the later {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:38.728412 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c71ec2fc-662e-47a2-a7ab-e2ffdba10c76 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.215972 Oct 29 02:49:38.730818 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 618/1285] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:49:38 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:49:38.740623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b3672d09-e88d-47a4-ba2b-b39b7fb6971e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:38.742865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b3672d09-e88d-47a4-ba2b-b39b7fb6971e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:38.750750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9e92a4da-4237-46c5-9736-d09dbe5d3777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:38.756408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3672d09-e88d-47a4-ba2b-b39b7fb6971e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.756912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3672d09-e88d-47a4-ba2b-b39b7fb6971e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.757343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3672d09-e88d-47a4-ba2b-b39b7fb6971e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.758085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3672d09-e88d-47a4-ba2b-b39b7fb6971e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.758535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3672d09-e88d-47a4-ba2b-b39b7fb6971e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.758955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3672d09-e88d-47a4-ba2b-b39b7fb6971e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.759070 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9e92a4da-4237-46c5-9736-d09dbe5d3777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1358 microversion: 2.1 time: 0.219061 Oct 29 02:49:38.759869 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 668/1286] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:38 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:38.777983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1216c549-4387-4dfd-905f-851c54ab3dc6 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a8728e50>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1126161956", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:38.780144 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-1216c549-4387-4dfd-905f-851c54ab3dc6 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] HTTP exception thrown: Security group id should be uuid Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1216c549-4387-4dfd-905f-851c54ab3dc6 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Request method failure captured: Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 131 Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJS6Flve33mwglP6GNYw_sa1_Xz2UZ-iaA5RlQ3qZZTHgG65cA23dlM1Adna5uvawIOJN7cXeaTmH1PMfADj1JFlzyWHQiwV_4kNltuFu9X9HYTXVdhY5oZT9VB5_B5ZqPZErH-9GT6_JJoCVDkGHSj8MvPgy0GjJBf5UIbqYrpQxPc Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:38.782342 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4e6814941f64857a662c3ddc0ec9ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}] Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 10d0adc7068a4f82828a344e3f18d2db Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1126161956", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:49:38.783637 n-d-862964-4 devstack@n-api.service[127041]: exception: Security group id should be uuid Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1126161956', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:38.784596 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1216c549-4387-4dfd-905f-851c54ab3dc6 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Returning 400 to user: Security group id should be uuid {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:38.786380 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1216c549-4387-4dfd-905f-851c54ab3dc6 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.022916 Oct 29 02:49:38.790411 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 669/1287] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:49:38 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:38.795626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ccea8c9-4691-4675-9447-e4428c37950e tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a87b5d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-539222119", "description": "tempest-description-1665514788"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:39.063438 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ccea8c9-4691-4675-9447-e4428c37950e tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.271875 Oct 29 02:49:39.066644 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 670/1288] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:49:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:39.079873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e192c1b2-b232-4e85-9588-44bde8d8ac8a tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a873fdc0>, body: {"security_group_rule": {"parent_group_id": "c1755b8e-f7ea-496d-9043-42e60422c10a", "ip_protocol": "tempest-999-274520500", "from_port": 22, "to_port": 22}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:39.085885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3672d09-e88d-47a4-ba2b-b39b7fb6971e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.095134 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b3672d09-e88d-47a4-ba2b-b39b7fb6971e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1379 microversion: 2.1 time: 0.362530 Oct 29 02:49:39.111965 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 619/1289] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:38 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1379 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:39.174500 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-e192c1b2-b232-4e85-9588-44bde8d8ac8a tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] HTTP exception thrown: Invalid IP protocol tempest-999-274520500. Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e192c1b2-b232-4e85-9588-44bde8d8ac8a tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Request method failure captured: Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 156 Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJS6Flve33mwglP6GNYw_sa1_Xz2UZ-iaA5RlQ3qZZTHgG65cA23dlM1Adna5uvawIOJN7cXeaTmH1PMfADj1JFlzyWHQiwV_4kNltuFu9X9HYTXVdhY5oZT9VB5_B5ZqPZErH-9GT6_JJoCVDkGHSj8MvPgy0GjJBf5UIbqYrpQxPc Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:39.176238 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4e6814941f64857a662c3ddc0ec9ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}] Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 10d0adc7068a4f82828a344e3f18d2db Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: {"security_group_rule": {"parent_group_id": "c1755b8e-f7ea-496d-9043-42e60422c10a", "ip_protocol": "tempest-999-274520500", "from_port": 22, "to_port": 22}} Oct 29 02:49:39.177657 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid IP protocol tempest-999-274520500. Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c1755b8e-f7ea-496d-9043-42e60422c10a', 'ip_protocol': 'tempest-999-274520500', 'from_port': 22, 'to_port': 22}}} Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-274520500. Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:39.178752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-274520500. Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-274520500. Oct 29 02:49:39.180203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:39.185745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e192c1b2-b232-4e85-9588-44bde8d8ac8a tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Returning 400 to user: Invalid IP protocol tempest-999-274520500. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:39.185745 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e192c1b2-b232-4e85-9588-44bde8d8ac8a tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.104208 Oct 29 02:49:39.185745 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 671/1290] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:49:39 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:39.191917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ff058527-ba6a-491c-9b7f-d20f76402a33 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a8993790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-994764176", "description": "tempest-description-594876030"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:39.197176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:39.197928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:39.205613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.206256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.207185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.207953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.208400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.208873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.306415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.318938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.320766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.329995 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f1fb5889-af7a-4d1d-a85b-a5f0629505f2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.141747 Oct 29 02:49:39.331588 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 672/1291] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:39 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:39.425066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:39.426930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 49192f24-c094-4830-9245-aaf0fc79a197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:39.442993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.447091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.447834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.448841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.451284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.452667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.508900 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] HTTP exception thrown: Instance 49192f24-c094-4830-9245-aaf0fc79a197 could not be found. Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Request method failure captured: Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 HTTP/1.1 Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQcdpT8JB8GrvvAJ61Yxe1jlfCECOh5sugNg5m64KLROk1GsYWS0LZYnuqGvCgF6T5ipecgpuIJ1pa8J_NGPz1f8AEuzcC4jHyMs4ppIRkZE4j2YKuif_5zJmkugQyuc0qpZy_xKmnOmxvJsusF0EbAIU9HMx6aOM6uQ5Gkn2pdf9w Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:39.511302 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1031cc111cc747098bbc8a428c1cfad6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}] Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: fa30f68a081646d6b452d1cdf6e0181c Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 49192f24-c094-4830-9245-aaf0fc79a197 could not be found. Oct 29 02:49:39.512946 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '49192f24-c094-4830-9245-aaf0fc79a197'} Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49192f24-c094-4830-9245-aaf0fc79a197 could not be found. Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:39.513892 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49192f24-c094-4830-9245-aaf0fc79a197 could not be found. Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49192f24-c094-4830-9245-aaf0fc79a197 could not be found. Oct 29 02:49:39.515509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:39.517082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Returning 404 to user: Instance 49192f24-c094-4830-9245-aaf0fc79a197 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:39.517082 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fb59b20c-d528-49f1-979c-1f1b775533ad tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197" status: 404 len: 111 microversion: 2.1 time: 0.092409 Oct 29 02:49:39.517535 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 673/1292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:39 2022] GET /compute/v2.1/servers/49192f24-c094-4830-9245-aaf0fc79a197 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:49:39.546876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a212e9a8-6cf6-4abc-abaa-614dcad778bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:39.552487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a212e9a8-6cf6-4abc-abaa-614dcad778bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:39.559787 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ff058527-ba6a-491c-9b7f-d20f76402a33 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.371611 Oct 29 02:49:39.561312 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 620/1293] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:49:39 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:39.566290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:39.567161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:39.575417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a212e9a8-6cf6-4abc-abaa-614dcad778bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.575915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a212e9a8-6cf6-4abc-abaa-614dcad778bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.578062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a212e9a8-6cf6-4abc-abaa-614dcad778bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.578828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a212e9a8-6cf6-4abc-abaa-614dcad778bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.579296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a212e9a8-6cf6-4abc-abaa-614dcad778bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.579719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a212e9a8-6cf6-4abc-abaa-614dcad778bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.585543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.586064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.586491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.593211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.593700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.594203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.636861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a212e9a8-6cf6-4abc-abaa-614dcad778bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:39.847928 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a212e9a8-6cf6-4abc-abaa-614dcad778bb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 204 len: 0 microversion: 2.1 time: 0.328667 Oct 29 02:49:39.848652 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 674/1294] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:39 2022] DELETE /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:39.855850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38c3ea46-6732-4a22-a848-f02512bfe328 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a87cdc10>, body: {"security_group_rule": {"parent_group_id": "97f77188-7ef5-4204-bfa8-49f4084c6341", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:39.932385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.943427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.945021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.949738 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-34eebb2d-d537-440c-8fb2-0533780f9bc1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1543 microversion: 2.25 time: 0.387053 Oct 29 02:49:39.952164 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 621/1295] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:39 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1543 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:39.962318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4cdfcb7d-c02d-4839-a5f6-65a20db73cb9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:39.967490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4cdfcb7d-c02d-4839-a5f6-65a20db73cb9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:39.978325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdfcb7d-c02d-4839-a5f6-65a20db73cb9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.983106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdfcb7d-c02d-4839-a5f6-65a20db73cb9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.983947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdfcb7d-c02d-4839-a5f6-65a20db73cb9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.984918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdfcb7d-c02d-4839-a5f6-65a20db73cb9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.985455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdfcb7d-c02d-4839-a5f6-65a20db73cb9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.985999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdfcb7d-c02d-4839-a5f6-65a20db73cb9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.095648 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-38c3ea46-6732-4a22-a848-f02512bfe328 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38c3ea46-6732-4a22-a848-f02512bfe328 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Request method failure captured: Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 138 Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJS6Flve33mwglP6GNYw_sa1_Xz2UZ-iaA5RlQ3qZZTHgG65cA23dlM1Adna5uvawIOJN7cXeaTmH1PMfADj1JFlzyWHQiwV_4kNltuFu9X9HYTXVdhY5oZT9VB5_B5ZqPZErH-9GT6_JJoCVDkGHSj8MvPgy0GjJBf5UIbqYrpQxPc Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:40.098472 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4e6814941f64857a662c3ddc0ec9ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}] Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 10d0adc7068a4f82828a344e3f18d2db Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: {"security_group_rule": {"parent_group_id": "97f77188-7ef5-4204-bfa8-49f4084c6341", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 29 02:49:40.100304 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'security_group_rule': {'parent_group_id': '97f77188-7ef5-4204-bfa8-49f4084c6341', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:40.101470 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 02:49:40.102944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:40.108442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38c3ea46-6732-4a22-a848-f02512bfe328 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:40.109693 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-38c3ea46-6732-4a22-a848-f02512bfe328 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.259763 Oct 29 02:49:40.111044 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 675/1296] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:49:39 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 262 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:49:40.122355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dc111af1-61a9-4ba6-b376-6e79a8542d65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:40.124270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dc111af1-61a9-4ba6-b376-6e79a8542d65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:40.141031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc111af1-61a9-4ba6-b376-6e79a8542d65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.149472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc111af1-61a9-4ba6-b376-6e79a8542d65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.151017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc111af1-61a9-4ba6-b376-6e79a8542d65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.153497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc111af1-61a9-4ba6-b376-6e79a8542d65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.154422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc111af1-61a9-4ba6-b376-6e79a8542d65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.156313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc111af1-61a9-4ba6-b376-6e79a8542d65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.308909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cdfcb7d-c02d-4839-a5f6-65a20db73cb9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:40.322421 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4cdfcb7d-c02d-4839-a5f6-65a20db73cb9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1358 microversion: 2.1 time: 0.366129 Oct 29 02:49:40.324979 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 622/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:39 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1358 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:40.331565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-facd1aa4-5328-4004-b862-376b9ff82f37 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '.version_select at 0x7fe1a8993f70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:40.351169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-facd1aa4-5328-4004-b862-376b9ff82f37 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.354039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-facd1aa4-5328-4004-b862-376b9ff82f37 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.356235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-facd1aa4-5328-4004-b862-376b9ff82f37 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.376289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=12 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:40.390965 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-facd1aa4-5328-4004-b862-376b9ff82f37 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.064432 Oct 29 02:49:40.393196 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 623/1298] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Oct 29 02:49:40 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:40.399921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63eed4f3-47e0-4058-b493-6da90bd51418 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:40.400923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-63eed4f3-47e0-4058-b493-6da90bd51418 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:40.408157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63eed4f3-47e0-4058-b493-6da90bd51418 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.409043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63eed4f3-47e0-4058-b493-6da90bd51418 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.409931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63eed4f3-47e0-4058-b493-6da90bd51418 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.410884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63eed4f3-47e0-4058-b493-6da90bd51418 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.414096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63eed4f3-47e0-4058-b493-6da90bd51418 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.414871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63eed4f3-47e0-4058-b493-6da90bd51418 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.472173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=70 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:40.806378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dc111af1-61a9-4ba6-b376-6e79a8542d65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:40.817666 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dc111af1-61a9-4ba6-b376-6e79a8542d65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1472 microversion: 2.1 time: 0.704734 Oct 29 02:49:40.817940 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 676/1299] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:40 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1472 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:40.860460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5ad0cba9-0337-4fbe-9383-13d121677232 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a8788ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1016725143", "description": "tempest-description-1861356287"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:41.416034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-63eed4f3-47e0-4058-b493-6da90bd51418 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:41.432000 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-63eed4f3-47e0-4058-b493-6da90bd51418 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1379 microversion: 2.1 time: 1.035973 Oct 29 02:49:41.432534 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 624/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:40 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1379 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:41.461936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:41.477086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:41.492207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.492993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.493705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.496117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.496862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.500484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.838231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:41.872794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:41.884067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:41.913658 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f68293e-79db-4c3b-9823-71d46707d1c8 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.456395 Oct 29 02:49:41.938046 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 625/1301] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:41 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:41.960791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-741749d5-cad8-4f1d-8546-67e0e92d6229 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:41.961401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-741749d5-cad8-4f1d-8546-67e0e92d6229 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:41.982033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741749d5-cad8-4f1d-8546-67e0e92d6229 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.982529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741749d5-cad8-4f1d-8546-67e0e92d6229 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.982958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741749d5-cad8-4f1d-8546-67e0e92d6229 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.995077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741749d5-cad8-4f1d-8546-67e0e92d6229 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:42.000118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741749d5-cad8-4f1d-8546-67e0e92d6229 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:42.000818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741749d5-cad8-4f1d-8546-67e0e92d6229 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:42.477763 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5ad0cba9-0337-4fbe-9383-13d121677232 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.631913 Oct 29 02:49:42.479310 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 677/1302] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:49:40 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:42.484482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce8b1132-fcda-4208-9c26-b40c56fffa35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:42.485306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce8b1132-fcda-4208-9c26-b40c56fffa35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:42.528129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce8b1132-fcda-4208-9c26-b40c56fffa35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:42.543942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce8b1132-fcda-4208-9c26-b40c56fffa35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:42.544516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce8b1132-fcda-4208-9c26-b40c56fffa35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:42.545291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce8b1132-fcda-4208-9c26-b40c56fffa35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:42.545760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce8b1132-fcda-4208-9c26-b40c56fffa35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:42.546201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce8b1132-fcda-4208-9c26-b40c56fffa35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:43.211948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-741749d5-cad8-4f1d-8546-67e0e92d6229 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid a6d4d5fa-ae6a-43c5-970e-a6ab2610133d {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:43.236415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce8b1132-fcda-4208-9c26-b40c56fffa35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:43.243307 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-741749d5-cad8-4f1d-8546-67e0e92d6229 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 2036 microversion: 2.25 time: 1.304013 Oct 29 02:49:43.248564 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 626/1303] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:41 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 2036 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:43.255213 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce8b1132-fcda-4208-9c26-b40c56fffa35 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1358 microversion: 2.1 time: 0.773193 Oct 29 02:49:43.268944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-58fd63ee-f4b4-401f-a4fa-23bf75136c71 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:43.269884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-58fd63ee-f4b4-401f-a4fa-23bf75136c71 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:43.277048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58fd63ee-f4b4-401f-a4fa-23bf75136c71 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:43.277788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58fd63ee-f4b4-401f-a4fa-23bf75136c71 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:43.278461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58fd63ee-f4b4-401f-a4fa-23bf75136c71 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:43.278585 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 678/1304] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:42 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1358 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:43.279677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58fd63ee-f4b4-401f-a4fa-23bf75136c71 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:43.280427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58fd63ee-f4b4-401f-a4fa-23bf75136c71 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:43.281006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58fd63ee-f4b4-401f-a4fa-23bf75136c71 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:43.284740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9f341de8-b88b-4772-8f20-fe75dfd73bc2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:43.288745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9f341de8-b88b-4772-8f20-fe75dfd73bc2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:43.316977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f341de8-b88b-4772-8f20-fe75dfd73bc2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:43.317466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f341de8-b88b-4772-8f20-fe75dfd73bc2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:43.327181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f341de8-b88b-4772-8f20-fe75dfd73bc2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:43.328096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f341de8-b88b-4772-8f20-fe75dfd73bc2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:43.328577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f341de8-b88b-4772-8f20-fe75dfd73bc2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:43.329010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f341de8-b88b-4772-8f20-fe75dfd73bc2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:43.816814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-58fd63ee-f4b4-401f-a4fa-23bf75136c71 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:43.854776 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-58fd63ee-f4b4-401f-a4fa-23bf75136c71 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1472 microversion: 2.1 time: 0.604373 Oct 29 02:49:43.855747 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 627/1305] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:43 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1472 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:43.864110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3bab1dfb-dcf3-4b34-b124-7336f4760879 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a89443a0>, body: {"security_group_rule": {"parent_group_id": "dd981608-bb83-455b-9c7c-6bff85cae930", "ip_protocol": "tcp", "from_port": 22, "to_port": 1700511773}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:43.985940 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-3bab1dfb-dcf3-4b34-b124-7336f4760879 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] HTTP exception thrown: Invalid port range 22:1700511773. Valid TCP ports should be between 1-65535 Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3bab1dfb-dcf3-4b34-b124-7336f4760879 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Request method failure captured: Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 146 Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJS6Flve33mwglP6GNYw_sa1_Xz2UZ-iaA5RlQ3qZZTHgG65cA23dlM1Adna5uvawIOJN7cXeaTmH1PMfADj1JFlzyWHQiwV_4kNltuFu9X9HYTXVdhY5oZT9VB5_B5ZqPZErH-9GT6_JJoCVDkGHSj8MvPgy0GjJBf5UIbqYrpQxPc Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:49:43.988048 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4e6814941f64857a662c3ddc0ec9ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}] Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 10d0adc7068a4f82828a344e3f18d2db Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: {"security_group_rule": {"parent_group_id": "dd981608-bb83-455b-9c7c-6bff85cae930", "ip_protocol": "tcp", "from_port": 22, "to_port": 1700511773}} Oct 29 02:49:43.990386 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid port range 22:1700511773. Valid TCP ports should be between 1-65535 Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'dd981608-bb83-455b-9c7c-6bff85cae930', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1700511773}}} Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1700511773. Valid TCP ports should be between 1-65535 Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:43.991996 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1700511773. Valid TCP ports should be between 1-65535 Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1700511773. Valid TCP ports should be between 1-65535 Oct 29 02:49:43.993420 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:43.996859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3bab1dfb-dcf3-4b34-b124-7336f4760879 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Returning 400 to user: Invalid port range 22:1700511773. Valid TCP ports should be between 1-65535 {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:43.999316 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3bab1dfb-dcf3-4b34-b124-7336f4760879 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.142054 Oct 29 02:49:44.000393 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 628/1306] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:49:43 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:49:44.150333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9f341de8-b88b-4772-8f20-fe75dfd73bc2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:44.158626 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9f341de8-b88b-4772-8f20-fe75dfd73bc2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1379 microversion: 2.1 time: 0.878872 Oct 29 02:49:44.159198 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 679/1307] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:43 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1379 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:44.177049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:44.179024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:44.197226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:44.197983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:44.198785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:44.200316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:44.201073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:44.201733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:44.329221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-65ff944e-fed1-4209-8c23-20534f9f3485 tempest-SecurityGroupsTestAdminJSON-524364737 tempest-SecurityGroupsTestAdminJSON-524364737-project] Action: 'create', calling method: .version_select at 0x7fe1a88d73a0>, body: {"security_group": {"name": "tempest-securitygroup-451600127", "description": "tempest-description-2063881805"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:44.333833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:44.345300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:44.363911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:44.366205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:44.376555 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aaa59f3d-0fc1-46af-a100-ee0e2329f425 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.213474 Oct 29 02:49:44.377090 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 680/1308] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:44 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:44.398487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-68e1c389-e63b-4b65-b6cb-434f8e53314c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Action: 'create', calling method: .version_select at 0x7fe1a86fe040>, body: {"keypair": {"name": "tempest-keypair-727801795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2BPpd5pr5jFYjqBIqoleC2m32l323YLnl7wywZjAR4I1IL88rd9Nm2f9M1nBHaWoE7qXFO3qvZE2wgYYJPICWj5anB3UVVJaVKbKI9sRwk+cenuLitAiskRW8DlL8zWw=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:44.408768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=10 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:44.418533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=51 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:44.422838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-68e1c389-e63b-4b65-b6cb-434f8e53314c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Getting quotas for project 60896479fb0c4357ad5fb03016470283. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:44.427266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-68e1c389-e63b-4b65-b6cb-434f8e53314c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Getting quotas for user f0ea28d9bb3544bca1a3c90d983fe8e4 and project 60896479fb0c4357ad5fb03016470283. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:44.472659 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-68e1c389-e63b-4b65-b6cb-434f8e53314c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.082289 Oct 29 02:49:44.474070 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 681/1309] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Oct 29 02:49:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:49:44.480945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4f35394d-f43b-4232-91e4-ae5e08c64e11 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Action: 'create', calling method: .version_select at 0x7fe1a87cdb80>, body: {"security_group_rule": {"parent_group_id": "59f56076-5058-494d-bdcb-b364b16a8761", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:44.531759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-4f35394d-f43b-4232-91e4-ae5e08c64e11 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 59f56076-5058-494d-bdcb-b364b16a8761 does not exist", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:49:44.532536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.security_group_api [None req-4f35394d-f43b-4232-91e4-ae5e08c64e11 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Neutron security group 59f56076-5058-494d-bdcb-b364b16a8761 not found {{(pid=127041) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:49:44.532860 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-4f35394d-f43b-4232-91e4-ae5e08c64e11 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] HTTP exception thrown: Security group 59f56076-5058-494d-bdcb-b364b16a8761 does not exist Oct 29 02:49:44.532860 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-c37500e3-2f08-467b-a71c-c3e23326da33'] Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4f35394d-f43b-4232-91e4-ae5e08c64e11 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Request method failure captured: Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 138 Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJS6Flve33mwglP6GNYw_sa1_Xz2UZ-iaA5RlQ3qZZTHgG65cA23dlM1Adna5uvawIOJN7cXeaTmH1PMfADj1JFlzyWHQiwV_4kNltuFu9X9HYTXVdhY5oZT9VB5_B5ZqPZErH-9GT6_JJoCVDkGHSj8MvPgy0GjJBf5UIbqYrpQxPc Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:44.549578 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4e6814941f64857a662c3ddc0ec9ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}] Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 10d0adc7068a4f82828a344e3f18d2db Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: {"security_group_rule": {"parent_group_id": "59f56076-5058-494d-bdcb-b364b16a8761", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 02:49:44.551170 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: exception: Security group 59f56076-5058-494d-bdcb-b364b16a8761 does not exist Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-c37500e3-2f08-467b-a71c-c3e23326da33'] Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'security_group_rule': {'parent_group_id': '59f56076-5058-494d-bdcb-b364b16a8761', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:49:44.551907 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 59f56076-5058-494d-bdcb-b364b16a8761 does not exist Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c37500e3-2f08-467b-a71c-c3e23326da33'] Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 29 02:49:44.558068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 59f56076-5058-494d-bdcb-b364b16a8761 does not exist Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c37500e3-2f08-467b-a71c-c3e23326da33'] Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 59f56076-5058-494d-bdcb-b364b16a8761 does not exist Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c37500e3-2f08-467b-a71c-c3e23326da33'] Oct 29 02:49:44.560138 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 59f56076-5058-494d-bdcb-b364b16a8761 does not exist Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c37500e3-2f08-467b-a71c-c3e23326da33'] Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4f35394d-f43b-4232-91e4-ae5e08c64e11 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Returning 404 to user: Security group 59f56076-5058-494d-bdcb-b364b16a8761 does not exist Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-c37500e3-2f08-467b-a71c-c3e23326da33'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:44.562808 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4f35394d-f43b-4232-91e4-ae5e08c64e11 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.075772 Oct 29 02:49:44.564813 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 682/1310] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:49:44 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:44.564813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4284f581-25d5-44ad-985b-ef3313f9474b req-a79302be-5f44-4f3b-b276-122d5d20ea07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e695df-8d05-4202-9636-54600d730b15", "name": "network-vif-deleted", "tag": "0cc0ffef-76b5-4409-84ae-b6014aa47a4c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:44.576113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4284f581-25d5-44ad-985b-ef3313f9474b req-a79302be-5f44-4f3b-b276-122d5d20ea07 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:44.576576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4284f581-25d5-44ad-985b-ef3313f9474b req-a79302be-5f44-4f3b-b276-122d5d20ea07 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:44.577002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4284f581-25d5-44ad-985b-ef3313f9474b req-a79302be-5f44-4f3b-b276-122d5d20ea07 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:44.592647 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4284f581-25d5-44ad-985b-ef3313f9474b req-a79302be-5f44-4f3b-b276-122d5d20ea07 service nova] Creating event network-vif-deleted:0cc0ffef-76b5-4409-84ae-b6014aa47a4c for instance d6e695df-8d05-4202-9636-54600d730b15 on n-h1-862964-4 Oct 29 02:49:44.599138 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4284f581-25d5-44ad-985b-ef3313f9474b req-a79302be-5f44-4f3b-b276-122d5d20ea07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045783 Oct 29 02:49:44.600193 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 683/1311] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:44.607842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bbd1ac50-8917-4786-a3c4-a3ab2b2376bb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:44.608789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bbd1ac50-8917-4786-a3c4-a3ab2b2376bb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:44.615810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd1ac50-8917-4786-a3c4-a3ab2b2376bb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:44.616792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd1ac50-8917-4786-a3c4-a3ab2b2376bb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:44.617449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd1ac50-8917-4786-a3c4-a3ab2b2376bb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:44.618433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd1ac50-8917-4786-a3c4-a3ab2b2376bb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:44.618935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd1ac50-8917-4786-a3c4-a3ab2b2376bb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:44.619445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd1ac50-8917-4786-a3c4-a3ab2b2376bb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:44.790971 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-65ff944e-fed1-4209-8c23-20534f9f3485 tempest-SecurityGroupsTestAdminJSON-524364737 tempest-SecurityGroupsTestAdminJSON-524364737-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.788345 Oct 29 02:49:44.804672 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 629/1312] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:49:44 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:44.813680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6229b453-58bb-4cdf-a629-c95aee9990a2 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Calling method '.version_select at 0x7fe1a8864790>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:44.848515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bbd1ac50-8917-4786-a3c4-a3ab2b2376bb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:44.859983 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bbd1ac50-8917-4786-a3c4-a3ab2b2376bb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1358 microversion: 2.1 time: 0.258376 Oct 29 02:49:44.860783 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 684/1313] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:44 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:44.881578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG neutronclient.v2_0.client [None req-6229b453-58bb-4cdf-a629-c95aee9990a2 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 01a3fb59-822d-4bc9-8a4d-f20bcbb3521f does not exist", "detail": ""}} {{(pid=127042) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:49:44.882664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.security_group_api [None req-6229b453-58bb-4cdf-a629-c95aee9990a2 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Neutron security group rule 01a3fb59-822d-4bc9-8a4d-f20bcbb3521f not found {{(pid=127042) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 29 02:49:44.883415 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-6229b453-58bb-4cdf-a629-c95aee9990a2 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] HTTP exception thrown: Security group rule 01a3fb59-822d-4bc9-8a4d-f20bcbb3521f does not exist Oct 29 02:49:44.883415 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-f229a0c6-c161-4b27-a0ec-20873b9ce1fb'] Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6229b453-58bb-4cdf-a629-c95aee9990a2 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Request method failure captured: Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-security-group-rules/01a3fb59-822d-4bc9-8a4d-f20bcbb3521f HTTP/1.1 Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJS6Flve33mwglP6GNYw_sa1_Xz2UZ-iaA5RlQ3qZZTHgG65cA23dlM1Adna5uvawIOJN7cXeaTmH1PMfADj1JFlzyWHQiwV_4kNltuFu9X9HYTXVdhY5oZT9VB5_B5ZqPZErH-9GT6_JJoCVDkGHSj8MvPgy0GjJBf5UIbqYrpQxPc Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:49:44.888770 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c4e6814941f64857a662c3ddc0ec9ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c4e6814941f64857a662c3ddc0ec9ce3"}]}] Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c4e6814941f64857a662c3ddc0ec9ce3 Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910 Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 10d0adc7068a4f82828a344e3f18d2db Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: exception: Security group rule 01a3fb59-822d-4bc9-8a4d-f20bcbb3521f does not exist Oct 29 02:49:44.890185 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-f229a0c6-c161-4b27-a0ec-20873b9ce1fb'] Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '01a3fb59-822d-4bc9-8a4d-f20bcbb3521f'} Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:49:44.890910 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 01a3fb59-822d-4bc9-8a4d-f20bcbb3521f does not exist Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f229a0c6-c161-4b27-a0ec-20873b9ce1fb'] Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 29 02:49:44.892033 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 01a3fb59-822d-4bc9-8a4d-f20bcbb3521f does not exist Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f229a0c6-c161-4b27-a0ec-20873b9ce1fb'] Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 01a3fb59-822d-4bc9-8a4d-f20bcbb3521f does not exist Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f229a0c6-c161-4b27-a0ec-20873b9ce1fb'] Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.893089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:44.895924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.895924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:44.895924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:44.895924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:44.895924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:44.895924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:44.895924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 01a3fb59-822d-4bc9-8a4d-f20bcbb3521f does not exist Oct 29 02:49:44.895924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f229a0c6-c161-4b27-a0ec-20873b9ce1fb'] Oct 29 02:49:44.895924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:44.897484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ad290bd3-71d1-4cfd-8ea0-a9ae46cc7572 tempest-SecurityGroupsTestAdminJSON-524364737 tempest-SecurityGroupsTestAdminJSON-524364737-project] Action: 'create', calling method: .version_select at 0x7fe1a86ebd30>, body: {"security_group": {"name": "tempest-securitygroup-707289753", "description": "tempest-description-2103898322"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:44.898712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6229b453-58bb-4cdf-a629-c95aee9990a2 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Returning 404 to user: Security group rule 01a3fb59-822d-4bc9-8a4d-f20bcbb3521f does not exist Oct 29 02:49:44.898712 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-f229a0c6-c161-4b27-a0ec-20873b9ce1fb'] {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:44.900032 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6229b453-58bb-4cdf-a629-c95aee9990a2 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/01a3fb59-822d-4bc9-8a4d-f20bcbb3521f" status: 404 len: 199 microversion: 2.1 time: 0.093850 Oct 29 02:49:44.901996 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 630/1314] 10.222.0.16 () {58 vars in 1287 bytes} [Sat Oct 29 02:49:44 2022] DELETE /compute/v2.1/os-security-group-rules/01a3fb59-822d-4bc9-8a4d-f20bcbb3521f => generated 199 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:44.915396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:44.916958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:44.933916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:44.937033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:44.938582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:44.941071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:44.943194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:44.945160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:45.034792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:45.036380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:45.037040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:45.040123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lazy-loading 'fault' on Instance uuid d6e695df-8d05-4202-9636-54600d730b15 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:45.116623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:45.145033 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-80fd9044-4483-4ee3-abe2-b7c26c473b7f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 200 len: 1307 microversion: 2.1 time: 0.235707 Oct 29 02:49:45.149435 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 631/1315] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:44 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 1307 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:45.161909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8bc5cef7-7599-4652-ba57-38943b9d0b51 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Calling method '.version_select at 0x7fe1a88d7ee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:45.694973 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ad290bd3-71d1-4cfd-8ea0-a9ae46cc7572 tempest-SecurityGroupsTestAdminJSON-524364737 tempest-SecurityGroupsTestAdminJSON-524364737-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.832839 Oct 29 02:49:45.697044 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 685/1316] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:49:44 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:45.702679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1976c1fd-43f2-4312-8f39-d62f7d4b91ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:45.704660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1976c1fd-43f2-4312-8f39-d62f7d4b91ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:45.719513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1976c1fd-43f2-4312-8f39-d62f7d4b91ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:45.721554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1976c1fd-43f2-4312-8f39-d62f7d4b91ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:45.722289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1976c1fd-43f2-4312-8f39-d62f7d4b91ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:45.724673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1976c1fd-43f2-4312-8f39-d62f7d4b91ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:45.726500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1976c1fd-43f2-4312-8f39-d62f7d4b91ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:45.727250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1976c1fd-43f2-4312-8f39-d62f7d4b91ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:46.157849 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8bc5cef7-7599-4652-ba57-38943b9d0b51 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/dd981608-bb83-455b-9c7c-6bff85cae930" status: 202 len: 0 microversion: 2.1 time: 1.006567 Oct 29 02:49:46.158762 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 632/1317] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:49:45 2022] DELETE /compute/v2.1/os-security-groups/dd981608-bb83-455b-9c7c-6bff85cae930 => generated 0 bytes in 1008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:46.167125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:46.168391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:46.201721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:46.203780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:46.205502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:46.206306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:46.221632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:46.224541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:46.224717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1976c1fd-43f2-4312-8f39-d62f7d4b91ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:46.233764 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1976c1fd-43f2-4312-8f39-d62f7d4b91ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1379 microversion: 2.1 time: 0.535228 Oct 29 02:49:46.241859 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 686/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:45 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1379 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:46.369544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ad7dc536-2498-48c8-af6f-996e3bfd791f tempest-SecurityGroupsTestAdminJSON-1132612237 tempest-SecurityGroupsTestAdminJSON-1132612237-project-admin] Action: 'create', calling method: .version_select at 0x7fe1a86fec10>, body: {"security_group": {"name": "tempest-securitygroup-254916154", "description": "tempest-description-4644468"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:46.864296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:46.888182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:46.893578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:46.902943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-08c5485a-96fa-4cf4-90e9-13b31234e842 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.743293 Oct 29 02:49:46.918848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 633/1319] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:46 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:46.934115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8391a026-8f9d-4906-85fc-f488f1363c81 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:46.935455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8391a026-8f9d-4906-85fc-f488f1363c81 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:46.941851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:46.944446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8391a026-8f9d-4906-85fc-f488f1363c81 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:46.945545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8391a026-8f9d-4906-85fc-f488f1363c81 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:46.946280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8391a026-8f9d-4906-85fc-f488f1363c81 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:46.947447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8391a026-8f9d-4906-85fc-f488f1363c81 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:46.948301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8391a026-8f9d-4906-85fc-f488f1363c81 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:46.949039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8391a026-8f9d-4906-85fc-f488f1363c81 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.411119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8391a026-8f9d-4906-85fc-f488f1363c81 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:47.424350 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8391a026-8f9d-4906-85fc-f488f1363c81 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1358 microversion: 2.1 time: 0.503733 Oct 29 02:49:47.435361 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 634/1320] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:46 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1358 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:47.465172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e83397ff-813d-4ded-abd0-98c5750dceed req-560afcac-7b33-4e4c-b982-ad166adda9cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ce5a89-9c05-4459-9e6f-a94249149f0e", "name": "network-vif-plugged", "status": "completed", "tag": "55f158e4-c02f-4621-aef5-0df1f9eb6596"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:47.518626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e83397ff-813d-4ded-abd0-98c5750dceed req-560afcac-7b33-4e4c-b982-ad166adda9cd service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.519435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e83397ff-813d-4ded-abd0-98c5750dceed req-560afcac-7b33-4e4c-b982-ad166adda9cd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.520035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e83397ff-813d-4ded-abd0-98c5750dceed req-560afcac-7b33-4e4c-b982-ad166adda9cd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.583635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:47.592940 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e83397ff-813d-4ded-abd0-98c5750dceed req-560afcac-7b33-4e4c-b982-ad166adda9cd service nova] Creating event network-vif-plugged:55f158e4-c02f-4621-aef5-0df1f9eb6596 for instance 86ce5a89-9c05-4459-9e6f-a94249149f0e on n-h2-862964-4 Oct 29 02:49:47.601961 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e83397ff-813d-4ded-abd0-98c5750dceed req-560afcac-7b33-4e4c-b982-ad166adda9cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165140 Oct 29 02:49:47.603202 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 635/1321] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:47.621230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e045f271-962e-46da-9baa-0905bffbee23 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Calling method '.version_select at 0x7fe1a8a02040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:48.156530 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ad7dc536-2498-48c8-af6f-996e3bfd791f tempest-SecurityGroupsTestAdminJSON-1132612237 tempest-SecurityGroupsTestAdminJSON-1132612237-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 217 microversion: 2.1 time: 1.907125 Oct 29 02:49:48.160200 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 687/1322] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:49:46 2022] POST /compute/v2.1/os-security-groups => generated 217 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:48.166767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:48.172014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: d6e695df-8d05-4202-9636-54600d730b15] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:48.193889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.195018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.196690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.198834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.199952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.201172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.238474 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] HTTP exception thrown: Instance d6e695df-8d05-4202-9636-54600d730b15 could not be found. Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Request method failure captured: Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 HTTP/1.1 Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQcdpT8JB8GrvvAJ61Yxe1jlfCECOh5sugNg5m64KLROk1GsYWS0LZYnuqGvCgF6T5ipecgpuIJ1pa8J_NGPz1f8AEuzcC4jHyMs4ppIRkZE4j2YKuif_5zJmkugQyuc0qpZy_xKmnOmxvJsusF0EbAIU9HMx6aOM6uQ5Gkn2pdf9w Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:48.241849 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1031cc111cc747098bbc8a428c1cfad6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}] Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: fa30f68a081646d6b452d1cdf6e0181c Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance d6e695df-8d05-4202-9636-54600d730b15 could not be found. Oct 29 02:49:48.243672 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'd6e695df-8d05-4202-9636-54600d730b15'} Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e695df-8d05-4202-9636-54600d730b15 could not be found. Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:48.244411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e695df-8d05-4202-9636-54600d730b15 could not be found. Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e695df-8d05-4202-9636-54600d730b15 could not be found. Oct 29 02:49:48.245988 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:48.250266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Returning 404 to user: Instance d6e695df-8d05-4202-9636-54600d730b15 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:48.251718 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6ee8b10e-b2c6-4265-866b-06fd221d8a2b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15" status: 404 len: 111 microversion: 2.1 time: 0.090309 Oct 29 02:49:48.252845 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 688/1323] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:48 2022] GET /compute/v2.1/servers/d6e695df-8d05-4202-9636-54600d730b15 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:48.258568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a8f464cc-17ed-419f-aba9-fe11f2bcee07 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:48.260175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a8f464cc-17ed-419f-aba9-fe11f2bcee07 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:48.267274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:48.270985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f464cc-17ed-419f-aba9-fe11f2bcee07 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.272337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f464cc-17ed-419f-aba9-fe11f2bcee07 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.273091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f464cc-17ed-419f-aba9-fe11f2bcee07 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.274079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f464cc-17ed-419f-aba9-fe11f2bcee07 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.274942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f464cc-17ed-419f-aba9-fe11f2bcee07 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.275600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8f464cc-17ed-419f-aba9-fe11f2bcee07 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.313913 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e045f271-962e-46da-9baa-0905bffbee23 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/97f77188-7ef5-4204-bfa8-49f4084c6341" status: 202 len: 0 microversion: 2.1 time: 0.705530 Oct 29 02:49:48.313913 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 636/1324] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:49:47 2022] DELETE /compute/v2.1/os-security-groups/97f77188-7ef5-4204-bfa8-49f4084c6341 => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:48.318091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:48.319309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:48.335600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.336119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.336557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.337278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.337726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.349413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.532718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:48.546264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:48.552227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:48.564799 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-78eebfd6-bfc7-4b16-b25a-95217cb86b24 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.252137 Oct 29 02:49:48.565399 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 637/1325] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:48 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:48.576494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-caba1f29-f045-4a70-80e8-228d3f8f04bf tempest-SecurityGroupsTestAdminJSON-1132612237 tempest-SecurityGroupsTestAdminJSON-1132612237-project-admin] Action: 'create', calling method: .version_select at 0x7fe1a87ca040>, body: {"security_group": {"name": "tempest-securitygroup-1754369600", "description": "tempest-description-1755704216"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:48.834274 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-caba1f29-f045-4a70-80e8-228d3f8f04bf tempest-SecurityGroupsTestAdminJSON-1132612237 tempest-SecurityGroupsTestAdminJSON-1132612237-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.267469 Oct 29 02:49:48.835255 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 638/1326] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:49:48 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:48.839690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bddd3de-68b8-46dc-9dca-1c4466b5d2d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:48.840386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bddd3de-68b8-46dc-9dca-1c4466b5d2d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: e28d98f2-e795-480d-974a-094260081964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:48.846799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bddd3de-68b8-46dc-9dca-1c4466b5d2d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.847504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bddd3de-68b8-46dc-9dca-1c4466b5d2d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.848078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bddd3de-68b8-46dc-9dca-1c4466b5d2d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.848948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bddd3de-68b8-46dc-9dca-1c4466b5d2d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.849541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bddd3de-68b8-46dc-9dca-1c4466b5d2d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.850280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bddd3de-68b8-46dc-9dca-1c4466b5d2d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.884243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bddd3de-68b8-46dc-9dca-1c4466b5d2d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: e28d98f2-e795-480d-974a-094260081964] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:48.901500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a8f464cc-17ed-419f-aba9-fe11f2bcee07 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:48.912721 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a8f464cc-17ed-419f-aba9-fe11f2bcee07 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1379 microversion: 2.1 time: 0.658493 Oct 29 02:49:48.913698 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 689/1327] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:48 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1379 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:48.919587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-844625ee-5b98-402d-a3d4-dd2ceca018b4 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Calling method '.version_select at 0x7fe1a86ebd30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:48.982701 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9bddd3de-68b8-46dc-9dca-1c4466b5d2d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964" status: 204 len: 0 microversion: 2.1 time: 0.146009 Oct 29 02:49:48.984101 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 639/1328] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:48 2022] DELETE /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:48.990003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d130ad75-8409-4e8a-ba75-3b107aea2d6c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:48.990821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d130ad75-8409-4e8a-ba75-3b107aea2d6c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:48.997417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d130ad75-8409-4e8a-ba75-3b107aea2d6c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.997966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d130ad75-8409-4e8a-ba75-3b107aea2d6c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.998419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d130ad75-8409-4e8a-ba75-3b107aea2d6c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.999389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d130ad75-8409-4e8a-ba75-3b107aea2d6c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.999848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d130ad75-8409-4e8a-ba75-3b107aea2d6c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:49.000273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d130ad75-8409-4e8a-ba75-3b107aea2d6c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:49.161166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d130ad75-8409-4e8a-ba75-3b107aea2d6c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:49.169794 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d130ad75-8409-4e8a-ba75-3b107aea2d6c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1358 microversion: 2.1 time: 0.183794 Oct 29 02:49:49.170444 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 640/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:48 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:49.174878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a02b33e1-7f8f-4eb1-9f25-838e88b1b248 tempest-SecurityGroupsTestAdminJSON-1132612237 tempest-SecurityGroupsTestAdminJSON-1132612237-project-admin] Calling method '.version_select at 0x7fe1a89443a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:49.819023 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-844625ee-5b98-402d-a3d4-dd2ceca018b4 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c1755b8e-f7ea-496d-9043-42e60422c10a" status: 202 len: 0 microversion: 2.1 time: 0.903051 Oct 29 02:49:49.819762 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 690/1330] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:49:48 2022] DELETE /compute/v2.1/os-security-groups/c1755b8e-f7ea-496d-9043-42e60422c10a => generated 0 bytes in 905 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:49.826053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3f1d15dc-a962-47b8-9247-0226521ae16a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:49.826680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3f1d15dc-a962-47b8-9247-0226521ae16a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:49.860819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f1d15dc-a962-47b8-9247-0226521ae16a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:49.861638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f1d15dc-a962-47b8-9247-0226521ae16a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:49.862503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f1d15dc-a962-47b8-9247-0226521ae16a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:49.863442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f1d15dc-a962-47b8-9247-0226521ae16a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:49.864050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f1d15dc-a962-47b8-9247-0226521ae16a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:49.864622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f1d15dc-a962-47b8-9247-0226521ae16a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:49.924023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3f1d15dc-a962-47b8-9247-0226521ae16a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:50.067769 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3f1d15dc-a962-47b8-9247-0226521ae16a tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 204 len: 0 microversion: 2.1 time: 0.246619 Oct 29 02:49:50.074277 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 691/1331] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:49 2022] DELETE /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:50.080744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:50.081661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:50.089711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:50.096177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:50.096633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:50.097647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:50.097836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:50.098260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:50.219400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:50.233990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:50.235984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:50.244596 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d620f9e8-10a9-4071-985f-26c256e35269 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.168926 Oct 29 02:49:50.245750 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 692/1332] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:50 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:50.251701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f708cc87-b5a5-4ecc-a7a4-a91fc7eeada9 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Calling method '.version_select at 0x7fe1a886be50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:50.470051 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f708cc87-b5a5-4ecc-a7a4-a91fc7eeada9 tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/68d5034f-1fd7-424b-9668-34e177b2ccf9" status: 202 len: 0 microversion: 2.1 time: 0.222153 Oct 29 02:49:50.472048 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 693/1333] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:49:50 2022] DELETE /compute/v2.1/os-security-groups/68d5034f-1fd7-424b-9668-34e177b2ccf9 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:50.479197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a1467ac8-b44e-46e0-85b9-7f85d47125e8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:50.480519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a1467ac8-b44e-46e0-85b9-7f85d47125e8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:50.499734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1467ac8-b44e-46e0-85b9-7f85d47125e8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:50.500669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1467ac8-b44e-46e0-85b9-7f85d47125e8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:50.501236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1467ac8-b44e-46e0-85b9-7f85d47125e8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:50.502201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1467ac8-b44e-46e0-85b9-7f85d47125e8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:50.502908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1467ac8-b44e-46e0-85b9-7f85d47125e8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:50.503542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1467ac8-b44e-46e0-85b9-7f85d47125e8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:50.653510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a1467ac8-b44e-46e0-85b9-7f85d47125e8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:50.661940 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a1467ac8-b44e-46e0-85b9-7f85d47125e8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1379 microversion: 2.1 time: 0.188433 Oct 29 02:49:50.688773 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 694/1334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:50 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1379 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:50.699457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1528678759", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "77bc85c7-1f7e-4553-b485-501ac324775e"}], "security_groups": [{"name": "tempest-securitygroup--33865231"}], "key_name": "tempest-keypair-727801795", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:50.825833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] validate_networks() for [('77bc85c7-1f7e-4553-b485-501ac324775e', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:49:51.229142 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a02b33e1-7f8f-4eb1-9f25-838e88b1b248 tempest-SecurityGroupsTestAdminJSON-1132612237 tempest-SecurityGroupsTestAdminJSON-1132612237-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13688 microversion: 2.1 time: 2.057592 Oct 29 02:49:51.234433 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 641/1335] 10.222.0.16 () {58 vars in 1191 bytes} [Sat Oct 29 02:49:49 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13688 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:49:51.235405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5e057399-c392-4348-aa74-827c6aa1f0c8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:51.236064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5e057399-c392-4348-aa74-827c6aa1f0c8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: e28d98f2-e795-480d-974a-094260081964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:51.243807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e057399-c392-4348-aa74-827c6aa1f0c8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:51.244519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e057399-c392-4348-aa74-827c6aa1f0c8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:51.245606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e057399-c392-4348-aa74-827c6aa1f0c8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:51.246482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e057399-c392-4348-aa74-827c6aa1f0c8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:51.247071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e057399-c392-4348-aa74-827c6aa1f0c8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:51.247650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e057399-c392-4348-aa74-827c6aa1f0c8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:51.248336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:51.249206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:51.249971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:51.250982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:51.251394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:51.260700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:51.261169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:51.261590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:51.262348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:51.262790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:51.263199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:51.285047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Getting quotas for project 60896479fb0c4357ad5fb03016470283. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:51.290805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Getting quotas for user f0ea28d9bb3544bca1a3c90d983fe8e4 and project 60896479fb0c4357ad5fb03016470283. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:51.306063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:49:51.309001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:49:51.368472 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ffc47dd-922d-4d1d-b1da-5068bda1c69a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.25 time: 0.677022 Oct 29 02:49:51.369384 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 695/1336] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:49:50 2022] POST /compute/v2.1/servers => generated 404 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:49:51.375155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-39a5acae-eff0-4a7f-82fa-45736c4eaedd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:51.376192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-39a5acae-eff0-4a7f-82fa-45736c4eaedd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:51.383359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39a5acae-eff0-4a7f-82fa-45736c4eaedd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:51.383969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39a5acae-eff0-4a7f-82fa-45736c4eaedd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:51.384462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39a5acae-eff0-4a7f-82fa-45736c4eaedd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:51.385251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39a5acae-eff0-4a7f-82fa-45736c4eaedd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:51.385759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39a5acae-eff0-4a7f-82fa-45736c4eaedd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:51.386315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39a5acae-eff0-4a7f-82fa-45736c4eaedd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:51.411400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5e057399-c392-4348-aa74-827c6aa1f0c8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:51.421549 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5e057399-c392-4348-aa74-827c6aa1f0c8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964" status: 200 len: 1474 microversion: 2.1 time: 0.189995 Oct 29 02:49:51.424095 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 642/1337] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:51 2022] GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964 => generated 1474 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:51.544139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-64683007", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "7da6dbec-0aa3-4269-a738-63fa43633287"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:51.614294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] validate_networks() for [('7da6dbec-0aa3-4269-a738-63fa43633287', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:49:51.615576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-39a5acae-eff0-4a7f-82fa-45736c4eaedd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:51.624937 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-39a5acae-eff0-4a7f-82fa-45736c4eaedd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1358 microversion: 2.1 time: 0.253752 Oct 29 02:49:51.626488 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 696/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:51 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:51.638220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a71d90d9-ceac-4855-8e85-efd6a732747b tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] Calling method '.version_select at 0x7fe1a8858af0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:51.856971 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a71d90d9-ceac-4855-8e85-efd6a732747b tempest-SecurityGroupRulesNegativeTestJSON-1279590910 tempest-SecurityGroupRulesNegativeTestJSON-1279590910-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47" status: 202 len: 0 microversion: 2.1 time: 0.221648 Oct 29 02:49:51.858563 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 697/1339] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:49:51 2022] DELETE /compute/v2.1/os-security-groups/f8c97dee-3cfd-4cf9-bf44-b73c5ae23b47 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:51.865767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-a15f280b-74c4-43b8-a79d-a3b10bcefac4 req-047c33a3-5477-40bd-bcc5-151b55dd84c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b8047-ca96-48bc-8950-57a0b6f0d537", "name": "network-vif-plugged", "status": "completed", "tag": "a5042009-6ba4-421a-b724-be960ba5a87f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:51.897207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a15f280b-74c4-43b8-a79d-a3b10bcefac4 req-047c33a3-5477-40bd-bcc5-151b55dd84c9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:51.898910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a15f280b-74c4-43b8-a79d-a3b10bcefac4 req-047c33a3-5477-40bd-bcc5-151b55dd84c9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:51.899805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a15f280b-74c4-43b8-a79d-a3b10bcefac4 req-047c33a3-5477-40bd-bcc5-151b55dd84c9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:51.926527 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-a15f280b-74c4-43b8-a79d-a3b10bcefac4 req-047c33a3-5477-40bd-bcc5-151b55dd84c9 service nova] Creating event network-vif-plugged:a5042009-6ba4-421a-b724-be960ba5a87f for instance 239b8047-ca96-48bc-8950-57a0b6f0d537 on n-h2-862964-4 Oct 29 02:49:51.939728 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-a15f280b-74c4-43b8-a79d-a3b10bcefac4 req-047c33a3-5477-40bd-bcc5-151b55dd84c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079412 Oct 29 02:49:51.944913 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 698/1340] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:51.954064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a4daf8c-af2e-4d8f-9f4a-91c71efe7749 tempest-SecurityGroupsTestAdminJSON-524364737 tempest-SecurityGroupsTestAdminJSON-524364737-project] Calling method '.version_select at 0x7fe1a86eb040>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:52.379239 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5a4daf8c-af2e-4d8f-9f4a-91c71efe7749 tempest-SecurityGroupsTestAdminJSON-524364737 tempest-SecurityGroupsTestAdminJSON-524364737-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.432929 Oct 29 02:49:52.380772 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 699/1341] 10.222.0.16 () {58 vars in 1191 bytes} [Sat Oct 29 02:49:51 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:52.386344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:52.388305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:52.398695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.399348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.399886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.400742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.401294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.401932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.533901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:52.559893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:52.572529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:52.580350 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-06d6cb22-7260-4785-ac82-7dc782c0810d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.197827 Oct 29 02:49:52.594794 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 700/1342] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:52 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:52.608889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:52.609624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:52.625968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.626800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.647693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.661346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.661870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.662549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.706867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:52.707405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:52.707902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:52.708572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:52.709322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:52.744554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.745065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.746376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.749843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.750420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.750850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.815655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Getting quotas for project 802d5fbb45b84622acf59c4046f26a8c. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:52.824491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Getting quotas for user bba0b932c2af45c1a4e7fc5c185a64d1 and project 802d5fbb45b84622acf59c4046f26a8c. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:52.841087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:49:52.844263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:49:52.876392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:52.888898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:52.892310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:52.895917 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fd56434f-7d3c-4f84-a70e-710fd049e463 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1337 microversion: 2.25 time: 0.299729 Oct 29 02:49:52.898652 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 701/1343] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:52 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1337 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:52.912924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-671dbdef-308d-4eaf-973a-d2ae6ede1301 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:52.915530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-671dbdef-308d-4eaf-973a-d2ae6ede1301 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:52.932363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-671dbdef-308d-4eaf-973a-d2ae6ede1301 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.933265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-671dbdef-308d-4eaf-973a-d2ae6ede1301 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.934302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-671dbdef-308d-4eaf-973a-d2ae6ede1301 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.936334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-671dbdef-308d-4eaf-973a-d2ae6ede1301 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.936974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-671dbdef-308d-4eaf-973a-d2ae6ede1301 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.938672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-671dbdef-308d-4eaf-973a-d2ae6ede1301 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.989582 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aed0e249-350e-443e-99b8-8a3eabc40d16 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.564127 Oct 29 02:49:53.002049 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 643/1344] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:49:53.020828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1406f005-1ceb-469b-ab48-0ad0a6d857e5 tempest-SecurityGroupsTestAdminJSON-1132612237 tempest-SecurityGroupsTestAdminJSON-1132612237-project-admin] Calling method '.version_select at 0x7fe1a88973a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:53.476098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-671dbdef-308d-4eaf-973a-d2ae6ede1301 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:53.491302 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-671dbdef-308d-4eaf-973a-d2ae6ede1301 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1529 microversion: 2.1 time: 0.591325 Oct 29 02:49:53.494423 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 702/1345] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:52 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1529 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:53.509135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:53.511487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: e28d98f2-e795-480d-974a-094260081964] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:53.529570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.530932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.532695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.534816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.535445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.536709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.625347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.625972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.626724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.627255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lazy-loading 'fault' on Instance uuid e28d98f2-e795-480d-974a-094260081964 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:53.731475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:53.740544 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-14dec8e7-d8ea-4d40-b205-6095a5ea352b tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964" status: 200 len: 1308 microversion: 2.1 time: 0.243848 Oct 29 02:49:53.743436 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 703/1346] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:53 2022] GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:53.751488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-34e65aea-ff09-48b9-b2c2-e1b8414cfa9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:53.752458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-34e65aea-ff09-48b9-b2c2-e1b8414cfa9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:53.771731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34e65aea-ff09-48b9-b2c2-e1b8414cfa9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.772356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34e65aea-ff09-48b9-b2c2-e1b8414cfa9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.774136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34e65aea-ff09-48b9-b2c2-e1b8414cfa9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.779346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34e65aea-ff09-48b9-b2c2-e1b8414cfa9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.780172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34e65aea-ff09-48b9-b2c2-e1b8414cfa9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.780885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34e65aea-ff09-48b9-b2c2-e1b8414cfa9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.877093 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1406f005-1ceb-469b-ab48-0ad0a6d857e5 tempest-SecurityGroupsTestAdminJSON-1132612237 tempest-SecurityGroupsTestAdminJSON-1132612237-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/27ec322b-8f6f-45ee-b487-e3a8184b372e" status: 202 len: 0 microversion: 2.1 time: 0.873700 Oct 29 02:49:53.877987 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 644/1347] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:49:53 2022] DELETE /compute/v2.1/os-security-groups/27ec322b-8f6f-45ee-b487-e3a8184b372e => generated 0 bytes in 875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:53.894074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-75599b98-1d75-47e4-a48d-cd0670c51cdd req-47306fc3-122c-4564-a538-3a04c12b1522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b4a8c5-c08f-4c33-a57c-f2ac1a910f98", "name": "network-vif-deleted", "tag": "5717cd64-fb65-441b-8c4c-6aa355302be8"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:53.912054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-75599b98-1d75-47e4-a48d-cd0670c51cdd req-47306fc3-122c-4564-a538-3a04c12b1522 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.913236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-75599b98-1d75-47e4-a48d-cd0670c51cdd req-47306fc3-122c-4564-a538-3a04c12b1522 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.914659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-75599b98-1d75-47e4-a48d-cd0670c51cdd req-47306fc3-122c-4564-a538-3a04c12b1522 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.935601 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-75599b98-1d75-47e4-a48d-cd0670c51cdd req-47306fc3-122c-4564-a538-3a04c12b1522 service nova] Creating event network-vif-deleted:5717cd64-fb65-441b-8c4c-6aa355302be8 for instance 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 on n-h1-862964-4 Oct 29 02:49:53.948723 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-75599b98-1d75-47e4-a48d-cd0670c51cdd req-47306fc3-122c-4564-a538-3a04c12b1522 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065703 Oct 29 02:49:53.951122 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 645/1348] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:53.967307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-89091728-a321-4f30-918f-c6e19bf46988 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:53.968335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-89091728-a321-4f30-918f-c6e19bf46988 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:53.979134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89091728-a321-4f30-918f-c6e19bf46988 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.980044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89091728-a321-4f30-918f-c6e19bf46988 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.981416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89091728-a321-4f30-918f-c6e19bf46988 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.982408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89091728-a321-4f30-918f-c6e19bf46988 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.983109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89091728-a321-4f30-918f-c6e19bf46988 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.984269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89091728-a321-4f30-918f-c6e19bf46988 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.139949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-89091728-a321-4f30-918f-c6e19bf46988 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.153919 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-89091728-a321-4f30-918f-c6e19bf46988 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1226 microversion: 2.1 time: 0.198312 Oct 29 02:49:54.156944 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 646/1349] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:53 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1226 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:54.165085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bbf934ba-c4fa-45d3-ab34-28860996b7c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:54.165872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bbf934ba-c4fa-45d3-ab34-28860996b7c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:54.173236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbf934ba-c4fa-45d3-ab34-28860996b7c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.174044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbf934ba-c4fa-45d3-ab34-28860996b7c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.174699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbf934ba-c4fa-45d3-ab34-28860996b7c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.175437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbf934ba-c4fa-45d3-ab34-28860996b7c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.175965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbf934ba-c4fa-45d3-ab34-28860996b7c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.176488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbf934ba-c4fa-45d3-ab34-28860996b7c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.201683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34e65aea-ff09-48b9-b2c2-e1b8414cfa9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.210390 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-34e65aea-ff09-48b9-b2c2-e1b8414cfa9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1358 microversion: 2.1 time: 0.465546 Oct 29 02:49:54.216626 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 704/1350] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:53 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1358 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:54.233720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:54.234485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:54.247718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.248202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.248674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.249355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.249903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.250260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.366710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.380307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.384629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.397505 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ee86e1b-c658-4b67-99a7-0f9fa548ced7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.179543 Oct 29 02:49:54.401235 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 705/1351] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:54 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:54.410393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9a5621c1-2aca-4bd6-b265-0e71637cfb13 tempest-SecurityGroupsTestAdminJSON-1132612237 tempest-SecurityGroupsTestAdminJSON-1132612237-project-admin] Calling method '.version_select at 0x7fe1a886b790>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:54.505913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bbf934ba-c4fa-45d3-ab34-28860996b7c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.518469 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bbf934ba-c4fa-45d3-ab34-28860996b7c2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1529 microversion: 2.1 time: 0.357946 Oct 29 02:49:54.519757 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 647/1352] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:54 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1529 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:54.527054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:54.528543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:54.536188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.537025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.537991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.540289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.571513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.572597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.713730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.729420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.731118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.736755 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d8b8ba8d-5927-4cad-86c7-897009ab4300 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1343 microversion: 2.25 time: 0.215513 Oct 29 02:49:54.737348 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 648/1353] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:54 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1343 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:54.744761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5e0e57ac-3c41-4c2e-aa11-2ae7bc73d9ad tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:54.792566 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5e0e57ac-3c41-4c2e-aa11-2ae7bc73d9ad tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/ed145074-692f-45c8-91b5-a9951c6dac1a" status: 202 len: 0 microversion: 2.1 time: 0.053779 Oct 29 02:49:54.793215 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 649/1354] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:54 2022] DELETE /compute/v2.1/flavors/ed145074-692f-45c8-91b5-a9951c6dac1a => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:54.800782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:54.801378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: e28d98f2-e795-480d-974a-094260081964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:54.808190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.808675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.809945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.810850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.811451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.812062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.849076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.849977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.850776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.851440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lazy-loading 'fault' on Instance uuid e28d98f2-e795-480d-974a-094260081964 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:54.927566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.937577 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ba4386d9-a536-4559-b9e2-08e4b4a81bcb tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964" status: 200 len: 1308 microversion: 2.1 time: 0.142482 Oct 29 02:49:54.939580 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 650/1355] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:54 2022] GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964 => generated 1308 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:54.946566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-72329b96-ce8b-4321-a400-7db5c677f96b tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:54.979598 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9a5621c1-2aca-4bd6-b265-0e71637cfb13 tempest-SecurityGroupsTestAdminJSON-1132612237 tempest-SecurityGroupsTestAdminJSON-1132612237-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/28dda22b-807d-499d-8aee-fc4ff18b8ebc" status: 202 len: 0 microversion: 2.1 time: 0.577143 Oct 29 02:49:54.979833 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-72329b96-ce8b-4321-a400-7db5c677f96b tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038712 Oct 29 02:49:54.980611 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 651/1356] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:54.980886 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 706/1357] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:49:54 2022] DELETE /compute/v2.1/os-security-groups/28dda22b-807d-499d-8aee-fc4ff18b8ebc => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:54.989230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-88ed9362-93e6-46db-a389-87d001b32485 tempest-SecurityGroupsTestAdminJSON-524364737 tempest-SecurityGroupsTestAdminJSON-524364737-project] Calling method '.version_select at 0x7fe1a8927a60>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:55.006030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:55.009318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:55.017830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.018718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.019382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.020441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.021141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.021911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.027383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:55.064405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:55.071921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Old instance type tempest-test_resize_flavor_-1363039196, new instance type m1.heat {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 02:49:55.081187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:55.081997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:55.082626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:55.083419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:55.084672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:55.224409 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7765acc6-d389-4f92-bd07-f255d7f47f43 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "POST /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e/action" status: 202 len: 0 microversion: 2.1 time: 0.218026 Oct 29 02:49:55.229465 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 707/1358] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:49:55 2022] POST /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:55.234716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a947f605-f8eb-42db-b2df-6eb4f9d3760f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:55.250439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a947f605-f8eb-42db-b2df-6eb4f9d3760f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:55.257030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a947f605-f8eb-42db-b2df-6eb4f9d3760f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.257755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a947f605-f8eb-42db-b2df-6eb4f9d3760f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.258406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a947f605-f8eb-42db-b2df-6eb4f9d3760f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.259282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a947f605-f8eb-42db-b2df-6eb4f9d3760f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.260060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a947f605-f8eb-42db-b2df-6eb4f9d3760f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.260640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a947f605-f8eb-42db-b2df-6eb4f9d3760f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.459731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a947f605-f8eb-42db-b2df-6eb4f9d3760f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:55.470563 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a947f605-f8eb-42db-b2df-6eb4f9d3760f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1274 microversion: 2.1 time: 0.239694 Oct 29 02:49:55.478473 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 708/1359] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:55 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1274 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:55.483614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af3912f7-fd98-4370-a246-fac9825f01e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:55.484213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-af3912f7-fd98-4370-a246-fac9825f01e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:55.503031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af3912f7-fd98-4370-a246-fac9825f01e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.504243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af3912f7-fd98-4370-a246-fac9825f01e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.505020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af3912f7-fd98-4370-a246-fac9825f01e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.506036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af3912f7-fd98-4370-a246-fac9825f01e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.519342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af3912f7-fd98-4370-a246-fac9825f01e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.519845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af3912f7-fd98-4370-a246-fac9825f01e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.714892 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-88ed9362-93e6-46db-a389-87d001b32485 tempest-SecurityGroupsTestAdminJSON-524364737 tempest-SecurityGroupsTestAdminJSON-524364737-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a51ecd2e-f8e0-4f32-bcee-f6105d56f894" status: 202 len: 0 microversion: 2.1 time: 0.729580 Oct 29 02:49:55.716243 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 652/1360] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:49:54 2022] DELETE /compute/v2.1/os-security-groups/a51ecd2e-f8e0-4f32-bcee-f6105d56f894 => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:55.722246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82b56999-0aa1-4634-b00e-b86eec266d87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:55.723538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-82b56999-0aa1-4634-b00e-b86eec266d87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:55.740026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b56999-0aa1-4634-b00e-b86eec266d87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.740961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b56999-0aa1-4634-b00e-b86eec266d87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.744100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b56999-0aa1-4634-b00e-b86eec266d87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.745458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b56999-0aa1-4634-b00e-b86eec266d87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.747839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b56999-0aa1-4634-b00e-b86eec266d87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.748869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b56999-0aa1-4634-b00e-b86eec266d87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:56.377859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-af3912f7-fd98-4370-a246-fac9825f01e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:56.391740 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af3912f7-fd98-4370-a246-fac9825f01e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1540 microversion: 2.1 time: 0.910739 Oct 29 02:49:56.394074 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 709/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:55 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1540 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:56.406001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:56.408173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:56.423207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:56.424071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:56.426123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:56.429162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:56.432646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:56.433470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:56.627256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:56.645475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:56.669922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:56.685319 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3c0f53cb-83d8-4d0c-806c-047e5dfa6726 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.289790 Oct 29 02:49:56.687057 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 710/1362] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:56 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:56.698164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-42b54fb6-022e-4f20-89ea-1cdf987316eb tempest-SecurityGroupsTestAdminJSON-524364737 tempest-SecurityGroupsTestAdminJSON-524364737-project] Calling method '.version_select at 0x7fe1a8655c10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:56.699166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-82b56999-0aa1-4634-b00e-b86eec266d87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:56.712423 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-82b56999-0aa1-4634-b00e-b86eec266d87 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1538 microversion: 2.1 time: 0.994870 Oct 29 02:49:56.729677 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 653/1363] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:55 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1538 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:56.734172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:56.734799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:56.757083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:56.757569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:56.758008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:56.758756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:56.759146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:56.759558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:56.990566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:57.005859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:57.011832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:57.022858 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c4a5d141-a8d9-41e7-8c11-8d4895968feb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1409 microversion: 2.25 time: 0.301468 Oct 29 02:49:57.044285 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 654/1364] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:56 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1409 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:57.065362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:57.066317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: e28d98f2-e795-480d-974a-094260081964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:57.077300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.078112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.078936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.080370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.081150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.081723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.108116 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] HTTP exception thrown: Instance e28d98f2-e795-480d-974a-094260081964 could not be found. Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Request method failure captured: Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964 HTTP/1.1 Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQcdpT8JB8GrvvAJ61Yxe1jlfCECOh5sugNg5m64KLROk1GsYWS0LZYnuqGvCgF6T5ipecgpuIJ1pa8J_NGPz1f8AEuzcC4jHyMs4ppIRkZE4j2YKuif_5zJmkugQyuc0qpZy_xKmnOmxvJsusF0EbAIU9HMx6aOM6uQ5Gkn2pdf9w Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:49:57.110801 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1031cc111cc747098bbc8a428c1cfad6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}] Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fa30f68a081646d6b452d1cdf6e0181c Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance e28d98f2-e795-480d-974a-094260081964 could not be found. Oct 29 02:49:57.112353 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'e28d98f2-e795-480d-974a-094260081964'} Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e28d98f2-e795-480d-974a-094260081964 could not be found. Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:57.113391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e28d98f2-e795-480d-974a-094260081964 could not be found. Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e28d98f2-e795-480d-974a-094260081964 could not be found. Oct 29 02:49:57.115482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.118207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Returning 404 to user: Instance e28d98f2-e795-480d-974a-094260081964 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:57.119475 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c6253942-af44-4107-bbf6-d980057ed866 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964" status: 404 len: 111 microversion: 2.1 time: 0.062639 Oct 29 02:49:57.121611 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 655/1365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:57 2022] GET /compute/v2.1/servers/e28d98f2-e795-480d-974a-094260081964 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:57.129441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-583a99b0-ba0f-460d-853b-858a51158633 req-eb3f10e1-aa02-4b0d-adfe-828113ebb342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28d98f2-e795-480d-974a-094260081964", "name": "network-vif-deleted", "tag": "fdf72c9a-20ac-4e21-94e2-4bf07361d5ff"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:57.144699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-583a99b0-ba0f-460d-853b-858a51158633 req-eb3f10e1-aa02-4b0d-adfe-828113ebb342 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.145481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-583a99b0-ba0f-460d-853b-858a51158633 req-eb3f10e1-aa02-4b0d-adfe-828113ebb342 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.146168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-583a99b0-ba0f-460d-853b-858a51158633 req-eb3f10e1-aa02-4b0d-adfe-828113ebb342 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.165433 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-583a99b0-ba0f-460d-853b-858a51158633 req-eb3f10e1-aa02-4b0d-adfe-828113ebb342 service nova] Creating event network-vif-deleted:fdf72c9a-20ac-4e21-94e2-4bf07361d5ff for instance e28d98f2-e795-480d-974a-094260081964 on n-h2-862964-4 Oct 29 02:49:57.177944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-583a99b0-ba0f-460d-853b-858a51158633 req-eb3f10e1-aa02-4b0d-adfe-828113ebb342 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052390 Oct 29 02:49:57.179420 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 656/1366] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:57.194374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cc40d35c-7b57-429c-9922-a65e09a4388b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:57.194979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cc40d35c-7b57-429c-9922-a65e09a4388b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:57.207130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc40d35c-7b57-429c-9922-a65e09a4388b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.207540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc40d35c-7b57-429c-9922-a65e09a4388b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.207967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc40d35c-7b57-429c-9922-a65e09a4388b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.208669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc40d35c-7b57-429c-9922-a65e09a4388b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.209598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc40d35c-7b57-429c-9922-a65e09a4388b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.210067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc40d35c-7b57-429c-9922-a65e09a4388b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.368719 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cc40d35c-7b57-429c-9922-a65e09a4388b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187905 Oct 29 02:49:57.369430 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 657/1367] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 02:49:57 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:57.383914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-66d0e579-6e27-487e-b2fd-fbad31bf08b7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:57.384514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-66d0e579-6e27-487e-b2fd-fbad31bf08b7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:57.405623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66d0e579-6e27-487e-b2fd-fbad31bf08b7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.406141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66d0e579-6e27-487e-b2fd-fbad31bf08b7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.406567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66d0e579-6e27-487e-b2fd-fbad31bf08b7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.407265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66d0e579-6e27-487e-b2fd-fbad31bf08b7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.407705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66d0e579-6e27-487e-b2fd-fbad31bf08b7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.408129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66d0e579-6e27-487e-b2fd-fbad31bf08b7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.540100 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-42b54fb6-022e-4f20-89ea-1cdf987316eb tempest-SecurityGroupsTestAdminJSON-524364737 tempest-SecurityGroupsTestAdminJSON-524364737-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/526f977f-d84f-4982-b2ec-0d4a20c6e852" status: 202 len: 0 microversion: 2.1 time: 0.850489 Oct 29 02:49:57.541813 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 711/1368] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:49:56 2022] DELETE /compute/v2.1/os-security-groups/526f977f-d84f-4982-b2ec-0d4a20c6e852 => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:57.564965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:57.567422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:57.577971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-66d0e579-6e27-487e-b2fd-fbad31bf08b7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:57.592828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.594264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.594426 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-66d0e579-6e27-487e-b2fd-fbad31bf08b7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1280 microversion: 2.1 time: 0.214360 Oct 29 02:49:57.595017 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 658/1369] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:57 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1280 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:57.606778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.606778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.606778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.606778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.636104 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] HTTP exception thrown: Instance 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 could not be found. Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Request method failure captured: Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 HTTP/1.1 Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQcdpT8JB8GrvvAJ61Yxe1jlfCECOh5sugNg5m64KLROk1GsYWS0LZYnuqGvCgF6T5ipecgpuIJ1pa8J_NGPz1f8AEuzcC4jHyMs4ppIRkZE4j2YKuif_5zJmkugQyuc0qpZy_xKmnOmxvJsusF0EbAIU9HMx6aOM6uQ5Gkn2pdf9w Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:49:57.641217 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1031cc111cc747098bbc8a428c1cfad6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}] Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: fa30f68a081646d6b452d1cdf6e0181c Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 could not be found. Oct 29 02:49:57.642893 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '27b4a8c5-c08f-4c33-a57c-f2ac1a910f98'} Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 could not be found. Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:57.643857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 could not be found. Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 could not be found. Oct 29 02:49:57.645531 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.648308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Returning 404 to user: Instance 27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:57.650162 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18f60b1c-4d05-4359-b6dd-e54acb1400c4 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98" status: 404 len: 111 microversion: 2.1 time: 0.107049 Oct 29 02:49:57.654617 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 712/1370] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:57 2022] GET /compute/v2.1/servers/27b4a8c5-c08f-4c33-a57c-f2ac1a910f98 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:57.660563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-96acfa2e-5540-4106-a09d-346190249588 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:57.716128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:57.717407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:57.731687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.732555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.734997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.738989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.739857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.740410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.811183 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-96acfa2e-5540-4106-a09d-346190249588 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/731c01cd-87d0-4608-800c-5f6c8c707a9e" status: 204 len: 0 microversion: 2.1 time: 0.155684 Oct 29 02:49:57.814492 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 659/1371] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 02:49:57 2022] DELETE /compute/v2.1/os-server-groups/731c01cd-87d0-4608-800c-5f6c8c707a9e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:49:57.821411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5a479b0b-30d3-4947-b19c-14634ba7b44b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:57.829104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5a479b0b-30d3-4947-b19c-14634ba7b44b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:57.845242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a479b0b-30d3-4947-b19c-14634ba7b44b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.846031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a479b0b-30d3-4947-b19c-14634ba7b44b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.846824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a479b0b-30d3-4947-b19c-14634ba7b44b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.847799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a479b0b-30d3-4947-b19c-14634ba7b44b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.848475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a479b0b-30d3-4947-b19c-14634ba7b44b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.849253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a479b0b-30d3-4947-b19c-14634ba7b44b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.032574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.064833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.071161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.079765 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-641fb56e-6eec-44c6-a740-b39d8363b4b7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1533 microversion: 2.91 time: 0.368032 Oct 29 02:49:58.080599 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 713/1372] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:57 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1533 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:49:58.090001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4e7d79b3-be36-4667-8e76-87e625696ba3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:58.091559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4e7d79b3-be36-4667-8e76-87e625696ba3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:58.101276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7d79b3-be36-4667-8e76-87e625696ba3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.102084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7d79b3-be36-4667-8e76-87e625696ba3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.102685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7d79b3-be36-4667-8e76-87e625696ba3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.103773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7d79b3-be36-4667-8e76-87e625696ba3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.104701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7d79b3-be36-4667-8e76-87e625696ba3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.105126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7d79b3-be36-4667-8e76-87e625696ba3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.143267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4e7d79b3-be36-4667-8e76-87e625696ba3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:58.237289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5a479b0b-30d3-4947-b19c-14634ba7b44b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.253825 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5a479b0b-30d3-4947-b19c-14634ba7b44b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1538 microversion: 2.1 time: 0.434298 Oct 29 02:49:58.257402 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 660/1373] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:57 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1538 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:58.281925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:58.282624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:58.290000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.291533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.292207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.293496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.294407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.295290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.301195 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4e7d79b3-be36-4667-8e76-87e625696ba3 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381" status: 204 len: 0 microversion: 2.1 time: 0.219100 Oct 29 02:49:58.303313 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 714/1374] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:58 2022] DELETE /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:58.325495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cb0e02ad-04af-46f3-906e-1b423e00baf1 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:58.328478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cb0e02ad-04af-46f3-906e-1b423e00baf1 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:58.343313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb0e02ad-04af-46f3-906e-1b423e00baf1 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.343795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb0e02ad-04af-46f3-906e-1b423e00baf1 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.344219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb0e02ad-04af-46f3-906e-1b423e00baf1 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.345538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb0e02ad-04af-46f3-906e-1b423e00baf1 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.346103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb0e02ad-04af-46f3-906e-1b423e00baf1 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.346723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb0e02ad-04af-46f3-906e-1b423e00baf1 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.351227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:58.522537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-cb0e02ad-04af-46f3-906e-1b423e00baf1 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lazy-loading 'services' on Instance uuid c50495a0-6a28-4904-a856-768d30c4a6ec {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:58.561087 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cb0e02ad-04af-46f3-906e-1b423e00baf1 tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1938 microversion: 2.91 time: 0.256286 Oct 29 02:49:58.573216 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 715/1375] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:58 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1938 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:58.578643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3a2e9d00-fe0d-4f44-bc2e-ce9221af4e65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:58.579369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3a2e9d00-fe0d-4f44-bc2e-ce9221af4e65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:58.592136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a2e9d00-fe0d-4f44-bc2e-ce9221af4e65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.592664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a2e9d00-fe0d-4f44-bc2e-ce9221af4e65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.593699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a2e9d00-fe0d-4f44-bc2e-ce9221af4e65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.594931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a2e9d00-fe0d-4f44-bc2e-ce9221af4e65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.595539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a2e9d00-fe0d-4f44-bc2e-ce9221af4e65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.596123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a2e9d00-fe0d-4f44-bc2e-ce9221af4e65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.639555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3a2e9d00-fe0d-4f44-bc2e-ce9221af4e65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:58.740872 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3a2e9d00-fe0d-4f44-bc2e-ce9221af4e65 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 204 len: 0 microversion: 2.1 time: 0.165834 Oct 29 02:49:58.742887 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 716/1376] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:58 2022] DELETE /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:58.751877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c1e63432-e5bc-4926-af3d-6c4e42d29cda tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:58.753047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c1e63432-e5bc-4926-af3d-6c4e42d29cda tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:58.759744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1e63432-e5bc-4926-af3d-6c4e42d29cda tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.760567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1e63432-e5bc-4926-af3d-6c4e42d29cda tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.761234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1e63432-e5bc-4926-af3d-6c4e42d29cda tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.762190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1e63432-e5bc-4926-af3d-6c4e42d29cda tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.763100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1e63432-e5bc-4926-af3d-6c4e42d29cda tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.763727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1e63432-e5bc-4926-af3d-6c4e42d29cda tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.781096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.791206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-c1e63432-e5bc-4926-af3d-6c4e42d29cda tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lazy-loading 'flavor' on Instance uuid c50495a0-6a28-4904-a856-768d30c4a6ec {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:58.821283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.826635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.828573 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-23f2664f-ae6d-4642-a138-ef8c4ddd6643 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1409 microversion: 2.25 time: 0.569484 Oct 29 02:49:58.830924 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 661/1377] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:58 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1409 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:58.838800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4aebb55c-7c1c-49ab-9e52-8d8bca1fd0f2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:58.840630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4aebb55c-7c1c-49ab-9e52-8d8bca1fd0f2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:58.850953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4aebb55c-7c1c-49ab-9e52-8d8bca1fd0f2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.851537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4aebb55c-7c1c-49ab-9e52-8d8bca1fd0f2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.852448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4aebb55c-7c1c-49ab-9e52-8d8bca1fd0f2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.854430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4aebb55c-7c1c-49ab-9e52-8d8bca1fd0f2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.855053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4aebb55c-7c1c-49ab-9e52-8d8bca1fd0f2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.855630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4aebb55c-7c1c-49ab-9e52-8d8bca1fd0f2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.052201 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c1e63432-e5bc-4926-af3d-6c4e42d29cda tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "POST /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec/action" status: 202 len: 0 microversion: 2.91 time: 0.304418 Oct 29 02:49:59.053231 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 717/1378] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:49:58 2022] POST /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:59.059166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2b34fe53-c95f-4a26-b209-eedeae6858c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:59.060536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2b34fe53-c95f-4a26-b209-eedeae6858c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:59.067736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b34fe53-c95f-4a26-b209-eedeae6858c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.068911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b34fe53-c95f-4a26-b209-eedeae6858c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.070115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b34fe53-c95f-4a26-b209-eedeae6858c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.070989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b34fe53-c95f-4a26-b209-eedeae6858c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.071718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b34fe53-c95f-4a26-b209-eedeae6858c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.072398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b34fe53-c95f-4a26-b209-eedeae6858c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.104480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:59.339109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2b34fe53-c95f-4a26-b209-eedeae6858c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:59.348542 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2b34fe53-c95f-4a26-b209-eedeae6858c9 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381" status: 200 len: 1474 microversion: 2.1 time: 0.293577 Oct 29 02:49:59.350721 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 718/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:59 2022] GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381 => generated 1474 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:59.361350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:59.362260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:59.367303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:59.372134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.372623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.373055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.373838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.374342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.374763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.455192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:59.469029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:59.469189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4aebb55c-7c1c-49ab-9e52-8d8bca1fd0f2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:59.470780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:59.478799 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4aebb55c-7c1c-49ab-9e52-8d8bca1fd0f2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1322 microversion: 2.1 time: 0.646230 Oct 29 02:49:59.479393 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 662/1380] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:58 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1322 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:59.493537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-44fdaec0-4829-42db-af03-f1f40a02f580 req-56a39c9f-efbb-431f-88be-8e5b4c87cb2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce4caa1-3b78-4bcf-98e4-b4d9da71dfee", "tag": "13168635-67a9-4cb0-a7c1-c8262d0cd5a5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:59.501666 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f7cb1777-b1e5-46f7-b65f-e4c46f082727 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.147392 Oct 29 02:49:59.502537 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 719/1381] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:59 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:59.513660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-44fdaec0-4829-42db-af03-f1f40a02f580 req-56a39c9f-efbb-431f-88be-8e5b4c87cb2b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.514157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-44fdaec0-4829-42db-af03-f1f40a02f580 req-56a39c9f-efbb-431f-88be-8e5b4c87cb2b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.514584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-44fdaec0-4829-42db-af03-f1f40a02f580 req-56a39c9f-efbb-431f-88be-8e5b4c87cb2b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.528343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f4b8318-8841-4a80-a279-63ed17e1df66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:59.529257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f4b8318-8841-4a80-a279-63ed17e1df66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:59.531618 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-44fdaec0-4829-42db-af03-f1f40a02f580 req-56a39c9f-efbb-431f-88be-8e5b4c87cb2b service nova] Creating event network-changed:13168635-67a9-4cb0-a7c1-c8262d0cd5a5 for instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee on n-h1-862964-4 Oct 29 02:49:59.536026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4b8318-8841-4a80-a279-63ed17e1df66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.536672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4b8318-8841-4a80-a279-63ed17e1df66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.537242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4b8318-8841-4a80-a279-63ed17e1df66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.537986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4b8318-8841-4a80-a279-63ed17e1df66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.538509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4b8318-8841-4a80-a279-63ed17e1df66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.538991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4b8318-8841-4a80-a279-63ed17e1df66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.539569 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-44fdaec0-4829-42db-af03-f1f40a02f580 req-56a39c9f-efbb-431f-88be-8e5b4c87cb2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057964 Oct 29 02:49:59.540722 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 663/1382] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:59.704086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d781a268-b100-467c-b3d1-a579ca200151 req-e8a42874-6f69-4974-a74d-ecfcae195f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c285fc05-0513-4e2e-b7d8-fb6d8466eefb", "tag": "d7867910-0a7e-4d66-8d87-fee7084736c6"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:59.720531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d781a268-b100-467c-b3d1-a579ca200151 req-e8a42874-6f69-4974-a74d-ecfcae195f13 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.721003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d781a268-b100-467c-b3d1-a579ca200151 req-e8a42874-6f69-4974-a74d-ecfcae195f13 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.721741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d781a268-b100-467c-b3d1-a579ca200151 req-e8a42874-6f69-4974-a74d-ecfcae195f13 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.746098 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d781a268-b100-467c-b3d1-a579ca200151 req-e8a42874-6f69-4974-a74d-ecfcae195f13 service nova] Creating event network-changed:d7867910-0a7e-4d66-8d87-fee7084736c6 for instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb on n-h1-862964-4 Oct 29 02:49:59.753015 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d781a268-b100-467c-b3d1-a579ca200151 req-e8a42874-6f69-4974-a74d-ecfcae195f13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057051 Oct 29 02:49:59.754356 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 664/1383] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:49:59.861179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:59.862683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:59.869977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.871027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.871656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.872506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.873730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.874398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.977284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f4b8318-8841-4a80-a279-63ed17e1df66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:59.987504 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f4b8318-8841-4a80-a279-63ed17e1df66 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1538 microversion: 2.1 time: 0.470511 Oct 29 02:50:00.012746 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 720/1384] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:59 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1538 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:00.373388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bfd182ff-c8ce-42ca-bf7b-4bd62b9f693e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:00.374324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bfd182ff-c8ce-42ca-bf7b-4bd62b9f693e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:00.381777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfd182ff-c8ce-42ca-bf7b-4bd62b9f693e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:00.382542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfd182ff-c8ce-42ca-bf7b-4bd62b9f693e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:00.383121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfd182ff-c8ce-42ca-bf7b-4bd62b9f693e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:00.384096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfd182ff-c8ce-42ca-bf7b-4bd62b9f693e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:00.384688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfd182ff-c8ce-42ca-bf7b-4bd62b9f693e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:00.385287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfd182ff-c8ce-42ca-bf7b-4bd62b9f693e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:00.545271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bfd182ff-c8ce-42ca-bf7b-4bd62b9f693e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:00.556618 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bfd182ff-c8ce-42ca-bf7b-4bd62b9f693e tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381" status: 200 len: 1474 microversion: 2.1 time: 0.187907 Oct 29 02:50:00.564878 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 721/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:00 2022] GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381 => generated 1474 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:00.570907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1b19aa99-2a0b-48b2-b884-6b8e4fd841d7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:00.571695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1b19aa99-2a0b-48b2-b884-6b8e4fd841d7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:00.578535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b19aa99-2a0b-48b2-b884-6b8e4fd841d7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:00.579092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b19aa99-2a0b-48b2-b884-6b8e4fd841d7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:00.579590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b19aa99-2a0b-48b2-b884-6b8e4fd841d7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:00.580352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b19aa99-2a0b-48b2-b884-6b8e4fd841d7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:00.580937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b19aa99-2a0b-48b2-b884-6b8e4fd841d7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:00.581395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b19aa99-2a0b-48b2-b884-6b8e4fd841d7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:00.587956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:00.607737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:00.609615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:00.611129 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c0639771-e87a-4a53-8024-ce4810cc645f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1409 microversion: 2.25 time: 0.756605 Oct 29 02:50:00.612324 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 665/1386] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:59 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1409 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:00.618765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:00.619638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:00.627631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:00.631537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:00.632274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:00.633484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:00.634141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:00.634978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:00.736941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:00.747352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:00.749269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:00.751792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b19aa99-2a0b-48b2-b884-6b8e4fd841d7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:00.762122 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1b19aa99-2a0b-48b2-b884-6b8e4fd841d7 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1322 microversion: 2.1 time: 0.194969 Oct 29 02:50:00.763868 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 722/1387] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:00 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:00.767845 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-264e3e82-54cb-497f-8de9-70c8c3a33e9c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.154140 Oct 29 02:50:00.775081 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 666/1388] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:00 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:01.016752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b4333575-c190-424e-85ee-daefaf2ca234 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:01.017508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b4333575-c190-424e-85ee-daefaf2ca234 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:01.023993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4333575-c190-424e-85ee-daefaf2ca234 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.024484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4333575-c190-424e-85ee-daefaf2ca234 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.025096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4333575-c190-424e-85ee-daefaf2ca234 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.025844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4333575-c190-424e-85ee-daefaf2ca234 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.026450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4333575-c190-424e-85ee-daefaf2ca234 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.026874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4333575-c190-424e-85ee-daefaf2ca234 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.275007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:01.300328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=9 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:01.348319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b4333575-c190-424e-85ee-daefaf2ca234 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:01.368994 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b4333575-c190-424e-85ee-daefaf2ca234 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1538 microversion: 2.1 time: 0.343597 Oct 29 02:50:01.371060 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 723/1389] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:01 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1538 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:01.571608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ad2cd9a1-f96d-444a-8575-a2938c3be572 req-d1097909-abbe-48e3-899e-8130024ec583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239b8047-ca96-48bc-8950-57a0b6f0d537", "tag": "a5042009-6ba4-421a-b724-be960ba5a87f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:01.598830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c95ffea9-db04-43d9-9fec-4fc225eec9de tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:01.600556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c95ffea9-db04-43d9-9fec-4fc225eec9de tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:01.611120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ad2cd9a1-f96d-444a-8575-a2938c3be572 req-d1097909-abbe-48e3-899e-8130024ec583 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.611891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ad2cd9a1-f96d-444a-8575-a2938c3be572 req-d1097909-abbe-48e3-899e-8130024ec583 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.612531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ad2cd9a1-f96d-444a-8575-a2938c3be572 req-d1097909-abbe-48e3-899e-8130024ec583 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.623764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c95ffea9-db04-43d9-9fec-4fc225eec9de tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.626218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c95ffea9-db04-43d9-9fec-4fc225eec9de tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.629179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c95ffea9-db04-43d9-9fec-4fc225eec9de tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.629966 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ad2cd9a1-f96d-444a-8575-a2938c3be572 req-d1097909-abbe-48e3-899e-8130024ec583 service nova] Creating event network-changed:a5042009-6ba4-421a-b724-be960ba5a87f for instance 239b8047-ca96-48bc-8950-57a0b6f0d537 on n-h2-862964-4 Oct 29 02:50:01.632536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c95ffea9-db04-43d9-9fec-4fc225eec9de tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.633049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c95ffea9-db04-43d9-9fec-4fc225eec9de tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.633592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c95ffea9-db04-43d9-9fec-4fc225eec9de tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.637042 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ad2cd9a1-f96d-444a-8575-a2938c3be572 req-d1097909-abbe-48e3-899e-8130024ec583 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070937 Oct 29 02:50:01.637957 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 667/1390] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:01.644348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:01.645667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:01.676639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.677515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.678405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.679486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.680154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.680810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.856332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c95ffea9-db04-43d9-9fec-4fc225eec9de tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:01.877086 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c95ffea9-db04-43d9-9fec-4fc225eec9de tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381" status: 200 len: 1474 microversion: 2.1 time: 0.300146 Oct 29 02:50:01.890515 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 724/1391] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:01 2022] GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381 => generated 1474 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:01.910100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e6c57e8-131d-4520-874b-4491e8efe448 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:01.915353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9e6c57e8-131d-4520-874b-4491e8efe448 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:01.929570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:01.931736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6c57e8-131d-4520-874b-4491e8efe448 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.936639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6c57e8-131d-4520-874b-4491e8efe448 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.937381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6c57e8-131d-4520-874b-4491e8efe448 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.938513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6c57e8-131d-4520-874b-4491e8efe448 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.939075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6c57e8-131d-4520-874b-4491e8efe448 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.941132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:01.942798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:01.942969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6c57e8-131d-4520-874b-4491e8efe448 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.944663 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5ca5341d-9d78-4012-b734-af3d86658bed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1409 microversion: 2.25 time: 0.305212 Oct 29 02:50:01.945749 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 668/1392] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:01 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1409 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:01.959714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:01.961616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:01.976197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.980142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.981154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.983799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.988613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.989300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:02.111138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:02.123463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:02.125031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:02.135767 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b221a187-6c70-4d78-a305-ebcdc292377f tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.188789 Oct 29 02:50:02.150245 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 669/1393] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:01 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:02.272688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9e6c57e8-131d-4520-874b-4491e8efe448 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:02.283477 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9e6c57e8-131d-4520-874b-4491e8efe448 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1322 microversion: 2.1 time: 0.391710 Oct 29 02:50:02.284077 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 725/1394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:01 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:02.400011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-083d6fdc-d5bd-4bed-ad8f-53373d4a0db8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:02.401011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-083d6fdc-d5bd-4bed-ad8f-53373d4a0db8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:02.410696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-083d6fdc-d5bd-4bed-ad8f-53373d4a0db8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:02.412356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-083d6fdc-d5bd-4bed-ad8f-53373d4a0db8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:02.413311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-083d6fdc-d5bd-4bed-ad8f-53373d4a0db8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:02.414550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-083d6fdc-d5bd-4bed-ad8f-53373d4a0db8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:02.415239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-083d6fdc-d5bd-4bed-ad8f-53373d4a0db8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:02.415882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-083d6fdc-d5bd-4bed-ad8f-53373d4a0db8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:02.498068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-981975810", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:02.518327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:02.583891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:50:02.683618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-083d6fdc-d5bd-4bed-ad8f-53373d4a0db8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:02.705653 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-083d6fdc-d5bd-4bed-ad8f-53373d4a0db8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1538 microversion: 2.1 time: 0.309853 Oct 29 02:50:02.727475 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 726/1395] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:02 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1538 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:02.784907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:02.836679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:02.906945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-13e82abc-d67d-4ed7-863c-9203ff941444 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:02.908479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-13e82abc-d67d-4ed7-863c-9203ff941444 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:02.920489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13e82abc-d67d-4ed7-863c-9203ff941444 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:02.920976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13e82abc-d67d-4ed7-863c-9203ff941444 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:02.921402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13e82abc-d67d-4ed7-863c-9203ff941444 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:02.926319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13e82abc-d67d-4ed7-863c-9203ff941444 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:02.926791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13e82abc-d67d-4ed7-863c-9203ff941444 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:02.927247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13e82abc-d67d-4ed7-863c-9203ff941444 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.122237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:50:03.122656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:50:03.123121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:50:03.123519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:50:03.123920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:50:03.142400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.143175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.143789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.145146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.145831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.146848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.166181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Getting quotas for project 01d46bf526a149d7b149decc11d24f3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:50:03.170913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Getting quotas for user 5c78a473c70b4e29ac4d3fdd53c4b501 and project 01d46bf526a149d7b149decc11d24f3d. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:50:03.183438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:50:03.186594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:50:03.248964 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b81bd4fc-69ae-4d5e-8627-0a04ea1451ad tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929976 Oct 29 02:50:03.250331 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 670/1396] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:50:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:50:03.260036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:03.260981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:03.267090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-13e82abc-d67d-4ed7-863c-9203ff941444 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.268721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.269447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.270124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.271350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.272254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.272902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.281093 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-13e82abc-d67d-4ed7-863c-9203ff941444 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381" status: 200 len: 1474 microversion: 2.1 time: 0.379520 Oct 29 02:50:03.310641 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 727/1397] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:02 2022] GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381 => generated 1474 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:03.340383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c747a261-a504-4d3b-a494-6324d3168be6 req-e920806f-fe66-4a28-95ca-50ae08817b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c375224-e74e-4e93-934a-e38f06c2a47f", "name": "network-vif-deleted", "tag": "020f55b9-e5ef-4544-8e6b-f7fe204c8723"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:03.375460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c747a261-a504-4d3b-a494-6324d3168be6 req-e920806f-fe66-4a28-95ca-50ae08817b4f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.376879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c747a261-a504-4d3b-a494-6324d3168be6 req-e920806f-fe66-4a28-95ca-50ae08817b4f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.379054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c747a261-a504-4d3b-a494-6324d3168be6 req-e920806f-fe66-4a28-95ca-50ae08817b4f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.401369 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c747a261-a504-4d3b-a494-6324d3168be6 req-e920806f-fe66-4a28-95ca-50ae08817b4f service nova] Creating event network-vif-deleted:020f55b9-e5ef-4544-8e6b-f7fe204c8723 for instance 9c375224-e74e-4e93-934a-e38f06c2a47f on n-h2-862964-4 Oct 29 02:50:03.430312 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c747a261-a504-4d3b-a494-6324d3168be6 req-e920806f-fe66-4a28-95ca-50ae08817b4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118024 Oct 29 02:50:03.432180 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 728/1398] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:03.443362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:03.444307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:03.451765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.452494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.453177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.454147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.454802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.455431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.689589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.700631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.706520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.720078 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f3bfff06-d222-4afe-a12a-67516048030b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.284891 Oct 29 02:50:03.721303 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 729/1399] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:03 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:03.744233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a1407dc4-908b-4e85-a8b1-89a2f2c9d88e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:03.747485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a1407dc4-908b-4e85-a8b1-89a2f2c9d88e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:03.856862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a1407dc4-908b-4e85-a8b1-89a2f2c9d88e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.867149 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a1407dc4-908b-4e85-a8b1-89a2f2c9d88e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1213 microversion: 2.1 time: 0.143093 Oct 29 02:50:03.883637 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 730/1400] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:03 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1213 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:03.889830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4fa08606-9a3e-4fc7-b41c-c20d9be4d822 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:03.890442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4fa08606-9a3e-4fc7-b41c-c20d9be4d822 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:03.909963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fa08606-9a3e-4fc7-b41c-c20d9be4d822 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.910497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fa08606-9a3e-4fc7-b41c-c20d9be4d822 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.910940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fa08606-9a3e-4fc7-b41c-c20d9be4d822 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.912353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fa08606-9a3e-4fc7-b41c-c20d9be4d822 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.912939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fa08606-9a3e-4fc7-b41c-c20d9be4d822 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.913548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fa08606-9a3e-4fc7-b41c-c20d9be4d822 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.931085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.943897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.945356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.946528 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3f5c3320-aba9-4746-a484-8bcceec3bef3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1409 microversion: 2.25 time: 0.694961 Oct 29 02:50:03.947098 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 671/1401] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:03 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1409 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:03.962727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-81e471fc-f0e1-497a-ba30-2007b51ec3fa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:03.963563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-81e471fc-f0e1-497a-ba30-2007b51ec3fa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:03.979864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e471fc-f0e1-497a-ba30-2007b51ec3fa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.980645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e471fc-f0e1-497a-ba30-2007b51ec3fa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.981325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e471fc-f0e1-497a-ba30-2007b51ec3fa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.982078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e471fc-f0e1-497a-ba30-2007b51ec3fa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.982853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e471fc-f0e1-497a-ba30-2007b51ec3fa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.983142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e471fc-f0e1-497a-ba30-2007b51ec3fa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:04.444992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-81e471fc-f0e1-497a-ba30-2007b51ec3fa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:04.456804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4fa08606-9a3e-4fc7-b41c-c20d9be4d822 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:04.459244 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-81e471fc-f0e1-497a-ba30-2007b51ec3fa tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1538 microversion: 2.1 time: 0.500210 Oct 29 02:50:04.460377 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 672/1402] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:03 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1538 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:04.475302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e159059d-018d-4683-9cbe-9cc1e7eb83c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:04.476557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e159059d-018d-4683-9cbe-9cc1e7eb83c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:04.483331 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4fa08606-9a3e-4fc7-b41c-c20d9be4d822 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1322 microversion: 2.1 time: 0.598286 Oct 29 02:50:04.486847 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 731/1403] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:03 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:04.489867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e159059d-018d-4683-9cbe-9cc1e7eb83c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:04.490478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e159059d-018d-4683-9cbe-9cc1e7eb83c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:04.491002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e159059d-018d-4683-9cbe-9cc1e7eb83c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:04.492218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e159059d-018d-4683-9cbe-9cc1e7eb83c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:04.492887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e159059d-018d-4683-9cbe-9cc1e7eb83c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:04.493575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e159059d-018d-4683-9cbe-9cc1e7eb83c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:04.754164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:04.755064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:04.766610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:04.767862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:04.769016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:04.771198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:04.772078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:04.772779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:04.945249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:04.954626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:04.960604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:04.980038 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac61450a-bae3-4519-afe3-81b4213dc5fc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.230165 Oct 29 02:50:04.982098 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 732/1404] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:04 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:50:04.995655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-23ca4773-200f-4608-87ca-b1e193535824 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:04.996274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-23ca4773-200f-4608-87ca-b1e193535824 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:05.008316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23ca4773-200f-4608-87ca-b1e193535824 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:05.009064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23ca4773-200f-4608-87ca-b1e193535824 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:05.009654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23ca4773-200f-4608-87ca-b1e193535824 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:05.010574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23ca4773-200f-4608-87ca-b1e193535824 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:05.011183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23ca4773-200f-4608-87ca-b1e193535824 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:05.011810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23ca4773-200f-4608-87ca-b1e193535824 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:05.209553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e159059d-018d-4683-9cbe-9cc1e7eb83c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:05.226640 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e159059d-018d-4683-9cbe-9cc1e7eb83c5 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381" status: 200 len: 1432 microversion: 2.1 time: 0.764960 Oct 29 02:50:05.227802 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 673/1405] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:04 2022] GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381 => generated 1432 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:05.232647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:05.233430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:05.247700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:05.248481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:05.249075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:05.250003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:05.250601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:05.251161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:05.292390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-23ca4773-200f-4608-87ca-b1e193535824 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:05.321897 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-23ca4773-200f-4608-87ca-b1e193535824 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1265 microversion: 2.1 time: 0.337747 Oct 29 02:50:05.324355 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 733/1406] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:04 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1265 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:05.346732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-e38ea7d9-a620-46ff-b558-cc6a41d1b3e7 req-32630b60-2445-45ba-b216-b939fb724214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283e7c95-2e30-4537-9163-3b933b0bc381", "name": "network-vif-deleted", "tag": "8efa80a2-a5c8-431e-ac67-14abfbedc06e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:05.375687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e38ea7d9-a620-46ff-b558-cc6a41d1b3e7 req-32630b60-2445-45ba-b216-b939fb724214 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:05.376561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e38ea7d9-a620-46ff-b558-cc6a41d1b3e7 req-32630b60-2445-45ba-b216-b939fb724214 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:05.379089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e38ea7d9-a620-46ff-b558-cc6a41d1b3e7 req-32630b60-2445-45ba-b216-b939fb724214 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:05.422605 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-e38ea7d9-a620-46ff-b558-cc6a41d1b3e7 req-32630b60-2445-45ba-b216-b939fb724214 service nova] Creating event network-vif-deleted:8efa80a2-a5c8-431e-ac67-14abfbedc06e for instance 283e7c95-2e30-4537-9163-3b933b0bc381 on n-h2-862964-4 Oct 29 02:50:05.439461 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-e38ea7d9-a620-46ff-b558-cc6a41d1b3e7 req-32630b60-2445-45ba-b216-b939fb724214 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110797 Oct 29 02:50:05.441820 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 734/1407] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:05.488200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a06c9d03-f11c-4a45-8f39-782524b2ea20 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:05.490143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a06c9d03-f11c-4a45-8f39-782524b2ea20 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:05.512751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a06c9d03-f11c-4a45-8f39-782524b2ea20 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:05.514894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a06c9d03-f11c-4a45-8f39-782524b2ea20 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:05.517064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a06c9d03-f11c-4a45-8f39-782524b2ea20 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:05.518808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a06c9d03-f11c-4a45-8f39-782524b2ea20 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:05.520265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a06c9d03-f11c-4a45-8f39-782524b2ea20 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:05.520843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a06c9d03-f11c-4a45-8f39-782524b2ea20 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:05.686668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:05.695853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:05.697617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:05.707287 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-87e85805-8a32-4f2c-a456-8def5acb9977 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1409 microversion: 2.25 time: 0.478234 Oct 29 02:50:05.725213 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 674/1408] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:05 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1409 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:05.735685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b132af25-c163-45f3-9a62-8662d9de38ee req-42b75af3-dcc7-4e4e-942d-eadedf897c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce4caa1-3b78-4bcf-98e4-b4d9da71dfee", "name": "network-vif-plugged", "status": "completed", "tag": "13168635-67a9-4cb0-a7c1-c8262d0cd5a5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:05.747027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b132af25-c163-45f3-9a62-8662d9de38ee req-42b75af3-dcc7-4e4e-942d-eadedf897c73 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:05.747685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b132af25-c163-45f3-9a62-8662d9de38ee req-42b75af3-dcc7-4e4e-942d-eadedf897c73 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:05.748257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b132af25-c163-45f3-9a62-8662d9de38ee req-42b75af3-dcc7-4e4e-942d-eadedf897c73 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:05.761901 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b132af25-c163-45f3-9a62-8662d9de38ee req-42b75af3-dcc7-4e4e-942d-eadedf897c73 service nova] Creating event network-vif-plugged:13168635-67a9-4cb0-a7c1-c8262d0cd5a5 for instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee on n-h1-862964-4 Oct 29 02:50:05.777918 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b132af25-c163-45f3-9a62-8662d9de38ee req-42b75af3-dcc7-4e4e-942d-eadedf897c73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043162 Oct 29 02:50:05.779159 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 675/1409] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:05.787051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-54f46f58-5e22-4364-ace6-0ab2ce5bd594 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:05.788239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-54f46f58-5e22-4364-ace6-0ab2ce5bd594 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:05.796888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54f46f58-5e22-4364-ace6-0ab2ce5bd594 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:05.797677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54f46f58-5e22-4364-ace6-0ab2ce5bd594 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:05.798380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54f46f58-5e22-4364-ace6-0ab2ce5bd594 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:05.799312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54f46f58-5e22-4364-ace6-0ab2ce5bd594 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:05.800002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54f46f58-5e22-4364-ace6-0ab2ce5bd594 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:05.801183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54f46f58-5e22-4364-ace6-0ab2ce5bd594 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:05.962085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a06c9d03-f11c-4a45-8f39-782524b2ea20 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:05.973529 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a06c9d03-f11c-4a45-8f39-782524b2ea20 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1538 microversion: 2.1 time: 0.490539 Oct 29 02:50:05.974183 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 735/1410] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:05 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1538 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:06.012194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:06.012863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:06.040886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.042081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.046560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.047595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.049377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.050221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.166694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.177338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.179881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.189081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-54f46f58-5e22-4364-ace6-0ab2ce5bd594 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.200528 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-54f46f58-5e22-4364-ace6-0ab2ce5bd594 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1322 microversion: 2.1 time: 0.419125 Oct 29 02:50:06.203954 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3b26b342-b53f-449d-9559-c3198778133d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.197481 Oct 29 02:50:06.204438 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 676/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:05 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:06.219353 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 736/1412] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:06 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:06.265823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:06.267143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:06.279390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.281614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.286553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.287483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.287967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.288393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.369654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2f281204-b26c-4927-8b39-785f939e0d13 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:06.371138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2f281204-b26c-4927-8b39-785f939e0d13 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:06.380151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.383327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.385702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.386928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lazy-loading 'fault' on Instance uuid 283e7c95-2e30-4537-9163-3b933b0bc381 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:50:06.391061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f281204-b26c-4927-8b39-785f939e0d13 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.392086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f281204-b26c-4927-8b39-785f939e0d13 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.394130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f281204-b26c-4927-8b39-785f939e0d13 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.398665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f281204-b26c-4927-8b39-785f939e0d13 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.404104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f281204-b26c-4927-8b39-785f939e0d13 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.405669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f281204-b26c-4927-8b39-785f939e0d13 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.456813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:06.530547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.543004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2f281204-b26c-4927-8b39-785f939e0d13 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.559322 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2f281204-b26c-4927-8b39-785f939e0d13 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1271 microversion: 2.1 time: 0.203694 Oct 29 02:50:06.563406 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e83ba31c-eec3-415c-ac7c-ca0086cb0aea tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381" status: 200 len: 1308 microversion: 2.1 time: 0.302341 Oct 29 02:50:06.564360 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 677/1413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:06 2022] GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381 => generated 1308 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:06.564637 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 737/1414] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:06 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:06.736455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:06.737204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:06.746074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.746979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.747579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.748635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.749250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.749941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.971458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.987057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.989358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.992939 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6f5d142b-05ec-49f4-8ba2-b95d69609ac1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1409 microversion: 2.25 time: 0.261174 Oct 29 02:50:06.994034 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 678/1415] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:06 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1409 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:06.997209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b7c6eaf9-09bc-4600-be4e-c5f658bae65e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:06.997921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b7c6eaf9-09bc-4600-be4e-c5f658bae65e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:07.008646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c6eaf9-09bc-4600-be4e-c5f658bae65e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.013246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c6eaf9-09bc-4600-be4e-c5f658bae65e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.013775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c6eaf9-09bc-4600-be4e-c5f658bae65e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.015029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c6eaf9-09bc-4600-be4e-c5f658bae65e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.015488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c6eaf9-09bc-4600-be4e-c5f658bae65e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.015923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c6eaf9-09bc-4600-be4e-c5f658bae65e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.225695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e41762fe-7962-4370-9e29-fdb98cde7edd tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:07.226333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e41762fe-7962-4370-9e29-fdb98cde7edd tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:07.237592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e41762fe-7962-4370-9e29-fdb98cde7edd tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.238305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e41762fe-7962-4370-9e29-fdb98cde7edd tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.238897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e41762fe-7962-4370-9e29-fdb98cde7edd tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.239778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e41762fe-7962-4370-9e29-fdb98cde7edd tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.240502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e41762fe-7962-4370-9e29-fdb98cde7edd tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.241097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e41762fe-7962-4370-9e29-fdb98cde7edd tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.378234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b7c6eaf9-09bc-4600-be4e-c5f658bae65e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:07.393625 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b7c6eaf9-09bc-4600-be4e-c5f658bae65e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.400496 Oct 29 02:50:07.394996 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 738/1416] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:06 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:07.400078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:07.400950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:07.408939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.420481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.423157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.425335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.426729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.427900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.568292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:07.577617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:07.586927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:07.600999 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-584abcb1-d83d-4fe4-9b2c-880aef2d2d0d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.204640 Oct 29 02:50:07.601605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 739/1417] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:07 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:07.606387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-efe5e3b4-b0bb-416e-abe2-26a32b4dd2d8 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:07.607166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-efe5e3b4-b0bb-416e-abe2-26a32b4dd2d8 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:07.624812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e41762fe-7962-4370-9e29-fdb98cde7edd tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:07.627370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efe5e3b4-b0bb-416e-abe2-26a32b4dd2d8 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.627862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efe5e3b4-b0bb-416e-abe2-26a32b4dd2d8 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.628285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efe5e3b4-b0bb-416e-abe2-26a32b4dd2d8 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.628993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efe5e3b4-b0bb-416e-abe2-26a32b4dd2d8 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.629435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efe5e3b4-b0bb-416e-abe2-26a32b4dd2d8 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.629878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efe5e3b4-b0bb-416e-abe2-26a32b4dd2d8 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.635452 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e41762fe-7962-4370-9e29-fdb98cde7edd tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1322 microversion: 2.1 time: 0.413111 Oct 29 02:50:07.641978 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 679/1418] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:07 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:07.658088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:07.662626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 283e7c95-2e30-4537-9163-3b933b0bc381] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:07.685385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.686219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.686921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.687852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.688530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.689183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.710398 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] HTTP exception thrown: Instance 283e7c95-2e30-4537-9163-3b933b0bc381 could not be found. Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Request method failure captured: Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381 HTTP/1.1 Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQcdpT8JB8GrvvAJ61Yxe1jlfCECOh5sugNg5m64KLROk1GsYWS0LZYnuqGvCgF6T5ipecgpuIJ1pa8J_NGPz1f8AEuzcC4jHyMs4ppIRkZE4j2YKuif_5zJmkugQyuc0qpZy_xKmnOmxvJsusF0EbAIU9HMx6aOM6uQ5Gkn2pdf9w Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:50:07.712161 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1031cc111cc747098bbc8a428c1cfad6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}] Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fa30f68a081646d6b452d1cdf6e0181c Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 283e7c95-2e30-4537-9163-3b933b0bc381 could not be found. Oct 29 02:50:07.713563 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '283e7c95-2e30-4537-9163-3b933b0bc381'} Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283e7c95-2e30-4537-9163-3b933b0bc381 could not be found. Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:07.714413 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283e7c95-2e30-4537-9163-3b933b0bc381 could not be found. Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283e7c95-2e30-4537-9163-3b933b0bc381 could not be found. Oct 29 02:50:07.715634 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:07.716818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Returning 404 to user: Instance 283e7c95-2e30-4537-9163-3b933b0bc381 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:07.716818 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d153fb0a-b04a-4352-80bd-47bec648834f tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381" status: 404 len: 111 microversion: 2.1 time: 0.069373 Oct 29 02:50:07.718354 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 680/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:07 2022] GET /compute/v2.1/servers/283e7c95-2e30-4537-9163-3b933b0bc381 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:07.726635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:07.727347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: 9c375224-e74e-4e93-934a-e38f06c2a47f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:07.733963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.734447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.734971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.735670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.736294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.737245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.756281 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] HTTP exception thrown: Instance 9c375224-e74e-4e93-934a-e38f06c2a47f could not be found. Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Request method failure captured: Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f HTTP/1.1 Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQcdpT8JB8GrvvAJ61Yxe1jlfCECOh5sugNg5m64KLROk1GsYWS0LZYnuqGvCgF6T5ipecgpuIJ1pa8J_NGPz1f8AEuzcC4jHyMs4ppIRkZE4j2YKuif_5zJmkugQyuc0qpZy_xKmnOmxvJsusF0EbAIU9HMx6aOM6uQ5Gkn2pdf9w Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:50:07.759377 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1031cc111cc747098bbc8a428c1cfad6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}] Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fa30f68a081646d6b452d1cdf6e0181c Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 9c375224-e74e-4e93-934a-e38f06c2a47f could not be found. Oct 29 02:50:07.760923 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '9c375224-e74e-4e93-934a-e38f06c2a47f'} Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c375224-e74e-4e93-934a-e38f06c2a47f could not be found. Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:07.761847 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c375224-e74e-4e93-934a-e38f06c2a47f could not be found. Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c375224-e74e-4e93-934a-e38f06c2a47f could not be found. Oct 29 02:50:07.764383 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:07.768719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Returning 404 to user: Instance 9c375224-e74e-4e93-934a-e38f06c2a47f could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:07.770482 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4c4bb24a-20e7-4259-97db-5a2aa6c3daf7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f" status: 404 len: 111 microversion: 2.1 time: 0.047430 Oct 29 02:50:07.771583 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 681/1420] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:07 2022] GET /compute/v2.1/servers/9c375224-e74e-4e93-934a-e38f06c2a47f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:07.783868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b5d6f93-e32d-4a1f-ad5b-1aa057c662d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:07.823631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3b5d6f93-e32d-4a1f-ad5b-1aa057c662d7 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/493015c5-e33b-49ac-b057-228eb0d71581" status: 204 len: 0 microversion: 2.1 time: 0.039848 Oct 29 02:50:07.825846 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 682/1421] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 02:50:07 2022] DELETE /compute/v2.1/os-server-groups/493015c5-e33b-49ac-b057-228eb0d71581 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:07.837260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82e2ac82-c7d6-4d64-8f6f-d2ae304180ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:07.838882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-82e2ac82-c7d6-4d64-8f6f-d2ae304180ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:07.851431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e2ac82-c7d6-4d64-8f6f-d2ae304180ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.858633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e2ac82-c7d6-4d64-8f6f-d2ae304180ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.859562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e2ac82-c7d6-4d64-8f6f-d2ae304180ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.861758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e2ac82-c7d6-4d64-8f6f-d2ae304180ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.862402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e2ac82-c7d6-4d64-8f6f-d2ae304180ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.864344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e2ac82-c7d6-4d64-8f6f-d2ae304180ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.897214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:07.904117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-efe5e3b4-b0bb-416e-abe2-26a32b4dd2d8 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:07.907218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-82e2ac82-c7d6-4d64-8f6f-d2ae304180ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:50:07.914188 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-efe5e3b4-b0bb-416e-abe2-26a32b4dd2d8 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1313 microversion: 2.1 time: 0.311270 Oct 29 02:50:07.917664 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 740/1422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:07 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:07.933679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4a87b032-0a33-423f-9eea-3ca8531835f9 req-ca5bb848-02e2-4b77-88ba-8315094b8521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c285fc05-0513-4e2e-b7d8-fb6d8466eefb", "name": "network-vif-plugged", "status": "completed", "tag": "d7867910-0a7e-4d66-8d87-fee7084736c6"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:07.948903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4a87b032-0a33-423f-9eea-3ca8531835f9 req-ca5bb848-02e2-4b77-88ba-8315094b8521 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.954968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4a87b032-0a33-423f-9eea-3ca8531835f9 req-ca5bb848-02e2-4b77-88ba-8315094b8521 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.955321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4a87b032-0a33-423f-9eea-3ca8531835f9 req-ca5bb848-02e2-4b77-88ba-8315094b8521 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.979910 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4a87b032-0a33-423f-9eea-3ca8531835f9 req-ca5bb848-02e2-4b77-88ba-8315094b8521 service nova] Creating event network-vif-plugged:d7867910-0a7e-4d66-8d87-fee7084736c6 for instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb on n-h1-862964-4 Oct 29 02:50:07.986812 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4a87b032-0a33-423f-9eea-3ca8531835f9 req-ca5bb848-02e2-4b77-88ba-8315094b8521 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067726 Oct 29 02:50:07.988107 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 741/1423] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:08.020765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:08.021550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:08.047829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.048337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.048775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.049499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.049988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.050415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.083917 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-82e2ac82-c7d6-4d64-8f6f-d2ae304180ab tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 204 len: 0 microversion: 2.1 time: 0.254805 Oct 29 02:50:08.085561 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 683/1424] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:50:07 2022] DELETE /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:08.094815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4d8ab660-5120-4dba-a19d-07c08b5ae8a8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:08.095933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4d8ab660-5120-4dba-a19d-07c08b5ae8a8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:08.107168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d8ab660-5120-4dba-a19d-07c08b5ae8a8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.107756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d8ab660-5120-4dba-a19d-07c08b5ae8a8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.108274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d8ab660-5120-4dba-a19d-07c08b5ae8a8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.109002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d8ab660-5120-4dba-a19d-07c08b5ae8a8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.109456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d8ab660-5120-4dba-a19d-07c08b5ae8a8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.116505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d8ab660-5120-4dba-a19d-07c08b5ae8a8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.351635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:08.361608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:08.363347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:08.364845 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f21c5d6-8ce2-4c02-be86-aea40e52760a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1605 microversion: 2.25 time: 0.350863 Oct 29 02:50:08.366233 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 742/1425] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:08 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1605 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:50:08.390677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e9750b9-5c8c-4ce7-a99e-7663022face0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:08.390677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0e9750b9-5c8c-4ce7-a99e-7663022face0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:08.402014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e9750b9-5c8c-4ce7-a99e-7663022face0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.402836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e9750b9-5c8c-4ce7-a99e-7663022face0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.403455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e9750b9-5c8c-4ce7-a99e-7663022face0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.404356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e9750b9-5c8c-4ce7-a99e-7663022face0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.404960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e9750b9-5c8c-4ce7-a99e-7663022face0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.406309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e9750b9-5c8c-4ce7-a99e-7663022face0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.490308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4d8ab660-5120-4dba-a19d-07c08b5ae8a8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:08.506825 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4d8ab660-5120-4dba-a19d-07c08b5ae8a8 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1473 microversion: 2.1 time: 0.417210 Oct 29 02:50:08.520458 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 684/1426] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:08 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1473 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:08.520458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40dde4d4-b446-447f-b788-dde0e3746a49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:08.521460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40dde4d4-b446-447f-b788-dde0e3746a49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:08.529910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40dde4d4-b446-447f-b788-dde0e3746a49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.530396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40dde4d4-b446-447f-b788-dde0e3746a49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.530820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40dde4d4-b446-447f-b788-dde0e3746a49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.531519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40dde4d4-b446-447f-b788-dde0e3746a49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.531959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40dde4d4-b446-447f-b788-dde0e3746a49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.532371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40dde4d4-b446-447f-b788-dde0e3746a49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.637303 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e9750b9-5c8c-4ce7-a99e-7663022face0 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.251267 Oct 29 02:50:08.645880 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 743/1427] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Oct 29 02:50:08 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-interface => generated 285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:50:08.652127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d8d101ce-b1f1-495e-b49b-9058d3cebb54 req-6873bcac-8776-4fb2-a74a-c0f590b24993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cbe53ff-63ff-43b0-be87-9f728001a964", "tag": "c94390c1-0597-4a53-87f2-1ae7b808fca8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:08.674141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d8d101ce-b1f1-495e-b49b-9058d3cebb54 req-6873bcac-8776-4fb2-a74a-c0f590b24993 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.674906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d8d101ce-b1f1-495e-b49b-9058d3cebb54 req-6873bcac-8776-4fb2-a74a-c0f590b24993 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.675499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d8d101ce-b1f1-495e-b49b-9058d3cebb54 req-6873bcac-8776-4fb2-a74a-c0f590b24993 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.696619 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d8d101ce-b1f1-495e-b49b-9058d3cebb54 req-6873bcac-8776-4fb2-a74a-c0f590b24993 service nova] Creating event network-changed:c94390c1-0597-4a53-87f2-1ae7b808fca8 for instance 1cbe53ff-63ff-43b0-be87-9f728001a964 on n-h2-862964-4 Oct 29 02:50:08.703241 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d8d101ce-b1f1-495e-b49b-9058d3cebb54 req-6873bcac-8776-4fb2-a74a-c0f590b24993 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054622 Oct 29 02:50:08.707355 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 744/1428] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:08.717136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:08.718478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:08.727217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.727709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.728139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.728842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.729285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.729698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.795112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40dde4d4-b446-447f-b788-dde0e3746a49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:08.806436 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40dde4d4-b446-447f-b788-dde0e3746a49 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.297626 Oct 29 02:50:08.813971 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 685/1429] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:08 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:08.821776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-10f99dfd-b550-42b7-9611-eb62b4c6a475 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:08.823078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-10f99dfd-b550-42b7-9611-eb62b4c6a475 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:08.830544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f99dfd-b550-42b7-9611-eb62b4c6a475 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.831138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f99dfd-b550-42b7-9611-eb62b4c6a475 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.831683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f99dfd-b550-42b7-9611-eb62b4c6a475 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.832480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f99dfd-b550-42b7-9611-eb62b4c6a475 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.833004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f99dfd-b550-42b7-9611-eb62b4c6a475 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.833488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f99dfd-b550-42b7-9611-eb62b4c6a475 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.903014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:08.918911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:08.921362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:08.930471 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aea8ce24-a1cf-41fa-b239-ed8302cf4d69 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.221126 Oct 29 02:50:08.934413 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 745/1430] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:08 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:08.960811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-235462c3-ff8b-446d-9c55-d769d1201d81 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:08.962013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-235462c3-ff8b-446d-9c55-d769d1201d81 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:08.970194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235462c3-ff8b-446d-9c55-d769d1201d81 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.971065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235462c3-ff8b-446d-9c55-d769d1201d81 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.972483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235462c3-ff8b-446d-9c55-d769d1201d81 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.973433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235462c3-ff8b-446d-9c55-d769d1201d81 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.974867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235462c3-ff8b-446d-9c55-d769d1201d81 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.975571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235462c3-ff8b-446d-9c55-d769d1201d81 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:09.023921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-10f99dfd-b550-42b7-9611-eb62b4c6a475 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:09.033286 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-10f99dfd-b550-42b7-9611-eb62b4c6a475 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1322 microversion: 2.1 time: 0.217088 Oct 29 02:50:09.034259 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 686/1431] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:08 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:09.532937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d43c925e-ce2c-46d4-aaa7-6bab51c8b9a2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:09.533559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d43c925e-ce2c-46d4-aaa7-6bab51c8b9a2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:09.542023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d43c925e-ce2c-46d4-aaa7-6bab51c8b9a2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:09.542961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d43c925e-ce2c-46d4-aaa7-6bab51c8b9a2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:09.543754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d43c925e-ce2c-46d4-aaa7-6bab51c8b9a2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:09.544764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d43c925e-ce2c-46d4-aaa7-6bab51c8b9a2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:09.545532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d43c925e-ce2c-46d4-aaa7-6bab51c8b9a2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:09.546216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d43c925e-ce2c-46d4-aaa7-6bab51c8b9a2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:09.635727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-235462c3-ff8b-446d-9c55-d769d1201d81 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:09.648694 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-235462c3-ff8b-446d-9c55-d769d1201d81 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1313 microversion: 2.1 time: 0.709961 Oct 29 02:50:09.650294 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 746/1432] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:08 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:09.705529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d43c925e-ce2c-46d4-aaa7-6bab51c8b9a2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:09.718140 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d43c925e-ce2c-46d4-aaa7-6bab51c8b9a2 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1473 microversion: 2.1 time: 0.190261 Oct 29 02:50:09.719665 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 687/1433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:09 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1473 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:09.833380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d1f55e37-39b5-4ead-be91-a552589f3cf4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:09.834763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d1f55e37-39b5-4ead-be91-a552589f3cf4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:09.842276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1f55e37-39b5-4ead-be91-a552589f3cf4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:09.843116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1f55e37-39b5-4ead-be91-a552589f3cf4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:09.843771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1f55e37-39b5-4ead-be91-a552589f3cf4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:09.844708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1f55e37-39b5-4ead-be91-a552589f3cf4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:09.845369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1f55e37-39b5-4ead-be91-a552589f3cf4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:09.846050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1f55e37-39b5-4ead-be91-a552589f3cf4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:09.963930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:09.964531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:09.981531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:09.988892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:09.997167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:09.998299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:09.998952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:09.999556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:10.181452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:10.192614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:10.198089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:10.208415 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-680458a1-ac6e-489f-89b0-931b160951c5 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.248274 Oct 29 02:50:10.210186 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 688/1434] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:09 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:50:10.216394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-657d9d5e-f99b-4fea-a89a-a2f83a9f7b2c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:10.217212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-657d9d5e-f99b-4fea-a89a-a2f83a9f7b2c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:10.218772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d1f55e37-39b5-4ead-be91-a552589f3cf4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:10.225174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-657d9d5e-f99b-4fea-a89a-a2f83a9f7b2c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:10.226820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-657d9d5e-f99b-4fea-a89a-a2f83a9f7b2c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:10.227439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-657d9d5e-f99b-4fea-a89a-a2f83a9f7b2c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:10.229128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-657d9d5e-f99b-4fea-a89a-a2f83a9f7b2c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:10.229733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-657d9d5e-f99b-4fea-a89a-a2f83a9f7b2c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:10.230332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-657d9d5e-f99b-4fea-a89a-a2f83a9f7b2c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:10.236832 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d1f55e37-39b5-4ead-be91-a552589f3cf4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.407390 Oct 29 02:50:10.239311 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 747/1435] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:09 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:10.575163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-657d9d5e-f99b-4fea-a89a-a2f83a9f7b2c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:10.588625 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-657d9d5e-f99b-4fea-a89a-a2f83a9f7b2c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1517 microversion: 2.1 time: 0.376748 Oct 29 02:50:10.589848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 689/1436] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:10 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1517 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:10.613089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d24f95be-2e28-4c1e-b282-343ca9eef329 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Action: 'create', calling method: .version_select at 0x7fe1a873f940>, body: {"pool": null} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:10.675017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b991a4b-1c32-4fe2-aa77-27cbc3858355 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:10.676044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b991a4b-1c32-4fe2-aa77-27cbc3858355 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:10.683080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b991a4b-1c32-4fe2-aa77-27cbc3858355 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:10.683901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b991a4b-1c32-4fe2-aa77-27cbc3858355 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:10.684597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b991a4b-1c32-4fe2-aa77-27cbc3858355 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:10.686013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b991a4b-1c32-4fe2-aa77-27cbc3858355 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:10.687174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b991a4b-1c32-4fe2-aa77-27cbc3858355 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:10.688077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b991a4b-1c32-4fe2-aa77-27cbc3858355 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:10.986724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2b991a4b-1c32-4fe2-aa77-27cbc3858355 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:11.003019 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b991a4b-1c32-4fe2-aa77-27cbc3858355 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1313 microversion: 2.1 time: 0.332354 Oct 29 02:50:11.004186 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 690/1437] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:10 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:11.012957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e7425750-f9f9-44c4-b26d-3a5b8e7110d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:11.013828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e7425750-f9f9-44c4-b26d-3a5b8e7110d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:11.024107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7425750-f9f9-44c4-b26d-3a5b8e7110d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.024662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7425750-f9f9-44c4-b26d-3a5b8e7110d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.025094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7425750-f9f9-44c4-b26d-3a5b8e7110d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:11.025890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7425750-f9f9-44c4-b26d-3a5b8e7110d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.026372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7425750-f9f9-44c4-b26d-3a5b8e7110d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.026791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7425750-f9f9-44c4-b26d-3a5b8e7110d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:11.157665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e7425750-f9f9-44c4-b26d-3a5b8e7110d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:11.168000 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e7425750-f9f9-44c4-b26d-3a5b8e7110d6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1431 microversion: 2.1 time: 0.162522 Oct 29 02:50:11.168787 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 691/1438] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:11 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1431 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:11.241455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:11.242355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:11.257332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.258232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.259026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:11.260134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.260890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.261178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:11.356197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:11.364744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:11.366408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:11.372870 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7b902646-4fc0-4013-8223-2b1ce974503e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.137801 Oct 29 02:50:11.373921 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 692/1439] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:11 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:11.378727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b9d2936a-6a39-49a7-b1b6-6aabb6a81bd9 req-b5e80bc7-bb96-44a9-83a3-669466b149ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9", "name": "network-vif-deleted", "tag": "70b52719-e140-4fae-8687-982ee5af6aad"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:11.388786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b9d2936a-6a39-49a7-b1b6-6aabb6a81bd9 req-b5e80bc7-bb96-44a9-83a3-669466b149ef service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.389520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b9d2936a-6a39-49a7-b1b6-6aabb6a81bd9 req-b5e80bc7-bb96-44a9-83a3-669466b149ef service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.390232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b9d2936a-6a39-49a7-b1b6-6aabb6a81bd9 req-b5e80bc7-bb96-44a9-83a3-669466b149ef service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:11.404558 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b9d2936a-6a39-49a7-b1b6-6aabb6a81bd9 req-b5e80bc7-bb96-44a9-83a3-669466b149ef service nova] Creating event network-vif-deleted:70b52719-e140-4fae-8687-982ee5af6aad for instance b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 on n-h2-862964-4 Oct 29 02:50:11.411059 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b9d2936a-6a39-49a7-b1b6-6aabb6a81bd9 req-b5e80bc7-bb96-44a9-83a3-669466b149ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035652 Oct 29 02:50:11.412232 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 693/1440] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:11.418337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-79a726b8-a705-4799-94e9-1d2912d00b6f req-21fbcf35-f6f3-435b-bc4f-49c8ec711b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce4caa1-3b78-4bcf-98e4-b4d9da71dfee", "tag": "13168635-67a9-4cb0-a7c1-c8262d0cd5a5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:11.428817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-79a726b8-a705-4799-94e9-1d2912d00b6f req-21fbcf35-f6f3-435b-bc4f-49c8ec711b68 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.429303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-79a726b8-a705-4799-94e9-1d2912d00b6f req-21fbcf35-f6f3-435b-bc4f-49c8ec711b68 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.429731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-79a726b8-a705-4799-94e9-1d2912d00b6f req-21fbcf35-f6f3-435b-bc4f-49c8ec711b68 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:11.441398 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-79a726b8-a705-4799-94e9-1d2912d00b6f req-21fbcf35-f6f3-435b-bc4f-49c8ec711b68 service nova] Creating event network-changed:13168635-67a9-4cb0-a7c1-c8262d0cd5a5 for instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee on n-h1-862964-4 Oct 29 02:50:11.446656 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-79a726b8-a705-4799-94e9-1d2912d00b6f req-21fbcf35-f6f3-435b-bc4f-49c8ec711b68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032518 Oct 29 02:50:11.447578 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 694/1441] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:11.453153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bf40d219-b492-46f1-b4f1-465326e5adc8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:11.453917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bf40d219-b492-46f1-b4f1-465326e5adc8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:11.463783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf40d219-b492-46f1-b4f1-465326e5adc8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.464282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf40d219-b492-46f1-b4f1-465326e5adc8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.464727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf40d219-b492-46f1-b4f1-465326e5adc8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:11.465444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf40d219-b492-46f1-b4f1-465326e5adc8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.465932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf40d219-b492-46f1-b4f1-465326e5adc8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.466524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf40d219-b492-46f1-b4f1-465326e5adc8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:12.286126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bf40d219-b492-46f1-b4f1-465326e5adc8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:12.294299 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bf40d219-b492-46f1-b4f1-465326e5adc8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.845477 Oct 29 02:50:12.294943 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 695/1442] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:11 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:12.300153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4f78d5ed-febd-479e-aa3e-b2d0a99b823e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:12.300770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4f78d5ed-febd-479e-aa3e-b2d0a99b823e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:12.316089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f78d5ed-febd-479e-aa3e-b2d0a99b823e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:12.318540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f78d5ed-febd-479e-aa3e-b2d0a99b823e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:12.319173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f78d5ed-febd-479e-aa3e-b2d0a99b823e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:12.320070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f78d5ed-febd-479e-aa3e-b2d0a99b823e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:12.320705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f78d5ed-febd-479e-aa3e-b2d0a99b823e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:12.321286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f78d5ed-febd-479e-aa3e-b2d0a99b823e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:12.616475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4f78d5ed-febd-479e-aa3e-b2d0a99b823e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:12.632462 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4f78d5ed-febd-479e-aa3e-b2d0a99b823e tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1313 microversion: 2.1 time: 0.335242 Oct 29 02:50:12.633519 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 696/1443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:12 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:12.651599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-19d346f2-1e62-4faa-a319-594235fb9081 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:12.655011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-19d346f2-1e62-4faa-a319-594235fb9081 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:12.669693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19d346f2-1e62-4faa-a319-594235fb9081 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:12.670282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19d346f2-1e62-4faa-a319-594235fb9081 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:12.670773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19d346f2-1e62-4faa-a319-594235fb9081 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:12.672617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19d346f2-1e62-4faa-a319-594235fb9081 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:12.675426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19d346f2-1e62-4faa-a319-594235fb9081 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:12.675929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19d346f2-1e62-4faa-a319-594235fb9081 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:12.837396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-19d346f2-1e62-4faa-a319-594235fb9081 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa30f68a081646d6b452d1cdf6e0181c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1031cc111cc747098bbc8a428c1cfad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:12.846472 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-19d346f2-1e62-4faa-a319-594235fb9081 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 200 len: 1302 microversion: 2.1 time: 0.205074 Oct 29 02:50:12.849983 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 697/1444] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:12 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 1302 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:13.056509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-781053590", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "b43f911a-e08e-47ad-be42-082bf7509c29"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:13.158939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:13.173632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] validate_networks() for [('b43f911a-e08e-47ad-be42-082bf7509c29', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:50:13.180891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:13.355189 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d24f95be-2e28-4c1e-b282-343ca9eef329 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.746035 Oct 29 02:50:13.356330 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 748/1445] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Oct 29 02:50:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:13.364424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:13.365730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:13.379696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.380195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.380892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.382505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.383200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.383690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.470925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:13.484174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:13.486269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:13.494117 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-28ad87fb-cdd2-41da-8494-d371e885c3b4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.136318 Oct 29 02:50:13.495462 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 749/1446] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:13 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:13.501218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-07c51e28-0af4-42d0-b0a2-bc9e62643bde tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:13.502454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-07c51e28-0af4-42d0-b0a2-bc9e62643bde tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:13.510835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07c51e28-0af4-42d0-b0a2-bc9e62643bde tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.511318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07c51e28-0af4-42d0-b0a2-bc9e62643bde tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.511747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07c51e28-0af4-42d0-b0a2-bc9e62643bde tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.512446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07c51e28-0af4-42d0-b0a2-bc9e62643bde tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.512895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07c51e28-0af4-42d0-b0a2-bc9e62643bde tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.513306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07c51e28-0af4-42d0-b0a2-bc9e62643bde tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.636486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:50:13.636964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:50:13.637351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:50:13.637921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:50:13.638952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:50:13.650452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.650931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.651391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.652143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.652770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.653715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.662093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-07c51e28-0af4-42d0-b0a2-bc9e62643bde tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:13.670567 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-07c51e28-0af4-42d0-b0a2-bc9e62643bde tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.173771 Oct 29 02:50:13.671418 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 750/1447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:13 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:13.686049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Getting quotas for project 45fe14a8293e416992d1e6f29ff4d5f5. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:50:13.686049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Getting quotas for user 170992795bde4f318bb47ad5d2727ca0 and project 45fe14a8293e416992d1e6f29ff4d5f5. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:50:13.692133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2066354142", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "7da6dbec-0aa3-4269-a738-63fa43633287"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:13.699592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:50:13.703301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:50:13.715629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:13.761994 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908923 Oct 29 02:50:13.762914 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 698/1448] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:50:13.770133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ff6c7654-3554-4135-97c4-6f3c712a31a1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:13.770999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ff6c7654-3554-4135-97c4-6f3c712a31a1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:13.777949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff6c7654-3554-4135-97c4-6f3c712a31a1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.778606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff6c7654-3554-4135-97c4-6f3c712a31a1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.779209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff6c7654-3554-4135-97c4-6f3c712a31a1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.780270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff6c7654-3554-4135-97c4-6f3c712a31a1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.780863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff6c7654-3554-4135-97c4-6f3c712a31a1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.781585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff6c7654-3554-4135-97c4-6f3c712a31a1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.782961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] validate_networks() for [('7da6dbec-0aa3-4269-a738-63fa43633287', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:50:13.870964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:13.992869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ff6c7654-3554-4135-97c4-6f3c712a31a1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:14.010286 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ff6c7654-3554-4135-97c4-6f3c712a31a1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1313 microversion: 2.1 time: 0.246278 Oct 29 02:50:14.015331 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 699/1449] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:13 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:14.023544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64b9a7ce-a3e5-408a-ab4d-7ab82b15984b tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:14.024144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-64b9a7ce-a3e5-408a-ab4d-7ab82b15984b tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:14.125853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-64b9a7ce-a3e5-408a-ab4d-7ab82b15984b tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:14.142114 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-64b9a7ce-a3e5-408a-ab4d-7ab82b15984b tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1216 microversion: 2.1 time: 0.125559 Oct 29 02:50:14.153860 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 700/1450] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:14 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1216 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:14.153860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:14.153860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] [instance: b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:14.158049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.159725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.160436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.161304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.162432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.162949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.177855 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] HTTP exception thrown: Instance b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 could not be found. Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Request method failure captured: Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 HTTP/1.1 Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQcdpT8JB8GrvvAJ61Yxe1jlfCECOh5sugNg5m64KLROk1GsYWS0LZYnuqGvCgF6T5ipecgpuIJ1pa8J_NGPz1f8AEuzcC4jHyMs4ppIRkZE4j2YKuif_5zJmkugQyuc0qpZy_xKmnOmxvJsusF0EbAIU9HMx6aOM6uQ5Gkn2pdf9w Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:50:14.179792 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1031cc111cc747098bbc8a428c1cfad6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1031cc111cc747098bbc8a428c1cfad6"}]}] Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 1031cc111cc747098bbc8a428c1cfad6 Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1047108598 Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fa30f68a081646d6b452d1cdf6e0181c Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersOnMultiNodesTest-1047108598-project Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 could not be found. Oct 29 02:50:14.181246 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9'} Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 could not be found. Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:14.183029 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 could not be found. Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 could not be found. Oct 29 02:50:14.184468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:14.187064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] Returning 404 to user: Instance b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:14.187064 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-64a2fa41-bdcf-4837-a89c-fd01ed31faa6 tempest-ServersOnMultiNodesTest-1047108598 tempest-ServersOnMultiNodesTest-1047108598-project] 10.222.0.16 "GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9" status: 404 len: 111 microversion: 2.1 time: 0.037264 Oct 29 02:50:14.187064 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 701/1451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:14 2022] GET /compute/v2.1/servers/b9e44b6a-df5c-4845-a8fd-8ba70a0c69d9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:14.383471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:50:14.384102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:50:14.384347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:50:14.384748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:50:14.385718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:50:14.396674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.397176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.397614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.398457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.398904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.399322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.419400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Getting quotas for project 802d5fbb45b84622acf59c4046f26a8c. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:50:14.423724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Getting quotas for user bba0b932c2af45c1a4e7fc5c185a64d1 and project 802d5fbb45b84622acf59c4046f26a8c. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:50:14.450776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:50:14.453733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:50:14.527245 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-62eda47b-124c-4d6c-a31f-73cac5edadd3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839516 Oct 29 02:50:14.528306 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 751/1452] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:50:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:50:14.535872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:14.537449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:14.547268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.548155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.548675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.549471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.550053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.550574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.556231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:14.564204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cb8d25e0-f047-44cf-88f7-c7750e87ed7c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:14.564970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cb8d25e0-f047-44cf-88f7-c7750e87ed7c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:14.647798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cb8d25e0-f047-44cf-88f7-c7750e87ed7c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:14.659555 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cb8d25e0-f047-44cf-88f7-c7750e87ed7c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 200 len: 1224 microversion: 2.1 time: 0.103967 Oct 29 02:50:14.660761 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 752/1453] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:14 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 1224 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:14.700620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bacae346-0235-4693-b88a-ceaaeca8bc3d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:14.701389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bacae346-0235-4693-b88a-ceaaeca8bc3d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:14.722248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bacae346-0235-4693-b88a-ceaaeca8bc3d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.729371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bacae346-0235-4693-b88a-ceaaeca8bc3d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.730413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bacae346-0235-4693-b88a-ceaaeca8bc3d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.731182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bacae346-0235-4693-b88a-ceaaeca8bc3d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.731722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bacae346-0235-4693-b88a-ceaaeca8bc3d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.735425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bacae346-0235-4693-b88a-ceaaeca8bc3d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.744987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:14.760980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:14.762872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:14.770594 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-494137b2-03cd-4720-9580-de0c19100ffd tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.246435 Oct 29 02:50:14.771791 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 702/1454] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:14 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:14.942444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bacae346-0235-4693-b88a-ceaaeca8bc3d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:14.952004 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bacae346-0235-4693-b88a-ceaaeca8bc3d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.255914 Oct 29 02:50:14.969350 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 753/1455] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:14 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:15.036479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1697fc22-3422-44c4-a31c-6022359635d1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:15.037305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1697fc22-3422-44c4-a31c-6022359635d1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:15.069028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1697fc22-3422-44c4-a31c-6022359635d1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:15.069531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1697fc22-3422-44c4-a31c-6022359635d1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:15.070000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1697fc22-3422-44c4-a31c-6022359635d1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:15.079233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1697fc22-3422-44c4-a31c-6022359635d1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:15.079740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1697fc22-3422-44c4-a31c-6022359635d1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:15.080176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1697fc22-3422-44c4-a31c-6022359635d1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:15.166779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d2d60fd8-f9fb-4c80-adae-25b944629fcb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:15.167407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d2d60fd8-f9fb-4c80-adae-25b944629fcb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:15.169931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:15.186733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2d60fd8-f9fb-4c80-adae-25b944629fcb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:15.190932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2d60fd8-f9fb-4c80-adae-25b944629fcb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:15.192836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2d60fd8-f9fb-4c80-adae-25b944629fcb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:15.193998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2d60fd8-f9fb-4c80-adae-25b944629fcb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:15.196138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2d60fd8-f9fb-4c80-adae-25b944629fcb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:15.198213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2d60fd8-f9fb-4c80-adae-25b944629fcb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:15.354816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d2d60fd8-f9fb-4c80-adae-25b944629fcb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:15.369055 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d2d60fd8-f9fb-4c80-adae-25b944629fcb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1268 microversion: 2.1 time: 0.206131 Oct 29 02:50:15.371613 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 754/1456] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:15 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1268 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:15.390634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1697fc22-3422-44c4-a31c-6022359635d1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:15.400894 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1697fc22-3422-44c4-a31c-6022359635d1 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1313 microversion: 2.1 time: 0.368183 Oct 29 02:50:15.402827 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 703/1457] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:15 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:15.684582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-45509968-e0ed-4b5a-a051-b0879caddcd5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:15.685191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-45509968-e0ed-4b5a-a051-b0879caddcd5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:15.695273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45509968-e0ed-4b5a-a051-b0879caddcd5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:15.695616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45509968-e0ed-4b5a-a051-b0879caddcd5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:15.696048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45509968-e0ed-4b5a-a051-b0879caddcd5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:15.698303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45509968-e0ed-4b5a-a051-b0879caddcd5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:15.699079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45509968-e0ed-4b5a-a051-b0879caddcd5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:15.699830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45509968-e0ed-4b5a-a051-b0879caddcd5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:15.799475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:15.800223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:15.814059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:15.814608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:15.815025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:15.818374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:15.819005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:15.819284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:15.859629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-45509968-e0ed-4b5a-a051-b0879caddcd5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:15.869765 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-45509968-e0ed-4b5a-a051-b0879caddcd5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 200 len: 1220 microversion: 2.1 time: 0.190536 Oct 29 02:50:15.880841 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 755/1458] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:15 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 1220 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:15.979288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-78a82ab9-9ea3-4f68-8c41-b4f2734eda95 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:15.980098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-78a82ab9-9ea3-4f68-8c41-b4f2734eda95 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:15.989019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78a82ab9-9ea3-4f68-8c41-b4f2734eda95 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:15.994212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78a82ab9-9ea3-4f68-8c41-b4f2734eda95 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:16.002116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78a82ab9-9ea3-4f68-8c41-b4f2734eda95 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:16.003699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78a82ab9-9ea3-4f68-8c41-b4f2734eda95 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:16.004384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78a82ab9-9ea3-4f68-8c41-b4f2734eda95 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:16.005209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78a82ab9-9ea3-4f68-8c41-b4f2734eda95 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:16.062727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:16.074252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:16.076479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:16.104845 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-efe3e4a5-b719-4d74-b07f-73a224eef503 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.309606 Oct 29 02:50:16.105445 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 704/1459] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:15 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:16.292033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-78a82ab9-9ea3-4f68-8c41-b4f2734eda95 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:16.307093 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-78a82ab9-9ea3-4f68-8c41-b4f2734eda95 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.333247 Oct 29 02:50:16.308540 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 756/1460] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:15 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:16.397101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2d1f8fdd-5316-4adf-b97c-91b9fb7168b1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:16.398062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2d1f8fdd-5316-4adf-b97c-91b9fb7168b1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:16.407572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1f8fdd-5316-4adf-b97c-91b9fb7168b1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:16.408616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1f8fdd-5316-4adf-b97c-91b9fb7168b1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:16.410960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1f8fdd-5316-4adf-b97c-91b9fb7168b1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:16.413332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1f8fdd-5316-4adf-b97c-91b9fb7168b1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:16.415744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1f8fdd-5316-4adf-b97c-91b9fb7168b1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:16.416417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1f8fdd-5316-4adf-b97c-91b9fb7168b1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:16.423422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-17b1c0dd-390f-4ef7-83e6-b613f5b0b24d tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:16.424272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-17b1c0dd-390f-4ef7-83e6-b613f5b0b24d tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:16.438740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b1c0dd-390f-4ef7-83e6-b613f5b0b24d tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:16.439243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b1c0dd-390f-4ef7-83e6-b613f5b0b24d tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:16.439679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b1c0dd-390f-4ef7-83e6-b613f5b0b24d tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:16.440399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b1c0dd-390f-4ef7-83e6-b613f5b0b24d tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:16.440848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b1c0dd-390f-4ef7-83e6-b613f5b0b24d tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:16.450579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b1c0dd-390f-4ef7-83e6-b613f5b0b24d tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:16.605602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-17b1c0dd-390f-4ef7-83e6-b613f5b0b24d tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:16.614481 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-17b1c0dd-390f-4ef7-83e6-b613f5b0b24d tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1313 microversion: 2.1 time: 0.194689 Oct 29 02:50:16.615373 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 757/1461] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:16 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:16.655562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d1f8fdd-5316-4adf-b97c-91b9fb7168b1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:16.667223 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2d1f8fdd-5316-4adf-b97c-91b9fb7168b1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1274 microversion: 2.1 time: 0.274530 Oct 29 02:50:16.669842 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 705/1462] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:16 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1274 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:16.901994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-20d4bfdb-a6ed-4da2-9248-c3381c9d9716 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:16.902608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-20d4bfdb-a6ed-4da2-9248-c3381c9d9716 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:16.921935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20d4bfdb-a6ed-4da2-9248-c3381c9d9716 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:16.922427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20d4bfdb-a6ed-4da2-9248-c3381c9d9716 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:16.922857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20d4bfdb-a6ed-4da2-9248-c3381c9d9716 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:16.923565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20d4bfdb-a6ed-4da2-9248-c3381c9d9716 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:16.924009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20d4bfdb-a6ed-4da2-9248-c3381c9d9716 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:16.924422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20d4bfdb-a6ed-4da2-9248-c3381c9d9716 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:16.965103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:17.081499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-20d4bfdb-a6ed-4da2-9248-c3381c9d9716 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.091371 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-20d4bfdb-a6ed-4da2-9248-c3381c9d9716 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 200 len: 1284 microversion: 2.1 time: 0.194376 Oct 29 02:50:17.091992 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 758/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:16 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 1284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:17.137625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:17.138792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:17.159769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.161483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.163683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.165928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.170594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.171266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.323845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.332927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aa1b3c15-836a-4682-8283-70ea3ecfe319 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:17.333570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aa1b3c15-836a-4682-8283-70ea3ecfe319 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:17.340161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.342813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.344747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa1b3c15-836a-4682-8283-70ea3ecfe319 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.345246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa1b3c15-836a-4682-8283-70ea3ecfe319 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.345666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa1b3c15-836a-4682-8283-70ea3ecfe319 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.349377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa1b3c15-836a-4682-8283-70ea3ecfe319 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.349897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa1b3c15-836a-4682-8283-70ea3ecfe319 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.350338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa1b3c15-836a-4682-8283-70ea3ecfe319 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.353625 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2bd73bcc-560a-4cba-ae05-1d21a58ae1b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.220456 Oct 29 02:50:17.355702 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 706/1464] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:17 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:17.382904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-73e3ba7c-2685-402b-8cb7-14f3c7cc6287 req-f9201eac-137e-4894-9956-80adef14851b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cbe53ff-63ff-43b0-be87-9f728001a964", "name": "network-vif-plugged", "status": "completed", "tag": "c94390c1-0597-4a53-87f2-1ae7b808fca8"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:17.395186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-73e3ba7c-2685-402b-8cb7-14f3c7cc6287 req-f9201eac-137e-4894-9956-80adef14851b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.395649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-73e3ba7c-2685-402b-8cb7-14f3c7cc6287 req-f9201eac-137e-4894-9956-80adef14851b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.396413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-73e3ba7c-2685-402b-8cb7-14f3c7cc6287 req-f9201eac-137e-4894-9956-80adef14851b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.410509 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-73e3ba7c-2685-402b-8cb7-14f3c7cc6287 req-f9201eac-137e-4894-9956-80adef14851b service nova] Creating event network-vif-plugged:c94390c1-0597-4a53-87f2-1ae7b808fca8 for instance 1cbe53ff-63ff-43b0-be87-9f728001a964 on n-h2-862964-4 Oct 29 02:50:17.416022 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-73e3ba7c-2685-402b-8cb7-14f3c7cc6287 req-f9201eac-137e-4894-9956-80adef14851b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037057 Oct 29 02:50:17.417265 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 707/1465] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:17.625708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aa1b3c15-836a-4682-8283-70ea3ecfe319 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.638448 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aa1b3c15-836a-4682-8283-70ea3ecfe319 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.309548 Oct 29 02:50:17.648373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20b40949-425e-4f9f-8bd6-8b40109657ee tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:17.648573 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 759/1466] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:17 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:17.648694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-20b40949-425e-4f9f-8bd6-8b40109657ee tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:17.648694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20b40949-425e-4f9f-8bd6-8b40109657ee tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.648694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20b40949-425e-4f9f-8bd6-8b40109657ee tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.648694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20b40949-425e-4f9f-8bd6-8b40109657ee tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.649029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20b40949-425e-4f9f-8bd6-8b40109657ee tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.649029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20b40949-425e-4f9f-8bd6-8b40109657ee tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.649331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20b40949-425e-4f9f-8bd6-8b40109657ee tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.692797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a7a6283b-8aef-416c-a665-7d427611a4ee tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:17.693521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a7a6283b-8aef-416c-a665-7d427611a4ee tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:17.699824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7a6283b-8aef-416c-a665-7d427611a4ee tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.700567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7a6283b-8aef-416c-a665-7d427611a4ee tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.701056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7a6283b-8aef-416c-a665-7d427611a4ee tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.702054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7a6283b-8aef-416c-a665-7d427611a4ee tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.702573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7a6283b-8aef-416c-a665-7d427611a4ee tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.703222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7a6283b-8aef-416c-a665-7d427611a4ee tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.890006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a7a6283b-8aef-416c-a665-7d427611a4ee tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.903220 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a7a6283b-8aef-416c-a665-7d427611a4ee tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1316 microversion: 2.1 time: 0.214424 Oct 29 02:50:17.904636 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 760/1467] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:17 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:18.088979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20b40949-425e-4f9f-8bd6-8b40109657ee tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:18.105842 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20b40949-425e-4f9f-8bd6-8b40109657ee tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1313 microversion: 2.1 time: 0.470608 Oct 29 02:50:18.106831 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 708/1468] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:17 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:18.128919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b2c1e9f-1fbe-47e9-b314-d88475bf5c81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:18.129880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8b2c1e9f-1fbe-47e9-b314-d88475bf5c81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:18.139332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b2c1e9f-1fbe-47e9-b314-d88475bf5c81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:18.139831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b2c1e9f-1fbe-47e9-b314-d88475bf5c81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:18.140479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b2c1e9f-1fbe-47e9-b314-d88475bf5c81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:18.141198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b2c1e9f-1fbe-47e9-b314-d88475bf5c81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:18.141646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b2c1e9f-1fbe-47e9-b314-d88475bf5c81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:18.142094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b2c1e9f-1fbe-47e9-b314-d88475bf5c81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:18.374667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8b2c1e9f-1fbe-47e9-b314-d88475bf5c81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:18.383423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:18.384805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:18.392881 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b2c1e9f-1fbe-47e9-b314-d88475bf5c81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 200 len: 1324 microversion: 2.1 time: 0.267809 Oct 29 02:50:18.394083 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 761/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:18 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 1324 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:18.400276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:18.401043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:18.401631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:18.402543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:18.402997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:18.403586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:18.462752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6dab585a-2361-4d81-8c38-29f50077848e req-6dc4c590-ec77-41c0-8fc8-3f59ac8b8417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987fb2af-68a7-4981-83e7-2dd2da0f5a68", "tag": "c4b2b8a3-ff9a-4e7f-b8d5-0d061ad6c48f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:18.473302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6dab585a-2361-4d81-8c38-29f50077848e req-6dc4c590-ec77-41c0-8fc8-3f59ac8b8417 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:18.474392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6dab585a-2361-4d81-8c38-29f50077848e req-6dc4c590-ec77-41c0-8fc8-3f59ac8b8417 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:18.474915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6dab585a-2361-4d81-8c38-29f50077848e req-6dc4c590-ec77-41c0-8fc8-3f59ac8b8417 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:18.486921 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6dab585a-2361-4d81-8c38-29f50077848e req-6dc4c590-ec77-41c0-8fc8-3f59ac8b8417 service nova] Creating event network-changed:c4b2b8a3-ff9a-4e7f-b8d5-0d061ad6c48f for instance 987fb2af-68a7-4981-83e7-2dd2da0f5a68 on n-h1-862964-4 Oct 29 02:50:18.492360 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6dab585a-2361-4d81-8c38-29f50077848e req-6dc4c590-ec77-41c0-8fc8-3f59ac8b8417 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034365 Oct 29 02:50:18.493438 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 762/1470] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:50:18.534244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:18.543230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:18.544901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:18.551208 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-231b880a-bf04-4667-9d9a-1b98d2154c7d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.171738 Oct 29 02:50:18.552037 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 709/1471] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:18 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:50:18.665045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c1951097-ffe5-427f-b2c3-c25213b881d8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:18.666338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c1951097-ffe5-427f-b2c3-c25213b881d8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:18.672975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1951097-ffe5-427f-b2c3-c25213b881d8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:18.674039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1951097-ffe5-427f-b2c3-c25213b881d8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:18.674592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1951097-ffe5-427f-b2c3-c25213b881d8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:18.675387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1951097-ffe5-427f-b2c3-c25213b881d8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:18.676302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1951097-ffe5-427f-b2c3-c25213b881d8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:18.676954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1951097-ffe5-427f-b2c3-c25213b881d8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:18.933603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ed455e8-c08f-4fa4-9568-2e937237b453 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:18.934291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8ed455e8-c08f-4fa4-9568-2e937237b453 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:18.946445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ed455e8-c08f-4fa4-9568-2e937237b453 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:18.946945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ed455e8-c08f-4fa4-9568-2e937237b453 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:18.949531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ed455e8-c08f-4fa4-9568-2e937237b453 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:18.950336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ed455e8-c08f-4fa4-9568-2e937237b453 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:18.950803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ed455e8-c08f-4fa4-9568-2e937237b453 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:18.951213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ed455e8-c08f-4fa4-9568-2e937237b453 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:18.968027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c1951097-ffe5-427f-b2c3-c25213b881d8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:18.981706 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c1951097-ffe5-427f-b2c3-c25213b881d8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.321489 Oct 29 02:50:19.002693 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 763/1472] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:18 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:19.133727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-672dead6-5ddc-4438-80a6-4dbe6cdb3dcc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:19.134414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-672dead6-5ddc-4438-80a6-4dbe6cdb3dcc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:19.153754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-672dead6-5ddc-4438-80a6-4dbe6cdb3dcc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:19.155331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-672dead6-5ddc-4438-80a6-4dbe6cdb3dcc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:19.156017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-672dead6-5ddc-4438-80a6-4dbe6cdb3dcc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:19.158943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-672dead6-5ddc-4438-80a6-4dbe6cdb3dcc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:19.161442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-672dead6-5ddc-4438-80a6-4dbe6cdb3dcc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:19.162610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-672dead6-5ddc-4438-80a6-4dbe6cdb3dcc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:19.295616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8ed455e8-c08f-4fa4-9568-2e937237b453 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:19.308077 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8ed455e8-c08f-4fa4-9568-2e937237b453 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1316 microversion: 2.1 time: 0.378956 Oct 29 02:50:19.310320 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 710/1473] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:18 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:19.328003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e3cd325f-71f1-4cf9-b836-3b51ef8dc9aa req-911621b5-b3c4-4079-a83a-d4c60264b489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f222ce6-6c69-4a70-a003-3cc72186c175", "tag": "91d574ae-fd72-4533-a128-53170347b277"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:19.349269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e3cd325f-71f1-4cf9-b836-3b51ef8dc9aa req-911621b5-b3c4-4079-a83a-d4c60264b489 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:19.350828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e3cd325f-71f1-4cf9-b836-3b51ef8dc9aa req-911621b5-b3c4-4079-a83a-d4c60264b489 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:19.351665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e3cd325f-71f1-4cf9-b836-3b51ef8dc9aa req-911621b5-b3c4-4079-a83a-d4c60264b489 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:19.389404 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e3cd325f-71f1-4cf9-b836-3b51ef8dc9aa req-911621b5-b3c4-4079-a83a-d4c60264b489 service nova] Creating event network-changed:91d574ae-fd72-4533-a128-53170347b277 for instance 9f222ce6-6c69-4a70-a003-3cc72186c175 on n-h1-862964-4 Oct 29 02:50:19.400083 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e3cd325f-71f1-4cf9-b836-3b51ef8dc9aa req-911621b5-b3c4-4079-a83a-d4c60264b489 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080276 Oct 29 02:50:19.401309 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 711/1474] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:19.416491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cc219154-9b7c-4417-b7b2-7a72cbfad3ff tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:19.417484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cc219154-9b7c-4417-b7b2-7a72cbfad3ff tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:19.424256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc219154-9b7c-4417-b7b2-7a72cbfad3ff tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:19.425056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc219154-9b7c-4417-b7b2-7a72cbfad3ff tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:19.425722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc219154-9b7c-4417-b7b2-7a72cbfad3ff tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:19.426683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc219154-9b7c-4417-b7b2-7a72cbfad3ff tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:19.427447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc219154-9b7c-4417-b7b2-7a72cbfad3ff tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:19.428077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc219154-9b7c-4417-b7b2-7a72cbfad3ff tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:19.524729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-672dead6-5ddc-4438-80a6-4dbe6cdb3dcc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:19.538631 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-672dead6-5ddc-4438-80a6-4dbe6cdb3dcc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1313 microversion: 2.1 time: 0.408712 Oct 29 02:50:19.539340 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 764/1475] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:19 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:19.595148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:19.596379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:19.603912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:19.604712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:19.605382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:19.606659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:19.607360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:19.608130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:19.690780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:19.700346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:19.701774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:19.707752 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bda4583f-e81e-4d38-b0f6-53ab96563c8d tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.121567 Oct 29 02:50:19.710148 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 765/1476] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:19 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:50:20.007103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dc9ef34f-98aa-4d1c-bc05-8b9f7d7b01eb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:20.007792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dc9ef34f-98aa-4d1c-bc05-8b9f7d7b01eb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:20.014009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc9ef34f-98aa-4d1c-bc05-8b9f7d7b01eb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.014488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc9ef34f-98aa-4d1c-bc05-8b9f7d7b01eb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.014914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc9ef34f-98aa-4d1c-bc05-8b9f7d7b01eb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.015799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc9ef34f-98aa-4d1c-bc05-8b9f7d7b01eb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.016249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc9ef34f-98aa-4d1c-bc05-8b9f7d7b01eb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.016664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc9ef34f-98aa-4d1c-bc05-8b9f7d7b01eb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.095423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cc219154-9b7c-4417-b7b2-7a72cbfad3ff tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:20.103971 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cc219154-9b7c-4417-b7b2-7a72cbfad3ff tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 200 len: 1324 microversion: 2.1 time: 0.691751 Oct 29 02:50:20.104547 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 712/1477] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:19 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 1324 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:20.159594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dc9ef34f-98aa-4d1c-bc05-8b9f7d7b01eb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:20.168933 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dc9ef34f-98aa-4d1c-bc05-8b9f7d7b01eb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.165854 Oct 29 02:50:20.169521 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 766/1478] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:20 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:20.337589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cda003b4-4ce7-4388-851a-70f1c51646bd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:20.338523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cda003b4-4ce7-4388-851a-70f1c51646bd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:20.345561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cda003b4-4ce7-4388-851a-70f1c51646bd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.346306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cda003b4-4ce7-4388-851a-70f1c51646bd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.346736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cda003b4-4ce7-4388-851a-70f1c51646bd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.347461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cda003b4-4ce7-4388-851a-70f1c51646bd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.348067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cda003b4-4ce7-4388-851a-70f1c51646bd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.348682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cda003b4-4ce7-4388-851a-70f1c51646bd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.567339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-511a293b-6dd7-461b-923f-a9ad914a7e46 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:20.569217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-511a293b-6dd7-461b-923f-a9ad914a7e46 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:20.579257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-511a293b-6dd7-461b-923f-a9ad914a7e46 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.580745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-511a293b-6dd7-461b-923f-a9ad914a7e46 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.582953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-511a293b-6dd7-461b-923f-a9ad914a7e46 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.584667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-511a293b-6dd7-461b-923f-a9ad914a7e46 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.585391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-511a293b-6dd7-461b-923f-a9ad914a7e46 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.586532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-511a293b-6dd7-461b-923f-a9ad914a7e46 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.623594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cda003b4-4ce7-4388-851a-70f1c51646bd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:20.646221 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cda003b4-4ce7-4388-851a-70f1c51646bd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1316 microversion: 2.1 time: 0.313334 Oct 29 02:50:20.661351 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 713/1479] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:20 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:20.743644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:20.744325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:20.760325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.760937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.761434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.762226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.762767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.763215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.911748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:20.924248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:20.928653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:20.939665 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-35ece652-91ae-4916-b01d-a2bc5b70f0d1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.200090 Oct 29 02:50:20.950625 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 714/1480] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:20 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:50:20.984297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-511a293b-6dd7-461b-923f-a9ad914a7e46 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:20.998482 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-511a293b-6dd7-461b-923f-a9ad914a7e46 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1462 microversion: 2.1 time: 0.439856 Oct 29 02:50:21.000993 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 767/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:20 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1462 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:21.130904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-437ae4a2-b19e-4631-b282-b98b3615c65d tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:21.132713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-437ae4a2-b19e-4631-b282-b98b3615c65d tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:21.139994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-437ae4a2-b19e-4631-b282-b98b3615c65d tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.150816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-437ae4a2-b19e-4631-b282-b98b3615c65d tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.151307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-437ae4a2-b19e-4631-b282-b98b3615c65d tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.152118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-437ae4a2-b19e-4631-b282-b98b3615c65d tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.155332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-437ae4a2-b19e-4631-b282-b98b3615c65d tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.155731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-437ae4a2-b19e-4631-b282-b98b3615c65d tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.322236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-93614b23-9e67-4192-b730-794d1720b473 tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Calling method '.version_select at 0x7fe1a86f1c10>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:21.345639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93614b23-9e67-4192-b730-794d1720b473 tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.346242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93614b23-9e67-4192-b730-794d1720b473 tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.346675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93614b23-9e67-4192-b730-794d1720b473 tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.369776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93614b23-9e67-4192-b730-794d1720b473 tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.371335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93614b23-9e67-4192-b730-794d1720b473 tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.371780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93614b23-9e67-4192-b730-794d1720b473 tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.377566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-437ae4a2-b19e-4631-b282-b98b3615c65d tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:21.387668 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-437ae4a2-b19e-4631-b282-b98b3615c65d tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 200 len: 1324 microversion: 2.1 time: 0.260870 Oct 29 02:50:21.401836 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 768/1482] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:21 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:21.402074 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-93614b23-9e67-4192-b730-794d1720b473 tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/01d46bf526a149d7b149decc11d24f3d?start=2022-10-28T02%3A50%3A21.017485&end=2022-10-30T02%3A50%3A21.017485" status: 200 len: 694 microversion: 2.1 time: 0.372983 Oct 29 02:50:21.406602 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 715/1483] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Oct 29 02:50:21 2022] GET /compute/v2.1/os-simple-tenant-usage/01d46bf526a149d7b149decc11d24f3d?start=2022-10-28T02%3A50%3A21.017485&end=2022-10-30T02%3A50%3A21.017485 => generated 694 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:21.410950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a3be55e-50de-4dc1-8e58-1b86dcb02615 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:21.411703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a3be55e-50de-4dc1-8e58-1b86dcb02615 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:21.412999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3890eab9-e160-4072-9799-bbdf552fbdbf tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '.version_select at 0x7fe1a87d01f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:21.418126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a3be55e-50de-4dc1-8e58-1b86dcb02615 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.418921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a3be55e-50de-4dc1-8e58-1b86dcb02615 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.419424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a3be55e-50de-4dc1-8e58-1b86dcb02615 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.420334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a3be55e-50de-4dc1-8e58-1b86dcb02615 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.421007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a3be55e-50de-4dc1-8e58-1b86dcb02615 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.421508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a3be55e-50de-4dc1-8e58-1b86dcb02615 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.424842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3890eab9-e160-4072-9799-bbdf552fbdbf tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.425564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3890eab9-e160-4072-9799-bbdf552fbdbf tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.428208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3890eab9-e160-4072-9799-bbdf552fbdbf tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.444539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3890eab9-e160-4072-9799-bbdf552fbdbf tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.446031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3890eab9-e160-4072-9799-bbdf552fbdbf tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.446668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3890eab9-e160-4072-9799-bbdf552fbdbf tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.462526 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3890eab9-e160-4072-9799-bbdf552fbdbf tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/01d46bf526a149d7b149decc11d24f3d?start=2022-10-28T02%3A50%3A21.017485&end=2022-10-30T02%3A50%3A21.017485" status: 200 len: 694 microversion: 2.1 time: 0.054013 Oct 29 02:50:21.463213 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 716/1484] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Oct 29 02:50:21 2022] GET /compute/v2.1/os-simple-tenant-usage/01d46bf526a149d7b149decc11d24f3d?start=2022-10-28T02%3A50%3A21.017485&end=2022-10-30T02%3A50%3A21.017485 => generated 694 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:21.479817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40c13b18-3c1e-4ac8-8a8f-6adad42b83fe tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Calling method '.version_select at 0x7fe1a86f13a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:21.488916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40c13b18-3c1e-4ac8-8a8f-6adad42b83fe tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.489791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40c13b18-3c1e-4ac8-8a8f-6adad42b83fe tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.490758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40c13b18-3c1e-4ac8-8a8f-6adad42b83fe tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.599234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2a3be55e-50de-4dc1-8e58-1b86dcb02615 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:21.618644 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a3be55e-50de-4dc1-8e58-1b86dcb02615 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.213248 Oct 29 02:50:21.619332 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 769/1485] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:21 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:21.673603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b67e2588-66b4-4862-9351-d99a44a42ea9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:21.674603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b67e2588-66b4-4862-9351-d99a44a42ea9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:21.683849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b67e2588-66b4-4862-9351-d99a44a42ea9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.684954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b67e2588-66b4-4862-9351-d99a44a42ea9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.685623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b67e2588-66b4-4862-9351-d99a44a42ea9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.686613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b67e2588-66b4-4862-9351-d99a44a42ea9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.687330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b67e2588-66b4-4862-9351-d99a44a42ea9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.687998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b67e2588-66b4-4862-9351-d99a44a42ea9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.811987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40c13b18-3c1e-4ac8-8a8f-6adad42b83fe tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.813757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40c13b18-3c1e-4ac8-8a8f-6adad42b83fe tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.815216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40c13b18-3c1e-4ac8-8a8f-6adad42b83fe tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.915512 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40c13b18-3c1e-4ac8-8a8f-6adad42b83fe tempest-TenantUsagesTestJSON-1774407338 tempest-TenantUsagesTestJSON-1774407338-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T02%3A50%3A21.017485&end=2022-10-30T02%3A50%3A21.017485&detailed=1" status: 200 len: 16159 microversion: 2.1 time: 0.439278 Oct 29 02:50:21.917924 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 717/1486] 10.222.0.16 () {58 vars in 1335 bytes} [Sat Oct 29 02:50:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T02%3A50%3A21.017485&end=2022-10-30T02%3A50%3A21.017485&detailed=1 => generated 16159 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:50:21.918886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b67e2588-66b4-4862-9351-d99a44a42ea9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:21.927533 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b67e2588-66b4-4862-9351-d99a44a42ea9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1316 microversion: 2.1 time: 0.261319 Oct 29 02:50:21.952754 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 770/1487] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:21 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:21.954156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7dc3fa19-70e1-4f60-b21c-80eafa5f13fe tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:21.955187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7dc3fa19-70e1-4f60-b21c-80eafa5f13fe tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:21.964308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dc3fa19-70e1-4f60-b21c-80eafa5f13fe tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.965096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dc3fa19-70e1-4f60-b21c-80eafa5f13fe tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.965526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dc3fa19-70e1-4f60-b21c-80eafa5f13fe tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.966278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dc3fa19-70e1-4f60-b21c-80eafa5f13fe tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.966727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dc3fa19-70e1-4f60-b21c-80eafa5f13fe tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.967143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dc3fa19-70e1-4f60-b21c-80eafa5f13fe tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.980248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:21.981219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:21.989725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.990933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.991898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.994234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.996709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.998452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.002888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7dc3fa19-70e1-4f60-b21c-80eafa5f13fe tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:50:22.118083 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7dc3fa19-70e1-4f60-b21c-80eafa5f13fe tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 204 len: 0 microversion: 2.1 time: 0.169877 Oct 29 02:50:22.118957 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 718/1488] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:50:21 2022] DELETE /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:50:22.122519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:22.129860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2313072a-7273-45ed-9907-0d089fabb395 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:22.131192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2313072a-7273-45ed-9907-0d089fabb395 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:22.137849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2313072a-7273-45ed-9907-0d089fabb395 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.137849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2313072a-7273-45ed-9907-0d089fabb395 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.139148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2313072a-7273-45ed-9907-0d089fabb395 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.139249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2313072a-7273-45ed-9907-0d089fabb395 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.139632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2313072a-7273-45ed-9907-0d089fabb395 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.140052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2313072a-7273-45ed-9907-0d089fabb395 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.145130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:22.147594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:22.154609 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3c67aacb-9c71-4c73-83ed-8329ce56f2b0 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.178134 Oct 29 02:50:22.170404 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 771/1489] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:21 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:22.368786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2313072a-7273-45ed-9907-0d089fabb395 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:22.383363 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2313072a-7273-45ed-9907-0d089fabb395 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1468 microversion: 2.1 time: 0.257716 Oct 29 02:50:22.384646 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 719/1490] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:22 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1468 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:22.413108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0b67becd-4701-476c-879d-a1c0aae7c812 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:22.414018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0b67becd-4701-476c-879d-a1c0aae7c812 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:22.422260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b67becd-4701-476c-879d-a1c0aae7c812 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.423016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b67becd-4701-476c-879d-a1c0aae7c812 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.423452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b67becd-4701-476c-879d-a1c0aae7c812 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.424169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b67becd-4701-476c-879d-a1c0aae7c812 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.425228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b67becd-4701-476c-879d-a1c0aae7c812 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.425866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b67becd-4701-476c-879d-a1c0aae7c812 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.670517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e2691040-294a-4e71-9d9d-31da779b07af tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:22.672097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e2691040-294a-4e71-9d9d-31da779b07af tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:22.679549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2691040-294a-4e71-9d9d-31da779b07af tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.680564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2691040-294a-4e71-9d9d-31da779b07af tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.681166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2691040-294a-4e71-9d9d-31da779b07af tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.682134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2691040-294a-4e71-9d9d-31da779b07af tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.682768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2691040-294a-4e71-9d9d-31da779b07af tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.683360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2691040-294a-4e71-9d9d-31da779b07af tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.704143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:22.724458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0b67becd-4701-476c-879d-a1c0aae7c812 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:22.734799 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0b67becd-4701-476c-879d-a1c0aae7c812 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 200 len: 1324 microversion: 2.1 time: 0.326210 Oct 29 02:50:22.736051 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 772/1491] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:22 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 1324 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:22.960333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-53f7e0a2-251e-4987-bd08-d1be097225bb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:22.960668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-53f7e0a2-251e-4987-bd08-d1be097225bb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:22.969265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53f7e0a2-251e-4987-bd08-d1be097225bb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.969766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53f7e0a2-251e-4987-bd08-d1be097225bb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.970220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53f7e0a2-251e-4987-bd08-d1be097225bb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.976617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53f7e0a2-251e-4987-bd08-d1be097225bb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.977349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53f7e0a2-251e-4987-bd08-d1be097225bb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.978016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53f7e0a2-251e-4987-bd08-d1be097225bb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.980832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e2691040-294a-4e71-9d9d-31da779b07af tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:23.021149 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e2691040-294a-4e71-9d9d-31da779b07af tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.367842 Oct 29 02:50:23.033912 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 720/1492] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:22 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:23.185035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:23.185657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:23.192576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:23.193298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:23.194636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:23.195377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:23.195836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:23.203850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:23.219599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-53f7e0a2-251e-4987-bd08-d1be097225bb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:23.232856 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-53f7e0a2-251e-4987-bd08-d1be097225bb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1316 microversion: 2.1 time: 0.275488 Oct 29 02:50:23.247812 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 773/1493] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:22 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:23.323866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:23.333067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:23.335356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:23.340630 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-646b306c-31c7-47b7-b814-1b7ad7bcea62 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.159783 Oct 29 02:50:23.341433 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 721/1494] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:23 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:50:23.407509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3344ff4e-f3f9-4aa0-ba93-1850da197385 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:23.408355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3344ff4e-f3f9-4aa0-ba93-1850da197385 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:23.414832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3344ff4e-f3f9-4aa0-ba93-1850da197385 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:23.415313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3344ff4e-f3f9-4aa0-ba93-1850da197385 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:23.415942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3344ff4e-f3f9-4aa0-ba93-1850da197385 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:23.416800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3344ff4e-f3f9-4aa0-ba93-1850da197385 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:23.417413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3344ff4e-f3f9-4aa0-ba93-1850da197385 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:23.417855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3344ff4e-f3f9-4aa0-ba93-1850da197385 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:23.604934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3344ff4e-f3f9-4aa0-ba93-1850da197385 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:23.614141 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3344ff4e-f3f9-4aa0-ba93-1850da197385 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1468 microversion: 2.1 time: 0.210786 Oct 29 02:50:23.614819 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 774/1495] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:23 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1468 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:23.760318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-857bd1f4-20da-4c25-ac29-8aab098d6238 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:23.761301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-857bd1f4-20da-4c25-ac29-8aab098d6238 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:23.780184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857bd1f4-20da-4c25-ac29-8aab098d6238 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:23.781468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857bd1f4-20da-4c25-ac29-8aab098d6238 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:23.782606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857bd1f4-20da-4c25-ac29-8aab098d6238 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:23.786983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857bd1f4-20da-4c25-ac29-8aab098d6238 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:23.790054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857bd1f4-20da-4c25-ac29-8aab098d6238 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:23.790856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857bd1f4-20da-4c25-ac29-8aab098d6238 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:24.048885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c1d60d83-736f-4c5e-a116-18967d2a167d req-e22bb4dd-d781-496e-83b8-d9d7e7d62383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987fb2af-68a7-4981-83e7-2dd2da0f5a68", "name": "network-vif-plugged", "status": "completed", "tag": "c4b2b8a3-ff9a-4e7f-b8d5-0d061ad6c48f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:24.069783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c1d60d83-736f-4c5e-a116-18967d2a167d req-e22bb4dd-d781-496e-83b8-d9d7e7d62383 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:24.086637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c1d60d83-736f-4c5e-a116-18967d2a167d req-e22bb4dd-d781-496e-83b8-d9d7e7d62383 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:24.094087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c1d60d83-736f-4c5e-a116-18967d2a167d req-e22bb4dd-d781-496e-83b8-d9d7e7d62383 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:24.112093 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c1d60d83-736f-4c5e-a116-18967d2a167d req-e22bb4dd-d781-496e-83b8-d9d7e7d62383 service nova] Creating event network-vif-plugged:c4b2b8a3-ff9a-4e7f-b8d5-0d061ad6c48f for instance 987fb2af-68a7-4981-83e7-2dd2da0f5a68 on n-h1-862964-4 Oct 29 02:50:24.123405 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c1d60d83-736f-4c5e-a116-18967d2a167d req-e22bb4dd-d781-496e-83b8-d9d7e7d62383 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077861 Oct 29 02:50:24.125298 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 775/1496] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:24.130070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:24.140600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-47ee4c4c-81ee-40c7-bc71-fef10488d4de tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:24.144173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-47ee4c4c-81ee-40c7-bc71-fef10488d4de tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:24.158365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47ee4c4c-81ee-40c7-bc71-fef10488d4de tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:24.159344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47ee4c4c-81ee-40c7-bc71-fef10488d4de tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:24.159952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47ee4c4c-81ee-40c7-bc71-fef10488d4de tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:24.195254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47ee4c4c-81ee-40c7-bc71-fef10488d4de tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:24.195747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47ee4c4c-81ee-40c7-bc71-fef10488d4de tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:24.196181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47ee4c4c-81ee-40c7-bc71-fef10488d4de tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:24.252170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:24.408164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:24.560072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-47ee4c4c-81ee-40c7-bc71-fef10488d4de tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:24.573463 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-47ee4c4c-81ee-40c7-bc71-fef10488d4de tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.445539 Oct 29 02:50:24.590220 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 776/1497] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:24 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:24.602191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f4cd2d68-7e4c-4846-b808-551d0e76bdcd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:24.604208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f4cd2d68-7e4c-4846-b808-551d0e76bdcd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:24.616902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-857bd1f4-20da-4c25-ac29-8aab098d6238 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:24.621333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4cd2d68-7e4c-4846-b808-551d0e76bdcd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:24.622124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4cd2d68-7e4c-4846-b808-551d0e76bdcd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:24.622717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4cd2d68-7e4c-4846-b808-551d0e76bdcd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:24.627098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4cd2d68-7e4c-4846-b808-551d0e76bdcd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:24.628000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4cd2d68-7e4c-4846-b808-551d0e76bdcd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:24.628660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4cd2d68-7e4c-4846-b808-551d0e76bdcd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:24.633853 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-857bd1f4-20da-4c25-ac29-8aab098d6238 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 200 len: 1324 microversion: 2.1 time: 0.874134 Oct 29 02:50:24.636224 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 722/1498] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:23 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 1324 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:24.655302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:24.656467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:24.662704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:24.663645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:24.664314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:24.665338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:24.666040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:24.668091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:24.684400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:24.818984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:24.831916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:24.835299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:24.843950 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-af16a078-cf62-4ce8-a05f-7efe1811dd51 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.206379 Oct 29 02:50:24.845076 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 723/1499] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:24 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:24.850631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e173b5c5-2851-474f-976c-c472635d21df tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:24.851568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e173b5c5-2851-474f-976c-c472635d21df tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:24.858184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e173b5c5-2851-474f-976c-c472635d21df tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:24.859292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e173b5c5-2851-474f-976c-c472635d21df tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:24.859909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e173b5c5-2851-474f-976c-c472635d21df tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:24.860781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e173b5c5-2851-474f-976c-c472635d21df tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:24.861386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e173b5c5-2851-474f-976c-c472635d21df tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:24.862008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e173b5c5-2851-474f-976c-c472635d21df tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:24.886891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f4cd2d68-7e4c-4846-b808-551d0e76bdcd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:24.896213 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f4cd2d68-7e4c-4846-b808-551d0e76bdcd tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1316 microversion: 2.1 time: 0.303871 Oct 29 02:50:24.897490 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 777/1500] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:24 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:24.991800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1095375649", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "488ae119-e32d-45f9-bc42-27cf88a93460"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:25.058873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] validate_networks() for [('488ae119-e32d-45f9-bc42-27cf88a93460', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:50:25.094179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e173b5c5-2851-474f-976c-c472635d21df tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:25.103258 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e173b5c5-2851-474f-976c-c472635d21df tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1468 microversion: 2.1 time: 0.256894 Oct 29 02:50:25.104220 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 724/1501] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:24 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1468 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:25.298982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-066d3b10-edb5-4df1-810a-f61573b31a17 req-23187bcc-8ea3-4d9a-ad3f-2e6bcb2b7e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cbe53ff-63ff-43b0-be87-9f728001a964", "name": "network-vif-deleted", "tag": "c94390c1-0597-4a53-87f2-1ae7b808fca8"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:25.312942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-066d3b10-edb5-4df1-810a-f61573b31a17 req-23187bcc-8ea3-4d9a-ad3f-2e6bcb2b7e64 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.313754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-066d3b10-edb5-4df1-810a-f61573b31a17 req-23187bcc-8ea3-4d9a-ad3f-2e6bcb2b7e64 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.314623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-066d3b10-edb5-4df1-810a-f61573b31a17 req-23187bcc-8ea3-4d9a-ad3f-2e6bcb2b7e64 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:25.329245 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-066d3b10-edb5-4df1-810a-f61573b31a17 req-23187bcc-8ea3-4d9a-ad3f-2e6bcb2b7e64 service nova] Creating event network-vif-deleted:c94390c1-0597-4a53-87f2-1ae7b808fca8 for instance 1cbe53ff-63ff-43b0-be87-9f728001a964 on n-h2-862964-4 Oct 29 02:50:25.339645 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-066d3b10-edb5-4df1-810a-f61573b31a17 req-23187bcc-8ea3-4d9a-ad3f-2e6bcb2b7e64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044460 Oct 29 02:50:25.340671 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 725/1502] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:25.575537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:50:25.576037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:50:25.576495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:50:25.577096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:50:25.578834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:50:25.597486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7384e970-7357-44ee-9e78-cc5d317d4449 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:25.598314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7384e970-7357-44ee-9e78-cc5d317d4449 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:25.606455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7384e970-7357-44ee-9e78-cc5d317d4449 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.606941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7384e970-7357-44ee-9e78-cc5d317d4449 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.607374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7384e970-7357-44ee-9e78-cc5d317d4449 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:25.608075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7384e970-7357-44ee-9e78-cc5d317d4449 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.608518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7384e970-7357-44ee-9e78-cc5d317d4449 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.608939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7384e970-7357-44ee-9e78-cc5d317d4449 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:25.614598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.615116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.615564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:25.616285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.616926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.617565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:25.645983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Getting quotas for project 0b30ce428766445d9d0d45f350ae1024. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:50:25.650853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Getting quotas for user 837f9940834e4eaeb31c967dba6d762f and project 0b30ce428766445d9d0d45f350ae1024. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:50:25.684065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:50:25.686492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:50:25.752928 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-12021086-9340-4898-b414-37757da2647d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853989 Oct 29 02:50:25.757979 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 778/1503] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:50:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:50:25.763733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac37cd8e-c134-4fd5-9989-35af209a8f3f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:25.764840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac37cd8e-c134-4fd5-9989-35af209a8f3f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:25.773589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37cd8e-c134-4fd5-9989-35af209a8f3f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.774252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37cd8e-c134-4fd5-9989-35af209a8f3f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.774816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37cd8e-c134-4fd5-9989-35af209a8f3f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:25.775756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37cd8e-c134-4fd5-9989-35af209a8f3f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.776617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37cd8e-c134-4fd5-9989-35af209a8f3f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.777102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac37cd8e-c134-4fd5-9989-35af209a8f3f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:25.799761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7384e970-7357-44ee-9e78-cc5d317d4449 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:25.813570 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7384e970-7357-44ee-9e78-cc5d317d4449 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.220635 Oct 29 02:50:25.814878 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 726/1504] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:25 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:25.821267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7680993-3dfc-4f63-b5ac-2f189fb20174 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:25.822263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b7680993-3dfc-4f63-b5ac-2f189fb20174 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:25.890045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b7680993-3dfc-4f63-b5ac-2f189fb20174 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:25.908823 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b7680993-3dfc-4f63-b5ac-2f189fb20174 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1225 microversion: 2.1 time: 0.092340 Oct 29 02:50:25.909417 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 727/1505] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:25 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:25.914670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:25.915462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:25.929615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.930322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.931140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:25.932509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.933058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.933673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.039865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac37cd8e-c134-4fd5-9989-35af209a8f3f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.050596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.062382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.063852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.064328 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac37cd8e-c134-4fd5-9989-35af209a8f3f tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 200 len: 1324 microversion: 2.1 time: 0.304688 Oct 29 02:50:26.065454 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 779/1506] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:25 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 1324 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:26.075494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aa9286a1-d6ba-42d0-ad30-2796a995c340 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:26.076795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aa9286a1-d6ba-42d0-ad30-2796a995c340 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:26.084946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa9286a1-d6ba-42d0-ad30-2796a995c340 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.085613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa9286a1-d6ba-42d0-ad30-2796a995c340 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.086235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa9286a1-d6ba-42d0-ad30-2796a995c340 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.087256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa9286a1-d6ba-42d0-ad30-2796a995c340 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.088491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa9286a1-d6ba-42d0-ad30-2796a995c340 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.089212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa9286a1-d6ba-42d0-ad30-2796a995c340 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.090160 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-801a5d24-3613-46eb-87ca-3682175000ba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.176332 Oct 29 02:50:26.090781 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 728/1507] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:25 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:26.132062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:26.136424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:26.147739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.148716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.151415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.152314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.152930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.153500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.225242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.226863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.232449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.233078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lazy-loading 'fault' on Instance uuid 1cbe53ff-63ff-43b0-be87-9f728001a964 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:50:26.324137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c78a473c70b4e29ac4d3fdd53c4b501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d46bf526a149d7b149decc11d24f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.333243 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ea0723d-17f5-43cf-9bc6-b05fad06a0cc tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 200 len: 1303 microversion: 2.1 time: 0.209327 Oct 29 02:50:26.334353 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 729/1508] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:26 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 1303 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:26.355243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aa9286a1-d6ba-42d0-ad30-2796a995c340 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.365196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4593a059-4631-4501-b15f-e1ccd1d581d0 req-249f98ec-151e-447d-889b-6a65e5da0584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f222ce6-6c69-4a70-a003-3cc72186c175", "name": "network-vif-plugged", "status": "completed", "tag": "91d574ae-fd72-4533-a128-53170347b277"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:26.371360 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aa9286a1-d6ba-42d0-ad30-2796a995c340 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1506 microversion: 2.1 time: 0.298122 Oct 29 02:50:26.372109 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 780/1509] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:26 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:26.388379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4593a059-4631-4501-b15f-e1ccd1d581d0 req-249f98ec-151e-447d-889b-6a65e5da0584 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.392282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4593a059-4631-4501-b15f-e1ccd1d581d0 req-249f98ec-151e-447d-889b-6a65e5da0584 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.393032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4593a059-4631-4501-b15f-e1ccd1d581d0 req-249f98ec-151e-447d-889b-6a65e5da0584 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.405414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b01df4d9-ce10-41b1-a792-51d03104bef9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:26.407227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b01df4d9-ce10-41b1-a792-51d03104bef9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:26.419313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b01df4d9-ce10-41b1-a792-51d03104bef9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.419798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b01df4d9-ce10-41b1-a792-51d03104bef9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.420239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b01df4d9-ce10-41b1-a792-51d03104bef9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.420955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b01df4d9-ce10-41b1-a792-51d03104bef9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.421444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b01df4d9-ce10-41b1-a792-51d03104bef9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.421906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b01df4d9-ce10-41b1-a792-51d03104bef9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.425681 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4593a059-4631-4501-b15f-e1ccd1d581d0 req-249f98ec-151e-447d-889b-6a65e5da0584 service nova] Creating event network-vif-plugged:91d574ae-fd72-4533-a128-53170347b277 for instance 9f222ce6-6c69-4a70-a003-3cc72186c175 on n-h1-862964-4 Oct 29 02:50:26.433731 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4593a059-4631-4501-b15f-e1ccd1d581d0 req-249f98ec-151e-447d-889b-6a65e5da0584 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077989 Oct 29 02:50:26.437866 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 730/1510] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:26.519658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b01df4d9-ce10-41b1-a792-51d03104bef9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.520807 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b01df4d9-ce10-41b1-a792-51d03104bef9 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68/os-instance-actions/req-bdba0f56-96c6-4f6f-a7f0-064e813e0558" status: 200 len: 313 microversion: 2.1 time: 0.123084 Oct 29 02:50:26.529862 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 781/1511] 10.222.0.16 () {58 vars in 1419 bytes} [Sat Oct 29 02:50:26 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68/os-instance-actions/req-bdba0f56-96c6-4f6f-a7f0-064e813e0558 => generated 313 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:26.536611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17b924a2-ed14-42b8-89c0-007d7889553a tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:26.540195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-17b924a2-ed14-42b8-89c0-007d7889553a tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:26.548053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b924a2-ed14-42b8-89c0-007d7889553a tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.548249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b924a2-ed14-42b8-89c0-007d7889553a tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.548960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b924a2-ed14-42b8-89c0-007d7889553a tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.550106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b924a2-ed14-42b8-89c0-007d7889553a tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.550558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b924a2-ed14-42b8-89c0-007d7889553a tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.551007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b924a2-ed14-42b8-89c0-007d7889553a tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.653246 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-17b924a2-ed14-42b8-89c0-007d7889553a tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "POST /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68/action" status: 202 len: 0 microversion: 2.1 time: 0.121294 Oct 29 02:50:26.653920 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 731/1512] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:26 2022] POST /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:50:26.662552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c56eb4c5-076e-4e19-97d5-151e8e725c55 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:26.663219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c56eb4c5-076e-4e19-97d5-151e8e725c55 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:26.670076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c56eb4c5-076e-4e19-97d5-151e8e725c55 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.670627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c56eb4c5-076e-4e19-97d5-151e8e725c55 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.671133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c56eb4c5-076e-4e19-97d5-151e8e725c55 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.671893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c56eb4c5-076e-4e19-97d5-151e8e725c55 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.672576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c56eb4c5-076e-4e19-97d5-151e8e725c55 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.673053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c56eb4c5-076e-4e19-97d5-151e8e725c55 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.847517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-26c8afcf-f7e5-4384-bafa-3dc2b0c5a4f4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:26.848230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-26c8afcf-f7e5-4384-bafa-3dc2b0c5a4f4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:26.872288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c8afcf-f7e5-4384-bafa-3dc2b0c5a4f4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.872775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c8afcf-f7e5-4384-bafa-3dc2b0c5a4f4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.873938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c8afcf-f7e5-4384-bafa-3dc2b0c5a4f4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.874894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c8afcf-f7e5-4384-bafa-3dc2b0c5a4f4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.875471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c8afcf-f7e5-4384-bafa-3dc2b0c5a4f4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.876040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c8afcf-f7e5-4384-bafa-3dc2b0c5a4f4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.921337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c56eb4c5-076e-4e19-97d5-151e8e725c55 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.931848 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c56eb4c5-076e-4e19-97d5-151e8e725c55 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1508 microversion: 2.1 time: 0.273447 Oct 29 02:50:26.933322 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 782/1513] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:26 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:26.945208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ed9fa42-8c04-454f-b5dd-a67c5a653b63 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:26.945881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2ed9fa42-8c04-454f-b5dd-a67c5a653b63 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:26.954615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa42-8c04-454f-b5dd-a67c5a653b63 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.955405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa42-8c04-454f-b5dd-a67c5a653b63 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.956079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa42-8c04-454f-b5dd-a67c5a653b63 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.956799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa42-8c04-454f-b5dd-a67c5a653b63 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.957246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa42-8c04-454f-b5dd-a67c5a653b63 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.957663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed9fa42-8c04-454f-b5dd-a67c5a653b63 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.028204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2ed9fa42-8c04-454f-b5dd-a67c5a653b63 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:27.038260 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ed9fa42-8c04-454f-b5dd-a67c5a653b63 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1277 microversion: 2.1 time: 0.103403 Oct 29 02:50:27.038979 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 783/1514] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:26 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:27.072128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-26c8afcf-f7e5-4384-bafa-3dc2b0c5a4f4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:27.080272 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-26c8afcf-f7e5-4384-bafa-3dc2b0c5a4f4 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.245993 Oct 29 02:50:27.080846 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 732/1515] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:26 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:27.088614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-adde70d2-783b-459a-94d0-3beffe448688 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:27.089220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-adde70d2-783b-459a-94d0-3beffe448688 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:27.095642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adde70d2-783b-459a-94d0-3beffe448688 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.096118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adde70d2-783b-459a-94d0-3beffe448688 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.096764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adde70d2-783b-459a-94d0-3beffe448688 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.097660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adde70d2-783b-459a-94d0-3beffe448688 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.098136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adde70d2-783b-459a-94d0-3beffe448688 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.098556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adde70d2-783b-459a-94d0-3beffe448688 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.123341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:27.125191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:27.128710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:27.135922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.136137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.136583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.137432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.137901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.138477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.221928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:27.235295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:27.237161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:27.244294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c94cdc8-3159-46c4-846c-df9ea5553d55 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.126417 Oct 29 02:50:27.245992 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 733/1516] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:27 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:27.284832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-adde70d2-783b-459a-94d0-3beffe448688 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:27.294123 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-adde70d2-783b-459a-94d0-3beffe448688 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 200 len: 1324 microversion: 2.1 time: 0.209254 Oct 29 02:50:27.301276 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 784/1517] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:27 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 1324 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:27.356569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:27.357302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] [instance: 1cbe53ff-63ff-43b0-be87-9f728001a964] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:27.363602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.364081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.364560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.365320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.365772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.366210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.382486 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] HTTP exception thrown: Instance 1cbe53ff-63ff-43b0-be87-9f728001a964 could not be found. Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Request method failure captured: Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 HTTP/1.1 Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJTYvWL4XrjJUWRfyAqovPz0uj3YeBi7MZ4yPFlxFnwSwn8BhKtyRjncWCZh7iDkqNKPlNotOT1jOCL0wz85oSBy3dxPkCYQypOVLa1S0IrFMoFoh57PN8BVSrPSRjP5omcnftFRzq67sOMelHN64PH3xw3PkLrBGnDquW4dxTtSszQ Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 01d46bf526a149d7b149decc11d24f3d Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TenantUsagesTestJSON-44024231 Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:50:27.384434 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/01d46bf526a149d7b149decc11d24f3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01d46bf526a149d7b149decc11d24f3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_01d46bf526a149d7b149decc11d24f3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01d46bf526a149d7b149decc11d24f3d"}]}] Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TenantUsagesTestJSON-44024231 Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 01d46bf526a149d7b149decc11d24f3d Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TenantUsagesTestJSON-44024231 Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TenantUsagesTestJSON-44024231-project Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 5c78a473c70b4e29ac4d3fdd53c4b501 Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TenantUsagesTestJSON-44024231-project Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1cbe53ff-63ff-43b0-be87-9f728001a964 could not be found. Oct 29 02:50:27.386245 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1cbe53ff-63ff-43b0-be87-9f728001a964'} Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cbe53ff-63ff-43b0-be87-9f728001a964 could not be found. Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:27.387099 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cbe53ff-63ff-43b0-be87-9f728001a964 could not be found. Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cbe53ff-63ff-43b0-be87-9f728001a964 could not be found. Oct 29 02:50:27.388576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:27.390708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] Returning 404 to user: Instance 1cbe53ff-63ff-43b0-be87-9f728001a964 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:27.390708 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2acf95e1-9010-48c2-9bce-6e28196569b5 tempest-TenantUsagesTestJSON-44024231 tempest-TenantUsagesTestJSON-44024231-project] 10.222.0.16 "GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964" status: 404 len: 111 microversion: 2.1 time: 0.033923 Oct 29 02:50:27.390708 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 734/1518] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:27 2022] GET /compute/v2.1/servers/1cbe53ff-63ff-43b0-be87-9f728001a964 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:27.957696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0904f51c-f458-441e-9ae9-4dd7e4bb9cbe tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:27.958541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0904f51c-f458-441e-9ae9-4dd7e4bb9cbe tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:27.979054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0904f51c-f458-441e-9ae9-4dd7e4bb9cbe tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.980857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0904f51c-f458-441e-9ae9-4dd7e4bb9cbe tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.982709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0904f51c-f458-441e-9ae9-4dd7e4bb9cbe tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.984037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0904f51c-f458-441e-9ae9-4dd7e4bb9cbe tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.988241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0904f51c-f458-441e-9ae9-4dd7e4bb9cbe tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.995734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0904f51c-f458-441e-9ae9-4dd7e4bb9cbe tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.064512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-899940ad-7d1f-49ce-84c6-11d91f8d6aec tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:28.065522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-899940ad-7d1f-49ce-84c6-11d91f8d6aec tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:28.085741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-899940ad-7d1f-49ce-84c6-11d91f8d6aec tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:28.086266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-899940ad-7d1f-49ce-84c6-11d91f8d6aec tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:28.086703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-899940ad-7d1f-49ce-84c6-11d91f8d6aec tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.087421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-899940ad-7d1f-49ce-84c6-11d91f8d6aec tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:28.088918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-899940ad-7d1f-49ce-84c6-11d91f8d6aec tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:28.089338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-899940ad-7d1f-49ce-84c6-11d91f8d6aec tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.275942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0904f51c-f458-441e-9ae9-4dd7e4bb9cbe tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:28.296342 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0904f51c-f458-441e-9ae9-4dd7e4bb9cbe tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1508 microversion: 2.1 time: 0.343326 Oct 29 02:50:28.297973 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 785/1519] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:27 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1508 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:28.305567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f2a1276-cac5-4b19-a057-add004ffd178 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:28.306260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-899940ad-7d1f-49ce-84c6-11d91f8d6aec tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:28.306744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f2a1276-cac5-4b19-a057-add004ffd178 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:28.314992 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-899940ad-7d1f-49ce-84c6-11d91f8d6aec tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1283 microversion: 2.1 time: 0.256346 Oct 29 02:50:28.315259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f2a1276-cac5-4b19-a057-add004ffd178 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:28.326046 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 735/1520] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:28 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1283 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:28.326670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f2a1276-cac5-4b19-a057-add004ffd178 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:28.326670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f2a1276-cac5-4b19-a057-add004ffd178 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.326670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f2a1276-cac5-4b19-a057-add004ffd178 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:28.326670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f2a1276-cac5-4b19-a057-add004ffd178 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:28.327063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f2a1276-cac5-4b19-a057-add004ffd178 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.331693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:28.332313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:28.342622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:28.343203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:28.343688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.345846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:28.346387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:28.346799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.522511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:28.536308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:28.538986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:28.548364 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ac4bb889-f71b-4239-a9a0-e3ae93492cd4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.231383 Oct 29 02:50:28.549109 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 736/1521] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:28 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:28.580320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f3dcce8-67f6-4b3a-8e9e-7067ee237df2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:28.581067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f3dcce8-67f6-4b3a-8e9e-7067ee237df2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:28.589066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3dcce8-67f6-4b3a-8e9e-7067ee237df2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:28.589991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3dcce8-67f6-4b3a-8e9e-7067ee237df2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:28.590532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3dcce8-67f6-4b3a-8e9e-7067ee237df2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.591385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3dcce8-67f6-4b3a-8e9e-7067ee237df2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:28.591946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3dcce8-67f6-4b3a-8e9e-7067ee237df2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:28.592466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3dcce8-67f6-4b3a-8e9e-7067ee237df2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.615672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f2a1276-cac5-4b19-a057-add004ffd178 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:28.624317 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f2a1276-cac5-4b19-a057-add004ffd178 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.324937 Oct 29 02:50:28.625266 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 786/1522] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:28 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:28.947883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8f3dcce8-67f6-4b3a-8e9e-7067ee237df2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:28.971599 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f3dcce8-67f6-4b3a-8e9e-7067ee237df2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 200 len: 1520 microversion: 2.1 time: 0.419080 Oct 29 02:50:28.972260 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 737/1523] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:28 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 1520 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:28.995957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Action: 'action', calling method: .version_select at 0x7fe1ab027ee0>, body: {"addFloatingIp": {"address": "172.25.9.130"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:28.998645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:29.006085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.006717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.007390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:29.008373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.009031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.009710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:29.142135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "refresh_cache-c285fc05-0513-4e2e-b7d8-fb6d8466eefb" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:50:29.142803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquired lock "refresh_cache-c285fc05-0513-4e2e-b7d8-fb6d8466eefb" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:50:29.324932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0df5b7e1-2024-439e-a959-1680d2268be1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:29.325864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0df5b7e1-2024-439e-a959-1680d2268be1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:29.336979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0df5b7e1-2024-439e-a959-1680d2268be1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.338211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0df5b7e1-2024-439e-a959-1680d2268be1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.339156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0df5b7e1-2024-439e-a959-1680d2268be1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:29.345560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0df5b7e1-2024-439e-a959-1680d2268be1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.346264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0df5b7e1-2024-439e-a959-1680d2268be1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.347051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0df5b7e1-2024-439e-a959-1680d2268be1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:29.698915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0df5b7e1-2024-439e-a959-1680d2268be1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:29.702945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:29.714759 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0df5b7e1-2024-439e-a959-1680d2268be1 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1513 microversion: 2.1 time: 0.394275 Oct 29 02:50:29.717565 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 738/1524] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:29 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1513 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:29.722950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a13b7692-d01b-4100-b960-cb52038db20b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:29.732012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a13b7692-d01b-4100-b960-cb52038db20b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:29.746788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a13b7692-d01b-4100-b960-cb52038db20b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.748823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a13b7692-d01b-4100-b960-cb52038db20b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.749283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a13b7692-d01b-4100-b960-cb52038db20b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:29.754592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a13b7692-d01b-4100-b960-cb52038db20b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.755105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a13b7692-d01b-4100-b960-cb52038db20b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.755552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a13b7692-d01b-4100-b960-cb52038db20b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.074771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a13b7692-d01b-4100-b960-cb52038db20b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.094488 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a13b7692-d01b-4100-b960-cb52038db20b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1325 microversion: 2.1 time: 0.371961 Oct 29 02:50:30.095182 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 739/1525] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:29 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1325 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:30.105604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:30.106243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:30.116335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.123682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:30.123682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.123890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.124676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:30.125833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.240316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.254674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.264558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.281026 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd33148c-a80b-481d-a975-d2cfa2121afc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.184320 Oct 29 02:50:30.281737 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 740/1526] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:30 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:30.287267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dcd9b973-177d-462e-a684-05ed26298528 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:30.288123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dcd9b973-177d-462e-a684-05ed26298528 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:30.296336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcd9b973-177d-462e-a684-05ed26298528 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.296839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcd9b973-177d-462e-a684-05ed26298528 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:30.297268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcd9b973-177d-462e-a684-05ed26298528 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.298091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcd9b973-177d-462e-a684-05ed26298528 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.298540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcd9b973-177d-462e-a684-05ed26298528 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:30.298962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcd9b973-177d-462e-a684-05ed26298528 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.547308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dcd9b973-177d-462e-a684-05ed26298528 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.565551 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dcd9b973-177d-462e-a684-05ed26298528 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.282217 Oct 29 02:50:30.566184 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 741/1527] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:30 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:30.723338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-efd9401d-99b2-445b-85ac-3c4920b6ac9c req-0a613a57-1e10-456f-b16f-636d71da7cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c43db9b0-c693-48cf-9902-82d38e76ea04", "tag": "9d930331-7f7c-4409-8940-0255a051fdb9"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:30.733793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-efd9401d-99b2-445b-85ac-3c4920b6ac9c req-0a613a57-1e10-456f-b16f-636d71da7cfb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.734619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-efd9401d-99b2-445b-85ac-3c4920b6ac9c req-0a613a57-1e10-456f-b16f-636d71da7cfb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:30.735231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-efd9401d-99b2-445b-85ac-3c4920b6ac9c req-0a613a57-1e10-456f-b16f-636d71da7cfb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.748567 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-efd9401d-99b2-445b-85ac-3c4920b6ac9c req-0a613a57-1e10-456f-b16f-636d71da7cfb service nova] Creating event network-changed:9d930331-7f7c-4409-8940-0255a051fdb9 for instance c43db9b0-c693-48cf-9902-82d38e76ea04 on n-h2-862964-4 Oct 29 02:50:30.754945 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-efd9401d-99b2-445b-85ac-3c4920b6ac9c req-0a613a57-1e10-456f-b16f-636d71da7cfb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035402 Oct 29 02:50:30.755854 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 742/1528] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:50:30.762009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-93d3b596-7850-403d-a595-5a3c778ac266 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:30.762972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-93d3b596-7850-403d-a595-5a3c778ac266 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:30.769305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93d3b596-7850-403d-a595-5a3c778ac266 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.770058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93d3b596-7850-403d-a595-5a3c778ac266 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:30.770488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93d3b596-7850-403d-a595-5a3c778ac266 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.771215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93d3b596-7850-403d-a595-5a3c778ac266 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.771829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93d3b596-7850-403d-a595-5a3c778ac266 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:30.772346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93d3b596-7850-403d-a595-5a3c778ac266 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.842624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Building network info cache for instance {{(pid=127041) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:50:31.030180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-93d3b596-7850-403d-a595-5a3c778ac266 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:31.042266 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-93d3b596-7850-403d-a595-5a3c778ac266 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1506 microversion: 2.1 time: 0.284770 Oct 29 02:50:31.060578 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 743/1529] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:30 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:31.073264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b3086a2d-3e2c-4f9a-b9d7-84d5a47b6304 req-6b499a2d-14fc-41ac-9f58-af420165e5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c285fc05-0513-4e2e-b7d8-fb6d8466eefb", "tag": "d7867910-0a7e-4d66-8d87-fee7084736c6"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:31.090109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b3086a2d-3e2c-4f9a-b9d7-84d5a47b6304 req-6b499a2d-14fc-41ac-9f58-af420165e5d5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.091000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b3086a2d-3e2c-4f9a-b9d7-84d5a47b6304 req-6b499a2d-14fc-41ac-9f58-af420165e5d5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.091569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b3086a2d-3e2c-4f9a-b9d7-84d5a47b6304 req-6b499a2d-14fc-41ac-9f58-af420165e5d5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.105371 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b3086a2d-3e2c-4f9a-b9d7-84d5a47b6304 req-6b499a2d-14fc-41ac-9f58-af420165e5d5 service nova] Creating event network-changed:d7867910-0a7e-4d66-8d87-fee7084736c6 for instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb on n-h1-862964-4 Oct 29 02:50:31.112922 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b3086a2d-3e2c-4f9a-b9d7-84d5a47b6304 req-6b499a2d-14fc-41ac-9f58-af420165e5d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048903 Oct 29 02:50:31.114294 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 744/1530] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:31.122706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be707b53-56a7-4582-b3b7-1bdeadae4357 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '.version_select at 0x7fe1a88f4310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:31.123354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-be707b53-56a7-4582-b3b7-1bdeadae4357 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:31.131960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be707b53-56a7-4582-b3b7-1bdeadae4357 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.132634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be707b53-56a7-4582-b3b7-1bdeadae4357 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.149579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be707b53-56a7-4582-b3b7-1bdeadae4357 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.150499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be707b53-56a7-4582-b3b7-1bdeadae4357 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.152228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be707b53-56a7-4582-b3b7-1bdeadae4357 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.152791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be707b53-56a7-4582-b3b7-1bdeadae4357 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.211567 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be707b53-56a7-4582-b3b7-1bdeadae4357 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.095270 Oct 29 02:50:31.212480 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 745/1531] 10.222.0.16 () {58 vars in 1296 bytes} [Sat Oct 29 02:50:31 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68/os-instance-actions => generated 611 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:31.217660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7b1d2a8f-320f-46e6-a451-771edd5292f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:31.218657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7b1d2a8f-320f-46e6-a451-771edd5292f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:31.231729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b1d2a8f-320f-46e6-a451-771edd5292f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.232424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b1d2a8f-320f-46e6-a451-771edd5292f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.233021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b1d2a8f-320f-46e6-a451-771edd5292f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.234595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b1d2a8f-320f-46e6-a451-771edd5292f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.235815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b1d2a8f-320f-46e6-a451-771edd5292f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.236610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b1d2a8f-320f-46e6-a451-771edd5292f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.569396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b1d2a8f-320f-46e6-a451-771edd5292f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:31.585115 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7b1d2a8f-320f-46e6-a451-771edd5292f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1325 microversion: 2.1 time: 0.370865 Oct 29 02:50:31.586394 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 746/1532] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:31 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1325 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:31.592459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-acac18d2-8ca2-4dd0-8448-cdbd36b5862c tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:31.593146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-acac18d2-8ca2-4dd0-8448-cdbd36b5862c tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:31.603692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acac18d2-8ca2-4dd0-8448-cdbd36b5862c tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.604680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acac18d2-8ca2-4dd0-8448-cdbd36b5862c tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.605412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acac18d2-8ca2-4dd0-8448-cdbd36b5862c tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.606458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acac18d2-8ca2-4dd0-8448-cdbd36b5862c tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.607188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acac18d2-8ca2-4dd0-8448-cdbd36b5862c tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.607867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acac18d2-8ca2-4dd0-8448-cdbd36b5862c tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.642960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-acac18d2-8ca2-4dd0-8448-cdbd36b5862c tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:50:31.767252 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-acac18d2-8ca2-4dd0-8448-cdbd36b5862c tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "DELETE /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 204 len: 0 microversion: 2.1 time: 0.179208 Oct 29 02:50:31.771132 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 747/1533] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:50:31 2022] DELETE /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:31.783315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:31.784276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:31.792126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.792822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.793422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.795009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.795629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.796765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.826189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:31.860864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Updating instance_info_cache with network_info: [{"id": "d7867910-0a7e-4d66-8d87-fee7084736c6", "address": "fa:16:3e:78:9d:fc", "network": {"id": "7da6dbec-0aa3-4269-a738-63fa43633287", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-516312878-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "802d5fbb45b84622acf59c4046f26a8c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd7867910-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127041) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:50:31.880934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Releasing lock "refresh_cache-c285fc05-0513-4e2e-b7d8-fb6d8466eefb" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:50:31.882330 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d22db3dc-b01f-4c62-8f8f-008bfcb94041 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "POST /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb/action" status: 202 len: 0 microversion: 2.1 time: 2.890780 Oct 29 02:50:31.886725 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 787/1534] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:28 2022] POST /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb/action => generated 0 bytes in 2896 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:50:31.895182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:31.896776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-31c81b82-e8ee-41a6-9f4b-3ed844fdeb8d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:31.902041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-31c81b82-e8ee-41a6-9f4b-3ed844fdeb8d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:31.908539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:31.910095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:31.913310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31c81b82-e8ee-41a6-9f4b-3ed844fdeb8d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.913827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31c81b82-e8ee-41a6-9f4b-3ed844fdeb8d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.914258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31c81b82-e8ee-41a6-9f4b-3ed844fdeb8d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.915151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31c81b82-e8ee-41a6-9f4b-3ed844fdeb8d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.915920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31c81b82-e8ee-41a6-9f4b-3ed844fdeb8d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.916320 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c7c55fdc-6778-4ea6-b08a-917a7c0c7f61 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.138833 Oct 29 02:50:31.916811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31c81b82-e8ee-41a6-9f4b-3ed844fdeb8d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.916943 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 748/1535] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:31 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:31.923430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d89a0c0a-472b-4ff1-b35c-823cff565978 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:31.924048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d89a0c0a-472b-4ff1-b35c-823cff565978 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:31.931468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89a0c0a-472b-4ff1-b35c-823cff565978 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.932016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89a0c0a-472b-4ff1-b35c-823cff565978 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.932442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89a0c0a-472b-4ff1-b35c-823cff565978 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.933363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89a0c0a-472b-4ff1-b35c-823cff565978 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.934003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89a0c0a-472b-4ff1-b35c-823cff565978 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.934583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89a0c0a-472b-4ff1-b35c-823cff565978 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.091638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d89a0c0a-472b-4ff1-b35c-823cff565978 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:32.102440 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d89a0c0a-472b-4ff1-b35c-823cff565978 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1512 microversion: 2.1 time: 0.183935 Oct 29 02:50:32.117180 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 749/1536] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:31 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:32.123386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Action: 'action', calling method: .version_select at 0x7fe1aa677af0>, body: {"addFloatingIp": {"address": "172.25.9.130"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:32.127154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:32.134863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.136168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.136330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.137027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.137473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.137945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.219160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "refresh_cache-9f222ce6-6c69-4a70-a003-3cc72186c175" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:50:32.219774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquired lock "refresh_cache-9f222ce6-6c69-4a70-a003-3cc72186c175" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:50:32.551086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-31c81b82-e8ee-41a6-9f4b-3ed844fdeb8d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:32.562125 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-31c81b82-e8ee-41a6-9f4b-3ed844fdeb8d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.673398 Oct 29 02:50:32.562769 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 788/1537] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:31 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:32.611264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1973dac4-7054-4d28-8fcd-22e69231e671 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:32.612305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1973dac4-7054-4d28-8fcd-22e69231e671 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:32.621579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1973dac4-7054-4d28-8fcd-22e69231e671 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.622792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1973dac4-7054-4d28-8fcd-22e69231e671 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.623234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1973dac4-7054-4d28-8fcd-22e69231e671 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.624141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1973dac4-7054-4d28-8fcd-22e69231e671 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.624753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1973dac4-7054-4d28-8fcd-22e69231e671 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.625334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1973dac4-7054-4d28-8fcd-22e69231e671 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.890522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1973dac4-7054-4d28-8fcd-22e69231e671 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:32.900183 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1973dac4-7054-4d28-8fcd-22e69231e671 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1325 microversion: 2.1 time: 0.294294 Oct 29 02:50:32.916027 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 789/1538] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:32 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1325 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:32.945097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:32.950043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:32.973791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.974788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.975239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.976037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.976494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.976914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.069504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:33.079582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:33.081525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:33.087751 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-45c68038-45d9-452a-bb87-04f54ec19abc tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.147016 Oct 29 02:50:33.098743 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 790/1539] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:32 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:33.145249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dbc407c0-56ad-4e19-8218-703400af333e tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:33.146396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dbc407c0-56ad-4e19-8218-703400af333e tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:33.153600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbc407c0-56ad-4e19-8218-703400af333e tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.154394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbc407c0-56ad-4e19-8218-703400af333e tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.154824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbc407c0-56ad-4e19-8218-703400af333e tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.155545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbc407c0-56ad-4e19-8218-703400af333e tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.156002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbc407c0-56ad-4e19-8218-703400af333e tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.156425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbc407c0-56ad-4e19-8218-703400af333e tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.347410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dbc407c0-56ad-4e19-8218-703400af333e tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:33.356333 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dbc407c0-56ad-4e19-8218-703400af333e tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1512 microversion: 2.1 time: 0.215479 Oct 29 02:50:33.357433 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 791/1540] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:33 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:33.589857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-db4a8fd6-c22a-43c6-bbf9-57b4507a1e63 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:33.590997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db4a8fd6-c22a-43c6-bbf9-57b4507a1e63 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:33.603219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db4a8fd6-c22a-43c6-bbf9-57b4507a1e63 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.603725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db4a8fd6-c22a-43c6-bbf9-57b4507a1e63 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.604160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db4a8fd6-c22a-43c6-bbf9-57b4507a1e63 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.608728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db4a8fd6-c22a-43c6-bbf9-57b4507a1e63 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.610055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db4a8fd6-c22a-43c6-bbf9-57b4507a1e63 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.610986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db4a8fd6-c22a-43c6-bbf9-57b4507a1e63 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.941560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-db4a8fd6-c22a-43c6-bbf9-57b4507a1e63 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:33.950433 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-db4a8fd6-c22a-43c6-bbf9-57b4507a1e63 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1543 microversion: 2.1 time: 0.367400 Oct 29 02:50:33.951666 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 792/1541] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:33 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1543 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:33.969604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b8ca2047-1f0f-4bed-a9c3-91f7228eb12b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:33.970423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b8ca2047-1f0f-4bed-a9c3-91f7228eb12b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:33.978666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8ca2047-1f0f-4bed-a9c3-91f7228eb12b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.979786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8ca2047-1f0f-4bed-a9c3-91f7228eb12b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.980422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8ca2047-1f0f-4bed-a9c3-91f7228eb12b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.981456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8ca2047-1f0f-4bed-a9c3-91f7228eb12b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.982206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8ca2047-1f0f-4bed-a9c3-91f7228eb12b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.983903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8ca2047-1f0f-4bed-a9c3-91f7228eb12b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.990979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:34.309650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b8ca2047-1f0f-4bed-a9c3-91f7228eb12b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:34.349736 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b8ca2047-1f0f-4bed-a9c3-91f7228eb12b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1325 microversion: 2.1 time: 0.396564 Oct 29 02:50:34.370999 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 793/1542] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:33 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1325 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:34.378790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:34.382279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:34.392465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:34.393952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:34.394609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:34.395227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:34.397010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:34.397773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:34.398356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:34.526449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:34.542326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:34.545382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:34.552717 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6007905c-206c-4434-9d8d-975cafc0933b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.180246 Oct 29 02:50:34.553878 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 794/1543] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:34 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:34.564153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c17049c6-da88-46a2-8c5d-45ab6e7c41fb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:34.565070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c17049c6-da88-46a2-8c5d-45ab6e7c41fb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:34.580213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c17049c6-da88-46a2-8c5d-45ab6e7c41fb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:34.580916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c17049c6-da88-46a2-8c5d-45ab6e7c41fb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:34.581554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c17049c6-da88-46a2-8c5d-45ab6e7c41fb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:34.582439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c17049c6-da88-46a2-8c5d-45ab6e7c41fb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:34.585056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c17049c6-da88-46a2-8c5d-45ab6e7c41fb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:34.585487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c17049c6-da88-46a2-8c5d-45ab6e7c41fb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.085958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c17049c6-da88-46a2-8c5d-45ab6e7c41fb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170992795bde4f318bb47ad5d2727ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fe14a8293e416992d1e6f29ff4d5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:35.127413 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c17049c6-da88-46a2-8c5d-45ab6e7c41fb tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 200 len: 1512 microversion: 2.1 time: 0.570521 Oct 29 02:50:35.135018 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 795/1544] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:34 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 1512 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:35.147443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-bf4ab9ba-16a1-4be0-aae5-81c8f236be22 req-cc8fbdd3-d7f7-4064-b923-77e05502579f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c285fc05-0513-4e2e-b7d8-fb6d8466eefb", "tag": "d7867910-0a7e-4d66-8d87-fee7084736c6"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:35.162201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bf4ab9ba-16a1-4be0-aae5-81c8f236be22 req-cc8fbdd3-d7f7-4064-b923-77e05502579f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.163017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bf4ab9ba-16a1-4be0-aae5-81c8f236be22 req-cc8fbdd3-d7f7-4064-b923-77e05502579f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.163644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bf4ab9ba-16a1-4be0-aae5-81c8f236be22 req-cc8fbdd3-d7f7-4064-b923-77e05502579f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.186002 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-bf4ab9ba-16a1-4be0-aae5-81c8f236be22 req-cc8fbdd3-d7f7-4064-b923-77e05502579f service nova] Creating event network-changed:d7867910-0a7e-4d66-8d87-fee7084736c6 for instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb on n-h1-862964-4 Oct 29 02:50:35.195977 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-bf4ab9ba-16a1-4be0-aae5-81c8f236be22 req-cc8fbdd3-d7f7-4064-b923-77e05502579f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059234 Oct 29 02:50:35.197349 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 796/1545] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:35.208889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b81caee8-ae75-48cf-90f4-cd5a009501da tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:35.209768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b81caee8-ae75-48cf-90f4-cd5a009501da tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:35.217662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81caee8-ae75-48cf-90f4-cd5a009501da tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.218387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81caee8-ae75-48cf-90f4-cd5a009501da tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.218883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81caee8-ae75-48cf-90f4-cd5a009501da tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.221186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81caee8-ae75-48cf-90f4-cd5a009501da tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.222699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81caee8-ae75-48cf-90f4-cd5a009501da tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.223516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81caee8-ae75-48cf-90f4-cd5a009501da tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.282877 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.network.neutron [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] re-assign floating IP 172.25.9.130 from instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb Oct 29 02:50:35.386384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Building network info cache for instance {{(pid=127042) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:50:35.630917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:35.672839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:35.699840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b81caee8-ae75-48cf-90f4-cd5a009501da tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:35.712664 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b81caee8-ae75-48cf-90f4-cd5a009501da tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1542 microversion: 2.1 time: 0.513714 Oct 29 02:50:35.728843 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 797/1546] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:35 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1542 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:35.728843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-724c59df-6a87-4bac-800a-97373db01b5a req-d55ee9ec-f407-4338-be42-f33fe6c2caf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987fb2af-68a7-4981-83e7-2dd2da0f5a68", "name": "network-vif-deleted", "tag": "c4b2b8a3-ff9a-4e7f-b8d5-0d061ad6c48f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:35.745940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-724c59df-6a87-4bac-800a-97373db01b5a req-d55ee9ec-f407-4338-be42-f33fe6c2caf4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.746421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-724c59df-6a87-4bac-800a-97373db01b5a req-d55ee9ec-f407-4338-be42-f33fe6c2caf4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.746860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-724c59df-6a87-4bac-800a-97373db01b5a req-d55ee9ec-f407-4338-be42-f33fe6c2caf4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.765270 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-724c59df-6a87-4bac-800a-97373db01b5a req-d55ee9ec-f407-4338-be42-f33fe6c2caf4 service nova] Creating event network-vif-deleted:c4b2b8a3-ff9a-4e7f-b8d5-0d061ad6c48f for instance 987fb2af-68a7-4981-83e7-2dd2da0f5a68 on n-h1-862964-4 Oct 29 02:50:35.785126 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-724c59df-6a87-4bac-800a-97373db01b5a req-d55ee9ec-f407-4338-be42-f33fe6c2caf4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057982 Oct 29 02:50:35.785863 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 798/1547] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:35.799672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94a3d9d5-ec77-49fc-9544-0842cb6930ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:35.800391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-94a3d9d5-ec77-49fc-9544-0842cb6930ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:35.814912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94a3d9d5-ec77-49fc-9544-0842cb6930ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.815412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94a3d9d5-ec77-49fc-9544-0842cb6930ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.815847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94a3d9d5-ec77-49fc-9544-0842cb6930ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.816579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94a3d9d5-ec77-49fc-9544-0842cb6930ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.817031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94a3d9d5-ec77-49fc-9544-0842cb6930ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.817739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94a3d9d5-ec77-49fc-9544-0842cb6930ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.907789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:36.178696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-94a3d9d5-ec77-49fc-9544-0842cb6930ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:36.194530 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94a3d9d5-ec77-49fc-9544-0842cb6930ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1325 microversion: 2.1 time: 0.404445 Oct 29 02:50:36.210214 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 799/1548] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:35 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:36.215508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:36.216401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:36.227239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.228072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.230761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:36.231916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.234520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.235258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:36.473629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:36.486517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:36.493895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:36.504509 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9808686e-61ca-4d83-8bac-f7672d0dc46b tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1560 microversion: 2.91 time: 0.293051 Oct 29 02:50:36.514132 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 800/1549] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:36 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1560 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:36.519673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:36.520686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] [instance: 987fb2af-68a7-4981-83e7-2dd2da0f5a68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:36.527953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.528746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.529410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:36.530852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.532639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.533301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:36.567990 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] HTTP exception thrown: Instance 987fb2af-68a7-4981-83e7-2dd2da0f5a68 could not be found. Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Request method failure captured: Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 HTTP/1.1 Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJTkePzGe676AdnlKumU975z4kh7gPHFi5YOZb813cAAo6E5Si2qROZBHr8AclhScUaz-Yh6KCStjQop3uxl5YrcElt7qEVlk67GVEc6LpWAXL_npQGR-kWtrX3ja6F7cZb4xOIE5NoxKqJ2T9GZytG-sacKaYc1Gqf96SyErp4M4PE Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 45fe14a8293e416992d1e6f29ff4d5f5 Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-InstanceActionsTestJSON-1095171407 Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:50:36.569391 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/45fe14a8293e416992d1e6f29ff4d5f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45fe14a8293e416992d1e6f29ff4d5f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_45fe14a8293e416992d1e6f29ff4d5f5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45fe14a8293e416992d1e6f29ff4d5f5"}]}] Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-InstanceActionsTestJSON-1095171407 Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 45fe14a8293e416992d1e6f29ff4d5f5 Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1095171407 Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-InstanceActionsTestJSON-1095171407-project Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 170992795bde4f318bb47ad5d2727ca0 Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-InstanceActionsTestJSON-1095171407-project Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 987fb2af-68a7-4981-83e7-2dd2da0f5a68 could not be found. Oct 29 02:50:36.570780 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '987fb2af-68a7-4981-83e7-2dd2da0f5a68'} Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987fb2af-68a7-4981-83e7-2dd2da0f5a68 could not be found. Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:36.571536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987fb2af-68a7-4981-83e7-2dd2da0f5a68 could not be found. Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987fb2af-68a7-4981-83e7-2dd2da0f5a68 could not be found. Oct 29 02:50:36.572781 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:36.573955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] Returning 404 to user: Instance 987fb2af-68a7-4981-83e7-2dd2da0f5a68 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:36.573955 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c1a8b9ac-89a5-4023-9f09-8c56445b2ff5 tempest-InstanceActionsTestJSON-1095171407 tempest-InstanceActionsTestJSON-1095171407-project] 10.222.0.16 "GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68" status: 404 len: 111 microversion: 2.1 time: 0.055309 Oct 29 02:50:36.579057 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 801/1550] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:36 2022] GET /compute/v2.1/servers/987fb2af-68a7-4981-83e7-2dd2da0f5a68 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:36.737877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c4f2449d-561c-4e27-a60e-de949e08cc23 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:36.739361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c4f2449d-561c-4e27-a60e-de949e08cc23 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:36.753933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f2449d-561c-4e27-a60e-de949e08cc23 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.754525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f2449d-561c-4e27-a60e-de949e08cc23 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.758093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f2449d-561c-4e27-a60e-de949e08cc23 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:36.759559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f2449d-561c-4e27-a60e-de949e08cc23 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.760054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f2449d-561c-4e27-a60e-de949e08cc23 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.765725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f2449d-561c-4e27-a60e-de949e08cc23 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:37.344780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c4f2449d-561c-4e27-a60e-de949e08cc23 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:37.355544 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c4f2449d-561c-4e27-a60e-de949e08cc23 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1542 microversion: 2.1 time: 0.622625 Oct 29 02:50:37.361204 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 802/1551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:36 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1542 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:37.384452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-311f50d7-b114-4fb1-b142-1fa623dae541 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:37.385065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-311f50d7-b114-4fb1-b142-1fa623dae541 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:37.405955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-311f50d7-b114-4fb1-b142-1fa623dae541 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:37.406460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-311f50d7-b114-4fb1-b142-1fa623dae541 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:37.406899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-311f50d7-b114-4fb1-b142-1fa623dae541 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:37.407622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-311f50d7-b114-4fb1-b142-1fa623dae541 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:37.408074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-311f50d7-b114-4fb1-b142-1fa623dae541 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:37.408497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-311f50d7-b114-4fb1-b142-1fa623dae541 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:37.950911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-311f50d7-b114-4fb1-b142-1fa623dae541 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:37.975177 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-311f50d7-b114-4fb1-b142-1fa623dae541 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1325 microversion: 2.1 time: 0.593479 Oct 29 02:50:37.977787 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 803/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:37 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1325 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:37.987952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b68b4eeb-b1a8-44fd-9059-beefa98e35e7 req-9e49f997-d7bc-4e75-a168-f1716758edf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f222ce6-6c69-4a70-a003-3cc72186c175", "tag": "91d574ae-fd72-4533-a128-53170347b277"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:38.012204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b68b4eeb-b1a8-44fd-9059-beefa98e35e7 req-9e49f997-d7bc-4e75-a168-f1716758edf1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.014640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b68b4eeb-b1a8-44fd-9059-beefa98e35e7 req-9e49f997-d7bc-4e75-a168-f1716758edf1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.015168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b68b4eeb-b1a8-44fd-9059-beefa98e35e7 req-9e49f997-d7bc-4e75-a168-f1716758edf1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.049292 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b68b4eeb-b1a8-44fd-9059-beefa98e35e7 req-9e49f997-d7bc-4e75-a168-f1716758edf1 service nova] Creating event network-changed:91d574ae-fd72-4533-a128-53170347b277 for instance 9f222ce6-6c69-4a70-a003-3cc72186c175 on n-h1-862964-4 Oct 29 02:50:38.065297 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b68b4eeb-b1a8-44fd-9059-beefa98e35e7 req-9e49f997-d7bc-4e75-a168-f1716758edf1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085897 Oct 29 02:50:38.065928 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 804/1553] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:38.087937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:38.088746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Updating instance_info_cache with network_info: [{"id": "d7867910-0a7e-4d66-8d87-fee7084736c6", "address": "fa:16:3e:78:9d:fc", "network": {"id": "7da6dbec-0aa3-4269-a738-63fa43633287", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-516312878-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "802d5fbb45b84622acf59c4046f26a8c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd7867910-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127042) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:50:38.090709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:38.103569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Building network info cache for instance {{(pid=127042) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:50:38.105920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.106489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.106872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.107593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.110014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.110474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.318755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:38.329210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:38.338101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:38.355981 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d0425271-4f2c-4622-a000-c1b33a50f1d2 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.285535 Oct 29 02:50:38.371143 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 805/1554] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:38 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:38.394657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-a52476f8-d2a6-4fcd-a2ea-f311bbe0a507 req-408ccdbe-ebf0-47dc-928e-c4e8aa945634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43db9b0-c693-48cf-9902-82d38e76ea04", "name": "network-vif-plugged", "status": "completed", "tag": "9d930331-7f7c-4409-8940-0255a051fdb9"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:38.414059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a52476f8-d2a6-4fcd-a2ea-f311bbe0a507 req-408ccdbe-ebf0-47dc-928e-c4e8aa945634 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.414802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a52476f8-d2a6-4fcd-a2ea-f311bbe0a507 req-408ccdbe-ebf0-47dc-928e-c4e8aa945634 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.415388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a52476f8-d2a6-4fcd-a2ea-f311bbe0a507 req-408ccdbe-ebf0-47dc-928e-c4e8aa945634 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.440395 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-a52476f8-d2a6-4fcd-a2ea-f311bbe0a507 req-408ccdbe-ebf0-47dc-928e-c4e8aa945634 service nova] Creating event network-vif-plugged:9d930331-7f7c-4409-8940-0255a051fdb9 for instance c43db9b0-c693-48cf-9902-82d38e76ea04 on n-h2-862964-4 Oct 29 02:50:38.452262 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-a52476f8-d2a6-4fcd-a2ea-f311bbe0a507 req-408ccdbe-ebf0-47dc-928e-c4e8aa945634 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079425 Oct 29 02:50:38.459662 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 806/1555] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:38.467595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ed4e06d-9b8f-423e-81c5-52ec1762b2e7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:38.469174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2ed4e06d-9b8f-423e-81c5-52ec1762b2e7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:38.489416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed4e06d-9b8f-423e-81c5-52ec1762b2e7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.490194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed4e06d-9b8f-423e-81c5-52ec1762b2e7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.490790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed4e06d-9b8f-423e-81c5-52ec1762b2e7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.491686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed4e06d-9b8f-423e-81c5-52ec1762b2e7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.492302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed4e06d-9b8f-423e-81c5-52ec1762b2e7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.493054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed4e06d-9b8f-423e-81c5-52ec1762b2e7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.925598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2ed4e06d-9b8f-423e-81c5-52ec1762b2e7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:38.934776 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ed4e06d-9b8f-423e-81c5-52ec1762b2e7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1474 microversion: 2.1 time: 0.473566 Oct 29 02:50:38.938878 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 807/1556] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:38 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1474 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:38.998441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c47e5c15-3836-4253-9a27-052317253515 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:38.999046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c47e5c15-3836-4253-9a27-052317253515 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:39.005442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47e5c15-3836-4253-9a27-052317253515 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.005982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47e5c15-3836-4253-9a27-052317253515 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.016856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47e5c15-3836-4253-9a27-052317253515 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.018731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47e5c15-3836-4253-9a27-052317253515 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.019399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47e5c15-3836-4253-9a27-052317253515 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.019857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47e5c15-3836-4253-9a27-052317253515 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.657331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Updating instance_info_cache with network_info: [{"id": "91d574ae-fd72-4533-a128-53170347b277", "address": "fa:16:3e:24:68:33", "network": {"id": "7da6dbec-0aa3-4269-a738-63fa43633287", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-516312878-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "802d5fbb45b84622acf59c4046f26a8c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap91d574ae-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127042) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:50:39.672411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Releasing lock "refresh_cache-9f222ce6-6c69-4a70-a003-3cc72186c175" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:50:39.674585 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3d4601e4-c209-4b02-934f-a6bc3dd4d5b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "POST /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175/action" status: 202 len: 0 microversion: 2.1 time: 7.555733 Oct 29 02:50:39.676826 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 750/1557] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:32 2022] POST /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175/action => generated 0 bytes in 7558 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:50:39.684310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:39.687049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:39.695682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.696504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.697389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.698406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.699017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.703172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.728790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c47e5c15-3836-4253-9a27-052317253515 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:39.741259 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c47e5c15-3836-4253-9a27-052317253515 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1325 microversion: 2.1 time: 0.746905 Oct 29 02:50:39.742152 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 808/1558] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:38 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1325 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:39.747461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Action: 'action', calling method: .version_select at 0x7fe1aafb83a0>, body: {"removeFloatingIp": {"address": "172.25.9.130"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:39.893678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:39.903451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:39.910742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:39.920557 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4fd1b4a1-0c1d-4e77-914b-b749b84fc935 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.242183 Oct 29 02:50:39.922052 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 751/1559] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:39 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:39.966948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a882d88f-fa5c-482c-92b8-a88b351caab9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:39.967860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a882d88f-fa5c-482c-92b8-a88b351caab9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:39.980402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a882d88f-fa5c-482c-92b8-a88b351caab9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.981210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a882d88f-fa5c-482c-92b8-a88b351caab9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.982649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a882d88f-fa5c-482c-92b8-a88b351caab9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.984014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a882d88f-fa5c-482c-92b8-a88b351caab9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.984650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a882d88f-fa5c-482c-92b8-a88b351caab9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.985958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a882d88f-fa5c-482c-92b8-a88b351caab9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.281580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a882d88f-fa5c-482c-92b8-a88b351caab9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:40.292302 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a882d88f-fa5c-482c-92b8-a88b351caab9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1474 microversion: 2.1 time: 0.331388 Oct 29 02:50:40.292905 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 752/1560] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:39 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1474 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:40.381127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:40.393269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.394430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.395269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.397683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.398459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.399385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.617194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f29da80b-bada-4b0a-8faf-7544e6bc9f08 req-ccc196dc-8d48-49d0-9807-cefe4d43309f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ce5a89-9c05-4459-9e6f-a94249149f0e", "name": "network-vif-unplugged", "status": "completed", "tag": "55f158e4-c02f-4621-aef5-0df1f9eb6596"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:40.642101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f29da80b-bada-4b0a-8faf-7544e6bc9f08 req-ccc196dc-8d48-49d0-9807-cefe4d43309f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.645003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f29da80b-bada-4b0a-8faf-7544e6bc9f08 req-ccc196dc-8d48-49d0-9807-cefe4d43309f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.645577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f29da80b-bada-4b0a-8faf-7544e6bc9f08 req-ccc196dc-8d48-49d0-9807-cefe4d43309f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.670930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:40.674447 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f29da80b-bada-4b0a-8faf-7544e6bc9f08 req-ccc196dc-8d48-49d0-9807-cefe4d43309f service nova] Creating event network-vif-unplugged:55f158e4-c02f-4621-aef5-0df1f9eb6596 for instance 86ce5a89-9c05-4459-9e6f-a94249149f0e on n-h2-862964-4 Oct 29 02:50:40.691603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-f29da80b-bada-4b0a-8faf-7544e6bc9f08 req-ccc196dc-8d48-49d0-9807-cefe4d43309f service nova] Instance 86ce5a89-9c05-4459-9e6f-a94249149f0e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:50:40.711000 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f29da80b-bada-4b0a-8faf-7544e6bc9f08 req-ccc196dc-8d48-49d0-9807-cefe4d43309f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097366 Oct 29 02:50:40.711607 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 753/1561] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:40.769859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d28a92c8-d8d2-4c3c-9eb0-a7431d7b7981 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:40.770617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d28a92c8-d8d2-4c3c-9eb0-a7431d7b7981 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:40.789399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d28a92c8-d8d2-4c3c-9eb0-a7431d7b7981 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.789942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d28a92c8-d8d2-4c3c-9eb0-a7431d7b7981 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.790402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d28a92c8-d8d2-4c3c-9eb0-a7431d7b7981 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.792827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d28a92c8-d8d2-4c3c-9eb0-a7431d7b7981 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.793294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d28a92c8-d8d2-4c3c-9eb0-a7431d7b7981 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.794337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d28a92c8-d8d2-4c3c-9eb0-a7431d7b7981 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.950702 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] HTTP exception thrown: Floating IP 172.25.9.130 is not associated with instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb. Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Request method failure captured: Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb/action HTTP/1.1 Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 49 Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJTOp7vToc3md_9pATVCmWPm-PwEzAFF8PizNC9lnKfMTHWbFYjcKDq5B9arXPH0Mqph7xfs4KL3v5u3V2gRtij_mM673Lg7QVgvQBSl5hSmSPTAt8qf3KCsRgnLLkIuRD5o_NG8ypQTCbaODBP5vz-naXg-paNR-2j6qUieeTfbfbg Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 802d5fbb45b84622acf59c4046f26a8c Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:50:40.953109 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/802d5fbb45b84622acf59c4046f26a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/802d5fbb45b84622acf59c4046f26a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_802d5fbb45b84622acf59c4046f26a8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/802d5fbb45b84622acf59c4046f26a8c"}]}] Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 802d5fbb45b84622acf59c4046f26a8c Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FloatingIPsAssociationTestJSON-1740756663-project Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: bba0b932c2af45c1a4e7fc5c185a64d1 Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1740756663-project Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: {"removeFloatingIp": {"address": "172.25.9.130"}} Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:50:40.954834 n-d-862964-4 devstack@n-api.service[127041]: exception: Floating IP 172.25.9.130 is not associated with instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb. Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'c285fc05-0513-4e2e-b7d8-fb6d8466eefb', 'body': {'removeFloatingIp': {'address': '172.25.9.130'}}} Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.130 is not associated with instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb. Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:40.955903 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:40.957841 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:40.957841 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:40.957841 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:40.957841 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:40.957841 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.130 is not associated with instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb. Oct 29 02:50:40.957841 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:40.959337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Returning 409 to user: Floating IP 172.25.9.130 is not associated with instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:40.960391 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fc900faf-7a94-4044-8f28-60ff6b6bf10a tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "POST /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb/action" status: 409 len: 146 microversion: 2.1 time: 1.217126 Oct 29 02:50:40.961340 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 809/1562] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:39 2022] POST /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb/action => generated 146 bytes in 1218 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:50:40.967493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:40.970749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:40.983480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.986034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.986689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.989590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.990404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.991011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.115481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:41.128564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:41.132634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:41.149360 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fc4d6c7c-8c75-478f-80ee-c29082e17026 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.186615 Oct 29 02:50:41.162781 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 810/1563] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:40 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:41.183106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.130"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:41.374636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d28a92c8-d8d2-4c3c-9eb0-a7431d7b7981 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:41.384842 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d28a92c8-d8d2-4c3c-9eb0-a7431d7b7981 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1325 microversion: 2.1 time: 0.619824 Oct 29 02:50:41.387747 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 754/1564] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:40 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1325 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:41.401209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac7db225-b16c-4f73-8a90-c50640edbdad tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:41.401209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ac7db225-b16c-4f73-8a90-c50640edbdad tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:41.433374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7db225-b16c-4f73-8a90-c50640edbdad tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.437635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7db225-b16c-4f73-8a90-c50640edbdad tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.438140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7db225-b16c-4f73-8a90-c50640edbdad tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.438893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7db225-b16c-4f73-8a90-c50640edbdad tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.439357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7db225-b16c-4f73-8a90-c50640edbdad tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.439779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7db225-b16c-4f73-8a90-c50640edbdad tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.568210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:41.574452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.575200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.575813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.576709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.577941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.581086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.954800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ac7db225-b16c-4f73-8a90-c50640edbdad tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:41.967307 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ac7db225-b16c-4f73-8a90-c50640edbdad tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1471 microversion: 2.1 time: 0.576516 Oct 29 02:50:41.969448 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 755/1565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:41 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1471 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:41.991956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:41.992795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:42.007020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.007811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.008404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.009288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.009948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.010548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.101678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.102440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.103059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.103960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.104567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.105145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.160482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for project bb5aec15c4e844b2872c9eab52f69482. Resources: {'ram', 'cores'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:50:42.165355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for user efecedc77d3048c4a0ec0fe6701f9ccc and project bb5aec15c4e844b2872c9eab52f69482. Resources: {'ram', 'cores'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:50:42.376067 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e8963ce4-626f-485b-a5a9-4ab24c71265c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "POST /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e/action" status: 202 len: 0 microversion: 2.1 time: 0.388005 Oct 29 02:50:42.377310 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 756/1566] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:41 2022] POST /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:50:42.479165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4d069f14-8be6-44fd-85c5-3780873d1e26 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] Calling method '.version_select at 0x7fe1a8952e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:42.692458 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4d069f14-8be6-44fd-85c5-3780873d1e26 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.313581 Oct 29 02:50:42.693900 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 757/1567] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Oct 29 02:50:42 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:50:42.698923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:42.700245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:42.738153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.738665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.739108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.740309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.745735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.746217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.911893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "refresh_cache-9f222ce6-6c69-4a70-a003-3cc72186c175" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:50:42.912926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquired lock "refresh_cache-9f222ce6-6c69-4a70-a003-3cc72186c175" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:50:42.964392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:42.981689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:42.997004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:43.014136 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d1216ca-2f75-4167-b9ca-d0f4cefb6591 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.316848 Oct 29 02:50:43.015379 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 758/1568] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:42 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:43.030205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21368d4b-dda6-40a4-99f7-a90dc2ba5545 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:43.031102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-21368d4b-dda6-40a4-99f7-a90dc2ba5545 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:43.046773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21368d4b-dda6-40a4-99f7-a90dc2ba5545 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.049134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21368d4b-dda6-40a4-99f7-a90dc2ba5545 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.051065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21368d4b-dda6-40a4-99f7-a90dc2ba5545 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:43.052341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21368d4b-dda6-40a4-99f7-a90dc2ba5545 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.055918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21368d4b-dda6-40a4-99f7-a90dc2ba5545 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.056855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21368d4b-dda6-40a4-99f7-a90dc2ba5545 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:43.454125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-21368d4b-dda6-40a4-99f7-a90dc2ba5545 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:43.496829 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-21368d4b-dda6-40a4-99f7-a90dc2ba5545 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1470 microversion: 2.1 time: 0.476732 Oct 29 02:50:43.508697 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 759/1569] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:43 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1470 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:43.525390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7fb27438-4d52-4ded-822e-642b3472fba2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:43.528891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7fb27438-4d52-4ded-822e-642b3472fba2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:43.565451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fb27438-4d52-4ded-822e-642b3472fba2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.566516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fb27438-4d52-4ded-822e-642b3472fba2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.570708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fb27438-4d52-4ded-822e-642b3472fba2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:43.571721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fb27438-4d52-4ded-822e-642b3472fba2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.573957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fb27438-4d52-4ded-822e-642b3472fba2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.575163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fb27438-4d52-4ded-822e-642b3472fba2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:44.033628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7fb27438-4d52-4ded-822e-642b3472fba2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:44.046930 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7fb27438-4d52-4ded-822e-642b3472fba2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1523 microversion: 2.1 time: 0.541381 Oct 29 02:50:44.070757 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 760/1570] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:43 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1523 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:44.078644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c06e3e14-a6cf-4551-a4a4-8f475add27b9 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] Action: 'create', calling method: .version_select at 0x7fe1a8a0f1f0>, body: {"pool": "non_exist_pool"} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:44.279979 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c06e3e14-a6cf-4551-a4a4-8f475add27b9 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] HTTP exception thrown: Floating IP pool not found. Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c06e3e14-a6cf-4551-a4a4-8f475add27b9 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] Request method failure captured: Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 26 Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUBJSLIriTqL1VVcRXOiCKeluRpLGx39U54Qks1VBvAYkShykGc4mSaF2UaKs-Z3Vqpx7OX7H70uN-_O-7b711hiW0XysGnJ4sgc6j5ZrrP2uaF4Ye5YP7ZGnEViXDh04c6J1HLVEAS5FLcpjspXngzl9Kl9fdM9BSaknVqom1AksM Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 6179c6ca4a3a43f9985b4b1e4c30dc43 Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1740133164 Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:50:44.282120 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6179c6ca4a3a43f9985b4b1e4c30dc43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6179c6ca4a3a43f9985b4b1e4c30dc43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6179c6ca4a3a43f9985b4b1e4c30dc43", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6179c6ca4a3a43f9985b4b1e4c30dc43"}]}] Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1740133164 Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 6179c6ca4a3a43f9985b4b1e4c30dc43 Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1740133164 Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-FloatingIPsNegativeTestJSON-1740133164-project Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a72f924bb7cb4aa78f374ef96f6926ad Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1740133164-project Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: {"pool": "non_exist_pool"} Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: exception: Floating IP pool not found. Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 29 02:50:44.283902 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:44.285175 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c06e3e14-a6cf-4551-a4a4-8f475add27b9 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] Returning 404 to user: Floating IP pool not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:44.286829 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c06e3e14-a6cf-4551-a4a4-8f475add27b9 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.211444 Oct 29 02:50:44.288747 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 761/1571] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Oct 29 02:50:44 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:50:44.294500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:44.295352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:44.311373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:44.317440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:44.318197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:44.319362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:44.319986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:44.320579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:44.589772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:44.598262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:44.603629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:44.617313 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ce9c3682-ed55-4e3d-a91c-e57f2d1e8d70 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.327240 Oct 29 02:50:44.620857 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 762/1572] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:44 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:44.635621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-58de88e6-0bd3-4690-a9b3-fc985bd9558c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:44.637113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-58de88e6-0bd3-4690-a9b3-fc985bd9558c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:44.653766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58de88e6-0bd3-4690-a9b3-fc985bd9558c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:44.662240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58de88e6-0bd3-4690-a9b3-fc985bd9558c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:44.663037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58de88e6-0bd3-4690-a9b3-fc985bd9558c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:44.664009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58de88e6-0bd3-4690-a9b3-fc985bd9558c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:44.664678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58de88e6-0bd3-4690-a9b3-fc985bd9558c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:44.665310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58de88e6-0bd3-4690-a9b3-fc985bd9558c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:44.766807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Building network info cache for instance {{(pid=127041) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:50:44.834111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-58de88e6-0bd3-4690-a9b3-fc985bd9558c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:44.846420 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-58de88e6-0bd3-4690-a9b3-fc985bd9558c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1523 microversion: 2.1 time: 0.223140 Oct 29 02:50:44.848214 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 763/1573] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:44 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:44.854099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb4eb939-b643-421c-8cec-c89c8a8aed34 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] Calling method '.version_select at 0x7fe1a8a08c10>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:44.926192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG neutronclient.v2_0.client [None req-bb4eb939-b643-421c-8cec-c89c8a8aed34 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7 could not be found", "detail": ""}} {{(pid=127042) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:50:44.927271 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-bb4eb939-b643-421c-8cec-c89c8a8aed34 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] HTTP exception thrown: Floating IP not found for ID dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7 Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb4eb939-b643-421c-8cec-c89c8a8aed34 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] Request method failure captured: Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-floating-ips/dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7 HTTP/1.1 Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUBJSLIriTqL1VVcRXOiCKeluRpLGx39U54Qks1VBvAYkShykGc4mSaF2UaKs-Z3Vqpx7OX7H70uN-_O-7b711hiW0XysGnJ4sgc6j5ZrrP2uaF4Ye5YP7ZGnEViXDh04c6J1HLVEAS5FLcpjspXngzl9Kl9fdM9BSaknVqom1AksM Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 6179c6ca4a3a43f9985b4b1e4c30dc43 Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1740133164 Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:50:44.929347 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6179c6ca4a3a43f9985b4b1e4c30dc43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6179c6ca4a3a43f9985b4b1e4c30dc43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6179c6ca4a3a43f9985b4b1e4c30dc43", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6179c6ca4a3a43f9985b4b1e4c30dc43"}]}] Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1740133164 Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 6179c6ca4a3a43f9985b4b1e4c30dc43 Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1740133164 Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-FloatingIPsNegativeTestJSON-1740133164-project Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a72f924bb7cb4aa78f374ef96f6926ad Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1740133164-project Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: exception: Floating IP not found for ID dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7 Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7'} Oct 29 02:50:44.932634 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:50:44.933458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7 could not be found Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2fc78ba-2050-4e11-bf2c-dd22c2da2b82'] Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7. Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:44.934695 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7 Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:44.935983 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:44.937213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7 Oct 29 02:50:44.937213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:44.945425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb4eb939-b643-421c-8cec-c89c8a8aed34 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] Returning 404 to user: Floating IP not found for ID dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7 {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:44.946670 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb4eb939-b643-421c-8cec-c89c8a8aed34 tempest-FloatingIPsNegativeTestJSON-1740133164 tempest-FloatingIPsNegativeTestJSON-1740133164-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7" status: 404 len: 111 microversion: 2.1 time: 0.097232 Oct 29 02:50:44.947659 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 764/1574] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 02:50:44 2022] DELETE /compute/v2.1/os-floating-ips/dba46cda-2b82-4fb9-b4e3-a0378b4bb8e7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:44.958697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-edf96d4b-739a-4d21-9776-16f1b22a80f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:44.961104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-edf96d4b-739a-4d21-9776-16f1b22a80f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:44.992011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edf96d4b-739a-4d21-9776-16f1b22a80f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:44.998729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edf96d4b-739a-4d21-9776-16f1b22a80f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:44.999703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edf96d4b-739a-4d21-9776-16f1b22a80f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:45.000837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edf96d4b-739a-4d21-9776-16f1b22a80f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:45.001517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edf96d4b-739a-4d21-9776-16f1b22a80f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:45.002174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edf96d4b-739a-4d21-9776-16f1b22a80f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:45.605005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-edf96d4b-739a-4d21-9776-16f1b22a80f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:45.616877 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-edf96d4b-739a-4d21-9776-16f1b22a80f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1470 microversion: 2.1 time: 0.667681 Oct 29 02:50:45.617956 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 765/1575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:44 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1470 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:45.625091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d991f9be-2dd0-40f0-bac4-c6e67862215d req-560ac8d9-179e-40e5-b5bc-8faee7fda66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f222ce6-6c69-4a70-a003-3cc72186c175", "tag": "91d574ae-fd72-4533-a128-53170347b277"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:45.664216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d991f9be-2dd0-40f0-bac4-c6e67862215d req-560ac8d9-179e-40e5-b5bc-8faee7fda66a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:45.669732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d991f9be-2dd0-40f0-bac4-c6e67862215d req-560ac8d9-179e-40e5-b5bc-8faee7fda66a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:45.670526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d991f9be-2dd0-40f0-bac4-c6e67862215d req-560ac8d9-179e-40e5-b5bc-8faee7fda66a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:45.700685 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d991f9be-2dd0-40f0-bac4-c6e67862215d req-560ac8d9-179e-40e5-b5bc-8faee7fda66a service nova] Creating event network-changed:91d574ae-fd72-4533-a128-53170347b277 for instance 9f222ce6-6c69-4a70-a003-3cc72186c175 on n-h1-862964-4 Oct 29 02:50:45.722829 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d991f9be-2dd0-40f0-bac4-c6e67862215d req-560ac8d9-179e-40e5-b5bc-8faee7fda66a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104070 Oct 29 02:50:45.723559 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 766/1576] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:45.736447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ae5e2fc3-03d8-4558-b513-e2df835fd910 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-240562237", "metadata": {"": ""}}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ae5e2fc3-03d8-4558-b513-e2df835fd910 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action HTTP/1.1 Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 106 Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:50:45.748148 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-240562237", "metadata": {"": ""}}} Oct 29 02:50:45.749974 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c43db9b0-c693-48cf-9902-82d38e76ea04', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-240562237', 'metadata': {'': ''}}}} Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'': ''} Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:45.750963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:45.752628 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:45.754239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:45.754239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:45.754239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:50:45.754239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:50:45.754239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:50:45.754239 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:45.761247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ae5e2fc3-03d8-4558-b513-e2df835fd910 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:45.762469 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ae5e2fc3-03d8-4558-b513-e2df835fd910 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action" status: 400 len: 170 microversion: 2.1 time: 0.037477 Oct 29 02:50:45.763248 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 767/1577] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Oct 29 02:50:45 2022] POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action => generated 170 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:50:45.772160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:45.798179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:45.829885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:45.838528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:45.839218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:45.846869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:45.852637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:45.856231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:46.079894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Updating instance_info_cache with network_info: [{"id": "91d574ae-fd72-4533-a128-53170347b277", "address": "fa:16:3e:24:68:33", "network": {"id": "7da6dbec-0aa3-4269-a738-63fa43633287", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-516312878-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "802d5fbb45b84622acf59c4046f26a8c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap91d574ae-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127041) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:50:46.118096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Releasing lock "refresh_cache-9f222ce6-6c69-4a70-a003-3cc72186c175" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:50:46.118977 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fe78bc0d-aa9d-4260-a389-7a8d1e2d1d81 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "POST /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175/action" status: 202 len: 0 microversion: 2.1 time: 4.954517 Oct 29 02:50:46.121056 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 811/1578] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:41 2022] POST /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175/action => generated 0 bytes in 4957 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:50:46.125910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-334bf84c-e2e5-4a92-a586-c3e598ea114a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:46.126528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-334bf84c-e2e5-4a92-a586-c3e598ea114a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:46.140016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:46.147738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-334bf84c-e2e5-4a92-a586-c3e598ea114a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:46.148473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-334bf84c-e2e5-4a92-a586-c3e598ea114a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:46.149102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-334bf84c-e2e5-4a92-a586-c3e598ea114a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:46.149620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:46.156166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:46.156516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-334bf84c-e2e5-4a92-a586-c3e598ea114a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:46.157966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-334bf84c-e2e5-4a92-a586-c3e598ea114a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:46.158789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-334bf84c-e2e5-4a92-a586-c3e598ea114a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:46.166361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:46.176305 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c135e85-d68b-44c0-814b-1494c1426162 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.407983 Oct 29 02:50:46.176944 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 768/1579] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:45 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:46.191824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-35768f4b-93fb-4333-941a-dbf9a95292c3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:46.192739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-35768f4b-93fb-4333-941a-dbf9a95292c3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:46.196626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:46.210053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35768f4b-93fb-4333-941a-dbf9a95292c3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:46.217568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35768f4b-93fb-4333-941a-dbf9a95292c3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:46.218070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35768f4b-93fb-4333-941a-dbf9a95292c3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:46.218786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35768f4b-93fb-4333-941a-dbf9a95292c3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:46.226672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35768f4b-93fb-4333-941a-dbf9a95292c3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:46.227844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35768f4b-93fb-4333-941a-dbf9a95292c3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:46.322502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-35768f4b-93fb-4333-941a-dbf9a95292c3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:50:46.514663 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-35768f4b-93fb-4333-941a-dbf9a95292c3 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 204 len: 0 microversion: 2.1 time: 0.333950 Oct 29 02:50:46.516044 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 769/1580] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:50:46 2022] DELETE /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:46.526691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.130"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:46.532723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:46.550346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:46.551211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:46.551916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:46.557568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:46.558076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:46.563133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:46.631841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:46.644283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "refresh_cache-c285fc05-0513-4e2e-b7d8-fb6d8466eefb" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:50:46.644422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquired lock "refresh_cache-c285fc05-0513-4e2e-b7d8-fb6d8466eefb" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:50:46.828472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-334bf84c-e2e5-4a92-a586-c3e598ea114a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:46.846514 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-334bf84c-e2e5-4a92-a586-c3e598ea114a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1523 microversion: 2.1 time: 0.724293 Oct 29 02:50:46.847645 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 812/1581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:46 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1523 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:46.853020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b5eea203-f8b1-4c99-aaae-213ffedc985d req-9240903a-dab0-4930-85cd-d4b0348778c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ce5a89-9c05-4459-9e6f-a94249149f0e", "name": "network-vif-plugged", "status": "completed", "tag": "55f158e4-c02f-4621-aef5-0df1f9eb6596"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:46.877237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b5eea203-f8b1-4c99-aaae-213ffedc985d req-9240903a-dab0-4930-85cd-d4b0348778c2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:46.878295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b5eea203-f8b1-4c99-aaae-213ffedc985d req-9240903a-dab0-4930-85cd-d4b0348778c2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:46.879055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b5eea203-f8b1-4c99-aaae-213ffedc985d req-9240903a-dab0-4930-85cd-d4b0348778c2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:46.912196 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b5eea203-f8b1-4c99-aaae-213ffedc985d req-9240903a-dab0-4930-85cd-d4b0348778c2 service nova] Creating event network-vif-plugged:55f158e4-c02f-4621-aef5-0df1f9eb6596 for instance 86ce5a89-9c05-4459-9e6f-a94249149f0e on n-h2-862964-4 Oct 29 02:50:46.928449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-b5eea203-f8b1-4c99-aaae-213ffedc985d req-9240903a-dab0-4930-85cd-d4b0348778c2 service nova] Instance 86ce5a89-9c05-4459-9e6f-a94249149f0e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:50:46.937229 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b5eea203-f8b1-4c99-aaae-213ffedc985d req-9240903a-dab0-4930-85cd-d4b0348778c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088084 Oct 29 02:50:46.939456 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 813/1582] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:46.947285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f171406d-b6bc-4ef5-9439-c54de252aa9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:46.948205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f171406d-b6bc-4ef5-9439-c54de252aa9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:46.956837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f171406d-b6bc-4ef5-9439-c54de252aa9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:46.957675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f171406d-b6bc-4ef5-9439-c54de252aa9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:46.959801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f171406d-b6bc-4ef5-9439-c54de252aa9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:46.961434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f171406d-b6bc-4ef5-9439-c54de252aa9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:46.962286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f171406d-b6bc-4ef5-9439-c54de252aa9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:46.963211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f171406d-b6bc-4ef5-9439-c54de252aa9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:47.351201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f171406d-b6bc-4ef5-9439-c54de252aa9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:47.369386 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f171406d-b6bc-4ef5-9439-c54de252aa9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1470 microversion: 2.1 time: 0.427357 Oct 29 02:50:47.382242 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 814/1583] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:46 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1470 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:47.389381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c0797ab8-e702-487e-9f00-c5ce9235d6f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:47.402728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c0797ab8-e702-487e-9f00-c5ce9235d6f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:47.422526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0797ab8-e702-487e-9f00-c5ce9235d6f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:47.423482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0797ab8-e702-487e-9f00-c5ce9235d6f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:47.424628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0797ab8-e702-487e-9f00-c5ce9235d6f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:47.426109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0797ab8-e702-487e-9f00-c5ce9235d6f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:47.427199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0797ab8-e702-487e-9f00-c5ce9235d6f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:47.437635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0797ab8-e702-487e-9f00-c5ce9235d6f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:47.958244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c0797ab8-e702-487e-9f00-c5ce9235d6f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:47.978877 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c0797ab8-e702-487e-9f00-c5ce9235d6f6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1523 microversion: 2.1 time: 0.594758 Oct 29 02:50:47.980133 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 815/1584] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:47 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1523 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:47.985153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:47.986119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:47.999188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:48.000023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:48.000693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:48.001965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:48.004590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:48.005356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:48.111440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:48.122834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:48.124591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:48.132638 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29287a03-2fd3-4318-b99a-a9adc1b993ca tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.151188 Oct 29 02:50:48.133738 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 816/1585] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:47 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:48.138460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e58b9939-1b50-4bb7-baa3-3f44a561479a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:48.139042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e58b9939-1b50-4bb7-baa3-3f44a561479a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:48.145250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e58b9939-1b50-4bb7-baa3-3f44a561479a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:48.146144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e58b9939-1b50-4bb7-baa3-3f44a561479a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:48.146774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e58b9939-1b50-4bb7-baa3-3f44a561479a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:48.147645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e58b9939-1b50-4bb7-baa3-3f44a561479a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:48.148299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e58b9939-1b50-4bb7-baa3-3f44a561479a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:48.148910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e58b9939-1b50-4bb7-baa3-3f44a561479a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:48.586724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-e58b9939-1b50-4bb7-baa3-3f44a561479a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid bce4caa1-3b78-4bcf-98e4-b4d9da71dfee {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:50:48.628383 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e58b9939-1b50-4bb7-baa3-3f44a561479a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 2343 microversion: 2.25 time: 0.493331 Oct 29 02:50:48.632870 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 817/1586] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:48 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 2343 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:48.638139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-23f29035-9b43-4bcc-a78c-aa50f13d8130 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:48.644387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-23f29035-9b43-4bcc-a78c-aa50f13d8130 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:48.664852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23f29035-9b43-4bcc-a78c-aa50f13d8130 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:48.667548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23f29035-9b43-4bcc-a78c-aa50f13d8130 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:48.668217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23f29035-9b43-4bcc-a78c-aa50f13d8130 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:48.670661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23f29035-9b43-4bcc-a78c-aa50f13d8130 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:48.673219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23f29035-9b43-4bcc-a78c-aa50f13d8130 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:48.674821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23f29035-9b43-4bcc-a78c-aa50f13d8130 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.209626 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-23f29035-9b43-4bcc-a78c-aa50f13d8130 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1810 microversion: 2.1 time: 0.575124 Oct 29 02:50:49.210559 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 818/1587] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:48 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1810 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:49.225410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f58f16c2-5265-4c83-a67e-d5b727280b0f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1242971337", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f58f16c2-5265-4c83-a67e-d5b727280b0f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action HTTP/1.1 Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 619 Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:50:49.240643 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:50:49.242219 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:50:49.242219 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:49.242219 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:50:49.242219 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:49.242219 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:50:49.242219 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:50:49.242219 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:50:49.242219 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:50:49.242219 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:50:49.242219 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:50:49.242878 n-d-862964-4 devstack@n-api.service[127041]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1242971337", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 29 02:50:49.242878 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:50:49.242878 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:50:49.243122 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'c43db9b0-c693-48cf-9902-82d38e76ea04', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1242971337', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 29 02:50:49.243122 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:49.243122 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:49.243122 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:50:49.243122 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:50:49.243122 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:50:49.243122 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:50:49.243122 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:50:49.243122 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:49.243122 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 29 02:50:49.243122 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:49.244009 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:49.245548 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:49.246481 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:49.246481 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:49.246481 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:50:49.246481 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:50:49.246481 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:50:49.246481 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:49.246955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f58f16c2-5265-4c83-a67e-d5b727280b0f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:49.246955 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f58f16c2-5265-4c83-a67e-d5b727280b0f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action" status: 400 len: 938 microversion: 2.1 time: 0.030713 Oct 29 02:50:49.247539 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 819/1588] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Oct 29 02:50:49 2022] POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action => generated 938 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:50:49.254081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a66e0500-d3e3-4db2-9e7c-906a0677ad12 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:49.254725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a66e0500-d3e3-4db2-9e7c-906a0677ad12 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:49.265382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a66e0500-d3e3-4db2-9e7c-906a0677ad12 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.265922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a66e0500-d3e3-4db2-9e7c-906a0677ad12 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.266380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a66e0500-d3e3-4db2-9e7c-906a0677ad12 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.267084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a66e0500-d3e3-4db2-9e7c-906a0677ad12 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.267531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a66e0500-d3e3-4db2-9e7c-906a0677ad12 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.267957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a66e0500-d3e3-4db2-9e7c-906a0677ad12 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.511369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a66e0500-d3e3-4db2-9e7c-906a0677ad12 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:49.520798 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a66e0500-d3e3-4db2-9e7c-906a0677ad12 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1536 microversion: 2.1 time: 0.272448 Oct 29 02:50:49.523002 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 820/1589] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:49 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1536 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:49.528280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3e4e5469-501e-43ea-9715-c40c48fe6124 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:49.533096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4e5469-501e-43ea-9715-c40c48fe6124 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.533885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4e5469-501e-43ea-9715-c40c48fe6124 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.534603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4e5469-501e-43ea-9715-c40c48fe6124 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.536460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4e5469-501e-43ea-9715-c40c48fe6124 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.537345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4e5469-501e-43ea-9715-c40c48fe6124 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.538016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4e5469-501e-43ea-9715-c40c48fe6124 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.591522 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3e4e5469-501e-43ea-9715-c40c48fe6124 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.067098 Oct 29 02:50:49.593408 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 821/1590] 10.222.0.16 () {60 vars in 1217 bytes} [Sat Oct 29 02:50:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:50:49.598926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:49.599890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:49.626362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.630819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.631784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.632757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.634449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.635272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.754070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:49.767319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:49.769603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:49.781618 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e53769cb-e96a-427f-85bd-42882c902611 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.186671 Oct 29 02:50:49.786998 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 822/1591] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:49 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:49.806472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dbb82109-4200-4ea9-9a89-93f1d17492a4 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:49.816879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbb82109-4200-4ea9-9a89-93f1d17492a4 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.817427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbb82109-4200-4ea9-9a89-93f1d17492a4 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.817874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbb82109-4200-4ea9-9a89-93f1d17492a4 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.818635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbb82109-4200-4ea9-9a89-93f1d17492a4 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.819075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbb82109-4200-4ea9-9a89-93f1d17492a4 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.823028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbb82109-4200-4ea9-9a89-93f1d17492a4 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.923327 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dbb82109-4200-4ea9-9a89-93f1d17492a4 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.134083 Oct 29 02:50:49.923973 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 823/1592] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Oct 29 02:50:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:49.931830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f855b498-1394-4c22-88ea-135a9a159eca tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:49.943195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f855b498-1394-4c22-88ea-135a9a159eca tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:49.960430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f855b498-1394-4c22-88ea-135a9a159eca tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.961778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f855b498-1394-4c22-88ea-135a9a159eca tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.962240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f855b498-1394-4c22-88ea-135a9a159eca tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.962943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f855b498-1394-4c22-88ea-135a9a159eca tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.963385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f855b498-1394-4c22-88ea-135a9a159eca tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.968290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f855b498-1394-4c22-88ea-135a9a159eca tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:50.395118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f855b498-1394-4c22-88ea-135a9a159eca tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:50.412322 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f855b498-1394-4c22-88ea-135a9a159eca tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1523 microversion: 2.1 time: 0.486821 Oct 29 02:50:50.413815 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 824/1593] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:49 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1523 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:50.442182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e996cab7-57bb-4b08-a4d2-8fc5f1891838 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:50.443017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e996cab7-57bb-4b08-a4d2-8fc5f1891838 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:50.460673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e996cab7-57bb-4b08-a4d2-8fc5f1891838 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:50.461384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e996cab7-57bb-4b08-a4d2-8fc5f1891838 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:50.475554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e996cab7-57bb-4b08-a4d2-8fc5f1891838 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:50.476473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e996cab7-57bb-4b08-a4d2-8fc5f1891838 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:50.477650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e996cab7-57bb-4b08-a4d2-8fc5f1891838 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:50.478102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e996cab7-57bb-4b08-a4d2-8fc5f1891838 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:50.744262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e996cab7-57bb-4b08-a4d2-8fc5f1891838 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:50.755050 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e996cab7-57bb-4b08-a4d2-8fc5f1891838 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1523 microversion: 2.1 time: 0.316106 Oct 29 02:50:50.756747 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 825/1594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:50 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:50.761708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-322d6e66-06f5-443d-9130-2721df053ad1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:50.762618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-322d6e66-06f5-443d-9130-2721df053ad1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:50.776025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-322d6e66-06f5-443d-9130-2721df053ad1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:50.776693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-322d6e66-06f5-443d-9130-2721df053ad1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:50.780343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-322d6e66-06f5-443d-9130-2721df053ad1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:50.781228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-322d6e66-06f5-443d-9130-2721df053ad1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:50.781864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-322d6e66-06f5-443d-9130-2721df053ad1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:50.782398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-322d6e66-06f5-443d-9130-2721df053ad1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:51.135527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-322d6e66-06f5-443d-9130-2721df053ad1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:51.152211 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-322d6e66-06f5-443d-9130-2721df053ad1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1536 microversion: 2.1 time: 0.394082 Oct 29 02:50:51.152804 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 826/1595] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:50 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1536 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:51.162702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1a757452-f3bf-4a18-ae88-6d70c6e603ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1a757452-f3bf-4a18-ae88-6d70c6e603ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action HTTP/1.1 Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 285 Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:50:51.178549 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:50:51.180292 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:50:51.180292 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:51.180292 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:50:51.180292 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:51.180292 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:50:51.180292 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:50:51.180292 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:50:51.180292 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:50:51.180292 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:50:51.180292 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:50:51.180292 n-d-862964-4 devstack@n-api.service[127041]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 02:50:51.181145 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:50:51.181145 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:50:51.181145 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'c43db9b0-c693-48cf-9902-82d38e76ea04', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 02:50:51.181145 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:51.181145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:51.181145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:50:51.181145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:50:51.181145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:50:51.181145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:50:51.181145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:50:51.181981 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:50:51.189672 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:50:51.190683 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:50:51.190683 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:50:51.190683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1a757452-f3bf-4a18-ae88-6d70c6e603ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:51.190683 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1a757452-f3bf-4a18-ae88-6d70c6e603ae tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action" status: 400 len: 619 microversion: 2.1 time: 0.021386 Oct 29 02:50:51.191045 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 827/1596] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Oct 29 02:50:51 2022] POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:50:51.191045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:51.191389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:51.215618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:51.216418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:51.217030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:51.221094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:51.221884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:51.228096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:51.460426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:51.473530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:51.482603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:51.502635 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c914647-d813-4ee9-bd1f-99d3ad71a8c6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.318196 Oct 29 02:50:51.503228 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 828/1597] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:51 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:51.532248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5f21009-a070-4f83-9659-ef659dd6cda1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:51.532860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f5f21009-a070-4f83-9659-ef659dd6cda1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:51.547263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5f21009-a070-4f83-9659-ef659dd6cda1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:51.553864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5f21009-a070-4f83-9659-ef659dd6cda1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:51.554576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5f21009-a070-4f83-9659-ef659dd6cda1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:51.557939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5f21009-a070-4f83-9659-ef659dd6cda1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:51.559186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5f21009-a070-4f83-9659-ef659dd6cda1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:51.559922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5f21009-a070-4f83-9659-ef659dd6cda1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:52.082666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f5f21009-a070-4f83-9659-ef659dd6cda1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:52.096494 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5f21009-a070-4f83-9659-ef659dd6cda1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1523 microversion: 2.1 time: 0.570261 Oct 29 02:50:52.112628 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 829/1598] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:51 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1523 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:52.112628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-39d728b4-cb5d-4185-93dc-741d76c7701e req-adebd414-8d76-4693-80ff-823b6d26d319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ce5a89-9c05-4459-9e6f-a94249149f0e", "name": "network-vif-unplugged", "status": "completed", "tag": "55f158e4-c02f-4621-aef5-0df1f9eb6596"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:52.128592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:52.148852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-39d728b4-cb5d-4185-93dc-741d76c7701e req-adebd414-8d76-4693-80ff-823b6d26d319 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:52.149477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-39d728b4-cb5d-4185-93dc-741d76c7701e req-adebd414-8d76-4693-80ff-823b6d26d319 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:52.149945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-39d728b4-cb5d-4185-93dc-741d76c7701e req-adebd414-8d76-4693-80ff-823b6d26d319 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:52.192911 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-39d728b4-cb5d-4185-93dc-741d76c7701e req-adebd414-8d76-4693-80ff-823b6d26d319 service nova] Creating event network-vif-unplugged:55f158e4-c02f-4621-aef5-0df1f9eb6596 for instance 86ce5a89-9c05-4459-9e6f-a94249149f0e on n-h2-862964-4 Oct 29 02:50:52.204359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-39d728b4-cb5d-4185-93dc-741d76c7701e req-adebd414-8d76-4693-80ff-823b6d26d319 service nova] Instance 86ce5a89-9c05-4459-9e6f-a94249149f0e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:50:52.214757 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-39d728b4-cb5d-4185-93dc-741d76c7701e req-adebd414-8d76-4693-80ff-823b6d26d319 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115229 Oct 29 02:50:52.216021 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 830/1599] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:52.221840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-439da946-6ffe-4582-be72-cba6e6f549df tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:52.222903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-439da946-6ffe-4582-be72-cba6e6f549df tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:52.230847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-439da946-6ffe-4582-be72-cba6e6f549df tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:52.231889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-439da946-6ffe-4582-be72-cba6e6f549df tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:52.232605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-439da946-6ffe-4582-be72-cba6e6f549df tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:52.233590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-439da946-6ffe-4582-be72-cba6e6f549df tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:52.234817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-439da946-6ffe-4582-be72-cba6e6f549df tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:52.235478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-439da946-6ffe-4582-be72-cba6e6f549df tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:52.860549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-439da946-6ffe-4582-be72-cba6e6f549df tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:52.870062 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-439da946-6ffe-4582-be72-cba6e6f549df tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1523 microversion: 2.1 time: 0.652419 Oct 29 02:50:52.874564 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 831/1600] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:52 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1523 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:52.885268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d1bc47ef-e16f-4529-89c2-f4d28c294100 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:52.887473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d1bc47ef-e16f-4529-89c2-f4d28c294100 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:52.900776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1bc47ef-e16f-4529-89c2-f4d28c294100 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:52.901535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1bc47ef-e16f-4529-89c2-f4d28c294100 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:52.903603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1bc47ef-e16f-4529-89c2-f4d28c294100 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:52.905757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1bc47ef-e16f-4529-89c2-f4d28c294100 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:52.907040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1bc47ef-e16f-4529-89c2-f4d28c294100 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:52.908118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1bc47ef-e16f-4529-89c2-f4d28c294100 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:53.399971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d1bc47ef-e16f-4529-89c2-f4d28c294100 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:53.405218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:53.425004 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d1bc47ef-e16f-4529-89c2-f4d28c294100 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1536 microversion: 2.1 time: 0.542776 Oct 29 02:50:53.439791 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 832/1601] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:52 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1536 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:53.458018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44fd9c87-930b-4332-a016-6048070232ed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e586232f-b0af-4d14-8e55-2dca13cb8629", "device": "/dev/xvdb"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:53.469058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-44fd9c87-930b-4332-a016-6048070232ed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:53.483080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44fd9c87-930b-4332-a016-6048070232ed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:53.485635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44fd9c87-930b-4332-a016-6048070232ed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:53.487683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44fd9c87-930b-4332-a016-6048070232ed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:53.490192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44fd9c87-930b-4332-a016-6048070232ed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:53.492205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44fd9c87-930b-4332-a016-6048070232ed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:53.492880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44fd9c87-930b-4332-a016-6048070232ed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:53.539792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Building network info cache for instance {{(pid=127042) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:50:54.422182 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-44fd9c87-930b-4332-a016-6048070232ed tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "POST /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.979592 Oct 29 02:50:54.434100 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 833/1602] 10.222.0.16 () {62 vars in 1364 bytes} [Sat Oct 29 02:50:53 2022] POST /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:50:54.446082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:54.447038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:54.465094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:54.466796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:54.467286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:54.469103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:54.470107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:54.472094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:54.992672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:55.002450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:55.016861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:55.042178 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d0a0b952-4de5-422a-82f9-2ebbb4b697bf tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.600581 Oct 29 02:50:55.047780 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 834/1603] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:54 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:55.065373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50f0ac9a-6c5b-40c0-9f85-fd529124ff04 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ed00420-ca6c-4cbc-a65b-7f8bfb4c26ca", "device": "/dev/xvdb"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:55.068862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-50f0ac9a-6c5b-40c0-9f85-fd529124ff04 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:55.095516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f0ac9a-6c5b-40c0-9f85-fd529124ff04 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:55.103852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f0ac9a-6c5b-40c0-9f85-fd529124ff04 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:55.105437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f0ac9a-6c5b-40c0-9f85-fd529124ff04 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:55.116328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f0ac9a-6c5b-40c0-9f85-fd529124ff04 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:55.122835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f0ac9a-6c5b-40c0-9f85-fd529124ff04 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:55.126666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f0ac9a-6c5b-40c0-9f85-fd529124ff04 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:55.700018 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50f0ac9a-6c5b-40c0-9f85-fd529124ff04 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "POST /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.650502 Oct 29 02:50:55.714897 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 835/1604] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 02:50:55 2022] POST /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:55.750590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7994bbec-7427-4f16-9707-e403f65e2a16 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2099179873"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:55.762281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7994bbec-7427-4f16-9707-e403f65e2a16 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:55.772263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:55.792017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7994bbec-7427-4f16-9707-e403f65e2a16 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:55.792509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7994bbec-7427-4f16-9707-e403f65e2a16 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:55.792940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7994bbec-7427-4f16-9707-e403f65e2a16 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:55.793652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7994bbec-7427-4f16-9707-e403f65e2a16 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:55.802814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7994bbec-7427-4f16-9707-e403f65e2a16 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:55.804364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7994bbec-7427-4f16-9707-e403f65e2a16 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:56.351521 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7994bbec-7427-4f16-9707-e403f65e2a16 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action" status: 202 len: 0 microversion: 2.1 time: 0.629506 Oct 29 02:50:56.362563 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 836/1605] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:55 2022] POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:50:56.540195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:56.588260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Updating instance_info_cache with network_info: [{"id": "d7867910-0a7e-4d66-8d87-fee7084736c6", "address": "fa:16:3e:78:9d:fc", "network": {"id": "7da6dbec-0aa3-4269-a738-63fa43633287", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-516312878-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "802d5fbb45b84622acf59c4046f26a8c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd7867910-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127042) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:50:56.623425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Releasing lock "refresh_cache-c285fc05-0513-4e2e-b7d8-fb6d8466eefb" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:50:56.627213 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-83d87bb6-49d3-4916-8ae1-c48ef6ea9b4c tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "POST /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb/action" status: 202 len: 0 microversion: 2.1 time: 10.102406 Oct 29 02:50:56.639365 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 770/1606] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:46 2022] POST /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb/action => generated 0 bytes in 10116 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:50:56.655333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f007824f-d935-45bd-8f1e-4b18d1c8ce6f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:56.656006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f007824f-d935-45bd-8f1e-4b18d1c8ce6f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:56.693762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f007824f-d935-45bd-8f1e-4b18d1c8ce6f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:56.694622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f007824f-d935-45bd-8f1e-4b18d1c8ce6f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:56.698437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f007824f-d935-45bd-8f1e-4b18d1c8ce6f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:56.699390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f007824f-d935-45bd-8f1e-4b18d1c8ce6f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:56.704367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f007824f-d935-45bd-8f1e-4b18d1c8ce6f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:56.707913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f007824f-d935-45bd-8f1e-4b18d1c8ce6f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:56.756699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-872d5a2f-3dab-4878-b498-fd1988e47ed6 req-207add26-4260-4764-8318-01a049e206b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f222ce6-6c69-4a70-a003-3cc72186c175", "name": "network-vif-deleted", "tag": "91d574ae-fd72-4533-a128-53170347b277"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:56.779883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-872d5a2f-3dab-4878-b498-fd1988e47ed6 req-207add26-4260-4764-8318-01a049e206b1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:56.782443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-872d5a2f-3dab-4878-b498-fd1988e47ed6 req-207add26-4260-4764-8318-01a049e206b1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:56.785042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-872d5a2f-3dab-4878-b498-fd1988e47ed6 req-207add26-4260-4764-8318-01a049e206b1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:56.810620 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-872d5a2f-3dab-4878-b498-fd1988e47ed6 req-207add26-4260-4764-8318-01a049e206b1 service nova] Creating event network-vif-deleted:91d574ae-fd72-4533-a128-53170347b277 for instance 9f222ce6-6c69-4a70-a003-3cc72186c175 on n-h1-862964-4 Oct 29 02:50:56.828197 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-872d5a2f-3dab-4878-b498-fd1988e47ed6 req-207add26-4260-4764-8318-01a049e206b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463133 Oct 29 02:50:56.832219 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 837/1607] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:56.846841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:56.849608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:56.866493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:56.867271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:56.871627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:56.872556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:56.873250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:56.873877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:57.079254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f007824f-d935-45bd-8f1e-4b18d1c8ce6f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:57.093943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f007824f-d935-45bd-8f1e-4b18d1c8ce6f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1529 microversion: 2.1 time: 0.452922 Oct 29 02:50:57.094630 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 771/1608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:56 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1529 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:57.109452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-299181022"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:57.112442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:57.127913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:57.128416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:57.128926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:57.129907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:57.130346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:57.130769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:57.215148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:57.216105 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] HTTP exception thrown: Cannot 'createImage' instance c43db9b0-c693-48cf-9902-82d38e76ea04 while it is in task_state image_snapshot Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action HTTP/1.1 Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 84 Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:50:57.220300 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-299181022"}} Oct 29 02:50:57.222078 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: exception: Cannot 'createImage' instance c43db9b0-c693-48cf-9902-82d38e76ea04 while it is in task_state image_snapshot Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c43db9b0-c693-48cf-9902-82d38e76ea04', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-299181022'}}} Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:57.223023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance c43db9b0-c693-48cf-9902-82d38e76ea04 while it is in task_state image_snapshot Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance c43db9b0-c693-48cf-9902-82d38e76ea04 while it is in task_state image_snapshot Oct 29 02:50:57.225345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:50:57.228328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:57.231374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 409 to user: Cannot 'createImage' instance c43db9b0-c693-48cf-9902-82d38e76ea04 while it is in task_state image_snapshot {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:57.232639 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-94f86b3b-9b49-4586-a3e8-03b7e0dc6465 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action" status: 409 len: 159 microversion: 2.1 time: 0.136730 Oct 29 02:50:57.234489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:57.234968 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 772/1609] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:57 2022] POST /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04/action => generated 159 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:50:57.245720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e062ed46-92cc-4528-8abe-8c0963dd2620 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '.version_select at 0x7fe1a8aa3790>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:57.248346 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9c4fdd9c-84bf-4f62-b2fd-ad80e5d86c17 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.414396 Oct 29 02:50:57.256491 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 838/1610] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:56 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:57.261610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0a942802-060b-4168-a525-c4d95bf7f713 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:57.264263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0a942802-060b-4168-a525-c4d95bf7f713 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:57.277164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a942802-060b-4168-a525-c4d95bf7f713 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:57.280313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a942802-060b-4168-a525-c4d95bf7f713 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:57.280916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a942802-060b-4168-a525-c4d95bf7f713 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:57.281846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a942802-060b-4168-a525-c4d95bf7f713 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:57.286448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a942802-060b-4168-a525-c4d95bf7f713 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:57.287121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a942802-060b-4168-a525-c4d95bf7f713 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:57.720295 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e062ed46-92cc-4528-8abe-8c0963dd2620 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/7d259813-4190-4375-8365-279c291f5cbc" status: 200 len: 184 microversion: 2.1 time: 0.483993 Oct 29 02:50:57.721118 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 773/1611] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 02:50:57 2022] GET /compute/v2.1/os-floating-ips/7d259813-4190-4375-8365-279c291f5cbc => generated 184 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:57.736237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6feb3295-ec5c-4b0d-ad16-c31578dacd3b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '.version_select at 0x7fe1a8ac19d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:58.013744 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6feb3295-ec5c-4b0d-ad16-c31578dacd3b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "DELETE /compute/v2.1/images/8aea666a-f39b-40dc-a176-4a648f8aab6f" status: 204 len: 0 microversion: 2.1 time: 0.283498 Oct 29 02:50:58.016188 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 774/1612] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:57 2022] DELETE /compute/v2.1/images/8aea666a-f39b-40dc-a176-4a648f8aab6f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:58.021534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Action: 'action', calling method: .version_select at 0x7fe1aa677c10>, body: {"removeFloatingIp": {"address": "172.25.9.130"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:58.292746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:58.301843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:58.302329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:58.302806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:58.303529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:58.308812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:58.310521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:58.459555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0a942802-060b-4168-a525-c4d95bf7f713 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:58.470206 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0a942802-060b-4168-a525-c4d95bf7f713 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1529 microversion: 2.1 time: 1.212250 Oct 29 02:50:58.473552 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 839/1613] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:57 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1529 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:58.481410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b68534cb-cf08-4e7b-8af9-2417d0ddf33d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:58.482944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b68534cb-cf08-4e7b-8af9-2417d0ddf33d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:58.510028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b68534cb-cf08-4e7b-8af9-2417d0ddf33d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:58.510522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b68534cb-cf08-4e7b-8af9-2417d0ddf33d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:58.510953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b68534cb-cf08-4e7b-8af9-2417d0ddf33d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:58.511674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b68534cb-cf08-4e7b-8af9-2417d0ddf33d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:58.512116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b68534cb-cf08-4e7b-8af9-2417d0ddf33d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:58.518712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b68534cb-cf08-4e7b-8af9-2417d0ddf33d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:58.648625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "refresh_cache-c285fc05-0513-4e2e-b7d8-fb6d8466eefb" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:50:58.649179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquired lock "refresh_cache-c285fc05-0513-4e2e-b7d8-fb6d8466eefb" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:50:59.502139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b68534cb-cf08-4e7b-8af9-2417d0ddf33d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:59.514432 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b68534cb-cf08-4e7b-8af9-2417d0ddf33d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1541 microversion: 2.1 time: 1.039201 Oct 29 02:50:59.515418 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 840/1614] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:58 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1541 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:59.527179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:59.528019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:59.547678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:59.548329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:59.548807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:59.549618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:59.550106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:59.550536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:59.832314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:00.378783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Building network info cache for instance {{(pid=127042) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:51:00.411989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:00.423426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:00.424888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:00.452033 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8c773113-d149-48cb-8809-85105bb507a6 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.933322 Oct 29 02:51:00.472653 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 841/1615] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:59 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:00.484689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af3e9fa9-a17d-40e8-9a14-3a5f6fc9176e tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:00.515049 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-af3e9fa9-a17d-40e8-9a14-3a5f6fc9176e tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] HTTP exception thrown: Flavor ed145074-692f-45c8-91b5-a9951c6dac1a could not be found. Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af3e9fa9-a17d-40e8-9a14-3a5f6fc9176e tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Request method failure captured: Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/flavors/ed145074-692f-45c8-91b5-a9951c6dac1a HTTP/1.1 Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJP_7vhD0BgjAqkgP-rPzxYAXJGeyIW2VgjFNPzF6pdOCZrq1vRwSqvLxK8AmlairxgWVLn9C1ZKsWt7jaTpsASWpkGavbDTt6ufyiF1Y5LDE2NG3vRJDftfTmfNKSOPdQ68LH8b0yX4Dxorp5MrbbDkbO5I1xtEq0oh-uYyMr9QJeU Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 07f22d73ce564906bfcb14f79df2912e Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-MigrationsAdminTest-923670634 Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:51:00.523092 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/07f22d73ce564906bfcb14f79df2912e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f22d73ce564906bfcb14f79df2912e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_07f22d73ce564906bfcb14f79df2912e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f22d73ce564906bfcb14f79df2912e"}]}] Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-MigrationsAdminTest-923670634 Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 07f22d73ce564906bfcb14f79df2912e Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-MigrationsAdminTest-923670634 Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-MigrationsAdminTest-923670634-project-admin Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 13849b751a7141e9900d3999a3693b38 Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-MigrationsAdminTest-923670634-project-admin Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: exception: Flavor ed145074-692f-45c8-91b5-a9951c6dac1a could not be found. Oct 29 02:51:00.524587 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'ed145074-692f-45c8-91b5-a9951c6dac1a'} Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ed145074-692f-45c8-91b5-a9951c6dac1a could not be found. Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:00.525390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor ed145074-692f-45c8-91b5-a9951c6dac1a could not be found. Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ed145074-692f-45c8-91b5-a9951c6dac1a could not be found. Oct 29 02:51:00.526699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:00.530027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af3e9fa9-a17d-40e8-9a14-3a5f6fc9176e tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Returning 404 to user: Flavor ed145074-692f-45c8-91b5-a9951c6dac1a could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:00.531162 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af3e9fa9-a17d-40e8-9a14-3a5f6fc9176e tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/ed145074-692f-45c8-91b5-a9951c6dac1a" status: 404 len: 109 microversion: 2.1 time: 0.057332 Oct 29 02:51:00.574825 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 842/1616] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:00 2022] DELETE /compute/v2.1/flavors/ed145074-692f-45c8-91b5-a9951c6dac1a => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:00.586822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-fdb0f14e-ccf9-40a4-bbc7-ed6de8f5237a req-5be58a90-d918-433f-92fd-0c251b8e1a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c285fc05-0513-4e2e-b7d8-fb6d8466eefb", "tag": "d7867910-0a7e-4d66-8d87-fee7084736c6"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:00.653967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fdb0f14e-ccf9-40a4-bbc7-ed6de8f5237a req-5be58a90-d918-433f-92fd-0c251b8e1a46 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:00.654492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fdb0f14e-ccf9-40a4-bbc7-ed6de8f5237a req-5be58a90-d918-433f-92fd-0c251b8e1a46 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:00.654930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fdb0f14e-ccf9-40a4-bbc7-ed6de8f5237a req-5be58a90-d918-433f-92fd-0c251b8e1a46 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:00.687822 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-fdb0f14e-ccf9-40a4-bbc7-ed6de8f5237a req-5be58a90-d918-433f-92fd-0c251b8e1a46 service nova] Creating event network-changed:d7867910-0a7e-4d66-8d87-fee7084736c6 for instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb on n-h1-862964-4 Oct 29 02:51:00.693598 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-fdb0f14e-ccf9-40a4-bbc7-ed6de8f5237a req-5be58a90-d918-433f-92fd-0c251b8e1a46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116975 Oct 29 02:51:00.694744 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 843/1617] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:00.701111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e3307cc2-5abb-4a3d-a06a-35144db7e96e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:00.702053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e3307cc2-5abb-4a3d-a06a-35144db7e96e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:00.709326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3307cc2-5abb-4a3d-a06a-35144db7e96e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:00.710109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3307cc2-5abb-4a3d-a06a-35144db7e96e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:00.711711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3307cc2-5abb-4a3d-a06a-35144db7e96e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:00.712647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3307cc2-5abb-4a3d-a06a-35144db7e96e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:00.713270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3307cc2-5abb-4a3d-a06a-35144db7e96e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:00.713921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3307cc2-5abb-4a3d-a06a-35144db7e96e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:01.236223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e3307cc2-5abb-4a3d-a06a-35144db7e96e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:01.245481 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e3307cc2-5abb-4a3d-a06a-35144db7e96e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1541 microversion: 2.1 time: 0.548974 Oct 29 02:51:01.266488 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 844/1618] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:00 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1541 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:01.292261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-261383811", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:01.431110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:51:02.337967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:51:02.339315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:51:02.340275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:51:02.340889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:51:02.341768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:51:02.358185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:02.360784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:02.361598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:02.364563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:02.365997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:02.367253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:02.444635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for project bb5aec15c4e844b2872c9eab52f69482. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:51:02.451275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Getting quotas for user efecedc77d3048c4a0ec0fe6701f9ccc and project bb5aec15c4e844b2872c9eab52f69482. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:51:02.464666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:51:02.468091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:51:02.550582 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cd22490c-befc-44bc-ad1b-bac8394abcd6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.282627 Oct 29 02:51:02.551717 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 845/1619] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:51:02.565451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:02.566382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:02.573793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:02.574639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:02.576376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:02.578208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:02.578971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:02.581722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:02.793387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:02.812130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:02.813540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:02.844977 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b30327dc-fab9-4b8e-8273-f0e9d36a2dd7 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.288649 Oct 29 02:51:02.851082 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 846/1620] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:02 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:03.033748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Updating instance_info_cache with network_info: [{"id": "d7867910-0a7e-4d66-8d87-fee7084736c6", "address": "fa:16:3e:78:9d:fc", "network": {"id": "7da6dbec-0aa3-4269-a738-63fa43633287", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-516312878-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "802d5fbb45b84622acf59c4046f26a8c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd7867910-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127042) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:51:03.049024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Releasing lock "refresh_cache-c285fc05-0513-4e2e-b7d8-fb6d8466eefb" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:51:03.054066 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5c159172-ffae-403f-87e1-1cf7ed459be1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "POST /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb/action" status: 202 len: 0 microversion: 2.1 time: 5.036910 Oct 29 02:51:03.055038 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 775/1621] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:58 2022] POST /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb/action => generated 0 bytes in 5039 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:51:03.079858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e13304f2-34ef-4c37-ac35-ece2d47eaa29 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:03.081876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e13304f2-34ef-4c37-ac35-ece2d47eaa29 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:03.110552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e13304f2-34ef-4c37-ac35-ece2d47eaa29 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.118775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e13304f2-34ef-4c37-ac35-ece2d47eaa29 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.121202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e13304f2-34ef-4c37-ac35-ece2d47eaa29 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.122432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e13304f2-34ef-4c37-ac35-ece2d47eaa29 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.123664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e13304f2-34ef-4c37-ac35-ece2d47eaa29 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.125260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e13304f2-34ef-4c37-ac35-ece2d47eaa29 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.237934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1a17c36d-572d-4c3b-9a8a-618e4cae5127 req-9123429e-51de-434d-8d60-9417c324126f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ce5a89-9c05-4459-9e6f-a94249149f0e", "name": "network-vif-plugged", "status": "completed", "tag": "55f158e4-c02f-4621-aef5-0df1f9eb6596"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:03.263359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a17c36d-572d-4c3b-9a8a-618e4cae5127 req-9123429e-51de-434d-8d60-9417c324126f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.263848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a17c36d-572d-4c3b-9a8a-618e4cae5127 req-9123429e-51de-434d-8d60-9417c324126f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.264274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a17c36d-572d-4c3b-9a8a-618e4cae5127 req-9123429e-51de-434d-8d60-9417c324126f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.305350 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1a17c36d-572d-4c3b-9a8a-618e4cae5127 req-9123429e-51de-434d-8d60-9417c324126f service nova] Creating event network-vif-plugged:55f158e4-c02f-4621-aef5-0df1f9eb6596 for instance 86ce5a89-9c05-4459-9e6f-a94249149f0e on n-h2-862964-4 Oct 29 02:51:03.323825 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1a17c36d-572d-4c3b-9a8a-618e4cae5127 req-9123429e-51de-434d-8d60-9417c324126f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.470271 Oct 29 02:51:03.326298 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 847/1622] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:03.339792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-045c665a-cbb3-4773-b9ef-d8b534cf1fce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:03.340468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-045c665a-cbb3-4773-b9ef-d8b534cf1fce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:03.543999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-045c665a-cbb3-4773-b9ef-d8b534cf1fce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:03.556941 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-045c665a-cbb3-4773-b9ef-d8b534cf1fce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1212 microversion: 2.1 time: 0.225498 Oct 29 02:51:03.565926 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 848/1623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:03 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1212 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:03.574019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-835fc6a0-643c-40ac-9f84-b5d5a9576568 req-a469d552-70a7-47b0-ac89-7c94788476c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c285fc05-0513-4e2e-b7d8-fb6d8466eefb", "tag": "d7867910-0a7e-4d66-8d87-fee7084736c6"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:03.609135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-835fc6a0-643c-40ac-9f84-b5d5a9576568 req-a469d552-70a7-47b0-ac89-7c94788476c5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.610363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-835fc6a0-643c-40ac-9f84-b5d5a9576568 req-a469d552-70a7-47b0-ac89-7c94788476c5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.622512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-835fc6a0-643c-40ac-9f84-b5d5a9576568 req-a469d552-70a7-47b0-ac89-7c94788476c5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.628175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e13304f2-34ef-4c37-ac35-ece2d47eaa29 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:03.637473 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e13304f2-34ef-4c37-ac35-ece2d47eaa29 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1523 microversion: 2.1 time: 0.577284 Oct 29 02:51:03.646649 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 776/1624] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:03 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1523 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:03.684389 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-835fc6a0-643c-40ac-9f84-b5d5a9576568 req-a469d552-70a7-47b0-ac89-7c94788476c5 service nova] Creating event network-changed:d7867910-0a7e-4d66-8d87-fee7084736c6 for instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb on n-h1-862964-4 Oct 29 02:51:03.687296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:03.687804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:03.706546 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-835fc6a0-643c-40ac-9f84-b5d5a9576568 req-a469d552-70a7-47b0-ac89-7c94788476c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138408 Oct 29 02:51:03.709311 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 849/1625] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:03.715778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.716320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.716710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.717431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.718039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.718325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.727635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-47b2cd20-6986-4a63-927a-9258b53d2fce tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:03.728034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-47b2cd20-6986-4a63-927a-9258b53d2fce tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:03.764803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47b2cd20-6986-4a63-927a-9258b53d2fce tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.765314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47b2cd20-6986-4a63-927a-9258b53d2fce tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.769470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47b2cd20-6986-4a63-927a-9258b53d2fce tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.770488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47b2cd20-6986-4a63-927a-9258b53d2fce tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.771270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47b2cd20-6986-4a63-927a-9258b53d2fce tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.771725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47b2cd20-6986-4a63-927a-9258b53d2fce tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.775404 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] HTTP exception thrown: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Request method failure captured: Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 HTTP/1.1 Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJTOp7vToc3md_9pATVCmWPm-PwEzAFF8PizNC9lnKfMTHWbFYjcKDq5B9arXPH0Mqph7xfs4KL3v5u3V2gRtij_mM673Lg7QVgvQBSl5hSmSPTAt8qf3KCsRgnLLkIuRD5o_NG8ypQTCbaODBP5vz-naXg-paNR-2j6qUieeTfbfbg Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 802d5fbb45b84622acf59c4046f26a8c Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:51:03.777013 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/802d5fbb45b84622acf59c4046f26a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/802d5fbb45b84622acf59c4046f26a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_802d5fbb45b84622acf59c4046f26a8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/802d5fbb45b84622acf59c4046f26a8c"}]}] Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 802d5fbb45b84622acf59c4046f26a8c Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-FloatingIPsAssociationTestJSON-1740756663-project Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: bba0b932c2af45c1a4e7fc5c185a64d1 Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1740756663-project Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. Oct 29 02:51:03.778426 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '9f222ce6-6c69-4a70-a003-3cc72186c175'} Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:03.779204 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. Oct 29 02:51:03.781174 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:03.783927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Returning 404 to user: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:03.786804 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7d4fc7ab-2d6d-44e3-bad0-7a3056cc9ac2 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 404 len: 111 microversion: 2.1 time: 0.135983 Oct 29 02:51:03.791645 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 777/1626] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:03 2022] DELETE /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:03.808856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:03.810280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: 9f222ce6-6c69-4a70-a003-3cc72186c175] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:03.826906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.827961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.830678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.831542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.832186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.832644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.861551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-47b2cd20-6986-4a63-927a-9258b53d2fce tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:51:03.874449 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] HTTP exception thrown: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Request method failure captured: Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 HTTP/1.1 Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJTOp7vToc3md_9pATVCmWPm-PwEzAFF8PizNC9lnKfMTHWbFYjcKDq5B9arXPH0Mqph7xfs4KL3v5u3V2gRtij_mM673Lg7QVgvQBSl5hSmSPTAt8qf3KCsRgnLLkIuRD5o_NG8ypQTCbaODBP5vz-naXg-paNR-2j6qUieeTfbfbg Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 802d5fbb45b84622acf59c4046f26a8c Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:51:03.880979 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/802d5fbb45b84622acf59c4046f26a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/802d5fbb45b84622acf59c4046f26a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_802d5fbb45b84622acf59c4046f26a8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/802d5fbb45b84622acf59c4046f26a8c"}]}] Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 802d5fbb45b84622acf59c4046f26a8c Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-FloatingIPsAssociationTestJSON-1740756663-project Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: bba0b932c2af45c1a4e7fc5c185a64d1 Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1740756663-project Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. Oct 29 02:51:03.883348 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '9f222ce6-6c69-4a70-a003-3cc72186c175'} Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:03.884445 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. Oct 29 02:51:03.885995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:03.888419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:03.891674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Returning 404 to user: Instance 9f222ce6-6c69-4a70-a003-3cc72186c175 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:03.891674 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d89fc5d1-1aee-4ac0-bc21-d878a26b86a1 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175" status: 404 len: 111 microversion: 2.1 time: 0.098340 Oct 29 02:51:03.895519 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 778/1627] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:03 2022] GET /compute/v2.1/servers/9f222ce6-6c69-4a70-a003-3cc72186c175 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:03.909538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:03.914909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:03.929671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.930626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.931572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.933578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.935076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.936809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:04.089109 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-47b2cd20-6986-4a63-927a-9258b53d2fce tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 204 len: 0 microversion: 2.1 time: 0.377679 Oct 29 02:51:04.091529 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 850/1628] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:03 2022] DELETE /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:51:04.098865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-853693f7-f40b-43ef-bce1-1015286d5782 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '.version_select at 0x7fe1acc273a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:05.094838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:05.145878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:05.147738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:05.157610 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9652b25e-44d3-4c60-8cd5-f810d92c4939 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 1.259481 Oct 29 02:51:05.158250 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 779/1629] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:03 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:05.168005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d9457a06-6587-430c-a8ac-27da2c51b17e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:05.168819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d9457a06-6587-430c-a8ac-27da2c51b17e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:05.204532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9457a06-6587-430c-a8ac-27da2c51b17e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:05.205024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9457a06-6587-430c-a8ac-27da2c51b17e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:05.205462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9457a06-6587-430c-a8ac-27da2c51b17e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:05.211700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9457a06-6587-430c-a8ac-27da2c51b17e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:05.212208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9457a06-6587-430c-a8ac-27da2c51b17e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:05.212651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9457a06-6587-430c-a8ac-27da2c51b17e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:05.840656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d9457a06-6587-430c-a8ac-27da2c51b17e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:05.850603 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d9457a06-6587-430c-a8ac-27da2c51b17e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1529 microversion: 2.1 time: 0.689836 Oct 29 02:51:05.851200 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 780/1630] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:05 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1529 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:05.902231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-699a5bc9-9864-4f66-8d2f-ae8f25ebabcb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:05.902793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-699a5bc9-9864-4f66-8d2f-ae8f25ebabcb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:05.944693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-699a5bc9-9864-4f66-8d2f-ae8f25ebabcb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:05.945727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-699a5bc9-9864-4f66-8d2f-ae8f25ebabcb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:05.946750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-699a5bc9-9864-4f66-8d2f-ae8f25ebabcb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:05.948903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-699a5bc9-9864-4f66-8d2f-ae8f25ebabcb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:05.950260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-699a5bc9-9864-4f66-8d2f-ae8f25ebabcb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:05.951957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-699a5bc9-9864-4f66-8d2f-ae8f25ebabcb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.122870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-699a5bc9-9864-4f66-8d2f-ae8f25ebabcb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:06.143152 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-699a5bc9-9864-4f66-8d2f-ae8f25ebabcb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1270 microversion: 2.1 time: 0.262423 Oct 29 02:51:06.143769 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 781/1631] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:05 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1270 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:06.172546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b7a2d997-6320-486d-b2ed-ca0132223312 req-d9e1a5fd-85a1-4a4f-9cd2-44da8dee9b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43db9b0-c693-48cf-9902-82d38e76ea04", "name": "network-vif-plugged", "status": "completed", "tag": "9d930331-7f7c-4409-8940-0255a051fdb9"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:06.218305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b7a2d997-6320-486d-b2ed-ca0132223312 req-d9e1a5fd-85a1-4a4f-9cd2-44da8dee9b62 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.219934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b7a2d997-6320-486d-b2ed-ca0132223312 req-d9e1a5fd-85a1-4a4f-9cd2-44da8dee9b62 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.221028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b7a2d997-6320-486d-b2ed-ca0132223312 req-d9e1a5fd-85a1-4a4f-9cd2-44da8dee9b62 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.262956 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b7a2d997-6320-486d-b2ed-ca0132223312 req-d9e1a5fd-85a1-4a4f-9cd2-44da8dee9b62 service nova] Creating event network-vif-plugged:9d930331-7f7c-4409-8940-0255a051fdb9 for instance c43db9b0-c693-48cf-9902-82d38e76ea04 on n-h2-862964-4 Oct 29 02:51:06.286972 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b7a2d997-6320-486d-b2ed-ca0132223312 req-d9e1a5fd-85a1-4a4f-9cd2-44da8dee9b62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134764 Oct 29 02:51:06.290094 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 782/1632] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:06.308931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:06.313296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:06.336956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.339961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.342694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.343678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.346530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.349151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.527552 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-853693f7-f40b-43ef-bce1-1015286d5782 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/7d259813-4190-4375-8365-279c291f5cbc" status: 202 len: 0 microversion: 2.1 time: 2.434358 Oct 29 02:51:06.528138 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 851/1633] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 02:51:04 2022] DELETE /compute/v2.1/os-floating-ips/7d259813-4190-4375-8365-279c291f5cbc => generated 0 bytes in 2436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:51:06.537992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-83bfe118-0099-4034-9b2a-a6493a43c0b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:06.539080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-83bfe118-0099-4034-9b2a-a6493a43c0b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:06.550506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83bfe118-0099-4034-9b2a-a6493a43c0b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.560865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83bfe118-0099-4034-9b2a-a6493a43c0b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.562120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83bfe118-0099-4034-9b2a-a6493a43c0b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.563106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83bfe118-0099-4034-9b2a-a6493a43c0b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.563754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83bfe118-0099-4034-9b2a-a6493a43c0b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.564363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83bfe118-0099-4034-9b2a-a6493a43c0b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.634583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-83bfe118-0099-4034-9b2a-a6493a43c0b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:51:06.815416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:06.829644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:06.833119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:06.856066 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-83bfe118-0099-4034-9b2a-a6493a43c0b5 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 204 len: 0 microversion: 2.1 time: 0.323198 Oct 29 02:51:06.859946 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 852/1634] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:06 2022] DELETE /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:51:06.862016 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d160903d-4827-491c-bc17-142e850ce053 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1555 microversion: 2.91 time: 0.570381 Oct 29 02:51:06.862866 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 783/1635] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:06 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1555 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:06.888054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bde9496f-aaa6-49dc-8620-12a0990f843a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:06.891647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f09417fc-ff3c-453e-8001-2cdf2e1d6d89 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:06.892373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f09417fc-ff3c-453e-8001-2cdf2e1d6d89 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:06.892492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bde9496f-aaa6-49dc-8620-12a0990f843a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:06.906196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bde9496f-aaa6-49dc-8620-12a0990f843a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.906931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bde9496f-aaa6-49dc-8620-12a0990f843a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.907600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bde9496f-aaa6-49dc-8620-12a0990f843a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.908528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bde9496f-aaa6-49dc-8620-12a0990f843a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.910681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bde9496f-aaa6-49dc-8620-12a0990f843a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.911370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bde9496f-aaa6-49dc-8620-12a0990f843a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.916673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f09417fc-ff3c-453e-8001-2cdf2e1d6d89 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.917166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f09417fc-ff3c-453e-8001-2cdf2e1d6d89 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.917604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f09417fc-ff3c-453e-8001-2cdf2e1d6d89 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.918362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f09417fc-ff3c-453e-8001-2cdf2e1d6d89 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.918810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f09417fc-ff3c-453e-8001-2cdf2e1d6d89 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.919231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f09417fc-ff3c-453e-8001-2cdf2e1d6d89 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:07.347287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f09417fc-ff3c-453e-8001-2cdf2e1d6d89 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:07.359977 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f09417fc-ff3c-453e-8001-2cdf2e1d6d89 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1523 microversion: 2.1 time: 0.498373 Oct 29 02:51:07.363391 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 853/1636] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:06 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1523 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:07.371362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e496458-3cad-4a7c-aa61-0eac5f50f747 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:07.376681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9e496458-3cad-4a7c-aa61-0eac5f50f747 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:07.408821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e496458-3cad-4a7c-aa61-0eac5f50f747 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:07.409613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e496458-3cad-4a7c-aa61-0eac5f50f747 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:07.410264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e496458-3cad-4a7c-aa61-0eac5f50f747 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:07.411565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e496458-3cad-4a7c-aa61-0eac5f50f747 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:07.412200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e496458-3cad-4a7c-aa61-0eac5f50f747 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:07.414419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e496458-3cad-4a7c-aa61-0eac5f50f747 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:07.573759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9e496458-3cad-4a7c-aa61-0eac5f50f747 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:07.589307 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9e496458-3cad-4a7c-aa61-0eac5f50f747 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1270 microversion: 2.1 time: 0.220192 Oct 29 02:51:07.600370 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 854/1637] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:07 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1270 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:07.734703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bde9496f-aaa6-49dc-8620-12a0990f843a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:07.754080 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bde9496f-aaa6-49dc-8620-12a0990f843a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1529 microversion: 2.1 time: 0.875313 Oct 29 02:51:07.757470 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 784/1638] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:06 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1529 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:07.897973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:07.898780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:07.912676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:07.913618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:07.916511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:07.917412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:07.919340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:07.920575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:08.054125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1949256182", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "db5f338b-a308-4166-9271-ad64e0e546be"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:08.184902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] validate_networks() for [('db5f338b-a308-4166-9271-ad64e0e546be', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:51:08.406092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:08.415142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:08.417013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:08.427823 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-58102896-45f9-4aa1-8002-b53afbc03e90 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1537 microversion: 2.91 time: 0.533936 Oct 29 02:51:08.429748 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 855/1639] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:07 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1537 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:08.438352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4e7651e5-7e64-41af-978c-818793046e70 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:08.439164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4e7651e5-7e64-41af-978c-818793046e70 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:08.450633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7651e5-7e64-41af-978c-818793046e70 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:08.455189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7651e5-7e64-41af-978c-818793046e70 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:08.458989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7651e5-7e64-41af-978c-818793046e70 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:08.460471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7651e5-7e64-41af-978c-818793046e70 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:08.464785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7651e5-7e64-41af-978c-818793046e70 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:08.465473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e7651e5-7e64-41af-978c-818793046e70 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:08.731561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4e7651e5-7e64-41af-978c-818793046e70 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:08.741973 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4e7651e5-7e64-41af-978c-818793046e70 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1523 microversion: 2.1 time: 0.310922 Oct 29 02:51:08.748301 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 856/1640] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:08 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:08.753621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7e89be03-5293-4a74-b6f0-77db5950e5c3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:08.758605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7e89be03-5293-4a74-b6f0-77db5950e5c3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:08.775659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e89be03-5293-4a74-b6f0-77db5950e5c3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:08.776444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e89be03-5293-4a74-b6f0-77db5950e5c3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:08.777103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e89be03-5293-4a74-b6f0-77db5950e5c3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:08.778154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e89be03-5293-4a74-b6f0-77db5950e5c3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:08.778769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e89be03-5293-4a74-b6f0-77db5950e5c3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:08.782110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e89be03-5293-4a74-b6f0-77db5950e5c3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:09.320424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7e89be03-5293-4a74-b6f0-77db5950e5c3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:09.342633 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7e89be03-5293-4a74-b6f0-77db5950e5c3 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1312 microversion: 2.1 time: 0.592102 Oct 29 02:51:09.343580 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 857/1641] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:08 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1312 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:09.360419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f67b687a-ca17-4c04-81d8-bd3ab04de680 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:09.361034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f67b687a-ca17-4c04-81d8-bd3ab04de680 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:09.384770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f67b687a-ca17-4c04-81d8-bd3ab04de680 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:09.385291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f67b687a-ca17-4c04-81d8-bd3ab04de680 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:09.385861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f67b687a-ca17-4c04-81d8-bd3ab04de680 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:09.387697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f67b687a-ca17-4c04-81d8-bd3ab04de680 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:09.388343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f67b687a-ca17-4c04-81d8-bd3ab04de680 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:09.388943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f67b687a-ca17-4c04-81d8-bd3ab04de680 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:09.585254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f67b687a-ca17-4c04-81d8-bd3ab04de680 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:09.594631 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f67b687a-ca17-4c04-81d8-bd3ab04de680 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1487 microversion: 2.1 time: 0.247783 Oct 29 02:51:09.615328 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 858/1642] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:09 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1487 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:09.620853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-7307c694-769e-4526-805d-60b5c9a0eb7b req-330b4862-d2b4-4bc0-8e44-d349e1f33aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43db9b0-c693-48cf-9902-82d38e76ea04", "name": "network-vif-deleted", "tag": "9d930331-7f7c-4409-8940-0255a051fdb9"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:09.631976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7307c694-769e-4526-805d-60b5c9a0eb7b req-330b4862-d2b4-4bc0-8e44-d349e1f33aac service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:09.634102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7307c694-769e-4526-805d-60b5c9a0eb7b req-330b4862-d2b4-4bc0-8e44-d349e1f33aac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:09.637261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7307c694-769e-4526-805d-60b5c9a0eb7b req-330b4862-d2b4-4bc0-8e44-d349e1f33aac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:09.655731 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-7307c694-769e-4526-805d-60b5c9a0eb7b req-330b4862-d2b4-4bc0-8e44-d349e1f33aac service nova] Creating event network-vif-deleted:9d930331-7f7c-4409-8940-0255a051fdb9 for instance c43db9b0-c693-48cf-9902-82d38e76ea04 on n-h2-862964-4 Oct 29 02:51:09.660915 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-7307c694-769e-4526-805d-60b5c9a0eb7b req-330b4862-d2b4-4bc0-8e44-d349e1f33aac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043849 Oct 29 02:51:09.661858 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 859/1643] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:09.667361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:09.668054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:09.676896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:09.677877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:09.678486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:09.679563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:09.680454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:09.681143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:09.844451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:09.860361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:09.862433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:09.874519 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7b5a67f4-b70e-433b-9593-971b9054bf5e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1537 microversion: 2.91 time: 0.211445 Oct 29 02:51:09.878557 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 860/1644] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:09 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:09.889819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4196ddbd-8983-4cae-b472-ade54369d9cf tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:09.891382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4196ddbd-8983-4cae-b472-ade54369d9cf tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:09.904273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4196ddbd-8983-4cae-b472-ade54369d9cf tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:09.918321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4196ddbd-8983-4cae-b472-ade54369d9cf tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:09.918835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4196ddbd-8983-4cae-b472-ade54369d9cf tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:09.919599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4196ddbd-8983-4cae-b472-ade54369d9cf tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:09.920067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4196ddbd-8983-4cae-b472-ade54369d9cf tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:09.920487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4196ddbd-8983-4cae-b472-ade54369d9cf tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:10.302287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4196ddbd-8983-4cae-b472-ade54369d9cf tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:10.320933 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4196ddbd-8983-4cae-b472-ade54369d9cf tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1523 microversion: 2.1 time: 0.435325 Oct 29 02:51:10.321854 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 861/1645] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:09 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:10.369655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5f512ab0-ffb2-4b68-b7d8-56b2d6604be8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:10.370633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5f512ab0-ffb2-4b68-b7d8-56b2d6604be8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:10.383471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f512ab0-ffb2-4b68-b7d8-56b2d6604be8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:10.384210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f512ab0-ffb2-4b68-b7d8-56b2d6604be8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:10.384823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f512ab0-ffb2-4b68-b7d8-56b2d6604be8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:10.387912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f512ab0-ffb2-4b68-b7d8-56b2d6604be8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:10.388569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f512ab0-ffb2-4b68-b7d8-56b2d6604be8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:10.389969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f512ab0-ffb2-4b68-b7d8-56b2d6604be8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:10.600572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:51:10.601132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:51:10.601446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:51:10.601949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:51:10.602999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:51:10.632157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:10.634811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:10.636451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:10.638756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:10.641947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:10.642852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:10.717663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Getting quotas for project a4b218a2276a4bb9acd9c1b0cfa3b5a8. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:51:10.739136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Getting quotas for user f0790d41f1d6452c92dc3d3dcc8d0af6 and project a4b218a2276a4bb9acd9c1b0cfa3b5a8. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:51:10.746904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5f512ab0-ffb2-4b68-b7d8-56b2d6604be8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:10.757583 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5f512ab0-ffb2-4b68-b7d8-56b2d6604be8 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1312 microversion: 2.1 time: 0.391682 Oct 29 02:51:10.776227 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 862/1646] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:10 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:10.788803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Going to run 2 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:51:10.791841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: adaae0cd-6343-48ec-a887-ef5001a172ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:51:10.810588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:10.812850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:10.834240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:10.836391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:10.836846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:10.838513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:10.840118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:10.854982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:10.881426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=adaae0cd-6343-48ec-a887-ef5001a172ad,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:51:11.064118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.064654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.067226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.070436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lazy-loading 'fault' on Instance uuid c43db9b0-c693-48cf-9902-82d38e76ea04 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:11.138979 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0689aa75-ed1b-4b05-a61b-f1509b234145 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.204356 Oct 29 02:51:11.145933 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 785/1647] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:51:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:51:11.165769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:11.173603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:11.200967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.213108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.218448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.220743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.225006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.226147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.285009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:11.297046 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e4efc71d-9f8d-439c-be7d-235e0b3c5ac5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 200 len: 1315 microversion: 2.1 time: 0.513107 Oct 29 02:51:11.315090 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 863/1648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:10 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:11.321605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d8d0e540-f7f5-46e2-a6e0-a376fcf05b2f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:11.328089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d8d0e540-f7f5-46e2-a6e0-a376fcf05b2f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:11.329044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d8d0e540-f7f5-46e2-a6e0-a376fcf05b2f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Searching by: {'deleted': False, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:51:11.348181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8d0e540-f7f5-46e2-a6e0-a376fcf05b2f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.348920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8d0e540-f7f5-46e2-a6e0-a376fcf05b2f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.349513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8d0e540-f7f5-46e2-a6e0-a376fcf05b2f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.350439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8d0e540-f7f5-46e2-a6e0-a376fcf05b2f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.351070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8d0e540-f7f5-46e2-a6e0-a376fcf05b2f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.351656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8d0e540-f7f5-46e2-a6e0-a376fcf05b2f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.486855 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d8d0e540-f7f5-46e2-a6e0-a376fcf05b2f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.169702 Oct 29 02:51:11.488942 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 864/1649] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 02:51:11 2022] GET /compute/v2.1/servers => generated 677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:11.515454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:11.525155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:11.526627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:11.540306 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e0e369d7-7677-417b-bcd5-fe50622e947e tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1540 microversion: 2.91 time: 0.393022 Oct 29 02:51:11.558415 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 786/1650] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:11 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1540 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:11.578714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:11.579886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:11.589244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.589739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.590207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.590923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.591378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.591812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.595397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4a1a3612-88f9-4029-af7c-9b268b3b1d7d req-85b9b9b0-149e-4ada-91cd-e73fc921fcac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c", "tag": "34c62a40-e8c0-42f4-a697-e6a0fc8540fb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:11.607752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4a1a3612-88f9-4029-af7c-9b268b3b1d7d req-85b9b9b0-149e-4ada-91cd-e73fc921fcac service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.608558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4a1a3612-88f9-4029-af7c-9b268b3b1d7d req-85b9b9b0-149e-4ada-91cd-e73fc921fcac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.609263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4a1a3612-88f9-4029-af7c-9b268b3b1d7d req-85b9b9b0-149e-4ada-91cd-e73fc921fcac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.626436 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4a1a3612-88f9-4029-af7c-9b268b3b1d7d req-85b9b9b0-149e-4ada-91cd-e73fc921fcac service nova] Creating event network-changed:34c62a40-e8c0-42f4-a697-e6a0fc8540fb for instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c on n-h1-862964-4 Oct 29 02:51:11.633251 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4a1a3612-88f9-4029-af7c-9b268b3b1d7d req-85b9b9b0-149e-4ada-91cd-e73fc921fcac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142841 Oct 29 02:51:11.634571 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 865/1651] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:11.643354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-340d6aef-0fa5-4649-b48f-8f3475ed68c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:11.645171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-340d6aef-0fa5-4649-b48f-8f3475ed68c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:11.676526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:11.705511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.706699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.707691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.709158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lazy-loading 'fault' on Instance uuid c285fc05-0513-4e2e-b7d8-fb6d8466eefb {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:11.784288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-340d6aef-0fa5-4649-b48f-8f3475ed68c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:11.794636 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-340d6aef-0fa5-4649-b48f-8f3475ed68c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1220 microversion: 2.1 time: 0.156663 Oct 29 02:51:11.802939 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 866/1652] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:11 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1220 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:11.811051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-64f4b505-8f34-446d-b6c0-54d7714db20c tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-862964-4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:11.813417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-64f4b505-8f34-446d-b6c0-54d7714db20c tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:11.841104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64f4b505-8f34-446d-b6c0-54d7714db20c tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.845864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64f4b505-8f34-446d-b6c0-54d7714db20c tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.846597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64f4b505-8f34-446d-b6c0-54d7714db20c tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.850019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64f4b505-8f34-446d-b6c0-54d7714db20c tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.850692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64f4b505-8f34-446d-b6c0-54d7714db20c tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.858430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64f4b505-8f34-446d-b6c0-54d7714db20c tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.901261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba0b932c2af45c1a4e7fc5c185a64d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802d5fbb45b84622acf59c4046f26a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:11.911588 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cbca097d-53a7-4b9b-9a01-26588708a3a9 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 200 len: 1312 microversion: 2.1 time: 0.351461 Oct 29 02:51:11.914612 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 787/1653] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:11 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:11.926222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2d6540ec-39fb-4e67-924f-485908341794 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:11.929588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2d6540ec-39fb-4e67-924f-485908341794 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:11.947510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d6540ec-39fb-4e67-924f-485908341794 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.949503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d6540ec-39fb-4e67-924f-485908341794 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.950440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d6540ec-39fb-4e67-924f-485908341794 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.952838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d6540ec-39fb-4e67-924f-485908341794 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.954711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d6540ec-39fb-4e67-924f-485908341794 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.955454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d6540ec-39fb-4e67-924f-485908341794 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:12.018761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:12.040147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-64f4b505-8f34-446d-b6c0-54d7714db20c tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-862964-4". {{(pid=127041) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 02:51:12.256235 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-64f4b505-8f34-446d-b6c0-54d7714db20c tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec/action" status: 202 len: 0 microversion: 2.91 time: 0.452034 Oct 29 02:51:12.256870 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 867/1654] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:51:11 2022] POST /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:51:12.274254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c5e330fc-f5d4-40a5-8031-aa7385ab9e4e req-0af9f03e-35f5-46e2-9822-c33b9897ade3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c285fc05-0513-4e2e-b7d8-fb6d8466eefb", "name": "network-vif-deleted", "tag": "d7867910-0a7e-4d66-8d87-fee7084736c6"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:12.296124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c5e330fc-f5d4-40a5-8031-aa7385ab9e4e req-0af9f03e-35f5-46e2-9822-c33b9897ade3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:12.296604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c5e330fc-f5d4-40a5-8031-aa7385ab9e4e req-0af9f03e-35f5-46e2-9822-c33b9897ade3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:12.297029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c5e330fc-f5d4-40a5-8031-aa7385ab9e4e req-0af9f03e-35f5-46e2-9822-c33b9897ade3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:12.323251 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c5e330fc-f5d4-40a5-8031-aa7385ab9e4e req-0af9f03e-35f5-46e2-9822-c33b9897ade3 service nova] Creating event network-vif-deleted:d7867910-0a7e-4d66-8d87-fee7084736c6 for instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb on n-h1-862964-4 Oct 29 02:51:12.334182 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c5e330fc-f5d4-40a5-8031-aa7385ab9e4e req-0af9f03e-35f5-46e2-9822-c33b9897ade3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076002 Oct 29 02:51:12.337010 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 868/1655] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:12.350624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:12.352454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:12.365775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:12.366319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:12.366756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:12.367527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:12.368008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:12.368449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:12.553495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:12.571913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:12.574907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d6540ec-39fb-4e67-924f-485908341794 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:12.575492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:12.583518 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2d6540ec-39fb-4e67-924f-485908341794 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1312 microversion: 2.1 time: 0.667629 Oct 29 02:51:12.595529 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-416bbe2e-e96a-4edf-9b89-2b0e88dc6349 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1548 microversion: 2.91 time: 0.255809 Oct 29 02:51:12.596382 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 788/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:11 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1312 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:12.598059 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 869/1657] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:12 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1548 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:12.616196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:12.617621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:12.640871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:12.642703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:12.643145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:12.643878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:12.644331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:12.644789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:12.701520 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] HTTP exception thrown: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 HTTP/1.1 Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:51:12.727504 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:51:12.729727 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c43db9b0-c693-48cf-9902-82d38e76ea04'} Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:12.730963 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:51:12.732525 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:12.733883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 404 to user: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:12.736053 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-abfad2a4-a46f-4fa2-a4fd-5dd5aceb92fc tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 404 len: 111 microversion: 2.1 time: 0.136565 Oct 29 02:51:12.736656 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 789/1658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:12 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:12.751621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cda48bab-593e-4953-a279-0d46f1b2fbb2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Action: 'create', calling method: .version_select at 0x7fe1acd05820>, body: {"keypair": {"name": "tempest-keypair-1908969686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2zTurD+SZTlDoXRHabxbQRS2oO3uJPyAXVluh9bjTSa7r4dS7tCfz491gXldhWYXG0yJkSiIW6UN34dsRtzK9U86ohT/Y9dec8BAsGRdEoQN+1rJ+/BlpCtvsybtwd3Q=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:12.795061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-cda48bab-593e-4953-a279-0d46f1b2fbb2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Getting quotas for project 0b30ce428766445d9d0d45f350ae1024. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:51:12.800013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-cda48bab-593e-4953-a279-0d46f1b2fbb2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Getting quotas for user 837f9940834e4eaeb31c967dba6d762f and project 0b30ce428766445d9d0d45f350ae1024. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:51:12.830250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5fbc5b27-85f4-4ee9-b9dc-c7fcecaa4a95 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:12.833484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5fbc5b27-85f4-4ee9-b9dc-c7fcecaa4a95 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:12.864441 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cda48bab-593e-4953-a279-0d46f1b2fbb2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119330 Oct 29 02:51:12.866253 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 870/1659] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:51:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:51:12.938843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:12.939939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] [instance: c285fc05-0513-4e2e-b7d8-fb6d8466eefb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:12.956602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:12.957131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:12.957608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:12.958387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:12.961564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:12.962160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:13.000207 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] HTTP exception thrown: Instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb could not be found. Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Request method failure captured: Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb HTTP/1.1 Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJTOp7vToc3md_9pATVCmWPm-PwEzAFF8PizNC9lnKfMTHWbFYjcKDq5B9arXPH0Mqph7xfs4KL3v5u3V2gRtij_mM673Lg7QVgvQBSl5hSmSPTAt8qf3KCsRgnLLkIuRD5o_NG8ypQTCbaODBP5vz-naXg-paNR-2j6qUieeTfbfbg Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 802d5fbb45b84622acf59c4046f26a8c Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:51:13.004651 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/802d5fbb45b84622acf59c4046f26a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/802d5fbb45b84622acf59c4046f26a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_802d5fbb45b84622acf59c4046f26a8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/802d5fbb45b84622acf59c4046f26a8c"}]}] Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 802d5fbb45b84622acf59c4046f26a8c Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1740756663 Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FloatingIPsAssociationTestJSON-1740756663-project Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: bba0b932c2af45c1a4e7fc5c185a64d1 Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1740756663-project Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb could not be found. Oct 29 02:51:13.006561 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'c285fc05-0513-4e2e-b7d8-fb6d8466eefb'} Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb could not be found. Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:13.007570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb could not be found. Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb could not be found. Oct 29 02:51:13.009100 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:13.022546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] Returning 404 to user: Instance c285fc05-0513-4e2e-b7d8-fb6d8466eefb could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:13.025449 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4afa2b12-c264-4722-819f-68459c444139 tempest-FloatingIPsAssociationTestJSON-1740756663 tempest-FloatingIPsAssociationTestJSON-1740756663-project] 10.222.0.16 "GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb" status: 404 len: 111 microversion: 2.1 time: 0.091074 Oct 29 02:51:13.029528 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 871/1660] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:12 2022] GET /compute/v2.1/servers/c285fc05-0513-4e2e-b7d8-fb6d8466eefb => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:13.110512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5fbc5b27-85f4-4ee9-b9dc-c7fcecaa4a95 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:13.155116 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5fbc5b27-85f4-4ee9-b9dc-c7fcecaa4a95 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1220 microversion: 2.1 time: 0.330339 Oct 29 02:51:13.158918 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 790/1661] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:12 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1220 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:13.640271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ae4cad11-2b79-40df-bb35-8b0e5513da44 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:13.640893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ae4cad11-2b79-40df-bb35-8b0e5513da44 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:13.648921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:13.658756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:13.683721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae4cad11-2b79-40df-bb35-8b0e5513da44 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:13.690607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:13.691117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:13.691360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae4cad11-2b79-40df-bb35-8b0e5513da44 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:13.691560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:13.692360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:13.692817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:13.693238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:13.693574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae4cad11-2b79-40df-bb35-8b0e5513da44 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:13.694497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae4cad11-2b79-40df-bb35-8b0e5513da44 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:13.701828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae4cad11-2b79-40df-bb35-8b0e5513da44 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:13.705480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae4cad11-2b79-40df-bb35-8b0e5513da44 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:13.718178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:13.977730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:13.990348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:14.001831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:14.021407 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-94e31deb-203e-4a81-bff4-ac345ff970e4 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1488 microversion: 2.91 time: 0.375418 Oct 29 02:51:14.022056 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 791/1662] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:13 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1488 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:14.183370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d4c9510d-8ceb-4df7-b1ca-c9a3f5ebb06a tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:14.184336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d4c9510d-8ceb-4df7-b1ca-c9a3f5ebb06a tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:14.203200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4c9510d-8ceb-4df7-b1ca-c9a3f5ebb06a tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:14.204300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4c9510d-8ceb-4df7-b1ca-c9a3f5ebb06a tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:14.205719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4c9510d-8ceb-4df7-b1ca-c9a3f5ebb06a tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:14.206517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4c9510d-8ceb-4df7-b1ca-c9a3f5ebb06a tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:14.210621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4c9510d-8ceb-4df7-b1ca-c9a3f5ebb06a tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:14.211135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4c9510d-8ceb-4df7-b1ca-c9a3f5ebb06a tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:14.212997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ae4cad11-2b79-40df-bb35-8b0e5513da44 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:14.222437 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ae4cad11-2b79-40df-bb35-8b0e5513da44 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1312 microversion: 2.1 time: 0.592412 Oct 29 02:51:14.238456 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 872/1663] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:13 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1312 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:14.451663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d4c9510d-8ceb-4df7-b1ca-c9a3f5ebb06a tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:14.466686 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d4c9510d-8ceb-4df7-b1ca-c9a3f5ebb06a tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1216 microversion: 2.1 time: 0.288562 Oct 29 02:51:14.467293 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 792/1664] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:14 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1216 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:15.053160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:15.053757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:15.064535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:15.072598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:15.072772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:15.073667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:15.074281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:15.075775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:15.230242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:15.248442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:15.250777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:15.254293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b9f32c13-929b-4943-b130-66722dc4e7fb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:15.256430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b9f32c13-929b-4943-b130-66722dc4e7fb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:15.258306 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5b88eeb4-202e-40ff-97ce-aa64fe886442 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.209309 Oct 29 02:51:15.259175 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 873/1665] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:15 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:15.284713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9f32c13-929b-4943-b130-66722dc4e7fb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:15.286115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9f32c13-929b-4943-b130-66722dc4e7fb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:15.287357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9f32c13-929b-4943-b130-66722dc4e7fb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:15.289544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9f32c13-929b-4943-b130-66722dc4e7fb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:15.293577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9f32c13-929b-4943-b130-66722dc4e7fb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:15.295996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9f32c13-929b-4943-b130-66722dc4e7fb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:15.499118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aa83cdf1-6a23-417a-9995-03eaf551bc8b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:15.500282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aa83cdf1-6a23-417a-9995-03eaf551bc8b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:15.506970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa83cdf1-6a23-417a-9995-03eaf551bc8b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:15.507454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa83cdf1-6a23-417a-9995-03eaf551bc8b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:15.508762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa83cdf1-6a23-417a-9995-03eaf551bc8b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:15.510177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa83cdf1-6a23-417a-9995-03eaf551bc8b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:15.510836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa83cdf1-6a23-417a-9995-03eaf551bc8b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:15.511599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa83cdf1-6a23-417a-9995-03eaf551bc8b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:15.661560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aa83cdf1-6a23-417a-9995-03eaf551bc8b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:15.670111 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aa83cdf1-6a23-417a-9995-03eaf551bc8b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1272 microversion: 2.1 time: 0.177401 Oct 29 02:51:15.673697 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 874/1666] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:15 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:16.291577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:16.292265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:16.311659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:16.312230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b9f32c13-929b-4943-b130-66722dc4e7fb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:16.315126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:16.315639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:16.316378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:16.317033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:16.317543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:16.329440 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b9f32c13-929b-4943-b130-66722dc4e7fb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1312 microversion: 2.1 time: 1.075709 Oct 29 02:51:16.330454 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 793/1667] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:15 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1312 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:16.467763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:16.476854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:16.486545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:16.497014 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-06ef0943-34a6-4c99-93b8-b567b1712413 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.209808 Oct 29 02:51:16.502107 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 875/1668] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:16 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:51:16.692884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d634e1e1-dc07-4d0a-a603-66f1d386f7ba tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:16.693535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d634e1e1-dc07-4d0a-a603-66f1d386f7ba tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:16.709635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-625078566", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:16.719761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d634e1e1-dc07-4d0a-a603-66f1d386f7ba tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:16.720168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d634e1e1-dc07-4d0a-a603-66f1d386f7ba tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:16.722200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d634e1e1-dc07-4d0a-a603-66f1d386f7ba tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:16.723187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d634e1e1-dc07-4d0a-a603-66f1d386f7ba tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:16.725000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d634e1e1-dc07-4d0a-a603-66f1d386f7ba tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:16.726201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d634e1e1-dc07-4d0a-a603-66f1d386f7ba tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:16.838704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] validate_networks() for [('488ae119-e32d-45f9-bc42-27cf88a93460', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:51:16.981585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d634e1e1-dc07-4d0a-a603-66f1d386f7ba tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:17.000346 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d634e1e1-dc07-4d0a-a603-66f1d386f7ba tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1278 microversion: 2.1 time: 0.303631 Oct 29 02:51:17.012028 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 794/1669] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:16 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1278 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:17.367073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ad7866d9-18fe-4ea7-9448-3398293b25ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:17.368485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ad7866d9-18fe-4ea7-9448-3398293b25ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:17.394466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad7866d9-18fe-4ea7-9448-3398293b25ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:17.399351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad7866d9-18fe-4ea7-9448-3398293b25ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:17.401986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad7866d9-18fe-4ea7-9448-3398293b25ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:17.403142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad7866d9-18fe-4ea7-9448-3398293b25ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:17.405821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad7866d9-18fe-4ea7-9448-3398293b25ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:17.407108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad7866d9-18fe-4ea7-9448-3398293b25ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:17.715838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:51:17.716789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:51:17.717382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:51:17.717637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:51:17.718093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:51:17.727520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:17.727987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:17.728578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:17.729658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:17.730765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:17.731522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:17.772531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Getting quotas for project 0b30ce428766445d9d0d45f350ae1024. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:51:17.777891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Getting quotas for user 837f9940834e4eaeb31c967dba6d762f and project 0b30ce428766445d9d0d45f350ae1024. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:51:17.791805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:51:17.794666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:51:17.862853 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c65a8c4b-cf90-48db-a864-97937621ffb0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.159663 Oct 29 02:51:17.872667 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 876/1670] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:51:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 02:51:17.880477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:17.881148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:17.890825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:17.891320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:17.891994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:17.893470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:17.894102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:17.894532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:18.074438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:18.078068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ad7866d9-18fe-4ea7-9448-3398293b25ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:18.092342 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ad7866d9-18fe-4ea7-9448-3398293b25ce tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1312 microversion: 2.1 time: 0.735261 Oct 29 02:51:18.095863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:18.106758 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 795/1671] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:17 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1312 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:18.144472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:18.147884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce5a3804-155b-431e-8291-872ec9ec769b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:18.164881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ce5a3804-155b-431e-8291-872ec9ec769b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:18.181099 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-33ffe01e-1a6a-4902-9045-5fb1b8c1b328 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.306946 Oct 29 02:51:18.212932 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 877/1672] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:17 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:18.226223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6685362a-551a-440e-ae95-048bcd9c7348 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:18.228202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6685362a-551a-440e-ae95-048bcd9c7348 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:18.258222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6685362a-551a-440e-ae95-048bcd9c7348 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:18.259368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6685362a-551a-440e-ae95-048bcd9c7348 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:18.261461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6685362a-551a-440e-ae95-048bcd9c7348 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:18.263929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6685362a-551a-440e-ae95-048bcd9c7348 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:18.270668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6685362a-551a-440e-ae95-048bcd9c7348 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:18.272834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6685362a-551a-440e-ae95-048bcd9c7348 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:18.565980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6685362a-551a-440e-ae95-048bcd9c7348 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:18.576174 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6685362a-551a-440e-ae95-048bcd9c7348 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1278 microversion: 2.1 time: 0.361765 Oct 29 02:51:18.613995 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 878/1673] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:18 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1278 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:18.630329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-74b8c41c-4703-40a3-ba1c-695ebd4f0676 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:18.636502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-74b8c41c-4703-40a3-ba1c-695ebd4f0676 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:18.663639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74b8c41c-4703-40a3-ba1c-695ebd4f0676 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:18.666504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74b8c41c-4703-40a3-ba1c-695ebd4f0676 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:18.667148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74b8c41c-4703-40a3-ba1c-695ebd4f0676 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:18.670834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74b8c41c-4703-40a3-ba1c-695ebd4f0676 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:18.675951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74b8c41c-4703-40a3-ba1c-695ebd4f0676 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:18.678805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74b8c41c-4703-40a3-ba1c-695ebd4f0676 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:18.686296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ce5a3804-155b-431e-8291-872ec9ec769b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:18.712775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ce5a3804-155b-431e-8291-872ec9ec769b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1224 microversion: 2.1 time: 0.601619 Oct 29 02:51:18.716151 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 796/1674] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:18 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1224 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:19.120011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-74b8c41c-4703-40a3-ba1c-695ebd4f0676 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid bce4caa1-3b78-4bcf-98e4-b4d9da71dfee {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:19.141145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a456b108-7425-4115-bcbb-6709e7f299a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:19.142881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a456b108-7425-4115-bcbb-6709e7f299a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:19.161099 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-74b8c41c-4703-40a3-ba1c-695ebd4f0676 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 2421 microversion: 2.25 time: 0.543436 Oct 29 02:51:19.162908 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 879/1675] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:18 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 2421 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:19.190724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a8c19d80-e335-4e17-9ff0-511f9e9a545a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-4", "block_migration": "auto"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:19.200749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a456b108-7425-4115-bcbb-6709e7f299a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:19.201094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a8c19d80-e335-4e17-9ff0-511f9e9a545a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:19.209139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a456b108-7425-4115-bcbb-6709e7f299a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:19.210044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a456b108-7425-4115-bcbb-6709e7f299a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:19.214171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a456b108-7425-4115-bcbb-6709e7f299a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:19.218826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a456b108-7425-4115-bcbb-6709e7f299a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:19.219535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a456b108-7425-4115-bcbb-6709e7f299a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:19.225277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8c19d80-e335-4e17-9ff0-511f9e9a545a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:19.226267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8c19d80-e335-4e17-9ff0-511f9e9a545a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:19.227016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8c19d80-e335-4e17-9ff0-511f9e9a545a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:19.228040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8c19d80-e335-4e17-9ff0-511f9e9a545a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:19.230090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8c19d80-e335-4e17-9ff0-511f9e9a545a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:19.230893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a8c19d80-e335-4e17-9ff0-511f9e9a545a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:19.339386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-a8c19d80-e335-4e17-9ff0-511f9e9a545a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'flavor' on Instance uuid bce4caa1-3b78-4bcf-98e4-b4d9da71dfee {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:19.376292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a8c19d80-e335-4e17-9ff0-511f9e9a545a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Going to try to live migrate instance to n-h2-862964-4 {{(pid=127041) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:51:20.019924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a456b108-7425-4115-bcbb-6709e7f299a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:20.043711 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a456b108-7425-4115-bcbb-6709e7f299a7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1312 microversion: 2.1 time: 0.906930 Oct 29 02:51:20.054564 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 797/1676] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:19 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1312 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:20.069913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:20.071752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:20.096641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:20.099550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:20.101733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:20.102870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:20.104185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:20.113129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:20.398596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:20.426751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:20.433270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:20.452654 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7bea6299-a285-4933-97a9-2af3b2c58e02 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.395193 Oct 29 02:51:20.481867 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 798/1677] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:20 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:20.501524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e5171bb9-2f48-423c-9aab-ab68295d481d req-49af5468-2513-4a3d-bb39-37c3d558003c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c", "name": "network-vif-plugged", "status": "completed", "tag": "34c62a40-e8c0-42f4-a697-e6a0fc8540fb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:20.517972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e5171bb9-2f48-423c-9aab-ab68295d481d req-49af5468-2513-4a3d-bb39-37c3d558003c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:20.518944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e5171bb9-2f48-423c-9aab-ab68295d481d req-49af5468-2513-4a3d-bb39-37c3d558003c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:20.520450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e5171bb9-2f48-423c-9aab-ab68295d481d req-49af5468-2513-4a3d-bb39-37c3d558003c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:20.541407 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e5171bb9-2f48-423c-9aab-ab68295d481d req-49af5468-2513-4a3d-bb39-37c3d558003c service nova] Creating event network-vif-plugged:34c62a40-e8c0-42f4-a697-e6a0fc8540fb for instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c on n-h1-862964-4 Oct 29 02:51:20.583931 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e5171bb9-2f48-423c-9aab-ab68295d481d req-49af5468-2513-4a3d-bb39-37c3d558003c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098174 Oct 29 02:51:20.586545 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 799/1678] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:20.600012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eee41395-551b-495b-9a18-ec9de0aa72fd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:20.602762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eee41395-551b-495b-9a18-ec9de0aa72fd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:20.615782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eee41395-551b-495b-9a18-ec9de0aa72fd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:20.617414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eee41395-551b-495b-9a18-ec9de0aa72fd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:20.618238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eee41395-551b-495b-9a18-ec9de0aa72fd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:20.619849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eee41395-551b-495b-9a18-ec9de0aa72fd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:20.621067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eee41395-551b-495b-9a18-ec9de0aa72fd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:20.621735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eee41395-551b-495b-9a18-ec9de0aa72fd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:20.698383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:22.214434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eee41395-551b-495b-9a18-ec9de0aa72fd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:22.227927 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eee41395-551b-495b-9a18-ec9de0aa72fd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1320 microversion: 2.1 time: 1.632338 Oct 29 02:51:22.228452 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 800/1679] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:20 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1320 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:22.240530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8519b2a3-14f9-4bb1-aab7-47290b22ea08 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:22.243894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8519b2a3-14f9-4bb1-aab7-47290b22ea08 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:22.261182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8519b2a3-14f9-4bb1-aab7-47290b22ea08 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:22.262088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8519b2a3-14f9-4bb1-aab7-47290b22ea08 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:22.262689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8519b2a3-14f9-4bb1-aab7-47290b22ea08 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:22.263606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8519b2a3-14f9-4bb1-aab7-47290b22ea08 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:22.265550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8519b2a3-14f9-4bb1-aab7-47290b22ea08 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:22.266169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8519b2a3-14f9-4bb1-aab7-47290b22ea08 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:22.504768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8519b2a3-14f9-4bb1-aab7-47290b22ea08 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:22.524144 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8519b2a3-14f9-4bb1-aab7-47290b22ea08 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1276 microversion: 2.1 time: 0.287550 Oct 29 02:51:22.544108 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 801/1680] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:22 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1276 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:22.556758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17c79f67-e6f8-4bbb-bec8-2890c922e4f9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:22.557783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-17c79f67-e6f8-4bbb-bec8-2890c922e4f9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:22.569551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17c79f67-e6f8-4bbb-bec8-2890c922e4f9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:22.570546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17c79f67-e6f8-4bbb-bec8-2890c922e4f9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:22.571188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17c79f67-e6f8-4bbb-bec8-2890c922e4f9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:22.572278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17c79f67-e6f8-4bbb-bec8-2890c922e4f9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:22.572928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17c79f67-e6f8-4bbb-bec8-2890c922e4f9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:22.574392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17c79f67-e6f8-4bbb-bec8-2890c922e4f9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:23.577517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-17c79f67-e6f8-4bbb-bec8-2890c922e4f9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:23.589231 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-17c79f67-e6f8-4bbb-bec8-2890c922e4f9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1312 microversion: 2.1 time: 1.041299 Oct 29 02:51:23.594085 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 802/1681] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:22 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1312 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:23.607071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-87819895-b0d3-44c5-99b0-e17502f862d0 req-4bc5c0e5-402f-4d16-a43b-2a6a9961b291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2", "tag": "035620f0-56eb-4852-8f0a-fa8b570f59f2"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:23.645205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-87819895-b0d3-44c5-99b0-e17502f862d0 req-4bc5c0e5-402f-4d16-a43b-2a6a9961b291 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:23.645700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-87819895-b0d3-44c5-99b0-e17502f862d0 req-4bc5c0e5-402f-4d16-a43b-2a6a9961b291 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:23.646369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-87819895-b0d3-44c5-99b0-e17502f862d0 req-4bc5c0e5-402f-4d16-a43b-2a6a9961b291 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:23.678263 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-87819895-b0d3-44c5-99b0-e17502f862d0 req-4bc5c0e5-402f-4d16-a43b-2a6a9961b291 service nova] Creating event network-changed:035620f0-56eb-4852-8f0a-fa8b570f59f2 for instance 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 on n-h1-862964-4 Oct 29 02:51:23.686694 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-87819895-b0d3-44c5-99b0-e17502f862d0 req-4bc5c0e5-402f-4d16-a43b-2a6a9961b291 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090975 Oct 29 02:51:23.689471 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 803/1682] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:23.706854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:23.707904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:23.722026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:23.722924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:23.723567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:23.724699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:23.726283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:23.727018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:23.977102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:24.002161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:24.004481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:24.008646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:24.012034 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2549886e-c402-425e-a804-349d61d50ba9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.321113 Oct 29 02:51:24.013369 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 804/1683] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:23 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:24.020738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f3d87537-228a-42bd-9eb1-e074ea508b69 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:24.021581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f3d87537-228a-42bd-9eb1-e074ea508b69 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:24.032083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3d87537-228a-42bd-9eb1-e074ea508b69 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:24.032966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3d87537-228a-42bd-9eb1-e074ea508b69 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:24.033572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3d87537-228a-42bd-9eb1-e074ea508b69 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:24.034660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3d87537-228a-42bd-9eb1-e074ea508b69 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:24.035661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3d87537-228a-42bd-9eb1-e074ea508b69 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:24.036306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3d87537-228a-42bd-9eb1-e074ea508b69 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.031313 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f3d87537-228a-42bd-9eb1-e074ea508b69 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1856 microversion: 2.1 time: 1.016301 Oct 29 02:51:25.032077 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 805/1684] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:24 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1856 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:25.037479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-344f132a-81b8-4f26-8524-c657bfe2f8d0 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:25.037479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-344f132a-81b8-4f26-8524-c657bfe2f8d0 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:25.045181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-344f132a-81b8-4f26-8524-c657bfe2f8d0 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:25.045898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-344f132a-81b8-4f26-8524-c657bfe2f8d0 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:25.047145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-344f132a-81b8-4f26-8524-c657bfe2f8d0 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.048199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-344f132a-81b8-4f26-8524-c657bfe2f8d0 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:25.049006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-344f132a-81b8-4f26-8524-c657bfe2f8d0 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:25.050215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-344f132a-81b8-4f26-8524-c657bfe2f8d0 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.111710 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a8c19d80-e335-4e17-9ff0-511f9e9a545a tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/action" status: 202 len: 0 microversion: 2.25 time: 5.926200 Oct 29 02:51:25.116007 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 880/1685] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:51:19 2022] POST /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/action => generated 0 bytes in 5931 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:51:25.121838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81c7fd11-9c52-42a5-8e35-c07e761cb03a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:25.122717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81c7fd11-9c52-42a5-8e35-c07e761cb03a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:25.131883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81c7fd11-9c52-42a5-8e35-c07e761cb03a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:25.132665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81c7fd11-9c52-42a5-8e35-c07e761cb03a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:25.133277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81c7fd11-9c52-42a5-8e35-c07e761cb03a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.134238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81c7fd11-9c52-42a5-8e35-c07e761cb03a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:25.134841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81c7fd11-9c52-42a5-8e35-c07e761cb03a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:25.135588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81c7fd11-9c52-42a5-8e35-c07e761cb03a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.206522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-81c7fd11-9c52-42a5-8e35-c07e761cb03a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:25.215275 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81c7fd11-9c52-42a5-8e35-c07e761cb03a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1282 microversion: 2.1 time: 0.097858 Oct 29 02:51:25.216149 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 881/1686] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:25 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:25.220809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1a3a8aeb-fe5e-483c-ab14-03abcaffc8a3 req-65eac9a3-3982-48e7-b066-ea6dca8b80b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adaae0cd-6343-48ec-a887-ef5001a172ad", "tag": "02f2ebeb-15a0-4008-aef4-802678de94f4"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:25.232014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a3a8aeb-fe5e-483c-ab14-03abcaffc8a3 req-65eac9a3-3982-48e7-b066-ea6dca8b80b6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:25.232789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a3a8aeb-fe5e-483c-ab14-03abcaffc8a3 req-65eac9a3-3982-48e7-b066-ea6dca8b80b6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:25.233386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a3a8aeb-fe5e-483c-ab14-03abcaffc8a3 req-65eac9a3-3982-48e7-b066-ea6dca8b80b6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.247409 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1a3a8aeb-fe5e-483c-ab14-03abcaffc8a3 req-65eac9a3-3982-48e7-b066-ea6dca8b80b6 service nova] Creating event network-changed:02f2ebeb-15a0-4008-aef4-802678de94f4 for instance adaae0cd-6343-48ec-a887-ef5001a172ad on n-h2-862964-4 Oct 29 02:51:25.253152 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1a3a8aeb-fe5e-483c-ab14-03abcaffc8a3 req-65eac9a3-3982-48e7-b066-ea6dca8b80b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035402 Oct 29 02:51:25.254858 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 882/1687] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:25.427416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02e3b581-8971-4ee9-8949-72580ca6312f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:25.428423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-02e3b581-8971-4ee9-8949-72580ca6312f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:25.442567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02e3b581-8971-4ee9-8949-72580ca6312f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:25.443851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02e3b581-8971-4ee9-8949-72580ca6312f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:25.444489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02e3b581-8971-4ee9-8949-72580ca6312f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.445418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02e3b581-8971-4ee9-8949-72580ca6312f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:25.446128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02e3b581-8971-4ee9-8949-72580ca6312f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:25.446732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02e3b581-8971-4ee9-8949-72580ca6312f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.612715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02e3b581-8971-4ee9-8949-72580ca6312f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:25.624298 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02e3b581-8971-4ee9-8949-72580ca6312f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1312 microversion: 2.1 time: 0.367912 Oct 29 02:51:25.644112 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 883/1688] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:25 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1312 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:25.649644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:25.650859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:25.658023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:25.658515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:25.658946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.659659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:25.660240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:25.660713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.685897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:25.770848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:25.787942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:25.794328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:25.803795 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25679e86-cd4b-41ca-978a-b2d5908ca9cb tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.158465 Oct 29 02:51:25.819123 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 884/1689] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:25 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:25.836712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1fff7b12-b284-43c8-a723-46105cdac88e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862964-4", "block_migration": true, "disk_over_commit": false}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:25.843762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1fff7b12-b284-43c8-a723-46105cdac88e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:25.852729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fff7b12-b284-43c8-a723-46105cdac88e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:25.853510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fff7b12-b284-43c8-a723-46105cdac88e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:25.854170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fff7b12-b284-43c8-a723-46105cdac88e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.855341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fff7b12-b284-43c8-a723-46105cdac88e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:25.855972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fff7b12-b284-43c8-a723-46105cdac88e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:25.856566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fff7b12-b284-43c8-a723-46105cdac88e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:25.928710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-1fff7b12-b284-43c8-a723-46105cdac88e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lazy-loading 'flavor' on Instance uuid 239b8047-ca96-48bc-8950-57a0b6f0d537 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:25.955277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-344f132a-81b8-4f26-8524-c657bfe2f8d0 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:25.965017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1fff7b12-b284-43c8-a723-46105cdac88e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Going to try to live migrate instance to n-h1-862964-4 {{(pid=127041) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:51:26.001557 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-344f132a-81b8-4f26-8524-c657bfe2f8d0 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1320 microversion: 2.1 time: 0.967122 Oct 29 02:51:26.003899 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 806/1690] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:25 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1320 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:26.022429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:26.023889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:26.033613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:26.034412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:26.034536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:26.036757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:26.037217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:26.037641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:27.340100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:27.355541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:27.356566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:27.357793 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-966dec25-a525-44f3-8a29-be9134515b78 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 1.350922 Oct 29 02:51:27.358926 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 807/1691] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:26 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:27.377115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7cf3f283-615f-4cbf-99cb-854dbeb125e0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:27.377672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7cf3f283-615f-4cbf-99cb-854dbeb125e0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:27.419239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3f283-615f-4cbf-99cb-854dbeb125e0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:27.419731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3f283-615f-4cbf-99cb-854dbeb125e0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:27.428349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3f283-615f-4cbf-99cb-854dbeb125e0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:27.429375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3f283-615f-4cbf-99cb-854dbeb125e0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:27.429881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3f283-615f-4cbf-99cb-854dbeb125e0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:27.430313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3f283-615f-4cbf-99cb-854dbeb125e0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:27.703212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7cf3f283-615f-4cbf-99cb-854dbeb125e0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:27.724423 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7cf3f283-615f-4cbf-99cb-854dbeb125e0 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1324 microversion: 2.1 time: 0.364162 Oct 29 02:51:27.725710 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 808/1692] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:27 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1324 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:27.744921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:27.786234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=20 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:27.818274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1691079099", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "0ef24500-837e-47a7-9e10-a72e3fb043af"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:27.901092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] validate_networks() for [('0ef24500-837e-47a7-9e10-a72e3fb043af', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:51:28.548091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:51:28.549351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:51:28.549946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:51:28.550358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:51:28.550906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:51:28.575282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:28.575773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:28.576266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:28.576998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:28.577499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:28.577958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:28.639350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:51:28.645739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for user 0868f50723074f2b98f7b1096743f3cc and project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:51:28.669899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:51:28.690556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:51:28.785594 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-04f7f9ac-7bd5-441e-b21f-0fbb7b8c2de0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043261 Oct 29 02:51:28.793380 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 809/1693] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:51:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:51:28.799302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-970f359a-ebd5-4d22-a31a-4f144363b00c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:28.799950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-970f359a-ebd5-4d22-a31a-4f144363b00c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:28.810483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-970f359a-ebd5-4d22-a31a-4f144363b00c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:28.811068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-970f359a-ebd5-4d22-a31a-4f144363b00c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:28.811578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-970f359a-ebd5-4d22-a31a-4f144363b00c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:28.812370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-970f359a-ebd5-4d22-a31a-4f144363b00c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:28.812898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-970f359a-ebd5-4d22-a31a-4f144363b00c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:28.813475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-970f359a-ebd5-4d22-a31a-4f144363b00c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:29.364849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-970f359a-ebd5-4d22-a31a-4f144363b00c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:29.367374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:29.376530 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-970f359a-ebd5-4d22-a31a-4f144363b00c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1461 microversion: 2.1 time: 0.581700 Oct 29 02:51:29.377117 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 810/1694] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:28 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1461 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:29.393655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:29.394337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:29.411523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:29.413459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:29.413953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:29.416913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:29.417391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:29.417834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:30.147023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:30.163271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:30.164720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:30.180943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-831e3a3c-5c03-4ae4-9ff6-77e0ddf30348 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.802764 Oct 29 02:51:30.182253 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 811/1695] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:29 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:30.187245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ec3f2f66-70e1-49a1-9dd1-150c91be16c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:30.188123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ec3f2f66-70e1-49a1-9dd1-150c91be16c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:30.199853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec3f2f66-70e1-49a1-9dd1-150c91be16c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:30.200521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec3f2f66-70e1-49a1-9dd1-150c91be16c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:30.202727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec3f2f66-70e1-49a1-9dd1-150c91be16c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:30.203619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec3f2f66-70e1-49a1-9dd1-150c91be16c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:30.206797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec3f2f66-70e1-49a1-9dd1-150c91be16c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:30.207501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec3f2f66-70e1-49a1-9dd1-150c91be16c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:30.760305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec3f2f66-70e1-49a1-9dd1-150c91be16c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:30.764214 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1fff7b12-b284-43c8-a723-46105cdac88e tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/action" status: 202 len: 0 microversion: 2.1 time: 4.942823 Oct 29 02:51:30.765567 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 885/1696] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:51:25 2022] POST /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/action => generated 0 bytes in 4945 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:51:30.771249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:30.771862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:30.773261 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ec3f2f66-70e1-49a1-9dd1-150c91be16c3 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1320 microversion: 2.1 time: 0.589675 Oct 29 02:51:30.773878 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 812/1697] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:30 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1320 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:30.778434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f88d27bf-eabb-44d3-9673-de561d61e64f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:30.779026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f88d27bf-eabb-44d3-9673-de561d61e64f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:30.781435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:30.782297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:30.782917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:30.783857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:30.784793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:30.785537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:30.795511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f88d27bf-eabb-44d3-9673-de561d61e64f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:30.796001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f88d27bf-eabb-44d3-9673-de561d61e64f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:30.796648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f88d27bf-eabb-44d3-9673-de561d61e64f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:30.799232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f88d27bf-eabb-44d3-9673-de561d61e64f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:30.802001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f88d27bf-eabb-44d3-9673-de561d61e64f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:30.802634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f88d27bf-eabb-44d3-9673-de561d61e64f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:30.984055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:30.993548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:30.995012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:31.007049 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bfdd9bbe-2311-4c69-8339-9ca91f7119da tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.229875 Oct 29 02:51:31.007709 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 886/1698] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:30 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:31.012733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5791958-d9e8-490a-a07f-0040e889dd34 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:31.013338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d5791958-d9e8-490a-a07f-0040e889dd34 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:31.030735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5791958-d9e8-490a-a07f-0040e889dd34 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.031588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5791958-d9e8-490a-a07f-0040e889dd34 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.037485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5791958-d9e8-490a-a07f-0040e889dd34 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:31.038707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5791958-d9e8-490a-a07f-0040e889dd34 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.039400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5791958-d9e8-490a-a07f-0040e889dd34 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.040240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5791958-d9e8-490a-a07f-0040e889dd34 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:31.181155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5791958-d9e8-490a-a07f-0040e889dd34 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:31.189955 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5791958-d9e8-490a-a07f-0040e889dd34 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1268 microversion: 2.1 time: 0.181152 Oct 29 02:51:31.206422 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 887/1699] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:31 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:31.211954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-019d7d5f-ad6f-4615-b7b1-6172f8f7e815 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:31.213007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-019d7d5f-ad6f-4615-b7b1-6172f8f7e815 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:31.219334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-019d7d5f-ad6f-4615-b7b1-6172f8f7e815 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.220130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-019d7d5f-ad6f-4615-b7b1-6172f8f7e815 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.220779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-019d7d5f-ad6f-4615-b7b1-6172f8f7e815 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:31.221582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-019d7d5f-ad6f-4615-b7b1-6172f8f7e815 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.222248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-019d7d5f-ad6f-4615-b7b1-6172f8f7e815 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.222961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-019d7d5f-ad6f-4615-b7b1-6172f8f7e815 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:31.315726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f88d27bf-eabb-44d3-9673-de561d61e64f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:31.326962 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f88d27bf-eabb-44d3-9673-de561d61e64f tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1324 microversion: 2.1 time: 0.552024 Oct 29 02:51:31.327618 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 813/1700] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:30 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1324 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:31.335109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-33520450-f868-4ba7-a1a4-311f64b5a5f9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:31.337828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-33520450-f868-4ba7-a1a4-311f64b5a5f9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:31.352042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33520450-f868-4ba7-a1a4-311f64b5a5f9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.352548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33520450-f868-4ba7-a1a4-311f64b5a5f9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.352963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33520450-f868-4ba7-a1a4-311f64b5a5f9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:31.354456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33520450-f868-4ba7-a1a4-311f64b5a5f9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.358685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33520450-f868-4ba7-a1a4-311f64b5a5f9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.359223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33520450-f868-4ba7-a1a4-311f64b5a5f9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:31.525384 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-019d7d5f-ad6f-4615-b7b1-6172f8f7e815 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1612 microversion: 2.1 time: 0.316975 Oct 29 02:51:31.527579 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 888/1701] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:31 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1612 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:31.569252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:31.570109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:31.577689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.578435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.579042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:31.579915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.580519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.581256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:31.682095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:31.693997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-33520450-f868-4ba7-a1a4-311f64b5a5f9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:31.695269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:31.700310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:31.704210 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-33520450-f868-4ba7-a1a4-311f64b5a5f9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.374933 Oct 29 02:51:31.705216 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 814/1702] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:31 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:31.726318 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b365d64-f3ff-4b8e-ade0-9e3b65047e98 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.186697 Oct 29 02:51:31.727877 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 889/1703] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:31 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:31.734128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:31.735334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:31.777794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.780707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.783596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:31.785644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.786431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.787793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:31.926591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '13849b751a7141e9900d3999a3693b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f22d73ce564906bfcb14f79df2912e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:31.928273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] flavor_id is None. Assuming migration. {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 02:51:31.928894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 02:51:31.965492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a2f7bc0-d3d1-4af4-a754-97cc44205d75 tempest-ListImageFiltersNegativeTestJSON-262527302 tempest-ListImageFiltersNegativeTestJSON-262527302-project] Calling method '.version_select at 0x7fe1a89f23a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:32.013763 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-3a2f7bc0-d3d1-4af4-a754-97cc44205d75 tempest-ListImageFiltersNegativeTestJSON-262527302 tempest-ListImageFiltersNegativeTestJSON-262527302-project] HTTP exception thrown: Image not found. Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a2f7bc0-d3d1-4af4-a754-97cc44205d75 tempest-ListImageFiltersNegativeTestJSON-262527302 tempest-ListImageFiltersNegativeTestJSON-262527302-project] Request method failure captured: Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/images/e4923c41-c3b4-410f-87a4-afaae582429d HTTP/1.1 Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUzEsumFjsmMNCoOqaP-DfsbRSABnYBLLjyWATDt3S_6wNznwjNVInv_5ugnp85Mc1fop4Nds-erjpSGic38pJFivbLG4nOcNpFhxt2uFNqTNrePnmvo2RozQGu4sYLRseLIxV_ywTvmMJchFV5D7tBwcI3uupZoVC2OQNc6cHEv0k Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 458b1910dc504aadad8fa6fdc9c99b5c Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-262527302 Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:51:32.016112 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/458b1910dc504aadad8fa6fdc9c99b5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/458b1910dc504aadad8fa6fdc9c99b5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_458b1910dc504aadad8fa6fdc9c99b5c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/458b1910dc504aadad8fa6fdc9c99b5c"}]}] Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-262527302 Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 458b1910dc504aadad8fa6fdc9c99b5c Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-262527302 Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ListImageFiltersNegativeTestJSON-262527302-project Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fdb4859686e14440b293132eedd0ae3a Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-262527302-project Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'e4923c41-c3b4-410f-87a4-afaae582429d'} Oct 29 02:51:32.017659 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:32.018601 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e4923c41-c3b4-410f-87a4-afaae582429d Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:32.019915 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e4923c41-c3b4-410f-87a4-afaae582429d could not be found. Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:32.021165 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:32.023779 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:32.027256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a2f7bc0-d3d1-4af4-a754-97cc44205d75 tempest-ListImageFiltersNegativeTestJSON-262527302 tempest-ListImageFiltersNegativeTestJSON-262527302-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:32.028435 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3a2f7bc0-d3d1-4af4-a754-97cc44205d75 tempest-ListImageFiltersNegativeTestJSON-262527302 tempest-ListImageFiltersNegativeTestJSON-262527302-project] 10.222.0.16 "GET /compute/v2.1/images/e4923c41-c3b4-410f-87a4-afaae582429d" status: 404 len: 62 microversion: 2.1 time: 0.322025 Oct 29 02:51:32.033497 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 815/1704] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:31 2022] GET /compute/v2.1/images/e4923c41-c3b4-410f-87a4-afaae582429d => generated 62 bytes in 327 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:51:32.039164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-1701c210-5a96-44bc-900d-9f0bc054e0db req-e510ad86-55bf-4d49-92cc-e6112dd7f7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adaae0cd-6343-48ec-a887-ef5001a172ad", "name": "network-vif-plugged", "status": "completed", "tag": "02f2ebeb-15a0-4008-aef4-802678de94f4"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:32.051626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1701c210-5a96-44bc-900d-9f0bc054e0db req-e510ad86-55bf-4d49-92cc-e6112dd7f7aa service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.052517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1701c210-5a96-44bc-900d-9f0bc054e0db req-e510ad86-55bf-4d49-92cc-e6112dd7f7aa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.053153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1701c210-5a96-44bc-900d-9f0bc054e0db req-e510ad86-55bf-4d49-92cc-e6112dd7f7aa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:32.064074 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1701c210-5a96-44bc-900d-9f0bc054e0db req-e510ad86-55bf-4d49-92cc-e6112dd7f7aa service nova] Creating event network-vif-plugged:02f2ebeb-15a0-4008-aef4-802678de94f4 for instance adaae0cd-6343-48ec-a887-ef5001a172ad on n-h2-862964-4 Oct 29 02:51:32.070503 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-1701c210-5a96-44bc-900d-9f0bc054e0db req-e510ad86-55bf-4d49-92cc-e6112dd7f7aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034745 Oct 29 02:51:32.076236 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 816/1705] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:32.085318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c230f5a-ed99-42ea-ac76-9ea519652696 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:32.086467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c230f5a-ed99-42ea-ac76-9ea519652696 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:32.093564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c230f5a-ed99-42ea-ac76-9ea519652696 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.094485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c230f5a-ed99-42ea-ac76-9ea519652696 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.095284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c230f5a-ed99-42ea-ac76-9ea519652696 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:32.096369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c230f5a-ed99-42ea-ac76-9ea519652696 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.097295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c230f5a-ed99-42ea-ac76-9ea519652696 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.098201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c230f5a-ed99-42ea-ac76-9ea519652696 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:32.393884 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4739da25-5d79-4058-9006-9d77f5558119 tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c/action" status: 202 len: 0 microversion: 2.1 time: 0.663110 Oct 29 02:51:32.399621 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 890/1706] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:51:31 2022] POST /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:51:32.409194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c09b6704-e5ce-445e-bdad-496d0eb999c5 req-6002e3ec-0a12-4e19-a456-b2702c6c0096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1782e279-7a4c-47a0-983e-7e07b34162a6", "tag": "04204f29-7f5c-4dd3-bbe2-d9c1f52c66e8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:32.436176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c09b6704-e5ce-445e-bdad-496d0eb999c5 req-6002e3ec-0a12-4e19-a456-b2702c6c0096 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.436720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c09b6704-e5ce-445e-bdad-496d0eb999c5 req-6002e3ec-0a12-4e19-a456-b2702c6c0096 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.440915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c09b6704-e5ce-445e-bdad-496d0eb999c5 req-6002e3ec-0a12-4e19-a456-b2702c6c0096 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:32.470050 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c09b6704-e5ce-445e-bdad-496d0eb999c5 req-6002e3ec-0a12-4e19-a456-b2702c6c0096 service nova] Creating event network-changed:04204f29-7f5c-4dd3-bbe2-d9c1f52c66e8 for instance 1782e279-7a4c-47a0-983e-7e07b34162a6 on n-h2-862964-4 Oct 29 02:51:32.485096 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c09b6704-e5ce-445e-bdad-496d0eb999c5 req-6002e3ec-0a12-4e19-a456-b2702c6c0096 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085310 Oct 29 02:51:32.487009 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 891/1707] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:32.501107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:32.503390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:32.520655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.522872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.524709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:32.525781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.527601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.529710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:32.703352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c230f5a-ed99-42ea-ac76-9ea519652696 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:32.724506 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c230f5a-ed99-42ea-ac76-9ea519652696 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1320 microversion: 2.1 time: 0.644658 Oct 29 02:51:32.726004 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 817/1708] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:32 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1320 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:32.735566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-34899012-349c-453f-b76d-6f227f724dfb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:32.739009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-34899012-349c-453f-b76d-6f227f724dfb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:32.751519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34899012-349c-453f-b76d-6f227f724dfb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.752483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34899012-349c-453f-b76d-6f227f724dfb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.753357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34899012-349c-453f-b76d-6f227f724dfb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:32.754780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34899012-349c-453f-b76d-6f227f724dfb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.755978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34899012-349c-453f-b76d-6f227f724dfb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.756576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34899012-349c-453f-b76d-6f227f724dfb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:32.947099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-34899012-349c-453f-b76d-6f227f724dfb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:32.961893 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-34899012-349c-453f-b76d-6f227f724dfb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1266 microversion: 2.1 time: 0.232568 Oct 29 02:51:32.965338 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 818/1709] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:32 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:32.975825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dcfd4fab-d720-4699-bea3-bc9843379e9d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:32.976520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dcfd4fab-d720-4699-bea3-bc9843379e9d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:32.990805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcfd4fab-d720-4699-bea3-bc9843379e9d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.991292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcfd4fab-d720-4699-bea3-bc9843379e9d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.996258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcfd4fab-d720-4699-bea3-bc9843379e9d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:32.997061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcfd4fab-d720-4699-bea3-bc9843379e9d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.997525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcfd4fab-d720-4699-bea3-bc9843379e9d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.997979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcfd4fab-d720-4699-bea3-bc9843379e9d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:33.218677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:33.234362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:33.236018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:33.237766 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2149be0f-83ef-4950-8b2f-4ee616538222 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.747687 Oct 29 02:51:33.238918 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 892/1710] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:32 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:33.245719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-560349c6-ef52-41be-b3b3-12e652c86d1c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:33.247927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-560349c6-ef52-41be-b3b3-12e652c86d1c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:33.254257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:33.256878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-560349c6-ef52-41be-b3b3-12e652c86d1c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:33.257538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-560349c6-ef52-41be-b3b3-12e652c86d1c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:33.258237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-560349c6-ef52-41be-b3b3-12e652c86d1c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:33.259255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-560349c6-ef52-41be-b3b3-12e652c86d1c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:33.259977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-560349c6-ef52-41be-b3b3-12e652c86d1c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:33.260597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-560349c6-ef52-41be-b3b3-12e652c86d1c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:33.512842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dcfd4fab-d720-4699-bea3-bc9843379e9d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:33.525253 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dcfd4fab-d720-4699-bea3-bc9843379e9d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1324 microversion: 2.1 time: 0.556777 Oct 29 02:51:33.528329 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 819/1711] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:32 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1324 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:33.535850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7b7082a2-f1ea-43c6-8712-00d66a534a50 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:33.536632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7b7082a2-f1ea-43c6-8712-00d66a534a50 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:33.562912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b7082a2-f1ea-43c6-8712-00d66a534a50 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:33.563594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b7082a2-f1ea-43c6-8712-00d66a534a50 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:33.564199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b7082a2-f1ea-43c6-8712-00d66a534a50 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:33.565063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b7082a2-f1ea-43c6-8712-00d66a534a50 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:33.565668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b7082a2-f1ea-43c6-8712-00d66a534a50 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:33.566352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b7082a2-f1ea-43c6-8712-00d66a534a50 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:33.756544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b7082a2-f1ea-43c6-8712-00d66a534a50 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:33.766393 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7b7082a2-f1ea-43c6-8712-00d66a534a50 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.234724 Oct 29 02:51:33.767599 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 820/1712] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:33 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:33.788470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:33.789217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:33.795614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:33.796103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:33.796687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:33.797691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:33.798341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:33.798878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:33.873219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:33.882747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:33.884457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:33.890665 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3b5cbe09-3ceb-4ade-82a3-e2e473ff7107 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1546 microversion: 2.91 time: 0.121737 Oct 29 02:51:33.891249 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 821/1713] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:33 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1546 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:33.896070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-434e016a-cc5e-4118-89be-51cec4d2c1e2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:33.897708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-434e016a-cc5e-4118-89be-51cec4d2c1e2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:33.904466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-434e016a-cc5e-4118-89be-51cec4d2c1e2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:33.905188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-434e016a-cc5e-4118-89be-51cec4d2c1e2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:33.905773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-434e016a-cc5e-4118-89be-51cec4d2c1e2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:33.906834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-434e016a-cc5e-4118-89be-51cec4d2c1e2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:33.907485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-434e016a-cc5e-4118-89be-51cec4d2c1e2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:33.908120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-434e016a-cc5e-4118-89be-51cec4d2c1e2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:34.392902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-434e016a-cc5e-4118-89be-51cec4d2c1e2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:34.408989 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-434e016a-cc5e-4118-89be-51cec4d2c1e2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1320 microversion: 2.1 time: 0.516446 Oct 29 02:51:34.410847 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 822/1714] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:33 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1320 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:34.427985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0daa579e-974c-4fb0-813b-10cb177b6a9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:34.431732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0daa579e-974c-4fb0-813b-10cb177b6a9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:34.451525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daa579e-974c-4fb0-813b-10cb177b6a9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:34.453025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daa579e-974c-4fb0-813b-10cb177b6a9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:34.453795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daa579e-974c-4fb0-813b-10cb177b6a9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:34.454858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daa579e-974c-4fb0-813b-10cb177b6a9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:34.456263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daa579e-974c-4fb0-813b-10cb177b6a9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:34.456927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daa579e-974c-4fb0-813b-10cb177b6a9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:34.669076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-560349c6-ef52-41be-b3b3-12e652c86d1c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:34.687433 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-560349c6-ef52-41be-b3b3-12e652c86d1c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1470 microversion: 2.1 time: 1.446956 Oct 29 02:51:34.704006 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 893/1715] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:33 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1470 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:34.726491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:34.730555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:34.748794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:34.749705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:34.750397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:34.763367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:34.766175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:34.769602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:34.837666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0daa579e-974c-4fb0-813b-10cb177b6a9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:34.846511 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0daa579e-974c-4fb0-813b-10cb177b6a9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1308 microversion: 2.1 time: 0.434066 Oct 29 02:51:34.847217 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 823/1716] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:34 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:34.852156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2f145dbb-767f-455b-9d3a-5409043a4053 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:34.853048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2f145dbb-767f-455b-9d3a-5409043a4053 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:34.860689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f145dbb-767f-455b-9d3a-5409043a4053 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:34.862171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f145dbb-767f-455b-9d3a-5409043a4053 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:34.862853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f145dbb-767f-455b-9d3a-5409043a4053 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:34.863929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f145dbb-767f-455b-9d3a-5409043a4053 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:34.864688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f145dbb-767f-455b-9d3a-5409043a4053 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:34.865313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f145dbb-767f-455b-9d3a-5409043a4053 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.047497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f145dbb-767f-455b-9d3a-5409043a4053 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:35.054683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:35.057543 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2f145dbb-767f-455b-9d3a-5409043a4053 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1324 microversion: 2.1 time: 0.208882 Oct 29 02:51:35.059666 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 824/1717] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:34 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:35.065849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-849384d4-e8fc-45aa-9088-e2c41d5f2e3f req-c9eb8d97-1aaf-4586-aa97-1a3bfec2e1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2", "name": "network-vif-plugged", "status": "completed", "tag": "035620f0-56eb-4852-8f0a-fa8b570f59f2"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:35.078194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:35.078723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-849384d4-e8fc-45aa-9088-e2c41d5f2e3f req-c9eb8d97-1aaf-4586-aa97-1a3bfec2e1fe service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.079457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-849384d4-e8fc-45aa-9088-e2c41d5f2e3f req-c9eb8d97-1aaf-4586-aa97-1a3bfec2e1fe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.080175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-849384d4-e8fc-45aa-9088-e2c41d5f2e3f req-c9eb8d97-1aaf-4586-aa97-1a3bfec2e1fe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.080322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:35.081588 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c5efec4e-552a-4644-9ed9-c9f940141b30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.376484 Oct 29 02:51:35.082810 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 894/1718] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:34 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:35.095140 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-849384d4-e8fc-45aa-9088-e2c41d5f2e3f req-c9eb8d97-1aaf-4586-aa97-1a3bfec2e1fe service nova] Creating event network-vif-plugged:035620f0-56eb-4852-8f0a-fa8b570f59f2 for instance 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 on n-h1-862964-4 Oct 29 02:51:35.105111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a0cb3d09-0830-4fec-83b1-14da60416bfb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:35.106125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a0cb3d09-0830-4fec-83b1-14da60416bfb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:35.112241 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-849384d4-e8fc-45aa-9088-e2c41d5f2e3f req-c9eb8d97-1aaf-4586-aa97-1a3bfec2e1fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050333 Oct 29 02:51:35.113403 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 825/1719] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:35.121720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:35.122726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:35.123914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0cb3d09-0830-4fec-83b1-14da60416bfb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.125202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0cb3d09-0830-4fec-83b1-14da60416bfb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.125705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0cb3d09-0830-4fec-83b1-14da60416bfb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.126653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0cb3d09-0830-4fec-83b1-14da60416bfb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.127275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0cb3d09-0830-4fec-83b1-14da60416bfb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.127700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0cb3d09-0830-4fec-83b1-14da60416bfb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.132573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.134409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.134848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.135568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.136018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.136435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.251455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:35.263680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:35.265471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:35.273045 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9d0ded21-db00-4512-b3fc-13dc6b5298e9 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1533 microversion: 2.91 time: 0.156308 Oct 29 02:51:35.274341 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 826/1720] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:35 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1533 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:35.306275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ebbb19f3-1ec5-486f-b94d-08fb4778b9cb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:35.306889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ebbb19f3-1ec5-486f-b94d-08fb4778b9cb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:35.314184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebbb19f3-1ec5-486f-b94d-08fb4778b9cb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.314673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebbb19f3-1ec5-486f-b94d-08fb4778b9cb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.315107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebbb19f3-1ec5-486f-b94d-08fb4778b9cb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.316459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebbb19f3-1ec5-486f-b94d-08fb4778b9cb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.317200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebbb19f3-1ec5-486f-b94d-08fb4778b9cb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.317738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebbb19f3-1ec5-486f-b94d-08fb4778b9cb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.408226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-ebbb19f3-1ec5-486f-b94d-08fb4778b9cb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] Lazy-loading 'services' on Instance uuid c50495a0-6a28-4904-a856-768d30c4a6ec {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:35.423902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a0cb3d09-0830-4fec-83b1-14da60416bfb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:35.435740 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a0cb3d09-0830-4fec-83b1-14da60416bfb tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.351337 Oct 29 02:51:35.439181 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 895/1721] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:35 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:35.448089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a07a88e3-1c0e-439c-ac3f-b7ddf59eba6d tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:35.451507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a07a88e3-1c0e-439c-ac3f-b7ddf59eba6d tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:35.465490 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ebbb19f3-1ec5-486f-b94d-08fb4778b9cb tempest-UnshelveToHostMultiNodesTest-1004771862 tempest-UnshelveToHostMultiNodesTest-1004771862-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1938 microversion: 2.91 time: 0.164869 Oct 29 02:51:35.466259 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 827/1722] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:35 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1938 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:51:35.469193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a07a88e3-1c0e-439c-ac3f-b7ddf59eba6d tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.478735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a07a88e3-1c0e-439c-ac3f-b7ddf59eba6d tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.478735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a07a88e3-1c0e-439c-ac3f-b7ddf59eba6d tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.478735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a07a88e3-1c0e-439c-ac3f-b7ddf59eba6d tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.478735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a07a88e3-1c0e-439c-ac3f-b7ddf59eba6d tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.479281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a07a88e3-1c0e-439c-ac3f-b7ddf59eba6d tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.524808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-307380e2-8d39-4c53-aa23-7d90a3873dba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:35.525570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-307380e2-8d39-4c53-aa23-7d90a3873dba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:35.534735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-307380e2-8d39-4c53-aa23-7d90a3873dba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.535949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-307380e2-8d39-4c53-aa23-7d90a3873dba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.536602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-307380e2-8d39-4c53-aa23-7d90a3873dba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.537495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-307380e2-8d39-4c53-aa23-7d90a3873dba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.538271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-307380e2-8d39-4c53-aa23-7d90a3873dba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.538860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-307380e2-8d39-4c53-aa23-7d90a3873dba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.601337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-307380e2-8d39-4c53-aa23-7d90a3873dba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:51:35.646339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:35.682307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a07a88e3-1c0e-439c-ac3f-b7ddf59eba6d tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:35.693205 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a07a88e3-1c0e-439c-ac3f-b7ddf59eba6d tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1320 microversion: 2.1 time: 0.252758 Oct 29 02:51:35.697853 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 896/1723] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:35 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1320 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:35.715990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3d76af4e-adc5-469d-bf5e-091bcda5a900 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:35.716885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3d76af4e-adc5-469d-bf5e-091bcda5a900 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:35.723671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d76af4e-adc5-469d-bf5e-091bcda5a900 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.724627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d76af4e-adc5-469d-bf5e-091bcda5a900 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.725225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d76af4e-adc5-469d-bf5e-091bcda5a900 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.726317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d76af4e-adc5-469d-bf5e-091bcda5a900 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.726941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d76af4e-adc5-469d-bf5e-091bcda5a900 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.727522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d76af4e-adc5-469d-bf5e-091bcda5a900 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.760422 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-307380e2-8d39-4c53-aa23-7d90a3873dba tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 204 len: 0 microversion: 2.91 time: 0.240058 Oct 29 02:51:35.764501 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 828/1724] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:51:35 2022] DELETE /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 02:51:35.899954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3d76af4e-adc5-469d-bf5e-091bcda5a900 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:35.908937 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3d76af4e-adc5-469d-bf5e-091bcda5a900 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1470 microversion: 2.1 time: 0.198000 Oct 29 02:51:35.921835 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 897/1725] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:35 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:35.921835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:35.921835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:35.935034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.935522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.936106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.937166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.937618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.938065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.943363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:35.948218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-042efea8-7867-48cf-8dbe-00d7ee9344a7 tempest-ListImagesTestJSON-1509899343 tempest-ListImagesTestJSON-1509899343-project] Calling method '.version_select at 0x7fe1a8864dc0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.019480 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-042efea8-7867-48cf-8dbe-00d7ee9344a7 tempest-ListImagesTestJSON-1509899343 tempest-ListImagesTestJSON-1509899343-project] 10.222.0.16 "GET /compute/v2.1/images/c6777954-04bd-4ae1-b363-bbcd09a3f6ab" status: 200 len: 784 microversion: 2.1 time: 0.253595 Oct 29 02:51:36.021850 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 829/1726] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:35 2022] GET /compute/v2.1/images/c6777954-04bd-4ae1-b363-bbcd09a3f6ab => generated 784 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:36.032071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:36.039192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e3be3745-89b5-4003-b0a0-4e3a6f646eb6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.039927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e3be3745-89b5-4003-b0a0-4e3a6f646eb6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:36.045320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:36.047179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:36.048254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3be3745-89b5-4003-b0a0-4e3a6f646eb6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.048741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3be3745-89b5-4003-b0a0-4e3a6f646eb6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.049164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3be3745-89b5-4003-b0a0-4e3a6f646eb6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.050067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3be3745-89b5-4003-b0a0-4e3a6f646eb6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.050730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3be3745-89b5-4003-b0a0-4e3a6f646eb6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.051312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3be3745-89b5-4003-b0a0-4e3a6f646eb6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.054663 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3966524f-0ca2-4de4-80da-9b43a6d177ee tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.143642 Oct 29 02:51:36.069830 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 898/1727] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:35 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:36.078079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-30545454-1b27-4072-ae2b-c6a19e6839e8 tempest-ListImagesTestJSON-1509899343 tempest-ListImagesTestJSON-1509899343-project] Calling method '.version_select at 0x7fe1acc9eca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.209741 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-30545454-1b27-4072-ae2b-c6a19e6839e8 tempest-ListImagesTestJSON-1509899343 tempest-ListImagesTestJSON-1509899343-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.152915 Oct 29 02:51:36.218290 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 899/1728] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/images => generated 445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:36.243040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ea796cb2-8fc4-4c8d-b4c4-972ce3a07d14 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.243714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ea796cb2-8fc4-4c8d-b4c4-972ce3a07d14 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:36.263615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea796cb2-8fc4-4c8d-b4c4-972ce3a07d14 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.267721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea796cb2-8fc4-4c8d-b4c4-972ce3a07d14 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.268709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea796cb2-8fc4-4c8d-b4c4-972ce3a07d14 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.269832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea796cb2-8fc4-4c8d-b4c4-972ce3a07d14 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.273616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea796cb2-8fc4-4c8d-b4c4-972ce3a07d14 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.274314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea796cb2-8fc4-4c8d-b4c4-972ce3a07d14 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.406573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e3be3745-89b5-4003-b0a0-4e3a6f646eb6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:36.416174 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e3be3745-89b5-4003-b0a0-4e3a6f646eb6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1308 microversion: 2.1 time: 0.394657 Oct 29 02:51:36.418376 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 830/1729] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:36.423442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.432507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:36.441211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.445382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.445856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.447488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.449716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.450253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.633167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:36.645663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:36.647853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:36.649289 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a6fe4175-4458-4ca0-a5db-0e9ee5340cd2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.229829 Oct 29 02:51:36.650567 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 831/1730] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:36.659314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c7e1d7bd-26b9-4228-8ed1-fb5cff6b48b8 tempest-ListImagesTestJSON-1509899343 tempest-ListImagesTestJSON-1509899343-project] Calling method '.version_select at 0x7fe1a8c07f70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.710819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ea796cb2-8fc4-4c8d-b4c4-972ce3a07d14 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:36.728516 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ea796cb2-8fc4-4c8d-b4c4-972ce3a07d14 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1324 microversion: 2.1 time: 0.516973 Oct 29 02:51:36.729955 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 900/1731] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1324 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:36.733077 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c7e1d7bd-26b9-4228-8ed1-fb5cff6b48b8 tempest-ListImagesTestJSON-1509899343 tempest-ListImagesTestJSON-1509899343-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.078269 Oct 29 02:51:36.734513 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 832/1732] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:36.736402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-512eb4d0-9f8d-4909-9d37-f7ba098ba197 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.737445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-512eb4d0-9f8d-4909-9d37-f7ba098ba197 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:36.739240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2e32a742-9303-4304-a76d-e75807536ee9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.739845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2e32a742-9303-4304-a76d-e75807536ee9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:36.749748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-512eb4d0-9f8d-4909-9d37-f7ba098ba197 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.750569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-512eb4d0-9f8d-4909-9d37-f7ba098ba197 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.751169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-512eb4d0-9f8d-4909-9d37-f7ba098ba197 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.752211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-512eb4d0-9f8d-4909-9d37-f7ba098ba197 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.753473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-512eb4d0-9f8d-4909-9d37-f7ba098ba197 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.755006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-512eb4d0-9f8d-4909-9d37-f7ba098ba197 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.764526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e32a742-9303-4304-a76d-e75807536ee9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.765305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e32a742-9303-4304-a76d-e75807536ee9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.766073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e32a742-9303-4304-a76d-e75807536ee9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.768184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e32a742-9303-4304-a76d-e75807536ee9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.768808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e32a742-9303-4304-a76d-e75807536ee9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.769434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e32a742-9303-4304-a76d-e75807536ee9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.990389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2e32a742-9303-4304-a76d-e75807536ee9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:37.001100 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2e32a742-9303-4304-a76d-e75807536ee9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 200 len: 1507 microversion: 2.1 time: 0.265395 Oct 29 02:51:37.003539 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 833/1733] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 1507 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:37.015670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1802532f-bf8f-4466-8b16-d09d73369bd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:37.016420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1802532f-bf8f-4466-8b16-d09d73369bd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:37.030566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1802532f-bf8f-4466-8b16-d09d73369bd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.031066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1802532f-bf8f-4466-8b16-d09d73369bd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.034366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1802532f-bf8f-4466-8b16-d09d73369bd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.035294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1802532f-bf8f-4466-8b16-d09d73369bd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.038102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1802532f-bf8f-4466-8b16-d09d73369bd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.038625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1802532f-bf8f-4466-8b16-d09d73369bd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.116595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-512eb4d0-9f8d-4909-9d37-f7ba098ba197 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:37.131689 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-512eb4d0-9f8d-4909-9d37-f7ba098ba197 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.400265 Oct 29 02:51:37.132398 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 901/1734] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:37.147366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b001592e-4ea0-47a1-8feb-9dbe8ef99dfc tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:37.148302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b001592e-4ea0-47a1-8feb-9dbe8ef99dfc tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: adaae0cd-6343-48ec-a887-ef5001a172ad] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:37.159744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b001592e-4ea0-47a1-8feb-9dbe8ef99dfc tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.160897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b001592e-4ea0-47a1-8feb-9dbe8ef99dfc tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.161574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b001592e-4ea0-47a1-8feb-9dbe8ef99dfc tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.162627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b001592e-4ea0-47a1-8feb-9dbe8ef99dfc tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.163281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b001592e-4ea0-47a1-8feb-9dbe8ef99dfc tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.163923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b001592e-4ea0-47a1-8feb-9dbe8ef99dfc tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.293264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1802532f-bf8f-4466-8b16-d09d73369bd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:37.301306 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1802532f-bf8f-4466-8b16-d09d73369bd5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1470 microversion: 2.1 time: 0.291985 Oct 29 02:51:37.318951 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 834/1735] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:37 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1470 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:37.324268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:37.324885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:37.333172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.333681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.334163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.334874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.335326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.335752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.480160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:37.490936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:37.492409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1dbe55d773a4e60b7ad0f0589cbc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9d23d263bb44b7a600166d113bf63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:37.508293 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7c7d4c55-10b4-470e-bffd-5a467a35180c tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 200 len: 1539 microversion: 2.91 time: 0.187910 Oct 29 02:51:37.510729 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 835/1736] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:37 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 1539 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:37.534732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20dfe4de-7504-485a-84ff-32984a6c219c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:37.535540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-20dfe4de-7504-485a-84ff-32984a6c219c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:37.551048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20dfe4de-7504-485a-84ff-32984a6c219c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.551860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20dfe4de-7504-485a-84ff-32984a6c219c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.552309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20dfe4de-7504-485a-84ff-32984a6c219c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.553071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20dfe4de-7504-485a-84ff-32984a6c219c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.553684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20dfe4de-7504-485a-84ff-32984a6c219c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.554173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20dfe4de-7504-485a-84ff-32984a6c219c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.691012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b001592e-4ea0-47a1-8feb-9dbe8ef99dfc tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:37.703357 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b001592e-4ea0-47a1-8feb-9dbe8ef99dfc tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/adaae0cd-6343-48ec-a887-ef5001a172ad" status: 200 len: 1507 microversion: 2.1 time: 0.569758 Oct 29 02:51:37.709354 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 902/1737] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:37 2022] GET /compute/v2.1/servers/adaae0cd-6343-48ec-a887-ef5001a172ad => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:37.722651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:37.725457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:37.743622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.744427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.745021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.746240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.746849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.750443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.914182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20dfe4de-7504-485a-84ff-32984a6c219c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:37.923420 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20dfe4de-7504-485a-84ff-32984a6c219c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1308 microversion: 2.1 time: 0.411565 Oct 29 02:51:37.941828 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 836/1738] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:37 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:37.945317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-556871af-271b-45b6-87a4-9e7d014a1bba req-2422ea94-0d7a-4f8f-b40c-06f522e3cc10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236d6444-122e-4926-b00b-2fd646ed9715", "tag": "e34003f1-cdfb-4f6e-9403-62dff5b693e5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:37.975768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-556871af-271b-45b6-87a4-9e7d014a1bba req-2422ea94-0d7a-4f8f-b40c-06f522e3cc10 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.976670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-556871af-271b-45b6-87a4-9e7d014a1bba req-2422ea94-0d7a-4f8f-b40c-06f522e3cc10 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.977317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-556871af-271b-45b6-87a4-9e7d014a1bba req-2422ea94-0d7a-4f8f-b40c-06f522e3cc10 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.992916 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-556871af-271b-45b6-87a4-9e7d014a1bba req-2422ea94-0d7a-4f8f-b40c-06f522e3cc10 service nova] Creating event network-changed:e34003f1-cdfb-4f6e-9403-62dff5b693e5 for instance 236d6444-122e-4926-b00b-2fd646ed9715 on n-h2-862964-4 Oct 29 02:51:38.009391 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-556871af-271b-45b6-87a4-9e7d014a1bba req-2422ea94-0d7a-4f8f-b40c-06f522e3cc10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072597 Oct 29 02:51:38.010780 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 837/1739] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:38.017038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17042aa5-0266-4035-9bb0-02c64f99acf9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:38.018085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-17042aa5-0266-4035-9bb0-02c64f99acf9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: adaae0cd-6343-48ec-a887-ef5001a172ad] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:38.036454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17042aa5-0266-4035-9bb0-02c64f99acf9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.037998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17042aa5-0266-4035-9bb0-02c64f99acf9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.039366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17042aa5-0266-4035-9bb0-02c64f99acf9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.040188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17042aa5-0266-4035-9bb0-02c64f99acf9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.040952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17042aa5-0266-4035-9bb0-02c64f99acf9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.041428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17042aa5-0266-4035-9bb0-02c64f99acf9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.118806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-17042aa5-0266-4035-9bb0-02c64f99acf9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: adaae0cd-6343-48ec-a887-ef5001a172ad] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:51:38.177380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:38.193693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:38.200389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:38.203532 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af2a11dd-7721-4058-b682-51722b9afc19 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.492164 Oct 29 02:51:38.204937 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 903/1740] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:37 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:38.238443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-70c37dff-0005-4258-86e8-da10c99cae44 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:38.242120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-70c37dff-0005-4258-86e8-da10c99cae44 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:38.270636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c37dff-0005-4258-86e8-da10c99cae44 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.272027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c37dff-0005-4258-86e8-da10c99cae44 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.274187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c37dff-0005-4258-86e8-da10c99cae44 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.282492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c37dff-0005-4258-86e8-da10c99cae44 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.287446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c37dff-0005-4258-86e8-da10c99cae44 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.289334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c37dff-0005-4258-86e8-da10c99cae44 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.320756 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-17042aa5-0266-4035-9bb0-02c64f99acf9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/adaae0cd-6343-48ec-a887-ef5001a172ad" status: 204 len: 0 microversion: 2.1 time: 0.307736 Oct 29 02:51:38.326658 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 838/1741] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:38 2022] DELETE /compute/v2.1/servers/adaae0cd-6343-48ec-a887-ef5001a172ad => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:51:38.332593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-08f9d3ea-2a58-4e4d-9912-1fc0c9313911 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:38.333339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-08f9d3ea-2a58-4e4d-9912-1fc0c9313911 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:38.339718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:38.341950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08f9d3ea-2a58-4e4d-9912-1fc0c9313911 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.342566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08f9d3ea-2a58-4e4d-9912-1fc0c9313911 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.343005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08f9d3ea-2a58-4e4d-9912-1fc0c9313911 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.343696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08f9d3ea-2a58-4e4d-9912-1fc0c9313911 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.344136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08f9d3ea-2a58-4e4d-9912-1fc0c9313911 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.344551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08f9d3ea-2a58-4e4d-9912-1fc0c9313911 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.523310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-08f9d3ea-2a58-4e4d-9912-1fc0c9313911 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:38.538810 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-08f9d3ea-2a58-4e4d-9912-1fc0c9313911 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.209064 Oct 29 02:51:38.539208 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 839/1742] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:38 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:38.548094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6060eca7-6772-4185-acf1-a01c4701d020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:38.548697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6060eca7-6772-4185-acf1-a01c4701d020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:38.563266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060eca7-6772-4185-acf1-a01c4701d020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.565589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060eca7-6772-4185-acf1-a01c4701d020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.568114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060eca7-6772-4185-acf1-a01c4701d020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.568937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060eca7-6772-4185-acf1-a01c4701d020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.569396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060eca7-6772-4185-acf1-a01c4701d020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.570048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060eca7-6772-4185-acf1-a01c4701d020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.628545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:38.664212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=16 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:38.714909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-70c37dff-0005-4258-86e8-da10c99cae44 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:38.727480 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-70c37dff-0005-4258-86e8-da10c99cae44 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1324 microversion: 2.1 time: 0.518268 Oct 29 02:51:38.728725 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 904/1743] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:38 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1324 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:38.741989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c6a8d600-ee32-4101-a698-c3a25bc201cd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:38.741989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c6a8d600-ee32-4101-a698-c3a25bc201cd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:38.748025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6a8d600-ee32-4101-a698-c3a25bc201cd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.748637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6a8d600-ee32-4101-a698-c3a25bc201cd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.749111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6a8d600-ee32-4101-a698-c3a25bc201cd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.749833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6a8d600-ee32-4101-a698-c3a25bc201cd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.750294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6a8d600-ee32-4101-a698-c3a25bc201cd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.750709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6a8d600-ee32-4101-a698-c3a25bc201cd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.801427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c6a8d600-ee32-4101-a698-c3a25bc201cd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:51:38.805087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6060eca7-6772-4185-acf1-a01c4701d020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:38.815899 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6060eca7-6772-4185-acf1-a01c4701d020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1470 microversion: 2.1 time: 0.274592 Oct 29 02:51:38.816820 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 840/1744] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:38 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1470 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:38.821916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:38.822731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] [instance: c50495a0-6a28-4904-a856-768d30c4a6ec] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:38.831651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.833125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.833836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.835354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.836360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.836962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.856544 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] HTTP exception thrown: Instance c50495a0-6a28-4904-a856-768d30c4a6ec could not be found. Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Request method failure captured: Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec HTTP/1.1 Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJRf4MdZ_W1rsaLhSBIO_qgxw7LgWcw5DN6b5-6bqHGqeFY75ysuF0q6wJGL8wqcjKoRSn0KsVTVVEKbw4R67kwZ-BkCTWhAA4bxqIXuwfqIvzrIDXnnlx8SiC5EckrNiDoE8hkNY06y7EwDB6XJTc7Rdv5Tyb3UPxlG5wZx16q_gZQ Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.91 Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 7f9d23d263bb44b7a600166d113bf63b Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-968730140 Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:51:38.858711 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7f9d23d263bb44b7a600166d113bf63b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7f9d23d263bb44b7a600166d113bf63b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7f9d23d263bb44b7a600166d113bf63b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7f9d23d263bb44b7a600166d113bf63b"}]}] Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-968730140 Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 7f9d23d263bb44b7a600166d113bf63b Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-968730140 Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-UnshelveToHostMultiNodesTest-968730140-project Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: e1dbe55d773a4e60b7ad0f0589cbc9e8 Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-968730140-project Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance c50495a0-6a28-4904-a856-768d30c4a6ec could not be found. Oct 29 02:51:38.860500 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c50495a0-6a28-4904-a856-768d30c4a6ec'} Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50495a0-6a28-4904-a856-768d30c4a6ec could not be found. Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:38.861496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50495a0-6a28-4904-a856-768d30c4a6ec could not be found. Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50495a0-6a28-4904-a856-768d30c4a6ec could not be found. Oct 29 02:51:38.863338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:38.867144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] Returning 404 to user: Instance c50495a0-6a28-4904-a856-768d30c4a6ec could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:38.868332 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6094a717-cf6b-4ce9-a2ae-9d62f1afe0f1 tempest-UnshelveToHostMultiNodesTest-968730140 tempest-UnshelveToHostMultiNodesTest-968730140-project] 10.222.0.16 "GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec" status: 404 len: 111 microversion: 2.91 time: 0.050390 Oct 29 02:51:38.873755 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 841/1745] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:38 2022] GET /compute/v2.1/servers/c50495a0-6a28-4904-a856-768d30c4a6ec => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:51:38.954296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4804a67d-c40a-4fc0-ac02-b600fd3de090 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:38.954935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4804a67d-c40a-4fc0-ac02-b600fd3de090 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:38.970439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4804a67d-c40a-4fc0-ac02-b600fd3de090 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.970943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4804a67d-c40a-4fc0-ac02-b600fd3de090 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.971466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4804a67d-c40a-4fc0-ac02-b600fd3de090 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.972724 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c6a8d600-ee32-4101-a698-c3a25bc201cd tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2" status: 204 len: 0 microversion: 2.1 time: 0.240595 Oct 29 02:51:38.973196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4804a67d-c40a-4fc0-ac02-b600fd3de090 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.973646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4804a67d-c40a-4fc0-ac02-b600fd3de090 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.974104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4804a67d-c40a-4fc0-ac02-b600fd3de090 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.974801 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 905/1746] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:38 2022] DELETE /compute/v2.1/servers/8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:51:39.138499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4804a67d-c40a-4fc0-ac02-b600fd3de090 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:39.145793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1551269554", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "db5f338b-a308-4166-9271-ad64e0e546be"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:39.146534 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4804a67d-c40a-4fc0-ac02-b600fd3de090 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1308 microversion: 2.1 time: 0.197378 Oct 29 02:51:39.167312 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 842/1747] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:38 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:39.220470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] validate_networks() for [('db5f338b-a308-4166-9271-ad64e0e546be', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:51:39.239831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:39.240508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:39.256857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.257368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.260757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.261605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.262111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.262794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.520392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:39.538408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:39.540077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:39.541560 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5d9d8a0d-446f-453a-b5f1-d0ebc39d802c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.312711 Oct 29 02:51:39.542159 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 843/1748] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:39 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:39.571621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-499af0bf-3af9-46ae-bde2-d3709cfc94d9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:39.572229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-499af0bf-3af9-46ae-bde2-d3709cfc94d9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:39.586820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499af0bf-3af9-46ae-bde2-d3709cfc94d9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.587308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499af0bf-3af9-46ae-bde2-d3709cfc94d9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.587738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499af0bf-3af9-46ae-bde2-d3709cfc94d9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.588443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499af0bf-3af9-46ae-bde2-d3709cfc94d9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.591167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499af0bf-3af9-46ae-bde2-d3709cfc94d9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.591853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499af0bf-3af9-46ae-bde2-d3709cfc94d9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.853679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:51:39.854159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:51:39.854587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:51:39.855828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:51:39.856287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:51:39.868277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.868764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.869191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.869952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.870727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.871267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.871480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-499af0bf-3af9-46ae-bde2-d3709cfc94d9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:39.886915 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-499af0bf-3af9-46ae-bde2-d3709cfc94d9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.327242 Oct 29 02:51:39.887511 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 844/1749] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:39 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:39.892106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-5b379fd3-cb06-43de-8aa4-bcfae0a03ae6 req-1a4d0a31-47de-442b-b9f9-290642f661da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1782e279-7a4c-47a0-983e-7e07b34162a6", "name": "network-vif-plugged", "status": "completed", "tag": "04204f29-7f5c-4dd3-bbe2-d9c1f52c66e8"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:39.901632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5b379fd3-cb06-43de-8aa4-bcfae0a03ae6 req-1a4d0a31-47de-442b-b9f9-290642f661da service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.902356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5b379fd3-cb06-43de-8aa4-bcfae0a03ae6 req-1a4d0a31-47de-442b-b9f9-290642f661da service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.902984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5b379fd3-cb06-43de-8aa4-bcfae0a03ae6 req-1a4d0a31-47de-442b-b9f9-290642f661da service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.908675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Getting quotas for project a4b218a2276a4bb9acd9c1b0cfa3b5a8. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:51:39.914322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Getting quotas for user f0790d41f1d6452c92dc3d3dcc8d0af6 and project a4b218a2276a4bb9acd9c1b0cfa3b5a8. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:51:39.917036 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-5b379fd3-cb06-43de-8aa4-bcfae0a03ae6 req-1a4d0a31-47de-442b-b9f9-290642f661da service nova] Creating event network-vif-plugged:04204f29-7f5c-4dd3-bbe2-d9c1f52c66e8 for instance 1782e279-7a4c-47a0-983e-7e07b34162a6 on n-h2-862964-4 Oct 29 02:51:39.922459 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-5b379fd3-cb06-43de-8aa4-bcfae0a03ae6 req-1a4d0a31-47de-442b-b9f9-290642f661da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033528 Oct 29 02:51:39.923989 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 845/1750] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:39.930707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-202006e1-23c4-4dc9-a27b-5bba256148f8 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:39.932294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-202006e1-23c4-4dc9-a27b-5bba256148f8 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:39.934966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Going to run 2 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:51:39.937529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: fa3632ea-9875-4193-8b4e-3917063ba265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:51:39.940065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-202006e1-23c4-4dc9-a27b-5bba256148f8 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.940717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-202006e1-23c4-4dc9-a27b-5bba256148f8 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.941641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-202006e1-23c4-4dc9-a27b-5bba256148f8 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.942542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-202006e1-23c4-4dc9-a27b-5bba256148f8 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.943219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-202006e1-23c4-4dc9-a27b-5bba256148f8 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.944390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-202006e1-23c4-4dc9-a27b-5bba256148f8 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.976773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=fa3632ea-9875-4193-8b4e-3917063ba265,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:51:40.062702 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f0feb359-5828-4fc8-8d58-af48c8484930 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.920832 Oct 29 02:51:40.063983 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 906/1751] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:51:39 2022] POST /compute/v2.1/servers => generated 32 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 29 02:51:40.077385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0f9c5346-d73a-42de-b0a1-03c3ca5a39b6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:40.083866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0f9c5346-d73a-42de-b0a1-03c3ca5a39b6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:40.093106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f9c5346-d73a-42de-b0a1-03c3ca5a39b6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:40.093769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f9c5346-d73a-42de-b0a1-03c3ca5a39b6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:40.094434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f9c5346-d73a-42de-b0a1-03c3ca5a39b6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:40.095308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f9c5346-d73a-42de-b0a1-03c3ca5a39b6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:40.095918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f9c5346-d73a-42de-b0a1-03c3ca5a39b6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:40.096636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f9c5346-d73a-42de-b0a1-03c3ca5a39b6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:40.316250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0f9c5346-d73a-42de-b0a1-03c3ca5a39b6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:40.327919 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0f9c5346-d73a-42de-b0a1-03c3ca5a39b6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1470 microversion: 2.1 time: 0.260381 Oct 29 02:51:40.347716 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 907/1752] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:40 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:40.357764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-202006e1-23c4-4dc9-a27b-5bba256148f8 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:40.361505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:40.381482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7074b09a-7506-4485-a4e5-fe2e6081d3c9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:40.388808 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-202006e1-23c4-4dc9-a27b-5bba256148f8 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1324 microversion: 2.1 time: 0.458213 Oct 29 02:51:40.394265 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 846/1753] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:39 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1324 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:40.405623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7074b09a-7506-4485-a4e5-fe2e6081d3c9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:40.408725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7074b09a-7506-4485-a4e5-fe2e6081d3c9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Searching by: {'deleted': False, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:51:40.415631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d1581ce4-0579-481c-a38c-a0b02a3a2e7f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:40.416902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d1581ce4-0579-481c-a38c-a0b02a3a2e7f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:40.437603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1581ce4-0579-481c-a38c-a0b02a3a2e7f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:40.438674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1581ce4-0579-481c-a38c-a0b02a3a2e7f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:40.439324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1581ce4-0579-481c-a38c-a0b02a3a2e7f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:40.440531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1581ce4-0579-481c-a38c-a0b02a3a2e7f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:40.441269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1581ce4-0579-481c-a38c-a0b02a3a2e7f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:40.441962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1581ce4-0579-481c-a38c-a0b02a3a2e7f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:40.443537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7074b09a-7506-4485-a4e5-fe2e6081d3c9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:40.444028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7074b09a-7506-4485-a4e5-fe2e6081d3c9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:40.444462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7074b09a-7506-4485-a4e5-fe2e6081d3c9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:40.445749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7074b09a-7506-4485-a4e5-fe2e6081d3c9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:40.446232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7074b09a-7506-4485-a4e5-fe2e6081d3c9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:40.446652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7074b09a-7506-4485-a4e5-fe2e6081d3c9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:40.522166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-7074b09a-7506-4485-a4e5-fe2e6081d3c9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:51:40.597548 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7074b09a-7506-4485-a4e5-fe2e6081d3c9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.247213 Oct 29 02:51:40.607318 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 908/1754] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 02:51:40 2022] GET /compute/v2.1/servers => generated 1337 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:40.614578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:40.616253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:40.624333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:40.624873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:40.625405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:40.626153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:40.626609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:40.627124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:40.881901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:40.903068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:40.904946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:40.906585 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59c976a1-1467-4253-9eb3-47f12d9204b7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.297193 Oct 29 02:51:40.907662 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 909/1755] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:40 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:40.926748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f4c632e4-bfcf-4240-b62f-843a9515077b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:40.927629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f4c632e4-bfcf-4240-b62f-843a9515077b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:41.417404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1581ce4-0579-481c-a38c-a0b02a3a2e7f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:41.431721 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d1581ce4-0579-481c-a38c-a0b02a3a2e7f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1308 microversion: 2.1 time: 1.033579 Oct 29 02:51:41.433214 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 847/1756] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:40 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1308 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:41.450962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1bdc7322-29a5-4398-af9a-0cd9d87e32f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:41.453819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1bdc7322-29a5-4398-af9a-0cd9d87e32f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:41.476254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bdc7322-29a5-4398-af9a-0cd9d87e32f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:41.478939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bdc7322-29a5-4398-af9a-0cd9d87e32f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:41.479724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bdc7322-29a5-4398-af9a-0cd9d87e32f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:41.482178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bdc7322-29a5-4398-af9a-0cd9d87e32f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:41.483847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bdc7322-29a5-4398-af9a-0cd9d87e32f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:41.484833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bdc7322-29a5-4398-af9a-0cd9d87e32f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:41.901016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f4c632e4-bfcf-4240-b62f-843a9515077b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:41.913728 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f4c632e4-bfcf-4240-b62f-843a9515077b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1218 microversion: 2.1 time: 1.004630 Oct 29 02:51:41.915304 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 910/1757] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:40 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1218 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:41.928872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-172e2ad7-cf9a-4e0e-807b-ae80ef7df394 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:41.932080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-172e2ad7-cf9a-4e0e-807b-ae80ef7df394 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:41.948882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-172e2ad7-cf9a-4e0e-807b-ae80ef7df394 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:41.954187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-172e2ad7-cf9a-4e0e-807b-ae80ef7df394 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:41.955023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-172e2ad7-cf9a-4e0e-807b-ae80ef7df394 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:41.962825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-172e2ad7-cf9a-4e0e-807b-ae80ef7df394 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:41.963488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-172e2ad7-cf9a-4e0e-807b-ae80ef7df394 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:41.964050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-172e2ad7-cf9a-4e0e-807b-ae80ef7df394 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:42.373230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-172e2ad7-cf9a-4e0e-807b-ae80ef7df394 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:42.382842 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-172e2ad7-cf9a-4e0e-807b-ae80ef7df394 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.466063 Oct 29 02:51:42.383566 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 911/1758] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:41 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:42.389071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c58b0cc-9e50-4bec-870e-c3d7680f67aa tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:42.389836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6c58b0cc-9e50-4bec-870e-c3d7680f67aa tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:42.396174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c58b0cc-9e50-4bec-870e-c3d7680f67aa tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:42.396923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c58b0cc-9e50-4bec-870e-c3d7680f67aa tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:42.397457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c58b0cc-9e50-4bec-870e-c3d7680f67aa tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:42.398473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c58b0cc-9e50-4bec-870e-c3d7680f67aa tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:42.399056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c58b0cc-9e50-4bec-870e-c3d7680f67aa tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:42.399576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c58b0cc-9e50-4bec-870e-c3d7680f67aa tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:42.593090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1bdc7322-29a5-4398-af9a-0cd9d87e32f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:42.609088 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1bdc7322-29a5-4398-af9a-0cd9d87e32f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 1.174607 Oct 29 02:51:42.612674 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 848/1759] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:41 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:42.626267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:42.638222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:42.654861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:42.655592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:42.656376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:42.657323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:42.658096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:42.658856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:42.687719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6c58b0cc-9e50-4bec-870e-c3d7680f67aa tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:42.698763 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6c58b0cc-9e50-4bec-870e-c3d7680f67aa tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1324 microversion: 2.1 time: 0.311983 Oct 29 02:51:42.700838 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 912/1760] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:42 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:42.714202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6da53d3a-74ae-401f-932e-3212f1be76e7 req-b296ff8c-e1a5-4dc3-8133-8593381230bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2", "name": "network-vif-deleted", "tag": "035620f0-56eb-4852-8f0a-fa8b570f59f2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:42.743890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6da53d3a-74ae-401f-932e-3212f1be76e7 req-b296ff8c-e1a5-4dc3-8133-8593381230bb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:42.744819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6da53d3a-74ae-401f-932e-3212f1be76e7 req-b296ff8c-e1a5-4dc3-8133-8593381230bb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:42.745778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6da53d3a-74ae-401f-932e-3212f1be76e7 req-b296ff8c-e1a5-4dc3-8133-8593381230bb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:42.798656 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6da53d3a-74ae-401f-932e-3212f1be76e7 req-b296ff8c-e1a5-4dc3-8133-8593381230bb service nova] Creating event network-vif-deleted:035620f0-56eb-4852-8f0a-fa8b570f59f2 for instance 8f8e6ab2-7ba7-43a8-aab2-ebc0bf8574e2 on n-h1-862964-4 Oct 29 02:51:42.816940 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6da53d3a-74ae-401f-932e-3212f1be76e7 req-b296ff8c-e1a5-4dc3-8133-8593381230bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111702 Oct 29 02:51:42.832213 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 913/1761] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:42.838604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c4049bc7-68d9-432a-9bae-301950294429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:42.841844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c4049bc7-68d9-432a-9bae-301950294429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:42.855947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4049bc7-68d9-432a-9bae-301950294429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:42.856433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4049bc7-68d9-432a-9bae-301950294429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:42.859590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4049bc7-68d9-432a-9bae-301950294429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:42.860726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4049bc7-68d9-432a-9bae-301950294429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:42.861347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4049bc7-68d9-432a-9bae-301950294429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:42.862286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4049bc7-68d9-432a-9bae-301950294429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:43.304637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c4049bc7-68d9-432a-9bae-301950294429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:43.319665 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c4049bc7-68d9-432a-9bae-301950294429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1308 microversion: 2.1 time: 0.486155 Oct 29 02:51:43.322445 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 914/1762] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:42 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1308 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:43.329343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b29d8296-c801-4a41-8244-7a588c489295 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:43.331551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b29d8296-c801-4a41-8244-7a588c489295 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:43.358461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29d8296-c801-4a41-8244-7a588c489295 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:43.373146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29d8296-c801-4a41-8244-7a588c489295 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:43.374049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29d8296-c801-4a41-8244-7a588c489295 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:43.377936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29d8296-c801-4a41-8244-7a588c489295 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:43.379114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29d8296-c801-4a41-8244-7a588c489295 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:43.380470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29d8296-c801-4a41-8244-7a588c489295 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:43.511831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b29d8296-c801-4a41-8244-7a588c489295 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:43.565680 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b29d8296-c801-4a41-8244-7a588c489295 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1276 microversion: 2.1 time: 0.236976 Oct 29 02:51:43.567562 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 915/1763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:43 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:43.576847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3b5b2a14-a134-4d83-80d7-7a861b17ab9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:43.577504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b5b2a14-a134-4d83-80d7-7a861b17ab9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:43.594375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5b2a14-a134-4d83-80d7-7a861b17ab9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:43.595566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5b2a14-a134-4d83-80d7-7a861b17ab9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:43.596266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5b2a14-a134-4d83-80d7-7a861b17ab9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:43.597269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5b2a14-a134-4d83-80d7-7a861b17ab9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:43.598032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5b2a14-a134-4d83-80d7-7a861b17ab9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:43.598789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5b2a14-a134-4d83-80d7-7a861b17ab9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:43.605067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:43.785513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:43.809724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:43.818535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:43.822739 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ca65ad61-4878-4402-be91-3b3ff58a2b83 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 1.199614 Oct 29 02:51:43.823696 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 849/1764] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:42 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:43.842609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7bc7362a-b8a6-4d65-bf39-c5f09c62fd8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:43.846041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7bc7362a-b8a6-4d65-bf39-c5f09c62fd8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:43.868780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc7362a-b8a6-4d65-bf39-c5f09c62fd8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:43.875280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc7362a-b8a6-4d65-bf39-c5f09c62fd8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:43.878355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc7362a-b8a6-4d65-bf39-c5f09c62fd8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:43.879882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc7362a-b8a6-4d65-bf39-c5f09c62fd8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:43.880471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc7362a-b8a6-4d65-bf39-c5f09c62fd8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:43.880901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc7362a-b8a6-4d65-bf39-c5f09c62fd8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:44.638211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b5b2a14-a134-4d83-80d7-7a861b17ab9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:44.654263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7bc7362a-b8a6-4d65-bf39-c5f09c62fd8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:44.655773 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3b5b2a14-a134-4d83-80d7-7a861b17ab9e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 1.084859 Oct 29 02:51:44.656400 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 916/1765] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:43 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:44.681945 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7bc7362a-b8a6-4d65-bf39-c5f09c62fd8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.854776 Oct 29 02:51:44.683036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5903ba64-624a-4c0e-93ae-a32fe2266800 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:44.686767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5903ba64-624a-4c0e-93ae-a32fe2266800 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:44.689001 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 850/1766] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:43 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:44.699063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1261e390-344c-41ba-9bfe-f0ae41710e5e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:44.700203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1261e390-344c-41ba-9bfe-f0ae41710e5e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:44.719086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5903ba64-624a-4c0e-93ae-a32fe2266800 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:44.719586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5903ba64-624a-4c0e-93ae-a32fe2266800 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:44.720026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5903ba64-624a-4c0e-93ae-a32fe2266800 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:44.720742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5903ba64-624a-4c0e-93ae-a32fe2266800 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:44.729113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5903ba64-624a-4c0e-93ae-a32fe2266800 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:44.729560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5903ba64-624a-4c0e-93ae-a32fe2266800 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:44.731244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1261e390-344c-41ba-9bfe-f0ae41710e5e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:44.731738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1261e390-344c-41ba-9bfe-f0ae41710e5e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:44.732167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1261e390-344c-41ba-9bfe-f0ae41710e5e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:44.732877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1261e390-344c-41ba-9bfe-f0ae41710e5e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:44.746748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1261e390-344c-41ba-9bfe-f0ae41710e5e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:44.751769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1261e390-344c-41ba-9bfe-f0ae41710e5e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:45.127271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1261e390-344c-41ba-9bfe-f0ae41710e5e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:45.142200 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1261e390-344c-41ba-9bfe-f0ae41710e5e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1308 microversion: 2.1 time: 0.450174 Oct 29 02:51:45.145768 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 851/1767] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:44 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:45.163626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7c595bf0-43f2-4db2-b286-2842de39289e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:45.164553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7c595bf0-43f2-4db2-b286-2842de39289e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:45.187723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c595bf0-43f2-4db2-b286-2842de39289e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:45.189999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c595bf0-43f2-4db2-b286-2842de39289e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:45.191736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c595bf0-43f2-4db2-b286-2842de39289e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:45.192706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c595bf0-43f2-4db2-b286-2842de39289e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:45.194333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c595bf0-43f2-4db2-b286-2842de39289e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:45.196666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c595bf0-43f2-4db2-b286-2842de39289e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:45.432675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5903ba64-624a-4c0e-93ae-a32fe2266800 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:45.451846 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5903ba64-624a-4c0e-93ae-a32fe2266800 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1521 microversion: 2.1 time: 0.770643 Oct 29 02:51:45.452746 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 917/1768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:44 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1521 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:45.463399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-521e68a0-f102-4fdf-a00a-49edbc13120c req-8b408285-4b39-48ee-bea1-649244080ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adaae0cd-6343-48ec-a887-ef5001a172ad", "name": "network-vif-deleted", "tag": "02f2ebeb-15a0-4008-aef4-802678de94f4"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:45.484151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-521e68a0-f102-4fdf-a00a-49edbc13120c req-8b408285-4b39-48ee-bea1-649244080ef8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:45.485023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-521e68a0-f102-4fdf-a00a-49edbc13120c req-8b408285-4b39-48ee-bea1-649244080ef8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:45.485673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-521e68a0-f102-4fdf-a00a-49edbc13120c req-8b408285-4b39-48ee-bea1-649244080ef8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:45.504001 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-521e68a0-f102-4fdf-a00a-49edbc13120c req-8b408285-4b39-48ee-bea1-649244080ef8 service nova] Creating event network-vif-deleted:02f2ebeb-15a0-4008-aef4-802678de94f4 for instance adaae0cd-6343-48ec-a887-ef5001a172ad on n-h2-862964-4 Oct 29 02:51:45.511495 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-521e68a0-f102-4fdf-a00a-49edbc13120c req-8b408285-4b39-48ee-bea1-649244080ef8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056486 Oct 29 02:51:45.512406 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 918/1769] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:45.519829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:45.520592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:45.529565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:45.530055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:45.530489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:45.531663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:45.531990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:45.532414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:45.609431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7c595bf0-43f2-4db2-b286-2842de39289e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:45.623983 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7c595bf0-43f2-4db2-b286-2842de39289e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1318 microversion: 2.1 time: 0.476673 Oct 29 02:51:45.625066 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 852/1770] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:45 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:45.907094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b638d334-91a8-4c61-bc15-9efcc414f416 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:45.925976 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b638d334-91a8-4c61-bc15-9efcc414f416 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.299390 Oct 29 02:51:45.926922 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 853/1771] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:45.932388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8c6f7121-66ea-4215-a69c-65926e18cca1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:45.936175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:45.948686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8c6f7121-66ea-4215-a69c-65926e18cca1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:45.954955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:45.960970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:45.973970 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5ea421e-f539-487d-9c9a-fd37ed99b7f1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.460097 Oct 29 02:51:45.995550 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 919/1772] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:45 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:46.009584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c6f7121-66ea-4215-a69c-65926e18cca1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.010143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c6f7121-66ea-4215-a69c-65926e18cca1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.010614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c6f7121-66ea-4215-a69c-65926e18cca1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.011318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c6f7121-66ea-4215-a69c-65926e18cca1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.011771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c6f7121-66ea-4215-a69c-65926e18cca1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.012184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c6f7121-66ea-4215-a69c-65926e18cca1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.018047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-737dab6f-a91a-454f-ab76-f7a322d32cc1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:46.018899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-737dab6f-a91a-454f-ab76-f7a322d32cc1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:46.025496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737dab6f-a91a-454f-ab76-f7a322d32cc1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.026108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737dab6f-a91a-454f-ab76-f7a322d32cc1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.026623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737dab6f-a91a-454f-ab76-f7a322d32cc1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.027442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737dab6f-a91a-454f-ab76-f7a322d32cc1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.027978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737dab6f-a91a-454f-ab76-f7a322d32cc1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.028452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737dab6f-a91a-454f-ab76-f7a322d32cc1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.306662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8c6f7121-66ea-4215-a69c-65926e18cca1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:46.328417 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8c6f7121-66ea-4215-a69c-65926e18cca1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1521 microversion: 2.1 time: 0.399588 Oct 29 02:51:46.329015 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 854/1773] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:45 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:46.353456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b93e7051-2349-41eb-a4c0-e0ad848fe60a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:46.354111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b93e7051-2349-41eb-a4c0-e0ad848fe60a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:46.364638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b93e7051-2349-41eb-a4c0-e0ad848fe60a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.365129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b93e7051-2349-41eb-a4c0-e0ad848fe60a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.367371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b93e7051-2349-41eb-a4c0-e0ad848fe60a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.368241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b93e7051-2349-41eb-a4c0-e0ad848fe60a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.368921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b93e7051-2349-41eb-a4c0-e0ad848fe60a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.369361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b93e7051-2349-41eb-a4c0-e0ad848fe60a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.630952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-737dab6f-a91a-454f-ab76-f7a322d32cc1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:46.642613 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-737dab6f-a91a-454f-ab76-f7a322d32cc1 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.643831 Oct 29 02:51:46.653583 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 920/1774] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:45 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:46.664105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0bb61c65-ef32-4d20-804c-e28f6e4bb0ba tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:46.701531 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0bb61c65-ef32-4d20-804c-e28f6e4bb0ba tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.046421 Oct 29 02:51:46.703479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b93e7051-2349-41eb-a4c0-e0ad848fe60a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:46.712028 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 921/1775] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 02:51:46 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:46.716900 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b93e7051-2349-41eb-a4c0-e0ad848fe60a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.369954 Oct 29 02:51:46.717111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f720e64c-3aed-48ad-9ec8-916d34958a5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:46.717529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f720e64c-3aed-48ad-9ec8-916d34958a5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:46.720332 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 855/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:46 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:46.725642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f167dc6d-fbf3-45b6-9f2e-b02fc6284c9d req-566adb96-d1cd-4f4d-837f-ed8ea65c5e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236d6444-122e-4926-b00b-2fd646ed9715", "name": "network-vif-plugged", "status": "completed", "tag": "e34003f1-cdfb-4f6e-9403-62dff5b693e5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:46.731576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f720e64c-3aed-48ad-9ec8-916d34958a5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.732063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f720e64c-3aed-48ad-9ec8-916d34958a5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.732489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f720e64c-3aed-48ad-9ec8-916d34958a5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.733186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f720e64c-3aed-48ad-9ec8-916d34958a5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.733633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f720e64c-3aed-48ad-9ec8-916d34958a5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.734077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f720e64c-3aed-48ad-9ec8-916d34958a5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.752232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f167dc6d-fbf3-45b6-9f2e-b02fc6284c9d req-566adb96-d1cd-4f4d-837f-ed8ea65c5e99 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.753026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f167dc6d-fbf3-45b6-9f2e-b02fc6284c9d req-566adb96-d1cd-4f4d-837f-ed8ea65c5e99 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.754786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f167dc6d-fbf3-45b6-9f2e-b02fc6284c9d req-566adb96-d1cd-4f4d-837f-ed8ea65c5e99 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.790542 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f167dc6d-fbf3-45b6-9f2e-b02fc6284c9d req-566adb96-d1cd-4f4d-837f-ed8ea65c5e99 service nova] Creating event network-vif-plugged:e34003f1-cdfb-4f6e-9403-62dff5b693e5 for instance 236d6444-122e-4926-b00b-2fd646ed9715 on n-h2-862964-4 Oct 29 02:51:46.800826 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f167dc6d-fbf3-45b6-9f2e-b02fc6284c9d req-566adb96-d1cd-4f4d-837f-ed8ea65c5e99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078834 Oct 29 02:51:46.802750 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 856/1777] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:46.812147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-015a43b1-0fd8-450e-8005-cf9a0df4ee76 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1400756934"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:46.816874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-015a43b1-0fd8-450e-8005-cf9a0df4ee76 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:46.824401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-015a43b1-0fd8-450e-8005-cf9a0df4ee76 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.825197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-015a43b1-0fd8-450e-8005-cf9a0df4ee76 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.826050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-015a43b1-0fd8-450e-8005-cf9a0df4ee76 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.827059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-015a43b1-0fd8-450e-8005-cf9a0df4ee76 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.827717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-015a43b1-0fd8-450e-8005-cf9a0df4ee76 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.828336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-015a43b1-0fd8-450e-8005-cf9a0df4ee76 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.102293 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-015a43b1-0fd8-450e-8005-cf9a0df4ee76 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "POST /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6/action" status: 202 len: 0 microversion: 2.1 time: 0.297664 Oct 29 02:51:47.102970 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 857/1778] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:51:46 2022] POST /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:51:47.109514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-42fee3d9-bcb2-46ca-b802-4e726f3da6fa tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:47.110982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-42fee3d9-bcb2-46ca-b802-4e726f3da6fa tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:47.124010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fee3d9-bcb2-46ca-b802-4e726f3da6fa tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.125496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fee3d9-bcb2-46ca-b802-4e726f3da6fa tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.126058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fee3d9-bcb2-46ca-b802-4e726f3da6fa tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.126848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fee3d9-bcb2-46ca-b802-4e726f3da6fa tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.127367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fee3d9-bcb2-46ca-b802-4e726f3da6fa tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.127989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fee3d9-bcb2-46ca-b802-4e726f3da6fa tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.216451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f720e64c-3aed-48ad-9ec8-916d34958a5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:47.230671 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f720e64c-3aed-48ad-9ec8-916d34958a5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1308 microversion: 2.1 time: 0.517374 Oct 29 02:51:47.231649 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 922/1779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:46 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1308 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:47.236458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5921a21-59a6-4908-a50b-dc53bb9f5c06 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:47.244870 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e5921a21-59a6-4908-a50b-dc53bb9f5c06 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011967 Oct 29 02:51:47.246158 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 923/1780] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:47.251200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:47.252126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:47.262363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.263094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.263755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.265432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.266766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.267429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.385199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-42fee3d9-bcb2-46ca-b802-4e726f3da6fa tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:47.401436 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-42fee3d9-bcb2-46ca-b802-4e726f3da6fa tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1318 microversion: 2.1 time: 0.294364 Oct 29 02:51:47.412690 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 858/1781] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:47 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:47.442645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64cd569b-6703-4ad2-a590-51764d14836e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '.version_select at 0x7fe1a8aa3d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:47.646748 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-64cd569b-6703-4ad2-a590-51764d14836e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "DELETE /compute/v2.1/images/fe326bd4-0c2c-4c6e-9da4-8da1af72d580" status: 204 len: 0 microversion: 2.1 time: 0.225791 Oct 29 02:51:47.647702 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 859/1782] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:47 2022] DELETE /compute/v2.1/images/fe326bd4-0c2c-4c6e-9da4-8da1af72d580 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:51:47.655319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6a5febe9-fb97-40b1-8952-c05254721cb2 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:47.657512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:47.666510 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6a5febe9-fb97-40b1-8952-c05254721cb2 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015095 Oct 29 02:51:47.673329 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 860/1783] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:47.675013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:47.677543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:47.679470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2adaa1c-898d-4182-8c90-e19aab2d4677 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '.version_select at 0x7fe1a8a45280>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:47.680765 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a053164-d636-4b28-a735-66c0d38a50ea tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.432964 Oct 29 02:51:47.699800 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 924/1784] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:47 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:47.704879 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f2adaa1c-898d-4182-8c90-e19aab2d4677 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] HTTP exception thrown: Image not found. Oct 29 02:51:47.707862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-47056825-3fb2-46bd-96b6-edd38305c70d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:47.708620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-47056825-3fb2-46bd-96b6-edd38305c70d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2adaa1c-898d-4182-8c90-e19aab2d4677 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/images/fe326bd4-0c2c-4c6e-9da4-8da1af72d580 HTTP/1.1 Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:51:47.709950 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'fe326bd4-0c2c-4c6e-9da4-8da1af72d580'} Oct 29 02:51:47.711417 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:47.712438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fe326bd4-0c2c-4c6e-9da4-8da1af72d580 Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:47.713649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fe326bd4-0c2c-4c6e-9da4-8da1af72d580 could not be found. Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:47.716008 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:47.718741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2adaa1c-898d-4182-8c90-e19aab2d4677 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:47.721597 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f2adaa1c-898d-4182-8c90-e19aab2d4677 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/images/fe326bd4-0c2c-4c6e-9da4-8da1af72d580" status: 404 len: 62 microversion: 2.1 time: 0.037056 Oct 29 02:51:47.721597 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 861/1785] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:47 2022] GET /compute/v2.1/images/fe326bd4-0c2c-4c6e-9da4-8da1af72d580 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:51:47.722011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47056825-3fb2-46bd-96b6-edd38305c70d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.722011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47056825-3fb2-46bd-96b6-edd38305c70d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.722011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47056825-3fb2-46bd-96b6-edd38305c70d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.722011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47056825-3fb2-46bd-96b6-edd38305c70d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.722802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47056825-3fb2-46bd-96b6-edd38305c70d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.722802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47056825-3fb2-46bd-96b6-edd38305c70d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.738539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d70d8db-9e70-4e86-b834-71b1f643bf5d tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:47.789970 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d70d8db-9e70-4e86-b834-71b1f643bf5d tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.076725 Oct 29 02:51:47.801834 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 862/1786] 10.222.0.16 () {58 vars in 1165 bytes} [Sat Oct 29 02:51:47 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:47.801834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76a4ec97-14eb-4954-8b38-06cb056f1e7e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:47.801834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-76a4ec97-14eb-4954-8b38-06cb056f1e7e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:47.805750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76a4ec97-14eb-4954-8b38-06cb056f1e7e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.806289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76a4ec97-14eb-4954-8b38-06cb056f1e7e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.806717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76a4ec97-14eb-4954-8b38-06cb056f1e7e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.807505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76a4ec97-14eb-4954-8b38-06cb056f1e7e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.807955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76a4ec97-14eb-4954-8b38-06cb056f1e7e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.808673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76a4ec97-14eb-4954-8b38-06cb056f1e7e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:48.147259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-47056825-3fb2-46bd-96b6-edd38305c70d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:48.160661 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-47056825-3fb2-46bd-96b6-edd38305c70d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.459395 Oct 29 02:51:48.162141 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 925/1787] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:47 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:48.168556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8a038aef-06de-4ab7-a4ae-ec1a9ca5cc42 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:48.170005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8a038aef-06de-4ab7-a4ae-ec1a9ca5cc42 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:48.179985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a038aef-06de-4ab7-a4ae-ec1a9ca5cc42 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:48.180762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a038aef-06de-4ab7-a4ae-ec1a9ca5cc42 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:48.181418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a038aef-06de-4ab7-a4ae-ec1a9ca5cc42 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:48.182618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a038aef-06de-4ab7-a4ae-ec1a9ca5cc42 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:48.183518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a038aef-06de-4ab7-a4ae-ec1a9ca5cc42 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:48.184330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a038aef-06de-4ab7-a4ae-ec1a9ca5cc42 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:48.230845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-76a4ec97-14eb-4954-8b38-06cb056f1e7e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:48.243669 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-76a4ec97-14eb-4954-8b38-06cb056f1e7e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1533 microversion: 2.1 time: 0.451554 Oct 29 02:51:48.244535 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 863/1788] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:47 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1533 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:48.264225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2636677-98ce-4f52-afda-f3e83d172440 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:48.279485 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b2636677-98ce-4f52-afda-f3e83d172440 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033019 Oct 29 02:51:48.282019 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 864/1789] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:48.290109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-0d5772f7-3a81-4b6a-99da-6f206871c457 req-47180fd3-ce5d-4e47-be1a-ba8022c1f034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e79dac-7876-4e2d-913c-0662ffb235c9", "tag": "2f43e45f-e320-4fc5-9065-a0984991b317"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:48.316524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0d5772f7-3a81-4b6a-99da-6f206871c457 req-47180fd3-ce5d-4e47-be1a-ba8022c1f034 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:48.318664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0d5772f7-3a81-4b6a-99da-6f206871c457 req-47180fd3-ce5d-4e47-be1a-ba8022c1f034 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:48.319377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0d5772f7-3a81-4b6a-99da-6f206871c457 req-47180fd3-ce5d-4e47-be1a-ba8022c1f034 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:48.350899 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-0d5772f7-3a81-4b6a-99da-6f206871c457 req-47180fd3-ce5d-4e47-be1a-ba8022c1f034 service nova] Creating event network-changed:2f43e45f-e320-4fc5-9065-a0984991b317 for instance 34e79dac-7876-4e2d-913c-0662ffb235c9 on n-h1-862964-4 Oct 29 02:51:48.359001 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-0d5772f7-3a81-4b6a-99da-6f206871c457 req-47180fd3-ce5d-4e47-be1a-ba8022c1f034 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077321 Oct 29 02:51:48.360340 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 865/1790] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:48.367250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d91bfac6-3034-4fb6-92fc-7020e150c0a6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:48.368310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d91bfac6-3034-4fb6-92fc-7020e150c0a6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:48.377796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d91bfac6-3034-4fb6-92fc-7020e150c0a6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:48.378776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d91bfac6-3034-4fb6-92fc-7020e150c0a6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:48.379454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d91bfac6-3034-4fb6-92fc-7020e150c0a6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:48.380466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d91bfac6-3034-4fb6-92fc-7020e150c0a6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:48.381240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d91bfac6-3034-4fb6-92fc-7020e150c0a6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:48.381867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d91bfac6-3034-4fb6-92fc-7020e150c0a6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:48.742937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d91bfac6-3034-4fb6-92fc-7020e150c0a6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:48.751412 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d91bfac6-3034-4fb6-92fc-7020e150c0a6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1308 microversion: 2.1 time: 0.389549 Oct 29 02:51:48.766399 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 866/1791] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:48 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:48.773000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-448e0efe-4140-4843-b3ed-2b31f7bcf512 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:48.780321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8a038aef-06de-4ab7-a4ae-ec1a9ca5cc42 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:48.794071 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8a038aef-06de-4ab7-a4ae-ec1a9ca5cc42 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.629946 Oct 29 02:51:48.797843 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 926/1792] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:48 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:48.810116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eef2b1c9-297f-42de-8a0c-b027aa9a0e5e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:48.811926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eef2b1c9-297f-42de-8a0c-b027aa9a0e5e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:48.820537 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-448e0efe-4140-4843-b3ed-2b31f7bcf512 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.052518 Oct 29 02:51:48.821366 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 867/1793] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Oct 29 02:51:48 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:48.839069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eef2b1c9-297f-42de-8a0c-b027aa9a0e5e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:48.839248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:48.839979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eef2b1c9-297f-42de-8a0c-b027aa9a0e5e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:48.840102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:48.841180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eef2b1c9-297f-42de-8a0c-b027aa9a0e5e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:48.842410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eef2b1c9-297f-42de-8a0c-b027aa9a0e5e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:48.844000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eef2b1c9-297f-42de-8a0c-b027aa9a0e5e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:48.844970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eef2b1c9-297f-42de-8a0c-b027aa9a0e5e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:48.861371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:48.863352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:48.864245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:48.867099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:48.868743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:48.869413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.092583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eef2b1c9-297f-42de-8a0c-b027aa9a0e5e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:49.102601 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eef2b1c9-297f-42de-8a0c-b027aa9a0e5e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1318 microversion: 2.1 time: 0.301408 Oct 29 02:51:49.103611 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 927/1794] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:48 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:49.109979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-33b225e9-125b-4c9d-b763-b4c25eefa89f tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.123636 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-33b225e9-125b-4c9d-b763-b4c25eefa89f tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.018628 Oct 29 02:51:49.124220 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 928/1795] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:49.130059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-159b6c45-1a6f-4bf8-b7d8-853c0e380a5b req-cce15bb9-55fd-464b-b659-a9d17cb80425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce4caa1-3b78-4bcf-98e4-b4d9da71dfee", "name": "network-vif-unplugged", "status": "completed", "tag": "13168635-67a9-4cb0-a7c1-c8262d0cd5a5"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:49.142057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-159b6c45-1a6f-4bf8-b7d8-853c0e380a5b req-cce15bb9-55fd-464b-b659-a9d17cb80425 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.143191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-159b6c45-1a6f-4bf8-b7d8-853c0e380a5b req-cce15bb9-55fd-464b-b659-a9d17cb80425 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.143765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-159b6c45-1a6f-4bf8-b7d8-853c0e380a5b req-cce15bb9-55fd-464b-b659-a9d17cb80425 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.155695 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-159b6c45-1a6f-4bf8-b7d8-853c0e380a5b req-cce15bb9-55fd-464b-b659-a9d17cb80425 service nova] Creating event network-vif-unplugged:13168635-67a9-4cb0-a7c1-c8262d0cd5a5 for instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee on n-h1-862964-4 Oct 29 02:51:49.161193 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-159b6c45-1a6f-4bf8-b7d8-853c0e380a5b req-cce15bb9-55fd-464b-b659-a9d17cb80425 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035632 Oct 29 02:51:49.162047 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 929/1796] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:49.167465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-120e20ab-1f5e-4700-a306-4d946c57406e tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.171853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:49.175794 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-120e20ab-1f5e-4700-a306-4d946c57406e tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012450 Oct 29 02:51:49.177929 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 930/1797] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:49.187518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc95dba8-c2d7-4248-9c35-31f1737a47cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.188247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fc95dba8-c2d7-4248-9c35-31f1737a47cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:49.196209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc95dba8-c2d7-4248-9c35-31f1737a47cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.196686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc95dba8-c2d7-4248-9c35-31f1737a47cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.197146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc95dba8-c2d7-4248-9c35-31f1737a47cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.198093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc95dba8-c2d7-4248-9c35-31f1737a47cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.198720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc95dba8-c2d7-4248-9c35-31f1737a47cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.199299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc95dba8-c2d7-4248-9c35-31f1737a47cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.331070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:49.345191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:49.345578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc95dba8-c2d7-4248-9c35-31f1737a47cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:49.351210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:49.352646 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4c584759-73ee-45b4-83ea-0b2aab749094 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.525570 Oct 29 02:51:49.356652 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fc95dba8-c2d7-4248-9c35-31f1737a47cf tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.176090 Oct 29 02:51:49.368333 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 868/1798] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:48 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:49.370146 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 931/1799] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:49.377901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d01bb927-6f35-4317-8728-45ee6ade5f03 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.378609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d01bb927-6f35-4317-8728-45ee6ade5f03 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:49.384639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fcf24c1b-082a-4c64-9185-2c36cc912f1d tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.386200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01bb927-6f35-4317-8728-45ee6ade5f03 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.386679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01bb927-6f35-4317-8728-45ee6ade5f03 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.387118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01bb927-6f35-4317-8728-45ee6ade5f03 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.387834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01bb927-6f35-4317-8728-45ee6ade5f03 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.388281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01bb927-6f35-4317-8728-45ee6ade5f03 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.388734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01bb927-6f35-4317-8728-45ee6ade5f03 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.457603 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fcf24c1b-082a-4c64-9185-2c36cc912f1d tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.082681 Oct 29 02:51:49.459854 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 869/1800] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:49.479229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-efa940d1-2703-493e-ae1e-5b3033a3d6b5 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.489218 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-efa940d1-2703-493e-ae1e-5b3033a3d6b5 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015026 Oct 29 02:51:49.490449 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 870/1801] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:49.503274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ba0dd372-ee3e-47ad-b44d-7a8b940ecd56 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.520966 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ba0dd372-ee3e-47ad-b44d-7a8b940ecd56 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.022152 Oct 29 02:51:49.521554 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 871/1802] 10.222.0.16 () {58 vars in 1144 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:49.538293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e6e1122d-0da9-42a3-8399-01b330cfb349 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.546560 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e6e1122d-0da9-42a3-8399-01b330cfb349 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012357 Oct 29 02:51:49.555360 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 872/1803] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:49.560686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e3dae943-6463-4c9c-8dba-4c23ecb08633 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.561208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d01bb927-6f35-4317-8728-45ee6ade5f03 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:49.574604 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d01bb927-6f35-4317-8728-45ee6ade5f03 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1539 microversion: 2.1 time: 0.200533 Oct 29 02:51:49.579323 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e3dae943-6463-4c9c-8dba-4c23ecb08633 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.022577 Oct 29 02:51:49.580103 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 932/1804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1539 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:49.591108 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 873/1805] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:49.598418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a036e0d4-6468-4aa4-b99e-403abfed5884 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.615206 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a036e0d4-6468-4aa4-b99e-403abfed5884 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.022652 Oct 29 02:51:49.616809 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 933/1806] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:49.628955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-29eca477-e797-4d7a-bee0-0eda5ef34056 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.636899 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-29eca477-e797-4d7a-bee0-0eda5ef34056 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011941 Oct 29 02:51:49.637702 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 874/1807] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:49.653616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-539f17fa-385e-4bac-acd3-d99d4ce7bd88 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.709663 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-539f17fa-385e-4bac-acd3-d99d4ce7bd88 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.062629 Oct 29 02:51:49.719435 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 934/1808] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:49.726942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0376e9b5-bd48-47d5-8d6a-146e738527ba tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.758726 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0376e9b5-bd48-47d5-8d6a-146e738527ba tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037596 Oct 29 02:51:49.764012 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 875/1809] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:49.777614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b01b3c35-f0a7-417c-959c-f5dca2bcfec2 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.786382 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b01b3c35-f0a7-417c-959c-f5dca2bcfec2 tempest-FlavorsV2TestJSON-1096773806 tempest-FlavorsV2TestJSON-1096773806-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012563 Oct 29 02:51:49.796269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-399faf54-7e1e-4b4e-9545-2b0a704a75ab tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.796269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-399faf54-7e1e-4b4e-9545-2b0a704a75ab tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:49.798129 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 935/1810] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:49.806816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-399faf54-7e1e-4b4e-9545-2b0a704a75ab tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.808133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-399faf54-7e1e-4b4e-9545-2b0a704a75ab tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.808826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-399faf54-7e1e-4b4e-9545-2b0a704a75ab tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.809758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-399faf54-7e1e-4b4e-9545-2b0a704a75ab tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.810643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-399faf54-7e1e-4b4e-9545-2b0a704a75ab tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.811313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-399faf54-7e1e-4b4e-9545-2b0a704a75ab tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.824150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fbe18ded-62d8-4413-8fa3-a3e6973c845f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.825271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fbe18ded-62d8-4413-8fa3-a3e6973c845f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:49.836808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe18ded-62d8-4413-8fa3-a3e6973c845f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.842485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe18ded-62d8-4413-8fa3-a3e6973c845f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.843389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe18ded-62d8-4413-8fa3-a3e6973c845f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.844339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe18ded-62d8-4413-8fa3-a3e6973c845f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.844991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe18ded-62d8-4413-8fa3-a3e6973c845f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.845627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe18ded-62d8-4413-8fa3-a3e6973c845f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:50.144290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-399faf54-7e1e-4b4e-9545-2b0a704a75ab tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:50.158906 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-399faf54-7e1e-4b4e-9545-2b0a704a75ab tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1308 microversion: 2.1 time: 0.373667 Oct 29 02:51:50.160271 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 876/1811] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1308 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:50.168833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6c846e26-2f1c-490f-b151-34cb5e0e1d03 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:50.173971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6c846e26-2f1c-490f-b151-34cb5e0e1d03 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:50.189314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c846e26-2f1c-490f-b151-34cb5e0e1d03 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:50.193235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c846e26-2f1c-490f-b151-34cb5e0e1d03 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:50.194236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c846e26-2f1c-490f-b151-34cb5e0e1d03 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:50.195307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c846e26-2f1c-490f-b151-34cb5e0e1d03 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:50.196491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c846e26-2f1c-490f-b151-34cb5e0e1d03 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:50.198140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c846e26-2f1c-490f-b151-34cb5e0e1d03 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:50.213836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fbe18ded-62d8-4413-8fa3-a3e6973c845f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:50.228910 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fbe18ded-62d8-4413-8fa3-a3e6973c845f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.408386 Oct 29 02:51:50.235608 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 936/1812] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:50.248106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:50.391702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dfaba413-a4bd-4436-aade-807ac32bb99b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:50.392739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dfaba413-a4bd-4436-aade-807ac32bb99b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:50.404603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfaba413-a4bd-4436-aade-807ac32bb99b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:50.405456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfaba413-a4bd-4436-aade-807ac32bb99b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:50.406131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfaba413-a4bd-4436-aade-807ac32bb99b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:50.407033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfaba413-a4bd-4436-aade-807ac32bb99b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:50.407753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfaba413-a4bd-4436-aade-807ac32bb99b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:50.408422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfaba413-a4bd-4436-aade-807ac32bb99b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:50.484577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:50.640960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6c846e26-2f1c-490f-b151-34cb5e0e1d03 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:50.650884 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6c846e26-2f1c-490f-b151-34cb5e0e1d03 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1318 microversion: 2.1 time: 0.488055 Oct 29 02:51:50.655158 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 877/1813] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:50 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:50.662447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:50.668502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:50.700030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:50.700625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:50.701297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:50.702384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:50.703087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:50.703716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:50.890467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dfaba413-a4bd-4436-aade-807ac32bb99b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:50.901293 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dfaba413-a4bd-4436-aade-807ac32bb99b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.521667 Oct 29 02:51:50.917831 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 937/1814] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:50 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:50.917831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-5b7ba830-4959-4cc9-aa8c-62725a8d1270 req-807d3dcd-f5fd-4bb4-aa3a-a63157492f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa3632ea-9875-4193-8b4e-3917063ba265", "tag": "4c48a2aa-0282-4c60-954d-a90eaeb2c0e8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:50.933356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5b7ba830-4959-4cc9-aa8c-62725a8d1270 req-807d3dcd-f5fd-4bb4-aa3a-a63157492f33 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:50.933857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5b7ba830-4959-4cc9-aa8c-62725a8d1270 req-807d3dcd-f5fd-4bb4-aa3a-a63157492f33 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:50.934296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5b7ba830-4959-4cc9-aa8c-62725a8d1270 req-807d3dcd-f5fd-4bb4-aa3a-a63157492f33 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:50.959835 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-5b7ba830-4959-4cc9-aa8c-62725a8d1270 req-807d3dcd-f5fd-4bb4-aa3a-a63157492f33 service nova] Creating event network-changed:4c48a2aa-0282-4c60-954d-a90eaeb2c0e8 for instance fa3632ea-9875-4193-8b4e-3917063ba265 on n-h2-862964-4 Oct 29 02:51:50.969178 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-5b7ba830-4959-4cc9-aa8c-62725a8d1270 req-807d3dcd-f5fd-4bb4-aa3a-a63157492f33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054574 Oct 29 02:51:50.970557 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 938/1815] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:50.984451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9040424c-a6b9-4cfd-ba37-b0785bac858d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:50.985365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9040424c-a6b9-4cfd-ba37-b0785bac858d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:50.997546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9040424c-a6b9-4cfd-ba37-b0785bac858d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:50.999238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9040424c-a6b9-4cfd-ba37-b0785bac858d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:50.999866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9040424c-a6b9-4cfd-ba37-b0785bac858d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.000956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9040424c-a6b9-4cfd-ba37-b0785bac858d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.001741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9040424c-a6b9-4cfd-ba37-b0785bac858d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.002362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9040424c-a6b9-4cfd-ba37-b0785bac858d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.011627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:51.025909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:51.027368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:51.028578 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6318dede-e32f-438b-bf7f-178049f26d94 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.372210 Oct 29 02:51:51.029155 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 878/1816] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:50 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:51.188509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c84f2279-2e11-40a5-a632-e9d0a28f8eaa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:51.189122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c84f2279-2e11-40a5-a632-e9d0a28f8eaa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:51.201076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c84f2279-2e11-40a5-a632-e9d0a28f8eaa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.201825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c84f2279-2e11-40a5-a632-e9d0a28f8eaa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.202634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c84f2279-2e11-40a5-a632-e9d0a28f8eaa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.203516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c84f2279-2e11-40a5-a632-e9d0a28f8eaa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.208875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c84f2279-2e11-40a5-a632-e9d0a28f8eaa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.209605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c84f2279-2e11-40a5-a632-e9d0a28f8eaa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.274392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9040424c-a6b9-4cfd-ba37-b0785bac858d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:51.282585 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9040424c-a6b9-4cfd-ba37-b0785bac858d tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1539 microversion: 2.1 time: 0.310394 Oct 29 02:51:51.283169 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 939/1817] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:50 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1539 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:51.288050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b0e08ea5-3ae3-4ed9-b372-fe38970ffe05 req-c2e17bdf-de87-4edf-a908-6709e178c82c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce4caa1-3b78-4bcf-98e4-b4d9da71dfee", "tag": "13168635-67a9-4cb0-a7c1-c8262d0cd5a5"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:51.298058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0e08ea5-3ae3-4ed9-b372-fe38970ffe05 req-c2e17bdf-de87-4edf-a908-6709e178c82c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.298531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0e08ea5-3ae3-4ed9-b372-fe38970ffe05 req-c2e17bdf-de87-4edf-a908-6709e178c82c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.298950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0e08ea5-3ae3-4ed9-b372-fe38970ffe05 req-c2e17bdf-de87-4edf-a908-6709e178c82c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.311365 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b0e08ea5-3ae3-4ed9-b372-fe38970ffe05 req-c2e17bdf-de87-4edf-a908-6709e178c82c service nova] Creating event network-changed:13168635-67a9-4cb0-a7c1-c8262d0cd5a5 for instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee on n-h1-862964-4 Oct 29 02:51:51.317314 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b0e08ea5-3ae3-4ed9-b372-fe38970ffe05 req-c2e17bdf-de87-4edf-a908-6709e178c82c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031827 Oct 29 02:51:51.317908 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 940/1818] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:51.323052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-188ee551-0993-4984-a969-fa177d095737 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:51.323752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-188ee551-0993-4984-a969-fa177d095737 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:51.334433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-188ee551-0993-4984-a969-fa177d095737 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.334967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-188ee551-0993-4984-a969-fa177d095737 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.335517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-188ee551-0993-4984-a969-fa177d095737 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.336241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-188ee551-0993-4984-a969-fa177d095737 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.336934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-188ee551-0993-4984-a969-fa177d095737 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.337377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-188ee551-0993-4984-a969-fa177d095737 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.486933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-188ee551-0993-4984-a969-fa177d095737 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:51.496771 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-188ee551-0993-4984-a969-fa177d095737 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.177641 Oct 29 02:51:51.497362 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 941/1819] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:51 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:51.545502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c84f2279-2e11-40a5-a632-e9d0a28f8eaa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:51.554330 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c84f2279-2e11-40a5-a632-e9d0a28f8eaa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1488 microversion: 2.1 time: 0.370269 Oct 29 02:51:51.566874 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 879/1820] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:51 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1488 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:51.578086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-761f839e-24ef-44af-8d0a-f09a1736eb8e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:51.578601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-761f839e-24ef-44af-8d0a-f09a1736eb8e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:51.584683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-761f839e-24ef-44af-8d0a-f09a1736eb8e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.585162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-761f839e-24ef-44af-8d0a-f09a1736eb8e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.585582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-761f839e-24ef-44af-8d0a-f09a1736eb8e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.586289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-761f839e-24ef-44af-8d0a-f09a1736eb8e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.586714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-761f839e-24ef-44af-8d0a-f09a1736eb8e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.587126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-761f839e-24ef-44af-8d0a-f09a1736eb8e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.607341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:51.681584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ab68d4c-23b4-4520-809d-0b7f1159e3a1 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:51.683484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ab68d4c-23b4-4520-809d-0b7f1159e3a1 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:51.691246 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-761f839e-24ef-44af-8d0a-f09a1736eb8e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715/action" status: 202 len: 0 microversion: 2.1 time: 0.116673 Oct 29 02:51:51.693953 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 942/1821] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:51:51 2022] POST /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:51:51.704157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab68d4c-23b4-4520-809d-0b7f1159e3a1 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.704751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab68d4c-23b4-4520-809d-0b7f1159e3a1 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.705197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab68d4c-23b4-4520-809d-0b7f1159e3a1 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.708918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4d771e2d-7c2a-41d6-8378-9ea1e4aceb6f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:51.709608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4d771e2d-7c2a-41d6-8378-9ea1e4aceb6f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:51.710705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab68d4c-23b4-4520-809d-0b7f1159e3a1 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.711263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab68d4c-23b4-4520-809d-0b7f1159e3a1 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.711702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab68d4c-23b4-4520-809d-0b7f1159e3a1 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.725166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d771e2d-7c2a-41d6-8378-9ea1e4aceb6f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.727158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d771e2d-7c2a-41d6-8378-9ea1e4aceb6f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.729046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d771e2d-7c2a-41d6-8378-9ea1e4aceb6f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.732369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d771e2d-7c2a-41d6-8378-9ea1e4aceb6f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.733107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d771e2d-7c2a-41d6-8378-9ea1e4aceb6f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.734289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d771e2d-7c2a-41d6-8378-9ea1e4aceb6f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.913277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:51.928651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4d771e2d-7c2a-41d6-8378-9ea1e4aceb6f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:51.940032 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4d771e2d-7c2a-41d6-8378-9ea1e4aceb6f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1493 microversion: 2.1 time: 0.242136 Oct 29 02:51:51.945314 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 943/1822] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:51 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1493 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:51.946035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f2f43f21-3748-4296-8efa-45f74b8432e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:51.947076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f2f43f21-3748-4296-8efa-45f74b8432e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:51.953857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f43f21-3748-4296-8efa-45f74b8432e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.954780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f43f21-3748-4296-8efa-45f74b8432e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.955427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f43f21-3748-4296-8efa-45f74b8432e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.956304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f43f21-3748-4296-8efa-45f74b8432e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:51.957112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f43f21-3748-4296-8efa-45f74b8432e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:51.957700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f43f21-3748-4296-8efa-45f74b8432e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:52.236283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f2f43f21-3748-4296-8efa-45f74b8432e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:52.246500 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f2f43f21-3748-4296-8efa-45f74b8432e6 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.304167 Oct 29 02:51:52.251047 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 944/1823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:51 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:52.264137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:52.274988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:52.297045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:52.297537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:52.305559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:52.306466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:52.306909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:52.307342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:52.365693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ab68d4c-23b4-4520-809d-0b7f1159e3a1 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:52.385468 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ab68d4c-23b4-4520-809d-0b7f1159e3a1 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1318 microversion: 2.1 time: 0.708646 Oct 29 02:51:52.386790 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 880/1824] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:51 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1318 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:52.392776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b4e73985-1f74-4c43-bfa8-d07fce6b14ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:52.396760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b4e73985-1f74-4c43-bfa8-d07fce6b14ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:52.420777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4e73985-1f74-4c43-bfa8-d07fce6b14ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:52.421175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4e73985-1f74-4c43-bfa8-d07fce6b14ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:52.427430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4e73985-1f74-4c43-bfa8-d07fce6b14ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:52.430682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4e73985-1f74-4c43-bfa8-d07fce6b14ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:52.433369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4e73985-1f74-4c43-bfa8-d07fce6b14ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:52.434043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4e73985-1f74-4c43-bfa8-d07fce6b14ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:52.710733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:52.725762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:52.731695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:52.735687 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8335844-7c88-4d93-b389-82c449ec6901 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.482909 Oct 29 02:51:52.739483 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 945/1825] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:52 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:52.749469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f299f3c8-6882-4263-a39d-39b3963f6592 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:52.760343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f299f3c8-6882-4263-a39d-39b3963f6592 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:52.777491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f299f3c8-6882-4263-a39d-39b3963f6592 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:52.778245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f299f3c8-6882-4263-a39d-39b3963f6592 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:52.778767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f299f3c8-6882-4263-a39d-39b3963f6592 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:52.779575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f299f3c8-6882-4263-a39d-39b3963f6592 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:52.780088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f299f3c8-6882-4263-a39d-39b3963f6592 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:52.781377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f299f3c8-6882-4263-a39d-39b3963f6592 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:52.888467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b4e73985-1f74-4c43-bfa8-d07fce6b14ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:52.898909 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b4e73985-1f74-4c43-bfa8-d07fce6b14ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1539 microversion: 2.1 time: 0.508682 Oct 29 02:51:52.901013 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 881/1826] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:52 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1539 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:53.372081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-902e4e6a-85a1-4ad3-9ad6-c089fa857fcd tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Calling method '.version_select at 0x7fe1a8aa3040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:53.416373 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-902e4e6a-85a1-4ad3-9ad6-c089fa857fcd tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] HTTP exception thrown: Image not found. Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-902e4e6a-85a1-4ad3-9ad6-c089fa857fcd tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Request method failure captured: Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/images/a4849a9a-1bbb-4571-85d2-56a7607c5235/metadata/os_distro HTTP/1.1 Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJVIemM6sARZq2dy-v_TOwpxJ_WIymvjp4keGmpClrzeCL7e8mAXmSFSXh3IBQJOWy7qRcDM5fS1xK-AxFBx6qkzPRniiTMIWiiBM3u5FY1z0e0u-ceTaOM1gJ1hpLH0m4qmgEcJvQ6Y--Zxv-uk3Iv2eTqd6Ny_-Va2tce-fJ96XlU Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:51:53.422390 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d87c98c0e8b438497cb63dce76fd5d0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}] Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 1f5a7f86b9a74e7cacc4d00f9b86d271 Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'image_id': 'a4849a9a-1bbb-4571-85d2-56a7607c5235', 'id': 'os_distro'} Oct 29 02:51:53.424033 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:53.425224 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a4849a9a-1bbb-4571-85d2-56a7607c5235 Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:53.426919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4849a9a-1bbb-4571-85d2-56a7607c5235 could not be found. Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:53.428728 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:53.431108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-902e4e6a-85a1-4ad3-9ad6-c089fa857fcd tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:53.435437 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-902e4e6a-85a1-4ad3-9ad6-c089fa857fcd tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] 10.222.0.16 "DELETE /compute/v2.1/images/a4849a9a-1bbb-4571-85d2-56a7607c5235/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.521931 Oct 29 02:51:53.435437 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 882/1827] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Oct 29 02:51:52 2022] DELETE /compute/v2.1/images/a4849a9a-1bbb-4571-85d2-56a7607c5235/metadata/os_distro => generated 62 bytes in 523 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:51:53.435437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f317919-c689-41e4-af80-6cd69a3f2ed1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:53.435437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f317919-c689-41e4-af80-6cd69a3f2ed1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:53.446740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f317919-c689-41e4-af80-6cd69a3f2ed1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:53.447232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f317919-c689-41e4-af80-6cd69a3f2ed1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:53.447665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f317919-c689-41e4-af80-6cd69a3f2ed1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:53.448375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f317919-c689-41e4-af80-6cd69a3f2ed1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:53.448822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f317919-c689-41e4-af80-6cd69a3f2ed1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:53.449239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f317919-c689-41e4-af80-6cd69a3f2ed1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:53.698006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f299f3c8-6882-4263-a39d-39b3963f6592 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:53.714846 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f299f3c8-6882-4263-a39d-39b3963f6592 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.973950 Oct 29 02:51:53.726736 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 946/1828] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:52 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:53.743385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-494f734f-a8ef-4a68-b1b0-d4d9f11a4f52 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:53.744946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-494f734f-a8ef-4a68-b1b0-d4d9f11a4f52 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:53.759915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-494f734f-a8ef-4a68-b1b0-d4d9f11a4f52 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:53.761919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-494f734f-a8ef-4a68-b1b0-d4d9f11a4f52 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:53.763070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-494f734f-a8ef-4a68-b1b0-d4d9f11a4f52 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:53.765489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-494f734f-a8ef-4a68-b1b0-d4d9f11a4f52 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:53.766246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-494f734f-a8ef-4a68-b1b0-d4d9f11a4f52 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:53.767348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-494f734f-a8ef-4a68-b1b0-d4d9f11a4f52 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:53.820932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8f317919-c689-41e4-af80-6cd69a3f2ed1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:53.835979 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f317919-c689-41e4-af80-6cd69a3f2ed1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 200 len: 1473 microversion: 2.1 time: 0.410310 Oct 29 02:51:53.836979 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 883/1829] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:53 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 1473 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:53.856577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f180e1fd-6a3c-40e1-a7df-74b4880f6f13 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:53.858600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f180e1fd-6a3c-40e1-a7df-74b4880f6f13 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:53.869865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f180e1fd-6a3c-40e1-a7df-74b4880f6f13 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:53.871241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f180e1fd-6a3c-40e1-a7df-74b4880f6f13 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:53.872548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f180e1fd-6a3c-40e1-a7df-74b4880f6f13 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:53.874069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f180e1fd-6a3c-40e1-a7df-74b4880f6f13 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:53.875284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f180e1fd-6a3c-40e1-a7df-74b4880f6f13 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:53.875926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f180e1fd-6a3c-40e1-a7df-74b4880f6f13 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:54.060380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-494f734f-a8ef-4a68-b1b0-d4d9f11a4f52 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:54.072876 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-494f734f-a8ef-4a68-b1b0-d4d9f11a4f52 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.342061 Oct 29 02:51:54.074770 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 947/1830] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:53 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:54.081900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2eec2527-dc11-4693-bf3a-94f8de79b018 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Calling method '.version_select at 0x7fe1acc113a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:54.112527 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-2eec2527-dc11-4693-bf3a-94f8de79b018 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] HTTP exception thrown: Image not found. Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2eec2527-dc11-4693-bf3a-94f8de79b018 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Request method failure captured: Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/images/4beeb284-47bc-4c13-9cfd-c4d91dde987b/metadata/os_version HTTP/1.1 Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJVIemM6sARZq2dy-v_TOwpxJ_WIymvjp4keGmpClrzeCL7e8mAXmSFSXh3IBQJOWy7qRcDM5fS1xK-AxFBx6qkzPRniiTMIWiiBM3u5FY1z0e0u-ceTaOM1gJ1hpLH0m4qmgEcJvQ6Y--Zxv-uk3Iv2eTqd6Ny_-Va2tce-fJ96XlU Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:51:54.115340 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d87c98c0e8b438497cb63dce76fd5d0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}] Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 1f5a7f86b9a74e7cacc4d00f9b86d271 Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: exception: Image not found. Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'image_id': '4beeb284-47bc-4c13-9cfd-c4d91dde987b', 'id': 'os_version'} Oct 29 02:51:54.117120 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:54.118209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4beeb284-47bc-4c13-9cfd-c4d91dde987b Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:54.119598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4beeb284-47bc-4c13-9cfd-c4d91dde987b could not be found. Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:54.121541 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:54.122957 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.126783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2eec2527-dc11-4693-bf3a-94f8de79b018 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Returning 404 to user: Image not found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:54.127247 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2eec2527-dc11-4693-bf3a-94f8de79b018 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] 10.222.0.16 "GET /compute/v2.1/images/4beeb284-47bc-4c13-9cfd-c4d91dde987b/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.049059 Oct 29 02:51:54.128119 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 948/1831] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Oct 29 02:51:54 2022] GET /compute/v2.1/images/4beeb284-47bc-4c13-9cfd-c4d91dde987b/metadata/os_version => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:51:54.142941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3a7c8e20-1cc9-4685-96f0-849ab93e1f9d req-265bb632-c429-44ef-a87e-72576c410af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b8047-ca96-48bc-8950-57a0b6f0d537", "name": "network-vif-unplugged", "status": "completed", "tag": "a5042009-6ba4-421a-b724-be960ba5a87f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:54.168375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3a7c8e20-1cc9-4685-96f0-849ab93e1f9d req-265bb632-c429-44ef-a87e-72576c410af6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:54.173732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3a7c8e20-1cc9-4685-96f0-849ab93e1f9d req-265bb632-c429-44ef-a87e-72576c410af6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:54.174208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3a7c8e20-1cc9-4685-96f0-849ab93e1f9d req-265bb632-c429-44ef-a87e-72576c410af6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:54.201879 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3a7c8e20-1cc9-4685-96f0-849ab93e1f9d req-265bb632-c429-44ef-a87e-72576c410af6 service nova] Creating event network-vif-unplugged:a5042009-6ba4-421a-b724-be960ba5a87f for instance 239b8047-ca96-48bc-8950-57a0b6f0d537 on n-h2-862964-4 Oct 29 02:51:54.213229 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3a7c8e20-1cc9-4685-96f0-849ab93e1f9d req-265bb632-c429-44ef-a87e-72576c410af6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079061 Oct 29 02:51:54.219463 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 949/1832] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:54.229664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:54.230904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:54.246167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:54.248132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:54.249241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:54.250893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:54.253211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:54.253944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:54.344409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f180e1fd-6a3c-40e1-a7df-74b4880f6f13 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:54.353838 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f180e1fd-6a3c-40e1-a7df-74b4880f6f13 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1318 microversion: 2.1 time: 0.515290 Oct 29 02:51:54.357418 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 884/1833] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:53 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:54.364830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3a6d345-0553-4764-aaf8-d2f99a35ecbc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1597331763"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:54.376785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d3a6d345-0553-4764-aaf8-d2f99a35ecbc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:54.392720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3a6d345-0553-4764-aaf8-d2f99a35ecbc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:54.401753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3a6d345-0553-4764-aaf8-d2f99a35ecbc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:54.402643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3a6d345-0553-4764-aaf8-d2f99a35ecbc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:54.403617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3a6d345-0553-4764-aaf8-d2f99a35ecbc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:54.404275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3a6d345-0553-4764-aaf8-d2f99a35ecbc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:54.404901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3a6d345-0553-4764-aaf8-d2f99a35ecbc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:54.727741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:54.743680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:54.746009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:54.748109 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-06fb2434-4581-4834-87d1-397c6bd06173 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.526655 Oct 29 02:51:54.763815 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 950/1834] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:54 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:54.776603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-032ec05c-9aa7-41db-b9db-8a52fd4db033 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:54.777558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-032ec05c-9aa7-41db-b9db-8a52fd4db033 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:54.787089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032ec05c-9aa7-41db-b9db-8a52fd4db033 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:54.788465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032ec05c-9aa7-41db-b9db-8a52fd4db033 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:54.789192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032ec05c-9aa7-41db-b9db-8a52fd4db033 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:54.790552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032ec05c-9aa7-41db-b9db-8a52fd4db033 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:54.791322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032ec05c-9aa7-41db-b9db-8a52fd4db033 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:54.792235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032ec05c-9aa7-41db-b9db-8a52fd4db033 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:54.841886 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3a6d345-0553-4764-aaf8-d2f99a35ecbc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715/action" status: 202 len: 0 microversion: 2.1 time: 0.479542 Oct 29 02:51:54.844179 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 885/1835] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:51:54 2022] POST /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:51:54.863236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3720be2-49c8-4083-826d-34c4f6f2e861 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Calling method '.version_select at 0x7fe1a87d0af0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:54.904680 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a3720be2-49c8-4083-826d-34c4f6f2e861 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] HTTP exception thrown: Image not found. Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3720be2-49c8-4083-826d-34c4f6f2e861 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Request method failure captured: Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/images/2fbdd59e-fa09-48f4-b0aa-8f2468b7317f/metadata HTTP/1.1 Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJVIemM6sARZq2dy-v_TOwpxJ_WIymvjp4keGmpClrzeCL7e8mAXmSFSXh3IBQJOWy7qRcDM5fS1xK-AxFBx6qkzPRniiTMIWiiBM3u5FY1z0e0u-ceTaOM1gJ1hpLH0m4qmgEcJvQ6Y--Zxv-uk3Iv2eTqd6Ny_-Va2tce-fJ96XlU Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:51:54.911527 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d87c98c0e8b438497cb63dce76fd5d0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}] Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 1f5a7f86b9a74e7cacc4d00f9b86d271 Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'image_id': '2fbdd59e-fa09-48f4-b0aa-8f2468b7317f'} Oct 29 02:51:54.913455 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:54.914536 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2fbdd59e-fa09-48f4-b0aa-8f2468b7317f Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:54.916002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2fbdd59e-fa09-48f4-b0aa-8f2468b7317f could not be found. Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:54.919181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:54.920655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3720be2-49c8-4083-826d-34c4f6f2e861 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:54.923902 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a3720be2-49c8-4083-826d-34c4f6f2e861 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] 10.222.0.16 "GET /compute/v2.1/images/2fbdd59e-fa09-48f4-b0aa-8f2468b7317f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.070044 Oct 29 02:51:54.924989 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 886/1836] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 02:51:54 2022] GET /compute/v2.1/images/2fbdd59e-fa09-48f4-b0aa-8f2468b7317f/metadata => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:51:54.942025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ad00c36c-2561-4d46-b59e-27973507b47f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:54.943580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ad00c36c-2561-4d46-b59e-27973507b47f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:54.959824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad00c36c-2561-4d46-b59e-27973507b47f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:54.962371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad00c36c-2561-4d46-b59e-27973507b47f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:54.963175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad00c36c-2561-4d46-b59e-27973507b47f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:54.966126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad00c36c-2561-4d46-b59e-27973507b47f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:54.967057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad00c36c-2561-4d46-b59e-27973507b47f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:54.968681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad00c36c-2561-4d46-b59e-27973507b47f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.114257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-032ec05c-9aa7-41db-b9db-8a52fd4db033 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:55.125326 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-032ec05c-9aa7-41db-b9db-8a52fd4db033 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1521 microversion: 2.1 time: 0.359758 Oct 29 02:51:55.126654 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 951/1837] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:54 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:55.135200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-31910df5-979b-409d-9b21-68b3268d66b3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a806c8b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:55.209125 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-31910df5-979b-409d-9b21-68b3268d66b3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1414 microversion: 2.1 time: 0.080319 Oct 29 02:51:55.218839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 952/1838] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:55 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:55.224867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-23f3e9c4-ae66-4dc4-a24c-d1f60941ed64 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Action: 'update_all', calling method: .version_select at 0x7fe1acb08b80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:55.234171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ad00c36c-2561-4d46-b59e-27973507b47f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:55.260705 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ad00c36c-2561-4d46-b59e-27973507b47f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.334897 Oct 29 02:51:55.261291 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 887/1839] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:54 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:55.279434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e98771fd-7cf9-4941-96bf-3578106325ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:55.281832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e98771fd-7cf9-4941-96bf-3578106325ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:55.295701 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-23f3e9c4-ae66-4dc4-a24c-d1f60941ed64 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] HTTP exception thrown: Image not found. Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-23f3e9c4-ae66-4dc4-a24c-d1f60941ed64 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Request method failure captured: Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/images/e9b33359-c1e5-4e75-8bff-cd6ebc953485/metadata HTTP/1.1 Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 57 Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJVIemM6sARZq2dy-v_TOwpxJ_WIymvjp4keGmpClrzeCL7e8mAXmSFSXh3IBQJOWy7qRcDM5fS1xK-AxFBx6qkzPRniiTMIWiiBM3u5FY1z0e0u-ceTaOM1gJ1hpLH0m4qmgEcJvQ6Y--Zxv-uk3Iv2eTqd6Ny_-Va2tce-fJ96XlU Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:51:55.302427 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d87c98c0e8b438497cb63dce76fd5d0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}] Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 1f5a7f86b9a74e7cacc4d00f9b86d271 Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: exception: Image not found. Oct 29 02:51:55.303905 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'image_id': 'e9b33359-c1e5-4e75-8bff-cd6ebc953485', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:55.304880 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e9b33359-c1e5-4e75-8bff-cd6ebc953485 Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:55.307930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e9b33359-c1e5-4e75-8bff-cd6ebc953485 could not be found. Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:55.309180 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:55.310501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.316209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e98771fd-7cf9-4941-96bf-3578106325ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.316209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e98771fd-7cf9-4941-96bf-3578106325ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.317470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-23f3e9c4-ae66-4dc4-a24c-d1f60941ed64 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Returning 404 to user: Image not found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:55.317470 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-23f3e9c4-ae66-4dc4-a24c-d1f60941ed64 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] 10.222.0.16 "PUT /compute/v2.1/images/e9b33359-c1e5-4e75-8bff-cd6ebc953485/metadata" status: 404 len: 62 microversion: 2.1 time: 0.095691 Oct 29 02:51:55.317772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e98771fd-7cf9-4941-96bf-3578106325ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.318039 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 953/1840] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:51:55 2022] PUT /compute/v2.1/images/e9b33359-c1e5-4e75-8bff-cd6ebc953485/metadata => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:51:55.318734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e98771fd-7cf9-4941-96bf-3578106325ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.319192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e98771fd-7cf9-4941-96bf-3578106325ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.319722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e98771fd-7cf9-4941-96bf-3578106325ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.325228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-07f03e47-9d36-407a-abad-490edd0e7735 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:55.325729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-07f03e47-9d36-407a-abad-490edd0e7735 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:55.332567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07f03e47-9d36-407a-abad-490edd0e7735 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.333064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07f03e47-9d36-407a-abad-490edd0e7735 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.333503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07f03e47-9d36-407a-abad-490edd0e7735 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.334595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07f03e47-9d36-407a-abad-490edd0e7735 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.334765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07f03e47-9d36-407a-abad-490edd0e7735 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.335187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07f03e47-9d36-407a-abad-490edd0e7735 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.392267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-07f03e47-9d36-407a-abad-490edd0e7735 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:51:55.520769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e98771fd-7cf9-4941-96bf-3578106325ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:55.533500 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e98771fd-7cf9-4941-96bf-3578106325ea tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.264796 Oct 29 02:51:55.535112 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 888/1841] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:55 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:55.540392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb14efd1-e464-49e7-93f4-0788dc0fa302 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Action: 'update', calling method: .version_select at 0x7fe1a90381f0>, body: {"meta": {"os_distro": "alt"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:55.544466 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-07f03e47-9d36-407a-abad-490edd0e7735 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 204 len: 0 microversion: 2.1 time: 0.223926 Oct 29 02:51:55.545651 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 954/1842] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:55 2022] DELETE /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:51:55.554458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1ccf1f28-78c7-4990-af74-dd84fa9eb7be tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:55.555494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1ccf1f28-78c7-4990-af74-dd84fa9eb7be tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:55.562800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ccf1f28-78c7-4990-af74-dd84fa9eb7be tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.563633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ccf1f28-78c7-4990-af74-dd84fa9eb7be tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.564369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ccf1f28-78c7-4990-af74-dd84fa9eb7be tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.565543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ccf1f28-78c7-4990-af74-dd84fa9eb7be tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.567975 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-bb14efd1-e464-49e7-93f4-0788dc0fa302 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] HTTP exception thrown: Image not found. Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb14efd1-e464-49e7-93f4-0788dc0fa302 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Request method failure captured: Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: request: PUT /compute/v2.1/images/40b1e0fd-80a0-45f0-95d3-7a3ae1c86dea/metadata/os_distro HTTP/1.1 Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 30 Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJVIemM6sARZq2dy-v_TOwpxJ_WIymvjp4keGmpClrzeCL7e8mAXmSFSXh3IBQJOWy7qRcDM5fS1xK-AxFBx6qkzPRniiTMIWiiBM3u5FY1z0e0u-ceTaOM1gJ1hpLH0m4qmgEcJvQ6Y--Zxv-uk3Iv2eTqd6Ny_-Va2tce-fJ96XlU Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:51:55.570477 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d87c98c0e8b438497cb63dce76fd5d0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}] Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 1f5a7f86b9a74e7cacc4d00f9b86d271 Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: {"meta": {"os_distro": "alt"}} Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:51:55.572231 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'image_id': '40b1e0fd-80a0-45f0-95d3-7a3ae1c86dea', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:55.574210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 40b1e0fd-80a0-45f0-95d3-7a3ae1c86dea Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:55.577168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 40b1e0fd-80a0-45f0-95d3-7a3ae1c86dea could not be found. Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:55.583796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:55.587301 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.593736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ccf1f28-78c7-4990-af74-dd84fa9eb7be tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.593736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ccf1f28-78c7-4990-af74-dd84fa9eb7be tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.594170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb14efd1-e464-49e7-93f4-0788dc0fa302 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:55.594170 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb14efd1-e464-49e7-93f4-0788dc0fa302 tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] 10.222.0.16 "PUT /compute/v2.1/images/40b1e0fd-80a0-45f0-95d3-7a3ae1c86dea/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.037196 Oct 29 02:51:55.594170 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 889/1843] 10.222.0.16 () {60 vars in 1310 bytes} [Sat Oct 29 02:51:55 2022] PUT /compute/v2.1/images/40b1e0fd-80a0-45f0-95d3-7a3ae1c86dea/metadata/os_distro => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:51:55.594170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e85d3b8c-8541-42f5-8e3b-632fc2c079cf req-86c6c223-8549-431d-b082-3720237062cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1782e279-7a4c-47a0-983e-7e07b34162a6", "name": "network-vif-plugged", "status": "completed", "tag": "04204f29-7f5c-4dd3-bbe2-d9c1f52c66e8"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:55.601177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e85d3b8c-8541-42f5-8e3b-632fc2c079cf req-86c6c223-8549-431d-b082-3720237062cb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.601655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e85d3b8c-8541-42f5-8e3b-632fc2c079cf req-86c6c223-8549-431d-b082-3720237062cb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.602099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e85d3b8c-8541-42f5-8e3b-632fc2c079cf req-86c6c223-8549-431d-b082-3720237062cb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.614025 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e85d3b8c-8541-42f5-8e3b-632fc2c079cf req-86c6c223-8549-431d-b082-3720237062cb service nova] Creating event network-vif-plugged:04204f29-7f5c-4dd3-bbe2-d9c1f52c66e8 for instance 1782e279-7a4c-47a0-983e-7e07b34162a6 on n-h2-862964-4 Oct 29 02:51:55.619245 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e85d3b8c-8541-42f5-8e3b-632fc2c079cf req-86c6c223-8549-431d-b082-3720237062cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043407 Oct 29 02:51:55.620538 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 890/1844] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:55.626200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c0bad3dc-f1c5-4206-a1bf-020795af0309 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:55.627167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c0bad3dc-f1c5-4206-a1bf-020795af0309 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:55.635581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0bad3dc-f1c5-4206-a1bf-020795af0309 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.636154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0bad3dc-f1c5-4206-a1bf-020795af0309 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.636655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0bad3dc-f1c5-4206-a1bf-020795af0309 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.637546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0bad3dc-f1c5-4206-a1bf-020795af0309 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.638116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0bad3dc-f1c5-4206-a1bf-020795af0309 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.638588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0bad3dc-f1c5-4206-a1bf-020795af0309 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.813633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1ccf1f28-78c7-4990-af74-dd84fa9eb7be tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:55.814944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c0bad3dc-f1c5-4206-a1bf-020795af0309 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:55.825637 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1ccf1f28-78c7-4990-af74-dd84fa9eb7be tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1318 microversion: 2.1 time: 0.274490 Oct 29 02:51:55.828612 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c0bad3dc-f1c5-4206-a1bf-020795af0309 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1527 microversion: 2.1 time: 0.205559 Oct 29 02:51:55.838471 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 955/1845] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:55 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:55.846144 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 891/1846] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:55 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1527 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:55.850761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16d9fc8f-82f1-4837-8345-3c0543672d5f tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Action: 'create', calling method: .version_select at 0x7fe1acd05f70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:55.855265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:55.855876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:55.863097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.864004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.864624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.865518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.866177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.866764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.888860 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-16d9fc8f-82f1-4837-8345-3c0543672d5f tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] HTTP exception thrown: Image not found. Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16d9fc8f-82f1-4837-8345-3c0543672d5f tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Request method failure captured: Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/images/35262713-25ae-4490-943f-97ed9ba6f805/metadata HTTP/1.1 Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 57 Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJVIemM6sARZq2dy-v_TOwpxJ_WIymvjp4keGmpClrzeCL7e8mAXmSFSXh3IBQJOWy7qRcDM5fS1xK-AxFBx6qkzPRniiTMIWiiBM3u5FY1z0e0u-ceTaOM1gJ1hpLH0m4qmgEcJvQ6Y--Zxv-uk3Iv2eTqd6Ny_-Va2tce-fJ96XlU Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:51:55.891078 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d87c98c0e8b438497cb63dce76fd5d0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d87c98c0e8b438497cb63dce76fd5d0"}]}] Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 7d87c98c0e8b438497cb63dce76fd5d0 Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-656267498 Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 1f5a7f86b9a74e7cacc4d00f9b86d271 Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-656267498-project Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: exception: Image not found. Oct 29 02:51:55.892830 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'image_id': '35262713-25ae-4490-943f-97ed9ba6f805', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:55.894469 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 35262713-25ae-4490-943f-97ed9ba6f805 Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:51:55.895639 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 35262713-25ae-4490-943f-97ed9ba6f805 could not be found. Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:55.896882 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:55.898972 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:51:55.901018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16d9fc8f-82f1-4837-8345-3c0543672d5f tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] Returning 404 to user: Image not found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:55.901018 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-16d9fc8f-82f1-4837-8345-3c0543672d5f tempest-ImagesMetadataNegativeTestJSON-656267498 tempest-ImagesMetadataNegativeTestJSON-656267498-project] 10.222.0.16 "POST /compute/v2.1/images/35262713-25ae-4490-943f-97ed9ba6f805/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052621 Oct 29 02:51:55.901018 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 956/1847] 10.222.0.16 () {60 vars in 1281 bytes} [Sat Oct 29 02:51:55 2022] POST /compute/v2.1/images/35262713-25ae-4490-943f-97ed9ba6f805/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:51:56.072351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:56.088603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:56.090237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:56.092377 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bbbc6469-2018-4ff0-88b6-9ea41f18e8dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.245010 Oct 29 02:51:56.107882 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 892/1848] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:55 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:56.231420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7448c649-f534-42c9-8e78-2fd059951e1c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a919d700>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:56.259812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-392602f3-37a2-46d6-bec4-f1c2a892ab24 req-89561b2f-e27d-48fc-a158-89ebc8dedc7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239b8047-ca96-48bc-8950-57a0b6f0d537", "tag": "a5042009-6ba4-421a-b724-be960ba5a87f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:56.289764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-392602f3-37a2-46d6-bec4-f1c2a892ab24 req-89561b2f-e27d-48fc-a158-89ebc8dedc7e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:56.292770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-392602f3-37a2-46d6-bec4-f1c2a892ab24 req-89561b2f-e27d-48fc-a158-89ebc8dedc7e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:56.294644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-392602f3-37a2-46d6-bec4-f1c2a892ab24 req-89561b2f-e27d-48fc-a158-89ebc8dedc7e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:56.323963 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-392602f3-37a2-46d6-bec4-f1c2a892ab24 req-89561b2f-e27d-48fc-a158-89ebc8dedc7e service nova] Creating event network-changed:a5042009-6ba4-421a-b724-be960ba5a87f for instance 239b8047-ca96-48bc-8950-57a0b6f0d537 on n-h2-862964-4 Oct 29 02:51:56.351898 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-392602f3-37a2-46d6-bec4-f1c2a892ab24 req-89561b2f-e27d-48fc-a158-89ebc8dedc7e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089973 Oct 29 02:51:56.354314 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7448c649-f534-42c9-8e78-2fd059951e1c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1414 microversion: 2.1 time: 0.130912 Oct 29 02:51:56.355559 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 893/1849] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:51:56.369591 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 957/1850] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:56 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1414 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:56.372139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-631c3df7-8ec0-4861-b7d9-c60ab7624262 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:56.383201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-631c3df7-8ec0-4861-b7d9-c60ab7624262 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:56.386604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:56.401216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-631c3df7-8ec0-4861-b7d9-c60ab7624262 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:56.401776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-631c3df7-8ec0-4861-b7d9-c60ab7624262 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:56.402265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-631c3df7-8ec0-4861-b7d9-c60ab7624262 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:56.406417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-631c3df7-8ec0-4861-b7d9-c60ab7624262 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:56.407105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-631c3df7-8ec0-4861-b7d9-c60ab7624262 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:56.407352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-631c3df7-8ec0-4861-b7d9-c60ab7624262 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:56.571595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9db2f4b-d7c3-4d3f-a86c-e68aade3c770 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:56.572689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c9db2f4b-d7c3-4d3f-a86c-e68aade3c770 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:56.580479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9db2f4b-d7c3-4d3f-a86c-e68aade3c770 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:56.581571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9db2f4b-d7c3-4d3f-a86c-e68aade3c770 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:56.582235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9db2f4b-d7c3-4d3f-a86c-e68aade3c770 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:56.583414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9db2f4b-d7c3-4d3f-a86c-e68aade3c770 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:56.584074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9db2f4b-d7c3-4d3f-a86c-e68aade3c770 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:56.584657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9db2f4b-d7c3-4d3f-a86c-e68aade3c770 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:56.760330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-631c3df7-8ec0-4861-b7d9-c60ab7624262 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:56.773356 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-631c3df7-8ec0-4861-b7d9-c60ab7624262 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.414280 Oct 29 02:51:56.786649 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 894/1851] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:56 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:56.852711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-222e00a8-399d-4644-b68f-f91d46706fe7 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:56.853334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-222e00a8-399d-4644-b68f-f91d46706fe7 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:56.866604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-222e00a8-399d-4644-b68f-f91d46706fe7 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:56.867367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-222e00a8-399d-4644-b68f-f91d46706fe7 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:56.868206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-222e00a8-399d-4644-b68f-f91d46706fe7 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:56.869101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-222e00a8-399d-4644-b68f-f91d46706fe7 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:56.869722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-222e00a8-399d-4644-b68f-f91d46706fe7 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:56.870643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-222e00a8-399d-4644-b68f-f91d46706fe7 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:57.128932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-222e00a8-399d-4644-b68f-f91d46706fe7 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:57.143496 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-222e00a8-399d-4644-b68f-f91d46706fe7 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1318 microversion: 2.1 time: 0.294460 Oct 29 02:51:57.163198 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 895/1852] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:56 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:57.176774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f57aadd1-38ef-465e-a56c-d96c41c0a598 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:57.177386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f57aadd1-38ef-465e-a56c-d96c41c0a598 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:57.189485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c9db2f4b-d7c3-4d3f-a86c-e68aade3c770 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:57.194439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f57aadd1-38ef-465e-a56c-d96c41c0a598 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:57.194937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f57aadd1-38ef-465e-a56c-d96c41c0a598 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:57.196520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f57aadd1-38ef-465e-a56c-d96c41c0a598 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:57.197718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f57aadd1-38ef-465e-a56c-d96c41c0a598 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:57.200238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f57aadd1-38ef-465e-a56c-d96c41c0a598 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:57.201413 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c9db2f4b-d7c3-4d3f-a86c-e68aade3c770 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.638094 Oct 29 02:51:57.202128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f57aadd1-38ef-465e-a56c-d96c41c0a598 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:57.202263 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 958/1853] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:56 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:57.209866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:57.210953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:57.217726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:57.218617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:57.219282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:57.220214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:57.220874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:57.221492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:57.499140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f57aadd1-38ef-465e-a56c-d96c41c0a598 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:57.509207 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f57aadd1-38ef-465e-a56c-d96c41c0a598 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1527 microversion: 2.1 time: 0.344779 Oct 29 02:51:57.525601 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 896/1854] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:57 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1527 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:57.525841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:57.539044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f59cc5bd-4ce0-4229-980c-c46c18c60fce tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c80040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:57.550895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:57.561567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:57.569206 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f46640b0-0326-4a87-8f6d-24d19d272cc9 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.364783 Oct 29 02:51:57.569895 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 959/1855] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:57 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:57.605081 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f59cc5bd-4ce0-4229-980c-c46c18c60fce tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1414 microversion: 2.1 time: 0.076068 Oct 29 02:51:57.606088 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 897/1856] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:57 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:57.754687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d96f785c-e082-4880-a4e8-0130c2ff7231 req-6731264b-0a5f-49de-8808-d69c975cfcaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e79dac-7876-4e2d-913c-0662ffb235c9", "name": "network-vif-plugged", "status": "completed", "tag": "2f43e45f-e320-4fc5-9065-a0984991b317"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:57.768463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d96f785c-e082-4880-a4e8-0130c2ff7231 req-6731264b-0a5f-49de-8808-d69c975cfcaf service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:57.783260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d96f785c-e082-4880-a4e8-0130c2ff7231 req-6731264b-0a5f-49de-8808-d69c975cfcaf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:57.783910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d96f785c-e082-4880-a4e8-0130c2ff7231 req-6731264b-0a5f-49de-8808-d69c975cfcaf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:57.809387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-13055296-736e-4055-b23b-e4b02cf6cac1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:57.810047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-13055296-736e-4055-b23b-e4b02cf6cac1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:57.836397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13055296-736e-4055-b23b-e4b02cf6cac1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:57.836895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13055296-736e-4055-b23b-e4b02cf6cac1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:57.837335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13055296-736e-4055-b23b-e4b02cf6cac1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:57.847606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13055296-736e-4055-b23b-e4b02cf6cac1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:57.850306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13055296-736e-4055-b23b-e4b02cf6cac1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:57.850733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13055296-736e-4055-b23b-e4b02cf6cac1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:57.854319 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d96f785c-e082-4880-a4e8-0130c2ff7231 req-6731264b-0a5f-49de-8808-d69c975cfcaf service nova] Creating event network-vif-plugged:2f43e45f-e320-4fc5-9065-a0984991b317 for instance 34e79dac-7876-4e2d-913c-0662ffb235c9 on n-h1-862964-4 Oct 29 02:51:57.856457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:57.867445 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d96f785c-e082-4880-a4e8-0130c2ff7231 req-6731264b-0a5f-49de-8808-d69c975cfcaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116795 Oct 29 02:51:57.870105 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 960/1857] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:58.090428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-13055296-736e-4055-b23b-e4b02cf6cac1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:58.115932 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-13055296-736e-4055-b23b-e4b02cf6cac1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.304021 Oct 29 02:51:58.126536 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 898/1858] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:57 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:58.198155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-518e85f0-265d-484f-b96e-b35e34dccfa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:58.200452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-518e85f0-265d-484f-b96e-b35e34dccfa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:58.208506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-518e85f0-265d-484f-b96e-b35e34dccfa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:58.209442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-518e85f0-265d-484f-b96e-b35e34dccfa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:58.211519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-518e85f0-265d-484f-b96e-b35e34dccfa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:58.212304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-518e85f0-265d-484f-b96e-b35e34dccfa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:58.212960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-518e85f0-265d-484f-b96e-b35e34dccfa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:58.213395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-518e85f0-265d-484f-b96e-b35e34dccfa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:58.225457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b339a17b-6ccc-465f-a21b-3129cde15712 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:58.226090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b339a17b-6ccc-465f-a21b-3129cde15712 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:58.249308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b339a17b-6ccc-465f-a21b-3129cde15712 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:58.250019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b339a17b-6ccc-465f-a21b-3129cde15712 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:58.250464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b339a17b-6ccc-465f-a21b-3129cde15712 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:58.257070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b339a17b-6ccc-465f-a21b-3129cde15712 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:58.260084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b339a17b-6ccc-465f-a21b-3129cde15712 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:58.261319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b339a17b-6ccc-465f-a21b-3129cde15712 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:58.740974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b339a17b-6ccc-465f-a21b-3129cde15712 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:58.753483 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b339a17b-6ccc-465f-a21b-3129cde15712 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.528946 Oct 29 02:51:58.754875 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 899/1859] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:58 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:58.762507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e23dec4e-c7c9-4892-a4fe-111fd1aea92b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:58.769849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e23dec4e-c7c9-4892-a4fe-111fd1aea92b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:58.781562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e23dec4e-c7c9-4892-a4fe-111fd1aea92b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:58.782386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e23dec4e-c7c9-4892-a4fe-111fd1aea92b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:58.783014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e23dec4e-c7c9-4892-a4fe-111fd1aea92b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:58.787383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e23dec4e-c7c9-4892-a4fe-111fd1aea92b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:58.788044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e23dec4e-c7c9-4892-a4fe-111fd1aea92b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:58.788634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e23dec4e-c7c9-4892-a4fe-111fd1aea92b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:58.884789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-518e85f0-265d-484f-b96e-b35e34dccfa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:58.898176 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-518e85f0-265d-484f-b96e-b35e34dccfa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1318 microversion: 2.1 time: 0.725649 Oct 29 02:51:58.901081 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 961/1860] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:58 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1318 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:58.925541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:58.927375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:58.943228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:58.946610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:58.949515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:58.950814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:58.951289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:58.953951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:59.144790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e23dec4e-c7c9-4892-a4fe-111fd1aea92b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:59.153585 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e23dec4e-c7c9-4892-a4fe-111fd1aea92b tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1527 microversion: 2.1 time: 0.397390 Oct 29 02:51:59.154263 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 900/1861] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:58 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1527 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:59.164762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3abd700-700b-44e7-a7c5-6b8698c45076 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a86ddca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:59.250916 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3abd700-700b-44e7-a7c5-6b8698c45076 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1414 microversion: 2.1 time: 0.095492 Oct 29 02:51:59.251625 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 901/1862] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:59 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:59.256814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d50c932-3d27-4847-b406-344cdcf037ee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:59.257715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7d50c932-3d27-4847-b406-344cdcf037ee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:59.279845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d50c932-3d27-4847-b406-344cdcf037ee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:59.280712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d50c932-3d27-4847-b406-344cdcf037ee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:59.281346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d50c932-3d27-4847-b406-344cdcf037ee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:59.282385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d50c932-3d27-4847-b406-344cdcf037ee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:59.283030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d50c932-3d27-4847-b406-344cdcf037ee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:59.283638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d50c932-3d27-4847-b406-344cdcf037ee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:59.498107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:59.510339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:59.516189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:59.523399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:59.528792 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8a919939-41df-4dac-8fa5-c4401f1c2e30 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.626459 Oct 29 02:51:59.530172 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 962/1863] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:58 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:59.687249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7d50c932-3d27-4847-b406-344cdcf037ee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:59.696294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7d50c932-3d27-4847-b406-344cdcf037ee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.443300 Oct 29 02:51:59.700778 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 902/1864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:59 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:59.780888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c531d69-8699-46f1-91b9-3a890b19c3d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:59.781497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c531d69-8699-46f1-91b9-3a890b19c3d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:59.809082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c531d69-8699-46f1-91b9-3a890b19c3d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:59.809580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c531d69-8699-46f1-91b9-3a890b19c3d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:59.810058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c531d69-8699-46f1-91b9-3a890b19c3d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:59.818700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c531d69-8699-46f1-91b9-3a890b19c3d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:59.820102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c531d69-8699-46f1-91b9-3a890b19c3d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:59.821501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c531d69-8699-46f1-91b9-3a890b19c3d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:59.933819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-12bbd443-6ad0-406b-a2e1-d37de195e29f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:59.934875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-12bbd443-6ad0-406b-a2e1-d37de195e29f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:59.960503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12bbd443-6ad0-406b-a2e1-d37de195e29f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:59.970569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12bbd443-6ad0-406b-a2e1-d37de195e29f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:59.972316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12bbd443-6ad0-406b-a2e1-d37de195e29f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:59.975156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12bbd443-6ad0-406b-a2e1-d37de195e29f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:59.976747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12bbd443-6ad0-406b-a2e1-d37de195e29f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:59.977383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12bbd443-6ad0-406b-a2e1-d37de195e29f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:00.391784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-12bbd443-6ad0-406b-a2e1-d37de195e29f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:00.407004 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-12bbd443-6ad0-406b-a2e1-d37de195e29f tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 200 len: 1505 microversion: 2.1 time: 0.479651 Oct 29 02:52:00.407743 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 903/1865] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:59 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:00.415609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-1ec324de-d704-445c-97d1-289c28fc216d req-2c641de6-0a39-4597-ab97-c85d77e158ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1782e279-7a4c-47a0-983e-7e07b34162a6", "name": "network-vif-deleted", "tag": "04204f29-7f5c-4dd3-bbe2-d9c1f52c66e8"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:00.426876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1ec324de-d704-445c-97d1-289c28fc216d req-2c641de6-0a39-4597-ab97-c85d77e158ad service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:00.427730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1ec324de-d704-445c-97d1-289c28fc216d req-2c641de6-0a39-4597-ab97-c85d77e158ad service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:00.428438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1ec324de-d704-445c-97d1-289c28fc216d req-2c641de6-0a39-4597-ab97-c85d77e158ad service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:00.460675 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1ec324de-d704-445c-97d1-289c28fc216d req-2c641de6-0a39-4597-ab97-c85d77e158ad service nova] Creating event network-vif-deleted:04204f29-7f5c-4dd3-bbe2-d9c1f52c66e8 for instance 1782e279-7a4c-47a0-983e-7e07b34162a6 on n-h2-862964-4 Oct 29 02:52:00.472141 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-1ec324de-d704-445c-97d1-289c28fc216d req-2c641de6-0a39-4597-ab97-c85d77e158ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062242 Oct 29 02:52:00.477998 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 904/1866] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:00.484526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9aa4c452-1417-4fe6-9a86-053c1c78d7bf req-337d4701-c657-4f71-a5ab-7151151c7d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3632ea-9875-4193-8b4e-3917063ba265", "name": "network-vif-plugged", "status": "completed", "tag": "4c48a2aa-0282-4c60-954d-a90eaeb2c0e8"}, {"server_uuid": "1782e279-7a4c-47a0-983e-7e07b34162a6", "name": "network-vif-unplugged", "status": "completed", "tag": "04204f29-7f5c-4dd3-bbe2-d9c1f52c66e8"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:00.502877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9aa4c452-1417-4fe6-9a86-053c1c78d7bf req-337d4701-c657-4f71-a5ab-7151151c7d80 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:00.504390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9aa4c452-1417-4fe6-9a86-053c1c78d7bf req-337d4701-c657-4f71-a5ab-7151151c7d80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:00.505230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9aa4c452-1417-4fe6-9a86-053c1c78d7bf req-337d4701-c657-4f71-a5ab-7151151c7d80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:00.529149 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9aa4c452-1417-4fe6-9a86-053c1c78d7bf req-337d4701-c657-4f71-a5ab-7151151c7d80 service nova] Creating event network-vif-plugged:4c48a2aa-0282-4c60-954d-a90eaeb2c0e8 for instance fa3632ea-9875-4193-8b4e-3917063ba265 on n-h2-862964-4 Oct 29 02:52:00.531148 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9aa4c452-1417-4fe6-9a86-053c1c78d7bf req-337d4701-c657-4f71-a5ab-7151151c7d80 service nova] Creating event network-vif-unplugged:04204f29-7f5c-4dd3-bbe2-d9c1f52c66e8 for instance 1782e279-7a4c-47a0-983e-7e07b34162a6 on n-h2-862964-4 Oct 29 02:52:00.540825 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9aa4c452-1417-4fe6-9a86-053c1c78d7bf req-337d4701-c657-4f71-a5ab-7151151c7d80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.059713 Oct 29 02:52:00.542514 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 905/1867] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:00.551884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:00.554216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:00.578454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:00.579316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:00.579975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:00.583175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:00.584123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:00.584905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:00.631722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:00.632205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:00.632825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:00.633440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lazy-loading 'fault' on Instance uuid 1782e279-7a4c-47a0-983e-7e07b34162a6 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:00.700609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5c531d69-8699-46f1-91b9-3a890b19c3d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:00.710008 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c531d69-8699-46f1-91b9-3a890b19c3d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.933133 Oct 29 02:52:00.710628 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 963/1868] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:59 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:00.721291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-daef4a3c-e9e6-4b17-af81-21918dfbe628 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acb19e50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:00.732311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:00.742402 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c0e14369-be1e-4d46-87c5-e691c929dbc6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 200 len: 1314 microversion: 2.1 time: 0.198178 Oct 29 02:52:00.743193 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 906/1869] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:00 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:00.757905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3f56fc0-09fa-42ad-b984-46c488b5771c tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:00.758918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d3f56fc0-09fa-42ad-b984-46c488b5771c tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: fa3632ea-9875-4193-8b4e-3917063ba265] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:00.775909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f56fc0-09fa-42ad-b984-46c488b5771c tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:00.777842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f56fc0-09fa-42ad-b984-46c488b5771c tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:00.778488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f56fc0-09fa-42ad-b984-46c488b5771c tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:00.778609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f56fc0-09fa-42ad-b984-46c488b5771c tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:00.779020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f56fc0-09fa-42ad-b984-46c488b5771c tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:00.782093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f56fc0-09fa-42ad-b984-46c488b5771c tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:00.804878 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-daef4a3c-e9e6-4b17-af81-21918dfbe628 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1414 microversion: 2.1 time: 0.084722 Oct 29 02:52:00.806384 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 964/1870] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:00 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:00.820769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:00.821795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:00.831847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:00.832658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:00.833541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:00.834468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:00.836717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:00.837359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.107480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d3f56fc0-09fa-42ad-b984-46c488b5771c tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:01.115946 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3f56fc0-09fa-42ad-b984-46c488b5771c tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265" status: 200 len: 1318 microversion: 2.1 time: 0.371492 Oct 29 02:52:01.116538 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 907/1871] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:00 2022] GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:01.130125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9ac5350b-3ea4-4c69-84cb-08adf51b60fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:01.131031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9ac5350b-3ea4-4c69-84cb-08adf51b60fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:01.142327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ac5350b-3ea4-4c69-84cb-08adf51b60fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.145218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ac5350b-3ea4-4c69-84cb-08adf51b60fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.152013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ac5350b-3ea4-4c69-84cb-08adf51b60fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.153080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ac5350b-3ea4-4c69-84cb-08adf51b60fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.153746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ac5350b-3ea4-4c69-84cb-08adf51b60fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.154364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ac5350b-3ea4-4c69-84cb-08adf51b60fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.465651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:01.483904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:01.486458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:01.488492 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-42625472-fb8b-4d06-b83e-46f618feac51 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.680986 Oct 29 02:52:01.489655 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 965/1872] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:00 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:01.545343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9ac5350b-3ea4-4c69-84cb-08adf51b60fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:01.563341 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9ac5350b-3ea4-4c69-84cb-08adf51b60fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.443153 Oct 29 02:52:01.579534 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 908/1873] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:01 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:01.738094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44d43ef2-3477-4891-9add-a35f541503e5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:01.750832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-44d43ef2-3477-4891-9add-a35f541503e5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:01.766837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:01.767947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:01.775539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.777503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44d43ef2-3477-4891-9add-a35f541503e5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.778417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.779103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.781013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.784953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.785763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.790509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44d43ef2-3477-4891-9add-a35f541503e5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.791062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44d43ef2-3477-4891-9add-a35f541503e5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.791824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44d43ef2-3477-4891-9add-a35f541503e5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.792289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44d43ef2-3477-4891-9add-a35f541503e5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.792705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44d43ef2-3477-4891-9add-a35f541503e5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.826325 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] HTTP exception thrown: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 HTTP/1.1 Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:52:01.836503 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:01.838129 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1782e279-7a4c-47a0-983e-7e07b34162a6'} Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:01.839014 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:01.840438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:01.845526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 404 to user: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:01.846708 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ce60ec76-f230-4a15-80c7-8ffaeb63ef07 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 404 len: 111 microversion: 2.1 time: 0.083757 Oct 29 02:52:01.848787 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 909/1874] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:01 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:52:01.863530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d8eb37b-0293-4581-9f3e-75ca301d217b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c734c0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:01.928504 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d8eb37b-0293-4581-9f3e-75ca301d217b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1414 microversion: 2.1 time: 0.077576 Oct 29 02:52:01.929716 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 910/1875] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:01 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:02.052078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-904647240", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:02.182909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] validate_networks() for [('488ae119-e32d-45f9-bc42-27cf88a93460', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:52:02.262204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-44d43ef2-3477-4891-9add-a35f541503e5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:02.275636 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-44d43ef2-3477-4891-9add-a35f541503e5 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1475 microversion: 2.1 time: 0.544263 Oct 29 02:52:02.290173 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 966/1876] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:01 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1475 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:02.298588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f664bf94-28a8-4358-af8f-46b762051b00 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:02.299426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f664bf94-28a8-4358-af8f-46b762051b00 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: fa3632ea-9875-4193-8b4e-3917063ba265] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:02.306653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f664bf94-28a8-4358-af8f-46b762051b00 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:02.307526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f664bf94-28a8-4358-af8f-46b762051b00 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:02.308130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f664bf94-28a8-4358-af8f-46b762051b00 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:02.308997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f664bf94-28a8-4358-af8f-46b762051b00 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:02.309602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f664bf94-28a8-4358-af8f-46b762051b00 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:02.310231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f664bf94-28a8-4358-af8f-46b762051b00 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:03.707786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:52:03.708452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:52:03.709688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:52:03.710788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:52:03.711731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:52:03.723470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:03.724196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:03.724799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:03.734192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:03.735055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:03.735691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:03.785263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Getting quotas for project 0b30ce428766445d9d0d45f350ae1024. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:52:03.794001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Getting quotas for user 837f9940834e4eaeb31c967dba6d762f and project 0b30ce428766445d9d0d45f350ae1024. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:52:03.819505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:52:03.829157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:52:03.983644 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-93835772-660f-483d-a27b-1de8648402ab tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.935911 Oct 29 02:52:03.987913 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 911/1877] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:52:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 02:52:04.006630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:04.009572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:04.042164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:04.046202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:04.046995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:04.048068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:04.050652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:04.051337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:04.542577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f664bf94-28a8-4358-af8f-46b762051b00 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:04.554262 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f664bf94-28a8-4358-af8f-46b762051b00 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265" status: 200 len: 1318 microversion: 2.1 time: 2.261353 Oct 29 02:52:04.559097 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 967/1878] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:02 2022] GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265 => generated 1318 bytes in 2268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:04.582533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fd77f7d3-0a03-4eff-b126-4d7a4747b736 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:04.583847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fd77f7d3-0a03-4eff-b126-4d7a4747b736 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:04.595744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd77f7d3-0a03-4eff-b126-4d7a4747b736 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:04.596237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd77f7d3-0a03-4eff-b126-4d7a4747b736 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:04.596753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd77f7d3-0a03-4eff-b126-4d7a4747b736 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:04.608566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd77f7d3-0a03-4eff-b126-4d7a4747b736 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:04.613777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd77f7d3-0a03-4eff-b126-4d7a4747b736 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:04.614375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd77f7d3-0a03-4eff-b126-4d7a4747b736 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:04.910511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:04.926998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:04.931082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:04.934517 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c18a2fc1-79c0-412e-b05c-0ed73b78c194 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 0.943158 Oct 29 02:52:04.935333 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 912/1879] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:03 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:04.944423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5100c613-295b-445d-8376-82d0f8d13993 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8a109d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:05.047385 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5100c613-295b-445d-8376-82d0f8d13993 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1414 microversion: 2.1 time: 0.108681 Oct 29 02:52:05.048932 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 913/1880] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:04 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:05.103879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-467c324b-fb29-420e-ba11-f1d5b1f96037 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:05.110141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-467c324b-fb29-420e-ba11-f1d5b1f96037 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:05.133560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-467c324b-fb29-420e-ba11-f1d5b1f96037 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:05.138009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-467c324b-fb29-420e-ba11-f1d5b1f96037 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:05.140283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-467c324b-fb29-420e-ba11-f1d5b1f96037 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:05.146896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-467c324b-fb29-420e-ba11-f1d5b1f96037 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:05.148859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-467c324b-fb29-420e-ba11-f1d5b1f96037 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:05.149499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-467c324b-fb29-420e-ba11-f1d5b1f96037 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:05.677727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-467c324b-fb29-420e-ba11-f1d5b1f96037 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:05.692041 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-467c324b-fb29-420e-ba11-f1d5b1f96037 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1474 microversion: 2.1 time: 0.638031 Oct 29 02:52:05.694538 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 914/1881] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:05 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1474 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:05.700205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-60222420-c427-4899-a977-47eabcded53f req-289102c3-805e-4efa-82a2-53d566a4fc5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236d6444-122e-4926-b00b-2fd646ed9715", "name": "network-vif-plugged", "status": "completed", "tag": "e34003f1-cdfb-4f6e-9403-62dff5b693e5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:05.714595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-60222420-c427-4899-a977-47eabcded53f req-289102c3-805e-4efa-82a2-53d566a4fc5c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:05.721990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-60222420-c427-4899-a977-47eabcded53f req-289102c3-805e-4efa-82a2-53d566a4fc5c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:05.723151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-60222420-c427-4899-a977-47eabcded53f req-289102c3-805e-4efa-82a2-53d566a4fc5c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:05.753602 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-60222420-c427-4899-a977-47eabcded53f req-289102c3-805e-4efa-82a2-53d566a4fc5c service nova] Creating event network-vif-plugged:e34003f1-cdfb-4f6e-9403-62dff5b693e5 for instance 236d6444-122e-4926-b00b-2fd646ed9715 on n-h2-862964-4 Oct 29 02:52:05.767338 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-60222420-c427-4899-a977-47eabcded53f req-289102c3-805e-4efa-82a2-53d566a4fc5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070488 Oct 29 02:52:05.769783 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 915/1882] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:05.777504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-651d2c4f-b6cb-477e-be06-ace4249439db tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:05.778469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-651d2c4f-b6cb-477e-be06-ace4249439db tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:05.787321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d2c4f-b6cb-477e-be06-ace4249439db tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:05.787826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d2c4f-b6cb-477e-be06-ace4249439db tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:05.788821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d2c4f-b6cb-477e-be06-ace4249439db tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:05.789663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d2c4f-b6cb-477e-be06-ace4249439db tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:05.790208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d2c4f-b6cb-477e-be06-ace4249439db tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:05.790639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d2c4f-b6cb-477e-be06-ace4249439db tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:06.005364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-651d2c4f-b6cb-477e-be06-ace4249439db tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:06.017599 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-651d2c4f-b6cb-477e-be06-ace4249439db tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1276 microversion: 2.1 time: 0.245373 Oct 29 02:52:06.020991 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 916/1883] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:05 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:06.033404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f5f9440-4d64-4c67-b135-60ad76a62c60 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:06.046868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1f5f9440-4d64-4c67-b135-60ad76a62c60 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: fa3632ea-9875-4193-8b4e-3917063ba265] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:06.068553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5f9440-4d64-4c67-b135-60ad76a62c60 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:06.069044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5f9440-4d64-4c67-b135-60ad76a62c60 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:06.069470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5f9440-4d64-4c67-b135-60ad76a62c60 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:06.070205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5f9440-4d64-4c67-b135-60ad76a62c60 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:06.070652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5f9440-4d64-4c67-b135-60ad76a62c60 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:06.083098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f5f9440-4d64-4c67-b135-60ad76a62c60 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:06.437999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fd77f7d3-0a03-4eff-b126-4d7a4747b736 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:06.456430 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fd77f7d3-0a03-4eff-b126-4d7a4747b736 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 1.895881 Oct 29 02:52:06.461467 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 968/1884] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:04 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:06.480188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:06.488072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:06.501675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1f5f9440-4d64-4c67-b135-60ad76a62c60 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:06.514052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:06.515024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:06.515327 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1f5f9440-4d64-4c67-b135-60ad76a62c60 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265" status: 200 len: 1505 microversion: 2.1 time: 0.491539 Oct 29 02:52:06.515856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:06.516807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:06.517426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:06.518078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:06.518425 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 917/1885] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:06 2022] GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265 => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:06.539566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90f8012a-5201-4962-8880-778e26fa1723 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c730d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:06.667542 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90f8012a-5201-4962-8880-778e26fa1723 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1414 microversion: 2.1 time: 0.147483 Oct 29 02:52:06.668453 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 918/1886] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:06 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1414 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:06.701790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-5a4e3139-b638-49c6-8cba-313882151f34 req-9297977a-b18b-4ae4-9455-633e6a611c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c", "name": "network-vif-unplugged", "status": "completed", "tag": "34c62a40-e8c0-42f4-a697-e6a0fc8540fb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:06.733274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5a4e3139-b638-49c6-8cba-313882151f34 req-9297977a-b18b-4ae4-9455-633e6a611c60 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:06.733754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5a4e3139-b638-49c6-8cba-313882151f34 req-9297977a-b18b-4ae4-9455-633e6a611c60 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:06.738448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5a4e3139-b638-49c6-8cba-313882151f34 req-9297977a-b18b-4ae4-9455-633e6a611c60 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:06.765458 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-5a4e3139-b638-49c6-8cba-313882151f34 req-9297977a-b18b-4ae4-9455-633e6a611c60 service nova] Creating event network-vif-unplugged:34c62a40-e8c0-42f4-a697-e6a0fc8540fb for instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c on n-h2-862964-4 Oct 29 02:52:06.807090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-5a4e3139-b638-49c6-8cba-313882151f34 req-9297977a-b18b-4ae4-9455-633e6a611c60 service nova] Instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:52:06.830862 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-5a4e3139-b638-49c6-8cba-313882151f34 req-9297977a-b18b-4ae4-9455-633e6a611c60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160863 Oct 29 02:52:06.832697 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 919/1887] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:06.847305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d1fa5b3c-21b0-4d8c-9814-0baa3ce5bd61 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:06.848178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d1fa5b3c-21b0-4d8c-9814-0baa3ce5bd61 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: fa3632ea-9875-4193-8b4e-3917063ba265] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:06.876961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1fa5b3c-21b0-4d8c-9814-0baa3ce5bd61 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:06.877763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1fa5b3c-21b0-4d8c-9814-0baa3ce5bd61 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:06.878735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1fa5b3c-21b0-4d8c-9814-0baa3ce5bd61 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:06.880904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1fa5b3c-21b0-4d8c-9814-0baa3ce5bd61 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:06.881645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1fa5b3c-21b0-4d8c-9814-0baa3ce5bd61 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:06.883760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1fa5b3c-21b0-4d8c-9814-0baa3ce5bd61 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:06.996353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d1fa5b3c-21b0-4d8c-9814-0baa3ce5bd61 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: fa3632ea-9875-4193-8b4e-3917063ba265] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:52:07.160170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:07.273359 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d1fa5b3c-21b0-4d8c-9814-0baa3ce5bd61 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265" status: 204 len: 0 microversion: 2.1 time: 0.418429 Oct 29 02:52:07.275110 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 920/1888] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:52:06 2022] DELETE /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:52:07.299084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5172639c-e361-4b92-abd4-dc68abe396bb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:07.303718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5172639c-e361-4b92-abd4-dc68abe396bb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:07.334176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5172639c-e361-4b92-abd4-dc68abe396bb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:07.335509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5172639c-e361-4b92-abd4-dc68abe396bb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:07.337595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5172639c-e361-4b92-abd4-dc68abe396bb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:07.341498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5172639c-e361-4b92-abd4-dc68abe396bb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:07.343342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5172639c-e361-4b92-abd4-dc68abe396bb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:07.344483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5172639c-e361-4b92-abd4-dc68abe396bb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:07.828893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:07.843216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:07.852343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:07.853767 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-68827dc6-b6ca-42cd-82ce-35d526fc2323 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1812 microversion: 2.25 time: 1.390406 Oct 29 02:52:07.855594 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 969/1889] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:06 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1812 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:07.863149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5172639c-e361-4b92-abd4-dc68abe396bb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:07.863966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c149752-8d40-4555-9ca7-4027b02c5b0a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:07.866040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1c149752-8d40-4555-9ca7-4027b02c5b0a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:07.878572 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5172639c-e361-4b92-abd4-dc68abe396bb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1474 microversion: 2.1 time: 0.599110 Oct 29 02:52:07.887595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c149752-8d40-4555-9ca7-4027b02c5b0a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:07.888132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c149752-8d40-4555-9ca7-4027b02c5b0a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:07.890137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c149752-8d40-4555-9ca7-4027b02c5b0a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:07.890973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c149752-8d40-4555-9ca7-4027b02c5b0a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:07.892382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c149752-8d40-4555-9ca7-4027b02c5b0a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:07.894775 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 921/1890] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:07 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1474 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:07.895491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c149752-8d40-4555-9ca7-4027b02c5b0a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:07.906584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e44e4d1f-f969-45e7-96e3-c9ef57adc612 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:07.907110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e44e4d1f-f969-45e7-96e3-c9ef57adc612 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:07.936267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44e4d1f-f969-45e7-96e3-c9ef57adc612 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:07.937199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44e4d1f-f969-45e7-96e3-c9ef57adc612 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:07.945918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44e4d1f-f969-45e7-96e3-c9ef57adc612 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:07.946994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44e4d1f-f969-45e7-96e3-c9ef57adc612 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:07.947487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44e4d1f-f969-45e7-96e3-c9ef57adc612 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:07.947971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44e4d1f-f969-45e7-96e3-c9ef57adc612 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:08.022468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e44e4d1f-f969-45e7-96e3-c9ef57adc612 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:52:08.151745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1c149752-8d40-4555-9ca7-4027b02c5b0a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:08.182173 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1c149752-8d40-4555-9ca7-4027b02c5b0a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1282 microversion: 2.1 time: 0.313581 Oct 29 02:52:08.182837 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 970/1891] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:07 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1282 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:08.207076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d6098aa7-cef1-49e1-a7f7-4240493f89c0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:08.208441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d6098aa7-cef1-49e1-a7f7-4240493f89c0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:08.224437 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e44e4d1f-f969-45e7-96e3-c9ef57adc612 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 204 len: 0 microversion: 2.1 time: 0.328108 Oct 29 02:52:08.225017 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 922/1892] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:52:07 2022] DELETE /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:52:08.229417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6098aa7-cef1-49e1-a7f7-4240493f89c0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:08.236581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6098aa7-cef1-49e1-a7f7-4240493f89c0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:08.237042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6098aa7-cef1-49e1-a7f7-4240493f89c0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:08.238014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6098aa7-cef1-49e1-a7f7-4240493f89c0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:08.238476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6098aa7-cef1-49e1-a7f7-4240493f89c0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:08.238899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6098aa7-cef1-49e1-a7f7-4240493f89c0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:08.247547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-06f3070c-717d-43cf-a7c6-ac2b10741d80 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a89444c0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:08.344153 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-06f3070c-717d-43cf-a7c6-ac2b10741d80 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1414 microversion: 2.1 time: 0.113613 Oct 29 02:52:08.344742 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 923/1893] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:08 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:08.376250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-25361f59-3875-4788-b97f-52d6a0f3ce7b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:08.382579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-25361f59-3875-4788-b97f-52d6a0f3ce7b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: fa3632ea-9875-4193-8b4e-3917063ba265] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:08.394924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25361f59-3875-4788-b97f-52d6a0f3ce7b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:08.397653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25361f59-3875-4788-b97f-52d6a0f3ce7b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:08.398484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25361f59-3875-4788-b97f-52d6a0f3ce7b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:08.399788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25361f59-3875-4788-b97f-52d6a0f3ce7b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:08.400535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25361f59-3875-4788-b97f-52d6a0f3ce7b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:08.401406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25361f59-3875-4788-b97f-52d6a0f3ce7b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:08.575683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-25361f59-3875-4788-b97f-52d6a0f3ce7b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:08.586001 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-25361f59-3875-4788-b97f-52d6a0f3ce7b tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265" status: 200 len: 1511 microversion: 2.1 time: 0.229298 Oct 29 02:52:08.586588 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 924/1894] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:08 2022] GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:08.820431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d6098aa7-cef1-49e1-a7f7-4240493f89c0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:08.846729 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d6098aa7-cef1-49e1-a7f7-4240493f89c0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 0.657551 Oct 29 02:52:08.862606 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 971/1895] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:08 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:08.888729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:08.890507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:08.903992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1313410a-562a-494b-98f5-af12cd0a404f req-70884860-e034-4381-9e6c-956f21c864e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c", "tag": "34c62a40-e8c0-42f4-a697-e6a0fc8540fb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:08.918707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:08.923925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1313410a-562a-494b-98f5-af12cd0a404f req-70884860-e034-4381-9e6c-956f21c864e6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:08.927430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:08.928213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:08.930496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1313410a-562a-494b-98f5-af12cd0a404f req-70884860-e034-4381-9e6c-956f21c864e6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:08.931105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:08.932074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1313410a-562a-494b-98f5-af12cd0a404f req-70884860-e034-4381-9e6c-956f21c864e6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:08.932782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:08.935610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:08.967396 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1313410a-562a-494b-98f5-af12cd0a404f req-70884860-e034-4381-9e6c-956f21c864e6 service nova] Creating event network-changed:34c62a40-e8c0-42f4-a697-e6a0fc8540fb for instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c on n-h2-862964-4 Oct 29 02:52:08.998512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-1313410a-562a-494b-98f5-af12cd0a404f req-70884860-e034-4381-9e6c-956f21c864e6 service nova] Instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:52:09.033306 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1313410a-562a-494b-98f5-af12cd0a404f req-70884860-e034-4381-9e6c-956f21c864e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134869 Oct 29 02:52:09.038881 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 972/1896] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:09.052869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-572bd25e-af3c-4453-91b7-cabc690b4b47 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:09.062398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-572bd25e-af3c-4453-91b7-cabc690b4b47 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:09.081606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-572bd25e-af3c-4453-91b7-cabc690b4b47 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:09.083128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-572bd25e-af3c-4453-91b7-cabc690b4b47 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:09.083963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-572bd25e-af3c-4453-91b7-cabc690b4b47 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:09.087896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-572bd25e-af3c-4453-91b7-cabc690b4b47 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:09.090127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-572bd25e-af3c-4453-91b7-cabc690b4b47 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:09.091674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-572bd25e-af3c-4453-91b7-cabc690b4b47 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:09.460725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-572bd25e-af3c-4453-91b7-cabc690b4b47 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:09.475740 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-572bd25e-af3c-4453-91b7-cabc690b4b47 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1474 microversion: 2.1 time: 0.431617 Oct 29 02:52:09.500836 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 973/1897] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:09 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1474 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:09.524490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90a1e31f-f967-4c65-8584-def7db96fb04 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:09.530700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-90a1e31f-f967-4c65-8584-def7db96fb04 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:09.577520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90a1e31f-f967-4c65-8584-def7db96fb04 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:09.578478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90a1e31f-f967-4c65-8584-def7db96fb04 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:09.582255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90a1e31f-f967-4c65-8584-def7db96fb04 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:09.587449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90a1e31f-f967-4c65-8584-def7db96fb04 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:09.589925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90a1e31f-f967-4c65-8584-def7db96fb04 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:09.591922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90a1e31f-f967-4c65-8584-def7db96fb04 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:10.127477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:10.144544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:10.146604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:10.149678 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d6d29e8-dcf4-41a3-ac92-8f09a047fd1e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1802 microversion: 2.25 time: 1.267198 Oct 29 02:52:10.153758 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 925/1898] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:08 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1802 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:10.164381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f281fc35-b28d-4bb9-99ff-bf043e546b4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a88d7a60>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:10.248396 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f281fc35-b28d-4bb9-99ff-bf043e546b4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1414 microversion: 2.1 time: 0.093148 Oct 29 02:52:10.251433 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 926/1899] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:10 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:10.262081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7af55a50-7db9-4c7b-841f-89fafbe92788 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:10.263826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7af55a50-7db9-4c7b-841f-89fafbe92788 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: fa3632ea-9875-4193-8b4e-3917063ba265] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:10.280684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7af55a50-7db9-4c7b-841f-89fafbe92788 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:10.281388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7af55a50-7db9-4c7b-841f-89fafbe92788 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:10.282391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7af55a50-7db9-4c7b-841f-89fafbe92788 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:10.283363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7af55a50-7db9-4c7b-841f-89fafbe92788 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:10.285311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7af55a50-7db9-4c7b-841f-89fafbe92788 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:10.287085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7af55a50-7db9-4c7b-841f-89fafbe92788 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:10.371307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-90a1e31f-f967-4c65-8584-def7db96fb04 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:10.393915 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-90a1e31f-f967-4c65-8584-def7db96fb04 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1282 microversion: 2.1 time: 0.891266 Oct 29 02:52:10.407478 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 974/1900] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:09 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1282 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:10.421740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7c6edbdd-3342-4559-9840-bf78749ab0be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:10.429159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7c6edbdd-3342-4559-9840-bf78749ab0be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:10.448117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6edbdd-3342-4559-9840-bf78749ab0be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:10.448864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6edbdd-3342-4559-9840-bf78749ab0be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:10.449486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6edbdd-3342-4559-9840-bf78749ab0be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:10.450422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6edbdd-3342-4559-9840-bf78749ab0be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:10.458268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6edbdd-3342-4559-9840-bf78749ab0be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:10.458979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6edbdd-3342-4559-9840-bf78749ab0be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:10.858404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7af55a50-7db9-4c7b-841f-89fafbe92788 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:10.891099 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7af55a50-7db9-4c7b-841f-89fafbe92788 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265" status: 200 len: 1511 microversion: 2.1 time: 0.638500 Oct 29 02:52:10.896943 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 927/1901] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:10 2022] GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265 => generated 1511 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:10.921514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c565d165-d987-4586-91e5-2143d60a0750 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '.version_select at 0x7fe1a89e1c10>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:10.955946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c565d165-d987-4586-91e5-2143d60a0750 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:10.956502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c565d165-d987-4586-91e5-2143d60a0750 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:10.962774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c565d165-d987-4586-91e5-2143d60a0750 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:11.040101 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c565d165-d987-4586-91e5-2143d60a0750 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 4719 microversion: 2.25 time: 0.139326 Oct 29 02:52:11.040748 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 928/1902] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Oct 29 02:52:10 2022] GET /compute/v2.1/os-migrations => generated 4719 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:11.062999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a9296fa0-e91d-4de5-ba1a-d634fd5c896b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:11.063637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a9296fa0-e91d-4de5-ba1a-d634fd5c896b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:11.098327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9296fa0-e91d-4de5-ba1a-d634fd5c896b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:11.102368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9296fa0-e91d-4de5-ba1a-d634fd5c896b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:11.102860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9296fa0-e91d-4de5-ba1a-d634fd5c896b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:11.108346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9296fa0-e91d-4de5-ba1a-d634fd5c896b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:11.109007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9296fa0-e91d-4de5-ba1a-d634fd5c896b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:11.109386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9296fa0-e91d-4de5-ba1a-d634fd5c896b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:12.229782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a9296fa0-e91d-4de5-ba1a-d634fd5c896b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:12.238772 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a9296fa0-e91d-4de5-ba1a-d634fd5c896b tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1474 microversion: 2.1 time: 1.191363 Oct 29 02:52:12.242130 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 929/1903] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:11 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1474 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:12.257660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fd682351-e64b-406c-8d67-b498a4ebfc44 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:12.258566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fd682351-e64b-406c-8d67-b498a4ebfc44 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:12.272548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd682351-e64b-406c-8d67-b498a4ebfc44 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:12.273038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd682351-e64b-406c-8d67-b498a4ebfc44 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:12.273469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd682351-e64b-406c-8d67-b498a4ebfc44 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:12.274206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd682351-e64b-406c-8d67-b498a4ebfc44 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:12.274652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd682351-e64b-406c-8d67-b498a4ebfc44 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:12.275070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd682351-e64b-406c-8d67-b498a4ebfc44 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:12.383278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7c6edbdd-3342-4559-9840-bf78749ab0be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:12.397646 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7c6edbdd-3342-4559-9840-bf78749ab0be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1715 microversion: 2.1 time: 1.988591 Oct 29 02:52:12.398527 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 975/1904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:10 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1715 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:12.421732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-47590cb8-af1b-4a57-9822-31d081e6b8a5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acc081f0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:13.765086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:13.816234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:13.835835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-fd682351-e64b-406c-8d67-b498a4ebfc44 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid bce4caa1-3b78-4bcf-98e4-b4d9da71dfee {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:13.875144 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fd682351-e64b-406c-8d67-b498a4ebfc44 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 2421 microversion: 2.25 time: 1.629738 Oct 29 02:52:13.894474 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 930/1905] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:12 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 2421 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:13.922720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-679a0aa8-3752-4a7f-91dd-cebd991b9f7a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:13.923139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-679a0aa8-3752-4a7f-91dd-cebd991b9f7a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:13.958611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679a0aa8-3752-4a7f-91dd-cebd991b9f7a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:13.966037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679a0aa8-3752-4a7f-91dd-cebd991b9f7a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:13.966602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679a0aa8-3752-4a7f-91dd-cebd991b9f7a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:13.967354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679a0aa8-3752-4a7f-91dd-cebd991b9f7a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:13.967819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679a0aa8-3752-4a7f-91dd-cebd991b9f7a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:13.968243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679a0aa8-3752-4a7f-91dd-cebd991b9f7a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:14.489706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-679a0aa8-3752-4a7f-91dd-cebd991b9f7a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:14.500062 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-679a0aa8-3752-4a7f-91dd-cebd991b9f7a tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1282 microversion: 2.1 time: 0.602035 Oct 29 02:52:14.518340 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 931/1906] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:13 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1282 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:14.528008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:14.528823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: fa3632ea-9875-4193-8b4e-3917063ba265] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:14.561455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:14.561637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:14.562115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:14.567168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:14.567644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:14.568309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:14.631083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:14.631986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:14.632587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:14.633199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lazy-loading 'fault' on Instance uuid fa3632ea-9875-4193-8b4e-3917063ba265 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:14.768850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:14.781057 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e0d0b626-c4fc-40ce-8197-6770ef8e71f2 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265" status: 200 len: 1308 microversion: 2.1 time: 0.261201 Oct 29 02:52:14.782023 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 932/1907] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:14 2022] GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265 => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:14.794357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-8bb600d9-2c22-41a0-a7fe-8151c0fcb73c req-ba364446-20d4-42b9-a7e3-70336800970d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e79dac-7876-4e2d-913c-0662ffb235c9", "name": "network-vif-deleted", "tag": "2f43e45f-e320-4fc5-9065-a0984991b317"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:14.813225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8bb600d9-2c22-41a0-a7fe-8151c0fcb73c req-ba364446-20d4-42b9-a7e3-70336800970d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:14.814689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8bb600d9-2c22-41a0-a7fe-8151c0fcb73c req-ba364446-20d4-42b9-a7e3-70336800970d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:14.817352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8bb600d9-2c22-41a0-a7fe-8151c0fcb73c req-ba364446-20d4-42b9-a7e3-70336800970d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:14.831995 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-8bb600d9-2c22-41a0-a7fe-8151c0fcb73c req-ba364446-20d4-42b9-a7e3-70336800970d service nova] Creating event network-vif-deleted:2f43e45f-e320-4fc5-9065-a0984991b317 for instance 34e79dac-7876-4e2d-913c-0662ffb235c9 on n-h1-862964-4 Oct 29 02:52:14.837541 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-8bb600d9-2c22-41a0-a7fe-8151c0fcb73c req-ba364446-20d4-42b9-a7e3-70336800970d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053944 Oct 29 02:52:14.839001 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 933/1908] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:14.846058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b95f1624-2146-490f-9a91-67db44dbed75 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:14.847335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b95f1624-2146-490f-9a91-67db44dbed75 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:14.855014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95f1624-2146-490f-9a91-67db44dbed75 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:14.856059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95f1624-2146-490f-9a91-67db44dbed75 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:14.856769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95f1624-2146-490f-9a91-67db44dbed75 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:14.857715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95f1624-2146-490f-9a91-67db44dbed75 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:14.858629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95f1624-2146-490f-9a91-67db44dbed75 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:14.859454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95f1624-2146-490f-9a91-67db44dbed75 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:15.302496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b95f1624-2146-490f-9a91-67db44dbed75 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:15.312085 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b95f1624-2146-490f-9a91-67db44dbed75 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1472 microversion: 2.1 time: 0.471615 Oct 29 02:52:15.312676 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 934/1909] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:14 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1472 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:15.330618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-07274cc4-08c7-4464-b63e-d937a87c8484 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:15.331383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-07274cc4-08c7-4464-b63e-d937a87c8484 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:15.340370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07274cc4-08c7-4464-b63e-d937a87c8484 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:15.344690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07274cc4-08c7-4464-b63e-d937a87c8484 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:15.347403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07274cc4-08c7-4464-b63e-d937a87c8484 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:15.350037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07274cc4-08c7-4464-b63e-d937a87c8484 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:15.352429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07274cc4-08c7-4464-b63e-d937a87c8484 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:15.353107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07274cc4-08c7-4464-b63e-d937a87c8484 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:15.767373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-07274cc4-08c7-4464-b63e-d937a87c8484 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:15.780038 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-07274cc4-08c7-4464-b63e-d937a87c8484 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1705 microversion: 2.1 time: 0.459329 Oct 29 02:52:15.787630 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 935/1910] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:15 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1705 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:15.794385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c33d80b9-8c98-4d46-8feb-f4aee314b3a7 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:15.797107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c33d80b9-8c98-4d46-8feb-f4aee314b3a7 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:15.811184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c33d80b9-8c98-4d46-8feb-f4aee314b3a7 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:15.812546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c33d80b9-8c98-4d46-8feb-f4aee314b3a7 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:15.819212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c33d80b9-8c98-4d46-8feb-f4aee314b3a7 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:15.820340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c33d80b9-8c98-4d46-8feb-f4aee314b3a7 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:15.821012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c33d80b9-8c98-4d46-8feb-f4aee314b3a7 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:15.825250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c33d80b9-8c98-4d46-8feb-f4aee314b3a7 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:16.402367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-c33d80b9-8c98-4d46-8feb-f4aee314b3a7 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid bce4caa1-3b78-4bcf-98e4-b4d9da71dfee {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:16.437952 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c33d80b9-8c98-4d46-8feb-f4aee314b3a7 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 2421 microversion: 2.25 time: 0.648836 Oct 29 02:52:16.438555 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 936/1911] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:15 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 2421 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:16.450415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3705b3bb-3c77-4968-b3a9-115ab8ef5e88 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:16.451288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3705b3bb-3c77-4968-b3a9-115ab8ef5e88 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:16.466618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:16.478513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3705b3bb-3c77-4968-b3a9-115ab8ef5e88 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:16.479210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3705b3bb-3c77-4968-b3a9-115ab8ef5e88 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:16.479828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3705b3bb-3c77-4968-b3a9-115ab8ef5e88 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:16.480748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3705b3bb-3c77-4968-b3a9-115ab8ef5e88 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:16.484663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3705b3bb-3c77-4968-b3a9-115ab8ef5e88 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:16.485645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3705b3bb-3c77-4968-b3a9-115ab8ef5e88 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:17.021378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3705b3bb-3c77-4968-b3a9-115ab8ef5e88 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:17.025006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:17.047581 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3705b3bb-3c77-4968-b3a9-115ab8ef5e88 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1324 microversion: 2.1 time: 0.602621 Oct 29 02:52:17.051605 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 937/1912] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:16 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1324 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:17.069191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:17.072680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: fa3632ea-9875-4193-8b4e-3917063ba265] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:17.097604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:17.098569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:17.099396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:17.100348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:17.100969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:17.109277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:17.222918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:17.229380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:17.230521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:17.232652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lazy-loading 'fault' on Instance uuid fa3632ea-9875-4193-8b4e-3917063ba265 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:17.365596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0790d41f1d6452c92dc3d3dcc8d0af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:17.379691 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8c8f583e-2761-41b2-96e5-188c1f9e1fa9 tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265" status: 200 len: 1308 microversion: 2.1 time: 0.326677 Oct 29 02:52:17.380300 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 938/1913] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:17 2022] GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265 => generated 1308 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:17.407461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-68d24468-3c1c-4404-98ba-9aa91466ea80 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '.version_select at 0x7fe1a86dd5e0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:17.412073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68d24468-3c1c-4404-98ba-9aa91466ea80 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:17.422576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68d24468-3c1c-4404-98ba-9aa91466ea80 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:17.423352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68d24468-3c1c-4404-98ba-9aa91466ea80 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:17.437177 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-68d24468-3c1c-4404-98ba-9aa91466ea80 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3889 microversion: 2.1 time: 0.041494 Oct 29 02:52:17.437819 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 939/1914] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:52:17 2022] GET /compute/v2.1/os-migrations => generated 3889 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:17.455824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ff74f14-aad2-4b03-bc67-e0c982e5ae27 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:17.460166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ff74f14-aad2-4b03-bc67-e0c982e5ae27 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:17.472643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff74f14-aad2-4b03-bc67-e0c982e5ae27 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:17.475442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff74f14-aad2-4b03-bc67-e0c982e5ae27 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:17.482688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff74f14-aad2-4b03-bc67-e0c982e5ae27 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:17.483854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff74f14-aad2-4b03-bc67-e0c982e5ae27 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:17.484530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff74f14-aad2-4b03-bc67-e0c982e5ae27 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:17.485125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff74f14-aad2-4b03-bc67-e0c982e5ae27 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:18.169036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ff74f14-aad2-4b03-bc67-e0c982e5ae27 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:18.187885 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ff74f14-aad2-4b03-bc67-e0c982e5ae27 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1469 microversion: 2.1 time: 0.738529 Oct 29 02:52:18.214217 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 940/1915] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:17 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1469 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:18.223105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63650f5f-b8fe-4cf4-bca4-72c12ca05df8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:18.226013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-63650f5f-b8fe-4cf4-bca4-72c12ca05df8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:18.236538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63650f5f-b8fe-4cf4-bca4-72c12ca05df8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:18.237675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63650f5f-b8fe-4cf4-bca4-72c12ca05df8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:18.238726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63650f5f-b8fe-4cf4-bca4-72c12ca05df8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:18.239831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63650f5f-b8fe-4cf4-bca4-72c12ca05df8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:18.240675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63650f5f-b8fe-4cf4-bca4-72c12ca05df8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:18.241779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63650f5f-b8fe-4cf4-bca4-72c12ca05df8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:18.446952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-63650f5f-b8fe-4cf4-bca4-72c12ca05df8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lazy-loading 'services' on Instance uuid bce4caa1-3b78-4bcf-98e4-b4d9da71dfee {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:18.740451 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-63650f5f-b8fe-4cf4-bca4-72c12ca05df8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments/e586232f-b0af-4d14-8e55-2dca13cb8629" status: 202 len: 0 microversion: 2.25 time: 0.524417 Oct 29 02:52:18.743243 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 941/1916] 10.222.0.16 () {60 vars in 1457 bytes} [Sat Oct 29 02:52:18 2022] DELETE /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments/e586232f-b0af-4d14-8e55-2dca13cb8629 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:52:18.758758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ec6cab0c-1b5b-400f-922b-7bdab156c1ab req-736ef1da-348a-4abb-ba1c-4ed6e13786b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3632ea-9875-4193-8b4e-3917063ba265", "name": "network-vif-deleted", "tag": "4c48a2aa-0282-4c60-954d-a90eaeb2c0e8"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:18.789387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ec6cab0c-1b5b-400f-922b-7bdab156c1ab req-736ef1da-348a-4abb-ba1c-4ed6e13786b8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:18.789880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ec6cab0c-1b5b-400f-922b-7bdab156c1ab req-736ef1da-348a-4abb-ba1c-4ed6e13786b8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:18.790339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ec6cab0c-1b5b-400f-922b-7bdab156c1ab req-736ef1da-348a-4abb-ba1c-4ed6e13786b8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:18.824468 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ec6cab0c-1b5b-400f-922b-7bdab156c1ab req-736ef1da-348a-4abb-ba1c-4ed6e13786b8 service nova] Creating event network-vif-deleted:4c48a2aa-0282-4c60-954d-a90eaeb2c0e8 for instance fa3632ea-9875-4193-8b4e-3917063ba265 on n-h2-862964-4 Oct 29 02:52:18.842430 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ec6cab0c-1b5b-400f-922b-7bdab156c1ab req-736ef1da-348a-4abb-ba1c-4ed6e13786b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096170 Oct 29 02:52:18.844675 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 942/1917] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:18.869210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ae927ddc-9c1a-4e28-bf42-be8f5f4243ec tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:18.869962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ae927ddc-9c1a-4e28-bf42-be8f5f4243ec tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:18.884818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae927ddc-9c1a-4e28-bf42-be8f5f4243ec tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:18.885311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae927ddc-9c1a-4e28-bf42-be8f5f4243ec tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:18.885744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae927ddc-9c1a-4e28-bf42-be8f5f4243ec tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:18.886496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae927ddc-9c1a-4e28-bf42-be8f5f4243ec tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:18.889682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae927ddc-9c1a-4e28-bf42-be8f5f4243ec tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:18.891697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae927ddc-9c1a-4e28-bf42-be8f5f4243ec tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:19.488278 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ae927ddc-9c1a-4e28-bf42-be8f5f4243ec tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1856 microversion: 2.1 time: 0.617163 Oct 29 02:52:19.502314 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 943/1918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:18 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1856 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:19.515167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3fbb874-c007-489f-8354-b68b3496fb3e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:19.520453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a3fbb874-c007-489f-8354-b68b3496fb3e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:19.535233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3fbb874-c007-489f-8354-b68b3496fb3e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:19.537023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3fbb874-c007-489f-8354-b68b3496fb3e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:19.539130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3fbb874-c007-489f-8354-b68b3496fb3e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:19.542467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3fbb874-c007-489f-8354-b68b3496fb3e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:19.542960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3fbb874-c007-489f-8354-b68b3496fb3e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:19.543402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3fbb874-c007-489f-8354-b68b3496fb3e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:20.006752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a3fbb874-c007-489f-8354-b68b3496fb3e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:20.023121 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a3fbb874-c007-489f-8354-b68b3496fb3e tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1324 microversion: 2.1 time: 0.518671 Oct 29 02:52:20.024318 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 944/1919] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:19 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1324 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:20.029904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f15fa971-8ab9-458d-b775-047fec2448e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:20.030784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f15fa971-8ab9-458d-b775-047fec2448e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:20.042741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f15fa971-8ab9-458d-b775-047fec2448e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:20.044233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f15fa971-8ab9-458d-b775-047fec2448e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:20.045592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f15fa971-8ab9-458d-b775-047fec2448e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:20.047110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f15fa971-8ab9-458d-b775-047fec2448e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:20.048479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f15fa971-8ab9-458d-b775-047fec2448e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:20.051071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f15fa971-8ab9-458d-b775-047fec2448e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:20.340179 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f15fa971-8ab9-458d-b775-047fec2448e9 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "POST /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c/action" status: 202 len: 0 microversion: 2.1 time: 0.313731 Oct 29 02:52:20.343949 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 945/1920] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:52:20 2022] POST /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:52:20.353086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:20.353861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: fa3632ea-9875-4193-8b4e-3917063ba265] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:20.387031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:20.388048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:20.388612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:20.389349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:20.390345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:20.395348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:20.427474 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] HTTP exception thrown: Instance fa3632ea-9875-4193-8b4e-3917063ba265 could not be found. Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Request method failure captured: Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265 HTTP/1.1 Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUb9XpEK9BzicKMdpF02jm_lQKxNrm4eDrQWB14scPBMy2SnFqLO5Iv-iv2V5SoakEd84hUDjRrSwK7GQf7PdP7CLCToCRJprQN8nVA9MSuLT9Byvu-2Q3U62Qf3CViVOAbhggLvKl29N4U_M415FRy-5K2_954xuDyG1jBZ9N5D4g Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: a4b218a2276a4bb9acd9c1b0cfa3b5a8 Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-MultipleCreateTestJSON-1233558714 Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:52:20.429523 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4b218a2276a4bb9acd9c1b0cfa3b5a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4b218a2276a4bb9acd9c1b0cfa3b5a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4b218a2276a4bb9acd9c1b0cfa3b5a8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4b218a2276a4bb9acd9c1b0cfa3b5a8"}]}] Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-MultipleCreateTestJSON-1233558714 Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: a4b218a2276a4bb9acd9c1b0cfa3b5a8 Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1233558714 Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-MultipleCreateTestJSON-1233558714-project Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f0790d41f1d6452c92dc3d3dcc8d0af6 Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-MultipleCreateTestJSON-1233558714-project Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance fa3632ea-9875-4193-8b4e-3917063ba265 could not be found. Oct 29 02:52:20.431698 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'fa3632ea-9875-4193-8b4e-3917063ba265'} Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3632ea-9875-4193-8b4e-3917063ba265 could not be found. Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:20.432615 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3632ea-9875-4193-8b4e-3917063ba265 could not be found. Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3632ea-9875-4193-8b4e-3917063ba265 could not be found. Oct 29 02:52:20.434102 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:20.436483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Returning 404 to user: Instance fa3632ea-9875-4193-8b4e-3917063ba265 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:20.437372 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e2e16e1a-caf4-4a85-a22c-af1c64c5e91e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265" status: 404 len: 111 microversion: 2.1 time: 0.094516 Oct 29 02:52:20.445052 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 946/1921] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:20 2022] GET /compute/v2.1/servers/fa3632ea-9875-4193-8b4e-3917063ba265 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:20.446792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:20.457649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8496099a-be6e-42a7-a78a-4d8d6d26de6e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:20.463500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8496099a-be6e-42a7-a78a-4d8d6d26de6e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:20.479167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8496099a-be6e-42a7-a78a-4d8d6d26de6e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:20.480066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8496099a-be6e-42a7-a78a-4d8d6d26de6e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:20.481900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8496099a-be6e-42a7-a78a-4d8d6d26de6e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:20.484581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8496099a-be6e-42a7-a78a-4d8d6d26de6e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:20.485354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8496099a-be6e-42a7-a78a-4d8d6d26de6e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:20.487278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8496099a-be6e-42a7-a78a-4d8d6d26de6e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:20.557881 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8496099a-be6e-42a7-a78a-4d8d6d26de6e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.110265 Oct 29 02:52:20.566676 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 947/1922] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 02:52:20 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:52:20.577114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d05ced25-be9b-4f51-b12b-f96353d1b5e6 req-0ad251f5-7d93-4cc6-b873-0de40e7beff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c", "name": "network-vif-plugged", "status": "completed", "tag": "34c62a40-e8c0-42f4-a697-e6a0fc8540fb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:20.600973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d05ced25-be9b-4f51-b12b-f96353d1b5e6 req-0ad251f5-7d93-4cc6-b873-0de40e7beff6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:20.604086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d05ced25-be9b-4f51-b12b-f96353d1b5e6 req-0ad251f5-7d93-4cc6-b873-0de40e7beff6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:20.604645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d05ced25-be9b-4f51-b12b-f96353d1b5e6 req-0ad251f5-7d93-4cc6-b873-0de40e7beff6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:20.632013 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d05ced25-be9b-4f51-b12b-f96353d1b5e6 req-0ad251f5-7d93-4cc6-b873-0de40e7beff6 service nova] Creating event network-vif-plugged:34c62a40-e8c0-42f4-a697-e6a0fc8540fb for instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c on n-h2-862964-4 Oct 29 02:52:20.649258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-d05ced25-be9b-4f51-b12b-f96353d1b5e6 req-0ad251f5-7d93-4cc6-b873-0de40e7beff6 service nova] Instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:52:20.670911 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d05ced25-be9b-4f51-b12b-f96353d1b5e6 req-0ad251f5-7d93-4cc6-b873-0de40e7beff6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101161 Oct 29 02:52:20.671935 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 948/1923] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:20.697498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-43db4008-43ba-454c-9edd-88e8d207c0cd tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:20.698378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-43db4008-43ba-454c-9edd-88e8d207c0cd tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:20.757005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43db4008-43ba-454c-9edd-88e8d207c0cd tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:20.758068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43db4008-43ba-454c-9edd-88e8d207c0cd tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:20.758521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43db4008-43ba-454c-9edd-88e8d207c0cd tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:20.766200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43db4008-43ba-454c-9edd-88e8d207c0cd tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:20.770291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43db4008-43ba-454c-9edd-88e8d207c0cd tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:20.770742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43db4008-43ba-454c-9edd-88e8d207c0cd tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:21.104092 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-43db4008-43ba-454c-9edd-88e8d207c0cd tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1856 microversion: 2.1 time: 0.430844 Oct 29 02:52:21.109970 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 949/1924] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:20 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1856 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:21.115464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-beb13735-f306-49d8-9d0c-c66e1d41ba17 req-09e93f66-b9c4-4540-b80f-9aec9e414909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0f8e1f-659c-4e3d-be95-88c47843a291", "tag": "098b461c-9fa2-4857-b9a0-87402ea4e24d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:21.165989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-beb13735-f306-49d8-9d0c-c66e1d41ba17 req-09e93f66-b9c4-4540-b80f-9aec9e414909 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:21.166919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-beb13735-f306-49d8-9d0c-c66e1d41ba17 req-09e93f66-b9c4-4540-b80f-9aec9e414909 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:21.167558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-beb13735-f306-49d8-9d0c-c66e1d41ba17 req-09e93f66-b9c4-4540-b80f-9aec9e414909 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:21.195725 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-beb13735-f306-49d8-9d0c-c66e1d41ba17 req-09e93f66-b9c4-4540-b80f-9aec9e414909 service nova] Creating event network-changed:098b461c-9fa2-4857-b9a0-87402ea4e24d for instance 0a0f8e1f-659c-4e3d-be95-88c47843a291 on n-h2-862964-4 Oct 29 02:52:21.212690 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-beb13735-f306-49d8-9d0c-c66e1d41ba17 req-09e93f66-b9c4-4540-b80f-9aec9e414909 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100355 Oct 29 02:52:21.216562 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 950/1925] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:21.222889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f372e82-a82a-4756-bcbc-daac091676d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:21.231093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5f372e82-a82a-4756-bcbc-daac091676d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:21.267520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f372e82-a82a-4756-bcbc-daac091676d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:21.268624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f372e82-a82a-4756-bcbc-daac091676d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:21.270573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f372e82-a82a-4756-bcbc-daac091676d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:21.271925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f372e82-a82a-4756-bcbc-daac091676d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:21.273751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f372e82-a82a-4756-bcbc-daac091676d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:21.276940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f372e82-a82a-4756-bcbc-daac091676d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:21.598361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5f372e82-a82a-4756-bcbc-daac091676d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:21.607756 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f372e82-a82a-4756-bcbc-daac091676d7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1468 microversion: 2.1 time: 0.389697 Oct 29 02:52:21.629142 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 951/1926] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:21 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1468 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:21.638358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:21.642763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] [instance: 34e79dac-7876-4e2d-913c-0662ffb235c9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:21.660368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:21.660960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:21.661438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:21.666291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:21.666762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:21.667173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:21.691094 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] HTTP exception thrown: Instance 34e79dac-7876-4e2d-913c-0662ffb235c9 could not be found. Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Request method failure captured: Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 HTTP/1.1 Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUb9XpEK9BzicKMdpF02jm_lQKxNrm4eDrQWB14scPBMy2SnFqLO5Iv-iv2V5SoakEd84hUDjRrSwK7GQf7PdP7CLCToCRJprQN8nVA9MSuLT9Byvu-2Q3U62Qf3CViVOAbhggLvKl29N4U_M415FRy-5K2_954xuDyG1jBZ9N5D4g Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: a4b218a2276a4bb9acd9c1b0cfa3b5a8 Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-MultipleCreateTestJSON-1233558714 Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:52:21.692727 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4b218a2276a4bb9acd9c1b0cfa3b5a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4b218a2276a4bb9acd9c1b0cfa3b5a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4b218a2276a4bb9acd9c1b0cfa3b5a8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4b218a2276a4bb9acd9c1b0cfa3b5a8"}]}] Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-MultipleCreateTestJSON-1233558714 Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: a4b218a2276a4bb9acd9c1b0cfa3b5a8 Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1233558714 Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-MultipleCreateTestJSON-1233558714-project Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f0790d41f1d6452c92dc3d3dcc8d0af6 Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-MultipleCreateTestJSON-1233558714-project Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 34e79dac-7876-4e2d-913c-0662ffb235c9 could not be found. Oct 29 02:52:21.694518 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '34e79dac-7876-4e2d-913c-0662ffb235c9'} Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34e79dac-7876-4e2d-913c-0662ffb235c9 could not be found. Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:21.695551 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34e79dac-7876-4e2d-913c-0662ffb235c9 could not be found. Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34e79dac-7876-4e2d-913c-0662ffb235c9 could not be found. Oct 29 02:52:21.697182 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:21.704043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] Returning 404 to user: Instance 34e79dac-7876-4e2d-913c-0662ffb235c9 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:21.708218 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-97bc0fb7-ac55-4568-baf6-79d4e20e738e tempest-MultipleCreateTestJSON-1233558714 tempest-MultipleCreateTestJSON-1233558714-project] 10.222.0.16 "GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9" status: 404 len: 111 microversion: 2.1 time: 0.074594 Oct 29 02:52:21.729204 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 952/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:21 2022] GET /compute/v2.1/servers/34e79dac-7876-4e2d-913c-0662ffb235c9 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:21.750247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-861b94d8-2f7c-4b3a-9750-b11febb8bad5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:21.750877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-861b94d8-2f7c-4b3a-9750-b11febb8bad5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:21.775578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861b94d8-2f7c-4b3a-9750-b11febb8bad5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:21.776082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861b94d8-2f7c-4b3a-9750-b11febb8bad5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:21.776500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861b94d8-2f7c-4b3a-9750-b11febb8bad5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:21.777211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861b94d8-2f7c-4b3a-9750-b11febb8bad5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:21.781423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861b94d8-2f7c-4b3a-9750-b11febb8bad5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:21.781931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861b94d8-2f7c-4b3a-9750-b11febb8bad5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:22.329113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-861b94d8-2f7c-4b3a-9750-b11febb8bad5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:22.338267 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-861b94d8-2f7c-4b3a-9750-b11febb8bad5 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1324 microversion: 2.1 time: 0.607758 Oct 29 02:52:22.344831 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 953/1928] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:21 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1324 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:22.360762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7e0af477-ec51-40e4-be24-f51d4558eb96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:22.366067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7e0af477-ec51-40e4-be24-f51d4558eb96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:22.387219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0af477-ec51-40e4-be24-f51d4558eb96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:22.392537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=70 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:22.393154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0af477-ec51-40e4-be24-f51d4558eb96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:22.393890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0af477-ec51-40e4-be24-f51d4558eb96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:22.395835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0af477-ec51-40e4-be24-f51d4558eb96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:22.399122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0af477-ec51-40e4-be24-f51d4558eb96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:22.401090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0af477-ec51-40e4-be24-f51d4558eb96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:22.645654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-7e0af477-ec51-40e4-be24-f51d4558eb96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lazy-loading 'services' on Instance uuid 239b8047-ca96-48bc-8950-57a0b6f0d537 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:22.684642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:22.863828 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7e0af477-ec51-40e4-be24-f51d4558eb96 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "DELETE /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments/2ed00420-ca6c-4cbc-a65b-7f8bfb4c26ca" status: 202 len: 0 microversion: 2.1 time: 0.517058 Oct 29 02:52:22.865302 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 954/1929] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 02:52:22 2022] DELETE /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments/2ed00420-ca6c-4cbc-a65b-7f8bfb4c26ca => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:52:22.898720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6865e643-d10b-45a8-a709-cf91ea1ba295 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:22.901509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6865e643-d10b-45a8-a709-cf91ea1ba295 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:22.954982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6865e643-d10b-45a8-a709-cf91ea1ba295 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:22.955493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6865e643-d10b-45a8-a709-cf91ea1ba295 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:22.956017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6865e643-d10b-45a8-a709-cf91ea1ba295 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:22.956745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6865e643-d10b-45a8-a709-cf91ea1ba295 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:22.957210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6865e643-d10b-45a8-a709-cf91ea1ba295 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:22.957642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6865e643-d10b-45a8-a709-cf91ea1ba295 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:23.054558 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6865e643-d10b-45a8-a709-cf91ea1ba295 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.172778 Oct 29 02:52:23.058139 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 955/1930] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 02:52:22 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:52:23.070286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b4b5cc8e-f523-4e8c-98e3-9e91392d2b9c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:23.070910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b4b5cc8e-f523-4e8c-98e3-9e91392d2b9c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:23.087742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4b5cc8e-f523-4e8c-98e3-9e91392d2b9c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:23.088236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4b5cc8e-f523-4e8c-98e3-9e91392d2b9c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:23.088663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4b5cc8e-f523-4e8c-98e3-9e91392d2b9c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:23.089823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4b5cc8e-f523-4e8c-98e3-9e91392d2b9c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:23.092141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4b5cc8e-f523-4e8c-98e3-9e91392d2b9c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:23.092824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4b5cc8e-f523-4e8c-98e3-9e91392d2b9c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:23.736567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b4b5cc8e-f523-4e8c-98e3-9e91392d2b9c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:23.746892 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b4b5cc8e-f523-4e8c-98e3-9e91392d2b9c tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1468 microversion: 2.1 time: 0.686329 Oct 29 02:52:23.749546 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 956/1931] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:23 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1468 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:23.757605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1dc939d2-14a2-4916-bfe0-7300b1fa6bfa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:23.767643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1dc939d2-14a2-4916-bfe0-7300b1fa6bfa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:23.785387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1dc939d2-14a2-4916-bfe0-7300b1fa6bfa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:23.786067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1dc939d2-14a2-4916-bfe0-7300b1fa6bfa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:23.786580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1dc939d2-14a2-4916-bfe0-7300b1fa6bfa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:23.787395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1dc939d2-14a2-4916-bfe0-7300b1fa6bfa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:23.787947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1dc939d2-14a2-4916-bfe0-7300b1fa6bfa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:23.788490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1dc939d2-14a2-4916-bfe0-7300b1fa6bfa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:23.904793 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1dc939d2-14a2-4916-bfe0-7300b1fa6bfa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152616 Oct 29 02:52:23.905401 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 957/1932] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:52:23 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:23.930414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e05dc36-1ae5-4702-b2b8-bc1a2ed19d02 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:23.932575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4e05dc36-1ae5-4702-b2b8-bc1a2ed19d02 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:23.954715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e05dc36-1ae5-4702-b2b8-bc1a2ed19d02 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:23.958381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e05dc36-1ae5-4702-b2b8-bc1a2ed19d02 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:23.960466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e05dc36-1ae5-4702-b2b8-bc1a2ed19d02 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:23.963289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e05dc36-1ae5-4702-b2b8-bc1a2ed19d02 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:23.965797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e05dc36-1ae5-4702-b2b8-bc1a2ed19d02 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:23.966465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e05dc36-1ae5-4702-b2b8-bc1a2ed19d02 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:25.373866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4e05dc36-1ae5-4702-b2b8-bc1a2ed19d02 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:25.390139 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4e05dc36-1ae5-4702-b2b8-bc1a2ed19d02 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1324 microversion: 2.1 time: 1.479848 Oct 29 02:52:25.399568 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 958/1933] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:23 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1324 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:25.426622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4f23d32c-e21f-40d4-b948-e2f43f66fb48 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:25.441470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4f23d32c-e21f-40d4-b948-e2f43f66fb48 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:25.479463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f23d32c-e21f-40d4-b948-e2f43f66fb48 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:25.490179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f23d32c-e21f-40d4-b948-e2f43f66fb48 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:25.494898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f23d32c-e21f-40d4-b948-e2f43f66fb48 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:25.496846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f23d32c-e21f-40d4-b948-e2f43f66fb48 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:25.500116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f23d32c-e21f-40d4-b948-e2f43f66fb48 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:25.500880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f23d32c-e21f-40d4-b948-e2f43f66fb48 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:25.638076 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4f23d32c-e21f-40d4-b948-e2f43f66fb48 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.235727 Oct 29 02:52:25.639310 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 959/1934] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 02:52:25 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:52:25.648145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d6e59dd2-015a-476a-8707-b90731e2993d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:25.651168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d6e59dd2-015a-476a-8707-b90731e2993d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:25.674512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6e59dd2-015a-476a-8707-b90731e2993d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:25.675323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6e59dd2-015a-476a-8707-b90731e2993d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:25.676467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6e59dd2-015a-476a-8707-b90731e2993d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:25.677974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6e59dd2-015a-476a-8707-b90731e2993d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:25.678805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6e59dd2-015a-476a-8707-b90731e2993d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:25.679399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6e59dd2-015a-476a-8707-b90731e2993d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:26.307379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d6e59dd2-015a-476a-8707-b90731e2993d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:26.332906 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d6e59dd2-015a-476a-8707-b90731e2993d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1468 microversion: 2.1 time: 0.686004 Oct 29 02:52:26.334500 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 960/1935] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:25 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1468 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:26.348554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f5c4454f-4e89-4f90-a47b-3828415c32b8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:26.358010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f5c4454f-4e89-4f90-a47b-3828415c32b8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:26.383099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c4454f-4e89-4f90-a47b-3828415c32b8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:26.384879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c4454f-4e89-4f90-a47b-3828415c32b8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:26.387440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c4454f-4e89-4f90-a47b-3828415c32b8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:26.392288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c4454f-4e89-4f90-a47b-3828415c32b8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:26.395607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c4454f-4e89-4f90-a47b-3828415c32b8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:26.398550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c4454f-4e89-4f90-a47b-3828415c32b8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:26.538571 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f5c4454f-4e89-4f90-a47b-3828415c32b8 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201203 Oct 29 02:52:26.573549 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 961/1936] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:52:26 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:26.586185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2054411270", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "baef7ea0-b54c-41d1-9827-8e7428152b7b"}, {"uuid": "95167e5f-e445-4261-ba95-ce08fa061ca3"}, {"uuid": "baef7ea0-b54c-41d1-9827-8e7428152b7b"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:28.868791 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-47590cb8-af1b-4a57-9822-31d081e6b8a5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1423 microversion: 2.1 time: 16.457026 Oct 29 02:52:28.869530 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 976/1937] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:12 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1423 bytes in 16458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:28.884316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-355168d1-6cf8-4ae0-9d92-6d7f134f6c17 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:28.886547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-355168d1-6cf8-4ae0-9d92-6d7f134f6c17 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:28.895764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] validate_networks() for [('baef7ea0-b54c-41d1-9827-8e7428152b7b', None, None, None, None, None), ('95167e5f-e445-4261-ba95-ce08fa061ca3', None, None, None, None, None), ('baef7ea0-b54c-41d1-9827-8e7428152b7b', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:52:28.901707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-355168d1-6cf8-4ae0-9d92-6d7f134f6c17 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:28.903171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-355168d1-6cf8-4ae0-9d92-6d7f134f6c17 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:28.904561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-355168d1-6cf8-4ae0-9d92-6d7f134f6c17 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:28.906341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-355168d1-6cf8-4ae0-9d92-6d7f134f6c17 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:28.906793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-355168d1-6cf8-4ae0-9d92-6d7f134f6c17 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:28.907219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-355168d1-6cf8-4ae0-9d92-6d7f134f6c17 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:29.249537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-355168d1-6cf8-4ae0-9d92-6d7f134f6c17 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:29.263546 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-355168d1-6cf8-4ae0-9d92-6d7f134f6c17 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1324 microversion: 2.1 time: 0.392696 Oct 29 02:52:29.264537 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 977/1938] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:28 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1324 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:29.271796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-00c25874-040e-43e3-83c5-674fa1b49371 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:29.274682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-00c25874-040e-43e3-83c5-674fa1b49371 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:29.329760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00c25874-040e-43e3-83c5-674fa1b49371 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:29.332732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00c25874-040e-43e3-83c5-674fa1b49371 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:29.333206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00c25874-040e-43e3-83c5-674fa1b49371 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:29.347637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00c25874-040e-43e3-83c5-674fa1b49371 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:29.348425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00c25874-040e-43e3-83c5-674fa1b49371 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:29.349120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00c25874-040e-43e3-83c5-674fa1b49371 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:29.498969 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-00c25874-040e-43e3-83c5-674fa1b49371 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.233162 Oct 29 02:52:29.504165 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 978/1939] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 02:52:29 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:52:29.527890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-845b8911-4664-4458-a16f-da2696b2f459 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:29.530991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-845b8911-4664-4458-a16f-da2696b2f459 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:29.546351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845b8911-4664-4458-a16f-da2696b2f459 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:29.546837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845b8911-4664-4458-a16f-da2696b2f459 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:29.547485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845b8911-4664-4458-a16f-da2696b2f459 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:29.550793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845b8911-4664-4458-a16f-da2696b2f459 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:29.551545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845b8911-4664-4458-a16f-da2696b2f459 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:29.552290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845b8911-4664-4458-a16f-da2696b2f459 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:29.954271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-845b8911-4664-4458-a16f-da2696b2f459 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:29.970381 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-845b8911-4664-4458-a16f-da2696b2f459 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1468 microversion: 2.1 time: 0.463097 Oct 29 02:52:29.972312 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 979/1940] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:29 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1468 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:29.985009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0d72025d-0bbd-48e5-a62e-39e6c93789d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:30.000699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0d72025d-0bbd-48e5-a62e-39e6c93789d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:30.020466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d72025d-0bbd-48e5-a62e-39e6c93789d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:30.025294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d72025d-0bbd-48e5-a62e-39e6c93789d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:30.025901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d72025d-0bbd-48e5-a62e-39e6c93789d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:30.026799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d72025d-0bbd-48e5-a62e-39e6c93789d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:30.027304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d72025d-0bbd-48e5-a62e-39e6c93789d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:30.027731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d72025d-0bbd-48e5-a62e-39e6c93789d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:30.114302 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0d72025d-0bbd-48e5-a62e-39e6c93789d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140540 Oct 29 02:52:30.121582 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 980/1941] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:52:29 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:30.130026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5b02b3a2-70f7-433a-855e-feda143f222d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a808aaf0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:30.298803 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5b02b3a2-70f7-433a-855e-feda143f222d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 200 len: 1423 microversion: 2.1 time: 0.175761 Oct 29 02:52:30.318841 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 981/1942] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:30 2022] GET /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 1423 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:30.328885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-99de4f7d-a6ee-46d8-8e79-88d427c728c4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:30.332379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-99de4f7d-a6ee-46d8-8e79-88d427c728c4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:30.352186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99de4f7d-a6ee-46d8-8e79-88d427c728c4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:30.356244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99de4f7d-a6ee-46d8-8e79-88d427c728c4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:30.356786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99de4f7d-a6ee-46d8-8e79-88d427c728c4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:30.357540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99de4f7d-a6ee-46d8-8e79-88d427c728c4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:30.361944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99de4f7d-a6ee-46d8-8e79-88d427c728c4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:30.367821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99de4f7d-a6ee-46d8-8e79-88d427c728c4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:30.847930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-99de4f7d-a6ee-46d8-8e79-88d427c728c4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:30.874458 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-99de4f7d-a6ee-46d8-8e79-88d427c728c4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1324 microversion: 2.1 time: 0.552406 Oct 29 02:52:30.893048 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 982/1943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:30 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1324 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:30.908292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-33761d64-9ecf-43a0-8fa0-769d1ace6db9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acc3baf0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:30.915769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:52:30.916282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:52:30.917516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:52:30.918066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:52:30.919052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:52:30.969465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:30.971108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:30.971636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:30.972556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:30.980166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:30.981939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:31.026562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Getting quotas for project d86df8edf5044361a65c11542c2dc585. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:52:31.032482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Getting quotas for user 5d2e129a84e847a0b5c80ad47ca4d233 and project d86df8edf5044361a65c11542c2dc585. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:52:31.047492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:52:31.051089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:52:31.152656 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d1ac0a17-233c-44e4-91ae-58d5dffead20 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.576576 Oct 29 02:52:31.157662 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 962/1944] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:52:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:52:31.170773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-daf6e011-43cf-4267-8950-e65486b970e5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:31.176852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-daf6e011-43cf-4267-8950-e65486b970e5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:31.192859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-daf6e011-43cf-4267-8950-e65486b970e5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:31.193653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-daf6e011-43cf-4267-8950-e65486b970e5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:31.194312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-daf6e011-43cf-4267-8950-e65486b970e5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:31.195300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-daf6e011-43cf-4267-8950-e65486b970e5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:31.196897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-daf6e011-43cf-4267-8950-e65486b970e5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:31.197546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-daf6e011-43cf-4267-8950-e65486b970e5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:31.246589 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-daf6e011-43cf-4267-8950-e65486b970e5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.085468 Oct 29 02:52:31.252376 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 963/1945] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 02:52:31 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:31.274219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d42f9162-ce50-4069-93a5-cebe827881e4 req-d2b14e46-c676-414a-8106-4e55d7ccb275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0f8e1f-659c-4e3d-be95-88c47843a291", "name": "network-vif-plugged", "status": "completed", "tag": "098b461c-9fa2-4857-b9a0-87402ea4e24d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:31.307851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d42f9162-ce50-4069-93a5-cebe827881e4 req-d2b14e46-c676-414a-8106-4e55d7ccb275 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:31.307851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d42f9162-ce50-4069-93a5-cebe827881e4 req-d2b14e46-c676-414a-8106-4e55d7ccb275 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:31.308221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d42f9162-ce50-4069-93a5-cebe827881e4 req-d2b14e46-c676-414a-8106-4e55d7ccb275 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:31.350960 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d42f9162-ce50-4069-93a5-cebe827881e4 req-d2b14e46-c676-414a-8106-4e55d7ccb275 service nova] Creating event network-vif-plugged:098b461c-9fa2-4857-b9a0-87402ea4e24d for instance 0a0f8e1f-659c-4e3d-be95-88c47843a291 on n-h2-862964-4 Oct 29 02:52:31.358557 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d42f9162-ce50-4069-93a5-cebe827881e4 req-d2b14e46-c676-414a-8106-4e55d7ccb275 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104286 Oct 29 02:52:31.359733 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 964/1946] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:31.370190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4654d757-fe59-443a-9769-68cf6337c020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:31.372299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4654d757-fe59-443a-9769-68cf6337c020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:31.382332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4654d757-fe59-443a-9769-68cf6337c020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:31.383143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4654d757-fe59-443a-9769-68cf6337c020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:31.384669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4654d757-fe59-443a-9769-68cf6337c020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:31.385650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4654d757-fe59-443a-9769-68cf6337c020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:31.386440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4654d757-fe59-443a-9769-68cf6337c020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:31.387208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4654d757-fe59-443a-9769-68cf6337c020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:31.975511 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-33761d64-9ecf-43a0-8fa0-769d1ace6db9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 204 len: 0 microversion: 2.1 time: 1.079351 Oct 29 02:52:31.976861 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 983/1947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:30 2022] DELETE /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 0 bytes in 1082 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:52:31.983526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37cd6cb1-8db5-4781-92c3-8f217df8fdec tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:31.986148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37cd6cb1-8db5-4781-92c3-8f217df8fdec tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:32.009519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37cd6cb1-8db5-4781-92c3-8f217df8fdec tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:32.013419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37cd6cb1-8db5-4781-92c3-8f217df8fdec tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:32.014485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37cd6cb1-8db5-4781-92c3-8f217df8fdec tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:32.017795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37cd6cb1-8db5-4781-92c3-8f217df8fdec tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:32.019796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37cd6cb1-8db5-4781-92c3-8f217df8fdec tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:32.022157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37cd6cb1-8db5-4781-92c3-8f217df8fdec tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:32.079552 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37cd6cb1-8db5-4781-92c3-8f217df8fdec tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100385 Oct 29 02:52:32.096407 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 984/1948] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:52:31 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:32.103649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce6857e8-ec42-43f4-b941-af5b741f2895 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:32.106488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce6857e8-ec42-43f4-b941-af5b741f2895 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:32.259669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce6857e8-ec42-43f4-b941-af5b741f2895 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:32.287357 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce6857e8-ec42-43f4-b941-af5b741f2895 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1213 microversion: 2.1 time: 0.189428 Oct 29 02:52:32.294929 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 985/1949] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:32 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1213 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:32.317057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3a3ddabf-9d23-4fa6-94fb-7d430c238074 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:32.321835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3a3ddabf-9d23-4fa6-94fb-7d430c238074 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:32.354932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a3ddabf-9d23-4fa6-94fb-7d430c238074 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:32.355533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a3ddabf-9d23-4fa6-94fb-7d430c238074 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:32.357939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a3ddabf-9d23-4fa6-94fb-7d430c238074 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:32.358782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a3ddabf-9d23-4fa6-94fb-7d430c238074 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:32.362503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a3ddabf-9d23-4fa6-94fb-7d430c238074 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:32.363053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a3ddabf-9d23-4fa6-94fb-7d430c238074 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:32.675994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4654d757-fe59-443a-9769-68cf6337c020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:32.685316 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4654d757-fe59-443a-9769-68cf6337c020 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1468 microversion: 2.1 time: 1.323922 Oct 29 02:52:32.690136 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 965/1950] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:31 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1468 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:32.697371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b71b6f18-6706-4aaa-8d97-65cfb9d19c6c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:32.701117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b71b6f18-6706-4aaa-8d97-65cfb9d19c6c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:32.715557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b71b6f18-6706-4aaa-8d97-65cfb9d19c6c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:32.718281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b71b6f18-6706-4aaa-8d97-65cfb9d19c6c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:32.718827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b71b6f18-6706-4aaa-8d97-65cfb9d19c6c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:32.722850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b71b6f18-6706-4aaa-8d97-65cfb9d19c6c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:32.723430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b71b6f18-6706-4aaa-8d97-65cfb9d19c6c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:32.724130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b71b6f18-6706-4aaa-8d97-65cfb9d19c6c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:32.795743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b71b6f18-6706-4aaa-8d97-65cfb9d19c6c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:52:33.020951 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b71b6f18-6706-4aaa-8d97-65cfb9d19c6c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 204 len: 0 microversion: 2.1 time: 0.328552 Oct 29 02:52:33.024969 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 966/1951] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:52:32 2022] DELETE /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:52:33.043884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ba5aba4c-5fb4-418c-aa32-cc1b3d23b131 req-0f0f29e8-dfe8-4b53-a963-a2494052e49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c", "name": "network-vif-unplugged", "status": "completed", "tag": "34c62a40-e8c0-42f4-a697-e6a0fc8540fb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:33.089665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ba5aba4c-5fb4-418c-aa32-cc1b3d23b131 req-0f0f29e8-dfe8-4b53-a963-a2494052e49c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:33.091839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ba5aba4c-5fb4-418c-aa32-cc1b3d23b131 req-0f0f29e8-dfe8-4b53-a963-a2494052e49c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:33.092955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ba5aba4c-5fb4-418c-aa32-cc1b3d23b131 req-0f0f29e8-dfe8-4b53-a963-a2494052e49c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:33.157370 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ba5aba4c-5fb4-418c-aa32-cc1b3d23b131 req-0f0f29e8-dfe8-4b53-a963-a2494052e49c service nova] Creating event network-vif-unplugged:34c62a40-e8c0-42f4-a697-e6a0fc8540fb for instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c on n-h1-862964-4 Oct 29 02:52:33.178544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-ba5aba4c-5fb4-418c-aa32-cc1b3d23b131 req-0f0f29e8-dfe8-4b53-a963-a2494052e49c service nova] Instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:52:33.212761 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ba5aba4c-5fb4-418c-aa32-cc1b3d23b131 req-0f0f29e8-dfe8-4b53-a963-a2494052e49c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172865 Oct 29 02:52:33.225819 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 967/1952] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:33.241161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-087163ab-af46-4f87-abb5-3b9d02d6ac0b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:33.247492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-087163ab-af46-4f87-abb5-3b9d02d6ac0b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:33.271078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-087163ab-af46-4f87-abb5-3b9d02d6ac0b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:33.274265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-087163ab-af46-4f87-abb5-3b9d02d6ac0b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:33.274737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-087163ab-af46-4f87-abb5-3b9d02d6ac0b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:33.275662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-087163ab-af46-4f87-abb5-3b9d02d6ac0b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:33.278010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-087163ab-af46-4f87-abb5-3b9d02d6ac0b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:33.278442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-087163ab-af46-4f87-abb5-3b9d02d6ac0b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:33.367213 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-087163ab-af46-4f87-abb5-3b9d02d6ac0b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139638 Oct 29 02:52:33.382234 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 968/1953] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:52:33 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:33.388231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1772a60a-fca1-42f5-ba6a-b4161a50e73d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:33.388842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1772a60a-fca1-42f5-ba6a-b4161a50e73d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:33.399159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1772a60a-fca1-42f5-ba6a-b4161a50e73d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:33.399651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1772a60a-fca1-42f5-ba6a-b4161a50e73d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:33.400077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1772a60a-fca1-42f5-ba6a-b4161a50e73d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:33.400780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1772a60a-fca1-42f5-ba6a-b4161a50e73d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:33.401298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1772a60a-fca1-42f5-ba6a-b4161a50e73d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:33.401712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1772a60a-fca1-42f5-ba6a-b4161a50e73d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:33.610622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1772a60a-fca1-42f5-ba6a-b4161a50e73d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:33.624838 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1772a60a-fca1-42f5-ba6a-b4161a50e73d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1265 microversion: 2.1 time: 0.240251 Oct 29 02:52:33.627705 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 969/1954] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:33 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:33.641080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3a3ddabf-9d23-4fa6-94fb-7d430c238074 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:33.652308 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3a3ddabf-9d23-4fa6-94fb-7d430c238074 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1324 microversion: 2.1 time: 1.354405 Oct 29 02:52:33.658187 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 986/1955] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:32 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1324 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:33.669524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-852160808", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "0ef24500-837e-47a7-9e10-a72e3fb043af"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:33.719209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d6e0c409-c3b7-4745-8179-79537c9d981f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:33.720047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d6e0c409-c3b7-4745-8179-79537c9d981f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:33.733954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6e0c409-c3b7-4745-8179-79537c9d981f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:33.735741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6e0c409-c3b7-4745-8179-79537c9d981f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:33.736411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6e0c409-c3b7-4745-8179-79537c9d981f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:33.737944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6e0c409-c3b7-4745-8179-79537c9d981f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:33.738669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6e0c409-c3b7-4745-8179-79537c9d981f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:33.739328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6e0c409-c3b7-4745-8179-79537c9d981f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:33.814116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] validate_networks() for [('0ef24500-837e-47a7-9e10-a72e3fb043af', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:52:34.340006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d6e0c409-c3b7-4745-8179-79537c9d981f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:34.355910 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d6e0c409-c3b7-4745-8179-79537c9d981f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1468 microversion: 2.1 time: 0.640806 Oct 29 02:52:34.356492 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 987/1956] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:33 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1468 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:34.381505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-152cd089-3b32-400f-8d50-c062832227cd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:34.383819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-152cd089-3b32-400f-8d50-c062832227cd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:34.408523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-152cd089-3b32-400f-8d50-c062832227cd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:34.410552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-152cd089-3b32-400f-8d50-c062832227cd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:34.411010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-152cd089-3b32-400f-8d50-c062832227cd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:34.411748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-152cd089-3b32-400f-8d50-c062832227cd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:34.412207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-152cd089-3b32-400f-8d50-c062832227cd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:34.412618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-152cd089-3b32-400f-8d50-c062832227cd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:34.496744 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-152cd089-3b32-400f-8d50-c062832227cd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119359 Oct 29 02:52:34.498512 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 988/1957] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:52:34 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:34.653586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-befeea63-c6bf-4989-a148-bcfe44784f44 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:34.654522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-befeea63-c6bf-4989-a148-bcfe44784f44 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:34.663603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-befeea63-c6bf-4989-a148-bcfe44784f44 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:34.667339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-befeea63-c6bf-4989-a148-bcfe44784f44 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:34.668028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-befeea63-c6bf-4989-a148-bcfe44784f44 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:34.669772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-befeea63-c6bf-4989-a148-bcfe44784f44 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:34.671107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-befeea63-c6bf-4989-a148-bcfe44784f44 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:34.671708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-befeea63-c6bf-4989-a148-bcfe44784f44 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:34.826960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-befeea63-c6bf-4989-a148-bcfe44784f44 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:34.843758 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-befeea63-c6bf-4989-a148-bcfe44784f44 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1271 microversion: 2.1 time: 0.193818 Oct 29 02:52:34.844839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 989/1958] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:34 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:52:34.858030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-197626a0-f24e-4b43-a35c-1d2da43186d4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:34.858989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-197626a0-f24e-4b43-a35c-1d2da43186d4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:34.879270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-197626a0-f24e-4b43-a35c-1d2da43186d4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:34.886948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-197626a0-f24e-4b43-a35c-1d2da43186d4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:34.889317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-197626a0-f24e-4b43-a35c-1d2da43186d4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:34.897776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-197626a0-f24e-4b43-a35c-1d2da43186d4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:34.898723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-197626a0-f24e-4b43-a35c-1d2da43186d4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:34.901968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-197626a0-f24e-4b43-a35c-1d2da43186d4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.228852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:52:35.229364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:52:35.229704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:52:35.230470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:52:35.231534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:52:35.244212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.245135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.246511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.247410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.248021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.248608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.274291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:52:35.279920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for user 0868f50723074f2b98f7b1096743f3cc and project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:52:35.294080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:35.304147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:52:35.308539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:52:35.309787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-197626a0-f24e-4b43-a35c-1d2da43186d4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:35.341135 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-197626a0-f24e-4b43-a35c-1d2da43186d4 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1324 microversion: 2.1 time: 0.484831 Oct 29 02:52:35.354445 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 990/1959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:34 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1324 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:35.365222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-bdaf4ee9-81ea-4834-878b-b35836579d7a req-a94908e1-a864-4307-84b4-1863e72e9ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236d6444-122e-4926-b00b-2fd646ed9715", "name": "network-vif-unplugged", "status": "completed", "tag": "e34003f1-cdfb-4f6e-9403-62dff5b693e5"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:35.378199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bdaf4ee9-81ea-4834-878b-b35836579d7a req-a94908e1-a864-4307-84b4-1863e72e9ba5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.379132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bdaf4ee9-81ea-4834-878b-b35836579d7a req-a94908e1-a864-4307-84b4-1863e72e9ba5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.379803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bdaf4ee9-81ea-4834-878b-b35836579d7a req-a94908e1-a864-4307-84b4-1863e72e9ba5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.394590 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-bdaf4ee9-81ea-4834-878b-b35836579d7a req-a94908e1-a864-4307-84b4-1863e72e9ba5 service nova] Creating event network-vif-unplugged:e34003f1-cdfb-4f6e-9403-62dff5b693e5 for instance 236d6444-122e-4926-b00b-2fd646ed9715 on n-h2-862964-4 Oct 29 02:52:35.405244 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-bdaf4ee9-81ea-4834-878b-b35836579d7a req-a94908e1-a864-4307-84b4-1863e72e9ba5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044640 Oct 29 02:52:35.407046 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 991/1960] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:35.414031 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e9a9ca16-0b16-4c6d-853a-11e82696e36d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.778790 Oct 29 02:52:35.414908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9f699326-aa75-4cda-b54c-1ad99862ee3e req-0009ff4c-5f0e-414b-b828-080d987550d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c", "tag": "34c62a40-e8c0-42f4-a697-e6a0fc8540fb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:35.416868 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 970/1961] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:52:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:52:35.428035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9f699326-aa75-4cda-b54c-1ad99862ee3e req-0009ff4c-5f0e-414b-b828-080d987550d4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.428871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9f699326-aa75-4cda-b54c-1ad99862ee3e req-0009ff4c-5f0e-414b-b828-080d987550d4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.429548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9f699326-aa75-4cda-b54c-1ad99862ee3e req-0009ff4c-5f0e-414b-b828-080d987550d4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.437629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4048c7fd-bc79-45f4-9144-2506b16a5c19 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:35.440295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4048c7fd-bc79-45f4-9144-2506b16a5c19 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:35.457775 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9f699326-aa75-4cda-b54c-1ad99862ee3e req-0009ff4c-5f0e-414b-b828-080d987550d4 service nova] Creating event network-changed:34c62a40-e8c0-42f4-a697-e6a0fc8540fb for instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c on n-h1-862964-4 Oct 29 02:52:35.474402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4048c7fd-bc79-45f4-9144-2506b16a5c19 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.479487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-9f699326-aa75-4cda-b54c-1ad99862ee3e req-0009ff4c-5f0e-414b-b828-080d987550d4 service nova] Instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 02:52:35.480971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4048c7fd-bc79-45f4-9144-2506b16a5c19 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.481663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4048c7fd-bc79-45f4-9144-2506b16a5c19 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.482874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4048c7fd-bc79-45f4-9144-2506b16a5c19 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.484112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4048c7fd-bc79-45f4-9144-2506b16a5c19 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.487153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4048c7fd-bc79-45f4-9144-2506b16a5c19 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.508584 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9f699326-aa75-4cda-b54c-1ad99862ee3e req-0009ff4c-5f0e-414b-b828-080d987550d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095129 Oct 29 02:52:35.512077 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 992/1962] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:35.522739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-34708356-2b5e-4185-91ad-8b45a074877c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:35.526017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-34708356-2b5e-4185-91ad-8b45a074877c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:35.680898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34708356-2b5e-4185-91ad-8b45a074877c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:35.698148 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-34708356-2b5e-4185-91ad-8b45a074877c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1207 microversion: 2.1 time: 0.184484 Oct 29 02:52:35.699815 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 993/1963] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:35 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1207 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:35.715177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eedf1a0f-5541-41ba-b8ef-e110f2d1b742 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:35.718005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eedf1a0f-5541-41ba-b8ef-e110f2d1b742 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:35.745076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eedf1a0f-5541-41ba-b8ef-e110f2d1b742 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.749984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eedf1a0f-5541-41ba-b8ef-e110f2d1b742 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.751380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eedf1a0f-5541-41ba-b8ef-e110f2d1b742 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.754567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eedf1a0f-5541-41ba-b8ef-e110f2d1b742 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.757200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eedf1a0f-5541-41ba-b8ef-e110f2d1b742 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.757919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eedf1a0f-5541-41ba-b8ef-e110f2d1b742 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.825617 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eedf1a0f-5541-41ba-b8ef-e110f2d1b742 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121041 Oct 29 02:52:35.832143 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 994/1964] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:52:35 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:35.875370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bd1913b5-a911-46c5-a63c-180a308acf68 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:35.876079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bd1913b5-a911-46c5-a63c-180a308acf68 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:35.897639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1913b5-a911-46c5-a63c-180a308acf68 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.899370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1913b5-a911-46c5-a63c-180a308acf68 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.899800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1913b5-a911-46c5-a63c-180a308acf68 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.902382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1913b5-a911-46c5-a63c-180a308acf68 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.903370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1913b5-a911-46c5-a63c-180a308acf68 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.903837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd1913b5-a911-46c5-a63c-180a308acf68 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:36.659326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bd1913b5-a911-46c5-a63c-180a308acf68 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:36.677248 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bd1913b5-a911-46c5-a63c-180a308acf68 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1313 microversion: 2.1 time: 0.808305 Oct 29 02:52:36.678425 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 995/1965] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:35 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1313 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:36.687874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9d1995db-c13e-4f79-916b-52ae37f025b2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:36.688547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9d1995db-c13e-4f79-916b-52ae37f025b2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:36.706593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d1995db-c13e-4f79-916b-52ae37f025b2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:36.707564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d1995db-c13e-4f79-916b-52ae37f025b2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:36.710158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d1995db-c13e-4f79-916b-52ae37f025b2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:36.711112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d1995db-c13e-4f79-916b-52ae37f025b2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:36.711990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d1995db-c13e-4f79-916b-52ae37f025b2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:36.712959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d1995db-c13e-4f79-916b-52ae37f025b2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:37.147866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4048c7fd-bc79-45f4-9144-2506b16a5c19 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:37.151944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:37.175591 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4048c7fd-bc79-45f4-9144-2506b16a5c19 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1468 microversion: 2.1 time: 1.746053 Oct 29 02:52:37.176344 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 971/1966] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:35 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1468 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:37.185181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1b310cba-4da6-4cc5-bd27-8da2cb418f5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:37.201920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b310cba-4da6-4cc5-bd27-8da2cb418f5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:37.227828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b310cba-4da6-4cc5-bd27-8da2cb418f5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:37.229680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b310cba-4da6-4cc5-bd27-8da2cb418f5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:37.230523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b310cba-4da6-4cc5-bd27-8da2cb418f5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:37.231471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b310cba-4da6-4cc5-bd27-8da2cb418f5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:37.233315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b310cba-4da6-4cc5-bd27-8da2cb418f5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:37.235222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b310cba-4da6-4cc5-bd27-8da2cb418f5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:37.469238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9d1995db-c13e-4f79-916b-52ae37f025b2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:37.483278 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9d1995db-c13e-4f79-916b-52ae37f025b2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1521 microversion: 2.1 time: 0.803737 Oct 29 02:52:37.490244 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 996/1967] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:36 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1521 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:37.511023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e2691bcb-bbd9-443f-9951-76e7724f67b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:37.517719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e2691bcb-bbd9-443f-9951-76e7724f67b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:37.559880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2691bcb-bbd9-443f-9951-76e7724f67b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:37.560485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2691bcb-bbd9-443f-9951-76e7724f67b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:37.561069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2691bcb-bbd9-443f-9951-76e7724f67b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:37.565896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2691bcb-bbd9-443f-9951-76e7724f67b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:37.566376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2691bcb-bbd9-443f-9951-76e7724f67b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:37.566798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2691bcb-bbd9-443f-9951-76e7724f67b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:37.681475 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e2691bcb-bbd9-443f-9951-76e7724f67b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188174 Oct 29 02:52:37.683510 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 997/1968] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:52:37 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:37.701161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-404755ff-8431-44d1-8ce6-f2a6a5cc6526 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:37.702488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-404755ff-8431-44d1-8ce6-f2a6a5cc6526 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:37.724694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-404755ff-8431-44d1-8ce6-f2a6a5cc6526 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:37.727698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-404755ff-8431-44d1-8ce6-f2a6a5cc6526 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:37.728990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-404755ff-8431-44d1-8ce6-f2a6a5cc6526 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:37.731435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-404755ff-8431-44d1-8ce6-f2a6a5cc6526 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:37.732104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-404755ff-8431-44d1-8ce6-f2a6a5cc6526 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:37.733824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-404755ff-8431-44d1-8ce6-f2a6a5cc6526 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:37.808472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:37.825839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-404755ff-8431-44d1-8ce6-f2a6a5cc6526 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:52:38.052263 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-404755ff-8431-44d1-8ce6-f2a6a5cc6526 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 204 len: 0 microversion: 2.1 time: 0.357768 Oct 29 02:52:38.058676 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 998/1969] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:52:37 2022] DELETE /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:52:38.078882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bda5f921-6ac1-4518-b0e0-28883f2a4dbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:38.085647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bda5f921-6ac1-4518-b0e0-28883f2a4dbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:38.100073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda5f921-6ac1-4518-b0e0-28883f2a4dbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.100073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda5f921-6ac1-4518-b0e0-28883f2a4dbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.102797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda5f921-6ac1-4518-b0e0-28883f2a4dbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.104469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda5f921-6ac1-4518-b0e0-28883f2a4dbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.105014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda5f921-6ac1-4518-b0e0-28883f2a4dbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.106655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bda5f921-6ac1-4518-b0e0-28883f2a4dbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.377716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b310cba-4da6-4cc5-bd27-8da2cb418f5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:38.386554 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1b310cba-4da6-4cc5-bd27-8da2cb418f5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1259 microversion: 2.1 time: 1.205093 Oct 29 02:52:38.390289 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 972/1970] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:37 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1259 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:38.407168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-65ffdfe7-269f-4b6a-84d2-b9197bc345c1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:38.411441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-65ffdfe7-269f-4b6a-84d2-b9197bc345c1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:38.423617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65ffdfe7-269f-4b6a-84d2-b9197bc345c1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.430262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65ffdfe7-269f-4b6a-84d2-b9197bc345c1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.430891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65ffdfe7-269f-4b6a-84d2-b9197bc345c1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.431811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65ffdfe7-269f-4b6a-84d2-b9197bc345c1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.432428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65ffdfe7-269f-4b6a-84d2-b9197bc345c1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.433044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65ffdfe7-269f-4b6a-84d2-b9197bc345c1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.583130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bda5f921-6ac1-4518-b0e0-28883f2a4dbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:38.594704 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bda5f921-6ac1-4518-b0e0-28883f2a4dbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1334 microversion: 2.1 time: 0.532876 Oct 29 02:52:38.595498 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 999/1971] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:38 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1334 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:38.604439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9c9c0ab-b0fe-437b-b873-08d6094621f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:38.605092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f9c9c0ab-b0fe-437b-b873-08d6094621f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:38.616911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9c9c0ab-b0fe-437b-b873-08d6094621f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.617411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9c9c0ab-b0fe-437b-b873-08d6094621f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.620760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9c9c0ab-b0fe-437b-b873-08d6094621f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.627379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9c9c0ab-b0fe-437b-b873-08d6094621f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.630940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9c9c0ab-b0fe-437b-b873-08d6094621f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.630940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9c9c0ab-b0fe-437b-b873-08d6094621f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.913180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f9c9c0ab-b0fe-437b-b873-08d6094621f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:38.919784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-65ffdfe7-269f-4b6a-84d2-b9197bc345c1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:38.921828 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f9c9c0ab-b0fe-437b-b873-08d6094621f2 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1468 microversion: 2.1 time: 0.322245 Oct 29 02:52:38.937288 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1000/1972] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:38 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1468 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:38.942302 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-65ffdfe7-269f-4b6a-84d2-b9197bc345c1 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1527 microversion: 2.1 time: 0.544311 Oct 29 02:52:38.943525 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 973/1973] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:38 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1527 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:38.953252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5667d3c-51b8-4b91-a575-617728276fac tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:38.968752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d5667d3c-51b8-4b91-a575-617728276fac tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:38.989283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5667d3c-51b8-4b91-a575-617728276fac tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.989676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5667d3c-51b8-4b91-a575-617728276fac tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.996480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5667d3c-51b8-4b91-a575-617728276fac tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.997255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5667d3c-51b8-4b91-a575-617728276fac tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:39.000118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5667d3c-51b8-4b91-a575-617728276fac tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:39.000579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5667d3c-51b8-4b91-a575-617728276fac tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:39.092752 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5667d3c-51b8-4b91-a575-617728276fac tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153876 Oct 29 02:52:39.104565 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1001/1974] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:52:38 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:39.417536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a4c96817-9257-4a4c-a31f-42dabe95d0f0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:39.418790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a4c96817-9257-4a4c-a31f-42dabe95d0f0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:39.442019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4c96817-9257-4a4c-a31f-42dabe95d0f0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:39.442312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-e11bec1f-d246-41a6-930f-ec6693eb64e6 req-029e3656-00b5-4227-9823-3d0ca6968e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236d6444-122e-4926-b00b-2fd646ed9715", "name": "network-vif-deleted", "tag": "e34003f1-cdfb-4f6e-9403-62dff5b693e5"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:39.442976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4c96817-9257-4a4c-a31f-42dabe95d0f0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:39.445032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4c96817-9257-4a4c-a31f-42dabe95d0f0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:39.449115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4c96817-9257-4a4c-a31f-42dabe95d0f0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:39.449822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4c96817-9257-4a4c-a31f-42dabe95d0f0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:39.450253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4c96817-9257-4a4c-a31f-42dabe95d0f0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:39.481172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e11bec1f-d246-41a6-930f-ec6693eb64e6 req-029e3656-00b5-4227-9823-3d0ca6968e9a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:39.482364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e11bec1f-d246-41a6-930f-ec6693eb64e6 req-029e3656-00b5-4227-9823-3d0ca6968e9a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:39.485918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e11bec1f-d246-41a6-930f-ec6693eb64e6 req-029e3656-00b5-4227-9823-3d0ca6968e9a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:39.522844 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-e11bec1f-d246-41a6-930f-ec6693eb64e6 req-029e3656-00b5-4227-9823-3d0ca6968e9a service nova] Creating event network-vif-deleted:e34003f1-cdfb-4f6e-9403-62dff5b693e5 for instance 236d6444-122e-4926-b00b-2fd646ed9715 on n-h2-862964-4 Oct 29 02:52:39.543192 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-e11bec1f-d246-41a6-930f-ec6693eb64e6 req-029e3656-00b5-4227-9823-3d0ca6968e9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104911 Oct 29 02:52:39.545371 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1002/1975] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:39.619090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-467be2d7-367a-4271-a085-06062b659260 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:39.620557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-467be2d7-367a-4271-a085-06062b659260 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:39.644279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-467be2d7-367a-4271-a085-06062b659260 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:39.650244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-467be2d7-367a-4271-a085-06062b659260 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:39.654248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-467be2d7-367a-4271-a085-06062b659260 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:39.655441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-467be2d7-367a-4271-a085-06062b659260 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:39.656896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-467be2d7-367a-4271-a085-06062b659260 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:39.660608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-467be2d7-367a-4271-a085-06062b659260 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:39.977914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-467be2d7-367a-4271-a085-06062b659260 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:39.998366 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-467be2d7-367a-4271-a085-06062b659260 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.384279 Oct 29 02:52:39.999404 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1003/1976] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:39 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:40.006789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9224b200-1610-4eec-821a-c30e34b2b00f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:40.007403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9224b200-1610-4eec-821a-c30e34b2b00f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:40.022972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9224b200-1610-4eec-821a-c30e34b2b00f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:40.023498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9224b200-1610-4eec-821a-c30e34b2b00f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:40.023900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9224b200-1610-4eec-821a-c30e34b2b00f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:40.024621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9224b200-1610-4eec-821a-c30e34b2b00f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:40.025066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9224b200-1610-4eec-821a-c30e34b2b00f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:40.025738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9224b200-1610-4eec-821a-c30e34b2b00f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:40.032698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a4c96817-9257-4a4c-a31f-42dabe95d0f0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:40.049649 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a4c96817-9257-4a4c-a31f-42dabe95d0f0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1267 microversion: 2.1 time: 0.637583 Oct 29 02:52:40.059066 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 974/1977] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:39 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1267 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:40.075767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-167cbaf5-d40c-4c3f-adce-94a1f8137fbd tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:40.076401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-167cbaf5-d40c-4c3f-adce-94a1f8137fbd tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:40.097503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-167cbaf5-d40c-4c3f-adce-94a1f8137fbd tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:40.098742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-167cbaf5-d40c-4c3f-adce-94a1f8137fbd tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:40.102491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-167cbaf5-d40c-4c3f-adce-94a1f8137fbd tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:40.104004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-167cbaf5-d40c-4c3f-adce-94a1f8137fbd tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:40.107566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-167cbaf5-d40c-4c3f-adce-94a1f8137fbd tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:40.108143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-167cbaf5-d40c-4c3f-adce-94a1f8137fbd tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:40.372353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9224b200-1610-4eec-821a-c30e34b2b00f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:40.384121 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9224b200-1610-4eec-821a-c30e34b2b00f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1468 microversion: 2.1 time: 0.383554 Oct 29 02:52:40.385252 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1004/1978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:39 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1468 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:40.394219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3b2540be-21d1-478d-a570-4b8bb890297e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:40.398987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b2540be-21d1-478d-a570-4b8bb890297e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:40.420164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b2540be-21d1-478d-a570-4b8bb890297e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:40.420928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b2540be-21d1-478d-a570-4b8bb890297e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:40.421547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b2540be-21d1-478d-a570-4b8bb890297e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:40.424996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b2540be-21d1-478d-a570-4b8bb890297e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:40.425641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b2540be-21d1-478d-a570-4b8bb890297e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:40.426312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b2540be-21d1-478d-a570-4b8bb890297e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:40.477234 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3b2540be-21d1-478d-a570-4b8bb890297e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089314 Oct 29 02:52:40.484441 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1005/1979] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:52:40 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:40.594422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-167cbaf5-d40c-4c3f-adce-94a1f8137fbd tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:40.605950 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-167cbaf5-d40c-4c3f-adce-94a1f8137fbd tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1527 microversion: 2.1 time: 0.545597 Oct 29 02:52:40.607283 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 975/1980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:40 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1527 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:40.949152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-29b4fab6-d4a1-439c-958a-4dfb3f18dbc2 req-35465911-9e37-4582-89dc-f83191d29a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0f8e1f-659c-4e3d-be95-88c47843a291", "name": "network-vif-deleted", "tag": "098b461c-9fa2-4857-b9a0-87402ea4e24d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:40.981987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-29b4fab6-d4a1-439c-958a-4dfb3f18dbc2 req-35465911-9e37-4582-89dc-f83191d29a8c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:40.984604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-29b4fab6-d4a1-439c-958a-4dfb3f18dbc2 req-35465911-9e37-4582-89dc-f83191d29a8c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:40.985320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-29b4fab6-d4a1-439c-958a-4dfb3f18dbc2 req-35465911-9e37-4582-89dc-f83191d29a8c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.025940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-97b010f6-b01a-458e-a368-e1eb10034180 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:41.027264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-97b010f6-b01a-458e-a368-e1eb10034180 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:41.045833 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-29b4fab6-d4a1-439c-958a-4dfb3f18dbc2 req-35465911-9e37-4582-89dc-f83191d29a8c service nova] Creating event network-vif-deleted:098b461c-9fa2-4857-b9a0-87402ea4e24d for instance 0a0f8e1f-659c-4e3d-be95-88c47843a291 on n-h2-862964-4 Oct 29 02:52:41.049488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97b010f6-b01a-458e-a368-e1eb10034180 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.054356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97b010f6-b01a-458e-a368-e1eb10034180 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.057883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97b010f6-b01a-458e-a368-e1eb10034180 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.061861 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-29b4fab6-d4a1-439c-958a-4dfb3f18dbc2 req-35465911-9e37-4582-89dc-f83191d29a8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120525 Oct 29 02:52:41.062075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97b010f6-b01a-458e-a368-e1eb10034180 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.062705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97b010f6-b01a-458e-a368-e1eb10034180 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.063606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97b010f6-b01a-458e-a368-e1eb10034180 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.066808 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1006/1981] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:41.085233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d3062656-e735-475f-b546-af2831be0b60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:41.088989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d3062656-e735-475f-b546-af2831be0b60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:41.108503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3062656-e735-475f-b546-af2831be0b60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.111978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3062656-e735-475f-b546-af2831be0b60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.113488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3062656-e735-475f-b546-af2831be0b60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.114824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3062656-e735-475f-b546-af2831be0b60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.118372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3062656-e735-475f-b546-af2831be0b60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.119015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3062656-e735-475f-b546-af2831be0b60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.254063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d3062656-e735-475f-b546-af2831be0b60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:41.267676 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d3062656-e735-475f-b546-af2831be0b60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1265 microversion: 2.1 time: 0.187661 Oct 29 02:52:41.272019 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1007/1982] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:41 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:41.410788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5bbe0015-affc-424f-92fb-96719bc8c810 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:41.412203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5bbe0015-affc-424f-92fb-96719bc8c810 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:41.428216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbe0015-affc-424f-92fb-96719bc8c810 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.433358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbe0015-affc-424f-92fb-96719bc8c810 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.437411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbe0015-affc-424f-92fb-96719bc8c810 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.443274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbe0015-affc-424f-92fb-96719bc8c810 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.444249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbe0015-affc-424f-92fb-96719bc8c810 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.444939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbe0015-affc-424f-92fb-96719bc8c810 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.778286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5bbe0015-affc-424f-92fb-96719bc8c810 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:41.790233 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5bbe0015-affc-424f-92fb-96719bc8c810 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1468 microversion: 2.1 time: 0.384780 Oct 29 02:52:41.801567 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1008/1983] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:41 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1468 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:52:42.001950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-97b010f6-b01a-458e-a368-e1eb10034180 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:42.023076 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-97b010f6-b01a-458e-a368-e1eb10034180 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 1.001575 Oct 29 02:52:42.024325 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 976/1984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:41 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:52:42.038451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:42.039356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:42.053784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.054707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.056437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:42.057450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.058852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.059745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:42.105413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.106260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.106904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:42.107671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lazy-loading 'fault' on Instance uuid 0a0f8e1f-659c-4e3d-be95-88c47843a291 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:42.411527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f9940834e4eaeb31c967dba6d762f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b30ce428766445d9d0d45f350ae1024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:42.426074 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6eafe616-e99d-4537-b4c0-b46a3073bc7c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 200 len: 1314 microversion: 2.1 time: 0.399919 Oct 29 02:52:42.432981 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 977/1985] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:42 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:42.453667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7ff9c8d7-d6b1-4724-bc8a-65397cdcbdbd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:42.473727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7ff9c8d7-d6b1-4724-bc8a-65397cdcbdbd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:42.481193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff9c8d7-d6b1-4724-bc8a-65397cdcbdbd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.482093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff9c8d7-d6b1-4724-bc8a-65397cdcbdbd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.482703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff9c8d7-d6b1-4724-bc8a-65397cdcbdbd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:42.483724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff9c8d7-d6b1-4724-bc8a-65397cdcbdbd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.484361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff9c8d7-d6b1-4724-bc8a-65397cdcbdbd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.484926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff9c8d7-d6b1-4724-bc8a-65397cdcbdbd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:42.507928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e3093bd8-0312-4e2b-a1b4-ef4ecd5f0078 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:42.510671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e3093bd8-0312-4e2b-a1b4-ef4ecd5f0078 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:42.527523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3093bd8-0312-4e2b-a1b4-ef4ecd5f0078 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.532781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3093bd8-0312-4e2b-a1b4-ef4ecd5f0078 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.533716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3093bd8-0312-4e2b-a1b4-ef4ecd5f0078 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:42.535357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3093bd8-0312-4e2b-a1b4-ef4ecd5f0078 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.537560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3093bd8-0312-4e2b-a1b4-ef4ecd5f0078 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.540203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3093bd8-0312-4e2b-a1b4-ef4ecd5f0078 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:42.645793 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e3093bd8-0312-4e2b-a1b4-ef4ecd5f0078 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.842966 Oct 29 02:52:42.660389 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1009/1986] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:52:41 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537/os-volume_attachments => generated 25 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:52:42.707865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7ff9c8d7-d6b1-4724-bc8a-65397cdcbdbd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:42.720547 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7ff9c8d7-d6b1-4724-bc8a-65397cdcbdbd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1265 microversion: 2.1 time: 0.279502 Oct 29 02:52:42.724999 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 978/1987] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:42 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:42.827858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eebe9a2a-9cc0-472e-a4f3-e11ad3923f46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:42.828463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eebe9a2a-9cc0-472e-a4f3-e11ad3923f46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:42.836314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eebe9a2a-9cc0-472e-a4f3-e11ad3923f46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.836753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eebe9a2a-9cc0-472e-a4f3-e11ad3923f46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.837172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eebe9a2a-9cc0-472e-a4f3-e11ad3923f46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:42.842264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eebe9a2a-9cc0-472e-a4f3-e11ad3923f46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.842914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eebe9a2a-9cc0-472e-a4f3-e11ad3923f46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.843499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eebe9a2a-9cc0-472e-a4f3-e11ad3923f46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:43.051178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-08940b3b-b892-444c-ba63-ceb7b61f9c5e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:43.051692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-08940b3b-b892-444c-ba63-ceb7b61f9c5e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:43.063939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08940b3b-b892-444c-ba63-ceb7b61f9c5e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:43.064433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08940b3b-b892-444c-ba63-ceb7b61f9c5e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:43.064914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08940b3b-b892-444c-ba63-ceb7b61f9c5e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:43.065617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08940b3b-b892-444c-ba63-ceb7b61f9c5e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:43.066088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08940b3b-b892-444c-ba63-ceb7b61f9c5e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:43.066506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08940b3b-b892-444c-ba63-ceb7b61f9c5e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:43.756889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eebe9a2a-9cc0-472e-a4f3-e11ad3923f46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:43.770415 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eebe9a2a-9cc0-472e-a4f3-e11ad3923f46 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1461 microversion: 2.1 time: 0.944381 Oct 29 02:52:43.794348 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1010/1988] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:42 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1461 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:43.819411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-a1af6da8-4de7-4127-8df9-b31bd3277b8c req-50953636-41c3-48d4-99aa-a9c4a308324f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e20ef4b-4f1c-42b4-9307-857848aab3a7", "tag": "2dc0d31b-4d3a-40f5-a243-c58dd7680fc3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:43.876338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a1af6da8-4de7-4127-8df9-b31bd3277b8c req-50953636-41c3-48d4-99aa-a9c4a308324f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:43.877051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a1af6da8-4de7-4127-8df9-b31bd3277b8c req-50953636-41c3-48d4-99aa-a9c4a308324f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:43.877771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a1af6da8-4de7-4127-8df9-b31bd3277b8c req-50953636-41c3-48d4-99aa-a9c4a308324f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:43.891123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-08940b3b-b892-444c-ba63-ceb7b61f9c5e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:43.905912 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-08940b3b-b892-444c-ba63-ceb7b61f9c5e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.860598 Oct 29 02:52:43.908309 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 979/1989] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:43 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:43.915035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:43.916221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 0a0f8e1f-659c-4e3d-be95-88c47843a291] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:43.920276 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-a1af6da8-4de7-4127-8df9-b31bd3277b8c req-50953636-41c3-48d4-99aa-a9c4a308324f service nova] Creating event network-changed:2dc0d31b-4d3a-40f5-a243-c58dd7680fc3 for instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 on n-h1-862964-4 Oct 29 02:52:43.933469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:43.934756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:43.935496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:43.941743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:43.945955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:43.951365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:43.954124 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-a1af6da8-4de7-4127-8df9-b31bd3277b8c req-50953636-41c3-48d4-99aa-a9c4a308324f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158231 Oct 29 02:52:43.962351 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1011/1990] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:44.001611 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] HTTP exception thrown: Instance 0a0f8e1f-659c-4e3d-be95-88c47843a291 could not be found. Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 HTTP/1.1 Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:52:44.004560 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 0a0f8e1f-659c-4e3d-be95-88c47843a291 could not be found. Oct 29 02:52:44.006222 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '0a0f8e1f-659c-4e3d-be95-88c47843a291'} Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0f8e1f-659c-4e3d-be95-88c47843a291 could not be found. Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:44.007146 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0f8e1f-659c-4e3d-be95-88c47843a291 could not be found. Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0f8e1f-659c-4e3d-be95-88c47843a291 could not be found. Oct 29 02:52:44.009992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.014130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 404 to user: Instance 0a0f8e1f-659c-4e3d-be95-88c47843a291 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:44.015330 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1f945a76-00a7-446e-870e-576c11849769 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291" status: 404 len: 111 microversion: 2.1 time: 0.105093 Oct 29 02:52:44.016547 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 980/1991] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:43 2022] GET /compute/v2.1/servers/0a0f8e1f-659c-4e3d-be95-88c47843a291 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:44.029052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-648bdf61-04fb-46b8-b8fd-0602954c480a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:44.037291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-648bdf61-04fb-46b8-b8fd-0602954c480a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:44.108355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648bdf61-04fb-46b8-b8fd-0602954c480a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:44.110412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648bdf61-04fb-46b8-b8fd-0602954c480a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:44.118211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648bdf61-04fb-46b8-b8fd-0602954c480a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:44.129601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648bdf61-04fb-46b8-b8fd-0602954c480a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:44.132545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648bdf61-04fb-46b8-b8fd-0602954c480a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:44.132830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648bdf61-04fb-46b8-b8fd-0602954c480a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:44.789610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-648bdf61-04fb-46b8-b8fd-0602954c480a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:44.799178 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-648bdf61-04fb-46b8-b8fd-0602954c480a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1307 microversion: 2.1 time: 0.832358 Oct 29 02:52:44.811800 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1012/1992] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:43 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1307 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:44.831443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ac51e43-6e6a-421d-803f-32838ba61175 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '.version_select at 0x7fe1acc9e550>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:44.852321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4a846dde-1ab7-4321-b0cf-7e0f289598aa tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:44.852950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4a846dde-1ab7-4321-b0cf-7e0f289598aa tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:44.862972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a846dde-1ab7-4321-b0cf-7e0f289598aa tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:44.869599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a846dde-1ab7-4321-b0cf-7e0f289598aa tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:44.870806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a846dde-1ab7-4321-b0cf-7e0f289598aa tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:44.874835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a846dde-1ab7-4321-b0cf-7e0f289598aa tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:44.878305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a846dde-1ab7-4321-b0cf-7e0f289598aa tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:44.879159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a846dde-1ab7-4321-b0cf-7e0f289598aa tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:44.888500 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-3ac51e43-6e6a-421d-803f-32838ba61175 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] HTTP exception thrown: Image not found. Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ac51e43-6e6a-421d-803f-32838ba61175 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/images/fe326bd4-0c2c-4c6e-9da4-8da1af72d580 HTTP/1.1 Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:52:44.893786 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: exception: Image not found. Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'fe326bd4-0c2c-4c6e-9da4-8da1af72d580'} Oct 29 02:52:44.895366 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fe326bd4-0c2c-4c6e-9da4-8da1af72d580 to delete Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:44.896295 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fe326bd4-0c2c-4c6e-9da4-8da1af72d580 could not be found. Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:44.898444 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:52:44.901323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:44.906226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ac51e43-6e6a-421d-803f-32838ba61175 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 404 to user: Image not found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:44.915796 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3ac51e43-6e6a-421d-803f-32838ba61175 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "DELETE /compute/v2.1/images/fe326bd4-0c2c-4c6e-9da4-8da1af72d580" status: 404 len: 62 microversion: 2.1 time: 0.101043 Oct 29 02:52:44.918197 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1013/1993] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:44 2022] DELETE /compute/v2.1/images/fe326bd4-0c2c-4c6e-9da4-8da1af72d580 => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:52:45.057571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-390363178", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": "none"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:45.169100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:52:45.169957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:52:45.172616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:52:45.181004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:52:45.181724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:52:45.209861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:45.210369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:45.210901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:45.211547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:45.212001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:45.212423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:45.263913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Getting quotas for project 65837d49e9914967875ca457c466337f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:52:45.264483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:45.269696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Getting quotas for user 62af8e77eeca4ecc942b76ef82bf2ff2 and project 65837d49e9914967875ca457c466337f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:52:45.290890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=12 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:45.291955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:52:45.297584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:52:45.446198 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6cd25258-3186-4f9c-b9c9-77babed05813 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.526474 Oct 29 02:52:45.447119 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1014/1994] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:52:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:52:45.452301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:45.453025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:45.460535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:45.461354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:45.462165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:45.463116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:45.463739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:45.464331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:45.479542 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] HTTP exception thrown: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 HTTP/1.1 Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:52:45.481619 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:45.483456 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1782e279-7a4c-47a0-983e-7e07b34162a6'} Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:45.484477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:45.486142 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:45.506146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 404 to user: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:45.507280 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0f98cc8c-7131-4d7d-a8d9-10c84694dc5c tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 404 len: 111 microversion: 2.1 time: 0.059047 Oct 29 02:52:45.510075 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1015/1995] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:52:45 2022] DELETE /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:45.537830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6dd93c39-8533-45b7-8f7c-83f33663185e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:45.538736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6dd93c39-8533-45b7-8f7c-83f33663185e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:45.558474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd93c39-8533-45b7-8f7c-83f33663185e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:45.559260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd93c39-8533-45b7-8f7c-83f33663185e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:45.560747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd93c39-8533-45b7-8f7c-83f33663185e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:45.561658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd93c39-8533-45b7-8f7c-83f33663185e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:45.564107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd93c39-8533-45b7-8f7c-83f33663185e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:45.567491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd93c39-8533-45b7-8f7c-83f33663185e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:46.094244 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4a846dde-1ab7-4321-b0cf-7e0f289598aa tempest-MigrationsAdminTest-923670634 tempest-MigrationsAdminTest-923670634-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1612 microversion: 2.1 time: 2.076079 Oct 29 02:52:46.099938 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 981/1996] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:44 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1612 bytes in 2082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:46.117121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0299e216-a3c0-4cc5-9731-18fa9c2c20bf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:46.117758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0299e216-a3c0-4cc5-9731-18fa9c2c20bf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:46.338153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6dd93c39-8533-45b7-8f7c-83f33663185e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:46.350684 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6dd93c39-8533-45b7-8f7c-83f33663185e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.821375 Oct 29 02:52:46.351864 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1016/1997] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:45 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:46.371070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:46.372071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: 1782e279-7a4c-47a0-983e-7e07b34162a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:46.375483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:46.380446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.381195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.381992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:46.383317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.383977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.384573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:46.411827 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] HTTP exception thrown: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 HTTP/1.1 Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:52:46.414050 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:46.416080 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1782e279-7a4c-47a0-983e-7e07b34162a6'} Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:46.417236 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. Oct 29 02:52:46.419271 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:46.423104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 404 to user: Instance 1782e279-7a4c-47a0-983e-7e07b34162a6 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:46.424510 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1aeb2ab6-8056-4e48-be23-a28b9f278ea2 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6" status: 404 len: 111 microversion: 2.1 time: 0.071390 Oct 29 02:52:46.425498 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1017/1998] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:46 2022] GET /compute/v2.1/servers/1782e279-7a4c-47a0-983e-7e07b34162a6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:46.465624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0299e216-a3c0-4cc5-9731-18fa9c2c20bf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:46.468786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-183ea607-fa1d-49b0-ab81-dfbe933fd866 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:46.471591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-183ea607-fa1d-49b0-ab81-dfbe933fd866 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:46.478575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0299e216-a3c0-4cc5-9731-18fa9c2c20bf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:46.483131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0299e216-a3c0-4cc5-9731-18fa9c2c20bf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:46.487625 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0299e216-a3c0-4cc5-9731-18fa9c2c20bf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1277 microversion: 2.57 time: 0.385599 Oct 29 02:52:46.487836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-183ea607-fa1d-49b0-ab81-dfbe933fd866 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.490264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-183ea607-fa1d-49b0-ab81-dfbe933fd866 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.490435 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 982/1999] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:46 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1277 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:46.491415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-183ea607-fa1d-49b0-ab81-dfbe933fd866 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:46.494013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-183ea607-fa1d-49b0-ab81-dfbe933fd866 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.495244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-39e388aa-1e22-44a9-908f-7f7d6cb48d73 req-1733601f-ff23-4f01-b90e-7906a1563f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c", "name": "network-vif-plugged", "status": "completed", "tag": "34c62a40-e8c0-42f4-a697-e6a0fc8540fb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:46.496425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-183ea607-fa1d-49b0-ab81-dfbe933fd866 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.496971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-183ea607-fa1d-49b0-ab81-dfbe933fd866 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:46.532227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-39e388aa-1e22-44a9-908f-7f7d6cb48d73 req-1733601f-ff23-4f01-b90e-7906a1563f86 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.532708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-39e388aa-1e22-44a9-908f-7f7d6cb48d73 req-1733601f-ff23-4f01-b90e-7906a1563f86 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.533130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-39e388aa-1e22-44a9-908f-7f7d6cb48d73 req-1733601f-ff23-4f01-b90e-7906a1563f86 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:46.539137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:46.568243 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-39e388aa-1e22-44a9-908f-7f7d6cb48d73 req-1733601f-ff23-4f01-b90e-7906a1563f86 service nova] Creating event network-vif-plugged:34c62a40-e8c0-42f4-a697-e6a0fc8540fb for instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c on n-h1-862964-4 Oct 29 02:52:46.579881 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-39e388aa-1e22-44a9-908f-7f7d6cb48d73 req-1733601f-ff23-4f01-b90e-7906a1563f86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087531 Oct 29 02:52:46.582175 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 983/2000] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:46.595069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d413ed11-c91c-4049-8f44-9771a292e609 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:46.595657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d413ed11-c91c-4049-8f44-9771a292e609 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:46.610814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d413ed11-c91c-4049-8f44-9771a292e609 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.613172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d413ed11-c91c-4049-8f44-9771a292e609 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.614078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d413ed11-c91c-4049-8f44-9771a292e609 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:46.617872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d413ed11-c91c-4049-8f44-9771a292e609 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.618501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d413ed11-c91c-4049-8f44-9771a292e609 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.619013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d413ed11-c91c-4049-8f44-9771a292e609 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:46.674855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d413ed11-c91c-4049-8f44-9771a292e609 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:52:46.863860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-183ea607-fa1d-49b0-ab81-dfbe933fd866 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:46.872993 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d413ed11-c91c-4049-8f44-9771a292e609 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 204 len: 0 microversion: 2.1 time: 0.287722 Oct 29 02:52:46.873844 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-183ea607-fa1d-49b0-ab81-dfbe933fd866 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1307 microversion: 2.1 time: 0.446927 Oct 29 02:52:46.876540 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 984/2001] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:52:46 2022] DELETE /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:52:46.877158 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1018/2002] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:46 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1307 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:46.888439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cae1fd1e-a852-4f68-b5fb-c4d7d70d5d52 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '.version_select at 0x7fe1acb08af0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:46.889454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-df9e581b-8a4a-4eeb-9591-95025c6f26e1 req-0477ba11-f341-4bde-a596-c724ee120b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e20ef4b-4f1c-42b4-9307-857848aab3a7", "tag": "f1b664e0-4f41-434d-99ac-439f18224c4f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:46.913619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-df9e581b-8a4a-4eeb-9591-95025c6f26e1 req-0477ba11-f341-4bde-a596-c724ee120b98 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.914133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-df9e581b-8a4a-4eeb-9591-95025c6f26e1 req-0477ba11-f341-4bde-a596-c724ee120b98 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.918382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-df9e581b-8a4a-4eeb-9591-95025c6f26e1 req-0477ba11-f341-4bde-a596-c724ee120b98 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:46.931193 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cae1fd1e-a852-4f68-b5fb-c4d7d70d5d52 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908969686" status: 202 len: 0 microversion: 2.1 time: 0.052665 Oct 29 02:52:46.932474 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1019/2003] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 02:52:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908969686 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:52:46.939785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6aee11ff-6081-4e20-bddd-0bb98f00389e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:46.942596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6aee11ff-6081-4e20-bddd-0bb98f00389e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:46.950395 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-df9e581b-8a4a-4eeb-9591-95025c6f26e1 req-0477ba11-f341-4bde-a596-c724ee120b98 service nova] Creating event network-changed:f1b664e0-4f41-434d-99ac-439f18224c4f for instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 on n-h1-862964-4 Oct 29 02:52:46.956994 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-df9e581b-8a4a-4eeb-9591-95025c6f26e1 req-0477ba11-f341-4bde-a596-c724ee120b98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076981 Oct 29 02:52:46.957309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aee11ff-6081-4e20-bddd-0bb98f00389e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.958320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aee11ff-6081-4e20-bddd-0bb98f00389e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.958753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aee11ff-6081-4e20-bddd-0bb98f00389e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:46.958937 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 985/2004] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:46.961842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aee11ff-6081-4e20-bddd-0bb98f00389e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.962632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aee11ff-6081-4e20-bddd-0bb98f00389e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.964623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aee11ff-6081-4e20-bddd-0bb98f00389e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:47.100045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f943a8c4-f5aa-475c-b8b6-cd252f76a2a5 req-98057f8b-99e3-4bb1-b1b4-0f5090766a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48", "tag": "c7ca1518-2cf2-4f9f-8bf2-8a07dafc3f4f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:47.110545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f943a8c4-f5aa-475c-b8b6-cd252f76a2a5 req-98057f8b-99e3-4bb1-b1b4-0f5090766a32 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:47.112627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f943a8c4-f5aa-475c-b8b6-cd252f76a2a5 req-98057f8b-99e3-4bb1-b1b4-0f5090766a32 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:47.113257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f943a8c4-f5aa-475c-b8b6-cd252f76a2a5 req-98057f8b-99e3-4bb1-b1b4-0f5090766a32 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:47.127212 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f943a8c4-f5aa-475c-b8b6-cd252f76a2a5 req-98057f8b-99e3-4bb1-b1b4-0f5090766a32 service nova] Creating event network-changed:c7ca1518-2cf2-4f9f-8bf2-8a07dafc3f4f for instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 on n-h2-862964-4 Oct 29 02:52:47.133649 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f943a8c4-f5aa-475c-b8b6-cd252f76a2a5 req-98057f8b-99e3-4bb1-b1b4-0f5090766a32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038523 Oct 29 02:52:47.139285 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 986/2005] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:52:47.277604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6aee11ff-6081-4e20-bddd-0bb98f00389e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:47.287104 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6aee11ff-6081-4e20-bddd-0bb98f00389e tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1467 microversion: 2.1 time: 0.353445 Oct 29 02:52:47.305942 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1020/2006] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:46 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1467 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:47.377420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b115b9f2-707c-4340-8451-dace18cf3838 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:47.378755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b115b9f2-707c-4340-8451-dace18cf3838 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:47.388477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b115b9f2-707c-4340-8451-dace18cf3838 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:47.389211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b115b9f2-707c-4340-8451-dace18cf3838 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:47.390103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b115b9f2-707c-4340-8451-dace18cf3838 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:47.391177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b115b9f2-707c-4340-8451-dace18cf3838 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:47.391814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b115b9f2-707c-4340-8451-dace18cf3838 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:47.392405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b115b9f2-707c-4340-8451-dace18cf3838 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:47.517705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:47.518486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:47.530373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:47.531216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:47.531950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:47.532896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:47.533643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:47.534446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:47.725684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b115b9f2-707c-4340-8451-dace18cf3838 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:47.741358 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b115b9f2-707c-4340-8451-dace18cf3838 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.369147 Oct 29 02:52:47.741991 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 987/2007] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:47 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:47.902354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-69d595a2-1bb6-404a-affb-478c763e0746 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:47.902953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-69d595a2-1bb6-404a-affb-478c763e0746 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:47.912466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69d595a2-1bb6-404a-affb-478c763e0746 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:47.912948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69d595a2-1bb6-404a-affb-478c763e0746 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:47.913683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69d595a2-1bb6-404a-affb-478c763e0746 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:47.914697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69d595a2-1bb6-404a-affb-478c763e0746 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:47.915806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69d595a2-1bb6-404a-affb-478c763e0746 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:47.916426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69d595a2-1bb6-404a-affb-478c763e0746 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:47.925266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:47.942317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:47.945056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:47.946384 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3d48dc5-ec7e-483c-8e66-89b4b1696140 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1347 microversion: 2.57 time: 0.432758 Oct 29 02:52:47.953426 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1021/2008] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:47 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1347 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:52:48.160833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69d595a2-1bb6-404a-affb-478c763e0746 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:48.169907 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-69d595a2-1bb6-404a-affb-478c763e0746 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1307 microversion: 2.1 time: 0.271332 Oct 29 02:52:48.171073 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 988/2009] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:47 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1307 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:52:48.316050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8c4cc686-8b2c-4e39-b427-638192768583 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:48.317154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8c4cc686-8b2c-4e39-b427-638192768583 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:48.331777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c4cc686-8b2c-4e39-b427-638192768583 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:48.332667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c4cc686-8b2c-4e39-b427-638192768583 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:48.335567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c4cc686-8b2c-4e39-b427-638192768583 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:48.336536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c4cc686-8b2c-4e39-b427-638192768583 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:48.338452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c4cc686-8b2c-4e39-b427-638192768583 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:48.338884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c4cc686-8b2c-4e39-b427-638192768583 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:48.602367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c4cc686-8b2c-4e39-b427-638192768583 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:48.610258 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8c4cc686-8b2c-4e39-b427-638192768583 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 200 len: 1467 microversion: 2.1 time: 0.298601 Oct 29 02:52:48.626746 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1022/2010] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:48 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 1467 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:48.772203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c1f95ebf-fd36-4484-ab1d-9050bc2dc5f0 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:48.772930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c1f95ebf-fd36-4484-ab1d-9050bc2dc5f0 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:48.786569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1f95ebf-fd36-4484-ab1d-9050bc2dc5f0 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:48.811481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1f95ebf-fd36-4484-ab1d-9050bc2dc5f0 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:48.812443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1f95ebf-fd36-4484-ab1d-9050bc2dc5f0 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:48.815120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ab953979-5612-48ba-bc5c-659c3c12e3d6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '.version_select at 0x7fe1acb1c8b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:48.819973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1f95ebf-fd36-4484-ab1d-9050bc2dc5f0 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:48.822171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1f95ebf-fd36-4484-ab1d-9050bc2dc5f0 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:48.823172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1f95ebf-fd36-4484-ab1d-9050bc2dc5f0 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:49.273543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c1f95ebf-fd36-4484-ab1d-9050bc2dc5f0 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:49.284778 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c1f95ebf-fd36-4484-ab1d-9050bc2dc5f0 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.517532 Oct 29 02:52:49.285428 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 989/2011] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:48 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:49.290392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:49.291325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:49.298340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.299268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.299856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:49.300709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.301317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.301947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:49.411984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:49.601665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:49.622351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:49.625692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:49.631897 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6f2219e9-7b74-441a-bf83-766f1e37be99 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1335 microversion: 2.57 time: 0.342416 Oct 29 02:52:49.632676 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 990/2012] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:49 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1335 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:49.640952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-8877f8f4-c180-4f57-8233-d779a1215d45 req-5bca757a-0bf4-45f3-b944-d0e945d10b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e20ef4b-4f1c-42b4-9307-857848aab3a7", "tag": "f754e90f-ecef-4004-ba77-7f20a2f9176d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:49.661972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8877f8f4-c180-4f57-8233-d779a1215d45 req-5bca757a-0bf4-45f3-b944-d0e945d10b1e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.665527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8877f8f4-c180-4f57-8233-d779a1215d45 req-5bca757a-0bf4-45f3-b944-d0e945d10b1e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.666239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8877f8f4-c180-4f57-8233-d779a1215d45 req-5bca757a-0bf4-45f3-b944-d0e945d10b1e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:49.684230 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-8877f8f4-c180-4f57-8233-d779a1215d45 req-5bca757a-0bf4-45f3-b944-d0e945d10b1e service nova] Creating event network-changed:f754e90f-ecef-4004-ba77-7f20a2f9176d for instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 on n-h1-862964-4 Oct 29 02:52:49.689427 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-8877f8f4-c180-4f57-8233-d779a1215d45 req-5bca757a-0bf4-45f3-b944-d0e945d10b1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054499 Oct 29 02:52:49.690450 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 991/2013] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:49.697698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-073ae062-ff7b-4e5e-97ee-50fc4e1edd8f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:49.698630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-073ae062-ff7b-4e5e-97ee-50fc4e1edd8f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:49.704927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-073ae062-ff7b-4e5e-97ee-50fc4e1edd8f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.705587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-073ae062-ff7b-4e5e-97ee-50fc4e1edd8f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.706285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-073ae062-ff7b-4e5e-97ee-50fc4e1edd8f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:49.707098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-073ae062-ff7b-4e5e-97ee-50fc4e1edd8f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.707780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-073ae062-ff7b-4e5e-97ee-50fc4e1edd8f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.708429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-073ae062-ff7b-4e5e-97ee-50fc4e1edd8f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:49.941347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-073ae062-ff7b-4e5e-97ee-50fc4e1edd8f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:49.951548 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-073ae062-ff7b-4e5e-97ee-50fc4e1edd8f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1307 microversion: 2.1 time: 0.259254 Oct 29 02:52:49.952584 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 992/2014] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:49 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1307 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:49.976645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e4eb25d9-9c1d-48f3-859f-cfff895e91dc req-3608e3ca-e543-4217-8de3-5c253263273f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c", "name": "network-vif-deleted", "tag": "34c62a40-e8c0-42f4-a697-e6a0fc8540fb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:49.987860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e4eb25d9-9c1d-48f3-859f-cfff895e91dc req-3608e3ca-e543-4217-8de3-5c253263273f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.988464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e4eb25d9-9c1d-48f3-859f-cfff895e91dc req-3608e3ca-e543-4217-8de3-5c253263273f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.988994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e4eb25d9-9c1d-48f3-859f-cfff895e91dc req-3608e3ca-e543-4217-8de3-5c253263273f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.003713 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e4eb25d9-9c1d-48f3-859f-cfff895e91dc req-3608e3ca-e543-4217-8de3-5c253263273f service nova] Creating event network-vif-deleted:34c62a40-e8c0-42f4-a697-e6a0fc8540fb for instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c on n-h1-862964-4 Oct 29 02:52:50.009781 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e4eb25d9-9c1d-48f3-859f-cfff895e91dc req-3608e3ca-e543-4217-8de3-5c253263273f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041346 Oct 29 02:52:50.010827 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 993/2015] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:50.016471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:50.017587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:50.027225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.027711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.028182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.028893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.029343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.030176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.045697 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] HTTP exception thrown: Instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c could not be found. Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Request method failure captured: Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c HTTP/1.1 Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJP9p9evjhd81UDpuydHkWkt6DnMM6qoX2XA0Xx90NHReODhL8aoxga_PZyQEUxHN9tm4fU33DuaH1H_qB59ySVW_d3YlGBVmFANIPtJpjlWGublYdwhpxc9EVtkPI1jgW02Y4YumMHpsychJNkGjYnIWf6J5a2ss2MIUkQOJfcAG9o Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: bb5aec15c4e844b2872c9eab52f69482 Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-MigrationsAdminTest-1838705440 Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:52:50.047393 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bb5aec15c4e844b2872c9eab52f69482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb5aec15c4e844b2872c9eab52f69482"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bb5aec15c4e844b2872c9eab52f69482", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb5aec15c4e844b2872c9eab52f69482"}]}] Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-MigrationsAdminTest-1838705440 Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: bb5aec15c4e844b2872c9eab52f69482 Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-MigrationsAdminTest-1838705440 Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-MigrationsAdminTest-1838705440-project Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: efecedc77d3048c4a0ec0fe6701f9ccc Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-MigrationsAdminTest-1838705440-project Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c could not be found. Oct 29 02:52:50.049465 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c'} Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c could not be found. Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:50.050669 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c could not be found. Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c could not be found. Oct 29 02:52:50.052674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:50.055037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Returning 404 to user: Instance a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:50.055037 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-082dcc03-54ec-43c8-a554-ca25e1da702f tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c" status: 404 len: 111 microversion: 2.1 time: 0.036888 Oct 29 02:52:50.055037 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 994/2016] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:50 2022] GET /compute/v2.1/servers/a424f7eb-ba88-43b6-8d1b-7e9dd5e6425c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:50.058466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2efc7a1e-ea3b-4b8d-82b6-b5089349ef4a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:50.058947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2efc7a1e-ea3b-4b8d-82b6-b5089349ef4a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:50.065256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2efc7a1e-ea3b-4b8d-82b6-b5089349ef4a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.065966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2efc7a1e-ea3b-4b8d-82b6-b5089349ef4a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.066575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2efc7a1e-ea3b-4b8d-82b6-b5089349ef4a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.067387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2efc7a1e-ea3b-4b8d-82b6-b5089349ef4a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.067842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2efc7a1e-ea3b-4b8d-82b6-b5089349ef4a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.068258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2efc7a1e-ea3b-4b8d-82b6-b5089349ef4a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.098013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2efc7a1e-ea3b-4b8d-82b6-b5089349ef4a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:52:50.198003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2efc7a1e-ea3b-4b8d-82b6-b5089349ef4a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 204 len: 0 microversion: 2.1 time: 0.143218 Oct 29 02:52:50.202612 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 995/2017] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:52:50 2022] DELETE /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:52:50.211705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ae480dd8-b949-4759-9726-da4f1a2cb815 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:50.211705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ae480dd8-b949-4759-9726-da4f1a2cb815 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:50.219750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae480dd8-b949-4759-9726-da4f1a2cb815 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.220246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae480dd8-b949-4759-9726-da4f1a2cb815 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.220671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae480dd8-b949-4759-9726-da4f1a2cb815 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.222239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae480dd8-b949-4759-9726-da4f1a2cb815 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.222704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae480dd8-b949-4759-9726-da4f1a2cb815 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.223996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae480dd8-b949-4759-9726-da4f1a2cb815 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.409988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ae480dd8-b949-4759-9726-da4f1a2cb815 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:50.420539 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ae480dd8-b949-4759-9726-da4f1a2cb815 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1535 microversion: 2.1 time: 0.215927 Oct 29 02:52:50.422207 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 996/2018] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:50 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1535 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:50.428816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d846c4ee-1309-483e-96b7-96d5220d4a08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:50.430012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d846c4ee-1309-483e-96b7-96d5220d4a08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:50.437815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d846c4ee-1309-483e-96b7-96d5220d4a08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.438914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d846c4ee-1309-483e-96b7-96d5220d4a08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.439685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d846c4ee-1309-483e-96b7-96d5220d4a08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.441436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d846c4ee-1309-483e-96b7-96d5220d4a08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.442185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d846c4ee-1309-483e-96b7-96d5220d4a08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.442840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d846c4ee-1309-483e-96b7-96d5220d4a08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.696039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d846c4ee-1309-483e-96b7-96d5220d4a08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:50.704347 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d846c4ee-1309-483e-96b7-96d5220d4a08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.280071 Oct 29 02:52:50.705094 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 997/2019] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:50 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:50.710513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:50.711110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:50.717998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.718470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.718893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.719784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.720228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.720647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.790706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:50.799393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:50.801100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:50.802265 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8fbe4bde-760a-456e-bb51-33b91677b2c3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1335 microversion: 2.57 time: 0.095370 Oct 29 02:52:50.802808 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 998/2020] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:50 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:50.978800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-783b01d5-2639-4525-b504-765248b18fcc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:50.979600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-783b01d5-2639-4525-b504-765248b18fcc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:50.987437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-783b01d5-2639-4525-b504-765248b18fcc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.987936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-783b01d5-2639-4525-b504-765248b18fcc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.988530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-783b01d5-2639-4525-b504-765248b18fcc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.989609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-783b01d5-2639-4525-b504-765248b18fcc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.990087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-783b01d5-2639-4525-b504-765248b18fcc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.990730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-783b01d5-2639-4525-b504-765248b18fcc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:51.140909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-783b01d5-2639-4525-b504-765248b18fcc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:51.150263 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-783b01d5-2639-4525-b504-765248b18fcc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1307 microversion: 2.1 time: 0.176243 Oct 29 02:52:51.151523 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 999/2021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:50 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1307 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:51.451352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c08e7a5c-f20b-4ac8-93b5-4b59497ab839 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:51.452041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c08e7a5c-f20b-4ac8-93b5-4b59497ab839 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:51.459747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c08e7a5c-f20b-4ac8-93b5-4b59497ab839 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:51.460350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c08e7a5c-f20b-4ac8-93b5-4b59497ab839 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:51.461159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c08e7a5c-f20b-4ac8-93b5-4b59497ab839 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:51.462130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c08e7a5c-f20b-4ac8-93b5-4b59497ab839 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:51.462815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c08e7a5c-f20b-4ac8-93b5-4b59497ab839 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:51.463470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c08e7a5c-f20b-4ac8-93b5-4b59497ab839 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:51.618866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c08e7a5c-f20b-4ac8-93b5-4b59497ab839 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:51.628070 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c08e7a5c-f20b-4ac8-93b5-4b59497ab839 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1535 microversion: 2.1 time: 0.183144 Oct 29 02:52:51.628663 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1000/2022] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:51 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1535 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:52:51.729828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e7822eb1-b11d-4972-8f69-589cfa9d6de5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:51.730703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e7822eb1-b11d-4972-8f69-589cfa9d6de5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:51.737838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7822eb1-b11d-4972-8f69-589cfa9d6de5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:51.738801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7822eb1-b11d-4972-8f69-589cfa9d6de5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:51.739270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7822eb1-b11d-4972-8f69-589cfa9d6de5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:51.740756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7822eb1-b11d-4972-8f69-589cfa9d6de5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:51.740756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7822eb1-b11d-4972-8f69-589cfa9d6de5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:51.741115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7822eb1-b11d-4972-8f69-589cfa9d6de5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:51.932083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e7822eb1-b11d-4972-8f69-589cfa9d6de5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:51.944677 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e7822eb1-b11d-4972-8f69-589cfa9d6de5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.218712 Oct 29 02:52:51.981859 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1001/2023] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:51 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:52:51.997116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:52.004086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:52.046486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.048952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.054240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.056771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.059244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.059244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.235371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:52.244254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:52.246171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:52.248234 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-52c55af3-7cf3-429c-8f8e-ffe0ef66c281 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1335 microversion: 2.57 time: 0.264389 Oct 29 02:52:52.258038 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1002/2024] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:51 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1335 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:52.258038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f3b7696-df23-4760-8a06-dabdcbec6ee6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:52.258038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f3b7696-df23-4760-8a06-dabdcbec6ee6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:52.262150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3b7696-df23-4760-8a06-dabdcbec6ee6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.262976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3b7696-df23-4760-8a06-dabdcbec6ee6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.263292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3b7696-df23-4760-8a06-dabdcbec6ee6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.269201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3b7696-df23-4760-8a06-dabdcbec6ee6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.269739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3b7696-df23-4760-8a06-dabdcbec6ee6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.270393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f3b7696-df23-4760-8a06-dabdcbec6ee6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.496867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8f3b7696-df23-4760-8a06-dabdcbec6ee6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:52.506950 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f3b7696-df23-4760-8a06-dabdcbec6ee6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1307 microversion: 2.1 time: 0.256559 Oct 29 02:52:52.507866 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1003/2025] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:52 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1307 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:52.653151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6e7e1119-08d3-4ff5-9fd3-d3b3c471dc2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:52.654465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6e7e1119-08d3-4ff5-9fd3-d3b3c471dc2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:52.661933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7e1119-08d3-4ff5-9fd3-d3b3c471dc2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.662822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7e1119-08d3-4ff5-9fd3-d3b3c471dc2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.663487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7e1119-08d3-4ff5-9fd3-d3b3c471dc2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.664440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7e1119-08d3-4ff5-9fd3-d3b3c471dc2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.665221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7e1119-08d3-4ff5-9fd3-d3b3c471dc2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.665837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7e1119-08d3-4ff5-9fd3-d3b3c471dc2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.945724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6e7e1119-08d3-4ff5-9fd3-d3b3c471dc2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:52.977387 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6e7e1119-08d3-4ff5-9fd3-d3b3c471dc2a tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 200 len: 1535 microversion: 2.1 time: 0.328549 Oct 29 02:52:52.990798 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1004/2026] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:52 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 1535 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:53.002080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-463fa913-b484-496f-917a-cbd71445dbb3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:53.002720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-463fa913-b484-496f-917a-cbd71445dbb3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:53.017681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-463fa913-b484-496f-917a-cbd71445dbb3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.018839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-463fa913-b484-496f-917a-cbd71445dbb3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.018839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-463fa913-b484-496f-917a-cbd71445dbb3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.019380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-463fa913-b484-496f-917a-cbd71445dbb3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.019832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-463fa913-b484-496f-917a-cbd71445dbb3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.020250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-463fa913-b484-496f-917a-cbd71445dbb3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.392778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-463fa913-b484-496f-917a-cbd71445dbb3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:53.402669 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-463fa913-b484-496f-917a-cbd71445dbb3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.409759 Oct 29 02:52:53.421704 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1005/2027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:52 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:53.432054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:53.433090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:53.439917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.440821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.441581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.442624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.443372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.444129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.612939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:53.624920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:53.626342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:53.636581 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7d280c0a-92b4-4648-b2fe-c012c7ef2fdb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1356 microversion: 2.57 time: 0.212968 Oct 29 02:52:53.637452 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1006/2028] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:53 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1356 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:53.644687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-28b53c34-b211-4456-9f6d-7abbe53844b1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:53.648236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-28b53c34-b211-4456-9f6d-7abbe53844b1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:53.665304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28b53c34-b211-4456-9f6d-7abbe53844b1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.665832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28b53c34-b211-4456-9f6d-7abbe53844b1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.666467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28b53c34-b211-4456-9f6d-7abbe53844b1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.670736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28b53c34-b211-4456-9f6d-7abbe53844b1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.671423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28b53c34-b211-4456-9f6d-7abbe53844b1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.672127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28b53c34-b211-4456-9f6d-7abbe53844b1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.723467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:54.181741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-28b53c34-b211-4456-9f6d-7abbe53844b1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:54.198421 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-28b53c34-b211-4456-9f6d-7abbe53844b1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1307 microversion: 2.1 time: 0.551265 Oct 29 02:52:54.199308 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1007/2029] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:53 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1307 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:54.205967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:54.213421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:54.227260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:54.227746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:54.228172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:54.228870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:54.229319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:54.229765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:55.239890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:55.286374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=10 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:56.471290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:56.957747 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-ab953979-5612-48ba-bc5c-659c3c12e3d6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] HTTP exception thrown: Image not found. Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ab953979-5612-48ba-bc5c-659c3c12e3d6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/images/8aea666a-f39b-40dc-a176-4a648f8aab6f HTTP/1.1 Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:52:56.961837 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: exception: Image not found. Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '8aea666a-f39b-40dc-a176-4a648f8aab6f'} Oct 29 02:52:56.963501 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8aea666a-f39b-40dc-a176-4a648f8aab6f to delete Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:56.964436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8aea666a-f39b-40dc-a176-4a648f8aab6f could not be found. Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:56.965821 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ab953979-5612-48ba-bc5c-659c3c12e3d6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 404 to user: Image not found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:56.967228 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ab953979-5612-48ba-bc5c-659c3c12e3d6 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "DELETE /compute/v2.1/images/8aea666a-f39b-40dc-a176-4a648f8aab6f" status: 404 len: 62 microversion: 2.1 time: 8.152671 Oct 29 02:52:56.970214 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1023/2030] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:48 2022] DELETE /compute/v2.1/images/8aea666a-f39b-40dc-a176-4a648f8aab6f => generated 62 bytes in 8157 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:52:56.977125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:56.978240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 86ce5a89-9c05-4459-9e6f-a94249149f0e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:56.985121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.987341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.987993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.988893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.989380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.990030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.024260 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] HTTP exception thrown: Instance 86ce5a89-9c05-4459-9e6f-a94249149f0e could not be found. Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Request method failure captured: Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e HTTP/1.1 Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJP9p9evjhd81UDpuydHkWkt6DnMM6qoX2XA0Xx90NHReODhL8aoxga_PZyQEUxHN9tm4fU33DuaH1H_qB59ySVW_d3YlGBVmFANIPtJpjlWGublYdwhpxc9EVtkPI1jgW02Y4YumMHpsychJNkGjYnIWf6J5a2ss2MIUkQOJfcAG9o Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: bb5aec15c4e844b2872c9eab52f69482 Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-MigrationsAdminTest-1838705440 Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:52:57.026147 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bb5aec15c4e844b2872c9eab52f69482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb5aec15c4e844b2872c9eab52f69482"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bb5aec15c4e844b2872c9eab52f69482", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb5aec15c4e844b2872c9eab52f69482"}]}] Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-MigrationsAdminTest-1838705440 Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: bb5aec15c4e844b2872c9eab52f69482 Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-MigrationsAdminTest-1838705440 Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-MigrationsAdminTest-1838705440-project Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: efecedc77d3048c4a0ec0fe6701f9ccc Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-MigrationsAdminTest-1838705440-project Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 86ce5a89-9c05-4459-9e6f-a94249149f0e could not be found. Oct 29 02:52:57.027682 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '86ce5a89-9c05-4459-9e6f-a94249149f0e'} Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ce5a89-9c05-4459-9e6f-a94249149f0e could not be found. Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:57.028535 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ce5a89-9c05-4459-9e6f-a94249149f0e could not be found. Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ce5a89-9c05-4459-9e6f-a94249149f0e could not be found. Oct 29 02:52:57.029943 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.033795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Returning 404 to user: Instance 86ce5a89-9c05-4459-9e6f-a94249149f0e could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:57.035495 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c1d5a72-3c24-4592-8609-b34477b9878d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e" status: 404 len: 111 microversion: 2.1 time: 0.066640 Oct 29 02:52:57.036324 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1024/2031] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:56 2022] GET /compute/v2.1/servers/86ce5a89-9c05-4459-9e6f-a94249149f0e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:57.041869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b9d73eb7-70e9-4693-94d4-be68de58ba41 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:57.043310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b9d73eb7-70e9-4693-94d4-be68de58ba41 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:57.047827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:52:57.048466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:52:57.049147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:52:57.049727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:52:57.050336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:52:57.053071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9d73eb7-70e9-4693-94d4-be68de58ba41 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.056729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9d73eb7-70e9-4693-94d4-be68de58ba41 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.057672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9d73eb7-70e9-4693-94d4-be68de58ba41 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.058555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9d73eb7-70e9-4693-94d4-be68de58ba41 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.059118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9d73eb7-70e9-4693-94d4-be68de58ba41 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.059904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9d73eb7-70e9-4693-94d4-be68de58ba41 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.151073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:57.157221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:57.163389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.164821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.165872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.166839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.167465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.168413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.207961 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e08f3272-8aef-4131-bbb3-ad23d426ca63 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "POST /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e/action" status: 202 len: 1137 microversion: 2.57 time: 3.007309 Oct 29 02:52:57.208854 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1008/2032] 10.222.0.16 () {62 vars in 1320 bytes} [Sat Oct 29 02:52:54 2022] POST /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e/action => generated 1137 bytes in 3009 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 02:52:57.214940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-6d65dded-fdc4-49b6-bf5a-0f0e970ae7ed req-57fe4c23-cd96-4a35-b13b-0da0709d0887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ce5a89-9c05-4459-9e6f-a94249149f0e", "name": "network-vif-deleted", "tag": "55f158e4-c02f-4621-aef5-0df1f9eb6596"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:57.228144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6d65dded-fdc4-49b6-bf5a-0f0e970ae7ed req-57fe4c23-cd96-4a35-b13b-0da0709d0887 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.228991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6d65dded-fdc4-49b6-bf5a-0f0e970ae7ed req-57fe4c23-cd96-4a35-b13b-0da0709d0887 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.229664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6d65dded-fdc4-49b6-bf5a-0f0e970ae7ed req-57fe4c23-cd96-4a35-b13b-0da0709d0887 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.244120 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-6d65dded-fdc4-49b6-bf5a-0f0e970ae7ed req-57fe4c23-cd96-4a35-b13b-0da0709d0887 service nova] Creating event network-vif-deleted:55f158e4-c02f-4621-aef5-0df1f9eb6596 for instance 86ce5a89-9c05-4459-9e6f-a94249149f0e on n-h2-862964-4 Oct 29 02:52:57.262553 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-6d65dded-fdc4-49b6-bf5a-0f0e970ae7ed req-57fe4c23-cd96-4a35-b13b-0da0709d0887 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039894 Oct 29 02:52:57.264863 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1009/2033] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:57.282554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0dfaa4a4-a6fd-4c29-981e-ccb9de1e752b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:57.283408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0dfaa4a4-a6fd-4c29-981e-ccb9de1e752b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:57.291302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dfaa4a4-a6fd-4c29-981e-ccb9de1e752b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.292179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dfaa4a4-a6fd-4c29-981e-ccb9de1e752b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.292831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dfaa4a4-a6fd-4c29-981e-ccb9de1e752b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.294059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dfaa4a4-a6fd-4c29-981e-ccb9de1e752b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.294988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dfaa4a4-a6fd-4c29-981e-ccb9de1e752b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.296015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dfaa4a4-a6fd-4c29-981e-ccb9de1e752b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.687605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0dfaa4a4-a6fd-4c29-981e-ccb9de1e752b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:57.712747 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0dfaa4a4-a6fd-4c29-981e-ccb9de1e752b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1307 microversion: 2.1 time: 0.433141 Oct 29 02:52:57.714044 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1010/2034] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:57 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1307 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:57.742658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ad32b5d-0208-478c-893b-600e50c2b617 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Action: 'create', calling method: .version_select at 0x7fe1a848c280>, body: {"keypair": {"name": "tempest-keypair-88122665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsuJYBx3b+ww1SD03ppwC84daErf9oQyLOr/XmzLRDomJXDdsZ4gWjeZLY9VceGrvxpBfV1Ik+3DGPBQdgZ3UlFu2V4hitpFAn+hqt12+weOQnqnr4/oNfzoeRb5q/QFA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:57.765932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-4ad32b5d-0208-478c-893b-600e50c2b617 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Getting quotas for project c813a6b4d51c4c268e9871a292ac33b8. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:52:57.771267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-4ad32b5d-0208-478c-893b-600e50c2b617 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Getting quotas for user 3b95983a06784c0092841b61efd66ba4 and project c813a6b4d51c4c268e9871a292ac33b8. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:52:57.833939 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ad32b5d-0208-478c-893b-600e50c2b617 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.32 time: 0.101395 Oct 29 02:52:57.843029 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1011/2035] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Oct 29 02:52:57 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:52:57.850138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:57.850849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:57.860088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.860864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.861586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.863460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.864126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.864706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.889290 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] HTTP exception thrown: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 HTTP/1.1 Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:52:57.891103 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:52:57.892902 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c43db9b0-c693-48cf-9902-82d38e76ea04'} Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:57.894106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:52:57.899168 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.901324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 404 to user: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:57.901324 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-57fea9b0-9e6a-40b5-8815-f472640c58b9 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 404 len: 111 microversion: 2.1 time: 0.048526 Oct 29 02:52:57.901324 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1012/2036] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:52:57 2022] DELETE /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:57.907988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b9d73eb7-70e9-4693-94d4-be68de58ba41 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:57.926954 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b9d73eb7-70e9-4693-94d4-be68de58ba41 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.888279 Oct 29 02:52:57.927577 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1025/2037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:57 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:57.936145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ed941eb3-7e11-4f47-98b1-71bf3e23d5cb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '.version_select at 0x7fe1a8422e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:57.951617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:57.952930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:57.966338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.967799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.970968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.971522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.972073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.972994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.995727 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ed941eb3-7e11-4f47-98b1-71bf3e23d5cb tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998564294" status: 202 len: 0 microversion: 2.1 time: 0.098254 Oct 29 02:52:58.002846 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1013/2038] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 02:52:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998564294 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:52:58.014146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-51ef2b5f-706b-44f8-9469-6a8cce34f713 req-9549994a-9427-49e0-b2f9-c8d78b2c104b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48", "name": "network-vif-plugged", "status": "completed", "tag": "c7ca1518-2cf2-4f9f-8bf2-8a07dafc3f4f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:58.034572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-51ef2b5f-706b-44f8-9469-6a8cce34f713 req-9549994a-9427-49e0-b2f9-c8d78b2c104b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:58.037065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-51ef2b5f-706b-44f8-9469-6a8cce34f713 req-9549994a-9427-49e0-b2f9-c8d78b2c104b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:58.037537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-51ef2b5f-706b-44f8-9469-6a8cce34f713 req-9549994a-9427-49e0-b2f9-c8d78b2c104b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:58.061183 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-51ef2b5f-706b-44f8-9469-6a8cce34f713 req-9549994a-9427-49e0-b2f9-c8d78b2c104b service nova] Creating event network-vif-plugged:c7ca1518-2cf2-4f9f-8bf2-8a07dafc3f4f for instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 on n-h2-862964-4 Oct 29 02:52:58.073684 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-51ef2b5f-706b-44f8-9469-6a8cce34f713 req-9549994a-9427-49e0-b2f9-c8d78b2c104b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069255 Oct 29 02:52:58.074703 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1014/2039] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:58.083243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:58.095164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] [instance: c43db9b0-c693-48cf-9902-82d38e76ea04] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:58.119589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:58.132283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:58.133176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:58.134985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:58.136415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:58.138920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:58.186693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:58.210431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:58.215559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:58.216160 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] HTTP exception thrown: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:52:58.219777 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c69e13d4-f8c1-47ef-938d-9222946c52b3 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.273737 Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Request method failure captured: Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 HTTP/1.1 Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJTwCv7p3Iqk42QOX8-7YoQbiw_ZDN_NlX25GSp0vMdJJVcbpeQgB7lXdnqIrahwk475hA7ztOGLWdW9MTsZWxSdZ9Zmr7YWNt7HFudJhj1SbvjGq_hJ1xaSmd5o0InVgdmpXZVTRWeN1mlxPCnlAA1FYn5FVmd2OdvDrzqPc9-Btho Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:52:58.220338 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b30ce428766445d9d0d45f350ae1024", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b30ce428766445d9d0d45f350ae1024"}]}] Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 0b30ce428766445d9d0d45f350ae1024 Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-259406597 Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 837f9940834e4eaeb31c967dba6d762f Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-259406597-project Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:52:58.222127 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c43db9b0-c693-48cf-9902-82d38e76ea04'} Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:58.223328 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. Oct 29 02:52:58.225444 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:52:58.229694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] Returning 404 to user: Instance c43db9b0-c693-48cf-9902-82d38e76ea04 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:58.230125 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1026/2040] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:57 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:58.231171 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b5dd9689-7ea2-4096-a327-67b9e7de2a97 tempest-ImagesOneServerNegativeTestJSON-259406597 tempest-ImagesOneServerNegativeTestJSON-259406597-project] 10.222.0.16 "GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04" status: 404 len: 111 microversion: 2.1 time: 0.155398 Oct 29 02:52:58.232050 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1015/2041] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:58 2022] GET /compute/v2.1/servers/c43db9b0-c693-48cf-9902-82d38e76ea04 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:58.739496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-352b50a3-a72a-4451-8283-804a14f86a91 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:58.740382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-352b50a3-a72a-4451-8283-804a14f86a91 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:58.758709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-352b50a3-a72a-4451-8283-804a14f86a91 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:58.759474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-352b50a3-a72a-4451-8283-804a14f86a91 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:58.762935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-352b50a3-a72a-4451-8283-804a14f86a91 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:58.763689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-352b50a3-a72a-4451-8283-804a14f86a91 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:58.764143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-352b50a3-a72a-4451-8283-804a14f86a91 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:58.770033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-352b50a3-a72a-4451-8283-804a14f86a91 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:58.954936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2a64d1cf-5aee-48ca-b082-f8e8d5ea5b6f tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:58.956829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2a64d1cf-5aee-48ca-b082-f8e8d5ea5b6f tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:58.971331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a64d1cf-5aee-48ca-b082-f8e8d5ea5b6f tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:58.972088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a64d1cf-5aee-48ca-b082-f8e8d5ea5b6f tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:58.972684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a64d1cf-5aee-48ca-b082-f8e8d5ea5b6f tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:58.973731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a64d1cf-5aee-48ca-b082-f8e8d5ea5b6f tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:58.974079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a64d1cf-5aee-48ca-b082-f8e8d5ea5b6f tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:58.975665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a64d1cf-5aee-48ca-b082-f8e8d5ea5b6f tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:59.336730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-352b50a3-a72a-4451-8283-804a14f86a91 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:59.353597 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-352b50a3-a72a-4451-8283-804a14f86a91 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1307 microversion: 2.1 time: 0.618286 Oct 29 02:52:59.354281 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1027/2042] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:58 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1307 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:59.368893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:59.369527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:59.398228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:59.398641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:59.407609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:59.410795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:59.411476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:59.412078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:59.523394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:59.543658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2a64d1cf-5aee-48ca-b082-f8e8d5ea5b6f tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:59.545601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:59.551565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:59.556110 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2a64d1cf-5aee-48ca-b082-f8e8d5ea5b6f tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.605628 Oct 29 02:52:59.556399 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-05d5b386-ede4-441c-936e-d6e898ad6835 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.200664 Oct 29 02:52:59.557875 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1016/2043] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:58 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:59.571379 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1028/2044] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:59 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:00.073110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b4dce7a5-865f-4411-b3c4-25215be4b718 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:00.074289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b4dce7a5-865f-4411-b3c4-25215be4b718 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:00.088463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a5-865f-4411-b3c4-25215be4b718 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.088977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a5-865f-4411-b3c4-25215be4b718 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.089415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a5-865f-4411-b3c4-25215be4b718 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.091316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a5-865f-4411-b3c4-25215be4b718 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.092660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a5-865f-4411-b3c4-25215be4b718 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.094688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4dce7a5-865f-4411-b3c4-25215be4b718 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.154595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b4dce7a5-865f-4411-b3c4-25215be4b718 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:53:00.191163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8f586275-9817-45cb-a5ac-e8f115281af2 req-1e28f66d-f23c-4ff5-be70-96894ba7d715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e20ef4b-4f1c-42b4-9307-857848aab3a7", "name": "network-vif-plugged", "status": "completed", "tag": "f1b664e0-4f41-434d-99ac-439f18224c4f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:00.207468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8f586275-9817-45cb-a5ac-e8f115281af2 req-1e28f66d-f23c-4ff5-be70-96894ba7d715 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.209656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8f586275-9817-45cb-a5ac-e8f115281af2 req-1e28f66d-f23c-4ff5-be70-96894ba7d715 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.210365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8f586275-9817-45cb-a5ac-e8f115281af2 req-1e28f66d-f23c-4ff5-be70-96894ba7d715 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.230033 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8f586275-9817-45cb-a5ac-e8f115281af2 req-1e28f66d-f23c-4ff5-be70-96894ba7d715 service nova] Creating event network-vif-plugged:f1b664e0-4f41-434d-99ac-439f18224c4f for instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 on n-h1-862964-4 Oct 29 02:53:00.242026 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8f586275-9817-45cb-a5ac-e8f115281af2 req-1e28f66d-f23c-4ff5-be70-96894ba7d715 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054492 Oct 29 02:53:00.244879 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1029/2045] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:00.350259 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b4dce7a5-865f-4411-b3c4-25215be4b718 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 204 len: 0 microversion: 2.1 time: 0.280794 Oct 29 02:53:00.353153 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1017/2046] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:53:00 2022] DELETE /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:00.369580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-adcc34df-a731-49d9-9229-e894c63d6f0d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:00.371812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-adcc34df-a731-49d9-9229-e894c63d6f0d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:00.381079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-18fff9cf-a057-4054-a2e3-f9610fd297f4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:00.382106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-18fff9cf-a057-4054-a2e3-f9610fd297f4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:00.389195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adcc34df-a731-49d9-9229-e894c63d6f0d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.390596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adcc34df-a731-49d9-9229-e894c63d6f0d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.390753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18fff9cf-a057-4054-a2e3-f9610fd297f4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.391392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18fff9cf-a057-4054-a2e3-f9610fd297f4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.391534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adcc34df-a731-49d9-9229-e894c63d6f0d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.392193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18fff9cf-a057-4054-a2e3-f9610fd297f4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.393256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18fff9cf-a057-4054-a2e3-f9610fd297f4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.393966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18fff9cf-a057-4054-a2e3-f9610fd297f4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.394913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18fff9cf-a057-4054-a2e3-f9610fd297f4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.395148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adcc34df-a731-49d9-9229-e894c63d6f0d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.397470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adcc34df-a731-49d9-9229-e894c63d6f0d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.399089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adcc34df-a731-49d9-9229-e894c63d6f0d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:01.123848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-adcc34df-a731-49d9-9229-e894c63d6f0d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:01.140832 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-adcc34df-a731-49d9-9229-e894c63d6f0d tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1468 microversion: 2.1 time: 0.779591 Oct 29 02:53:01.141659 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1030/2047] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:00 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1468 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:01.157298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ffdd1f6a-ab52-4131-8567-2475616c08a7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:01.165485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ffdd1f6a-ab52-4131-8567-2475616c08a7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:01.175465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-18fff9cf-a057-4054-a2e3-f9610fd297f4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:01.183054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffdd1f6a-ab52-4131-8567-2475616c08a7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:01.184478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffdd1f6a-ab52-4131-8567-2475616c08a7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:01.184784 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-18fff9cf-a057-4054-a2e3-f9610fd297f4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1486 microversion: 2.1 time: 0.808581 Oct 29 02:53:01.185368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffdd1f6a-ab52-4131-8567-2475616c08a7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:01.188070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffdd1f6a-ab52-4131-8567-2475616c08a7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:01.189589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffdd1f6a-ab52-4131-8567-2475616c08a7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:01.190446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffdd1f6a-ab52-4131-8567-2475616c08a7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:01.205616 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1018/2048] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:00 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1486 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:01.211401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:01.211999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:01.230631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:01.231127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:01.232409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:01.233126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:01.233574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:01.234683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:01.387028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:01.400563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:01.404027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:01.405326 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f28fdc1d-3434-473d-aab2-2671480efa03 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.198622 Oct 29 02:53:01.408115 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1019/2049] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:01 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:01.418336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e5f8dec5-7ca4-489f-bc37-46a138520c5f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:01.433401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5f8dec5-7ca4-489f-bc37-46a138520c5f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:01.435672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5f8dec5-7ca4-489f-bc37-46a138520c5f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:01.436333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5f8dec5-7ca4-489f-bc37-46a138520c5f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:01.603961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e5f8dec5-7ca4-489f-bc37-46a138520c5f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Going to try to stop instance {{(pid=127042) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 02:53:01.686279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ffdd1f6a-ab52-4131-8567-2475616c08a7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:01.695788 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e5f8dec5-7ca4-489f-bc37-46a138520c5f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48/action" status: 202 len: 0 microversion: 2.1 time: 0.285786 Oct 29 02:53:01.697492 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ffdd1f6a-ab52-4131-8567-2475616c08a7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.552324 Oct 29 02:53:01.701713 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1031/2050] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:01 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:01.715799 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1020/2051] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:53:01 2022] POST /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:53:01.730856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-997bfb24-813a-4cf5-879d-294f1cba925b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:01.731770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-997bfb24-813a-4cf5-879d-294f1cba925b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:01.744855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-997bfb24-813a-4cf5-879d-294f1cba925b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:01.745634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-997bfb24-813a-4cf5-879d-294f1cba925b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:01.754306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-997bfb24-813a-4cf5-879d-294f1cba925b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:01.755373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-997bfb24-813a-4cf5-879d-294f1cba925b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:01.756012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-997bfb24-813a-4cf5-879d-294f1cba925b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:01.756602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-997bfb24-813a-4cf5-879d-294f1cba925b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:02.168661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3d907460-1e5d-4bdc-b4e5-db2f3c3e45b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:02.169639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3d907460-1e5d-4bdc-b4e5-db2f3c3e45b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:02.188849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d907460-1e5d-4bdc-b4e5-db2f3c3e45b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:02.189550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d907460-1e5d-4bdc-b4e5-db2f3c3e45b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:02.189720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d907460-1e5d-4bdc-b4e5-db2f3c3e45b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:02.190436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d907460-1e5d-4bdc-b4e5-db2f3c3e45b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:02.193352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d907460-1e5d-4bdc-b4e5-db2f3c3e45b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:02.194007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d907460-1e5d-4bdc-b4e5-db2f3c3e45b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:02.521233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3d907460-1e5d-4bdc-b4e5-db2f3c3e45b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:02.530420 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3d907460-1e5d-4bdc-b4e5-db2f3c3e45b7 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1468 microversion: 2.1 time: 0.366080 Oct 29 02:53:02.546919 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1021/2052] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:02 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1468 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:02.558584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f2a1b537-5817-4f83-bf3c-56a7ca7b93fa req-21bbd1be-d1d9-4d9b-ba76-8a2bbf92dc27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e20ef4b-4f1c-42b4-9307-857848aab3a7", "name": "network-vif-plugged", "status": "completed", "tag": "2dc0d31b-4d3a-40f5-a243-c58dd7680fc3"}, {"server_uuid": "1e20ef4b-4f1c-42b4-9307-857848aab3a7", "name": "network-vif-plugged", "status": "completed", "tag": "f754e90f-ecef-4004-ba77-7f20a2f9176d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:02.570864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f2a1b537-5817-4f83-bf3c-56a7ca7b93fa req-21bbd1be-d1d9-4d9b-ba76-8a2bbf92dc27 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:02.571340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f2a1b537-5817-4f83-bf3c-56a7ca7b93fa req-21bbd1be-d1d9-4d9b-ba76-8a2bbf92dc27 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:02.571763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f2a1b537-5817-4f83-bf3c-56a7ca7b93fa req-21bbd1be-d1d9-4d9b-ba76-8a2bbf92dc27 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:02.584313 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f2a1b537-5817-4f83-bf3c-56a7ca7b93fa req-21bbd1be-d1d9-4d9b-ba76-8a2bbf92dc27 service nova] Creating event network-vif-plugged:2dc0d31b-4d3a-40f5-a243-c58dd7680fc3 for instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 on n-h1-862964-4 Oct 29 02:53:02.585079 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f2a1b537-5817-4f83-bf3c-56a7ca7b93fa req-21bbd1be-d1d9-4d9b-ba76-8a2bbf92dc27 service nova] Creating event network-vif-plugged:f754e90f-ecef-4004-ba77-7f20a2f9176d for instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 on n-h1-862964-4 Oct 29 02:53:02.591530 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f2a1b537-5817-4f83-bf3c-56a7ca7b93fa req-21bbd1be-d1d9-4d9b-ba76-8a2bbf92dc27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042984 Oct 29 02:53:02.592929 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1022/2053] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:02.598914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:02.599890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:02.606399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:02.607199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:02.607843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:02.609305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:02.610093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:02.610730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:02.736058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:02.756396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:02.760671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:02.769780 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d9271224-cf6e-4656-ad3c-b563e5161777 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.168939 Oct 29 02:53:02.770793 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1023/2054] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:02 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:02.805017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2138902482", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "bb6453f8-b0c6-41f5-8f8b-914e1db11a0e"}, {"port": "4beb4d66-65d9-4b60-af1e-c467c190d7ef", "tag": "port-1"}, {"port": "5de667bc-fe03-4e62-86b0-0d4687f62228", "tag": "port-2"}, {"uuid": "c7c3fdb6-7d69-4ca0-9306-b62bdfb2900d", "tag": "net-1"}, {"uuid": "c7c3fdb6-7d69-4ca0-9306-b62bdfb2900d"}, {"uuid": "fc5c16b8-065c-4fc6-8741-e5ff7b6f4f02", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "fc5c16b8-065c-4fc6-8741-e5ff7b6f4f02", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "af0c47a1-07d6-4503-a332-ee2a50ca92ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "57936a91-930b-498c-9bc6-3f87d90f69d6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d4717b03-62d8-476d-a174-238aa4b00f18", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--894012671"}], "key_name": "tempest-keypair-88122665", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:02.881775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-997bfb24-813a-4cf5-879d-294f1cba925b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:02.891968 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-997bfb24-813a-4cf5-879d-294f1cba925b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 1.164974 Oct 29 02:53:02.894870 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1032/2055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:01 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:02.905373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c213c4df-ad7d-4392-80e2-b6dc4df07dfc tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:02.907547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c213c4df-ad7d-4392-80e2-b6dc4df07dfc tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:02.923094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c213c4df-ad7d-4392-80e2-b6dc4df07dfc tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:02.923589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c213c4df-ad7d-4392-80e2-b6dc4df07dfc tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:02.924100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c213c4df-ad7d-4392-80e2-b6dc4df07dfc tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:02.924813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c213c4df-ad7d-4392-80e2-b6dc4df07dfc tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:02.925267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c213c4df-ad7d-4392-80e2-b6dc4df07dfc tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:02.935838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c213c4df-ad7d-4392-80e2-b6dc4df07dfc tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:03.117965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] validate_networks() for [('bb6453f8-b0c6-41f5-8f8b-914e1db11a0e', None, None, None, None, None), (None, None, '4beb4d66-65d9-4b60-af1e-c467c190d7ef', None, None, None), (None, None, '5de667bc-fe03-4e62-86b0-0d4687f62228', None, None, None), ('c7c3fdb6-7d69-4ca0-9306-b62bdfb2900d', None, None, None, None, None), ('c7c3fdb6-7d69-4ca0-9306-b62bdfb2900d', None, None, None, None, None), ('fc5c16b8-065c-4fc6-8741-e5ff7b6f4f02', '10.2.2.100', None, None, None, None), ('fc5c16b8-065c-4fc6-8741-e5ff7b6f4f02', '10.2.2.200', None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:03.378609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c213c4df-ad7d-4392-80e2-b6dc4df07dfc tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:03.396212 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c213c4df-ad7d-4392-80e2-b6dc4df07dfc tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1355 microversion: 2.1 time: 0.499902 Oct 29 02:53:03.396789 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1033/2056] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:02 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1355 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:03.558656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5d8e3f4a-3238-49d5-8c7f-7e2981595529 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:03.562473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5d8e3f4a-3238-49d5-8c7f-7e2981595529 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:03.581502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d8e3f4a-3238-49d5-8c7f-7e2981595529 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:03.582413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d8e3f4a-3238-49d5-8c7f-7e2981595529 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:03.583083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d8e3f4a-3238-49d5-8c7f-7e2981595529 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:03.584053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d8e3f4a-3238-49d5-8c7f-7e2981595529 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:03.584762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d8e3f4a-3238-49d5-8c7f-7e2981595529 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:03.585413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d8e3f4a-3238-49d5-8c7f-7e2981595529 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:03.721502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5d8e3f4a-3238-49d5-8c7f-7e2981595529 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:03.738734 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5d8e3f4a-3238-49d5-8c7f-7e2981595529 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 200 len: 1426 microversion: 2.1 time: 0.179531 Oct 29 02:53:03.745957 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1034/2057] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:03 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 1426 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:03.766658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-7a78c9fc-6f66-4459-a809-ffdecda47b6c req-5dee5b80-fed5-41c4-b711-8585e6b24a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39", "name": "network-vif-deleted", "tag": "2aee52dc-63e0-47de-821b-34b98b339294"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:03.815443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7a78c9fc-6f66-4459-a809-ffdecda47b6c req-5dee5b80-fed5-41c4-b711-8585e6b24a77 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:03.820878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7a78c9fc-6f66-4459-a809-ffdecda47b6c req-5dee5b80-fed5-41c4-b711-8585e6b24a77 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:03.823757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7a78c9fc-6f66-4459-a809-ffdecda47b6c req-5dee5b80-fed5-41c4-b711-8585e6b24a77 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:03.860822 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-7a78c9fc-6f66-4459-a809-ffdecda47b6c req-5dee5b80-fed5-41c4-b711-8585e6b24a77 service nova] Creating event network-vif-deleted:2aee52dc-63e0-47de-821b-34b98b339294 for instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 on n-h1-862964-4 Oct 29 02:53:03.875731 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-7a78c9fc-6f66-4459-a809-ffdecda47b6c req-5dee5b80-fed5-41c4-b711-8585e6b24a77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128042 Oct 29 02:53:03.882520 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1035/2058] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:03.889409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:03.890199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:03.912399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:03.912898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:03.913332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:03.918348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:03.921312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:03.921788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:04.149329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:04.169440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:04.174933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:04.179402 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fc761415-7f43-4950-b9cd-23cbc8e4562f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.295891 Oct 29 02:53:04.183691 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1036/2059] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:03 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:04.199517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4cce0d0a-eea5-4dd7-bffc-9ae0d93123e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:04.207349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4cce0d0a-eea5-4dd7-bffc-9ae0d93123e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:04.225426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cce0d0a-eea5-4dd7-bffc-9ae0d93123e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:04.227420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cce0d0a-eea5-4dd7-bffc-9ae0d93123e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:04.228261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cce0d0a-eea5-4dd7-bffc-9ae0d93123e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:04.238978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cce0d0a-eea5-4dd7-bffc-9ae0d93123e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:04.240919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cce0d0a-eea5-4dd7-bffc-9ae0d93123e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:04.244792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cce0d0a-eea5-4dd7-bffc-9ae0d93123e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:05.224933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4cce0d0a-eea5-4dd7-bffc-9ae0d93123e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:05.243946 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4cce0d0a-eea5-4dd7-bffc-9ae0d93123e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 1.058875 Oct 29 02:53:05.264600 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1037/2060] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:04 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:05.277480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8a5e166c-5040-49e5-b3a0-31bc2c459ecd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:05.279150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8a5e166c-5040-49e5-b3a0-31bc2c459ecd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:05.291624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a5e166c-5040-49e5-b3a0-31bc2c459ecd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:05.294495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a5e166c-5040-49e5-b3a0-31bc2c459ecd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:05.295849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a5e166c-5040-49e5-b3a0-31bc2c459ecd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:05.297832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a5e166c-5040-49e5-b3a0-31bc2c459ecd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:05.300666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a5e166c-5040-49e5-b3a0-31bc2c459ecd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:05.301969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a5e166c-5040-49e5-b3a0-31bc2c459ecd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:05.667170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8a5e166c-5040-49e5-b3a0-31bc2c459ecd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:05.680815 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8a5e166c-5040-49e5-b3a0-31bc2c459ecd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1805 microversion: 2.1 time: 0.412444 Oct 29 02:53:05.682897 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1038/2061] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:05 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1805 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:05.702541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:05.703413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:05.711715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:05.712419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:05.713126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:05.714086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:05.714544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:05.714972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:05.719690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:05.730816 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] HTTP exception thrown: Instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 could not be found. Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Request method failure captured: Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 HTTP/1.1 Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJP9p9evjhd81UDpuydHkWkt6DnMM6qoX2XA0Xx90NHReODhL8aoxga_PZyQEUxHN9tm4fU33DuaH1H_qB59ySVW_d3YlGBVmFANIPtJpjlWGublYdwhpxc9EVtkPI1jgW02Y4YumMHpsychJNkGjYnIWf6J5a2ss2MIUkQOJfcAG9o Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: bb5aec15c4e844b2872c9eab52f69482 Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-MigrationsAdminTest-1838705440 Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:53:05.732851 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bb5aec15c4e844b2872c9eab52f69482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb5aec15c4e844b2872c9eab52f69482"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bb5aec15c4e844b2872c9eab52f69482", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb5aec15c4e844b2872c9eab52f69482"}]}] Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-MigrationsAdminTest-1838705440 Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: bb5aec15c4e844b2872c9eab52f69482 Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-MigrationsAdminTest-1838705440 Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-MigrationsAdminTest-1838705440-project Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: efecedc77d3048c4a0ec0fe6701f9ccc Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-MigrationsAdminTest-1838705440-project Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 could not be found. Oct 29 02:53:05.734622 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39'} Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 could not be found. Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:05.735648 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 could not be found. Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 could not be found. Oct 29 02:53:05.737461 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:05.740595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Returning 404 to user: Instance aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:05.741723 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b6b7b5a-6add-44fe-91a7-e060ca09c903 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39" status: 404 len: 111 microversion: 2.1 time: 0.057078 Oct 29 02:53:05.742568 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1039/2062] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:05 2022] GET /compute/v2.1/servers/aad89c7f-fc9e-40a5-9a6b-7efb9aebdf39 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:53:05.751114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:05.751964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:05.758528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:05.759261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:05.760032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:05.760913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:05.761529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:05.762141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:05.854992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:05.877793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:05.883510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:05.888101 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6219aca2-ac3c-4c0d-8362-1be482fe3961 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.144352 Oct 29 02:53:05.893451 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1040/2063] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:05 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:05.911034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bd5f6d14-d01a-4488-83b0-89d623802fab tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:05.911881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bd5f6d14-d01a-4488-83b0-89d623802fab tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:05.927614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd5f6d14-d01a-4488-83b0-89d623802fab tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:05.930137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd5f6d14-d01a-4488-83b0-89d623802fab tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:05.931734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd5f6d14-d01a-4488-83b0-89d623802fab tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:05.934524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd5f6d14-d01a-4488-83b0-89d623802fab tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:05.935564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd5f6d14-d01a-4488-83b0-89d623802fab tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:05.937129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd5f6d14-d01a-4488-83b0-89d623802fab tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.008216 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bd5f6d14-d01a-4488-83b0-89d623802fab tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7/ips" status: 200 len: 218 microversion: 2.1 time: 0.111477 Oct 29 02:53:06.011243 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1041/2064] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 02:53:05 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7/ips => generated 218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:06.022177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3651451e-05d5-49bc-b0e0-d2ad1ea73387 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:06.022686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3651451e-05d5-49bc-b0e0-d2ad1ea73387 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:06.038843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3651451e-05d5-49bc-b0e0-d2ad1ea73387 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.038843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3651451e-05d5-49bc-b0e0-d2ad1ea73387 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.038843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3651451e-05d5-49bc-b0e0-d2ad1ea73387 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.039831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3651451e-05d5-49bc-b0e0-d2ad1ea73387 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.040997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3651451e-05d5-49bc-b0e0-d2ad1ea73387 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.042290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3651451e-05d5-49bc-b0e0-d2ad1ea73387 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.105938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3651451e-05d5-49bc-b0e0-d2ad1ea73387 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:53:06.247296 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3651451e-05d5-49bc-b0e0-d2ad1ea73387 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 204 len: 0 microversion: 2.1 time: 0.234380 Oct 29 02:53:06.251217 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1042/2065] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:53:06 2022] DELETE /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:06.259907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d16c36ff-8b5c-43b7-8d53-37f8eccb8e92 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:06.261016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d16c36ff-8b5c-43b7-8d53-37f8eccb8e92 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:06.271274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16c36ff-8b5c-43b7-8d53-37f8eccb8e92 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.271999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16c36ff-8b5c-43b7-8d53-37f8eccb8e92 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.272534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16c36ff-8b5c-43b7-8d53-37f8eccb8e92 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.274006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16c36ff-8b5c-43b7-8d53-37f8eccb8e92 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.274585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16c36ff-8b5c-43b7-8d53-37f8eccb8e92 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.275104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16c36ff-8b5c-43b7-8d53-37f8eccb8e92 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.312647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d16c36ff-8b5c-43b7-8d53-37f8eccb8e92 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:53:06.435859 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d16c36ff-8b5c-43b7-8d53-37f8eccb8e92 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 204 len: 0 microversion: 2.1 time: 0.182508 Oct 29 02:53:06.437069 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1043/2066] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:53:06 2022] DELETE /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:06.462275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f572101d-4d0f-4d92-8c0b-1981a4932eae tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:06.462662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f572101d-4d0f-4d92-8c0b-1981a4932eae tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:06.484237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f572101d-4d0f-4d92-8c0b-1981a4932eae tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.485578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f572101d-4d0f-4d92-8c0b-1981a4932eae tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.486568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f572101d-4d0f-4d92-8c0b-1981a4932eae tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.489345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f572101d-4d0f-4d92-8c0b-1981a4932eae tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.489913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f572101d-4d0f-4d92-8c0b-1981a4932eae tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.490296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f572101d-4d0f-4d92-8c0b-1981a4932eae tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.825185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f572101d-4d0f-4d92-8c0b-1981a4932eae tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:06.836391 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f572101d-4d0f-4d92-8c0b-1981a4932eae tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1469 microversion: 2.1 time: 0.394531 Oct 29 02:53:06.838066 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1044/2067] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:06 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1469 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:06.844528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dd58a733-1862-4d3d-9f8f-e5c89a7ddc7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:06.845410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dd58a733-1862-4d3d-9f8f-e5c89a7ddc7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:06.852636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd58a733-1862-4d3d-9f8f-e5c89a7ddc7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.853793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd58a733-1862-4d3d-9f8f-e5c89a7ddc7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.854507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd58a733-1862-4d3d-9f8f-e5c89a7ddc7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.855470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd58a733-1862-4d3d-9f8f-e5c89a7ddc7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.856174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd58a733-1862-4d3d-9f8f-e5c89a7ddc7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.856821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd58a733-1862-4d3d-9f8f-e5c89a7ddc7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:07.113528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dd58a733-1862-4d3d-9f8f-e5c89a7ddc7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:07.124928 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dd58a733-1862-4d3d-9f8f-e5c89a7ddc7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.284699 Oct 29 02:53:07.136331 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1045/2068] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:06 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:07.149153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-874a8682-7acb-41df-a769-520291eb295d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:07.150055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-874a8682-7acb-41df-a769-520291eb295d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:07.160893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-874a8682-7acb-41df-a769-520291eb295d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:07.161602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-874a8682-7acb-41df-a769-520291eb295d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:07.162087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-874a8682-7acb-41df-a769-520291eb295d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:07.162855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-874a8682-7acb-41df-a769-520291eb295d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:07.163378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-874a8682-7acb-41df-a769-520291eb295d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:07.163813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-874a8682-7acb-41df-a769-520291eb295d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:07.421168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:07.422314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:07.422977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:07.423439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:07.423893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:07.435119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:07.435471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:07.436090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:07.437225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:07.437913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:07.438493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:07.453872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-874a8682-7acb-41df-a769-520291eb295d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:07.467137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Getting quotas for project c813a6b4d51c4c268e9871a292ac33b8. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:07.470733 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-874a8682-7acb-41df-a769-520291eb295d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1811 microversion: 2.1 time: 0.332557 Oct 29 02:53:07.471769 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1046/2069] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:07 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1811 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:07.480096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:07.484689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:07.491834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Getting quotas for user 3b95983a06784c0092841b61efd66ba4 and project c813a6b4d51c4c268e9871a292ac33b8. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:07.504137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:07.504939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:07.505577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:07.507058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:07.507777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:07.509508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:07.668767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:07.684548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:07.686174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:07.690938 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-85f65e1c-5226-46e5-ac09-abc1c520a202 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.217360 Oct 29 02:53:07.693145 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1047/2070] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:07 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:07.744158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:53:07.753538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='af0c47a1-07d6-4503-a332-ee2a50ca92ea',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='57936a91-930b-498c-9bc6-3f87d90f69d6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4717b03-62d8-476d-a174-238aa4b00f18',volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:53:07.864785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-956f54c5-6369-48ac-83c3-150d64e95339 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:07.865782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-956f54c5-6369-48ac-83c3-150d64e95339 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:07.879813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-956f54c5-6369-48ac-83c3-150d64e95339 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:07.880280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-956f54c5-6369-48ac-83c3-150d64e95339 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:07.882231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-956f54c5-6369-48ac-83c3-150d64e95339 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:07.882984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-956f54c5-6369-48ac-83c3-150d64e95339 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:07.883437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-956f54c5-6369-48ac-83c3-150d64e95339 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:07.883862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-956f54c5-6369-48ac-83c3-150d64e95339 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.217574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-956f54c5-6369-48ac-83c3-150d64e95339 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:08.229049 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cac66863-d720-475f-88b0-bcde69eeeae6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 5.430410 Oct 29 02:53:08.232457 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1024/2071] 10.222.0.16 () {62 vars in 1189 bytes} [Sat Oct 29 02:53:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 5435 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:53:08.240306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-605e591e-888e-43ef-8691-55373b450e7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:08.241132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-605e591e-888e-43ef-8691-55373b450e7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:08.242401 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-956f54c5-6369-48ac-83c3-150d64e95339 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1469 microversion: 2.1 time: 0.367212 Oct 29 02:53:08.254037 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1048/2072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:07 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1469 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:53:08.254260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605e591e-888e-43ef-8691-55373b450e7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.254816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605e591e-888e-43ef-8691-55373b450e7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.255545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605e591e-888e-43ef-8691-55373b450e7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.256466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605e591e-888e-43ef-8691-55373b450e7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.257141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605e591e-888e-43ef-8691-55373b450e7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.257959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-605e591e-888e-43ef-8691-55373b450e7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.263216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8093f7e3-433f-4549-a31f-49d2e575f1b0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:08.263839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8093f7e3-433f-4549-a31f-49d2e575f1b0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:08.265073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:08.377097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8093f7e3-433f-4549-a31f-49d2e575f1b0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:08.388621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8093f7e3-433f-4549-a31f-49d2e575f1b0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:08.391806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8093f7e3-433f-4549-a31f-49d2e575f1b0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:08.393461 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8093f7e3-433f-4549-a31f-49d2e575f1b0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1284 microversion: 2.32 time: 0.137813 Oct 29 02:53:08.394662 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1049/2073] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:08 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:08.496882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-284ee911-6928-4995-bbed-ee4091db8cf8 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:08.497589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-284ee911-6928-4995-bbed-ee4091db8cf8 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:08.517569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ee911-6928-4995-bbed-ee4091db8cf8 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.518278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ee911-6928-4995-bbed-ee4091db8cf8 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.518722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ee911-6928-4995-bbed-ee4091db8cf8 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.519932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ee911-6928-4995-bbed-ee4091db8cf8 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.520429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ee911-6928-4995-bbed-ee4091db8cf8 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.520858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ee911-6928-4995-bbed-ee4091db8cf8 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.653328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-605e591e-888e-43ef-8691-55373b450e7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:08.671412 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-605e591e-888e-43ef-8691-55373b450e7d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.437527 Oct 29 02:53:08.672275 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1025/2074] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:08 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:08.728123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:08.729101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:08.736773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.737992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.738696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.740355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.741058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.741664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.873907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-284ee911-6928-4995-bbed-ee4091db8cf8 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:08.890605 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-284ee911-6928-4995-bbed-ee4091db8cf8 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1811 microversion: 2.1 time: 0.397920 Oct 29 02:53:08.891795 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1050/2075] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:08 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1811 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:53:08.899994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:08.915858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:08.919056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:08.923802 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-775460f5-058c-4da8-9a1c-581595c74a9f tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.208286 Oct 29 02:53:08.926672 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1026/2076] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:08 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:09.047832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-71bcdfc6-c45d-4163-84ba-313cd77b094d req-4c2dc265-3d6c-4ea1-a960-79ebc2a08027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fec365b-4f49-47e5-85b9-281a3f583dd4", "name": "network-vif-deleted", "tag": "babba213-6f2e-4317-8a56-6f03e53d177d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:09.067270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-71bcdfc6-c45d-4163-84ba-313cd77b094d req-4c2dc265-3d6c-4ea1-a960-79ebc2a08027 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.067753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-71bcdfc6-c45d-4163-84ba-313cd77b094d req-4c2dc265-3d6c-4ea1-a960-79ebc2a08027 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.068180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-71bcdfc6-c45d-4163-84ba-313cd77b094d req-4c2dc265-3d6c-4ea1-a960-79ebc2a08027 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.091994 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-71bcdfc6-c45d-4163-84ba-313cd77b094d req-4c2dc265-3d6c-4ea1-a960-79ebc2a08027 service nova] Creating event network-vif-deleted:babba213-6f2e-4317-8a56-6f03e53d177d for instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 on n-h1-862964-4 Oct 29 02:53:09.107525 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-71bcdfc6-c45d-4163-84ba-313cd77b094d req-4c2dc265-3d6c-4ea1-a960-79ebc2a08027 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063238 Oct 29 02:53:09.108146 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1051/2077] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:09.269515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:09.270097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:09.306066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.310050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.311187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.315354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.321255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.324013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.410880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.411824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.412328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.413611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lazy-loading 'fault' on Instance uuid 5fec365b-4f49-47e5-85b9-281a3f583dd4 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:53:09.428197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e67117e1-63e2-492e-becd-a13ceb39fa3f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:09.429388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e67117e1-63e2-492e-becd-a13ceb39fa3f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:09.501045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efecedc77d3048c4a0ec0fe6701f9ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5aec15c4e844b2872c9eab52f69482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:09.514776 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e45bb30b-bfbb-45f6-942d-834050524049 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 200 len: 1303 microversion: 2.1 time: 0.250226 Oct 29 02:53:09.517042 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1027/2078] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:09 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 1303 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:09.539540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-0478d4f9-cb59-471f-9c59-4be1da3c9021 req-11dd68cc-5c8d-4237-9d04-2ef3637fa91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e20ef4b-4f1c-42b4-9307-857848aab3a7", "name": "network-vif-deleted", "tag": "f754e90f-ecef-4004-ba77-7f20a2f9176d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:09.558958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0478d4f9-cb59-471f-9c59-4be1da3c9021 req-11dd68cc-5c8d-4237-9d04-2ef3637fa91b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.561249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e67117e1-63e2-492e-becd-a13ceb39fa3f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:09.563777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0478d4f9-cb59-471f-9c59-4be1da3c9021 req-11dd68cc-5c8d-4237-9d04-2ef3637fa91b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.565505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0478d4f9-cb59-471f-9c59-4be1da3c9021 req-11dd68cc-5c8d-4237-9d04-2ef3637fa91b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.574338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e67117e1-63e2-492e-becd-a13ceb39fa3f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:09.577364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e67117e1-63e2-492e-becd-a13ceb39fa3f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:09.588427 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e67117e1-63e2-492e-becd-a13ceb39fa3f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1284 microversion: 2.32 time: 0.168583 Oct 29 02:53:09.589026 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1052/2079] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:09 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:53:09.593572 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-0478d4f9-cb59-471f-9c59-4be1da3c9021 req-11dd68cc-5c8d-4237-9d04-2ef3637fa91b service nova] Creating event network-vif-deleted:f754e90f-ecef-4004-ba77-7f20a2f9176d for instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 on n-h1-862964-4 Oct 29 02:53:09.609769 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-0478d4f9-cb59-471f-9c59-4be1da3c9021 req-11dd68cc-5c8d-4237-9d04-2ef3637fa91b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073749 Oct 29 02:53:09.610420 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1028/2080] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:53:09.694536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8068fba8-b09a-4ea9-956c-ffc006c3c66a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:09.695388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8068fba8-b09a-4ea9-956c-ffc006c3c66a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:09.703822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8068fba8-b09a-4ea9-956c-ffc006c3c66a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.704320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8068fba8-b09a-4ea9-956c-ffc006c3c66a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.704751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8068fba8-b09a-4ea9-956c-ffc006c3c66a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.705657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8068fba8-b09a-4ea9-956c-ffc006c3c66a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.711414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8068fba8-b09a-4ea9-956c-ffc006c3c66a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.711909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8068fba8-b09a-4ea9-956c-ffc006c3c66a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.923980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7a97f1f5-0cd9-43c2-8728-cfb96b702f8a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:09.924975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7a97f1f5-0cd9-43c2-8728-cfb96b702f8a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:09.948469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a97f1f5-0cd9-43c2-8728-cfb96b702f8a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.948984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a97f1f5-0cd9-43c2-8728-cfb96b702f8a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.955775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a97f1f5-0cd9-43c2-8728-cfb96b702f8a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.956891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a97f1f5-0cd9-43c2-8728-cfb96b702f8a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.959059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a97f1f5-0cd9-43c2-8728-cfb96b702f8a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.961299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a97f1f5-0cd9-43c2-8728-cfb96b702f8a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.967983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8068fba8-b09a-4ea9-956c-ffc006c3c66a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:09.978648 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8068fba8-b09a-4ea9-956c-ffc006c3c66a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.287591 Oct 29 02:53:09.981335 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1053/2081] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:09 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:10.001274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:10.001274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:10.014273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:10.014853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:10.015299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:10.015997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:10.016445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:10.016872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:10.151834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:10.160277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:10.161712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:10.162934 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ef6a2f8-a9a8-4faa-a8b2-3b6c02e1633e tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.178709 Oct 29 02:53:10.163501 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1054/2082] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:09 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:10.199331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-419332325", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "77bc85c7-1f7e-4553-b485-501ac324775e"}], "block_device_mapping_v2": [{"uuid": "dbc8aa88-8136-416b-a950-d910e7ae9669", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:10.219577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7a97f1f5-0cd9-43c2-8728-cfb96b702f8a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:10.230528 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7a97f1f5-0cd9-43c2-8728-cfb96b702f8a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1675 microversion: 2.1 time: 0.313707 Oct 29 02:53:10.232336 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1029/2083] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:09 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1675 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:53:10.328027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] validate_networks() for [('77bc85c7-1f7e-4553-b485-501ac324775e', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:10.739764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa6057c4-52db-4d34-8a57-9bf958a82654 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Action: 'create', calling method: .version_select at 0x7fe1a85948b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJuSEC20gBvbjZCPQ9qnhuDVdMjzB6yf6U9lHbj3X9vSQEOIFtTTC50Y9yGWtXjJdD6VzAT1djJUYotLMKA8qzEShIrImPjnRE04EIns527446Iiqf2qGLD1vvm1F/jdQ=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa6057c4-52db-4d34-8a57-9bf958a82654 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Request method failure captured: Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 257 Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJWWPyEYAdh7kAk3tq3IillAuX-hKhW7Yc9S2x-fvKxZoPRvlxYZ-KVy0hpjHEERajRcr5c40jWPnyT0iGvzIiaE1nYSJ6bIYcEAEvC9aHkLbw9bs3V2HTKrJi4e3oETGdnKzh78tOdxQS9I9N9k0Yi5mndZls1rOR-y_xYB5pauIYQ Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:53:10.745105 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:53:10.747367 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_437ad319907448b18f600f6ac741e5f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}] Oct 29 02:53:10.747367 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:10.747367 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:10.747367 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:10.747367 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:10.747367 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:53:10.747367 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:53:10.747367 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:10.747367 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:10.747367 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:53:10.747367 n-d-862964-4 devstack@n-api.service[127042]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJuSEC20gBvbjZCPQ9qnhuDVdMjzB6yf6U9lHbj3X9vSQEOIFtTTC50Y9yGWtXjJdD6VzAT1djJUYotLMKA8qzEShIrImPjnRE04EIns527446Iiqf2qGLD1vvm1F/jdQ=="}} Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJuSEC20gBvbjZCPQ9qnhuDVdMjzB6yf6U9lHbj3X9vSQEOIFtTTC50Y9yGWtXjJdD6VzAT1djJUYotLMKA8qzEShIrImPjnRE04EIns527446Iiqf2qGLD1vvm1F/jdQ=='}}} Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:10.748339 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:10.750345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:53:10.752496 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:53:10.755262 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 02:53:10.755262 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.755262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa6057c4-52db-4d34-8a57-9bf958a82654 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:10.756856 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fa6057c4-52db-4d34-8a57-9bf958a82654 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.303968 Oct 29 02:53:10.758027 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1030/2084] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:53:10 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 306 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:53:10.764602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:10.765472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] [instance: 5fec365b-4f49-47e5-85b9-281a3f583dd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:10.773694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:10.774504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:10.775124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:10.776376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:10.777145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:10.777744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:10.800542 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] HTTP exception thrown: Instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 could not be found. Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Request method failure captured: Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 HTTP/1.1 Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJP9p9evjhd81UDpuydHkWkt6DnMM6qoX2XA0Xx90NHReODhL8aoxga_PZyQEUxHN9tm4fU33DuaH1H_qB59ySVW_d3YlGBVmFANIPtJpjlWGublYdwhpxc9EVtkPI1jgW02Y4YumMHpsychJNkGjYnIWf6J5a2ss2MIUkQOJfcAG9o Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: bb5aec15c4e844b2872c9eab52f69482 Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-MigrationsAdminTest-1838705440 Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:53:10.802634 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bb5aec15c4e844b2872c9eab52f69482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb5aec15c4e844b2872c9eab52f69482"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bb5aec15c4e844b2872c9eab52f69482", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bb5aec15c4e844b2872c9eab52f69482"}]}] Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-MigrationsAdminTest-1838705440 Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: bb5aec15c4e844b2872c9eab52f69482 Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-MigrationsAdminTest-1838705440 Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-MigrationsAdminTest-1838705440-project Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: efecedc77d3048c4a0ec0fe6701f9ccc Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-MigrationsAdminTest-1838705440-project Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 could not be found. Oct 29 02:53:10.804530 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '5fec365b-4f49-47e5-85b9-281a3f583dd4'} Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 could not be found. Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:10.805527 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 could not be found. Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 could not be found. Oct 29 02:53:10.807190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.810097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] Returning 404 to user: Instance 5fec365b-4f49-47e5-85b9-281a3f583dd4 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:10.812289 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-136403da-fa9f-4468-99ec-4bc10d267f13 tempest-MigrationsAdminTest-1838705440 tempest-MigrationsAdminTest-1838705440-project] 10.222.0.16 "GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4" status: 404 len: 111 microversion: 2.1 time: 0.051981 Oct 29 02:53:10.817450 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1031/2085] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:10 2022] GET /compute/v2.1/servers/5fec365b-4f49-47e5-85b9-281a3f583dd4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:53:10.841050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:10.842287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:10.851320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:10.852111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:10.852709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:10.853764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:10.854422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:10.855139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.007130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:11.022683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:11.027882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:11.032619 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dd688002-ca3d-43f7-8e7b-cca2ee9a2d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1574 microversion: 2.32 time: 0.205562 Oct 29 02:53:11.047428 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1032/2086] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:10 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1574 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:11.057170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:11.058259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:11.059090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:11.059673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:11.060296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b84f800-79b8-4391-bf2d-20057032d938 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Action: 'create', calling method: .version_select at 0x7fe1a848cf70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1858629602", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:11.060825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:11.072797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.074096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.074709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.075686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.076382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.076989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.081778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-2b84f800-79b8-4391-bf2d-20057032d938 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Getting quotas for project 437ad319907448b18f600f6ac741e5f9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:11.087439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-2b84f800-79b8-4391-bf2d-20057032d938 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Getting quotas for user 891d9b18b58c461c99251a545e64c4a4 and project 437ad319907448b18f600f6ac741e5f9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:11.103263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Getting quotas for project 60896479fb0c4357ad5fb03016470283. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:11.109680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Getting quotas for user f0ea28d9bb3544bca1a3c90d983fe8e4 and project 60896479fb0c4357ad5fb03016470283. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:11.115820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:11.127992 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-2b84f800-79b8-4391-bf2d-20057032d938 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b84f800-79b8-4391-bf2d-20057032d938 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Request method failure captured: Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 2167 Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJWWPyEYAdh7kAk3tq3IillAuX-hKhW7Yc9S2x-fvKxZoPRvlxYZ-KVy0hpjHEERajRcr5c40jWPnyT0iGvzIiaE1nYSJ6bIYcEAEvC9aHkLbw9bs3V2HTKrJi4e3oETGdnKzh78tOdxQS9I9N9k0Yi5mndZls1rOR-y_xYB5pauIYQ Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_437ad319907448b18f600f6ac741e5f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}] Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1858629602", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:53:11.148853 n-d-862964-4 devstack@n-api.service[127042]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1858629602', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:11.152991 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:11.159304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.163105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b84f800-79b8-4391-bf2d-20057032d938 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:11.163105 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b84f800-79b8-4391-bf2d-20057032d938 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.112445 Oct 29 02:53:11.164272 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1033/2087] 10.222.0.16 () {60 vars in 1160 bytes} [Sat Oct 29 02:53:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:11.175502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c0a967b-cd19-4ae5-9fd9-e1eed4b70aa3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:11.178085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c0a967b-cd19-4ae5-9fd9-e1eed4b70aa3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:11.193877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c0a967b-cd19-4ae5-9fd9-e1eed4b70aa3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.194975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c0a967b-cd19-4ae5-9fd9-e1eed4b70aa3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.195694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c0a967b-cd19-4ae5-9fd9-e1eed4b70aa3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.196811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c0a967b-cd19-4ae5-9fd9-e1eed4b70aa3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.197543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c0a967b-cd19-4ae5-9fd9-e1eed4b70aa3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.198293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c0a967b-cd19-4ae5-9fd9-e1eed4b70aa3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.240150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:53:11.242463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dbc8aa88-8136-416b-a950-d910e7ae9669',volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:53:11.469991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c0a967b-cd19-4ae5-9fd9-e1eed4b70aa3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:11.482473 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c0a967b-cd19-4ae5-9fd9-e1eed4b70aa3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.316674 Oct 29 02:53:11.483890 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1034/2088] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:11 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:11.489466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f9491587-4c99-4b01-a411-a1394f87498e tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Action: 'create', calling method: .version_select at 0x7fe1a84755e0>, body: {"keypair": {"name": "tempest-keypair-130178801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKKGUdMqRGZYJqdyR/8p2i2oUbJWKcn4/kdYxdjhkyJN1L9sKWypIOpygWiXv6+pTcDYhh2ncGefjOjlVN0o/tNCm1+C8i0oddRELjR/Jf8+48jlLwCEQxPHth2Y2j21w=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:11.509977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-f9491587-4c99-4b01-a411-a1394f87498e tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Getting quotas for project 437ad319907448b18f600f6ac741e5f9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:11.515957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:11.518002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-f9491587-4c99-4b01-a411-a1394f87498e tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Getting quotas for user 891d9b18b58c461c99251a545e64c4a4 and project 437ad319907448b18f600f6ac741e5f9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:11.558067 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f9491587-4c99-4b01-a411-a1394f87498e tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072752 Oct 29 02:53:11.589899 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1035/2089] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:53:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:11.600843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:11.602521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:11.625447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.629344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.629914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.633911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.636914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.639904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.659922 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5892ddd-6d06-415e-aadd-ab1a367d8554 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.464630 Oct 29 02:53:11.666698 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1055/2090] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:53:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:53:11.672471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:11.673311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:11.704478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.705613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.706290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.707205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.708576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.709249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.782686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.785964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.788984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.789482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lazy-loading 'fault' on Instance uuid 1e20ef4b-4f1c-42b4-9307-857848aab3a7 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:53:11.799477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:11.873663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:11.890940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:11.894658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:11.896151 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c3952e89-e423-470d-9f3e-fc8de75adb8c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.304037 Oct 29 02:53:11.914053 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1036/2091] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:11 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:11.928393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87380edd-fc66-4ce4-9dbd-92038e5b55e0 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Action: 'create', calling method: .version_select at 0x7fe1a8475e50>, body: {"keypair": {"name": "tempest-keypair-130178801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/VihmdYZlP00bM1VdKHseIiv2Q7aiE7fUmf+kiCY5+E3L4MkB9MiPD8NJCU2UEEh4NvWWazn+8tLAva88alJZm03qBDq7IVbKpcefu1JIyMvwe1EX2vNe9ZrF9QBYM2Q=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:11.931583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:11.940605 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-de9d6e78-f729-44db-b8fc-e30ed50c5e2d tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 200 len: 1303 microversion: 2.1 time: 0.272018 Oct 29 02:53:11.945517 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1056/2092] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:11 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 1303 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:11.961384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-55fea14e-efcb-4ef6-be6c-df968f7558e2 req-5154ae8a-88df-4ee1-905c-34a04e8fc7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e20ef4b-4f1c-42b4-9307-857848aab3a7", "name": "network-vif-deleted", "tag": "2dc0d31b-4d3a-40f5-a243-c58dd7680fc3"}, {"server_uuid": "1e20ef4b-4f1c-42b4-9307-857848aab3a7", "name": "network-vif-deleted", "tag": "f1b664e0-4f41-434d-99ac-439f18224c4f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:11.965557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-87380edd-fc66-4ce4-9dbd-92038e5b55e0 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Getting quotas for project 437ad319907448b18f600f6ac741e5f9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:11.971636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-87380edd-fc66-4ce4-9dbd-92038e5b55e0 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Getting quotas for user 891d9b18b58c461c99251a545e64c4a4 and project 437ad319907448b18f600f6ac741e5f9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:11.992062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55fea14e-efcb-4ef6-be6c-df968f7558e2 req-5154ae8a-88df-4ee1-905c-34a04e8fc7ee service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.992532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55fea14e-efcb-4ef6-be6c-df968f7558e2 req-5154ae8a-88df-4ee1-905c-34a04e8fc7ee service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.992963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55fea14e-efcb-4ef6-be6c-df968f7558e2 req-5154ae8a-88df-4ee1-905c-34a04e8fc7ee service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:12.002908 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-87380edd-fc66-4ce4-9dbd-92038e5b55e0 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] HTTP exception thrown: Key pair 'tempest-keypair-130178801' already exists. Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87380edd-fc66-4ce4-9dbd-92038e5b55e0 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Request method failure captured: Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 272 Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJWWPyEYAdh7kAk3tq3IillAuX-hKhW7Yc9S2x-fvKxZoPRvlxYZ-KVy0hpjHEERajRcr5c40jWPnyT0iGvzIiaE1nYSJ6bIYcEAEvC9aHkLbw9bs3V2HTKrJi4e3oETGdnKzh78tOdxQS9I9N9k0Yi5mndZls1rOR-y_xYB5pauIYQ Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_437ad319907448b18f600f6ac741e5f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}] Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: {"keypair": {"name": "tempest-keypair-130178801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/VihmdYZlP00bM1VdKHseIiv2Q7aiE7fUmf+kiCY5+E3L4MkB9MiPD8NJCU2UEEh4NvWWazn+8tLAva88alJZm03qBDq7IVbKpcefu1JIyMvwe1EX2vNe9ZrF9QBYM2Q=="}} Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: exception: Key pair 'tempest-keypair-130178801' already exists. Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-130178801', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/VihmdYZlP00bM1VdKHseIiv2Q7aiE7fUmf+kiCY5+E3L4MkB9MiPD8NJCU2UEEh4NvWWazn+8tLAva88alJZm03qBDq7IVbKpcefu1JIyMvwe1EX2vNe9ZrF9QBYM2Q=='}}} Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result.read() Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '891d9b18b58c461c99251a545e64c4a4-tempest-keypair-130178801' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 29 02:53:12.013407 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result.read() Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 02:53:12.019861 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '891d9b18b58c461c99251a545e64c4a4-tempest-keypair-130178801' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 2, 53, 11, 990338), 'updated_at': None, 'name': 'tempest-keypair-130178801', 'user_id': '891d9b18b58c461c99251a545e64c4a4', 'fingerprint': '76:83:9e:5b:7f:ff:74:cc:5a:23:70:b7:3f:8b:df:96', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/VihmdYZlP00bM1VdKHseIiv2Q7aiE7fUmf+kiCY5+E3L4MkB9MiPD8NJCU2UEEh4NvWWazn+8tLAva88alJZm03qBDq7IVbKpcefu1JIyMvwe1EX2vNe9ZrF9QBYM2Q==', 'type': 'ssh'}] Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi keypair.create() Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._create() Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-130178801' already exists. Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 29 02:53:12.031433 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-130178801' already exists. Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-130178801' already exists. Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87380edd-fc66-4ce4-9dbd-92038e5b55e0 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Returning 409 to user: Key pair 'tempest-keypair-130178801' already exists. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-87380edd-fc66-4ce4-9dbd-92038e5b55e0 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.096495 Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1037/2093] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:53:11 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a52a893f-90ba-4f41-87d8-c46862a5b4f2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:12.042376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a52a893f-90ba-4f41-87d8-c46862a5b4f2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:12.044791 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-55fea14e-efcb-4ef6-be6c-df968f7558e2 req-5154ae8a-88df-4ee1-905c-34a04e8fc7ee service nova] Creating event network-vif-deleted:2dc0d31b-4d3a-40f5-a243-c58dd7680fc3 for instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 on n-h1-862964-4 Oct 29 02:53:12.044791 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-55fea14e-efcb-4ef6-be6c-df968f7558e2 req-5154ae8a-88df-4ee1-905c-34a04e8fc7ee service nova] Creating event network-vif-deleted:f1b664e0-4f41-434d-99ac-439f18224c4f for instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 on n-h1-862964-4 Oct 29 02:53:12.047688 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-55fea14e-efcb-4ef6-be6c-df968f7558e2 req-5154ae8a-88df-4ee1-905c-34a04e8fc7ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099139 Oct 29 02:53:12.048317 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1057/2094] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:12.058502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8980ec96-952c-4312-ac2e-1c1c3ecc9cc2 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Calling method '.version_select at 0x7fe1a808a0d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:12.104706 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8980ec96-952c-4312-ac2e-1c1c3ecc9cc2 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-130178801" status: 202 len: 0 microversion: 2.1 time: 0.054664 Oct 29 02:53:12.105533 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1058/2095] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 02:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-130178801 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:53:12.119114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:12.121493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:12.136935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:12.137444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:12.138442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:12.139410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:12.140067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:12.140660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:12.248367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:12.261045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a52a893f-90ba-4f41-87d8-c46862a5b4f2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:12.261657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:12.263148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:12.270349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a52a893f-90ba-4f41-87d8-c46862a5b4f2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:12.272091 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-78766815-c0dc-4a3e-aaff-e2c4abbabebd tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1592 microversion: 2.32 time: 0.165203 Oct 29 02:53:12.274199 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1059/2096] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:12 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1592 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:12.275663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a52a893f-90ba-4f41-87d8-c46862a5b4f2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:12.279408 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a52a893f-90ba-4f41-87d8-c46862a5b4f2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1103 microversion: 2.25 time: 0.259882 Oct 29 02:53:12.288908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9adbcccd-9651-497c-b010-ebf2ede536e2 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Action: 'create', calling method: .version_select at 0x7fe1acb08ee0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeAKJ6g47rYCOojcrCUs5UUlQAVZM9z9N83InqpzJHO1xjqpwM7xwKBScOtUjt1puUI8Wt2IQy+Cq8VGB7pmW1x3kJsz9qi6mC/YEOgw749PZasN4Ytxi51K3xOPGJxVw=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:12.291446 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1038/2097] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:12 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1103 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9adbcccd-9651-497c-b010-ebf2ede536e2 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Request method failure captured: Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 247 Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJWWPyEYAdh7kAk3tq3IillAuX-hKhW7Yc9S2x-fvKxZoPRvlxYZ-KVy0hpjHEERajRcr5c40jWPnyT0iGvzIiaE1nYSJ6bIYcEAEvC9aHkLbw9bs3V2HTKrJi4e3oETGdnKzh78tOdxQS9I9N9k0Yi5mndZls1rOR-y_xYB5pauIYQ Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_437ad319907448b18f600f6ac741e5f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}] Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeAKJ6g47rYCOojcrCUs5UUlQAVZM9z9N83InqpzJHO1xjqpwM7xwKBScOtUjt1puUI8Wt2IQy+Cq8VGB7pmW1x3kJsz9qi6mC/YEOgw749PZasN4Ytxi51K3xOPGJxVw=="}} Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeAKJ6g47rYCOojcrCUs5UUlQAVZM9z9N83InqpzJHO1xjqpwM7xwKBScOtUjt1puUI8Wt2IQy+Cq8VGB7pmW1x3kJsz9qi6mC/YEOgw749PZasN4Ytxi51K3xOPGJxVw=='}}} Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi '' Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:53:12.298154 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:53:12.303790 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.316619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9adbcccd-9651-497c-b010-ebf2ede536e2 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:12.317982 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9adbcccd-9651-497c-b010-ebf2ede536e2 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.041202 Oct 29 02:53:12.319362 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1060/2098] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:53:12 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:53:12.329177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-520a473c-2877-4477-8534-4f43915c4c08 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Action: 'create', calling method: .version_select at 0x7fe1a8475670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-360557118", "public_key": " "}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:12.356092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-520a473c-2877-4477-8534-4f43915c4c08 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Getting quotas for project 437ad319907448b18f600f6ac741e5f9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:12.361046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-520a473c-2877-4477-8534-4f43915c4c08 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Getting quotas for user 891d9b18b58c461c99251a545e64c4a4 and project 437ad319907448b18f600f6ac741e5f9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:12.395387 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-520a473c-2877-4477-8534-4f43915c4c08 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-520a473c-2877-4477-8534-4f43915c4c08 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Request method failure captured: Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 94 Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJWWPyEYAdh7kAk3tq3IillAuX-hKhW7Yc9S2x-fvKxZoPRvlxYZ-KVy0hpjHEERajRcr5c40jWPnyT0iGvzIiaE1nYSJ6bIYcEAEvC9aHkLbw9bs3V2HTKrJi4e3oETGdnKzh78tOdxQS9I9N9k0Yi5mndZls1rOR-y_xYB5pauIYQ Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_437ad319907448b18f600f6ac741e5f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}] Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-360557118", "public_key": " "}} Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-360557118', 'public_key': ' '}}} Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.397396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-520a473c-2877-4477-8534-4f43915c4c08 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-520a473c-2877-4477-8534-4f43915c4c08 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.074392 Oct 29 02:53:12.403799 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1039/2099] 10.222.0.16 () {60 vars in 1158 bytes} [Sat Oct 29 02:53:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:12.411974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c13d591-0c4f-4ed7-ae50-90735c760840 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Action: 'create', calling method: .version_select at 0x7fe1a808a790>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1B7xRbUDe3DSVTL3VOk7MTvyhL8FFoeCbhkOxi5M5p3Kg27B6t/V88HhMxWFFDLz8QgSzxsTHPEqXmJSATL66UW0TqOLo4w++zSgI2MFRu44eu8qUF0JSzfYNaCYYE8Q=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c13d591-0c4f-4ed7-ae50-90735c760840 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Request method failure captured: Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 507 Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJWWPyEYAdh7kAk3tq3IillAuX-hKhW7Yc9S2x-fvKxZoPRvlxYZ-KVy0hpjHEERajRcr5c40jWPnyT0iGvzIiaE1nYSJ6bIYcEAEvC9aHkLbw9bs3V2HTKrJi4e3oETGdnKzh78tOdxQS9I9N9k0Yi5mndZls1rOR-y_xYB5pauIYQ Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_437ad319907448b18f600f6ac741e5f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}] Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1B7xRbUDe3DSVTL3VOk7MTvyhL8FFoeCbhkOxi5M5p3Kg27B6t/V88HhMxWFFDLz8QgSzxsTHPEqXmJSATL66UW0TqOLo4w++zSgI2MFRu44eu8qUF0JSzfYNaCYYE8Q=="}} Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1B7xRbUDe3DSVTL3VOk7MTvyhL8FFoeCbhkOxi5M5p3Kg27B6t/V88HhMxWFFDLz8QgSzxsTHPEqXmJSATL66UW0TqOLo4w++zSgI2MFRu44eu8qUF0JSzfYNaCYYE8Q=='}}} Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 29 02:53:12.417963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c13d591-0c4f-4ed7-ae50-90735c760840 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:12.421485 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6c13d591-0c4f-4ed7-ae50-90735c760840 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.013606 Oct 29 02:53:12.432160 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1061/2100] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:53:12 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:53:12.432332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0147a25-22e7-41bc-b0f7-db32a34ae36e tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Action: 'create', calling method: .version_select at 0x7fe1a86f4f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-447611492", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:12.489373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-b0147a25-22e7-41bc-b0f7-db32a34ae36e tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Getting quotas for project 437ad319907448b18f600f6ac741e5f9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:12.510726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25322f6a-8952-4741-9973-8bbe885f4c7c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:12.511347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25322f6a-8952-4741-9973-8bbe885f4c7c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:12.521794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-b0147a25-22e7-41bc-b0f7-db32a34ae36e tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Getting quotas for user 891d9b18b58c461c99251a545e64c4a4 and project 437ad319907448b18f600f6ac741e5f9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:12.534787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25322f6a-8952-4741-9973-8bbe885f4c7c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:12.535298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25322f6a-8952-4741-9973-8bbe885f4c7c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:12.535786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25322f6a-8952-4741-9973-8bbe885f4c7c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:12.536753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25322f6a-8952-4741-9973-8bbe885f4c7c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:12.537220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25322f6a-8952-4741-9973-8bbe885f4c7c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:12.537655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25322f6a-8952-4741-9973-8bbe885f4c7c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:12.593038 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-b0147a25-22e7-41bc-b0f7-db32a34ae36e tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0147a25-22e7-41bc-b0f7-db32a34ae36e tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Request method failure captured: Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 117 Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJWWPyEYAdh7kAk3tq3IillAuX-hKhW7Yc9S2x-fvKxZoPRvlxYZ-KVy0hpjHEERajRcr5c40jWPnyT0iGvzIiaE1nYSJ6bIYcEAEvC9aHkLbw9bs3V2HTKrJi4e3oETGdnKzh78tOdxQS9I9N9k0Yi5mndZls1rOR-y_xYB5pauIYQ Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_437ad319907448b18f600f6ac741e5f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}] Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-447611492", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-447611492', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 02:53:12.597450 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 02:53:12.602199 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.605526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0147a25-22e7-41bc-b0f7-db32a34ae36e tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:12.610212 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b0147a25-22e7-41bc-b0f7-db32a34ae36e tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.183097 Oct 29 02:53:12.617115 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1040/2101] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:53:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 29 02:53:12.628707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83a3b9d2-d682-4a0d-a0ce-a479b536df12 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Calling method '.version_select at 0x7fe1a83daee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:12.672747 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-83a3b9d2-d682-4a0d-a0ce-a479b536df12 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1205552327 not found for user 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83a3b9d2-d682-4a0d-a0ce-a479b536df12 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Request method failure captured: Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1205552327 HTTP/1.1 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJWWPyEYAdh7kAk3tq3IillAuX-hKhW7Yc9S2x-fvKxZoPRvlxYZ-KVy0hpjHEERajRcr5c40jWPnyT0iGvzIiaE1nYSJ6bIYcEAEvC9aHkLbw9bs3V2HTKrJi4e3oETGdnKzh78tOdxQS9I9N9k0Yi5mndZls1rOR-y_xYB5pauIYQ Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_437ad319907448b18f600f6ac741e5f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/437ad319907448b18f600f6ac741e5f9"}]}] Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 437ad319907448b18f600f6ac741e5f9 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-233802629 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-KeyPairsNegativeTestJSON-233802629-project Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: exception: Keypair tempest-keypair-non-existent-1205552327 not found for user 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'tempest-keypair-non-existent-1205552327'} Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1205552327 not found for user 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.677002 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1205552327 not found for user 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1205552327 not found for user 891d9b18b58c461c99251a545e64c4a4 Oct 29 02:53:12.681665 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.688699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83a3b9d2-d682-4a0d-a0ce-a479b536df12 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1205552327 not found for user 891d9b18b58c461c99251a545e64c4a4 {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:12.694206 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-83a3b9d2-d682-4a0d-a0ce-a479b536df12 tempest-KeyPairsNegativeTestJSON-233802629 tempest-KeyPairsNegativeTestJSON-233802629-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1205552327" status: 404 len: 145 microversion: 2.1 time: 0.069659 Oct 29 02:53:12.698111 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1041/2102] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 02:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1205552327 => generated 145 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:53:12.883001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25322f6a-8952-4741-9973-8bbe885f4c7c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:12.896440 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25322f6a-8952-4741-9973-8bbe885f4c7c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.390214 Oct 29 02:53:12.914982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1062/2103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:12 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:53:12.932996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:12.933762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:12.941245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:12.941999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:12.942432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:12.943221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:12.943749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:12.944172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:12.977275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:12.979385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:12.996910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:12.999385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.001720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:13.002956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:13.003995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.004708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:13.027760 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] HTTP exception thrown: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Request method failure captured: Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 HTTP/1.1 Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJVktjAxCUizcWaz4uJsdtOQdSqVlmt3kUsMsJe1ti4S7RVNTBtBtiKNm2mrQ2zRygqSVJCcLcUT-nnXaj3YI8DY3Oeeno6pUQij1gAtIPBD5u150TlvGLQcjMJGQZHHEPkiZ07CbO9PM1X7MhjLdVSdiBDhl2-3QVKSChB86imXU_E Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86df8edf5044361a65c11542c2dc585", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}] Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestMultiNic-191906656 Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestMultiNic-191906656-project Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 5d2e129a84e847a0b5c80ad47ca4d233 Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestMultiNic-191906656-project Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1e20ef4b-4f1c-42b4-9307-857848aab3a7'} Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:13.029833 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.034785 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:13.034785 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:13.034785 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:13.034785 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:13.034785 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:13.034785 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:53:13.034785 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.038799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Returning 404 to user: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:13.040286 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b19475cc-2515-4688-bc56-9f9cd3d04ba1 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 404 len: 111 microversion: 2.1 time: 0.073170 Oct 29 02:53:13.041545 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1063/2104] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:12 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:53:13.080220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:13.097571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:13.103238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:13.109968 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dd71a4fd-cab5-4987-87c1-a3f62c2f92f9 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.178002 Oct 29 02:53:13.112571 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1042/2105] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:12 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:53:13.302716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:13.304223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:13.307966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:13.308956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:13.323318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:13.323494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:13.323978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.330134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.331671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:13.332647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:13.335200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:13.335810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.335955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:13.336546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:13.337724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.343924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:13.482026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:13.496245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:13.500664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:13.505987 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-69f529db-9ae0-420d-9ef9-a1e117fb84fb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1232 microversion: 2.25 time: 0.200616 Oct 29 02:53:13.506737 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1043/2106] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:13 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1232 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:53:13.591363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:13.615485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:13.617322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:13.618821 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f26b96d5-0c40-4e0e-b1bf-c4f6c8c8f55d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1659 microversion: 2.32 time: 0.322060 Oct 29 02:53:13.619858 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1064/2107] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:13 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1659 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:13.922507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a9fd65c2-ab3a-482f-8c91-5143918ab5e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:13.922841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a9fd65c2-ab3a-482f-8c91-5143918ab5e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:13.942615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9fd65c2-ab3a-482f-8c91-5143918ab5e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:13.954383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9fd65c2-ab3a-482f-8c91-5143918ab5e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.954969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9fd65c2-ab3a-482f-8c91-5143918ab5e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:13.956109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9fd65c2-ab3a-482f-8c91-5143918ab5e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:13.956572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9fd65c2-ab3a-482f-8c91-5143918ab5e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.957000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9fd65c2-ab3a-482f-8c91-5143918ab5e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:14.146918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:14.147499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:14.163468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:14.164026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:14.164470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:14.167721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:14.170159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:14.170597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:14.347055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:14.359113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:14.361630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:14.365985 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7408bd28-13c2-46d0-bd58-637bd456296c tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.224962 Oct 29 02:53:14.390884 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1065/2108] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:14 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:14.531570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:14.532183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:14.561355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:14.570645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:14.571251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:14.572455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:14.572935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:14.573368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:14.927674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a9fd65c2-ab3a-482f-8c91-5143918ab5e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:14.929293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:14.941105 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a9fd65c2-ab3a-482f-8c91-5143918ab5e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 1.022508 Oct 29 02:53:14.946452 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1044/2109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:13 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:14.952631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:14.957207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:14.958966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:14.959583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:14.962771 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7f730f9a-18fd-4136-8f47-77c0f6ded510 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1250 microversion: 2.25 time: 0.433586 Oct 29 02:53:14.980952 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1066/2110] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:14 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1250 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:53:14.983260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:14.983890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:14.984331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:14.985049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:14.985497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:14.985997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:15.408091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:15.410999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:15.432476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:15.435508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:15.436037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:15.436792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:15.437246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:15.437661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:15.533504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:15.557705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:15.559625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:15.563330 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f758030b-88ed-4f78-a0c1-83c6d26e5c61 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1659 microversion: 2.32 time: 0.613252 Oct 29 02:53:15.586483 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1045/2111] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:14 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1659 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:15.690335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:15.706957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:15.708688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:15.713076 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-354e3973-f261-4b07-a408-8affa00ae1c2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.316161 Oct 29 02:53:15.714891 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1067/2112] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:15 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:15.973636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c860ceaf-fd9f-4ac3-be3f-f2f50bae6b4f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:15.974264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c860ceaf-fd9f-4ac3-be3f-f2f50bae6b4f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:16.000106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:16.000961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:16.008522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c860ceaf-fd9f-4ac3-be3f-f2f50bae6b4f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:16.015754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c860ceaf-fd9f-4ac3-be3f-f2f50bae6b4f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:16.018083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c860ceaf-fd9f-4ac3-be3f-f2f50bae6b4f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:16.020437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c860ceaf-fd9f-4ac3-be3f-f2f50bae6b4f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:16.023786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c860ceaf-fd9f-4ac3-be3f-f2f50bae6b4f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:16.024219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c860ceaf-fd9f-4ac3-be3f-f2f50bae6b4f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:16.026151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:16.026916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:16.029708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:16.031498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:16.035872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:16.037406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:16.834282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c860ceaf-fd9f-4ac3-be3f-f2f50bae6b4f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:16.875167 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c860ceaf-fd9f-4ac3-be3f-f2f50bae6b4f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.906090 Oct 29 02:53:16.898750 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1046/2113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:15 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:16.908913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:16.910383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:16.977606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:16.978906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:16.984063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:16.989888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:16.991710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:17.008464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:17.025353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:17.047163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:17.059994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:17.061447 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-56ffc4aa-0083-43e5-a6f1-9b62003b9bdd tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1292 microversion: 2.25 time: 1.066981 Oct 29 02:53:17.064375 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1068/2114] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:15 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1292 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:53:17.452970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:17.834156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-430a0028-a5c1-4589-9c00-eb5cae584d52 tempest-QuotaClassesAdmin257Test-1072354303 tempest-QuotaClassesAdmin257Test-1072354303-project-admin] Calling method '.version_select at 0x7fe1acc01c10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:17.854939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:17.866125 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-430a0028-a5c1-4589-9c00-eb5cae584d52 tempest-QuotaClassesAdmin257Test-1072354303 tempest-QuotaClassesAdmin257Test-1072354303-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.795839 Oct 29 02:53:17.867467 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1069/2115] 10.222.0.16 () {60 vars in 1226 bytes} [Sat Oct 29 02:53:17 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:53:17.872496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:17.876575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:17.877558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:17.879013 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-041a431d-8138-4b77-8f7e-1d51506ffe92 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1705 microversion: 2.32 time: 0.978727 Oct 29 02:53:17.882001 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1047/2116] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:16 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1705 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:17.898645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:17.911590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:17.912092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:17.912536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:17.913264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:17.913721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:17.914226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:18.016362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0effbfb7-0bdd-44fe-945e-a888951da535 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Action: 'create', calling method: .version_select at 0x7fe1a848c670>, body: {"keypair": {"name": "tempest-keypair-564315640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZerpIBdMI8vp197NuM2fJWo9UW2CiqRTAQc1qvFTir2lzyEc/c4kujIBjKuBuCLRiYBVHydnAs8kEQjxE4+gHOVZ5I4lir0ATAT775SAXQYmhrGb91wUiip5ZoOQ5bGA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:18.055025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0effbfb7-0bdd-44fe-945e-a888951da535 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:18.066381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0effbfb7-0bdd-44fe-945e-a888951da535 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for user eb69e4365fa5420aa8ca5b539924a1c5 and project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:18.133180 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0effbfb7-0bdd-44fe-945e-a888951da535 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.249823 Oct 29 02:53:18.134141 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1048/2117] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Oct 29 02:53:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 251 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:53:18.140788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-658a7965-4c5a-4aaa-b3fe-4298d1ae4e9b tempest-QuotaClassesAdmin257Test-1072354303 tempest-QuotaClassesAdmin257Test-1072354303-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a84138b0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:18.185103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:18.203638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:18.211127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:18.212762 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-129722fc-54e7-4469-b7d1-871752a8209a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.343793 Oct 29 02:53:18.215547 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1070/2118] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:17 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:18.237971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3b11ab3-c73b-4717-9943-234d5fcc4cd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:18.239522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a3b11ab3-c73b-4717-9943-234d5fcc4cd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:18.246565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b11ab3-c73b-4717-9943-234d5fcc4cd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:18.250758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b11ab3-c73b-4717-9943-234d5fcc4cd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:18.253003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b11ab3-c73b-4717-9943-234d5fcc4cd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:18.254459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b11ab3-c73b-4717-9943-234d5fcc4cd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:18.255149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b11ab3-c73b-4717-9943-234d5fcc4cd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:18.255781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b11ab3-c73b-4717-9943-234d5fcc4cd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:18.498396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:UPDATE=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:18.608058 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-658a7965-4c5a-4aaa-b3fe-4298d1ae4e9b tempest-QuotaClassesAdmin257Test-1072354303 tempest-QuotaClassesAdmin257Test-1072354303-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.470514 Oct 29 02:53:18.610975 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1049/2119] 10.222.0.16 () {62 vars in 1247 bytes} [Sat Oct 29 02:53:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:53:18.622328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:18.624116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:18.639808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:18.640090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:18.640626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:18.644969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:18.645547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:18.646127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:18.719050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3b11ab3-c73b-4717-9943-234d5fcc4cd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:18.730500 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3b11ab3-c73b-4717-9943-234d5fcc4cd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.508155 Oct 29 02:53:18.731290 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1071/2120] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:18 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:18.741681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81e37bfe-8d7f-40c6-b1a9-d8bfb8c7cecc tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1acbc9040>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:18.764222 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81e37bfe-8d7f-40c6-b1a9-d8bfb8c7cecc tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-564315640" status: 200 len: 512 microversion: 2.2 time: 0.031868 Oct 29 02:53:18.764817 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1072/2121] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Oct 29 02:53:18 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-564315640 => generated 512 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:18.777833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d2e95a06-3110-4a4a-91cd-1d7c6d1b4653 req-01ddd84b-a1a9-4b55-9e06-644d1b133160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b13b0f93-4ed1-4257-8a35-0db82db20bd7", "tag": "f5ac891c-6ef2-46f7-96d6-3bb775f98a04"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:18.795704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d2e95a06-3110-4a4a-91cd-1d7c6d1b4653 req-01ddd84b-a1a9-4b55-9e06-644d1b133160 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:18.796262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d2e95a06-3110-4a4a-91cd-1d7c6d1b4653 req-01ddd84b-a1a9-4b55-9e06-644d1b133160 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:18.796698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d2e95a06-3110-4a4a-91cd-1d7c6d1b4653 req-01ddd84b-a1a9-4b55-9e06-644d1b133160 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:18.826933 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d2e95a06-3110-4a4a-91cd-1d7c6d1b4653 req-01ddd84b-a1a9-4b55-9e06-644d1b133160 service nova] Creating event network-changed:f5ac891c-6ef2-46f7-96d6-3bb775f98a04 for instance b13b0f93-4ed1-4257-8a35-0db82db20bd7 on n-h1-862964-4 Oct 29 02:53:18.833705 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d2e95a06-3110-4a4a-91cd-1d7c6d1b4653 req-01ddd84b-a1a9-4b55-9e06-644d1b133160 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067652 Oct 29 02:53:18.838367 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1073/2122] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:18.849161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3c1f3855-bd3f-4e3f-968e-19b5d991cca3 tempest-QuotaClassesAdmin257Test-1072354303 tempest-QuotaClassesAdmin257Test-1072354303-project-admin] Calling method '.version_select at 0x7fe1a8039040>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:18.853646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:18.866736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:18.871976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:18.873181 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-97ae9237-863e-4110-914b-cdd5d37ffe4c tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1292 microversion: 2.25 time: 0.261122 Oct 29 02:53:18.876173 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1050/2123] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:18 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1292 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:18.879444 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3c1f3855-bd3f-4e3f-968e-19b5d991cca3 tempest-QuotaClassesAdmin257Test-1072354303 tempest-QuotaClassesAdmin257Test-1072354303-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.038429 Oct 29 02:53:18.880242 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1074/2124] 10.222.0.16 () {60 vars in 1226 bytes} [Sat Oct 29 02:53:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:53:18.887354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c9510137-6b4f-4bfe-9443-0b85f4c533b5 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1acce8d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:18.891703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a4c40284-15e5-48bd-8544-bd4bbed0dfb5 tempest-QuotaClassesAdmin257Test-1072354303 tempest-QuotaClassesAdmin257Test-1072354303-project-admin] Action: 'update', calling method: .version_select at 0x7fe1acaf3ee0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:18.926898 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c9510137-6b4f-4bfe-9443-0b85f4c533b5 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-564315640" status: 204 len: 0 microversion: 2.2 time: 0.049723 Oct 29 02:53:18.935084 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1051/2125] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Oct 29 02:53:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-564315640 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:18.940209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:18.940775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:18.963347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:18.963915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:18.964309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:18.965112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:18.965771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:18.966075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:19.076586 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a4c40284-15e5-48bd-8544-bd4bbed0dfb5 tempest-QuotaClassesAdmin257Test-1072354303 tempest-QuotaClassesAdmin257Test-1072354303-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.188808 Oct 29 02:53:19.078714 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1075/2126] 10.222.0.16 () {62 vars in 1247 bytes} [Sat Oct 29 02:53:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:53:19.090458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec894b64-8c09-41bd-a84d-54ffeba14541 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Action: 'create', calling method: .version_select at 0x7fe1acb1cdc0>, body: {"keypair": {"name": "tempest-keypair-2066143381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/dkqTMvKcK+kykZMvJka8SHf2GM9OjlZktK3zBa//IPKgDFweoTUXLEpEUifRQHxvdv3fP5mMMMfoMPn3461cGTBoc6YU3I/r6Ih8Mkh8AV3iUGH5K88XFvSVcJsW0Fg=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:19.130610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-ec894b64-8c09-41bd-a84d-54ffeba14541 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:19.149714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-ec894b64-8c09-41bd-a84d-54ffeba14541 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for user eb69e4365fa5420aa8ca5b539924a1c5 and project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:19.215556 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ec894b64-8c09-41bd-a84d-54ffeba14541 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.135659 Oct 29 02:53:19.218239 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1076/2127] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Oct 29 02:53:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:53:19.230429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dbdc0bca-b61c-45f5-a3e9-e94d1c45caa9 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1acbc90d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:19.275277 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dbdc0bca-b61c-45f5-a3e9-e94d1c45caa9 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066143381" status: 204 len: 0 microversion: 2.2 time: 0.050172 Oct 29 02:53:19.277343 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1077/2128] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Oct 29 02:53:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066143381 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:19.288155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:19.290968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:19.304933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.312606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.313355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:19.316231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.316925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.317562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:19.582898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:19.593785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:19.595797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:19.597671 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bd48ea6d-f6df-4ade-b9bb-52ed23d0f344 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.317008 Oct 29 02:53:19.598802 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1078/2129] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:19 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:19.604729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44ca6ea6-dea9-4c3f-b921-87c9d0ea3040 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Action: 'create', calling method: .version_select at 0x7fe1a802bee0>, body: {"keypair": {"name": "tempest-keypair-162110432", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:19.622037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-44ca6ea6-dea9-4c3f-b921-87c9d0ea3040 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:19.633796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-44ca6ea6-dea9-4c3f-b921-87c9d0ea3040 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for user eb69e4365fa5420aa8ca5b539924a1c5 and project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:19.687350 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-44ca6ea6-dea9-4c3f-b921-87c9d0ea3040 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.087120 Oct 29 02:53:19.698913 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1079/2130] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Oct 29 02:53:19 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:53:19.711494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-038c74f3-995c-4ddd-9e6a-2626373f414f tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1acb1cf70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:19.758888 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-038c74f3-995c-4ddd-9e6a-2626373f414f tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-162110432" status: 204 len: 0 microversion: 2.2 time: 0.056335 Oct 29 02:53:19.759514 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1080/2131] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Oct 29 02:53:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-162110432 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:19.769290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-48805d34-842f-4524-85bc-42aa4ccc1990 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:19.772872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-48805d34-842f-4524-85bc-42aa4ccc1990 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:19.787524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48805d34-842f-4524-85bc-42aa4ccc1990 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.789172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48805d34-842f-4524-85bc-42aa4ccc1990 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.789756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48805d34-842f-4524-85bc-42aa4ccc1990 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:19.792792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48805d34-842f-4524-85bc-42aa4ccc1990 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.794419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48805d34-842f-4524-85bc-42aa4ccc1990 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.795093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48805d34-842f-4524-85bc-42aa4ccc1990 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:19.807892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:19.818419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:19.819771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:19.820943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b972700e-2d73-4f00-a0f1-cfa8bbc4f0f1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1751 microversion: 2.32 time: 0.884798 Oct 29 02:53:19.821507 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1052/2132] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:18 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1751 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:19.838155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bcdaef2a-73dd-41f0-b250-18081b4ca775 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Action: 'create', calling method: .version_select at 0x7fe1acd3bee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-211047268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAd/cNwzdtkmG1dGgGyms4kjQnix9MpFjY0V00O4jPpThtfxmH7hqUo6wbriRXdPLEheGAdc5MOcHrhXrkDSIwd/tNGrwpBQVT17Y0Od4lpTkCnWmwWdUP6lz5WgOknFg=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:19.857350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-bcdaef2a-73dd-41f0-b250-18081b4ca775 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:19.862419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-bcdaef2a-73dd-41f0-b250-18081b4ca775 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for user eb69e4365fa5420aa8ca5b539924a1c5 and project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:19.901698 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bcdaef2a-73dd-41f0-b250-18081b4ca775 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.063565 Oct 29 02:53:19.914506 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1053/2133] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Oct 29 02:53:19 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:53:19.920970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:19.929998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:19.948895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.949380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.950027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:19.950737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.951020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.954405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:20.209248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-48805d34-842f-4524-85bc-42aa4ccc1990 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:20.216807 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-48805d34-842f-4524-85bc-42aa4ccc1990 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.454222 Oct 29 02:53:20.218103 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1081/2134] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:19 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:20.218385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:20.225055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:20.225731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3b00ba53-fb9c-4a27-888f-1146346597ab tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Action: 'create', calling method: .version_select at 0x7fe1acaf35e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1941758370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdwPuPCpbl5Q1Jwr9wHMD5AJxbek+2uDYO1H8RKq15wZAxdoy77VjJC6duNlGO8+mRSnOAuYigrSR1/BhBueE9fvjHDvlm30WclCBM8sENlfCv+9RACe5zobfaAKjZmEg=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:20.233424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:20.235000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:20.237333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:20.237493 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-02cea16c-c3cd-46fe-9d33-5dca58a8bd73 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1292 microversion: 2.25 time: 0.321696 Oct 29 02:53:20.253846 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1054/2135] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:19 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1292 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:20.266019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b00ba53-fb9c-4a27-888f-1146346597ab tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:20.271923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3b00ba53-fb9c-4a27-888f-1146346597ab tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for user eb69e4365fa5420aa8ca5b539924a1c5 and project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:20.305268 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3b00ba53-fb9c-4a27-888f-1146346597ab tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.085727 Oct 29 02:53:20.306432 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1082/2136] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Oct 29 02:53:20 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:53:20.319214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-54c8f528-cd28-458e-ab95-ea363ddd52f8 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Action: 'create', calling method: .version_select at 0x7fe1a8422670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2102972135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmCKiZqyei5nsWElp5ZjFtt6JjiBNeGdf4i2mAXsD06Q0TyfG3n70C5y6KUwDBLbFdmchO0FW9bW3/RzcRTcUvkoEOxhrHVcHDavcUmUIflguftVfhO+LbyFS3YgJRQPQ=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:20.341894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-54c8f528-cd28-458e-ab95-ea363ddd52f8 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:20.352231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-54c8f528-cd28-458e-ab95-ea363ddd52f8 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for user eb69e4365fa5420aa8ca5b539924a1c5 and project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:20.384011 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-54c8f528-cd28-458e-ab95-ea363ddd52f8 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.068426 Oct 29 02:53:20.385307 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1055/2137] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Oct 29 02:53:20 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:53:20.396974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5ac93ee-94ef-44fd-afd4-d40552ac3be7 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1acc43d30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:20.403726 n-d-862964-4 devstack@n-api.service[127041]: WARNING oslo_db.sqlalchemy.utils [None req-f5ac93ee-94ef-44fd-afd4-d40552ac3be7 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 02:53:20.415151 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5ac93ee-94ef-44fd-afd4-d40552ac3be7 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.022571 Oct 29 02:53:20.416788 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1083/2138] 10.222.0.16 () {60 vars in 1177 bytes} [Sat Oct 29 02:53:20 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:20.428552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cfe2ee0f-17e3-4b20-baf1-5a04bfb57a6b tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1accff8b0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:20.454176 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cfe2ee0f-17e3-4b20-baf1-5a04bfb57a6b tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2102972135" status: 204 len: 0 microversion: 2.2 time: 0.030376 Oct 29 02:53:20.455537 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1056/2139] 10.222.0.16 () {60 vars in 1321 bytes} [Sat Oct 29 02:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2102972135 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:53:20.475956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-649bb6b4-9796-4670-8c56-f26cd8ab5512 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1a808ac10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:20.510086 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-649bb6b4-9796-4670-8c56-f26cd8ab5512 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1941758370" status: 204 len: 0 microversion: 2.2 time: 0.049079 Oct 29 02:53:20.511465 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1084/2140] 10.222.0.16 () {60 vars in 1321 bytes} [Sat Oct 29 02:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1941758370 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:20.521660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e123b833-b42a-4e0b-8ed3-2cade063ac25 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1a854b040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:20.551712 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e123b833-b42a-4e0b-8ed3-2cade063ac25 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-211047268" status: 204 len: 0 microversion: 2.2 time: 0.035597 Oct 29 02:53:20.553070 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1057/2141] 10.222.0.16 () {60 vars in 1318 bytes} [Sat Oct 29 02:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-211047268 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:20.571646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6bf8190e-949d-4858-ad36-3386e429b5c1 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Action: 'create', calling method: .version_select at 0x7fe1acaf3f70>, body: {"keypair": {"name": "tempest-keypair-460125124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+9aSeeasCozKLsTZXzwHVZVQwz7NRGaSOvLsyBZgReDhfMhwzoH9A/4qrKmKIqA+euBdMewyNvz+XUdQiboV0AQgownA2ecv1D6TNi+SeIqmdDKxAKWmZgNLNJRAe+Dg=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:20.599402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6bf8190e-949d-4858-ad36-3386e429b5c1 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:20.605322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6bf8190e-949d-4858-ad36-3386e429b5c1 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for user eb69e4365fa5420aa8ca5b539924a1c5 and project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:20.632176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:20.632905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:20.655033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:20.655646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:20.656145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:20.656884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:20.657494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:20.658008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:20.683460 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6bf8190e-949d-4858-ad36-3386e429b5c1 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.122591 Oct 29 02:53:20.685140 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1085/2142] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Oct 29 02:53:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 29 02:53:20.697780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d36a762d-445c-4709-a9fa-68a276880756 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1acc434c0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:20.719677 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d36a762d-445c-4709-a9fa-68a276880756 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-460125124" status: 200 len: 512 microversion: 2.2 time: 0.028433 Oct 29 02:53:20.721871 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1086/2143] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Oct 29 02:53:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-460125124 => generated 512 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:53:20.734508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8a7ab431-3dd0-45f2-86ff-fefe46e85c96 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1a802b790>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:20.744896 n-d-862964-4 devstack@n-api.service[127041]: WARNING oslo_db.sqlalchemy.utils [None req-8a7ab431-3dd0-45f2-86ff-fefe46e85c96 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 02:53:20.757839 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8a7ab431-3dd0-45f2-86ff-fefe46e85c96 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.027232 Oct 29 02:53:20.760199 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1087/2144] 10.222.0.16 () {60 vars in 1177 bytes} [Sat Oct 29 02:53:20 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:53:20.780538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-abde68a1-f6c0-40f0-8881-34db7b89b6a3 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1acc27310>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:20.814486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:20.817820 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-abde68a1-f6c0-40f0-8881-34db7b89b6a3 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460125124" status: 204 len: 0 microversion: 2.2 time: 0.051325 Oct 29 02:53:20.818832 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1088/2145] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Oct 29 02:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460125124 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:20.829602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f778b9e7-acec-4c80-abc0-654d1ef71e0a tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Action: 'create', calling method: .version_select at 0x7fe1acc22700>, body: {"keypair": {"name": "tempest-keypair-1301683382", "type": "x509"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:20.840940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:20.847609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:20.851903 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40600af3-58a7-4bbc-8041-93d24f193653 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.227068 Oct 29 02:53:20.852814 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1058/2146] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:20 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:53:20.892044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f778b9e7-acec-4c80-abc0-654d1ef71e0a tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:20.893852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:20.894843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:20.900596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f778b9e7-acec-4c80-abc0-654d1ef71e0a tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for user eb69e4365fa5420aa8ca5b539924a1c5 and project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:20.917633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.processutils [None req-f778b9e7-acec-4c80-abc0-654d1ef71e0a tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpzst55z7v/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpzst55z7v/temp.key -subj /CN=eb69e4365fa5420aa8ca5b539924a1c5 -extensions v3_req_client {{(pid=127041) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 29 02:53:20.929300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:20.929958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:20.931781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:20.932661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:20.934453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:20.934986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:21.094336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:21.119510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.processutils [None req-f778b9e7-acec-4c80-abc0-654d1ef71e0a tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpzst55z7v/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpzst55z7v/temp.key -subj /CN=eb69e4365fa5420aa8ca5b539924a1c5 -extensions v3_req_client" returned: 0 in 0.202s {{(pid=127041) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 29 02:53:21.121749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.processutils [None req-f778b9e7-acec-4c80-abc0-654d1ef71e0a tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpzst55z7v/temp.key -password pass: {{(pid=127041) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 29 02:53:21.198330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.processutils [None req-f778b9e7-acec-4c80-abc0-654d1ef71e0a tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpzst55z7v/temp.key -password pass:" returned: 0 in 0.076s {{(pid=127041) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 29 02:53:21.240309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:21.253619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:21.255525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:21.256899 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a9e50ec7-b175-4c7d-b946-28e617042094 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1797 microversion: 2.32 time: 0.376531 Oct 29 02:53:21.258109 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1059/2147] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:20 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1797 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:21.262954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6e38b40a-2f85-4bb0-ad2d-5b451af2ab67 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:21.263787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6e38b40a-2f85-4bb0-ad2d-5b451af2ab67 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:21.270706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e38b40a-2f85-4bb0-ad2d-5b451af2ab67 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:21.271462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e38b40a-2f85-4bb0-ad2d-5b451af2ab67 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:21.272184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e38b40a-2f85-4bb0-ad2d-5b451af2ab67 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:21.273172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e38b40a-2f85-4bb0-ad2d-5b451af2ab67 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:21.273876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e38b40a-2f85-4bb0-ad2d-5b451af2ab67 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:21.274557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e38b40a-2f85-4bb0-ad2d-5b451af2ab67 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:21.287934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f778b9e7-acec-4c80-abc0-654d1ef71e0a tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:21.297791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f778b9e7-acec-4c80-abc0-654d1ef71e0a tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Getting quotas for user eb69e4365fa5420aa8ca5b539924a1c5 and project 510a17ba8db3409fa425fe14df06b8e4. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:21.330546 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f778b9e7-acec-4c80-abc0-654d1ef71e0a tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.505404 Oct 29 02:53:21.333282 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1089/2148] 10.222.0.16 () {62 vars in 1198 bytes} [Sat Oct 29 02:53:20 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 510 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:53:21.341983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:21.344942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:21.356078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:21.357770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:21.358477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:21.359521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:21.360189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:21.361952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:21.445733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6e38b40a-2f85-4bb0-ad2d-5b451af2ab67 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:21.454198 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6e38b40a-2f85-4bb0-ad2d-5b451af2ab67 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.194721 Oct 29 02:53:21.455508 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1060/2149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:21 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:21.461359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-084139b7-e7bc-4651-ab68-b822ac067e29 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1acd3bee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:21.471249 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-084139b7-e7bc-4651-ab68-b822ac067e29 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1301683382" status: 200 len: 1534 microversion: 2.2 time: 0.013791 Oct 29 02:53:21.472069 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1061/2150] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Oct 29 02:53:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1301683382 => generated 1534 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:21.485439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7085acbb-adbb-4fc3-a819-a1f87cbfcbf7 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1a85514c0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:21.491385 n-d-862964-4 devstack@n-api.service[127042]: WARNING oslo_db.sqlalchemy.utils [None req-7085acbb-adbb-4fc3-a819-a1f87cbfcbf7 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 02:53:21.500514 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7085acbb-adbb-4fc3-a819-a1f87cbfcbf7 tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.019044 Oct 29 02:53:21.501929 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1062/2151] 10.222.0.16 () {60 vars in 1177 bytes} [Sat Oct 29 02:53:21 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:21.514486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4d336db5-09d1-4c4a-8571-9f7dcbf4079e tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] Calling method '.version_select at 0x7fe1a854baf0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:21.543759 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4d336db5-09d1-4c4a-8571-9f7dcbf4079e tempest-KeyPairsV22TestJSON-1065154298 tempest-KeyPairsV22TestJSON-1065154298-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301683382" status: 204 len: 0 microversion: 2.2 time: 0.034026 Oct 29 02:53:21.545516 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1063/2152] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Oct 29 02:53:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301683382 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:21.905710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:21.918074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:21.924514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:21.932189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:21.939658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:21.945072 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d52ffa67-e6c3-4aef-ab66-d50e25ec4b8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1292 microversion: 2.25 time: 0.608761 Oct 29 02:53:21.945982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1090/2153] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:21 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1292 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:21.966956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:21.967453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:21.967879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:21.977657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:21.990442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:21.993252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:22.078758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:22.095717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:22.097539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:22.100385 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-813d086e-4481-4bb0-970a-406ecbe21f3a tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.222777 Oct 29 02:53:22.101557 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1064/2154] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:21 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:22.290326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:22.290982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:22.301262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:22.304292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:22.305086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:22.306206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:22.307011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:22.311442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:22.481010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21383d62-2e0f-421b-8c52-4215de4ed387 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:22.481754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-21383d62-2e0f-421b-8c52-4215de4ed387 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:22.492095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21383d62-2e0f-421b-8c52-4215de4ed387 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:22.493497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21383d62-2e0f-421b-8c52-4215de4ed387 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:22.494731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21383d62-2e0f-421b-8c52-4215de4ed387 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:22.496805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21383d62-2e0f-421b-8c52-4215de4ed387 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:22.499346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21383d62-2e0f-421b-8c52-4215de4ed387 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:22.500101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21383d62-2e0f-421b-8c52-4215de4ed387 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:22.769337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:22.788969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:22.790512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:22.805399 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5e823dbf-b169-462f-8e50-9b72a20efdf7 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1797 microversion: 2.32 time: 0.520412 Oct 29 02:53:22.818950 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1091/2155] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:22 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1797 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:22.971008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:22.971658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:22.984193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:22.985124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:22.985948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:22.987021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:22.988378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:22.989039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:23.270107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-21383d62-2e0f-421b-8c52-4215de4ed387 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:23.287170 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-21383d62-2e0f-421b-8c52-4215de4ed387 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.810304 Oct 29 02:53:23.292923 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1065/2156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:22 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:23.298787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:23.302071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:23.318724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:23.319235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:23.319672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:23.325247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:23.326027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:23.329036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:23.456844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:23.469027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:23.475035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:23.476635 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8fd4c8e0-8678-47b3-9c0e-9e3bd99e3f57 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.182391 Oct 29 02:53:23.481281 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1066/2157] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:23 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:23.839683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:23.841522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:23.850421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:23.852013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:23.852706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:23.853656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:23.854358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:23.855012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:24.267437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.278304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.284830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.287285 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6968b262-00af-4010-95dc-3b81f41245b1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1292 microversion: 2.25 time: 1.320527 Oct 29 02:53:24.289427 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1092/2158] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:22 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1292 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:24.315477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.320441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-92fa0634-2524-4b23-a96e-7d997195c0e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:24.322451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-92fa0634-2524-4b23-a96e-7d997195c0e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:24.333335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.335303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92fa0634-2524-4b23-a96e-7d997195c0e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:24.336002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92fa0634-2524-4b23-a96e-7d997195c0e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:24.336618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92fa0634-2524-4b23-a96e-7d997195c0e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:24.337696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92fa0634-2524-4b23-a96e-7d997195c0e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:24.338321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92fa0634-2524-4b23-a96e-7d997195c0e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:24.341308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.342327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92fa0634-2524-4b23-a96e-7d997195c0e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:24.345646 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-950c83ee-e928-4bdb-9a41-9f341ee31f41 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1843 microversion: 2.32 time: 0.509557 Oct 29 02:53:24.359506 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1067/2159] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:23 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1843 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:24.513251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:24.513911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:24.527669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:24.532052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:24.532868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:24.533965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:24.534743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:24.538963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:24.695067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.703544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.705081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.706353 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a23ef214-3996-49d7-9531-1d7a2f593022 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.197799 Oct 29 02:53:24.713484 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1068/2160] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:24 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:53:25.316910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-92fa0634-2524-4b23-a96e-7d997195c0e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:25.327099 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-92fa0634-2524-4b23-a96e-7d997195c0e2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 1.010274 Oct 29 02:53:25.328204 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1093/2161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:24 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:25.334373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:25.335403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:25.348945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:25.349731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:25.350412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:25.352300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:25.355031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:25.355728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:25.369003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:25.603766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-586956079", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:25.703885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:25.928941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:25.948727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:25.955890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:25.957089 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-894a9fe7-e1df-4729-bcd7-169a2493e00f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1292 microversion: 2.25 time: 0.627682 Oct 29 02:53:25.969085 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1094/2162] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:25 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1292 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:25.989008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:25.993607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:26.012962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:26.013754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:26.014445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:26.016351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:26.018600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:26.020036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:26.110395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:26.110847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:26.111387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:26.111797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:26.112207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:26.131028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:26.132971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:26.133442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:26.136570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:26.137333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:26.138018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:26.188961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Getting quotas for project 4935f9a2442d43a8bfc4e2a18c542c08. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:26.206441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Getting quotas for user aa3cb8ca820c4976beb0f156d53c6bdd and project 4935f9a2442d43a8bfc4e2a18c542c08. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:26.240937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:53:26.243944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:53:26.334851 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-97f169d7-cce4-4ac6-aeb5-5983b45d453c tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036259 Oct 29 02:53:26.345307 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1069/2163] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:53:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:53:26.358161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1657339720", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "cad6258a-6a8a-480a-924f-804a5d2d86e4"}, {"uuid": "7eb943c4-b3f8-4061-bd24-f6091e865009"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:26.481504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] validate_networks() for [('cad6258a-6a8a-480a-924f-804a5d2d86e4', None, None, None, None, None), ('7eb943c4-b3f8-4061-bd24-f6091e865009', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:26.506334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:26.516193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:26.532261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:26.534216 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-411ae9b1-55f1-4c31-b778-6bc2661fc1fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1843 microversion: 2.32 time: 0.563911 Oct 29 02:53:26.537194 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1095/2164] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:25 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1843 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:26.565771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:26.566787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:26.589602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:26.590044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:26.590482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:26.591204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:26.591655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:26.592075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:26.860832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:26.899254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:26.901138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:26.902453 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e73afaef-4ac5-4745-af51-a65ac7f1feb8 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1365 microversion: 2.57 time: 0.352898 Oct 29 02:53:26.903225 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1096/2165] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:26 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:26.911411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2034972937", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2525c91e-f8df-4369-b3fa-9ce9342c6d85"}], "block_device_mapping_v2": [{"uuid": "5b09900d-39ae-4c9e-82a4-1d5cac3003d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Oct 29 02:53:27.534997 n-d-862964-4 devstack@n-api.service[127041]: ERROR sqlalchemy.pool.impl.QueuePool Oct 29 02:53:27.539657 n-d-862964-4 devstack@n-api.service[127041]: Exception ignored in: . at 0x7fe1a802b310> Oct 29 02:53:27.539657 n-d-862964-4 devstack@n-api.service[127041]: Traceback (most recent call last): Oct 29 02:53:27.539657 n-d-862964-4 devstack@n-api.service[127041]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 29 02:53:27.540032 n-d-862964-4 devstack@n-api.service[127041]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 29 02:53:27.540032 n-d-862964-4 devstack@n-api.service[127041]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 29 02:53:27.540412 n-d-862964-4 devstack@n-api.service[127041]: connection_record.checkin() Oct 29 02:53:27.540412 n-d-862964-4 devstack@n-api.service[127041]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 29 02:53:27.540719 n-d-862964-4 devstack@n-api.service[127041]: pool.dispatch.checkin(connection, self) Oct 29 02:53:27.540719 n-d-862964-4 devstack@n-api.service[127041]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 29 02:53:27.547883 n-d-862964-4 devstack@n-api.service[127041]: fn(*args, **kw) Oct 29 02:53:27.547883 n-d-862964-4 devstack@n-api.service[127041]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Oct 29 02:53:27.552875 n-d-862964-4 devstack@n-api.service[127041]: time.sleep(0) Oct 29 02:53:27.553058 n-d-862964-4 devstack@n-api.service[127041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 29 02:53:27.555546 n-d-862964-4 devstack@n-api.service[127041]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 29 02:53:27.555728 n-d-862964-4 devstack@n-api.service[127041]: AssertionError: do not call blocking functions from the mainloop Oct 29 02:53:28.053446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:28.054104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:28.055148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:28.055563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:28.057046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:28.076341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=74,nova_cell0:UPDATE=7 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:28.079073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.080320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.081456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:28.084520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.085001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.085499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:28.122702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Getting quotas for project d86df8edf5044361a65c11542c2dc585. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:28.134237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Getting quotas for user 5d2e129a84e847a0b5c80ad47ca4d233 and project d86df8edf5044361a65c11542c2dc585. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:28.139203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:28.164286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:53:28.168982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:53:28.312192 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b58b1f14-a23e-4d30-abf2-765efa8907fd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.965580 Oct 29 02:53:28.315329 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1070/2166] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:53:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:53:28.329014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-56f25f25-823e-489d-8a74-bdc46759d8ab tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:28.331794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-56f25f25-823e-489d-8a74-bdc46759d8ab tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:28.359078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f25f25-823e-489d-8a74-bdc46759d8ab tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.361343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f25f25-823e-489d-8a74-bdc46759d8ab tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.363153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f25f25-823e-489d-8a74-bdc46759d8ab tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:28.365245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f25f25-823e-489d-8a74-bdc46759d8ab tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.366738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f25f25-823e-489d-8a74-bdc46759d8ab tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.368312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f25f25-823e-489d-8a74-bdc46759d8ab tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:28.498383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-56f25f25-823e-489d-8a74-bdc46759d8ab tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:28.511755 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-56f25f25-823e-489d-8a74-bdc46759d8ab tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1218 microversion: 2.1 time: 0.191024 Oct 29 02:53:28.512584 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1071/2167] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:28 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:28.530025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b81f66ca-8e0a-40b9-b7a6-36d6ff4fb4f8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:28.530803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b81f66ca-8e0a-40b9-b7a6-36d6ff4fb4f8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:28.538698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81f66ca-8e0a-40b9-b7a6-36d6ff4fb4f8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.540847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81f66ca-8e0a-40b9-b7a6-36d6ff4fb4f8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.541903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81f66ca-8e0a-40b9-b7a6-36d6ff4fb4f8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:28.543173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81f66ca-8e0a-40b9-b7a6-36d6ff4fb4f8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.543887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81f66ca-8e0a-40b9-b7a6-36d6ff4fb4f8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.544346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b81f66ca-8e0a-40b9-b7a6-36d6ff4fb4f8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:28.852417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b81f66ca-8e0a-40b9-b7a6-36d6ff4fb4f8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:28.871582 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b81f66ca-8e0a-40b9-b7a6-36d6ff4fb4f8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.356202 Oct 29 02:53:28.874174 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1072/2168] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:28 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:28.894068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:28.895453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:28.910782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.916741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.917551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:28.918994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.920111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.922685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:29.252697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:29.265856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:29.267844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:29.269323 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-39ba2adc-5314-44ed-a2ba-54c0d9abd524 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1292 microversion: 2.25 time: 0.392728 Oct 29 02:53:29.270155 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1073/2169] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:28 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1292 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:29.287207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9ddaf5ae-4ee8-4740-b620-7b18b3f7c6c6 req-fcd0ed97-4d1d-4f9e-abdd-608531a2bba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "tag": "f9ad5c3b-d639-4b01-8092-245696df4798"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:29.312664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ddaf5ae-4ee8-4740-b620-7b18b3f7c6c6 req-fcd0ed97-4d1d-4f9e-abdd-608531a2bba0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:29.313203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ddaf5ae-4ee8-4740-b620-7b18b3f7c6c6 req-fcd0ed97-4d1d-4f9e-abdd-608531a2bba0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:29.314181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ddaf5ae-4ee8-4740-b620-7b18b3f7c6c6 req-fcd0ed97-4d1d-4f9e-abdd-608531a2bba0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:29.331434 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9ddaf5ae-4ee8-4740-b620-7b18b3f7c6c6 req-fcd0ed97-4d1d-4f9e-abdd-608531a2bba0 service nova] Creating event network-changed:f9ad5c3b-d639-4b01-8092-245696df4798 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:53:29.342435 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9ddaf5ae-4ee8-4740-b620-7b18b3f7c6c6 req-fcd0ed97-4d1d-4f9e-abdd-608531a2bba0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070210 Oct 29 02:53:29.344813 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1074/2170] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:29.358233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:29.364436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:29.390565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:29.392151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:29.394399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:29.395638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:29.397409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:29.398077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:30.002781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] validate_networks() for [('2525c91e-f8df-4369-b3fa-9ce9342c6d85', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:30.388208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.416035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.424745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.426831 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f244ff0-2164-40c7-85bd-10f9f3d528c1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1864 microversion: 2.32 time: 1.079037 Oct 29 02:53:30.427927 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1075/2171] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:29 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1864 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:30.447317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:30.452616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:30.464564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:30.466227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:30.466662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:30.467384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:30.468658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:30.472026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:30.566259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.576478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.578306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.579803 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c57c9272-44d7-4970-890b-8ab80594d510 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1371 microversion: 2.57 time: 0.150555 Oct 29 02:53:30.580699 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1076/2172] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:30 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:30.585429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef249480-636c-410a-986b-061e3eb564bf tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:30.586405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ef249480-636c-410a-986b-061e3eb564bf tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:30.595643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef249480-636c-410a-986b-061e3eb564bf tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:30.597527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef249480-636c-410a-986b-061e3eb564bf tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:30.598415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef249480-636c-410a-986b-061e3eb564bf tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:30.599501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef249480-636c-410a-986b-061e3eb564bf tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:30.600214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef249480-636c-410a-986b-061e3eb564bf tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:30.600906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef249480-636c-410a-986b-061e3eb564bf tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:30.681732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ef249480-636c-410a-986b-061e3eb564bf tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.691549 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ef249480-636c-410a-986b-061e3eb564bf tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1209 microversion: 2.1 time: 0.109728 Oct 29 02:53:30.692830 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1077/2173] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:30 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:30.697191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4a8888ad-1def-4fa6-838b-3721e64e3229 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:30.697778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4a8888ad-1def-4fa6-838b-3721e64e3229 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:30.712213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a8888ad-1def-4fa6-838b-3721e64e3229 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:30.712711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a8888ad-1def-4fa6-838b-3721e64e3229 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:30.713927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a8888ad-1def-4fa6-838b-3721e64e3229 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:30.714066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a8888ad-1def-4fa6-838b-3721e64e3229 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:30.714458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a8888ad-1def-4fa6-838b-3721e64e3229 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:30.714862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a8888ad-1def-4fa6-838b-3721e64e3229 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:30.798151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4a8888ad-1def-4fa6-838b-3721e64e3229 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.807084 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4a8888ad-1def-4fa6-838b-3721e64e3229 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1274 microversion: 2.1 time: 0.113770 Oct 29 02:53:30.819400 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1078/2174] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:30 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:30.831416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2932f1b-c988-4ea9-9aa2-4e55d4c90c09 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:30.832039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2932f1b-c988-4ea9-9aa2-4e55d4c90c09 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:30.839508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2932f1b-c988-4ea9-9aa2-4e55d4c90c09 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:30.840011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2932f1b-c988-4ea9-9aa2-4e55d4c90c09 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:30.840449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2932f1b-c988-4ea9-9aa2-4e55d4c90c09 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:30.841164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2932f1b-c988-4ea9-9aa2-4e55d4c90c09 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:30.841618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2932f1b-c988-4ea9-9aa2-4e55d4c90c09 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:30.846705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2932f1b-c988-4ea9-9aa2-4e55d4c90c09 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:30.875062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:31.169499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2932f1b-c988-4ea9-9aa2-4e55d4c90c09 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:31.211770 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2932f1b-c988-4ea9-9aa2-4e55d4c90c09 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1496 microversion: 2.1 time: 0.384394 Oct 29 02:53:31.226371 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1079/2175] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:30 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1496 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:31.234772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:31.235493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:31.243445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:31.244122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:31.244629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:31.245745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:31.246378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:31.246893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:31.306726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=40 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:31.570202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:31.570404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:31.571174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:31.572024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:31.572643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:31.608484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:31.610114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:31.612820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:31.616562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:31.617839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:31.622708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:31.709583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Getting quotas for project a1287e36822b48f9a9020375bd0da2ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:31.722511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Getting quotas for user 6c2aa25bffe3421e8a75d88388dd5441 and project a1287e36822b48f9a9020375bd0da2ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:31.943347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:53:31.947590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b09900d-39ae-4c9e-82a4-1d5cac3003d8',volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:53:31.950471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:31.961697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:31.969643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:31.971091 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-912e689e-a805-4d6c-b303-18fc26bd1a59 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1280 microversion: 2.25 time: 0.743530 Oct 29 02:53:31.971761 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1080/2176] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:31 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1280 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:31.995622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4973b629-4207-4c3e-9d7e-1a168365a4a0 req-ce7997bc-1182-41b2-b572-3e7e94abaea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "tag": "4beb4d66-65d9-4b60-af1e-c467c190d7ef"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:32.007860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4973b629-4207-4c3e-9d7e-1a168365a4a0 req-ce7997bc-1182-41b2-b572-3e7e94abaea6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:32.009163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4973b629-4207-4c3e-9d7e-1a168365a4a0 req-ce7997bc-1182-41b2-b572-3e7e94abaea6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:32.009772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4973b629-4207-4c3e-9d7e-1a168365a4a0 req-ce7997bc-1182-41b2-b572-3e7e94abaea6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:32.022964 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4973b629-4207-4c3e-9d7e-1a168365a4a0 req-ce7997bc-1182-41b2-b572-3e7e94abaea6 service nova] Creating event network-changed:4beb4d66-65d9-4b60-af1e-c467c190d7ef for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:53:32.029575 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4973b629-4207-4c3e-9d7e-1a168365a4a0 req-ce7997bc-1182-41b2-b572-3e7e94abaea6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044869 Oct 29 02:53:32.030829 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1081/2177] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:32.037676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:32.038671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:32.050457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:32.054621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:32.055085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:32.056442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:32.056442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:32.056690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:32.268627 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0b45f14a-79d3-4eb7-adf0-d39c8335b1f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.363539 Oct 29 02:53:32.269608 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1097/2178] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:53:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 5366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:53:32.283230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:32.283854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:32.302296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:32.302796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:32.303236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:32.303958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:32.304409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:32.304827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:32.887726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:32.904293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:32.907484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:32.910144 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b977d299-a472-44b6-b9bb-e17256cef9cf tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1371 microversion: 2.57 time: 0.632035 Oct 29 02:53:32.911047 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1098/2179] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:32 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1371 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:32.938112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a62b6e4c-0d2c-4faf-88f8-dcb0a53b2d6a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:32.939249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a62b6e4c-0d2c-4faf-88f8-dcb0a53b2d6a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:32.946702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a62b6e4c-0d2c-4faf-88f8-dcb0a53b2d6a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:32.947961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a62b6e4c-0d2c-4faf-88f8-dcb0a53b2d6a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:32.948667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a62b6e4c-0d2c-4faf-88f8-dcb0a53b2d6a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:32.949562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a62b6e4c-0d2c-4faf-88f8-dcb0a53b2d6a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:32.950208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a62b6e4c-0d2c-4faf-88f8-dcb0a53b2d6a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:32.950842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a62b6e4c-0d2c-4faf-88f8-dcb0a53b2d6a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.096277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:33.109509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a62b6e4c-0d2c-4faf-88f8-dcb0a53b2d6a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:33.122239 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a62b6e4c-0d2c-4faf-88f8-dcb0a53b2d6a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1265 microversion: 2.1 time: 0.193371 Oct 29 02:53:33.123371 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1099/2180] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:32 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:33.141085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:33.143107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:33.144526 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2d92dd4e-b6b2-44f9-b408-4442460e2425 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1885 microversion: 2.32 time: 1.112261 Oct 29 02:53:33.145139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a70876a5-91da-4216-9a5c-72b4a3b83277 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:33.147698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a70876a5-91da-4216-9a5c-72b4a3b83277 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:33.162382 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1082/2181] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:32 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1885 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:33.171677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a70876a5-91da-4216-9a5c-72b4a3b83277 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.173330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7a1a68ae-5c43-4c54-bb1c-941155dff94e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:33.173562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a70876a5-91da-4216-9a5c-72b4a3b83277 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.175882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a70876a5-91da-4216-9a5c-72b4a3b83277 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.176785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a70876a5-91da-4216-9a5c-72b4a3b83277 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.180340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7a1a68ae-5c43-4c54-bb1c-941155dff94e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:33.181123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a70876a5-91da-4216-9a5c-72b4a3b83277 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.183783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a70876a5-91da-4216-9a5c-72b4a3b83277 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.196166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a1a68ae-5c43-4c54-bb1c-941155dff94e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.196734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a1a68ae-5c43-4c54-bb1c-941155dff94e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.197162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a1a68ae-5c43-4c54-bb1c-941155dff94e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.197929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a1a68ae-5c43-4c54-bb1c-941155dff94e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.198601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a1a68ae-5c43-4c54-bb1c-941155dff94e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.199200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a1a68ae-5c43-4c54-bb1c-941155dff94e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.374481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a70876a5-91da-4216-9a5c-72b4a3b83277 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:33.390167 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a70876a5-91da-4216-9a5c-72b4a3b83277 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1280 microversion: 2.1 time: 0.264191 Oct 29 02:53:33.392958 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1100/2182] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:33 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1280 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:33.405014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ab160368-6cfb-414d-a6a1-09807e250584 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:33.412329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ab160368-6cfb-414d-a6a1-09807e250584 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:33.435828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab160368-6cfb-414d-a6a1-09807e250584 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.439907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab160368-6cfb-414d-a6a1-09807e250584 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.440705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab160368-6cfb-414d-a6a1-09807e250584 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.443653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab160368-6cfb-414d-a6a1-09807e250584 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.444376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab160368-6cfb-414d-a6a1-09807e250584 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.445760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab160368-6cfb-414d-a6a1-09807e250584 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.790242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ab160368-6cfb-414d-a6a1-09807e250584 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:33.808311 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ab160368-6cfb-414d-a6a1-09807e250584 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1095 microversion: 2.1 time: 0.412037 Oct 29 02:53:33.811102 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1101/2183] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:33 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1095 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:33.826444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:33.827413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:33.838595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.844661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.848334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.849382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.850149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.852552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.129355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7a1a68ae-5c43-4c54-bb1c-941155dff94e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:34.143626 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7a1a68ae-5c43-4c54-bb1c-941155dff94e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 200 len: 1473 microversion: 2.1 time: 0.977405 Oct 29 02:53:34.144575 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1083/2184] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:33 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 1473 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:34.154275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:34.155685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:34.172014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.174548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.175665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.176776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.179143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.179766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.286976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:34.292850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:34.298536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:34.301459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:34.303678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:34.305573 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d3f17c18-bd5d-4358-8ecd-c174dfedb0df tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1280 microversion: 2.25 time: 0.492740 Oct 29 02:53:34.314140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:34.314140 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-340345c6-0e44-4a61-a4d6-6331e18f5c02 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1356 microversion: 2.57 time: 0.165875 Oct 29 02:53:34.314140 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1084/2185] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:34 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:34.315895 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1102/2186] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:33 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1280 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:34.327521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-75cb570e-5110-4b7e-b0fe-4edee819fb36 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:34.328354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-00e316c1-6dd0-49fb-b852-af80314bc9dd req-b9abf70b-4650-4822-a30a-7c4fdd87cde4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "tag": "5de667bc-fe03-4e62-86b0-0d4687f62228"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:34.343860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-75cb570e-5110-4b7e-b0fe-4edee819fb36 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:34.354628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75cb570e-5110-4b7e-b0fe-4edee819fb36 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.355823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75cb570e-5110-4b7e-b0fe-4edee819fb36 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.357954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75cb570e-5110-4b7e-b0fe-4edee819fb36 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.358855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75cb570e-5110-4b7e-b0fe-4edee819fb36 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.359976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-00e316c1-6dd0-49fb-b852-af80314bc9dd req-b9abf70b-4650-4822-a30a-7c4fdd87cde4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.360457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-00e316c1-6dd0-49fb-b852-af80314bc9dd req-b9abf70b-4650-4822-a30a-7c4fdd87cde4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.360843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75cb570e-5110-4b7e-b0fe-4edee819fb36 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.361025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-00e316c1-6dd0-49fb-b852-af80314bc9dd req-b9abf70b-4650-4822-a30a-7c4fdd87cde4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.362949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75cb570e-5110-4b7e-b0fe-4edee819fb36 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.382898 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-00e316c1-6dd0-49fb-b852-af80314bc9dd req-b9abf70b-4650-4822-a30a-7c4fdd87cde4 service nova] Creating event network-changed:5de667bc-fe03-4e62-86b0-0d4687f62228 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:53:34.391274 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-00e316c1-6dd0-49fb-b852-af80314bc9dd req-b9abf70b-4650-4822-a30a-7c4fdd87cde4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076918 Oct 29 02:53:34.393189 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1085/2187] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:34.402729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a32698c0-24f8-42f0-9557-77f8f883ab0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-751196318"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:34.409099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a32698c0-24f8-42f0-9557-77f8f883ab0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:34.417233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a32698c0-24f8-42f0-9557-77f8f883ab0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.418049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a32698c0-24f8-42f0-9557-77f8f883ab0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.418676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a32698c0-24f8-42f0-9557-77f8f883ab0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.419971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a32698c0-24f8-42f0-9557-77f8f883ab0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.420797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a32698c0-24f8-42f0-9557-77f8f883ab0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.421392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a32698c0-24f8-42f0-9557-77f8f883ab0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.638295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-75cb570e-5110-4b7e-b0fe-4edee819fb36 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:34.651630 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-75cb570e-5110-4b7e-b0fe-4edee819fb36 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1271 microversion: 2.1 time: 0.329436 Oct 29 02:53:34.652274 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1103/2188] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:34 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1271 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:34.662291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:34.667533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:34.670443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:34.683232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.683759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.684692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.684936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.685399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.685838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.773981 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a32698c0-24f8-42f0-9557-77f8f883ab0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48/action" status: 202 len: 0 microversion: 2.1 time: 0.378631 Oct 29 02:53:34.776333 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1086/2189] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:53:34 2022] POST /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:53:34.782641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-97cb68a6-218b-410d-9019-9e7a6f3504ba tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:34.783936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-97cb68a6-218b-410d-9019-9e7a6f3504ba tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:34.812403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97cb68a6-218b-410d-9019-9e7a6f3504ba tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.813027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97cb68a6-218b-410d-9019-9e7a6f3504ba tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.814272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97cb68a6-218b-410d-9019-9e7a6f3504ba tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.816869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97cb68a6-218b-410d-9019-9e7a6f3504ba tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.817461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97cb68a6-218b-410d-9019-9e7a6f3504ba tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.818381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97cb68a6-218b-410d-9019-9e7a6f3504ba tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.885894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-97cb68a6-218b-410d-9019-9e7a6f3504ba tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:53:35.067050 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-97cb68a6-218b-410d-9019-9e7a6f3504ba tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "DELETE /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 204 len: 0 microversion: 2.57 time: 0.289921 Oct 29 02:53:35.067658 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1087/2190] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:53:34 2022] DELETE /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:53:35.087325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ad9524b2-de9d-4273-9607-e8f33d098981 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:35.088991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ad9524b2-de9d-4273-9607-e8f33d098981 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:35.106370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9524b2-de9d-4273-9607-e8f33d098981 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.107003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9524b2-de9d-4273-9607-e8f33d098981 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.107295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9524b2-de9d-4273-9607-e8f33d098981 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:35.107991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9524b2-de9d-4273-9607-e8f33d098981 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.113037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9524b2-de9d-4273-9607-e8f33d098981 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.113291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9524b2-de9d-4273-9607-e8f33d098981 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:35.295124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:35.315950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:35.319647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:35.323230 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-496f57ee-5559-493a-8490-cf9e21904f16 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1885 microversion: 2.32 time: 0.667889 Oct 29 02:53:35.326247 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1104/2191] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:34 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1885 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:35.341616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3cea32ca-7e7e-49d0-b0ec-7f13ada2c5e6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acc43e50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:35.419024 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3cea32ca-7e7e-49d0-b0ec-7f13ada2c5e6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.090643 Oct 29 02:53:35.420848 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1105/2192] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:35 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:35.433406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-03a46a4b-db49-4fba-9858-abe644bce17b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:35.435650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-03a46a4b-db49-4fba-9858-abe644bce17b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:35.437608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ad9524b2-de9d-4273-9607-e8f33d098981 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:35.448994 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ad9524b2-de9d-4273-9607-e8f33d098981 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1280 microversion: 2.1 time: 0.374039 Oct 29 02:53:35.449909 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1088/2193] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:35 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1280 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:35.461744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a46a4b-db49-4fba-9858-abe644bce17b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.464104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a46a4b-db49-4fba-9858-abe644bce17b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.470485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a46a4b-db49-4fba-9858-abe644bce17b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:35.470880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:35.470880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:35.471218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a46a4b-db49-4fba-9858-abe644bce17b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.471218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a46a4b-db49-4fba-9858-abe644bce17b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.474224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a46a4b-db49-4fba-9858-abe644bce17b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:35.484732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.501705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.503296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:35.505541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.508291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.511717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:35.758766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-03a46a4b-db49-4fba-9858-abe644bce17b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:35.783641 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-03a46a4b-db49-4fba-9858-abe644bce17b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1169 microversion: 2.1 time: 0.361442 Oct 29 02:53:35.786758 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1106/2194] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:35 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1169 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:35.791732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:35.802061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:35.827435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.834603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.835059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:35.835817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.836275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.836703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:35.902270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:35.916766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:35.921640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:35.922937 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b555396b-b272-43fb-9add-fb3a48d42dd2 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1362 microversion: 2.57 time: 0.470910 Oct 29 02:53:35.934408 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1089/2195] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:35 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1362 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:35.946117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-88c4135d-268e-464b-ae75-6ae27ea4fbd5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:35.946747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-88c4135d-268e-464b-ae75-6ae27ea4fbd5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:35.967596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88c4135d-268e-464b-ae75-6ae27ea4fbd5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.968108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88c4135d-268e-464b-ae75-6ae27ea4fbd5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.968546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88c4135d-268e-464b-ae75-6ae27ea4fbd5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:35.969268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88c4135d-268e-464b-ae75-6ae27ea4fbd5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.978375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88c4135d-268e-464b-ae75-6ae27ea4fbd5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.978943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88c4135d-268e-464b-ae75-6ae27ea4fbd5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:37.005400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-88c4135d-268e-464b-ae75-6ae27ea4fbd5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:37.015680 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-88c4135d-268e-464b-ae75-6ae27ea4fbd5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1313 microversion: 2.1 time: 1.080052 Oct 29 02:53:37.016330 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1090/2196] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:35 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1313 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:37.041635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:37.042602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:37.051008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:37.052037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:37.053262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:37.054261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:37.054947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:37.055599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:37.178187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:37.194144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:37.197360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:37.202759 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9677bd01-5608-485f-ac69-35d4fb96c6c7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1280 microversion: 2.25 time: 1.414675 Oct 29 02:53:37.203828 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1107/2197] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:35 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1280 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:37.230894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-5733fe14-2281-40a0-8d89-43ced576508b req-8f540b08-fb3e-4387-9bd0-13da9a493b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "tag": "767f0367-bff9-4f07-ac30-bfe344612d57"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:37.244227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5733fe14-2281-40a0-8d89-43ced576508b req-8f540b08-fb3e-4387-9bd0-13da9a493b72 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:37.245054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5733fe14-2281-40a0-8d89-43ced576508b req-8f540b08-fb3e-4387-9bd0-13da9a493b72 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:37.246100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5733fe14-2281-40a0-8d89-43ced576508b req-8f540b08-fb3e-4387-9bd0-13da9a493b72 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:37.262542 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-5733fe14-2281-40a0-8d89-43ced576508b req-8f540b08-fb3e-4387-9bd0-13da9a493b72 service nova] Creating event network-changed:767f0367-bff9-4f07-ac30-bfe344612d57 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:53:37.271500 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-5733fe14-2281-40a0-8d89-43ced576508b req-8f540b08-fb3e-4387-9bd0-13da9a493b72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054512 Oct 29 02:53:37.273249 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1108/2198] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:37.295088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-edc9a635-d2fb-45de-bb23-d8ba767329cd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acd4a3a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:37.377875 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-edc9a635-d2fb-45de-bb23-d8ba767329cd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.103011 Oct 29 02:53:37.381877 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1109/2199] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:37 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:37.394467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-99cec51b-15c1-4cf6-9fbf-76695b2dbbf1 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:37.398024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-99cec51b-15c1-4cf6-9fbf-76695b2dbbf1 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:37.419428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99cec51b-15c1-4cf6-9fbf-76695b2dbbf1 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:37.420597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99cec51b-15c1-4cf6-9fbf-76695b2dbbf1 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:37.423338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99cec51b-15c1-4cf6-9fbf-76695b2dbbf1 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:37.424389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99cec51b-15c1-4cf6-9fbf-76695b2dbbf1 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:37.427870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99cec51b-15c1-4cf6-9fbf-76695b2dbbf1 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:37.428624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99cec51b-15c1-4cf6-9fbf-76695b2dbbf1 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:37.968509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:37.991372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:38.004641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:38.008849 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0d8df46a-f5ff-451d-8b28-3b0027d4f779 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1885 microversion: 2.32 time: 0.976451 Oct 29 02:53:38.033558 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1091/2200] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:37 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1885 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:38.056340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2dfeb8d1-1d5a-43a4-bef8-2e331ee2a777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:38.057380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2dfeb8d1-1d5a-43a4-bef8-2e331ee2a777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:38.071419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dfeb8d1-1d5a-43a4-bef8-2e331ee2a777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:38.071923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dfeb8d1-1d5a-43a4-bef8-2e331ee2a777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:38.072366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dfeb8d1-1d5a-43a4-bef8-2e331ee2a777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:38.077377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dfeb8d1-1d5a-43a4-bef8-2e331ee2a777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:38.078595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dfeb8d1-1d5a-43a4-bef8-2e331ee2a777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:38.081990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dfeb8d1-1d5a-43a4-bef8-2e331ee2a777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:38.110995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:38.165514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=5 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:38.353409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-99cec51b-15c1-4cf6-9fbf-76695b2dbbf1 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:38.371384 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-99cec51b-15c1-4cf6-9fbf-76695b2dbbf1 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1322 microversion: 2.1 time: 0.987219 Oct 29 02:53:38.373286 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1110/2201] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:37 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1322 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:38.388494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:38.394315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:38.408822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:38.410699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:38.411374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:38.415485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:38.416349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:38.417169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:38.722043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:38.746454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:38.758217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62af8e77eeca4ecc942b76ef82bf2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65837d49e9914967875ca457c466337f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:38.759481 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5752b13-c7f1-487f-8d2a-71496a8c84eb tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 200 len: 1362 microversion: 2.57 time: 0.384732 Oct 29 02:53:38.782641 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1111/2202] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:38 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:38.799582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3a242cd7-1556-4742-b8ed-18c9ee43ea63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:38.800552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3a242cd7-1556-4742-b8ed-18c9ee43ea63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:38.832111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a242cd7-1556-4742-b8ed-18c9ee43ea63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:38.832715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a242cd7-1556-4742-b8ed-18c9ee43ea63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:38.833159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a242cd7-1556-4742-b8ed-18c9ee43ea63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:38.833915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a242cd7-1556-4742-b8ed-18c9ee43ea63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:38.834370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a242cd7-1556-4742-b8ed-18c9ee43ea63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:38.834793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a242cd7-1556-4742-b8ed-18c9ee43ea63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:39.072272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2dfeb8d1-1d5a-43a4-bef8-2e331ee2a777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:39.090950 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2dfeb8d1-1d5a-43a4-bef8-2e331ee2a777 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1211 microversion: 2.1 time: 1.052604 Oct 29 02:53:39.094128 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1092/2203] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:38 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1211 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:39.106454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:39.107085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:39.124990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:39.125729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:39.129638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:39.130640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:39.132850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:39.133839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:39.748620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3a242cd7-1556-4742-b8ed-18c9ee43ea63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:39.758421 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3a242cd7-1556-4742-b8ed-18c9ee43ea63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1313 microversion: 2.1 time: 0.973980 Oct 29 02:53:39.759024 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1112/2204] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:38 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1313 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:39.777907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fd9ba666-e8ca-4a37-92f7-2fd232f71675 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acccec10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:39.901088 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fd9ba666-e8ca-4a37-92f7-2fd232f71675 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.137071 Oct 29 02:53:39.901701 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1113/2205] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:39 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:39.907859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:39.915714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:39.929442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:39.931950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:39.932414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:39.933159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:39.933623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:39.934074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.384808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:40.405208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:40.409731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:40.416233 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-28c5346d-b6ce-4e83-9329-3f44e395f728 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1280 microversion: 2.25 time: 1.318910 Oct 29 02:53:40.417222 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1093/2206] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:39 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1280 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:40.422767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6694d7a0-d992-49e6-ba12-5f7f2766229a tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:40.425020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6694d7a0-d992-49e6-ba12-5f7f2766229a tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:40.433690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6694d7a0-d992-49e6-ba12-5f7f2766229a tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.435036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6694d7a0-d992-49e6-ba12-5f7f2766229a tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.435918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6694d7a0-d992-49e6-ba12-5f7f2766229a tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.437641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6694d7a0-d992-49e6-ba12-5f7f2766229a tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.438712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6694d7a0-d992-49e6-ba12-5f7f2766229a tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.439456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6694d7a0-d992-49e6-ba12-5f7f2766229a tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.463962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:40.732832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:40.745661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:40.751907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:40.760849 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2bf718fc-d0c0-45cc-b8bc-3bc87f40ca72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1885 microversion: 2.32 time: 0.857212 Oct 29 02:53:40.761672 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1114/2207] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:39 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1885 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:40.776980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:40.778099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] [instance: 892ce1c5-fe52-489f-a5bb-0f0df067696e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:40.787382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.789483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.791438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.795356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.796016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.797047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.812392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:40.848607 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] HTTP exception thrown: Instance 892ce1c5-fe52-489f-a5bb-0f0df067696e could not be found. Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Request method failure captured: Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e HTTP/1.1 Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJV8EA7g6UC2O8Xx120ENzUGmnbrFRlkBx6JMscXaS89yOZ7gavamJscaS8ir9AVslJA3BtCqtkpaeJie0fQw1aVVUwYnOfA2VTGVRBITONeNny5IwpOMhpxM3tYj5LUPvWI3H6gGR8mLqmXNGlIoRMFGXU5ajiBZw5vGs6NMBp-1YQ Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.57 Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 65837d49e9914967875ca457c466337f Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerShowV257Test-1940557917 Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/65837d49e9914967875ca457c466337f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65837d49e9914967875ca457c466337f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_65837d49e9914967875ca457c466337f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/65837d49e9914967875ca457c466337f"}]}] Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerShowV257Test-1940557917 Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 65837d49e9914967875ca457c466337f Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerShowV257Test-1940557917 Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerShowV257Test-1940557917-project Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 62af8e77eeca4ecc942b76ef82bf2ff2 Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerShowV257Test-1940557917-project Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 892ce1c5-fe52-489f-a5bb-0f0df067696e could not be found. Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '892ce1c5-fe52-489f-a5bb-0f0df067696e'} Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 892ce1c5-fe52-489f-a5bb-0f0df067696e could not be found. Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 892ce1c5-fe52-489f-a5bb-0f0df067696e could not be found. Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:40.850876 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:40.857895 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:40.857895 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:40.857895 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:40.857895 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:40.857895 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:40.857895 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 892ce1c5-fe52-489f-a5bb-0f0df067696e could not be found. Oct 29 02:53:40.857895 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:40.857895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] Returning 404 to user: Instance 892ce1c5-fe52-489f-a5bb-0f0df067696e could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:40.857895 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-532afb5c-d641-4a42-8fd4-0cccb1199e78 tempest-ServerShowV257Test-1940557917 tempest-ServerShowV257Test-1940557917-project] 10.222.0.16 "GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e" status: 404 len: 111 microversion: 2.57 time: 0.088446 Oct 29 02:53:40.857895 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1115/2208] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:40 2022] GET /compute/v2.1/servers/892ce1c5-fe52-489f-a5bb-0f0df067696e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:53:40.867964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-65d3fbaa-e0a1-49a4-a454-bc0df77c07e0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:40.878871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-65d3fbaa-e0a1-49a4-a454-bc0df77c07e0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:40.910505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d3fbaa-e0a1-49a4-a454-bc0df77c07e0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.911068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d3fbaa-e0a1-49a4-a454-bc0df77c07e0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.911438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d3fbaa-e0a1-49a4-a454-bc0df77c07e0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.915877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d3fbaa-e0a1-49a4-a454-bc0df77c07e0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.916321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d3fbaa-e0a1-49a4-a454-bc0df77c07e0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.916774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d3fbaa-e0a1-49a4-a454-bc0df77c07e0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.993357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6694d7a0-d992-49e6-ba12-5f7f2766229a tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:41.006838 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6694d7a0-d992-49e6-ba12-5f7f2766229a tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1322 microversion: 2.1 time: 0.587721 Oct 29 02:53:41.007444 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1094/2209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:40 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1322 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:41.036482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-acfc8c93-7591-4811-9932-46400f74ab6a req-7ad48589-d70e-4c91-a4b3-80b6ffb76aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "tag": "0ac995e9-7dce-47bf-9e58-e63e0cc63800"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:41.078697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-acfc8c93-7591-4811-9932-46400f74ab6a req-7ad48589-d70e-4c91-a4b3-80b6ffb76aec service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:41.079253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-acfc8c93-7591-4811-9932-46400f74ab6a req-7ad48589-d70e-4c91-a4b3-80b6ffb76aec service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:41.080005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-acfc8c93-7591-4811-9932-46400f74ab6a req-7ad48589-d70e-4c91-a4b3-80b6ffb76aec service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:41.110951 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-acfc8c93-7591-4811-9932-46400f74ab6a req-7ad48589-d70e-4c91-a4b3-80b6ffb76aec service nova] Creating event network-changed:0ac995e9-7dce-47bf-9e58-e63e0cc63800 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:53:41.122970 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-acfc8c93-7591-4811-9932-46400f74ab6a req-7ad48589-d70e-4c91-a4b3-80b6ffb76aec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113298 Oct 29 02:53:41.128503 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1095/2210] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:41.138846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-676cac35-7202-4e29-8147-21e672130a81 req-324ea60d-a4e1-47e7-9806-71a87f3c1869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48", "name": "network-vif-plugged", "status": "completed", "tag": "c7ca1518-2cf2-4f9f-8bf2-8a07dafc3f4f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:41.163989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-676cac35-7202-4e29-8147-21e672130a81 req-324ea60d-a4e1-47e7-9806-71a87f3c1869 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:41.164680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-676cac35-7202-4e29-8147-21e672130a81 req-324ea60d-a4e1-47e7-9806-71a87f3c1869 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:41.165297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-676cac35-7202-4e29-8147-21e672130a81 req-324ea60d-a4e1-47e7-9806-71a87f3c1869 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:41.192809 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-676cac35-7202-4e29-8147-21e672130a81 req-324ea60d-a4e1-47e7-9806-71a87f3c1869 service nova] Creating event network-vif-plugged:c7ca1518-2cf2-4f9f-8bf2-8a07dafc3f4f for instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 on n-h2-862964-4 Oct 29 02:53:41.214013 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-676cac35-7202-4e29-8147-21e672130a81 req-324ea60d-a4e1-47e7-9806-71a87f3c1869 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083755 Oct 29 02:53:41.216393 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1096/2211] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:41.229573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-577a852a-7e9b-431e-a530-1ca89dfca833 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:41.230606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-577a852a-7e9b-431e-a530-1ca89dfca833 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:41.245217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-577a852a-7e9b-431e-a530-1ca89dfca833 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:41.248484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-577a852a-7e9b-431e-a530-1ca89dfca833 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:41.252962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-577a852a-7e9b-431e-a530-1ca89dfca833 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:41.254280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-577a852a-7e9b-431e-a530-1ca89dfca833 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:41.254937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-577a852a-7e9b-431e-a530-1ca89dfca833 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:41.256753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-577a852a-7e9b-431e-a530-1ca89dfca833 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:41.690070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:41.787926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:41.989034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65d3fbaa-e0a1-49a4-a454-bc0df77c07e0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:41.999368 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-65d3fbaa-e0a1-49a4-a454-bc0df77c07e0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1211 microversion: 2.1 time: 1.139980 Oct 29 02:53:42.009034 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1116/2212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:40 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1211 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:42.032335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-75f1ca35-7ff2-488c-b031-59fecb8121d7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8039040>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:42.094983 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-75f1ca35-7ff2-488c-b031-59fecb8121d7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.084409 Oct 29 02:53:42.096317 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1117/2213] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:42 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:42.116303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:42.116927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:42.133643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:42.134471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:42.135124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:42.136032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:42.136823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:42.137436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:42.741049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:42.754904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:42.759109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:42.761141 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ff98e555-cdb7-430d-b173-41d40fa5cbc6 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1280 microversion: 2.25 time: 0.663604 Oct 29 02:53:42.764657 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1118/2214] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:42 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1280 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:42.796150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:42.796899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:42.807606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:42.808346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:42.808903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:42.812966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:42.814069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:42.814637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:43.339668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-577a852a-7e9b-431e-a530-1ca89dfca833 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:43.348348 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-577a852a-7e9b-431e-a530-1ca89dfca833 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 2.129188 Oct 29 02:53:43.352299 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1097/2215] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:41 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:43.366424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8db3a78a-237d-42ec-8f85-79bcf4a0c829 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:43.367233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8db3a78a-237d-42ec-8f85-79bcf4a0c829 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:43.379112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db3a78a-237d-42ec-8f85-79bcf4a0c829 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:43.383406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db3a78a-237d-42ec-8f85-79bcf4a0c829 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:43.384136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db3a78a-237d-42ec-8f85-79bcf4a0c829 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:43.385066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db3a78a-237d-42ec-8f85-79bcf4a0c829 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:43.386334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db3a78a-237d-42ec-8f85-79bcf4a0c829 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:43.390429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db3a78a-237d-42ec-8f85-79bcf4a0c829 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:44.139415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:44.156020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:44.163639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:44.166947 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-43210af7-b0a4-41aa-b512-a70aa3c1ba1c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1885 microversion: 2.32 time: 1.387869 Oct 29 02:53:44.186274 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1119/2216] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:42 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1885 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:44.202175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f2c2f525-e192-4b9c-9de2-2ecdade35ecf req-66526cfd-5930-4a96-9a6c-86cf2a109521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00bcd54f-e117-4c84-8204-7c29fbea37df", "tag": "41ab2822-5c33-45f2-849f-d08bb9e71e63"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:44.222114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f2c2f525-e192-4b9c-9de2-2ecdade35ecf req-66526cfd-5930-4a96-9a6c-86cf2a109521 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:44.229990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f2c2f525-e192-4b9c-9de2-2ecdade35ecf req-66526cfd-5930-4a96-9a6c-86cf2a109521 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:44.231458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f2c2f525-e192-4b9c-9de2-2ecdade35ecf req-66526cfd-5930-4a96-9a6c-86cf2a109521 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:44.268419 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f2c2f525-e192-4b9c-9de2-2ecdade35ecf req-66526cfd-5930-4a96-9a6c-86cf2a109521 service nova] Creating event network-changed:41ab2822-5c33-45f2-849f-d08bb9e71e63 for instance 00bcd54f-e117-4c84-8204-7c29fbea37df on n-h2-862964-4 Oct 29 02:53:44.286943 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f2c2f525-e192-4b9c-9de2-2ecdade35ecf req-66526cfd-5930-4a96-9a6c-86cf2a109521 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098092 Oct 29 02:53:44.289426 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1120/2217] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:44.312078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-db8522bb-5a81-485a-9e5f-f3e60233eb0e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:44.318914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db8522bb-5a81-485a-9e5f-f3e60233eb0e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:44.334751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db8522bb-5a81-485a-9e5f-f3e60233eb0e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:44.337145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db8522bb-5a81-485a-9e5f-f3e60233eb0e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:44.337902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db8522bb-5a81-485a-9e5f-f3e60233eb0e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:44.339025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db8522bb-5a81-485a-9e5f-f3e60233eb0e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:44.344333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db8522bb-5a81-485a-9e5f-f3e60233eb0e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:44.345164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db8522bb-5a81-485a-9e5f-f3e60233eb0e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:44.533343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8db3a78a-237d-42ec-8f85-79bcf4a0c829 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:44.551168 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8db3a78a-237d-42ec-8f85-79bcf4a0c829 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1322 microversion: 2.1 time: 1.189257 Oct 29 02:53:44.552046 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1098/2218] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:43 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1322 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:44.568235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-13462f57-bfb6-4e07-8312-b5f674515161 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a84731f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:44.648640 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-13462f57-bfb6-4e07-8312-b5f674515161 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.091965 Oct 29 02:53:44.649590 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1099/2219] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:44 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:44.661221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-5499ad4f-769a-4a3c-86e0-77448adc8583 req-52965ab4-9c10-4b49-a233-c9f861457bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b13b0f93-4ed1-4257-8a35-0db82db20bd7", "name": "network-vif-plugged", "status": "completed", "tag": "f5ac891c-6ef2-46f7-96d6-3bb775f98a04"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:44.698437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5499ad4f-769a-4a3c-86e0-77448adc8583 req-52965ab4-9c10-4b49-a233-c9f861457bf8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:44.699200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5499ad4f-769a-4a3c-86e0-77448adc8583 req-52965ab4-9c10-4b49-a233-c9f861457bf8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:44.702196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5499ad4f-769a-4a3c-86e0-77448adc8583 req-52965ab4-9c10-4b49-a233-c9f861457bf8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:44.743743 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-5499ad4f-769a-4a3c-86e0-77448adc8583 req-52965ab4-9c10-4b49-a233-c9f861457bf8 service nova] Creating event network-vif-plugged:f5ac891c-6ef2-46f7-96d6-3bb775f98a04 for instance b13b0f93-4ed1-4257-8a35-0db82db20bd7 on n-h1-862964-4 Oct 29 02:53:44.774035 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-5499ad4f-769a-4a3c-86e0-77448adc8583 req-52965ab4-9c10-4b49-a233-c9f861457bf8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118488 Oct 29 02:53:44.776769 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1100/2220] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:44.807361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:44.810971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:44.850890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:44.852922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:44.853400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:44.855279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:44.856625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:44.859064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:45.154878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-db8522bb-5a81-485a-9e5f-f3e60233eb0e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:45.167882 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-db8522bb-5a81-485a-9e5f-f3e60233eb0e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1211 microversion: 2.1 time: 0.874331 Oct 29 02:53:45.176808 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1121/2221] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:44 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1211 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:45.195818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-70bab576-4cc6-44d6-97d3-1d66f960e3a5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:45.203093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-70bab576-4cc6-44d6-97d3-1d66f960e3a5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:45.226127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70bab576-4cc6-44d6-97d3-1d66f960e3a5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:45.231236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70bab576-4cc6-44d6-97d3-1d66f960e3a5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:45.235210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70bab576-4cc6-44d6-97d3-1d66f960e3a5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:45.238850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70bab576-4cc6-44d6-97d3-1d66f960e3a5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:45.241724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70bab576-4cc6-44d6-97d3-1d66f960e3a5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:45.242511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70bab576-4cc6-44d6-97d3-1d66f960e3a5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:45.808920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-70bab576-4cc6-44d6-97d3-1d66f960e3a5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:45.819933 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-70bab576-4cc6-44d6-97d3-1d66f960e3a5 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 0.639573 Oct 29 02:53:45.821201 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1122/2222] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:45 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:45.840240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9baff9d3-8f0d-44e1-95a9-cab7935c4db4 req-dd0dfd0e-ea4e-4aa1-9e2b-efb7637e8a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "tag": "f768439c-3452-4070-b9fe-dc99900a9aba"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:45.879032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9baff9d3-8f0d-44e1-95a9-cab7935c4db4 req-dd0dfd0e-ea4e-4aa1-9e2b-efb7637e8a05 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:45.882182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9baff9d3-8f0d-44e1-95a9-cab7935c4db4 req-dd0dfd0e-ea4e-4aa1-9e2b-efb7637e8a05 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:45.883836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9baff9d3-8f0d-44e1-95a9-cab7935c4db4 req-dd0dfd0e-ea4e-4aa1-9e2b-efb7637e8a05 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:45.925931 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9baff9d3-8f0d-44e1-95a9-cab7935c4db4 req-dd0dfd0e-ea4e-4aa1-9e2b-efb7637e8a05 service nova] Creating event network-changed:f768439c-3452-4070-b9fe-dc99900a9aba for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:53:45.937591 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9baff9d3-8f0d-44e1-95a9-cab7935c4db4 req-dd0dfd0e-ea4e-4aa1-9e2b-efb7637e8a05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114653 Oct 29 02:53:45.946565 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1123/2223] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:45.960915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:45.962966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:45.980648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:45.986988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:45.988663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:45.991247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:45.992000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:45.993620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:46.022072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:46.035873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:46.041311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:46.044911 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4609aeab-bb57-4eaa-82f3-ff1c3a1277a3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1280 microversion: 2.25 time: 1.260318 Oct 29 02:53:46.049191 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1101/2224] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:44 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1280 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:46.422742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-34ed730f-3019-435e-abea-0633e6cca03f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Action: 'create', calling method: .version_select at 0x7fe1a8730a60>, body: {"keypair": {"name": "tempest-keypair-1820252728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQ4Y87LP2xj1pyd8xI7eLhrpLQufBjr5tR060X61scVweLs4Sa0VEOmeYdVAratgGnr91wQEYb+wvaypzRrJx/sOY9Fzly3mgiizKfJy5Jx4IQcDQUA84ypa4/59uSIEQ=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:46.482644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-34ed730f-3019-435e-abea-0633e6cca03f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Getting quotas for project 87111b9e962d4606a29bc7ad37b8d484. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:46.503845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-34ed730f-3019-435e-abea-0633e6cca03f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Getting quotas for user 2bccf42abb184f15ae36a855e0d8e68f and project 87111b9e962d4606a29bc7ad37b8d484. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:46.562393 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-34ed730f-3019-435e-abea-0633e6cca03f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.511428 Oct 29 02:53:46.563005 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1102/2225] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:53:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:46.579973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-618ee308-c503-4e87-b487-c37cbb8b374d tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:46.581124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-618ee308-c503-4e87-b487-c37cbb8b374d tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:46.604125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618ee308-c503-4e87-b487-c37cbb8b374d tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:46.606405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618ee308-c503-4e87-b487-c37cbb8b374d tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:46.607430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618ee308-c503-4e87-b487-c37cbb8b374d tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:46.609246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618ee308-c503-4e87-b487-c37cbb8b374d tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:46.612173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618ee308-c503-4e87-b487-c37cbb8b374d tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:46.612879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-618ee308-c503-4e87-b487-c37cbb8b374d tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:47.227159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:47.245143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:47.249112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:47.253038 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5438841-c676-4c26-897d-c0eafabbcdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1885 microversion: 2.32 time: 1.304872 Oct 29 02:53:47.271682 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1124/2226] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:45 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1885 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:47.287698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b44d06f-ed5d-46b6-8b75-77f44cd7a03f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8052160>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:47.365783 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b44d06f-ed5d-46b6-8b75-77f44cd7a03f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.092607 Oct 29 02:53:47.366713 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1125/2227] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:47 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:47.372175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-30bad4b6-825e-4fe8-8c29-efceb23f1453 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:47.384564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-30bad4b6-825e-4fe8-8c29-efceb23f1453 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:47.395382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30bad4b6-825e-4fe8-8c29-efceb23f1453 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:47.398174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30bad4b6-825e-4fe8-8c29-efceb23f1453 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:47.400850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30bad4b6-825e-4fe8-8c29-efceb23f1453 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:47.401837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30bad4b6-825e-4fe8-8c29-efceb23f1453 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:47.402468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30bad4b6-825e-4fe8-8c29-efceb23f1453 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:47.404044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30bad4b6-825e-4fe8-8c29-efceb23f1453 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:47.452146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-618ee308-c503-4e87-b487-c37cbb8b374d tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:47.466723 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-618ee308-c503-4e87-b487-c37cbb8b374d tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1322 microversion: 2.1 time: 0.899871 Oct 29 02:53:47.473963 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1103/2228] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:46 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1322 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:47.490329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f2796668-f50d-4b9c-8df1-89de43d4d922 req-020ded48-817f-4238-bfc0-45bb6e6afe39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c0253f5-cea4-471a-97d6-16c7702c07ee", "tag": "95d5adb4-6512-4e6f-9edb-c3dd7ee44c98"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:47.520799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f2796668-f50d-4b9c-8df1-89de43d4d922 req-020ded48-817f-4238-bfc0-45bb6e6afe39 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:47.521283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f2796668-f50d-4b9c-8df1-89de43d4d922 req-020ded48-817f-4238-bfc0-45bb6e6afe39 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:47.521763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f2796668-f50d-4b9c-8df1-89de43d4d922 req-020ded48-817f-4238-bfc0-45bb6e6afe39 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:47.578247 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f2796668-f50d-4b9c-8df1-89de43d4d922 req-020ded48-817f-4238-bfc0-45bb6e6afe39 service nova] Creating event network-changed:95d5adb4-6512-4e6f-9edb-c3dd7ee44c98 for instance 5c0253f5-cea4-471a-97d6-16c7702c07ee on n-h1-862964-4 Oct 29 02:53:47.597677 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f2796668-f50d-4b9c-8df1-89de43d4d922 req-020ded48-817f-4238-bfc0-45bb6e6afe39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122118 Oct 29 02:53:47.604005 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1104/2229] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:47.630239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-29948983-9bef-4e5f-848d-166f864b684a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:47.630976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-29948983-9bef-4e5f-848d-166f864b684a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:47.665242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29948983-9bef-4e5f-848d-166f864b684a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:47.665778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29948983-9bef-4e5f-848d-166f864b684a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:47.666262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29948983-9bef-4e5f-848d-166f864b684a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:47.671311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29948983-9bef-4e5f-848d-166f864b684a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:47.671794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29948983-9bef-4e5f-848d-166f864b684a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:47.672232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29948983-9bef-4e5f-848d-166f864b684a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:48.545863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-30bad4b6-825e-4fe8-8c29-efceb23f1453 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:48.577424 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-30bad4b6-825e-4fe8-8c29-efceb23f1453 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1211 microversion: 2.1 time: 1.209189 Oct 29 02:53:48.597839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1126/2230] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:47 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1211 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:48.597839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:48.597839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:48.626008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:48.626527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:48.626970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:48.627735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:48.630294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:48.630729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:48.862193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-29948983-9bef-4e5f-848d-166f864b684a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:48.870757 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-29948983-9bef-4e5f-848d-166f864b684a tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 1.263772 Oct 29 02:53:48.891899 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1105/2231] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:47 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:48.902586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:48.903254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:48.916406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:48.926668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:48.927122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:48.931251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:48.931727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:48.932159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:49.511576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:49.522029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:49.523487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:49.541416 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-19afc4c5-643d-402b-a43f-f1c097d04ad7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1475 microversion: 2.25 time: 0.953500 Oct 29 02:53:49.569416 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1127/2232] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:48 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1475 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:49.587604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af99169d-a0a7-43b4-ba18-7619e39057d5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1accffa60>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:49.739660 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af99169d-a0a7-43b4-ba18-7619e39057d5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.167339 Oct 29 02:53:49.740916 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1128/2233] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:49 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:49.755364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9497b2bb-a48c-47c2-9823-04888cef3748 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:49.755976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9497b2bb-a48c-47c2-9823-04888cef3748 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:49.787188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9497b2bb-a48c-47c2-9823-04888cef3748 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:49.787684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9497b2bb-a48c-47c2-9823-04888cef3748 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:49.798979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9497b2bb-a48c-47c2-9823-04888cef3748 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:49.803671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9497b2bb-a48c-47c2-9823-04888cef3748 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:49.804316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9497b2bb-a48c-47c2-9823-04888cef3748 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:49.804769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9497b2bb-a48c-47c2-9823-04888cef3748 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:50.260924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9497b2bb-a48c-47c2-9823-04888cef3748 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:50.273042 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9497b2bb-a48c-47c2-9823-04888cef3748 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1322 microversion: 2.1 time: 0.530678 Oct 29 02:53:50.277606 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1129/2234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:49 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:50.282737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-892c43e3-0dcb-445f-b7ab-3ada54e1c0b6 req-4e34069b-a836-42d1-adb7-2aa385925e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "tag": "6ee1db3a-b8f9-46be-9d54-08b853dc8555"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:50.293892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-892c43e3-0dcb-445f-b7ab-3ada54e1c0b6 req-4e34069b-a836-42d1-adb7-2aa385925e8f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:50.294673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-892c43e3-0dcb-445f-b7ab-3ada54e1c0b6 req-4e34069b-a836-42d1-adb7-2aa385925e8f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:50.295433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-892c43e3-0dcb-445f-b7ab-3ada54e1c0b6 req-4e34069b-a836-42d1-adb7-2aa385925e8f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:50.324009 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-892c43e3-0dcb-445f-b7ab-3ada54e1c0b6 req-4e34069b-a836-42d1-adb7-2aa385925e8f service nova] Creating event network-changed:6ee1db3a-b8f9-46be-9d54-08b853dc8555 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:53:50.337360 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-892c43e3-0dcb-445f-b7ab-3ada54e1c0b6 req-4e34069b-a836-42d1-adb7-2aa385925e8f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058589 Oct 29 02:53:50.339189 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1130/2235] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:50.727539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0ac49bde-74fe-4520-9959-a3d2fb03a02d tempest-ComputeTenantNetworksTest-1977913930 tempest-ComputeTenantNetworksTest-1977913930-project] Calling method '.version_select at 0x7fe1acaf3af0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:50.812568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:50.834061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:50.838362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:50.841227 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-624ad402-dbf5-4f3a-ba18-ec5fc54dbdaa tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1885 microversion: 2.32 time: 1.948105 Oct 29 02:53:50.844561 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1106/2236] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:48 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1885 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:51.063761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aa281266-4df3-40f0-ab9f-bcd3f08e3863 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:51.065172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aa281266-4df3-40f0-ab9f-bcd3f08e3863 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:51.078304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa281266-4df3-40f0-ab9f-bcd3f08e3863 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:51.092590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa281266-4df3-40f0-ab9f-bcd3f08e3863 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:51.094413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa281266-4df3-40f0-ab9f-bcd3f08e3863 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:51.097787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa281266-4df3-40f0-ab9f-bcd3f08e3863 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:51.103831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa281266-4df3-40f0-ab9f-bcd3f08e3863 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:51.104722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa281266-4df3-40f0-ab9f-bcd3f08e3863 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:51.533462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-aa281266-4df3-40f0-ab9f-bcd3f08e3863 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid b13b0f93-4ed1-4257-8a35-0db82db20bd7 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:53:51.569207 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aa281266-4df3-40f0-ab9f-bcd3f08e3863 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1967 microversion: 2.25 time: 0.718617 Oct 29 02:53:51.588339 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1107/2237] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:50 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1967 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:51.596622 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0ac49bde-74fe-4520-9959-a3d2fb03a02d tempest-ComputeTenantNetworksTest-1977913930 tempest-ComputeTenantNetworksTest-1977913930-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.251302 Oct 29 02:53:51.597660 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1131/2238] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:53:50 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:51.603305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c7843e98-c583-43d2-9113-f6abe2b86477 req-2f185e18-ae1e-4821-8205-47bf8231c151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e8fb7c-e71d-4e00-9806-7b2b295a32fa", "tag": "370d1fd9-7205-4c54-bdb3-e0ae1de142a0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:51.621706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-860ed7dc-5fe2-4615-ac18-01c7703e93f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:51.623409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-860ed7dc-5fe2-4615-ac18-01c7703e93f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:51.629769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c7843e98-c583-43d2-9113-f6abe2b86477 req-2f185e18-ae1e-4821-8205-47bf8231c151 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:51.630388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c7843e98-c583-43d2-9113-f6abe2b86477 req-2f185e18-ae1e-4821-8205-47bf8231c151 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:51.630806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c7843e98-c583-43d2-9113-f6abe2b86477 req-2f185e18-ae1e-4821-8205-47bf8231c151 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:51.642695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860ed7dc-5fe2-4615-ac18-01c7703e93f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:51.643712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860ed7dc-5fe2-4615-ac18-01c7703e93f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:51.644239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860ed7dc-5fe2-4615-ac18-01c7703e93f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:51.645762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860ed7dc-5fe2-4615-ac18-01c7703e93f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:51.646632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860ed7dc-5fe2-4615-ac18-01c7703e93f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:51.647155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860ed7dc-5fe2-4615-ac18-01c7703e93f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:51.688739 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c7843e98-c583-43d2-9113-f6abe2b86477 req-2f185e18-ae1e-4821-8205-47bf8231c151 service nova] Creating event network-changed:370d1fd9-7205-4c54-bdb3-e0ae1de142a0 for instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa on n-h2-862964-4 Oct 29 02:53:51.704089 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c7843e98-c583-43d2-9113-f6abe2b86477 req-2f185e18-ae1e-4821-8205-47bf8231c151 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103537 Oct 29 02:53:51.708637 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1132/2239] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:51.739339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dbddb252-9565-403a-bcb6-6cd55c476a8e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:51.743618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dbddb252-9565-403a-bcb6-6cd55c476a8e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:51.766209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbddb252-9565-403a-bcb6-6cd55c476a8e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:51.767634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbddb252-9565-403a-bcb6-6cd55c476a8e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:51.769689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbddb252-9565-403a-bcb6-6cd55c476a8e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:51.773035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbddb252-9565-403a-bcb6-6cd55c476a8e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:51.777319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbddb252-9565-403a-bcb6-6cd55c476a8e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:51.779452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbddb252-9565-403a-bcb6-6cd55c476a8e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:52.180616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-860ed7dc-5fe2-4615-ac18-01c7703e93f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:52.190220 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-860ed7dc-5fe2-4615-ac18-01c7703e93f7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1211 microversion: 2.1 time: 0.600495 Oct 29 02:53:52.194309 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1108/2240] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:51 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1211 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:52.215237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-7dbacc4f-9690-4c6c-ad8a-0a6aebd7efb6 req-c2ced587-01ef-4ec4-9066-f8072ec0d895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bcd54f-e117-4c84-8204-7c29fbea37df", "name": "network-vif-plugged", "status": "completed", "tag": "41ab2822-5c33-45f2-849f-d08bb9e71e63"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:52.215981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dbddb252-9565-403a-bcb6-6cd55c476a8e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:52.225258 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dbddb252-9565-403a-bcb6-6cd55c476a8e tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 0.514447 Oct 29 02:53:52.226468 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1133/2241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:51 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:52.231661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-62fa0236-1271-4745-8db6-aea2e22fa02b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acd05ca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:52.234138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7dbacc4f-9690-4c6c-ad8a-0a6aebd7efb6 req-c2ced587-01ef-4ec4-9066-f8072ec0d895 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:52.239546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7dbacc4f-9690-4c6c-ad8a-0a6aebd7efb6 req-c2ced587-01ef-4ec4-9066-f8072ec0d895 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:52.240584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7dbacc4f-9690-4c6c-ad8a-0a6aebd7efb6 req-c2ced587-01ef-4ec4-9066-f8072ec0d895 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:52.264700 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-7dbacc4f-9690-4c6c-ad8a-0a6aebd7efb6 req-c2ced587-01ef-4ec4-9066-f8072ec0d895 service nova] Creating event network-vif-plugged:41ab2822-5c33-45f2-849f-d08bb9e71e63 for instance 00bcd54f-e117-4c84-8204-7c29fbea37df on n-h2-862964-4 Oct 29 02:53:52.275489 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-7dbacc4f-9690-4c6c-ad8a-0a6aebd7efb6 req-c2ced587-01ef-4ec4-9066-f8072ec0d895 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076331 Oct 29 02:53:52.279327 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1109/2242] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:52.288301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-06181ab6-862e-44c9-8543-6ec1369775a5 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:52.288998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-06181ab6-862e-44c9-8543-6ec1369775a5 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:52.292507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:52.310288 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-62fa0236-1271-4745-8db6-aea2e22fa02b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.080983 Oct 29 02:53:52.311662 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1134/2243] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:52 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:52.317606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-975fdaab-e3d2-4b9f-a1fc-de3fda1c815b tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:52.318445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-975fdaab-e3d2-4b9f-a1fc-de3fda1c815b tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:52.326808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-975fdaab-e3d2-4b9f-a1fc-de3fda1c815b tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:52.327666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-975fdaab-e3d2-4b9f-a1fc-de3fda1c815b tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:52.331070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06181ab6-862e-44c9-8543-6ec1369775a5 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:52.331557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06181ab6-862e-44c9-8543-6ec1369775a5 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:52.331987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06181ab6-862e-44c9-8543-6ec1369775a5 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:52.332801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06181ab6-862e-44c9-8543-6ec1369775a5 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:52.333503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06181ab6-862e-44c9-8543-6ec1369775a5 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:52.334112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06181ab6-862e-44c9-8543-6ec1369775a5 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:52.340900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-975fdaab-e3d2-4b9f-a1fc-de3fda1c815b tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:52.342135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-975fdaab-e3d2-4b9f-a1fc-de3fda1c815b tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:52.342939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-975fdaab-e3d2-4b9f-a1fc-de3fda1c815b tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:52.343863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-975fdaab-e3d2-4b9f-a1fc-de3fda1c815b tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:52.716074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-975fdaab-e3d2-4b9f-a1fc-de3fda1c815b tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid b13b0f93-4ed1-4257-8a35-0db82db20bd7 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:53:52.742851 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-975fdaab-e3d2-4b9f-a1fc-de3fda1c815b tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1967 microversion: 2.25 time: 0.429455 Oct 29 02:53:52.744538 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1135/2244] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:52 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1967 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:52.751111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5917ce7d-3ad3-48ba-a4e5-1a8eeabc3116 tempest-ComputeTenantNetworksTest-1977913930 tempest-ComputeTenantNetworksTest-1977913930-project] Calling method '.version_select at 0x7fe1acaf3ee0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:52.871525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-06181ab6-862e-44c9-8543-6ec1369775a5 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:52.885335 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-06181ab6-862e-44c9-8543-6ec1369775a5 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1322 microversion: 2.1 time: 0.602129 Oct 29 02:53:52.887913 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1110/2245] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:52 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:52.898848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:52.901833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:52.926015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:52.927000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:52.927639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:52.929227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:52.930258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:52.930981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.005930 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5917ce7d-3ad3-48ba-a4e5-1a8eeabc3116 tempest-ComputeTenantNetworksTest-1977913930 tempest-ComputeTenantNetworksTest-1977913930-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/9a3bf205-58eb-4ee3-bc3d-b8912a4ae3bd" status: 200 len: 139 microversion: 2.1 time: 0.260110 Oct 29 02:53:53.007124 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1136/2246] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:53:52 2022] GET /compute/v2.1/os-tenant-networks/9a3bf205-58eb-4ee3-bc3d-b8912a4ae3bd => generated 139 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:53.011821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fd3dc627-3dce-46f4-adb2-22b271a66ef6 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:53.015857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd3dc627-3dce-46f4-adb2-22b271a66ef6 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.023091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd3dc627-3dce-46f4-adb2-22b271a66ef6 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.023785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd3dc627-3dce-46f4-adb2-22b271a66ef6 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.024767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd3dc627-3dce-46f4-adb2-22b271a66ef6 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.025393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd3dc627-3dce-46f4-adb2-22b271a66ef6 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.026050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd3dc627-3dce-46f4-adb2-22b271a66ef6 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.076383 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fd3dc627-3dce-46f4-adb2-22b271a66ef6 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.068008 Oct 29 02:53:53.086996 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1137/2247] 10.222.0.16 () {60 vars in 1217 bytes} [Sat Oct 29 02:53:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:53:53.100806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ba3893f3-1d8e-4348-ad78-ef54d5fb512e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-4", "block_migration": "auto"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:53.104190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ba3893f3-1d8e-4348-ad78-ef54d5fb512e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:53.121840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3893f3-1d8e-4348-ad78-ef54d5fb512e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.122637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3893f3-1d8e-4348-ad78-ef54d5fb512e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.123256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3893f3-1d8e-4348-ad78-ef54d5fb512e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.124135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3893f3-1d8e-4348-ad78-ef54d5fb512e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.124745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3893f3-1d8e-4348-ad78-ef54d5fb512e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.132013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3893f3-1d8e-4348-ad78-ef54d5fb512e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.177877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-ba3893f3-1d8e-4348-ad78-ef54d5fb512e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'flavor' on Instance uuid b13b0f93-4ed1-4257-8a35-0db82db20bd7 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:53:53.207528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ba3893f3-1d8e-4348-ad78-ef54d5fb512e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Going to try to live migrate instance to n-h2-862964-4 {{(pid=127041) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:53:53.408458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:53.444559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:53.446800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:53.456014 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e368b33f-847f-4107-9d30-74fceebf906a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1885 microversion: 2.32 time: 0.557928 Oct 29 02:53:53.457824 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1111/2248] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:52 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1885 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:53.464210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-532e8955-4e6a-4596-b2bf-650d490f7d2a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:53.465615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-532e8955-4e6a-4596-b2bf-650d490f7d2a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:53.496623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-532e8955-4e6a-4596-b2bf-650d490f7d2a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.498498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-532e8955-4e6a-4596-b2bf-650d490f7d2a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.499138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-532e8955-4e6a-4596-b2bf-650d490f7d2a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.500146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-532e8955-4e6a-4596-b2bf-650d490f7d2a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.501205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-532e8955-4e6a-4596-b2bf-650d490f7d2a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.501930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-532e8955-4e6a-4596-b2bf-650d490f7d2a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.904007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-532e8955-4e6a-4596-b2bf-650d490f7d2a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:53.934488 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-532e8955-4e6a-4596-b2bf-650d490f7d2a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1199 microversion: 2.1 time: 0.474993 Oct 29 02:53:53.939287 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1112/2249] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:53 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1199 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:53.949858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eb929a71-899e-46fb-96c7-8d2cce67d249 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:53.955455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eb929a71-899e-46fb-96c7-8d2cce67d249 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:53.969519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb929a71-899e-46fb-96c7-8d2cce67d249 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.970461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb929a71-899e-46fb-96c7-8d2cce67d249 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.976145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb929a71-899e-46fb-96c7-8d2cce67d249 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.983019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb929a71-899e-46fb-96c7-8d2cce67d249 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.986882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb929a71-899e-46fb-96c7-8d2cce67d249 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.988465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb929a71-899e-46fb-96c7-8d2cce67d249 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:54.570990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eb929a71-899e-46fb-96c7-8d2cce67d249 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:54.580556 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eb929a71-899e-46fb-96c7-8d2cce67d249 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 0.639838 Oct 29 02:53:54.581145 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1113/2250] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:53 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:54.587179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ddfe95a-36b7-45a9-8780-79d52d7a36ff tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a84e65e0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:54.672002 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ddfe95a-36b7-45a9-8780-79d52d7a36ff tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.089051 Oct 29 02:53:54.688563 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1114/2251] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:54 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:54.697239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-532f1064-fb6f-42ca-80c4-4256dbb82a1d req-c10a90b3-cec9-4952-a61b-55dbd5819952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e8fb7c-e71d-4e00-9806-7b2b295a32fa", "tag": "41e4be31-a897-46bb-b7f6-4f6dac346a37"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:54.724381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-532f1064-fb6f-42ca-80c4-4256dbb82a1d req-c10a90b3-cec9-4952-a61b-55dbd5819952 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:54.725218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-532f1064-fb6f-42ca-80c4-4256dbb82a1d req-c10a90b3-cec9-4952-a61b-55dbd5819952 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:54.725743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-532f1064-fb6f-42ca-80c4-4256dbb82a1d req-c10a90b3-cec9-4952-a61b-55dbd5819952 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:54.738888 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-532f1064-fb6f-42ca-80c4-4256dbb82a1d req-c10a90b3-cec9-4952-a61b-55dbd5819952 service nova] Creating event network-changed:41e4be31-a897-46bb-b7f6-4f6dac346a37 for instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa on n-h2-862964-4 Oct 29 02:53:54.745841 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-532f1064-fb6f-42ca-80c4-4256dbb82a1d req-c10a90b3-cec9-4952-a61b-55dbd5819952 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054063 Oct 29 02:53:54.747121 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1115/2252] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:54.753062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-798d3f00-ff21-45b9-b166-bbbc95348b4f tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:54.754173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-798d3f00-ff21-45b9-b166-bbbc95348b4f tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:54.762127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-798d3f00-ff21-45b9-b166-bbbc95348b4f tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:54.763087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-798d3f00-ff21-45b9-b166-bbbc95348b4f tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:54.764519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-798d3f00-ff21-45b9-b166-bbbc95348b4f tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:54.765546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-798d3f00-ff21-45b9-b166-bbbc95348b4f tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:54.766420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-798d3f00-ff21-45b9-b166-bbbc95348b4f tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:54.768094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-798d3f00-ff21-45b9-b166-bbbc95348b4f tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:55.126311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-798d3f00-ff21-45b9-b166-bbbc95348b4f tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:55.151158 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-798d3f00-ff21-45b9-b166-bbbc95348b4f tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1472 microversion: 2.1 time: 0.387794 Oct 29 02:53:55.153503 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1116/2253] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:54 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1472 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:55.169406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1155662012", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a2c03d08-7d48-4945-901a-38ba2f60845a"}], "security_groups": [{"name": "tempest-securitygroup--1495810913"}], "key_name": "tempest-keypair-1820252728", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:55.480980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] validate_networks() for [('a2c03d08-7d48-4945-901a-38ba2f60845a', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:56.146699 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ba3893f3-1d8e-4348-ad78-ef54d5fb512e tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7/action" status: 202 len: 0 microversion: 2.25 time: 3.050494 Oct 29 02:53:56.147104 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1138/2254] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:53:53 2022] POST /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7/action => generated 0 bytes in 3052 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:53:56.151891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:56.153229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:56.157104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Getting quotas for project 87111b9e962d4606a29bc7ad37b8d484. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:56.173082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.173682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.174396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.175337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.175704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Getting quotas for user 2bccf42abb184f15ae36a855e0d8e68f and project 87111b9e962d4606a29bc7ad37b8d484. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:56.176315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.176921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.210825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:56.211244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:56.211714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:56.216922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:56.218845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:56.220305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:56.251434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.252450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.254157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.255581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.256433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.257108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.282529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Getting quotas for project 87111b9e962d4606a29bc7ad37b8d484. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:56.292436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Getting quotas for user 2bccf42abb184f15ae36a855e0d8e68f and project 87111b9e962d4606a29bc7ad37b8d484. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:56.312746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:53:56.316525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:53:56.399653 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6475ad7c-d0ed-42f4-a3fb-15fd0f307c10 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.243036 Oct 29 02:53:56.408786 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1117/2255] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:53:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:53:56.421781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9dbaea27-7e47-44d3-8cd9-d9102765786e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:56.425598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9dbaea27-7e47-44d3-8cd9-d9102765786e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:56.433596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dbaea27-7e47-44d3-8cd9-d9102765786e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.434133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dbaea27-7e47-44d3-8cd9-d9102765786e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.434571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dbaea27-7e47-44d3-8cd9-d9102765786e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.435359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dbaea27-7e47-44d3-8cd9-d9102765786e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.435814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dbaea27-7e47-44d3-8cd9-d9102765786e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.436393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dbaea27-7e47-44d3-8cd9-d9102765786e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.473325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:56.668641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:56.682793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:56.684940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:56.686438 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ccb350c-e7f6-4c9d-aa52-35b8865082a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.538261 Oct 29 02:53:56.702893 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1139/2256] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:56 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:56.711339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9dbaea27-7e47-44d3-8cd9-d9102765786e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:56.712559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:56.713254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:56.720892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.721701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.722366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.723294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.723930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.724553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.733795 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9dbaea27-7e47-44d3-8cd9-d9102765786e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1199 microversion: 2.1 time: 0.323743 Oct 29 02:53:56.735439 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1118/2257] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:56 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1199 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:56.747177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-69dd242f-4a94-49aa-8dc8-820ba208d593 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:56.749333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-69dd242f-4a94-49aa-8dc8-820ba208d593 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:56.764995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:56.767726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69dd242f-4a94-49aa-8dc8-820ba208d593 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.768355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69dd242f-4a94-49aa-8dc8-820ba208d593 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.770347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69dd242f-4a94-49aa-8dc8-820ba208d593 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.771992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69dd242f-4a94-49aa-8dc8-820ba208d593 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.772472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69dd242f-4a94-49aa-8dc8-820ba208d593 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.772949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69dd242f-4a94-49aa-8dc8-820ba208d593 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Request method failure captured: Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df/diagnostics HTTP/1.1 Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJWjZXJiGF-1npHTt3Mig3bpxDTtG_9N7nbcV3X2vAFmgIY7xXbHz6fGNiaQ8jd5gogoql7_QJlJDV-B0psFazV8PvHx6ixYSXSpfPRNFzS73GvZ9Two2Qwjr5iyOxSC8OHw8ChIqa_U-bs3V1-wd6RqE7rVwnfUqym4yZu4KlHLNvc Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4935f9a2442d43a8bfc4e2a18c542c08 Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-225443977 Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4935f9a2442d43a8bfc4e2a18c542c08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4935f9a2442d43a8bfc4e2a18c542c08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4935f9a2442d43a8bfc4e2a18c542c08", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4935f9a2442d43a8bfc4e2a18c542c08"}]}] Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-225443977 Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4935f9a2442d43a8bfc4e2a18c542c08 Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-225443977 Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerDiagnosticsNegativeTest-225443977-project Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: aa3cb8ca820c4976beb0f156d53c6bdd Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-225443977-project Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'server_id': '00bcd54f-e117-4c84-8204-7c29fbea37df'} Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:56.773927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:56.779465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:56.779465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:56.779465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:53:56.779465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:53:56.779465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 02:53:56.779465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:53:56.782231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:56.783835 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7b5337d8-c7b2-4237-8bf7-8a45fd2ee71b tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.079513 Oct 29 02:53:56.784468 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1140/2258] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:53:56 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df/diagnostics => generated 117 bytes in 81 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:53:56.793487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-937ab6d7-9699-4571-b354-60e053a1aa44 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acd4a9d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:56.866117 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-937ab6d7-9699-4571-b354-60e053a1aa44 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.079893 Oct 29 02:53:56.902844 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1141/2259] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:56 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:56.902844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:56.902844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:56.902844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.902844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.902844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.902844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.902844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.902844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.052386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69dd242f-4a94-49aa-8dc8-820ba208d593 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:57.065782 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-69dd242f-4a94-49aa-8dc8-820ba208d593 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 0.329000 Oct 29 02:53:57.075013 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1119/2260] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:56 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:57.085899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6597df5-1268-4c57-a271-eef35c876e60 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.086161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:57.087014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b6597df5-1268-4c57-a271-eef35c876e60 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:57.097845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:57.099794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:57.101461 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.233469 Oct 29 02:53:57.102903 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1142/2261] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:56 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:57.104391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.105662 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f9d38f4a-f6c3-43fd-8e7c-6c12788844b3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001545 Oct 29 02:53:57.106705 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1143/2262] 10.222.0.16 () {56 vars in 886 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 02:53:57.113048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be47fc07-7ce8-4247-b6e8-4a2bc570a704 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.113920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be47fc07-7ce8-4247-b6e8-4a2bc570a704 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:57.121971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be47fc07-7ce8-4247-b6e8-4a2bc570a704 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:57.122884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be47fc07-7ce8-4247-b6e8-4a2bc570a704 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:57.123550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be47fc07-7ce8-4247-b6e8-4a2bc570a704 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.124667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be47fc07-7ce8-4247-b6e8-4a2bc570a704 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:57.125367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be47fc07-7ce8-4247-b6e8-4a2bc570a704 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:57.126324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be47fc07-7ce8-4247-b6e8-4a2bc570a704 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.154930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b6597df5-1268-4c57-a271-eef35c876e60 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:57.160622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be47fc07-7ce8-4247-b6e8-4a2bc570a704 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:53:57.166901 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6597df5-1268-4c57-a271-eef35c876e60 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1278 microversion: 2.1 time: 0.090105 Oct 29 02:53:57.181587 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1120/2263] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1278 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:57.185348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6597df5-1268-4c57-a271-eef35c876e60 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.191572 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6597df5-1268-4c57-a271-eef35c876e60 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.007175 Oct 29 02:53:57.193109 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1121/2264] 10.222.0.16 () {54 vars in 1035 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/v2/ => generated 379 bytes in 11 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 29 02:53:57.201285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6597df5-1268-4c57-a271-eef35c876e60 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.202890 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6597df5-1268-4c57-a271-eef35c876e60 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001904 Oct 29 02:53:57.218480 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1122/2265] 10.222.0.16 () {54 vars in 1041 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/v2.1/ => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:57.220362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6597df5-1268-4c57-a271-eef35c876e60 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.223100 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6597df5-1268-4c57-a271-eef35c876e60 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003125 Oct 29 02:53:57.226994 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1123/2266] 10.222.0.16 () {56 vars in 886 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 02:53:57.320286 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-be47fc07-7ce8-4247-b6e8-4a2bc570a704 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "DELETE /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 204 len: 0 microversion: 2.1 time: 0.211770 Oct 29 02:53:57.323834 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1144/2267] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:53:57 2022] DELETE /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:57.333693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8796c057-e5de-414a-8566-5040a0c320a6 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.334358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8796c057-e5de-414a-8566-5040a0c320a6 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:57.345832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8796c057-e5de-414a-8566-5040a0c320a6 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:57.348433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8796c057-e5de-414a-8566-5040a0c320a6 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:57.349252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8796c057-e5de-414a-8566-5040a0c320a6 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.350029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8796c057-e5de-414a-8566-5040a0c320a6 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:57.350479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8796c057-e5de-414a-8566-5040a0c320a6 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:57.350885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8796c057-e5de-414a-8566-5040a0c320a6 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.566830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8796c057-e5de-414a-8566-5040a0c320a6 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:57.576174 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8796c057-e5de-414a-8566-5040a0c320a6 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1478 microversion: 2.1 time: 0.248188 Oct 29 02:53:57.590608 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1124/2268] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1478 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:53:57.721229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.722458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:57.730537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:57.731607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:57.732514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.733209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:57.734030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:57.734528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.763608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e39705f4-9269-4681-8410-8f40cdf55d3c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.764335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e39705f4-9269-4681-8410-8f40cdf55d3c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:57.801934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e39705f4-9269-4681-8410-8f40cdf55d3c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:57.804303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e39705f4-9269-4681-8410-8f40cdf55d3c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:57.805263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e39705f4-9269-4681-8410-8f40cdf55d3c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.807563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e39705f4-9269-4681-8410-8f40cdf55d3c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:57.819212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e39705f4-9269-4681-8410-8f40cdf55d3c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:57.820185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e39705f4-9269-4681-8410-8f40cdf55d3c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.049401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e39705f4-9269-4681-8410-8f40cdf55d3c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:58.053972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:58.060110 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e39705f4-9269-4681-8410-8f40cdf55d3c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1199 microversion: 2.1 time: 0.302002 Oct 29 02:53:58.062297 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1125/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1199 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:58.070192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:58.071939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:58.073033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-16f98c16-fb49-41b3-957e-c0cc397b0cfc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8730ca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:58.073551 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-19b767f3-595b-4dc0-8dd5-7a74f6ea6001 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.357836 Oct 29 02:53:58.074811 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1145/2270] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:53:58.091382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-35d33521-34fa-42ac-9025-e5830a89e360 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:58.092008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-35d33521-34fa-42ac-9025-e5830a89e360 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:58.103410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d33521-34fa-42ac-9025-e5830a89e360 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.104184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d33521-34fa-42ac-9025-e5830a89e360 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.104797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d33521-34fa-42ac-9025-e5830a89e360 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.106346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d33521-34fa-42ac-9025-e5830a89e360 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.107033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d33521-34fa-42ac-9025-e5830a89e360 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.108183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d33521-34fa-42ac-9025-e5830a89e360 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.144594 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-16f98c16-fb49-41b3-957e-c0cc397b0cfc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.081105 Oct 29 02:53:58.146116 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1126/2271] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:58 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:58.151627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:58.152542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:58.163524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.164693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.166017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.167160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.168445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.169328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.355601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-35d33521-34fa-42ac-9025-e5830a89e360 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:58.367880 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-35d33521-34fa-42ac-9025-e5830a89e360 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 0.281058 Oct 29 02:53:58.370317 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1146/2272] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:58 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:58.389943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ebbbabb2-6f09-43a5-a77e-b9e599992645 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:58.389943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ebbbabb2-6f09-43a5-a77e-b9e599992645 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:58.402069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebbbabb2-6f09-43a5-a77e-b9e599992645 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.402598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebbbabb2-6f09-43a5-a77e-b9e599992645 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.403041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebbbabb2-6f09-43a5-a77e-b9e599992645 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.407535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebbbabb2-6f09-43a5-a77e-b9e599992645 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.411642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebbbabb2-6f09-43a5-a77e-b9e599992645 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.412246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebbbabb2-6f09-43a5-a77e-b9e599992645 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.543028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ebbbabb2-6f09-43a5-a77e-b9e599992645 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:58.561762 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ebbbabb2-6f09-43a5-a77e-b9e599992645 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1282 microversion: 2.1 time: 0.180682 Oct 29 02:53:58.562732 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1147/2273] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:58 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:58.602559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-daffe6f6-03b9-4afa-939e-c9924be12448 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:58.603614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-daffe6f6-03b9-4afa-939e-c9924be12448 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:58.610703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-daffe6f6-03b9-4afa-939e-c9924be12448 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.611812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-daffe6f6-03b9-4afa-939e-c9924be12448 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.612506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-daffe6f6-03b9-4afa-939e-c9924be12448 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.613479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-daffe6f6-03b9-4afa-939e-c9924be12448 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.614220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-daffe6f6-03b9-4afa-939e-c9924be12448 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.615054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-daffe6f6-03b9-4afa-939e-c9924be12448 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.947246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-daffe6f6-03b9-4afa-939e-c9924be12448 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:58.956438 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-daffe6f6-03b9-4afa-939e-c9924be12448 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1478 microversion: 2.1 time: 0.357684 Oct 29 02:53:58.963413 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1148/2274] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:58 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1478 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:53:58.992063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:59.001285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:59.007762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:59.009050 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-888dd302-58e3-4aef-9d04-438e2613d187 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.861787 Oct 29 02:53:59.018872 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1127/2275] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:58 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:59.083807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2d32e87c-e491-4fb3-8b35-f0925d79c948 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:59.084756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2d32e87c-e491-4fb3-8b35-f0925d79c948 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:59.095970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d32e87c-e491-4fb3-8b35-f0925d79c948 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:59.098778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d32e87c-e491-4fb3-8b35-f0925d79c948 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:59.099779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d32e87c-e491-4fb3-8b35-f0925d79c948 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:59.102655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d32e87c-e491-4fb3-8b35-f0925d79c948 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:59.103309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d32e87c-e491-4fb3-8b35-f0925d79c948 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:59.103912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d32e87c-e491-4fb3-8b35-f0925d79c948 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:59.104558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:59.105180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:59.115536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:59.116034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:59.116473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:59.117199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:59.117779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:59.118090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:59.499465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2d32e87c-e491-4fb3-8b35-f0925d79c948 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:59.511569 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2d32e87c-e491-4fb3-8b35-f0925d79c948 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1199 microversion: 2.1 time: 0.432935 Oct 29 02:53:59.512161 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1149/2276] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:59 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1199 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:59.524101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-97ed14b4-66ad-4c27-8112-fc780597d53b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1accffd30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:59.604889 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-97ed14b4-66ad-4c27-8112-fc780597d53b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.084946 Oct 29 02:53:59.605488 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1150/2277] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:59 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:59.638849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ffd3a71-07b0-4c42-82da-829b5d495270 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:59.639515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2ffd3a71-07b0-4c42-82da-829b5d495270 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:59.649597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffd3a71-07b0-4c42-82da-829b5d495270 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:59.654881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffd3a71-07b0-4c42-82da-829b5d495270 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:59.655645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffd3a71-07b0-4c42-82da-829b5d495270 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:59.657415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffd3a71-07b0-4c42-82da-829b5d495270 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:59.658365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffd3a71-07b0-4c42-82da-829b5d495270 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:59.658988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ffd3a71-07b0-4c42-82da-829b5d495270 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:59.947015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:59.950436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2ffd3a71-07b0-4c42-82da-829b5d495270 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:59.959672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:59.960629 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ffd3a71-07b0-4c42-82da-829b5d495270 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 0.353368 Oct 29 02:53:59.966802 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1151/2278] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:59 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:59.986283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-115ef996-3150-4f9a-bf16-2f34fe8638c7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:59.987238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-115ef996-3150-4f9a-bf16-2f34fe8638c7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:59.994351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-115ef996-3150-4f9a-bf16-2f34fe8638c7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:59.995115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-115ef996-3150-4f9a-bf16-2f34fe8638c7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:59.996069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-115ef996-3150-4f9a-bf16-2f34fe8638c7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:59.997518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-115ef996-3150-4f9a-bf16-2f34fe8638c7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:59.998196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-115ef996-3150-4f9a-bf16-2f34fe8638c7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:59.998976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-115ef996-3150-4f9a-bf16-2f34fe8638c7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.000375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:00.016240 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0d568d78-c0f6-48d2-9ce9-6351b67a2811 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.915377 Oct 29 02:54:00.021987 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1128/2279] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:59 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:54:00.034088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-11534a0a-3450-43b8-9d8c-ea817d6484c7 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:00.042642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-11534a0a-3450-43b8-9d8c-ea817d6484c7 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:00.064229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11534a0a-3450-43b8-9d8c-ea817d6484c7 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.065817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11534a0a-3450-43b8-9d8c-ea817d6484c7 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.072257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11534a0a-3450-43b8-9d8c-ea817d6484c7 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.074958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11534a0a-3450-43b8-9d8c-ea817d6484c7 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.075476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11534a0a-3450-43b8-9d8c-ea817d6484c7 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.080572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11534a0a-3450-43b8-9d8c-ea817d6484c7 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.277476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-115ef996-3150-4f9a-bf16-2f34fe8638c7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:00.294829 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-115ef996-3150-4f9a-bf16-2f34fe8638c7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1330 microversion: 2.1 time: 0.323026 Oct 29 02:54:00.300388 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1152/2280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:59 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1330 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:00.323413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:00.333502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:00.349722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.351185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.353105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.365501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.367650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.370099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.746632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:00.764856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:00.768226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:00.770592 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-149d5f8d-8faa-4c5b-8749-a2ddadb73358 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.465403 Oct 29 02:54:00.771834 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1153/2281] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:00 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:00.778116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3364a09-6f33-4f71-9d56-c511162dbcd9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:00.778997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a3364a09-6f33-4f71-9d56-c511162dbcd9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:00.787364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3364a09-6f33-4f71-9d56-c511162dbcd9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.788100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3364a09-6f33-4f71-9d56-c511162dbcd9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.788738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3364a09-6f33-4f71-9d56-c511162dbcd9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.789755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3364a09-6f33-4f71-9d56-c511162dbcd9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.790717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3364a09-6f33-4f71-9d56-c511162dbcd9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.791471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3364a09-6f33-4f71-9d56-c511162dbcd9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.877465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-11534a0a-3450-43b8-9d8c-ea817d6484c7 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:00.895527 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-11534a0a-3450-43b8-9d8c-ea817d6484c7 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1478 microversion: 2.1 time: 0.868844 Oct 29 02:54:00.910425 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1129/2282] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:00 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1478 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:00.932285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87b0e34b-0973-4bd7-84a9-06e923d78c9c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acd3bdc0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:01.036837 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-87b0e34b-0973-4bd7-84a9-06e923d78c9c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.128092 Oct 29 02:54:01.040502 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1130/2283] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:00 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:01.060905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4cb1213c-400d-4ae0-8606-f122ef5b14e7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:01.065132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4cb1213c-400d-4ae0-8606-f122ef5b14e7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:01.102120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cb1213c-400d-4ae0-8606-f122ef5b14e7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:01.104433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cb1213c-400d-4ae0-8606-f122ef5b14e7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:01.106713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cb1213c-400d-4ae0-8606-f122ef5b14e7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:01.110658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cb1213c-400d-4ae0-8606-f122ef5b14e7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:01.116703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cb1213c-400d-4ae0-8606-f122ef5b14e7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:01.117476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cb1213c-400d-4ae0-8606-f122ef5b14e7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:01.143911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3364a09-6f33-4f71-9d56-c511162dbcd9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:01.161120 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3364a09-6f33-4f71-9d56-c511162dbcd9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1199 microversion: 2.1 time: 0.387861 Oct 29 02:54:01.182890 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1154/2284] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:00 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1199 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:01.192386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:01.193087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:01.209409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:01.210407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:01.211009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:01.213338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:01.214346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:01.216155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:01.686020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:01.697886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:01.755003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:01.755003 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b93a6011-9aa3-4792-ba38-2c9d6bc5a4fb tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.517112 Oct 29 02:54:01.755003 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1155/2285] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:01 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:01.755003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-472da29f-f8bf-4670-add4-e5e0d5f70442 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:01.755003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-472da29f-f8bf-4670-add4-e5e0d5f70442 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:01.755003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472da29f-f8bf-4670-add4-e5e0d5f70442 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:01.755003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472da29f-f8bf-4670-add4-e5e0d5f70442 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:01.755003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472da29f-f8bf-4670-add4-e5e0d5f70442 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:01.755003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472da29f-f8bf-4670-add4-e5e0d5f70442 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:01.755003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472da29f-f8bf-4670-add4-e5e0d5f70442 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:01.755003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-472da29f-f8bf-4670-add4-e5e0d5f70442 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:01.830893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-472da29f-f8bf-4670-add4-e5e0d5f70442 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:01.841583 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-472da29f-f8bf-4670-add4-e5e0d5f70442 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1336 microversion: 2.1 time: 0.137998 Oct 29 02:54:01.861142 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1156/2286] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:01 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1336 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:01.869684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:01.871270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:01.878105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:01.878738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:01.879279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:01.880138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:01.880701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:01.881749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.139142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:02.145732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:02.164203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:02.168039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:02.169283 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8e24b33a-76e9-4d63-b381-e5789d9e7e11 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.306285 Oct 29 02:54:02.188595 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1157/2287] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:01 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:02.203656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:02.208021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:02.209707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cb1213c-400d-4ae0-8606-f122ef5b14e7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:02.220637 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4cb1213c-400d-4ae0-8606-f122ef5b14e7 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 1.178125 Oct 29 02:54:02.222769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.223150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.223592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.224312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.224766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.225190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.239256 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1131/2288] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:01 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:02.261243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-cf10d463-3883-438e-b0fb-059ae69fe11d req-7fec476a-121d-4dd8-8601-2b33365ec7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0253f5-cea4-471a-97d6-16c7702c07ee", "name": "network-vif-plugged", "status": "completed", "tag": "95d5adb4-6512-4e6f-9edb-c3dd7ee44c98"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:02.295283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cf10d463-3883-438e-b0fb-059ae69fe11d req-7fec476a-121d-4dd8-8601-2b33365ec7b9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.295787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cf10d463-3883-438e-b0fb-059ae69fe11d req-7fec476a-121d-4dd8-8601-2b33365ec7b9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.298483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cf10d463-3883-438e-b0fb-059ae69fe11d req-7fec476a-121d-4dd8-8601-2b33365ec7b9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.328335 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-cf10d463-3883-438e-b0fb-059ae69fe11d req-7fec476a-121d-4dd8-8601-2b33365ec7b9 service nova] Creating event network-vif-plugged:95d5adb4-6512-4e6f-9edb-c3dd7ee44c98 for instance 5c0253f5-cea4-471a-97d6-16c7702c07ee on n-h1-862964-4 Oct 29 02:54:02.353768 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-cf10d463-3883-438e-b0fb-059ae69fe11d req-7fec476a-121d-4dd8-8601-2b33365ec7b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112010 Oct 29 02:54:02.355563 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1132/2289] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:02.370823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-52fa89bc-1cfb-4b45-8c86-3f65cf725ebb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a898af70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:02.398263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.398753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.420994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.421471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lazy-loading 'fault' on Instance uuid 00bcd54f-e117-4c84-8204-7c29fbea37df {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:54:02.489938 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-52fa89bc-1cfb-4b45-8c86-3f65cf725ebb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.133117 Oct 29 02:54:02.490528 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1133/2290] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:02 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:02.509769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cb8ca820c4976beb0f156d53c6bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935f9a2442d43a8bfc4e2a18c542c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:02.513731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-00111d46-51a2-4e03-b72b-f53db1ede030 req-ee60d5b6-3d96-4110-a115-c96f232a75f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bcd54f-e117-4c84-8204-7c29fbea37df", "name": "network-vif-deleted", "tag": "41ab2822-5c33-45f2-849f-d08bb9e71e63"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:02.523757 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-22645b6c-8289-4c9c-a69b-c88c325f4b9e tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 200 len: 1312 microversion: 2.1 time: 0.331777 Oct 29 02:54:02.543066 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1158/2291] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:02 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 1312 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:02.562289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-00111d46-51a2-4e03-b72b-f53db1ede030 req-ee60d5b6-3d96-4110-a115-c96f232a75f0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.562774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-00111d46-51a2-4e03-b72b-f53db1ede030 req-ee60d5b6-3d96-4110-a115-c96f232a75f0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.571145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-00111d46-51a2-4e03-b72b-f53db1ede030 req-ee60d5b6-3d96-4110-a115-c96f232a75f0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.578158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-24de5859-c051-49b3-9cc1-cfcf217391c2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:02.579446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-24de5859-c051-49b3-9cc1-cfcf217391c2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:02.592274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24de5859-c051-49b3-9cc1-cfcf217391c2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.593050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24de5859-c051-49b3-9cc1-cfcf217391c2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.594037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24de5859-c051-49b3-9cc1-cfcf217391c2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.605340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24de5859-c051-49b3-9cc1-cfcf217391c2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.607480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24de5859-c051-49b3-9cc1-cfcf217391c2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.608074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24de5859-c051-49b3-9cc1-cfcf217391c2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.621776 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-00111d46-51a2-4e03-b72b-f53db1ede030 req-ee60d5b6-3d96-4110-a115-c96f232a75f0 service nova] Creating event network-vif-deleted:41ab2822-5c33-45f2-849f-d08bb9e71e63 for instance 00bcd54f-e117-4c84-8204-7c29fbea37df on n-h2-862964-4 Oct 29 02:54:02.647970 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-00111d46-51a2-4e03-b72b-f53db1ede030 req-ee60d5b6-3d96-4110-a115-c96f232a75f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156126 Oct 29 02:54:02.652151 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1134/2292] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:02.734394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:02.736011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:02.755416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.757794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.758452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.760496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.762235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.762867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.946484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-24de5859-c051-49b3-9cc1-cfcf217391c2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:02.958181 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-24de5859-c051-49b3-9cc1-cfcf217391c2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1199 microversion: 2.1 time: 0.412609 Oct 29 02:54:02.976181 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1159/2293] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:02 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1199 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:02.987608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-db699641-3799-47d2-ad03-17a3cfceeb4b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:02.988246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db699641-3799-47d2-ad03-17a3cfceeb4b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:02.993851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:02.996665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db699641-3799-47d2-ad03-17a3cfceeb4b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.997300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db699641-3799-47d2-ad03-17a3cfceeb4b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.997745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db699641-3799-47d2-ad03-17a3cfceeb4b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.998488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db699641-3799-47d2-ad03-17a3cfceeb4b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.998943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db699641-3799-47d2-ad03-17a3cfceeb4b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.999357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db699641-3799-47d2-ad03-17a3cfceeb4b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.041068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:03.138102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-db699641-3799-47d2-ad03-17a3cfceeb4b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:03.156088 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-db699641-3799-47d2-ad03-17a3cfceeb4b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1336 microversion: 2.1 time: 0.175303 Oct 29 02:54:03.158289 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1160/2294] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:02 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1336 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:03.202315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:03.203330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:03.212794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:03.214256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:03.214921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.215807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:03.216467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:03.217073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.478025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:03.506230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:03.521515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:03.522827 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2d1d85a1-4837-4330-8f55-d227b8561670 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.793840 Oct 29 02:54:03.523423 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1135/2295] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:02 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:03.524902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:03.549088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6728d694-abc8-494f-9d6e-a001586d194b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:03.551666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:03.554840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:03.558825 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b869374e-0c7c-4ffd-bedf-b2998eb4802b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.364104 Oct 29 02:54:03.561927 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1161/2296] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:03 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:54:03.579272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-589d60cd-6b1f-45b9-9ef7-4c81dfc799e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acc435e0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:03.589437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6728d694-abc8-494f-9d6e-a001586d194b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:03.625232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6728d694-abc8-494f-9d6e-a001586d194b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:03.625753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6728d694-abc8-494f-9d6e-a001586d194b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:03.634692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6728d694-abc8-494f-9d6e-a001586d194b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.635638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6728d694-abc8-494f-9d6e-a001586d194b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:03.637225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6728d694-abc8-494f-9d6e-a001586d194b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:03.638780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6728d694-abc8-494f-9d6e-a001586d194b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.652701 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-589d60cd-6b1f-45b9-9ef7-4c81dfc799e1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1413 microversion: 2.1 time: 0.089399 Oct 29 02:54:03.661091 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1162/2297] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:03 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:03.661091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:03.661091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] [instance: 00bcd54f-e117-4c84-8204-7c29fbea37df] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:03.667263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:03.667757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:03.668308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.669034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:03.669754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:03.670190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.690419 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] HTTP exception thrown: Instance 00bcd54f-e117-4c84-8204-7c29fbea37df could not be found. Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Request method failure captured: Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df HTTP/1.1 Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJWjZXJiGF-1npHTt3Mig3bpxDTtG_9N7nbcV3X2vAFmgIY7xXbHz6fGNiaQ8jd5gogoql7_QJlJDV-B0psFazV8PvHx6ixYSXSpfPRNFzS73GvZ9Two2Qwjr5iyOxSC8OHw8ChIqa_U-bs3V1-wd6RqE7rVwnfUqym4yZu4KlHLNvc Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4935f9a2442d43a8bfc4e2a18c542c08 Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-225443977 Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4935f9a2442d43a8bfc4e2a18c542c08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4935f9a2442d43a8bfc4e2a18c542c08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4935f9a2442d43a8bfc4e2a18c542c08", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4935f9a2442d43a8bfc4e2a18c542c08"}]}] Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-225443977 Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4935f9a2442d43a8bfc4e2a18c542c08 Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-225443977 Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerDiagnosticsNegativeTest-225443977-project Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: aa3cb8ca820c4976beb0f156d53c6bdd Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-225443977-project Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 00bcd54f-e117-4c84-8204-7c29fbea37df could not be found. Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '00bcd54f-e117-4c84-8204-7c29fbea37df'} Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00bcd54f-e117-4c84-8204-7c29fbea37df could not be found. Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00bcd54f-e117-4c84-8204-7c29fbea37df could not be found. Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:03.691832 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:03.698582 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:03.698582 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:03.698582 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:03.698582 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:03.698582 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:03.698582 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:03.698582 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00bcd54f-e117-4c84-8204-7c29fbea37df could not be found. Oct 29 02:54:03.698582 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:03.698582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] Returning 404 to user: Instance 00bcd54f-e117-4c84-8204-7c29fbea37df could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:03.698582 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81958a4f-04bf-426c-a474-64600716ae35 tempest-ServerDiagnosticsNegativeTest-225443977 tempest-ServerDiagnosticsNegativeTest-225443977-project] 10.222.0.16 "GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df" status: 404 len: 111 microversion: 2.1 time: 0.038243 Oct 29 02:54:03.698582 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1163/2298] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:03 2022] GET /compute/v2.1/servers/00bcd54f-e117-4c84-8204-7c29fbea37df => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:04.005840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b539663e-75d9-434c-8546-2afa5f6b8b9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:04.006843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b539663e-75d9-434c-8546-2afa5f6b8b9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:04.063904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b539663e-75d9-434c-8546-2afa5f6b8b9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:04.065222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b539663e-75d9-434c-8546-2afa5f6b8b9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:04.067809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b539663e-75d9-434c-8546-2afa5f6b8b9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:04.073430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b539663e-75d9-434c-8546-2afa5f6b8b9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:04.073430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b539663e-75d9-434c-8546-2afa5f6b8b9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:04.074047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b539663e-75d9-434c-8546-2afa5f6b8b9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:04.266802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6728d694-abc8-494f-9d6e-a001586d194b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:04.276273 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6728d694-abc8-494f-9d6e-a001586d194b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 0.741168 Oct 29 02:54:04.286203 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1136/2299] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:03 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:04.316907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fc319909-1c46-495e-a92b-957b48f74226 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:04.318556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fc319909-1c46-495e-a92b-957b48f74226 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:04.334249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc319909-1c46-495e-a92b-957b48f74226 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:04.335144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc319909-1c46-495e-a92b-957b48f74226 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:04.336180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc319909-1c46-495e-a92b-957b48f74226 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:04.337142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc319909-1c46-495e-a92b-957b48f74226 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:04.337834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc319909-1c46-495e-a92b-957b48f74226 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:04.338937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc319909-1c46-495e-a92b-957b48f74226 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:04.866018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b539663e-75d9-434c-8546-2afa5f6b8b9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:04.876494 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b539663e-75d9-434c-8546-2afa5f6b8b9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1199 microversion: 2.1 time: 0.882131 Oct 29 02:54:04.880113 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1164/2300] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:03 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1199 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:04.891455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:04.892853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:04.914479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:04.917547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:04.918317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:04.919356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:04.920104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:04.920804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:05.168397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fc319909-1c46-495e-a92b-957b48f74226 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:05.181616 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fc319909-1c46-495e-a92b-957b48f74226 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1404 microversion: 2.1 time: 0.894114 Oct 29 02:54:05.182479 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1137/2301] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:04 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1404 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:05.197913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:05.198742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:05.209166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:05.209987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:05.213069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:05.214237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:05.218002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:05.218773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:05.220086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:05.240751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:05.242241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:05.243915 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8be87dbd-181b-4b00-93b6-fcd908d5987b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.359996 Oct 29 02:54:05.244418 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1165/2302] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:04 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:05.249384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ec75afd3-e0e1-4d51-aa6b-864b355132c1 req-04142846-a4c0-442d-a74b-da10ea892091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e8fb7c-e71d-4e00-9806-7b2b295a32fa", "name": "network-vif-plugged", "status": "completed", "tag": "370d1fd9-7205-4c54-bdb3-e0ae1de142a0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:05.268997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ec75afd3-e0e1-4d51-aa6b-864b355132c1 req-04142846-a4c0-442d-a74b-da10ea892091 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:05.269483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ec75afd3-e0e1-4d51-aa6b-864b355132c1 req-04142846-a4c0-442d-a74b-da10ea892091 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:05.269942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ec75afd3-e0e1-4d51-aa6b-864b355132c1 req-04142846-a4c0-442d-a74b-da10ea892091 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:05.283514 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ec75afd3-e0e1-4d51-aa6b-864b355132c1 req-04142846-a4c0-442d-a74b-da10ea892091 service nova] Creating event network-vif-plugged:370d1fd9-7205-4c54-bdb3-e0ae1de142a0 for instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa on n-h2-862964-4 Oct 29 02:54:05.288521 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ec75afd3-e0e1-4d51-aa6b-864b355132c1 req-04142846-a4c0-442d-a74b-da10ea892091 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042775 Oct 29 02:54:05.289634 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1166/2303] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:05.295749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0890870d-1f92-4521-a5b3-e8bbd204b91a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acc27ca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:05.344131 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0890870d-1f92-4521-a5b3-e8bbd204b91a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1422 microversion: 2.1 time: 0.052935 Oct 29 02:54:05.345040 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1167/2304] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:05 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1422 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:05.350184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-53376d7e-d479-49db-aad5-d5e102b010f6 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] Calling method '.version_select at 0x7fe1acd053a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:05.406128 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-53376d7e-d479-49db-aad5-d5e102b010f6 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1bc73562-3c6f-44fb-ba69-2a3a2f5647fe" status: 200 len: 350 microversion: 2.1 time: 0.059676 Oct 29 02:54:05.406841 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1168/2305] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 02:54:05 2022] GET /compute/v2.1/os-volumes/1bc73562-3c6f-44fb-ba69-2a3a2f5647fe => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:05.419896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-67c880c2-2d64-40e4-8f21-5c1292bdb0b6 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:05.420793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-67c880c2-2d64-40e4-8f21-5c1292bdb0b6 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:05.435010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c880c2-2d64-40e4-8f21-5c1292bdb0b6 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:05.435599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c880c2-2d64-40e4-8f21-5c1292bdb0b6 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:05.436207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c880c2-2d64-40e4-8f21-5c1292bdb0b6 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:05.438983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c880c2-2d64-40e4-8f21-5c1292bdb0b6 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:05.439685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c880c2-2d64-40e4-8f21-5c1292bdb0b6 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:05.440267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c880c2-2d64-40e4-8f21-5c1292bdb0b6 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:05.579453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:05.599947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:05.601905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:05.606129 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2825ebda-bed7-44b8-842a-58e6b60ebeef tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.421834 Oct 29 02:54:05.610510 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1138/2306] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:05 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:05.635340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-15eadf52-75bc-41a8-95d4-ae35126abf64 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8944e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:05.723965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-67c880c2-2d64-40e4-8f21-5c1292bdb0b6 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:05.736080 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-15eadf52-75bc-41a8-95d4-ae35126abf64 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 200 len: 1422 microversion: 2.1 time: 0.122687 Oct 29 02:54:05.736800 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1139/2307] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:05 2022] GET /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 1422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:05.737013 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-67c880c2-2d64-40e4-8f21-5c1292bdb0b6 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 0.322805 Oct 29 02:54:05.746787 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1169/2308] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:05 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:05.752824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d097e01e-2648-4d27-9c0f-49c92c48bbf7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8a02310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:05.899289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-468d8b2c-fd98-4945-aef6-4554f313011e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:05.899980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-468d8b2c-fd98-4945-aef6-4554f313011e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:05.914345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-468d8b2c-fd98-4945-aef6-4554f313011e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:05.914898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-468d8b2c-fd98-4945-aef6-4554f313011e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:05.915343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-468d8b2c-fd98-4945-aef6-4554f313011e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:05.918882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-468d8b2c-fd98-4945-aef6-4554f313011e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:05.919409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-468d8b2c-fd98-4945-aef6-4554f313011e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:05.920316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-468d8b2c-fd98-4945-aef6-4554f313011e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:06.256060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-468d8b2c-fd98-4945-aef6-4554f313011e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:06.264268 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-468d8b2c-fd98-4945-aef6-4554f313011e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1382 microversion: 2.1 time: 0.369512 Oct 29 02:54:06.269704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:06.277854 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1170/2309] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:05 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1382 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:06.286274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-09c08737-946d-4c55-a521-bf953d8839a3 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:06.286907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-09c08737-946d-4c55-a521-bf953d8839a3 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:06.307256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09c08737-946d-4c55-a521-bf953d8839a3 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:06.308995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09c08737-946d-4c55-a521-bf953d8839a3 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:06.309612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09c08737-946d-4c55-a521-bf953d8839a3 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:06.311586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09c08737-946d-4c55-a521-bf953d8839a3 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:06.315059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09c08737-946d-4c55-a521-bf953d8839a3 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:06.315519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09c08737-946d-4c55-a521-bf953d8839a3 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:06.685553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-09c08737-946d-4c55-a521-bf953d8839a3 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:06.695900 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-09c08737-946d-4c55-a521-bf953d8839a3 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1404 microversion: 2.1 time: 0.423902 Oct 29 02:54:06.700109 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1171/2310] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:06 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:06.714009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:06.714009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:06.728443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:06.728945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:06.729379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:06.731894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:06.732375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:06.738466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.046129 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d097e01e-2648-4d27-9c0f-49c92c48bbf7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 204 len: 0 microversion: 2.1 time: 1.298522 Oct 29 02:54:07.047908 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1140/2311] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:05 2022] DELETE /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 0 bytes in 1301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:54:07.159482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=16 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:07.224932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:07.248337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:07.253977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:07.257245 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c2a342b3-0713-4e6f-964c-0119a5409b72 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.555550 Oct 29 02:54:07.260134 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1172/2312] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:06 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:07.271123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-0ec7de12-dcbf-46e1-b4ce-5371d1a71d05 req-eb48724e-fc4e-4317-b343-54920d573773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab", "tag": "865810e5-9544-4851-8631-350a7fd73c5f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:07.283317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0ec7de12-dcbf-46e1-b4ce-5371d1a71d05 req-eb48724e-fc4e-4317-b343-54920d573773 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.284208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0ec7de12-dcbf-46e1-b4ce-5371d1a71d05 req-eb48724e-fc4e-4317-b343-54920d573773 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.285211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0ec7de12-dcbf-46e1-b4ce-5371d1a71d05 req-eb48724e-fc4e-4317-b343-54920d573773 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.303630 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-0ec7de12-dcbf-46e1-b4ce-5371d1a71d05 req-eb48724e-fc4e-4317-b343-54920d573773 service nova] Creating event network-changed:865810e5-9544-4851-8631-350a7fd73c5f for instance aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab on n-h2-862964-4 Oct 29 02:54:07.315385 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-0ec7de12-dcbf-46e1-b4ce-5371d1a71d05 req-eb48724e-fc4e-4317-b343-54920d573773 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052710 Oct 29 02:54:07.317085 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1173/2313] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:07.327350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:07.328186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:07.337711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.338244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.338692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.339393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.339941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.340450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.455402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b42fd95c-7e62-40e0-a812-5c31502dd3da tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:07.457005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b42fd95c-7e62-40e0-a812-5c31502dd3da tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:07.463901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b42fd95c-7e62-40e0-a812-5c31502dd3da tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.464705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b42fd95c-7e62-40e0-a812-5c31502dd3da tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.465462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b42fd95c-7e62-40e0-a812-5c31502dd3da tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.466613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b42fd95c-7e62-40e0-a812-5c31502dd3da tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.467500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b42fd95c-7e62-40e0-a812-5c31502dd3da tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.468095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b42fd95c-7e62-40e0-a812-5c31502dd3da tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.508405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:07.529066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:07.531172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:07.533091 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e5f22542-b819-42a9-8c67-d87c498e1909 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.214166 Oct 29 02:54:07.534334 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1174/2314] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:07 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:07.541768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44691f40-25c9-4631-bed2-5dc7d369e64c tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:07.542503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-44691f40-25c9-4631-bed2-5dc7d369e64c tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:07.549563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44691f40-25c9-4631-bed2-5dc7d369e64c tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.550293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44691f40-25c9-4631-bed2-5dc7d369e64c tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.558110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44691f40-25c9-4631-bed2-5dc7d369e64c tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.559291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44691f40-25c9-4631-bed2-5dc7d369e64c tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.563495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44691f40-25c9-4631-bed2-5dc7d369e64c tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.564787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44691f40-25c9-4631-bed2-5dc7d369e64c tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.640183 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b42fd95c-7e62-40e0-a812-5c31502dd3da tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1533 microversion: 2.1 time: 0.590254 Oct 29 02:54:07.641136 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1141/2315] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:07 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1533 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:07.646429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2a0490cc-41f9-45f0-986c-be000618d289 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:07.647057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2a0490cc-41f9-45f0-986c-be000618d289 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:07.654177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a0490cc-41f9-45f0-986c-be000618d289 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.654667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a0490cc-41f9-45f0-986c-be000618d289 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.655099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a0490cc-41f9-45f0-986c-be000618d289 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.655809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a0490cc-41f9-45f0-986c-be000618d289 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.656335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a0490cc-41f9-45f0-986c-be000618d289 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.656695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a0490cc-41f9-45f0-986c-be000618d289 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.689495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2a0490cc-41f9-45f0-986c-be000618d289 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:54:07.799769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-44691f40-25c9-4631-bed2-5dc7d369e64c tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:07.810207 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-44691f40-25c9-4631-bed2-5dc7d369e64c tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 0.274522 Oct 29 02:54:07.810803 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1175/2316] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:07 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:07.825834 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2a0490cc-41f9-45f0-986c-be000618d289 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 204 len: 0 microversion: 2.1 time: 0.179118 Oct 29 02:54:07.825834 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1142/2317] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:54:07 2022] DELETE /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:54:07.831333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac64a937-26de-434f-89de-d8bb2c4adf57 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:07.832501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ac64a937-26de-434f-89de-d8bb2c4adf57 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:07.839912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac64a937-26de-434f-89de-d8bb2c4adf57 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.840827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac64a937-26de-434f-89de-d8bb2c4adf57 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.841585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac64a937-26de-434f-89de-d8bb2c4adf57 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.842769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac64a937-26de-434f-89de-d8bb2c4adf57 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.843411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac64a937-26de-434f-89de-d8bb2c4adf57 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.844577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac64a937-26de-434f-89de-d8bb2c4adf57 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.856160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1ea3d902-1e5a-4416-8235-3efff2021319 req-206f46d3-f737-42e9-b88f-7c85ac3341ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e8fb7c-e71d-4e00-9806-7b2b295a32fa", "name": "network-vif-plugged", "status": "completed", "tag": "41e4be31-a897-46bb-b7f6-4f6dac346a37"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:07.882552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1ea3d902-1e5a-4416-8235-3efff2021319 req-206f46d3-f737-42e9-b88f-7c85ac3341ec service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.885395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1ea3d902-1e5a-4416-8235-3efff2021319 req-206f46d3-f737-42e9-b88f-7c85ac3341ec service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.886027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1ea3d902-1e5a-4416-8235-3efff2021319 req-206f46d3-f737-42e9-b88f-7c85ac3341ec service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.914777 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1ea3d902-1e5a-4416-8235-3efff2021319 req-206f46d3-f737-42e9-b88f-7c85ac3341ec service nova] Creating event network-vif-plugged:41e4be31-a897-46bb-b7f6-4f6dac346a37 for instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa on n-h2-862964-4 Oct 29 02:54:07.926836 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1ea3d902-1e5a-4416-8235-3efff2021319 req-206f46d3-f737-42e9-b88f-7c85ac3341ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104721 Oct 29 02:54:07.928469 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1176/2318] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:07.943347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-07445f04-9976-4c23-b702-370637c09dda tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:07.944075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-07445f04-9976-4c23-b702-370637c09dda tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:07.962801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07445f04-9976-4c23-b702-370637c09dda tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.963304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07445f04-9976-4c23-b702-370637c09dda tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.963745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07445f04-9976-4c23-b702-370637c09dda tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.964488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07445f04-9976-4c23-b702-370637c09dda tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.964925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07445f04-9976-4c23-b702-370637c09dda tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.965362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07445f04-9976-4c23-b702-370637c09dda tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:08.063530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:08.067086 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ac64a937-26de-434f-89de-d8bb2c4adf57 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1533 microversion: 2.1 time: 0.241676 Oct 29 02:54:08.074277 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1143/2319] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:07 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1533 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:08.092043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-75f9aa10-a2cb-4911-9ea5-9966c8d6f3e1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:08.097533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f9aa10-a2cb-4911-9ea5-9966c8d6f3e1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:08.098470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f9aa10-a2cb-4911-9ea5-9966c8d6f3e1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:08.099449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f9aa10-a2cb-4911-9ea5-9966c8d6f3e1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:08.101284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f9aa10-a2cb-4911-9ea5-9966c8d6f3e1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:08.102083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f9aa10-a2cb-4911-9ea5-9966c8d6f3e1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:08.102766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f9aa10-a2cb-4911-9ea5-9966c8d6f3e1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:08.158799 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-75f9aa10-a2cb-4911-9ea5-9966c8d6f3e1 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.071439 Oct 29 02:54:08.159489 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1144/2320] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Oct 29 02:54:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:54:08.185861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-caf388b5-26d2-4bc9-b62d-be601b536f6a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862964-4", "block_migration": false, "disk_over_commit": false}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:08.189437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-caf388b5-26d2-4bc9-b62d-be601b536f6a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:08.195878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-caf388b5-26d2-4bc9-b62d-be601b536f6a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:08.196478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-caf388b5-26d2-4bc9-b62d-be601b536f6a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:08.196796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-caf388b5-26d2-4bc9-b62d-be601b536f6a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:08.197836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-caf388b5-26d2-4bc9-b62d-be601b536f6a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:08.198379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-caf388b5-26d2-4bc9-b62d-be601b536f6a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:08.198699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-caf388b5-26d2-4bc9-b62d-be601b536f6a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:08.220898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-07445f04-9976-4c23-b702-370637c09dda tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:08.231137 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-07445f04-9976-4c23-b702-370637c09dda tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1404 microversion: 2.1 time: 0.299287 Oct 29 02:54:08.232437 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1177/2321] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:07 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1404 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:08.256179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b54f1a94-d895-4145-9fd7-de1227f5a09d tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] Calling method '.version_select at 0x7fe1a9857c10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:08.269060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-caf388b5-26d2-4bc9-b62d-be601b536f6a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lazy-loading 'flavor' on Instance uuid 5c0253f5-cea4-471a-97d6-16c7702c07ee {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:54:08.290552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-caf388b5-26d2-4bc9-b62d-be601b536f6a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Going to try to live migrate instance to n-h2-862964-4 {{(pid=127042) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:54:08.318884 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b54f1a94-d895-4145-9fd7-de1227f5a09d tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/eb0ef6c4-eb06-4973-a39e-847fe86d35ba" status: 200 len: 351 microversion: 2.1 time: 0.067131 Oct 29 02:54:08.319579 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1178/2322] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 02:54:08 2022] GET /compute/v2.1/os-volumes/eb0ef6c4-eb06-4973-a39e-847fe86d35ba => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:08.333270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:08.334087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:08.341718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:08.342249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:08.342689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:08.343399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:08.344175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:08.344943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:08.686554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:08.701375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:08.704580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:08.706042 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9d040142-2925-47e4-98b8-919a2d338640 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.385382 Oct 29 02:54:08.707006 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1179/2323] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:08 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:08.713213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1796315338", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "0ef24500-837e-47a7-9e10-a72e3fb043af"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:08.806615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] validate_networks() for [('0ef24500-837e-47a7-9e10-a72e3fb043af', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:54:09.389356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:54:09.389994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:54:09.390283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:54:09.390693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:54:09.391343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:54:09.404175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:09.405185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:09.405766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:09.407150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:09.407933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:09.408502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:09.432282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:54:09.438816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for user 0868f50723074f2b98f7b1096743f3cc and project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:54:09.455111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:54:09.458516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:54:09.519130 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a81bcc04-fe2e-4403-83b1-e2f18c3a5c48 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810949 Oct 29 02:54:09.520294 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1180/2324] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:54:09.525384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:09.526211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:09.534734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:09.535594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:09.536253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:09.537175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:09.537774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:09.538400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:09.563923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:09.723655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:09.744608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:09.748251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:09.753780 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b5199116-fa11-4355-95cc-2cdc6075e616 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.232222 Oct 29 02:54:09.754424 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1181/2325] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:09 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:09.768930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b19acffb-0995-4bae-81ad-3d8309ef03e2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:09.771251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b19acffb-0995-4bae-81ad-3d8309ef03e2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:09.784606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19acffb-0995-4bae-81ad-3d8309ef03e2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:09.785195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19acffb-0995-4bae-81ad-3d8309ef03e2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:09.789734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19acffb-0995-4bae-81ad-3d8309ef03e2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:09.791036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19acffb-0995-4bae-81ad-3d8309ef03e2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:09.791871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19acffb-0995-4bae-81ad-3d8309ef03e2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:09.792580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b19acffb-0995-4bae-81ad-3d8309ef03e2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:10.025549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b19acffb-0995-4bae-81ad-3d8309ef03e2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:10.034839 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b19acffb-0995-4bae-81ad-3d8309ef03e2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 0.278544 Oct 29 02:54:10.035436 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1182/2326] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:09 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:10.065756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d82471df-43b3-44fc-80bb-3fa0fb566e48 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:10.068897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d82471df-43b3-44fc-80bb-3fa0fb566e48 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:10.081372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d82471df-43b3-44fc-80bb-3fa0fb566e48 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:10.086312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d82471df-43b3-44fc-80bb-3fa0fb566e48 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:10.090332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d82471df-43b3-44fc-80bb-3fa0fb566e48 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:10.091201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d82471df-43b3-44fc-80bb-3fa0fb566e48 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:10.091770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d82471df-43b3-44fc-80bb-3fa0fb566e48 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:10.092233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d82471df-43b3-44fc-80bb-3fa0fb566e48 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:10.326458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d82471df-43b3-44fc-80bb-3fa0fb566e48 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:10.335683 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d82471df-43b3-44fc-80bb-3fa0fb566e48 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1404 microversion: 2.1 time: 0.298825 Oct 29 02:54:10.346983 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1183/2327] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:10 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1404 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:10.547314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-24b906c1-a9a2-4de8-9deb-d47e2e5f13fb tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:10.553995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24b906c1-a9a2-4de8-9deb-d47e2e5f13fb tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:10.555172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24b906c1-a9a2-4de8-9deb-d47e2e5f13fb tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:10.555996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24b906c1-a9a2-4de8-9deb-d47e2e5f13fb tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:10.557340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24b906c1-a9a2-4de8-9deb-d47e2e5f13fb tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:10.558345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24b906c1-a9a2-4de8-9deb-d47e2e5f13fb tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:10.559189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24b906c1-a9a2-4de8-9deb-d47e2e5f13fb tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:10.590522 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-24b906c1-a9a2-4de8-9deb-d47e2e5f13fb tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.252541 Oct 29 02:54:10.601351 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1184/2328] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:54:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:10.601351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-77b408d2-4dbe-4c76-bb9c-45166ea4360e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:10.601351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-77b408d2-4dbe-4c76-bb9c-45166ea4360e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:10.605338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b408d2-4dbe-4c76-bb9c-45166ea4360e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:10.605733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b408d2-4dbe-4c76-bb9c-45166ea4360e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:10.606382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b408d2-4dbe-4c76-bb9c-45166ea4360e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:10.607245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b408d2-4dbe-4c76-bb9c-45166ea4360e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:10.607892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b408d2-4dbe-4c76-bb9c-45166ea4360e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:10.608459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b408d2-4dbe-4c76-bb9c-45166ea4360e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:10.678397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-77b408d2-4dbe-4c76-bb9c-45166ea4360e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:10.686906 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-77b408d2-4dbe-4c76-bb9c-45166ea4360e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1260 microversion: 2.1 time: 0.094052 Oct 29 02:54:10.687620 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1185/2329] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:10 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1260 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:10.693178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:10.693796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:10.700669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:10.701129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:10.701593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:10.703272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:10.704351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:10.704898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.013756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:11.027895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:11.029432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:11.030634 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29ab5c31-8ee9-4f8b-8b77-79afede5e20e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.341770 Oct 29 02:54:11.031354 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1186/2330] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:10 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:11.037315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ffd82f9f-d602-4f6d-8072-0d430a00f84f req-31e8f7a7-55b7-45fd-86a1-7d5327c88c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48", "name": "network-vif-unplugged", "status": "completed", "tag": "c7ca1518-2cf2-4f9f-8bf2-8a07dafc3f4f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:11.058059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ffd82f9f-d602-4f6d-8072-0d430a00f84f req-31e8f7a7-55b7-45fd-86a1-7d5327c88c14 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.058737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ffd82f9f-d602-4f6d-8072-0d430a00f84f req-31e8f7a7-55b7-45fd-86a1-7d5327c88c14 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.059174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ffd82f9f-d602-4f6d-8072-0d430a00f84f req-31e8f7a7-55b7-45fd-86a1-7d5327c88c14 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.075373 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ffd82f9f-d602-4f6d-8072-0d430a00f84f req-31e8f7a7-55b7-45fd-86a1-7d5327c88c14 service nova] Creating event network-vif-unplugged:c7ca1518-2cf2-4f9f-8bf2-8a07dafc3f4f for instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 on n-h2-862964-4 Oct 29 02:54:11.079944 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ffd82f9f-d602-4f6d-8072-0d430a00f84f req-31e8f7a7-55b7-45fd-86a1-7d5327c88c14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046934 Oct 29 02:54:11.080897 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1187/2331] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:11.086634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-57324375-8fbb-45fa-b6e5-b4afc163d60b tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:11.091733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57324375-8fbb-45fa-b6e5-b4afc163d60b tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.092300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57324375-8fbb-45fa-b6e5-b4afc163d60b tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.092744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57324375-8fbb-45fa-b6e5-b4afc163d60b tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.093499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57324375-8fbb-45fa-b6e5-b4afc163d60b tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.093995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57324375-8fbb-45fa-b6e5-b4afc163d60b tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.094568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57324375-8fbb-45fa-b6e5-b4afc163d60b tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.142593 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-57324375-8fbb-45fa-b6e5-b4afc163d60b tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-862964-4" status: 200 len: 578 microversion: 2.1 time: 0.060341 Oct 29 02:54:11.145143 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1188/2332] 10.222.0.16 () {58 vars in 1172 bytes} [Sat Oct 29 02:54:11 2022] GET /compute/v2.1/os-services?host=n-d-862964-4 => generated 578 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:11.156397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:11.159267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:11.167812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.168346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.168886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.169667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.170710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.171141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.400831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:11.410399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:11.412073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:11.413336 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-73fb2ced-ec18-4c2f-8b3e-3657b8543c8d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.265557 Oct 29 02:54:11.424623 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1189/2333] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:11 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:11.424623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-60a5cf04-8a4f-43d8-a2d7-efdcf759b3ae tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:11.424623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-60a5cf04-8a4f-43d8-a2d7-efdcf759b3ae tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:11.426787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a5cf04-8a4f-43d8-a2d7-efdcf759b3ae tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.427276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a5cf04-8a4f-43d8-a2d7-efdcf759b3ae tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.427692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a5cf04-8a4f-43d8-a2d7-efdcf759b3ae tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.428587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a5cf04-8a4f-43d8-a2d7-efdcf759b3ae tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.429034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a5cf04-8a4f-43d8-a2d7-efdcf759b3ae tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.429470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a5cf04-8a4f-43d8-a2d7-efdcf759b3ae tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.654371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-60a5cf04-8a4f-43d8-a2d7-efdcf759b3ae tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:11.656357 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-caf388b5-26d2-4bc9-b62d-be601b536f6a tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee/action" status: 202 len: 0 microversion: 2.1 time: 3.483627 Oct 29 02:54:11.657432 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1145/2334] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:54:08 2022] POST /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee/action => generated 0 bytes in 3485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:11.662964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ea10add-5b83-452b-b1ee-51f644bc074e tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] Calling method '.version_select at 0x7fe1a84733a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:11.676384 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-60a5cf04-8a4f-43d8-a2d7-efdcf759b3ae tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1334 microversion: 2.1 time: 0.261020 Oct 29 02:54:11.677070 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1190/2335] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:11 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1334 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:11.695178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95f5246c-7ca3-4c02-81be-fdee0c9deed9 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:11.699496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f5246c-7ca3-4c02-81be-fdee0c9deed9 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.700024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f5246c-7ca3-4c02-81be-fdee0c9deed9 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.700557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f5246c-7ca3-4c02-81be-fdee0c9deed9 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.701529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f5246c-7ca3-4c02-81be-fdee0c9deed9 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.702385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f5246c-7ca3-4c02-81be-fdee0c9deed9 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.703242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f5246c-7ca3-4c02-81be-fdee0c9deed9 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.733115 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-95f5246c-7ca3-4c02-81be-fdee0c9deed9 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.054482 Oct 29 02:54:11.733753 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1191/2336] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Oct 29 02:54:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:11.737483 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8ea10add-5b83-452b-b1ee-51f644bc074e tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/51cac274-d713-4520-99d8-3894273edeaa" status: 200 len: 351 microversion: 2.1 time: 0.078922 Oct 29 02:54:11.738969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-55b92128-88f3-4560-ad03-6fcb2a051184 req-2d8ed3a3-5b17-4f39-b0ab-607820734e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48", "name": "network-vif-deleted", "tag": "c7ca1518-2cf2-4f9f-8bf2-8a07dafc3f4f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:11.750666 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1146/2337] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 02:54:11 2022] GET /compute/v2.1/os-volumes/51cac274-d713-4520-99d8-3894273edeaa => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:11.752192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55b92128-88f3-4560-ad03-6fcb2a051184 req-2d8ed3a3-5b17-4f39-b0ab-607820734e1d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.752717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55b92128-88f3-4560-ad03-6fcb2a051184 req-2d8ed3a3-5b17-4f39-b0ab-607820734e1d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.753301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55b92128-88f3-4560-ad03-6fcb2a051184 req-2d8ed3a3-5b17-4f39-b0ab-607820734e1d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.757430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-313a5f7c-54b6-44cd-8346-a38b8cc1af61 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:11.758268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-313a5f7c-54b6-44cd-8346-a38b8cc1af61 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:11.765729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-313a5f7c-54b6-44cd-8346-a38b8cc1af61 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.766216 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-55b92128-88f3-4560-ad03-6fcb2a051184 req-2d8ed3a3-5b17-4f39-b0ab-607820734e1d service nova] Creating event network-vif-deleted:c7ca1518-2cf2-4f9f-8bf2-8a07dafc3f4f for instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 on n-h2-862964-4 Oct 29 02:54:11.767231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-313a5f7c-54b6-44cd-8346-a38b8cc1af61 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.767876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-313a5f7c-54b6-44cd-8346-a38b8cc1af61 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.768809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-313a5f7c-54b6-44cd-8346-a38b8cc1af61 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.769491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-313a5f7c-54b6-44cd-8346-a38b8cc1af61 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.770563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-313a5f7c-54b6-44cd-8346-a38b8cc1af61 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.772518 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-55b92128-88f3-4560-ad03-6fcb2a051184 req-2d8ed3a3-5b17-4f39-b0ab-607820734e1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037459 Oct 29 02:54:11.773735 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1192/2338] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:11.783581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-252523ea-5cfd-44cb-8aa5-39374a2df5ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:11.784855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-252523ea-5cfd-44cb-8aa5-39374a2df5ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:11.794920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252523ea-5cfd-44cb-8aa5-39374a2df5ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.795635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252523ea-5cfd-44cb-8aa5-39374a2df5ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.796257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252523ea-5cfd-44cb-8aa5-39374a2df5ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.797305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252523ea-5cfd-44cb-8aa5-39374a2df5ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.797784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252523ea-5cfd-44cb-8aa5-39374a2df5ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.798447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252523ea-5cfd-44cb-8aa5-39374a2df5ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.957787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-252523ea-5cfd-44cb-8aa5-39374a2df5ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:11.968594 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-252523ea-5cfd-44cb-8aa5-39374a2df5ae tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.192448 Oct 29 02:54:11.969547 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1193/2339] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:11 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:11.990539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a767ba93-8fbf-49ba-90cc-a0e854a83568 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:11.991206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a767ba93-8fbf-49ba-90cc-a0e854a83568 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:11.998209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a767ba93-8fbf-49ba-90cc-a0e854a83568 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.998857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a767ba93-8fbf-49ba-90cc-a0e854a83568 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.999474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a767ba93-8fbf-49ba-90cc-a0e854a83568 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.000563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a767ba93-8fbf-49ba-90cc-a0e854a83568 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.001085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a767ba93-8fbf-49ba-90cc-a0e854a83568 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.001630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a767ba93-8fbf-49ba-90cc-a0e854a83568 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.075389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a767ba93-8fbf-49ba-90cc-a0e854a83568 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:12.075570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-313a5f7c-54b6-44cd-8346-a38b8cc1af61 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:12.084472 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-313a5f7c-54b6-44cd-8346-a38b8cc1af61 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1404 microversion: 2.1 time: 0.332521 Oct 29 02:54:12.085308 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a767ba93-8fbf-49ba-90cc-a0e854a83568 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1260 microversion: 2.1 time: 0.098555 Oct 29 02:54:12.085574 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1147/2340] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:11 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1404 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:12.086204 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1194/2341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:11 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1260 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:12.090467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aa8ff1b6-2d70-4ca6-a70a-cd77f97335e5 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:12.094432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa8ff1b6-2d70-4ca6-a70a-cd77f97335e5 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.095172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa8ff1b6-2d70-4ca6-a70a-cd77f97335e5 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.095807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa8ff1b6-2d70-4ca6-a70a-cd77f97335e5 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.096745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa8ff1b6-2d70-4ca6-a70a-cd77f97335e5 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.098184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa8ff1b6-2d70-4ca6-a70a-cd77f97335e5 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.098805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa8ff1b6-2d70-4ca6-a70a-cd77f97335e5 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.118313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d88034f5-9e63-4cef-8745-d62818e20a3f tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] Calling method '.version_select at 0x7fe1acd05b80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:12.144202 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aa8ff1b6-2d70-4ca6-a70a-cd77f97335e5 tempest-ServicesAdminTestJSON-1523160004 tempest-ServicesAdminTestJSON-1523160004-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.056870 Oct 29 02:54:12.144787 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1148/2342] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:54:12 2022] GET /compute/v2.1/os-services => generated 944 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:12.150143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:12.150959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:12.159651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.160343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.160956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.162195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.162829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.163457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.276772 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d88034f5-9e63-4cef-8745-d62818e20a3f tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.189505 Oct 29 02:54:12.287603 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1195/2343] 10.222.0.16 () {58 vars in 1134 bytes} [Sat Oct 29 02:54:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:12.302606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29bb9656-ca3d-4036-a8f7-66ed51238aa5 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] Calling method '.version_select at 0x7fe1a8e6f4c0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:12.447446 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29bb9656-ca3d-4036-a8f7-66ed51238aa5 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.155816 Oct 29 02:54:12.448274 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1196/2344] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Oct 29 02:54:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:54:12.454481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:12.456414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:12.458119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:12.472391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.473142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.473650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.475617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.476430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.480092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.481726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:12.484749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:12.487990 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-487ae911-fc3b-452e-b381-46b93d4f68a0 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.341723 Oct 29 02:54:12.499868 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1149/2345] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:12 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:12.518151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d4643c7-a617-46a8-835e-83b7cfd9ab40 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] Calling method '.version_select at 0x7fe1a87c5a60>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:12.672684 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d4643c7-a617-46a8-835e-83b7cfd9ab40 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.169719 Oct 29 02:54:12.673489 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1150/2346] 10.222.0.16 () {58 vars in 1134 bytes} [Sat Oct 29 02:54:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:12.688089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-96bc9dc2-befe-4e90-918c-bdf62732577a tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] Calling method '.version_select at 0x7fe1a9038280>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:12.735231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:12.748247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:12.750985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:12.761522 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ff801c3b-7393-43e2-bcb4-b5d5f858c844 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.310097 Oct 29 02:54:12.762732 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1197/2347] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:12 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:12.768577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d2e04255-290b-4af7-9b0e-020e0f826cbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:12.770290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d2e04255-290b-4af7-9b0e-020e0f826cbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:12.777583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e04255-290b-4af7-9b0e-020e0f826cbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.778332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e04255-290b-4af7-9b0e-020e0f826cbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.778936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e04255-290b-4af7-9b0e-020e0f826cbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.779838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e04255-290b-4af7-9b0e-020e0f826cbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.780457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e04255-290b-4af7-9b0e-020e0f826cbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.781820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e04255-290b-4af7-9b0e-020e0f826cbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.860906 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-96bc9dc2-befe-4e90-918c-bdf62732577a tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.177387 Oct 29 02:54:12.862009 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1151/2348] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Oct 29 02:54:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:54:12.877839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-368b74b9-9fca-4d06-91d1-c4633c966d22 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] Calling method '.version_select at 0x7fe1a8f460d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:12.980174 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-368b74b9-9fca-4d06-91d1-c4633c966d22 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.107222 Oct 29 02:54:12.990926 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1152/2349] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Oct 29 02:54:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:12.991147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d2e04255-290b-4af7-9b0e-020e0f826cbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:12.993698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dfd1a4bd-cc85-4120-94b7-72adf837f806 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:12.995190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dfd1a4bd-cc85-4120-94b7-72adf837f806 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:13.008839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd1a4bd-cc85-4120-94b7-72adf837f806 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.009786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd1a4bd-cc85-4120-94b7-72adf837f806 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.010491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd1a4bd-cc85-4120-94b7-72adf837f806 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.011702 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d2e04255-290b-4af7-9b0e-020e0f826cbd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1668 microversion: 2.1 time: 0.247599 Oct 29 02:54:13.014463 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1198/2350] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:12 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1668 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:13.020862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd1a4bd-cc85-4120-94b7-72adf837f806 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.022827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-61cec49e-1a53-4611-8b4d-1dcab55e52d0 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] Calling method '.version_select at 0x7fe1a8a24d30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:13.023881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd1a4bd-cc85-4120-94b7-72adf837f806 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.024465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd1a4bd-cc85-4120-94b7-72adf837f806 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.155251 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-61cec49e-1a53-4611-8b4d-1dcab55e52d0 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.139558 Oct 29 02:54:13.166035 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1199/2351] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:54:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:13.172337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4eed479e-7a73-498b-88d6-af14017994a3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:13.173154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4eed479e-7a73-498b-88d6-af14017994a3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:13.181146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4eed479e-7a73-498b-88d6-af14017994a3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.181631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4eed479e-7a73-498b-88d6-af14017994a3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.182134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4eed479e-7a73-498b-88d6-af14017994a3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.182846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4eed479e-7a73-498b-88d6-af14017994a3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.183283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4eed479e-7a73-498b-88d6-af14017994a3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.183702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4eed479e-7a73-498b-88d6-af14017994a3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.221846 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4eed479e-7a73-498b-88d6-af14017994a3 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa/ips" status: 200 len: 178 microversion: 2.1 time: 0.054359 Oct 29 02:54:13.222611 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1200/2352] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 02:54:13 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa/ips => generated 178 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:13.227652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-edb04af8-dde6-402d-8b94-b0678eaf2e6f req-52718f93-550b-4677-b9ed-827273db1c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab", "name": "network-vif-plugged", "status": "completed", "tag": "865810e5-9544-4851-8631-350a7fd73c5f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:13.238266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-edb04af8-dde6-402d-8b94-b0678eaf2e6f req-52718f93-550b-4677-b9ed-827273db1c6c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.238682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-edb04af8-dde6-402d-8b94-b0678eaf2e6f req-52718f93-550b-4677-b9ed-827273db1c6c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.239111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-edb04af8-dde6-402d-8b94-b0678eaf2e6f req-52718f93-550b-4677-b9ed-827273db1c6c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.252817 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-edb04af8-dde6-402d-8b94-b0678eaf2e6f req-52718f93-550b-4677-b9ed-827273db1c6c service nova] Creating event network-vif-plugged:865810e5-9544-4851-8631-350a7fd73c5f for instance aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab on n-h2-862964-4 Oct 29 02:54:13.258496 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-edb04af8-dde6-402d-8b94-b0678eaf2e6f req-52718f93-550b-4677-b9ed-827273db1c6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034344 Oct 29 02:54:13.259038 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1201/2353] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:13.265241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-61351d04-141e-4401-bc60-192457e5ab2a tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:13.266033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-61351d04-141e-4401-bc60-192457e5ab2a tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:13.276164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61351d04-141e-4401-bc60-192457e5ab2a tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.276996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61351d04-141e-4401-bc60-192457e5ab2a tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.277737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61351d04-141e-4401-bc60-192457e5ab2a tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.278637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61351d04-141e-4401-bc60-192457e5ab2a tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.279807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61351d04-141e-4401-bc60-192457e5ab2a tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.280377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61351d04-141e-4401-bc60-192457e5ab2a tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.336025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dfd1a4bd-cc85-4120-94b7-72adf837f806 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:13.346437 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dfd1a4bd-cc85-4120-94b7-72adf837f806 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.357540 Oct 29 02:54:13.347022 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1153/2354] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:12 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:13.352494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0263bac2-92b1-460a-abcd-1c65f64c34af tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:13.353526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0263bac2-92b1-460a-abcd-1c65f64c34af tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:13.356958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:13.362499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0263bac2-92b1-460a-abcd-1c65f64c34af tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.362991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0263bac2-92b1-460a-abcd-1c65f64c34af tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.363602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0263bac2-92b1-460a-abcd-1c65f64c34af tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.364310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0263bac2-92b1-460a-abcd-1c65f64c34af tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.364751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0263bac2-92b1-460a-abcd-1c65f64c34af tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.365164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0263bac2-92b1-460a-abcd-1c65f64c34af tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.460585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0263bac2-92b1-460a-abcd-1c65f64c34af tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:13.471139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-61351d04-141e-4401-bc60-192457e5ab2a tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:13.472230 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0263bac2-92b1-460a-abcd-1c65f64c34af tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1266 microversion: 2.1 time: 0.123263 Oct 29 02:54:13.472851 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1154/2355] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:13 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:13.479160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-07d28e7d-96ea-489d-867d-6bacb873d8f2 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] Calling method '.version_select at 0x7fe1a86dd700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:13.494385 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-61351d04-141e-4401-bc60-192457e5ab2a tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1404 microversion: 2.1 time: 0.233521 Oct 29 02:54:13.495058 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1202/2356] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:13 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1404 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:13.505561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fee5ead1-88e9-488d-ad68-ec9e631f5c63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:13.506656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fee5ead1-88e9-488d-ad68-ec9e631f5c63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:13.519016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fee5ead1-88e9-488d-ad68-ec9e631f5c63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.519786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fee5ead1-88e9-488d-ad68-ec9e631f5c63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.520577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fee5ead1-88e9-488d-ad68-ec9e631f5c63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.521759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fee5ead1-88e9-488d-ad68-ec9e631f5c63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.522367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fee5ead1-88e9-488d-ad68-ec9e631f5c63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.522911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fee5ead1-88e9-488d-ad68-ec9e631f5c63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.565095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fee5ead1-88e9-488d-ad68-ec9e631f5c63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:54:13.617017 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-07d28e7d-96ea-489d-867d-6bacb873d8f2 tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.142778 Oct 29 02:54:13.619005 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1155/2357] 10.222.0.16 () {58 vars in 1188 bytes} [Sat Oct 29 02:54:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:13.633288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:13.636895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:13.637399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:13.649219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.650918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.651532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.652671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.654001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.654858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.682355 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fee5ead1-88e9-488d-ad68-ec9e631f5c63 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 204 len: 0 microversion: 2.1 time: 0.185491 Oct 29 02:54:13.682964 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1203/2358] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:54:13 2022] DELETE /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:54:13.694581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-448a0964-bdbc-47e6-9087-a6e31310d30e tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] Calling method '.version_select at 0x7fe1acc27820>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:13.817245 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-448a0964-bdbc-47e6-9087-a6e31310d30e tempest-VolumesTestJSON-1404162030 tempest-VolumesTestJSON-1404162030-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.132824 Oct 29 02:54:13.817856 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1204/2359] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 02:54:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:13.822971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a63ba575-56e8-4626-8f80-332d3a864b89 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:13.823579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a63ba575-56e8-4626-8f80-332d3a864b89 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:13.829530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:13.844822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a63ba575-56e8-4626-8f80-332d3a864b89 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.846639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a63ba575-56e8-4626-8f80-332d3a864b89 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.851208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a63ba575-56e8-4626-8f80-332d3a864b89 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.855151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a63ba575-56e8-4626-8f80-332d3a864b89 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:13.857418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a63ba575-56e8-4626-8f80-332d3a864b89 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:13.858194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a63ba575-56e8-4626-8f80-332d3a864b89 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.024776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:14.041945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:14.047677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:14.049054 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4b0587b9-c65c-4195-8d52-dd22c9ffadac tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.428919 Oct 29 02:54:14.049629 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1156/2360] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:13 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:14.066875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:14.067490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:14.079366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.080061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.080632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.081474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.082226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.082781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.160419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a63ba575-56e8-4626-8f80-332d3a864b89 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:14.180467 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a63ba575-56e8-4626-8f80-332d3a864b89 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1674 microversion: 2.1 time: 0.360750 Oct 29 02:54:14.191395 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1205/2361] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:13 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1674 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:14.342203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:14.360068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:14.363147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:14.365015 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b62b5317-cf4b-425b-a229-ca16edf25393 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.305827 Oct 29 02:54:14.365982 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1157/2362] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:14 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:14.374477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-98510a02-eb98-4492-9526-c53c43078ef7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:14.375088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-98510a02-eb98-4492-9526-c53c43078ef7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:14.381770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98510a02-eb98-4492-9526-c53c43078ef7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.386442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98510a02-eb98-4492-9526-c53c43078ef7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.387055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98510a02-eb98-4492-9526-c53c43078ef7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.387932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98510a02-eb98-4492-9526-c53c43078ef7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.388528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98510a02-eb98-4492-9526-c53c43078ef7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.389094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98510a02-eb98-4492-9526-c53c43078ef7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.497184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ead5e30-db87-4116-b97b-f41456e6bb82 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:14.498577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1ead5e30-db87-4116-b97b-f41456e6bb82 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:14.515249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ead5e30-db87-4116-b97b-f41456e6bb82 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.517019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ead5e30-db87-4116-b97b-f41456e6bb82 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.517658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ead5e30-db87-4116-b97b-f41456e6bb82 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.518678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ead5e30-db87-4116-b97b-f41456e6bb82 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.520003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ead5e30-db87-4116-b97b-f41456e6bb82 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.520632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ead5e30-db87-4116-b97b-f41456e6bb82 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.623946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-98510a02-eb98-4492-9526-c53c43078ef7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:14.632558 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-98510a02-eb98-4492-9526-c53c43078ef7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.266021 Oct 29 02:54:14.633770 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1206/2363] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:14 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:14.650588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ce74f9e-5235-42cc-86e0-bdb5ebd72c3b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:14.651255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ce74f9e-5235-42cc-86e0-bdb5ebd72c3b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:14.659804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ce74f9e-5235-42cc-86e0-bdb5ebd72c3b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.660296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ce74f9e-5235-42cc-86e0-bdb5ebd72c3b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.660725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ce74f9e-5235-42cc-86e0-bdb5ebd72c3b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.661437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ce74f9e-5235-42cc-86e0-bdb5ebd72c3b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.662039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ce74f9e-5235-42cc-86e0-bdb5ebd72c3b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.662469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ce74f9e-5235-42cc-86e0-bdb5ebd72c3b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.811977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ead5e30-db87-4116-b97b-f41456e6bb82 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:14.820140 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ead5e30-db87-4116-b97b-f41456e6bb82 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.328380 Oct 29 02:54:14.825788 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1158/2364] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:14 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:14.844057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ce74f9e-5235-42cc-86e0-bdb5ebd72c3b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:14.854751 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ce74f9e-5235-42cc-86e0-bdb5ebd72c3b tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1404 microversion: 2.1 time: 0.219144 Oct 29 02:54:14.866587 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1207/2365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:14 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1404 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:15.022001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ada97325-5944-4c4b-a01f-395063fa053c req-ae5eba7f-fded-4fd9-92a0-d121d9bf542c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e07792-807a-44e9-b644-72504509f2f5", "tag": "8a4b46d3-0738-4cd4-a78e-25f2da119a4e"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:15.034363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ada97325-5944-4c4b-a01f-395063fa053c req-ae5eba7f-fded-4fd9-92a0-d121d9bf542c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.038333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ada97325-5944-4c4b-a01f-395063fa053c req-ae5eba7f-fded-4fd9-92a0-d121d9bf542c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.038991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ada97325-5944-4c4b-a01f-395063fa053c req-ae5eba7f-fded-4fd9-92a0-d121d9bf542c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.060999 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ada97325-5944-4c4b-a01f-395063fa053c req-ae5eba7f-fded-4fd9-92a0-d121d9bf542c service nova] Creating event network-changed:8a4b46d3-0738-4cd4-a78e-25f2da119a4e for instance 26e07792-807a-44e9-b644-72504509f2f5 on n-h2-862964-4 Oct 29 02:54:15.066960 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ada97325-5944-4c4b-a01f-395063fa053c req-ae5eba7f-fded-4fd9-92a0-d121d9bf542c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048575 Oct 29 02:54:15.067608 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1159/2366] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:15.096079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:15.097549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:15.114368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.115126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.115713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.116574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.120997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.121733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.207371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-238a8e83-8261-4e51-901a-d99c34beea37 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:15.208401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-238a8e83-8261-4e51-901a-d99c34beea37 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:15.217654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-238a8e83-8261-4e51-901a-d99c34beea37 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.219308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-238a8e83-8261-4e51-901a-d99c34beea37 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.219903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-238a8e83-8261-4e51-901a-d99c34beea37 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.220789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-238a8e83-8261-4e51-901a-d99c34beea37 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.221409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-238a8e83-8261-4e51-901a-d99c34beea37 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.222057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-238a8e83-8261-4e51-901a-d99c34beea37 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.398973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-238a8e83-8261-4e51-901a-d99c34beea37 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:15.402864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:15.408007 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-238a8e83-8261-4e51-901a-d99c34beea37 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1674 microversion: 2.1 time: 0.205262 Oct 29 02:54:15.408932 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1160/2367] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:15 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1674 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:15.415009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:15.415793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:15.423016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.423691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:15.424124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.425199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.425308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:15.426308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.426898 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f6706c53-ab19-445c-98c7-a45e227db29b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.341614 Oct 29 02:54:15.427202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.427476 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1208/2368] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:15 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:15.428012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.591947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:15.601082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:15.603008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:15.604339 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ebfecd21-552d-4b66-a071-e2a21dcdf75a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.193501 Oct 29 02:54:15.605113 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1161/2369] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:15 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:15.661353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-71da78f9-8752-4f14-8cdf-aaae5d934e3e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:15.662057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-71da78f9-8752-4f14-8cdf-aaae5d934e3e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:15.663072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-60a6aa93-c26e-47bf-842d-4f32d33e13c3 tempest-FlavorsV2NegativeTest-1742954686 tempest-FlavorsV2NegativeTest-1742954686-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:15.669009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71da78f9-8752-4f14-8cdf-aaae5d934e3e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.669681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71da78f9-8752-4f14-8cdf-aaae5d934e3e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.670175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71da78f9-8752-4f14-8cdf-aaae5d934e3e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.671257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71da78f9-8752-4f14-8cdf-aaae5d934e3e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.671829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71da78f9-8752-4f14-8cdf-aaae5d934e3e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.672348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71da78f9-8752-4f14-8cdf-aaae5d934e3e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.674135 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-60a6aa93-c26e-47bf-842d-4f32d33e13c3 tempest-FlavorsV2NegativeTest-1742954686 tempest-FlavorsV2NegativeTest-1742954686-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.190536 Oct 29 02:54:15.675005 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1209/2370] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:54:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:54:15.844569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-71da78f9-8752-4f14-8cdf-aaae5d934e3e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:15.847900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec13cb9a-1cc0-4938-b9eb-c7c2290a7190 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:15.848686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ec13cb9a-1cc0-4938-b9eb-c7c2290a7190 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:15.856755 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-71da78f9-8752-4f14-8cdf-aaae5d934e3e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.202273 Oct 29 02:54:15.863724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec13cb9a-1cc0-4938-b9eb-c7c2290a7190 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.864382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec13cb9a-1cc0-4938-b9eb-c7c2290a7190 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.864972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec13cb9a-1cc0-4938-b9eb-c7c2290a7190 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.866716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec13cb9a-1cc0-4938-b9eb-c7c2290a7190 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.868725 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1162/2371] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:15 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:15.873160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec13cb9a-1cc0-4938-b9eb-c7c2290a7190 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.876019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec13cb9a-1cc0-4938-b9eb-c7c2290a7190 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.881933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2de1a910-7984-4da9-a514-9af89ed10ca7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:15.882988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2de1a910-7984-4da9-a514-9af89ed10ca7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:15.891113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2de1a910-7984-4da9-a514-9af89ed10ca7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.891823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2de1a910-7984-4da9-a514-9af89ed10ca7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.892399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2de1a910-7984-4da9-a514-9af89ed10ca7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.893517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2de1a910-7984-4da9-a514-9af89ed10ca7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.894182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2de1a910-7984-4da9-a514-9af89ed10ca7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.894936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2de1a910-7984-4da9-a514-9af89ed10ca7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.054054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ec13cb9a-1cc0-4938-b9eb-c7c2290a7190 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.064156 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ec13cb9a-1cc0-4938-b9eb-c7c2290a7190 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.220394 Oct 29 02:54:16.065409 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1210/2372] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:15 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:16.084127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2de1a910-7984-4da9-a514-9af89ed10ca7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.094855 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2de1a910-7984-4da9-a514-9af89ed10ca7 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1404 microversion: 2.1 time: 0.216890 Oct 29 02:54:16.096689 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1163/2373] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:15 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:16.351886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3ae7bf2-6727-4bd0-aee5-e0fe8f82b9b7 tempest-FlavorsV2NegativeTest-1742954686 tempest-FlavorsV2NegativeTest-1742954686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-156831215", "imageRef": "94ff172c-d233-4ab6-8d91-3c51369f479d", "flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:16.410964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-a3ae7bf2-6727-4bd0-aee5-e0fe8f82b9b7 tempest-FlavorsV2NegativeTest-1742954686 tempest-FlavorsV2NegativeTest-1742954686-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:54:16.436335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-18177882-a27c-4290-9f55-4c8b5aff07d2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:16.437058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-18177882-a27c-4290-9f55-4c8b5aff07d2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:16.445177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18177882-a27c-4290-9f55-4c8b5aff07d2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.445922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18177882-a27c-4290-9f55-4c8b5aff07d2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.446442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18177882-a27c-4290-9f55-4c8b5aff07d2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.447263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18177882-a27c-4290-9f55-4c8b5aff07d2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.455638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18177882-a27c-4290-9f55-4c8b5aff07d2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.456248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18177882-a27c-4290-9f55-4c8b5aff07d2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.632664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-18177882-a27c-4290-9f55-4c8b5aff07d2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.642822 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-18177882-a27c-4290-9f55-4c8b5aff07d2 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1674 microversion: 2.1 time: 0.211214 Oct 29 02:54:16.643487 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1164/2374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:16 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1674 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:16.646119 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-a3ae7bf2-6727-4bd0-aee5-e0fe8f82b9b7 tempest-FlavorsV2NegativeTest-1742954686 tempest-FlavorsV2NegativeTest-1742954686-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 29 02:54:16.648717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3ae7bf2-6727-4bd0-aee5-e0fe8f82b9b7 tempest-FlavorsV2NegativeTest-1742954686 tempest-FlavorsV2NegativeTest-1742954686-project] Request method failure captured: Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 142 Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJXXR-AIzyrEPjuO9VBigRjTCDOpa_3KOKGFP-gKaZi7TRfsviqsOGEiquwWHmS0GG6Zq7OUybFCrgkpX0MBG9G1io5resTHw7_QDWn0LawUScJ0VmNLFWLySzn4Zk8JyexzbSf7X7xG9bzYPRt9dslX4DrTE0TtQt11Ir-oZl65bac Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: d7aec6191ee4471ebb8c025e8ccb7c6b Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FlavorsV2NegativeTest-1742954686 Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d7aec6191ee4471ebb8c025e8ccb7c6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7aec6191ee4471ebb8c025e8ccb7c6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d7aec6191ee4471ebb8c025e8ccb7c6b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d7aec6191ee4471ebb8c025e8ccb7c6b"}]}] Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FlavorsV2NegativeTest-1742954686 Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: d7aec6191ee4471ebb8c025e8ccb7c6b Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1742954686 Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FlavorsV2NegativeTest-1742954686-project Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 44e2123a4d8b47569d4a1961b66c6185 Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FlavorsV2NegativeTest-1742954686-project Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-156831215", "imageRef": "94ff172c-d233-4ab6-8d91-3c51369f479d", "flavorRef": "452"}} Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: exception: Flavor's memory is too small for requested image. Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-156831215', 'imageRef': '94ff172c-d233-4ab6-8d91-3c51369f479d', 'flavorRef': '452'}}} Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:54:16.648960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3ae7bf2-6727-4bd0-aee5-e0fe8f82b9b7 tempest-FlavorsV2NegativeTest-1742954686 tempest-FlavorsV2NegativeTest-1742954686-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:16.652423 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3ae7bf2-6727-4bd0-aee5-e0fe8f82b9b7 tempest-FlavorsV2NegativeTest-1742954686 tempest-FlavorsV2NegativeTest-1742954686-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.303988 Oct 29 02:54:16.655432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:16.656260 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1211/2375] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:54:16 2022] POST /compute/v2.1/servers => generated 93 bytes in 309 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:16.663174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:16.664304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:16.670203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.670961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.671697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.672633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.673546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.674150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.675459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.676347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.677056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.678376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.678842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.679412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.696875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:16.883252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.897504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.900170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.901769 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-74356d40-195e-4326-881d-7d904887eeb5 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.243816 Oct 29 02:54:16.902950 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1212/2376] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:16 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:16.909990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-34c8992d-4e11-4749-ad24-a3ee10c7a661 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:16.910658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-34c8992d-4e11-4749-ad24-a3ee10c7a661 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:16.934192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34c8992d-4e11-4749-ad24-a3ee10c7a661 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.947082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34c8992d-4e11-4749-ad24-a3ee10c7a661 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.948545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34c8992d-4e11-4749-ad24-a3ee10c7a661 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.950719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34c8992d-4e11-4749-ad24-a3ee10c7a661 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.951889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34c8992d-4e11-4749-ad24-a3ee10c7a661 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.953296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34c8992d-4e11-4749-ad24-a3ee10c7a661 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.961826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.978873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.980775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.982217 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-05bfa087-43eb-43f5-a357-c194d66fdd9b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.337385 Oct 29 02:54:16.983021 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1165/2377] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:16 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:17.089217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-81c1ce87-c7d6-4b31-a2a3-8a1577a4f5e9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:17.090139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-81c1ce87-c7d6-4b31-a2a3-8a1577a4f5e9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:17.103484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81c1ce87-c7d6-4b31-a2a3-8a1577a4f5e9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.104017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81c1ce87-c7d6-4b31-a2a3-8a1577a4f5e9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.104453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81c1ce87-c7d6-4b31-a2a3-8a1577a4f5e9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.105256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81c1ce87-c7d6-4b31-a2a3-8a1577a4f5e9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.106956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81c1ce87-c7d6-4b31-a2a3-8a1577a4f5e9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.107607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81c1ce87-c7d6-4b31-a2a3-8a1577a4f5e9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.148360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34c8992d-4e11-4749-ad24-a3ee10c7a661 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:17.161506 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-34c8992d-4e11-4749-ad24-a3ee10c7a661 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.257335 Oct 29 02:54:17.165412 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1213/2378] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:16 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:17.171071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a7b2ef2d-e837-4ccf-9c5f-96bff4354579 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:17.171780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a7b2ef2d-e837-4ccf-9c5f-96bff4354579 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:17.188468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7b2ef2d-e837-4ccf-9c5f-96bff4354579 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.189041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7b2ef2d-e837-4ccf-9c5f-96bff4354579 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.189474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7b2ef2d-e837-4ccf-9c5f-96bff4354579 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.190400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7b2ef2d-e837-4ccf-9c5f-96bff4354579 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.190836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7b2ef2d-e837-4ccf-9c5f-96bff4354579 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.191316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7b2ef2d-e837-4ccf-9c5f-96bff4354579 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.458206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a7b2ef2d-e837-4ccf-9c5f-96bff4354579 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:17.468677 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a7b2ef2d-e837-4ccf-9c5f-96bff4354579 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1590 microversion: 2.1 time: 0.301754 Oct 29 02:54:17.472561 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1214/2379] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:17 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1590 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:17.502725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2908477a-86a8-434b-ab44-6748f8b750a2 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:17.503484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2908477a-86a8-434b-ab44-6748f8b750a2 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:17.520656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2908477a-86a8-434b-ab44-6748f8b750a2 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.523332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2908477a-86a8-434b-ab44-6748f8b750a2 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.526381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2908477a-86a8-434b-ab44-6748f8b750a2 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.527777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2908477a-86a8-434b-ab44-6748f8b750a2 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.529107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2908477a-86a8-434b-ab44-6748f8b750a2 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.529734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2908477a-86a8-434b-ab44-6748f8b750a2 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.680005 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2908477a-86a8-434b-ab44-6748f8b750a2 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.182083 Oct 29 02:54:17.680623 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1215/2380] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 02:54:17 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:54:17.685336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-88973ed7-709c-43ef-8d20-f5fe61d5963b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:17.686156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-88973ed7-709c-43ef-8d20-f5fe61d5963b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:17.715581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88973ed7-709c-43ef-8d20-f5fe61d5963b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.716336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88973ed7-709c-43ef-8d20-f5fe61d5963b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.716942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88973ed7-709c-43ef-8d20-f5fe61d5963b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.717842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88973ed7-709c-43ef-8d20-f5fe61d5963b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.718440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88973ed7-709c-43ef-8d20-f5fe61d5963b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.719068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88973ed7-709c-43ef-8d20-f5fe61d5963b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.907863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-81c1ce87-c7d6-4b31-a2a3-8a1577a4f5e9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:17.923055 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-81c1ce87-c7d6-4b31-a2a3-8a1577a4f5e9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.837926 Oct 29 02:54:17.940024 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1166/2381] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:17 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:17.945266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:17.953898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:17.980505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.981795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.982505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.986610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.987229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.987844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:18.368320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-88973ed7-709c-43ef-8d20-f5fe61d5963b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:18.392908 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-88973ed7-709c-43ef-8d20-f5fe61d5963b tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1674 microversion: 2.1 time: 0.709736 Oct 29 02:54:18.417183 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1216/2382] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:17 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1674 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:18.424396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:18.426613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:18.434748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:18.435562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:18.436821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:18.438801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:18.439508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:18.440088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:18.543917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:18.571111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:18.572746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:18.574332 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b43de23f-49c9-470e-90e5-39794ad3c508 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.633149 Oct 29 02:54:18.575040 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1167/2383] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:17 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:18.602556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1124d64e-5607-4ace-a963-b4c0bdd8450c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:18.608540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1124d64e-5607-4ace-a963-b4c0bdd8450c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:18.625100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1124d64e-5607-4ace-a963-b4c0bdd8450c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:18.628456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1124d64e-5607-4ace-a963-b4c0bdd8450c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:18.630317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1124d64e-5607-4ace-a963-b4c0bdd8450c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:18.638136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1124d64e-5607-4ace-a963-b4c0bdd8450c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:18.638803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1124d64e-5607-4ace-a963-b4c0bdd8450c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:18.639251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1124d64e-5607-4ace-a963-b4c0bdd8450c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:18.968585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:18.980350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:18.982571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:18.984152 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d265a55-99ad-46e0-b79b-4bdce4809097 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.565598 Oct 29 02:54:18.998278 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1217/2384] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:18 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:19.010886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6dd38902-7366-4430-8bb9-9e8417b4f170 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:19.011759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6dd38902-7366-4430-8bb9-9e8417b4f170 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:19.018332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd38902-7366-4430-8bb9-9e8417b4f170 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.019011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd38902-7366-4430-8bb9-9e8417b4f170 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.020625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd38902-7366-4430-8bb9-9e8417b4f170 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.021515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd38902-7366-4430-8bb9-9e8417b4f170 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.022153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd38902-7366-4430-8bb9-9e8417b4f170 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.022714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd38902-7366-4430-8bb9-9e8417b4f170 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.179066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1124d64e-5607-4ace-a963-b4c0bdd8450c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:19.194929 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1124d64e-5607-4ace-a963-b4c0bdd8450c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.599274 Oct 29 02:54:19.194929 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1168/2385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:18 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:19.386555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6dd38902-7366-4430-8bb9-9e8417b4f170 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:19.404555 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6dd38902-7366-4430-8bb9-9e8417b4f170 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.403770 Oct 29 02:54:19.405846 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1218/2386] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:18 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:19.423395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a97e0ece-e0b6-420a-8f32-42c81c5f9980 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:19.424750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a97e0ece-e0b6-420a-8f32-42c81c5f9980 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:19.432360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a97e0ece-e0b6-420a-8f32-42c81c5f9980 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.432857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a97e0ece-e0b6-420a-8f32-42c81c5f9980 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.433451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a97e0ece-e0b6-420a-8f32-42c81c5f9980 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.434590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a97e0ece-e0b6-420a-8f32-42c81c5f9980 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.435057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a97e0ece-e0b6-420a-8f32-42c81c5f9980 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.435485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a97e0ece-e0b6-420a-8f32-42c81c5f9980 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.610234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:19.611143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:19.613867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:19.630048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.630815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.632696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.633617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.635923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.636952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.990158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.000014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.001820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.003252 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-de9d583e-3fa1-477e-ba15-28bb98531f17 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.397339 Oct 29 02:54:20.015236 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1219/2387] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:19 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:54:20.028057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-54460c0e-7ee4-42e2-99da-4debc224e07a req-58985343-e680-43d9-98d2-87950f951c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b13b0f93-4ed1-4257-8a35-0db82db20bd7", "name": "network-vif-unplugged", "status": "completed", "tag": "f5ac891c-6ef2-46f7-96d6-3bb775f98a04"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:20.047525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-54460c0e-7ee4-42e2-99da-4debc224e07a req-58985343-e680-43d9-98d2-87950f951c29 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.048690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-54460c0e-7ee4-42e2-99da-4debc224e07a req-58985343-e680-43d9-98d2-87950f951c29 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.049583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-54460c0e-7ee4-42e2-99da-4debc224e07a req-58985343-e680-43d9-98d2-87950f951c29 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:20.067963 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-54460c0e-7ee4-42e2-99da-4debc224e07a req-58985343-e680-43d9-98d2-87950f951c29 service nova] Creating event network-vif-unplugged:f5ac891c-6ef2-46f7-96d6-3bb775f98a04 for instance b13b0f93-4ed1-4257-8a35-0db82db20bd7 on n-h1-862964-4 Oct 29 02:54:20.079246 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-54460c0e-7ee4-42e2-99da-4debc224e07a req-58985343-e680-43d9-98d2-87950f951c29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061033 Oct 29 02:54:20.080456 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1220/2388] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:20.089593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bcf4d3c0-bab1-4a86-a634-c2bb26643ae6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:20.091869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bcf4d3c0-bab1-4a86-a634-c2bb26643ae6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:20.108064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcf4d3c0-bab1-4a86-a634-c2bb26643ae6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.109109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcf4d3c0-bab1-4a86-a634-c2bb26643ae6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.127248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcf4d3c0-bab1-4a86-a634-c2bb26643ae6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:20.130890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcf4d3c0-bab1-4a86-a634-c2bb26643ae6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.132375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcf4d3c0-bab1-4a86-a634-c2bb26643ae6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.133915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcf4d3c0-bab1-4a86-a634-c2bb26643ae6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:20.242864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a97e0ece-e0b6-420a-8f32-42c81c5f9980 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.259205 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a97e0ece-e0b6-420a-8f32-42c81c5f9980 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1674 microversion: 2.1 time: 0.841991 Oct 29 02:54:20.259517 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1169/2389] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:19 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1674 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:20.264351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9e1de987-4124-4816-a784-194b6f64cd1d req-7e45c789-fc59-4a14-80cf-31df6bf1a459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab", "tag": "865810e5-9544-4851-8631-350a7fd73c5f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:20.287677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9e1de987-4124-4816-a784-194b6f64cd1d req-7e45c789-fc59-4a14-80cf-31df6bf1a459 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.288426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9e1de987-4124-4816-a784-194b6f64cd1d req-7e45c789-fc59-4a14-80cf-31df6bf1a459 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.288994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9e1de987-4124-4816-a784-194b6f64cd1d req-7e45c789-fc59-4a14-80cf-31df6bf1a459 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:20.318231 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9e1de987-4124-4816-a784-194b6f64cd1d req-7e45c789-fc59-4a14-80cf-31df6bf1a459 service nova] Creating event network-changed:865810e5-9544-4851-8631-350a7fd73c5f for instance aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab on n-h2-862964-4 Oct 29 02:54:20.327862 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9e1de987-4124-4816-a784-194b6f64cd1d req-7e45c789-fc59-4a14-80cf-31df6bf1a459 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066946 Oct 29 02:54:20.328553 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1170/2390] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:20.340794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:20.341497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:20.360825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.361309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.361734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:20.362478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.362920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.367040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:20.467257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bcf4d3c0-bab1-4a86-a634-c2bb26643ae6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.483965 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bcf4d3c0-bab1-4a86-a634-c2bb26643ae6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1590 microversion: 2.1 time: 0.400006 Oct 29 02:54:20.486265 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1221/2391] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:20 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1590 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:20.503012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51012124-9256-4ba0-b563-faa744d3aa6d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:20.504584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-51012124-9256-4ba0-b563-faa744d3aa6d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:20.515422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51012124-9256-4ba0-b563-faa744d3aa6d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.517218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51012124-9256-4ba0-b563-faa744d3aa6d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.520681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51012124-9256-4ba0-b563-faa744d3aa6d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:20.522404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51012124-9256-4ba0-b563-faa744d3aa6d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.523043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51012124-9256-4ba0-b563-faa744d3aa6d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.523702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51012124-9256-4ba0-b563-faa744d3aa6d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:20.720217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.739645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.744209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.746098 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d514855-b6c2-4acc-bc5a-7649502664ad tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.415816 Oct 29 02:54:20.759705 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1171/2392] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:20 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:20.771274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0fd1224a-4048-47ef-b6a5-82bb17759f59 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:20.771850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-51012124-9256-4ba0-b563-faa744d3aa6d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.777201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0fd1224a-4048-47ef-b6a5-82bb17759f59 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:20.783788 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-51012124-9256-4ba0-b563-faa744d3aa6d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.295835 Oct 29 02:54:20.785149 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1222/2393] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:20 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:20.808796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fd1224a-4048-47ef-b6a5-82bb17759f59 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.809732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fd1224a-4048-47ef-b6a5-82bb17759f59 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.810613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fd1224a-4048-47ef-b6a5-82bb17759f59 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:20.811607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fd1224a-4048-47ef-b6a5-82bb17759f59 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.812368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fd1224a-4048-47ef-b6a5-82bb17759f59 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.813152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fd1224a-4048-47ef-b6a5-82bb17759f59 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:21.035782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:21.036702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:21.063830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:21.064654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:21.065270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:21.066197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:21.066808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:21.067358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:21.168797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0fd1224a-4048-47ef-b6a5-82bb17759f59 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:21.189125 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0fd1224a-4048-47ef-b6a5-82bb17759f59 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.420529 Oct 29 02:54:21.192712 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1172/2394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:20 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:21.289738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-027d6239-8ef5-4a95-b651-56503111d089 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:21.290977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-027d6239-8ef5-4a95-b651-56503111d089 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:21.304620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-027d6239-8ef5-4a95-b651-56503111d089 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:21.305490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-027d6239-8ef5-4a95-b651-56503111d089 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:21.306119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-027d6239-8ef5-4a95-b651-56503111d089 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:21.306991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-027d6239-8ef5-4a95-b651-56503111d089 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:21.308594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-027d6239-8ef5-4a95-b651-56503111d089 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:21.309460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-027d6239-8ef5-4a95-b651-56503111d089 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:21.316080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:21.328118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:21.330820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:21.332161 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-baa2951d-1b19-4a82-a11f-95e8b9382b62 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.303999 Oct 29 02:54:21.333064 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1223/2395] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:21 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:21.616708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-adf62f8d-6a4e-47cc-a726-9121842b860c req-f3a6b610-a091-4bd9-8315-287009890a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e8fb7c-e71d-4e00-9806-7b2b295a32fa", "name": "network-vif-unplugged", "status": "completed", "tag": "370d1fd9-7205-4c54-bdb3-e0ae1de142a0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:21.644622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-adf62f8d-6a4e-47cc-a726-9121842b860c req-f3a6b610-a091-4bd9-8315-287009890a43 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:21.645463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-adf62f8d-6a4e-47cc-a726-9121842b860c req-f3a6b610-a091-4bd9-8315-287009890a43 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:21.646174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-adf62f8d-6a4e-47cc-a726-9121842b860c req-f3a6b610-a091-4bd9-8315-287009890a43 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:21.674016 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-adf62f8d-6a4e-47cc-a726-9121842b860c req-f3a6b610-a091-4bd9-8315-287009890a43 service nova] Creating event network-vif-unplugged:370d1fd9-7205-4c54-bdb3-e0ae1de142a0 for instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa on n-h2-862964-4 Oct 29 02:54:21.679687 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-adf62f8d-6a4e-47cc-a726-9121842b860c req-f3a6b610-a091-4bd9-8315-287009890a43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066925 Oct 29 02:54:21.680803 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1224/2396] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:21.771163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:21.775996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:21.776976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:21.793456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:21.794747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:21.796582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:21.799377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:21.800038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:21.802480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:21.858825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:21.906197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-027d6239-8ef5-4a95-b651-56503111d089 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:21.915461 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-027d6239-8ef5-4a95-b651-56503111d089 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1611 microversion: 2.1 time: 0.630287 Oct 29 02:54:21.922466 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1173/2397] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:21 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1611 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:21.929103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3ddd8591-1950-498e-ba10-2e736b35854e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:21.933335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3ddd8591-1950-498e-ba10-2e736b35854e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:21.953697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddd8591-1950-498e-ba10-2e736b35854e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:21.960472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddd8591-1950-498e-ba10-2e736b35854e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:21.961138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddd8591-1950-498e-ba10-2e736b35854e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:21.962274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddd8591-1950-498e-ba10-2e736b35854e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:21.962942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddd8591-1950-498e-ba10-2e736b35854e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:21.963545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddd8591-1950-498e-ba10-2e736b35854e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:22.124884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:22.488664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ddd8591-1950-498e-ba10-2e736b35854e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:22.503731 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3ddd8591-1950-498e-ba10-2e736b35854e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.578617 Oct 29 02:54:22.505538 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1174/2398] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:21 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:22.513584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a51be637-98da-46dd-97ea-eba45edec87a req-2b0c95c7-c41c-498c-bc74-548a928a07f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e8fb7c-e71d-4e00-9806-7b2b295a32fa", "name": "network-vif-deleted", "tag": "41e4be31-a897-46bb-b7f6-4f6dac346a37"}, {"name": "network-changed", "server_uuid": "b13b0f93-4ed1-4257-8a35-0db82db20bd7", "tag": "f5ac891c-6ef2-46f7-96d6-3bb775f98a04"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:22.536491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a51be637-98da-46dd-97ea-eba45edec87a req-2b0c95c7-c41c-498c-bc74-548a928a07f6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:22.537227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a51be637-98da-46dd-97ea-eba45edec87a req-2b0c95c7-c41c-498c-bc74-548a928a07f6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:22.538011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a51be637-98da-46dd-97ea-eba45edec87a req-2b0c95c7-c41c-498c-bc74-548a928a07f6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:22.588755 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a51be637-98da-46dd-97ea-eba45edec87a req-2b0c95c7-c41c-498c-bc74-548a928a07f6 service nova] Creating event network-vif-deleted:41e4be31-a897-46bb-b7f6-4f6dac346a37 for instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa on n-h2-862964-4 Oct 29 02:54:22.591086 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a51be637-98da-46dd-97ea-eba45edec87a req-2b0c95c7-c41c-498c-bc74-548a928a07f6 service nova] Creating event network-changed:f5ac891c-6ef2-46f7-96d6-3bb775f98a04 for instance b13b0f93-4ed1-4257-8a35-0db82db20bd7 on n-h1-862964-4 Oct 29 02:54:22.618325 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a51be637-98da-46dd-97ea-eba45edec87a req-2b0c95c7-c41c-498c-bc74-548a928a07f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.111086 Oct 29 02:54:22.622918 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1175/2399] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:22.637256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-acf524e2-3ec6-4e55-ab47-0732132ad589 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:22.645258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-acf524e2-3ec6-4e55-ab47-0732132ad589 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:22.655238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:22.663374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acf524e2-3ec6-4e55-ab47-0732132ad589 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:22.664944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acf524e2-3ec6-4e55-ab47-0732132ad589 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:22.665676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acf524e2-3ec6-4e55-ab47-0732132ad589 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:22.671108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:22.671310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acf524e2-3ec6-4e55-ab47-0732132ad589 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:22.671731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acf524e2-3ec6-4e55-ab47-0732132ad589 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:22.672244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-acf524e2-3ec6-4e55-ab47-0732132ad589 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:22.676949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:22.679124 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18a8f451-868d-4069-aece-521d52161b49 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.908948 Oct 29 02:54:22.699120 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1225/2400] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:21 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:22.712682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:22.713310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:22.724286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:22.733769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:22.734640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:22.738565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:22.741594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:22.742391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:22.970730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-acf524e2-3ec6-4e55-ab47-0732132ad589 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:22.980094 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-acf524e2-3ec6-4e55-ab47-0732132ad589 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.355157 Oct 29 02:54:22.994499 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1176/2401] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:22 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:23.005172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:23.006302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:23.013433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:23.014200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:23.014779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:23.015629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:23.016301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:23.017257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:23.062115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:23.062910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:23.063495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:23.064261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lazy-loading 'fault' on Instance uuid 87e8fb7c-e71d-4e00-9806-7b2b295a32fa {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:54:23.124863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:23.137508 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-96635e89-ed03-46bd-872c-e9cab2de6f26 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1303 microversion: 2.1 time: 0.140048 Oct 29 02:54:23.138609 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1177/2402] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:22 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:23.269537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:23.282363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:23.284111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:23.286896 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d9e6d289-b4a9-45fa-8e0a-0e44960f0602 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.585229 Oct 29 02:54:23.287965 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1226/2403] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:22 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:23.531693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6e775914-941f-4769-956f-adffc766fcdd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:23.532484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6e775914-941f-4769-956f-adffc766fcdd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:23.540738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e775914-941f-4769-956f-adffc766fcdd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:23.542498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e775914-941f-4769-956f-adffc766fcdd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:23.543468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e775914-941f-4769-956f-adffc766fcdd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:23.544680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e775914-941f-4769-956f-adffc766fcdd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:23.545414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e775914-941f-4769-956f-adffc766fcdd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:23.546185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e775914-941f-4769-956f-adffc766fcdd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:23.714266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:23.714893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:23.730134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:23.730980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:23.731502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:23.732251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:23.732705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:23.733131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:23.817481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6e775914-941f-4769-956f-adffc766fcdd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:23.828854 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6e775914-941f-4769-956f-adffc766fcdd tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.301583 Oct 29 02:54:23.830517 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1178/2404] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:23 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:24.009204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-585fbbc6-a619-48dc-9444-56266ebd4ede tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:24.010118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-585fbbc6-a619-48dc-9444-56266ebd4ede tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:24.017953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-585fbbc6-a619-48dc-9444-56266ebd4ede tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:24.018677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-585fbbc6-a619-48dc-9444-56266ebd4ede tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:24.019330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-585fbbc6-a619-48dc-9444-56266ebd4ede tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:24.020230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-585fbbc6-a619-48dc-9444-56266ebd4ede tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:24.020885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-585fbbc6-a619-48dc-9444-56266ebd4ede tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:24.021722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-585fbbc6-a619-48dc-9444-56266ebd4ede tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:24.231603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-585fbbc6-a619-48dc-9444-56266ebd4ede tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:24.242242 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-585fbbc6-a619-48dc-9444-56266ebd4ede tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.237224 Oct 29 02:54:24.257083 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1179/2405] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:24 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:24.267284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:24.268273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:24.275622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:24.276335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:24.276915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:24.277770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:24.278401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:24.278963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:24.303628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:24.328346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:24.329319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:24.333227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:24.335260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lazy-loading 'fault' on Instance uuid 87e8fb7c-e71d-4e00-9806-7b2b295a32fa {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:54:24.352426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:24.358477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:24.366479 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-800b224c-daa6-4437-b409-2c3b5d705069 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.656055 Oct 29 02:54:24.367457 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1227/2406] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:23 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:24.375383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:24.387709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:24.405447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:24.410641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:24.411390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:24.412313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:24.413499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:24.415296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:24.433321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2e129a84e847a0b5c80ad47ca4d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86df8edf5044361a65c11542c2dc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:24.445474 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-66e9da91-fcf2-4147-8178-65adc66b5c08 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 200 len: 1303 microversion: 2.1 time: 0.186402 Oct 29 02:54:24.446708 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1180/2407] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:24 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 1303 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:24.676336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-8b07fcf8-1df1-4dd3-a37b-0b7c98313608 req-2ea4024c-43f0-4af2-b90c-b6575b363601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e8fb7c-e71d-4e00-9806-7b2b295a32fa", "name": "network-vif-deleted", "tag": "370d1fd9-7205-4c54-bdb3-e0ae1de142a0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:24.696685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8b07fcf8-1df1-4dd3-a37b-0b7c98313608 req-2ea4024c-43f0-4af2-b90c-b6575b363601 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:24.697586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8b07fcf8-1df1-4dd3-a37b-0b7c98313608 req-2ea4024c-43f0-4af2-b90c-b6575b363601 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:24.698261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8b07fcf8-1df1-4dd3-a37b-0b7c98313608 req-2ea4024c-43f0-4af2-b90c-b6575b363601 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:24.729338 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-8b07fcf8-1df1-4dd3-a37b-0b7c98313608 req-2ea4024c-43f0-4af2-b90c-b6575b363601 service nova] Creating event network-vif-deleted:370d1fd9-7205-4c54-bdb3-e0ae1de142a0 for instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa on n-h2-862964-4 Oct 29 02:54:24.738975 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-8b07fcf8-1df1-4dd3-a37b-0b7c98313608 req-2ea4024c-43f0-4af2-b90c-b6575b363601 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072504 Oct 29 02:54:24.741862 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1181/2408] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:24.826863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:24.844230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:24.847239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:24.850915 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f512eda-36dd-4299-b5b7-56473794aaeb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.475948 Oct 29 02:54:24.857322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76ba0a58-88c1-4260-98cc-2e19ef942d2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:24.858406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-76ba0a58-88c1-4260-98cc-2e19ef942d2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:24.876901 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1228/2409] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:24 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:24.877178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76ba0a58-88c1-4260-98cc-2e19ef942d2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:24.877925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76ba0a58-88c1-4260-98cc-2e19ef942d2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:24.879245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76ba0a58-88c1-4260-98cc-2e19ef942d2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:24.880901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76ba0a58-88c1-4260-98cc-2e19ef942d2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:24.883244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76ba0a58-88c1-4260-98cc-2e19ef942d2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:24.883912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76ba0a58-88c1-4260-98cc-2e19ef942d2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:25.275902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-448ede0d-c4fb-49af-9abd-6c89b7400179 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:25.276994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-448ede0d-c4fb-49af-9abd-6c89b7400179 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:25.294107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-448ede0d-c4fb-49af-9abd-6c89b7400179 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:25.294945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-448ede0d-c4fb-49af-9abd-6c89b7400179 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:25.295621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-448ede0d-c4fb-49af-9abd-6c89b7400179 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:25.296538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-448ede0d-c4fb-49af-9abd-6c89b7400179 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:25.297353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-448ede0d-c4fb-49af-9abd-6c89b7400179 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:25.302972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-448ede0d-c4fb-49af-9abd-6c89b7400179 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:25.492640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-76ba0a58-88c1-4260-98cc-2e19ef942d2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:25.508898 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-76ba0a58-88c1-4260-98cc-2e19ef942d2f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.657531 Oct 29 02:54:25.510593 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1182/2410] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:24 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:25.553040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:25.564222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:25.584558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:25.585002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:25.585428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:25.586188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:25.586644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:25.587313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:25.673106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:26.129262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-448ede0d-c4fb-49af-9abd-6c89b7400179 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:26.139638 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-448ede0d-c4fb-49af-9abd-6c89b7400179 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.870353 Oct 29 02:54:26.165890 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1229/2411] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:25 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:26.168377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:26.178466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:26.179673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:26.180524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:26.195266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:26.196939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:26.198460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:26.198876 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-88dce598-481f-45f0-acdd-841b080c4789 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.671417 Oct 29 02:54:26.199399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:26.199540 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1183/2412] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:25 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:26.201049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:26.201877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:26.203362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:26.221490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:26.223955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:26.236562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:26.239748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:26.240365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:26.241285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:26.241920 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] HTTP exception thrown: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Request method failure captured: Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa HTTP/1.1 Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJVktjAxCUizcWaz4uJsdtOQdSqVlmt3kUsMsJe1ti4S7RVNTBtBtiKNm2mrQ2zRygqSVJCcLcUT-nnXaj3YI8DY3Oeeno6pUQij1gAtIPBD5u150TlvGLQcjMJGQZHHEPkiZ07CbO9PM1X7MhjLdVSdiBDhl2-3QVKSChB86imXU_E Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86df8edf5044361a65c11542c2dc585", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}] Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestMultiNic-191906656-project Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 5d2e129a84e847a0b5c80ad47ca4d233 Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestMultiNic-191906656-project Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '87e8fb7c-e71d-4e00-9806-7b2b295a32fa'} Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:26.244443 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:26.248031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:26.248031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:26.248031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:26.248031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:26.248031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:26.248031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:26.248031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:26.248031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Returning 404 to user: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:26.248031 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-15c65a5d-b5b4-496f-a302-6b19d1ffd5bd tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 404 len: 111 microversion: 2.1 time: 0.079116 Oct 29 02:54:26.248031 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1230/2413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:26 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:26.250141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:26.251082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:26.545739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d449e3d1-1ead-4a01-8a40-4f3f95c4ba3d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:26.546654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d449e3d1-1ead-4a01-8a40-4f3f95c4ba3d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:26.580383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:26.598587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d449e3d1-1ead-4a01-8a40-4f3f95c4ba3d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:26.599467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d449e3d1-1ead-4a01-8a40-4f3f95c4ba3d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:26.599933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d449e3d1-1ead-4a01-8a40-4f3f95c4ba3d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:26.600467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:26.600736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d449e3d1-1ead-4a01-8a40-4f3f95c4ba3d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:26.601197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d449e3d1-1ead-4a01-8a40-4f3f95c4ba3d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:26.601619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d449e3d1-1ead-4a01-8a40-4f3f95c4ba3d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:26.603946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:26.608684 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-36d6de33-0115-4b41-814c-2a588242f2c1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.395210 Oct 29 02:54:26.611005 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1184/2414] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:26 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:26.705129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4ec85b93-31e4-4614-b3e7-05ff82d498b5 req-b49e9bde-d5ba-4a75-8bff-a6aeef704889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-plugged", "status": "completed", "tag": "5de667bc-fe03-4e62-86b0-0d4687f62228"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:26.728922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4ec85b93-31e4-4614-b3e7-05ff82d498b5 req-b49e9bde-d5ba-4a75-8bff-a6aeef704889 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:26.732733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4ec85b93-31e4-4614-b3e7-05ff82d498b5 req-b49e9bde-d5ba-4a75-8bff-a6aeef704889 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:26.733796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4ec85b93-31e4-4614-b3e7-05ff82d498b5 req-b49e9bde-d5ba-4a75-8bff-a6aeef704889 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:26.786007 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4ec85b93-31e4-4614-b3e7-05ff82d498b5 req-b49e9bde-d5ba-4a75-8bff-a6aeef704889 service nova] Creating event network-vif-plugged:5de667bc-fe03-4e62-86b0-0d4687f62228 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:54:26.807472 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4ec85b93-31e4-4614-b3e7-05ff82d498b5 req-b49e9bde-d5ba-4a75-8bff-a6aeef704889 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104655 Oct 29 02:54:26.812157 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1185/2415] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:54:27.086857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d449e3d1-1ead-4a01-8a40-4f3f95c4ba3d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:27.098536 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d449e3d1-1ead-4a01-8a40-4f3f95c4ba3d tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.559560 Oct 29 02:54:27.100353 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1231/2416] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:26 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:27.192149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-df0d17cd-9071-4b8d-828d-cc5c4644690a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:27.195358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-df0d17cd-9071-4b8d-828d-cc5c4644690a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:27.230676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df0d17cd-9071-4b8d-828d-cc5c4644690a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:27.231088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:27.231862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:27.233456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df0d17cd-9071-4b8d-828d-cc5c4644690a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:27.233966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df0d17cd-9071-4b8d-828d-cc5c4644690a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:27.238003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df0d17cd-9071-4b8d-828d-cc5c4644690a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:27.239394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df0d17cd-9071-4b8d-828d-cc5c4644690a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:27.239850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df0d17cd-9071-4b8d-828d-cc5c4644690a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:27.249326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:27.251029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:27.251844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:27.253326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:27.254751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:27.255790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:27.632904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-df0d17cd-9071-4b8d-828d-cc5c4644690a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:27.655961 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-df0d17cd-9071-4b8d-828d-cc5c4644690a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.488280 Oct 29 02:54:27.669841 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1186/2417] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:27 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:27.669841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:27.669841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:27.677028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:27.677028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:27.677028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:27.677028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:27.677028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:27.677468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:28.094762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:28.110278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:28.111796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:28.126935 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f8f06e48-39a7-454b-87c7-b1bd4eac9206 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.454167 Oct 29 02:54:28.131413 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1187/2418] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:27 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:28.153965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-24e7ccfe-1761-4649-9dfb-67840141b2f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:28.156835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-24e7ccfe-1761-4649-9dfb-67840141b2f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:28.179666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24e7ccfe-1761-4649-9dfb-67840141b2f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:28.180166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24e7ccfe-1761-4649-9dfb-67840141b2f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:28.180605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24e7ccfe-1761-4649-9dfb-67840141b2f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:28.181334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24e7ccfe-1761-4649-9dfb-67840141b2f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:28.183433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24e7ccfe-1761-4649-9dfb-67840141b2f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:28.186091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:28.193474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24e7ccfe-1761-4649-9dfb-67840141b2f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:28.204591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:28.209754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:28.214798 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ee5784ea-f9d4-4baa-916f-cc4069c169df tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.989667 Oct 29 02:54:28.219476 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1232/2419] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:27 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:54:28.472091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-24e7ccfe-1761-4649-9dfb-67840141b2f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:28.500326 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-24e7ccfe-1761-4649-9dfb-67840141b2f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.364567 Oct 29 02:54:28.513601 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1188/2420] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:28 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:28.690163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-36cef923-b458-47b4-b300-db6d1a735656 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:28.694705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-36cef923-b458-47b4-b300-db6d1a735656 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:28.707098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36cef923-b458-47b4-b300-db6d1a735656 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:28.708848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36cef923-b458-47b4-b300-db6d1a735656 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:28.709569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36cef923-b458-47b4-b300-db6d1a735656 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:28.710635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36cef923-b458-47b4-b300-db6d1a735656 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:28.711533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36cef923-b458-47b4-b300-db6d1a735656 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:28.724049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36cef923-b458-47b4-b300-db6d1a735656 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:28.917013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-53afcee4-df5e-4bb0-96f6-53845f887ae4 req-953311a2-eb4b-40c0-a3ae-03c34c16f751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e07792-807a-44e9-b644-72504509f2f5", "name": "network-vif-plugged", "status": "completed", "tag": "8a4b46d3-0738-4cd4-a78e-25f2da119a4e"}, {"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-plugged", "status": "completed", "tag": "f9ad5c3b-d639-4b01-8092-245696df4798"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:28.934470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-53afcee4-df5e-4bb0-96f6-53845f887ae4 req-953311a2-eb4b-40c0-a3ae-03c34c16f751 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:28.935609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-53afcee4-df5e-4bb0-96f6-53845f887ae4 req-953311a2-eb4b-40c0-a3ae-03c34c16f751 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:28.936391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-53afcee4-df5e-4bb0-96f6-53845f887ae4 req-953311a2-eb4b-40c0-a3ae-03c34c16f751 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:28.972482 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-53afcee4-df5e-4bb0-96f6-53845f887ae4 req-953311a2-eb4b-40c0-a3ae-03c34c16f751 service nova] Creating event network-vif-plugged:8a4b46d3-0738-4cd4-a78e-25f2da119a4e for instance 26e07792-807a-44e9-b644-72504509f2f5 on n-h2-862964-4 Oct 29 02:54:28.973221 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-53afcee4-df5e-4bb0-96f6-53845f887ae4 req-953311a2-eb4b-40c0-a3ae-03c34c16f751 service nova] Creating event network-vif-plugged:f9ad5c3b-d639-4b01-8092-245696df4798 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:54:28.988933 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-53afcee4-df5e-4bb0-96f6-53845f887ae4 req-953311a2-eb4b-40c0-a3ae-03c34c16f751 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076134 Oct 29 02:54:28.990310 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1189/2421] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:29.167607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:29.168626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:29.190078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:29.191954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:29.192505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:29.193433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:29.196087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:29.197131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:29.241670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-36cef923-b458-47b4-b300-db6d1a735656 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:29.274057 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-36cef923-b458-47b4-b300-db6d1a735656 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.586771 Oct 29 02:54:29.276732 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1233/2422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:28 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:29.295651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:29.296308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:29.329971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:29.334873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:29.335441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:29.342905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:29.344752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:29.347116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:30.091849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:30.106259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:30.110346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:30.117276 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c167433-3585-4a7b-9ad2-076bb564bb99 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.953522 Oct 29 02:54:30.125852 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1190/2423] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:29 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:30.133978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4f73dfe6-498d-41e7-bfb6-f4b82d9295f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:30.134924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4f73dfe6-498d-41e7-bfb6-f4b82d9295f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:30.141422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f73dfe6-498d-41e7-bfb6-f4b82d9295f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:30.143126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f73dfe6-498d-41e7-bfb6-f4b82d9295f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:30.146502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f73dfe6-498d-41e7-bfb6-f4b82d9295f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:30.147420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f73dfe6-498d-41e7-bfb6-f4b82d9295f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:30.148036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f73dfe6-498d-41e7-bfb6-f4b82d9295f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:30.148612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f73dfe6-498d-41e7-bfb6-f4b82d9295f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:30.268623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:30.285205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:30.287099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:30.289254 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b4637bd7-d6c5-401f-b6c0-16b07d0233e6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 1.011438 Oct 29 02:54:30.289939 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1234/2424] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:29 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:30.315135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7494a44c-36c2-4b6d-b816-c8571ec6e408 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:30.315989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7494a44c-36c2-4b6d-b816-c8571ec6e408 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:30.324678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7494a44c-36c2-4b6d-b816-c8571ec6e408 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:30.325579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7494a44c-36c2-4b6d-b816-c8571ec6e408 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:30.326315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7494a44c-36c2-4b6d-b816-c8571ec6e408 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:30.327287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7494a44c-36c2-4b6d-b816-c8571ec6e408 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:30.330234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7494a44c-36c2-4b6d-b816-c8571ec6e408 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:30.348104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7494a44c-36c2-4b6d-b816-c8571ec6e408 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:30.668266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7494a44c-36c2-4b6d-b816-c8571ec6e408 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:30.686103 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7494a44c-36c2-4b6d-b816-c8571ec6e408 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.381368 Oct 29 02:54:30.688927 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1235/2425] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:30 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:31.029319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9f315149-6d22-4bee-b91b-29233f119fa1 req-d0eff01e-304c-4933-81dc-98bca6f26bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-plugged", "status": "completed", "tag": "4beb4d66-65d9-4b60-af1e-c467c190d7ef"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:31.064456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9f315149-6d22-4bee-b91b-29233f119fa1 req-d0eff01e-304c-4933-81dc-98bca6f26bf5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:31.066626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9f315149-6d22-4bee-b91b-29233f119fa1 req-d0eff01e-304c-4933-81dc-98bca6f26bf5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:31.067939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9f315149-6d22-4bee-b91b-29233f119fa1 req-d0eff01e-304c-4933-81dc-98bca6f26bf5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:31.096218 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9f315149-6d22-4bee-b91b-29233f119fa1 req-d0eff01e-304c-4933-81dc-98bca6f26bf5 service nova] Creating event network-vif-plugged:4beb4d66-65d9-4b60-af1e-c467c190d7ef for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:54:31.112440 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9f315149-6d22-4bee-b91b-29233f119fa1 req-d0eff01e-304c-4933-81dc-98bca6f26bf5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089610 Oct 29 02:54:31.118163 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1236/2426] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:54:31.151065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:31.151911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:31.168560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:31.170454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:31.172027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:31.173170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:31.174898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:31.176751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:31.205155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4f73dfe6-498d-41e7-bfb6-f4b82d9295f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:31.221039 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4f73dfe6-498d-41e7-bfb6-f4b82d9295f1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 1.097947 Oct 29 02:54:31.238981 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1191/2427] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:30 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:31.322948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:31.323829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:31.352198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:31.354025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:31.358479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:31.360818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:31.375601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:31.376803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:31.656280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:31.666171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:31.667625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:31.668811 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4e0e14cc-3813-49c8-940d-11c7b0462ebb tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.523685 Oct 29 02:54:31.669377 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1237/2428] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:31 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:31.682775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:31.685720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:31.694791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:31.707632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:31.708241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:31.709205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:31.709790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:31.717791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:31.743057 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] HTTP exception thrown: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Request method failure captured: Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa HTTP/1.1 Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJVktjAxCUizcWaz4uJsdtOQdSqVlmt3kUsMsJe1ti4S7RVNTBtBtiKNm2mrQ2zRygqSVJCcLcUT-nnXaj3YI8DY3Oeeno6pUQij1gAtIPBD5u150TlvGLQcjMJGQZHHEPkiZ07CbO9PM1X7MhjLdVSdiBDhl2-3QVKSChB86imXU_E Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86df8edf5044361a65c11542c2dc585", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}] Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestMultiNic-191906656-project Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 5d2e129a84e847a0b5c80ad47ca4d233 Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestMultiNic-191906656-project Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '87e8fb7c-e71d-4e00-9806-7b2b295a32fa'} Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:31.745128 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:31.748572 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:31.748572 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:31.748572 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:31.748572 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:31.748572 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:31.748572 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:31.748572 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:31.748572 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:31.748572 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:31.748572 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:31.748572 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:31.750656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Returning 404 to user: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:31.751849 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2690c317-8dcd-49b8-9d5f-bc9ec6f4c608 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 404 len: 111 microversion: 2.1 time: 0.074049 Oct 29 02:54:31.752949 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1238/2429] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:54:31 2022] DELETE /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:31.758891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c7142ab-8165-461d-9e4f-0aaef6285799 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:31.775826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c7142ab-8165-461d-9e4f-0aaef6285799 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:31.782300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7142ab-8165-461d-9e4f-0aaef6285799 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:31.783369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7142ab-8165-461d-9e4f-0aaef6285799 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:31.784148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7142ab-8165-461d-9e4f-0aaef6285799 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:31.788149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7142ab-8165-461d-9e4f-0aaef6285799 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:31.791672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7142ab-8165-461d-9e4f-0aaef6285799 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:31.792464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7142ab-8165-461d-9e4f-0aaef6285799 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:31.873286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:31.891311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:31.896064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:31.897869 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b53d5484-320b-4fbe-a303-0e9c40e26963 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.580087 Oct 29 02:54:31.898700 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1192/2430] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:31 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:54:31.905933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:31.909528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 87e8fb7c-e71d-4e00-9806-7b2b295a32fa] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:31.920058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:31.926372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:31.927115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:31.928196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:31.928855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:31.930318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:31.957207 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] HTTP exception thrown: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Request method failure captured: Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa HTTP/1.1 Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJVktjAxCUizcWaz4uJsdtOQdSqVlmt3kUsMsJe1ti4S7RVNTBtBtiKNm2mrQ2zRygqSVJCcLcUT-nnXaj3YI8DY3Oeeno6pUQij1gAtIPBD5u150TlvGLQcjMJGQZHHEPkiZ07CbO9PM1X7MhjLdVSdiBDhl2-3QVKSChB86imXU_E Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86df8edf5044361a65c11542c2dc585", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}] Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestMultiNic-191906656-project Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 5d2e129a84e847a0b5c80ad47ca4d233 Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestMultiNic-191906656-project Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '87e8fb7c-e71d-4e00-9806-7b2b295a32fa'} Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:31.972359 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:31.975647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:31.975647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:31.975647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:31.975647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:31.975647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:31.975647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. Oct 29 02:54:31.975647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:31.978699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Returning 404 to user: Instance 87e8fb7c-e71d-4e00-9806-7b2b295a32fa could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:31.981179 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d0d18137-78f6-4aa1-9ebd-1ebfa83a0993 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa" status: 404 len: 111 microversion: 2.1 time: 0.081312 Oct 29 02:54:31.984390 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1193/2431] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:31 2022] GET /compute/v2.1/servers/87e8fb7c-e71d-4e00-9806-7b2b295a32fa => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:31.993942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:31.997885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:32.011211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.013003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.015875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.016913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.018323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.019032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.051802 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] HTTP exception thrown: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:54:32.053188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5c7142ab-8165-461d-9e4f-0aaef6285799 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Request method failure captured: Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 HTTP/1.1 Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJVktjAxCUizcWaz4uJsdtOQdSqVlmt3kUsMsJe1ti4S7RVNTBtBtiKNm2mrQ2zRygqSVJCcLcUT-nnXaj3YI8DY3Oeeno6pUQij1gAtIPBD5u150TlvGLQcjMJGQZHHEPkiZ07CbO9PM1X7MhjLdVSdiBDhl2-3QVKSChB86imXU_E Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86df8edf5044361a65c11542c2dc585", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}] Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestMultiNic-191906656-project Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 5d2e129a84e847a0b5c80ad47ca4d233 Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestMultiNic-191906656-project Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1e20ef4b-4f1c-42b4-9307-857848aab3a7'} Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:32.053869 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Returning 404 to user: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-231533cc-db98-4feb-82df-8bcc07fc1e04 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 404 len: 111 microversion: 2.1 time: 0.068086 Oct 29 02:54:32.057556 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1194/2432] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:54:31 2022] DELETE /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:32.064745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:32.065509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] [instance: 1e20ef4b-4f1c-42b4-9307-857848aab3a7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:32.067596 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c7142ab-8165-461d-9e4f-0aaef6285799 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1308 microversion: 2.1 time: 0.312845 Oct 29 02:54:32.068446 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1239/2433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:31 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:32.072374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.072972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.073498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.074412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.074965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.075482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.094603 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] HTTP exception thrown: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Request method failure captured: Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 HTTP/1.1 Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJVktjAxCUizcWaz4uJsdtOQdSqVlmt3kUsMsJe1ti4S7RVNTBtBtiKNm2mrQ2zRygqSVJCcLcUT-nnXaj3YI8DY3Oeeno6pUQij1gAtIPBD5u150TlvGLQcjMJGQZHHEPkiZ07CbO9PM1X7MhjLdVSdiBDhl2-3QVKSChB86imXU_E Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86df8edf5044361a65c11542c2dc585", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86df8edf5044361a65c11542c2dc585"}]}] Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: d86df8edf5044361a65c11542c2dc585 Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestMultiNic-191906656 Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestMultiNic-191906656-project Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 5d2e129a84e847a0b5c80ad47ca4d233 Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestMultiNic-191906656-project Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1e20ef4b-4f1c-42b4-9307-857848aab3a7'} Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:32.096596 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.100509 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:32.100509 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:32.100509 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:32.100509 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:32.100509 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:32.100509 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. Oct 29 02:54:32.100509 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.100509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] Returning 404 to user: Instance 1e20ef4b-4f1c-42b4-9307-857848aab3a7 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:32.102740 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a2a14a57-8275-44b2-bb26-0c68f81bfa07 tempest-ServersTestMultiNic-191906656 tempest-ServersTestMultiNic-191906656-project] 10.222.0.16 "GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7" status: 404 len: 111 microversion: 2.1 time: 0.041364 Oct 29 02:54:32.103790 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1195/2434] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:32 2022] GET /compute/v2.1/servers/1e20ef4b-4f1c-42b4-9307-857848aab3a7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:54:32.262827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-533cb152-c439-435b-acbf-6e26916156f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:32.264734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-533cb152-c439-435b-acbf-6e26916156f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:32.278385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-533cb152-c439-435b-acbf-6e26916156f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.280700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-533cb152-c439-435b-acbf-6e26916156f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.281392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-533cb152-c439-435b-acbf-6e26916156f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.283062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-533cb152-c439-435b-acbf-6e26916156f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.283856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-533cb152-c439-435b-acbf-6e26916156f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.285178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-533cb152-c439-435b-acbf-6e26916156f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.589381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-533cb152-c439-435b-acbf-6e26916156f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:32.601260 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-533cb152-c439-435b-acbf-6e26916156f0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.354119 Oct 29 02:54:32.603058 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1240/2435] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:32 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:32.707636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:32.708876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:32.724510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.726585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.727496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.729255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.731486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.732228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.934988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:32.936745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:32.947624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.948602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.949581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.951139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.952238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.970174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:33.227606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:33.248327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:33.253907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:33.256145 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c24e0ecb-06c6-4dc2-90e2-5ff1d81c3d52 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1485 microversion: 2.25 time: 0.557786 Oct 29 02:54:33.260042 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1196/2436] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:32 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1485 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:33.276331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eceaab90-0d10-44bd-ae2b-a213f22dd663 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:33.277130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eceaab90-0d10-44bd-ae2b-a213f22dd663 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:33.287651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceaab90-0d10-44bd-ae2b-a213f22dd663 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:33.289285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceaab90-0d10-44bd-ae2b-a213f22dd663 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:33.290907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceaab90-0d10-44bd-ae2b-a213f22dd663 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:33.291996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceaab90-0d10-44bd-ae2b-a213f22dd663 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:33.293942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceaab90-0d10-44bd-ae2b-a213f22dd663 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:33.295151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceaab90-0d10-44bd-ae2b-a213f22dd663 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:33.704843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:33.734743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:33.738361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:33.744043 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-01977130-5f26-4024-a8d5-b1dd1908629b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.813505 Oct 29 02:54:33.747033 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1241/2437] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:32 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:33.765055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-83a973c2-10bf-4050-9fa3-1f36217e6d2c req-0bf926b8-020c-40ac-afe5-91006981f7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-plugged", "status": "completed", "tag": "767f0367-bff9-4f07-ac30-bfe344612d57"}, {"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-plugged", "status": "completed", "tag": "f768439c-3452-4070-b9fe-dc99900a9aba"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:33.791449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-83a973c2-10bf-4050-9fa3-1f36217e6d2c req-0bf926b8-020c-40ac-afe5-91006981f7f3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:33.791851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-83a973c2-10bf-4050-9fa3-1f36217e6d2c req-0bf926b8-020c-40ac-afe5-91006981f7f3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:33.792268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-83a973c2-10bf-4050-9fa3-1f36217e6d2c req-0bf926b8-020c-40ac-afe5-91006981f7f3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:33.834404 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-83a973c2-10bf-4050-9fa3-1f36217e6d2c req-0bf926b8-020c-40ac-afe5-91006981f7f3 service nova] Creating event network-vif-plugged:767f0367-bff9-4f07-ac30-bfe344612d57 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:54:33.835229 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-83a973c2-10bf-4050-9fa3-1f36217e6d2c req-0bf926b8-020c-40ac-afe5-91006981f7f3 service nova] Creating event network-vif-plugged:f768439c-3452-4070-b9fe-dc99900a9aba for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:54:33.853598 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-83a973c2-10bf-4050-9fa3-1f36217e6d2c req-0bf926b8-020c-40ac-afe5-91006981f7f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102825 Oct 29 02:54:33.858285 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1242/2438] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:33.870007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0088a6e4-666e-454c-9a5c-d3117ea56a71 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:33.871281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0088a6e4-666e-454c-9a5c-d3117ea56a71 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:33.879871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0088a6e4-666e-454c-9a5c-d3117ea56a71 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:33.880738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0088a6e4-666e-454c-9a5c-d3117ea56a71 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:33.882398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0088a6e4-666e-454c-9a5c-d3117ea56a71 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:33.883141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0088a6e4-666e-454c-9a5c-d3117ea56a71 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:33.884645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0088a6e4-666e-454c-9a5c-d3117ea56a71 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:33.886462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0088a6e4-666e-454c-9a5c-d3117ea56a71 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.100762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eceaab90-0d10-44bd-ae2b-a213f22dd663 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:34.112915 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eceaab90-0d10-44bd-ae2b-a213f22dd663 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1487 microversion: 2.1 time: 0.851143 Oct 29 02:54:34.129044 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1197/2439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:33 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1487 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:34.140697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0088a6e4-666e-454c-9a5c-d3117ea56a71 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:34.147515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-46ec8bfb-3493-456a-a632-c5274114d580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:34.148074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-46ec8bfb-3493-456a-a632-c5274114d580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:34.151533 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0088a6e4-666e-454c-9a5c-d3117ea56a71 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.290949 Oct 29 02:54:34.153619 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1243/2440] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:33 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:34.167112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ec8bfb-3493-456a-a632-c5274114d580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.167592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ec8bfb-3493-456a-a632-c5274114d580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.168017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ec8bfb-3493-456a-a632-c5274114d580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.175366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ec8bfb-3493-456a-a632-c5274114d580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.176007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ec8bfb-3493-456a-a632-c5274114d580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.176456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ec8bfb-3493-456a-a632-c5274114d580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.208372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-46ec8bfb-3493-456a-a632-c5274114d580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lazy-loading 'flavor' on Instance uuid 26e07792-807a-44e9-b644-72504509f2f5 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:54:34.294788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:34.295408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:34.318259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.319120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.319720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.320630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.321086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.321509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.375877 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-46ec8bfb-3493-456a-a632-c5274114d580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5/action" status: 202 len: 0 microversion: 2.1 time: 0.237895 Oct 29 02:54:34.376790 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1198/2441] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:54:34 2022] POST /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:34.386922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:34.396682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-efbc8c0b-c042-4269-83de-3f27dd562e0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:34.397577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-efbc8c0b-c042-4269-83de-3f27dd562e0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:34.405541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efbc8c0b-c042-4269-83de-3f27dd562e0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.410882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efbc8c0b-c042-4269-83de-3f27dd562e0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.412687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efbc8c0b-c042-4269-83de-3f27dd562e0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.413609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efbc8c0b-c042-4269-83de-3f27dd562e0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.415926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efbc8c0b-c042-4269-83de-3f27dd562e0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.420981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efbc8c0b-c042-4269-83de-3f27dd562e0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.874932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:34.884447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:34.890118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:34.894627 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-529edb51-59f0-40b5-8507-dc9c00452913 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1475 microversion: 2.25 time: 0.604606 Oct 29 02:54:34.895992 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1244/2442] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:34 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1475 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:34.916384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:34.917275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:34.926704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.927217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.927650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.928364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.928810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.929224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.938883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-efbc8c0b-c042-4269-83de-3f27dd562e0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:34.952544 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-efbc8c0b-c042-4269-83de-3f27dd562e0b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1495 microversion: 2.1 time: 0.571189 Oct 29 02:54:34.966221 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1199/2443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:34 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1495 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:34.972111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21458d76-7681-4088-a23e-6dbe7394c91d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '.version_select at 0x7fe1a85519d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:34.993273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21458d76-7681-4088-a23e-6dbe7394c91d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.993794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21458d76-7681-4088-a23e-6dbe7394c91d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.994274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21458d76-7681-4088-a23e-6dbe7394c91d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:35.046987 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-21458d76-7681-4088-a23e-6dbe7394c91d tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3869 microversion: 2.25 time: 0.080216 Oct 29 02:54:35.051985 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1200/2444] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Oct 29 02:54:34 2022] GET /compute/v2.1/os-migrations => generated 3869 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:35.080562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2e1ba862-4264-43ec-b77d-9a5d093092d5 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:35.081547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2e1ba862-4264-43ec-b77d-9a5d093092d5 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:35.107254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1ba862-4264-43ec-b77d-9a5d093092d5 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:35.107906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1ba862-4264-43ec-b77d-9a5d093092d5 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:35.108094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1ba862-4264-43ec-b77d-9a5d093092d5 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:35.109006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1ba862-4264-43ec-b77d-9a5d093092d5 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:35.109518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1ba862-4264-43ec-b77d-9a5d093092d5 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:35.110162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1ba862-4264-43ec-b77d-9a5d093092d5 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:35.459445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-2e1ba862-4264-43ec-b77d-9a5d093092d5 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] Lazy-loading 'services' on Instance uuid b13b0f93-4ed1-4257-8a35-0db82db20bd7 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:54:35.486774 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2e1ba862-4264-43ec-b77d-9a5d093092d5 tempest-LiveAutoBlockMigrationV225Test-752430249 tempest-LiveAutoBlockMigrationV225Test-752430249-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1967 microversion: 2.25 time: 0.419839 Oct 29 02:54:35.508321 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1201/2445] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:35 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1967 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:35.527456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bceb6251-e423-4c84-a409-b94dc812027a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:35.530763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bceb6251-e423-4c84-a409-b94dc812027a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:35.561023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bceb6251-e423-4c84-a409-b94dc812027a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:35.561528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bceb6251-e423-4c84-a409-b94dc812027a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:35.568495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bceb6251-e423-4c84-a409-b94dc812027a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:35.574730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bceb6251-e423-4c84-a409-b94dc812027a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:35.575231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bceb6251-e423-4c84-a409-b94dc812027a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:35.575670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bceb6251-e423-4c84-a409-b94dc812027a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:35.587121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:35.756726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:35.774770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:35.779815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:35.781182 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-486458a2-f264-4298-b1be-b35fb07838b9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 0.882200 Oct 29 02:54:35.798983 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1245/2446] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:34 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:35.814674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac2ce59d-e3be-45a7-8cb6-9383cedb9270 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:35.815142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac2ce59d-e3be-45a7-8cb6-9383cedb9270 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:35.823626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac2ce59d-e3be-45a7-8cb6-9383cedb9270 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:35.824155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac2ce59d-e3be-45a7-8cb6-9383cedb9270 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:35.827064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac2ce59d-e3be-45a7-8cb6-9383cedb9270 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:35.828404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac2ce59d-e3be-45a7-8cb6-9383cedb9270 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:35.829948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac2ce59d-e3be-45a7-8cb6-9383cedb9270 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:35.830877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac2ce59d-e3be-45a7-8cb6-9383cedb9270 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:35.877167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac2ce59d-e3be-45a7-8cb6-9383cedb9270 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:54:36.112456 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac2ce59d-e3be-45a7-8cb6-9383cedb9270 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 204 len: 0 microversion: 2.25 time: 0.311749 Oct 29 02:54:36.115906 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1246/2447] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:54:35 2022] DELETE /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:54:36.178586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bceb6251-e423-4c84-a409-b94dc812027a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:36.195406 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bceb6251-e423-4c84-a409-b94dc812027a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.685430 Oct 29 02:54:36.221997 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1202/2448] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:35 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:36.229720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ec82a0b7-ca92-431b-b70b-75d833656314 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:36.233724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ec82a0b7-ca92-431b-b70b-75d833656314 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:36.255168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec82a0b7-ca92-431b-b70b-75d833656314 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:36.256128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec82a0b7-ca92-431b-b70b-75d833656314 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:36.256951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec82a0b7-ca92-431b-b70b-75d833656314 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:36.260504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec82a0b7-ca92-431b-b70b-75d833656314 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:36.261249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec82a0b7-ca92-431b-b70b-75d833656314 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:36.262875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec82a0b7-ca92-431b-b70b-75d833656314 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:36.420835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c50ba03-6658-450b-abe9-6fa5b7c7ee0b tempest-FloatingIPDetailsNegativeTestJSON-798045833 tempest-FloatingIPDetailsNegativeTestJSON-798045833-project] Calling method '.version_select at 0x7fe1a86eba60>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:36.488467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-1c50ba03-6658-450b-abe9-6fa5b7c7ee0b tempest-FloatingIPDetailsNegativeTestJSON-798045833 tempest-FloatingIPDetailsNegativeTestJSON-798045833-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6 could not be found", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:54:36.489475 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-1c50ba03-6658-450b-abe9-6fa5b7c7ee0b tempest-FloatingIPDetailsNegativeTestJSON-798045833 tempest-FloatingIPDetailsNegativeTestJSON-798045833-project] HTTP exception thrown: Floating IP not found for ID 1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6 Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c50ba03-6658-450b-abe9-6fa5b7c7ee0b tempest-FloatingIPDetailsNegativeTestJSON-798045833 tempest-FloatingIPDetailsNegativeTestJSON-798045833-project] Request method failure captured: Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-floating-ips/1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6 HTTP/1.1 Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJXruQSEO5d3hLwiJpIcT_GSfTV95H17-eGV63EuhZ2cHs22MLsLiJKO9WrQvSlcma9anopXDWEYieJCwxeK_tOOZvxfTqYcSdwJTJRQHURV7rou2QPAqi3izXoRmwcvN3SjzhNKjM6yaaT1JeOs7wVVrhbcfQlf6xW3U1Kwki4fyTI Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 47073c9231a7489aa0a1ff3d6496366f Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-798045833 Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47073c9231a7489aa0a1ff3d6496366f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47073c9231a7489aa0a1ff3d6496366f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47073c9231a7489aa0a1ff3d6496366f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47073c9231a7489aa0a1ff3d6496366f"}]}] Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-798045833 Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 47073c9231a7489aa0a1ff3d6496366f Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-798045833 Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-798045833-project Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 5b42df0e125d40ab9d1264c5b3c94ed1 Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-798045833-project Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: exception: Floating IP not found for ID 1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6 Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6'} Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6 could not be found Oct 29 02:54:36.491775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cecda9f-9acc-40e5-aa6f-d735a88f4638'] Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6. Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6 Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6 Oct 29 02:54:36.496146 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.499917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c50ba03-6658-450b-abe9-6fa5b7c7ee0b tempest-FloatingIPDetailsNegativeTestJSON-798045833 tempest-FloatingIPDetailsNegativeTestJSON-798045833-project] Returning 404 to user: Floating IP not found for ID 1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6 {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:36.501026 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1c50ba03-6658-450b-abe9-6fa5b7c7ee0b tempest-FloatingIPDetailsNegativeTestJSON-798045833 tempest-FloatingIPDetailsNegativeTestJSON-798045833-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6" status: 404 len: 111 microversion: 2.1 time: 0.383588 Oct 29 02:54:36.502132 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1247/2449] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 02:54:36 2022] GET /compute/v2.1/os-floating-ips/1b3d733f-e7ce-4311-a6ef-3f1f09fe96d6 => generated 111 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:36.513003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:36.518110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:36.543781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:36.546639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:36.548331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:36.551855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:36.556508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:36.561141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:36.615828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec82a0b7-ca92-431b-b70b-75d833656314 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:36.626930 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ec82a0b7-ca92-431b-b70b-75d833656314 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 200 len: 1478 microversion: 2.1 time: 0.403262 Oct 29 02:54:36.628458 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1203/2450] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:36 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 1478 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:36.640705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-0c8fad11-801d-4a4f-a8ba-e518cd9affa2 req-a0adc0ae-ce4c-419b-b078-519fedad231c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-plugged", "status": "completed", "tag": "6ee1db3a-b8f9-46be-9d54-08b853dc8555"}, {"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-plugged", "status": "completed", "tag": "0ac995e9-7dce-47bf-9e58-e63e0cc63800"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:36.664522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:36.666603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0c8fad11-801d-4a4f-a8ba-e518cd9affa2 req-a0adc0ae-ce4c-419b-b078-519fedad231c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:36.667086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0c8fad11-801d-4a4f-a8ba-e518cd9affa2 req-a0adc0ae-ce4c-419b-b078-519fedad231c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:36.667517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0c8fad11-801d-4a4f-a8ba-e518cd9affa2 req-a0adc0ae-ce4c-419b-b078-519fedad231c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:36.685890 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-0c8fad11-801d-4a4f-a8ba-e518cd9affa2 req-a0adc0ae-ce4c-419b-b078-519fedad231c service nova] Creating event network-vif-plugged:6ee1db3a-b8f9-46be-9d54-08b853dc8555 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:54:36.686694 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-0c8fad11-801d-4a4f-a8ba-e518cd9affa2 req-a0adc0ae-ce4c-419b-b078-519fedad231c service nova] Creating event network-vif-plugged:0ac995e9-7dce-47bf-9e58-e63e0cc63800 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:54:36.694544 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-0c8fad11-801d-4a4f-a8ba-e518cd9affa2 req-a0adc0ae-ce4c-419b-b078-519fedad231c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064251 Oct 29 02:54:36.695876 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1204/2451] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:54:36.701709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0a125cf-3aab-488a-afc1-4cd95449948e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-124044876"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:36.705209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0a125cf-3aab-488a-afc1-4cd95449948e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:36.713451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0a125cf-3aab-488a-afc1-4cd95449948e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:36.714350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0a125cf-3aab-488a-afc1-4cd95449948e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:36.714957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0a125cf-3aab-488a-afc1-4cd95449948e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:36.715984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0a125cf-3aab-488a-afc1-4cd95449948e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:36.716702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0a125cf-3aab-488a-afc1-4cd95449948e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:36.717127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0a125cf-3aab-488a-afc1-4cd95449948e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:37.240310 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d0a125cf-3aab-488a-afc1-4cd95449948e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5/action" status: 202 len: 0 microversion: 2.1 time: 0.542532 Oct 29 02:54:37.242982 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1205/2452] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:54:36 2022] POST /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:54:37.258071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:37.259054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:37.268403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:37.269203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:37.269870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:37.271000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:37.271647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:37.272445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:37.462626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:37.485732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:37.487308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:37.488542 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5dbe0e00-c986-44c6-a50b-8c0d89a9db07 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1481 microversion: 2.25 time: 0.985202 Oct 29 02:54:37.501862 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1248/2453] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:36 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1481 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:37.505149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8c93b5bc-9917-4aa1-b9ca-e965d41766d5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:37.505294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8c93b5bc-9917-4aa1-b9ca-e965d41766d5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:37.521746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c93b5bc-9917-4aa1-b9ca-e965d41766d5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:37.525082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c93b5bc-9917-4aa1-b9ca-e965d41766d5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:37.525697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c93b5bc-9917-4aa1-b9ca-e965d41766d5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:37.526835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c93b5bc-9917-4aa1-b9ca-e965d41766d5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:37.527906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c93b5bc-9917-4aa1-b9ca-e965d41766d5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:37.531433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c93b5bc-9917-4aa1-b9ca-e965d41766d5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:38.267020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c93b5bc-9917-4aa1-b9ca-e965d41766d5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:38.282379 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8c93b5bc-9917-4aa1-b9ca-e965d41766d5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.787485 Oct 29 02:54:38.283233 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1249/2454] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:37 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:38.296467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dfc47a19-539f-4d86-911e-01ca9413524d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a88580d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:38.394654 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dfc47a19-539f-4d86-911e-01ca9413524d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.110038 Oct 29 02:54:38.403895 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1250/2455] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:38 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:38.532731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:38.533486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:38.546811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:38.547727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:38.550137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:38.551425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:38.554448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:38.555444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:38.684659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:38.705961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:38.707710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:38.710944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-268dad97-0055-4a80-9bdb-0165f5d8ede1 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1873 microversion: 2.32 time: 1.465483 Oct 29 02:54:38.716638 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1206/2456] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:37 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1873 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:39.133046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:39.143148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:39.146141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:39.148111 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-381e1823-884b-4ff5-9b2a-0588f852ef77 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1481 microversion: 2.25 time: 0.625437 Oct 29 02:54:39.149360 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1251/2457] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:38 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1481 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:39.235455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-86cd3443-583f-41f5-bb84-a1a39c7cecf4 req-402bad4d-b2dd-41bf-bf6f-a14fc1d530a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b13b0f93-4ed1-4257-8a35-0db82db20bd7", "name": "network-vif-deleted", "tag": "f5ac891c-6ef2-46f7-96d6-3bb775f98a04"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:39.265665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86cd3443-583f-41f5-bb84-a1a39c7cecf4 req-402bad4d-b2dd-41bf-bf6f-a14fc1d530a4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:39.266230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86cd3443-583f-41f5-bb84-a1a39c7cecf4 req-402bad4d-b2dd-41bf-bf6f-a14fc1d530a4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:39.266668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86cd3443-583f-41f5-bb84-a1a39c7cecf4 req-402bad4d-b2dd-41bf-bf6f-a14fc1d530a4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:39.311458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f03a037f-e8e9-4263-929e-63783f6cef8c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:39.312510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f03a037f-e8e9-4263-929e-63783f6cef8c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:39.326816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f03a037f-e8e9-4263-929e-63783f6cef8c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:39.327320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f03a037f-e8e9-4263-929e-63783f6cef8c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:39.328962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f03a037f-e8e9-4263-929e-63783f6cef8c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:39.329859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f03a037f-e8e9-4263-929e-63783f6cef8c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:39.330315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f03a037f-e8e9-4263-929e-63783f6cef8c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:39.330739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f03a037f-e8e9-4263-929e-63783f6cef8c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:39.331570 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-86cd3443-583f-41f5-bb84-a1a39c7cecf4 req-402bad4d-b2dd-41bf-bf6f-a14fc1d530a4 service nova] Creating event network-vif-deleted:f5ac891c-6ef2-46f7-96d6-3bb775f98a04 for instance b13b0f93-4ed1-4257-8a35-0db82db20bd7 on n-h2-862964-4 Oct 29 02:54:39.354210 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-86cd3443-583f-41f5-bb84-a1a39c7cecf4 req-402bad4d-b2dd-41bf-bf6f-a14fc1d530a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128875 Oct 29 02:54:39.356040 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1207/2458] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:39.412071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c0b403a5-5012-4726-8adf-ca48285bab80 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8a309d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:39.504588 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c0b403a5-5012-4726-8adf-ca48285bab80 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.093200 Oct 29 02:54:39.505661 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1208/2459] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:39 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:39.743726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:39.744465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:39.772036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:39.772622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:39.773136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:39.779791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:39.789699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:39.790373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:40.203101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f03a037f-e8e9-4263-929e-63783f6cef8c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:40.211723 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f03a037f-e8e9-4263-929e-63783f6cef8c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.905484 Oct 29 02:54:40.212319 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1252/2460] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:39 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:40.216356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:40.225862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:40.227352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:40.238417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:40.239968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:40.246403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:40.247470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:40.247715 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-644549fa-c63d-4081-8ceb-92e5f8b71454 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2824 microversion: 2.32 time: 0.502759 Oct 29 02:54:40.251445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:40.251665 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1209/2461] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:39 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2824 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:54:40.254751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:40.255394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:40.256007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:40.284019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-61864339-5d47-4acb-bddd-43eb5fca12d6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:40.284281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-61864339-5d47-4acb-bddd-43eb5fca12d6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:40.301302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61864339-5d47-4acb-bddd-43eb5fca12d6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:40.304000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61864339-5d47-4acb-bddd-43eb5fca12d6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:40.304600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61864339-5d47-4acb-bddd-43eb5fca12d6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:40.310015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61864339-5d47-4acb-bddd-43eb5fca12d6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:40.310685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61864339-5d47-4acb-bddd-43eb5fca12d6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:40.311285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61864339-5d47-4acb-bddd-43eb5fca12d6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:40.560579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:40.579649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:40.581471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:40.591185 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2072b477-effc-451c-a7c0-072eb24cf0a2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1265 microversion: 2.25 time: 0.375855 Oct 29 02:54:40.599890 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1253/2462] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:40 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1265 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:40.607430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d06ac5fa-1997-4b3b-abb3-f59e3779a910 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a86fe8b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:40.686914 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-61864339-5d47-4acb-bddd-43eb5fca12d6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.407106 Oct 29 02:54:40.710849 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1210/2463] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Oct 29 02:54:40 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9/os-interface => generated 1830 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:40.731211 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d06ac5fa-1997-4b3b-abb3-f59e3779a910 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.129414 Oct 29 02:54:40.731760 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1254/2464] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:40 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:41.251714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f964a642-2007-4d7f-b2d9-63a7691ea81b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:41.253406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f964a642-2007-4d7f-b2d9-63a7691ea81b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:41.277006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f964a642-2007-4d7f-b2d9-63a7691ea81b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:41.281756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f964a642-2007-4d7f-b2d9-63a7691ea81b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:41.283250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f964a642-2007-4d7f-b2d9-63a7691ea81b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:41.284828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f964a642-2007-4d7f-b2d9-63a7691ea81b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:41.286406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f964a642-2007-4d7f-b2d9-63a7691ea81b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:41.289181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f964a642-2007-4d7f-b2d9-63a7691ea81b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:41.630181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:41.643955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:41.671864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:41.702183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:41.703988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:41.706070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:41.710239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:41.711761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:41.712593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:41.840830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f964a642-2007-4d7f-b2d9-63a7691ea81b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:41.854375 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f964a642-2007-4d7f-b2d9-63a7691ea81b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.618254 Oct 29 02:54:41.858365 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1211/2465] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:41 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:41.880300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83414bc9-778e-45d8-9e26-8684d3ab3ed4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8944ee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:42.058589 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-83414bc9-778e-45d8-9e26-8684d3ab3ed4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.193947 Oct 29 02:54:42.061723 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1212/2466] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:41 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:42.883529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-582d978c-0bca-41bd-81a3-d04760ec5af3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:42.884946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-582d978c-0bca-41bd-81a3-d04760ec5af3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:42.902849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-582d978c-0bca-41bd-81a3-d04760ec5af3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:42.903702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-582d978c-0bca-41bd-81a3-d04760ec5af3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:42.904333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-582d978c-0bca-41bd-81a3-d04760ec5af3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:42.905246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-582d978c-0bca-41bd-81a3-d04760ec5af3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:42.906143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-582d978c-0bca-41bd-81a3-d04760ec5af3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:42.915051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-582d978c-0bca-41bd-81a3-d04760ec5af3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:42.987469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:43.010812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:43.023310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:43.034759 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-51457f19-3771-4b4b-be91-bd36f24f3d04 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1265 microversion: 2.25 time: 1.410392 Oct 29 02:54:43.059374 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1255/2467] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:41 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1265 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:43.076916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4d3f8a60-1dc8-460c-bbcf-c6313a6e3c20 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8858dc0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:43.188650 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4d3f8a60-1dc8-460c-bbcf-c6313a6e3c20 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.115867 Oct 29 02:54:43.189935 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1256/2468] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:43 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:43.378242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-582d978c-0bca-41bd-81a3-d04760ec5af3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:43.393915 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-582d978c-0bca-41bd-81a3-d04760ec5af3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.514595 Oct 29 02:54:43.411988 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1213/2469] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:42 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:44.075231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:44.076088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:44.102529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:44.106082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:44.132211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:44.134703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:44.139879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:44.140523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:44.206412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64d60151-66bb-400e-9024-940f34fd7906 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8475820>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:44.339394 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-64d60151-66bb-400e-9024-940f34fd7906 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.137219 Oct 29 02:54:44.342233 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1214/2470] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:44 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:44.418000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:44.419383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a74e7f1c-9f39-48ff-a1a2-41566ee0175e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:44.420276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a74e7f1c-9f39-48ff-a1a2-41566ee0175e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:44.436805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:44.438589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:44.440554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a74e7f1c-9f39-48ff-a1a2-41566ee0175e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:44.441623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a74e7f1c-9f39-48ff-a1a2-41566ee0175e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:44.443945 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6849b19a-4d65-47a8-9394-394d57919fde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1265 microversion: 2.25 time: 0.376027 Oct 29 02:54:44.449099 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1257/2471] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:44 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1265 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:44.459836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a74e7f1c-9f39-48ff-a1a2-41566ee0175e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:44.460797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a74e7f1c-9f39-48ff-a1a2-41566ee0175e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:44.470614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a74e7f1c-9f39-48ff-a1a2-41566ee0175e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:44.471712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a74e7f1c-9f39-48ff-a1a2-41566ee0175e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:44.652653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-5b4a7655-53f6-436b-a1d5-790217fad181 req-fddabea6-e6ba-4029-a7f4-d9ef668159cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e07792-807a-44e9-b644-72504509f2f5", "name": "network-vif-plugged", "status": "completed", "tag": "8a4b46d3-0738-4cd4-a78e-25f2da119a4e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:44.682522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5b4a7655-53f6-436b-a1d5-790217fad181 req-fddabea6-e6ba-4029-a7f4-d9ef668159cb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:44.684187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5b4a7655-53f6-436b-a1d5-790217fad181 req-fddabea6-e6ba-4029-a7f4-d9ef668159cb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:44.686137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5b4a7655-53f6-436b-a1d5-790217fad181 req-fddabea6-e6ba-4029-a7f4-d9ef668159cb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:44.726661 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-5b4a7655-53f6-436b-a1d5-790217fad181 req-fddabea6-e6ba-4029-a7f4-d9ef668159cb service nova] Creating event network-vif-plugged:8a4b46d3-0738-4cd4-a78e-25f2da119a4e for instance 26e07792-807a-44e9-b644-72504509f2f5 on n-h2-862964-4 Oct 29 02:54:44.740149 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-5b4a7655-53f6-436b-a1d5-790217fad181 req-fddabea6-e6ba-4029-a7f4-d9ef668159cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095475 Oct 29 02:54:44.744050 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1258/2472] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:44.964656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a74e7f1c-9f39-48ff-a1a2-41566ee0175e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:44.977151 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a74e7f1c-9f39-48ff-a1a2-41566ee0175e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.561898 Oct 29 02:54:44.985217 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1215/2473] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:44 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:45.362639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fedf7e5f-9ee1-4517-af42-d1a0fea6336c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a86c43a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:45.451315 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fedf7e5f-9ee1-4517-af42-d1a0fea6336c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.089948 Oct 29 02:54:45.454597 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1259/2474] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:45 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:45.479304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:45.480211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:45.492864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:45.495006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:45.496704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:45.497674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:45.503468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:45.505962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:45.842820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-089587ad-1298-4510-bcd0-c5cec1de1730 req-aabb9bd1-a1ea-42d7-aa77-639a9f630541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "tag": "f9ad5c3b-d639-4b01-8092-245696df4798"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:45.857738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-089587ad-1298-4510-bcd0-c5cec1de1730 req-aabb9bd1-a1ea-42d7-aa77-639a9f630541 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:45.862858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-089587ad-1298-4510-bcd0-c5cec1de1730 req-aabb9bd1-a1ea-42d7-aa77-639a9f630541 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:45.863563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-089587ad-1298-4510-bcd0-c5cec1de1730 req-aabb9bd1-a1ea-42d7-aa77-639a9f630541 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:45.882430 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-089587ad-1298-4510-bcd0-c5cec1de1730 req-aabb9bd1-a1ea-42d7-aa77-639a9f630541 service nova] Creating event network-changed:f9ad5c3b-d639-4b01-8092-245696df4798 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:54:45.899858 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-089587ad-1298-4510-bcd0-c5cec1de1730 req-aabb9bd1-a1ea-42d7-aa77-639a9f630541 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061140 Oct 29 02:54:45.908083 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1260/2475] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:46.020174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:46.026999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-64ca4b88-a5a2-4a56-8da9-262062900a02 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:46.032387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-64ca4b88-a5a2-4a56-8da9-262062900a02 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:46.053847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64ca4b88-a5a2-4a56-8da9-262062900a02 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:46.055225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:46.057233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:46.059667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64ca4b88-a5a2-4a56-8da9-262062900a02 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:46.063510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64ca4b88-a5a2-4a56-8da9-262062900a02 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:46.065697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64ca4b88-a5a2-4a56-8da9-262062900a02 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:46.066889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64ca4b88-a5a2-4a56-8da9-262062900a02 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:46.067284 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ed10344-4c19-4b3f-809d-f0e1bd310d9f tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1265 microversion: 2.25 time: 0.587626 Oct 29 02:54:46.084515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64ca4b88-a5a2-4a56-8da9-262062900a02 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:46.085137 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1216/2476] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:45 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1265 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:46.448697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-64ca4b88-a5a2-4a56-8da9-262062900a02 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:46.471945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-05e6937e-81e6-417c-8080-82ff3d18ae9e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c07ee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:46.479845 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-64ca4b88-a5a2-4a56-8da9-262062900a02 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.470575 Oct 29 02:54:46.507719 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1261/2477] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:46 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:46.596003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-05e6937e-81e6-417c-8080-82ff3d18ae9e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.129487 Oct 29 02:54:46.598356 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1217/2478] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:46 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:47.098806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:47.101116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:47.127173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:47.129467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:47.131953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:47.133180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:47.134635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:47.135829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:47.332265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:47.348784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:47.356886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:47.362972 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dffd0af1-6d60-4174-bbe2-4b0b27726aee tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1265 microversion: 2.25 time: 0.264686 Oct 29 02:54:47.380266 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1262/2479] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:47 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:47.515589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-854f2fa8-cf53-4b25-afa8-31df3db9fe9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:47.517160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-854f2fa8-cf53-4b25-afa8-31df3db9fe9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:47.542877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-854f2fa8-cf53-4b25-afa8-31df3db9fe9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:47.549901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-854f2fa8-cf53-4b25-afa8-31df3db9fe9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:47.551463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-854f2fa8-cf53-4b25-afa8-31df3db9fe9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:47.553783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-854f2fa8-cf53-4b25-afa8-31df3db9fe9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:47.556889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-854f2fa8-cf53-4b25-afa8-31df3db9fe9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:47.558630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-854f2fa8-cf53-4b25-afa8-31df3db9fe9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:47.613672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8943a6e5-6060-47af-87f9-6487a4bf8f92 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8976ee0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:47.718157 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8943a6e5-6060-47af-87f9-6487a4bf8f92 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.098106 Oct 29 02:54:47.718157 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1263/2480] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:47 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:48.040776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-854f2fa8-cf53-4b25-afa8-31df3db9fe9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:48.050744 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-854f2fa8-cf53-4b25-afa8-31df3db9fe9f tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.537415 Oct 29 02:54:48.053663 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1218/2481] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:47 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:48.394320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:48.395183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:48.410133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:48.419297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:48.419917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:48.420822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:48.421494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:48.422119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:48.609729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:48.625344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:48.634900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:48.638372 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6c307173-ec9d-4703-aa2e-85cc4478ab98 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1265 microversion: 2.25 time: 0.248758 Oct 29 02:54:48.668463 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1264/2482] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:48 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:48.725286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-58874b16-5679-4d9f-bf31-3323dacc8d06 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a91830d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:48.809162 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-58874b16-5679-4d9f-bf31-3323dacc8d06 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.087797 Oct 29 02:54:48.810302 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1219/2483] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:48 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:49.076215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b28c2be-3a3f-454d-b899-bc1c2bea6a13 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:49.077039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6b28c2be-3a3f-454d-b899-bc1c2bea6a13 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:49.088473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b28c2be-3a3f-454d-b899-bc1c2bea6a13 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:49.089304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b28c2be-3a3f-454d-b899-bc1c2bea6a13 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:49.092879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b28c2be-3a3f-454d-b899-bc1c2bea6a13 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:49.094282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b28c2be-3a3f-454d-b899-bc1c2bea6a13 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:49.097051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b28c2be-3a3f-454d-b899-bc1c2bea6a13 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:49.097872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b28c2be-3a3f-454d-b899-bc1c2bea6a13 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:49.669479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:49.671106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:49.695372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:49.697860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:49.698932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:49.699686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:49.706558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:49.707292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:49.893721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:49.910497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:49.919108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:49.920613 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-05542adf-7687-4b83-bc13-49d0b5c8471e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 200 len: 1265 microversion: 2.25 time: 0.255777 Oct 29 02:54:49.923128 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1220/2484] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:49 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:54:49.934056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-99cc69c0-b0bf-466a-8d9b-325adbfe6055 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c07310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.045584 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-99cc69c0-b0bf-466a-8d9b-325adbfe6055 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.119097 Oct 29 02:54:50.057902 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1221/2485] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:49 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:50.074109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b28c2be-3a3f-454d-b899-bc1c2bea6a13 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:50.092139 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b28c2be-3a3f-454d-b899-bc1c2bea6a13 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 1.020094 Oct 29 02:54:50.096650 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1265/2486] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:49 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:50.955178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.956541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: b13b0f93-4ed1-4257-8a35-0db82db20bd7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:50.976067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.976969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.982399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.984560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.986367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.987471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:51.030271 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] HTTP exception thrown: Instance b13b0f93-4ed1-4257-8a35-0db82db20bd7 could not be found. Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Request method failure captured: Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 HTTP/1.1 Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQuccPsSxpEQcD2tjrWhykr3SJ_3P29lS31n5eNXssW4WXG0XOTjhxbCShrHaXna_t_vldyKx-vpE-HAQvpnmh2Vn9lq73PhGlwLyH56ar0kN7N0dwVSRtdPk48J6HFJWP0eYqbjMnfXbhjn5C4ycpyD4CECFllRO4l_ch-L8eoy5Y Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 60896479fb0c4357ad5fb03016470283 Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/60896479fb0c4357ad5fb03016470283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60896479fb0c4357ad5fb03016470283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_60896479fb0c4357ad5fb03016470283", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60896479fb0c4357ad5fb03016470283"}]}] Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 60896479fb0c4357ad5fb03016470283 Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-LiveAutoBlockMigrationV225Test-1573949452-project Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f0ea28d9bb3544bca1a3c90d983fe8e4 Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452-project Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance b13b0f93-4ed1-4257-8a35-0db82db20bd7 could not be found. Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'b13b0f93-4ed1-4257-8a35-0db82db20bd7'} Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b13b0f93-4ed1-4257-8a35-0db82db20bd7 could not be found. Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b13b0f93-4ed1-4257-8a35-0db82db20bd7 could not be found. Oct 29 02:54:51.037530 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:51.041375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:51.041375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:51.041375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:51.041375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:51.041375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:51.041375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:51.041375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:51.041375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b13b0f93-4ed1-4257-8a35-0db82db20bd7 could not be found. Oct 29 02:54:51.041375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:54:51.044226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Returning 404 to user: Instance b13b0f93-4ed1-4257-8a35-0db82db20bd7 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:51.046456 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-06863ee4-f717-42d3-93c6-92174b42997a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7" status: 404 len: 111 microversion: 2.25 time: 0.097006 Oct 29 02:54:51.048622 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1222/2487] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:50 2022] GET /compute/v2.1/servers/b13b0f93-4ed1-4257-8a35-0db82db20bd7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:54:51.064073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1064c595-3a5d-4ee2-90cf-e96e2a53a374 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8976940>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:51.115699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3d86a334-3b67-411c-9a5b-08b7a899f5fe tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:51.116390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3d86a334-3b67-411c-9a5b-08b7a899f5fe tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:51.134299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d86a334-3b67-411c-9a5b-08b7a899f5fe tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:51.136180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d86a334-3b67-411c-9a5b-08b7a899f5fe tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:51.139497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d86a334-3b67-411c-9a5b-08b7a899f5fe tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:51.141740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d86a334-3b67-411c-9a5b-08b7a899f5fe tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:51.148082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d86a334-3b67-411c-9a5b-08b7a899f5fe tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:51.151569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d86a334-3b67-411c-9a5b-08b7a899f5fe tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:51.239586 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1064c595-3a5d-4ee2-90cf-e96e2a53a374 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.176960 Oct 29 02:54:51.258697 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1266/2488] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:51 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:51.961656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3d86a334-3b67-411c-9a5b-08b7a899f5fe tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:51.974304 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3d86a334-3b67-411c-9a5b-08b7a899f5fe tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.862522 Oct 29 02:54:51.976415 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1223/2489] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:51 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:52.261952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ade532ea-1ab7-4aa1-9e7f-028605909f7e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8788280>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:52.346160 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ade532ea-1ab7-4aa1-9e7f-028605909f7e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.090596 Oct 29 02:54:52.346859 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1267/2490] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:52 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:53.003217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90d0153f-292c-4dd1-b081-e4f87d504ecf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:53.004101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-90d0153f-292c-4dd1-b081-e4f87d504ecf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:53.024506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0153f-292c-4dd1-b081-e4f87d504ecf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:53.025142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0153f-292c-4dd1-b081-e4f87d504ecf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:53.025680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0153f-292c-4dd1-b081-e4f87d504ecf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:53.026512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0153f-292c-4dd1-b081-e4f87d504ecf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:53.032599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0153f-292c-4dd1-b081-e4f87d504ecf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:53.038252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0153f-292c-4dd1-b081-e4f87d504ecf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:53.362432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dba1da47-aad9-4af4-9bf0-71c40bbef218 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acc22f70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:53.448923 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dba1da47-aad9-4af4-9bf0-71c40bbef218 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.090322 Oct 29 02:54:53.457891 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1268/2491] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:53 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:53.790718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-90d0153f-292c-4dd1-b081-e4f87d504ecf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:53.802375 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90d0153f-292c-4dd1-b081-e4f87d504ecf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.803247 Oct 29 02:54:53.820611 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1224/2492] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:52 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:54.311145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d2e76d16-b18c-4efb-bf8a-61277ba8dde1 tempest-AbsoluteLimitsTestJSON-966472384 tempest-AbsoluteLimitsTestJSON-966472384-project] Calling method '.version_select at 0x7fe1a86eb550>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:54.355627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e76d16-b18c-4efb-bf8a-61277ba8dde1 tempest-AbsoluteLimitsTestJSON-966472384 tempest-AbsoluteLimitsTestJSON-966472384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:54.356474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e76d16-b18c-4efb-bf8a-61277ba8dde1 tempest-AbsoluteLimitsTestJSON-966472384 tempest-AbsoluteLimitsTestJSON-966472384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:54.357150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e76d16-b18c-4efb-bf8a-61277ba8dde1 tempest-AbsoluteLimitsTestJSON-966472384 tempest-AbsoluteLimitsTestJSON-966472384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:54.358066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e76d16-b18c-4efb-bf8a-61277ba8dde1 tempest-AbsoluteLimitsTestJSON-966472384 tempest-AbsoluteLimitsTestJSON-966472384-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:54.367404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e76d16-b18c-4efb-bf8a-61277ba8dde1 tempest-AbsoluteLimitsTestJSON-966472384 tempest-AbsoluteLimitsTestJSON-966472384-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:54.368524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2e76d16-b18c-4efb-bf8a-61277ba8dde1 tempest-AbsoluteLimitsTestJSON-966472384 tempest-AbsoluteLimitsTestJSON-966472384-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:54.414210 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d2e76d16-b18c-4efb-bf8a-61277ba8dde1 tempest-AbsoluteLimitsTestJSON-966472384 tempest-AbsoluteLimitsTestJSON-966472384-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.707338 Oct 29 02:54:54.416852 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1269/2493] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:53 2022] GET /compute/v2.1/limits => generated 511 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:54.464588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7a325d2e-acea-42a7-b015-21a32efbd8db tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a854bee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:54.585277 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7a325d2e-acea-42a7-b015-21a32efbd8db tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.124472 Oct 29 02:54:54.594852 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1225/2494] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:54 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:54.830203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c650d008-ca34-418e-a4ff-adfb01895293 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:54.831880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c650d008-ca34-418e-a4ff-adfb01895293 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:54.846511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c650d008-ca34-418e-a4ff-adfb01895293 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:54.847007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c650d008-ca34-418e-a4ff-adfb01895293 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:54.847445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c650d008-ca34-418e-a4ff-adfb01895293 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:54.848175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c650d008-ca34-418e-a4ff-adfb01895293 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:54.848609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c650d008-ca34-418e-a4ff-adfb01895293 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:54.849019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c650d008-ca34-418e-a4ff-adfb01895293 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:54.931703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:55.215457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c650d008-ca34-418e-a4ff-adfb01895293 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:55.231900 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c650d008-ca34-418e-a4ff-adfb01895293 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.407037 Oct 29 02:54:55.235483 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1270/2495] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:54 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:55.601644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3f3534b9-a8c4-4bab-92dd-cd18a2031736 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c07ee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:55.702321 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3f3534b9-a8c4-4bab-92dd-cd18a2031736 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.105381 Oct 29 02:54:55.714590 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1226/2496] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:55 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:56.263082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-622107bd-5781-4bdf-8939-072aff100728 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:56.264342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-622107bd-5781-4bdf-8939-072aff100728 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:56.299326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-622107bd-5781-4bdf-8939-072aff100728 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:56.299800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-622107bd-5781-4bdf-8939-072aff100728 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:56.300315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-622107bd-5781-4bdf-8939-072aff100728 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:56.301122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-622107bd-5781-4bdf-8939-072aff100728 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:56.301559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-622107bd-5781-4bdf-8939-072aff100728 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:56.302423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-622107bd-5781-4bdf-8939-072aff100728 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:56.722178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-325356af-eafa-414d-be11-aaa289e87c96 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a873e3a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:56.772996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-622107bd-5781-4bdf-8939-072aff100728 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:56.789646 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-622107bd-5781-4bdf-8939-072aff100728 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.531221 Oct 29 02:54:56.796006 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1271/2497] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:56 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:56.809895 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-325356af-eafa-414d-be11-aaa289e87c96 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.093629 Oct 29 02:54:56.811210 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1227/2498] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:56 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:57.825993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-107512ff-0a25-4d6c-8a98-b4f107bfa772 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c079d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:57.830627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a527aaf-40d3-4ec4-bf1b-3dffe164e123 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:57.831255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5a527aaf-40d3-4ec4-bf1b-3dffe164e123 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:57.872261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a527aaf-40d3-4ec4-bf1b-3dffe164e123 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:57.873042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a527aaf-40d3-4ec4-bf1b-3dffe164e123 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:57.875102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a527aaf-40d3-4ec4-bf1b-3dffe164e123 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:57.878164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a527aaf-40d3-4ec4-bf1b-3dffe164e123 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:57.884024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a527aaf-40d3-4ec4-bf1b-3dffe164e123 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:57.888432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a527aaf-40d3-4ec4-bf1b-3dffe164e123 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:57.946637 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-107512ff-0a25-4d6c-8a98-b4f107bfa772 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.124501 Oct 29 02:54:57.960280 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1228/2499] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:57 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:58.640661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5a527aaf-40d3-4ec4-bf1b-3dffe164e123 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:58.652631 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5a527aaf-40d3-4ec4-bf1b-3dffe164e123 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.834300 Oct 29 02:54:58.656366 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1272/2500] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:57 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:58.964603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6c295563-900d-4772-8a92-7211fd92281e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a86dd670>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:59.059474 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6c295563-900d-4772-8a92-7211fd92281e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.098225 Oct 29 02:54:59.073372 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1229/2501] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:58 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:59.687280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b8b630ef-8b74-466f-8df3-26d09eac2dea tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:59.689151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b8b630ef-8b74-466f-8df3-26d09eac2dea tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:59.708814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8b630ef-8b74-466f-8df3-26d09eac2dea tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:59.708814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8b630ef-8b74-466f-8df3-26d09eac2dea tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:59.708814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8b630ef-8b74-466f-8df3-26d09eac2dea tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:59.711255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8b630ef-8b74-466f-8df3-26d09eac2dea tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:59.711778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8b630ef-8b74-466f-8df3-26d09eac2dea tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:59.712220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8b630ef-8b74-466f-8df3-26d09eac2dea tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:00.080158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-113df62e-a361-4319-9134-435c00188910 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8fc2d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:00.181922 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-113df62e-a361-4319-9134-435c00188910 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.107480 Oct 29 02:55:00.182804 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1230/2502] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:00 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:00.763243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b8b630ef-8b74-466f-8df3-26d09eac2dea tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:00.786089 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b8b630ef-8b74-466f-8df3-26d09eac2dea tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 1.099161 Oct 29 02:55:00.786755 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1273/2503] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:59 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:01.198313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9e221575-c34c-496d-b241-c7d070626628 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a90bb0d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:01.297325 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9e221575-c34c-496d-b241-c7d070626628 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.102677 Oct 29 02:55:01.302655 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1231/2504] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:01 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:01.819815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-515d615f-4417-4acb-89ae-9f7a0fd55307 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:01.820497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-515d615f-4417-4acb-89ae-9f7a0fd55307 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:01.841217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-515d615f-4417-4acb-89ae-9f7a0fd55307 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:01.847374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-515d615f-4417-4acb-89ae-9f7a0fd55307 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:01.849107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-515d615f-4417-4acb-89ae-9f7a0fd55307 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:01.850258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-515d615f-4417-4acb-89ae-9f7a0fd55307 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:01.857312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-515d615f-4417-4acb-89ae-9f7a0fd55307 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:01.861530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-515d615f-4417-4acb-89ae-9f7a0fd55307 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:02.392893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-515d615f-4417-4acb-89ae-9f7a0fd55307 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:02.405533 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-515d615f-4417-4acb-89ae-9f7a0fd55307 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.591053 Oct 29 02:55:02.406780 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1274/2505] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:01 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:02.412391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-196c1d8e-a9d7-4d52-b8ce-2f2486f7bd08 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a88bfaf0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:02.496862 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-196c1d8e-a9d7-4d52-b8ce-2f2486f7bd08 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.088738 Oct 29 02:55:02.505174 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1275/2506] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:02 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:02.821471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1924934204", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "206445a3-72bd-4ae4-a1d4-4c994350bfbb"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:03.007333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] validate_networks() for [('206445a3-72bd-4ae4-a1d4-4c994350bfbb', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:55:03.436190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c75aa329-9995-44fc-bcc0-2342cd9ebdf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:03.436795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c75aa329-9995-44fc-bcc0-2342cd9ebdf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:03.459535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c75aa329-9995-44fc-bcc0-2342cd9ebdf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:03.463501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c75aa329-9995-44fc-bcc0-2342cd9ebdf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:03.464418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c75aa329-9995-44fc-bcc0-2342cd9ebdf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:03.465427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c75aa329-9995-44fc-bcc0-2342cd9ebdf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:03.468301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c75aa329-9995-44fc-bcc0-2342cd9ebdf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:03.472674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c75aa329-9995-44fc-bcc0-2342cd9ebdf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:03.797984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:04.212330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c75aa329-9995-44fc-bcc0-2342cd9ebdf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:04.229213 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c75aa329-9995-44fc-bcc0-2342cd9ebdf2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.794044 Oct 29 02:55:04.241102 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1276/2507] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:03 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:04.258956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-031c4d0d-03a0-4c49-b3b2-82a59b04a8cd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acc22f70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:04.326778 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-031c4d0d-03a0-4c49-b3b2-82a59b04a8cd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.076691 Oct 29 02:55:04.327878 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1277/2508] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:04 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:05.259322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-648414fe-bf96-4eae-88d6-4fcaf8cd7f54 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:05.259976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-648414fe-bf96-4eae-88d6-4fcaf8cd7f54 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:05.262153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:05.262808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:05.304531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648414fe-bf96-4eae-88d6-4fcaf8cd7f54 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:05.305036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648414fe-bf96-4eae-88d6-4fcaf8cd7f54 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:05.305515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648414fe-bf96-4eae-88d6-4fcaf8cd7f54 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:05.306236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648414fe-bf96-4eae-88d6-4fcaf8cd7f54 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:05.306696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648414fe-bf96-4eae-88d6-4fcaf8cd7f54 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:05.307122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648414fe-bf96-4eae-88d6-4fcaf8cd7f54 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:05.785410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-648414fe-bf96-4eae-88d6-4fcaf8cd7f54 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:05.799936 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-648414fe-bf96-4eae-88d6-4fcaf8cd7f54 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.544367 Oct 29 02:55:05.803255 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1278/2509] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:05 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:05.817734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29a9f18f-1b9b-4e78-932e-0dfbba46920a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acc22b80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:05.921000 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29a9f18f-1b9b-4e78-932e-0dfbba46920a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.116455 Oct 29 02:55:05.922152 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1279/2510] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:05 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:06.268649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fbe110f7-d95c-4159-95e6-e619535a3be1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:06.270668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fbe110f7-d95c-4159-95e6-e619535a3be1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:06.325936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe110f7-d95c-4159-95e6-e619535a3be1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:06.329782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe110f7-d95c-4159-95e6-e619535a3be1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:06.330613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe110f7-d95c-4159-95e6-e619535a3be1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:06.334112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe110f7-d95c-4159-95e6-e619535a3be1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:06.338115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe110f7-d95c-4159-95e6-e619535a3be1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:06.341007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe110f7-d95c-4159-95e6-e619535a3be1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:06.440482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fbe110f7-d95c-4159-95e6-e619535a3be1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:06.769161 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fbe110f7-d95c-4159-95e6-e619535a3be1 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 204 len: 0 microversion: 2.25 time: 0.504734 Oct 29 02:55:06.771869 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1280/2511] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:55:06 2022] DELETE /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 02:55:06.794623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d52cd47d-7f84-4ab8-8be7-41956b1fb103 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:06.825649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d52cd47d-7f84-4ab8-8be7-41956b1fb103 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:06.829717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d52cd47d-7f84-4ab8-8be7-41956b1fb103 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Searching by: {'deleted': False, 'project_id': '87111b9e962d4606a29bc7ad37b8d484'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:55:06.857332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52cd47d-7f84-4ab8-8be7-41956b1fb103 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:06.862291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52cd47d-7f84-4ab8-8be7-41956b1fb103 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:06.862820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52cd47d-7f84-4ab8-8be7-41956b1fb103 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:06.868040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52cd47d-7f84-4ab8-8be7-41956b1fb103 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:06.871331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52cd47d-7f84-4ab8-8be7-41956b1fb103 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:06.871957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d52cd47d-7f84-4ab8-8be7-41956b1fb103 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:07.006403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-d52cd47d-7f84-4ab8-8be7-41956b1fb103 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:55:07.160663 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d52cd47d-7f84-4ab8-8be7-41956b1fb103 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.375238 Oct 29 02:55:07.160663 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1281/2512] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 02:55:06 2022] GET /compute/v2.1/servers => generated 340 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:07.183764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:07.188137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:07.219303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.220804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.223575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:07.228154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.228958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.229409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:07.633597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:07.651448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:07.657277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:07.660450 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2cf759e2-2854-4046-8568-a76c9074ed2e tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1730 microversion: 2.25 time: 0.499639 Oct 29 02:55:07.661316 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1282/2513] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:07 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1730 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:07.671095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3b5364d6-461e-4c3a-998c-c3b206f8a43e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:07.672021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b5364d6-461e-4c3a-998c-c3b206f8a43e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:07.681125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5364d6-461e-4c3a-998c-c3b206f8a43e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.682039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5364d6-461e-4c3a-998c-c3b206f8a43e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.682678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5364d6-461e-4c3a-998c-c3b206f8a43e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:07.683560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5364d6-461e-4c3a-998c-c3b206f8a43e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.684925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5364d6-461e-4c3a-998c-c3b206f8a43e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.685562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b5364d6-461e-4c3a-998c-c3b206f8a43e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:07.933319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:55:07.933776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:55:07.934253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:55:07.934703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:55:07.935201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:55:07.944867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=31 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:07.964517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.965686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.967613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:07.968578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.971394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.972417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:08.031629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:08.047274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for user fceb096cc5414b3a9d7300fefeb90dff and project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:08.083666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:55:08.090176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b5364d6-461e-4c3a-998c-c3b206f8a43e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:08.090353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:55:08.099196 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3b5364d6-461e-4c3a-998c-c3b206f8a43e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.436359 Oct 29 02:55:08.099795 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1283/2514] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:07 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:08.149678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d987ecae-dc44-4009-867f-b4c682c88580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a873f790>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:08.258781 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f767486c-8abe-4eed-872c-71e1b33f0538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.325135 Oct 29 02:55:08.268370 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1232/2515] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 6336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:55:08.280356 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d987ecae-dc44-4009-867f-b4c682c88580 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.154924 Oct 29 02:55:08.280670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:08.281737 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1284/2516] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:08 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:08.291849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:08.292934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Searching by: {'deleted': False, 'project_id': '87111b9e962d4606a29bc7ad37b8d484'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:55:08.306958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:08.308349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7eaccda-6211-45d9-b053-4dbbfe81661f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:08.308956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:08.309512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:08.313650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:08.314216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:08.314839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:08.315265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7eaccda-6211-45d9-b053-4dbbfe81661f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:08.586845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:55:08.622796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c7eaccda-6211-45d9-b053-4dbbfe81661f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:08.650263 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7eaccda-6211-45d9-b053-4dbbfe81661f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1215 microversion: 2.1 time: 0.365957 Oct 29 02:55:08.652399 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1285/2517] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:08 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1215 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:08.696463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:08.697208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:08.713717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:08.714243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:08.714691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:08.722416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:08.722919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:08.723362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:08.826229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:08.860630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:08.862455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:08.863052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:09.266973 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4a930151-a660-46e6-8915-b8d41442c4bc tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.995617 Oct 29 02:55:09.268207 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1233/2518] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:55:08 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:09.286812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-67240d6c-8cc1-4a58-97f9-71e584902a8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:09.288465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-67240d6c-8cc1-4a58-97f9-71e584902a8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:09.299639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67240d6c-8cc1-4a58-97f9-71e584902a8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:09.300680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67240d6c-8cc1-4a58-97f9-71e584902a8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:09.302471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67240d6c-8cc1-4a58-97f9-71e584902a8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:09.303305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67240d6c-8cc1-4a58-97f9-71e584902a8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:09.306990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67240d6c-8cc1-4a58-97f9-71e584902a8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:09.307509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67240d6c-8cc1-4a58-97f9-71e584902a8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:09.592146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:09.606523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:09.608140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:09.613341 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3c42232a-145c-4530-b5b8-3818bab002dc tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1730 microversion: 2.25 time: 0.922309 Oct 29 02:55:09.630710 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1286/2519] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:08 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1730 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:09.630710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e1c95bcb-2798-4b5a-9bac-a5c685ebc97e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a886bd30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:09.648759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-67240d6c-8cc1-4a58-97f9-71e584902a8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:09.682620 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-67240d6c-8cc1-4a58-97f9-71e584902a8e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.411342 Oct 29 02:55:09.684770 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1234/2520] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:09 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:09.693882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c7546560-b46c-4b06-a507-252f2b0fe449 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:09.719932 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c7546560-b46c-4b06-a507-252f2b0fe449 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033858 Oct 29 02:55:09.720818 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1235/2521] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:55:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:09.738217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9ea5225e-b169-4417-a6d7-362bfc37891d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:09.739548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9ea5225e-b169-4417-a6d7-362bfc37891d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:09.744299 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e1c95bcb-2798-4b5a-9bac-a5c685ebc97e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.124719 Oct 29 02:55:09.745030 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1287/2522] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:09 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:09.751883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ea5225e-b169-4417-a6d7-362bfc37891d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:09.752881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ea5225e-b169-4417-a6d7-362bfc37891d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:09.753547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ea5225e-b169-4417-a6d7-362bfc37891d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:09.755025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ea5225e-b169-4417-a6d7-362bfc37891d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:09.755692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ea5225e-b169-4417-a6d7-362bfc37891d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:09.756259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ea5225e-b169-4417-a6d7-362bfc37891d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:09.949502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9ea5225e-b169-4417-a6d7-362bfc37891d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:09.965324 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9ea5225e-b169-4417-a6d7-362bfc37891d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1219 microversion: 2.1 time: 0.243320 Oct 29 02:55:09.986894 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1236/2523] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:09 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1219 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:10.047987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-789949d3-b05f-4b88-b491-f29141826ed1 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:10.049102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-789949d3-b05f-4b88-b491-f29141826ed1 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:10.065823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-789949d3-b05f-4b88-b491-f29141826ed1 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.073044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-789949d3-b05f-4b88-b491-f29141826ed1 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.076325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-789949d3-b05f-4b88-b491-f29141826ed1 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.079192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-789949d3-b05f-4b88-b491-f29141826ed1 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.081906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-789949d3-b05f-4b88-b491-f29141826ed1 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.083301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-789949d3-b05f-4b88-b491-f29141826ed1 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.192731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-789949d3-b05f-4b88-b491-f29141826ed1 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:10.448515 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-789949d3-b05f-4b88-b491-f29141826ed1 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 204 len: 0 microversion: 2.1 time: 0.405339 Oct 29 02:55:10.452302 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1288/2524] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:10 2022] DELETE /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:10.458617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f796d7b7-f35c-4d61-ba8f-6a7063c201fe tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:10.460071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f796d7b7-f35c-4d61-ba8f-6a7063c201fe tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:10.474622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f796d7b7-f35c-4d61-ba8f-6a7063c201fe tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.475355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f796d7b7-f35c-4d61-ba8f-6a7063c201fe tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.476000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f796d7b7-f35c-4d61-ba8f-6a7063c201fe tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.477029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f796d7b7-f35c-4d61-ba8f-6a7063c201fe tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.477669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f796d7b7-f35c-4d61-ba8f-6a7063c201fe tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.478305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f796d7b7-f35c-4d61-ba8f-6a7063c201fe tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.653791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:10.654703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:10.666283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.671109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.673248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.676517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.677533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.679644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.744794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:10.822150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f796d7b7-f35c-4d61-ba8f-6a7063c201fe tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:10.835748 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f796d7b7-f35c-4d61-ba8f-6a7063c201fe tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1713 microversion: 2.1 time: 0.381438 Oct 29 02:55:10.837049 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1237/2525] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:10 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1713 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:10.842969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-8b42cd5d-1d82-4687-b7fb-da87881f3fcd req-4a445377-44d3-4881-a9cf-98830e0cc257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce4caa1-3b78-4bcf-98e4-b4d9da71dfee", "name": "network-vif-deleted", "tag": "13168635-67a9-4cb0-a7c1-c8262d0cd5a5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:10.855607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8b42cd5d-1d82-4687-b7fb-da87881f3fcd req-4a445377-44d3-4881-a9cf-98830e0cc257 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.857156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8b42cd5d-1d82-4687-b7fb-da87881f3fcd req-4a445377-44d3-4881-a9cf-98830e0cc257 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.858009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8b42cd5d-1d82-4687-b7fb-da87881f3fcd req-4a445377-44d3-4881-a9cf-98830e0cc257 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.862337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:10.877103 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-8b42cd5d-1d82-4687-b7fb-da87881f3fcd req-4a445377-44d3-4881-a9cf-98830e0cc257 service nova] Creating event network-vif-deleted:13168635-67a9-4cb0-a7c1-c8262d0cd5a5 for instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee on n-h2-862964-4 Oct 29 02:55:10.878291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:10.884301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:10.885914 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bbb415a7-3135-4328-a518-c8d3de3f706d tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1664 microversion: 2.25 time: 0.241763 Oct 29 02:55:10.887024 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-8b42cd5d-1d82-4687-b7fb-da87881f3fcd req-4a445377-44d3-4881-a9cf-98830e0cc257 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045386 Oct 29 02:55:10.887759 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1238/2526] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:10.888338 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1289/2527] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:10 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1664 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:10.901853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-85770c5a-9b4d-48a4-8cdc-8c34bff52fc7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:10.903135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-85770c5a-9b4d-48a4-8cdc-8c34bff52fc7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:10.907841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b329446d-e086-453f-a78e-f9e3e78d5f20 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a918fc10>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:10.916686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85770c5a-9b4d-48a4-8cdc-8c34bff52fc7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.919111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85770c5a-9b4d-48a4-8cdc-8c34bff52fc7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.919768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85770c5a-9b4d-48a4-8cdc-8c34bff52fc7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.924048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85770c5a-9b4d-48a4-8cdc-8c34bff52fc7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.924771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85770c5a-9b4d-48a4-8cdc-8c34bff52fc7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.925389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85770c5a-9b4d-48a4-8cdc-8c34bff52fc7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:11.016545 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b329446d-e086-453f-a78e-f9e3e78d5f20 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.123033 Oct 29 02:55:11.020416 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1239/2528] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:10 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:11.027462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b773bee-186a-492f-9773-370891c3e29b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:11.028776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0b773bee-186a-492f-9773-370891c3e29b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:11.038012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b773bee-186a-492f-9773-370891c3e29b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:11.039028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b773bee-186a-492f-9773-370891c3e29b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:11.039544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b773bee-186a-492f-9773-370891c3e29b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:11.041023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b773bee-186a-492f-9773-370891c3e29b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:11.041558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b773bee-186a-492f-9773-370891c3e29b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:11.042411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b773bee-186a-492f-9773-370891c3e29b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:11.205042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b773bee-186a-492f-9773-370891c3e29b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:11.214432 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b773bee-186a-492f-9773-370891c3e29b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1267 microversion: 2.1 time: 0.192819 Oct 29 02:55:11.238089 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1240/2529] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:11 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:11.640288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-85770c5a-9b4d-48a4-8cdc-8c34bff52fc7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:11.655411 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-85770c5a-9b4d-48a4-8cdc-8c34bff52fc7 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.762563 Oct 29 02:55:11.658465 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1290/2530] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:10 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:11.871838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d804f34-5675-42b6-a1cf-2b24137d20f6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:11.872541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7d804f34-5675-42b6-a1cf-2b24137d20f6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:11.897452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d804f34-5675-42b6-a1cf-2b24137d20f6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:11.897452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d804f34-5675-42b6-a1cf-2b24137d20f6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:11.913580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d804f34-5675-42b6-a1cf-2b24137d20f6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:11.913580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d804f34-5675-42b6-a1cf-2b24137d20f6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:11.913580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d804f34-5675-42b6-a1cf-2b24137d20f6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:11.913580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d804f34-5675-42b6-a1cf-2b24137d20f6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:11.918035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:11.921627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:11.935696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:11.959462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:11.960369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:11.968202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:11.969825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:11.972320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:11.973083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:12.228684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7d804f34-5675-42b6-a1cf-2b24137d20f6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:12.245953 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7d804f34-5675-42b6-a1cf-2b24137d20f6 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1713 microversion: 2.1 time: 0.380449 Oct 29 02:55:12.256366 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1241/2531] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:11 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1713 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:12.273749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6b1f5ace-b1ea-49b6-9060-06962100d429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8730e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:12.398648 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6b1f5ace-b1ea-49b6-9060-06962100d429 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.140271 Oct 29 02:55:12.408914 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1242/2532] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:12 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:12.411883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-68d5a27b-4c8a-4d92-90dd-8a9e226457d7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:12.416674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-68d5a27b-4c8a-4d92-90dd-8a9e226457d7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:12.435221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68d5a27b-4c8a-4d92-90dd-8a9e226457d7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:12.437357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68d5a27b-4c8a-4d92-90dd-8a9e226457d7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:12.437978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68d5a27b-4c8a-4d92-90dd-8a9e226457d7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:12.441217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68d5a27b-4c8a-4d92-90dd-8a9e226457d7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:12.441860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68d5a27b-4c8a-4d92-90dd-8a9e226457d7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:12.445264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68d5a27b-4c8a-4d92-90dd-8a9e226457d7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:12.456775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:12.471376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:12.478759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:12.486460 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0cdc718c-45bd-4f77-a7b5-de146583f310 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1370 microversion: 2.25 time: 0.571196 Oct 29 02:55:12.487302 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1291/2533] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:11 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1370 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:12.690387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f40e086b-be91-4ef8-a817-c840baf09e23 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:12.691057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f40e086b-be91-4ef8-a817-c840baf09e23 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:12.715175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f40e086b-be91-4ef8-a817-c840baf09e23 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:12.715681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f40e086b-be91-4ef8-a817-c840baf09e23 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:12.716119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f40e086b-be91-4ef8-a817-c840baf09e23 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:12.725087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f40e086b-be91-4ef8-a817-c840baf09e23 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:12.725832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f40e086b-be91-4ef8-a817-c840baf09e23 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:12.734287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f40e086b-be91-4ef8-a817-c840baf09e23 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:12.767055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-68d5a27b-4c8a-4d92-90dd-8a9e226457d7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:12.775918 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-68d5a27b-4c8a-4d92-90dd-8a9e226457d7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1267 microversion: 2.1 time: 0.375465 Oct 29 02:55:12.778749 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1243/2534] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:12 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1267 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:13.285334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0243f555-2972-477f-b11c-e22ae71d438f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:13.286114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0243f555-2972-477f-b11c-e22ae71d438f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:13.298423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0243f555-2972-477f-b11c-e22ae71d438f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.311168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0243f555-2972-477f-b11c-e22ae71d438f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.312095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0243f555-2972-477f-b11c-e22ae71d438f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.313424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0243f555-2972-477f-b11c-e22ae71d438f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.314188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0243f555-2972-477f-b11c-e22ae71d438f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.314733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0243f555-2972-477f-b11c-e22ae71d438f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.398493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f40e086b-be91-4ef8-a817-c840baf09e23 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:13.413345 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f40e086b-be91-4ef8-a817-c840baf09e23 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.731414 Oct 29 02:55:13.416007 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1292/2535] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:12 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:13.428027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6e1f8a69-2579-4969-a639-8f74de031e9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c0ae50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:13.511340 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6e1f8a69-2579-4969-a639-8f74de031e9d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1439 microversion: 2.1 time: 0.094037 Oct 29 02:55:13.515278 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1293/2536] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:13 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:13.531516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:13.532399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:13.540683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.541392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.542008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.542869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.543837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.544650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.596799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.597731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.598336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.598923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lazy-loading 'fault' on Instance uuid bce4caa1-3b78-4bcf-98e4-b4d9da71dfee {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:55:13.723222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:13.740005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:13.744372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:13.749041 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6194c4c3-f5ff-40aa-be47-fce1dae871ce tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 200 len: 1375 microversion: 2.25 time: 0.221148 Oct 29 02:55:13.762023 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1294/2537] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:13 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 1375 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:13.800852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fa73f2ed-923e-4636-9341-501fd4c8eea2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:13.801470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fa73f2ed-923e-4636-9341-501fd4c8eea2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:13.807159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0243f555-2972-477f-b11c-e22ae71d438f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:13.812365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa73f2ed-923e-4636-9341-501fd4c8eea2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.815813 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0243f555-2972-477f-b11c-e22ae71d438f tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1713 microversion: 2.1 time: 0.534763 Oct 29 02:55:13.827261 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1244/2538] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:13 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1713 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:13.847717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa73f2ed-923e-4636-9341-501fd4c8eea2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.848318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa73f2ed-923e-4636-9341-501fd4c8eea2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.849433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa73f2ed-923e-4636-9341-501fd4c8eea2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.849547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa73f2ed-923e-4636-9341-501fd4c8eea2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.849933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa73f2ed-923e-4636-9341-501fd4c8eea2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.005490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fa73f2ed-923e-4636-9341-501fd4c8eea2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:14.031241 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fa73f2ed-923e-4636-9341-501fd4c8eea2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1273 microversion: 2.1 time: 0.224231 Oct 29 02:55:14.033274 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1295/2539] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:13 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:14.348005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-32f02fae-935a-49f3-b76d-000415d47cad tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1a8944d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1988771103", "description": "tempest-description-1842707561"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:14.445558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ba847b7b-c0ee-4d94-a688-d25ed66a9201 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:14.446872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ba847b7b-c0ee-4d94-a688-d25ed66a9201 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:14.455437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba847b7b-c0ee-4d94-a688-d25ed66a9201 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.456102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba847b7b-c0ee-4d94-a688-d25ed66a9201 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.460749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba847b7b-c0ee-4d94-a688-d25ed66a9201 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.461695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba847b7b-c0ee-4d94-a688-d25ed66a9201 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.462303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba847b7b-c0ee-4d94-a688-d25ed66a9201 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.462872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba847b7b-c0ee-4d94-a688-d25ed66a9201 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.692791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ba847b7b-c0ee-4d94-a688-d25ed66a9201 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:14.704522 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ba847b7b-c0ee-4d94-a688-d25ed66a9201 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.264537 Oct 29 02:55:14.705077 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1296/2540] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:14 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:14.720110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50e094ab-ece0-44a3-891b-c5b8bff3e986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c0ae50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:14.793642 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50e094ab-ece0-44a3-891b-c5b8bff3e986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1448 microversion: 2.1 time: 0.087321 Oct 29 02:55:14.794896 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1297/2541] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:14 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1448 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:14.801149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:14.802171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: bce4caa1-3b78-4bcf-98e4-b4d9da71dfee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:14.810138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.810903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.811805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.813015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.813501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.814051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.836230 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] HTTP exception thrown: Instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee could not be found. Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Request method failure captured: Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee HTTP/1.1 Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQuccPsSxpEQcD2tjrWhykr3SJ_3P29lS31n5eNXssW4WXG0XOTjhxbCShrHaXna_t_vldyKx-vpE-HAQvpnmh2Vn9lq73PhGlwLyH56ar0kN7N0dwVSRtdPk48J6HFJWP0eYqbjMnfXbhjn5C4ycpyD4CECFllRO4l_ch-L8eoy5Y Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 60896479fb0c4357ad5fb03016470283 Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/60896479fb0c4357ad5fb03016470283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60896479fb0c4357ad5fb03016470283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_60896479fb0c4357ad5fb03016470283", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60896479fb0c4357ad5fb03016470283"}]}] Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 60896479fb0c4357ad5fb03016470283 Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-LiveAutoBlockMigrationV225Test-1573949452-project Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: f0ea28d9bb3544bca1a3c90d983fe8e4 Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452-project Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee could not be found. Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'bce4caa1-3b78-4bcf-98e4-b4d9da71dfee'} Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee could not be found. Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee could not be found. Oct 29 02:55:14.838408 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:14.844304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:14.844304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:14.844304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:14.844304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:14.844304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:14.844304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:14.844304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:14.844304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee could not be found. Oct 29 02:55:14.844304 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:14.849457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Returning 404 to user: Instance bce4caa1-3b78-4bcf-98e4-b4d9da71dfee could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:14.850717 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-864b8100-0ed3-4fc1-9c3d-3272cd1817f8 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee" status: 404 len: 111 microversion: 2.25 time: 0.053784 Oct 29 02:55:14.852905 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1298/2542] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:14 2022] GET /compute/v2.1/servers/bce4caa1-3b78-4bcf-98e4-b4d9da71dfee => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:14.860922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ece7adb-3954-4cea-81d4-a87d393df5ec tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a87cddc0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:14.933036 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ece7adb-3954-4cea-81d4-a87d393df5ec tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 200 len: 1448 microversion: 2.1 time: 0.077107 Oct 29 02:55:14.953291 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1299/2543] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:14 2022] GET /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 1448 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:14.973118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-97bd5cbd-ccbd-49ca-9e37-9f077b80b682 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:14.976047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-97bd5cbd-ccbd-49ca-9e37-9f077b80b682 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:14.989430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97bd5cbd-ccbd-49ca-9e37-9f077b80b682 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.990338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97bd5cbd-ccbd-49ca-9e37-9f077b80b682 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.991134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97bd5cbd-ccbd-49ca-9e37-9f077b80b682 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.993338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97bd5cbd-ccbd-49ca-9e37-9f077b80b682 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.994064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97bd5cbd-ccbd-49ca-9e37-9f077b80b682 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.996088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97bd5cbd-ccbd-49ca-9e37-9f077b80b682 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.119711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-97bd5cbd-ccbd-49ca-9e37-9f077b80b682 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:15.148609 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-97bd5cbd-ccbd-49ca-9e37-9f077b80b682 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1645 microversion: 2.1 time: 0.192780 Oct 29 02:55:15.149536 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1300/2544] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:14 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1645 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:15.178070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3740115-69c4-4e60-920d-272c0768be95 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '.version_select at 0x7fe1a873fc10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:15.225064 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3740115-69c4-4e60-920d-272c0768be95 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-727801795" status: 204 len: 0 microversion: 2.25 time: 0.066818 Oct 29 02:55:15.226419 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1301/2545] 10.222.0.16 () {60 vars in 1259 bytes} [Sat Oct 29 02:55:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-727801795 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:55:15.265457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5b997f45-592c-40c8-aafc-9e889cc4b43b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a89c9e50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:15.443164 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-32f02fae-935a-49f3-b76d-000415d47cad tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.320244 Oct 29 02:55:15.445427 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1245/2546] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:55:14 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:55:15.460283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-80af386d-81bd-4e6e-a674-f20440298a4a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:15.461568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-80af386d-81bd-4e6e-a674-f20440298a4a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:15.473667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80af386d-81bd-4e6e-a674-f20440298a4a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.474417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80af386d-81bd-4e6e-a674-f20440298a4a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.475086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80af386d-81bd-4e6e-a674-f20440298a4a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.476012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80af386d-81bd-4e6e-a674-f20440298a4a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.476852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80af386d-81bd-4e6e-a674-f20440298a4a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.477776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80af386d-81bd-4e6e-a674-f20440298a4a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:16.450793 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5b997f45-592c-40c8-aafc-9e889cc4b43b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 204 len: 0 microversion: 2.1 time: 1.223094 Oct 29 02:55:16.455722 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1302/2547] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:15 2022] DELETE /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 0 bytes in 1228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:16.471823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ff1c075-cfbd-4083-8ea2-02f51f4582db tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1a8789f70>, body: {"security_group_rule": {"parent_group_id": "e214e7a4-f278-4ff3-bddb-7dd1c612413d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:16.670878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-80af386d-81bd-4e6e-a674-f20440298a4a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:16.691711 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-80af386d-81bd-4e6e-a674-f20440298a4a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1315 microversion: 2.1 time: 1.242627 Oct 29 02:55:16.692324 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1246/2548] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:15 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1315 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:16.715171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f38398f9-f6d8-4ab0-b44e-5ff466c29b1e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:16.715791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f38398f9-f6d8-4ab0-b44e-5ff466c29b1e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:16.739351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f38398f9-f6d8-4ab0-b44e-5ff466c29b1e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:16.739845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f38398f9-f6d8-4ab0-b44e-5ff466c29b1e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:16.740284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f38398f9-f6d8-4ab0-b44e-5ff466c29b1e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:16.740980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f38398f9-f6d8-4ab0-b44e-5ff466c29b1e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:16.743558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f38398f9-f6d8-4ab0-b44e-5ff466c29b1e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:16.746856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f38398f9-f6d8-4ab0-b44e-5ff466c29b1e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:16.921328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:17.245837 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ff1c075-cfbd-4083-8ea2-02f51f4582db tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.783972 Oct 29 02:55:17.247057 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1303/2549] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:55:16 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:17.262585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:17.263476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:17.287402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.287935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.288503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.290454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.292300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.292458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.339334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.340296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.342093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.342915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lazy-loading 'fault' on Instance uuid aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:55:17.402677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bccf42abb184f15ae36a855e0d8e68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87111b9e962d4606a29bc7ad37b8d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:17.413321 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-15f92f08-7314-4883-b097-0468c3eca771 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 200 len: 1368 microversion: 2.1 time: 0.165135 Oct 29 02:55:17.414645 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1304/2550] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:17 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:17.420378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b3c46da8-6ca7-4433-b503-ad2126fc1ae2 req-9f58aaae-fb40-484c-83e9-e56469bb4a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0253f5-cea4-471a-97d6-16c7702c07ee", "name": "network-vif-unplugged", "status": "completed", "tag": "95d5adb4-6512-4e6f-9edb-c3dd7ee44c98"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:17.432188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b3c46da8-6ca7-4433-b503-ad2126fc1ae2 req-9f58aaae-fb40-484c-83e9-e56469bb4a01 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.434914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b3c46da8-6ca7-4433-b503-ad2126fc1ae2 req-9f58aaae-fb40-484c-83e9-e56469bb4a01 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.435720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b3c46da8-6ca7-4433-b503-ad2126fc1ae2 req-9f58aaae-fb40-484c-83e9-e56469bb4a01 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.441246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f38398f9-f6d8-4ab0-b44e-5ff466c29b1e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:17.449512 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f38398f9-f6d8-4ab0-b44e-5ff466c29b1e tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.756160 Oct 29 02:55:17.450139 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1247/2551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:16 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:17.455162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d6bdbccb-9e4d-4dd3-a4d5-742c117f9899 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:17.455901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d6bdbccb-9e4d-4dd3-a4d5-742c117f9899 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:17.462151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6bdbccb-9e4d-4dd3-a4d5-742c117f9899 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.462908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6bdbccb-9e4d-4dd3-a4d5-742c117f9899 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.463485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6bdbccb-9e4d-4dd3-a4d5-742c117f9899 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.464330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6bdbccb-9e4d-4dd3-a4d5-742c117f9899 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.464914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6bdbccb-9e4d-4dd3-a4d5-742c117f9899 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.465479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6bdbccb-9e4d-4dd3-a4d5-742c117f9899 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.477127 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b3c46da8-6ca7-4433-b503-ad2126fc1ae2 req-9f58aaae-fb40-484c-83e9-e56469bb4a01 service nova] Creating event network-vif-unplugged:95d5adb4-6512-4e6f-9edb-c3dd7ee44c98 for instance 5c0253f5-cea4-471a-97d6-16c7702c07ee on n-h1-862964-4 Oct 29 02:55:17.484887 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b3c46da8-6ca7-4433-b503-ad2126fc1ae2 req-9f58aaae-fb40-484c-83e9-e56469bb4a01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068424 Oct 29 02:55:17.486107 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1305/2552] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:17.498244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-695fcb02-53f6-49f4-807b-15d2d22f734b req-b7985128-c7e3-4a09-bcd8-f45d4c287286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e07792-807a-44e9-b644-72504509f2f5", "name": "network-vif-unplugged", "status": "completed", "tag": "8a4b46d3-0738-4cd4-a78e-25f2da119a4e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:17.514130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-695fcb02-53f6-49f4-807b-15d2d22f734b req-b7985128-c7e3-4a09-bcd8-f45d4c287286 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.514776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-695fcb02-53f6-49f4-807b-15d2d22f734b req-b7985128-c7e3-4a09-bcd8-f45d4c287286 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.515509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-695fcb02-53f6-49f4-807b-15d2d22f734b req-b7985128-c7e3-4a09-bcd8-f45d4c287286 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.519152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d6bdbccb-9e4d-4dd3-a4d5-742c117f9899 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:17.537677 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-695fcb02-53f6-49f4-807b-15d2d22f734b req-b7985128-c7e3-4a09-bcd8-f45d4c287286 service nova] Creating event network-vif-unplugged:8a4b46d3-0738-4cd4-a78e-25f2da119a4e for instance 26e07792-807a-44e9-b644-72504509f2f5 on n-h2-862964-4 Oct 29 02:55:17.560096 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-695fcb02-53f6-49f4-807b-15d2d22f734b req-b7985128-c7e3-4a09-bcd8-f45d4c287286 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071187 Oct 29 02:55:17.561690 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1306/2553] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:17.584120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d196cbd9-2a93-408a-8f44-9d942955b289 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:17.585874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d196cbd9-2a93-408a-8f44-9d942955b289 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:17.621851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d196cbd9-2a93-408a-8f44-9d942955b289 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.623778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d196cbd9-2a93-408a-8f44-9d942955b289 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.626094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d196cbd9-2a93-408a-8f44-9d942955b289 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.626932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d196cbd9-2a93-408a-8f44-9d942955b289 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.629276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d196cbd9-2a93-408a-8f44-9d942955b289 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.630409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d196cbd9-2a93-408a-8f44-9d942955b289 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.693714 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d6bdbccb-9e4d-4dd3-a4d5-742c117f9899 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 204 len: 0 microversion: 2.1 time: 0.241991 Oct 29 02:55:17.697005 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1248/2554] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:17 2022] DELETE /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:17.708766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d196cbd9-2a93-408a-8f44-9d942955b289 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:17.710589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-028ddb46-c27a-4af1-83ea-f1dbfe9a49e3 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1a89e1a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1500650605", "description": "tempest-description-1524952054"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:17.860705 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d196cbd9-2a93-408a-8f44-9d942955b289 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 204 len: 0 microversion: 2.25 time: 0.294188 Oct 29 02:55:17.862811 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1307/2555] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:55:17 2022] DELETE /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:55:17.869208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44eecf8c-efc2-44c1-bb5a-6140cf54e708 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:17.871242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-44eecf8c-efc2-44c1-bb5a-6140cf54e708 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:17.880008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44eecf8c-efc2-44c1-bb5a-6140cf54e708 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.881408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44eecf8c-efc2-44c1-bb5a-6140cf54e708 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.882048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44eecf8c-efc2-44c1-bb5a-6140cf54e708 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.883034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44eecf8c-efc2-44c1-bb5a-6140cf54e708 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.883648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44eecf8c-efc2-44c1-bb5a-6140cf54e708 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.884488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44eecf8c-efc2-44c1-bb5a-6140cf54e708 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.072454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-44eecf8c-efc2-44c1-bb5a-6140cf54e708 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:18.082746 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-44eecf8c-efc2-44c1-bb5a-6140cf54e708 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1315 microversion: 2.1 time: 0.218360 Oct 29 02:55:18.083497 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1308/2556] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:17 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:18.089578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:18.090810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:18.104383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:18.105395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:18.106066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.107489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:18.108151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:18.108714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.315329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:18.331078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:18.336285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:18.338645 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-08d12ec8-5b62-478b-a6df-48a2c7a24d24 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1549 microversion: 2.25 time: 0.253551 Oct 29 02:55:18.339791 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1309/2557] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:18 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1549 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:18.347392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1727284284", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "0ef24500-837e-47a7-9e10-a72e3fb043af"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:18.437552 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-028ddb46-c27a-4af1-83ea-f1dbfe9a49e3 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.737012 Oct 29 02:55:18.438562 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1249/2558] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:55:17 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:18.445484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:18.447414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] [instance: aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:18.458410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] validate_networks() for [('0ef24500-837e-47a7-9e10-a72e3fb043af', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:55:18.463677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:18.465619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:18.466307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.467203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:18.468611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:18.472264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.498816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:18.508235 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] HTTP exception thrown: Instance aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab could not be found. Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Request method failure captured: Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab HTTP/1.1 Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJW5akA7YY_p003NpCyiU0O-jTcC2O8-vkJbzgKPs3BkwA6TIx1_uSPFD1V-ed1fUd6K92WR4ooaFJEuF_pDMd62pY86ecRZtMYZ3aCEI9cq6UsS_JOQZmQTYZEBC6Qa5hsyc-XIyUz-80j2yQqFQIjeB2h_NPtIm5KDB6YMTbzkTXU Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 87111b9e962d4606a29bc7ad37b8d484 Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestManualDisk-1143379437 Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87111b9e962d4606a29bc7ad37b8d484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87111b9e962d4606a29bc7ad37b8d484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87111b9e962d4606a29bc7ad37b8d484", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87111b9e962d4606a29bc7ad37b8d484"}]}] Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestManualDisk-1143379437 Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 87111b9e962d4606a29bc7ad37b8d484 Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestManualDisk-1143379437 Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestManualDisk-1143379437-project Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 2bccf42abb184f15ae36a855e0d8e68f Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestManualDisk-1143379437-project Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab could not be found. Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab'} Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab could not be found. Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab could not be found. Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:18.510627 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:18.515816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:18.515816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:18.515816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:18.515816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:18.515816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:18.515816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab could not be found. Oct 29 02:55:18.515816 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:18.516746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Returning 404 to user: Instance aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:18.519815 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8eb32269-f034-4b24-b553-b9015ad6ce80 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab" status: 404 len: 111 microversion: 2.1 time: 0.079434 Oct 29 02:55:18.520449 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1250/2559] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:18 2022] GET /compute/v2.1/servers/aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:18.533795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-32e1d56a-35e0-4b20-a7af-297883f4c1d1 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1a86dd0d0>, body: {"security_group_rule": {"parent_group_id": "7b1b6450-b6a4-49f7-b4f2-4a14b07d88ae", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:18.635923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:18.826001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:19.121404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:55:19.122085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:55:19.122742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:55:19.123971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:55:19.124542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:55:19.136158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:19.137101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:19.137676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:19.138580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:19.139586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:19.140277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:19.163736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:19.173503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for user 0868f50723074f2b98f7b1096743f3cc and project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:19.189028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:55:19.191615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:55:19.251965 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6e2f65d5-d51e-4175-a67e-9428c2ae076c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910508 Oct 29 02:55:19.259675 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1310/2560] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:55:19.267801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0643e444-383f-43a6-8137-2d320e1985fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:19.268463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0643e444-383f-43a6-8137-2d320e1985fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:19.277335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0643e444-383f-43a6-8137-2d320e1985fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:19.277937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0643e444-383f-43a6-8137-2d320e1985fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:19.278407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0643e444-383f-43a6-8137-2d320e1985fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:19.279208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0643e444-383f-43a6-8137-2d320e1985fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:19.282467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0643e444-383f-43a6-8137-2d320e1985fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:19.283190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0643e444-383f-43a6-8137-2d320e1985fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:19.454886 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-32e1d56a-35e0-4b20-a7af-297883f4c1d1 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.933246 Oct 29 02:55:19.455844 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1251/2561] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:55:18 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:19.461873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-75feb8f7-9a54-4a91-b4dc-10fc1a28af24 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] Calling method '.version_select at 0x7fe1a8c224c0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:19.558943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-75feb8f7-9a54-4a91-b4dc-10fc1a28af24 tempest-ServersTestManualDisk-1143379437 tempest-ServersTestManualDisk-1143379437-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820252728" status: 202 len: 0 microversion: 2.1 time: 0.101569 Oct 29 02:55:19.559547 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1252/2562] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 02:55:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820252728 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:19.570784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0643e444-383f-43a6-8137-2d320e1985fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:19.587612 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0643e444-383f-43a6-8137-2d320e1985fa tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.326679 Oct 29 02:55:19.588606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-149e0ea2-16a8-444c-9de3-f9683d9b34b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:19.589235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-149e0ea2-16a8-444c-9de3-f9683d9b34b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:19.593521 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1311/2563] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:19 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:19.599286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-80dedb0c-fdcf-4103-b3f9-8b5148109d50 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:19.600230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-80dedb0c-fdcf-4103-b3f9-8b5148109d50 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:19.610568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-149e0ea2-16a8-444c-9de3-f9683d9b34b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:19.611057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-149e0ea2-16a8-444c-9de3-f9683d9b34b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:19.611495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-149e0ea2-16a8-444c-9de3-f9683d9b34b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:19.612250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-149e0ea2-16a8-444c-9de3-f9683d9b34b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:19.612702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-149e0ea2-16a8-444c-9de3-f9683d9b34b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:19.613119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-149e0ea2-16a8-444c-9de3-f9683d9b34b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:19.693796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-80dedb0c-fdcf-4103-b3f9-8b5148109d50 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:19.708685 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-80dedb0c-fdcf-4103-b3f9-8b5148109d50 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 200 len: 1208 microversion: 2.1 time: 0.113794 Oct 29 02:55:19.721829 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1312/2564] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:19 2022] GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 1208 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:19.721829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:19.721829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:19.727205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:19.727801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:19.728340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:19.729154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:19.729910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:19.730636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:19.764258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:19.926211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:19.938959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:19.940530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:19.941909 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2184bba9-30ae-43e2-ac5a-d03c9f764da2 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1549 microversion: 2.25 time: 0.230163 Oct 29 02:55:19.942869 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1313/2565] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:19 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1549 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:19.949128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-20f99d65-6458-4e32-a39c-fff2b8feea55 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1a8679ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-619365422", "description": "tempest-description-798597318"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:20.315075 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-20f99d65-6458-4e32-a39c-fff2b8feea55 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.370285 Oct 29 02:55:20.315686 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1314/2566] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:55:19 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:20.331544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-613ae57c-7307-47ab-b298-416722ed5c59 req-e9269759-f0ec-4303-8859-d7775a760239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab", "name": "network-vif-deleted", "tag": "865810e5-9544-4851-8631-350a7fd73c5f"}, {"name": "network-changed", "server_uuid": "5c0253f5-cea4-471a-97d6-16c7702c07ee", "tag": "95d5adb4-6512-4e6f-9edb-c3dd7ee44c98"}, {"name": "network-changed", "server_uuid": "59fa09ed-b246-47b4-91a8-408031ac5835", "tag": "5f23facb-f546-40f2-9a96-6d9396227f83"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:20.387258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-613ae57c-7307-47ab-b298-416722ed5c59 req-e9269759-f0ec-4303-8859-d7775a760239 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:20.387783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-613ae57c-7307-47ab-b298-416722ed5c59 req-e9269759-f0ec-4303-8859-d7775a760239 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:20.390446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-613ae57c-7307-47ab-b298-416722ed5c59 req-e9269759-f0ec-4303-8859-d7775a760239 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:20.416493 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-613ae57c-7307-47ab-b298-416722ed5c59 req-e9269759-f0ec-4303-8859-d7775a760239 service nova] Creating event network-vif-deleted:865810e5-9544-4851-8631-350a7fd73c5f for instance aedb7f3b-7ff5-4cb2-bdc3-9fba331eeeab on n-h2-862964-4 Oct 29 02:55:20.430024 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-613ae57c-7307-47ab-b298-416722ed5c59 req-e9269759-f0ec-4303-8859-d7775a760239 service nova] Creating event network-changed:95d5adb4-6512-4e6f-9edb-c3dd7ee44c98 for instance 5c0253f5-cea4-471a-97d6-16c7702c07ee on n-h1-862964-4 Oct 29 02:55:20.430721 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-613ae57c-7307-47ab-b298-416722ed5c59 req-e9269759-f0ec-4303-8859-d7775a760239 service nova] Creating event network-changed:5f23facb-f546-40f2-9a96-6d9396227f83 for instance 59fa09ed-b246-47b4-91a8-408031ac5835 on n-h2-862964-4 Oct 29 02:55:20.446659 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-613ae57c-7307-47ab-b298-416722ed5c59 req-e9269759-f0ec-4303-8859-d7775a760239 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.129456 Oct 29 02:55:20.447630 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1315/2567] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:20.455570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-313aa256-a96f-484f-87db-df2034f8a47d tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1acc435e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-62143198", "description": "tempest-description-685376132"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:20.734977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-149e0ea2-16a8-444c-9de3-f9683d9b34b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:20.750157 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-149e0ea2-16a8-444c-9de3-f9683d9b34b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1315 microversion: 2.1 time: 1.182680 Oct 29 02:55:20.751809 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1253/2568] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:19 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1315 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:20.757129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82e62b58-8c12-48eb-9ca4-0127819de529 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:20.757955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-82e62b58-8c12-48eb-9ca4-0127819de529 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:20.765421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e62b58-8c12-48eb-9ca4-0127819de529 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:20.766314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e62b58-8c12-48eb-9ca4-0127819de529 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:20.766977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e62b58-8c12-48eb-9ca4-0127819de529 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:20.767902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e62b58-8c12-48eb-9ca4-0127819de529 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:20.768505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e62b58-8c12-48eb-9ca4-0127819de529 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:20.769075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e62b58-8c12-48eb-9ca4-0127819de529 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:20.940402 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-313aa256-a96f-484f-87db-df2034f8a47d tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.491302 Oct 29 02:55:20.941499 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1316/2569] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:55:20 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:20.946486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-610c2dba-8b4d-4893-8baa-e912c6a6b9eb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:20.947639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-610c2dba-8b4d-4893-8baa-e912c6a6b9eb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:20.963629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-610c2dba-8b4d-4893-8baa-e912c6a6b9eb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:20.964556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-610c2dba-8b4d-4893-8baa-e912c6a6b9eb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:20.965156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-610c2dba-8b4d-4893-8baa-e912c6a6b9eb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:20.966948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-610c2dba-8b4d-4893-8baa-e912c6a6b9eb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:20.968261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-610c2dba-8b4d-4893-8baa-e912c6a6b9eb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:20.971303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-610c2dba-8b4d-4893-8baa-e912c6a6b9eb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:21.113770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-610c2dba-8b4d-4893-8baa-e912c6a6b9eb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:21.124477 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-610c2dba-8b4d-4893-8baa-e912c6a6b9eb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 200 len: 1260 microversion: 2.1 time: 0.181533 Oct 29 02:55:21.126448 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1317/2570] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:20 2022] GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:21.142182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f23bbde7-3b29-4c4d-86cd-074ebe223115 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1acc439d0>, body: {"security_group_rule": {"parent_group_id": "e1cf2a68-605c-4574-be78-429f9a4c0610", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "f733a5de-baf4-45a0-987e-001f114259e5"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:21.368356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-82e62b58-8c12-48eb-9ca4-0127819de529 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:21.394173 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-82e62b58-8c12-48eb-9ca4-0127819de529 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.638924 Oct 29 02:55:21.396479 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1254/2571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:20 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:21.406172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:21.407058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:21.414734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:21.415586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:21.416195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:21.417087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:21.417689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:21.418274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:21.430013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:21.472708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:21.473597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:21.475250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:21.477789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lazy-loading 'fault' on Instance uuid a6d4d5fa-ae6a-43c5-970e-a6ab2610133d {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:55:21.660274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:21.669691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:21.671899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:21.698051 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fe69b6a7-95cb-49a2-bfa2-071102a822d3 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1352 microversion: 2.25 time: 0.297053 Oct 29 02:55:21.698970 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1255/2572] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:21 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1352 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:21.780633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fe484aa0-9e20-483e-b99c-69dba244f911 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:21.783402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fe484aa0-9e20-483e-b99c-69dba244f911 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:21.790625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe484aa0-9e20-483e-b99c-69dba244f911 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:21.791379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe484aa0-9e20-483e-b99c-69dba244f911 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:21.792015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe484aa0-9e20-483e-b99c-69dba244f911 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:21.792924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe484aa0-9e20-483e-b99c-69dba244f911 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:21.793557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe484aa0-9e20-483e-b99c-69dba244f911 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:21.794203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe484aa0-9e20-483e-b99c-69dba244f911 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.075219 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f23bbde7-3b29-4c4d-86cd-074ebe223115 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.947266 Oct 29 02:55:22.076021 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1318/2573] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:55:21 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:22.089992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac265cbb-75cb-4a8c-bac0-446bf07e5f9d tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1a8679d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-677390408", "description": "tempest-description-526599635"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:22.255716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fe484aa0-9e20-483e-b99c-69dba244f911 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:22.268126 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fe484aa0-9e20-483e-b99c-69dba244f911 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1315 microversion: 2.1 time: 0.493771 Oct 29 02:55:22.286891 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1256/2574] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:21 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:22.296778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7787089f-a01e-4758-80bc-242a7ef96e01 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:22.297881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7787089f-a01e-4758-80bc-242a7ef96e01 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:22.307962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7787089f-a01e-4758-80bc-242a7ef96e01 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.308684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7787089f-a01e-4758-80bc-242a7ef96e01 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.309411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7787089f-a01e-4758-80bc-242a7ef96e01 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.310345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7787089f-a01e-4758-80bc-242a7ef96e01 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.311015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7787089f-a01e-4758-80bc-242a7ef96e01 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.311687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7787089f-a01e-4758-80bc-242a7ef96e01 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.447227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7787089f-a01e-4758-80bc-242a7ef96e01 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:22.456604 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7787089f-a01e-4758-80bc-242a7ef96e01 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 200 len: 1266 microversion: 2.1 time: 0.167229 Oct 29 02:55:22.465882 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1257/2575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:22 2022] GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:22.465882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3934d58c-f9b0-42de-b11c-9ed0bbaa7ab3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:22.467060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3934d58c-f9b0-42de-b11c-9ed0bbaa7ab3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:22.482375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3934d58c-f9b0-42de-b11c-9ed0bbaa7ab3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.486802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3934d58c-f9b0-42de-b11c-9ed0bbaa7ab3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.487439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3934d58c-f9b0-42de-b11c-9ed0bbaa7ab3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.488991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3934d58c-f9b0-42de-b11c-9ed0bbaa7ab3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.491207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3934d58c-f9b0-42de-b11c-9ed0bbaa7ab3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.492128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3934d58c-f9b0-42de-b11c-9ed0bbaa7ab3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.846418 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac265cbb-75cb-4a8c-bac0-446bf07e5f9d tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.760575 Oct 29 02:55:22.847138 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1319/2576] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:55:22 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:55:22.851960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d321a835-6658-42cb-9e4e-1a96a935f2c7 req-e7fb49ef-3611-4bce-a9b5-85b44762f63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d4d5fa-ae6a-43c5-970e-a6ab2610133d", "name": "network-vif-deleted", "tag": "8588516f-6e55-45e6-a304-2834e66e1413"}, {"server_uuid": "26e07792-807a-44e9-b644-72504509f2f5", "name": "network-vif-deleted", "tag": "8a4b46d3-0738-4cd4-a78e-25f2da119a4e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:22.876175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3934d58c-f9b0-42de-b11c-9ed0bbaa7ab3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:22.881947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d321a835-6658-42cb-9e4e-1a96a935f2c7 req-e7fb49ef-3611-4bce-a9b5-85b44762f63d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.884884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d321a835-6658-42cb-9e4e-1a96a935f2c7 req-e7fb49ef-3611-4bce-a9b5-85b44762f63d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.885493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d321a835-6658-42cb-9e4e-1a96a935f2c7 req-e7fb49ef-3611-4bce-a9b5-85b44762f63d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.907679 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3934d58c-f9b0-42de-b11c-9ed0bbaa7ab3 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.439304 Oct 29 02:55:22.911756 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1258/2577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:22 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:22.926087 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d321a835-6658-42cb-9e4e-1a96a935f2c7 req-e7fb49ef-3611-4bce-a9b5-85b44762f63d service nova] Creating event network-vif-deleted:8588516f-6e55-45e6-a304-2834e66e1413 for instance a6d4d5fa-ae6a-43c5-970e-a6ab2610133d on n-h1-862964-4 Oct 29 02:55:22.927083 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d321a835-6658-42cb-9e4e-1a96a935f2c7 req-e7fb49ef-3611-4bce-a9b5-85b44762f63d service nova] Creating event network-vif-deleted:8a4b46d3-0738-4cd4-a78e-25f2da119a4e for instance 26e07792-807a-44e9-b644-72504509f2f5 on n-h2-862964-4 Oct 29 02:55:22.942622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:22.943788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:22.956301 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d321a835-6658-42cb-9e4e-1a96a935f2c7 req-e7fb49ef-3611-4bce-a9b5-85b44762f63d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.107822 Oct 29 02:55:22.965519 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1320/2578] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:22.976340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-52a2fd6c-4a9e-4e09-a366-7cb7c8116020 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1a86fed30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1373415292", "description": "tempest-description-383831262"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:22.979516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.983368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.983830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.984582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.985043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.985468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:23.182982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:23.186638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:23.190710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:23.191342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lazy-loading 'fault' on Instance uuid a6d4d5fa-ae6a-43c5-970e-a6ab2610133d {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:55:23.350216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:23.364959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:23.367190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:23.373059 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-084fcf74-4757-4fdf-abf4-9c100c7bd35b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 200 len: 1352 microversion: 2.25 time: 0.453841 Oct 29 02:55:23.374209 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1259/2579] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:22 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 1352 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:23.380951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-499b2812-8302-4187-bef9-91a4d1d5126a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:23.381888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-499b2812-8302-4187-bef9-91a4d1d5126a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:23.390302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499b2812-8302-4187-bef9-91a4d1d5126a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:23.390792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499b2812-8302-4187-bef9-91a4d1d5126a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:23.403802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499b2812-8302-4187-bef9-91a4d1d5126a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:23.404528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499b2812-8302-4187-bef9-91a4d1d5126a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:23.405626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499b2812-8302-4187-bef9-91a4d1d5126a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:23.411461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499b2812-8302-4187-bef9-91a4d1d5126a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:23.866614 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-52a2fd6c-4a9e-4e09-a366-7cb7c8116020 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.896883 Oct 29 02:55:23.867424 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1321/2580] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:55:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:23.885412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0142688a-da94-4458-8238-d88229ca2777 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:23.887154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0142688a-da94-4458-8238-d88229ca2777 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:23.916753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0142688a-da94-4458-8238-d88229ca2777 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:23.918983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0142688a-da94-4458-8238-d88229ca2777 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:23.920756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0142688a-da94-4458-8238-d88229ca2777 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:23.923229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0142688a-da94-4458-8238-d88229ca2777 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:23.925201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0142688a-da94-4458-8238-d88229ca2777 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:23.926675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0142688a-da94-4458-8238-d88229ca2777 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:24.011203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0142688a-da94-4458-8238-d88229ca2777 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:24.020422 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0142688a-da94-4458-8238-d88229ca2777 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 200 len: 1266 microversion: 2.1 time: 0.150389 Oct 29 02:55:24.022183 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1322/2581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:23 2022] GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:24.044571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d1973d6b-e57e-4591-a1a3-3675f21b6d53 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1a87cd9d0>, body: {"security_group_rule": {"parent_group_id": "30c1df74-d02f-4142-968b-291cc67ed92a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "25544d5d-d78e-4d73-9156-024228d92cd4"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:24.292783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-499b2812-8302-4187-bef9-91a4d1d5126a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:24.308307 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-499b2812-8302-4187-bef9-91a4d1d5126a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1315 microversion: 2.1 time: 0.932803 Oct 29 02:55:24.315551 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1260/2582] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:23 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1315 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:24.333190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b9a320f-c313-4d8c-9b4c-4389e1f075b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:24.334836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3b9a320f-c313-4d8c-9b4c-4389e1f075b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:24.348892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b9a320f-c313-4d8c-9b4c-4389e1f075b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:24.349386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b9a320f-c313-4d8c-9b4c-4389e1f075b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:24.349835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b9a320f-c313-4d8c-9b4c-4389e1f075b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:24.350550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b9a320f-c313-4d8c-9b4c-4389e1f075b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:24.350996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b9a320f-c313-4d8c-9b4c-4389e1f075b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:24.355614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b9a320f-c313-4d8c-9b4c-4389e1f075b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:24.959601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b9a320f-c313-4d8c-9b4c-4389e1f075b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:24.976122 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3b9a320f-c313-4d8c-9b4c-4389e1f075b2 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.655986 Oct 29 02:55:24.977693 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1261/2583] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:24 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:24.978299 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d1973d6b-e57e-4591-a1a3-3675f21b6d53 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.954193 Oct 29 02:55:24.978895 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1323/2584] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:55:24 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:24.991042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:24.991984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: a6d4d5fa-ae6a-43c5-970e-a6ab2610133d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:25.001021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:25.003228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:25.003866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:25.006316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:25.006971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:25.009868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:25.016171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-05d26268-6a51-4b9a-9de4-821b74b7e63a tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Calling method '.version_select at 0x7fe1a88f40d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:25.043834 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] HTTP exception thrown: Instance a6d4d5fa-ae6a-43c5-970e-a6ab2610133d could not be found. Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Request method failure captured: Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d HTTP/1.1 Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQuccPsSxpEQcD2tjrWhykr3SJ_3P29lS31n5eNXssW4WXG0XOTjhxbCShrHaXna_t_vldyKx-vpE-HAQvpnmh2Vn9lq73PhGlwLyH56ar0kN7N0dwVSRtdPk48J6HFJWP0eYqbjMnfXbhjn5C4ycpyD4CECFllRO4l_ch-L8eoy5Y Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 60896479fb0c4357ad5fb03016470283 Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/60896479fb0c4357ad5fb03016470283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60896479fb0c4357ad5fb03016470283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_60896479fb0c4357ad5fb03016470283", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60896479fb0c4357ad5fb03016470283"}]}] Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 60896479fb0c4357ad5fb03016470283 Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-LiveAutoBlockMigrationV225Test-1573949452-project Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: f0ea28d9bb3544bca1a3c90d983fe8e4 Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452-project Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance a6d4d5fa-ae6a-43c5-970e-a6ab2610133d could not be found. Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'a6d4d5fa-ae6a-43c5-970e-a6ab2610133d'} Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d4d5fa-ae6a-43c5-970e-a6ab2610133d could not be found. Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d4d5fa-ae6a-43c5-970e-a6ab2610133d could not be found. Oct 29 02:55:25.046312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:25.050371 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:25.050371 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:25.050371 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:25.050371 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:25.050371 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:25.050371 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:25.050371 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:25.050371 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d4d5fa-ae6a-43c5-970e-a6ab2610133d could not be found. Oct 29 02:55:25.050371 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:25.051552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Returning 404 to user: Instance a6d4d5fa-ae6a-43c5-970e-a6ab2610133d could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:25.055326 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a5362f53-9a5f-4266-8214-799e94b4751b tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d" status: 404 len: 111 microversion: 2.25 time: 0.072143 Oct 29 02:55:25.055817 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1324/2585] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:24 2022] GET /compute/v2.1/servers/a6d4d5fa-ae6a-43c5-970e-a6ab2610133d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:25.065244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-12369e0e-99fb-46e2-becc-e2a66d342986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:25.069473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-12369e0e-99fb-46e2-becc-e2a66d342986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:25.091967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12369e0e-99fb-46e2-becc-e2a66d342986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:25.092833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12369e0e-99fb-46e2-becc-e2a66d342986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:25.093362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12369e0e-99fb-46e2-becc-e2a66d342986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:25.094116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12369e0e-99fb-46e2-becc-e2a66d342986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:25.094572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12369e0e-99fb-46e2-becc-e2a66d342986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:25.095005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12369e0e-99fb-46e2-becc-e2a66d342986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:25.522295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-12369e0e-99fb-46e2-becc-e2a66d342986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:25.553741 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-12369e0e-99fb-46e2-becc-e2a66d342986 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 200 len: 1308 microversion: 2.1 time: 0.495664 Oct 29 02:55:25.572129 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1325/2586] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:25 2022] GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 1308 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:25.591122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4461f956-f10b-42bd-93fe-e2b7dafe01e7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:25.591812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4461f956-f10b-42bd-93fe-e2b7dafe01e7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:25.601796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4461f956-f10b-42bd-93fe-e2b7dafe01e7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:25.608861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4461f956-f10b-42bd-93fe-e2b7dafe01e7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:25.609467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4461f956-f10b-42bd-93fe-e2b7dafe01e7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:25.610842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4461f956-f10b-42bd-93fe-e2b7dafe01e7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:25.611424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4461f956-f10b-42bd-93fe-e2b7dafe01e7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:25.611991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4461f956-f10b-42bd-93fe-e2b7dafe01e7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:25.674744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4461f956-f10b-42bd-93fe-e2b7dafe01e7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:25.862538 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4461f956-f10b-42bd-93fe-e2b7dafe01e7 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 204 len: 0 microversion: 2.25 time: 0.286941 Oct 29 02:55:25.863548 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1326/2587] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:55:25 2022] DELETE /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:55:25.875428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8708095-288e-4c87-ab6b-9b321563a711 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:25.876382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8708095-288e-4c87-ab6b-9b321563a711 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:25.894290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8708095-288e-4c87-ab6b-9b321563a711 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:25.894694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8708095-288e-4c87-ab6b-9b321563a711 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:25.895121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8708095-288e-4c87-ab6b-9b321563a711 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:25.895830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8708095-288e-4c87-ab6b-9b321563a711 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:25.896276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8708095-288e-4c87-ab6b-9b321563a711 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:25.896693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8708095-288e-4c87-ab6b-9b321563a711 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:26.015990 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-05d26268-6a51-4b9a-9de4-821b74b7e63a tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/25544d5d-d78e-4d73-9156-024228d92cd4" status: 202 len: 0 microversion: 2.1 time: 1.028036 Oct 29 02:55:26.018127 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1262/2588] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:24 2022] DELETE /compute/v2.1/os-security-groups/25544d5d-d78e-4d73-9156-024228d92cd4 => generated 0 bytes in 1031 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:26.024706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:26.025905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:26.042794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:26.043300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:26.043745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:26.044448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:26.044973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:26.045744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:26.628067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:26.648495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:26.657600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:26.663607 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4331ad9b-0381-42d7-9794-9d7791508bde tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1563 microversion: 2.25 time: 0.644239 Oct 29 02:55:26.687471 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1263/2589] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:26 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1563 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:26.696367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d456d6c-4585-40c5-b287-15197f5754be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:26.699473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d456d6c-4585-40c5-b287-15197f5754be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:26.717479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d456d6c-4585-40c5-b287-15197f5754be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:26.720447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d456d6c-4585-40c5-b287-15197f5754be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:26.721096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d456d6c-4585-40c5-b287-15197f5754be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:26.722766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d456d6c-4585-40c5-b287-15197f5754be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:26.725694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d456d6c-4585-40c5-b287-15197f5754be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:26.726392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d456d6c-4585-40c5-b287-15197f5754be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:26.750391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8708095-288e-4c87-ab6b-9b321563a711 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:26.771073 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8708095-288e-4c87-ab6b-9b321563a711 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1315 microversion: 2.1 time: 0.905765 Oct 29 02:55:26.793975 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1327/2590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:25 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1315 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:26.805461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-33419f65-2834-40b8-be14-572c767d1600 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Calling method '.version_select at 0x7fe1acca2b80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:27.048841 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-33419f65-2834-40b8-be14-572c767d1600 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/30c1df74-d02f-4142-968b-291cc67ed92a" status: 200 len: 246 microversion: 2.1 time: 0.253230 Oct 29 02:55:27.049982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1328/2591] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:55:26 2022] GET /compute/v2.1/os-security-groups/30c1df74-d02f-4142-968b-291cc67ed92a => generated 246 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:27.058909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8ebce0ba-a507-4c0b-874f-220db2132250 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:27.064925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8ebce0ba-a507-4c0b-874f-220db2132250 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:27.079284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebce0ba-a507-4c0b-874f-220db2132250 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:27.079975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebce0ba-a507-4c0b-874f-220db2132250 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:27.080620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebce0ba-a507-4c0b-874f-220db2132250 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:27.081788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebce0ba-a507-4c0b-874f-220db2132250 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:27.083020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebce0ba-a507-4c0b-874f-220db2132250 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:27.084074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebce0ba-a507-4c0b-874f-220db2132250 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:27.205756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d456d6c-4585-40c5-b287-15197f5754be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:27.219552 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d456d6c-4585-40c5-b287-15197f5754be tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.530435 Oct 29 02:55:27.226029 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1264/2592] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:26 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:27.233761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-82f88879-5dde-481a-bf01-9bc35946a8b6 req-ff35e290-a310-43c9-8651-73f242746519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d", "tag": "5fdf8084-8c8b-4cd7-a958-0335d3697a1c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:27.262859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-82f88879-5dde-481a-bf01-9bc35946a8b6 req-ff35e290-a310-43c9-8651-73f242746519 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:27.263852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-82f88879-5dde-481a-bf01-9bc35946a8b6 req-ff35e290-a310-43c9-8651-73f242746519 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:27.264889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-82f88879-5dde-481a-bf01-9bc35946a8b6 req-ff35e290-a310-43c9-8651-73f242746519 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:27.310649 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-82f88879-5dde-481a-bf01-9bc35946a8b6 req-ff35e290-a310-43c9-8651-73f242746519 service nova] Creating event network-changed:5fdf8084-8c8b-4cd7-a958-0335d3697a1c for instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d on n-h1-862964-4 Oct 29 02:55:27.317741 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-82f88879-5dde-481a-bf01-9bc35946a8b6 req-ff35e290-a310-43c9-8651-73f242746519 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089799 Oct 29 02:55:27.319838 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1265/2593] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:27.334692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8e0f8c11-a62e-44da-8e1a-7945834def4a tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1a8bd1c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-108246180", "description": "tempest-description-1898075434"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:27.672006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8ebce0ba-a507-4c0b-874f-220db2132250 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:27.693851 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8ebce0ba-a507-4c0b-874f-220db2132250 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 200 len: 1308 microversion: 2.1 time: 0.636731 Oct 29 02:55:27.702127 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1329/2594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:27 2022] GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 1308 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:27.708360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:27.713390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:27.725654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:27.732110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:27.733063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:27.734019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:27.734642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:27.740229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:27.963383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:27.998267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:28.001230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0ea28d9bb3544bca1a3c90d983fe8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60896479fb0c4357ad5fb03016470283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:28.002999 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8e5317b3-7beb-494f-a84f-b4167199e806 tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 200 len: 1521 microversion: 2.25 time: 0.299426 Oct 29 02:55:28.038354 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1330/2595] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:27 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:28.052323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1979ad8b-cc6e-4253-93e6-f4f6451ce5e5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:28.060159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1979ad8b-cc6e-4253-93e6-f4f6451ce5e5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:28.080748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1979ad8b-cc6e-4253-93e6-f4f6451ce5e5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:28.081663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1979ad8b-cc6e-4253-93e6-f4f6451ce5e5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:28.083568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1979ad8b-cc6e-4253-93e6-f4f6451ce5e5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:28.086238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1979ad8b-cc6e-4253-93e6-f4f6451ce5e5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:28.087705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1979ad8b-cc6e-4253-93e6-f4f6451ce5e5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:28.090800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1979ad8b-cc6e-4253-93e6-f4f6451ce5e5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:28.098843 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8e0f8c11-a62e-44da-8e1a-7945834def4a tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.777467 Oct 29 02:55:28.099900 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1266/2596] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:55:27 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:28.107553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-43c377fa-6f89-47aa-bf60-6ee6ff3b35bc req-d57c49fc-3044-4359-9da0-4132a254848a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fa09ed-b246-47b4-91a8-408031ac5835", "name": "network-vif-plugged", "status": "completed", "tag": "5f23facb-f546-40f2-9a96-6d9396227f83"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:28.154421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-43c377fa-6f89-47aa-bf60-6ee6ff3b35bc req-d57c49fc-3044-4359-9da0-4132a254848a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:28.167936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-43c377fa-6f89-47aa-bf60-6ee6ff3b35bc req-d57c49fc-3044-4359-9da0-4132a254848a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:28.168399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-43c377fa-6f89-47aa-bf60-6ee6ff3b35bc req-d57c49fc-3044-4359-9da0-4132a254848a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:28.196361 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-43c377fa-6f89-47aa-bf60-6ee6ff3b35bc req-d57c49fc-3044-4359-9da0-4132a254848a service nova] Creating event network-vif-plugged:5f23facb-f546-40f2-9a96-6d9396227f83 for instance 59fa09ed-b246-47b4-91a8-408031ac5835 on n-h2-862964-4 Oct 29 02:55:28.209268 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-43c377fa-6f89-47aa-bf60-6ee6ff3b35bc req-d57c49fc-3044-4359-9da0-4132a254848a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107555 Oct 29 02:55:28.214804 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1267/2597] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:28.256888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-00f05b3c-4f29-4292-ac49-f13e32fcd03d tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1a8ac1310>, body: {"security_group_rule": {"parent_group_id": "7aa637c9-f937-4146-bc7e-b029a878f96e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:28.550136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1979ad8b-cc6e-4253-93e6-f4f6451ce5e5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:28.560279 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1979ad8b-cc6e-4253-93e6-f4f6451ce5e5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1315 microversion: 2.1 time: 0.520152 Oct 29 02:55:28.561152 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1331/2598] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:28 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:28.570441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-465c1244-6807-41db-9add-db49757ff632 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:28.571177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-465c1244-6807-41db-9add-db49757ff632 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:28.579450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465c1244-6807-41db-9add-db49757ff632 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:28.579945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465c1244-6807-41db-9add-db49757ff632 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:28.580379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465c1244-6807-41db-9add-db49757ff632 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:28.581228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465c1244-6807-41db-9add-db49757ff632 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:28.581892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465c1244-6807-41db-9add-db49757ff632 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:28.582644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465c1244-6807-41db-9add-db49757ff632 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:28.678445 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-00f05b3c-4f29-4292-ac49-f13e32fcd03d tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.462039 Oct 29 02:55:28.680515 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1268/2599] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:55:28 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:28.699081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:28.700699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:28.709205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:28.710192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:28.710971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:28.711932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:28.712368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:28.713157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:28.926089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-465c1244-6807-41db-9add-db49757ff632 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:28.938078 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-465c1244-6807-41db-9add-db49757ff632 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.375585 Oct 29 02:55:28.940102 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1332/2600] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:28 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:28.945462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5b76fb96-7056-4084-81be-75215df0d63f tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Action: 'create', calling method: .version_select at 0x7fe1a8679280>, body: {"security_group_rule": {"parent_group_id": "7aa637c9-f937-4146-bc7e-b029a878f96e", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:29.103896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:29.113859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:29.115296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:29.116540 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f99042b4-5c93-48a7-b29f-1dbfd4f0ddbc tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2943 microversion: 2.32 time: 0.434722 Oct 29 02:55:29.117113 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1269/2601] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:28 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2943 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:29.122019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2e9a9258-1174-48dc-98dd-431129c61ba3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:29.122941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2e9a9258-1174-48dc-98dd-431129c61ba3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:29.130283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e9a9258-1174-48dc-98dd-431129c61ba3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.130917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e9a9258-1174-48dc-98dd-431129c61ba3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.131350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e9a9258-1174-48dc-98dd-431129c61ba3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.132204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e9a9258-1174-48dc-98dd-431129c61ba3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.132670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e9a9258-1174-48dc-98dd-431129c61ba3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.133377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e9a9258-1174-48dc-98dd-431129c61ba3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.151358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:29.514119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2e9a9258-1174-48dc-98dd-431129c61ba3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:29.526227 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2e9a9258-1174-48dc-98dd-431129c61ba3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 200 len: 1308 microversion: 2.1 time: 0.407946 Oct 29 02:55:29.526866 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1270/2602] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:29 2022] GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:29.543753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:29.544796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] [instance: 981cdc70-e4e6-4431-a243-068d39d4160d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:29.568367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.569687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.570817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.572495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.574460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.575131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.587053 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5b76fb96-7056-4084-81be-75215df0d63f tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.644803 Oct 29 02:55:29.587699 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1333/2603] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Oct 29 02:55:28 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:29.602688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b12a02a6-c405-4290-aaea-fce5180c654e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:29.603447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b12a02a6-c405-4290-aaea-fce5180c654e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:29.603647 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] HTTP exception thrown: Instance 981cdc70-e4e6-4431-a243-068d39d4160d could not be found. Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Request method failure captured: Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d HTTP/1.1 Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQuccPsSxpEQcD2tjrWhykr3SJ_3P29lS31n5eNXssW4WXG0XOTjhxbCShrHaXna_t_vldyKx-vpE-HAQvpnmh2Vn9lq73PhGlwLyH56ar0kN7N0dwVSRtdPk48J6HFJWP0eYqbjMnfXbhjn5C4ycpyD4CECFllRO4l_ch-L8eoy5Y Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 60896479fb0c4357ad5fb03016470283 Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/60896479fb0c4357ad5fb03016470283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60896479fb0c4357ad5fb03016470283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_60896479fb0c4357ad5fb03016470283", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/60896479fb0c4357ad5fb03016470283"}]}] Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 60896479fb0c4357ad5fb03016470283 Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452 Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-LiveAutoBlockMigrationV225Test-1573949452-project Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f0ea28d9bb3544bca1a3c90d983fe8e4 Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1573949452-project Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 981cdc70-e4e6-4431-a243-068d39d4160d could not be found. Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '981cdc70-e4e6-4431-a243-068d39d4160d'} Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981cdc70-e4e6-4431-a243-068d39d4160d could not be found. Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981cdc70-e4e6-4431-a243-068d39d4160d could not be found. Oct 29 02:55:29.606190 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:29.610448 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:29.610448 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:29.610448 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:29.610448 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:29.610448 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:29.610448 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:29.610448 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:29.610448 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981cdc70-e4e6-4431-a243-068d39d4160d could not be found. Oct 29 02:55:29.610448 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:29.611370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] Returning 404 to user: Instance 981cdc70-e4e6-4431-a243-068d39d4160d could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:29.612513 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dcf6de6d-5cdd-409c-b1e1-e26a416d807a tempest-LiveAutoBlockMigrationV225Test-1573949452 tempest-LiveAutoBlockMigrationV225Test-1573949452-project] 10.222.0.16 "GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d" status: 404 len: 111 microversion: 2.25 time: 0.084502 Oct 29 02:55:29.614527 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1271/2604] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:29 2022] GET /compute/v2.1/servers/981cdc70-e4e6-4431-a243-068d39d4160d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:29.622180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-774b239a-4564-43a6-9709-b801980580e4 req-48eaf636-84d2-4bdd-a809-ae48d736d492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981cdc70-e4e6-4431-a243-068d39d4160d", "name": "network-vif-deleted", "tag": "1861c328-f726-4893-80d7-4debdd4d709b"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:29.629559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12a02a6-c405-4290-aaea-fce5180c654e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.630281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12a02a6-c405-4290-aaea-fce5180c654e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.630958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12a02a6-c405-4290-aaea-fce5180c654e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.631868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12a02a6-c405-4290-aaea-fce5180c654e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.632316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12a02a6-c405-4290-aaea-fce5180c654e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.632722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12a02a6-c405-4290-aaea-fce5180c654e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.643244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-774b239a-4564-43a6-9709-b801980580e4 req-48eaf636-84d2-4bdd-a809-ae48d736d492 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.644168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-774b239a-4564-43a6-9709-b801980580e4 req-48eaf636-84d2-4bdd-a809-ae48d736d492 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.645138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-774b239a-4564-43a6-9709-b801980580e4 req-48eaf636-84d2-4bdd-a809-ae48d736d492 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.666227 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-774b239a-4564-43a6-9709-b801980580e4 req-48eaf636-84d2-4bdd-a809-ae48d736d492 service nova] Creating event network-vif-deleted:1861c328-f726-4893-80d7-4debdd4d709b for instance 981cdc70-e4e6-4431-a243-068d39d4160d on n-h2-862964-4 Oct 29 02:55:29.684607 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-774b239a-4564-43a6-9709-b801980580e4 req-48eaf636-84d2-4bdd-a809-ae48d736d492 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067607 Oct 29 02:55:29.692064 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1272/2605] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:29.702104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:29.711234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6da085ea-b062-43b5-abad-3abc712631df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:29.712838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6da085ea-b062-43b5-abad-3abc712631df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:29.737417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6da085ea-b062-43b5-abad-3abc712631df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.738328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6da085ea-b062-43b5-abad-3abc712631df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.739029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6da085ea-b062-43b5-abad-3abc712631df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.739983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6da085ea-b062-43b5-abad-3abc712631df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.741366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6da085ea-b062-43b5-abad-3abc712631df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.742179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6da085ea-b062-43b5-abad-3abc712631df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.846632 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b12a02a6-c405-4290-aaea-fce5180c654e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.247752 Oct 29 02:55:29.848239 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1334/2606] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Oct 29 02:55:29 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9/os-interface => generated 1830 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:29.860078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9a9c3cfe-4c13-415e-8477-3527b11101c8 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Calling method '.version_select at 0x7fe1a86fe040>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:29.959547 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9a9c3cfe-4c13-415e-8477-3527b11101c8 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/7aa637c9-f937-4146-bc7e-b029a878f96e" status: 200 len: 664 microversion: 2.1 time: 0.109487 Oct 29 02:55:29.960235 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1335/2607] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:55:29 2022] GET /compute/v2.1/os-security-groups/7aa637c9-f937-4146-bc7e-b029a878f96e => generated 664 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:29.965501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-062311ae-ac96-4ad1-855d-59922b8c8bab tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:29.967172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-062311ae-ac96-4ad1-855d-59922b8c8bab tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:29.981694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062311ae-ac96-4ad1-855d-59922b8c8bab tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.982214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062311ae-ac96-4ad1-855d-59922b8c8bab tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.982772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062311ae-ac96-4ad1-855d-59922b8c8bab tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.998436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062311ae-ac96-4ad1-855d-59922b8c8bab tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.999617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062311ae-ac96-4ad1-855d-59922b8c8bab tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:30.002644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-062311ae-ac96-4ad1-855d-59922b8c8bab tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:30.245941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-062311ae-ac96-4ad1-855d-59922b8c8bab tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:30.262493 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-062311ae-ac96-4ad1-855d-59922b8c8bab tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.299684 Oct 29 02:55:30.277849 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1336/2608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:29 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:30.287168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5dc74108-22ca-4d56-b7ef-8f1b9e982f4b tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Calling method '.version_select at 0x7fe1a86fec10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:30.303274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6da085ea-b062-43b5-abad-3abc712631df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:30.311351 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6da085ea-b062-43b5-abad-3abc712631df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1315 microversion: 2.1 time: 0.617371 Oct 29 02:55:30.311940 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1273/2609] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:29 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:30.555442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-415aa4ed-d1b5-480a-8e38-b46916096df5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:30.556385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-415aa4ed-d1b5-480a-8e38-b46916096df5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:30.566757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-415aa4ed-d1b5-480a-8e38-b46916096df5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:30.567587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-415aa4ed-d1b5-480a-8e38-b46916096df5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:30.568261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-415aa4ed-d1b5-480a-8e38-b46916096df5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:30.569271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-415aa4ed-d1b5-480a-8e38-b46916096df5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:30.569985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-415aa4ed-d1b5-480a-8e38-b46916096df5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:30.570706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-415aa4ed-d1b5-480a-8e38-b46916096df5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:30.772891 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5dc74108-22ca-4d56-b7ef-8f1b9e982f4b tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/574c43fb-9e11-452c-8524-723f747b7976" status: 202 len: 0 microversion: 2.1 time: 0.500433 Oct 29 02:55:30.773675 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1337/2610] 10.222.0.16 () {58 vars in 1287 bytes} [Sat Oct 29 02:55:30 2022] DELETE /compute/v2.1/os-security-group-rules/574c43fb-9e11-452c-8524-723f747b7976 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:30.784432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-457c9f63-6eed-4233-b2b8-ed351972c244 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Calling method '.version_select at 0x7fe1a8788a60>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:31.223051 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-457c9f63-6eed-4233-b2b8-ed351972c244 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7aa637c9-f937-4146-bc7e-b029a878f96e" status: 202 len: 0 microversion: 2.1 time: 0.443109 Oct 29 02:55:31.224195 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1338/2611] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:30 2022] DELETE /compute/v2.1/os-security-groups/7aa637c9-f937-4146-bc7e-b029a878f96e => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:55:31.232430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16d39d0e-b350-4e86-aeb5-6a9ac2e16cfa tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Calling method '.version_select at 0x7fe1a87cd940>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:31.329447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-16d39d0e-b350-4e86-aeb5-6a9ac2e16cfa tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 25544d5d-d78e-4d73-9156-024228d92cd4 does not exist", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:55:31.329447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.security_group_api [None req-16d39d0e-b350-4e86-aeb5-6a9ac2e16cfa tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Neutron security group 25544d5d-d78e-4d73-9156-024228d92cd4 not found {{(pid=127041) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:55:31.329447 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-16d39d0e-b350-4e86-aeb5-6a9ac2e16cfa tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] HTTP exception thrown: Security group 25544d5d-d78e-4d73-9156-024228d92cd4 does not exist Oct 29 02:55:31.329447 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-a92708e0-d974-4e4e-babe-dd03f7588ec4'] Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16d39d0e-b350-4e86-aeb5-6a9ac2e16cfa tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Request method failure captured: Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-security-groups/25544d5d-d78e-4d73-9156-024228d92cd4 HTTP/1.1 Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJYRGjlvNAcZZCAkyifm8PPxbK2r1x_Bak9n5tLeOVt5xRUjUzTHqI3Soz421zr-VVBY-DzdYYQwWkvgc5b-5dt9ODnxSl2dVtPFASru_bleopuePtJMN-6D8IBec64bnzt-9u4d_REJU2TdesZLlIOtdepGzgRDr3b9Jfyq7n-f1OA Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 431241db26d44c4ea915ded528edb4f8 Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2074407808 Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/431241db26d44c4ea915ded528edb4f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/431241db26d44c4ea915ded528edb4f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_431241db26d44c4ea915ded528edb4f8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/431241db26d44c4ea915ded528edb4f8"}]}] Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2074407808 Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 431241db26d44c4ea915ded528edb4f8 Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2074407808 Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupRulesTestJSON-2074407808-project Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 487d794ccbf544809c8e422efe507716 Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2074407808-project Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: exception: Security group 25544d5d-d78e-4d73-9156-024228d92cd4 does not exist Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-a92708e0-d974-4e4e-babe-dd03f7588ec4'] Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '25544d5d-d78e-4d73-9156-024228d92cd4'} Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:55:31.331937 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 25544d5d-d78e-4d73-9156-024228d92cd4 does not exist Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a92708e0-d974-4e4e-babe-dd03f7588ec4'] Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 25544d5d-d78e-4d73-9156-024228d92cd4 does not exist Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a92708e0-d974-4e4e-babe-dd03f7588ec4'] Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 25544d5d-d78e-4d73-9156-024228d92cd4 does not exist Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a92708e0-d974-4e4e-babe-dd03f7588ec4'] Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 25544d5d-d78e-4d73-9156-024228d92cd4 does not exist Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a92708e0-d974-4e4e-babe-dd03f7588ec4'] Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16d39d0e-b350-4e86-aeb5-6a9ac2e16cfa tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Returning 404 to user: Security group 25544d5d-d78e-4d73-9156-024228d92cd4 does not exist Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-a92708e0-d974-4e4e-babe-dd03f7588ec4'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:31.336283 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-16d39d0e-b350-4e86-aeb5-6a9ac2e16cfa tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/25544d5d-d78e-4d73-9156-024228d92cd4" status: 404 len: 194 microversion: 2.1 time: 0.106313 Oct 29 02:55:31.339147 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1339/2612] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:31 2022] DELETE /compute/v2.1/os-security-groups/25544d5d-d78e-4d73-9156-024228d92cd4 => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:31.346887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-28a3556c-0365-4d3f-868e-5a056e537aa4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:31.347882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-28a3556c-0365-4d3f-868e-5a056e537aa4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:31.369662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28a3556c-0365-4d3f-868e-5a056e537aa4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:31.370848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28a3556c-0365-4d3f-868e-5a056e537aa4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:31.371609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28a3556c-0365-4d3f-868e-5a056e537aa4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:31.372638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28a3556c-0365-4d3f-868e-5a056e537aa4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:31.373626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28a3556c-0365-4d3f-868e-5a056e537aa4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:31.374521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28a3556c-0365-4d3f-868e-5a056e537aa4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:31.524754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-415aa4ed-d1b5-480a-8e38-b46916096df5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:31.535911 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-415aa4ed-d1b5-480a-8e38-b46916096df5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 200 len: 1308 microversion: 2.1 time: 0.984764 Oct 29 02:55:31.538880 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1274/2613] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:30 2022] GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 1308 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:31.564465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9fac627b-1ab4-4076-8754-9ba019002379 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:31.566220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9fac627b-1ab4-4076-8754-9ba019002379 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:31.573897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9fac627b-1ab4-4076-8754-9ba019002379 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:31.574583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9fac627b-1ab4-4076-8754-9ba019002379 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:31.575173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9fac627b-1ab4-4076-8754-9ba019002379 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:31.576023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9fac627b-1ab4-4076-8754-9ba019002379 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:31.576754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9fac627b-1ab4-4076-8754-9ba019002379 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:31.579202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9fac627b-1ab4-4076-8754-9ba019002379 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:31.707254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-28a3556c-0365-4d3f-868e-5a056e537aa4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:31.720801 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-28a3556c-0365-4d3f-868e-5a056e537aa4 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1392 microversion: 2.1 time: 0.380478 Oct 29 02:55:31.733832 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1340/2614] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:31 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1392 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:31.739601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c4614aa-5e00-4129-8719-7b73a3b6ce0e tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Calling method '.version_select at 0x7fe1a88bfca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:32.198953 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1c4614aa-5e00-4129-8719-7b73a3b6ce0e tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/30c1df74-d02f-4142-968b-291cc67ed92a" status: 202 len: 0 microversion: 2.1 time: 0.472505 Oct 29 02:55:32.199960 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1341/2615] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:31 2022] DELETE /compute/v2.1/os-security-groups/30c1df74-d02f-4142-968b-291cc67ed92a => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:32.208686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-40f0876f-a4e8-4540-864e-2b68ed306dec req-b11e30a0-fe06-4692-8dc2-898c63a26409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d", "name": "network-vif-plugged", "status": "completed", "tag": "5fdf8084-8c8b-4cd7-a958-0335d3697a1c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:32.240799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:32.246860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9fac627b-1ab4-4076-8754-9ba019002379 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:32.256035 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9fac627b-1ab4-4076-8754-9ba019002379 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1500 microversion: 2.1 time: 0.715868 Oct 29 02:55:32.256620 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1275/2616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:31 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1500 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:32.268842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e60cd0c-61e0-4020-9c63-65078acd6c7f tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Calling method '.version_select at 0x7fe1a8730c10>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:32.272880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-40f0876f-a4e8-4540-864e-2b68ed306dec req-b11e30a0-fe06-4692-8dc2-898c63a26409 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:32.273846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-40f0876f-a4e8-4540-864e-2b68ed306dec req-b11e30a0-fe06-4692-8dc2-898c63a26409 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:32.274861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-40f0876f-a4e8-4540-864e-2b68ed306dec req-b11e30a0-fe06-4692-8dc2-898c63a26409 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:32.292174 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-40f0876f-a4e8-4540-864e-2b68ed306dec req-b11e30a0-fe06-4692-8dc2-898c63a26409 service nova] Creating event network-vif-plugged:5fdf8084-8c8b-4cd7-a958-0335d3697a1c for instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d on n-h1-862964-4 Oct 29 02:55:32.298393 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-40f0876f-a4e8-4540-864e-2b68ed306dec req-b11e30a0-fe06-4692-8dc2-898c63a26409 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096909 Oct 29 02:55:32.299288 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1342/2617] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:32.306164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0554f849-8126-4a05-8e0a-4c6c10e513b0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:32.306795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0554f849-8126-4a05-8e0a-4c6c10e513b0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:32.314122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0554f849-8126-4a05-8e0a-4c6c10e513b0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:32.314697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0554f849-8126-4a05-8e0a-4c6c10e513b0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:32.315196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0554f849-8126-4a05-8e0a-4c6c10e513b0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:32.315973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0554f849-8126-4a05-8e0a-4c6c10e513b0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:32.316486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0554f849-8126-4a05-8e0a-4c6c10e513b0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:32.317068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0554f849-8126-4a05-8e0a-4c6c10e513b0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:32.358148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0554f849-8126-4a05-8e0a-4c6c10e513b0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:32.413289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:32.503728 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0554f849-8126-4a05-8e0a-4c6c10e513b0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 204 len: 0 microversion: 2.1 time: 0.202348 Oct 29 02:55:32.507458 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1343/2618] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:32 2022] DELETE /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:32.516217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e0788e0a-29ba-438c-b224-b8393b4ead88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:32.516934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e0788e0a-29ba-438c-b224-b8393b4ead88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:32.534243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0788e0a-29ba-438c-b224-b8393b4ead88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:32.534972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0788e0a-29ba-438c-b224-b8393b4ead88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:32.535471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0788e0a-29ba-438c-b224-b8393b4ead88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:32.536161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0788e0a-29ba-438c-b224-b8393b4ead88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:32.536617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0788e0a-29ba-438c-b224-b8393b4ead88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:32.537679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0788e0a-29ba-438c-b224-b8393b4ead88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:32.857172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e0788e0a-29ba-438c-b224-b8393b4ead88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:32.868657 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e0788e0a-29ba-438c-b224-b8393b4ead88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1506 microversion: 2.1 time: 0.356291 Oct 29 02:55:32.869297 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1344/2619] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:32 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:32.876917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-45723831-e3ed-4524-8e55-3f214db8179c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:32.878659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-45723831-e3ed-4524-8e55-3f214db8179c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:32.887149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45723831-e3ed-4524-8e55-3f214db8179c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:32.888049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45723831-e3ed-4524-8e55-3f214db8179c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:32.889024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45723831-e3ed-4524-8e55-3f214db8179c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:32.889893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45723831-e3ed-4524-8e55-3f214db8179c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:32.890508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45723831-e3ed-4524-8e55-3f214db8179c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:32.891474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45723831-e3ed-4524-8e55-3f214db8179c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.056384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-45723831-e3ed-4524-8e55-3f214db8179c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:33.067094 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-45723831-e3ed-4524-8e55-3f214db8179c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 200 len: 1308 microversion: 2.1 time: 0.195069 Oct 29 02:55:33.068658 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1345/2620] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:32 2022] GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:33.073068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d86d458-a3da-4143-9195-a8a44634ddee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:33.074000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7d86d458-a3da-4143-9195-a8a44634ddee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:33.080425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d86d458-a3da-4143-9195-a8a44634ddee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.081207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d86d458-a3da-4143-9195-a8a44634ddee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.082820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d86d458-a3da-4143-9195-a8a44634ddee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.084185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d86d458-a3da-4143-9195-a8a44634ddee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.084796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d86d458-a3da-4143-9195-a8a44634ddee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.085410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d86d458-a3da-4143-9195-a8a44634ddee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.189302 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4e60cd0c-61e0-4020-9c63-65078acd6c7f tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f733a5de-baf4-45a0-987e-001f114259e5" status: 202 len: 0 microversion: 2.1 time: 0.924084 Oct 29 02:55:33.189970 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1276/2621] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:32 2022] DELETE /compute/v2.1/os-security-groups/f733a5de-baf4-45a0-987e-001f114259e5 => generated 0 bytes in 926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:33.198802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7fc30f39-20c2-4b68-af2b-7a176e9f7d95 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Calling method '.version_select at 0x7fe1a8a08b80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:33.298840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d86d458-a3da-4143-9195-a8a44634ddee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:33.311835 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d86d458-a3da-4143-9195-a8a44634ddee tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1382 microversion: 2.1 time: 0.242213 Oct 29 02:55:33.312445 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1346/2622] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:33 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1382 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:33.335898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc9dc739-090d-40c0-b4bb-22e46398b33b tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '.version_select at 0x7fe1acc3b1f0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:33.340286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc9dc739-090d-40c0-b4bb-22e46398b33b tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.341001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc9dc739-090d-40c0-b4bb-22e46398b33b tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.341605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc9dc739-090d-40c0-b4bb-22e46398b33b tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.353482 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fc9dc739-090d-40c0-b4bb-22e46398b33b tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1551 microversion: 2.1 time: 0.022332 Oct 29 02:55:33.365547 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1347/2623] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:55:33 2022] GET /compute/v2.1/os-migrations => generated 1551 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:33.372153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7578a2f8-ffd5-4c0c-ad90-85acb116bc62 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:33.372999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7578a2f8-ffd5-4c0c-ad90-85acb116bc62 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:33.381062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7578a2f8-ffd5-4c0c-ad90-85acb116bc62 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.381062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7578a2f8-ffd5-4c0c-ad90-85acb116bc62 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.381377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7578a2f8-ffd5-4c0c-ad90-85acb116bc62 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.382289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7578a2f8-ffd5-4c0c-ad90-85acb116bc62 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.383001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7578a2f8-ffd5-4c0c-ad90-85acb116bc62 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.384243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7578a2f8-ffd5-4c0c-ad90-85acb116bc62 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.599428 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7578a2f8-ffd5-4c0c-ad90-85acb116bc62 tempest-LiveMigrationTest-774177899 tempest-LiveMigrationTest-774177899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1533 microversion: 2.1 time: 0.231509 Oct 29 02:55:33.600756 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1348/2624] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:33 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1533 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:33.640337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d4f1e79d-7be3-4502-a7da-077aed7739fc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:33.640895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d4f1e79d-7be3-4502-a7da-077aed7739fc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:33.647788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4f1e79d-7be3-4502-a7da-077aed7739fc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.648272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4f1e79d-7be3-4502-a7da-077aed7739fc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.649033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4f1e79d-7be3-4502-a7da-077aed7739fc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.649945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4f1e79d-7be3-4502-a7da-077aed7739fc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.650393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4f1e79d-7be3-4502-a7da-077aed7739fc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.650955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4f1e79d-7be3-4502-a7da-077aed7739fc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.677499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d4f1e79d-7be3-4502-a7da-077aed7739fc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:33.723684 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7fc30f39-20c2-4b68-af2b-7a176e9f7d95 tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e1cf2a68-605c-4574-be78-429f9a4c0610" status: 202 len: 0 microversion: 2.1 time: 0.529423 Oct 29 02:55:33.728631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1277/2625] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:33 2022] DELETE /compute/v2.1/os-security-groups/e1cf2a68-605c-4574-be78-429f9a4c0610 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:55:33.747521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c71a53c2-2156-4cf1-a10b-df1e14c2524e tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Calling method '.version_select at 0x7fe1a8c223a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:33.795821 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d4f1e79d-7be3-4502-a7da-077aed7739fc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 204 len: 0 microversion: 2.1 time: 0.159488 Oct 29 02:55:33.797555 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1349/2626] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:33 2022] DELETE /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:55:33.808692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce3ce028-7295-4b6a-9f77-385c49c7f010 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:33.810004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce3ce028-7295-4b6a-9f77-385c49c7f010 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:33.819208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce3ce028-7295-4b6a-9f77-385c49c7f010 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.819933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce3ce028-7295-4b6a-9f77-385c49c7f010 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.820696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce3ce028-7295-4b6a-9f77-385c49c7f010 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.821763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce3ce028-7295-4b6a-9f77-385c49c7f010 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.822722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce3ce028-7295-4b6a-9f77-385c49c7f010 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.823595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce3ce028-7295-4b6a-9f77-385c49c7f010 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:34.160700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce3ce028-7295-4b6a-9f77-385c49c7f010 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:34.177646 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce3ce028-7295-4b6a-9f77-385c49c7f010 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1388 microversion: 2.1 time: 0.374731 Oct 29 02:55:34.194584 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1350/2627] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:33 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1388 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:34.199095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3381b897-6ab6-455e-9acc-569b48453500 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:34.199793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3381b897-6ab6-455e-9acc-569b48453500 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:34.213036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3381b897-6ab6-455e-9acc-569b48453500 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:34.214055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3381b897-6ab6-455e-9acc-569b48453500 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:34.215231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3381b897-6ab6-455e-9acc-569b48453500 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:34.216348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3381b897-6ab6-455e-9acc-569b48453500 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:34.222879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3381b897-6ab6-455e-9acc-569b48453500 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:34.224434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3381b897-6ab6-455e-9acc-569b48453500 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:34.256550 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c71a53c2-2156-4cf1-a10b-df1e14c2524e tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7b1b6450-b6a4-49f7-b4f2-4a14b07d88ae" status: 202 len: 0 microversion: 2.1 time: 0.526297 Oct 29 02:55:34.263346 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1278/2628] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:33 2022] DELETE /compute/v2.1/os-security-groups/7b1b6450-b6a4-49f7-b4f2-4a14b07d88ae => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:34.270884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45353fb6-347f-4235-8b23-bbc352dd8917 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:34.271555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-45353fb6-347f-4235-8b23-bbc352dd8917 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:34.297208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45353fb6-347f-4235-8b23-bbc352dd8917 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:34.301742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45353fb6-347f-4235-8b23-bbc352dd8917 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:34.302757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45353fb6-347f-4235-8b23-bbc352dd8917 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:34.308288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45353fb6-347f-4235-8b23-bbc352dd8917 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:34.309038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45353fb6-347f-4235-8b23-bbc352dd8917 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:34.311259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45353fb6-347f-4235-8b23-bbc352dd8917 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:34.508447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3381b897-6ab6-455e-9acc-569b48453500 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:34.522042 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3381b897-6ab6-455e-9acc-569b48453500 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1506 microversion: 2.1 time: 0.336746 Oct 29 02:55:34.523028 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1351/2629] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:34 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:34.533322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89b77c6e-db15-4d8e-86a3-4a760ad315ba tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] Calling method '.version_select at 0x7fe1a889cd30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:35.206251 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89b77c6e-db15-4d8e-86a3-4a760ad315ba tempest-SecurityGroupRulesTestJSON-2074407808 tempest-SecurityGroupRulesTestJSON-2074407808-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e214e7a4-f278-4ff3-bddb-7dd1c612413d" status: 202 len: 0 microversion: 2.1 time: 0.681884 Oct 29 02:55:35.207314 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1352/2630] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:34 2022] DELETE /compute/v2.1/os-security-groups/e214e7a4-f278-4ff3-bddb-7dd1c612413d => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:35.212620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ba6e7e66-3385-4c7e-9757-b861d3882a49 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:35.213588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ba6e7e66-3385-4c7e-9757-b861d3882a49 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:35.228490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6e7e66-3385-4c7e-9757-b861d3882a49 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:35.230485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6e7e66-3385-4c7e-9757-b861d3882a49 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:35.234238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6e7e66-3385-4c7e-9757-b861d3882a49 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:35.235082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6e7e66-3385-4c7e-9757-b861d3882a49 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:35.235968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6e7e66-3385-4c7e-9757-b861d3882a49 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:35.236406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba6e7e66-3385-4c7e-9757-b861d3882a49 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:35.774286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ba6e7e66-3385-4c7e-9757-b861d3882a49 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:35.785496 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ba6e7e66-3385-4c7e-9757-b861d3882a49 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1388 microversion: 2.1 time: 0.576859 Oct 29 02:55:35.786395 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1353/2631] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:35 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1388 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:35.804134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b8a75bc8-4038-4325-89dd-09d8754f42f7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:35.804762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b8a75bc8-4038-4325-89dd-09d8754f42f7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:35.823608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8a75bc8-4038-4325-89dd-09d8754f42f7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:35.824113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8a75bc8-4038-4325-89dd-09d8754f42f7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:35.824558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8a75bc8-4038-4325-89dd-09d8754f42f7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:35.825767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8a75bc8-4038-4325-89dd-09d8754f42f7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:35.826398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8a75bc8-4038-4325-89dd-09d8754f42f7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:35.827153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8a75bc8-4038-4325-89dd-09d8754f42f7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:35.928824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-45353fb6-347f-4235-8b23-bbc352dd8917 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:35.933550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:35.943296 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-45353fb6-347f-4235-8b23-bbc352dd8917 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 200 len: 1488 microversion: 2.1 time: 1.678509 Oct 29 02:55:35.944986 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1279/2632] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:34 2022] GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 1488 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:36.207748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b8a75bc8-4038-4325-89dd-09d8754f42f7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:36.223884 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b8a75bc8-4038-4325-89dd-09d8754f42f7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1506 microversion: 2.1 time: 0.436255 Oct 29 02:55:36.227846 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1354/2633] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:35 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:36.242557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37925758-1555-476f-9008-5b2f0a6e18a2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-927536368"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:36.249177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37925758-1555-476f-9008-5b2f0a6e18a2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:36.266758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37925758-1555-476f-9008-5b2f0a6e18a2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:36.268279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37925758-1555-476f-9008-5b2f0a6e18a2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:36.275459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37925758-1555-476f-9008-5b2f0a6e18a2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:36.277044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37925758-1555-476f-9008-5b2f0a6e18a2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:36.277380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7361e455-2095-4350-9b14-9f6e4c545eb5 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2021111990", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:36.279702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37925758-1555-476f-9008-5b2f0a6e18a2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:36.281437 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-7361e455-2095-4350-9b14-9f6e4c545eb5 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] HTTP exception thrown: min_count must be <= max_count Oct 29 02:55:36.282184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37925758-1555-476f-9008-5b2f0a6e18a2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7361e455-2095-4350-9b14-9f6e4c545eb5 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Request method failure captured: Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 184 Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYnYA8pliiXzx60hHyccAn_YgampLxfCTs5e-XF3MSIEGvctpGdmKXvpNrVPv2b7aLL2L7tW0laj2kBDT2U8B9rjWyHkJjtLkEKBeF6oeo4JZ4QZBBHwYzNpk7tvM0THElJLW49oDVlhYozGF7VEyu9nfCK3a_ZyZxLivmHUXBemYI Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: fc54ca946910499d877b803cd567d289 Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc54ca946910499d877b803cd567d289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc54ca946910499d877b803cd567d289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc54ca946910499d877b803cd567d289", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc54ca946910499d877b803cd567d289"}]}] Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: fc54ca946910499d877b803cd567d289 Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-MultipleCreateNegativeTestJSON-743319291-project Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 384db252fce5450eb3a2121da5d0fab2 Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-743319291-project Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2021111990", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: exception: min_count must be <= max_count Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2021111990', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 29 02:55:36.283725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.290366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7361e455-2095-4350-9b14-9f6e4c545eb5 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Returning 400 to user: min_count must be <= max_count {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:36.292233 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7361e455-2095-4350-9b14-9f6e4c545eb5 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.345808 Oct 29 02:55:36.293253 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1280/2634] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:35 2022] POST /compute/v2.1/servers => generated 74 bytes in 348 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:36.539052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bcb58df9-0bca-45da-bf56-da2de41d2e01 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1388538494", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "max_count": 0}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bcb58df9-0bca-45da-bf56-da2de41d2e01 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Request method failure captured: Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 168 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYnYA8pliiXzx60hHyccAn_YgampLxfCTs5e-XF3MSIEGvctpGdmKXvpNrVPv2b7aLL2L7tW0laj2kBDT2U8B9rjWyHkJjtLkEKBeF6oeo4JZ4QZBBHwYzNpk7tvM0THElJLW49oDVlhYozGF7VEyu9nfCK3a_ZyZxLivmHUXBemYI Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: fc54ca946910499d877b803cd567d289 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc54ca946910499d877b803cd567d289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc54ca946910499d877b803cd567d289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc54ca946910499d877b803cd567d289", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc54ca946910499d877b803cd567d289"}]}] Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: fc54ca946910499d877b803cd567d289 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-MultipleCreateNegativeTestJSON-743319291-project Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 384db252fce5450eb3a2121da5d0fab2 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-743319291-project Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1388538494", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "max_count": 0}} Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1388538494', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'max_count': 0}}} Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 0 Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:55:36.565265 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:36.569583 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.573904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bcb58df9-0bca-45da-bf56-da2de41d2e01 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:36.574789 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bcb58df9-0bca-45da-bf56-da2de41d2e01 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.044762 Oct 29 02:55:36.575137 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1281/2635] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:36 2022] POST /compute/v2.1/servers => generated 130 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:55:36.813981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-771fba65-782f-4d15-ab58-c69ae0ee47ef tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-527974316", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "max_count": 2.5}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-771fba65-782f-4d15-ab58-c69ae0ee47ef tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Request method failure captured: Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 169 Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYnYA8pliiXzx60hHyccAn_YgampLxfCTs5e-XF3MSIEGvctpGdmKXvpNrVPv2b7aLL2L7tW0laj2kBDT2U8B9rjWyHkJjtLkEKBeF6oeo4JZ4QZBBHwYzNpk7tvM0THElJLW49oDVlhYozGF7VEyu9nfCK3a_ZyZxLivmHUXBemYI Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: fc54ca946910499d877b803cd567d289 Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc54ca946910499d877b803cd567d289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc54ca946910499d877b803cd567d289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc54ca946910499d877b803cd567d289", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc54ca946910499d877b803cd567d289"}]}] Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: fc54ca946910499d877b803cd567d289 Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-MultipleCreateNegativeTestJSON-743319291-project Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 384db252fce5450eb3a2121da5d0fab2 Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-743319291-project Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-527974316", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "max_count": 2.5}} Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-527974316', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'max_count': 2.5}}} Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 2.5 Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:55:36.818300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-771fba65-782f-4d15-ab58-c69ae0ee47ef tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-771fba65-782f-4d15-ab58-c69ae0ee47ef tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018722 Oct 29 02:55:36.822655 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1282/2636] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:36 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:55:36.833492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ee4534c0-d373-43c0-8d61-5663744b68b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:36.837488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ee4534c0-d373-43c0-8d61-5663744b68b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:36.858034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:36.861722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4534c0-d373-43c0-8d61-5663744b68b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:36.862646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4534c0-d373-43c0-8d61-5663744b68b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:36.863252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4534c0-d373-43c0-8d61-5663744b68b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:36.864395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4534c0-d373-43c0-8d61-5663744b68b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:36.865043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4534c0-d373-43c0-8d61-5663744b68b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:36.865609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4534c0-d373-43c0-8d61-5663744b68b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.206504 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37925758-1555-476f-9008-5b2f0a6e18a2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.974748 Oct 29 02:55:37.207831 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1355/2637] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:55:36 2022] POST /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d/action => generated 0 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:55:37.233209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f46c2f9b-d2b0-4daa-a2be-482242a4a902 req-3aabd605-b584-4b57-ac56-10536b77e44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59fa09ed-b246-47b4-91a8-408031ac5835", "name": "network-vif-deleted", "tag": "5f23facb-f546-40f2-9a96-6d9396227f83"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:37.257679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f46c2f9b-d2b0-4daa-a2be-482242a4a902 req-3aabd605-b584-4b57-ac56-10536b77e44d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:37.258491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f46c2f9b-d2b0-4daa-a2be-482242a4a902 req-3aabd605-b584-4b57-ac56-10536b77e44d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:37.263496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f46c2f9b-d2b0-4daa-a2be-482242a4a902 req-3aabd605-b584-4b57-ac56-10536b77e44d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.280336 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f46c2f9b-d2b0-4daa-a2be-482242a4a902 req-3aabd605-b584-4b57-ac56-10536b77e44d service nova] Creating event network-vif-deleted:5f23facb-f546-40f2-9a96-6d9396227f83 for instance 59fa09ed-b246-47b4-91a8-408031ac5835 on n-h2-862964-4 Oct 29 02:55:37.295524 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f46c2f9b-d2b0-4daa-a2be-482242a4a902 req-3aabd605-b584-4b57-ac56-10536b77e44d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081142 Oct 29 02:55:37.298066 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1356/2638] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:37.307412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1504a1ad-f4f1-40e3-af15-90d6ec475600 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1083345540", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "min_count": 0}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1504a1ad-f4f1-40e3-af15-90d6ec475600 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Request method failure captured: Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 168 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJYnYA8pliiXzx60hHyccAn_YgampLxfCTs5e-XF3MSIEGvctpGdmKXvpNrVPv2b7aLL2L7tW0laj2kBDT2U8B9rjWyHkJjtLkEKBeF6oeo4JZ4QZBBHwYzNpk7tvM0THElJLW49oDVlhYozGF7VEyu9nfCK3a_ZyZxLivmHUXBemYI Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: fc54ca946910499d877b803cd567d289 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc54ca946910499d877b803cd567d289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc54ca946910499d877b803cd567d289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc54ca946910499d877b803cd567d289", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc54ca946910499d877b803cd567d289"}]}] Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: fc54ca946910499d877b803cd567d289 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-MultipleCreateNegativeTestJSON-743319291-project Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 384db252fce5450eb3a2121da5d0fab2 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-743319291-project Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1083345540", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "min_count": 0}} Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1083345540', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'min_count': 0}}} Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 0 Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:55:37.315199 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1504a1ad-f4f1-40e3-af15-90d6ec475600 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1504a1ad-f4f1-40e3-af15-90d6ec475600 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.017308 Oct 29 02:55:37.327835 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1357/2639] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:37.334396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-40b34dba-16e7-4fb5-a4df-be073f264994 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a3fda430>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:37.396038 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-40b34dba-16e7-4fb5-a4df-be073f264994 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.076200 Oct 29 02:55:37.398518 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1358/2640] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:37 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:37.404377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:37.410463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:37.440166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:37.440957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:37.442007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.442751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:37.447074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:37.449406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.488949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ee4534c0-d373-43c0-8d61-5663744b68b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:37.499024 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ee4534c0-d373-43c0-8d61-5663744b68b6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1388 microversion: 2.1 time: 0.677829 Oct 29 02:55:37.522393 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1283/2641] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:36 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1388 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:37.523813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:37.524725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:37.525397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.526101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lazy-loading 'fault' on Instance uuid 59fa09ed-b246-47b4-91a8-408031ac5835 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:55:37.527580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-980efae8-7846-45d2-aaa0-7b5137628170 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-81593501", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "min_count": 2.5}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-980efae8-7846-45d2-aaa0-7b5137628170 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Request method failure captured: Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 168 Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYnYA8pliiXzx60hHyccAn_YgampLxfCTs5e-XF3MSIEGvctpGdmKXvpNrVPv2b7aLL2L7tW0laj2kBDT2U8B9rjWyHkJjtLkEKBeF6oeo4JZ4QZBBHwYzNpk7tvM0THElJLW49oDVlhYozGF7VEyu9nfCK3a_ZyZxLivmHUXBemYI Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: fc54ca946910499d877b803cd567d289 Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc54ca946910499d877b803cd567d289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc54ca946910499d877b803cd567d289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc54ca946910499d877b803cd567d289", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc54ca946910499d877b803cd567d289"}]}] Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: fc54ca946910499d877b803cd567d289 Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-743319291 Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-MultipleCreateNegativeTestJSON-743319291-project Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 384db252fce5450eb3a2121da5d0fab2 Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-743319291-project Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-81593501", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "min_count": 2.5}} Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-81593501', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'min_count': 2.5}}} Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 2.5 Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:55:37.532363 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:37.536512 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:37.572490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-980efae8-7846-45d2-aaa0-7b5137628170 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:37.575987 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-980efae8-7846-45d2-aaa0-7b5137628170 tempest-MultipleCreateNegativeTestJSON-743319291 tempest-MultipleCreateNegativeTestJSON-743319291-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.052462 Oct 29 02:55:37.577592 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1284/2642] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:37.659459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:37.670858 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ee0a2739-33d6-4727-aad2-bad1c9c32538 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 200 len: 1305 microversion: 2.1 time: 0.270431 Oct 29 02:55:37.694715 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1359/2643] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:37 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 1305 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:38.414867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-125ac319-b39b-406b-8f5c-71cae6031bc0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8a089d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:38.540913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1ab265ea-864f-4764-8dc7-a16467c4412c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:38.541409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1ab265ea-864f-4764-8dc7-a16467c4412c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:38.572319 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-125ac319-b39b-406b-8f5c-71cae6031bc0 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.163483 Oct 29 02:55:38.574866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab265ea-864f-4764-8dc7-a16467c4412c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.575553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab265ea-864f-4764-8dc7-a16467c4412c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.576444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab265ea-864f-4764-8dc7-a16467c4412c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:38.576989 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1285/2644] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:38 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:38.579962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab265ea-864f-4764-8dc7-a16467c4412c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.580612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab265ea-864f-4764-8dc7-a16467c4412c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.581214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab265ea-864f-4764-8dc7-a16467c4412c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:38.631956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:38.707394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:38.708120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:38.724352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.725056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.725649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:38.725782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1ab265ea-864f-4764-8dc7-a16467c4412c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:38.726673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.727270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.727833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:38.736177 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1ab265ea-864f-4764-8dc7-a16467c4412c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1184 microversion: 2.1 time: 0.209718 Oct 29 02:55:38.752071 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1360/2645] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:38 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1184 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:38.757885 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 HTTP/1.1 Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '59fa09ed-b246-47b4-91a8-408031ac5835'} Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:38.759438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.763799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:38.763799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:38.763799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:38.763799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:38.763799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:38.763799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 02:55:38.763799 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.763799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:38.763799 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bbbd805e-1ab4-4ebe-9c70-5313af4fca13 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 404 len: 111 microversion: 2.1 time: 0.057757 Oct 29 02:55:38.766756 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1286/2646] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:38 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:38.933099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1967681794", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "206445a3-72bd-4ae4-a1d4-4c994350bfbb"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:39.010646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] validate_networks() for [('206445a3-72bd-4ae4-a1d4-4c994350bfbb', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:55:39.555890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-204fe42d-e658-488c-83ee-1d0bb83c0cb7 req-18b5dc0c-d96d-4b3b-908d-825b79373bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0253f5-cea4-471a-97d6-16c7702c07ee", "name": "network-vif-deleted", "tag": "95d5adb4-6512-4e6f-9edb-c3dd7ee44c98"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:39.580044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-204fe42d-e658-488c-83ee-1d0bb83c0cb7 req-18b5dc0c-d96d-4b3b-908d-825b79373bf3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:39.580676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-204fe42d-e658-488c-83ee-1d0bb83c0cb7 req-18b5dc0c-d96d-4b3b-908d-825b79373bf3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:39.580918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-204fe42d-e658-488c-83ee-1d0bb83c0cb7 req-18b5dc0c-d96d-4b3b-908d-825b79373bf3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:39.616870 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-204fe42d-e658-488c-83ee-1d0bb83c0cb7 req-18b5dc0c-d96d-4b3b-908d-825b79373bf3 service nova] Creating event network-vif-deleted:95d5adb4-6512-4e6f-9edb-c3dd7ee44c98 for instance 5c0253f5-cea4-471a-97d6-16c7702c07ee on n-h2-862964-4 Oct 29 02:55:39.627531 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-204fe42d-e658-488c-83ee-1d0bb83c0cb7 req-18b5dc0c-d96d-4b3b-908d-825b79373bf3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075300 Oct 29 02:55:39.630633 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1287/2647] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:39.642761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bc0015d4-6b8e-4af0-9830-75dfccff07a8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8bd1b80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:39.678207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:55:39.678723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:55:39.679084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:55:39.679479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:55:39.679884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:55:39.697324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:39.697853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:39.702412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:39.702719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:39.706274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:39.707495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:39.719337 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bc0015d4-6b8e-4af0-9830-75dfccff07a8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.086879 Oct 29 02:55:39.723977 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1288/2648] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:39 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:39.747788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:39.754331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for user fceb096cc5414b3a9d7300fefeb90dff and project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:39.764917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4f1249d6-0862-467e-89a3-f949839a1942 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:39.766173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4f1249d6-0862-467e-89a3-f949839a1942 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:39.782326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1249d6-0862-467e-89a3-f949839a1942 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:39.785214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1249d6-0862-467e-89a3-f949839a1942 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:39.786013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1249d6-0862-467e-89a3-f949839a1942 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:39.787545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1249d6-0862-467e-89a3-f949839a1942 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:39.790874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1249d6-0862-467e-89a3-f949839a1942 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:39.795560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1249d6-0862-467e-89a3-f949839a1942 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:39.816730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:55:39.819515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:55:39.941062 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a60b145-f358-483e-9c29-0243af699d57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014975 Oct 29 02:55:39.943803 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1361/2649] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:55:39.955316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5407ae2-c1a3-447c-99fe-e6e9db2a213b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:39.958050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5407ae2-c1a3-447c-99fe-e6e9db2a213b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:40.094253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4f1249d6-0862-467e-89a3-f949839a1942 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:40.103645 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4f1249d6-0862-467e-89a3-f949839a1942 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1184 microversion: 2.1 time: 0.343454 Oct 29 02:55:40.119087 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1289/2650] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:39 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1184 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:40.140851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e5407ae2-c1a3-447c-99fe-e6e9db2a213b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:40.158326 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e5407ae2-c1a3-447c-99fe-e6e9db2a213b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1215 microversion: 2.1 time: 0.200798 Oct 29 02:55:40.162205 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1362/2651] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:39 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1215 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:40.740591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3412aa17-db87-4fd7-b9c4-bc829703a2a3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8a0f790>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:40.881435 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3412aa17-db87-4fd7-b9c4-bc829703a2a3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.145024 Oct 29 02:55:40.882063 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1290/2652] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:40 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:41.130159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ed96eba2-f562-40a0-9b64-18a9dfa9ad28 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:41.131157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ed96eba2-f562-40a0-9b64-18a9dfa9ad28 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:41.143353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed96eba2-f562-40a0-9b64-18a9dfa9ad28 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:41.146242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed96eba2-f562-40a0-9b64-18a9dfa9ad28 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:41.146866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed96eba2-f562-40a0-9b64-18a9dfa9ad28 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:41.148678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed96eba2-f562-40a0-9b64-18a9dfa9ad28 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:41.151951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed96eba2-f562-40a0-9b64-18a9dfa9ad28 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:41.152553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed96eba2-f562-40a0-9b64-18a9dfa9ad28 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:41.185634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8859bc08-275f-46de-bce8-1ed0d1c87922 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:41.186615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8859bc08-275f-46de-bce8-1ed0d1c87922 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:41.201477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8859bc08-275f-46de-bce8-1ed0d1c87922 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:41.202502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8859bc08-275f-46de-bce8-1ed0d1c87922 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:41.204921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8859bc08-275f-46de-bce8-1ed0d1c87922 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:41.207092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8859bc08-275f-46de-bce8-1ed0d1c87922 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:41.210832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8859bc08-275f-46de-bce8-1ed0d1c87922 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:41.211696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8859bc08-275f-46de-bce8-1ed0d1c87922 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:41.417657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8859bc08-275f-46de-bce8-1ed0d1c87922 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:41.432013 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8859bc08-275f-46de-bce8-1ed0d1c87922 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1211 microversion: 2.1 time: 0.250290 Oct 29 02:55:41.434837 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1291/2653] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:41 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1211 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:41.896785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a71a32ce-e7ad-4616-9bb2-308e053b383d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8944700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:42.014339 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a71a32ce-e7ad-4616-9bb2-308e053b383d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.121309 Oct 29 02:55:42.015040 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1292/2654] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:41 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:42.132491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ed96eba2-f562-40a0-9b64-18a9dfa9ad28 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:42.143071 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ed96eba2-f562-40a0-9b64-18a9dfa9ad28 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1184 microversion: 2.1 time: 1.016961 Oct 29 02:55:42.148942 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1363/2655] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:41 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1184 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:42.461774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bfb1bc16-29ce-484a-beea-e08bd1b79e66 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:42.462478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bfb1bc16-29ce-484a-beea-e08bd1b79e66 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:42.483267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfb1bc16-29ce-484a-beea-e08bd1b79e66 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:42.490413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfb1bc16-29ce-484a-beea-e08bd1b79e66 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:42.493835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfb1bc16-29ce-484a-beea-e08bd1b79e66 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.498719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfb1bc16-29ce-484a-beea-e08bd1b79e66 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:42.505608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfb1bc16-29ce-484a-beea-e08bd1b79e66 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:42.506475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfb1bc16-29ce-484a-beea-e08bd1b79e66 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.995657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bfb1bc16-29ce-484a-beea-e08bd1b79e66 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:43.012817 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bfb1bc16-29ce-484a-beea-e08bd1b79e66 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1273 microversion: 2.1 time: 0.555957 Oct 29 02:55:43.032623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f1a61e8b-83ca-41ef-95b9-aa758ed45ffa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8679d30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:43.048685 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1293/2656] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:42 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1273 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:43.172134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7be94936-48c9-4e9a-b640-d1d1517c0d98 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:43.173024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7be94936-48c9-4e9a-b640-d1d1517c0d98 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:43.187287 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f1a61e8b-83ca-41ef-95b9-aa758ed45ffa tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.153468 Oct 29 02:55:43.189610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7be94936-48c9-4e9a-b640-d1d1517c0d98 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:43.190541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7be94936-48c9-4e9a-b640-d1d1517c0d98 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:43.193598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7be94936-48c9-4e9a-b640-d1d1517c0d98 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:43.199042 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1364/2657] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:43 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:43.201006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7be94936-48c9-4e9a-b640-d1d1517c0d98 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:43.204347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7be94936-48c9-4e9a-b640-d1d1517c0d98 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:43.207545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7be94936-48c9-4e9a-b640-d1d1517c0d98 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:43.367138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7be94936-48c9-4e9a-b640-d1d1517c0d98 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:43.380404 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7be94936-48c9-4e9a-b640-d1d1517c0d98 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1184 microversion: 2.1 time: 0.213087 Oct 29 02:55:43.382408 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1294/2658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:43 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1184 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:44.045163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-84ea5669-7465-4a26-9dfc-f7eaacc7b00c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:44.046051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-84ea5669-7465-4a26-9dfc-f7eaacc7b00c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:44.054317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84ea5669-7465-4a26-9dfc-f7eaacc7b00c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:44.059578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84ea5669-7465-4a26-9dfc-f7eaacc7b00c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:44.060191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84ea5669-7465-4a26-9dfc-f7eaacc7b00c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:44.062857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84ea5669-7465-4a26-9dfc-f7eaacc7b00c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:44.067566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84ea5669-7465-4a26-9dfc-f7eaacc7b00c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:44.068605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84ea5669-7465-4a26-9dfc-f7eaacc7b00c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:44.206008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d946bf4a-5512-46ab-b43c-723e5b4fc96a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c0b0d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:44.337296 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d946bf4a-5512-46ab-b43c-723e5b4fc96a tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.136495 Oct 29 02:55:44.346737 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1295/2659] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:44 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:44.403891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1142c52c-c40b-4736-820b-518ccdfbb7f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:44.404984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1142c52c-c40b-4736-820b-518ccdfbb7f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:44.419942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1142c52c-c40b-4736-820b-518ccdfbb7f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:44.420619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1142c52c-c40b-4736-820b-518ccdfbb7f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:44.421199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1142c52c-c40b-4736-820b-518ccdfbb7f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:44.422589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1142c52c-c40b-4736-820b-518ccdfbb7f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:44.423192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1142c52c-c40b-4736-820b-518ccdfbb7f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:44.423757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1142c52c-c40b-4736-820b-518ccdfbb7f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:44.691853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1142c52c-c40b-4736-820b-518ccdfbb7f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:44.709338 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1142c52c-c40b-4736-820b-518ccdfbb7f6 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1184 microversion: 2.1 time: 0.309270 Oct 29 02:55:44.710032 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1296/2660] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:44 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1184 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:44.731308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-81681670-8535-4680-a208-70ae480c5eb8 req-ca6c8d06-a70a-4b9a-a6e5-738f1f8ff9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d", "name": "network-vif-plugged", "status": "completed", "tag": "5fdf8084-8c8b-4cd7-a958-0335d3697a1c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:44.741724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-81681670-8535-4680-a208-70ae480c5eb8 req-ca6c8d06-a70a-4b9a-a6e5-738f1f8ff9f5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:44.742465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-81681670-8535-4680-a208-70ae480c5eb8 req-ca6c8d06-a70a-4b9a-a6e5-738f1f8ff9f5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:44.743036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-81681670-8535-4680-a208-70ae480c5eb8 req-ca6c8d06-a70a-4b9a-a6e5-738f1f8ff9f5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:44.770638 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-81681670-8535-4680-a208-70ae480c5eb8 req-ca6c8d06-a70a-4b9a-a6e5-738f1f8ff9f5 service nova] Creating event network-vif-plugged:5fdf8084-8c8b-4cd7-a958-0335d3697a1c for instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d on n-h1-862964-4 Oct 29 02:55:44.795842 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-81681670-8535-4680-a208-70ae480c5eb8 req-ca6c8d06-a70a-4b9a-a6e5-738f1f8ff9f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059774 Oct 29 02:55:44.796824 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1297/2661] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:45.214745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-84ea5669-7465-4a26-9dfc-f7eaacc7b00c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:45.223785 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-84ea5669-7465-4a26-9dfc-f7eaacc7b00c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1315 microversion: 2.1 time: 1.183035 Oct 29 02:55:45.228367 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1365/2662] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:44 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1315 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:45.356459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8652c843-55a8-4829-a2da-be4ca26bf121 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c078b0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:45.438617 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8652c843-55a8-4829-a2da-be4ca26bf121 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.087408 Oct 29 02:55:45.449924 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1298/2663] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:45 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:45.733401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f27898ff-153f-48ac-a5de-4a87f6f7459c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:45.734440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f27898ff-153f-48ac-a5de-4a87f6f7459c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:45.744864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f27898ff-153f-48ac-a5de-4a87f6f7459c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.750783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f27898ff-153f-48ac-a5de-4a87f6f7459c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.751470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f27898ff-153f-48ac-a5de-4a87f6f7459c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.752691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f27898ff-153f-48ac-a5de-4a87f6f7459c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.753404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f27898ff-153f-48ac-a5de-4a87f6f7459c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.754130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f27898ff-153f-48ac-a5de-4a87f6f7459c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.968311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f27898ff-153f-48ac-a5de-4a87f6f7459c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:45.983566 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f27898ff-153f-48ac-a5de-4a87f6f7459c tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1184 microversion: 2.1 time: 0.254362 Oct 29 02:55:45.984135 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1366/2664] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:45 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1184 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:46.254963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0b21e0c-5c4f-4e07-9d1d-809d5fed5291 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.255719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0b21e0c-5c4f-4e07-9d1d-809d5fed5291 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:46.265159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b21e0c-5c4f-4e07-9d1d-809d5fed5291 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.268693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b21e0c-5c4f-4e07-9d1d-809d5fed5291 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.274607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b21e0c-5c4f-4e07-9d1d-809d5fed5291 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.275896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b21e0c-5c4f-4e07-9d1d-809d5fed5291 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.276523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b21e0c-5c4f-4e07-9d1d-809d5fed5291 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.277096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b21e0c-5c4f-4e07-9d1d-809d5fed5291 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.458100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c897d8d6-97d4-4288-b650-ec122ceda343 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a85c6820>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.617326 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c897d8d6-97d4-4288-b650-ec122ceda343 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.165644 Oct 29 02:55:46.647606 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1367/2665] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:46 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:46.662154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4ade21bd-a994-406e-b39f-5f7cdbf26268 req-51ffaa1d-67ef-4366-9185-68b1dff29c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1615ba83-e03b-4936-9ea2-f08ea0436ec9", "tag": "43aab893-af24-479f-b6ac-8648136a4de1"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:46.694580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4ade21bd-a994-406e-b39f-5f7cdbf26268 req-51ffaa1d-67ef-4366-9185-68b1dff29c0f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.695814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4ade21bd-a994-406e-b39f-5f7cdbf26268 req-51ffaa1d-67ef-4366-9185-68b1dff29c0f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.698076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4ade21bd-a994-406e-b39f-5f7cdbf26268 req-51ffaa1d-67ef-4366-9185-68b1dff29c0f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.732132 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4ade21bd-a994-406e-b39f-5f7cdbf26268 req-51ffaa1d-67ef-4366-9185-68b1dff29c0f service nova] Creating event network-changed:43aab893-af24-479f-b6ac-8648136a4de1 for instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 on n-h2-862964-4 Oct 29 02:55:46.743679 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4ade21bd-a994-406e-b39f-5f7cdbf26268 req-51ffaa1d-67ef-4366-9185-68b1dff29c0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093315 Oct 29 02:55:46.745269 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1368/2666] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:47.013986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-66ae62ea-01f6-4c4a-95e0-90419c60ae47 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:47.015845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-66ae62ea-01f6-4c4a-95e0-90419c60ae47 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:47.028781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ae62ea-01f6-4c4a-95e0-90419c60ae47 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.029680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ae62ea-01f6-4c4a-95e0-90419c60ae47 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.030342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ae62ea-01f6-4c4a-95e0-90419c60ae47 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.034841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ae62ea-01f6-4c4a-95e0-90419c60ae47 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.036691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ae62ea-01f6-4c4a-95e0-90419c60ae47 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.037491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ae62ea-01f6-4c4a-95e0-90419c60ae47 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.264802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-66ae62ea-01f6-4c4a-95e0-90419c60ae47 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:47.273338 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-66ae62ea-01f6-4c4a-95e0-90419c60ae47 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 200 len: 1184 microversion: 2.1 time: 0.263700 Oct 29 02:55:47.292731 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1369/2667] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:47 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 1184 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:47.656132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-237defe2-b18c-4bc8-99a3-05dd17f66466 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a86d0160>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:47.758071 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-237defe2-b18c-4bc8-99a3-05dd17f66466 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.106835 Oct 29 02:55:47.769783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d0b21e0c-5c4f-4e07-9d1d-809d5fed5291 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:47.777869 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d0b21e0c-5c4f-4e07-9d1d-809d5fed5291 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1315 microversion: 2.1 time: 1.526739 Oct 29 02:55:47.778129 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1370/2668] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:47 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:47.783041 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1299/2669] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:46 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1315 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:48.306800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:48.307654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 5c0253f5-cea4-471a-97d6-16c7702c07ee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:48.324903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:48.329392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:48.331267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:48.333874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:48.346711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:48.347323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:48.387164 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] HTTP exception thrown: Instance 5c0253f5-cea4-471a-97d6-16c7702c07ee could not be found. Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Request method failure captured: Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee HTTP/1.1 Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQ4oadDTWZ6gY9J7t_an5xFUorYOuLNrBWfJOUIDO_MZeNVqLOvsGQdtUu4lVuztvy2rbcyfGYmqcgVVSkmaKvS60NGgmAbvrfrLA2gJ3Ep4kytbp8cuCoPsDRu7ctSGZVqDgi5c_9ydXTgn0VbwIq1DX0OP3NHtyCSJ1p58HkE1mE Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: a1287e36822b48f9a9020375bd0da2ab Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-LiveMigrationTest-737300509 Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a1287e36822b48f9a9020375bd0da2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1287e36822b48f9a9020375bd0da2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a1287e36822b48f9a9020375bd0da2ab", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1287e36822b48f9a9020375bd0da2ab"}]}] Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-LiveMigrationTest-737300509 Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: a1287e36822b48f9a9020375bd0da2ab Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-LiveMigrationTest-737300509 Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-LiveMigrationTest-737300509-project Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 6c2aa25bffe3421e8a75d88388dd5441 Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-LiveMigrationTest-737300509-project Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 5c0253f5-cea4-471a-97d6-16c7702c07ee could not be found. Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '5c0253f5-cea4-471a-97d6-16c7702c07ee'} Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c0253f5-cea4-471a-97d6-16c7702c07ee could not be found. Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c0253f5-cea4-471a-97d6-16c7702c07ee could not be found. Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:48.400239 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:48.403898 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:48.403898 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:48.403898 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:48.403898 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:48.403898 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:48.403898 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c0253f5-cea4-471a-97d6-16c7702c07ee could not be found. Oct 29 02:55:48.403898 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:55:48.403898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Returning 404 to user: Instance 5c0253f5-cea4-471a-97d6-16c7702c07ee could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:48.403898 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b3154168-c10f-44ff-99b5-8ce96e4fc6f5 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee" status: 404 len: 111 microversion: 2.1 time: 0.098974 Oct 29 02:55:48.403898 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1371/2670] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:48 2022] GET /compute/v2.1/servers/5c0253f5-cea4-471a-97d6-16c7702c07ee => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:48.774292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-874e384d-ed58-4428-a162-0d6c91599058 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8f46d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:48.810906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2c80e4eb-fc41-4bb7-9ab1-83757b5fd732 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:48.813474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2c80e4eb-fc41-4bb7-9ab1-83757b5fd732 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:48.835666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c80e4eb-fc41-4bb7-9ab1-83757b5fd732 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:48.847609 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-874e384d-ed58-4428-a162-0d6c91599058 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.075866 Oct 29 02:55:48.851869 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1300/2671] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:48 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:48.852739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c80e4eb-fc41-4bb7-9ab1-83757b5fd732 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:48.853337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c80e4eb-fc41-4bb7-9ab1-83757b5fd732 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:48.854811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c80e4eb-fc41-4bb7-9ab1-83757b5fd732 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:48.855485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c80e4eb-fc41-4bb7-9ab1-83757b5fd732 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:48.856039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c80e4eb-fc41-4bb7-9ab1-83757b5fd732 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:49.356341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c80e4eb-fc41-4bb7-9ab1-83757b5fd732 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:49.380185 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2c80e4eb-fc41-4bb7-9ab1-83757b5fd732 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1315 microversion: 2.1 time: 0.573623 Oct 29 02:55:49.381758 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1372/2672] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:48 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:49.865588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6cd469f0-e15f-4281-a43a-222f9670dfa2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c07d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:49.952852 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6cd469f0-e15f-4281-a43a-222f9670dfa2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.092202 Oct 29 02:55:49.953565 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1301/2673] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:49 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:50.409230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-14d1c5cc-98b3-4920-9456-8bd8255a3a8d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:50.410772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-14d1c5cc-98b3-4920-9456-8bd8255a3a8d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:50.421711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:50.431070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:50.437110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14d1c5cc-98b3-4920-9456-8bd8255a3a8d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:50.438075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14d1c5cc-98b3-4920-9456-8bd8255a3a8d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:50.438715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14d1c5cc-98b3-4920-9456-8bd8255a3a8d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:50.440412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14d1c5cc-98b3-4920-9456-8bd8255a3a8d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:50.446520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14d1c5cc-98b3-4920-9456-8bd8255a3a8d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:50.448282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14d1c5cc-98b3-4920-9456-8bd8255a3a8d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:50.969470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dc101434-23d5-4a0e-afaa-5d2ff41a40d5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8a45ca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:51.062236 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dc101434-23d5-4a0e-afaa-5d2ff41a40d5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.096962 Oct 29 02:55:51.074306 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1302/2674] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:50 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:51.387904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-14d1c5cc-98b3-4920-9456-8bd8255a3a8d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:51.414310 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-14d1c5cc-98b3-4920-9456-8bd8255a3a8d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1315 microversion: 2.1 time: 0.992456 Oct 29 02:55:51.415163 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1373/2675] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:50 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1315 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:52.079730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c19373df-29b6-430a-aaaf-4dfcbd307c07 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c078b0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:52.207313 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c19373df-29b6-430a-aaaf-4dfcbd307c07 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.132722 Oct 29 02:55:52.207974 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1303/2676] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:52 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:52.438216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-224325c8-f7ac-4f22-b433-da81198d1ef2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:52.438818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-224325c8-f7ac-4f22-b433-da81198d1ef2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:52.454967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-224325c8-f7ac-4f22-b433-da81198d1ef2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:52.460983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-224325c8-f7ac-4f22-b433-da81198d1ef2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:52.469336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-224325c8-f7ac-4f22-b433-da81198d1ef2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:52.471842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-224325c8-f7ac-4f22-b433-da81198d1ef2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:52.472327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-224325c8-f7ac-4f22-b433-da81198d1ef2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:52.472762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-224325c8-f7ac-4f22-b433-da81198d1ef2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:53.223126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64d10341-755e-49ba-b5b7-ef044451758b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8ac1d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:53.305821 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-64d10341-755e-49ba-b5b7-ef044451758b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.086397 Oct 29 02:55:53.310211 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1304/2677] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:53 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:53.403533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-224325c8-f7ac-4f22-b433-da81198d1ef2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:53.432125 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-224325c8-f7ac-4f22-b433-da81198d1ef2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1315 microversion: 2.1 time: 0.999009 Oct 29 02:55:53.437572 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1374/2678] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:52 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1315 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:54.323487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-22d78ced-3471-4d2c-9d8e-923715285fa2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a88978b0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:54.460289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-58f7b422-56b4-4edd-bedd-2dc361d4eadd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:54.461540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-58f7b422-56b4-4edd-bedd-2dc361d4eadd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:54.469720 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-22d78ced-3471-4d2c-9d8e-923715285fa2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.150643 Oct 29 02:55:54.470804 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1305/2679] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:54 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:54.473308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f7b422-56b4-4edd-bedd-2dc361d4eadd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:54.486712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f7b422-56b4-4edd-bedd-2dc361d4eadd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:54.487460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f7b422-56b4-4edd-bedd-2dc361d4eadd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:54.488627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f7b422-56b4-4edd-bedd-2dc361d4eadd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:54.490632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f7b422-56b4-4edd-bedd-2dc361d4eadd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:54.491092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f7b422-56b4-4edd-bedd-2dc361d4eadd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:55.490732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0a429d15-2be3-4311-967d-6c1572853614 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8993d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:55.538757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-58f7b422-56b4-4edd-bedd-2dc361d4eadd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:55.549154 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-58f7b422-56b4-4edd-bedd-2dc361d4eadd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1315 microversion: 2.1 time: 1.092636 Oct 29 02:55:55.549553 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1375/2680] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:54 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:55.583512 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0a429d15-2be3-4311-967d-6c1572853614 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.102699 Oct 29 02:55:55.585383 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1306/2681] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:55 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:56.576944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b1e5a33f-ff83-4db2-99b3-24efc8dbfa3f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:56.577564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b1e5a33f-ff83-4db2-99b3-24efc8dbfa3f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:56.593993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1e5a33f-ff83-4db2-99b3-24efc8dbfa3f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:56.599259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a5c0320-de2d-433a-8865-c69325e6caa7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c07d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:56.605559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=19 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:56.610894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1e5a33f-ff83-4db2-99b3-24efc8dbfa3f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:56.611359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1e5a33f-ff83-4db2-99b3-24efc8dbfa3f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:56.612128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1e5a33f-ff83-4db2-99b3-24efc8dbfa3f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:56.612593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1e5a33f-ff83-4db2-99b3-24efc8dbfa3f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:56.613021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1e5a33f-ff83-4db2-99b3-24efc8dbfa3f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:56.729611 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1a5c0320-de2d-433a-8865-c69325e6caa7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.133159 Oct 29 02:55:56.730377 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1307/2682] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:56 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:57.244412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b1e5a33f-ff83-4db2-99b3-24efc8dbfa3f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:57.259561 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b1e5a33f-ff83-4db2-99b3-24efc8dbfa3f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1315 microversion: 2.1 time: 0.681996 Oct 29 02:55:57.264312 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1376/2683] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:56 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:57.303188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-6b8e6432-6ff5-4e32-bafc-1672a64a823a req-3b0c17ac-493c-441e-8c9e-5585366d7cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1615ba83-e03b-4936-9ea2-f08ea0436ec9", "name": "network-vif-plugged", "status": "completed", "tag": "43aab893-af24-479f-b6ac-8648136a4de1"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:57.330038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6b8e6432-6ff5-4e32-bafc-1672a64a823a req-3b0c17ac-493c-441e-8c9e-5585366d7cd9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:57.330558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6b8e6432-6ff5-4e32-bafc-1672a64a823a req-3b0c17ac-493c-441e-8c9e-5585366d7cd9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:57.330993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6b8e6432-6ff5-4e32-bafc-1672a64a823a req-3b0c17ac-493c-441e-8c9e-5585366d7cd9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:57.358850 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-6b8e6432-6ff5-4e32-bafc-1672a64a823a req-3b0c17ac-493c-441e-8c9e-5585366d7cd9 service nova] Creating event network-vif-plugged:43aab893-af24-479f-b6ac-8648136a4de1 for instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 on n-h2-862964-4 Oct 29 02:55:57.375490 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-6b8e6432-6ff5-4e32-bafc-1672a64a823a req-3b0c17ac-493c-441e-8c9e-5585366d7cd9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076717 Oct 29 02:55:57.378307 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1308/2684] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:55:57.650849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-67451d6a-103f-42f9-8460-d52af0ce2636 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:57.651401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-67451d6a-103f-42f9-8460-d52af0ce2636 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:57.674269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67451d6a-103f-42f9-8460-d52af0ce2636 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:57.680742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67451d6a-103f-42f9-8460-d52af0ce2636 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:57.682340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67451d6a-103f-42f9-8460-d52af0ce2636 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:57.686682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67451d6a-103f-42f9-8460-d52af0ce2636 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:57.688441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67451d6a-103f-42f9-8460-d52af0ce2636 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:57.690049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67451d6a-103f-42f9-8460-d52af0ce2636 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:57.745415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-47f668e1-feab-467b-b5d3-f797db67b1ff tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8927dc0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:57.799382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-67451d6a-103f-42f9-8460-d52af0ce2636 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:57.859887 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-47f668e1-feab-467b-b5d3-f797db67b1ff tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.119056 Oct 29 02:55:57.860796 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1309/2685] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:57 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:57.956661 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-67451d6a-103f-42f9-8460-d52af0ce2636 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "DELETE /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 204 len: 0 microversion: 2.1 time: 0.308798 Oct 29 02:55:57.961605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1377/2686] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:57 2022] DELETE /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:57.966738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-54668850-b64b-4350-990a-800d4cf82d39 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:57.968260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-54668850-b64b-4350-990a-800d4cf82d39 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:57.985991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54668850-b64b-4350-990a-800d4cf82d39 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:57.988879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54668850-b64b-4350-990a-800d4cf82d39 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:57.989543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54668850-b64b-4350-990a-800d4cf82d39 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:57.990465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54668850-b64b-4350-990a-800d4cf82d39 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:57.996557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54668850-b64b-4350-990a-800d4cf82d39 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:57.997019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54668850-b64b-4350-990a-800d4cf82d39 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:58.289821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-733c45c9-38f5-45c2-b083-35e3512d0404 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:58.290895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-733c45c9-38f5-45c2-b083-35e3512d0404 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:58.303709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-733c45c9-38f5-45c2-b083-35e3512d0404 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:58.304437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-733c45c9-38f5-45c2-b083-35e3512d0404 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:58.305179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-733c45c9-38f5-45c2-b083-35e3512d0404 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:58.306085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-733c45c9-38f5-45c2-b083-35e3512d0404 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:58.310585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-733c45c9-38f5-45c2-b083-35e3512d0404 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:58.311180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-733c45c9-38f5-45c2-b083-35e3512d0404 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:58.417941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-54668850-b64b-4350-990a-800d4cf82d39 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:58.432815 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-54668850-b64b-4350-990a-800d4cf82d39 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1665 microversion: 2.1 time: 0.469421 Oct 29 02:55:58.434263 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1310/2687] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:57 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1665 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:58.876055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e0efc132-ca34-4573-bdf1-29b2af33e776 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a88ff3a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:58.965230 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e0efc132-ca34-4573-bdf1-29b2af33e776 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.093575 Oct 29 02:55:58.972555 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1311/2688] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:58 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:59.081332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-733c45c9-38f5-45c2-b083-35e3512d0404 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:59.092733 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-733c45c9-38f5-45c2-b083-35e3512d0404 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1315 microversion: 2.1 time: 0.807069 Oct 29 02:55:59.125551 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1378/2689] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:58 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1315 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:59.460688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ee00e7a7-11c9-4224-8f1f-bb2ffa151425 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:59.461483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ee00e7a7-11c9-4224-8f1f-bb2ffa151425 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:59.490567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee00e7a7-11c9-4224-8f1f-bb2ffa151425 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:59.492390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee00e7a7-11c9-4224-8f1f-bb2ffa151425 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:59.492840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee00e7a7-11c9-4224-8f1f-bb2ffa151425 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:59.493635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee00e7a7-11c9-4224-8f1f-bb2ffa151425 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:59.494065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee00e7a7-11c9-4224-8f1f-bb2ffa151425 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:59.494482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee00e7a7-11c9-4224-8f1f-bb2ffa151425 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:59.980735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-959cb0ce-697a-4a71-b86e-3cb48cafb9e8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8788a60>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:00.060152 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-959cb0ce-697a-4a71-b86e-3cb48cafb9e8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.083229 Oct 29 02:56:00.075873 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1379/2690] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:59 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:00.133043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e49fd3f4-964a-4908-b45d-86fbb801c7ba tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:00.135054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e49fd3f4-964a-4908-b45d-86fbb801c7ba tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:00.154661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49fd3f4-964a-4908-b45d-86fbb801c7ba tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:00.155158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49fd3f4-964a-4908-b45d-86fbb801c7ba tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:00.155585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49fd3f4-964a-4908-b45d-86fbb801c7ba tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:00.163037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49fd3f4-964a-4908-b45d-86fbb801c7ba tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:00.166116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49fd3f4-964a-4908-b45d-86fbb801c7ba tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:00.170241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49fd3f4-964a-4908-b45d-86fbb801c7ba tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:00.890653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ee00e7a7-11c9-4224-8f1f-bb2ffa151425 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:00.906226 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ee00e7a7-11c9-4224-8f1f-bb2ffa151425 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1665 microversion: 2.1 time: 1.444005 Oct 29 02:56:00.907493 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1312/2691] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:59 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1665 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:01.030457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e49fd3f4-964a-4908-b45d-86fbb801c7ba tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:01.040730 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e49fd3f4-964a-4908-b45d-86fbb801c7ba tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1501 microversion: 2.1 time: 0.912076 Oct 29 02:56:01.049041 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1380/2692] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:00 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1501 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:01.074836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-95459de8-d8a1-449d-ab15-10099dec5322 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8993e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:01.159258 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-95459de8-d8a1-449d-ab15-10099dec5322 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.088047 Oct 29 02:56:01.167337 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1313/2693] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:01 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:01.934455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-56806768-cfea-4b58-9e0d-d15a8485ef18 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:01.935271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-56806768-cfea-4b58-9e0d-d15a8485ef18 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:01.948910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56806768-cfea-4b58-9e0d-d15a8485ef18 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:01.954110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56806768-cfea-4b58-9e0d-d15a8485ef18 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:01.967427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56806768-cfea-4b58-9e0d-d15a8485ef18 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:01.968466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56806768-cfea-4b58-9e0d-d15a8485ef18 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:01.969172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56806768-cfea-4b58-9e0d-d15a8485ef18 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:01.970515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56806768-cfea-4b58-9e0d-d15a8485ef18 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:02.176754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cc224f5d-9eb3-4e83-8e25-661327b99c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8beedc0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:02.313840 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cc224f5d-9eb3-4e83-8e25-661327b99c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.141667 Oct 29 02:56:02.314519 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1314/2694] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:02 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:02.823437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-56806768-cfea-4b58-9e0d-d15a8485ef18 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:02.831911 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-56806768-cfea-4b58-9e0d-d15a8485ef18 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1665 microversion: 2.1 time: 0.901462 Oct 29 02:56:02.840612 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1381/2695] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:01 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1665 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:03.332028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e06c45f1-4441-48e0-97b8-c277d07e9bfc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a88ffb80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:03.443014 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e06c45f1-4441-48e0-97b8-c277d07e9bfc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.116951 Oct 29 02:56:03.451804 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1315/2696] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:03 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:03.860354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a81c71b0-a7f9-42cf-a1e7-9c8cda09d2d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:03.860916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a81c71b0-a7f9-42cf-a1e7-9c8cda09d2d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:03.864162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:03.905360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81c71b0-a7f9-42cf-a1e7-9c8cda09d2d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:03.913966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81c71b0-a7f9-42cf-a1e7-9c8cda09d2d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:03.914876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81c71b0-a7f9-42cf-a1e7-9c8cda09d2d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:03.920258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81c71b0-a7f9-42cf-a1e7-9c8cda09d2d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:03.922380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81c71b0-a7f9-42cf-a1e7-9c8cda09d2d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:03.922970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81c71b0-a7f9-42cf-a1e7-9c8cda09d2d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:04.026910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:04.739465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a81c71b0-a7f9-42cf-a1e7-9c8cda09d2d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:04.765573 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a81c71b0-a7f9-42cf-a1e7-9c8cda09d2d1 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 200 len: 1599 microversion: 2.1 time: 0.909258 Oct 29 02:56:04.777197 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1382/2697] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:03 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 1599 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:04.784728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-05f644e5-abc2-4b3e-97ea-1ed1ca98af10 req-1f19d31c-668c-4bc6-b40b-a3207bffd3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b8047-ca96-48bc-8950-57a0b6f0d537", "name": "network-vif-deleted", "tag": "a5042009-6ba4-421a-b724-be960ba5a87f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:04.795109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3349c981-97bd-424d-a633-3108603705cb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acc3b790>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:04.808987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-05f644e5-abc2-4b3e-97ea-1ed1ca98af10 req-1f19d31c-668c-4bc6-b40b-a3207bffd3cf service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:04.819504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-05f644e5-abc2-4b3e-97ea-1ed1ca98af10 req-1f19d31c-668c-4bc6-b40b-a3207bffd3cf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:04.820349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-05f644e5-abc2-4b3e-97ea-1ed1ca98af10 req-1f19d31c-668c-4bc6-b40b-a3207bffd3cf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:04.867856 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-05f644e5-abc2-4b3e-97ea-1ed1ca98af10 req-1f19d31c-668c-4bc6-b40b-a3207bffd3cf service nova] Creating event network-vif-deleted:a5042009-6ba4-421a-b724-be960ba5a87f for instance 239b8047-ca96-48bc-8950-57a0b6f0d537 on n-h1-862964-4 Oct 29 02:56:04.895262 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-05f644e5-abc2-4b3e-97ea-1ed1ca98af10 req-1f19d31c-668c-4bc6-b40b-a3207bffd3cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.881166 Oct 29 02:56:04.895824 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1316/2698] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:56:04.923468 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3349c981-97bd-424d-a633-3108603705cb tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.145137 Oct 29 02:56:04.924689 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1383/2699] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:04 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:05.147545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-716dc27b-bb50-4b52-a031-0760fac95066 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfaff4e0-231b-45ea-b021-368d98bbbe4b"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:05.157264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-716dc27b-bb50-4b52-a031-0760fac95066 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:05.178614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-716dc27b-bb50-4b52-a031-0760fac95066 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:05.179112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-716dc27b-bb50-4b52-a031-0760fac95066 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:05.179547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-716dc27b-bb50-4b52-a031-0760fac95066 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:05.180260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-716dc27b-bb50-4b52-a031-0760fac95066 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:05.180713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-716dc27b-bb50-4b52-a031-0760fac95066 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:05.181128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-716dc27b-bb50-4b52-a031-0760fac95066 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:05.803062 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-716dc27b-bb50-4b52-a031-0760fac95066 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.659804 Oct 29 02:56:05.809449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:05.811233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: 239b8047-ca96-48bc-8950-57a0b6f0d537] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:05.818490 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1317/2700] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 02:56:05 2022] POST /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:05.846636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:05.848648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:05.849083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:05.849851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:05.850323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:05.854369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:05.916094 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] HTTP exception thrown: Instance 239b8047-ca96-48bc-8950-57a0b6f0d537 could not be found. Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Request method failure captured: Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 HTTP/1.1 Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQ4oadDTWZ6gY9J7t_an5xFUorYOuLNrBWfJOUIDO_MZeNVqLOvsGQdtUu4lVuztvy2rbcyfGYmqcgVVSkmaKvS60NGgmAbvrfrLA2gJ3Ep4kytbp8cuCoPsDRu7ctSGZVqDgi5c_9ydXTgn0VbwIq1DX0OP3NHtyCSJ1p58HkE1mE Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: a1287e36822b48f9a9020375bd0da2ab Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-LiveMigrationTest-737300509 Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a1287e36822b48f9a9020375bd0da2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1287e36822b48f9a9020375bd0da2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a1287e36822b48f9a9020375bd0da2ab", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1287e36822b48f9a9020375bd0da2ab"}]}] Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-LiveMigrationTest-737300509 Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: a1287e36822b48f9a9020375bd0da2ab Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-LiveMigrationTest-737300509 Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-LiveMigrationTest-737300509-project Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 6c2aa25bffe3421e8a75d88388dd5441 Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-LiveMigrationTest-737300509-project Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 239b8047-ca96-48bc-8950-57a0b6f0d537 could not be found. Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '239b8047-ca96-48bc-8950-57a0b6f0d537'} Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239b8047-ca96-48bc-8950-57a0b6f0d537 could not be found. Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239b8047-ca96-48bc-8950-57a0b6f0d537 could not be found. Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:05.922807 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:05.927753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:05.927753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:05.927753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:05.927753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:05.927753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:05.927753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239b8047-ca96-48bc-8950-57a0b6f0d537 could not be found. Oct 29 02:56:05.927753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:05.929615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Returning 404 to user: Instance 239b8047-ca96-48bc-8950-57a0b6f0d537 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:05.939693 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f8b5c87-35e1-40b2-8d7d-4f6dd59fb6a0 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537" status: 404 len: 111 microversion: 2.1 time: 0.143425 Oct 29 02:56:05.940980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f5992244-e848-4c70-b2dc-90aa0805fb81 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a88ffe50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:05.942498 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1384/2701] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:05 2022] GET /compute/v2.1/servers/239b8047-ca96-48bc-8950-57a0b6f0d537 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:05.956944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5b3bce0e-848c-49cf-8025-301c2bb8c6cf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '.version_select at 0x7fe1a3f513a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:05.999753 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5b3bce0e-848c-49cf-8025-301c2bb8c6cf tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1743298275" status: 202 len: 0 microversion: 2.1 time: 0.051723 Oct 29 02:56:06.001399 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1385/2702] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 02:56:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1743298275 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:56:06.104157 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f5992244-e848-4c70-b2dc-90aa0805fb81 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.167920 Oct 29 02:56:06.107668 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1318/2703] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:05 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:07.124747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-192161dc-52dd-46e6-bd37-db9b6a47e7a2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a3f5a0d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:07.227024 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-192161dc-52dd-46e6-bd37-db9b6a47e7a2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.107675 Oct 29 02:56:07.235028 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1386/2704] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:07 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:07.990978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d78ad601-d3e1-4eba-98fa-f34f9850624b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:07.992458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d78ad601-d3e1-4eba-98fa-f34f9850624b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:08.014835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78ad601-d3e1-4eba-98fa-f34f9850624b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:08.020229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78ad601-d3e1-4eba-98fa-f34f9850624b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:08.025614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78ad601-d3e1-4eba-98fa-f34f9850624b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:08.026585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78ad601-d3e1-4eba-98fa-f34f9850624b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:08.027725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78ad601-d3e1-4eba-98fa-f34f9850624b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:08.028274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d78ad601-d3e1-4eba-98fa-f34f9850624b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:08.080726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:08.151837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d78ad601-d3e1-4eba-98fa-f34f9850624b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:56:08.455526 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d78ad601-d3e1-4eba-98fa-f34f9850624b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 204 len: 0 microversion: 2.1 time: 0.465413 Oct 29 02:56:08.461395 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1319/2705] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:56:07 2022] DELETE /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:56:08.489629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ba782e6-d0d5-4525-8aa7-79fec05d81d9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8ac1790>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:08.587153 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ba782e6-d0d5-4525-8aa7-79fec05d81d9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.121672 Oct 29 02:56:08.598816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89ffec55-76db-4c49-a883-c684710782d0 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a3f5a550>, body: {"quota_set": {"ram": "5120"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:08.609014 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1320/2706] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:08 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:08.619039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8c9a0963-a10c-43bd-8c57-08a7e410ec9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:08.642169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8c9a0963-a10c-43bd-8c57-08a7e410ec9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:08.679016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c9a0963-a10c-43bd-8c57-08a7e410ec9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:08.685986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c9a0963-a10c-43bd-8c57-08a7e410ec9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:08.687291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c9a0963-a10c-43bd-8c57-08a7e410ec9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:08.688292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c9a0963-a10c-43bd-8c57-08a7e410ec9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:08.689219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c9a0963-a10c-43bd-8c57-08a7e410ec9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:08.689920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c9a0963-a10c-43bd-8c57-08a7e410ec9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:08.766816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89ffec55-76db-4c49-a883-c684710782d0 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:08.767854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89ffec55-76db-4c49-a883-c684710782d0 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:08.782740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89ffec55-76db-4c49-a883-c684710782d0 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:08.783960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89ffec55-76db-4c49-a883-c684710782d0 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:08.788619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89ffec55-76db-4c49-a883-c684710782d0 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:08.789290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89ffec55-76db-4c49-a883-c684710782d0 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:08.984255 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89ffec55-76db-4c49-a883-c684710782d0 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/bc29332e0f5d4f199cdbecd7b351bd54" status: 200 len: 240 microversion: 2.36 time: 0.846704 Oct 29 02:56:08.987413 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1387/2707] 10.222.0.16 () {62 vars in 1303 bytes} [Sat Oct 29 02:56:08 2022] PUT /compute/v2.1/os-quota-sets/bc29332e0f5d4f199cdbecd7b351bd54 => generated 240 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:56:09.001379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b2efa214-5695-46ef-b888-e4ec674378dd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Calling method '.version_select at 0x7fe1a3f55b80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:09.183857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2efa214-5695-46ef-b888-e4ec674378dd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:09.185250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2efa214-5695-46ef-b888-e4ec674378dd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:09.186240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2efa214-5695-46ef-b888-e4ec674378dd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:09.188586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2efa214-5695-46ef-b888-e4ec674378dd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:09.188586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2efa214-5695-46ef-b888-e4ec674378dd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:09.189024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2efa214-5695-46ef-b888-e4ec674378dd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:09.265655 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b2efa214-5695-46ef-b888-e4ec674378dd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/bc29332e0f5d4f199cdbecd7b351bd54/detail" status: 200 len: 672 microversion: 2.36 time: 0.268109 Oct 29 02:56:09.268271 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1388/2708] 10.222.0.16 () {60 vars in 1304 bytes} [Sat Oct 29 02:56:08 2022] GET /compute/v2.1/os-quota-sets/bc29332e0f5d4f199cdbecd7b351bd54/detail => generated 672 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:56:09.436071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8c9a0963-a10c-43bd-8c57-08a7e410ec9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:09.454099 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8c9a0963-a10c-43bd-8c57-08a7e410ec9a tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1485 microversion: 2.1 time: 0.838099 Oct 29 02:56:09.458406 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1321/2709] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:08 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1485 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:09.490206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1178896741", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "0fccb82a-4c10-4bc7-8ac2-1bf80a33a0d1"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:09.624695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c6da402-7c5e-4aed-bc68-21685b95d8dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8a45b80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:09.649081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] validate_networks() for [('0fccb82a-4c10-4bc7-8ac2-1bf80a33a0d1', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:09.738579 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c6da402-7c5e-4aed-bc68-21685b95d8dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.118352 Oct 29 02:56:09.739329 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1322/2710] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:09 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:09.743966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a8a0f430>, body: {"quota_set": {"ram": "2048"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:09.891762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:09.892506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:09.893084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:09.893997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:09.894797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:09.895491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:09.992146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:09.994367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:09.995352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:10.000442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:10.001128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:10.001699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:10.137399 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-af740ddf-f4c4-4e4c-afac-dc0b8efb8c2c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/bc29332e0f5d4f199cdbecd7b351bd54?user_id=f12cc1ba4bec40029b31edf1e804e135" status: 200 len: 240 microversion: 2.36 time: 0.396824 Oct 29 02:56:10.144830 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1323/2711] 10.222.0.16 () {62 vars in 1384 bytes} [Sat Oct 29 02:56:09 2022] PUT /compute/v2.1/os-quota-sets/bc29332e0f5d4f199cdbecd7b351bd54?user_id=f12cc1ba4bec40029b31edf1e804e135 => generated 240 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:56:10.150124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b418e9c-f591-4417-86f9-87b7be894d32 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Calling method '.version_select at 0x7fe1a8a08dc0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:10.281383 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b418e9c-f591-4417-86f9-87b7be894d32 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/bc29332e0f5d4f199cdbecd7b351bd54?user_id=f12cc1ba4bec40029b31edf1e804e135" status: 200 len: 282 microversion: 2.36 time: 0.134949 Oct 29 02:56:10.289081 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1324/2712] 10.222.0.16 () {60 vars in 1364 bytes} [Sat Oct 29 02:56:10 2022] GET /compute/v2.1/os-quota-sets/bc29332e0f5d4f199cdbecd7b351bd54?user_id=f12cc1ba4bec40029b31edf1e804e135 => generated 282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:56:10.478534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1413138b-4eca-4738-a3e1-1a8eb8383920 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:10.480558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1413138b-4eca-4738-a3e1-1a8eb8383920 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:10.489795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1413138b-4eca-4738-a3e1-1a8eb8383920 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:10.492099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1413138b-4eca-4738-a3e1-1a8eb8383920 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:10.492972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1413138b-4eca-4738-a3e1-1a8eb8383920 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:10.496563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1413138b-4eca-4738-a3e1-1a8eb8383920 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:10.497298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1413138b-4eca-4738-a3e1-1a8eb8383920 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:10.500011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1413138b-4eca-4738-a3e1-1a8eb8383920 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:10.896995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1413138b-4eca-4738-a3e1-1a8eb8383920 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:10.925948 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1413138b-4eca-4738-a3e1-1a8eb8383920 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 200 len: 1443 microversion: 2.1 time: 0.453065 Oct 29 02:56:10.926615 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1325/2713] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:10 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 1443 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:10.941935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-babd8b63-c6da-44bb-ab60-4a2893b32e5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8c88430>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:11.089944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-babd8b63-c6da-44bb-ab60-4a2893b32e5c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.159195 Oct 29 02:56:11.091772 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1326/2714] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:10 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:11.299025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:11.300174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:11.300918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:11.301499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:11.302099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:11.324588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:11.326251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:11.332841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:11.333951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:11.335862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:11.338518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:11.402376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Getting quotas for project 9f94d5560cbe4ad98fdb148e80c66ffc. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:11.418958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Getting quotas for user 3c307a82cd9d4c3f884e67c376757a6a and project 9f94d5560cbe4ad98fdb148e80c66ffc. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:11.454074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:11.477160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:11.723734 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-067ea7a9-5ba7-4903-9168-cd9988da5e3f tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.452071 Oct 29 02:56:11.732707 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1389/2715] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:56:11.739159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c5168094-734c-492c-9a31-98a28566f93d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:11.739807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c5168094-734c-492c-9a31-98a28566f93d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:12.280880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c5168094-734c-492c-9a31-98a28566f93d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:12.290863 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c5168094-734c-492c-9a31-98a28566f93d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1217 microversion: 2.1 time: 0.556381 Oct 29 02:56:12.298143 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1327/2716] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:11 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1217 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:12.312999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:12.319100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: e22e9e45-c266-455e-8aff-da1aed5519ab] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:12.338134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:12.340883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:12.344745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:12.346678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:12.349077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:12.350607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:12.405670 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] HTTP exception thrown: Instance e22e9e45-c266-455e-8aff-da1aed5519ab could not be found. Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Request method failure captured: Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab HTTP/1.1 Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJQ4oadDTWZ6gY9J7t_an5xFUorYOuLNrBWfJOUIDO_MZeNVqLOvsGQdtUu4lVuztvy2rbcyfGYmqcgVVSkmaKvS60NGgmAbvrfrLA2gJ3Ep4kytbp8cuCoPsDRu7ctSGZVqDgi5c_9ydXTgn0VbwIq1DX0OP3NHtyCSJ1p58HkE1mE Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: a1287e36822b48f9a9020375bd0da2ab Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-LiveMigrationTest-737300509 Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a1287e36822b48f9a9020375bd0da2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1287e36822b48f9a9020375bd0da2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a1287e36822b48f9a9020375bd0da2ab", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1287e36822b48f9a9020375bd0da2ab"}]}] Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-LiveMigrationTest-737300509 Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: a1287e36822b48f9a9020375bd0da2ab Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-LiveMigrationTest-737300509 Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-LiveMigrationTest-737300509-project Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 6c2aa25bffe3421e8a75d88388dd5441 Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-LiveMigrationTest-737300509-project Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance e22e9e45-c266-455e-8aff-da1aed5519ab could not be found. Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'e22e9e45-c266-455e-8aff-da1aed5519ab'} Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22e9e45-c266-455e-8aff-da1aed5519ab could not be found. Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22e9e45-c266-455e-8aff-da1aed5519ab could not be found. Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:12.421925 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:12.426311 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:12.426311 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:12.426311 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:12.426311 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:12.426311 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:12.426311 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22e9e45-c266-455e-8aff-da1aed5519ab could not be found. Oct 29 02:56:12.426311 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:12.428749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Returning 404 to user: Instance e22e9e45-c266-455e-8aff-da1aed5519ab could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:12.429932 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-94f6dbfc-0db9-4a26-b67b-4d387cc2afc9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab" status: 404 len: 111 microversion: 2.1 time: 0.130287 Oct 29 02:56:12.432044 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1328/2717] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:12 2022] GET /compute/v2.1/servers/e22e9e45-c266-455e-8aff-da1aed5519ab => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:12.439094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-34e06e93-c4c3-40eb-8d7a-baf190934529 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8927a60>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:12.461968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-12e26b86-65cf-49f2-ae4e-dd40d24eab7a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'create', calling method: .version_select at 0x7fe1a3f5ae50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1507854415", "description": "tempest-description-17832629"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:12.568053 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-34e06e93-c4c3-40eb-8d7a-baf190934529 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1413 microversion: 2.1 time: 0.132311 Oct 29 02:56:12.570539 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1329/2718] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:12 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1413 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:12.587993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b09f129c-e706-4515-8886-f40a026583cf req-c2f08fd6-1fbc-40f3-84f9-102283588230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22e9e45-c266-455e-8aff-da1aed5519ab", "name": "network-vif-deleted", "tag": "675d097b-03fe-4cf0-9756-d0e175fce642"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:12.632942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b09f129c-e706-4515-8886-f40a026583cf req-c2f08fd6-1fbc-40f3-84f9-102283588230 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:12.634565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b09f129c-e706-4515-8886-f40a026583cf req-c2f08fd6-1fbc-40f3-84f9-102283588230 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:12.635455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b09f129c-e706-4515-8886-f40a026583cf req-c2f08fd6-1fbc-40f3-84f9-102283588230 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:12.678084 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b09f129c-e706-4515-8886-f40a026583cf req-c2f08fd6-1fbc-40f3-84f9-102283588230 service nova] Creating event network-vif-deleted:675d097b-03fe-4cf0-9756-d0e175fce642 for instance e22e9e45-c266-455e-8aff-da1aed5519ab on n-h1-862964-4 Oct 29 02:56:12.704906 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b09f129c-e706-4515-8886-f40a026583cf req-c2f08fd6-1fbc-40f3-84f9-102283588230 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122432 Oct 29 02:56:12.711999 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1330/2719] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:12.721091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f2aacbc-e4a3-41a0-a8f2-778c8392e9dc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:12.732568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f2aacbc-e4a3-41a0-a8f2-778c8392e9dc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:12.763128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f2aacbc-e4a3-41a0-a8f2-778c8392e9dc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:12.764489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f2aacbc-e4a3-41a0-a8f2-778c8392e9dc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:12.768577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f2aacbc-e4a3-41a0-a8f2-778c8392e9dc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:12.770671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f2aacbc-e4a3-41a0-a8f2-778c8392e9dc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:12.777556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f2aacbc-e4a3-41a0-a8f2-778c8392e9dc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:12.779586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f2aacbc-e4a3-41a0-a8f2-778c8392e9dc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:12.929226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f2aacbc-e4a3-41a0-a8f2-778c8392e9dc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:56:13.125029 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-12e26b86-65cf-49f2-ae4e-dd40d24eab7a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.225048 Oct 29 02:56:13.126791 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1390/2720] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:56:11 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:13.147163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e6bda49c-3e8d-4fe4-9edd-41ded44f0457 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'create', calling method: .version_select at 0x7fe1a886b940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1820591265", "description": "tempest-description-936847019"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:13.201200 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f2aacbc-e4a3-41a0-a8f2-778c8392e9dc tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 204 len: 0 microversion: 2.1 time: 0.483698 Oct 29 02:56:13.202747 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1331/2721] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:56:12 2022] DELETE /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:56:13.241029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ad9131e4-f466-4937-b5f7-38fa801b4f7b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:13.245555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ad9131e4-f466-4937-b5f7-38fa801b4f7b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:13.265716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9131e4-f466-4937-b5f7-38fa801b4f7b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:13.267136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9131e4-f466-4937-b5f7-38fa801b4f7b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:13.267629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9131e4-f466-4937-b5f7-38fa801b4f7b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:13.268334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9131e4-f466-4937-b5f7-38fa801b4f7b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:13.273935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9131e4-f466-4937-b5f7-38fa801b4f7b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:13.275383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad9131e4-f466-4937-b5f7-38fa801b4f7b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:13.910001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ad9131e4-f466-4937-b5f7-38fa801b4f7b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:13.936025 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ad9131e4-f466-4937-b5f7-38fa801b4f7b tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1498 microversion: 2.1 time: 0.711820 Oct 29 02:56:14.006146 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1332/2722] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:13 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1498 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:14.017839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d84eda77-1e4c-4681-be39-e627db27c6dc tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:14.019084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d84eda77-1e4c-4681-be39-e627db27c6dc tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:14.039027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d84eda77-1e4c-4681-be39-e627db27c6dc tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:14.039627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d84eda77-1e4c-4681-be39-e627db27c6dc tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:14.039945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d84eda77-1e4c-4681-be39-e627db27c6dc tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:14.040662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d84eda77-1e4c-4681-be39-e627db27c6dc tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:14.046869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d84eda77-1e4c-4681-be39-e627db27c6dc tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:14.049464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d84eda77-1e4c-4681-be39-e627db27c6dc tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:14.417444 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e6bda49c-3e8d-4fe4-9edd-41ded44f0457 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.275829 Oct 29 02:56:14.418134 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1391/2723] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:56:13 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:56:14.446483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8af5c86b-c683-47db-a3e0-34f48d2ceb5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a806c280>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:14.544057 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8af5c86b-c683-47db-a3e0-34f48d2ceb5b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1422 microversion: 2.1 time: 0.124510 Oct 29 02:56:14.545096 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1392/2724] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:14 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1422 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:14.566629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-213a5798-4834-4fcb-badc-c5f40343c9bf tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acc3bf70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:14.650546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d84eda77-1e4c-4681-be39-e627db27c6dc tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:14.665244 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d84eda77-1e4c-4681-be39-e627db27c6dc tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1221 microversion: 2.1 time: 0.657385 Oct 29 02:56:14.669574 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1333/2725] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:14 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1221 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:14.677478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2061355450", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "522cc676-82d1-4371-9935-f1df64119702"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:14.746959 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-213a5798-4834-4fcb-badc-c5f40343c9bf tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 200 len: 1422 microversion: 2.1 time: 0.191795 Oct 29 02:56:14.758315 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1393/2726] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:14 2022] GET /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 1422 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:14.907258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] validate_networks() for [('522cc676-82d1-4371-9935-f1df64119702', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:15.034328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-032e8ae7-ac08-4c8e-9053-db79b3bf81df tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:15.035739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-032e8ae7-ac08-4c8e-9053-db79b3bf81df tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:15.051310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032e8ae7-ac08-4c8e-9053-db79b3bf81df tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:15.053851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032e8ae7-ac08-4c8e-9053-db79b3bf81df tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:15.054485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032e8ae7-ac08-4c8e-9053-db79b3bf81df tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:15.055879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032e8ae7-ac08-4c8e-9053-db79b3bf81df tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:15.056506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032e8ae7-ac08-4c8e-9053-db79b3bf81df tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:15.057403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-032e8ae7-ac08-4c8e-9053-db79b3bf81df tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:15.346769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-032e8ae7-ac08-4c8e-9053-db79b3bf81df tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2aa25bffe3421e8a75d88388dd5441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1287e36822b48f9a9020375bd0da2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:15.366343 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-032e8ae7-ac08-4c8e-9053-db79b3bf81df tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 200 len: 1498 microversion: 2.1 time: 0.338590 Oct 29 02:56:15.368061 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1394/2727] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:15 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 1498 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:15.375352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1565543927", "imageRef": "c018922f-06ce-4979-8b41-5528024e3eea", "flavorRef": "452", "networks": [{"uuid": "0ef24500-837e-47a7-9e10-a72e3fb043af"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:15.516369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] validate_networks() for [('0ef24500-837e-47a7-9e10-a72e3fb043af', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:17.573407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:17.573929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:17.575430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:17.575937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:17.576478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:17.610934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:17.611512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:17.611954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:17.612687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:17.613143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:17.613566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:17.692033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Getting quotas for project 81d9071c47304d7ca128734f7bc8eeed. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:17.717515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Getting quotas for user f909cc7113594047add07a2bbd14187a and project 81d9071c47304d7ca128734f7bc8eeed. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:17.765512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:17.775253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:17.872030 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fce508a0-d7e1-46af-8d47-e1fc55671c44 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.200547 Oct 29 02:56:17.888795 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1334/2728] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:56:17.904596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6e27449c-f9d4-48e2-826c-517bfe1f7fba tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:17.905327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6e27449c-f9d4-48e2-826c-517bfe1f7fba tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:17.931788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e27449c-f9d4-48e2-826c-517bfe1f7fba tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:17.932977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e27449c-f9d4-48e2-826c-517bfe1f7fba tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:17.940282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e27449c-f9d4-48e2-826c-517bfe1f7fba tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:17.955083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e27449c-f9d4-48e2-826c-517bfe1f7fba tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:17.955960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e27449c-f9d4-48e2-826c-517bfe1f7fba tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:17.956556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e27449c-f9d4-48e2-826c-517bfe1f7fba tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:18.308660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:18.309082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:18.309685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:18.310450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:18.310903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:18.344516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:18.349166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:18.349899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:18.363624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:18.364205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:18.367167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:18.442029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:18.458719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for user 0868f50723074f2b98f7b1096743f3cc and project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:18.501788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:18.504404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c018922f-06ce-4979-8b41-5528024e3eea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:18.641743 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-265ff240-57fe-44aa-945d-755996069554 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.272222 Oct 29 02:56:18.648610 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1395/2729] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:56:18.666228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:18.667148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] [instance: c953eb9c-9ad8-471d-95d6-f95740b8b7f2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:18.684571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:18.685236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:18.686929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:18.687814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:18.695246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:18.696014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:18.728668 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] HTTP exception thrown: Instance c953eb9c-9ad8-471d-95d6-f95740b8b7f2 could not be found. Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Request method failure captured: Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 HTTP/1.1 Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJQ4oadDTWZ6gY9J7t_an5xFUorYOuLNrBWfJOUIDO_MZeNVqLOvsGQdtUu4lVuztvy2rbcyfGYmqcgVVSkmaKvS60NGgmAbvrfrLA2gJ3Ep4kytbp8cuCoPsDRu7ctSGZVqDgi5c_9ydXTgn0VbwIq1DX0OP3NHtyCSJ1p58HkE1mE Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: a1287e36822b48f9a9020375bd0da2ab Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-LiveMigrationTest-737300509 Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a1287e36822b48f9a9020375bd0da2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1287e36822b48f9a9020375bd0da2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a1287e36822b48f9a9020375bd0da2ab", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1287e36822b48f9a9020375bd0da2ab"}]}] Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-LiveMigrationTest-737300509 Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: a1287e36822b48f9a9020375bd0da2ab Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-LiveMigrationTest-737300509 Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-LiveMigrationTest-737300509-project Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 6c2aa25bffe3421e8a75d88388dd5441 Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-LiveMigrationTest-737300509-project Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance c953eb9c-9ad8-471d-95d6-f95740b8b7f2 could not be found. Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'c953eb9c-9ad8-471d-95d6-f95740b8b7f2'} Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c953eb9c-9ad8-471d-95d6-f95740b8b7f2 could not be found. Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c953eb9c-9ad8-471d-95d6-f95740b8b7f2 could not be found. Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:18.731690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:18.735352 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:18.735352 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:18.735352 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:18.735352 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:18.735352 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:18.735352 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c953eb9c-9ad8-471d-95d6-f95740b8b7f2 could not be found. Oct 29 02:56:18.735352 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:18.736648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] Returning 404 to user: Instance c953eb9c-9ad8-471d-95d6-f95740b8b7f2 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:18.737909 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-61817d44-0b2d-4f96-8054-0f0f1c5a53e9 tempest-LiveMigrationTest-737300509 tempest-LiveMigrationTest-737300509-project] 10.222.0.16 "GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2" status: 404 len: 111 microversion: 2.1 time: 0.088020 Oct 29 02:56:18.744370 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1396/2730] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:18 2022] GET /compute/v2.1/servers/c953eb9c-9ad8-471d-95d6-f95740b8b7f2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:18.754390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d1f218d7-a34f-4b56-ba12-e788bfc5bc6f req-13af67a3-7d36-40be-9435-b945caf1588c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c953eb9c-9ad8-471d-95d6-f95740b8b7f2", "name": "network-vif-deleted", "tag": "ac90b439-6117-4e0a-8668-61ae3bc23afb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:18.769218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d1f218d7-a34f-4b56-ba12-e788bfc5bc6f req-13af67a3-7d36-40be-9435-b945caf1588c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:18.770005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d1f218d7-a34f-4b56-ba12-e788bfc5bc6f req-13af67a3-7d36-40be-9435-b945caf1588c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:18.770593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d1f218d7-a34f-4b56-ba12-e788bfc5bc6f req-13af67a3-7d36-40be-9435-b945caf1588c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:18.802809 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d1f218d7-a34f-4b56-ba12-e788bfc5bc6f req-13af67a3-7d36-40be-9435-b945caf1588c service nova] Creating event network-vif-deleted:ac90b439-6117-4e0a-8668-61ae3bc23afb for instance c953eb9c-9ad8-471d-95d6-f95740b8b7f2 on n-h1-862964-4 Oct 29 02:56:18.833218 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d1f218d7-a34f-4b56-ba12-e788bfc5bc6f req-13af67a3-7d36-40be-9435-b945caf1588c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086399 Oct 29 02:56:18.834802 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1397/2731] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:18.841717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fcff7dc5-683c-4d24-b2ae-164017895687 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:18.846203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fcff7dc5-683c-4d24-b2ae-164017895687 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:19.105867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fcff7dc5-683c-4d24-b2ae-164017895687 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:19.134923 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fcff7dc5-683c-4d24-b2ae-164017895687 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1216 microversion: 2.1 time: 0.298451 Oct 29 02:56:19.139112 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1398/2732] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:18 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1216 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:19.157993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d25f635-40b1-4e5b-93da-a0023677aa33 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:19.159328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7d25f635-40b1-4e5b-93da-a0023677aa33 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:19.221031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6e27449c-f9d4-48e2-826c-517bfe1f7fba tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:19.238411 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6e27449c-f9d4-48e2-826c-517bfe1f7fba tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1275 microversion: 2.1 time: 1.346226 Oct 29 02:56:19.239565 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1335/2733] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:17 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1275 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:19.643189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-7a6c9dce-e465-47f3-8bd6-32e93299dc58 req-b8bf60c3-54a8-4dec-a3bc-c72a68c8be41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d", "name": "network-vif-unplugged", "status": "completed", "tag": "5fdf8084-8c8b-4cd7-a958-0335d3697a1c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:19.662250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7a6c9dce-e465-47f3-8bd6-32e93299dc58 req-b8bf60c3-54a8-4dec-a3bc-c72a68c8be41 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:19.664982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7a6c9dce-e465-47f3-8bd6-32e93299dc58 req-b8bf60c3-54a8-4dec-a3bc-c72a68c8be41 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:19.665663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7a6c9dce-e465-47f3-8bd6-32e93299dc58 req-b8bf60c3-54a8-4dec-a3bc-c72a68c8be41 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:19.679582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d25f635-40b1-4e5b-93da-a0023677aa33 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:19.689719 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d25f635-40b1-4e5b-93da-a0023677aa33 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1208 microversion: 2.1 time: 0.546248 Oct 29 02:56:19.691944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-7a6c9dce-e465-47f3-8bd6-32e93299dc58 req-b8bf60c3-54a8-4dec-a3bc-c72a68c8be41 service nova] Creating event network-vif-unplugged:5fdf8084-8c8b-4cd7-a958-0335d3697a1c for instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d on n-h1-862964-4 Oct 29 02:56:19.705944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-7a6c9dce-e465-47f3-8bd6-32e93299dc58 req-b8bf60c3-54a8-4dec-a3bc-c72a68c8be41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.461897 Oct 29 02:56:19.709580 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1399/2735] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:19 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1208 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:19.709752 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1336/2735] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:20.189865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-510d4c38-b287-41ad-be1c-2e92d8505c76 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:20.194341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-510d4c38-b287-41ad-be1c-2e92d8505c76 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:20.224034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-510d4c38-b287-41ad-be1c-2e92d8505c76 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:20.225303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-510d4c38-b287-41ad-be1c-2e92d8505c76 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:20.225790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-510d4c38-b287-41ad-be1c-2e92d8505c76 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:20.226628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-510d4c38-b287-41ad-be1c-2e92d8505c76 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:20.227141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-510d4c38-b287-41ad-be1c-2e92d8505c76 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:20.227623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-510d4c38-b287-41ad-be1c-2e92d8505c76 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:20.267994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-496e1ea2-c895-4bc6-988b-f7f858b6be92 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:20.268612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-496e1ea2-c895-4bc6-988b-f7f858b6be92 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:20.286082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496e1ea2-c895-4bc6-988b-f7f858b6be92 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:20.296501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496e1ea2-c895-4bc6-988b-f7f858b6be92 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:20.298345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496e1ea2-c895-4bc6-988b-f7f858b6be92 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:20.302049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496e1ea2-c895-4bc6-988b-f7f858b6be92 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:20.303885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496e1ea2-c895-4bc6-988b-f7f858b6be92 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:20.309604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-496e1ea2-c895-4bc6-988b-f7f858b6be92 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:20.579870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-510d4c38-b287-41ad-be1c-2e92d8505c76 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:20.602082 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-510d4c38-b287-41ad-be1c-2e92d8505c76 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1268 microversion: 2.1 time: 0.441710 Oct 29 02:56:20.609686 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1337/2736] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:20 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1268 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:20.718329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fff368a6-2e9b-49c5-b38c-e2c9839f0202 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:20.719498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fff368a6-2e9b-49c5-b38c-e2c9839f0202 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:20.736423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fff368a6-2e9b-49c5-b38c-e2c9839f0202 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:20.738402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fff368a6-2e9b-49c5-b38c-e2c9839f0202 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:20.740068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fff368a6-2e9b-49c5-b38c-e2c9839f0202 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:20.742142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fff368a6-2e9b-49c5-b38c-e2c9839f0202 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:20.742885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fff368a6-2e9b-49c5-b38c-e2c9839f0202 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:20.743693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fff368a6-2e9b-49c5-b38c-e2c9839f0202 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:20.864074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fff368a6-2e9b-49c5-b38c-e2c9839f0202 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:20.898399 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fff368a6-2e9b-49c5-b38c-e2c9839f0202 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1260 microversion: 2.1 time: 0.186492 Oct 29 02:56:20.900851 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1338/2737] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:20 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:20.965353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-496e1ea2-c895-4bc6-988b-f7f858b6be92 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:20.977197 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-496e1ea2-c895-4bc6-988b-f7f858b6be92 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1317 microversion: 2.1 time: 0.713331 Oct 29 02:56:20.983760 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1400/2738] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:20 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1317 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:21.636842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-803a368c-e514-4a53-a5f7-b0fffef7639a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:21.637699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-803a368c-e514-4a53-a5f7-b0fffef7639a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:21.652878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-803a368c-e514-4a53-a5f7-b0fffef7639a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:21.653392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-803a368c-e514-4a53-a5f7-b0fffef7639a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:21.660640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-803a368c-e514-4a53-a5f7-b0fffef7639a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:21.661523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-803a368c-e514-4a53-a5f7-b0fffef7639a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:21.662821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-803a368c-e514-4a53-a5f7-b0fffef7639a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:21.663260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-803a368c-e514-4a53-a5f7-b0fffef7639a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:21.929358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-04e2fddc-180c-43d9-a13f-a97320671c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:21.930031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-04e2fddc-180c-43d9-a13f-a97320671c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:21.947795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e2fddc-180c-43d9-a13f-a97320671c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:21.948798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e2fddc-180c-43d9-a13f-a97320671c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:21.949710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e2fddc-180c-43d9-a13f-a97320671c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:21.951098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e2fddc-180c-43d9-a13f-a97320671c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:21.951613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e2fddc-180c-43d9-a13f-a97320671c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:21.952035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e2fddc-180c-43d9-a13f-a97320671c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:22.190425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-04e2fddc-180c-43d9-a13f-a97320671c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:22.194692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-803a368c-e514-4a53-a5f7-b0fffef7639a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:22.202615 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-04e2fddc-180c-43d9-a13f-a97320671c27 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1266 microversion: 2.1 time: 0.279412 Oct 29 02:56:22.203657 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1401/2739] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:21 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:22.210554 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-803a368c-e514-4a53-a5f7-b0fffef7639a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1274 microversion: 2.1 time: 0.576266 Oct 29 02:56:22.213155 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1339/2740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:21 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1274 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:22.216258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6906ca01-6f9d-4088-8b31-8e4a4e7b75e6 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:22.217100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6906ca01-6f9d-4088-8b31-8e4a4e7b75e6 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:22.238694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6906ca01-6f9d-4088-8b31-8e4a4e7b75e6 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:22.240514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6906ca01-6f9d-4088-8b31-8e4a4e7b75e6 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:22.243460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6906ca01-6f9d-4088-8b31-8e4a4e7b75e6 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:22.245248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6906ca01-6f9d-4088-8b31-8e4a4e7b75e6 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:22.245912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6906ca01-6f9d-4088-8b31-8e4a4e7b75e6 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:22.248547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6906ca01-6f9d-4088-8b31-8e4a4e7b75e6 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:22.806093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6906ca01-6f9d-4088-8b31-8e4a4e7b75e6 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:22.815525 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6906ca01-6f9d-4088-8b31-8e4a4e7b75e6 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1317 microversion: 2.1 time: 0.608704 Oct 29 02:56:22.821240 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1402/2741] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:22 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:22.829145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9ec69f1c-3bf0-41b2-89eb-bff14efdd3ae req-b35cf644-5c3a-4e5c-b49e-d877294236a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c272fb-32fc-49c0-bd23-68c2e10da4d3", "tag": "561af0fa-556f-4ed2-8a5c-387edd2f81a3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:22.852895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ec69f1c-3bf0-41b2-89eb-bff14efdd3ae req-b35cf644-5c3a-4e5c-b49e-d877294236a0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:22.853374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ec69f1c-3bf0-41b2-89eb-bff14efdd3ae req-b35cf644-5c3a-4e5c-b49e-d877294236a0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:22.853828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ec69f1c-3bf0-41b2-89eb-bff14efdd3ae req-b35cf644-5c3a-4e5c-b49e-d877294236a0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:22.914248 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9ec69f1c-3bf0-41b2-89eb-bff14efdd3ae req-b35cf644-5c3a-4e5c-b49e-d877294236a0 service nova] Creating event network-changed:561af0fa-556f-4ed2-8a5c-387edd2f81a3 for instance 85c272fb-32fc-49c0-bd23-68c2e10da4d3 on n-h1-862964-4 Oct 29 02:56:22.927631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9ec69f1c-3bf0-41b2-89eb-bff14efdd3ae req-b35cf644-5c3a-4e5c-b49e-d877294236a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.713153 Oct 29 02:56:22.937036 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1340/2742] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:23.238813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-857a94cb-b5ef-4beb-a034-2aa304f3f673 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:23.250765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c3c4bcef-3784-4f79-9dd1-0e6e04ea8710 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:23.251551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-857a94cb-b5ef-4beb-a034-2aa304f3f673 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:23.253509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c3c4bcef-3784-4f79-9dd1-0e6e04ea8710 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:23.268515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:23.293698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-857a94cb-b5ef-4beb-a034-2aa304f3f673 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:23.295649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-857a94cb-b5ef-4beb-a034-2aa304f3f673 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:23.297338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-857a94cb-b5ef-4beb-a034-2aa304f3f673 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:23.298901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-857a94cb-b5ef-4beb-a034-2aa304f3f673 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:23.304324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3c4bcef-3784-4f79-9dd1-0e6e04ea8710 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:23.304783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-857a94cb-b5ef-4beb-a034-2aa304f3f673 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:23.306287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-857a94cb-b5ef-4beb-a034-2aa304f3f673 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:23.316649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3c4bcef-3784-4f79-9dd1-0e6e04ea8710 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:23.319556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3c4bcef-3784-4f79-9dd1-0e6e04ea8710 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:23.320768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3c4bcef-3784-4f79-9dd1-0e6e04ea8710 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:23.324114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3c4bcef-3784-4f79-9dd1-0e6e04ea8710 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:23.325839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3c4bcef-3784-4f79-9dd1-0e6e04ea8710 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:23.576996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-857a94cb-b5ef-4beb-a034-2aa304f3f673 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:23.593473 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-857a94cb-b5ef-4beb-a034-2aa304f3f673 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1274 microversion: 2.1 time: 0.359578 Oct 29 02:56:23.596338 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1403/2743] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:23 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1274 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:23.848671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c22c1bcd-4c32-4c83-a9fc-4c68a5c1bc9a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:23.849327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c22c1bcd-4c32-4c83-a9fc-4c68a5c1bc9a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:23.875713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c22c1bcd-4c32-4c83-a9fc-4c68a5c1bc9a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:23.876260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c22c1bcd-4c32-4c83-a9fc-4c68a5c1bc9a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:23.880084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c22c1bcd-4c32-4c83-a9fc-4c68a5c1bc9a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:23.882689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c22c1bcd-4c32-4c83-a9fc-4c68a5c1bc9a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:23.885273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c22c1bcd-4c32-4c83-a9fc-4c68a5c1bc9a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:23.886004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c22c1bcd-4c32-4c83-a9fc-4c68a5c1bc9a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:24.546615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c3c4bcef-3784-4f79-9dd1-0e6e04ea8710 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:24.553887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:24.556247 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c3c4bcef-3784-4f79-9dd1-0e6e04ea8710 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 1.311992 Oct 29 02:56:24.576200 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1341/2744] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:23 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:24.624007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f1bdf22e-f2b2-42dd-9e3d-d87fb926e507 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:24.624620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f1bdf22e-f2b2-42dd-9e3d-d87fb926e507 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:24.634116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1bdf22e-f2b2-42dd-9e3d-d87fb926e507 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:24.641386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1bdf22e-f2b2-42dd-9e3d-d87fb926e507 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:24.642522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1bdf22e-f2b2-42dd-9e3d-d87fb926e507 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:24.643504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1bdf22e-f2b2-42dd-9e3d-d87fb926e507 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:24.643971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1bdf22e-f2b2-42dd-9e3d-d87fb926e507 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:24.646713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1bdf22e-f2b2-42dd-9e3d-d87fb926e507 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.567877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c22c1bcd-4c32-4c83-a9fc-4c68a5c1bc9a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:25.576874 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c22c1bcd-4c32-4c83-a9fc-4c68a5c1bc9a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1317 microversion: 2.1 time: 1.736148 Oct 29 02:56:25.577454 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1404/2745] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:23 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1317 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:25.596031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1a9fc790-13ed-4e76-87f9-663bc4150673 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:25.602051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1a9fc790-13ed-4e76-87f9-663bc4150673 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:25.634119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a9fc790-13ed-4e76-87f9-663bc4150673 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:25.634957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a9fc790-13ed-4e76-87f9-663bc4150673 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:25.636158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a9fc790-13ed-4e76-87f9-663bc4150673 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.637061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a9fc790-13ed-4e76-87f9-663bc4150673 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:25.642594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a9fc790-13ed-4e76-87f9-663bc4150673 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:25.654035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a9fc790-13ed-4e76-87f9-663bc4150673 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:26.442258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1a9fc790-13ed-4e76-87f9-663bc4150673 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:26.459756 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1a9fc790-13ed-4e76-87f9-663bc4150673 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 0.866344 Oct 29 02:56:26.473862 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1405/2746] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:25 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:26.605502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b8affc87-5406-439c-b0d1-c5b8c7577b3a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:26.606539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b8affc87-5406-439c-b0d1-c5b8c7577b3a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:26.618549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8affc87-5406-439c-b0d1-c5b8c7577b3a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:26.620417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8affc87-5406-439c-b0d1-c5b8c7577b3a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:26.621388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8affc87-5406-439c-b0d1-c5b8c7577b3a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:26.623765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8affc87-5406-439c-b0d1-c5b8c7577b3a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:26.626089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8affc87-5406-439c-b0d1-c5b8c7577b3a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:26.628259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8affc87-5406-439c-b0d1-c5b8c7577b3a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:26.646482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f1bdf22e-f2b2-42dd-9e3d-d87fb926e507 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:26.664108 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f1bdf22e-f2b2-42dd-9e3d-d87fb926e507 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 2.044343 Oct 29 02:56:26.679498 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1342/2747] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:24 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:27.308805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b8affc87-5406-439c-b0d1-c5b8c7577b3a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:27.326357 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b8affc87-5406-439c-b0d1-c5b8c7577b3a tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1317 microversion: 2.1 time: 0.723441 Oct 29 02:56:27.328676 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1406/2748] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:26 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1317 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:27.491068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dfb951df-49d9-4989-b1af-3b9a1efbf9d4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:27.491980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dfb951df-49d9-4989-b1af-3b9a1efbf9d4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:27.511421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb951df-49d9-4989-b1af-3b9a1efbf9d4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:27.516615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb951df-49d9-4989-b1af-3b9a1efbf9d4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:27.517458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb951df-49d9-4989-b1af-3b9a1efbf9d4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:27.518863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb951df-49d9-4989-b1af-3b9a1efbf9d4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:27.519733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb951df-49d9-4989-b1af-3b9a1efbf9d4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:27.532618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb951df-49d9-4989-b1af-3b9a1efbf9d4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:27.648611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=7 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:27.694069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec210ad0-55ca-43de-9bc7-a17a6ab68f8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:27.694757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ec210ad0-55ca-43de-9bc7-a17a6ab68f8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:27.712494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec210ad0-55ca-43de-9bc7-a17a6ab68f8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:27.713007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec210ad0-55ca-43de-9bc7-a17a6ab68f8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:27.713624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec210ad0-55ca-43de-9bc7-a17a6ab68f8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:27.729303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec210ad0-55ca-43de-9bc7-a17a6ab68f8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:27.729874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec210ad0-55ca-43de-9bc7-a17a6ab68f8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:27.743594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec210ad0-55ca-43de-9bc7-a17a6ab68f8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:27.753491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=24 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:28.412350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:28.530881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ec210ad0-55ca-43de-9bc7-a17a6ab68f8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:28.548700 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ec210ad0-55ca-43de-9bc7-a17a6ab68f8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 0.859452 Oct 29 02:56:28.550586 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1407/2749] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:27 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:28.570661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-210b6a85-f044-4954-b7ee-e0290bc31282 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:28.574441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-210b6a85-f044-4954-b7ee-e0290bc31282 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:28.591809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-210b6a85-f044-4954-b7ee-e0290bc31282 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:28.594556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-210b6a85-f044-4954-b7ee-e0290bc31282 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:28.595227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-210b6a85-f044-4954-b7ee-e0290bc31282 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:28.596773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-210b6a85-f044-4954-b7ee-e0290bc31282 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:28.603767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-210b6a85-f044-4954-b7ee-e0290bc31282 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:28.609199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-210b6a85-f044-4954-b7ee-e0290bc31282 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:28.691286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-210b6a85-f044-4954-b7ee-e0290bc31282 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:56:28.859403 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-210b6a85-f044-4954-b7ee-e0290bc31282 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 204 len: 0 microversion: 2.1 time: 0.307272 Oct 29 02:56:28.861057 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1408/2750] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:56:28 2022] DELETE /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:56:28.868011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2c8da781-e2ae-42b9-ae18-95987302a204 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:28.871279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2c8da781-e2ae-42b9-ae18-95987302a204 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:28.898066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c8da781-e2ae-42b9-ae18-95987302a204 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:28.898996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c8da781-e2ae-42b9-ae18-95987302a204 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:28.902294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c8da781-e2ae-42b9-ae18-95987302a204 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:28.903279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c8da781-e2ae-42b9-ae18-95987302a204 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:28.904016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c8da781-e2ae-42b9-ae18-95987302a204 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:28.905375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c8da781-e2ae-42b9-ae18-95987302a204 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:29.101775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dfb951df-49d9-4989-b1af-3b9a1efbf9d4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:29.110332 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dfb951df-49d9-4989-b1af-3b9a1efbf9d4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 1.625307 Oct 29 02:56:29.116872 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1343/2751] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:27 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:29.125685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4bd7b3a7-8433-4229-8afb-3453be1e7297 req-44c3ad62-4eae-41a7-aa05-27f69812db1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c272fb-32fc-49c0-bd23-68c2e10da4d3", "name": "network-vif-plugged", "status": "completed", "tag": "561af0fa-556f-4ed2-8a5c-387edd2f81a3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:29.157518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4bd7b3a7-8433-4229-8afb-3453be1e7297 req-44c3ad62-4eae-41a7-aa05-27f69812db1f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:29.158308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4bd7b3a7-8433-4229-8afb-3453be1e7297 req-44c3ad62-4eae-41a7-aa05-27f69812db1f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:29.163762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4bd7b3a7-8433-4229-8afb-3453be1e7297 req-44c3ad62-4eae-41a7-aa05-27f69812db1f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:29.192827 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4bd7b3a7-8433-4229-8afb-3453be1e7297 req-44c3ad62-4eae-41a7-aa05-27f69812db1f service nova] Creating event network-vif-plugged:561af0fa-556f-4ed2-8a5c-387edd2f81a3 for instance 85c272fb-32fc-49c0-bd23-68c2e10da4d3 on n-h1-862964-4 Oct 29 02:56:29.198736 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4bd7b3a7-8433-4229-8afb-3453be1e7297 req-44c3ad62-4eae-41a7-aa05-27f69812db1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079673 Oct 29 02:56:29.199809 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1344/2752] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:29.207280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cb3266af-080f-4a2f-a998-4d140d0530af tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:29.211578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cb3266af-080f-4a2f-a998-4d140d0530af tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:29.221626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb3266af-080f-4a2f-a998-4d140d0530af tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:29.222148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb3266af-080f-4a2f-a998-4d140d0530af tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:29.222573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb3266af-080f-4a2f-a998-4d140d0530af tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:29.223337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb3266af-080f-4a2f-a998-4d140d0530af tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:29.223944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb3266af-080f-4a2f-a998-4d140d0530af tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:29.224511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb3266af-080f-4a2f-a998-4d140d0530af tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:29.462306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c8da781-e2ae-42b9-ae18-95987302a204 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:29.472095 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2c8da781-e2ae-42b9-ae18-95987302a204 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1317 microversion: 2.1 time: 0.609404 Oct 29 02:56:29.473391 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1409/2753] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:28 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:29.478508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-05040f14-b1c5-4d94-bfea-2c5cb7763b85 req-6257dc97-e326-4159-ba30-8ce85a887eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ed9c7b-73e9-4268-af26-ff629c7e4ff4", "tag": "be09f872-ea24-47be-a1b5-c0d50808a72d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:29.485236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:29.489517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-05040f14-b1c5-4d94-bfea-2c5cb7763b85 req-6257dc97-e326-4159-ba30-8ce85a887eec service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:29.490452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-05040f14-b1c5-4d94-bfea-2c5cb7763b85 req-6257dc97-e326-4159-ba30-8ce85a887eec service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:29.491272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-05040f14-b1c5-4d94-bfea-2c5cb7763b85 req-6257dc97-e326-4159-ba30-8ce85a887eec service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:29.507147 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-05040f14-b1c5-4d94-bfea-2c5cb7763b85 req-6257dc97-e326-4159-ba30-8ce85a887eec service nova] Creating event network-changed:be09f872-ea24-47be-a1b5-c0d50808a72d for instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 on n-h2-862964-4 Oct 29 02:56:29.512529 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-05040f14-b1c5-4d94-bfea-2c5cb7763b85 req-6257dc97-e326-4159-ba30-8ce85a887eec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037633 Oct 29 02:56:29.513601 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1410/2754] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:29.579333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-58e27455-3962-49fc-8f20-3f8c47194fb7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:29.580735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-58e27455-3962-49fc-8f20-3f8c47194fb7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:29.592426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cb3266af-080f-4a2f-a998-4d140d0530af tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:29.592931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58e27455-3962-49fc-8f20-3f8c47194fb7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:29.593608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58e27455-3962-49fc-8f20-3f8c47194fb7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:29.594415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58e27455-3962-49fc-8f20-3f8c47194fb7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:29.595470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58e27455-3962-49fc-8f20-3f8c47194fb7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:29.596333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58e27455-3962-49fc-8f20-3f8c47194fb7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:29.596909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58e27455-3962-49fc-8f20-3f8c47194fb7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:29.606903 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cb3266af-080f-4a2f-a998-4d140d0530af tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1553 microversion: 2.1 time: 0.405253 Oct 29 02:56:29.607495 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1345/2755] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:29 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1553 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:29.684584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=26 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:30.142677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6a6e503a-e7d2-4c43-b7f6-bdba270cb68c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:30.143259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6a6e503a-e7d2-4c43-b7f6-bdba270cb68c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:30.155556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a6e503a-e7d2-4c43-b7f6-bdba270cb68c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:30.156121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a6e503a-e7d2-4c43-b7f6-bdba270cb68c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:30.156546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a6e503a-e7d2-4c43-b7f6-bdba270cb68c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:30.157257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a6e503a-e7d2-4c43-b7f6-bdba270cb68c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:30.157696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a6e503a-e7d2-4c43-b7f6-bdba270cb68c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:30.158317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a6e503a-e7d2-4c43-b7f6-bdba270cb68c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:30.272887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-58e27455-3962-49fc-8f20-3f8c47194fb7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:30.280174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:30.291465 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-58e27455-3962-49fc-8f20-3f8c47194fb7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 0.720394 Oct 29 02:56:30.293096 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1411/2756] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:29 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:30.370157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6a6e503a-e7d2-4c43-b7f6-bdba270cb68c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:30.382508 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6a6e503a-e7d2-4c43-b7f6-bdba270cb68c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 0.244459 Oct 29 02:56:30.383090 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1346/2757] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:30 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:30.502323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-282f712c-65b6-42e7-8fd1-b6633af3f75c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:30.502895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-282f712c-65b6-42e7-8fd1-b6633af3f75c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:30.534315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-282f712c-65b6-42e7-8fd1-b6633af3f75c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:30.534850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-282f712c-65b6-42e7-8fd1-b6633af3f75c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:30.535293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-282f712c-65b6-42e7-8fd1-b6633af3f75c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:30.541953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-282f712c-65b6-42e7-8fd1-b6633af3f75c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:30.550044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-282f712c-65b6-42e7-8fd1-b6633af3f75c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:30.564739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-282f712c-65b6-42e7-8fd1-b6633af3f75c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:30.642110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-81e50672-ac64-4de3-a76d-d2db33581f99 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:30.642926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-81e50672-ac64-4de3-a76d-d2db33581f99 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:30.667012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e50672-ac64-4de3-a76d-d2db33581f99 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:30.670939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e50672-ac64-4de3-a76d-d2db33581f99 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:30.672972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e50672-ac64-4de3-a76d-d2db33581f99 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:30.675221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e50672-ac64-4de3-a76d-d2db33581f99 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:30.677177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e50672-ac64-4de3-a76d-d2db33581f99 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:30.678074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81e50672-ac64-4de3-a76d-d2db33581f99 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.506670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-282f712c-65b6-42e7-8fd1-b6633af3f75c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:31.515744 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-282f712c-65b6-42e7-8fd1-b6633af3f75c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1317 microversion: 2.1 time: 1.017751 Oct 29 02:56:31.516090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-81e50672-ac64-4de3-a76d-d2db33581f99 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:31.518945 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1412/2758] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:30 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1317 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:31.530808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dfa0b0be-2300-4a91-9d19-e8c491859cae tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:31.531648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dfa0b0be-2300-4a91-9d19-e8c491859cae tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:31.543848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa0b0be-2300-4a91-9d19-e8c491859cae tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.544489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa0b0be-2300-4a91-9d19-e8c491859cae tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.548486 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-81e50672-ac64-4de3-a76d-d2db33581f99 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1553 microversion: 2.1 time: 0.913830 Oct 29 02:56:31.549433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa0b0be-2300-4a91-9d19-e8c491859cae tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.549841 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1347/2759] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:30 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1553 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:31.550144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa0b0be-2300-4a91-9d19-e8c491859cae tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.550607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa0b0be-2300-4a91-9d19-e8c491859cae tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.551026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa0b0be-2300-4a91-9d19-e8c491859cae tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.568658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3bdcfb78-bd14-4aa6-af82-187bb91631ca tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:31.569509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3bdcfb78-bd14-4aa6-af82-187bb91631ca tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:31.582664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bdcfb78-bd14-4aa6-af82-187bb91631ca tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.583398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bdcfb78-bd14-4aa6-af82-187bb91631ca tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.585186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bdcfb78-bd14-4aa6-af82-187bb91631ca tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.589895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bdcfb78-bd14-4aa6-af82-187bb91631ca tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.600049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bdcfb78-bd14-4aa6-af82-187bb91631ca tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.600674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bdcfb78-bd14-4aa6-af82-187bb91631ca tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.051306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3bdcfb78-bd14-4aa6-af82-187bb91631ca tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:32.062066 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3bdcfb78-bd14-4aa6-af82-187bb91631ca tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 0.510616 Oct 29 02:56:32.075937 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1348/2760] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:31 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:32.103809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-0dc2e264-938c-454e-a88e-b86f28f15223 req-9333c879-0970-4df3-96f5-0826679e9ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd9e3b45-8ae9-470a-80f6-26c3057f7afe", "tag": "9eebf062-ba82-4f9f-85ad-21b23f2023ad"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:32.157404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0dc2e264-938c-454e-a88e-b86f28f15223 req-9333c879-0970-4df3-96f5-0826679e9ca6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.158758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0dc2e264-938c-454e-a88e-b86f28f15223 req-9333c879-0970-4df3-96f5-0826679e9ca6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.159470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0dc2e264-938c-454e-a88e-b86f28f15223 req-9333c879-0970-4df3-96f5-0826679e9ca6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.176337 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-0dc2e264-938c-454e-a88e-b86f28f15223 req-9333c879-0970-4df3-96f5-0826679e9ca6 service nova] Creating event network-changed:9eebf062-ba82-4f9f-85ad-21b23f2023ad for instance cd9e3b45-8ae9-470a-80f6-26c3057f7afe on n-h2-862964-4 Oct 29 02:56:32.184866 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-0dc2e264-938c-454e-a88e-b86f28f15223 req-9333c879-0970-4df3-96f5-0826679e9ca6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106862 Oct 29 02:56:32.186594 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1349/2761] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:32.549560 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6922d2b9-d80d-4f71-842b-f0fb5ea7f529 tempest-TenantUsagesNegativeTestJSON-170662252 tempest-TenantUsagesNegativeTestJSON-170662252-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-28T02%3A56%3A32.154086&end=2022-10-30T02%3A56%3A32.154086" status: 404 len: 112 microversion: - time: 0.360952 Oct 29 02:56:32.566042 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1350/2762] 10.222.0.16 () {58 vars in 1316 bytes} [Sat Oct 29 02:56:32 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-28T02%3A56%3A32.154086&end=2022-10-30T02%3A56%3A32.154086 => generated 112 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 02:56:32.573384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-beecbe66-a396-4dea-99b8-fc3413aba3ab tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:32.575387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-beecbe66-a396-4dea-99b8-fc3413aba3ab tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:32.611101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-beecbe66-a396-4dea-99b8-fc3413aba3ab tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.613485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-beecbe66-a396-4dea-99b8-fc3413aba3ab tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.616278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-beecbe66-a396-4dea-99b8-fc3413aba3ab tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.621781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-beecbe66-a396-4dea-99b8-fc3413aba3ab tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.623609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-beecbe66-a396-4dea-99b8-fc3413aba3ab tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.626932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-beecbe66-a396-4dea-99b8-fc3413aba3ab tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.724580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dfa0b0be-2300-4a91-9d19-e8c491859cae tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:32.752756 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dfa0b0be-2300-4a91-9d19-e8c491859cae tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 1.231113 Oct 29 02:56:32.754295 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1413/2763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:31 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:32.760624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-776f5981-723a-4fa8-8487-ad66475bc610 tempest-TenantUsagesNegativeTestJSON-170662252 tempest-TenantUsagesNegativeTestJSON-170662252-project-admin] Calling method '.version_select at 0x7fe1a3fdadc0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:32.770453 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-776f5981-723a-4fa8-8487-ad66475bc610 tempest-TenantUsagesNegativeTestJSON-170662252 tempest-TenantUsagesNegativeTestJSON-170662252-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-776f5981-723a-4fa8-8487-ad66475bc610 tempest-TenantUsagesNegativeTestJSON-170662252 tempest-TenantUsagesNegativeTestJSON-170662252-project-admin] Request method failure captured: Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-simple-tenant-usage/c30f37c67c8447aa81e36881aea344e2?start=2022-10-30T02%3A56%3A32.154086&end=2022-10-28T02%3A56%3A32.154086 HTTP/1.1 Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZfyGiYkLEnear78uvAICCmImw9x6RorUUYqWL8sVPDFn3eurZGiaKCAjjc664Xc1AKir6leMMhVnCUdvc13acS_94zv5URNoKtAtOrEE6SzKtA144ycpHnyRV7jUz2CzsGSubxQ8UUu-PZsn2YOeG24GOVq4yvx7u168-B6D7wfmY Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b22d6f7db6554d618d55ce37a81c7594 Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-170662252 Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b22d6f7db6554d618d55ce37a81c7594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b22d6f7db6554d618d55ce37a81c7594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b22d6f7db6554d618d55ce37a81c7594", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b22d6f7db6554d618d55ce37a81c7594"}]}] Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-170662252 Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b22d6f7db6554d618d55ce37a81c7594 Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-170662252 Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TenantUsagesNegativeTestJSON-170662252-project-admin Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 810a7b2c94f64ba69ff2d605e9335eb7 Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-170662252-project-admin Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid start time. The start time cannot occur after the end time. Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'c30f37c67c8447aa81e36881aea344e2'} Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 29 02:56:32.780574 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:32.790266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-776f5981-723a-4fa8-8487-ad66475bc610 tempest-TenantUsagesNegativeTestJSON-170662252 tempest-TenantUsagesNegativeTestJSON-170662252-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:32.791269 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-776f5981-723a-4fa8-8487-ad66475bc610 tempest-TenantUsagesNegativeTestJSON-170662252 tempest-TenantUsagesNegativeTestJSON-170662252-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/c30f37c67c8447aa81e36881aea344e2?start=2022-10-30T02%3A56%3A32.154086&end=2022-10-28T02%3A56%3A32.154086" status: 400 len: 111 microversion: 2.1 time: 0.035196 Oct 29 02:56:32.802285 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1414/2764] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Oct 29 02:56:32 2022] GET /compute/v2.1/os-simple-tenant-usage/c30f37c67c8447aa81e36881aea344e2?start=2022-10-30T02%3A56%3A32.154086&end=2022-10-28T02%3A56%3A32.154086 => generated 111 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:56:32.810926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c0867413-d195-4b7d-8ed0-2003da7e5867 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:32.812762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c0867413-d195-4b7d-8ed0-2003da7e5867 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:32.827610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0867413-d195-4b7d-8ed0-2003da7e5867 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.828712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0867413-d195-4b7d-8ed0-2003da7e5867 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.829390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0867413-d195-4b7d-8ed0-2003da7e5867 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.831049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0867413-d195-4b7d-8ed0-2003da7e5867 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.832351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0867413-d195-4b7d-8ed0-2003da7e5867 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.833053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0867413-d195-4b7d-8ed0-2003da7e5867 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:33.255441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c0867413-d195-4b7d-8ed0-2003da7e5867 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:33.266795 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c0867413-d195-4b7d-8ed0-2003da7e5867 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1553 microversion: 2.1 time: 0.462882 Oct 29 02:56:33.272267 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1415/2765] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:32 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1553 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:33.515889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc3fb5d6-ccf7-4a6b-bc77-66b70eee55d5 tempest-TenantUsagesNegativeTestJSON-386596179 tempest-TenantUsagesNegativeTestJSON-386596179-project] Calling method '.version_select at 0x7fe1acc434c0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:33.519414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc3fb5d6-ccf7-4a6b-bc77-66b70eee55d5 tempest-TenantUsagesNegativeTestJSON-386596179 tempest-TenantUsagesNegativeTestJSON-386596179-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'c20348dd3ba24c5880d7cb00f95ddb9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30f37c67c8447aa81e36881aea344e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc3fb5d6-ccf7-4a6b-bc77-66b70eee55d5 tempest-TenantUsagesNegativeTestJSON-386596179 tempest-TenantUsagesNegativeTestJSON-386596179-project] Request method failure captured: Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T02%3A56%3A32.154086&end=2022-10-30T02%3A56%3A32.154086&detailed=1 HTTP/1.1 Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZexRfp4UkeiAtw5HkFkg1uaGTSs-ILbyGiMVmJ78BY_O_f6A_Hj7L9qXnEbII__2lmatsDjMzQz2fZ_6aW4jSpo4shhsY-7cIEcqeWL88Ccz3mEWjvTBhm16XonVb0KQi9tRNyjB80d-4sZLgOv2if0RQzu6LjpVYkHg7EPVtIxf0 Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c30f37c67c8447aa81e36881aea344e2 Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-386596179 Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c30f37c67c8447aa81e36881aea344e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c30f37c67c8447aa81e36881aea344e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c30f37c67c8447aa81e36881aea344e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c30f37c67c8447aa81e36881aea344e2"}]}] Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-386596179 Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c30f37c67c8447aa81e36881aea344e2 Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-386596179 Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TenantUsagesNegativeTestJSON-386596179-project Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: c20348dd3ba24c5880d7cb00f95ddb9f Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-386596179-project Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: action_args: {} Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:56:33.521025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:33.526498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc3fb5d6-ccf7-4a6b-bc77-66b70eee55d5 tempest-TenantUsagesNegativeTestJSON-386596179 tempest-TenantUsagesNegativeTestJSON-386596179-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:33.529046 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fc3fb5d6-ccf7-4a6b-bc77-66b70eee55d5 tempest-TenantUsagesNegativeTestJSON-386596179 tempest-TenantUsagesNegativeTestJSON-386596179-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T02%3A56%3A32.154086&end=2022-10-30T02%3A56%3A32.154086&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.254114 Oct 29 02:56:33.529046 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1416/2766] 10.222.0.16 () {58 vars in 1335 bytes} [Sat Oct 29 02:56:33 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T02%3A56%3A32.154086&end=2022-10-30T02%3A56%3A32.154086&detailed=1 => generated 123 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:33.540483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-79effdde-12f6-4a28-8d6d-58afd89758a9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:33.541101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-79effdde-12f6-4a28-8d6d-58afd89758a9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:33.562146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79effdde-12f6-4a28-8d6d-58afd89758a9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:33.562818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79effdde-12f6-4a28-8d6d-58afd89758a9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:33.563417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79effdde-12f6-4a28-8d6d-58afd89758a9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:33.564297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79effdde-12f6-4a28-8d6d-58afd89758a9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:33.565420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79effdde-12f6-4a28-8d6d-58afd89758a9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:33.566026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79effdde-12f6-4a28-8d6d-58afd89758a9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:34.268971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-79effdde-12f6-4a28-8d6d-58afd89758a9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:34.288919 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-79effdde-12f6-4a28-8d6d-58afd89758a9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 0.759416 Oct 29 02:56:34.289937 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1417/2767] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:33 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:34.303566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-72cc43dc-994d-44aa-9dfc-754884bc2ada tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:34.304752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-72cc43dc-994d-44aa-9dfc-754884bc2ada tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:34.326813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72cc43dc-994d-44aa-9dfc-754884bc2ada tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:34.327431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72cc43dc-994d-44aa-9dfc-754884bc2ada tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:34.327834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72cc43dc-994d-44aa-9dfc-754884bc2ada tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:34.328599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72cc43dc-994d-44aa-9dfc-754884bc2ada tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:34.329101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72cc43dc-994d-44aa-9dfc-754884bc2ada tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:34.329586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72cc43dc-994d-44aa-9dfc-754884bc2ada tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:34.425418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-beecbe66-a396-4dea-99b8-fc3413aba3ab tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:34.438036 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-beecbe66-a396-4dea-99b8-fc3413aba3ab tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1507 microversion: 2.1 time: 1.880411 Oct 29 02:56:34.438894 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1351/2768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:32 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1507 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:34.450725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d5fb9046-f765-4617-904c-6c618c717bbd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:34.451963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d5fb9046-f765-4617-904c-6c618c717bbd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:34.459319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5fb9046-f765-4617-904c-6c618c717bbd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:34.460058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5fb9046-f765-4617-904c-6c618c717bbd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:34.460643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5fb9046-f765-4617-904c-6c618c717bbd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:34.461506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5fb9046-f765-4617-904c-6c618c717bbd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:34.462206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5fb9046-f765-4617-904c-6c618c717bbd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:34.462825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5fb9046-f765-4617-904c-6c618c717bbd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.032442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d5fb9046-f765-4617-904c-6c618c717bbd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:35.045252 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d5fb9046-f765-4617-904c-6c618c717bbd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1553 microversion: 2.1 time: 0.602989 Oct 29 02:56:35.046116 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1352/2769] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:34 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1553 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:35.058929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b501f0d9-465b-4861-8932-b82a657891cb tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:35.060031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b501f0d9-465b-4861-8932-b82a657891cb tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:35.076001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b501f0d9-465b-4861-8932-b82a657891cb tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.076784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b501f0d9-465b-4861-8932-b82a657891cb tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.079422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b501f0d9-465b-4861-8932-b82a657891cb tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.080380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b501f0d9-465b-4861-8932-b82a657891cb tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.081012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b501f0d9-465b-4861-8932-b82a657891cb tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.082304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b501f0d9-465b-4861-8932-b82a657891cb tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.152844 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b501f0d9-465b-4861-8932-b82a657891cb tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3/ips" status: 200 len: 110 microversion: 2.1 time: 0.101962 Oct 29 02:56:35.158707 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1353/2770] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 02:56:35 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3/ips => generated 110 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:35.172121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-608bca5a-8153-4128-ab72-a5a101fec80c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:35.172960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-608bca5a-8153-4128-ab72-a5a101fec80c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:35.183537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-608bca5a-8153-4128-ab72-a5a101fec80c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.186189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-608bca5a-8153-4128-ab72-a5a101fec80c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.186844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-608bca5a-8153-4128-ab72-a5a101fec80c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.187748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-608bca5a-8153-4128-ab72-a5a101fec80c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.192655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-608bca5a-8153-4128-ab72-a5a101fec80c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.193356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-608bca5a-8153-4128-ab72-a5a101fec80c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.240859 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-608bca5a-8153-4128-ab72-a5a101fec80c tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3/ips" status: 200 len: 110 microversion: 2.1 time: 0.073550 Oct 29 02:56:35.242104 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1354/2771] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 02:56:35 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3/ips => generated 110 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:56:35.256107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2f8d5853-e62a-4d53-a26e-8e32582a84d9 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:35.259370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2f8d5853-e62a-4d53-a26e-8e32582a84d9 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:35.276364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f8d5853-e62a-4d53-a26e-8e32582a84d9 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.280184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f8d5853-e62a-4d53-a26e-8e32582a84d9 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.280883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f8d5853-e62a-4d53-a26e-8e32582a84d9 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.281834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f8d5853-e62a-4d53-a26e-8e32582a84d9 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.284935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f8d5853-e62a-4d53-a26e-8e32582a84d9 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.285875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f8d5853-e62a-4d53-a26e-8e32582a84d9 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.347673 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2f8d5853-e62a-4d53-a26e-8e32582a84d9 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3/ips/tempest-ServerAddressesTestJSON-1078967354-network" status: 200 len: 95 microversion: 2.1 time: 0.097563 Oct 29 02:56:35.348890 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1355/2772] 10.222.0.16 () {58 vars in 1401 bytes} [Sat Oct 29 02:56:35 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3/ips/tempest-ServerAddressesTestJSON-1078967354-network => generated 95 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:56:35.353947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76d3af80-9cf0-4a24-9ded-0c217f8edc63 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:35.354819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-76d3af80-9cf0-4a24-9ded-0c217f8edc63 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:35.371388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76d3af80-9cf0-4a24-9ded-0c217f8edc63 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.372465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76d3af80-9cf0-4a24-9ded-0c217f8edc63 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.373086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76d3af80-9cf0-4a24-9ded-0c217f8edc63 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.374624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76d3af80-9cf0-4a24-9ded-0c217f8edc63 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.376569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76d3af80-9cf0-4a24-9ded-0c217f8edc63 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.377330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76d3af80-9cf0-4a24-9ded-0c217f8edc63 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.769264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-72cc43dc-994d-44aa-9dfc-754884bc2ada tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:35.779510 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-72cc43dc-994d-44aa-9dfc-754884bc2ada tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 1.488294 Oct 29 02:56:35.780073 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1418/2773] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:34 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:35.784865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c51dd619-07f5-4a49-a4ba-d2eaef2b0ab3 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:35.785525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c51dd619-07f5-4a49-a4ba-d2eaef2b0ab3 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:35.792264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c51dd619-07f5-4a49-a4ba-d2eaef2b0ab3 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.792932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c51dd619-07f5-4a49-a4ba-d2eaef2b0ab3 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.793649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c51dd619-07f5-4a49-a4ba-d2eaef2b0ab3 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.794577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c51dd619-07f5-4a49-a4ba-d2eaef2b0ab3 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.795166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c51dd619-07f5-4a49-a4ba-d2eaef2b0ab3 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.795724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c51dd619-07f5-4a49-a4ba-d2eaef2b0ab3 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.825131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c51dd619-07f5-4a49-a4ba-d2eaef2b0ab3 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:56:35.934952 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c51dd619-07f5-4a49-a4ba-d2eaef2b0ab3 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "DELETE /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 204 len: 0 microversion: 2.1 time: 0.152872 Oct 29 02:56:35.938792 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1419/2774] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:56:35 2022] DELETE /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:56:35.942918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4ce32538-e486-4ff7-acbc-98c00a4ab58d req-9b7cdd79-3133-4544-b8fe-b44fda24627e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1615ba83-e03b-4936-9ea2-f08ea0436ec9", "name": "network-vif-deleted", "tag": "43aab893-af24-479f-b6ac-8648136a4de1"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:35.953066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4ce32538-e486-4ff7-acbc-98c00a4ab58d req-9b7cdd79-3133-4544-b8fe-b44fda24627e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.953547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4ce32538-e486-4ff7-acbc-98c00a4ab58d req-9b7cdd79-3133-4544-b8fe-b44fda24627e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.955558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4ce32538-e486-4ff7-acbc-98c00a4ab58d req-9b7cdd79-3133-4544-b8fe-b44fda24627e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.967854 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4ce32538-e486-4ff7-acbc-98c00a4ab58d req-9b7cdd79-3133-4544-b8fe-b44fda24627e service nova] Creating event network-vif-deleted:43aab893-af24-479f-b6ac-8648136a4de1 for instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 on n-h2-862964-4 Oct 29 02:56:35.973174 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4ce32538-e486-4ff7-acbc-98c00a4ab58d req-9b7cdd79-3133-4544-b8fe-b44fda24627e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035685 Oct 29 02:56:35.974062 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1420/2775] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:35.979348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be1b7f66-4a7d-4c03-b8b5-1e85408ae14d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:35.980041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be1b7f66-4a7d-4c03-b8b5-1e85408ae14d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:35.986897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be1b7f66-4a7d-4c03-b8b5-1e85408ae14d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.987306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be1b7f66-4a7d-4c03-b8b5-1e85408ae14d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.987738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be1b7f66-4a7d-4c03-b8b5-1e85408ae14d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.988431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be1b7f66-4a7d-4c03-b8b5-1e85408ae14d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.989002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be1b7f66-4a7d-4c03-b8b5-1e85408ae14d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.989293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be1b7f66-4a7d-4c03-b8b5-1e85408ae14d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.013855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-76d3af80-9cf0-4a24-9ded-0c217f8edc63 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:36.028204 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-76d3af80-9cf0-4a24-9ded-0c217f8edc63 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 0.677706 Oct 29 02:56:36.029647 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1356/2776] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:35 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:36.074581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b62c26cf-5883-4114-af72-50cecfb86ab4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:36.076040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b62c26cf-5883-4114-af72-50cecfb86ab4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:36.082827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62c26cf-5883-4114-af72-50cecfb86ab4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.083511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62c26cf-5883-4114-af72-50cecfb86ab4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.083940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62c26cf-5883-4114-af72-50cecfb86ab4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.084739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62c26cf-5883-4114-af72-50cecfb86ab4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.085186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62c26cf-5883-4114-af72-50cecfb86ab4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.085597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62c26cf-5883-4114-af72-50cecfb86ab4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.162282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b62c26cf-5883-4114-af72-50cecfb86ab4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:36.173435 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b62c26cf-5883-4114-af72-50cecfb86ab4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1511 microversion: 2.1 time: 0.102799 Oct 29 02:56:36.174165 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1357/2777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:36 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1511 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:36.354812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-be1b7f66-4a7d-4c03-b8b5-1e85408ae14d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:36.368668 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-be1b7f66-4a7d-4c03-b8b5-1e85408ae14d tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1513 microversion: 2.1 time: 0.393388 Oct 29 02:56:36.371521 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1421/2778] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:35 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:36.809415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6feea686-328b-48cd-a152-d799c85aa596 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:36.810631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6feea686-328b-48cd-a152-d799c85aa596 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:36.819668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6feea686-328b-48cd-a152-d799c85aa596 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.820516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6feea686-328b-48cd-a152-d799c85aa596 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.823108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6feea686-328b-48cd-a152-d799c85aa596 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.824718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6feea686-328b-48cd-a152-d799c85aa596 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.825672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6feea686-328b-48cd-a152-d799c85aa596 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.826355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6feea686-328b-48cd-a152-d799c85aa596 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.051206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-06240dd4-461e-4f0e-b581-20442d8c3a60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:37.051965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-06240dd4-461e-4f0e-b581-20442d8c3a60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:37.061695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06240dd4-461e-4f0e-b581-20442d8c3a60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.062322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06240dd4-461e-4f0e-b581-20442d8c3a60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.062699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06240dd4-461e-4f0e-b581-20442d8c3a60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.063397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06240dd4-461e-4f0e-b581-20442d8c3a60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.069407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06240dd4-461e-4f0e-b581-20442d8c3a60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.072573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06240dd4-461e-4f0e-b581-20442d8c3a60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.343329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06240dd4-461e-4f0e-b581-20442d8c3a60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:37.356695 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-06240dd4-461e-4f0e-b581-20442d8c3a60 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 0.306833 Oct 29 02:56:37.357872 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1422/2779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:37 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:37.362781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37af7755-bafb-42fb-adb5-a495c30aa6eb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:37.366458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37af7755-bafb-42fb-adb5-a495c30aa6eb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:37.383648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37af7755-bafb-42fb-adb5-a495c30aa6eb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.385293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37af7755-bafb-42fb-adb5-a495c30aa6eb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.386386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37af7755-bafb-42fb-adb5-a495c30aa6eb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.388612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37af7755-bafb-42fb-adb5-a495c30aa6eb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.390093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37af7755-bafb-42fb-adb5-a495c30aa6eb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.390894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37af7755-bafb-42fb-adb5-a495c30aa6eb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.489269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6feea686-328b-48cd-a152-d799c85aa596 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:37.522524 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6feea686-328b-48cd-a152-d799c85aa596 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 0.722357 Oct 29 02:56:37.539377 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1358/2780] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:36 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:37.579247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37af7755-bafb-42fb-adb5-a495c30aa6eb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:37.583300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87484ac1-a576-4fcf-b290-cb5adc1dc26e tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:37.588560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-87484ac1-a576-4fcf-b290-cb5adc1dc26e tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:37.592330 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37af7755-bafb-42fb-adb5-a495c30aa6eb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1346 microversion: 2.1 time: 0.232653 Oct 29 02:56:37.602853 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1423/2781] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:37 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1346 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:37.624110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87484ac1-a576-4fcf-b290-cb5adc1dc26e tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.626000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87484ac1-a576-4fcf-b290-cb5adc1dc26e tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.627654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87484ac1-a576-4fcf-b290-cb5adc1dc26e tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.629168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87484ac1-a576-4fcf-b290-cb5adc1dc26e tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.629937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87484ac1-a576-4fcf-b290-cb5adc1dc26e tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.630807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87484ac1-a576-4fcf-b290-cb5adc1dc26e tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.381718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f579f259-7ed7-43bb-bd3f-79bbf62d0f25 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:38.384876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f579f259-7ed7-43bb-bd3f-79bbf62d0f25 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:38.399387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f579f259-7ed7-43bb-bd3f-79bbf62d0f25 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.399887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f579f259-7ed7-43bb-bd3f-79bbf62d0f25 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.400325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f579f259-7ed7-43bb-bd3f-79bbf62d0f25 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.401051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f579f259-7ed7-43bb-bd3f-79bbf62d0f25 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.401504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f579f259-7ed7-43bb-bd3f-79bbf62d0f25 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.401966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f579f259-7ed7-43bb-bd3f-79bbf62d0f25 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.657701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-87484ac1-a576-4fcf-b290-cb5adc1dc26e tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:38.671283 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-87484ac1-a576-4fcf-b290-cb5adc1dc26e tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1513 microversion: 2.1 time: 1.111401 Oct 29 02:56:38.672942 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1359/2782] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:37 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1513 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:38.679274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ec688416-7685-4e34-97e0-0745e6482536 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:38.680149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ec688416-7685-4e34-97e0-0745e6482536 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:38.688600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec688416-7685-4e34-97e0-0745e6482536 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.689311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec688416-7685-4e34-97e0-0745e6482536 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.690062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec688416-7685-4e34-97e0-0745e6482536 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.691112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec688416-7685-4e34-97e0-0745e6482536 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.691706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec688416-7685-4e34-97e0-0745e6482536 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.692437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec688416-7685-4e34-97e0-0745e6482536 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.912456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec688416-7685-4e34-97e0-0745e6482536 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:38.928315 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ec688416-7685-4e34-97e0-0745e6482536 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 0.250765 Oct 29 02:56:38.929522 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1360/2783] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:38 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:38.944898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-75675c73-2dce-4dff-8bb2-104338114b16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:38.945784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-75675c73-2dce-4dff-8bb2-104338114b16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:38.968030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75675c73-2dce-4dff-8bb2-104338114b16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.968526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75675c73-2dce-4dff-8bb2-104338114b16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.968953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75675c73-2dce-4dff-8bb2-104338114b16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.972930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75675c73-2dce-4dff-8bb2-104338114b16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.976183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75675c73-2dce-4dff-8bb2-104338114b16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.976965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75675c73-2dce-4dff-8bb2-104338114b16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:39.227828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-75675c73-2dce-4dff-8bb2-104338114b16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:39.232265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:39.246074 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-75675c73-2dce-4dff-8bb2-104338114b16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1346 microversion: 2.1 time: 0.315227 Oct 29 02:56:39.251234 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1361/2784] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:38 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1346 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:39.312337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a823f3ed-b92d-4d3e-b56b-4e6346fbffe4 req-31d1f651-b4c2-4df9-b0e7-37fa7140a778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c272fb-32fc-49c0-bd23-68c2e10da4d3", "name": "network-vif-deleted", "tag": "561af0fa-556f-4ed2-8a5c-387edd2f81a3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:39.313889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f579f259-7ed7-43bb-bd3f-79bbf62d0f25 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:39.326795 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f579f259-7ed7-43bb-bd3f-79bbf62d0f25 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 0.947958 Oct 29 02:56:39.328693 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1424/2785] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:38 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:39.362281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a823f3ed-b92d-4d3e-b56b-4e6346fbffe4 req-31d1f651-b4c2-4df9-b0e7-37fa7140a778 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:39.365166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a823f3ed-b92d-4d3e-b56b-4e6346fbffe4 req-31d1f651-b4c2-4df9-b0e7-37fa7140a778 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:39.365763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a823f3ed-b92d-4d3e-b56b-4e6346fbffe4 req-31d1f651-b4c2-4df9-b0e7-37fa7140a778 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:39.396561 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a823f3ed-b92d-4d3e-b56b-4e6346fbffe4 req-31d1f651-b4c2-4df9-b0e7-37fa7140a778 service nova] Creating event network-vif-deleted:561af0fa-556f-4ed2-8a5c-387edd2f81a3 for instance 85c272fb-32fc-49c0-bd23-68c2e10da4d3 on n-h1-862964-4 Oct 29 02:56:39.405072 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a823f3ed-b92d-4d3e-b56b-4e6346fbffe4 req-31d1f651-b4c2-4df9-b0e7-37fa7140a778 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105038 Oct 29 02:56:39.406562 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1362/2786] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:39.700090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:39.700603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:39.718645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:39.719113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:39.719732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:39.721242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:39.721898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:39.722495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:39.804006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:39.804554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:39.804995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:39.808992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lazy-loading 'fault' on Instance uuid 85c272fb-32fc-49c0-bd23-68c2e10da4d3 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:56:39.962345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40a4effe-f4ea-47d5-9bfb-93f9d2aeeb45 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:39.963582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40a4effe-f4ea-47d5-9bfb-93f9d2aeeb45 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:39.981719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40a4effe-f4ea-47d5-9bfb-93f9d2aeeb45 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:39.983468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40a4effe-f4ea-47d5-9bfb-93f9d2aeeb45 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:39.983927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40a4effe-f4ea-47d5-9bfb-93f9d2aeeb45 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:39.990703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40a4effe-f4ea-47d5-9bfb-93f9d2aeeb45 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:39.993674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40a4effe-f4ea-47d5-9bfb-93f9d2aeeb45 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:39.995200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40a4effe-f4ea-47d5-9bfb-93f9d2aeeb45 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:40.283735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c307a82cd9d4c3f884e67c376757a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f94d5560cbe4ad98fdb148e80c66ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:40.298137 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-182be708-574d-4c20-8290-7763f3e857b8 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 200 len: 1307 microversion: 2.1 time: 0.602538 Oct 29 02:56:40.298745 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1425/2787] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:39 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 1307 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:40.320561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-78020c74-09c2-45d8-abf9-2cc508ec54fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:40.321154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-78020c74-09c2-45d8-abf9-2cc508ec54fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:40.329083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78020c74-09c2-45d8-abf9-2cc508ec54fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:40.330194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78020c74-09c2-45d8-abf9-2cc508ec54fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:40.331284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78020c74-09c2-45d8-abf9-2cc508ec54fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:40.332361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78020c74-09c2-45d8-abf9-2cc508ec54fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:40.333020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78020c74-09c2-45d8-abf9-2cc508ec54fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:40.333788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78020c74-09c2-45d8-abf9-2cc508ec54fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:40.530135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-78020c74-09c2-45d8-abf9-2cc508ec54fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:40.540476 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-78020c74-09c2-45d8-abf9-2cc508ec54fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1346 microversion: 2.1 time: 0.225002 Oct 29 02:56:40.545007 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1426/2788] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:40 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1346 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:40.564045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4facaf3c-cdc7-4349-a9b8-d2411eec16b2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:40.570692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4facaf3c-cdc7-4349-a9b8-d2411eec16b2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:40.578319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4facaf3c-cdc7-4349-a9b8-d2411eec16b2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:40.581932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4facaf3c-cdc7-4349-a9b8-d2411eec16b2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:40.582635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4facaf3c-cdc7-4349-a9b8-d2411eec16b2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:40.589822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4facaf3c-cdc7-4349-a9b8-d2411eec16b2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:40.590516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4facaf3c-cdc7-4349-a9b8-d2411eec16b2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:40.591020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4facaf3c-cdc7-4349-a9b8-d2411eec16b2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:41.003077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4facaf3c-cdc7-4349-a9b8-d2411eec16b2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:41.007998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40a4effe-f4ea-47d5-9bfb-93f9d2aeeb45 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:41.020488 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4facaf3c-cdc7-4349-a9b8-d2411eec16b2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 0.473987 Oct 29 02:56:41.030648 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1427/2789] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:40 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:41.038335 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40a4effe-f4ea-47d5-9bfb-93f9d2aeeb45 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 1.084859 Oct 29 02:56:41.040734 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1363/2790] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:39 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:41.305244 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b7e6e27-9e4a-461a-8124-082b3f818265 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.270309 Oct 29 02:56:41.306002 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1428/2791] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Oct 29 02:56:41 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 02:56:41.317206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-547e92df-7867-4752-a3eb-934585d034b6 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Calling method '.version_select at 0x7fe1a8767670>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:41.326986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:41.327607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] [instance: 85c272fb-32fc-49c0-bd23-68c2e10da4d3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:41.352408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:41.357603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:41.358293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:41.362292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:41.363010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:41.365372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:41.367809 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-547e92df-7867-4752-a3eb-934585d034b6 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] HTTP exception thrown: Image not found. Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-547e92df-7867-4752-a3eb-934585d034b6 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Request method failure captured: Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZodQA_BsXv3qZ93bEDQezO78G0zQyEW77STNq_T1I5ISPi0niceqsCWPXaxZZJ2cQLcEsQGDlXAeyZ5xUeuq48w0Hxk2xK3QpAeVoyrkZCUPc7PXUiENTybkhCiPn-Q0SwvDqaUIAYxQC3Yw_Y7A6sDfW1-gDDvXkVuwS__hrB9Mw Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4d79effa8abb45b09a4e38134edd8f46 Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d79effa8abb45b09a4e38134edd8f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d79effa8abb45b09a4e38134edd8f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d79effa8abb45b09a4e38134edd8f46", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d79effa8abb45b09a4e38134edd8f46"}]}] Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4d79effa8abb45b09a4e38134edd8f46 Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesDeleteNegativeTestJSON-1807282745-project Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 8da7a286ae354ff18e919e5086dc9a04 Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745-project Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '-1'} Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.370388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:56:41.374542 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.377321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-547e92df-7867-4752-a3eb-934585d034b6 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:41.378446 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-547e92df-7867-4752-a3eb-934585d034b6 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.065333 Oct 29 02:56:41.380169 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1364/2792] 10.222.0.16 () {58 vars in 1134 bytes} [Sat Oct 29 02:56:41 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:56:41.392872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de422f93-d07b-49e9-b70c-8984831388cc tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Calling method '.version_select at 0x7fe1a86f1af0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:41.428315 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] HTTP exception thrown: Instance 85c272fb-32fc-49c0-bd23-68c2e10da4d3 could not be found. Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Request method failure captured: Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 HTTP/1.1 Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZIrlNjB6WGnjaSjbNvxw7simMxaDBDsjCCk2npowK3qruHYZ8Z-IJd-YE2D5zY1TdgkouxQ3TJ9mq7VpL0uoP84eAfGmM3m8FAm8VdpR5Z7-cFOBVJ2-4KXWXlXdxx1RxCQLrL1ZvZtFSzjB59LvudhpMAZKb3HX8mdA9xg1eSjZo Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9f94d5560cbe4ad98fdb148e80c66ffc Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerAddressesTestJSON-2072480984 Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f94d5560cbe4ad98fdb148e80c66ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f94d5560cbe4ad98fdb148e80c66ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f94d5560cbe4ad98fdb148e80c66ffc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f94d5560cbe4ad98fdb148e80c66ffc"}]}] Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerAddressesTestJSON-2072480984 Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9f94d5560cbe4ad98fdb148e80c66ffc Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2072480984 Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerAddressesTestJSON-2072480984-project Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3c307a82cd9d4c3f884e67c376757a6a Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerAddressesTestJSON-2072480984-project Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 85c272fb-32fc-49c0-bd23-68c2e10da4d3 could not be found. Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '85c272fb-32fc-49c0-bd23-68c2e10da4d3'} Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c272fb-32fc-49c0-bd23-68c2e10da4d3 could not be found. Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c272fb-32fc-49c0-bd23-68c2e10da4d3 could not be found. Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.433922 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.438579 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.438579 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.438579 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.438579 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:41.438579 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:41.438579 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c272fb-32fc-49c0-bd23-68c2e10da4d3 could not be found. Oct 29 02:56:41.438579 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.442673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] Returning 404 to user: Instance 85c272fb-32fc-49c0-bd23-68c2e10da4d3 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:41.445132 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0af92ca4-7d45-4b0a-8cfe-04d5d62f9e10 tempest-ServerAddressesTestJSON-2072480984 tempest-ServerAddressesTestJSON-2072480984-project] 10.222.0.16 "GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3" status: 404 len: 111 microversion: 2.1 time: 0.121262 Oct 29 02:56:41.446721 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1429/2793] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:41 2022] GET /compute/v2.1/servers/85c272fb-32fc-49c0-bd23-68c2e10da4d3 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:41.450917 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-de422f93-d07b-49e9-b70c-8984831388cc tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] HTTP exception thrown: Image not found. Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de422f93-d07b-49e9-b70c-8984831388cc tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Request method failure captured: Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/images/c6b38122-41a2-4bde-957c-08a7da50d6fj HTTP/1.1 Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZodQA_BsXv3qZ93bEDQezO78G0zQyEW77STNq_T1I5ISPi0niceqsCWPXaxZZJ2cQLcEsQGDlXAeyZ5xUeuq48w0Hxk2xK3QpAeVoyrkZCUPc7PXUiENTybkhCiPn-Q0SwvDqaUIAYxQC3Yw_Y7A6sDfW1-gDDvXkVuwS__hrB9Mw Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4d79effa8abb45b09a4e38134edd8f46 Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d79effa8abb45b09a4e38134edd8f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d79effa8abb45b09a4e38134edd8f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d79effa8abb45b09a4e38134edd8f46", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d79effa8abb45b09a4e38134edd8f46"}]}] Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4d79effa8abb45b09a4e38134edd8f46 Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesDeleteNegativeTestJSON-1807282745-project Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 8da7a286ae354ff18e919e5086dc9a04 Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745-project Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c6b38122-41a2-4bde-957c-08a7da50d6fj'} Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c6b38122-41a2-4bde-957c-08a7da50d6fj to delete Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c6b38122-41a2-4bde-957c-08a7da50d6fj could not be found. Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.453368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de422f93-d07b-49e9-b70c-8984831388cc tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de422f93-d07b-49e9-b70c-8984831388cc tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] 10.222.0.16 "DELETE /compute/v2.1/images/c6b38122-41a2-4bde-957c-08a7da50d6fj" status: 404 len: 62 microversion: 2.1 time: 0.068576 Oct 29 02:56:41.457210 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1365/2794] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:41 2022] DELETE /compute/v2.1/images/c6b38122-41a2-4bde-957c-08a7da50d6fj => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 02:56:41.467097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-622edde7-0d3f-4f7f-b0a8-0103bbd6c72a tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Calling method '.version_select at 0x7fe1a86fe310>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:41.492038 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-622edde7-0d3f-4f7f-b0a8-0103bbd6c72a tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] HTTP exception thrown: Image not found. Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-622edde7-0d3f-4f7f-b0a8-0103bbd6c72a tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Request method failure captured: Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/images/8677f288-83c7-4c3a-ba8f-c5722c11e40f1 HTTP/1.1 Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZodQA_BsXv3qZ93bEDQezO78G0zQyEW77STNq_T1I5ISPi0niceqsCWPXaxZZJ2cQLcEsQGDlXAeyZ5xUeuq48w0Hxk2xK3QpAeVoyrkZCUPc7PXUiENTybkhCiPn-Q0SwvDqaUIAYxQC3Yw_Y7A6sDfW1-gDDvXkVuwS__hrB9Mw Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4d79effa8abb45b09a4e38134edd8f46 Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d79effa8abb45b09a4e38134edd8f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d79effa8abb45b09a4e38134edd8f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d79effa8abb45b09a4e38134edd8f46", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d79effa8abb45b09a4e38134edd8f46"}]}] Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4d79effa8abb45b09a4e38134edd8f46 Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesDeleteNegativeTestJSON-1807282745-project Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 8da7a286ae354ff18e919e5086dc9a04 Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745-project Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: exception: Image not found. Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '8677f288-83c7-4c3a-ba8f-c5722c11e40f1'} Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8677f288-83c7-4c3a-ba8f-c5722c11e40f1 to delete Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8677f288-83c7-4c3a-ba8f-c5722c11e40f1 could not be found. Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.493862 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-622edde7-0d3f-4f7f-b0a8-0103bbd6c72a tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Returning 404 to user: Image not found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-622edde7-0d3f-4f7f-b0a8-0103bbd6c72a tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] 10.222.0.16 "DELETE /compute/v2.1/images/8677f288-83c7-4c3a-ba8f-c5722c11e40f1" status: 404 len: 62 microversion: 2.1 time: 0.033003 Oct 29 02:56:41.499402 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1430/2795] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:56:41 2022] DELETE /compute/v2.1/images/8677f288-83c7-4c3a-ba8f-c5722c11e40f1 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:56:41.506836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e0db43d1-53a0-4f96-aa6d-399221f4ecf0 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Calling method '.version_select at 0x7fe1a87679d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:41.539415 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-e0db43d1-53a0-4f96-aa6d-399221f4ecf0 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] HTTP exception thrown: Image not found. Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e0db43d1-53a0-4f96-aa6d-399221f4ecf0 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Request method failure captured: Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/images/tempest-invalid-1199438404 HTTP/1.1 Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZodQA_BsXv3qZ93bEDQezO78G0zQyEW77STNq_T1I5ISPi0niceqsCWPXaxZZJ2cQLcEsQGDlXAeyZ5xUeuq48w0Hxk2xK3QpAeVoyrkZCUPc7PXUiENTybkhCiPn-Q0SwvDqaUIAYxQC3Yw_Y7A6sDfW1-gDDvXkVuwS__hrB9Mw Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4d79effa8abb45b09a4e38134edd8f46 Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d79effa8abb45b09a4e38134edd8f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d79effa8abb45b09a4e38134edd8f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d79effa8abb45b09a4e38134edd8f46", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d79effa8abb45b09a4e38134edd8f46"}]}] Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4d79effa8abb45b09a4e38134edd8f46 Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesDeleteNegativeTestJSON-1807282745-project Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 8da7a286ae354ff18e919e5086dc9a04 Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745-project Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'tempest-invalid-1199438404'} Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1199438404 to delete Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1199438404 could not be found. Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.541332 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e0db43d1-53a0-4f96-aa6d-399221f4ecf0 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e0db43d1-53a0-4f96-aa6d-399221f4ecf0 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-1199438404" status: 404 len: 62 microversion: 2.1 time: 0.039832 Oct 29 02:56:41.545453 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1366/2796] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Oct 29 02:56:41 2022] DELETE /compute/v2.1/images/tempest-invalid-1199438404 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:56:41.555466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b3020dc5-0b05-4bc6-b5c4-8c393707fe34 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Calling method '.version_select at 0x7fe1a85c6160>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:41.582939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7b49775d-c063-4b92-bce7-564254227de2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:41.583548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7b49775d-c063-4b92-bce7-564254227de2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:41.594768 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-b3020dc5-0b05-4bc6-b5c4-8c393707fe34 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] HTTP exception thrown: Image not found. Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b3020dc5-0b05-4bc6-b5c4-8c393707fe34 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Request method failure captured: Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/images/019260e3-128f-4f1c-937e-22a3e1578c91 HTTP/1.1 Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZodQA_BsXv3qZ93bEDQezO78G0zQyEW77STNq_T1I5ISPi0niceqsCWPXaxZZJ2cQLcEsQGDlXAeyZ5xUeuq48w0Hxk2xK3QpAeVoyrkZCUPc7PXUiENTybkhCiPn-Q0SwvDqaUIAYxQC3Yw_Y7A6sDfW1-gDDvXkVuwS__hrB9Mw Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4d79effa8abb45b09a4e38134edd8f46 Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d79effa8abb45b09a4e38134edd8f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d79effa8abb45b09a4e38134edd8f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d79effa8abb45b09a4e38134edd8f46", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d79effa8abb45b09a4e38134edd8f46"}]}] Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4d79effa8abb45b09a4e38134edd8f46 Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745 Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesDeleteNegativeTestJSON-1807282745-project Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 8da7a286ae354ff18e919e5086dc9a04 Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1807282745-project Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: exception: Image not found. Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '019260e3-128f-4f1c-937e-22a3e1578c91'} Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 019260e3-128f-4f1c-937e-22a3e1578c91 to delete Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 019260e3-128f-4f1c-937e-22a3e1578c91 could not be found. Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.597202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b3020dc5-0b05-4bc6-b5c4-8c393707fe34 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] Returning 404 to user: Image not found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b3020dc5-0b05-4bc6-b5c4-8c393707fe34 tempest-ImagesDeleteNegativeTestJSON-1807282745 tempest-ImagesDeleteNegativeTestJSON-1807282745-project] 10.222.0.16 "DELETE /compute/v2.1/images/019260e3-128f-4f1c-937e-22a3e1578c91" status: 404 len: 62 microversion: 2.1 time: 0.047558 Oct 29 02:56:41.601687 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1431/2797] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:41 2022] DELETE /compute/v2.1/images/019260e3-128f-4f1c-937e-22a3e1578c91 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:56:41.603527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b49775d-c063-4b92-bce7-564254227de2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:41.603527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b49775d-c063-4b92-bce7-564254227de2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:41.603527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b49775d-c063-4b92-bce7-564254227de2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:41.603527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b49775d-c063-4b92-bce7-564254227de2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:41.603527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b49775d-c063-4b92-bce7-564254227de2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:41.603920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b49775d-c063-4b92-bce7-564254227de2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:42.046076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d64b72a9-9a65-4699-b8da-38ca0248779b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:42.048049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d64b72a9-9a65-4699-b8da-38ca0248779b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:42.068774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d64b72a9-9a65-4699-b8da-38ca0248779b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:42.069672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d64b72a9-9a65-4699-b8da-38ca0248779b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:42.070332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d64b72a9-9a65-4699-b8da-38ca0248779b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:42.071474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d64b72a9-9a65-4699-b8da-38ca0248779b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:42.072078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d64b72a9-9a65-4699-b8da-38ca0248779b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:42.072698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d64b72a9-9a65-4699-b8da-38ca0248779b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:42.146795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b49775d-c063-4b92-bce7-564254227de2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:42.160250 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7b49775d-c063-4b92-bce7-564254227de2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1346 microversion: 2.1 time: 0.581766 Oct 29 02:56:42.177907 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1367/2798] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:41 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1346 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:42.183077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5ec2034f-fc32-445b-b0d2-9e46fa64e791 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:42.184172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5ec2034f-fc32-445b-b0d2-9e46fa64e791 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:42.198054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ec2034f-fc32-445b-b0d2-9e46fa64e791 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:42.198837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ec2034f-fc32-445b-b0d2-9e46fa64e791 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:42.200168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ec2034f-fc32-445b-b0d2-9e46fa64e791 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:42.201066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ec2034f-fc32-445b-b0d2-9e46fa64e791 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:42.201788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ec2034f-fc32-445b-b0d2-9e46fa64e791 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:42.203054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ec2034f-fc32-445b-b0d2-9e46fa64e791 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:42.495663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d64b72a9-9a65-4699-b8da-38ca0248779b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:42.500193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:42.505166 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d64b72a9-9a65-4699-b8da-38ca0248779b tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 0.463466 Oct 29 02:56:42.519367 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1432/2799] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:42 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:42.798308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5ec2034f-fc32-445b-b0d2-9e46fa64e791 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:42.822296 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5ec2034f-fc32-445b-b0d2-9e46fa64e791 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 0.642761 Oct 29 02:56:42.827483 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1368/2800] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:42 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:43.184732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-22f34198-766d-4c9f-9958-1e54020022fa tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:43.185485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-22f34198-766d-4c9f-9958-1e54020022fa tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:43.208260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22f34198-766d-4c9f-9958-1e54020022fa tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:43.208956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22f34198-766d-4c9f-9958-1e54020022fa tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:43.209519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22f34198-766d-4c9f-9958-1e54020022fa tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:43.211084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22f34198-766d-4c9f-9958-1e54020022fa tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:43.213395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22f34198-766d-4c9f-9958-1e54020022fa tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:43.213982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22f34198-766d-4c9f-9958-1e54020022fa tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:43.439328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-22f34198-766d-4c9f-9958-1e54020022fa tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:43.449045 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-22f34198-766d-4c9f-9958-1e54020022fa tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1346 microversion: 2.1 time: 0.268251 Oct 29 02:56:43.468683 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1433/2801] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:43 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1346 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:43.538005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c784dc3a-7cb9-4653-b550-e881813e1845 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:43.538799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c784dc3a-7cb9-4653-b550-e881813e1845 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:43.579134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c784dc3a-7cb9-4653-b550-e881813e1845 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:43.579552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c784dc3a-7cb9-4653-b550-e881813e1845 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:43.591039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c784dc3a-7cb9-4653-b550-e881813e1845 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:43.598424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c784dc3a-7cb9-4653-b550-e881813e1845 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:43.601013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c784dc3a-7cb9-4653-b550-e881813e1845 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:43.602471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c784dc3a-7cb9-4653-b550-e881813e1845 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:43.851195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fff3a391-d406-4787-bffa-992de6a4ba9e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:43.852662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fff3a391-d406-4787-bffa-992de6a4ba9e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:43.865136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fff3a391-d406-4787-bffa-992de6a4ba9e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:43.866636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fff3a391-d406-4787-bffa-992de6a4ba9e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:43.867510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fff3a391-d406-4787-bffa-992de6a4ba9e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:43.868452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fff3a391-d406-4787-bffa-992de6a4ba9e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:43.869056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fff3a391-d406-4787-bffa-992de6a4ba9e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:43.869982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fff3a391-d406-4787-bffa-992de6a4ba9e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:44.078497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c784dc3a-7cb9-4653-b550-e881813e1845 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:44.092175 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c784dc3a-7cb9-4653-b550-e881813e1845 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 0.558953 Oct 29 02:56:44.092766 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1369/2802] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:43 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:44.102248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-85fcf3fa-2472-436f-89d9-7641161ff33f req-2aed918b-63bf-436f-89cb-1295b22e8411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ed9c7b-73e9-4268-af26-ff629c7e4ff4", "name": "network-vif-plugged", "status": "completed", "tag": "be09f872-ea24-47be-a1b5-c0d50808a72d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:44.113919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-85fcf3fa-2472-436f-89d9-7641161ff33f req-2aed918b-63bf-436f-89cb-1295b22e8411 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:44.114661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-85fcf3fa-2472-436f-89d9-7641161ff33f req-2aed918b-63bf-436f-89cb-1295b22e8411 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:44.115710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-85fcf3fa-2472-436f-89d9-7641161ff33f req-2aed918b-63bf-436f-89cb-1295b22e8411 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:44.140473 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-85fcf3fa-2472-436f-89d9-7641161ff33f req-2aed918b-63bf-436f-89cb-1295b22e8411 service nova] Creating event network-vif-plugged:be09f872-ea24-47be-a1b5-c0d50808a72d for instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 on n-h2-862964-4 Oct 29 02:56:44.151014 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-85fcf3fa-2472-436f-89d9-7641161ff33f req-2aed918b-63bf-436f-89cb-1295b22e8411 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052693 Oct 29 02:56:44.152403 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1370/2803] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:44.471721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fff3a391-d406-4787-bffa-992de6a4ba9e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:44.476697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e8fc40e-b16c-4a0d-85e7-8a1910dd1f56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:44.477413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e8fc40e-b16c-4a0d-85e7-8a1910dd1f56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:44.488574 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fff3a391-d406-4787-bffa-992de6a4ba9e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 0.647407 Oct 29 02:56:44.494288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e8fc40e-b16c-4a0d-85e7-8a1910dd1f56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:44.495462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e8fc40e-b16c-4a0d-85e7-8a1910dd1f56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:44.496110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e8fc40e-b16c-4a0d-85e7-8a1910dd1f56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:44.497318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e8fc40e-b16c-4a0d-85e7-8a1910dd1f56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:44.497992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e8fc40e-b16c-4a0d-85e7-8a1910dd1f56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:44.498568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e8fc40e-b16c-4a0d-85e7-8a1910dd1f56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:44.504026 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1434/2804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:43 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:44.689590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3e8fc40e-b16c-4a0d-85e7-8a1910dd1f56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:44.710522 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3e8fc40e-b16c-4a0d-85e7-8a1910dd1f56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1346 microversion: 2.1 time: 0.237983 Oct 29 02:56:44.710995 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1371/2805] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:44 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1346 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:45.118663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a86f975f-c91b-4986-8b17-7b74517135d3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:45.119780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a86f975f-c91b-4986-8b17-7b74517135d3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:45.131466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a86f975f-c91b-4986-8b17-7b74517135d3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:45.132235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a86f975f-c91b-4986-8b17-7b74517135d3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:45.135699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a86f975f-c91b-4986-8b17-7b74517135d3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:45.136774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a86f975f-c91b-4986-8b17-7b74517135d3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:45.137592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a86f975f-c91b-4986-8b17-7b74517135d3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:45.138228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a86f975f-c91b-4986-8b17-7b74517135d3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:45.409780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a86f975f-c91b-4986-8b17-7b74517135d3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:45.417675 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a86f975f-c91b-4986-8b17-7b74517135d3 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1308 microversion: 2.1 time: 0.303500 Oct 29 02:56:45.435266 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1435/2806] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:45 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:45.526216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0576e753-e9b9-4639-a43c-2ea64767b564 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:45.526892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0576e753-e9b9-4639-a43c-2ea64767b564 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:45.545978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0576e753-e9b9-4639-a43c-2ea64767b564 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:45.546468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0576e753-e9b9-4639-a43c-2ea64767b564 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:45.549935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0576e753-e9b9-4639-a43c-2ea64767b564 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:45.550832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0576e753-e9b9-4639-a43c-2ea64767b564 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:45.552181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0576e753-e9b9-4639-a43c-2ea64767b564 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:45.552874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0576e753-e9b9-4639-a43c-2ea64767b564 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:45.926766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d9263346-3671-49d9-a99a-3da9ae60de31 tempest-AZV2TestJSON-558620510 tempest-AZV2TestJSON-558620510-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:45.929837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9263346-3671-49d9-a99a-3da9ae60de31 tempest-AZV2TestJSON-558620510 tempest-AZV2TestJSON-558620510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:45.930640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9263346-3671-49d9-a99a-3da9ae60de31 tempest-AZV2TestJSON-558620510 tempest-AZV2TestJSON-558620510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:45.931220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9263346-3671-49d9-a99a-3da9ae60de31 tempest-AZV2TestJSON-558620510 tempest-AZV2TestJSON-558620510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:45.933110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9263346-3671-49d9-a99a-3da9ae60de31 tempest-AZV2TestJSON-558620510 tempest-AZV2TestJSON-558620510-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:45.934318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9263346-3671-49d9-a99a-3da9ae60de31 tempest-AZV2TestJSON-558620510 tempest-AZV2TestJSON-558620510-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:45.934887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9263346-3671-49d9-a99a-3da9ae60de31 tempest-AZV2TestJSON-558620510 tempest-AZV2TestJSON-558620510-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:45.965450 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d9263346-3671-49d9-a99a-3da9ae60de31 tempest-AZV2TestJSON-558620510 tempest-AZV2TestJSON-558620510-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.359557 Oct 29 02:56:45.966830 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1436/2807] 10.222.0.16 () {58 vars in 1164 bytes} [Sat Oct 29 02:56:45 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 02:56:45.993976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0576e753-e9b9-4639-a43c-2ea64767b564 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:45.995000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:45.995698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:46.007387 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0576e753-e9b9-4639-a43c-2ea64767b564 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 0.492448 Oct 29 02:56:46.010899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.011685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.013628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.020136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.026936 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1372/2808] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:45 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:46.027979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.028619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.100297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.100727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.101157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.101676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lazy-loading 'fault' on Instance uuid 1615ba83-e03b-4936-9ea2-f08ea0436ec9 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:56:46.149271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:46.164882 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2f57c8fc-6fe4-4cf3-b7a8-86d910edf8db tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 200 len: 1351 microversion: 2.1 time: 0.192405 Oct 29 02:56:46.165975 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1437/2809] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:45 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 1351 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:46.179521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-bb80600f-d835-4d46-8aeb-43a6798427ac req-e3ca2906-09b3-46c3-8b12-7af58b90553f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd9e3b45-8ae9-470a-80f6-26c3057f7afe", "name": "network-vif-plugged", "status": "completed", "tag": "9eebf062-ba82-4f9f-85ad-21b23f2023ad"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:46.198664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bb80600f-d835-4d46-8aeb-43a6798427ac req-e3ca2906-09b3-46c3-8b12-7af58b90553f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.202228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bb80600f-d835-4d46-8aeb-43a6798427ac req-e3ca2906-09b3-46c3-8b12-7af58b90553f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.202836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bb80600f-d835-4d46-8aeb-43a6798427ac req-e3ca2906-09b3-46c3-8b12-7af58b90553f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.225095 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-bb80600f-d835-4d46-8aeb-43a6798427ac req-e3ca2906-09b3-46c3-8b12-7af58b90553f service nova] Creating event network-vif-plugged:9eebf062-ba82-4f9f-85ad-21b23f2023ad for instance cd9e3b45-8ae9-470a-80f6-26c3057f7afe on n-h2-862964-4 Oct 29 02:56:46.234827 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-bb80600f-d835-4d46-8aeb-43a6798427ac req-e3ca2906-09b3-46c3-8b12-7af58b90553f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059695 Oct 29 02:56:46.235996 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1373/2810] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:46.445244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-86391d8c-9f5c-42f4-bc91-80027708c967 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:46.446472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-86391d8c-9f5c-42f4-bc91-80027708c967 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:46.455934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86391d8c-9f5c-42f4-bc91-80027708c967 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.459297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86391d8c-9f5c-42f4-bc91-80027708c967 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.460505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86391d8c-9f5c-42f4-bc91-80027708c967 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.461933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86391d8c-9f5c-42f4-bc91-80027708c967 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.462536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86391d8c-9f5c-42f4-bc91-80027708c967 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.463116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86391d8c-9f5c-42f4-bc91-80027708c967 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.664144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-86391d8c-9f5c-42f4-bc91-80027708c967 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:46.673212 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-86391d8c-9f5c-42f4-bc91-80027708c967 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1488 microversion: 2.1 time: 0.232213 Oct 29 02:56:46.674634 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1438/2811] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:46 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1488 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:46.699432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0baaf6be-e8cb-4c39-b61c-496814cbfbae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:46.701391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0baaf6be-e8cb-4c39-b61c-496814cbfbae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:46.708103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baaf6be-e8cb-4c39-b61c-496814cbfbae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.708774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baaf6be-e8cb-4c39-b61c-496814cbfbae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.709384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baaf6be-e8cb-4c39-b61c-496814cbfbae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.710580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baaf6be-e8cb-4c39-b61c-496814cbfbae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.711176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baaf6be-e8cb-4c39-b61c-496814cbfbae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.711732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baaf6be-e8cb-4c39-b61c-496814cbfbae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.760644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0baaf6be-e8cb-4c39-b61c-496814cbfbae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:56:46.875103 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0baaf6be-e8cb-4c39-b61c-496814cbfbae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 204 len: 0 microversion: 2.1 time: 0.179751 Oct 29 02:56:46.879236 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1374/2812] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:56:46 2022] DELETE /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:56:46.884846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f699ec64-8302-42c4-a689-b06f32126295 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:46.885527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f699ec64-8302-42c4-a689-b06f32126295 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:46.901670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f699ec64-8302-42c4-a689-b06f32126295 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.906514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f699ec64-8302-42c4-a689-b06f32126295 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.908126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f699ec64-8302-42c4-a689-b06f32126295 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.909563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f699ec64-8302-42c4-a689-b06f32126295 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.911356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f699ec64-8302-42c4-a689-b06f32126295 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.911977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f699ec64-8302-42c4-a689-b06f32126295 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.035733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a54f3c8-06ff-4590-af47-f587adae2350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:47.036444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3a54f3c8-06ff-4590-af47-f587adae2350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:47.053781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a54f3c8-06ff-4590-af47-f587adae2350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.055972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a54f3c8-06ff-4590-af47-f587adae2350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.057749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a54f3c8-06ff-4590-af47-f587adae2350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.060825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a54f3c8-06ff-4590-af47-f587adae2350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.062738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a54f3c8-06ff-4590-af47-f587adae2350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.063691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a54f3c8-06ff-4590-af47-f587adae2350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.203754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f699ec64-8302-42c4-a689-b06f32126295 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:47.217782 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f699ec64-8302-42c4-a689-b06f32126295 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1494 microversion: 2.1 time: 0.337223 Oct 29 02:56:47.218932 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1439/2813] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:46 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1494 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:47.223955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:47.224752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:47.234431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.235228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.235984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.247047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.247849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.249607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.283087 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 HTTP/1.1 Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1615ba83-e03b-4936-9ea2-f08ea0436ec9'} Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:47.291115 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:47.296272 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:47.296272 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:47.296272 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:47.296272 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:47.296272 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:47.296272 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 02:56:47.296272 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:47.298709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:47.300697 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29503c45-1a85-4917-9978-39d9100c5553 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 404 len: 111 microversion: 2.1 time: 0.080484 Oct 29 02:56:47.305863 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1440/2814] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:47 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:47.522317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:47.529015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:47.553865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.555809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.556272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.557022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.557484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.563221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.602051 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9/os-volume_attachments HTTP/1.1 Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'server_id': '1615ba83-e03b-4936-9ea2-f08ea0436ec9'} Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:47.608926 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d0484069-5dfb-4387-a7b8-59802e2858e6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.099143 Oct 29 02:56:47.613334 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1441/2815] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 02:56:47 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9/os-volume_attachments => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:56:47.667429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3a54f3c8-06ff-4590-af47-f587adae2350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:47.681027 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3a54f3c8-06ff-4590-af47-f587adae2350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 0.650589 Oct 29 02:56:47.683956 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1375/2816] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:47 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:47.908077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1985563006", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "206445a3-72bd-4ae4-a1d4-4c994350bfbb"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:48.017489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] validate_networks() for [('206445a3-72bd-4ae4-a1d4-4c994350bfbb', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:48.244813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fba24aa6-ce12-4ab6-8855-5d1e5842f92c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:48.245959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fba24aa6-ce12-4ab6-8855-5d1e5842f92c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:48.253114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba24aa6-ce12-4ab6-8855-5d1e5842f92c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:48.253704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba24aa6-ce12-4ab6-8855-5d1e5842f92c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:48.254050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba24aa6-ce12-4ab6-8855-5d1e5842f92c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:48.254980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba24aa6-ce12-4ab6-8855-5d1e5842f92c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:48.255350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba24aa6-ce12-4ab6-8855-5d1e5842f92c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:48.255773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba24aa6-ce12-4ab6-8855-5d1e5842f92c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:48.653840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:48.655677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:48.656411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:48.657111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:48.657751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:48.678815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:48.684366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:48.684896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:48.689607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:48.690065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:48.690506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:48.735982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fba24aa6-ce12-4ab6-8855-5d1e5842f92c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:48.739634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:48.743722 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fba24aa6-ce12-4ab6-8855-5d1e5842f92c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1494 microversion: 2.1 time: 0.503113 Oct 29 02:56:48.744298 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1376/2817] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:48 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1494 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:48.746420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for user fceb096cc5414b3a9d7300fefeb90dff and project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:48.760510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d4a92ec-b9c3-48be-bad3-7f1dcc930cc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:48.761116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d4a92ec-b9c3-48be-bad3-7f1dcc930cc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:48.764250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:48.766932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3d515818-9b5a-4016-93ba-e06ae489d4b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:48.780036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d4a92ec-b9c3-48be-bad3-7f1dcc930cc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:48.780611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d4a92ec-b9c3-48be-bad3-7f1dcc930cc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:48.781046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d4a92ec-b9c3-48be-bad3-7f1dcc930cc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:48.781745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d4a92ec-b9c3-48be-bad3-7f1dcc930cc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:48.782235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d4a92ec-b9c3-48be-bad3-7f1dcc930cc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:48.783365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d4a92ec-b9c3-48be-bad3-7f1dcc930cc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:48.843757 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d3546ccb-be1c-41d1-8e0a-fc37764c3388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939813 Oct 29 02:56:48.845715 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1442/2818] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:56:48.858922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-60a507a0-4c53-488a-86ef-9bc58b7bdb6b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:48.861301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-60a507a0-4c53-488a-86ef-9bc58b7bdb6b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3d515818-9b5a-4016-93ba-e06ae489d4b3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:48.969000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-60a507a0-4c53-488a-86ef-9bc58b7bdb6b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:48.981842 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-60a507a0-4c53-488a-86ef-9bc58b7bdb6b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3" status: 200 len: 1215 microversion: 2.1 time: 0.128278 Oct 29 02:56:48.983419 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1443/2819] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:48 2022] GET /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:49.011798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3edf565f-c737-4b5d-8f69-0f85ae5220e4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:49.012360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3edf565f-c737-4b5d-8f69-0f85ae5220e4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3d515818-9b5a-4016-93ba-e06ae489d4b3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:49.054705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3edf565f-c737-4b5d-8f69-0f85ae5220e4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3d515818-9b5a-4016-93ba-e06ae489d4b3] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:56:49.556778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d4a92ec-b9c3-48be-bad3-7f1dcc930cc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:49.568076 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d4a92ec-b9c3-48be-bad3-7f1dcc930cc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1316 microversion: 2.1 time: 0.812289 Oct 29 02:56:49.575017 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1377/2820] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:48 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1316 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:49.689026 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.scheduler.client.report [None req-3edf565f-c737-4b5d-8f69-0f85ae5220e4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Deleted allocations for instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 Oct 29 02:56:49.695390 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.compute.api [None req-3edf565f-c737-4b5d-8f69-0f85ae5220e4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3d515818-9b5a-4016-93ba-e06ae489d4b3] Instance Mapping does not exist while attempting local delete cleanup. Oct 29 02:56:49.697156 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3edf565f-c737-4b5d-8f69-0f85ae5220e4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3" status: 204 len: 0 microversion: 2.1 time: 0.691252 Oct 29 02:56:49.699247 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1444/2821] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:56:49 2022] DELETE /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:56:49.707640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e351c7d-c384-4841-9b74-58aacc4024f1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:49.708293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4e351c7d-c384-4841-9b74-58aacc4024f1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3d515818-9b5a-4016-93ba-e06ae489d4b3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:49.717138 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-4e351c7d-c384-4841-9b74-58aacc4024f1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e351c7d-c384-4841-9b74-58aacc4024f1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3 HTTP/1.1 Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3d515818-9b5a-4016-93ba-e06ae489d4b3'} Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:49.721650 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:49.725476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:49.725476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:49.725476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:49.725476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 02:56:49.725476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.725476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e351c7d-c384-4841-9b74-58aacc4024f1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:49.725476 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4e351c7d-c384-4841-9b74-58aacc4024f1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3" status: 404 len: 111 microversion: 2.1 time: 0.019916 Oct 29 02:56:49.735902 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1378/2822] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:49 2022] GET /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:49.770288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c5399f7f-54a1-473b-bbf8-9c7414a18056 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:49.770902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c5399f7f-54a1-473b-bbf8-9c7414a18056 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:49.785580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5399f7f-54a1-473b-bbf8-9c7414a18056 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:49.786128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5399f7f-54a1-473b-bbf8-9c7414a18056 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:49.786567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5399f7f-54a1-473b-bbf8-9c7414a18056 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:49.787351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5399f7f-54a1-473b-bbf8-9c7414a18056 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:49.787806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5399f7f-54a1-473b-bbf8-9c7414a18056 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:49.788607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5399f7f-54a1-473b-bbf8-9c7414a18056 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:50.076784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aedc8bfd-d347-46f0-ae05-82479352fb82 tempest-QuotaClassesAdminTestJSON-1711766331 tempest-QuotaClassesAdminTestJSON-1711766331-project-admin] Calling method '.version_select at 0x7fe1a8858820>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:50.101837 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aedc8bfd-d347-46f0-ae05-82479352fb82 tempest-QuotaClassesAdminTestJSON-1711766331 tempest-QuotaClassesAdminTestJSON-1711766331-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.232414 Oct 29 02:56:50.116778 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1379/2823] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Oct 29 02:56:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:50.123112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1500834216", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "206445a3-72bd-4ae4-a1d4-4c994350bfbb"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:50.203095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] validate_networks() for [('206445a3-72bd-4ae4-a1d4-4c994350bfbb', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:50.211959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c5399f7f-54a1-473b-bbf8-9c7414a18056 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:50.228038 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c5399f7f-54a1-473b-bbf8-9c7414a18056 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1494 microversion: 2.1 time: 0.462825 Oct 29 02:56:50.228702 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1445/2824] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:49 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1494 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:50.251269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7684202a-d6a6-4600-bc30-afd30e00917e tempest-QuotaClassesAdminTestJSON-1711766331 tempest-QuotaClassesAdminTestJSON-1711766331-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a8c0aca0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:50.260722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:50.535973 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7684202a-d6a6-4600-bc30-afd30e00917e tempest-QuotaClassesAdminTestJSON-1711766331 tempest-QuotaClassesAdminTestJSON-1711766331-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.305881 Oct 29 02:56:50.536808 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1446/2825] 10.222.0.16 () {60 vars in 1206 bytes} [Sat Oct 29 02:56:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:50.549349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-131ec4ce-8edb-46dc-9177-014c54dc16f4 tempest-QuotaClassesAdminTestJSON-1711766331 tempest-QuotaClassesAdminTestJSON-1711766331-project-admin] Calling method '.version_select at 0x7fe1a86fe670>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:50.566126 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-131ec4ce-8edb-46dc-9177-014c54dc16f4 tempest-QuotaClassesAdminTestJSON-1711766331 tempest-QuotaClassesAdminTestJSON-1711766331-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.019979 Oct 29 02:56:50.573833 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1447/2826] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Oct 29 02:56:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:50.579098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-61125f59-1a26-487c-b67a-d9bdbf852d30 tempest-QuotaClassesAdminTestJSON-1711766331 tempest-QuotaClassesAdminTestJSON-1711766331-project-admin] Action: 'update', calling method: .version_select at 0x7fe1a86fe700>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:50.745244 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-61125f59-1a26-487c-b67a-d9bdbf852d30 tempest-QuotaClassesAdminTestJSON-1711766331 tempest-QuotaClassesAdminTestJSON-1711766331-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.169455 Oct 29 02:56:50.746979 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1448/2827] 10.222.0.16 () {60 vars in 1206 bytes} [Sat Oct 29 02:56:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:50.753028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-36eb0eec-c2e5-4730-a15a-f7791f958dec tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:50.754025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-36eb0eec-c2e5-4730-a15a-f7791f958dec tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:50.763200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36eb0eec-c2e5-4730-a15a-f7791f958dec tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:50.764090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36eb0eec-c2e5-4730-a15a-f7791f958dec tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:50.764729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36eb0eec-c2e5-4730-a15a-f7791f958dec tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:50.766067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36eb0eec-c2e5-4730-a15a-f7791f958dec tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:50.766759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36eb0eec-c2e5-4730-a15a-f7791f958dec tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:50.767385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36eb0eec-c2e5-4730-a15a-f7791f958dec tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.404246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-36eb0eec-c2e5-4730-a15a-f7791f958dec tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:51.416052 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-36eb0eec-c2e5-4730-a15a-f7791f958dec tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1503 microversion: 2.1 time: 0.665523 Oct 29 02:56:51.418210 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1449/2828] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:50 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1503 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:51.442465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-0df12e4f-9276-4a42-92cf-19a8deda3611 req-8cfc0827-421e-4b87-89cc-0ca49ea5ca73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ed9c7b-73e9-4268-af26-ff629c7e4ff4", "name": "network-vif-deleted", "tag": "be09f872-ea24-47be-a1b5-c0d50808a72d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:51.463544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0df12e4f-9276-4a42-92cf-19a8deda3611 req-8cfc0827-421e-4b87-89cc-0ca49ea5ca73 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.464214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0df12e4f-9276-4a42-92cf-19a8deda3611 req-8cfc0827-421e-4b87-89cc-0ca49ea5ca73 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.464831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0df12e4f-9276-4a42-92cf-19a8deda3611 req-8cfc0827-421e-4b87-89cc-0ca49ea5ca73 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.481145 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-0df12e4f-9276-4a42-92cf-19a8deda3611 req-8cfc0827-421e-4b87-89cc-0ca49ea5ca73 service nova] Creating event network-vif-deleted:be09f872-ea24-47be-a1b5-c0d50808a72d for instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 on n-h2-862964-4 Oct 29 02:56:51.486758 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-0df12e4f-9276-4a42-92cf-19a8deda3611 req-8cfc0827-421e-4b87-89cc-0ca49ea5ca73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055439 Oct 29 02:56:51.488085 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1450/2829] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:51.493673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:51.494410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:51.507608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.508147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.509844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.511338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.513977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.515984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.601105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.601491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.602245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.602606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lazy-loading 'fault' on Instance uuid a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:56:51.789539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:51.790060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:51.790597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:51.791592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:51.793617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:51.811473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:51.839860 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0fc6d801-2ad2-4952-b585-613344129a4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 200 len: 1298 microversion: 2.1 time: 0.347708 Oct 29 02:56:51.840858 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1451/2830] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:51 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 1298 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:51.843267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.844066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.845194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.846219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.846815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.847756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.863762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b5c3efab-58a7-44a0-87c9-63dfb05074c8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1507854415"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:51.865248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b5c3efab-58a7-44a0-87c9-63dfb05074c8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:51.876804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c3efab-58a7-44a0-87c9-63dfb05074c8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.881081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c3efab-58a7-44a0-87c9-63dfb05074c8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.881662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c3efab-58a7-44a0-87c9-63dfb05074c8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.882628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c3efab-58a7-44a0-87c9-63dfb05074c8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.883236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c3efab-58a7-44a0-87c9-63dfb05074c8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.883808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c3efab-58a7-44a0-87c9-63dfb05074c8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.887880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:51.895377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for user fceb096cc5414b3a9d7300fefeb90dff and project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:51.914572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:51.918048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:51.981050 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-63124e35-62a9-49ab-9b87-9c71f2dc6ded tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.862718 Oct 29 02:56:51.981896 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1380/2831] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:56:51.996453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ac4e4ab-993d-4328-84d2-6e1fe5d30d53 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:51.997901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1ac4e4ab-993d-4328-84d2-6e1fe5d30d53 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:52.192715 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.network.security_group_api [None req-b5c3efab-58a7-44a0-87c9-63dfb05074c8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Adding security group 167dd4c5-e052-47b5-b1d6-009a7cd10c15 to port 9eebf062-ba82-4f9f-85ad-21b23f2023ad Oct 29 02:56:52.247863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ac4e4ab-993d-4328-84d2-6e1fe5d30d53 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:52.267003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ac4e4ab-993d-4328-84d2-6e1fe5d30d53 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1215 microversion: 2.1 time: 0.275280 Oct 29 02:56:52.267608 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1381/2832] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:51 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1215 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:52.700402 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b5c3efab-58a7-44a0-87c9-63dfb05074c8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe/action" status: 202 len: 0 microversion: 2.1 time: 0.857109 Oct 29 02:56:52.701168 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1452/2833] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:56:51 2022] POST /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe/action => generated 0 bytes in 859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:56:52.710182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f232f91-6142-4400-93a6-8ab55c6c641c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1820591265"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:52.710723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1f232f91-6142-4400-93a6-8ab55c6c641c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:52.721057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-cda31c4e-de97-47ea-86eb-aa1bc1075d3d req-080070d0-ae89-48ec-afa2-018380523806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd9e3b45-8ae9-470a-80f6-26c3057f7afe", "tag": "9eebf062-ba82-4f9f-85ad-21b23f2023ad"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:52.746493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f232f91-6142-4400-93a6-8ab55c6c641c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:52.747213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f232f91-6142-4400-93a6-8ab55c6c641c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:52.747654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f232f91-6142-4400-93a6-8ab55c6c641c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:52.752050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cda31c4e-de97-47ea-86eb-aa1bc1075d3d req-080070d0-ae89-48ec-afa2-018380523806 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:52.752713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cda31c4e-de97-47ea-86eb-aa1bc1075d3d req-080070d0-ae89-48ec-afa2-018380523806 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:52.753294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cda31c4e-de97-47ea-86eb-aa1bc1075d3d req-080070d0-ae89-48ec-afa2-018380523806 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:52.758436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f232f91-6142-4400-93a6-8ab55c6c641c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:52.759134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f232f91-6142-4400-93a6-8ab55c6c641c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:52.759723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f232f91-6142-4400-93a6-8ab55c6c641c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:52.781944 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-cda31c4e-de97-47ea-86eb-aa1bc1075d3d req-080070d0-ae89-48ec-afa2-018380523806 service nova] Creating event network-changed:9eebf062-ba82-4f9f-85ad-21b23f2023ad for instance cd9e3b45-8ae9-470a-80f6-26c3057f7afe on n-h2-862964-4 Oct 29 02:56:52.812244 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-cda31c4e-de97-47ea-86eb-aa1bc1075d3d req-080070d0-ae89-48ec-afa2-018380523806 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093205 Oct 29 02:56:52.815698 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1453/2834] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:56:52.865356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:52.866388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:52.886301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:52.888400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:52.889158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:52.890130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:52.891663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:52.892385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:52.914094 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 HTTP/1.1 Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'a3ed9c7b-73e9-4268-af26-ff629c7e4ff4'} Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:52.916172 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:52.920346 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:52.920346 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:52.920346 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:52.920346 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:52.920346 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:56:52.920346 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:52.922254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:52.923732 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-386da213-b878-48e0-8c8e-fefaf017991e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 404 len: 111 microversion: 2.1 time: 0.063597 Oct 29 02:56:52.924533 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1454/2835] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:52 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:52.932838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c427a8dc-20f2-4d7c-8f61-5777e4b4dea9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a3f559d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:53.584373 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.network.security_group_api [None req-1f232f91-6142-4400-93a6-8ab55c6c641c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Adding security group 9e266144-8b64-4500-a7f0-975e4a3af033 to port 9eebf062-ba82-4f9f-85ad-21b23f2023ad Oct 29 02:56:54.373165 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c427a8dc-20f2-4d7c-8f61-5777e4b4dea9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 204 len: 0 microversion: 2.1 time: 1.444184 Oct 29 02:56:54.374579 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1455/2836] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:52 2022] DELETE /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 0 bytes in 1446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:56:54.380258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8d37148-e9eb-4880-9c5f-4237207ddb74 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:54.380914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8d37148-e9eb-4880-9c5f-4237207ddb74 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:54.395778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8d37148-e9eb-4880-9c5f-4237207ddb74 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:54.396649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8d37148-e9eb-4880-9c5f-4237207ddb74 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:54.397560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8d37148-e9eb-4880-9c5f-4237207ddb74 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:54.399719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8d37148-e9eb-4880-9c5f-4237207ddb74 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:54.400435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8d37148-e9eb-4880-9c5f-4237207ddb74 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:54.401124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8d37148-e9eb-4880-9c5f-4237207ddb74 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:54.489074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8d37148-e9eb-4880-9c5f-4237207ddb74 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:54.499478 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8d37148-e9eb-4880-9c5f-4237207ddb74 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1273 microversion: 2.1 time: 0.123719 Oct 29 02:56:54.500426 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1456/2837] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:54 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:54.508499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9e75335-4fad-4336-b7c9-01ce600b9468 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:54.509029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9e75335-4fad-4336-b7c9-01ce600b9468 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:54.516389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9e75335-4fad-4336-b7c9-01ce600b9468 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:54.516720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9e75335-4fad-4336-b7c9-01ce600b9468 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:54.517197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9e75335-4fad-4336-b7c9-01ce600b9468 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:54.518254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9e75335-4fad-4336-b7c9-01ce600b9468 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:54.518711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9e75335-4fad-4336-b7c9-01ce600b9468 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:54.519659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9e75335-4fad-4336-b7c9-01ce600b9468 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:54.556612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9e75335-4fad-4336-b7c9-01ce600b9468 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:56:54.722082 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9e75335-4fad-4336-b7c9-01ce600b9468 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 204 len: 0 microversion: 2.1 time: 0.217964 Oct 29 02:56:54.722956 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1457/2838] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:56:54 2022] DELETE /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:56:54.973426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-334149641", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "0ef24500-837e-47a7-9e10-a72e3fb043af"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:55.003482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:UPDATE=25,nova_api:SELECT=68,nova_api:INSERT=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:55.088798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] validate_networks() for [('0ef24500-837e-47a7-9e10-a72e3fb043af', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:55.981204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:55.981755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:55.982315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:55.982945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:55.983586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:55.997458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:55.998598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:55.999135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:55.999980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:56.001007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:56.001528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:56.012230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:56.026257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:56.033040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Getting quotas for user 0868f50723074f2b98f7b1096743f3cc and project 09d1a1bd5d9d434a8a5e8f94d564515f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:56.049917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:56.052620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:56.141231 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac18caa7-27b9-41a0-8fb9-657734b9a9c6 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.172753 Oct 29 02:56:56.152193 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1458/2839] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 02:56:56.168854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9cacca9e-9d65-4383-90ef-d930fd35cbca tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:56.171047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9cacca9e-9d65-4383-90ef-d930fd35cbca tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:56.184971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cacca9e-9d65-4383-90ef-d930fd35cbca tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:56.186730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cacca9e-9d65-4383-90ef-d930fd35cbca tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:56.187642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cacca9e-9d65-4383-90ef-d930fd35cbca tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:56.191423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cacca9e-9d65-4383-90ef-d930fd35cbca tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:56.193044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cacca9e-9d65-4383-90ef-d930fd35cbca tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:56.197693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cacca9e-9d65-4383-90ef-d930fd35cbca tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:56.461275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9cacca9e-9d65-4383-90ef-d930fd35cbca tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:56.470062 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9cacca9e-9d65-4383-90ef-d930fd35cbca tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1273 microversion: 2.1 time: 0.316193 Oct 29 02:56:56.478128 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1459/2840] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:56 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1273 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:56.483379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d3e7ddb7-68f4-4bdf-b81f-11ab263d8ea4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:56.494956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d3e7ddb7-68f4-4bdf-b81f-11ab263d8ea4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:56.878747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d3e7ddb7-68f4-4bdf-b81f-11ab263d8ea4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:56.889705 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d3e7ddb7-68f4-4bdf-b81f-11ab263d8ea4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1207 microversion: 2.1 time: 0.410215 Oct 29 02:56:56.906901 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1460/2841] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:56 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1207 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:57.171908 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1f232f91-6142-4400-93a6-8ab55c6c641c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe/action" status: 202 len: 0 microversion: 2.1 time: 4.466087 Oct 29 02:56:57.172681 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1382/2842] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:56:52 2022] POST /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe/action => generated 0 bytes in 4468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:56:57.180897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b27b6145-14c1-49c2-9093-dc30a46d03d1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:57.182162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b27b6145-14c1-49c2-9093-dc30a46d03d1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:57.194500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b27b6145-14c1-49c2-9093-dc30a46d03d1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:57.195305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b27b6145-14c1-49c2-9093-dc30a46d03d1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:57.198004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b27b6145-14c1-49c2-9093-dc30a46d03d1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.199034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b27b6145-14c1-49c2-9093-dc30a46d03d1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:57.208044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b27b6145-14c1-49c2-9093-dc30a46d03d1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:57.208758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b27b6145-14c1-49c2-9093-dc30a46d03d1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.212733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-6225467c-12cd-43fd-bc8b-ff1ca63b00bf req-cab0ff5b-1a99-4435-a432-3966580580ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd9e3b45-8ae9-470a-80f6-26c3057f7afe", "tag": "9eebf062-ba82-4f9f-85ad-21b23f2023ad"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:57.218442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:57.239420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6225467c-12cd-43fd-bc8b-ff1ca63b00bf req-cab0ff5b-1a99-4435-a432-3966580580ca service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:57.240312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6225467c-12cd-43fd-bc8b-ff1ca63b00bf req-cab0ff5b-1a99-4435-a432-3966580580ca service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:57.240935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6225467c-12cd-43fd-bc8b-ff1ca63b00bf req-cab0ff5b-1a99-4435-a432-3966580580ca service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.291519 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-6225467c-12cd-43fd-bc8b-ff1ca63b00bf req-cab0ff5b-1a99-4435-a432-3966580580ca service nova] Creating event network-changed:9eebf062-ba82-4f9f-85ad-21b23f2023ad for instance cd9e3b45-8ae9-470a-80f6-26c3057f7afe on n-h2-862964-4 Oct 29 02:56:57.309408 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-6225467c-12cd-43fd-bc8b-ff1ca63b00bf req-cab0ff5b-1a99-4435-a432-3966580580ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104977 Oct 29 02:56:57.310354 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1383/2843] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 29 02:56:57.632476 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b27b6145-14c1-49c2-9093-dc30a46d03d1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.455481 Oct 29 02:56:57.645996 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1461/2844] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Oct 29 02:56:57 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe/os-security-groups => generated 1156 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:57.651755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-27f5080d-4d1a-43b2-b48f-a6c3d0cf177f req-de7fb8a4-6615-4bc4-8eec-e06fb9ced948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d", "name": "network-vif-deleted", "tag": "5fdf8084-8c8b-4cd7-a958-0335d3697a1c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:57.664689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-27f5080d-4d1a-43b2-b48f-a6c3d0cf177f req-de7fb8a4-6615-4bc4-8eec-e06fb9ced948 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:57.665432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-27f5080d-4d1a-43b2-b48f-a6c3d0cf177f req-de7fb8a4-6615-4bc4-8eec-e06fb9ced948 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:57.666134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-27f5080d-4d1a-43b2-b48f-a6c3d0cf177f req-de7fb8a4-6615-4bc4-8eec-e06fb9ced948 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.685736 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-27f5080d-4d1a-43b2-b48f-a6c3d0cf177f req-de7fb8a4-6615-4bc4-8eec-e06fb9ced948 service nova] Creating event network-vif-deleted:5fdf8084-8c8b-4cd7-a958-0335d3697a1c for instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d on n-h1-862964-4 Oct 29 02:56:57.691830 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-27f5080d-4d1a-43b2-b48f-a6c3d0cf177f req-de7fb8a4-6615-4bc4-8eec-e06fb9ced948 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043492 Oct 29 02:56:57.693435 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1462/2845] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:57.705325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-efd0aff3-5bc1-4309-8fdc-aad81912f2b7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:57.709589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-efd0aff3-5bc1-4309-8fdc-aad81912f2b7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:57.731441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd0aff3-5bc1-4309-8fdc-aad81912f2b7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:57.732699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd0aff3-5bc1-4309-8fdc-aad81912f2b7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:57.733419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd0aff3-5bc1-4309-8fdc-aad81912f2b7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.734888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd0aff3-5bc1-4309-8fdc-aad81912f2b7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:57.735554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd0aff3-5bc1-4309-8fdc-aad81912f2b7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:57.736337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd0aff3-5bc1-4309-8fdc-aad81912f2b7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.824301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-373125745", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:57.840039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-efd0aff3-5bc1-4309-8fdc-aad81912f2b7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:57.852782 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-efd0aff3-5bc1-4309-8fdc-aad81912f2b7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1273 microversion: 2.1 time: 0.154897 Oct 29 02:56:57.855946 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1463/2846] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:57 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:57.872940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e5df80e-7816-47ce-9db7-8ad319b6aa7f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'create', calling method: .version_select at 0x7fe1a3ec6f70>, body: {"security_group": {"name": " tempest-securitygroup -2088153327 ", "description": "tempest-description-930968478"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:57.962181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:58.127182 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e5df80e-7816-47ce-9db7-8ad319b6aa7f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.269869 Oct 29 02:56:58.128264 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1464/2847] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:56:57 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:58.148111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-268e1887-4a9e-4105-8c8b-0cf82dcfd680 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:58.148768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-268e1887-4a9e-4105-8c8b-0cf82dcfd680 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:58.155993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-268e1887-4a9e-4105-8c8b-0cf82dcfd680 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:58.156501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-268e1887-4a9e-4105-8c8b-0cf82dcfd680 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:58.156936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-268e1887-4a9e-4105-8c8b-0cf82dcfd680 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:58.158252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-268e1887-4a9e-4105-8c8b-0cf82dcfd680 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:58.158719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-268e1887-4a9e-4105-8c8b-0cf82dcfd680 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:58.159147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-268e1887-4a9e-4105-8c8b-0cf82dcfd680 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:58.230123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-268e1887-4a9e-4105-8c8b-0cf82dcfd680 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:58.239265 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-268e1887-4a9e-4105-8c8b-0cf82dcfd680 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1259 microversion: 2.1 time: 0.096023 Oct 29 02:56:58.240396 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1465/2848] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:58 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1259 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:58.245910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b0066a6d-be52-417e-8429-b26a383cee4c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a3f22b80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:58.304951 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b0066a6d-be52-417e-8429-b26a383cee4c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/7dea5fba-c89a-4056-ac83-d363706e9fa6" status: 200 len: 223 microversion: 2.1 time: 0.063101 Oct 29 02:56:58.306060 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1466/2849] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:56:58 2022] GET /compute/v2.1/os-security-groups/7dea5fba-c89a-4056-ac83-d363706e9fa6 => generated 223 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:58.320192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-62ba5e37-ff6a-48c1-97bf-4a51b860c29d tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a88bfca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:58.688600 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-62ba5e37-ff6a-48c1-97bf-4a51b860c29d tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7dea5fba-c89a-4056-ac83-d363706e9fa6" status: 202 len: 0 microversion: 2.1 time: 0.371478 Oct 29 02:56:58.693111 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1467/2850] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:56:58 2022] DELETE /compute/v2.1/os-security-groups/7dea5fba-c89a-4056-ac83-d363706e9fa6 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:56:58.705181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-df22b922-6f4d-425d-ab4b-b183b0707751 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a3ec6c10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:58.754805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-df22b922-6f4d-425d-ab4b-b183b0707751 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:56:58.755891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.security_group_api [None req-df22b922-6f4d-425d-ab4b-b183b0707751 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Neutron security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 not found {{(pid=127041) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:56:58.756803 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-df22b922-6f4d-425d-ab4b-b183b0707751 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:56:58.756803 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-b06d4249-6292-4e27-87d7-177267be6479'] Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-df22b922-6f4d-425d-ab4b-b183b0707751 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-security-groups/7dea5fba-c89a-4056-ac83-d363706e9fa6 HTTP/1.1 Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: exception: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-b06d4249-6292-4e27-87d7-177267be6479'] Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '7dea5fba-c89a-4056-ac83-d363706e9fa6'} Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:56:58.759963 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b06d4249-6292-4e27-87d7-177267be6479'] Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b06d4249-6292-4e27-87d7-177267be6479'] Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b06d4249-6292-4e27-87d7-177267be6479'] Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b06d4249-6292-4e27-87d7-177267be6479'] Oct 29 02:56:58.764354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:56:58.769356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-df22b922-6f4d-425d-ab4b-b183b0707751 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:56:58.769356 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-b06d4249-6292-4e27-87d7-177267be6479'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:58.772847 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-df22b922-6f4d-425d-ab4b-b183b0707751 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/7dea5fba-c89a-4056-ac83-d363706e9fa6" status: 404 len: 194 microversion: 2.1 time: 0.078667 Oct 29 02:56:58.773602 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1468/2851] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:56:58 2022] GET /compute/v2.1/os-security-groups/7dea5fba-c89a-4056-ac83-d363706e9fa6 => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:58.788361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7c2fe693-e7ec-4572-82f2-9d09072c97a5 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'create', calling method: .version_select at 0x7fe1a3f5aa60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1684309662", "description": "tempest-description-1923784236"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:59.196551 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7c2fe693-e7ec-4572-82f2-9d09072c97a5 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.416435 Oct 29 02:56:59.197758 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1469/2852] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:56:58 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:56:59.210874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4127ef5b-3eab-45d6-b61e-01b9973105c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:59.213201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4127ef5b-3eab-45d6-b61e-01b9973105c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:59.229487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4127ef5b-3eab-45d6-b61e-01b9973105c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:59.230151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4127ef5b-3eab-45d6-b61e-01b9973105c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:59.230722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4127ef5b-3eab-45d6-b61e-01b9973105c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:59.231771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4127ef5b-3eab-45d6-b61e-01b9973105c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:59.232299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4127ef5b-3eab-45d6-b61e-01b9973105c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:59.232828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4127ef5b-3eab-45d6-b61e-01b9973105c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:59.367609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:59.368130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:59.368470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:59.369051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:59.369980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:59.390679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:59.391133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:59.391734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:59.392747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:59.393200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:59.393620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:59.423675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Getting quotas for project fc4a5146b4134f11af39e82d9ae9f03b. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:59.429990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Getting quotas for user eeff83f3646947109a6a670d0711398f and project fc4a5146b4134f11af39e82d9ae9f03b. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:59.444871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:59.448291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:59.502901 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-95864be5-a2c1-4b27-970f-0e38375bc33e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.118294 Oct 29 02:56:59.504187 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1384/2853] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:56:59.509507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d5b3c36e-ec93-43c9-bee6-065984df25bb tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'create', calling method: .version_select at 0x7fe1a89e9790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-665906998", "description": "tempest-description-627366847"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:59.609612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4127ef5b-3eab-45d6-b61e-01b9973105c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:59.619990 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4127ef5b-3eab-45d6-b61e-01b9973105c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1315 microversion: 2.1 time: 0.420141 Oct 29 02:56:59.622641 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1470/2854] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:59 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:59.631044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02ade826-3837-4f22-83c1-7bd2838a2921 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:59.631642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-02ade826-3837-4f22-83c1-7bd2838a2921 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:59.647899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ade826-3837-4f22-83c1-7bd2838a2921 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:59.650412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ade826-3837-4f22-83c1-7bd2838a2921 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:59.651060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ade826-3837-4f22-83c1-7bd2838a2921 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:59.652155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ade826-3837-4f22-83c1-7bd2838a2921 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:59.653593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ade826-3837-4f22-83c1-7bd2838a2921 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:59.654300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02ade826-3837-4f22-83c1-7bd2838a2921 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:59.895045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02ade826-3837-4f22-83c1-7bd2838a2921 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:59.904479 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02ade826-3837-4f22-83c1-7bd2838a2921 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1265 microversion: 2.1 time: 0.280690 Oct 29 02:56:59.905062 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1471/2855] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:59 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:59.914814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-92334533", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:00.071594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:00.422731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:00.425512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:00.426408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:00.428056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:00.429231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:00.508629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:00.511319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:00.517180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:00.518677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:00.519162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:00.519841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:00.569358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Getting quotas for project fc4a5146b4134f11af39e82d9ae9f03b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:00.583232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Getting quotas for user eeff83f3646947109a6a670d0711398f and project fc4a5146b4134f11af39e82d9ae9f03b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:00.617757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:00.625003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:00.720897 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eaaaf7fd-ceb7-4509-9cea-68c95178ecd4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.808015 Oct 29 02:57:00.723176 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1472/2856] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:57:00.731175 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d5b3c36e-ec93-43c9-bee6-065984df25bb tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.225614 Oct 29 02:57:00.732493 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1385/2857] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:56:59 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:00.737445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db7c82a0-5fa6-4140-8785-6599cd67196c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:00.738097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-db7c82a0-5fa6-4140-8785-6599cd67196c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:00.742315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c5c8aca-4d94-4706-ba56-55b92a554f41 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:00.742940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1c5c8aca-4d94-4706-ba56-55b92a554f41 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:00.756511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c5c8aca-4d94-4706-ba56-55b92a554f41 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:00.761108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c5c8aca-4d94-4706-ba56-55b92a554f41 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:00.761767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c5c8aca-4d94-4706-ba56-55b92a554f41 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:00.762569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c5c8aca-4d94-4706-ba56-55b92a554f41 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:00.763030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c5c8aca-4d94-4706-ba56-55b92a554f41 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:00.764846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c5c8aca-4d94-4706-ba56-55b92a554f41 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:00.920162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-db7c82a0-5fa6-4140-8785-6599cd67196c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:00.928260 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-db7c82a0-5fa6-4140-8785-6599cd67196c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1212 microversion: 2.1 time: 0.194560 Oct 29 02:57:00.936291 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1386/2858] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:00 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1212 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:00.955274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e10ccef6-bd70-42f5-90dc-064b282c2d41 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'create', calling method: .version_select at 0x7fe1a8947e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1413262517", "description": "tempest-description-957328861"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:01.846137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1c5c8aca-4d94-4706-ba56-55b92a554f41 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:01.860040 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1c5c8aca-4d94-4706-ba56-55b92a554f41 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1315 microversion: 2.1 time: 1.134155 Oct 29 02:57:01.863401 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1473/2859] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:00 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1315 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:01.879467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e567ff5c-86de-435a-a173-55f876958de7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:01.881089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e567ff5c-86de-435a-a173-55f876958de7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:01.903154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e567ff5c-86de-435a-a173-55f876958de7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:01.904620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e567ff5c-86de-435a-a173-55f876958de7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:01.905336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e567ff5c-86de-435a-a173-55f876958de7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:01.908864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e567ff5c-86de-435a-a173-55f876958de7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:01.909581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e567ff5c-86de-435a-a173-55f876958de7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:01.912099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e567ff5c-86de-435a-a173-55f876958de7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:02.170968 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e10ccef6-bd70-42f5-90dc-064b282c2d41 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.233418 Oct 29 02:57:02.172512 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1387/2860] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:57:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:02.177621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c292e7a5-2cc7-4303-9efb-c9c73a9d011e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:02.178514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c292e7a5-2cc7-4303-9efb-c9c73a9d011e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:02.190395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c292e7a5-2cc7-4303-9efb-c9c73a9d011e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:02.194388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c292e7a5-2cc7-4303-9efb-c9c73a9d011e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:02.195095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c292e7a5-2cc7-4303-9efb-c9c73a9d011e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:02.196043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c292e7a5-2cc7-4303-9efb-c9c73a9d011e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:02.201592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c292e7a5-2cc7-4303-9efb-c9c73a9d011e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:02.202291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c292e7a5-2cc7-4303-9efb-c9c73a9d011e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:02.425914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c292e7a5-2cc7-4303-9efb-c9c73a9d011e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:02.436302 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c292e7a5-2cc7-4303-9efb-c9c73a9d011e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1264 microversion: 2.1 time: 0.262491 Oct 29 02:57:02.447853 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1388/2861] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:02 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1264 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:02.466088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7bf8d8c-863d-4ba4-bdf0-0cc37f89df27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a86f49d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:02.719516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e567ff5c-86de-435a-a173-55f876958de7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:02.731652 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e567ff5c-86de-435a-a173-55f876958de7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1307 microversion: 2.1 time: 0.866746 Oct 29 02:57:02.754026 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1474/2862] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:01 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1307 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:02.899938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d3d93eb6-b7f9-4957-ba72-672a8d3aed0a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:02.904027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d3d93eb6-b7f9-4957-ba72-672a8d3aed0a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:02.922320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d93eb6-b7f9-4957-ba72-672a8d3aed0a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:02.923454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d93eb6-b7f9-4957-ba72-672a8d3aed0a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:02.924012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d93eb6-b7f9-4957-ba72-672a8d3aed0a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:02.929140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d93eb6-b7f9-4957-ba72-672a8d3aed0a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:02.932894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d93eb6-b7f9-4957-ba72-672a8d3aed0a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:02.934192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d93eb6-b7f9-4957-ba72-672a8d3aed0a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:03.492746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d3d93eb6-b7f9-4957-ba72-672a8d3aed0a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:03.518735 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d3d93eb6-b7f9-4957-ba72-672a8d3aed0a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1315 microversion: 2.1 time: 0.636723 Oct 29 02:57:03.519345 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1475/2863] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:02 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:03.536807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-68bb237a-ed1c-481a-b113-3a27c0dbf873 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:03.542772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-68bb237a-ed1c-481a-b113-3a27c0dbf873 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:03.557566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68bb237a-ed1c-481a-b113-3a27c0dbf873 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:03.558608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68bb237a-ed1c-481a-b113-3a27c0dbf873 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:03.559198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68bb237a-ed1c-481a-b113-3a27c0dbf873 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:03.560064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68bb237a-ed1c-481a-b113-3a27c0dbf873 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:03.560660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68bb237a-ed1c-481a-b113-3a27c0dbf873 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:03.561285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68bb237a-ed1c-481a-b113-3a27c0dbf873 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:03.701783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-68bb237a-ed1c-481a-b113-3a27c0dbf873 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:03.714341 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-68bb237a-ed1c-481a-b113-3a27c0dbf873 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1270 microversion: 2.1 time: 0.188122 Oct 29 02:57:03.715839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1476/2864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:03 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:03.761129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-83d82ac5-2fe9-4bbd-9275-b630629cdbe2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:03.762514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-83d82ac5-2fe9-4bbd-9275-b630629cdbe2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:03.776007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83d82ac5-2fe9-4bbd-9275-b630629cdbe2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:03.779408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83d82ac5-2fe9-4bbd-9275-b630629cdbe2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:03.779937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83d82ac5-2fe9-4bbd-9275-b630629cdbe2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:03.781322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83d82ac5-2fe9-4bbd-9275-b630629cdbe2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:03.793226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83d82ac5-2fe9-4bbd-9275-b630629cdbe2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:03.797230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83d82ac5-2fe9-4bbd-9275-b630629cdbe2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:04.161268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-83d82ac5-2fe9-4bbd-9275-b630629cdbe2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:04.186385 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-83d82ac5-2fe9-4bbd-9275-b630629cdbe2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1307 microversion: 2.1 time: 0.430070 Oct 29 02:57:04.186937 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1477/2865] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:03 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:04.516238 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b7bf8d8c-863d-4ba4-bdf0-0cc37f89df27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 2.066967 Oct 29 02:57:04.517512 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1389/2866] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:57:02 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:04.532778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-22f099a1-1c79-43fc-b9df-6b99c5b0f06e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a3ed3430>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:04.550454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-efb458b1-75ac-4107-9cc8-77d96542c74c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:04.551535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-efb458b1-75ac-4107-9cc8-77d96542c74c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:04.565750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efb458b1-75ac-4107-9cc8-77d96542c74c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:04.566912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efb458b1-75ac-4107-9cc8-77d96542c74c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:04.567572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efb458b1-75ac-4107-9cc8-77d96542c74c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:04.569053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efb458b1-75ac-4107-9cc8-77d96542c74c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:04.569796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efb458b1-75ac-4107-9cc8-77d96542c74c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:04.571582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efb458b1-75ac-4107-9cc8-77d96542c74c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.173236 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-22f099a1-1c79-43fc-b9df-6b99c5b0f06e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/73a0a53e-4308-4272-8299-cea34eaa253e" status: 202 len: 0 microversion: 2.1 time: 0.644775 Oct 29 02:57:05.174391 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1478/2867] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:57:04 2022] DELETE /compute/v2.1/os-security-groups/73a0a53e-4308-4272-8299-cea34eaa253e => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:05.179502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-356c68af-e8f1-42c3-b5b7-e8de7d61eaaf req-e85caa53-17fd-4426-bf47-26b110ebdd06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1", "tag": "ca4e09b5-4c0b-4a09-a5a8-c942144c3423"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:05.190796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-356c68af-e8f1-42c3-b5b7-e8de7d61eaaf req-e85caa53-17fd-4426-bf47-26b110ebdd06 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:05.191650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-356c68af-e8f1-42c3-b5b7-e8de7d61eaaf req-e85caa53-17fd-4426-bf47-26b110ebdd06 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:05.192272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-356c68af-e8f1-42c3-b5b7-e8de7d61eaaf req-e85caa53-17fd-4426-bf47-26b110ebdd06 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.204571 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-356c68af-e8f1-42c3-b5b7-e8de7d61eaaf req-e85caa53-17fd-4426-bf47-26b110ebdd06 service nova] Creating event network-changed:ca4e09b5-4c0b-4a09-a5a8-c942144c3423 for instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 on n-h1-862964-4 Oct 29 02:57:05.210601 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-356c68af-e8f1-42c3-b5b7-e8de7d61eaaf req-e85caa53-17fd-4426-bf47-26b110ebdd06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034415 Oct 29 02:57:05.211712 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1479/2868] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:05.217937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0567d56f-9f1c-4293-b6bf-4fb1cc4be771 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:05.223314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0567d56f-9f1c-4293-b6bf-4fb1cc4be771 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:05.235450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0567d56f-9f1c-4293-b6bf-4fb1cc4be771 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:05.238258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0567d56f-9f1c-4293-b6bf-4fb1cc4be771 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:05.240090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0567d56f-9f1c-4293-b6bf-4fb1cc4be771 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.241994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0567d56f-9f1c-4293-b6bf-4fb1cc4be771 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:05.242641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0567d56f-9f1c-4293-b6bf-4fb1cc4be771 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:05.243233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0567d56f-9f1c-4293-b6bf-4fb1cc4be771 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.396241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-efb458b1-75ac-4107-9cc8-77d96542c74c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:05.404944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-efb458b1-75ac-4107-9cc8-77d96542c74c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1315 microversion: 2.1 time: 0.861260 Oct 29 02:57:05.405522 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1390/2869] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:04 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:05.427513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87721a22-dd8d-4b73-a402-745ef63f4283 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a83f5670>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:05.556170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG neutronclient.v2_0.client [None req-87721a22-dd8d-4b73-a402-745ef63f4283 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist", "detail": ""}} {{(pid=127042) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:57:05.557675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.security_group_api [None req-87721a22-dd8d-4b73-a402-745ef63f4283 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Neutron security group 73a0a53e-4308-4272-8299-cea34eaa253e not found {{(pid=127042) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:57:05.558631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-87721a22-dd8d-4b73-a402-745ef63f4283 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:57:05.558631 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-9c17fcae-4173-4a80-ba77-15141e7cca26'] Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87721a22-dd8d-4b73-a402-745ef63f4283 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-security-groups/73a0a53e-4308-4272-8299-cea34eaa253e HTTP/1.1 Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: exception: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-9c17fcae-4173-4a80-ba77-15141e7cca26'] Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '73a0a53e-4308-4272-8299-cea34eaa253e'} Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:57:05.561794 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c17fcae-4173-4a80-ba77-15141e7cca26'] Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c17fcae-4173-4a80-ba77-15141e7cca26'] Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c17fcae-4173-4a80-ba77-15141e7cca26'] Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c17fcae-4173-4a80-ba77-15141e7cca26'] Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87721a22-dd8d-4b73-a402-745ef63f4283 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-9c17fcae-4173-4a80-ba77-15141e7cca26'] {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:05.566232 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-87721a22-dd8d-4b73-a402-745ef63f4283 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/73a0a53e-4308-4272-8299-cea34eaa253e" status: 404 len: 194 microversion: 2.1 time: 0.142937 Oct 29 02:57:05.570723 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1391/2870] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:57:05 2022] GET /compute/v2.1/os-security-groups/73a0a53e-4308-4272-8299-cea34eaa253e => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:05.573405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-260ae07e-e2d0-4782-bca5-9161b3c7a685 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:05.576139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-260ae07e-e2d0-4782-bca5-9161b3c7a685 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:05.581882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260ae07e-e2d0-4782-bca5-9161b3c7a685 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:05.582576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260ae07e-e2d0-4782-bca5-9161b3c7a685 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:05.583200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260ae07e-e2d0-4782-bca5-9161b3c7a685 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.584109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260ae07e-e2d0-4782-bca5-9161b3c7a685 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:05.584767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260ae07e-e2d0-4782-bca5-9161b3c7a685 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:05.585338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260ae07e-e2d0-4782-bca5-9161b3c7a685 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.614109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:05.742175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0567d56f-9f1c-4293-b6bf-4fb1cc4be771 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:05.764905 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0567d56f-9f1c-4293-b6bf-4fb1cc4be771 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1270 microversion: 2.1 time: 0.551757 Oct 29 02:57:05.767902 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1480/2871] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:05 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1270 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:05.776128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94700f77-455b-4b8e-8cac-f360550c4cd9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a3ed38b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:06.277290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-260ae07e-e2d0-4782-bca5-9161b3c7a685 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:06.292743 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-260ae07e-e2d0-4782-bca5-9161b3c7a685 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1307 microversion: 2.1 time: 0.722294 Oct 29 02:57:06.296319 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1392/2872] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:05 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1307 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:06.415352 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94700f77-455b-4b8e-8cac-f360550c4cd9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7d02be92-a571-42ab-8546-c7cf0147e254" status: 202 len: 0 microversion: 2.1 time: 0.643270 Oct 29 02:57:06.426839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1481/2873] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:57:05 2022] DELETE /compute/v2.1/os-security-groups/7d02be92-a571-42ab-8546-c7cf0147e254 => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:06.432253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c5ae691d-f6c5-4e2e-8970-96fce89267b5 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a83f5700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:06.439761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-09de1f5b-c762-46d0-8ab4-bf1edb07ac73 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:06.442874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-09de1f5b-c762-46d0-8ab4-bf1edb07ac73 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:06.461658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09de1f5b-c762-46d0-8ab4-bf1edb07ac73 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:06.462575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09de1f5b-c762-46d0-8ab4-bf1edb07ac73 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:06.464888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09de1f5b-c762-46d0-8ab4-bf1edb07ac73 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:06.468399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09de1f5b-c762-46d0-8ab4-bf1edb07ac73 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:06.469283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09de1f5b-c762-46d0-8ab4-bf1edb07ac73 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:06.469988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09de1f5b-c762-46d0-8ab4-bf1edb07ac73 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:06.550758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG neutronclient.v2_0.client [None req-c5ae691d-f6c5-4e2e-8970-96fce89267b5 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist", "detail": ""}} {{(pid=127042) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:57:06.551714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.security_group_api [None req-c5ae691d-f6c5-4e2e-8970-96fce89267b5 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Neutron security group 7d02be92-a571-42ab-8546-c7cf0147e254 not found {{(pid=127042) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:57:06.552435 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c5ae691d-f6c5-4e2e-8970-96fce89267b5 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:57:06.552435 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-e395801e-3e1a-4e06-92fd-8ac3da7cb5c3'] Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c5ae691d-f6c5-4e2e-8970-96fce89267b5 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-security-groups/7d02be92-a571-42ab-8546-c7cf0147e254 HTTP/1.1 Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: exception: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-e395801e-3e1a-4e06-92fd-8ac3da7cb5c3'] Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '7d02be92-a571-42ab-8546-c7cf0147e254'} Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:57:06.554704 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e395801e-3e1a-4e06-92fd-8ac3da7cb5c3'] Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e395801e-3e1a-4e06-92fd-8ac3da7cb5c3'] Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e395801e-3e1a-4e06-92fd-8ac3da7cb5c3'] Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e395801e-3e1a-4e06-92fd-8ac3da7cb5c3'] Oct 29 02:57:06.559786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:06.564366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c5ae691d-f6c5-4e2e-8970-96fce89267b5 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:57:06.564366 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-e395801e-3e1a-4e06-92fd-8ac3da7cb5c3'] {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:06.565498 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c5ae691d-f6c5-4e2e-8970-96fce89267b5 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/7d02be92-a571-42ab-8546-c7cf0147e254" status: 404 len: 194 microversion: 2.1 time: 0.142966 Oct 29 02:57:06.569929 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1393/2874] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:57:06 2022] GET /compute/v2.1/os-security-groups/7d02be92-a571-42ab-8546-c7cf0147e254 => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:06.576680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d9ebe51f-faa2-43e0-a05f-6bc2fcc73dc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a86f4310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:06.876403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-09de1f5b-c762-46d0-8ab4-bf1edb07ac73 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:06.888662 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-09de1f5b-c762-46d0-8ab4-bf1edb07ac73 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1315 microversion: 2.1 time: 0.460069 Oct 29 02:57:06.902951 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1482/2875] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:06 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:06.912886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c2dd7427-11d5-40fd-aa28-16bc948db818 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:06.913881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c2dd7427-11d5-40fd-aa28-16bc948db818 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:06.921555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2dd7427-11d5-40fd-aa28-16bc948db818 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:06.922893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2dd7427-11d5-40fd-aa28-16bc948db818 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:06.924105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2dd7427-11d5-40fd-aa28-16bc948db818 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:06.925078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2dd7427-11d5-40fd-aa28-16bc948db818 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:06.925746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2dd7427-11d5-40fd-aa28-16bc948db818 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:06.927775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2dd7427-11d5-40fd-aa28-16bc948db818 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:07.113166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c2dd7427-11d5-40fd-aa28-16bc948db818 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:07.134378 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c2dd7427-11d5-40fd-aa28-16bc948db818 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1270 microversion: 2.1 time: 0.228747 Oct 29 02:57:07.135944 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1483/2876] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:06 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1270 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:07.323151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-364de453-a810-4024-a9af-b29bcff0f3c4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:07.323808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-364de453-a810-4024-a9af-b29bcff0f3c4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:07.342771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-364de453-a810-4024-a9af-b29bcff0f3c4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:07.343941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-364de453-a810-4024-a9af-b29bcff0f3c4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:07.348341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-364de453-a810-4024-a9af-b29bcff0f3c4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:07.349512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-364de453-a810-4024-a9af-b29bcff0f3c4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:07.351184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-364de453-a810-4024-a9af-b29bcff0f3c4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:07.351801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-364de453-a810-4024-a9af-b29bcff0f3c4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:07.859992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-364de453-a810-4024-a9af-b29bcff0f3c4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:07.870011 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-364de453-a810-4024-a9af-b29bcff0f3c4 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1307 microversion: 2.1 time: 0.550425 Oct 29 02:57:07.870950 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1484/2877] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:07 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1307 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:07.877346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-36145d3f-4d64-40de-b073-b685ab661e10 req-6e89519d-c230-46a6-99a4-ac4732b44d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ded3792-3d26-4e1e-9e2c-3a94ef959c05", "tag": "726dcb01-9a82-43bd-a9a0-866151f08df4"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:07.889666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-36145d3f-4d64-40de-b073-b685ab661e10 req-6e89519d-c230-46a6-99a4-ac4732b44d35 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:07.890279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-36145d3f-4d64-40de-b073-b685ab661e10 req-6e89519d-c230-46a6-99a4-ac4732b44d35 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:07.890797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-36145d3f-4d64-40de-b073-b685ab661e10 req-6e89519d-c230-46a6-99a4-ac4732b44d35 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:07.901416 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d9ebe51f-faa2-43e0-a05f-6bc2fcc73dc6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/1245e02d-82cc-4217-ba83-825fbada73ca" status: 202 len: 0 microversion: 2.1 time: 1.329522 Oct 29 02:57:07.901950 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1394/2878] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:57:06 2022] DELETE /compute/v2.1/os-security-groups/1245e02d-82cc-4217-ba83-825fbada73ca => generated 0 bytes in 1331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:07.907180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-01eb96ee-7954-42c3-86f8-4d6293a1ec5a req-352dd24a-2826-4af2-b68c-d0e911cc3848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373da2a7-dc50-4f64-bb50-98e9be4e00ea", "tag": "2a519e5a-0fce-4f47-84d2-9cab1c919527"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:07.914477 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-36145d3f-4d64-40de-b073-b685ab661e10 req-6e89519d-c230-46a6-99a4-ac4732b44d35 service nova] Creating event network-changed:726dcb01-9a82-43bd-a9a0-866151f08df4 for instance 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 on n-h2-862964-4 Oct 29 02:57:07.920889 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-36145d3f-4d64-40de-b073-b685ab661e10 req-6e89519d-c230-46a6-99a4-ac4732b44d35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048567 Oct 29 02:57:07.921838 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1485/2879] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:07.929647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-225b7eb5-cdd5-4b01-b6ec-f3b84e313d8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a3e8f700>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:07.929917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-01eb96ee-7954-42c3-86f8-4d6293a1ec5a req-352dd24a-2826-4af2-b68c-d0e911cc3848 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:07.932894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-01eb96ee-7954-42c3-86f8-4d6293a1ec5a req-352dd24a-2826-4af2-b68c-d0e911cc3848 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:07.933608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-01eb96ee-7954-42c3-86f8-4d6293a1ec5a req-352dd24a-2826-4af2-b68c-d0e911cc3848 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:07.958190 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-01eb96ee-7954-42c3-86f8-4d6293a1ec5a req-352dd24a-2826-4af2-b68c-d0e911cc3848 service nova] Creating event network-changed:2a519e5a-0fce-4f47-84d2-9cab1c919527 for instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea on n-h1-862964-4 Oct 29 02:57:07.965560 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-01eb96ee-7954-42c3-86f8-4d6293a1ec5a req-352dd24a-2826-4af2-b68c-d0e911cc3848 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062356 Oct 29 02:57:07.971577 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1395/2880] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:07.984708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-11347bfa-90f0-4a3b-814e-25f65b3538ce tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:07.986860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-11347bfa-90f0-4a3b-814e-25f65b3538ce tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:08.002610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11347bfa-90f0-4a3b-814e-25f65b3538ce tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:08.003737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11347bfa-90f0-4a3b-814e-25f65b3538ce tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:08.006300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11347bfa-90f0-4a3b-814e-25f65b3538ce tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:08.012961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11347bfa-90f0-4a3b-814e-25f65b3538ce tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:08.013973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11347bfa-90f0-4a3b-814e-25f65b3538ce tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:08.014664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11347bfa-90f0-4a3b-814e-25f65b3538ce tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:08.054118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-225b7eb5-cdd5-4b01-b6ec-f3b84e313d8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:57:08.055713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.security_group_api [None req-225b7eb5-cdd5-4b01-b6ec-f3b84e313d8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Neutron security group 1245e02d-82cc-4217-ba83-825fbada73ca not found {{(pid=127041) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:57:08.056271 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-225b7eb5-cdd5-4b01-b6ec-f3b84e313d8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:57:08.056271 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-9b65e09b-d371-449e-a8d4-5f4294f92dd0'] Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-225b7eb5-cdd5-4b01-b6ec-f3b84e313d8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-security-groups/1245e02d-82cc-4217-ba83-825fbada73ca HTTP/1.1 Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: exception: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-9b65e09b-d371-449e-a8d4-5f4294f92dd0'] Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1245e02d-82cc-4217-ba83-825fbada73ca'} Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:57:08.060107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b65e09b-d371-449e-a8d4-5f4294f92dd0'] Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b65e09b-d371-449e-a8d4-5f4294f92dd0'] Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b65e09b-d371-449e-a8d4-5f4294f92dd0'] Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b65e09b-d371-449e-a8d4-5f4294f92dd0'] Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-225b7eb5-cdd5-4b01-b6ec-f3b84e313d8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-9b65e09b-d371-449e-a8d4-5f4294f92dd0'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-225b7eb5-cdd5-4b01-b6ec-f3b84e313d8b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/1245e02d-82cc-4217-ba83-825fbada73ca" status: 404 len: 194 microversion: 2.1 time: 0.138506 Oct 29 02:57:08.066951 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1486/2881] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:57:07 2022] GET /compute/v2.1/os-security-groups/1245e02d-82cc-4217-ba83-825fbada73ca => generated 194 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:08.107011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-56b567cc-51b0-431a-a0fa-5cbb448c99ad tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a3ed38b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:08.680027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-11347bfa-90f0-4a3b-814e-25f65b3538ce tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:08.714253 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-11347bfa-90f0-4a3b-814e-25f65b3538ce tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1315 microversion: 2.1 time: 0.739416 Oct 29 02:57:08.718451 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1396/2882] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:07 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:08.731729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a4995bb6-1c6f-43a4-8e00-56f754c57899 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:08.734602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a4995bb6-1c6f-43a4-8e00-56f754c57899 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:08.758185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4995bb6-1c6f-43a4-8e00-56f754c57899 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:08.759038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4995bb6-1c6f-43a4-8e00-56f754c57899 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:08.761700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4995bb6-1c6f-43a4-8e00-56f754c57899 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:08.766017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4995bb6-1c6f-43a4-8e00-56f754c57899 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:08.766742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4995bb6-1c6f-43a4-8e00-56f754c57899 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:08.768136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4995bb6-1c6f-43a4-8e00-56f754c57899 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:09.193451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a4995bb6-1c6f-43a4-8e00-56f754c57899 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:09.203486 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a4995bb6-1c6f-43a4-8e00-56f754c57899 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1312 microversion: 2.1 time: 0.483273 Oct 29 02:57:09.218590 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1397/2883] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:08 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1312 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:09.226062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-212a76d6-2726-43df-92cf-ea7a848d224e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:09.226922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-212a76d6-2726-43df-92cf-ea7a848d224e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:09.234931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-212a76d6-2726-43df-92cf-ea7a848d224e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:09.235671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-212a76d6-2726-43df-92cf-ea7a848d224e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:09.236266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-212a76d6-2726-43df-92cf-ea7a848d224e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:09.237177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-212a76d6-2726-43df-92cf-ea7a848d224e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:09.238176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-212a76d6-2726-43df-92cf-ea7a848d224e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:09.238755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-212a76d6-2726-43df-92cf-ea7a848d224e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:09.368664 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-56b567cc-51b0-431a-a0fa-5cbb448c99ad tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.281712 Oct 29 02:57:09.370639 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1487/2884] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 02:57:08 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:09.387796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-123a81c1-dc53-4281-b6ea-bfb1d7bf90a5 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'create', calling method: .version_select at 0x7fe1a806c280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-242420721", "description": "tempest-description-1130044842"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:09.412511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:09.577970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-212a76d6-2726-43df-92cf-ea7a848d224e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:09.589322 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-212a76d6-2726-43df-92cf-ea7a848d224e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1307 microversion: 2.1 time: 0.369671 Oct 29 02:57:09.613787 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1398/2885] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:09 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:09.740811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7bb292bc-eeed-460b-b497-f723284339fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:09.741857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7bb292bc-eeed-460b-b497-f723284339fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:09.757297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bb292bc-eeed-460b-b497-f723284339fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:09.758037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bb292bc-eeed-460b-b497-f723284339fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:09.758639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bb292bc-eeed-460b-b497-f723284339fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:09.759517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bb292bc-eeed-460b-b497-f723284339fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:09.760206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bb292bc-eeed-460b-b497-f723284339fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:09.761476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bb292bc-eeed-460b-b497-f723284339fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:09.854164 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-123a81c1-dc53-4281-b6ea-bfb1d7bf90a5 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.471019 Oct 29 02:57:09.854941 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1488/2886] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:57:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:57:10.043731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-926b1bc5-801a-4240-b6d2-a9d8a3e88135 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Action: 'create', calling method: .version_select at 0x7fe1a85c6e50>, body: {"keypair": {"name": "tempest-keypair-1245804504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA92Fc8perPi8n3uWQdr1Myb7HJe9G55ZygeR810y+Iig7/DqDKh7FQeY4Vze54oULPt2BjymZ1UgmCE/nK5JyZEVIKfFlqWl2NjP7MqDytKTTnop//Ek9CBsiGDrN5m5g=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:10.076238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=52,nova_cell0:UPDATE=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:10.091510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-926b1bc5-801a-4240-b6d2-a9d8a3e88135 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Getting quotas for project fa9a72e5d3ea460ebdb09420824ba04b. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:10.099527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-926b1bc5-801a-4240-b6d2-a9d8a3e88135 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Getting quotas for user eaaa0b3debf041098f1f188124050dad and project fa9a72e5d3ea460ebdb09420824ba04b. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:10.132477 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-926b1bc5-801a-4240-b6d2-a9d8a3e88135 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.275531 Oct 29 02:57:10.139228 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1489/2887] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:57:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:10.139228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2614bc2e-eaca-4a9d-8cb8-7b1a6052c040 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'create', calling method: .version_select at 0x7fe1acca2b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-311804684", "description": "tempest-description-389819655"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:10.547384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:10.577287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7bb292bc-eeed-460b-b497-f723284339fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:10.588973 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7bb292bc-eeed-460b-b497-f723284339fd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1315 microversion: 2.1 time: 0.850494 Oct 29 02:57:10.591589 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1399/2888] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:09 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1315 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:10.620725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ff830be3-4b12-4238-bfb1-4b3df456d4e8 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:10.621185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ff830be3-4b12-4238-bfb1-4b3df456d4e8 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:10.639372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff830be3-4b12-4238-bfb1-4b3df456d4e8 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:10.640837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff830be3-4b12-4238-bfb1-4b3df456d4e8 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:10.643918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff830be3-4b12-4238-bfb1-4b3df456d4e8 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:10.645324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff830be3-4b12-4238-bfb1-4b3df456d4e8 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:10.647059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff830be3-4b12-4238-bfb1-4b3df456d4e8 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:10.648172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff830be3-4b12-4238-bfb1-4b3df456d4e8 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:10.927966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=18 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:11.251924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ff830be3-4b12-4238-bfb1-4b3df456d4e8 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:11.265929 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ff830be3-4b12-4238-bfb1-4b3df456d4e8 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1312 microversion: 2.1 time: 0.671522 Oct 29 02:57:11.266800 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1400/2889] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:10 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1312 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:11.269975 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2614bc2e-eaca-4a9d-8cb8-7b1a6052c040 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.135373 Oct 29 02:57:11.270570 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1490/2890] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:57:10 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:11.279694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-eeacfcb0-5055-4c39-a8a2-31682cf4ce1f req-08f60fcb-2e8b-466e-8c35-96fb1a416a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1", "name": "network-vif-plugged", "status": "completed", "tag": "ca4e09b5-4c0b-4a09-a5a8-c942144c3423"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:11.293145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b1c3c472-4c0b-453a-9218-2964aed68d4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:11.293790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b1c3c472-4c0b-453a-9218-2964aed68d4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:11.313324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c3c472-4c0b-453a-9218-2964aed68d4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:11.313947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c3c472-4c0b-453a-9218-2964aed68d4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:11.314496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c3c472-4c0b-453a-9218-2964aed68d4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:11.315303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c3c472-4c0b-453a-9218-2964aed68d4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:11.315858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c3c472-4c0b-453a-9218-2964aed68d4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:11.318511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c3c472-4c0b-453a-9218-2964aed68d4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:11.356433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-eeacfcb0-5055-4c39-a8a2-31682cf4ce1f req-08f60fcb-2e8b-466e-8c35-96fb1a416a01 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:11.358024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-eeacfcb0-5055-4c39-a8a2-31682cf4ce1f req-08f60fcb-2e8b-466e-8c35-96fb1a416a01 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:11.358986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-eeacfcb0-5055-4c39-a8a2-31682cf4ce1f req-08f60fcb-2e8b-466e-8c35-96fb1a416a01 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:11.409746 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-eeacfcb0-5055-4c39-a8a2-31682cf4ce1f req-08f60fcb-2e8b-466e-8c35-96fb1a416a01 service nova] Creating event network-vif-plugged:ca4e09b5-4c0b-4a09-a5a8-c942144c3423 for instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 on n-h1-862964-4 Oct 29 02:57:11.429966 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-eeacfcb0-5055-4c39-a8a2-31682cf4ce1f req-08f60fcb-2e8b-466e-8c35-96fb1a416a01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152853 Oct 29 02:57:11.430654 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1491/2891] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:11.559185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1149807112", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "522cc676-82d1-4371-9935-f1df64119702"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:11.656986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] validate_networks() for [('522cc676-82d1-4371-9935-f1df64119702', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:12.112481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b1c3c472-4c0b-453a-9218-2964aed68d4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:12.126058 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b1c3c472-4c0b-453a-9218-2964aed68d4e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1307 microversion: 2.1 time: 0.853741 Oct 29 02:57:12.138681 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1401/2892] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:11 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1307 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:12.171065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-59b1234e-78fb-4a2c-9e2a-f97b3e4e3155 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:12.172076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-59b1234e-78fb-4a2c-9e2a-f97b3e4e3155 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:12.178816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59b1234e-78fb-4a2c-9e2a-f97b3e4e3155 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:12.180239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59b1234e-78fb-4a2c-9e2a-f97b3e4e3155 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:12.180902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59b1234e-78fb-4a2c-9e2a-f97b3e4e3155 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:12.187435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59b1234e-78fb-4a2c-9e2a-f97b3e4e3155 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:12.188148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59b1234e-78fb-4a2c-9e2a-f97b3e4e3155 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:12.188814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59b1234e-78fb-4a2c-9e2a-f97b3e4e3155 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:12.505450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:12.506404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:12.507055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:12.507610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:12.508178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:12.520587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:12.521307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:12.522830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:12.523791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:12.524450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:12.525029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:12.535738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:12.564145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Getting quotas for project 81d9071c47304d7ca128734f7bc8eeed. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:12.572692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Getting quotas for user f909cc7113594047add07a2bbd14187a and project 81d9071c47304d7ca128734f7bc8eeed. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:12.594543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:12.597689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:12.635565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:12.664149 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-933688c6-87c8-4922-a4fa-1adff364a2f8 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111214 Oct 29 02:57:12.665389 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1492/2893] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:57:12.775215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1818330360", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "708a1e54-a0bf-4ed4-870f-05dc20a644af"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:12.880499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] validate_networks() for [('708a1e54-a0bf-4ed4-870f-05dc20a644af', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:13.085669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-59b1234e-78fb-4a2c-9e2a-f97b3e4e3155 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:13.094525 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-59b1234e-78fb-4a2c-9e2a-f97b3e4e3155 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1315 microversion: 2.1 time: 0.954288 Oct 29 02:57:13.100213 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1402/2894] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:12 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1315 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:13.112049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9539b23e-8e4a-47e2-a247-1bd61333c00e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:13.112915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9539b23e-8e4a-47e2-a247-1bd61333c00e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:13.129933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9539b23e-8e4a-47e2-a247-1bd61333c00e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:13.130723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9539b23e-8e4a-47e2-a247-1bd61333c00e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:13.135762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9539b23e-8e4a-47e2-a247-1bd61333c00e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:13.136934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9539b23e-8e4a-47e2-a247-1bd61333c00e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:13.138307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9539b23e-8e4a-47e2-a247-1bd61333c00e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:13.138935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9539b23e-8e4a-47e2-a247-1bd61333c00e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:13.711476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:13.714204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:13.716253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:13.716901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:13.717547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:13.731041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:13.738378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:13.739013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:13.740059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:13.740641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:13.743157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:13.808867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Getting quotas for project 523c0a96752940ca9416402d8180b1bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:13.826370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Getting quotas for user be3a530b7ca34f6b9e84e3e7ece9fcff and project 523c0a96752940ca9416402d8180b1bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:13.859240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:13.870017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:13.976961 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bde6e79c-f198-4cc4-b0a6-6d9fc1a4d636 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.306870 Oct 29 02:57:13.982614 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1493/2895] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:57:14.003504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3c2e6808-6e63-483b-9142-0a3d893d7997 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:14.008640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9539b23e-8e4a-47e2-a247-1bd61333c00e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:14.015828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3c2e6808-6e63-483b-9142-0a3d893d7997 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:14.025454 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9539b23e-8e4a-47e2-a247-1bd61333c00e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1312 microversion: 2.1 time: 0.923115 Oct 29 02:57:14.028912 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1403/2896] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:13 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1312 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:14.045268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9852fc0c-bd09-427f-9a43-cabd24f463b5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:14.047637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9852fc0c-bd09-427f-9a43-cabd24f463b5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:14.066433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2e6808-6e63-483b-9142-0a3d893d7997 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.067484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2e6808-6e63-483b-9142-0a3d893d7997 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.068778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9852fc0c-bd09-427f-9a43-cabd24f463b5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.070155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2e6808-6e63-483b-9142-0a3d893d7997 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.070421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9852fc0c-bd09-427f-9a43-cabd24f463b5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.071027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9852fc0c-bd09-427f-9a43-cabd24f463b5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.073148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2e6808-6e63-483b-9142-0a3d893d7997 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.073786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2e6808-6e63-483b-9142-0a3d893d7997 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.074254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2e6808-6e63-483b-9142-0a3d893d7997 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.074579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9852fc0c-bd09-427f-9a43-cabd24f463b5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.075906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9852fc0c-bd09-427f-9a43-cabd24f463b5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.076682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9852fc0c-bd09-427f-9a43-cabd24f463b5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.262972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c2e6808-6e63-483b-9142-0a3d893d7997 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:14.282999 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3c2e6808-6e63-483b-9142-0a3d893d7997 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1268 microversion: 2.1 time: 0.297399 Oct 29 02:57:14.301571 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1494/2897] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:13 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1268 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:14.313653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c211e95a-08e3-4c21-b65d-2f9336701735 req-50e3f8ac-f580-41fc-bf10-11f2309f467f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b92520-a832-4a78-8a12-b5d5db32dbe1", "tag": "a5677ae1-09cc-40c2-9504-6c3659e606f3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:14.342553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c211e95a-08e3-4c21-b65d-2f9336701735 req-50e3f8ac-f580-41fc-bf10-11f2309f467f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.343970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c211e95a-08e3-4c21-b65d-2f9336701735 req-50e3f8ac-f580-41fc-bf10-11f2309f467f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.346599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c211e95a-08e3-4c21-b65d-2f9336701735 req-50e3f8ac-f580-41fc-bf10-11f2309f467f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.364545 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c211e95a-08e3-4c21-b65d-2f9336701735 req-50e3f8ac-f580-41fc-bf10-11f2309f467f service nova] Creating event network-changed:a5677ae1-09cc-40c2-9504-6c3659e606f3 for instance b4b92520-a832-4a78-8a12-b5d5db32dbe1 on n-h2-862964-4 Oct 29 02:57:14.371045 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c211e95a-08e3-4c21-b65d-2f9336701735 req-50e3f8ac-f580-41fc-bf10-11f2309f467f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067183 Oct 29 02:57:14.373039 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1495/2898] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:14.379414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-593596e4-703f-4fcd-87c1-57c028fe747f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:14.380518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-593596e4-703f-4fcd-87c1-57c028fe747f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:14.475439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-593596e4-703f-4fcd-87c1-57c028fe747f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:14.489080 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-593596e4-703f-4fcd-87c1-57c028fe747f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1224 microversion: 2.1 time: 0.114275 Oct 29 02:57:14.489725 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1496/2899] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:14 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:14.516255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9586b0f-d1d3-4fcb-968a-6343d25bfd98 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:14.521479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9852fc0c-bd09-427f-9a43-cabd24f463b5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:14.523703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c9586b0f-d1d3-4fcb-968a-6343d25bfd98 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:14.545894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9586b0f-d1d3-4fcb-968a-6343d25bfd98 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.546444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9586b0f-d1d3-4fcb-968a-6343d25bfd98 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.546890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9586b0f-d1d3-4fcb-968a-6343d25bfd98 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.547617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9586b0f-d1d3-4fcb-968a-6343d25bfd98 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.549179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9586b0f-d1d3-4fcb-968a-6343d25bfd98 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.549836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9586b0f-d1d3-4fcb-968a-6343d25bfd98 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.550733 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9852fc0c-bd09-427f-9a43-cabd24f463b5 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1307 microversion: 2.1 time: 0.515056 Oct 29 02:57:14.553184 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1404/2900] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:14 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1307 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:14.567851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e46c4c7b-fe78-42a9-915f-4bd73687336e req-a8f72444-2d09-4cc7-887e-0cfab0dad28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ded3792-3d26-4e1e-9e2c-3a94ef959c05", "name": "network-vif-plugged", "status": "completed", "tag": "726dcb01-9a82-43bd-a9a0-866151f08df4"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:14.594412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e46c4c7b-fe78-42a9-915f-4bd73687336e req-a8f72444-2d09-4cc7-887e-0cfab0dad28c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.596962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e46c4c7b-fe78-42a9-915f-4bd73687336e req-a8f72444-2d09-4cc7-887e-0cfab0dad28c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.597704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e46c4c7b-fe78-42a9-915f-4bd73687336e req-a8f72444-2d09-4cc7-887e-0cfab0dad28c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.636843 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e46c4c7b-fe78-42a9-915f-4bd73687336e req-a8f72444-2d09-4cc7-887e-0cfab0dad28c service nova] Creating event network-vif-plugged:726dcb01-9a82-43bd-a9a0-866151f08df4 for instance 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 on n-h2-862964-4 Oct 29 02:57:14.652543 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e46c4c7b-fe78-42a9-915f-4bd73687336e req-a8f72444-2d09-4cc7-887e-0cfab0dad28c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094859 Oct 29 02:57:14.653627 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1405/2901] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:14.963591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c9586b0f-d1d3-4fcb-968a-6343d25bfd98 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:14.974613 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c9586b0f-d1d3-4fcb-968a-6343d25bfd98 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1500 microversion: 2.1 time: 0.481547 Oct 29 02:57:14.993926 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1497/2902] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:14 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1500 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:15.004231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f137acec-c413-4cd7-af85-123eb0b2a234 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:15.005068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f137acec-c413-4cd7-af85-123eb0b2a234 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:15.035875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f137acec-c413-4cd7-af85-123eb0b2a234 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.036504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f137acec-c413-4cd7-af85-123eb0b2a234 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.037391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f137acec-c413-4cd7-af85-123eb0b2a234 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.039295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f137acec-c413-4cd7-af85-123eb0b2a234 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.040291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f137acec-c413-4cd7-af85-123eb0b2a234 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.041066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f137acec-c413-4cd7-af85-123eb0b2a234 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.054156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d384d40b-0b0c-4e80-a17c-8d479a65e91f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:15.054962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d384d40b-0b0c-4e80-a17c-8d479a65e91f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:15.066920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d384d40b-0b0c-4e80-a17c-8d479a65e91f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.068041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d384d40b-0b0c-4e80-a17c-8d479a65e91f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.069420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d384d40b-0b0c-4e80-a17c-8d479a65e91f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.070827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d384d40b-0b0c-4e80-a17c-8d479a65e91f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.071629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d384d40b-0b0c-4e80-a17c-8d479a65e91f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.074149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d384d40b-0b0c-4e80-a17c-8d479a65e91f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.175718 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f137acec-c413-4cd7-af85-123eb0b2a234 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1/action" status: 202 len: 0 microversion: 2.1 time: 0.178059 Oct 29 02:57:15.176658 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1406/2903] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:14 2022] POST /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:15.193139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5adb59a5-4f70-4b46-97e3-570d587651c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:15.195114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5adb59a5-4f70-4b46-97e3-570d587651c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:15.214055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adb59a5-4f70-4b46-97e3-570d587651c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.215364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adb59a5-4f70-4b46-97e3-570d587651c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.216044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adb59a5-4f70-4b46-97e3-570d587651c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.218742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adb59a5-4f70-4b46-97e3-570d587651c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.220446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adb59a5-4f70-4b46-97e3-570d587651c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.221969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adb59a5-4f70-4b46-97e3-570d587651c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.360309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d384d40b-0b0c-4e80-a17c-8d479a65e91f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:15.390833 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d384d40b-0b0c-4e80-a17c-8d479a65e91f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1312 microversion: 2.1 time: 0.342223 Oct 29 02:57:15.395560 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1498/2904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:15 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1312 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:15.410732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b00165ca-44ea-4887-bbaf-408138a99248 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:15.411435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b00165ca-44ea-4887-bbaf-408138a99248 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:15.428970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b00165ca-44ea-4887-bbaf-408138a99248 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.430203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b00165ca-44ea-4887-bbaf-408138a99248 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.432266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b00165ca-44ea-4887-bbaf-408138a99248 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.433081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b00165ca-44ea-4887-bbaf-408138a99248 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.433546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b00165ca-44ea-4887-bbaf-408138a99248 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.434001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b00165ca-44ea-4887-bbaf-408138a99248 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.618887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5adb59a5-4f70-4b46-97e3-570d587651c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:15.625421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b00165ca-44ea-4887-bbaf-408138a99248 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:15.630626 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5adb59a5-4f70-4b46-97e3-570d587651c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1505 microversion: 2.1 time: 0.447996 Oct 29 02:57:15.635672 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1407/2905] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:15 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:15.641352 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b00165ca-44ea-4887-bbaf-408138a99248 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1274 microversion: 2.1 time: 0.239474 Oct 29 02:57:15.642974 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1499/2906] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:15 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:15.654599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b0fe895-366e-4f55-b6da-a49628262952 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:15.655493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4b0fe895-366e-4f55-b6da-a49628262952 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:15.666774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5217961a-2b15-418f-9351-c56b040d7170 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:15.668000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5217961a-2b15-418f-9351-c56b040d7170 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:15.674234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0fe895-366e-4f55-b6da-a49628262952 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.675224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0fe895-366e-4f55-b6da-a49628262952 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.676695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5217961a-2b15-418f-9351-c56b040d7170 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.677201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5217961a-2b15-418f-9351-c56b040d7170 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.677472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0fe895-366e-4f55-b6da-a49628262952 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.677695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5217961a-2b15-418f-9351-c56b040d7170 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.678505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5217961a-2b15-418f-9351-c56b040d7170 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.679307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5217961a-2b15-418f-9351-c56b040d7170 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.679769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0fe895-366e-4f55-b6da-a49628262952 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.680090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5217961a-2b15-418f-9351-c56b040d7170 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.680848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0fe895-366e-4f55-b6da-a49628262952 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.681282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0fe895-366e-4f55-b6da-a49628262952 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.788854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5217961a-2b15-418f-9351-c56b040d7170 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:15.797960 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5217961a-2b15-418f-9351-c56b040d7170 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1228 microversion: 2.1 time: 0.160161 Oct 29 02:57:15.801525 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1408/2907] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:15 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1228 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:15.985925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b0fe895-366e-4f55-b6da-a49628262952 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:16.012348 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4b0fe895-366e-4f55-b6da-a49628262952 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1307 microversion: 2.1 time: 0.367941 Oct 29 02:57:16.013008 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1500/2908] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:15 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1307 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:16.421135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b444e697-d6ab-43e2-a772-ce71d0cc81dc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:16.422227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b444e697-d6ab-43e2-a772-ce71d0cc81dc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:16.434621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b444e697-d6ab-43e2-a772-ce71d0cc81dc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.438902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b444e697-d6ab-43e2-a772-ce71d0cc81dc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.439951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b444e697-d6ab-43e2-a772-ce71d0cc81dc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:16.445186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b444e697-d6ab-43e2-a772-ce71d0cc81dc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.447013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b444e697-d6ab-43e2-a772-ce71d0cc81dc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.447456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b444e697-d6ab-43e2-a772-ce71d0cc81dc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:16.659219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4a7d70f0-2dd2-4e7a-b46d-52de51ccbd86 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:16.659883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4a7d70f0-2dd2-4e7a-b46d-52de51ccbd86 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:16.692553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a7d70f0-2dd2-4e7a-b46d-52de51ccbd86 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.693432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a7d70f0-2dd2-4e7a-b46d-52de51ccbd86 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.694119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a7d70f0-2dd2-4e7a-b46d-52de51ccbd86 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:16.696314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a7d70f0-2dd2-4e7a-b46d-52de51ccbd86 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.699200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a7d70f0-2dd2-4e7a-b46d-52de51ccbd86 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.699908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a7d70f0-2dd2-4e7a-b46d-52de51ccbd86 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.253929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4a7d70f0-2dd2-4e7a-b46d-52de51ccbd86 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:17.262849 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4a7d70f0-2dd2-4e7a-b46d-52de51ccbd86 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1485 microversion: 2.1 time: 0.608950 Oct 29 02:57:17.267100 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1501/2909] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:16 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1485 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:17.272942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-61fc5bdb-ca42-4175-8cdc-02995d376350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:17.280498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-61fc5bdb-ca42-4175-8cdc-02995d376350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:17.308055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61fc5bdb-ca42-4175-8cdc-02995d376350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.308817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61fc5bdb-ca42-4175-8cdc-02995d376350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.309622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61fc5bdb-ca42-4175-8cdc-02995d376350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.311921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61fc5bdb-ca42-4175-8cdc-02995d376350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.312559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61fc5bdb-ca42-4175-8cdc-02995d376350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.314895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61fc5bdb-ca42-4175-8cdc-02995d376350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.503468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-61fc5bdb-ca42-4175-8cdc-02995d376350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:17.523187 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-61fc5bdb-ca42-4175-8cdc-02995d376350 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1274 microversion: 2.1 time: 0.254603 Oct 29 02:57:17.528372 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1502/2910] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:17 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1274 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:17.548592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce337675-3870-4127-85eb-e9fecad8dfca tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:17.552422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce337675-3870-4127-85eb-e9fecad8dfca tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:17.573631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce337675-3870-4127-85eb-e9fecad8dfca tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.574435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce337675-3870-4127-85eb-e9fecad8dfca tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.575069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce337675-3870-4127-85eb-e9fecad8dfca tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.575982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce337675-3870-4127-85eb-e9fecad8dfca tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.576769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce337675-3870-4127-85eb-e9fecad8dfca tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.578374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce337675-3870-4127-85eb-e9fecad8dfca tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.581122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b444e697-d6ab-43e2-a772-ce71d0cc81dc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:17.596017 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b444e697-d6ab-43e2-a772-ce71d0cc81dc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1312 microversion: 2.1 time: 1.180107 Oct 29 02:57:17.596593 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1409/2911] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:16 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1312 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:17.612460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-bfb8b689-f2df-4120-b2ac-53ffeb115a2e req-c1e696b2-c67c-4e24-965d-0e5868af9ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373da2a7-dc50-4f64-bb50-98e9be4e00ea", "name": "network-vif-plugged", "status": "completed", "tag": "2a519e5a-0fce-4f47-84d2-9cab1c919527"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:17.656469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bfb8b689-f2df-4120-b2ac-53ffeb115a2e req-c1e696b2-c67c-4e24-965d-0e5868af9ce8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.657035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bfb8b689-f2df-4120-b2ac-53ffeb115a2e req-c1e696b2-c67c-4e24-965d-0e5868af9ce8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.657465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bfb8b689-f2df-4120-b2ac-53ffeb115a2e req-c1e696b2-c67c-4e24-965d-0e5868af9ce8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.685693 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-bfb8b689-f2df-4120-b2ac-53ffeb115a2e req-c1e696b2-c67c-4e24-965d-0e5868af9ce8 service nova] Creating event network-vif-plugged:2a519e5a-0fce-4f47-84d2-9cab1c919527 for instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea on n-h1-862964-4 Oct 29 02:57:17.698222 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-bfb8b689-f2df-4120-b2ac-53ffeb115a2e req-c1e696b2-c67c-4e24-965d-0e5868af9ce8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100351 Oct 29 02:57:17.704246 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1410/2912] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:17.714585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-effd3946-43af-4cd2-8183-892f70ab69dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:17.715681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-effd3946-43af-4cd2-8183-892f70ab69dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:17.730591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effd3946-43af-4cd2-8183-892f70ab69dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.738212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effd3946-43af-4cd2-8183-892f70ab69dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.743377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effd3946-43af-4cd2-8183-892f70ab69dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.744691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effd3946-43af-4cd2-8183-892f70ab69dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.746854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effd3946-43af-4cd2-8183-892f70ab69dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.749277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-effd3946-43af-4cd2-8183-892f70ab69dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.796938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce337675-3870-4127-85eb-e9fecad8dfca tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:17.813632 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce337675-3870-4127-85eb-e9fecad8dfca tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1282 microversion: 2.1 time: 0.279718 Oct 29 02:57:17.817089 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1503/2913] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:17 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1282 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:17.837859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5b09d967-8309-4f5f-9dbb-d412e135da9b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:17.838617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5b09d967-8309-4f5f-9dbb-d412e135da9b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:17.857176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b09d967-8309-4f5f-9dbb-d412e135da9b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.858780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b09d967-8309-4f5f-9dbb-d412e135da9b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.859420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b09d967-8309-4f5f-9dbb-d412e135da9b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.860994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b09d967-8309-4f5f-9dbb-d412e135da9b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.863580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b09d967-8309-4f5f-9dbb-d412e135da9b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.867386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b09d967-8309-4f5f-9dbb-d412e135da9b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.931667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5b09d967-8309-4f5f-9dbb-d412e135da9b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:57:18.115887 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5b09d967-8309-4f5f-9dbb-d412e135da9b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 204 len: 0 microversion: 2.1 time: 0.284865 Oct 29 02:57:18.122214 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1504/2914] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:17 2022] DELETE /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:57:18.136786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-12f08f8e-25f2-44dd-9068-31f57502a2c8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:18.138770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-12f08f8e-25f2-44dd-9068-31f57502a2c8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:18.156909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12f08f8e-25f2-44dd-9068-31f57502a2c8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.158954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12f08f8e-25f2-44dd-9068-31f57502a2c8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.160576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12f08f8e-25f2-44dd-9068-31f57502a2c8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.162713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12f08f8e-25f2-44dd-9068-31f57502a2c8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.164823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12f08f8e-25f2-44dd-9068-31f57502a2c8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.166533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12f08f8e-25f2-44dd-9068-31f57502a2c8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.376779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-effd3946-43af-4cd2-8183-892f70ab69dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:18.380988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:18.386809 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-effd3946-43af-4cd2-8183-892f70ab69dc tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1307 microversion: 2.1 time: 0.681053 Oct 29 02:57:18.392241 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1411/2915] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:17 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1307 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:18.555784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0457a564-84ac-47d2-b1f0-5cd4efb22ed7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:18.556829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0457a564-84ac-47d2-b1f0-5cd4efb22ed7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:18.569338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0457a564-84ac-47d2-b1f0-5cd4efb22ed7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.571078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0457a564-84ac-47d2-b1f0-5cd4efb22ed7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.572088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0457a564-84ac-47d2-b1f0-5cd4efb22ed7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.574158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0457a564-84ac-47d2-b1f0-5cd4efb22ed7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.575848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0457a564-84ac-47d2-b1f0-5cd4efb22ed7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.577576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0457a564-84ac-47d2-b1f0-5cd4efb22ed7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.623053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-12f08f8e-25f2-44dd-9068-31f57502a2c8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:18.633480 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-12f08f8e-25f2-44dd-9068-31f57502a2c8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1491 microversion: 2.1 time: 0.508380 Oct 29 02:57:18.634144 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1505/2916] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:18 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1491 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:18.659128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6e767811-279a-4ddb-89f0-3dacd3ddbea1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:18.659733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6e767811-279a-4ddb-89f0-3dacd3ddbea1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:18.679713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e767811-279a-4ddb-89f0-3dacd3ddbea1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.680202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e767811-279a-4ddb-89f0-3dacd3ddbea1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.680636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e767811-279a-4ddb-89f0-3dacd3ddbea1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.681341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e767811-279a-4ddb-89f0-3dacd3ddbea1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.681794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e767811-279a-4ddb-89f0-3dacd3ddbea1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.682229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e767811-279a-4ddb-89f0-3dacd3ddbea1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.891470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0457a564-84ac-47d2-b1f0-5cd4efb22ed7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:18.906736 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0457a564-84ac-47d2-b1f0-5cd4efb22ed7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1316 microversion: 2.1 time: 0.357006 Oct 29 02:57:18.907646 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1412/2917] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:18 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:18.912220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-012e610b-7d5f-4d4a-a5b5-be8a62e36b27 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:18.913015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-012e610b-7d5f-4d4a-a5b5-be8a62e36b27 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:18.919356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-012e610b-7d5f-4d4a-a5b5-be8a62e36b27 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.920137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-012e610b-7d5f-4d4a-a5b5-be8a62e36b27 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.921119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-012e610b-7d5f-4d4a-a5b5-be8a62e36b27 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.922043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-012e610b-7d5f-4d4a-a5b5-be8a62e36b27 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.923135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-012e610b-7d5f-4d4a-a5b5-be8a62e36b27 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.923871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-012e610b-7d5f-4d4a-a5b5-be8a62e36b27 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.158629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6e767811-279a-4ddb-89f0-3dacd3ddbea1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:19.171143 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6e767811-279a-4ddb-89f0-3dacd3ddbea1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1312 microversion: 2.1 time: 0.515925 Oct 29 02:57:19.171852 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1506/2918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:18 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1312 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:19.254669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-012e610b-7d5f-4d4a-a5b5-be8a62e36b27 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:19.280147 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-012e610b-7d5f-4d4a-a5b5-be8a62e36b27 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1324 microversion: 2.1 time: 0.371354 Oct 29 02:57:19.293835 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1413/2919] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:18 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:19.408510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a5fa8654-0c55-43fa-a7ba-ed8013fb61ea tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:19.409128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a5fa8654-0c55-43fa-a7ba-ed8013fb61ea tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:19.427844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5fa8654-0c55-43fa-a7ba-ed8013fb61ea tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.428343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5fa8654-0c55-43fa-a7ba-ed8013fb61ea tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.428784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5fa8654-0c55-43fa-a7ba-ed8013fb61ea tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.429938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5fa8654-0c55-43fa-a7ba-ed8013fb61ea tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.430079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5fa8654-0c55-43fa-a7ba-ed8013fb61ea tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.430399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5fa8654-0c55-43fa-a7ba-ed8013fb61ea tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.662125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6a39670b-0be4-422f-9d80-de9cd1bde378 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:19.662740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6a39670b-0be4-422f-9d80-de9cd1bde378 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:19.675141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a39670b-0be4-422f-9d80-de9cd1bde378 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.676908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a39670b-0be4-422f-9d80-de9cd1bde378 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.678950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a39670b-0be4-422f-9d80-de9cd1bde378 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.681837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a39670b-0be4-422f-9d80-de9cd1bde378 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.682518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a39670b-0be4-422f-9d80-de9cd1bde378 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.683452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a39670b-0be4-422f-9d80-de9cd1bde378 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.796991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a5fa8654-0c55-43fa-a7ba-ed8013fb61ea tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:19.810647 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a5fa8654-0c55-43fa-a7ba-ed8013fb61ea tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1486 microversion: 2.1 time: 0.401160 Oct 29 02:57:19.811489 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1507/2920] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:19 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1486 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:19.819510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-2cbb897e-8048-4479-a5d6-f781075264d0 req-33425104-dfc9-4cbb-befa-8f882bfcc644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b92520-a832-4a78-8a12-b5d5db32dbe1", "name": "network-vif-plugged", "status": "completed", "tag": "a5677ae1-09cc-40c2-9504-6c3659e606f3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:19.836501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2cbb897e-8048-4479-a5d6-f781075264d0 req-33425104-dfc9-4cbb-befa-8f882bfcc644 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.842169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2cbb897e-8048-4479-a5d6-f781075264d0 req-33425104-dfc9-4cbb-befa-8f882bfcc644 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.845746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2cbb897e-8048-4479-a5d6-f781075264d0 req-33425104-dfc9-4cbb-befa-8f882bfcc644 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.874185 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-2cbb897e-8048-4479-a5d6-f781075264d0 req-33425104-dfc9-4cbb-befa-8f882bfcc644 service nova] Creating event network-vif-plugged:a5677ae1-09cc-40c2-9504-6c3659e606f3 for instance b4b92520-a832-4a78-8a12-b5d5db32dbe1 on n-h2-862964-4 Oct 29 02:57:19.882158 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-2cbb897e-8048-4479-a5d6-f781075264d0 req-33425104-dfc9-4cbb-befa-8f882bfcc644 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067383 Oct 29 02:57:19.887621 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1508/2921] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:19.898882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4c12cb4d-1448-41c9-8620-9f3eb97b8bb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1153972581"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:19.901488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4c12cb4d-1448-41c9-8620-9f3eb97b8bb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:19.919991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c12cb4d-1448-41c9-8620-9f3eb97b8bb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.920483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c12cb4d-1448-41c9-8620-9f3eb97b8bb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.925163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c12cb4d-1448-41c9-8620-9f3eb97b8bb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.926156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c12cb4d-1448-41c9-8620-9f3eb97b8bb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.926780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c12cb4d-1448-41c9-8620-9f3eb97b8bb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.929308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c12cb4d-1448-41c9-8620-9f3eb97b8bb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:20.186135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:20.211865 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4c12cb4d-1448-41c9-8620-9f3eb97b8bb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "POST /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05/action" status: 202 len: 0 microversion: 2.1 time: 0.322502 Oct 29 02:57:20.212918 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1509/2922] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:19 2022] POST /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:57:20.218627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-971205a8-cf04-41b3-9b3d-d20a9a82afaa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:20.219725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-971205a8-cf04-41b3-9b3d-d20a9a82afaa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:20.227259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971205a8-cf04-41b3-9b3d-d20a9a82afaa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:20.238630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971205a8-cf04-41b3-9b3d-d20a9a82afaa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:20.239105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971205a8-cf04-41b3-9b3d-d20a9a82afaa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:20.239861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971205a8-cf04-41b3-9b3d-d20a9a82afaa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:20.240314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971205a8-cf04-41b3-9b3d-d20a9a82afaa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:20.240751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971205a8-cf04-41b3-9b3d-d20a9a82afaa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:20.313975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6a39670b-0be4-422f-9d80-de9cd1bde378 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:20.330916 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6a39670b-0be4-422f-9d80-de9cd1bde378 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1491 microversion: 2.1 time: 0.671647 Oct 29 02:57:20.333162 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1414/2923] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:19 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1491 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:20.340388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1b7c0680-e757-4176-831f-4e3630fa22b9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:20.341273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b7c0680-e757-4176-831f-4e3630fa22b9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:20.358255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b7c0680-e757-4176-831f-4e3630fa22b9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:20.359386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b7c0680-e757-4176-831f-4e3630fa22b9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:20.360450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b7c0680-e757-4176-831f-4e3630fa22b9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:20.361050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b7c0680-e757-4176-831f-4e3630fa22b9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:20.361622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b7c0680-e757-4176-831f-4e3630fa22b9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:20.362193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b7c0680-e757-4176-831f-4e3630fa22b9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:20.645779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b7c0680-e757-4176-831f-4e3630fa22b9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:20.660703 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1b7c0680-e757-4176-831f-4e3630fa22b9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1312 microversion: 2.1 time: 0.324325 Oct 29 02:57:20.675047 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1415/2924] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:20 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1312 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:20.697681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c7ddf99-b356-47dd-91c3-55991386f916 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a83f5f70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:20.763742 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0c7ddf99-b356-47dd-91c3-55991386f916 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22" status: 200 len: 1414 microversion: 2.1 time: 0.078744 Oct 29 02:57:20.774333 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1416/2925] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:20 2022] GET /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:20.780657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-31944d3f-51d6-4cd7-b4cc-1db5926ba940 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:20.781543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-31944d3f-51d6-4cd7-b4cc-1db5926ba940 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:20.794555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31944d3f-51d6-4cd7-b4cc-1db5926ba940 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:20.795047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31944d3f-51d6-4cd7-b4cc-1db5926ba940 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:20.796335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-971205a8-cf04-41b3-9b3d-d20a9a82afaa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:20.796685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31944d3f-51d6-4cd7-b4cc-1db5926ba940 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:20.797426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31944d3f-51d6-4cd7-b4cc-1db5926ba940 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:20.797906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31944d3f-51d6-4cd7-b4cc-1db5926ba940 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:20.798335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31944d3f-51d6-4cd7-b4cc-1db5926ba940 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:20.806431 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-971205a8-cf04-41b3-9b3d-d20a9a82afaa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1316 microversion: 2.1 time: 0.591952 Oct 29 02:57:20.823975 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1510/2926] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:20 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:20.829898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b9b2cbd0-ceb1-4046-8e18-f18d62679c00 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1acc439d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:20.902382 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b9b2cbd0-ceb1-4046-8e18-f18d62679c00 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22" status: 200 len: 1414 microversion: 2.1 time: 0.076335 Oct 29 02:57:20.903634 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1511/2927] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:20 2022] GET /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:20.923791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7fc12a33-2b41-409b-8cc7-960d9fc57bd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a3eeb160>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:21.186581 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7fc12a33-2b41-409b-8cc7-960d9fc57bd2 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22" status: 204 len: 0 microversion: 2.1 time: 0.270524 Oct 29 02:57:21.187220 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1512/2928] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:20 2022] DELETE /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:57:21.199738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-31944d3f-51d6-4cd7-b4cc-1db5926ba940 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:21.201849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-064ae74e-cba5-42cd-bb41-a7ee0e55998c req-66fe9d9f-b341-4126-be31-cca603686adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf06ee37-7622-4404-bfee-79b4e59a6f07", "tag": "357b9302-4bc7-4e44-8013-6ea636c939aa"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:21.207775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-31944d3f-51d6-4cd7-b4cc-1db5926ba940 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1324 microversion: 2.1 time: 0.431958 Oct 29 02:57:21.208912 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1417/2929] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:20 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:21.222059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ab340fb-9db3-4613-8a5b-8bc9da4252c9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a86f4ca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:21.234184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-064ae74e-cba5-42cd-bb41-a7ee0e55998c req-66fe9d9f-b341-4126-be31-cca603686adb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.234878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-064ae74e-cba5-42cd-bb41-a7ee0e55998c req-66fe9d9f-b341-4126-be31-cca603686adb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.235766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-064ae74e-cba5-42cd-bb41-a7ee0e55998c req-66fe9d9f-b341-4126-be31-cca603686adb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.252336 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-064ae74e-cba5-42cd-bb41-a7ee0e55998c req-66fe9d9f-b341-4126-be31-cca603686adb service nova] Creating event network-changed:357b9302-4bc7-4e44-8013-6ea636c939aa for instance cf06ee37-7622-4404-bfee-79b4e59a6f07 on n-h1-862964-4 Oct 29 02:57:21.263670 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-1ab340fb-9db3-4613-8a5b-8bc9da4252c9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Image not found. Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ab340fb-9db3-4613-8a5b-8bc9da4252c9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22 HTTP/1.1 Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '7814acbf-a109-4bac-a439-1d0982691e22'} Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7814acbf-a109-4bac-a439-1d0982691e22 Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:57:21.265958 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7814acbf-a109-4bac-a439-1d0982691e22 could not be found. Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ab340fb-9db3-4613-8a5b-8bc9da4252c9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ab340fb-9db3-4613-8a5b-8bc9da4252c9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22" status: 404 len: 62 microversion: 2.1 time: 0.057490 Oct 29 02:57:21.271396 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1418/2930] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:21 2022] GET /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:57:21.280101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b24f00a8-d4db-4f1c-827e-163d6438cfe7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:21.281844 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-064ae74e-cba5-42cd-bb41-a7ee0e55998c req-66fe9d9f-b341-4126-be31-cca603686adb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079288 Oct 29 02:57:21.282312 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1513/2931] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:21.282780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b24f00a8-d4db-4f1c-827e-163d6438cfe7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:21.291690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b24f00a8-d4db-4f1c-827e-163d6438cfe7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.292476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b24f00a8-d4db-4f1c-827e-163d6438cfe7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.293047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b24f00a8-d4db-4f1c-827e-163d6438cfe7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.293880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b24f00a8-d4db-4f1c-827e-163d6438cfe7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.294364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b24f00a8-d4db-4f1c-827e-163d6438cfe7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.294866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b24f00a8-d4db-4f1c-827e-163d6438cfe7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.359274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-532c5d7e-c707-4839-b0a6-26ec48fb5134 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:21.360184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-532c5d7e-c707-4839-b0a6-26ec48fb5134 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:21.367544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532c5d7e-c707-4839-b0a6-26ec48fb5134 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.368267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532c5d7e-c707-4839-b0a6-26ec48fb5134 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.368884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532c5d7e-c707-4839-b0a6-26ec48fb5134 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.370260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532c5d7e-c707-4839-b0a6-26ec48fb5134 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.370868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532c5d7e-c707-4839-b0a6-26ec48fb5134 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.371441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-532c5d7e-c707-4839-b0a6-26ec48fb5134 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.517775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-532c5d7e-c707-4839-b0a6-26ec48fb5134 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:21.527879 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-532c5d7e-c707-4839-b0a6-26ec48fb5134 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1449 microversion: 2.1 time: 0.173742 Oct 29 02:57:21.528483 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1514/2932] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:21 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1449 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:21.647712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b24f00a8-d4db-4f1c-827e-163d6438cfe7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:21.667568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-19985542-d065-4585-8144-42591a66fa63 req-d288070b-913b-4494-b832-e82e78870849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1", "name": "network-vif-deleted", "tag": "ca4e09b5-4c0b-4a09-a5a8-c942144c3423"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:21.673463 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b24f00a8-d4db-4f1c-827e-163d6438cfe7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1498 microversion: 2.1 time: 0.400462 Oct 29 02:57:21.674459 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1419/2933] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:21 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1498 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:21.685030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-19985542-d065-4585-8144-42591a66fa63 req-d288070b-913b-4494-b832-e82e78870849 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.685513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-19985542-d065-4585-8144-42591a66fa63 req-d288070b-913b-4494-b832-e82e78870849 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.686496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-19985542-d065-4585-8144-42591a66fa63 req-d288070b-913b-4494-b832-e82e78870849 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.694437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c5019f0e-7adf-4794-b172-e3c05361d9ef tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:21.695418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c5019f0e-7adf-4794-b172-e3c05361d9ef tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:21.711778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5019f0e-7adf-4794-b172-e3c05361d9ef tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.712278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5019f0e-7adf-4794-b172-e3c05361d9ef tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.712708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5019f0e-7adf-4794-b172-e3c05361d9ef tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.713409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5019f0e-7adf-4794-b172-e3c05361d9ef tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.713976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5019f0e-7adf-4794-b172-e3c05361d9ef tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.714404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5019f0e-7adf-4794-b172-e3c05361d9ef tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.730834 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-19985542-d065-4585-8144-42591a66fa63 req-d288070b-913b-4494-b832-e82e78870849 service nova] Creating event network-vif-deleted:ca4e09b5-4c0b-4a09-a5a8-c942144c3423 for instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 on n-h1-862964-4 Oct 29 02:57:21.757972 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-19985542-d065-4585-8144-42591a66fa63 req-d288070b-913b-4494-b832-e82e78870849 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094352 Oct 29 02:57:21.758613 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1515/2934] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:57:21.830460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a301f663-a548-4225-89e1-808d23772cca tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:21.831171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a301f663-a548-4225-89e1-808d23772cca tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:21.841966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a301f663-a548-4225-89e1-808d23772cca tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.846023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a301f663-a548-4225-89e1-808d23772cca tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.846771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a301f663-a548-4225-89e1-808d23772cca tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.847743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a301f663-a548-4225-89e1-808d23772cca tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.848360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a301f663-a548-4225-89e1-808d23772cca tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.848939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a301f663-a548-4225-89e1-808d23772cca tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.070775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c5019f0e-7adf-4794-b172-e3c05361d9ef tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:22.079566 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c5019f0e-7adf-4794-b172-e3c05361d9ef tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1312 microversion: 2.1 time: 0.389419 Oct 29 02:57:22.084836 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1420/2935] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:21 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1312 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:22.210898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a301f663-a548-4225-89e1-808d23772cca tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:22.219118 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a301f663-a548-4225-89e1-808d23772cca tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1316 microversion: 2.1 time: 0.393048 Oct 29 02:57:22.219693 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1516/2936] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:21 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:22.231755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2f40b679-fae4-41e8-8a1d-f4fe450e483b tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:22.232835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2f40b679-fae4-41e8-8a1d-f4fe450e483b tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:22.239165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f40b679-fae4-41e8-8a1d-f4fe450e483b tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:22.239731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f40b679-fae4-41e8-8a1d-f4fe450e483b tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:22.240223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f40b679-fae4-41e8-8a1d-f4fe450e483b tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.241007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f40b679-fae4-41e8-8a1d-f4fe450e483b tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:22.241820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f40b679-fae4-41e8-8a1d-f4fe450e483b tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:22.243490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f40b679-fae4-41e8-8a1d-f4fe450e483b tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.426691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f40b679-fae4-41e8-8a1d-f4fe450e483b tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:22.435860 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2f40b679-fae4-41e8-8a1d-f4fe450e483b tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1324 microversion: 2.1 time: 0.208984 Oct 29 02:57:22.436676 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1421/2937] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:22 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:22.570523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:22.571228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:22.578531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:22.579130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:22.579640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.580420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:22.580981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:22.581711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.620620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:22.621384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:22.621993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.622589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lazy-loading 'fault' on Instance uuid 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:57:22.685340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:22.694105 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f559ffe-462e-4a85-a72c-d592d3194162 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 200 len: 1305 microversion: 2.1 time: 0.130290 Oct 29 02:57:22.695051 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1517/2938] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:22 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 1305 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:22.701303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aeaa96ca-ad16-4871-a5af-fb11e51b2eb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:22.701933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aeaa96ca-ad16-4871-a5af-fb11e51b2eb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:22.710283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aeaa96ca-ad16-4871-a5af-fb11e51b2eb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:22.710711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aeaa96ca-ad16-4871-a5af-fb11e51b2eb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:22.711153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aeaa96ca-ad16-4871-a5af-fb11e51b2eb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.711849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aeaa96ca-ad16-4871-a5af-fb11e51b2eb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:22.712294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aeaa96ca-ad16-4871-a5af-fb11e51b2eb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:22.712711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aeaa96ca-ad16-4871-a5af-fb11e51b2eb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.878803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aeaa96ca-ad16-4871-a5af-fb11e51b2eb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:22.887690 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aeaa96ca-ad16-4871-a5af-fb11e51b2eb1 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1504 microversion: 2.1 time: 0.190305 Oct 29 02:57:22.888486 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1422/2939] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:22 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:23.112583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f23a56b2-6402-48a4-ba68-4623e0b88a72 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:23.113184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f23a56b2-6402-48a4-ba68-4623e0b88a72 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:23.124136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23a56b2-6402-48a4-ba68-4623e0b88a72 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.124632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23a56b2-6402-48a4-ba68-4623e0b88a72 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.125059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23a56b2-6402-48a4-ba68-4623e0b88a72 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.125975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23a56b2-6402-48a4-ba68-4623e0b88a72 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.126578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23a56b2-6402-48a4-ba68-4623e0b88a72 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.127343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23a56b2-6402-48a4-ba68-4623e0b88a72 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.244853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-edd236dc-516c-4470-882c-d2b7b924e293 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:23.245746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-edd236dc-516c-4470-882c-d2b7b924e293 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:23.253120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edd236dc-516c-4470-882c-d2b7b924e293 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.253608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edd236dc-516c-4470-882c-d2b7b924e293 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.254064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edd236dc-516c-4470-882c-d2b7b924e293 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.254782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edd236dc-516c-4470-882c-d2b7b924e293 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.255228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edd236dc-516c-4470-882c-d2b7b924e293 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.258324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-edd236dc-516c-4470-882c-d2b7b924e293 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.347449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f23a56b2-6402-48a4-ba68-4623e0b88a72 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:23.361614 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f23a56b2-6402-48a4-ba68-4623e0b88a72 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1462 microversion: 2.1 time: 0.252859 Oct 29 02:57:23.367989 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1518/2940] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:23 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1462 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:23.392991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37b5d12b-a4d1-4e87-a842-605a506ec8bc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:23.393741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37b5d12b-a4d1-4e87-a842-605a506ec8bc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:23.402403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b5d12b-a4d1-4e87-a842-605a506ec8bc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.404635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b5d12b-a4d1-4e87-a842-605a506ec8bc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.405878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b5d12b-a4d1-4e87-a842-605a506ec8bc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.406694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b5d12b-a4d1-4e87-a842-605a506ec8bc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.408589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b5d12b-a4d1-4e87-a842-605a506ec8bc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.409728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b5d12b-a4d1-4e87-a842-605a506ec8bc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.573589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-edd236dc-516c-4470-882c-d2b7b924e293 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:23.604687 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-edd236dc-516c-4470-882c-d2b7b924e293 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1316 microversion: 2.1 time: 0.362356 Oct 29 02:57:23.621836 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1423/2941] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:23 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:23.621836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9ff3ae46-35b2-421e-9842-1e808aabb854 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:23.622109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9ff3ae46-35b2-421e-9842-1e808aabb854 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:23.634964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ff3ae46-35b2-421e-9842-1e808aabb854 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.637136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ff3ae46-35b2-421e-9842-1e808aabb854 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.637647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ff3ae46-35b2-421e-9842-1e808aabb854 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.640097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37b5d12b-a4d1-4e87-a842-605a506ec8bc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:23.641062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ff3ae46-35b2-421e-9842-1e808aabb854 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.641765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ff3ae46-35b2-421e-9842-1e808aabb854 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.642352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ff3ae46-35b2-421e-9842-1e808aabb854 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.649558 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37b5d12b-a4d1-4e87-a842-605a506ec8bc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1462 microversion: 2.1 time: 0.260193 Oct 29 02:57:23.650555 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1519/2942] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:23 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1462 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:23.718991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:23.720323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:23.732769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.734911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.737230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.739147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.741996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.743112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.765248 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 HTTP/1.1 Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1'} Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:23.767363 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:23.771431 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:23.771431 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:23.771431 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:23.771431 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:23.771431 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:23.771431 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 02:57:23.771431 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:23.771431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:23.771431 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-918a5bd9-a4d8-47c9-a15f-1ec9d2861713 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 404 len: 111 microversion: 2.1 time: 0.055970 Oct 29 02:57:23.771431 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1520/2943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:23 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:57:23.797642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4cc21a59-7511-49ea-a6da-ffaa7ba7a2c2 req-0d1d8596-f268-44c2-a7db-93c9f71a93d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81fb73f-c42a-4ace-b365-b3e2bfde3e6d", "tag": "825a4637-659c-406d-89ad-960fe09b0d4c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:23.815407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:23.834246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4cc21a59-7511-49ea-a6da-ffaa7ba7a2c2 req-0d1d8596-f268-44c2-a7db-93c9f71a93d3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.834998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4cc21a59-7511-49ea-a6da-ffaa7ba7a2c2 req-0d1d8596-f268-44c2-a7db-93c9f71a93d3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.836863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4cc21a59-7511-49ea-a6da-ffaa7ba7a2c2 req-0d1d8596-f268-44c2-a7db-93c9f71a93d3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.880391 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4cc21a59-7511-49ea-a6da-ffaa7ba7a2c2 req-0d1d8596-f268-44c2-a7db-93c9f71a93d3 service nova] Creating event network-changed:825a4637-659c-406d-89ad-960fe09b0d4c for instance b81fb73f-c42a-4ace-b365-b3e2bfde3e6d on n-h2-862964-4 Oct 29 02:57:23.903819 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4cc21a59-7511-49ea-a6da-ffaa7ba7a2c2 req-0d1d8596-f268-44c2-a7db-93c9f71a93d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110385 Oct 29 02:57:23.907666 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1521/2944] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:57:23.915983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1619053919", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "373da2a7-dc50-4f64-bb50-98e9be4e00ea"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:24.014111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:24.035373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9ff3ae46-35b2-421e-9842-1e808aabb854 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:24.046512 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9ff3ae46-35b2-421e-9842-1e808aabb854 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1324 microversion: 2.1 time: 0.436418 Oct 29 02:57:24.047994 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1424/2945] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:23 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:24.057269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ca15f56a-f111-4656-be55-1a1a4949bd24 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:24.058175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ca15f56a-f111-4656-be55-1a1a4949bd24 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:24.075519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca15f56a-f111-4656-be55-1a1a4949bd24 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.078093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca15f56a-f111-4656-be55-1a1a4949bd24 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.080728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca15f56a-f111-4656-be55-1a1a4949bd24 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.085275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca15f56a-f111-4656-be55-1a1a4949bd24 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.086491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca15f56a-f111-4656-be55-1a1a4949bd24 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.089002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca15f56a-f111-4656-be55-1a1a4949bd24 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.419996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca15f56a-f111-4656-be55-1a1a4949bd24 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:24.428280 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ca15f56a-f111-4656-be55-1a1a4949bd24 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1504 microversion: 2.1 time: 0.379251 Oct 29 02:57:24.428878 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1425/2946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:24 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:24.450362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2126341828", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "206445a3-72bd-4ae4-a1d4-4c994350bfbb"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:24.481709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=17 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:24.528121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] validate_networks() for [('206445a3-72bd-4ae4-a1d4-4c994350bfbb', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:24.588271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:24.589266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:24.590026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:24.590678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:24.591273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:24.603796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.619161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.625442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.626476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.627267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.627830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.666290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Getting quotas for project fc4a5146b4134f11af39e82d9ae9f03b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:24.677832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Getting quotas for user eeff83f3646947109a6a670d0711398f and project fc4a5146b4134f11af39e82d9ae9f03b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:24.700718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:24.705444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:24.835553 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-155309b0-ff89-4190-90a8-98912385af2e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926401 Oct 29 02:57:24.837108 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1522/2947] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:57:24.842194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e6ec676d-9076-4b1d-9799-b6a16da02184 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:24.842893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e6ec676d-9076-4b1d-9799-b6a16da02184 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:24.850899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6ec676d-9076-4b1d-9799-b6a16da02184 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.850899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6ec676d-9076-4b1d-9799-b6a16da02184 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.853482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6ec676d-9076-4b1d-9799-b6a16da02184 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.853482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6ec676d-9076-4b1d-9799-b6a16da02184 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.853482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6ec676d-9076-4b1d-9799-b6a16da02184 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.853482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6ec676d-9076-4b1d-9799-b6a16da02184 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.205977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e6ec676d-9076-4b1d-9799-b6a16da02184 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:25.217954 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e6ec676d-9076-4b1d-9799-b6a16da02184 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1316 microversion: 2.1 time: 0.380081 Oct 29 02:57:25.222366 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1523/2948] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:24 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:25.243138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d45758a0-15ff-47c9-91dd-43d417dfdd1e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:25.244147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d45758a0-15ff-47c9-91dd-43d417dfdd1e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:25.263916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:25.311476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:25.312539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:25.313197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:25.313768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:25.314502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:25.326558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.327691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.328741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.329901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.330591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.331175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.356510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d45758a0-15ff-47c9-91dd-43d417dfdd1e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:25.359897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:25.370044 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d45758a0-15ff-47c9-91dd-43d417dfdd1e tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1214 microversion: 2.1 time: 0.144987 Oct 29 02:57:25.381132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for user fceb096cc5414b3a9d7300fefeb90dff and project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:25.381856 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1524/2949] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:25 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:25.411716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:25.414099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:25.420187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-267ad275-9d21-4a82-917a-b7e4cf6d8199 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:25.420887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-267ad275-9d21-4a82-917a-b7e4cf6d8199 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:25.445795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-267ad275-9d21-4a82-917a-b7e4cf6d8199 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.447185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-267ad275-9d21-4a82-917a-b7e4cf6d8199 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.448433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-267ad275-9d21-4a82-917a-b7e4cf6d8199 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.451131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-267ad275-9d21-4a82-917a-b7e4cf6d8199 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.453176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-267ad275-9d21-4a82-917a-b7e4cf6d8199 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.453900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-267ad275-9d21-4a82-917a-b7e4cf6d8199 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.502769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:25.560576 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ab81586-8149-4813-827b-87e364011df0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119838 Oct 29 02:57:25.567239 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1426/2950] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:57:25.577325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-746d9a86-b191-490c-8a37-3a9cbb5ee391 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:25.582442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-746d9a86-b191-490c-8a37-3a9cbb5ee391 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:25.600975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-746d9a86-b191-490c-8a37-3a9cbb5ee391 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.604460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-746d9a86-b191-490c-8a37-3a9cbb5ee391 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.605100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-746d9a86-b191-490c-8a37-3a9cbb5ee391 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.606194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-746d9a86-b191-490c-8a37-3a9cbb5ee391 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.612475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-746d9a86-b191-490c-8a37-3a9cbb5ee391 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.613308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-746d9a86-b191-490c-8a37-3a9cbb5ee391 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.757908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-267ad275-9d21-4a82-917a-b7e4cf6d8199 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:25.774549 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-267ad275-9d21-4a82-917a-b7e4cf6d8199 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1324 microversion: 2.1 time: 0.376739 Oct 29 02:57:25.775865 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1525/2951] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:25 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1324 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:25.786421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dd9a1fef-da43-4fdc-b949-2085f2ed08ed tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:25.787870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dd9a1fef-da43-4fdc-b949-2085f2ed08ed tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:25.884821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-746d9a86-b191-490c-8a37-3a9cbb5ee391 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:25.894880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dd9a1fef-da43-4fdc-b949-2085f2ed08ed tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:25.895003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-746d9a86-b191-490c-8a37-3a9cbb5ee391 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1486 microversion: 2.1 time: 0.326302 Oct 29 02:57:25.904399 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dd9a1fef-da43-4fdc-b949-2085f2ed08ed tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1215 microversion: 2.1 time: 0.126921 Oct 29 02:57:25.918412 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1427/2952] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:25 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1486 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:25.924953 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1526/2953] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:25 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:25.929183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c31f1ee-1643-4290-b89f-4bc6a054db4d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:25.929689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c31f1ee-1643-4290-b89f-4bc6a054db4d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:25.949852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c31f1ee-1643-4290-b89f-4bc6a054db4d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.950377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c31f1ee-1643-4290-b89f-4bc6a054db4d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.950824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c31f1ee-1643-4290-b89f-4bc6a054db4d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.951559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c31f1ee-1643-4290-b89f-4bc6a054db4d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.952016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c31f1ee-1643-4290-b89f-4bc6a054db4d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.952439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c31f1ee-1643-4290-b89f-4bc6a054db4d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.017354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c31f1ee-1643-4290-b89f-4bc6a054db4d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:57:26.169592 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c31f1ee-1643-4290-b89f-4bc6a054db4d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 204 len: 0 microversion: 2.1 time: 0.249356 Oct 29 02:57:26.180945 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1428/2954] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:25 2022] DELETE /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:57:26.183458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ded0f37d-6d47-41e0-ac19-c8bbe85fac5d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a3eb2b80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:26.233503 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-ded0f37d-6d47-41e0-ac19-c8bbe85fac5d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Image not found. Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ded0f37d-6d47-41e0-ac19-c8bbe85fac5d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22 HTTP/1.1 Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: exception: Image not found. Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '7814acbf-a109-4bac-a439-1d0982691e22'} Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7814acbf-a109-4bac-a439-1d0982691e22 to delete Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7814acbf-a109-4bac-a439-1d0982691e22 could not be found. Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:26.235726 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ded0f37d-6d47-41e0-ac19-c8bbe85fac5d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Image not found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ded0f37d-6d47-41e0-ac19-c8bbe85fac5d tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22" status: 404 len: 62 microversion: 2.1 time: 0.060873 Oct 29 02:57:26.241104 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1527/2955] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:26 2022] DELETE /compute/v2.1/images/7814acbf-a109-4bac-a439-1d0982691e22 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:57:26.246044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-81fc0b20-607c-44a4-bfc8-725f7541ceb1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:26.246833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-81fc0b20-607c-44a4-bfc8-725f7541ceb1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:26.252746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-68e14a5d-0b9e-49e7-b1cd-c41dde2a8aef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:26.256046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-68e14a5d-0b9e-49e7-b1cd-c41dde2a8aef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:26.266529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fc0b20-607c-44a4-bfc8-725f7541ceb1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.267297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fc0b20-607c-44a4-bfc8-725f7541ceb1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.268787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fc0b20-607c-44a4-bfc8-725f7541ceb1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.271730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fc0b20-607c-44a4-bfc8-725f7541ceb1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.273768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fc0b20-607c-44a4-bfc8-725f7541ceb1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.274921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fc0b20-607c-44a4-bfc8-725f7541ceb1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.281628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68e14a5d-0b9e-49e7-b1cd-c41dde2a8aef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.282504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68e14a5d-0b9e-49e7-b1cd-c41dde2a8aef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.283134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68e14a5d-0b9e-49e7-b1cd-c41dde2a8aef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.284010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68e14a5d-0b9e-49e7-b1cd-c41dde2a8aef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.284616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68e14a5d-0b9e-49e7-b1cd-c41dde2a8aef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.285444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68e14a5d-0b9e-49e7-b1cd-c41dde2a8aef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.304804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:26.348042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-68e14a5d-0b9e-49e7-b1cd-c41dde2a8aef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:57:26.451620 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.compute.api [None req-68e14a5d-0b9e-49e7-b1cd-c41dde2a8aef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Instance is already in deleting state, ignoring this request Oct 29 02:57:26.454511 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-68e14a5d-0b9e-49e7-b1cd-c41dde2a8aef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 204 len: 0 microversion: 2.1 time: 0.207988 Oct 29 02:57:26.465099 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1528/2956] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:26 2022] DELETE /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:57:26.471864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-565034d5-bb74-4910-9d8a-3229dfaba371 req-d83a25ad-3051-41fc-a1ca-229fb80fd66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ded3792-3d26-4e1e-9e2c-3a94ef959c05", "name": "network-vif-plugged", "status": "completed", "tag": "726dcb01-9a82-43bd-a9a0-866151f08df4"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:26.487899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-565034d5-bb74-4910-9d8a-3229dfaba371 req-d83a25ad-3051-41fc-a1ca-229fb80fd66d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.488745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-565034d5-bb74-4910-9d8a-3229dfaba371 req-d83a25ad-3051-41fc-a1ca-229fb80fd66d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.489643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-565034d5-bb74-4910-9d8a-3229dfaba371 req-d83a25ad-3051-41fc-a1ca-229fb80fd66d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.509644 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-565034d5-bb74-4910-9d8a-3229dfaba371 req-d83a25ad-3051-41fc-a1ca-229fb80fd66d service nova] Creating event network-vif-plugged:726dcb01-9a82-43bd-a9a0-866151f08df4 for instance 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 on n-h2-862964-4 Oct 29 02:57:26.517021 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-565034d5-bb74-4910-9d8a-3229dfaba371 req-d83a25ad-3051-41fc-a1ca-229fb80fd66d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049504 Oct 29 02:57:26.517885 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1529/2957] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:26.526737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54528111-fc61-4d7c-984c-86d7debd3730 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:26.528589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54528111-fc61-4d7c-984c-86d7debd3730 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:26.538758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54528111-fc61-4d7c-984c-86d7debd3730 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.540091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54528111-fc61-4d7c-984c-86d7debd3730 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.540680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54528111-fc61-4d7c-984c-86d7debd3730 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.548801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54528111-fc61-4d7c-984c-86d7debd3730 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.549548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54528111-fc61-4d7c-984c-86d7debd3730 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.550349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54528111-fc61-4d7c-984c-86d7debd3730 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.581990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-81fc0b20-607c-44a4-bfc8-725f7541ceb1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:26.591800 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-81fc0b20-607c-44a4-bfc8-725f7541ceb1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1316 microversion: 2.1 time: 0.350080 Oct 29 02:57:26.601907 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1429/2958] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:26 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:26.601907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2f299e1f-11f1-4fe8-b5d5-ee2936d10d2f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:26.601907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2f299e1f-11f1-4fe8-b5d5-ee2936d10d2f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:26.614111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f299e1f-11f1-4fe8-b5d5-ee2936d10d2f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.614599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f299e1f-11f1-4fe8-b5d5-ee2936d10d2f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.615019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f299e1f-11f1-4fe8-b5d5-ee2936d10d2f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.615723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f299e1f-11f1-4fe8-b5d5-ee2936d10d2f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.616141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f299e1f-11f1-4fe8-b5d5-ee2936d10d2f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.616550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f299e1f-11f1-4fe8-b5d5-ee2936d10d2f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.694895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-54528111-fc61-4d7c-984c-86d7debd3730 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:26.704598 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54528111-fc61-4d7c-984c-86d7debd3730 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1266 microversion: 2.1 time: 0.185315 Oct 29 02:57:26.722241 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1530/2959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:26 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:26.801629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50d1ddd9-fb09-4b17-84f9-ebb8da5ef655 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:26.802315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-50d1ddd9-fb09-4b17-84f9-ebb8da5ef655 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:26.809303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d1ddd9-fb09-4b17-84f9-ebb8da5ef655 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.809843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d1ddd9-fb09-4b17-84f9-ebb8da5ef655 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.810262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d1ddd9-fb09-4b17-84f9-ebb8da5ef655 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.810975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d1ddd9-fb09-4b17-84f9-ebb8da5ef655 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.811428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d1ddd9-fb09-4b17-84f9-ebb8da5ef655 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.811853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d1ddd9-fb09-4b17-84f9-ebb8da5ef655 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.812486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f299e1f-11f1-4fe8-b5d5-ee2936d10d2f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:26.823799 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2f299e1f-11f1-4fe8-b5d5-ee2936d10d2f tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1492 microversion: 2.1 time: 0.229948 Oct 29 02:57:26.824972 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1430/2960] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:26 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1492 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:26.927950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-477098d4-c7de-48c4-b339-57ca6beb4dd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:26.929401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-477098d4-c7de-48c4-b339-57ca6beb4dd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:26.947879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477098d4-c7de-48c4-b339-57ca6beb4dd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.948774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477098d4-c7de-48c4-b339-57ca6beb4dd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.951607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477098d4-c7de-48c4-b339-57ca6beb4dd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.953687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477098d4-c7de-48c4-b339-57ca6beb4dd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.955558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477098d4-c7de-48c4-b339-57ca6beb4dd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.956638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477098d4-c7de-48c4-b339-57ca6beb4dd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:27.014026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-50d1ddd9-fb09-4b17-84f9-ebb8da5ef655 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:27.024914 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50d1ddd9-fb09-4b17-84f9-ebb8da5ef655 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1324 microversion: 2.1 time: 0.227571 Oct 29 02:57:27.025546 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1531/2961] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:26 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1324 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:27.089328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-477098d4-c7de-48c4-b339-57ca6beb4dd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:27.098670 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-477098d4-c7de-48c4-b339-57ca6beb4dd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1211 microversion: 2.1 time: 0.174680 Oct 29 02:57:27.099757 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1431/2962] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:26 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1211 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:27.622470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e49060de-690c-4bfc-8ec1-39e44333ae1a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:27.623544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e49060de-690c-4bfc-8ec1-39e44333ae1a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:27.632892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49060de-690c-4bfc-8ec1-39e44333ae1a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:27.634287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49060de-690c-4bfc-8ec1-39e44333ae1a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:27.635726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49060de-690c-4bfc-8ec1-39e44333ae1a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:27.638328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49060de-690c-4bfc-8ec1-39e44333ae1a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:27.639662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49060de-690c-4bfc-8ec1-39e44333ae1a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:27.640915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e49060de-690c-4bfc-8ec1-39e44333ae1a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:27.746986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e4c2312-ef82-4466-9a05-c0fbc0008ebc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:27.748175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e4c2312-ef82-4466-9a05-c0fbc0008ebc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:27.759157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e4c2312-ef82-4466-9a05-c0fbc0008ebc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:27.760033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e4c2312-ef82-4466-9a05-c0fbc0008ebc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:27.760660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e4c2312-ef82-4466-9a05-c0fbc0008ebc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:27.762229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e4c2312-ef82-4466-9a05-c0fbc0008ebc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:27.762853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e4c2312-ef82-4466-9a05-c0fbc0008ebc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:27.763438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e4c2312-ef82-4466-9a05-c0fbc0008ebc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:27.877738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e49060de-690c-4bfc-8ec1-39e44333ae1a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:27.893090 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e49060de-690c-4bfc-8ec1-39e44333ae1a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1316 microversion: 2.1 time: 0.278822 Oct 29 02:57:27.905836 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1532/2963] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:27 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:27.910220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b6ef897-ce06-4afe-9f0f-5e903c61378c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:27.911029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8b6ef897-ce06-4afe-9f0f-5e903c61378c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:27.920669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6ef897-ce06-4afe-9f0f-5e903c61378c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:27.923154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6ef897-ce06-4afe-9f0f-5e903c61378c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:27.926499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6ef897-ce06-4afe-9f0f-5e903c61378c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:27.927441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6ef897-ce06-4afe-9f0f-5e903c61378c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:27.928067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6ef897-ce06-4afe-9f0f-5e903c61378c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:27.931551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b6ef897-ce06-4afe-9f0f-5e903c61378c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:27.934489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3e4c2312-ef82-4466-9a05-c0fbc0008ebc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:27.951638 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3e4c2312-ef82-4466-9a05-c0fbc0008ebc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1272 microversion: 2.1 time: 0.210335 Oct 29 02:57:27.952570 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1432/2964] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:27 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:27.974867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:28.049690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b5bb793-f677-479c-a5c8-5800a8b01363 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:28.050599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b5bb793-f677-479c-a5c8-5800a8b01363 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:28.064353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5bb793-f677-479c-a5c8-5800a8b01363 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.065077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5bb793-f677-479c-a5c8-5800a8b01363 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.065528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5bb793-f677-479c-a5c8-5800a8b01363 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.078368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5bb793-f677-479c-a5c8-5800a8b01363 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.082499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5bb793-f677-479c-a5c8-5800a8b01363 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.090089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b5bb793-f677-479c-a5c8-5800a8b01363 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.293202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8b6ef897-ce06-4afe-9f0f-5e903c61378c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:28.310188 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b6ef897-ce06-4afe-9f0f-5e903c61378c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1492 microversion: 2.1 time: 0.414633 Oct 29 02:57:28.311390 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1533/2965] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:27 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1492 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:28.316348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-00e95c50-0682-4889-bdc6-339746b8dbf5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:28.317236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-00e95c50-0682-4889-bdc6-339746b8dbf5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:28.335515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e95c50-0682-4889-bdc6-339746b8dbf5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.336432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e95c50-0682-4889-bdc6-339746b8dbf5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.337077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e95c50-0682-4889-bdc6-339746b8dbf5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.338071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e95c50-0682-4889-bdc6-339746b8dbf5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.338767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e95c50-0682-4889-bdc6-339746b8dbf5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.339401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e95c50-0682-4889-bdc6-339746b8dbf5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.489953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-00e95c50-0682-4889-bdc6-339746b8dbf5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:28.504553 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-00e95c50-0682-4889-bdc6-339746b8dbf5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1273 microversion: 2.1 time: 0.191765 Oct 29 02:57:28.506140 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1534/2966] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:28 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:28.554854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-35dec2b3-5434-45c1-9121-691e2f345ba8 req-8cac3400-d8eb-482b-98ca-c3c9e8ff5665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf06ee37-7622-4404-bfee-79b4e59a6f07", "name": "network-vif-plugged", "status": "completed", "tag": "357b9302-4bc7-4e44-8013-6ea636c939aa"}, {"server_uuid": "b81fb73f-c42a-4ace-b365-b3e2bfde3e6d", "name": "network-vif-plugged", "status": "completed", "tag": "825a4637-659c-406d-89ad-960fe09b0d4c"}, {"server_uuid": "7ded3792-3d26-4e1e-9e2c-3a94ef959c05", "name": "network-vif-unplugged", "status": "completed", "tag": "726dcb01-9a82-43bd-a9a0-866151f08df4"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:28.574233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-35dec2b3-5434-45c1-9121-691e2f345ba8 req-8cac3400-d8eb-482b-98ca-c3c9e8ff5665 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.575061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-35dec2b3-5434-45c1-9121-691e2f345ba8 req-8cac3400-d8eb-482b-98ca-c3c9e8ff5665 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.575718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-35dec2b3-5434-45c1-9121-691e2f345ba8 req-8cac3400-d8eb-482b-98ca-c3c9e8ff5665 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.594475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2b5bb793-f677-479c-a5c8-5800a8b01363 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:28.624711 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b5bb793-f677-479c-a5c8-5800a8b01363 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1324 microversion: 2.1 time: 0.573778 Oct 29 02:57:28.640591 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1433/2967] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:28 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1324 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:28.657566 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-35dec2b3-5434-45c1-9121-691e2f345ba8 req-8cac3400-d8eb-482b-98ca-c3c9e8ff5665 service nova] Creating event network-vif-plugged:357b9302-4bc7-4e44-8013-6ea636c939aa for instance cf06ee37-7622-4404-bfee-79b4e59a6f07 on n-h1-862964-4 Oct 29 02:57:28.661832 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-35dec2b3-5434-45c1-9121-691e2f345ba8 req-8cac3400-d8eb-482b-98ca-c3c9e8ff5665 service nova] Creating event network-vif-plugged:825a4637-659c-406d-89ad-960fe09b0d4c for instance b81fb73f-c42a-4ace-b365-b3e2bfde3e6d on n-h2-862964-4 Oct 29 02:57:28.663622 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-35dec2b3-5434-45c1-9121-691e2f345ba8 req-8cac3400-d8eb-482b-98ca-c3c9e8ff5665 service nova] Creating event network-vif-unplugged:726dcb01-9a82-43bd-a9a0-866151f08df4 for instance 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 on n-h2-862964-4 Oct 29 02:57:28.681081 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-35dec2b3-5434-45c1-9121-691e2f345ba8 req-8cac3400-d8eb-482b-98ca-c3c9e8ff5665 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.131424 Oct 29 02:57:28.696269 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1535/2968] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:57:28.936280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0ae71704-499b-47d0-a059-158f90a5346a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:28.937931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0ae71704-499b-47d0-a059-158f90a5346a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:28.950804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ae71704-499b-47d0-a059-158f90a5346a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.951766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ae71704-499b-47d0-a059-158f90a5346a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.953331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ae71704-499b-47d0-a059-158f90a5346a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.954305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ae71704-499b-47d0-a059-158f90a5346a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.960269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ae71704-499b-47d0-a059-158f90a5346a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.964990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ae71704-499b-47d0-a059-158f90a5346a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.982304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-df8ad9fc-cc32-4396-8d40-60ba45fadc46 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:28.984140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-df8ad9fc-cc32-4396-8d40-60ba45fadc46 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:29.009094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df8ad9fc-cc32-4396-8d40-60ba45fadc46 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.011057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df8ad9fc-cc32-4396-8d40-60ba45fadc46 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.012292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df8ad9fc-cc32-4396-8d40-60ba45fadc46 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.013313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df8ad9fc-cc32-4396-8d40-60ba45fadc46 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.015250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df8ad9fc-cc32-4396-8d40-60ba45fadc46 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.016856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df8ad9fc-cc32-4396-8d40-60ba45fadc46 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.480940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0ae71704-499b-47d0-a059-158f90a5346a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:29.494006 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0ae71704-499b-47d0-a059-158f90a5346a tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1316 microversion: 2.1 time: 0.575238 Oct 29 02:57:29.505836 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1434/2969] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:28 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1316 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:29.510781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e963f880-3aaa-43a5-bee8-18990c91997e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:29.511685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e963f880-3aaa-43a5-bee8-18990c91997e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:29.527448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e963f880-3aaa-43a5-bee8-18990c91997e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.528667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e963f880-3aaa-43a5-bee8-18990c91997e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.529289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e963f880-3aaa-43a5-bee8-18990c91997e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.530747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e963f880-3aaa-43a5-bee8-18990c91997e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.533140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e963f880-3aaa-43a5-bee8-18990c91997e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.533838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e963f880-3aaa-43a5-bee8-18990c91997e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.579688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-df8ad9fc-cc32-4396-8d40-60ba45fadc46 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:29.587669 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-df8ad9fc-cc32-4396-8d40-60ba45fadc46 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1314 microversion: 2.1 time: 0.611801 Oct 29 02:57:29.588263 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1536/2970] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:28 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:29.615211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b47583d0-a11b-48e6-bbd8-238142396396 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:29.615462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b47583d0-a11b-48e6-bbd8-238142396396 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:29.629489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b47583d0-a11b-48e6-bbd8-238142396396 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.631934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b47583d0-a11b-48e6-bbd8-238142396396 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.632573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b47583d0-a11b-48e6-bbd8-238142396396 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.636358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b47583d0-a11b-48e6-bbd8-238142396396 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.639823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b47583d0-a11b-48e6-bbd8-238142396396 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.640434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b47583d0-a11b-48e6-bbd8-238142396396 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.817586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b47583d0-a11b-48e6-bbd8-238142396396 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:29.830470 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b47583d0-a11b-48e6-bbd8-238142396396 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1273 microversion: 2.1 time: 0.222543 Oct 29 02:57:29.831373 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1537/2971] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:29 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:29.844408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e1e40a84-af82-4982-92e8-8ba9b1d3a5ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:29.845015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e1e40a84-af82-4982-92e8-8ba9b1d3a5ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:29.851160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1e40a84-af82-4982-92e8-8ba9b1d3a5ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.852515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1e40a84-af82-4982-92e8-8ba9b1d3a5ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.853170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1e40a84-af82-4982-92e8-8ba9b1d3a5ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.854198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1e40a84-af82-4982-92e8-8ba9b1d3a5ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.854431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e963f880-3aaa-43a5-bee8-18990c91997e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:29.855200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1e40a84-af82-4982-92e8-8ba9b1d3a5ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.855834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1e40a84-af82-4982-92e8-8ba9b1d3a5ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.871713 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e963f880-3aaa-43a5-bee8-18990c91997e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1492 microversion: 2.1 time: 0.369335 Oct 29 02:57:29.875574 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1435/2972] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:29 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1492 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:30.198517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e1e40a84-af82-4982-92e8-8ba9b1d3a5ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:30.208094 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e1e40a84-af82-4982-92e8-8ba9b1d3a5ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1324 microversion: 2.1 time: 0.375668 Oct 29 02:57:30.218917 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1538/2973] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:29 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:30.383148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-290bdedc-a756-4d0c-ab4b-4b5f408674ba req-dd16ce93-9233-4018-b6a8-8d31be13899d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f2304c2-394d-4a8c-bae0-dc41bcd00d60", "tag": "8b369caa-616a-4f1f-9461-78559ca7296c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:30.401738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-290bdedc-a756-4d0c-ab4b-4b5f408674ba req-dd16ce93-9233-4018-b6a8-8d31be13899d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:30.418330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-290bdedc-a756-4d0c-ab4b-4b5f408674ba req-dd16ce93-9233-4018-b6a8-8d31be13899d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:30.419727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-290bdedc-a756-4d0c-ab4b-4b5f408674ba req-dd16ce93-9233-4018-b6a8-8d31be13899d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:30.446823 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-290bdedc-a756-4d0c-ab4b-4b5f408674ba req-dd16ce93-9233-4018-b6a8-8d31be13899d service nova] Creating event network-changed:8b369caa-616a-4f1f-9461-78559ca7296c for instance 8f2304c2-394d-4a8c-bae0-dc41bcd00d60 on n-h1-862964-4 Oct 29 02:57:30.469226 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-290bdedc-a756-4d0c-ab4b-4b5f408674ba req-dd16ce93-9233-4018-b6a8-8d31be13899d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090245 Oct 29 02:57:30.470368 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1436/2974] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:30.520754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-71d47ffe-071c-4fb2-96b4-7781357d541b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:30.521442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-71d47ffe-071c-4fb2-96b4-7781357d541b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:30.556514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71d47ffe-071c-4fb2-96b4-7781357d541b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:30.566350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71d47ffe-071c-4fb2-96b4-7781357d541b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:30.567069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71d47ffe-071c-4fb2-96b4-7781357d541b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:30.568257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71d47ffe-071c-4fb2-96b4-7781357d541b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:30.568899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71d47ffe-071c-4fb2-96b4-7781357d541b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:30.570292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71d47ffe-071c-4fb2-96b4-7781357d541b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:30.618300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-05ae13db-eda8-49fe-9d0b-7efc16436fb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:30.618667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-05ae13db-eda8-49fe-9d0b-7efc16436fb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:30.661181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05ae13db-eda8-49fe-9d0b-7efc16436fb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:30.661687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05ae13db-eda8-49fe-9d0b-7efc16436fb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:30.668012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05ae13db-eda8-49fe-9d0b-7efc16436fb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:30.669105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05ae13db-eda8-49fe-9d0b-7efc16436fb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:30.669775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05ae13db-eda8-49fe-9d0b-7efc16436fb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:30.671566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05ae13db-eda8-49fe-9d0b-7efc16436fb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.036094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05ae13db-eda8-49fe-9d0b-7efc16436fb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:31.044816 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-05ae13db-eda8-49fe-9d0b-7efc16436fb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1314 microversion: 2.1 time: 0.433033 Oct 29 02:57:31.058740 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1437/2975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:30 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:31.061707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-71d47ffe-071c-4fb2-96b4-7781357d541b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:31.066827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-38cae319-380e-4e7d-a246-5285b4d4410b req-139e24e7-c99b-4d5e-818c-84b5e70fdb63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ded3792-3d26-4e1e-9e2c-3a94ef959c05", "name": "network-vif-deleted", "tag": "726dcb01-9a82-43bd-a9a0-866151f08df4"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:31.081668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-38cae319-380e-4e7d-a246-5285b4d4410b req-139e24e7-c99b-4d5e-818c-84b5e70fdb63 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.082444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-38cae319-380e-4e7d-a246-5285b4d4410b req-139e24e7-c99b-4d5e-818c-84b5e70fdb63 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.083036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-38cae319-380e-4e7d-a246-5285b4d4410b req-139e24e7-c99b-4d5e-818c-84b5e70fdb63 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.096458 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-71d47ffe-071c-4fb2-96b4-7781357d541b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1503 microversion: 2.1 time: 0.579641 Oct 29 02:57:31.098616 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-38cae319-380e-4e7d-a246-5285b4d4410b req-139e24e7-c99b-4d5e-818c-84b5e70fdb63 service nova] Creating event network-vif-deleted:726dcb01-9a82-43bd-a9a0-866151f08df4 for instance 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 on n-h2-862964-4 Oct 29 02:57:31.104124 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-38cae319-380e-4e7d-a246-5285b4d4410b req-139e24e7-c99b-4d5e-818c-84b5e70fdb63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043787 Oct 29 02:57:31.105165 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1438/2976] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:31.111008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-81fa23bd-696c-4f17-9d1a-f4fde0e89b9e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:31.111255 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1539/2977] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:30 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1503 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:31.111963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-81fa23bd-696c-4f17-9d1a-f4fde0e89b9e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:31.120253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fa23bd-696c-4f17-9d1a-f4fde0e89b9e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.120986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fa23bd-696c-4f17-9d1a-f4fde0e89b9e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.121874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fa23bd-696c-4f17-9d1a-f4fde0e89b9e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.122744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fa23bd-696c-4f17-9d1a-f4fde0e89b9e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.123504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fa23bd-696c-4f17-9d1a-f4fde0e89b9e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.124084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81fa23bd-696c-4f17-9d1a-f4fde0e89b9e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.137716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:31.138970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:31.157303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.158177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.159074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.161049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.162606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.166241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.252333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.253742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.254335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.254884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lazy-loading 'fault' on Instance uuid 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:57:31.350457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0868f50723074f2b98f7b1096743f3cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d1a1bd5d9d434a8a5e8f94d564515f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:31.366597 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3b426805-7e87-43f9-bbcc-70aa4f335bae tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 200 len: 1297 microversion: 2.1 time: 0.251199 Oct 29 02:57:31.370195 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1540/2978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:31 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 1297 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:31.376861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-32095785-c068-4301-a808-023577bcb925 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-242420721"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:31.378742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-32095785-c068-4301-a808-023577bcb925 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:31.386833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32095785-c068-4301-a808-023577bcb925 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.387770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32095785-c068-4301-a808-023577bcb925 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.388449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32095785-c068-4301-a808-023577bcb925 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.389881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32095785-c068-4301-a808-023577bcb925 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.390816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32095785-c068-4301-a808-023577bcb925 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.391834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32095785-c068-4301-a808-023577bcb925 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.434388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-81fa23bd-696c-4f17-9d1a-f4fde0e89b9e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:31.460647 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-81fa23bd-696c-4f17-9d1a-f4fde0e89b9e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1315 microversion: 2.1 time: 0.349969 Oct 29 02:57:31.462459 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1439/2979] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:31 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:31.470457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-55f52daa-f46b-4f88-a5d2-23c2d8ddf819 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:31.471485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-55f52daa-f46b-4f88-a5d2-23c2d8ddf819 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:31.481270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55f52daa-f46b-4f88-a5d2-23c2d8ddf819 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.483334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55f52daa-f46b-4f88-a5d2-23c2d8ddf819 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.490312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55f52daa-f46b-4f88-a5d2-23c2d8ddf819 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.492855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55f52daa-f46b-4f88-a5d2-23c2d8ddf819 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.495904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55f52daa-f46b-4f88-a5d2-23c2d8ddf819 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.500054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55f52daa-f46b-4f88-a5d2-23c2d8ddf819 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.884330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-55f52daa-f46b-4f88-a5d2-23c2d8ddf819 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:31.910056 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-55f52daa-f46b-4f88-a5d2-23c2d8ddf819 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1518 microversion: 2.1 time: 0.444562 Oct 29 02:57:31.910666 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1440/2980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:31 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1518 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:32.058029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-794ab600-858c-40a7-ada5-2e19b6b26a82 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1046970007", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "708a1e54-a0bf-4ed4-870f-05dc20a644af"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-794ab600-858c-40a7-ada5-2e19b6b26a82 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Request method failure captured: Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 243 Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJaIm_89J1tLdqFILsJqgxKsQft4mbIClnHc5QlzSHN9mOqgVbvKwtZYGLlQs2te1xnu_jhN3MHIpFzTgiaz-gxuAu66S-dHK-T3BjuT9C3qkCfa23l6_9bbzfQTcOHrlBO0U9Dy4d0ueojKVLUntQ0_pFHrdG-ZSNHqyRyENaxqpZ0 Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_523c0a96752940ca9416402d8180b1bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}] Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: be3a530b7ca34f6b9e84e3e7ece9fcff Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1046970007", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "708a1e54-a0bf-4ed4-870f-05dc20a644af"}]}} Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1046970007', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '708a1e54-a0bf-4ed4-870f-05dc20a644af'}]}}} Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:32.065125 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-794ab600-858c-40a7-ada5-2e19b6b26a82 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:32.069438 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-794ab600-858c-40a7-ada5-2e19b6b26a82 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.015406 Oct 29 02:57:32.072193 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1441/2981] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:32 2022] POST /compute/v2.1/servers => generated 175 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:57:32.086293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-890da778-78d7-4dcb-9715-a1a842ccc547 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:32.090731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-890da778-78d7-4dcb-9715-a1a842ccc547 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:32.108524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890da778-78d7-4dcb-9715-a1a842ccc547 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.111764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890da778-78d7-4dcb-9715-a1a842ccc547 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.112450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890da778-78d7-4dcb-9715-a1a842ccc547 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.115660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890da778-78d7-4dcb-9715-a1a842ccc547 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.116428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890da778-78d7-4dcb-9715-a1a842ccc547 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.117972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890da778-78d7-4dcb-9715-a1a842ccc547 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.319750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-890da778-78d7-4dcb-9715-a1a842ccc547 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:32.328338 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-890da778-78d7-4dcb-9715-a1a842ccc547 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1314 microversion: 2.1 time: 0.254869 Oct 29 02:57:32.329088 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1442/2982] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:32 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:32.337605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bfe37c19-a5a0-4084-ba84-8a03789e1b61 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:32.338303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bfe37c19-a5a0-4084-ba84-8a03789e1b61 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: d20e7350-e557-497a-9abb-39fef5a095e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:32.345171 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-bfe37c19-a5a0-4084-ba84-8a03789e1b61 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] HTTP exception thrown: Instance d20e7350-e557-497a-9abb-39fef5a095e2 could not be found. Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bfe37c19-a5a0-4084-ba84-8a03789e1b61 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Request method failure captured: Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/d20e7350-e557-497a-9abb-39fef5a095e2/metadata HTTP/1.1 Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJaIm_89J1tLdqFILsJqgxKsQft4mbIClnHc5QlzSHN9mOqgVbvKwtZYGLlQs2te1xnu_jhN3MHIpFzTgiaz-gxuAu66S-dHK-T3BjuT9C3qkCfa23l6_9bbzfQTcOHrlBO0U9Dy4d0ueojKVLUntQ0_pFHrdG-ZSNHqyRyENaxqpZ0 Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_523c0a96752940ca9416402d8180b1bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}] Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: be3a530b7ca34f6b9e84e3e7ece9fcff Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance d20e7350-e557-497a-9abb-39fef5a095e2 could not be found. Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': 'd20e7350-e557-497a-9abb-39fef5a095e2'} Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d20e7350-e557-497a-9abb-39fef5a095e2 could not be found. Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d20e7350-e557-497a-9abb-39fef5a095e2 could not be found. Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.355482 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.370436 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:32.370436 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:32.370436 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d20e7350-e557-497a-9abb-39fef5a095e2 could not be found. Oct 29 02:57:32.370436 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.370436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bfe37c19-a5a0-4084-ba84-8a03789e1b61 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Returning 404 to user: Instance d20e7350-e557-497a-9abb-39fef5a095e2 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:32.370436 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bfe37c19-a5a0-4084-ba84-8a03789e1b61 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/d20e7350-e557-497a-9abb-39fef5a095e2/metadata" status: 404 len: 111 microversion: 2.1 time: 0.026588 Oct 29 02:57:32.370436 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1443/2983] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 02:57:32 2022] GET /compute/v2.1/servers/d20e7350-e557-497a-9abb-39fef5a095e2/metadata => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:32.376454 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.network.security_group_api [None req-32095785-c068-4301-a808-023577bcb925 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Adding security group 8faae7dd-fbaf-4085-b967-3c5356fea5aa to port 357b9302-4bc7-4e44-8013-6ea636c939aa Oct 29 02:57:32.406919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:32.407886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 7ded3792-3d26-4e1e-9e2c-3a94ef959c05] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:32.422435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.426400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.427429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.428979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.429848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.430691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.449588 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 could not be found. Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 HTTP/1.1 Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 could not be found. Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '7ded3792-3d26-4e1e-9e2c-3a94ef959c05'} Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 could not be found. Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 could not be found. Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.456569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.461670 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.461670 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.461670 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:32.461670 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:32.461670 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 could not be found. Oct 29 02:57:32.461670 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.466287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance 7ded3792-3d26-4e1e-9e2c-3a94ef959c05 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:32.468396 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4125a50f-4095-4658-9e41-f99c90e383ef tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05" status: 404 len: 111 microversion: 2.1 time: 0.073841 Oct 29 02:57:32.472856 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1444/2984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:32 2022] GET /compute/v2.1/servers/7ded3792-3d26-4e1e-9e2c-3a94ef959c05 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:32.478739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c0730fc-56e6-4a95-aead-56a86eb0f6cc tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1351357353", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "708a1e54-a0bf-4ed4-870f-05dc20a644af"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c0730fc-56e6-4a95-aead-56a86eb0f6cc tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Request method failure captured: Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 499 Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJaIm_89J1tLdqFILsJqgxKsQft4mbIClnHc5QlzSHN9mOqgVbvKwtZYGLlQs2te1xnu_jhN3MHIpFzTgiaz-gxuAu66S-dHK-T3BjuT9C3qkCfa23l6_9bbzfQTcOHrlBO0U9Dy4d0ueojKVLUntQ0_pFHrdG-ZSNHqyRyENaxqpZ0 Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_523c0a96752940ca9416402d8180b1bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}] Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: be3a530b7ca34f6b9e84e3e7ece9fcff Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1351357353", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "708a1e54-a0bf-4ed4-870f-05dc20a644af"}]}} Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1351357353', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '708a1e54-a0bf-4ed4-870f-05dc20a644af'}]}}} Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:57:32.483770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.486770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.490441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c0730fc-56e6-4a95-aead-56a86eb0f6cc tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:32.491523 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0c0730fc-56e6-4a95-aead-56a86eb0f6cc tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.016971 Oct 29 02:57:32.492593 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1445/2985] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:32 2022] POST /compute/v2.1/servers => generated 687 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:32.507278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:32.508677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:32.528829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.529143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.529576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.530302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.530752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.531915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.566539 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 HTTP/1.1 Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'a3ed9c7b-73e9-4268-af26-ff629c7e4ff4'} Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:32.568778 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-45fcc882-0a40-41e6-8f0f-aa9724d3fa73 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 404 len: 111 microversion: 2.1 time: 0.078603 Oct 29 02:57:32.577056 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1446/2986] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:32 2022] DELETE /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:32.585115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-27587f17-e014-46f7-87c0-d888fe715a07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:32.586570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-27587f17-e014-46f7-87c0-d888fe715a07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:32.603543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27587f17-e014-46f7-87c0-d888fe715a07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.604485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27587f17-e014-46f7-87c0-d888fe715a07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.605450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27587f17-e014-46f7-87c0-d888fe715a07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.606218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27587f17-e014-46f7-87c0-d888fe715a07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.606675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27587f17-e014-46f7-87c0-d888fe715a07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.607104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27587f17-e014-46f7-87c0-d888fe715a07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.840611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-27587f17-e014-46f7-87c0-d888fe715a07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:32.851060 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-27587f17-e014-46f7-87c0-d888fe715a07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1315 microversion: 2.1 time: 0.277005 Oct 29 02:57:32.867487 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1447/2987] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:32 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:32.876025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d9e81333-939b-4332-b09a-54c43dcb3469 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1150485744", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "708a1e54-a0bf-4ed4-870f-05dc20a644af"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d9e81333-939b-4332-b09a-54c43dcb3469 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Request method failure captured: Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 500 Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJaIm_89J1tLdqFILsJqgxKsQft4mbIClnHc5QlzSHN9mOqgVbvKwtZYGLlQs2te1xnu_jhN3MHIpFzTgiaz-gxuAu66S-dHK-T3BjuT9C3qkCfa23l6_9bbzfQTcOHrlBO0U9Dy4d0ueojKVLUntQ0_pFHrdG-ZSNHqyRyENaxqpZ0 Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_523c0a96752940ca9416402d8180b1bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}] Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: be3a530b7ca34f6b9e84e3e7ece9fcff Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1150485744", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "708a1e54-a0bf-4ed4-870f-05dc20a644af"}]}} Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1150485744', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '708a1e54-a0bf-4ed4-870f-05dc20a644af'}]}}} Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:57:32.882513 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.885502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.891321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d9e81333-939b-4332-b09a-54c43dcb3469 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:32.894170 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d9e81333-939b-4332-b09a-54c43dcb3469 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.024336 Oct 29 02:57:32.905437 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1448/2988] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:32 2022] POST /compute/v2.1/servers => generated 689 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:32.911396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:32.912227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: a3ed9c7b-73e9-4268-af26-ff629c7e4ff4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:32.922964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.923449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.924071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.925231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.925951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.926692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.952393 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 HTTP/1.1 Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'a3ed9c7b-73e9-4268-af26-ff629c7e4ff4'} Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.953968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.957885 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.957885 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.957885 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:32.957885 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:32.957885 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. Oct 29 02:57:32.957885 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.959452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:32.970497 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a287b618-65bb-4bad-9853-61630f179901 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4" status: 404 len: 111 microversion: 2.1 time: 0.053275 Oct 29 02:57:32.972040 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1449/2989] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:32 2022] GET /compute/v2.1/servers/a3ed9c7b-73e9-4268-af26-ff629c7e4ff4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:32.977343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3461f814-2256-4124-a0f3-5068d890f4cd tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-824252442", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "708a1e54-a0bf-4ed4-870f-05dc20a644af"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3461f814-2256-4124-a0f3-5068d890f4cd tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Request method failure captured: Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 753 Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJaIm_89J1tLdqFILsJqgxKsQft4mbIClnHc5QlzSHN9mOqgVbvKwtZYGLlQs2te1xnu_jhN3MHIpFzTgiaz-gxuAu66S-dHK-T3BjuT9C3qkCfa23l6_9bbzfQTcOHrlBO0U9Dy4d0ueojKVLUntQ0_pFHrdG-ZSNHqyRyENaxqpZ0 Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_523c0a96752940ca9416402d8180b1bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}] Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: be3a530b7ca34f6b9e84e3e7ece9fcff Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-824252442", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "708a1e54-a0bf-4ed4-870f-05dc20a644af"}]}} Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-824252442', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '708a1e54-a0bf-4ed4-870f-05dc20a644af'}]}}} Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:32.982400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:32.984927 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:32.988297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:32.988297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.988297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3461f814-2256-4124-a0f3-5068d890f4cd tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:32.988297 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3461f814-2256-4124-a0f3-5068d890f4cd tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.010878 Oct 29 02:57:32.988297 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1450/2990] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:32 2022] POST /compute/v2.1/servers => generated 1197 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 29 02:57:33.000089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a610eb71-d54c-4e99-b60c-7d22276756bd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8a10f70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.037296 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a610eb71-d54c-4e99-b60c-7d22276756bd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Image not found. Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a610eb71-d54c-4e99-b60c-7d22276756bd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea HTTP/1.1 Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c018922f-06ce-4979-8b41-5528024e3eea'} Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c018922f-06ce-4979-8b41-5528024e3eea to delete Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c018922f-06ce-4979-8b41-5528024e3eea could not be found. Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.040566 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a610eb71-d54c-4e99-b60c-7d22276756bd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a610eb71-d54c-4e99-b60c-7d22276756bd tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea" status: 404 len: 62 microversion: 2.1 time: 0.056300 Oct 29 02:57:33.045040 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1451/2991] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:32 2022] DELETE /compute/v2.1/images/c018922f-06ce-4979-8b41-5528024e3eea => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:57:33.059756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.060256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.076203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.076706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.077141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.081048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.081910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.082358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.136831 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d HTTP/1.1 Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d'} Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:33.138611 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-51ab3021-4e25-42d6-b9e6-cfa8c89bced9 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 404 len: 111 microversion: 2.1 time: 0.092076 Oct 29 02:57:33.142394 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1452/2992] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:33 2022] DELETE /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:33.145646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d1b4b42-bcf2-45e1-99cc-7188bcb88852 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-746187824", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "708a1e54-a0bf-4ed4-870f-05dc20a644af"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d1b4b42-bcf2-45e1-99cc-7188bcb88852 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Request method failure captured: Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 1265 Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJaIm_89J1tLdqFILsJqgxKsQft4mbIClnHc5QlzSHN9mOqgVbvKwtZYGLlQs2te1xnu_jhN3MHIpFzTgiaz-gxuAu66S-dHK-T3BjuT9C3qkCfa23l6_9bbzfQTcOHrlBO0U9Dy4d0ueojKVLUntQ0_pFHrdG-ZSNHqyRyENaxqpZ0 Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_523c0a96752940ca9416402d8180b1bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}] Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: be3a530b7ca34f6b9e84e3e7ece9fcff Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-746187824", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "708a1e54-a0bf-4ed4-870f-05dc20a644af"}]}} Oct 29 02:57:33.153205 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-746187824', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '708a1e54-a0bf-4ed4-870f-05dc20a644af'}]}}} Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.155397 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:33.156443 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:33.163126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:57:33.163126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.163126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d1b4b42-bcf2-45e1-99cc-7188bcb88852 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:33.163126 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9d1b4b42-bcf2-45e1-99cc-7188bcb88852 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.014581 Oct 29 02:57:33.163126 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1453/2993] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Oct 29 02:57:33 2022] POST /compute/v2.1/servers => generated 2221 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 29 02:57:33.163126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ee899145-94a5-4f4b-959b-71d0ff6a3a6b req-bea7be56-0f9d-4cc8-9b9d-07cc56497712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a570891-4387-4f63-a59a-aa60fe7360db", "tag": "96a84e8f-b1fc-4584-a5f1-6409732df05f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:33.176237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ee899145-94a5-4f4b-959b-71d0ff6a3a6b req-bea7be56-0f9d-4cc8-9b9d-07cc56497712 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.176723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ee899145-94a5-4f4b-959b-71d0ff6a3a6b req-bea7be56-0f9d-4cc8-9b9d-07cc56497712 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.177157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ee899145-94a5-4f4b-959b-71d0ff6a3a6b req-bea7be56-0f9d-4cc8-9b9d-07cc56497712 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.193180 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ee899145-94a5-4f4b-959b-71d0ff6a3a6b req-bea7be56-0f9d-4cc8-9b9d-07cc56497712 service nova] Creating event network-changed:96a84e8f-b1fc-4584-a5f1-6409732df05f for instance 3a570891-4387-4f63-a59a-aa60fe7360db on n-h1-862964-4 Oct 29 02:57:33.198390 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ee899145-94a5-4f4b-959b-71d0ff6a3a6b req-bea7be56-0f9d-4cc8-9b9d-07cc56497712 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039923 Oct 29 02:57:33.199162 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1454/2994] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:33.205230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.205979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.212634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.213621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.214251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.215169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.215876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.216541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.240867 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d HTTP/1.1 Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d'} Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.243288 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.248065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.248065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.248065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:33.248065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:33.248065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. Oct 29 02:57:33.248065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.250582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance 2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:33.251692 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3b4d41f4-837f-4cd6-b302-8a3ed139b637 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d" status: 404 len: 111 microversion: 2.1 time: 0.051243 Oct 29 02:57:33.252771 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1455/2995] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:33 2022] GET /compute/v2.1/servers/2cd0b7c0-a9aa-4348-b0bc-a16a77cc0a8d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:33.258729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-30859895-ea84-4239-94f5-3e372a3adfa5 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.259626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-30859895-ea84-4239-94f5-3e372a3adfa5 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: 895810a7-042b-4193-bd6e-c1f232cc02e9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.267753 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-30859895-ea84-4239-94f5-3e372a3adfa5 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] HTTP exception thrown: Instance 895810a7-042b-4193-bd6e-c1f232cc02e9 could not be found. Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-30859895-ea84-4239-94f5-3e372a3adfa5 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Request method failure captured: Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/895810a7-042b-4193-bd6e-c1f232cc02e9/metadata/test2 HTTP/1.1 Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJaIm_89J1tLdqFILsJqgxKsQft4mbIClnHc5QlzSHN9mOqgVbvKwtZYGLlQs2te1xnu_jhN3MHIpFzTgiaz-gxuAu66S-dHK-T3BjuT9C3qkCfa23l6_9bbzfQTcOHrlBO0U9Dy4d0ueojKVLUntQ0_pFHrdG-ZSNHqyRyENaxqpZ0 Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_523c0a96752940ca9416402d8180b1bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}] Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: be3a530b7ca34f6b9e84e3e7ece9fcff Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 895810a7-042b-4193-bd6e-c1f232cc02e9 could not be found. Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': '895810a7-042b-4193-bd6e-c1f232cc02e9', 'id': 'test2'} Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 895810a7-042b-4193-bd6e-c1f232cc02e9 could not be found. Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 895810a7-042b-4193-bd6e-c1f232cc02e9 could not be found. Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.270110 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.274846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:33.274846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:33.274846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 895810a7-042b-4193-bd6e-c1f232cc02e9 could not be found. Oct 29 02:57:33.274846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.276345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-30859895-ea84-4239-94f5-3e372a3adfa5 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Returning 404 to user: Instance 895810a7-042b-4193-bd6e-c1f232cc02e9 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:33.277891 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-30859895-ea84-4239-94f5-3e372a3adfa5 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/895810a7-042b-4193-bd6e-c1f232cc02e9/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.023797 Oct 29 02:57:33.278625 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1456/2996] 10.222.0.16 () {58 vars in 1281 bytes} [Sat Oct 29 02:57:33 2022] GET /compute/v2.1/servers/895810a7-042b-4193-bd6e-c1f232cc02e9/metadata/test2 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:33.304696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-72f7582b-3b04-4e7f-8a41-37c59b221848 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a8864310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.330060 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-72f7582b-3b04-4e7f-8a41-37c59b221848 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Image not found. Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-72f7582b-3b04-4e7f-8a41-37c59b221848 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 HTTP/1.1 Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '22a2d0f4-ce89-44c8-bc91-b0a32884abe7'} Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 22a2d0f4-ce89-44c8-bc91-b0a32884abe7 to delete Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22a2d0f4-ce89-44c8-bc91-b0a32884abe7 could not be found. Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.332842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-72f7582b-3b04-4e7f-8a41-37c59b221848 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:33.336697 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-72f7582b-3b04-4e7f-8a41-37c59b221848 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7" status: 404 len: 62 microversion: 2.1 time: 0.054560 Oct 29 02:57:33.343867 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1457/2997] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:33 2022] DELETE /compute/v2.1/images/22a2d0f4-ce89-44c8-bc91-b0a32884abe7 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:57:33.343867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-784e5a73-210e-43ca-aa41-6f571938811f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.344446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-784e5a73-210e-43ca-aa41-6f571938811f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.353387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-784e5a73-210e-43ca-aa41-6f571938811f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.353387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-784e5a73-210e-43ca-aa41-6f571938811f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.353387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-784e5a73-210e-43ca-aa41-6f571938811f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.354628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-784e5a73-210e-43ca-aa41-6f571938811f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.355231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-784e5a73-210e-43ca-aa41-6f571938811f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.355755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-784e5a73-210e-43ca-aa41-6f571938811f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.367628 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-32095785-c068-4301-a808-023577bcb925 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07/action" status: 202 len: 0 microversion: 2.1 time: 1.995958 Oct 29 02:57:33.368444 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1541/2998] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:31 2022] POST /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07/action => generated 0 bytes in 1997 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:33.374097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.374831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.384791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-784e5a73-210e-43ca-aa41-6f571938811f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:57:33.395648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.396879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.397515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.398566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.399256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.399860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.455125 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 HTTP/1.1 Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '26e07792-807a-44e9-b644-72504509f2f5'} Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:33.457994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. Oct 29 02:57:33.461613 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.461613 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.461613 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.461613 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.461613 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.461613 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.461613 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:33.461613 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:33.461613 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. Oct 29 02:57:33.461613 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.464680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:33.467466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:33.470058 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6cbded0f-6a2d-43b9-b43a-2dd78cce0e22 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 404 len: 111 microversion: 2.1 time: 0.100100 Oct 29 02:57:33.476304 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1542/2999] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:33 2022] DELETE /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:33.489127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9697de5-f279-4802-a059-897abbabb331 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.490217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f9697de5-f279-4802-a059-897abbabb331 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.507830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9697de5-f279-4802-a059-897abbabb331 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.509101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9697de5-f279-4802-a059-897abbabb331 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.510573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9697de5-f279-4802-a059-897abbabb331 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.512368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9697de5-f279-4802-a059-897abbabb331 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.513948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9697de5-f279-4802-a059-897abbabb331 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.514617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9697de5-f279-4802-a059-897abbabb331 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.538310 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-784e5a73-210e-43ca-aa41-6f571938811f tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 204 len: 0 microversion: 2.1 time: 0.197837 Oct 29 02:57:33.541278 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1458/3000] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:33 2022] DELETE /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:57:33.578383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-424ff9be-fc28-4348-a5ac-9862b206e68e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a8bc3d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.774701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG neutronclient.v2_0.client [None req-424ff9be-fc28-4348-a5ac-9862b206e68e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8faae7dd-fbaf-4085-b967-3c5356fea5aa in use.", "detail": ""}} {{(pid=127042) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:57:33.775513 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-424ff9be-fc28-4348-a5ac-9862b206e68e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security Group 8faae7dd-fbaf-4085-b967-3c5356fea5aa in use. Oct 29 02:57:33.775513 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-b79be670-8abf-4301-a825-f43ea579bddf'] Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-424ff9be-fc28-4348-a5ac-9862b206e68e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-security-groups/8faae7dd-fbaf-4085-b967-3c5356fea5aa HTTP/1.1 Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: exception: Security Group 8faae7dd-fbaf-4085-b967-3c5356fea5aa in use. Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-b79be670-8abf-4301-a825-f43ea579bddf'] Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '8faae7dd-fbaf-4085-b967-3c5356fea5aa'} Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:57:33.777702 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 8faae7dd-fbaf-4085-b967-3c5356fea5aa in use. Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b79be670-8abf-4301-a825-f43ea579bddf'] Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 8faae7dd-fbaf-4085-b967-3c5356fea5aa in use. Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b79be670-8abf-4301-a825-f43ea579bddf'] Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 8faae7dd-fbaf-4085-b967-3c5356fea5aa in use. Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b79be670-8abf-4301-a825-f43ea579bddf'] Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 8faae7dd-fbaf-4085-b967-3c5356fea5aa in use. Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b79be670-8abf-4301-a825-f43ea579bddf'] Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-424ff9be-fc28-4348-a5ac-9862b206e68e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 400 to user: Security Group 8faae7dd-fbaf-4085-b967-3c5356fea5aa in use. Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-b79be670-8abf-4301-a825-f43ea579bddf'] {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-424ff9be-fc28-4348-a5ac-9862b206e68e tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8faae7dd-fbaf-4085-b967-3c5356fea5aa" status: 400 len: 185 microversion: 2.1 time: 0.227535 Oct 29 02:57:33.781623 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1459/3001] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:57:33 2022] DELETE /compute/v2.1/os-security-groups/8faae7dd-fbaf-4085-b967-3c5356fea5aa => generated 185 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:33.790163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.803513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 26e07792-807a-44e9-b644-72504509f2f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.821845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.826872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.831021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.832247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.833176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.833940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.875775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 HTTP/1.1 Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '26e07792-807a-44e9-b644-72504509f2f5'} Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.881368 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.885682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.885682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.885682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:33.885682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:33.885682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. Oct 29 02:57:33.885682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.887363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance 26e07792-807a-44e9-b644-72504509f2f5 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:33.888436 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-41367b37-fcd1-4b9c-893f-d04b73748f0e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5" status: 404 len: 111 microversion: 2.1 time: 0.106941 Oct 29 02:57:33.889232 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1460/3002] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:33 2022] GET /compute/v2.1/servers/26e07792-807a-44e9-b644-72504509f2f5 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:33.894105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-22aa94f7-1f9f-4157-8c46-79f2814579ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.895001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-22aa94f7-1f9f-4157-8c46-79f2814579ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.902544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22aa94f7-1f9f-4157-8c46-79f2814579ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.903372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22aa94f7-1f9f-4157-8c46-79f2814579ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.904021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22aa94f7-1f9f-4157-8c46-79f2814579ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.904985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22aa94f7-1f9f-4157-8c46-79f2814579ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.905645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22aa94f7-1f9f-4157-8c46-79f2814579ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.906314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22aa94f7-1f9f-4157-8c46-79f2814579ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.917500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f9697de5-f279-4802-a059-897abbabb331 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:33.930971 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f9697de5-f279-4802-a059-897abbabb331 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1314 microversion: 2.1 time: 0.448346 Oct 29 02:57:33.934836 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1543/3003] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:33 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:33.947999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2182e93f-7c06-4247-b003-5f2a578f287c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:33.960578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2182e93f-7c06-4247-b003-5f2a578f287c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.972047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2182e93f-7c06-4247-b003-5f2a578f287c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.977897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2182e93f-7c06-4247-b003-5f2a578f287c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.978516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2182e93f-7c06-4247-b003-5f2a578f287c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.980331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2182e93f-7c06-4247-b003-5f2a578f287c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.983076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2182e93f-7c06-4247-b003-5f2a578f287c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.984079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2182e93f-7c06-4247-b003-5f2a578f287c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.116713 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2182e93f-7c06-4247-b003-5f2a578f287c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07/action" status: 202 len: 0 microversion: 2.1 time: 0.177603 Oct 29 02:57:34.117374 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1544/3004] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:33 2022] POST /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:34.128088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4536aed5-8f99-4991-942e-d462ca68558e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.129050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4536aed5-8f99-4991-942e-d462ca68558e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.146931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4536aed5-8f99-4991-942e-d462ca68558e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.148104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4536aed5-8f99-4991-942e-d462ca68558e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.149947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4536aed5-8f99-4991-942e-d462ca68558e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.152109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4536aed5-8f99-4991-942e-d462ca68558e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.154193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4536aed5-8f99-4991-942e-d462ca68558e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.154853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4536aed5-8f99-4991-942e-d462ca68558e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.156984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-22aa94f7-1f9f-4157-8c46-79f2814579ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:34.167116 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-22aa94f7-1f9f-4157-8c46-79f2814579ed tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1524 microversion: 2.1 time: 0.276537 Oct 29 02:57:34.183144 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1461/3005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:33 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1524 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:34.198480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db482357-8cad-4405-a1ad-088bced10199 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a87d15e0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.215955 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-db482357-8cad-4405-a1ad-088bced10199 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Image not found. Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db482357-8cad-4405-a1ad-088bced10199 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f HTTP/1.1 Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: exception: Image not found. Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '13878a47-5a8c-4b28-af33-0f3f6a94469f'} Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 13878a47-5a8c-4b28-af33-0f3f6a94469f to delete Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 13878a47-5a8c-4b28-af33-0f3f6a94469f could not be found. Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.217846 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db482357-8cad-4405-a1ad-088bced10199 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Image not found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-db482357-8cad-4405-a1ad-088bced10199 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f" status: 404 len: 62 microversion: 2.1 time: 0.035810 Oct 29 02:57:34.222653 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1462/3006] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:34 2022] DELETE /compute/v2.1/images/13878a47-5a8c-4b28-af33-0f3f6a94469f => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:57:34.226925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-abaaa910-17c3-4574-b677-1439869c6956 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.227532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-abaaa910-17c3-4574-b677-1439869c6956 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.238278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abaaa910-17c3-4574-b677-1439869c6956 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.238918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abaaa910-17c3-4574-b677-1439869c6956 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.239459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abaaa910-17c3-4574-b677-1439869c6956 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.240269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abaaa910-17c3-4574-b677-1439869c6956 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.240791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abaaa910-17c3-4574-b677-1439869c6956 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.241316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abaaa910-17c3-4574-b677-1439869c6956 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.411837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4536aed5-8f99-4991-942e-d462ca68558e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:34.421652 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4536aed5-8f99-4991-942e-d462ca68558e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1315 microversion: 2.1 time: 0.301889 Oct 29 02:57:34.423261 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1545/3007] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:34 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:34.428770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.429605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.436261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.437223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.437880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.438684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.439236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.439759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.454774 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 HTTP/1.1 Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48'} Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:34.456881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. Oct 29 02:57:34.460643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.460643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.460643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.460643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.460643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.460643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.460643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:34.460643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:34.460643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. Oct 29 02:57:34.460643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.463163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:34.464341 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d19e85f9-3128-4b53-82f8-62621f5a75a7 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 404 len: 111 microversion: 2.1 time: 0.039835 Oct 29 02:57:34.468640 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1546/3008] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:34 2022] DELETE /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:34.475014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.476485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.483245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.484346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.484950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.486029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.486633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.487347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.503916 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 HTTP/1.1 Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48'} Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.505495 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.513044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.513044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.513044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:34.513044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:34.513044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. Oct 29 02:57:34.513044 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.513044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance 0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:34.513044 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a73648d1-ef9d-4a52-975f-c25c3140c4b8 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48" status: 404 len: 111 microversion: 2.1 time: 0.037056 Oct 29 02:57:34.513044 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1547/3009] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:34 2022] GET /compute/v2.1/servers/0d78e62d-a7c7-4ed5-97c7-a1a0c19ecc48 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:34.518929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be08e5c6-6751-4e83-916c-44a66722df06 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '.version_select at 0x7fe1a3ec65e0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.531495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-abaaa910-17c3-4574-b677-1439869c6956 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:34.539422 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-abaaa910-17c3-4574-b677-1439869c6956 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1573 microversion: 2.1 time: 0.317503 Oct 29 02:57:34.540235 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1463/3010] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:34 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1573 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:34.571284 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-be08e5c6-6751-4e83-916c-44a66722df06 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Image not found. Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be08e5c6-6751-4e83-916c-44a66722df06 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 HTTP/1.1 Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: exception: Image not found. Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '24a2a113-e240-4d18-b928-e670f12212e7'} Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 24a2a113-e240-4d18-b928-e670f12212e7 to delete Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 24a2a113-e240-4d18-b928-e670f12212e7 could not be found. Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.574233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be08e5c6-6751-4e83-916c-44a66722df06 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Image not found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-be08e5c6-6751-4e83-916c-44a66722df06 tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7" status: 404 len: 62 microversion: 2.1 time: 0.063210 Oct 29 02:57:34.579779 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1548/3011] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:34 2022] DELETE /compute/v2.1/images/24a2a113-e240-4d18-b928-e670f12212e7 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:57:34.584963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.585491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.592175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.592889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.593330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.594265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.594493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.594909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.611720 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 HTTP/1.1 Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '236d6444-122e-4926-b00b-2fd646ed9715'} Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:34.613901 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-481b3bd8-eaf3-4dff-b373-0a4cbcf29a2c tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 404 len: 111 microversion: 2.1 time: 0.034326 Oct 29 02:57:34.618759 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1464/3012] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:34 2022] DELETE /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:34.625039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.625693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] [instance: 236d6444-122e-4926-b00b-2fd646ed9715] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.635493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.636298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.636755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.637451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.637929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.638354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.639113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:34.657796 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] HTTP exception thrown: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Request method failure captured: Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 HTTP/1.1 Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJUtI1tmicqKv2EfJVBoglKBgH-_JStTBrRk58XT3O-oFUdE9umRoTzAraBNgENFZmF8QWKBzHdXkYo8pUoHse5wbPp6lqnigTB-X4ZSsJV6SDGvEo3ivOb1UL7Sk65B2ERoOy4jHIQJfZ7ZBjmBrfVOhsV6E1UwNskN44mUztvcM1k Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09d1a1bd5d9d434a8a5e8f94d564515f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09d1a1bd5d9d434a8a5e8f94d564515f"}]}] Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 09d1a1bd5d9d434a8a5e8f94d564515f Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesTestJSON-2008654808 Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 0868f50723074f2b98f7b1096743f3cc Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesTestJSON-2008654808-project Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '236d6444-122e-4926-b00b-2fd646ed9715'} Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.659449 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.663803 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.663803 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.663803 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:34.663803 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:34.663803 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. Oct 29 02:57:34.663803 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.663803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] Returning 404 to user: Instance 236d6444-122e-4926-b00b-2fd646ed9715 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:34.663803 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eb310147-685a-4bfe-a440-dfe41e352c6e tempest-ImagesTestJSON-2008654808 tempest-ImagesTestJSON-2008654808-project] 10.222.0.16 "GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715" status: 404 len: 111 microversion: 2.1 time: 0.040166 Oct 29 02:57:34.663803 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1549/3013] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:34 2022] GET /compute/v2.1/servers/236d6444-122e-4926-b00b-2fd646ed9715 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:34.903845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2f67342-f55a-4e77-9773-cfec3197c77a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.904339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2f67342-f55a-4e77-9773-cfec3197c77a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.911133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f67342-f55a-4e77-9773-cfec3197c77a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.916349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f67342-f55a-4e77-9773-cfec3197c77a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.917207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f67342-f55a-4e77-9773-cfec3197c77a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.917998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f67342-f55a-4e77-9773-cfec3197c77a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.921178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f67342-f55a-4e77-9773-cfec3197c77a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.921631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f67342-f55a-4e77-9773-cfec3197c77a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.954584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2f67342-f55a-4e77-9773-cfec3197c77a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:57:34.970202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-703c276a-0fe3-4dfe-858b-9adb83075a83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.972770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-703c276a-0fe3-4dfe-858b-9adb83075a83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.989078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-703c276a-0fe3-4dfe-858b-9adb83075a83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.989873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-703c276a-0fe3-4dfe-858b-9adb83075a83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.990573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-703c276a-0fe3-4dfe-858b-9adb83075a83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.991233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-703c276a-0fe3-4dfe-858b-9adb83075a83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.991684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-703c276a-0fe3-4dfe-858b-9adb83075a83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.994493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-703c276a-0fe3-4dfe-858b-9adb83075a83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.099505 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2f67342-f55a-4e77-9773-cfec3197c77a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 204 len: 0 microversion: 2.32 time: 0.448551 Oct 29 02:57:35.100457 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1465/3014] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:57:34 2022] DELETE /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:57:35.110742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:35.111554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:35.118152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.119169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.120174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.121337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.122046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.122546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.249709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-703c276a-0fe3-4dfe-858b-9adb83075a83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:35.263724 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-703c276a-0fe3-4dfe-858b-9adb83075a83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1314 microversion: 2.1 time: 0.304010 Oct 29 02:57:35.277650 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1550/3015] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:34 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:35.284909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c8cf116d-e7b9-485f-98dd-bfe9a3b8a545 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:35.285530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c8cf116d-e7b9-485f-98dd-bfe9a3b8a545 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:35.304092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8cf116d-e7b9-485f-98dd-bfe9a3b8a545 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.305333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8cf116d-e7b9-485f-98dd-bfe9a3b8a545 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.305982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8cf116d-e7b9-485f-98dd-bfe9a3b8a545 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.307297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8cf116d-e7b9-485f-98dd-bfe9a3b8a545 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.308698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8cf116d-e7b9-485f-98dd-bfe9a3b8a545 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.309312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8cf116d-e7b9-485f-98dd-bfe9a3b8a545 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.343531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:35.401178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:35.586713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:35.600852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:35.602938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:35.604603 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-04772793-87d2-4b78-9a53-6d1369aaab2d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2949 microversion: 2.32 time: 0.498874 Oct 29 02:57:35.605741 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1466/3016] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:35 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2949 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:35.613015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d03a41fa-0b08-4dca-ad4d-eec7dc53eb2c req-51379dc3-4581-4888-9ee9-96909f033d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf06ee37-7622-4404-bfee-79b4e59a6f07", "tag": "357b9302-4bc7-4e44-8013-6ea636c939aa"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:35.637835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d03a41fa-0b08-4dca-ad4d-eec7dc53eb2c req-51379dc3-4581-4888-9ee9-96909f033d47 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.641342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d03a41fa-0b08-4dca-ad4d-eec7dc53eb2c req-51379dc3-4581-4888-9ee9-96909f033d47 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.642220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d03a41fa-0b08-4dca-ad4d-eec7dc53eb2c req-51379dc3-4581-4888-9ee9-96909f033d47 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.653960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c8cf116d-e7b9-485f-98dd-bfe9a3b8a545 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:35.664021 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c8cf116d-e7b9-485f-98dd-bfe9a3b8a545 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1524 microversion: 2.1 time: 0.386789 Oct 29 02:57:35.671841 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d03a41fa-0b08-4dca-ad4d-eec7dc53eb2c req-51379dc3-4581-4888-9ee9-96909f033d47 service nova] Creating event network-changed:357b9302-4bc7-4e44-8013-6ea636c939aa for instance cf06ee37-7622-4404-bfee-79b4e59a6f07 on n-h1-862964-4 Oct 29 02:57:35.678602 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1551/3017] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:35 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1524 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:35.683834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ab63442-6cdc-427c-b783-6d12ce3f99e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:35.684257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ab63442-6cdc-427c-b783-6d12ce3f99e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:35.705311 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d03a41fa-0b08-4dca-ad4d-eec7dc53eb2c req-51379dc3-4581-4888-9ee9-96909f033d47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097599 Oct 29 02:57:35.705595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab63442-6cdc-427c-b783-6d12ce3f99e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.706119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab63442-6cdc-427c-b783-6d12ce3f99e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.710023 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1467/3018] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:35.710183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab63442-6cdc-427c-b783-6d12ce3f99e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.710974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab63442-6cdc-427c-b783-6d12ce3f99e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.711451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab63442-6cdc-427c-b783-6d12ce3f99e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.711880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab63442-6cdc-427c-b783-6d12ce3f99e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.717255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c3291fa-fee5-495e-86c7-65c4eee32f27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:35.718810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c3291fa-fee5-495e-86c7-65c4eee32f27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:35.727314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c3291fa-fee5-495e-86c7-65c4eee32f27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.728112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c3291fa-fee5-495e-86c7-65c4eee32f27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.728717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c3291fa-fee5-495e-86c7-65c4eee32f27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.729743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c3291fa-fee5-495e-86c7-65c4eee32f27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.730381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c3291fa-fee5-495e-86c7-65c4eee32f27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.731201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c3291fa-fee5-495e-86c7-65c4eee32f27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.903206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=10 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:36.059554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ab63442-6cdc-427c-b783-6d12ce3f99e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.079129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c3291fa-fee5-495e-86c7-65c4eee32f27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.088398 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c3291fa-fee5-495e-86c7-65c4eee32f27 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1573 microversion: 2.1 time: 0.376064 Oct 29 02:57:36.106187 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ab63442-6cdc-427c-b783-6d12ce3f99e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1315 microversion: 2.1 time: 0.424231 Oct 29 02:57:36.106892 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1468/3019] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:35 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1573 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:36.111333 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1552/3020] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:35 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:36.290731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fd9aaac5-f54c-4a51-b9cd-8f78da8af737 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:36.291334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fd9aaac5-f54c-4a51-b9cd-8f78da8af737 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:36.300627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd9aaac5-f54c-4a51-b9cd-8f78da8af737 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.301135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd9aaac5-f54c-4a51-b9cd-8f78da8af737 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.301544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd9aaac5-f54c-4a51-b9cd-8f78da8af737 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.316650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd9aaac5-f54c-4a51-b9cd-8f78da8af737 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.318772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd9aaac5-f54c-4a51-b9cd-8f78da8af737 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.319222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd9aaac5-f54c-4a51-b9cd-8f78da8af737 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.637098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:36.637757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:36.647245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.650260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.651096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.652688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.656116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.657242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.704604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:36.935093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.946051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.947983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.948967 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fd930996-4d33-4b5d-a50f-46e642f466b6 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2949 microversion: 2.32 time: 0.316951 Oct 29 02:57:36.950073 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1553/3021] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:36 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2949 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:36.954912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:36.955519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:36.964279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fd9aaac5-f54c-4a51-b9cd-8f78da8af737 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.970208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.970718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.971198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.974293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.974439 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fd9aaac5-f54c-4a51-b9cd-8f78da8af737 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1314 microversion: 2.1 time: 0.687071 Oct 29 02:57:36.975082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.975727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.975935 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1469/3022] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:36 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:37.038244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.039066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.039730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.040388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lazy-loading 'fault' on Instance uuid b81fb73f-c42a-4ace-b365-b3e2bfde3e6d {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:57:37.098581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3a530b7ca34f6b9e84e3e7ece9fcff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523c0a96752940ca9416402d8180b1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:37.108249 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7c6f145a-6b78-4f5a-b31b-7b60c6f71d5e tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 200 len: 1314 microversion: 2.1 time: 0.157001 Oct 29 02:57:37.132315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8a3b0d85-50e0-47b2-8637-f73465c1f3d2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:37.133204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8a3b0d85-50e0-47b2-8637-f73465c1f3d2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:37.138587 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1554/3023] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:36 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:37.144778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a3b0d85-50e0-47b2-8637-f73465c1f3d2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.148441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b4afc6a-3c21-4ffa-9f3d-79476feb248d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:37.149358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a3b0d85-50e0-47b2-8637-f73465c1f3d2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.153719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a3b0d85-50e0-47b2-8637-f73465c1f3d2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.156631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a3b0d85-50e0-47b2-8637-f73465c1f3d2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.156631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a3b0d85-50e0-47b2-8637-f73465c1f3d2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.156631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a3b0d85-50e0-47b2-8637-f73465c1f3d2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.157157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4b4afc6a-3c21-4ffa-9f3d-79476feb248d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:37.178147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b4afc6a-3c21-4ffa-9f3d-79476feb248d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.198941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b4afc6a-3c21-4ffa-9f3d-79476feb248d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.202873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b4afc6a-3c21-4ffa-9f3d-79476feb248d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.204092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b4afc6a-3c21-4ffa-9f3d-79476feb248d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.204850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b4afc6a-3c21-4ffa-9f3d-79476feb248d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.205456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b4afc6a-3c21-4ffa-9f3d-79476feb248d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.589610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b4afc6a-3c21-4ffa-9f3d-79476feb248d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:37.598414 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4b4afc6a-3c21-4ffa-9f3d-79476feb248d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1315 microversion: 2.1 time: 0.456938 Oct 29 02:57:37.614490 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1555/3024] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:37 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:37.627110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8a3b0d85-50e0-47b2-8637-f73465c1f3d2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:37.637151 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8a3b0d85-50e0-47b2-8637-f73465c1f3d2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1573 microversion: 2.1 time: 0.513250 Oct 29 02:57:37.653322 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1470/3025] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:37 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1573 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:37.769157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-180a36aa-d06b-4dbb-b517-99f8b68a012a req-1cbfefa8-61bd-4227-8bae-5b4dd00ad474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81fb73f-c42a-4ace-b365-b3e2bfde3e6d", "name": "network-vif-deleted", "tag": "825a4637-659c-406d-89ad-960fe09b0d4c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:37.790661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-180a36aa-d06b-4dbb-b517-99f8b68a012a req-1cbfefa8-61bd-4227-8bae-5b4dd00ad474 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.791259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-180a36aa-d06b-4dbb-b517-99f8b68a012a req-1cbfefa8-61bd-4227-8bae-5b4dd00ad474 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.791836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-180a36aa-d06b-4dbb-b517-99f8b68a012a req-1cbfefa8-61bd-4227-8bae-5b4dd00ad474 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.815731 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-180a36aa-d06b-4dbb-b517-99f8b68a012a req-1cbfefa8-61bd-4227-8bae-5b4dd00ad474 service nova] Creating event network-vif-deleted:825a4637-659c-406d-89ad-960fe09b0d4c for instance b81fb73f-c42a-4ace-b365-b3e2bfde3e6d on n-h2-862964-4 Oct 29 02:57:37.831963 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-180a36aa-d06b-4dbb-b517-99f8b68a012a req-1cbfefa8-61bd-4227-8bae-5b4dd00ad474 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065754 Oct 29 02:57:37.837584 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1556/3026] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:38.003731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.007299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-66919ae8-79ff-49ad-8437-d37b3bca723f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.008202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.009944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-66919ae8-79ff-49ad-8437-d37b3bca723f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.031828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.034103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.035363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66919ae8-79ff-49ad-8437-d37b3bca723f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.038059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.039077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.039809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66919ae8-79ff-49ad-8437-d37b3bca723f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.041135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.041667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66919ae8-79ff-49ad-8437-d37b3bca723f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.043265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66919ae8-79ff-49ad-8437-d37b3bca723f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.043928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.048848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66919ae8-79ff-49ad-8437-d37b3bca723f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.051200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66919ae8-79ff-49ad-8437-d37b3bca723f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.355529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-66919ae8-79ff-49ad-8437-d37b3bca723f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:38.364606 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-66919ae8-79ff-49ad-8437-d37b3bca723f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1314 microversion: 2.1 time: 0.366269 Oct 29 02:57:38.371858 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1557/3027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:37 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:38.379111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.386377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] [instance: b81fb73f-c42a-4ace-b365-b3e2bfde3e6d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.393867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.396157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.397101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.398579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.399625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.400355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.427156 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] HTTP exception thrown: Instance b81fb73f-c42a-4ace-b365-b3e2bfde3e6d could not be found. Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Request method failure captured: Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d HTTP/1.1 Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJaIm_89J1tLdqFILsJqgxKsQft4mbIClnHc5QlzSHN9mOqgVbvKwtZYGLlQs2te1xnu_jhN3MHIpFzTgiaz-gxuAu66S-dHK-T3BjuT9C3qkCfa23l6_9bbzfQTcOHrlBO0U9Dy4d0ueojKVLUntQ0_pFHrdG-ZSNHqyRyENaxqpZ0 Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_523c0a96752940ca9416402d8180b1bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/523c0a96752940ca9416402d8180b1bd"}]}] Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 523c0a96752940ca9416402d8180b1bd Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-472025593 Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: be3a530b7ca34f6b9e84e3e7ece9fcff Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-472025593-project Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance b81fb73f-c42a-4ace-b365-b3e2bfde3e6d could not be found. Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'b81fb73f-c42a-4ace-b365-b3e2bfde3e6d'} Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81fb73f-c42a-4ace-b365-b3e2bfde3e6d could not be found. Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81fb73f-c42a-4ace-b365-b3e2bfde3e6d could not be found. Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.430487 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:38.435243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.435243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.435243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:38.435243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:38.435243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:38.435243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:38.435243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81fb73f-c42a-4ace-b365-b3e2bfde3e6d could not be found. Oct 29 02:57:38.435243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.437626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] Returning 404 to user: Instance b81fb73f-c42a-4ace-b365-b3e2bfde3e6d could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:38.438706 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7b9a7bbb-94e4-4ed3-9a65-c40861f1a247 tempest-ServerMetadataNegativeTestJSON-472025593 tempest-ServerMetadataNegativeTestJSON-472025593-project] 10.222.0.16 "GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d" status: 404 len: 111 microversion: 2.1 time: 0.065621 Oct 29 02:57:38.439962 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1558/3028] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:38 2022] GET /compute/v2.1/servers/b81fb73f-c42a-4ace-b365-b3e2bfde3e6d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:38.449481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f40c5845-d427-4ccf-abd9-1d709b74036c req-d21d66e1-e6fc-421e-9183-55bca76726ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2304c2-394d-4a8c-bae0-dc41bcd00d60", "name": "network-vif-plugged", "status": "completed", "tag": "8b369caa-616a-4f1f-9461-78559ca7296c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:38.485982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f40c5845-d427-4ccf-abd9-1d709b74036c req-d21d66e1-e6fc-421e-9183-55bca76726ad service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.486623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f40c5845-d427-4ccf-abd9-1d709b74036c req-d21d66e1-e6fc-421e-9183-55bca76726ad service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.487078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f40c5845-d427-4ccf-abd9-1d709b74036c req-d21d66e1-e6fc-421e-9183-55bca76726ad service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.510079 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f40c5845-d427-4ccf-abd9-1d709b74036c req-d21d66e1-e6fc-421e-9183-55bca76726ad service nova] Creating event network-vif-plugged:8b369caa-616a-4f1f-9461-78559ca7296c for instance 8f2304c2-394d-4a8c-bae0-dc41bcd00d60 on n-h1-862964-4 Oct 29 02:57:38.527536 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f40c5845-d427-4ccf-abd9-1d709b74036c req-d21d66e1-e6fc-421e-9183-55bca76726ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086121 Oct 29 02:57:38.528741 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1559/3029] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:38.595983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:38.612963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:38.625154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51161730-5b34-4547-961d-bdef5310e53e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.626164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-51161730-5b34-4547-961d-bdef5310e53e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.640438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:38.643809 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2f4e3820-0c03-496e-9f1a-0e02eed57633 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2949 microversion: 2.32 time: 0.649246 Oct 29 02:57:38.664177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51161730-5b34-4547-961d-bdef5310e53e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.664809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51161730-5b34-4547-961d-bdef5310e53e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.665260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51161730-5b34-4547-961d-bdef5310e53e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.666044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51161730-5b34-4547-961d-bdef5310e53e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.666671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51161730-5b34-4547-961d-bdef5310e53e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.667281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51161730-5b34-4547-961d-bdef5310e53e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.670143 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1471/3030] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:37 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2949 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:38.675380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6371ecf3-00cd-4ef6-9fa9-44ea29af0a31 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.675987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6371ecf3-00cd-4ef6-9fa9-44ea29af0a31 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.712266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6371ecf3-00cd-4ef6-9fa9-44ea29af0a31 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.713764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6371ecf3-00cd-4ef6-9fa9-44ea29af0a31 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.714377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6371ecf3-00cd-4ef6-9fa9-44ea29af0a31 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.715594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6371ecf3-00cd-4ef6-9fa9-44ea29af0a31 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.716214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6371ecf3-00cd-4ef6-9fa9-44ea29af0a31 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.716789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6371ecf3-00cd-4ef6-9fa9-44ea29af0a31 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.206257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6371ecf3-00cd-4ef6-9fa9-44ea29af0a31 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:39.215876 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6371ecf3-00cd-4ef6-9fa9-44ea29af0a31 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1573 microversion: 2.1 time: 0.544441 Oct 29 02:57:39.231497 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1472/3031] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:38 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1573 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:39.386138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-51161730-5b34-4547-961d-bdef5310e53e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:39.395998 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-51161730-5b34-4547-961d-bdef5310e53e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1315 microversion: 2.1 time: 0.775265 Oct 29 02:57:39.397815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-797aacbd-7f3d-4c14-bcd6-41f441c015e2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:39.398535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-797aacbd-7f3d-4c14-bcd6-41f441c015e2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:39.402954 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1560/3032] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:38 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:39.426841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797aacbd-7f3d-4c14-bcd6-41f441c015e2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.429505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797aacbd-7f3d-4c14-bcd6-41f441c015e2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.429972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797aacbd-7f3d-4c14-bcd6-41f441c015e2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.434030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797aacbd-7f3d-4c14-bcd6-41f441c015e2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.437714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797aacbd-7f3d-4c14-bcd6-41f441c015e2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.438353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797aacbd-7f3d-4c14-bcd6-41f441c015e2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.679948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:39.680842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:39.691304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.694122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.694733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.698753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.699401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.699990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.133971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-797aacbd-7f3d-4c14-bcd6-41f441c015e2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:40.148509 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-797aacbd-7f3d-4c14-bcd6-41f441c015e2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1314 microversion: 2.1 time: 0.754415 Oct 29 02:57:40.152508 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1473/3033] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:39 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:40.252856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d51a4490-8c92-482a-8389-f9ede87f8e34 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:40.253507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d51a4490-8c92-482a-8389-f9ede87f8e34 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:40.286431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d51a4490-8c92-482a-8389-f9ede87f8e34 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.286936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d51a4490-8c92-482a-8389-f9ede87f8e34 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.294746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d51a4490-8c92-482a-8389-f9ede87f8e34 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.303283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d51a4490-8c92-482a-8389-f9ede87f8e34 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.303821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d51a4490-8c92-482a-8389-f9ede87f8e34 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.304650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d51a4490-8c92-482a-8389-f9ede87f8e34 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.037786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.060489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.062072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.063393 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ab10649-acb6-4c67-8096-bafc9f2dfdb9 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2949 microversion: 2.32 time: 1.387469 Oct 29 02:57:41.063963 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1561/3034] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:39 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2949 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:41.106821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d2bf3ddb-ce62-4d2a-a63c-e9b14b400f51 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.107964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d2bf3ddb-ce62-4d2a-a63c-e9b14b400f51 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.122526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2bf3ddb-ce62-4d2a-a63c-e9b14b400f51 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.126125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2bf3ddb-ce62-4d2a-a63c-e9b14b400f51 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.126784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2bf3ddb-ce62-4d2a-a63c-e9b14b400f51 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.127727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2bf3ddb-ce62-4d2a-a63c-e9b14b400f51 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.128353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2bf3ddb-ce62-4d2a-a63c-e9b14b400f51 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.130300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2bf3ddb-ce62-4d2a-a63c-e9b14b400f51 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.420213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d51a4490-8c92-482a-8389-f9ede87f8e34 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.440262 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d51a4490-8c92-482a-8389-f9ede87f8e34 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1578 microversion: 2.1 time: 1.202604 Oct 29 02:57:41.450892 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1474/3035] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:40 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1578 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:41.470454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-01228ea0-7dc9-417b-b839-bc6fc4c28ee5 req-5b53456b-a791-4fc2-9293-1b1b498e56d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a570891-4387-4f63-a59a-aa60fe7360db", "name": "network-vif-plugged", "status": "completed", "tag": "96a84e8f-b1fc-4584-a5f1-6409732df05f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:41.505494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-01228ea0-7dc9-417b-b839-bc6fc4c28ee5 req-5b53456b-a791-4fc2-9293-1b1b498e56d8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.512486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-01228ea0-7dc9-417b-b839-bc6fc4c28ee5 req-5b53456b-a791-4fc2-9293-1b1b498e56d8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.519019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-01228ea0-7dc9-417b-b839-bc6fc4c28ee5 req-5b53456b-a791-4fc2-9293-1b1b498e56d8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.578915 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-01228ea0-7dc9-417b-b839-bc6fc4c28ee5 req-5b53456b-a791-4fc2-9293-1b1b498e56d8 service nova] Creating event network-vif-plugged:96a84e8f-b1fc-4584-a5f1-6409732df05f for instance 3a570891-4387-4f63-a59a-aa60fe7360db on n-h1-862964-4 Oct 29 02:57:41.607916 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-01228ea0-7dc9-417b-b839-bc6fc4c28ee5 req-5b53456b-a791-4fc2-9293-1b1b498e56d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155103 Oct 29 02:57:41.612685 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1475/3036] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:41.641001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f427e61b-bc5b-4a6e-bc12-2375ff823821 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.643606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f427e61b-bc5b-4a6e-bc12-2375ff823821 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.664266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=96,nova_api:UPDATE=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:41.670887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f427e61b-bc5b-4a6e-bc12-2375ff823821 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.674476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f427e61b-bc5b-4a6e-bc12-2375ff823821 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.675357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f427e61b-bc5b-4a6e-bc12-2375ff823821 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.678003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f427e61b-bc5b-4a6e-bc12-2375ff823821 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.682542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f427e61b-bc5b-4a6e-bc12-2375ff823821 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.688133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f427e61b-bc5b-4a6e-bc12-2375ff823821 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.184234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d2bf3ddb-ce62-4d2a-a63c-e9b14b400f51 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:42.195160 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d2bf3ddb-ce62-4d2a-a63c-e9b14b400f51 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1315 microversion: 2.1 time: 1.101816 Oct 29 02:57:42.215454 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1562/3037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1315 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:42.230035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:42.231104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:42.266765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.267548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.269136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.273707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.274408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.277414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.681623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f427e61b-bc5b-4a6e-bc12-2375ff823821 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:42.712940 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f427e61b-bc5b-4a6e-bc12-2375ff823821 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1464 microversion: 2.1 time: 1.095421 Oct 29 02:57:42.715158 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1476/3038] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1464 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:42.740758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0374e642-9d5c-4a20-bfcc-6f5179ae7bfd tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:42.741706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0374e642-9d5c-4a20-bfcc-6f5179ae7bfd tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:42.774083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0374e642-9d5c-4a20-bfcc-6f5179ae7bfd tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.775921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0374e642-9d5c-4a20-bfcc-6f5179ae7bfd tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.776523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0374e642-9d5c-4a20-bfcc-6f5179ae7bfd tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.777436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0374e642-9d5c-4a20-bfcc-6f5179ae7bfd tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.778230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0374e642-9d5c-4a20-bfcc-6f5179ae7bfd tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.778779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0374e642-9d5c-4a20-bfcc-6f5179ae7bfd tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.421847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0374e642-9d5c-4a20-bfcc-6f5179ae7bfd tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:43.435236 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0374e642-9d5c-4a20-bfcc-6f5179ae7bfd tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1571 microversion: 2.1 time: 0.712484 Oct 29 02:57:43.437670 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1477/3039] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:42 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1571 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:43.659428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c03e0276-0f8f-479c-9623-e2451ca7c4cb tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:43.668241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c03e0276-0f8f-479c-9623-e2451ca7c4cb tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Searching by: {'deleted': False, 'project_id': 'd00b18d27eb643cfacec3f332d76cb9e'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:57:43.684699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c03e0276-0f8f-479c-9623-e2451ca7c4cb tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.685303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c03e0276-0f8f-479c-9623-e2451ca7c4cb tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.685604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c03e0276-0f8f-479c-9623-e2451ca7c4cb tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.688208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c03e0276-0f8f-479c-9623-e2451ca7c4cb tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.691239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c03e0276-0f8f-479c-9623-e2451ca7c4cb tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.692865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c03e0276-0f8f-479c-9623-e2451ca7c4cb tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.762992 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c03e0276-0f8f-479c-9623-e2451ca7c4cb tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.323839 Oct 29 02:57:43.764186 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1478/3040] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:57:43 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:57:43.770724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-70bd0d14-6be4-4e76-be79-19362fc9cfd2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:43.772477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-70bd0d14-6be4-4e76-be79-19362fc9cfd2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:43.779979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70bd0d14-6be4-4e76-be79-19362fc9cfd2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.781844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70bd0d14-6be4-4e76-be79-19362fc9cfd2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.783736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70bd0d14-6be4-4e76-be79-19362fc9cfd2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.784804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70bd0d14-6be4-4e76-be79-19362fc9cfd2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.785880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70bd0d14-6be4-4e76-be79-19362fc9cfd2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.788083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70bd0d14-6be4-4e76-be79-19362fc9cfd2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.798967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:43.925487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:43.958015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:43.972292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:43.979278 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3da57d23-9a83-43ae-8f3e-a59debc2de1a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2949 microversion: 2.32 time: 1.762110 Oct 29 02:57:43.987226 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1563/3041] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:42 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2949 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:44.009578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8d206778-799a-402f-9e12-5c07605d6d52 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-311804684"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:44.016932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8d206778-799a-402f-9e12-5c07605d6d52 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:44.032908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d206778-799a-402f-9e12-5c07605d6d52 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.037719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d206778-799a-402f-9e12-5c07605d6d52 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.038455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d206778-799a-402f-9e12-5c07605d6d52 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.039396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d206778-799a-402f-9e12-5c07605d6d52 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.040040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d206778-799a-402f-9e12-5c07605d6d52 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.044187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d206778-799a-402f-9e12-5c07605d6d52 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.228429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-70bd0d14-6be4-4e76-be79-19362fc9cfd2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.240514 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-70bd0d14-6be4-4e76-be79-19362fc9cfd2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1315 microversion: 2.1 time: 0.472980 Oct 29 02:57:44.241575 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1479/3042] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:43 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:44.251384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a422c110-4951-4008-8998-6229f8d7fd0a req-87963246-362c-4833-89ea-42df5c91ee1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "f9ad5c3b-d639-4b01-8092-245696df4798"}, {"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "767f0367-bff9-4f07-ac30-bfe344612d57"}, {"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "f768439c-3452-4070-b9fe-dc99900a9aba"}, {"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "6ee1db3a-b8f9-46be-9d54-08b853dc8555"}, {"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "0ac995e9-7dce-47bf-9e58-e63e0cc63800"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:44.286828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a422c110-4951-4008-8998-6229f8d7fd0a req-87963246-362c-4833-89ea-42df5c91ee1f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.286828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a422c110-4951-4008-8998-6229f8d7fd0a req-87963246-362c-4833-89ea-42df5c91ee1f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.287047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a422c110-4951-4008-8998-6229f8d7fd0a req-87963246-362c-4833-89ea-42df5c91ee1f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.322535 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a422c110-4951-4008-8998-6229f8d7fd0a req-87963246-362c-4833-89ea-42df5c91ee1f service nova] Creating event network-vif-unplugged:f9ad5c3b-d639-4b01-8092-245696df4798 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:57:44.323146 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a422c110-4951-4008-8998-6229f8d7fd0a req-87963246-362c-4833-89ea-42df5c91ee1f service nova] Creating event network-vif-unplugged:767f0367-bff9-4f07-ac30-bfe344612d57 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:57:44.323515 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a422c110-4951-4008-8998-6229f8d7fd0a req-87963246-362c-4833-89ea-42df5c91ee1f service nova] Creating event network-vif-unplugged:f768439c-3452-4070-b9fe-dc99900a9aba for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:57:44.324020 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a422c110-4951-4008-8998-6229f8d7fd0a req-87963246-362c-4833-89ea-42df5c91ee1f service nova] Creating event network-vif-unplugged:6ee1db3a-b8f9-46be-9d54-08b853dc8555 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:57:44.324512 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a422c110-4951-4008-8998-6229f8d7fd0a req-87963246-362c-4833-89ea-42df5c91ee1f service nova] Creating event network-vif-unplugged:0ac995e9-7dce-47bf-9e58-e63e0cc63800 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:57:44.341334 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a422c110-4951-4008-8998-6229f8d7fd0a req-87963246-362c-4833-89ea-42df5c91ee1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.094633 Oct 29 02:57:44.343701 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1480/3043] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:44.349128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:44.356076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Searching by: {'deleted': False} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:57:44.363390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.363871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.364299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.365056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.365503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.365943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.505086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:57:44.691794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.692792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.692792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.699596 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.network.security_group_api [None req-8d206778-799a-402f-9e12-5c07605d6d52 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Adding security group f6a31395-ecaf-46ae-bbc2-c5b659401dbd to port 357b9302-4bc7-4e44-8013-6ea636c939aa Oct 29 02:57:45.579973 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c031bf6f-821f-4254-b6d3-d5729529cf54 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12882 microversion: 2.1 time: 1.234997 Oct 29 02:57:45.595820 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1481/3044] 10.222.0.16 () {58 vars in 1171 bytes} [Sat Oct 29 02:57:44 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12882 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:57:45.633748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:45.639459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:45.664157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:45.667240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:45.669233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:45.671078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:45.673200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:45.674066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.265445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.279457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.293863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.298752 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7d144233-7543-4a9d-99e7-be6fd6196dd4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2928 microversion: 2.32 time: 0.701318 Oct 29 02:57:46.350658 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1482/3045] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:45 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2928 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:46.374884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f029ba5-a9d4-4d58-ab9f-a16c26d1e1c1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:46.378205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5f029ba5-a9d4-4d58-ab9f-a16c26d1e1c1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:46.410526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f029ba5-a9d4-4d58-ab9f-a16c26d1e1c1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.411536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f029ba5-a9d4-4d58-ab9f-a16c26d1e1c1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.415678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f029ba5-a9d4-4d58-ab9f-a16c26d1e1c1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.423210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f029ba5-a9d4-4d58-ab9f-a16c26d1e1c1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.424267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f029ba5-a9d4-4d58-ab9f-a16c26d1e1c1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.428798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f029ba5-a9d4-4d58-ab9f-a16c26d1e1c1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.742070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5f029ba5-a9d4-4d58-ab9f-a16c26d1e1c1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.754725 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f029ba5-a9d4-4d58-ab9f-a16c26d1e1c1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1500 microversion: 2.1 time: 0.399733 Oct 29 02:57:46.759512 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1483/3046] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:46 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1500 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:46.768989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e15b83ce-add7-43ed-863f-48f064f75976 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:46.781730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e15b83ce-add7-43ed-863f-48f064f75976 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Searching by: {'deleted': False, 'project_id': 'd00b18d27eb643cfacec3f332d76cb9e'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:57:46.795803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e15b83ce-add7-43ed-863f-48f064f75976 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.796514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e15b83ce-add7-43ed-863f-48f064f75976 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.797100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e15b83ce-add7-43ed-863f-48f064f75976 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.798174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e15b83ce-add7-43ed-863f-48f064f75976 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.798927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e15b83ce-add7-43ed-863f-48f064f75976 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.800887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e15b83ce-add7-43ed-863f-48f064f75976 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.872828 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e15b83ce-add7-43ed-863f-48f064f75976 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=fc4a5146b4134f11af39e82d9ae9f03b" status: 200 len: 15 microversion: 2.1 time: 0.111341 Oct 29 02:57:46.890854 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1484/3047] 10.222.0.16 () {58 vars in 1231 bytes} [Sat Oct 29 02:57:46 2022] GET /compute/v2.1/servers/detail?tenant_id=fc4a5146b4134f11af39e82d9ae9f03b => generated 15 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:57:46.899611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ebef58cd-9787-48a2-86ed-8c1b5660e7ec req-6b6fffa3-7c75-4f9c-9401-a2f014e32030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "5de667bc-fe03-4e62-86b0-0d4687f62228"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:46.909744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ebef58cd-9787-48a2-86ed-8c1b5660e7ec req-6b6fffa3-7c75-4f9c-9401-a2f014e32030 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.910512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ebef58cd-9787-48a2-86ed-8c1b5660e7ec req-6b6fffa3-7c75-4f9c-9401-a2f014e32030 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.911079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ebef58cd-9787-48a2-86ed-8c1b5660e7ec req-6b6fffa3-7c75-4f9c-9401-a2f014e32030 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.925119 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ebef58cd-9787-48a2-86ed-8c1b5660e7ec req-6b6fffa3-7c75-4f9c-9401-a2f014e32030 service nova] Creating event network-vif-unplugged:5de667bc-fe03-4e62-86b0-0d4687f62228 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:57:46.931686 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ebef58cd-9787-48a2-86ed-8c1b5660e7ec req-6b6fffa3-7c75-4f9c-9401-a2f014e32030 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039277 Oct 29 02:57:46.933693 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1485/3048] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:46.950758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aa39b404-fc25-46c5-9e36-b1398f10e47b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:46.951900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aa39b404-fc25-46c5-9e36-b1398f10e47b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:46.993657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa39b404-fc25-46c5-9e36-b1398f10e47b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.999489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa39b404-fc25-46c5-9e36-b1398f10e47b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.003507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa39b404-fc25-46c5-9e36-b1398f10e47b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:47.008278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa39b404-fc25-46c5-9e36-b1398f10e47b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:47.011127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa39b404-fc25-46c5-9e36-b1398f10e47b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.015407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa39b404-fc25-46c5-9e36-b1398f10e47b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:47.098316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-aa39b404-fc25-46c5-9e36-b1398f10e47b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lazy-loading 'flavor' on Instance uuid 3a570891-4387-4f63-a59a-aa60fe7360db {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:57:47.273981 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8d206778-799a-402f-9e12-5c07605d6d52 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07/action" status: 202 len: 0 microversion: 2.1 time: 3.285531 Oct 29 02:57:47.274700 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1564/3049] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:43 2022] POST /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07/action => generated 0 bytes in 3287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:47.283350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:47.293593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Searching by: {'tenant_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'deleted': False} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:57:47.318145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:47.318632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.328363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:47.329185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:47.330077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.331618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:47.700086 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aa39b404-fc25-46c5-9e36-b1398f10e47b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db/action" status: 202 len: 0 microversion: 2.1 time: 0.762041 Oct 29 02:57:47.704726 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1486/3050] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:46 2022] POST /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db/action => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:47.710829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-230b9388-f1b1-43ac-bacf-a61d32245f47 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a8537b80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:47.803175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:57:47.931066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG neutronclient.v2_0.client [None req-230b9388-f1b1-43ac-bacf-a61d32245f47 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f6a31395-ecaf-46ae-bbc2-c5b659401dbd in use.", "detail": ""}} {{(pid=127042) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:57:47.931815 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-230b9388-f1b1-43ac-bacf-a61d32245f47 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security Group f6a31395-ecaf-46ae-bbc2-c5b659401dbd in use. Oct 29 02:57:47.931815 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-38a8f0e9-a86d-4bd7-b7f6-25afd335d4b4'] Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-230b9388-f1b1-43ac-bacf-a61d32245f47 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-security-groups/f6a31395-ecaf-46ae-bbc2-c5b659401dbd HTTP/1.1 Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: exception: Security Group f6a31395-ecaf-46ae-bbc2-c5b659401dbd in use. Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-38a8f0e9-a86d-4bd7-b7f6-25afd335d4b4'] Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'f6a31395-ecaf-46ae-bbc2-c5b659401dbd'} Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:57:47.934079 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f6a31395-ecaf-46ae-bbc2-c5b659401dbd in use. Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38a8f0e9-a86d-4bd7-b7f6-25afd335d4b4'] Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f6a31395-ecaf-46ae-bbc2-c5b659401dbd in use. Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38a8f0e9-a86d-4bd7-b7f6-25afd335d4b4'] Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f6a31395-ecaf-46ae-bbc2-c5b659401dbd in use. Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38a8f0e9-a86d-4bd7-b7f6-25afd335d4b4'] Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f6a31395-ecaf-46ae-bbc2-c5b659401dbd in use. Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38a8f0e9-a86d-4bd7-b7f6-25afd335d4b4'] Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-230b9388-f1b1-43ac-bacf-a61d32245f47 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 400 to user: Security Group f6a31395-ecaf-46ae-bbc2-c5b659401dbd in use. Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-38a8f0e9-a86d-4bd7-b7f6-25afd335d4b4'] {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-230b9388-f1b1-43ac-bacf-a61d32245f47 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f6a31395-ecaf-46ae-bbc2-c5b659401dbd" status: 400 len: 185 microversion: 2.1 time: 0.229482 Oct 29 02:57:47.939063 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1487/3051] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:57:47 2022] DELETE /compute/v2.1/os-security-groups/f6a31395-ecaf-46ae-bbc2-c5b659401dbd => generated 185 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:47.949251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-60c45778-15be-46da-9070-73e66f481f7f req-c4972ee4-0727-4ca6-9db7-2fa8db85ef87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf06ee37-7622-4404-bfee-79b4e59a6f07", "tag": "357b9302-4bc7-4e44-8013-6ea636c939aa"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:48.004433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-60c45778-15be-46da-9070-73e66f481f7f req-c4972ee4-0727-4ca6-9db7-2fa8db85ef87 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.004928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-60c45778-15be-46da-9070-73e66f481f7f req-c4972ee4-0727-4ca6-9db7-2fa8db85ef87 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.005351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-60c45778-15be-46da-9070-73e66f481f7f req-c4972ee4-0727-4ca6-9db7-2fa8db85ef87 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.025315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.025928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.026464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.036676 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-60c45778-15be-46da-9070-73e66f481f7f req-c4972ee4-0727-4ca6-9db7-2fa8db85ef87 service nova] Creating event network-changed:357b9302-4bc7-4e44-8013-6ea636c939aa for instance cf06ee37-7622-4404-bfee-79b4e59a6f07 on n-h1-862964-4 Oct 29 02:57:48.046044 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-60c45778-15be-46da-9070-73e66f481f7f req-c4972ee4-0727-4ca6-9db7-2fa8db85ef87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103634 Oct 29 02:57:48.050469 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1488/3052] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:48.056258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:48.057106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:48.073930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.074721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.075308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.076187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.077037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.077622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.622402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.636011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.643065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.649100 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-52d19a17-cf92-4ad7-99a7-adf3866ddd32 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2928 microversion: 2.32 time: 0.597375 Oct 29 02:57:48.672952 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1489/3053] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:48 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2928 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:48.697667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a988330b-a0f8-4594-82f9-e33e72e5a2a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:48.702628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a988330b-a0f8-4594-82f9-e33e72e5a2a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:48.730192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a988330b-a0f8-4594-82f9-e33e72e5a2a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.735465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a988330b-a0f8-4594-82f9-e33e72e5a2a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.736273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a988330b-a0f8-4594-82f9-e33e72e5a2a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.741716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a988330b-a0f8-4594-82f9-e33e72e5a2a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.742694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a988330b-a0f8-4594-82f9-e33e72e5a2a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.746876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a988330b-a0f8-4594-82f9-e33e72e5a2a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.092022 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2b788ca1-9e43-404c-80fe-09590a454537 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fc4a5146b4134f11af39e82d9ae9f03b" status: 200 len: 4824 microversion: 2.1 time: 1.812932 Oct 29 02:57:49.093779 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1565/3054] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Oct 29 02:57:47 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fc4a5146b4134f11af39e82d9ae9f03b => generated 4824 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:49.098876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ebca8843-bc79-4573-95b4-7420aa85ab42 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.099706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ebca8843-bc79-4573-95b4-7420aa85ab42 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:49.109751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebca8843-bc79-4573-95b4-7420aa85ab42 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.110507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebca8843-bc79-4573-95b4-7420aa85ab42 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.111103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebca8843-bc79-4573-95b4-7420aa85ab42 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.111975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebca8843-bc79-4573-95b4-7420aa85ab42 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.112617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebca8843-bc79-4573-95b4-7420aa85ab42 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.113387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebca8843-bc79-4573-95b4-7420aa85ab42 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.142839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ebca8843-bc79-4573-95b4-7420aa85ab42 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:57:49.174770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a988330b-a0f8-4594-82f9-e33e72e5a2a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:49.184794 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a988330b-a0f8-4594-82f9-e33e72e5a2a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.508707 Oct 29 02:57:49.185709 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1490/3055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:48 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:49.192481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-206370664", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "193552d8-600b-45dc-9735-6385af1fcf18"}], "security_groups": [{"name": "tempest-securitygroup--320153522"}], "key_name": "tempest-keypair-1245804504", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "59556e3f-c207-433f-859f-2eec97919239", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:49.338307 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ebca8843-bc79-4573-95b4-7420aa85ab42 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 204 len: 0 microversion: 2.1 time: 0.242783 Oct 29 02:57:49.343199 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1566/3056] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:49 2022] DELETE /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:57:49.350776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8fc3ea4e-1fd1-4285-8761-10b3008473d6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.370465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8fc3ea4e-1fd1-4285-8761-10b3008473d6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Searching by: {'tenant_id': 'd00b18d27eb643cfacec3f332d76cb9e', 'deleted': False} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:57:49.376536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc3ea4e-1fd1-4285-8761-10b3008473d6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.377218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc3ea4e-1fd1-4285-8761-10b3008473d6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.377841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc3ea4e-1fd1-4285-8761-10b3008473d6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.378777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc3ea4e-1fd1-4285-8761-10b3008473d6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.379392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc3ea4e-1fd1-4285-8761-10b3008473d6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.379958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc3ea4e-1fd1-4285-8761-10b3008473d6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.441102 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8fc3ea4e-1fd1-4285-8761-10b3008473d6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d00b18d27eb643cfacec3f332d76cb9e" status: 200 len: 15 microversion: 2.1 time: 0.092092 Oct 29 02:57:49.445942 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1567/3057] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Oct 29 02:57:49 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d00b18d27eb643cfacec3f332d76cb9e => generated 15 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:57:49.459726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d795e9d8-3fe9-47d9-b4ac-e2f2176bddc1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.460822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d795e9d8-3fe9-47d9-b4ac-e2f2176bddc1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:49.482856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:49.488925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d795e9d8-3fe9-47d9-b4ac-e2f2176bddc1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.493008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d795e9d8-3fe9-47d9-b4ac-e2f2176bddc1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.493919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d795e9d8-3fe9-47d9-b4ac-e2f2176bddc1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.494646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d795e9d8-3fe9-47d9-b4ac-e2f2176bddc1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.495115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d795e9d8-3fe9-47d9-b4ac-e2f2176bddc1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.496043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d795e9d8-3fe9-47d9-b4ac-e2f2176bddc1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.796679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] validate_networks() for [('193552d8-600b-45dc-9735-6385af1fcf18', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:49.921081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d795e9d8-3fe9-47d9-b4ac-e2f2176bddc1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:49.929316 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d795e9d8-3fe9-47d9-b4ac-e2f2176bddc1 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1645 microversion: 2.1 time: 0.481946 Oct 29 02:57:49.930359 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1568/3058] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:49 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1645 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:49.935432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b21d197-4564-4b37-bdbc-15bbd7305d85 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.947624 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7b21d197-4564-4b37-bdbc-15bbd7305d85 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.015998 Oct 29 02:57:49.950221 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1569/3059] 10.222.0.16 () {58 vars in 1189 bytes} [Sat Oct 29 02:57:49 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:57:49.961863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.983157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:49.990193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.990966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.991638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.993188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.993753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.994795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.339542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:50.350554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:50.352319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:50.354209 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9207b2dd-127b-4c01-8788-bd2b98e1562e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2907 microversion: 2.32 time: 0.402686 Oct 29 02:57:50.355593 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1570/3060] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:49 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2907 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:50.361043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3c18190-3149-43d1-ae24-af9430fdbea9 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:50.363736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a3c18190-3149-43d1-ae24-af9430fdbea9 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:50.371279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3c18190-3149-43d1-ae24-af9430fdbea9 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.371980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3c18190-3149-43d1-ae24-af9430fdbea9 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.372584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3c18190-3149-43d1-ae24-af9430fdbea9 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.373737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3c18190-3149-43d1-ae24-af9430fdbea9 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.374461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3c18190-3149-43d1-ae24-af9430fdbea9 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.375095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3c18190-3149-43d1-ae24-af9430fdbea9 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.408992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:50.574022 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3c18190-3149-43d1-ae24-af9430fdbea9 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action" status: 202 len: 0 microversion: 2.1 time: 0.216628 Oct 29 02:57:50.577908 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1571/3061] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:50 2022] POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:50.640510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bdf1385c-37d8-4789-ba68-b3f883c64077 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:50.641196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bdf1385c-37d8-4789-ba68-b3f883c64077 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:50.679870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf1385c-37d8-4789-ba68-b3f883c64077 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.681256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf1385c-37d8-4789-ba68-b3f883c64077 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.682099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf1385c-37d8-4789-ba68-b3f883c64077 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.683103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf1385c-37d8-4789-ba68-b3f883c64077 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.683870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf1385c-37d8-4789-ba68-b3f883c64077 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.684727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf1385c-37d8-4789-ba68-b3f883c64077 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.954973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Getting quotas for project fa9a72e5d3ea460ebdb09420824ba04b. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:50.962724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Getting quotas for user eaaa0b3debf041098f1f188124050dad and project fa9a72e5d3ea460ebdb09420824ba04b. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:50.998729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:50.999126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:51.001491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:51.003729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:51.004352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:51.029768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.030283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.030710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.031422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.032718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.033324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.075311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Getting quotas for project fa9a72e5d3ea460ebdb09420824ba04b. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:51.089671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Getting quotas for user eaaa0b3debf041098f1f188124050dad and project fa9a72e5d3ea460ebdb09420824ba04b. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:51.100201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bdf1385c-37d8-4789-ba68-b3f883c64077 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:51.108652 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bdf1385c-37d8-4789-ba68-b3f883c64077 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.531775 Oct 29 02:57:51.130858 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1572/3062] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:50 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:51.144641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ebf0a04b-bd03-4a33-8100-cf3619e177b6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:51.151836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ebf0a04b-bd03-4a33-8100-cf3619e177b6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:51.152573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ebf0a04b-bd03-4a33-8100-cf3619e177b6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:57:51.186019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf0a04b-bd03-4a33-8100-cf3619e177b6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.186686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf0a04b-bd03-4a33-8100-cf3619e177b6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.187139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf0a04b-bd03-4a33-8100-cf3619e177b6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.187960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf0a04b-bd03-4a33-8100-cf3619e177b6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.188423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf0a04b-bd03-4a33-8100-cf3619e177b6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.188855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf0a04b-bd03-4a33-8100-cf3619e177b6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.220469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:51.222961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59556e3f-c207-433f-859f-2eec97919239',volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:51.371544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-ebf0a04b-bd03-4a33-8100-cf3619e177b6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:57:51.470083 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cfd07b27-af24-485d-9e65-89caa762f9c3 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.282902 Oct 29 02:57:51.470823 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1491/3063] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 2284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:57:51.484142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3f3782b-6102-4dba-934d-74a0b980f1e2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:51.486697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d3f3782b-6102-4dba-934d-74a0b980f1e2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:51.499675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f3782b-6102-4dba-934d-74a0b980f1e2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.500504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f3782b-6102-4dba-934d-74a0b980f1e2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.502321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f3782b-6102-4dba-934d-74a0b980f1e2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.503251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f3782b-6102-4dba-934d-74a0b980f1e2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.507527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f3782b-6102-4dba-934d-74a0b980f1e2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.508252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3f3782b-6102-4dba-934d-74a0b980f1e2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.510470 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ebf0a04b-bd03-4a33-8100-cf3619e177b6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.377394 Oct 29 02:57:51.511177 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1573/3064] 10.222.0.16 () {58 vars in 1150 bytes} [Sat Oct 29 02:57:51 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:51.515836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:51.528858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:51.536683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.537272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.537785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.538547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.539451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.539892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.859676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d3f3782b-6102-4dba-934d-74a0b980f1e2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:51.869762 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3f3782b-6102-4dba-934d-74a0b980f1e2 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1645 microversion: 2.1 time: 0.396056 Oct 29 02:57:51.874198 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1492/3065] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:51 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1645 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:51.896012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f1c8ec8d-998d-4cda-9811-3c8732a15bb1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:51.896810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f1c8ec8d-998d-4cda-9811-3c8732a15bb1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:51.996013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f1c8ec8d-998d-4cda-9811-3c8732a15bb1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:52.009575 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f1c8ec8d-998d-4cda-9811-3c8732a15bb1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1121 microversion: 2.1 time: 0.114220 Oct 29 02:57:52.011910 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1493/3066] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:51 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1121 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:52.042403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d9d2aeb-22f5-4584-8dbd-289605ff9af0 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:52.050907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9d9d2aeb-22f5-4584-8dbd-289605ff9af0 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:52.066193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d9d2aeb-22f5-4584-8dbd-289605ff9af0 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.066857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d9d2aeb-22f5-4584-8dbd-289605ff9af0 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.068064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d9d2aeb-22f5-4584-8dbd-289605ff9af0 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.068488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:52.069371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d9d2aeb-22f5-4584-8dbd-289605ff9af0 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.070066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d9d2aeb-22f5-4584-8dbd-289605ff9af0 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.071503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d9d2aeb-22f5-4584-8dbd-289605ff9af0 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.081486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:52.086052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:52.090885 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-501dcd19-eb99-4a23-8771-8a92e3b5127e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2907 microversion: 2.32 time: 0.577698 Oct 29 02:57:52.092152 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1574/3067] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:51 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2907 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:52.145707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-62ac5ac6-b550-4801-9a91-082425cdc136 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:52.146792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-62ac5ac6-b550-4801-9a91-082425cdc136 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:52.156095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62ac5ac6-b550-4801-9a91-082425cdc136 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.156594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62ac5ac6-b550-4801-9a91-082425cdc136 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.157043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62ac5ac6-b550-4801-9a91-082425cdc136 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.158013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62ac5ac6-b550-4801-9a91-082425cdc136 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.158719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62ac5ac6-b550-4801-9a91-082425cdc136 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.159132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62ac5ac6-b550-4801-9a91-082425cdc136 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.183294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9d9d2aeb-22f5-4584-8dbd-289605ff9af0 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action" status: 202 len: 0 microversion: 2.1 time: 0.157397 Oct 29 02:57:52.184824 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1494/3068] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:52 2022] POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:52.197665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5e3496df-aff8-40c4-b2ae-20acf60f3bda tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:52.199710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5e3496df-aff8-40c4-b2ae-20acf60f3bda tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:52.208814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e3496df-aff8-40c4-b2ae-20acf60f3bda tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.210090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e3496df-aff8-40c4-b2ae-20acf60f3bda tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.210090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e3496df-aff8-40c4-b2ae-20acf60f3bda tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.210880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e3496df-aff8-40c4-b2ae-20acf60f3bda tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.211356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e3496df-aff8-40c4-b2ae-20acf60f3bda tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.211780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e3496df-aff8-40c4-b2ae-20acf60f3bda tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.005565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-62ac5ac6-b550-4801-9a91-082425cdc136 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:53.028035 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-62ac5ac6-b550-4801-9a91-082425cdc136 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.891265 Oct 29 02:57:53.032435 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1575/3069] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:52 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:53.045869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-74216e78-27f5-45fd-ab3e-f82dc606116f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:53.055684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-74216e78-27f5-45fd-ab3e-f82dc606116f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:53.073775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74216e78-27f5-45fd-ab3e-f82dc606116f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.081939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74216e78-27f5-45fd-ab3e-f82dc606116f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.082612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74216e78-27f5-45fd-ab3e-f82dc606116f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.083386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74216e78-27f5-45fd-ab3e-f82dc606116f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.084014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74216e78-27f5-45fd-ab3e-f82dc606116f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.084443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74216e78-27f5-45fd-ab3e-f82dc606116f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.284344 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5e3496df-aff8-40c4-b2ae-20acf60f3bda tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1613 microversion: 2.1 time: 1.094490 Oct 29 02:57:53.308716 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1495/3070] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:52 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1613 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:53.325317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ac9e7267-37a2-49b9-9e8b-a7db9df1ead6 req-a712e40d-0f00-4c99-8f18-d32d7c72a7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-deleted", "tag": "6ee1db3a-b8f9-46be-9d54-08b853dc8555"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:53.346702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ac9e7267-37a2-49b9-9e8b-a7db9df1ead6 req-a712e40d-0f00-4c99-8f18-d32d7c72a7d7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.347475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ac9e7267-37a2-49b9-9e8b-a7db9df1ead6 req-a712e40d-0f00-4c99-8f18-d32d7c72a7d7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.349179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ac9e7267-37a2-49b9-9e8b-a7db9df1ead6 req-a712e40d-0f00-4c99-8f18-d32d7c72a7d7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.384610 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ac9e7267-37a2-49b9-9e8b-a7db9df1ead6 req-a712e40d-0f00-4c99-8f18-d32d7c72a7d7 service nova] Creating event network-vif-deleted:6ee1db3a-b8f9-46be-9d54-08b853dc8555 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:57:53.398652 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ac9e7267-37a2-49b9-9e8b-a7db9df1ead6 req-a712e40d-0f00-4c99-8f18-d32d7c72a7d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087809 Oct 29 02:57:53.402487 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1496/3071] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:53.419430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7da0de41-317a-498d-b0b5-632029aa17c9 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:53.420758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7da0de41-317a-498d-b0b5-632029aa17c9 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:53.440831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7da0de41-317a-498d-b0b5-632029aa17c9 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.442176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7da0de41-317a-498d-b0b5-632029aa17c9 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.443279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7da0de41-317a-498d-b0b5-632029aa17c9 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.446545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7da0de41-317a-498d-b0b5-632029aa17c9 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.448672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7da0de41-317a-498d-b0b5-632029aa17c9 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.450257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7da0de41-317a-498d-b0b5-632029aa17c9 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.678775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7da0de41-317a-498d-b0b5-632029aa17c9 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:53.681443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:53.713730 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7da0de41-317a-498d-b0b5-632029aa17c9 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1227 microversion: 2.1 time: 0.309627 Oct 29 02:57:53.714395 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1497/3072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:53 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1227 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:53.745376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:53.746297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:53.756117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.756889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.757470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.758382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.758980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.760655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.031483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-74216e78-27f5-45fd-ab3e-f82dc606116f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:54.060353 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-74216e78-27f5-45fd-ab3e-f82dc606116f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1645 microversion: 2.1 time: 1.025668 Oct 29 02:57:54.069942 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1576/3073] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:53 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1645 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:54.090933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-336d1e17-bf2a-436e-a7e2-9e732cd967dc tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:54.094281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-336d1e17-bf2a-436e-a7e2-9e732cd967dc tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:54.116153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336d1e17-bf2a-436e-a7e2-9e732cd967dc tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.120830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336d1e17-bf2a-436e-a7e2-9e732cd967dc tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.121564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336d1e17-bf2a-436e-a7e2-9e732cd967dc tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.122739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336d1e17-bf2a-436e-a7e2-9e732cd967dc tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.123274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:54.128096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336d1e17-bf2a-436e-a7e2-9e732cd967dc tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.129008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-336d1e17-bf2a-436e-a7e2-9e732cd967dc tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.149854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:54.151625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:54.163961 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9141d98c-1d29-463a-8988-0c40d462c2f4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2747 microversion: 2.32 time: 0.444418 Oct 29 02:57:54.172050 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1498/3074] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:53 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2747 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:54.180229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f279438-a9f1-4806-bfb8-cf97069e0cff tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:54.180971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f279438-a9f1-4806-bfb8-cf97069e0cff tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:54.200286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f279438-a9f1-4806-bfb8-cf97069e0cff tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.203965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f279438-a9f1-4806-bfb8-cf97069e0cff tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.204554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f279438-a9f1-4806-bfb8-cf97069e0cff tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.205359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f279438-a9f1-4806-bfb8-cf97069e0cff tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.207357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f279438-a9f1-4806-bfb8-cf97069e0cff tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.209005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f279438-a9f1-4806-bfb8-cf97069e0cff tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.578871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8f279438-a9f1-4806-bfb8-cf97069e0cff tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:54.590812 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f279438-a9f1-4806-bfb8-cf97069e0cff tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.422519 Oct 29 02:57:54.591707 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1499/3075] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:54 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:54.599642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d5990645-7a7f-40bb-b056-ef7f8178fd9e req-fcf70cca-bdef-4b50-9ead-fac30cae0981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf06ee37-7622-4404-bfee-79b4e59a6f07", "name": "network-vif-deleted", "tag": "357b9302-4bc7-4e44-8013-6ea636c939aa"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:54.641471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d5990645-7a7f-40bb-b056-ef7f8178fd9e req-fcf70cca-bdef-4b50-9ead-fac30cae0981 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.645515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d5990645-7a7f-40bb-b056-ef7f8178fd9e req-fcf70cca-bdef-4b50-9ead-fac30cae0981 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.647459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d5990645-7a7f-40bb-b056-ef7f8178fd9e req-fcf70cca-bdef-4b50-9ead-fac30cae0981 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.690925 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d5990645-7a7f-40bb-b056-ef7f8178fd9e req-fcf70cca-bdef-4b50-9ead-fac30cae0981 service nova] Creating event network-vif-deleted:357b9302-4bc7-4e44-8013-6ea636c939aa for instance cf06ee37-7622-4404-bfee-79b4e59a6f07 on n-h1-862964-4 Oct 29 02:57:54.707478 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d5990645-7a7f-40bb-b056-ef7f8178fd9e req-fcf70cca-bdef-4b50-9ead-fac30cae0981 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109222 Oct 29 02:57:54.708340 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1500/3076] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:54.739889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-52b3c2ee-4ed9-4e4f-91f7-e24753926fbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:54.740696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-52b3c2ee-4ed9-4e4f-91f7-e24753926fbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:54.759891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52b3c2ee-4ed9-4e4f-91f7-e24753926fbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.761931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52b3c2ee-4ed9-4e4f-91f7-e24753926fbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.762571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52b3c2ee-4ed9-4e4f-91f7-e24753926fbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.779735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52b3c2ee-4ed9-4e4f-91f7-e24753926fbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.780828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52b3c2ee-4ed9-4e4f-91f7-e24753926fbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.781609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52b3c2ee-4ed9-4e4f-91f7-e24753926fbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.941707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52b3c2ee-4ed9-4e4f-91f7-e24753926fbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:54.960834 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-52b3c2ee-4ed9-4e4f-91f7-e24753926fbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1237 microversion: 2.1 time: 0.225280 Oct 29 02:57:54.967026 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1501/3077] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:54 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1237 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:55.097282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:55.098638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:55.120405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.123352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.124127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.125117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.125765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.126425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.255196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.256075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.256598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.257492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lazy-loading 'fault' on Instance uuid cf06ee37-7622-4404-bfee-79b4e59a6f07 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:57:55.334000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:55.343071 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a00a70d3-3cc5-460f-abbb-59c112a1f441 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 200 len: 1306 microversion: 2.1 time: 0.250003 Oct 29 02:57:55.343843 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1502/3078] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:55 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 1306 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:55.351406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:55.353053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:55.370288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.371216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.371904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.373047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.374007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.374676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.615748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:55.631726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:55.636169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:55.638824 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5693c913-433f-4a6d-be14-8b67cf335d70 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2747 microversion: 2.32 time: 0.293903 Oct 29 02:57:55.640970 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1503/3079] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:55 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2747 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:55.667394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-13512744-e2b9-4a6e-8d38-4d2878ea1bd6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:55.668800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-13512744-e2b9-4a6e-8d38-4d2878ea1bd6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:55.686004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13512744-e2b9-4a6e-8d38-4d2878ea1bd6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.686700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13512744-e2b9-4a6e-8d38-4d2878ea1bd6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.687987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13512744-e2b9-4a6e-8d38-4d2878ea1bd6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.690274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13512744-e2b9-4a6e-8d38-4d2878ea1bd6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.691688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13512744-e2b9-4a6e-8d38-4d2878ea1bd6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.692811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13512744-e2b9-4a6e-8d38-4d2878ea1bd6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.731863 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-336d1e17-bf2a-436e-a7e2-9e732cd967dc tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1613 microversion: 2.1 time: 1.645152 Oct 29 02:57:55.742745 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1577/3080] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:54 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1613 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:55.764941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-483d570a-fd29-48e0-9141-bc4d3a17d462 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:55.783652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-483d570a-fd29-48e0-9141-bc4d3a17d462 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Searching by: {'host': 'n-h1-862964-4', 'deleted': False} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:57:55.790475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-483d570a-fd29-48e0-9141-bc4d3a17d462 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.791895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-483d570a-fd29-48e0-9141-bc4d3a17d462 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.792900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-483d570a-fd29-48e0-9141-bc4d3a17d462 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.794502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-483d570a-fd29-48e0-9141-bc4d3a17d462 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.795202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-483d570a-fd29-48e0-9141-bc4d3a17d462 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.795851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-483d570a-fd29-48e0-9141-bc4d3a17d462 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.971610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-13512744-e2b9-4a6e-8d38-4d2878ea1bd6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:55.983960 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-13512744-e2b9-4a6e-8d38-4d2878ea1bd6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.327048 Oct 29 02:57:55.985010 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1504/3081] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:55 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:56.005304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-483d570a-fd29-48e0-9141-bc4d3a17d462 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:57:56.095588 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-483d570a-fd29-48e0-9141-bc4d3a17d462 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=n-h1-862964-4&all_tenants=1" status: 200 len: 1311 microversion: 2.1 time: 0.334199 Oct 29 02:57:56.106042 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1578/3082] 10.222.0.16 () {58 vars in 1190 bytes} [Sat Oct 29 02:57:55 2022] GET /compute/v2.1/servers?host=n-h1-862964-4&all_tenants=1 => generated 1311 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:56.118482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d816e4fd-1699-44bb-bc84-2e7119cd0e3c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:56.119963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d816e4fd-1699-44bb-bc84-2e7119cd0e3c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:56.132907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d816e4fd-1699-44bb-bc84-2e7119cd0e3c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.133970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d816e4fd-1699-44bb-bc84-2e7119cd0e3c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.134904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d816e4fd-1699-44bb-bc84-2e7119cd0e3c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.135877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d816e4fd-1699-44bb-bc84-2e7119cd0e3c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.137251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d816e4fd-1699-44bb-bc84-2e7119cd0e3c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.138569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d816e4fd-1699-44bb-bc84-2e7119cd0e3c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.235524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1533234898", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": "none"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:56.299745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:56.300164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:56.300622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:56.301367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:56.301774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:56.311823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.312292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.312711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.313414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.314020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.314431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.349069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Getting quotas for project 34130dd0aa5d43c9846cf1a7fdb8d27d. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:56.357725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Getting quotas for user a1c2e0d8efb54a128b52722a2dcb3d7b and project 34130dd0aa5d43c9846cf1a7fdb8d27d. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:56.375756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:56.377376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:56.380133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: e73b32c1-3d4e-434c-9369-3fade59133b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:56.446178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b9a0902e-4a04-4e58-bf60-84e847d7086b tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.459591 Oct 29 02:57:56.446860 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1505/3083] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:57:56.460957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-22e748f4-3301-4119-96df-e72e8c93f35c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:56.471541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-22e748f4-3301-4119-96df-e72e8c93f35c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:57:56.509104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22e748f4-3301-4119-96df-e72e8c93f35c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.510137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22e748f4-3301-4119-96df-e72e8c93f35c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.512230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22e748f4-3301-4119-96df-e72e8c93f35c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.514745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22e748f4-3301-4119-96df-e72e8c93f35c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.515957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22e748f4-3301-4119-96df-e72e8c93f35c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.516436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22e748f4-3301-4119-96df-e72e8c93f35c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.538489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d816e4fd-1699-44bb-bc84-2e7119cd0e3c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:56.579438 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d816e4fd-1699-44bb-bc84-2e7119cd0e3c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1237 microversion: 2.1 time: 0.469999 Oct 29 02:57:56.580202 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1579/3084] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:56 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1237 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:56.584973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:56.585756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:56.598264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.608169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.609142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.610593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.611569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.612483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.648474 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 HTTP/1.1 Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'cf06ee37-7622-4404-bfee-79b4e59a6f07'} Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:56.651391 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:56.658212 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:56.658212 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:56.658212 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:56.658212 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:56.658212 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:56.658212 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:57:56.658212 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:57:56.659514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:56.660547 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1186a510-49e5-41e7-9540-cdcfb95c1479 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 404 len: 111 microversion: 2.1 time: 0.079261 Oct 29 02:57:56.661582 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1580/3085] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:56 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:56.671531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8644a263-c77e-4b70-9146-cf2b5a4d0588 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:56.677456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8644a263-c77e-4b70-9146-cf2b5a4d0588 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: e73b32c1-3d4e-434c-9369-3fade59133b3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:56.730264 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-22e748f4-3301-4119-96df-e72e8c93f35c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.282197 Oct 29 02:57:56.740677 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1506/3086] 10.222.0.16 () {58 vars in 1196 bytes} [Sat Oct 29 02:57:56 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:57:56.740677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f424bf07-eb73-4eea-aae8-070eb7bb4ed0 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1acb9d040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:56.800484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8644a263-c77e-4b70-9146-cf2b5a4d0588 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:56.825367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8644a263-c77e-4b70-9146-cf2b5a4d0588 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:56.827223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8644a263-c77e-4b70-9146-cf2b5a4d0588 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:56.828501 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8644a263-c77e-4b70-9146-cf2b5a4d0588 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3" status: 200 len: 1278 microversion: 2.47 time: 0.165798 Oct 29 02:57:56.831326 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1581/3087] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:56 2022] GET /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:56.843036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:56.847900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:56.855531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.856323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.856987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.857917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.858569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.859211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:57.179597 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f424bf07-eb73-4eea-aae8-070eb7bb4ed0 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8faae7dd-fbaf-4085-b967-3c5356fea5aa" status: 202 len: 0 microversion: 2.1 time: 0.446135 Oct 29 02:57:57.181216 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1507/3088] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:57:56 2022] DELETE /compute/v2.1/os-security-groups/8faae7dd-fbaf-4085-b967-3c5356fea5aa => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:57.190371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb1fd9c4-800d-464f-8142-a88885cea951 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:57.194157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bb1fd9c4-800d-464f-8142-a88885cea951 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:57.216248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb1fd9c4-800d-464f-8142-a88885cea951 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:57.230463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb1fd9c4-800d-464f-8142-a88885cea951 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:57.236741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb1fd9c4-800d-464f-8142-a88885cea951 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:57.238887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb1fd9c4-800d-464f-8142-a88885cea951 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:57.239828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb1fd9c4-800d-464f-8142-a88885cea951 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:57.240355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb1fd9c4-800d-464f-8142-a88885cea951 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:57.420066 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb1fd9c4-800d-464f-8142-a88885cea951 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action" status: 202 len: 0 microversion: 2.1 time: 0.235858 Oct 29 02:57:57.421923 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1508/3089] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:57 2022] POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:57.427120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-649089561", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": "none"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:57.567189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:57.567752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:57.568340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:57.568878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:57.569383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:57.611119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:57.611636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:57.612093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:57.612915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:57.614999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:57.616697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:57.617157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:57.645994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:57.647519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:57.655717 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b0489ead-fa2d-4881-a185-7bc6a5862b2b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2747 microversion: 2.32 time: 0.820224 Oct 29 02:57:57.664135 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1582/3090] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:56 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2747 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:57.701284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a03e4c8c-277c-46e2-8d7e-609785b4ef2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:57.702724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a03e4c8c-277c-46e2-8d7e-609785b4ef2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:57.704303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Getting quotas for project 34130dd0aa5d43c9846cf1a7fdb8d27d. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:57.718922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a03e4c8c-277c-46e2-8d7e-609785b4ef2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:57.719620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a03e4c8c-277c-46e2-8d7e-609785b4ef2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:57.720208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a03e4c8c-277c-46e2-8d7e-609785b4ef2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:57.721172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a03e4c8c-277c-46e2-8d7e-609785b4ef2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:57.722614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a03e4c8c-277c-46e2-8d7e-609785b4ef2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:57.723196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a03e4c8c-277c-46e2-8d7e-609785b4ef2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:57.725610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Getting quotas for user a1c2e0d8efb54a128b52722a2dcb3d7b and project 34130dd0aa5d43c9846cf1a7fdb8d27d. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:57.775574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:57.785223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:57.910026 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7185d2fb-4419-4995-b185-24bf66f2e198 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.486582 Oct 29 02:57:57.923950 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1509/3091] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:57:57.937328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a7038e1-47ad-48f2-907d-9e30755de47c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1acbac550>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:58.252402 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1a7038e1-47ad-48f2-907d-9e30755de47c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f6a31395-ecaf-46ae-bbc2-c5b659401dbd" status: 202 len: 0 microversion: 2.1 time: 0.327125 Oct 29 02:57:58.261466 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1510/3092] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:57:57 2022] DELETE /compute/v2.1/os-security-groups/f6a31395-ecaf-46ae-bbc2-c5b659401dbd => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:58.268005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:58.278171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:58.289850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.295104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.295793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.296749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.297519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.298180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.429558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a03e4c8c-277c-46e2-8d7e-609785b4ef2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:58.456182 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a03e4c8c-277c-46e2-8d7e-609785b4ef2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.781184 Oct 29 02:57:58.457246 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1583/3093] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:57 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:58.505105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bddd9a18-e827-43d3-9a30-ed23180f607b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:58.508168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bddd9a18-e827-43d3-9a30-ed23180f607b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:58.526050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bddd9a18-e827-43d3-9a30-ed23180f607b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.528130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bddd9a18-e827-43d3-9a30-ed23180f607b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.529158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bddd9a18-e827-43d3-9a30-ed23180f607b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.531331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bddd9a18-e827-43d3-9a30-ed23180f607b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.533035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:58.534042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bddd9a18-e827-43d3-9a30-ed23180f607b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.535548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bddd9a18-e827-43d3-9a30-ed23180f607b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.536041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:58.538740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:58.540111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:58.541164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:58.768597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:58.795923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.797361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.798088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.802466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.803527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.804461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.883337 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9f1b6313-24ac-428a-a54a-da906b7eec83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action" status: 202 len: 1066 microversion: 2.1 time: 0.619882 Oct 29 02:57:58.885097 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1511/3094] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:58 2022] POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action => generated 1066 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 02:57:58.892933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1499bb6b-ced6-4fa9-9429-9317a6ff8dc6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:58.895773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1499bb6b-ced6-4fa9-9429-9317a6ff8dc6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:59.037272 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1499bb6b-ced6-4fa9-9429-9317a6ff8dc6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "PUT /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 991 microversion: 2.47 time: 0.150018 Oct 29 02:57:59.046882 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1512/3095] 10.222.0.16 () {62 vars in 1297 bytes} [Sat Oct 29 02:57:58 2022] PUT /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 991 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:57:59.065356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d69c2fc9-0bb0-41dc-93aa-d2242e5d8917 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'create', calling method: .version_select at 0x7fe1acbc1a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-593787188", "description": "tempest-description-844519415"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:59.501715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bddd9a18-e827-43d3-9a30-ed23180f607b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:59.516663 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bddd9a18-e827-43d3-9a30-ed23180f607b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1304 microversion: 2.1 time: 1.023426 Oct 29 02:57:59.517384 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1584/3096] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:58 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1304 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:59.534313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:59.535020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:59.547406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:59.548318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:59.549406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:59.550390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:59.551098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:59.551733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:00.417527 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d69c2fc9-0bb0-41dc-93aa-d2242e5d8917 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.369218 Oct 29 02:58:00.419212 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1513/3097] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 02:57:59 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:00.424501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9531be49-fa6a-40cd-86c0-9972255f781f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:00.425533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9531be49-fa6a-40cd-86c0-9972255f781f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:00.440954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9531be49-fa6a-40cd-86c0-9972255f781f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:00.443662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9531be49-fa6a-40cd-86c0-9972255f781f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:00.445066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9531be49-fa6a-40cd-86c0-9972255f781f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:00.450240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9531be49-fa6a-40cd-86c0-9972255f781f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:00.451670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9531be49-fa6a-40cd-86c0-9972255f781f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:00.453143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9531be49-fa6a-40cd-86c0-9972255f781f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:00.676809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:00.692887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:00.698868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:00.706863 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ec97c2f6-7fe5-40a0-96dd-46131467151c tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2701 microversion: 2.32 time: 1.188221 Oct 29 02:58:00.710556 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1585/3098] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:59 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2701 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:00.763655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:00.764965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:00.784125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:00.786537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:00.789471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:00.790455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:00.791124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:00.792022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:00.958390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9531be49-fa6a-40cd-86c0-9972255f781f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:00.970163 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9531be49-fa6a-40cd-86c0-9972255f781f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1470 microversion: 2.1 time: 0.549428 Oct 29 02:58:00.971536 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1514/3099] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:00 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1470 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:00.978263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-77ba70b0-d3e8-4183-b273-17ca6f4548f9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:00.979248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-77ba70b0-d3e8-4183-b273-17ca6f4548f9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:00.992742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ba70b0-d3e8-4183-b273-17ca6f4548f9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:00.996223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ba70b0-d3e8-4183-b273-17ca6f4548f9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:00.996989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ba70b0-d3e8-4183-b273-17ca6f4548f9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:00.997997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ba70b0-d3e8-4183-b273-17ca6f4548f9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:00.998738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ba70b0-d3e8-4183-b273-17ca6f4548f9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:01.004174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ba70b0-d3e8-4183-b273-17ca6f4548f9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:01.037232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:01.054523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:01.056364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:01.059709 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0dd65ee2-2c01-4652-8cc3-ae1d6314aed6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1347 microversion: 2.47 time: 0.326352 Oct 29 02:58:01.060290 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1586/3100] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:00 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1347 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:01.085995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d020ab3d-31e1-4159-a6d1-4793de863f21 req-1d661a7d-a33b-445b-b883-bda35186f7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-deleted", "tag": "f9ad5c3b-d639-4b01-8092-245696df4798"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:01.122400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d020ab3d-31e1-4159-a6d1-4793de863f21 req-1d661a7d-a33b-445b-b883-bda35186f7d3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:01.122877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d020ab3d-31e1-4159-a6d1-4793de863f21 req-1d661a7d-a33b-445b-b883-bda35186f7d3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:01.123299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d020ab3d-31e1-4159-a6d1-4793de863f21 req-1d661a7d-a33b-445b-b883-bda35186f7d3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:01.171583 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d020ab3d-31e1-4159-a6d1-4793de863f21 req-1d661a7d-a33b-445b-b883-bda35186f7d3 service nova] Creating event network-vif-deleted:f9ad5c3b-d639-4b01-8092-245696df4798 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:58:01.185075 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d020ab3d-31e1-4159-a6d1-4793de863f21 req-1d661a7d-a33b-445b-b883-bda35186f7d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123516 Oct 29 02:58:01.187885 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1587/3101] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:01.200058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-41e6e026-999a-4c36-aa7b-e269093dec88 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Action: 'update', calling method: .version_select at 0x7fe1a3fda670>, body: {"security_group": {"name": "tempest-sg-hth-95086512", "description": "tempest-description-hth-1533203531"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:01.466597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77ba70b0-d3e8-4183-b273-17ca6f4548f9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:01.478302 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-77ba70b0-d3e8-4183-b273-17ca6f4548f9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.505378 Oct 29 02:58:01.478984 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1515/3102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:00 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:01.494689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-44bd534b-5b23-49ac-b570-d906cedd6d8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:01.496314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-44bd534b-5b23-49ac-b570-d906cedd6d8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:01.513439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-44bd534b-5b23-49ac-b570-d906cedd6d8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:01.513960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-44bd534b-5b23-49ac-b570-d906cedd6d8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:01.514389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-44bd534b-5b23-49ac-b570-d906cedd6d8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:01.515088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-44bd534b-5b23-49ac-b570-d906cedd6d8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:01.515530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-44bd534b-5b23-49ac-b570-d906cedd6d8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:01.515943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-44bd534b-5b23-49ac-b570-d906cedd6d8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:01.911940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-44bd534b-5b23-49ac-b570-d906cedd6d8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:01.926775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-44bd534b-5b23-49ac-b570-d906cedd6d8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1304 microversion: 2.1 time: 0.445083 Oct 29 02:58:01.927889 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1516/3103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:01 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1304 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:01.950283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:01.953588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:01.975194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:01.976889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:01.978419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:01.980485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:01.981645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:01.984706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:01.999247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:02.070378 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-41e6e026-999a-4c36-aa7b-e269093dec88 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/a6bb66db-aa15-4d13-97b4-deee106580ee" status: 200 len: 216 microversion: 2.1 time: 0.879589 Oct 29 02:58:02.071852 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1588/3104] 10.222.0.16 () {60 vars in 1290 bytes} [Sat Oct 29 02:58:01 2022] PUT /compute/v2.1/os-security-groups/a6bb66db-aa15-4d13-97b4-deee106580ee => generated 216 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:02.077259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-69733963-bd1b-42c9-8721-46d6c102f79c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:02.078291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-69733963-bd1b-42c9-8721-46d6c102f79c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:02.106053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69733963-bd1b-42c9-8721-46d6c102f79c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:02.106900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69733963-bd1b-42c9-8721-46d6c102f79c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:02.109366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69733963-bd1b-42c9-8721-46d6c102f79c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:02.111348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69733963-bd1b-42c9-8721-46d6c102f79c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:02.116322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69733963-bd1b-42c9-8721-46d6c102f79c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:02.121256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69733963-bd1b-42c9-8721-46d6c102f79c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:02.240763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:02.456271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:02.480167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:02.486224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:02.491353 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e8dcab20-c3c5-4e9b-a41a-219a50bebd3b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2415 microversion: 2.32 time: 0.558967 Oct 29 02:58:02.494467 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1517/3105] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:01 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2415 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:02.544606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b81bc1db-3823-4cf0-8edb-435c4625059b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a8389430>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:02.679041 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b81bc1db-3823-4cf0-8edb-435c4625059b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/a6bb66db-aa15-4d13-97b4-deee106580ee" status: 200 len: 216 microversion: 2.1 time: 0.147123 Oct 29 02:58:02.680079 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1518/3106] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 02:58:02 2022] GET /compute/v2.1/os-security-groups/a6bb66db-aa15-4d13-97b4-deee106580ee => generated 216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:02.686046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:02.686850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:02.722598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:02.723298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:02.723864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:02.724706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:02.725264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:02.725789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:02.892785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:02.901581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:02.907757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:02.908949 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4453a709-359a-4289-86b2-a829ea5558c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1335 microversion: 2.47 time: 0.227777 Oct 29 02:58:02.913947 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1519/3107] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:02 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1335 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:02.919249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-437641e8-307e-4c38-aec3-0f206c29ac07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:02.931308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-437641e8-307e-4c38-aec3-0f206c29ac07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:02.937894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-437641e8-307e-4c38-aec3-0f206c29ac07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:02.938477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-437641e8-307e-4c38-aec3-0f206c29ac07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:02.938801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-437641e8-307e-4c38-aec3-0f206c29ac07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:02.939491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-437641e8-307e-4c38-aec3-0f206c29ac07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:02.939929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-437641e8-307e-4c38-aec3-0f206c29ac07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:02.940337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-437641e8-307e-4c38-aec3-0f206c29ac07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:03.256337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-437641e8-307e-4c38-aec3-0f206c29ac07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:03.267856 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-437641e8-307e-4c38-aec3-0f206c29ac07 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.351398 Oct 29 02:58:03.268149 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1520/3108] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:02 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:03.282056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5c9c851e-0e07-4322-9151-554ca905c46c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a8374160>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:03.537990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-69733963-bd1b-42c9-8721-46d6c102f79c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:03.551331 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-69733963-bd1b-42c9-8721-46d6c102f79c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1470 microversion: 2.1 time: 1.478002 Oct 29 02:58:03.552213 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1589/3109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:02 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1470 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:03.557431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02914f1f-a3bc-4cd2-9b7e-d78e5eaf9421 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:03.562641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-02914f1f-a3bc-4cd2-9b7e-d78e5eaf9421 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:03.575806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02914f1f-a3bc-4cd2-9b7e-d78e5eaf9421 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:03.579504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02914f1f-a3bc-4cd2-9b7e-d78e5eaf9421 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:03.579966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02914f1f-a3bc-4cd2-9b7e-d78e5eaf9421 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:03.580712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02914f1f-a3bc-4cd2-9b7e-d78e5eaf9421 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:03.581176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02914f1f-a3bc-4cd2-9b7e-d78e5eaf9421 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:03.581605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02914f1f-a3bc-4cd2-9b7e-d78e5eaf9421 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:03.661678 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5c9c851e-0e07-4322-9151-554ca905c46c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a6bb66db-aa15-4d13-97b4-deee106580ee" status: 202 len: 0 microversion: 2.1 time: 0.390140 Oct 29 02:58:03.666119 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1521/3110] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:58:03 2022] DELETE /compute/v2.1/os-security-groups/a6bb66db-aa15-4d13-97b4-deee106580ee => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:58:03.783950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1106547538", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "54dde218-6f22-4df8-8157-eed1e513483c"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:03.882164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] validate_networks() for [('54dde218-6f22-4df8-8157-eed1e513483c', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:58:04.186962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02914f1f-a3bc-4cd2-9b7e-d78e5eaf9421 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:04.200627 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02914f1f-a3bc-4cd2-9b7e-d78e5eaf9421 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1304 microversion: 2.1 time: 0.646734 Oct 29 02:58:04.201400 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1590/3111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:03 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1304 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:04.208818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-642c8425-31e4-4b0f-888b-6e7f368f2a58 req-c4062995-2c65-48fb-9d9f-5169c41df471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b13893-1eca-43c0-b826-a35650183201", "tag": "82024e5d-6393-4421-bd98-5bae0e521412"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:04.252177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-642c8425-31e4-4b0f-888b-6e7f368f2a58 req-c4062995-2c65-48fb-9d9f-5169c41df471 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.252842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-642c8425-31e4-4b0f-888b-6e7f368f2a58 req-c4062995-2c65-48fb-9d9f-5169c41df471 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.266410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-642c8425-31e4-4b0f-888b-6e7f368f2a58 req-c4062995-2c65-48fb-9d9f-5169c41df471 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.286988 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-642c8425-31e4-4b0f-888b-6e7f368f2a58 req-c4062995-2c65-48fb-9d9f-5169c41df471 service nova] Creating event network-changed:82024e5d-6393-4421-bd98-5bae0e521412 for instance e1b13893-1eca-43c0-b826-a35650183201 on n-h2-862964-4 Oct 29 02:58:04.293313 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-642c8425-31e4-4b0f-888b-6e7f368f2a58 req-c4062995-2c65-48fb-9d9f-5169c41df471 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090348 Oct 29 02:58:04.294514 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1591/3112] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:04.301217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:04.301987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:04.310863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.311571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.312017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.312740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.313280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.314062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.575957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:58:04.576455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:58:04.578155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:58:04.578864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:58:04.579517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:58:04.592882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.593685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.594150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.597625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.598732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.598732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.623236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Getting quotas for project 2541b0313460463f87257f0cc735f973. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:58:04.629509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Getting quotas for user 7518ee5c6e334b768c9881ebb6e30559 and project 2541b0313460463f87257f0cc735f973. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:58:04.646278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:58:04.649195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:58:04.724558 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5623a166-2995-4191-8746-c812d8ec1beb tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057045 Oct 29 02:58:04.725966 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1522/3113] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:58:04.733707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:04.734283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:04.745202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.745202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.745202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.745858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.746323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.746919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.762449 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 HTTP/1.1 Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cf06ee37-7622-4404-bfee-79b4e59a6f07'} Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:04.764172 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f75e2ca6-2596-4ca8-8a7c-05867a1eff62 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 404 len: 111 microversion: 2.1 time: 0.038536 Oct 29 02:58:04.768948 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1523/3114] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:58:04 2022] DELETE /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:04.774058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:04.774679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:04.784268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:04.786186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.787387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.787986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.788860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.789466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.790060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.801383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:04.802771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:04.804016 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-88eeee4c-f499-4a15-bc58-5aa23bf20d2f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2369 microversion: 2.32 time: 0.508392 Oct 29 02:58:04.837950 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1592/3115] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:04 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2369 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:04.843118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a4956a0-7436-4466-a172-5dcc2127d74d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:04.843688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5a4956a0-7436-4466-a172-5dcc2127d74d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:04.866846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a4956a0-7436-4466-a172-5dcc2127d74d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.867297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a4956a0-7436-4466-a172-5dcc2127d74d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.867747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a4956a0-7436-4466-a172-5dcc2127d74d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.879294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a4956a0-7436-4466-a172-5dcc2127d74d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.879650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a4956a0-7436-4466-a172-5dcc2127d74d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.880302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a4956a0-7436-4466-a172-5dcc2127d74d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.894223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:04.904010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:04.906117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:04.907676 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-60079c4b-8583-4599-84a3-e6165bdb8b5f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1356 microversion: 2.47 time: 0.140023 Oct 29 02:58:04.908411 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1524/3116] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:04 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1356 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:04.935010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb62ea21-6729-40b9-be68-359a5a10f4cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:04.938973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bb62ea21-6729-40b9-be68-359a5a10f4cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:04.945858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb62ea21-6729-40b9-be68-359a5a10f4cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.946440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb62ea21-6729-40b9-be68-359a5a10f4cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.946937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb62ea21-6729-40b9-be68-359a5a10f4cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.947690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb62ea21-6729-40b9-be68-359a5a10f4cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.948135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb62ea21-6729-40b9-be68-359a5a10f4cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.948555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb62ea21-6729-40b9-be68-359a5a10f4cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:05.115230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5a4956a0-7436-4466-a172-5dcc2127d74d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:05.125518 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5a4956a0-7436-4466-a172-5dcc2127d74d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.286299 Oct 29 02:58:05.127930 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1593/3117] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:04 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:05.148010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bb62ea21-6729-40b9-be68-359a5a10f4cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:05.151587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0cfb87d2-76d1-4651-a337-601eda412e7c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:05.152484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0cfb87d2-76d1-4651-a337-601eda412e7c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:05.167350 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb62ea21-6729-40b9-be68-359a5a10f4cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1470 microversion: 2.1 time: 0.247410 Oct 29 02:58:05.172894 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1525/3118] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:04 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1470 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:05.179727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:05.181130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cf06ee37-7622-4404-bfee-79b4e59a6f07] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:05.223318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:05.225186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:05.226261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:05.227002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:05.229044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:05.229476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:05.269616 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 HTTP/1.1 Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cf06ee37-7622-4404-bfee-79b4e59a6f07'} Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:05.271220 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.275903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:05.275903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:05.275903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:05.275903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:05.275903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:05.275903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. Oct 29 02:58:05.275903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.275903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Instance cf06ee37-7622-4404-bfee-79b4e59a6f07 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:05.275903 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-883ae724-5a9f-4e64-8fcd-989aa205d229 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07" status: 404 len: 111 microversion: 2.1 time: 0.098616 Oct 29 02:58:05.275903 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1526/3119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:05 2022] GET /compute/v2.1/servers/cf06ee37-7622-4404-bfee-79b4e59a6f07 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:05.279204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:05.293184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0cfb87d2-76d1-4651-a337-601eda412e7c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:05.293873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:05.300752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:05.301459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:05.302108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:05.302882 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0cfb87d2-76d1-4651-a337-601eda412e7c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1216 microversion: 2.1 time: 0.171864 Oct 29 02:58:05.303504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:05.304218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:05.304975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:05.305338 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1594/3120] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:05 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1216 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:05.332127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0f77d83-85e2-489f-928c-177936538e8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:05.335201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d0f77d83-85e2-489f-928c-177936538e8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:05.353408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0f77d83-85e2-489f-928c-177936538e8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:05.356928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0f77d83-85e2-489f-928c-177936538e8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:05.359095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0f77d83-85e2-489f-928c-177936538e8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:05.362013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0f77d83-85e2-489f-928c-177936538e8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:05.363193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0f77d83-85e2-489f-928c-177936538e8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:05.364876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0f77d83-85e2-489f-928c-177936538e8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:05.504664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:58:05.505089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:58:05.506352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:58:05.507555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:58:05.509217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:58:05.596902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:05.613472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:05.614600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:05.615231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:05.618115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:05.618590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:05.619390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:05.678950 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cf77a22a-7d2a-4d61-b64e-570bfa307464 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "POST /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43/action" status: 202 len: 1078 microversion: 2.47 time: 0.404362 Oct 29 02:58:05.680259 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1527/3121] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 02:58:05 2022] POST /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43/action => generated 1078 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 02:58:05.685643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b8524000-127b-4f45-8ae1-006fb9376ec9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1acbc4310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:05.715352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG neutronclient.v2_0.client [None req-b8524000-127b-4f45-8ae1-006fb9376ec9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f6a31395-ecaf-46ae-bbc2-c5b659401dbd does not exist", "detail": ""}} {{(pid=127042) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:58:05.716795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.security_group_api [None req-b8524000-127b-4f45-8ae1-006fb9376ec9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Neutron security group f6a31395-ecaf-46ae-bbc2-c5b659401dbd not found {{(pid=127042) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:58:05.717591 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-b8524000-127b-4f45-8ae1-006fb9376ec9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security group f6a31395-ecaf-46ae-bbc2-c5b659401dbd does not exist Oct 29 02:58:05.717591 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-97e85a97-2785-4d07-ab45-1ff9db550f73'] Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b8524000-127b-4f45-8ae1-006fb9376ec9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-security-groups/f6a31395-ecaf-46ae-bbc2-c5b659401dbd HTTP/1.1 Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: exception: Security group f6a31395-ecaf-46ae-bbc2-c5b659401dbd does not exist Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-97e85a97-2785-4d07-ab45-1ff9db550f73'] Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'f6a31395-ecaf-46ae-bbc2-c5b659401dbd'} Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:58:05.719674 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f6a31395-ecaf-46ae-bbc2-c5b659401dbd does not exist Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97e85a97-2785-4d07-ab45-1ff9db550f73'] Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f6a31395-ecaf-46ae-bbc2-c5b659401dbd does not exist Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97e85a97-2785-4d07-ab45-1ff9db550f73'] Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f6a31395-ecaf-46ae-bbc2-c5b659401dbd does not exist Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97e85a97-2785-4d07-ab45-1ff9db550f73'] Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f6a31395-ecaf-46ae-bbc2-c5b659401dbd does not exist Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97e85a97-2785-4d07-ab45-1ff9db550f73'] Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b8524000-127b-4f45-8ae1-006fb9376ec9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Security group f6a31395-ecaf-46ae-bbc2-c5b659401dbd does not exist Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-97e85a97-2785-4d07-ab45-1ff9db550f73'] {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b8524000-127b-4f45-8ae1-006fb9376ec9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f6a31395-ecaf-46ae-bbc2-c5b659401dbd" status: 404 len: 194 microversion: 2.1 time: 0.039536 Oct 29 02:58:05.724209 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1528/3122] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:58:05 2022] DELETE /compute/v2.1/os-security-groups/f6a31395-ecaf-46ae-bbc2-c5b659401dbd => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:05.728506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:05.728506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:05.866644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:05.947726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0f77d83-85e2-489f-928c-177936538e8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:05.977102 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d0f77d83-85e2-489f-928c-177936538e8b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1292 microversion: 2.1 time: 0.669588 Oct 29 02:58:05.999728 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1595/3123] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:05 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1292 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:06.018933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bbebf9a7-f761-40d6-822e-6f4efa530345 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a87888b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:06.146352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-bbebf9a7-f761-40d6-822e-6f4efa530345 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8faae7dd-fbaf-4085-b967-3c5356fea5aa does not exist", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:58:06.147022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.security_group_api [None req-bbebf9a7-f761-40d6-822e-6f4efa530345 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Neutron security group 8faae7dd-fbaf-4085-b967-3c5356fea5aa not found {{(pid=127041) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:58:06.147546 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-bbebf9a7-f761-40d6-822e-6f4efa530345 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security group 8faae7dd-fbaf-4085-b967-3c5356fea5aa does not exist Oct 29 02:58:06.147546 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-fbc3786d-d6d5-4a37-8038-f07fd38a1781'] Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bbebf9a7-f761-40d6-822e-6f4efa530345 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-security-groups/8faae7dd-fbaf-4085-b967-3c5356fea5aa HTTP/1.1 Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: exception: Security group 8faae7dd-fbaf-4085-b967-3c5356fea5aa does not exist Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-fbc3786d-d6d5-4a37-8038-f07fd38a1781'] Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '8faae7dd-fbaf-4085-b967-3c5356fea5aa'} Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:58:06.149501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8faae7dd-fbaf-4085-b967-3c5356fea5aa does not exist Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc3786d-d6d5-4a37-8038-f07fd38a1781'] Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8faae7dd-fbaf-4085-b967-3c5356fea5aa does not exist Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc3786d-d6d5-4a37-8038-f07fd38a1781'] Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8faae7dd-fbaf-4085-b967-3c5356fea5aa does not exist Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc3786d-d6d5-4a37-8038-f07fd38a1781'] Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8faae7dd-fbaf-4085-b967-3c5356fea5aa does not exist Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbc3786d-d6d5-4a37-8038-f07fd38a1781'] Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bbebf9a7-f761-40d6-822e-6f4efa530345 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Security group 8faae7dd-fbaf-4085-b967-3c5356fea5aa does not exist Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-fbc3786d-d6d5-4a37-8038-f07fd38a1781'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bbebf9a7-f761-40d6-822e-6f4efa530345 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8faae7dd-fbaf-4085-b967-3c5356fea5aa" status: 404 len: 194 microversion: 2.1 time: 0.148445 Oct 29 02:58:06.153426 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1596/3124] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:58:05 2022] DELETE /compute/v2.1/os-security-groups/8faae7dd-fbaf-4085-b967-3c5356fea5aa => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:06.156569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:06.160942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:06.195323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.196376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.196838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:06.197683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.198175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.198592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:06.238842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.239335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.240045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:06.242345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.242837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.243269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:06.386690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:06.397308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:06.398781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:06.400072 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6a46f98e-49da-47e0-ad4a-367ed8ab3e3f tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.677605 Oct 29 02:58:06.410179 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1529/3125] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:05 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:06.421583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-05b62224-6e13-47cd-bdd9-b642006ed444 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:06.422492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-05b62224-6e13-47cd-bdd9-b642006ed444 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:06.429525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05b62224-6e13-47cd-bdd9-b642006ed444 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.430246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05b62224-6e13-47cd-bdd9-b642006ed444 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.431077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05b62224-6e13-47cd-bdd9-b642006ed444 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:06.432268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05b62224-6e13-47cd-bdd9-b642006ed444 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.432875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05b62224-6e13-47cd-bdd9-b642006ed444 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.433453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05b62224-6e13-47cd-bdd9-b642006ed444 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:06.716882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05b62224-6e13-47cd-bdd9-b642006ed444 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:06.729743 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-05b62224-6e13-47cd-bdd9-b642006ed444 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.317932 Oct 29 02:58:06.747091 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1530/3126] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:06 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:06.757207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dccc18dc-46bf-48d9-8f9d-d21b713d084c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1acb9d670>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:06.830094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:06.830712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG neutronclient.v2_0.client [None req-dccc18dc-46bf-48d9-8f9d-d21b713d084c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist", "detail": ""}} {{(pid=127042) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:58:06.831331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.security_group_api [None req-dccc18dc-46bf-48d9-8f9d-d21b713d084c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Neutron security group 1245e02d-82cc-4217-ba83-825fbada73ca not found {{(pid=127042) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:58:06.831847 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-dccc18dc-46bf-48d9-8f9d-d21b713d084c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:58:06.831847 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-a61bb48b-8de3-4e3e-b6bc-58165b30317f'] Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dccc18dc-46bf-48d9-8f9d-d21b713d084c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-security-groups/1245e02d-82cc-4217-ba83-825fbada73ca HTTP/1.1 Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: exception: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-a61bb48b-8de3-4e3e-b6bc-58165b30317f'] Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1245e02d-82cc-4217-ba83-825fbada73ca'} Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:58:06.834863 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a61bb48b-8de3-4e3e-b6bc-58165b30317f'] Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a61bb48b-8de3-4e3e-b6bc-58165b30317f'] Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a61bb48b-8de3-4e3e-b6bc-58165b30317f'] Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a61bb48b-8de3-4e3e-b6bc-58165b30317f'] Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dccc18dc-46bf-48d9-8f9d-d21b713d084c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Security group 1245e02d-82cc-4217-ba83-825fbada73ca does not exist Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-a61bb48b-8de3-4e3e-b6bc-58165b30317f'] {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dccc18dc-46bf-48d9-8f9d-d21b713d084c tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/1245e02d-82cc-4217-ba83-825fbada73ca" status: 404 len: 194 microversion: 2.1 time: 0.086910 Oct 29 02:58:06.841459 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1531/3127] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:58:06 2022] DELETE /compute/v2.1/os-security-groups/1245e02d-82cc-4217-ba83-825fbada73ca => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:06.844099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e19ca59e-223a-420e-8f38-3709a8373554 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:06.844371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:06.848181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e19ca59e-223a-420e-8f38-3709a8373554 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:06.848534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:06.850362 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2f4fbc48-452c-4644-9a74-a26be16ec42b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 2323 microversion: 2.32 time: 0.697299 Oct 29 02:58:06.854411 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1597/3128] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:06 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 2323 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:06.860905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e19ca59e-223a-420e-8f38-3709a8373554 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.864075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e19ca59e-223a-420e-8f38-3709a8373554 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.864739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e19ca59e-223a-420e-8f38-3709a8373554 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:06.865621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e19ca59e-223a-420e-8f38-3709a8373554 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.866326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e19ca59e-223a-420e-8f38-3709a8373554 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.866909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e19ca59e-223a-420e-8f38-3709a8373554 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:06.885210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ee3dd9fd-8b75-4df3-9f9b-a38553915bbc tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:06.885979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ee3dd9fd-8b75-4df3-9f9b-a38553915bbc tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:06.904318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee3dd9fd-8b75-4df3-9f9b-a38553915bbc tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.905882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee3dd9fd-8b75-4df3-9f9b-a38553915bbc tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.907234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee3dd9fd-8b75-4df3-9f9b-a38553915bbc tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:06.918382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee3dd9fd-8b75-4df3-9f9b-a38553915bbc tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.918926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee3dd9fd-8b75-4df3-9f9b-a38553915bbc tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.919367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee3dd9fd-8b75-4df3-9f9b-a38553915bbc tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.081403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ee3dd9fd-8b75-4df3-9f9b-a38553915bbc tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:07.092948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e19ca59e-223a-420e-8f38-3709a8373554 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:07.093833 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ee3dd9fd-8b75-4df3-9f9b-a38553915bbc tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1268 microversion: 2.1 time: 0.237935 Oct 29 02:58:07.096654 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1598/3129] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:06 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1268 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:07.104749 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e19ca59e-223a-420e-8f38-3709a8373554 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1470 microversion: 2.1 time: 0.265268 Oct 29 02:58:07.105197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8e02f664-109d-4235-b72d-a465d136c9cb req-4be736bc-8c19-4950-adbc-df14eb88466e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-deleted", "tag": "767f0367-bff9-4f07-ac30-bfe344612d57"}, {"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-deleted", "tag": "f768439c-3452-4070-b9fe-dc99900a9aba"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:07.113890 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1532/3130] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:06 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:07.113890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f9037e46-fc15-41e9-8b60-9e3d607a3504 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1acb9d790>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:07.136974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8e02f664-109d-4235-b72d-a465d136c9cb req-4be736bc-8c19-4950-adbc-df14eb88466e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.137561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8e02f664-109d-4235-b72d-a465d136c9cb req-4be736bc-8c19-4950-adbc-df14eb88466e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.138266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8e02f664-109d-4235-b72d-a465d136c9cb req-4be736bc-8c19-4950-adbc-df14eb88466e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.153534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG neutronclient.v2_0.client [None req-f9037e46-fc15-41e9-8b60-9e3d607a3504 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist", "detail": ""}} {{(pid=127042) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:58:07.154170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.security_group_api [None req-f9037e46-fc15-41e9-8b60-9e3d607a3504 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Neutron security group 7d02be92-a571-42ab-8546-c7cf0147e254 not found {{(pid=127042) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:58:07.154734 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f9037e46-fc15-41e9-8b60-9e3d607a3504 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:58:07.154734 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-1cdbcf9f-da63-40fd-bb31-17fe220423b7'] Oct 29 02:58:07.154956 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8e02f664-109d-4235-b72d-a465d136c9cb req-4be736bc-8c19-4950-adbc-df14eb88466e service nova] Creating event network-vif-deleted:767f0367-bff9-4f07-ac30-bfe344612d57 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:58:07.155481 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8e02f664-109d-4235-b72d-a465d136c9cb req-4be736bc-8c19-4950-adbc-df14eb88466e service nova] Creating event network-vif-deleted:f768439c-3452-4070-b9fe-dc99900a9aba for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f9037e46-fc15-41e9-8b60-9e3d607a3504 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-security-groups/7d02be92-a571-42ab-8546-c7cf0147e254 HTTP/1.1 Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: exception: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-1cdbcf9f-da63-40fd-bb31-17fe220423b7'] Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '7d02be92-a571-42ab-8546-c7cf0147e254'} Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:58:07.157054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cdbcf9f-da63-40fd-bb31-17fe220423b7'] Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cdbcf9f-da63-40fd-bb31-17fe220423b7'] Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cdbcf9f-da63-40fd-bb31-17fe220423b7'] Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cdbcf9f-da63-40fd-bb31-17fe220423b7'] Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f9037e46-fc15-41e9-8b60-9e3d607a3504 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Security group 7d02be92-a571-42ab-8546-c7cf0147e254 does not exist Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-1cdbcf9f-da63-40fd-bb31-17fe220423b7'] {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f9037e46-fc15-41e9-8b60-9e3d607a3504 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7d02be92-a571-42ab-8546-c7cf0147e254" status: 404 len: 194 microversion: 2.1 time: 0.051998 Oct 29 02:58:07.164889 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1533/3131] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:58:07 2022] DELETE /compute/v2.1/os-security-groups/7d02be92-a571-42ab-8546-c7cf0147e254 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:07.168111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-174161fe-3fa6-4a2e-92af-6be712199384 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:07.168860 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8e02f664-109d-4235-b72d-a465d136c9cb req-4be736bc-8c19-4950-adbc-df14eb88466e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070409 Oct 29 02:58:07.169860 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1599/3132] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:07.170375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-174161fe-3fa6-4a2e-92af-6be712199384 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:07.175139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a1e621c-8701-4d71-8aee-e952808af921 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1acc3b040>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:07.190919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-174161fe-3fa6-4a2e-92af-6be712199384 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.191405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-174161fe-3fa6-4a2e-92af-6be712199384 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.192436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-174161fe-3fa6-4a2e-92af-6be712199384 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.193413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-174161fe-3fa6-4a2e-92af-6be712199384 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.193967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-174161fe-3fa6-4a2e-92af-6be712199384 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.194396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-174161fe-3fa6-4a2e-92af-6be712199384 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.319222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-5a1e621c-8701-4d71-8aee-e952808af921 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:58:07.320111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.security_group_api [None req-5a1e621c-8701-4d71-8aee-e952808af921 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Neutron security group 73a0a53e-4308-4272-8299-cea34eaa253e not found {{(pid=127041) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:58:07.320909 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-5a1e621c-8701-4d71-8aee-e952808af921 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:58:07.320909 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-6cb749d5-ceb3-4da9-bcb5-d9006fa3cf00'] Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a1e621c-8701-4d71-8aee-e952808af921 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-security-groups/73a0a53e-4308-4272-8299-cea34eaa253e HTTP/1.1 Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: exception: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-6cb749d5-ceb3-4da9-bcb5-d9006fa3cf00'] Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '73a0a53e-4308-4272-8299-cea34eaa253e'} Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:58:07.323618 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cb749d5-ceb3-4da9-bcb5-d9006fa3cf00'] Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cb749d5-ceb3-4da9-bcb5-d9006fa3cf00'] Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cb749d5-ceb3-4da9-bcb5-d9006fa3cf00'] Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cb749d5-ceb3-4da9-bcb5-d9006fa3cf00'] Oct 29 02:58:07.328671 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.333108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a1e621c-8701-4d71-8aee-e952808af921 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Security group 73a0a53e-4308-4272-8299-cea34eaa253e does not exist Oct 29 02:58:07.333108 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-6cb749d5-ceb3-4da9-bcb5-d9006fa3cf00'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:07.334670 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5a1e621c-8701-4d71-8aee-e952808af921 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/73a0a53e-4308-4272-8299-cea34eaa253e" status: 404 len: 194 microversion: 2.1 time: 0.163730 Oct 29 02:58:07.335427 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1600/3133] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:58:07 2022] DELETE /compute/v2.1/os-security-groups/73a0a53e-4308-4272-8299-cea34eaa253e => generated 194 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:07.344533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a55a19ef-cbe6-4857-90a2-92240c74e23f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a3eeb3a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:07.444436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-174161fe-3fa6-4a2e-92af-6be712199384 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:07.453783 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-174161fe-3fa6-4a2e-92af-6be712199384 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1292 microversion: 2.1 time: 0.293564 Oct 29 02:58:07.454725 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1534/3134] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:07 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1292 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:07.460218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:07.461162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:07.467579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.468155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.468635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.469312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.469762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.470203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.482840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-a55a19ef-cbe6-4857-90a2-92240c74e23f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:58:07.483535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.security_group_api [None req-a55a19ef-cbe6-4857-90a2-92240c74e23f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Neutron security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 not found {{(pid=127041) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:58:07.484079 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-a55a19ef-cbe6-4857-90a2-92240c74e23f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:58:07.484079 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-bdc65570-8399-4c1e-9921-f4d9baff8591'] Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a55a19ef-cbe6-4857-90a2-92240c74e23f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-security-groups/7dea5fba-c89a-4056-ac83-d363706e9fa6 HTTP/1.1 Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: exception: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-bdc65570-8399-4c1e-9921-f4d9baff8591'] Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '7dea5fba-c89a-4056-ac83-d363706e9fa6'} Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:58:07.490229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdc65570-8399-4c1e-9921-f4d9baff8591'] Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdc65570-8399-4c1e-9921-f4d9baff8591'] Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdc65570-8399-4c1e-9921-f4d9baff8591'] Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdc65570-8399-4c1e-9921-f4d9baff8591'] Oct 29 02:58:07.495030 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:07.499168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a55a19ef-cbe6-4857-90a2-92240c74e23f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Security group 7dea5fba-c89a-4056-ac83-d363706e9fa6 does not exist Oct 29 02:58:07.499168 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-bdc65570-8399-4c1e-9921-f4d9baff8591'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:07.500371 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a55a19ef-cbe6-4857-90a2-92240c74e23f tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7dea5fba-c89a-4056-ac83-d363706e9fa6" status: 404 len: 194 microversion: 2.1 time: 0.160257 Oct 29 02:58:07.508223 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1601/3135] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:58:07 2022] DELETE /compute/v2.1/os-security-groups/7dea5fba-c89a-4056-ac83-d363706e9fa6 => generated 194 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:58:07.519060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d053302a-3f0c-44b7-bcab-f301a2b425f7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:07.519686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d053302a-3f0c-44b7-bcab-f301a2b425f7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:07.541299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d053302a-3f0c-44b7-bcab-f301a2b425f7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.541782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d053302a-3f0c-44b7-bcab-f301a2b425f7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.544808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d053302a-3f0c-44b7-bcab-f301a2b425f7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.545856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d053302a-3f0c-44b7-bcab-f301a2b425f7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.546534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d053302a-3f0c-44b7-bcab-f301a2b425f7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.549952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d053302a-3f0c-44b7-bcab-f301a2b425f7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.626878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d053302a-3f0c-44b7-bcab-f301a2b425f7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:58:07.820022 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d053302a-3f0c-44b7-bcab-f301a2b425f7 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 204 len: 0 microversion: 2.1 time: 0.298512 Oct 29 02:58:07.823464 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1602/3136] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:58:07 2022] DELETE /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:58:07.836107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-97b53331-b0c5-4966-b19f-0257406e5ffe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:07.840835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-97b53331-b0c5-4966-b19f-0257406e5ffe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:07.853693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97b53331-b0c5-4966-b19f-0257406e5ffe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.854378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97b53331-b0c5-4966-b19f-0257406e5ffe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.854892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97b53331-b0c5-4966-b19f-0257406e5ffe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.855884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97b53331-b0c5-4966-b19f-0257406e5ffe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.863832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97b53331-b0c5-4966-b19f-0257406e5ffe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.864286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97b53331-b0c5-4966-b19f-0257406e5ffe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.093097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.106368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.107072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-97b53331-b0c5-4966-b19f-0257406e5ffe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.112125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.113877 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-314e2271-1aae-4415-af79-a69e0a2da71e tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.657885 Oct 29 02:58:08.126586 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1535/3137] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:07 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:08.127700 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-97b53331-b0c5-4966-b19f-0257406e5ffe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.293318 Oct 29 02:58:08.141903 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1603/3138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:07 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:08.142138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:08.142800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:08.146109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b06e627-2df7-43fb-bce1-552004659db6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:08.146722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b06e627-2df7-43fb-bce1-552004659db6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:08.158261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.159079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.160834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.163093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.164454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b06e627-2df7-43fb-bce1-552004659db6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.164785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.164946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b06e627-2df7-43fb-bce1-552004659db6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.165620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b06e627-2df7-43fb-bce1-552004659db6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.165989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.166787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b06e627-2df7-43fb-bce1-552004659db6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.167432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b06e627-2df7-43fb-bce1-552004659db6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.168251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b06e627-2df7-43fb-bce1-552004659db6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.302563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.318663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.323503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.325025 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-616fbb45-9b6f-4c5c-b1dc-817628ec5837 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.193766 Oct 29 02:58:08.330277 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1604/3139] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:08 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:08.342060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1514067d-1105-4f08-b893-944f022c93fe tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:08.343764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1514067d-1105-4f08-b893-944f022c93fe tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:08.356158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1514067d-1105-4f08-b893-944f022c93fe tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.361031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1514067d-1105-4f08-b893-944f022c93fe tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.363740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1514067d-1105-4f08-b893-944f022c93fe tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.365049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1514067d-1105-4f08-b893-944f022c93fe tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.369794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1514067d-1105-4f08-b893-944f022c93fe tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.370697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1514067d-1105-4f08-b893-944f022c93fe tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.473597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1514067d-1105-4f08-b893-944f022c93fe tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.487394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9b06e627-2df7-43fb-bce1-552004659db6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.496251 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1514067d-1105-4f08-b893-944f022c93fe tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1274 microversion: 2.1 time: 0.162543 Oct 29 02:58:08.505982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1605/3140] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:08 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:08.513023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-32f43cc5-bba6-4277-ba24-a8ce297af050 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:08.515984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-32f43cc5-bba6-4277-ba24-a8ce297af050 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:08.527171 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b06e627-2df7-43fb-bce1-552004659db6 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1647 microversion: 2.1 time: 0.395389 Oct 29 02:58:08.530099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32f43cc5-bba6-4277-ba24-a8ce297af050 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.530711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32f43cc5-bba6-4277-ba24-a8ce297af050 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.531129 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1536/3141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:08 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1647 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:08.543897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32f43cc5-bba6-4277-ba24-a8ce297af050 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.546159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32f43cc5-bba6-4277-ba24-a8ce297af050 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.546795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32f43cc5-bba6-4277-ba24-a8ce297af050 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.548121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f8b9fe9-48a3-4c37-95fc-1d0b859fc49a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:08.548938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0f8b9fe9-48a3-4c37-95fc-1d0b859fc49a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:08.555581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f8b9fe9-48a3-4c37-95fc-1d0b859fc49a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.556380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f8b9fe9-48a3-4c37-95fc-1d0b859fc49a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.558136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f8b9fe9-48a3-4c37-95fc-1d0b859fc49a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.559078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f8b9fe9-48a3-4c37-95fc-1d0b859fc49a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.563004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32f43cc5-bba6-4277-ba24-a8ce297af050 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.566537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f8b9fe9-48a3-4c37-95fc-1d0b859fc49a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.569128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f8b9fe9-48a3-4c37-95fc-1d0b859fc49a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.787306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-32f43cc5-bba6-4277-ba24-a8ce297af050 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.796994 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-32f43cc5-bba6-4277-ba24-a8ce297af050 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1470 microversion: 2.1 time: 0.297311 Oct 29 02:58:08.799035 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1606/3142] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:08 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:08.881652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f8b9fe9-48a3-4c37-95fc-1d0b859fc49a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.895977 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f8b9fe9-48a3-4c37-95fc-1d0b859fc49a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1292 microversion: 2.1 time: 0.362061 Oct 29 02:58:08.896575 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1537/3143] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:08 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1292 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:09.150653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:09.157230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9841a063-90e9-415d-a358-77575e19b56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:09.159494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:09.160181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9841a063-90e9-415d-a358-77575e19b56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:09.174279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9841a063-90e9-415d-a358-77575e19b56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.178763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9841a063-90e9-415d-a358-77575e19b56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.182952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9841a063-90e9-415d-a358-77575e19b56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.184635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.185346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9841a063-90e9-415d-a358-77575e19b56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.187012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.187497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9841a063-90e9-415d-a358-77575e19b56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.188135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.189066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9841a063-90e9-415d-a358-77575e19b56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.191661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.193480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.195606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.360019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:09.370813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:09.373254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:09.375032 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9bc37c9f-d5d7-48d4-8eeb-328b8c3dd2cd tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.234348 Oct 29 02:58:09.376177 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1607/3144] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:09 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:09.381627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-804eb69c-97c9-4794-ae7a-7979cf076127 req-3167171b-7c5b-4ae3-b25d-a9172325068b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064a2fd2-d8fa-4598-bd7b-d67ea792a9d9", "name": "network-vif-deleted", "tag": "0ac995e9-7dce-47bf-9e58-e63e0cc63800"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:09.393215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-804eb69c-97c9-4794-ae7a-7979cf076127 req-3167171b-7c5b-4ae3-b25d-a9172325068b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.393969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-804eb69c-97c9-4794-ae7a-7979cf076127 req-3167171b-7c5b-4ae3-b25d-a9172325068b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.394619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-804eb69c-97c9-4794-ae7a-7979cf076127 req-3167171b-7c5b-4ae3-b25d-a9172325068b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.409349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-804eb69c-97c9-4794-ae7a-7979cf076127 req-3167171b-7c5b-4ae3-b25d-a9172325068b service nova] Creating event network-vif-deleted:0ac995e9-7dce-47bf-9e58-e63e0cc63800 for instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 on n-h1-862964-4 Oct 29 02:58:09.415394 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-804eb69c-97c9-4794-ae7a-7979cf076127 req-3167171b-7c5b-4ae3-b25d-a9172325068b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037710 Oct 29 02:58:09.416993 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1608/3145] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:09.423936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:09.424733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:09.436535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.437024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.437453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.438182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.438627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.439034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.551060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:09.572280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9841a063-90e9-415d-a358-77575e19b56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:09.576842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:09.578967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:09.582581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:09.584602 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b870f554-724d-494c-88f6-4e756fa15482 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.165548 Oct 29 02:58:09.585755 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1609/3146] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:09 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:09.591233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-86a74bfb-75b4-436b-b85d-e81b530c9c5f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:09.592351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-86a74bfb-75b4-436b-b85d-e81b530c9c5f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:09.599989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86a74bfb-75b4-436b-b85d-e81b530c9c5f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.600745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86a74bfb-75b4-436b-b85d-e81b530c9c5f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.601382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86a74bfb-75b4-436b-b85d-e81b530c9c5f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.602590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86a74bfb-75b4-436b-b85d-e81b530c9c5f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.603292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86a74bfb-75b4-436b-b85d-e81b530c9c5f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.603907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86a74bfb-75b4-436b-b85d-e81b530c9c5f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.604080 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9841a063-90e9-415d-a358-77575e19b56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.451093 Oct 29 02:58:09.609146 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1538/3147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:09 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:09.622055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c5ad3742-ad5d-4e14-9f57-badef1949799 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:09.623072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c5ad3742-ad5d-4e14-9f57-badef1949799 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:09.629190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:09.635810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5ad3742-ad5d-4e14-9f57-badef1949799 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.638927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5ad3742-ad5d-4e14-9f57-badef1949799 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.639660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5ad3742-ad5d-4e14-9f57-badef1949799 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.643057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5ad3742-ad5d-4e14-9f57-badef1949799 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.643891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5ad3742-ad5d-4e14-9f57-badef1949799 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.644537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5ad3742-ad5d-4e14-9f57-badef1949799 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.969822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c5ad3742-ad5d-4e14-9f57-badef1949799 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:09.980670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-86a74bfb-75b4-436b-b85d-e81b530c9c5f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:09.981105 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c5ad3742-ad5d-4e14-9f57-badef1949799 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1647 microversion: 2.1 time: 0.370256 Oct 29 02:58:09.982565 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1539/3148] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:09 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1647 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:09.990020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-13494f4b-2422-45ee-9dc1-df884f1b9da7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:09.991258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-13494f4b-2422-45ee-9dc1-df884f1b9da7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:09.997836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:10.000505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13494f4b-2422-45ee-9dc1-df884f1b9da7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.001478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13494f4b-2422-45ee-9dc1-df884f1b9da7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.002142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13494f4b-2422-45ee-9dc1-df884f1b9da7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.003356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13494f4b-2422-45ee-9dc1-df884f1b9da7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.004661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13494f4b-2422-45ee-9dc1-df884f1b9da7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.005240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13494f4b-2422-45ee-9dc1-df884f1b9da7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.013294 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-86a74bfb-75b4-436b-b85d-e81b530c9c5f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1316 microversion: 2.1 time: 0.425972 Oct 29 02:58:10.013945 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1610/3149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:09 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:10.030060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-39cd09a3-9147-4582-9a74-3094a6f79f59 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:10.030773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-39cd09a3-9147-4582-9a74-3094a6f79f59 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:10.045726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39cd09a3-9147-4582-9a74-3094a6f79f59 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.046244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39cd09a3-9147-4582-9a74-3094a6f79f59 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.046673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39cd09a3-9147-4582-9a74-3094a6f79f59 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.052971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39cd09a3-9147-4582-9a74-3094a6f79f59 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.053460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39cd09a3-9147-4582-9a74-3094a6f79f59 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.053916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39cd09a3-9147-4582-9a74-3094a6f79f59 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.311147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-39cd09a3-9147-4582-9a74-3094a6f79f59 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.319013 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-39cd09a3-9147-4582-9a74-3094a6f79f59 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1292 microversion: 2.1 time: 0.303998 Oct 29 02:58:10.319601 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1611/3150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:10 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1292 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:10.363741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-13494f4b-2422-45ee-9dc1-df884f1b9da7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.374444 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-13494f4b-2422-45ee-9dc1-df884f1b9da7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1470 microversion: 2.1 time: 0.389400 Oct 29 02:58:10.375040 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1540/3151] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:09 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1470 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:10.404455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:10.405067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:10.420218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.421539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.422649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.423582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.424330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.426182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.591624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.602414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.604282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.606737 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f976314e-7bf2-450b-8c21-b15c6c43b04d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.206109 Oct 29 02:58:10.607817 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1612/3152] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:10 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:10.625123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:10.625730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:10.628381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c396da8a-e994-44c9-b1d2-65fdfb691c7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:10.629216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c396da8a-e994-44c9-b1d2-65fdfb691c7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:10.633475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.634000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.634589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.635457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.636292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.636415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.639859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c396da8a-e994-44c9-b1d2-65fdfb691c7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.640414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c396da8a-e994-44c9-b1d2-65fdfb691c7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.641068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c396da8a-e994-44c9-b1d2-65fdfb691c7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.642194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c396da8a-e994-44c9-b1d2-65fdfb691c7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.643231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c396da8a-e994-44c9-b1d2-65fdfb691c7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.644011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c396da8a-e994-44c9-b1d2-65fdfb691c7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.786957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.798913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.802138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.806344 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e6793182-5e08-4f51-808b-f92a68136895 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.189608 Oct 29 02:58:10.822912 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1541/3153] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:10 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:10.822912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-693c5c69-7a91-42cd-951d-c1b623143003 req-edfaf12d-e177-454d-8bc2-348c65cb7e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e3883b-cb09-4f23-a780-addd0b95fa66", "tag": "c4c51b61-fc93-44e8-96b1-b8cc31e8bf3c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:10.841413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-693c5c69-7a91-42cd-951d-c1b623143003 req-edfaf12d-e177-454d-8bc2-348c65cb7e9a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.842808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-693c5c69-7a91-42cd-951d-c1b623143003 req-edfaf12d-e177-454d-8bc2-348c65cb7e9a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.843337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-693c5c69-7a91-42cd-951d-c1b623143003 req-edfaf12d-e177-454d-8bc2-348c65cb7e9a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.861401 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-693c5c69-7a91-42cd-951d-c1b623143003 req-edfaf12d-e177-454d-8bc2-348c65cb7e9a service nova] Creating event network-changed:c4c51b61-fc93-44e8-96b1-b8cc31e8bf3c for instance 75e3883b-cb09-4f23-a780-addd0b95fa66 on n-h2-862964-4 Oct 29 02:58:10.877787 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-693c5c69-7a91-42cd-951d-c1b623143003 req-edfaf12d-e177-454d-8bc2-348c65cb7e9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064190 Oct 29 02:58:10.878612 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1542/3154] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:10.900629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c396da8a-e994-44c9-b1d2-65fdfb691c7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.913169 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c396da8a-e994-44c9-b1d2-65fdfb691c7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.289634 Oct 29 02:58:10.917867 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1613/3155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:10 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:11.011065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-781295ce-8099-4516-9571-81c3b6b748b9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:11.011993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-781295ce-8099-4516-9571-81c3b6b748b9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:11.019311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-781295ce-8099-4516-9571-81c3b6b748b9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.020103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-781295ce-8099-4516-9571-81c3b6b748b9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.020809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-781295ce-8099-4516-9571-81c3b6b748b9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.021762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-781295ce-8099-4516-9571-81c3b6b748b9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.022524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-781295ce-8099-4516-9571-81c3b6b748b9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.023097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-781295ce-8099-4516-9571-81c3b6b748b9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.045348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5432b27-7e1f-4234-a8b8-cae55b5b5b09 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:11.046313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f5432b27-7e1f-4234-a8b8-cae55b5b5b09 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:11.062654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5432b27-7e1f-4234-a8b8-cae55b5b5b09 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.063564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5432b27-7e1f-4234-a8b8-cae55b5b5b09 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.064181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5432b27-7e1f-4234-a8b8-cae55b5b5b09 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.068808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5432b27-7e1f-4234-a8b8-cae55b5b5b09 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.069495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5432b27-7e1f-4234-a8b8-cae55b5b5b09 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.074460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5432b27-7e1f-4234-a8b8-cae55b5b5b09 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.152515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-781295ce-8099-4516-9571-81c3b6b748b9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:11.165414 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-781295ce-8099-4516-9571-81c3b6b748b9 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1467 microversion: 2.1 time: 0.158552 Oct 29 02:58:11.168360 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1543/3156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:11 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1467 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:11.264671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f5432b27-7e1f-4234-a8b8-cae55b5b5b09 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:11.273085 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5432b27-7e1f-4234-a8b8-cae55b5b5b09 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1316 microversion: 2.1 time: 0.232302 Oct 29 02:58:11.273673 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1614/3157] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:11 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:11.343404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e7cbe5c1-d883-4d16-a11b-c130c44699a4 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:11.344447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e7cbe5c1-d883-4d16-a11b-c130c44699a4 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:11.351853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7cbe5c1-d883-4d16-a11b-c130c44699a4 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.352653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7cbe5c1-d883-4d16-a11b-c130c44699a4 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.353314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7cbe5c1-d883-4d16-a11b-c130c44699a4 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.354250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7cbe5c1-d883-4d16-a11b-c130c44699a4 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.354872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7cbe5c1-d883-4d16-a11b-c130c44699a4 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.355465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7cbe5c1-d883-4d16-a11b-c130c44699a4 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.400922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-36c855e3-000f-4e45-8b5a-bb15316b1805 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:11.402842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-36c855e3-000f-4e45-8b5a-bb15316b1805 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:11.410506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36c855e3-000f-4e45-8b5a-bb15316b1805 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.410989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36c855e3-000f-4e45-8b5a-bb15316b1805 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.411419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36c855e3-000f-4e45-8b5a-bb15316b1805 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.412117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36c855e3-000f-4e45-8b5a-bb15316b1805 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.412595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36c855e3-000f-4e45-8b5a-bb15316b1805 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.414453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36c855e3-000f-4e45-8b5a-bb15316b1805 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.631231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e7cbe5c1-d883-4d16-a11b-c130c44699a4 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:11.640186 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e7cbe5c1-d883-4d16-a11b-c130c44699a4 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1292 microversion: 2.1 time: 0.300768 Oct 29 02:58:11.642221 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1544/3158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:11 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1292 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:11.665465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-310e4743-388e-4adf-a1ab-1099e8e50abf req-17793c11-a380-4179-ac33-8b9657832b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd9e3b45-8ae9-470a-80f6-26c3057f7afe", "name": "network-vif-deleted", "tag": "9eebf062-ba82-4f9f-85ad-21b23f2023ad"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:11.687000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-310e4743-388e-4adf-a1ab-1099e8e50abf req-17793c11-a380-4179-ac33-8b9657832b81 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.690071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-310e4743-388e-4adf-a1ab-1099e8e50abf req-17793c11-a380-4179-ac33-8b9657832b81 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.691034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-310e4743-388e-4adf-a1ab-1099e8e50abf req-17793c11-a380-4179-ac33-8b9657832b81 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.713109 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-310e4743-388e-4adf-a1ab-1099e8e50abf req-17793c11-a380-4179-ac33-8b9657832b81 service nova] Creating event network-vif-deleted:9eebf062-ba82-4f9f-85ad-21b23f2023ad for instance cd9e3b45-8ae9-470a-80f6-26c3057f7afe on n-h2-862964-4 Oct 29 02:58:11.726598 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-310e4743-388e-4adf-a1ab-1099e8e50abf req-17793c11-a380-4179-ac33-8b9657832b81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081043 Oct 29 02:58:11.729070 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1545/3159] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:11.739031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:11.746416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-36c855e3-000f-4e45-8b5a-bb15316b1805 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:11.754646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:11.758716 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-36c855e3-000f-4e45-8b5a-bb15316b1805 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1476 microversion: 2.1 time: 0.361586 Oct 29 02:58:11.769997 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1615/3160] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:11 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:11.777533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.778088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.778518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.779216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.784526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.784974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.836848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:11.837949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:11.854066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.855367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.856764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.857646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.859645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.861086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.873755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:11.883211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:11.884720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:11.885932 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a8847391-871c-4f58-9960-89e9af0d4d50 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.154696 Oct 29 02:58:11.886816 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1546/3161] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:11 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:11.938098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-14cbfa77-83d1-4249-aaa2-1ae17eb3c8f3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:11.938861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-14cbfa77-83d1-4249-aaa2-1ae17eb3c8f3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:11.952509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14cbfa77-83d1-4249-aaa2-1ae17eb3c8f3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.953633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14cbfa77-83d1-4249-aaa2-1ae17eb3c8f3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.954441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14cbfa77-83d1-4249-aaa2-1ae17eb3c8f3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.955579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14cbfa77-83d1-4249-aaa2-1ae17eb3c8f3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.956234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14cbfa77-83d1-4249-aaa2-1ae17eb3c8f3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.956853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14cbfa77-83d1-4249-aaa2-1ae17eb3c8f3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.991344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:12.002660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:12.003980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:12.005155 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-65b4e2af-8b2e-4599-a167-a6caf51f5566 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.173564 Oct 29 02:58:12.005701 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1616/3162] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:11 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:12.113530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-14cbfa77-83d1-4249-aaa2-1ae17eb3c8f3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:12.122798 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-14cbfa77-83d1-4249-aaa2-1ae17eb3c8f3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.188720 Oct 29 02:58:12.123397 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1547/3163] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:11 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:12.191234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:12.191950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:12.198670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.199160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.199591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.200292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.200741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.201157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.243084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:12.247788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.248607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.249127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.249667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lazy-loading 'fault' on Instance uuid cd9e3b45-8ae9-470a-80f6-26c3057f7afe {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:58:12.298059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-27b11871-cd5a-49a4-8a61-df5352da396f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:12.299008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-27b11871-cd5a-49a4-8a61-df5352da396f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:12.306573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b11871-cd5a-49a4-8a61-df5352da396f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.307353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b11871-cd5a-49a4-8a61-df5352da396f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.307967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b11871-cd5a-49a4-8a61-df5352da396f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.309111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b11871-cd5a-49a4-8a61-df5352da396f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.309716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b11871-cd5a-49a4-8a61-df5352da396f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.310328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b11871-cd5a-49a4-8a61-df5352da396f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.316012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f909cc7113594047add07a2bbd14187a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d9071c47304d7ca128734f7bc8eeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:12.328711 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c572f1d3-3048-4336-8874-c295b304d972 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 200 len: 1306 microversion: 2.1 time: 0.141368 Oct 29 02:58:12.329307 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1617/3164] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:12 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 1306 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:12.485137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-27b11871-cd5a-49a4-8a61-df5352da396f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:12.493195 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-27b11871-cd5a-49a4-8a61-df5352da396f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1316 microversion: 2.1 time: 0.200865 Oct 29 02:58:12.494443 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1548/3165] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:12 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:12.668352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9878c374-b187-4ed6-bfa3-83c167a295bd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:12.670145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9878c374-b187-4ed6-bfa3-83c167a295bd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:12.677125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9878c374-b187-4ed6-bfa3-83c167a295bd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.690330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9878c374-b187-4ed6-bfa3-83c167a295bd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.691052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9878c374-b187-4ed6-bfa3-83c167a295bd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.692119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9878c374-b187-4ed6-bfa3-83c167a295bd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.692722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9878c374-b187-4ed6-bfa3-83c167a295bd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.693368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9878c374-b187-4ed6-bfa3-83c167a295bd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.784918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-461649d8-98dc-412f-8c37-bc37af2944c5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:12.786286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-461649d8-98dc-412f-8c37-bc37af2944c5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:12.793128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461649d8-98dc-412f-8c37-bc37af2944c5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.793128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461649d8-98dc-412f-8c37-bc37af2944c5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.793630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461649d8-98dc-412f-8c37-bc37af2944c5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.794501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461649d8-98dc-412f-8c37-bc37af2944c5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.795017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461649d8-98dc-412f-8c37-bc37af2944c5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.795505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461649d8-98dc-412f-8c37-bc37af2944c5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.851539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9878c374-b187-4ed6-bfa3-83c167a295bd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:12.860264 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9878c374-b187-4ed6-bfa3-83c167a295bd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1292 microversion: 2.1 time: 0.196544 Oct 29 02:58:12.860853 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1618/3166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:12 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1292 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:12.911567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:12.912261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:12.918941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.919607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.920028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.920711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.921143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.921707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.939553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-461649d8-98dc-412f-8c37-bc37af2944c5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:12.948635 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-461649d8-98dc-412f-8c37-bc37af2944c5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1476 microversion: 2.1 time: 0.167920 Oct 29 02:58:12.962474 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1549/3167] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:12 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1476 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:12.991160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:13.000524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:13.001979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:13.003159 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-53c70d79-89c8-4e0b-9012-d9783437d2c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.095531 Oct 29 02:58:13.003727 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1619/3168] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:12 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:58:13.032739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:13.033510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:13.039865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.040505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.041031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.041889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.042399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.042881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.111474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:13.121978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:13.123392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:13.125188 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-35191d54-da78-4f4c-b57d-39d8c0cd178e tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.096510 Oct 29 02:58:13.136994 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1550/3169] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:13 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:13.153161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5ea5d73-31b4-40ca-8f45-eac26574839e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:13.153768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d5ea5d73-31b4-40ca-8f45-eac26574839e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:13.160210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea5d73-31b4-40ca-8f45-eac26574839e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.160688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea5d73-31b4-40ca-8f45-eac26574839e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.161112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea5d73-31b4-40ca-8f45-eac26574839e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.161794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea5d73-31b4-40ca-8f45-eac26574839e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.162329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea5d73-31b4-40ca-8f45-eac26574839e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.162738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5ea5d73-31b4-40ca-8f45-eac26574839e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.316835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5ea5d73-31b4-40ca-8f45-eac26574839e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:13.325794 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5ea5d73-31b4-40ca-8f45-eac26574839e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.182724 Oct 29 02:58:13.338900 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1620/3170] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:13 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:13.355822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:13.356661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] [instance: cd9e3b45-8ae9-470a-80f6-26c3057f7afe] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:13.364000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.364583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.365103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.366191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.366709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.367129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.384282 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] HTTP exception thrown: Instance cd9e3b45-8ae9-470a-80f6-26c3057f7afe could not be found. Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Request method failure captured: Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe HTTP/1.1 Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJZLZ8EdhIYEgSBD4dynInjX8IWzlx7gqqUWjUCV6YU-NFjqXnI9n_cS4ey4d4w8UnOvWyNcD8v6Lh44HsiXL7YhxJraQJkv3N6IyJ2IMTMpsuJ5-3dGsFsqBL1Vmka26NiXwOorpOIHDF5UFKtDxDIx84eBUzXhzCyM7smqCObFEQc Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81d9071c47304d7ca128734f7bc8eeed", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81d9071c47304d7ca128734f7bc8eeed"}]}] Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 81d9071c47304d7ca128734f7bc8eeed Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1174189544 Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f909cc7113594047add07a2bbd14187a Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsTestJSON-1174189544-project Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance cd9e3b45-8ae9-470a-80f6-26c3057f7afe could not be found. Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cd9e3b45-8ae9-470a-80f6-26c3057f7afe'} Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd9e3b45-8ae9-470a-80f6-26c3057f7afe could not be found. Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd9e3b45-8ae9-470a-80f6-26c3057f7afe could not be found. Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:13.386236 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:13.390914 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:13.390914 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:13.390914 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:13.390914 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:13.390914 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:13.390914 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd9e3b45-8ae9-470a-80f6-26c3057f7afe could not be found. Oct 29 02:58:13.390914 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:13.390914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Returning 404 to user: Instance cd9e3b45-8ae9-470a-80f6-26c3057f7afe could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:13.390914 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c97813fa-5b77-4e03-9bd4-8f34198e0d1b tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe" status: 404 len: 111 microversion: 2.1 time: 0.035964 Oct 29 02:58:13.391709 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1551/3171] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:13 2022] GET /compute/v2.1/servers/cd9e3b45-8ae9-470a-80f6-26c3057f7afe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:13.398640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3f5f025c-49f4-4a51-878d-45a7a15d96aa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a8858160>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:13.526871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-987e1994-8d05-443d-8f78-ac7e48f4e482 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:13.527482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-987e1994-8d05-443d-8f78-ac7e48f4e482 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:13.535236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-987e1994-8d05-443d-8f78-ac7e48f4e482 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.535719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-987e1994-8d05-443d-8f78-ac7e48f4e482 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.536141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-987e1994-8d05-443d-8f78-ac7e48f4e482 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.543386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-987e1994-8d05-443d-8f78-ac7e48f4e482 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.543869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-987e1994-8d05-443d-8f78-ac7e48f4e482 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.544295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-987e1994-8d05-443d-8f78-ac7e48f4e482 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.645443 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3f5f025c-49f4-4a51-878d-45a7a15d96aa tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9e266144-8b64-4500-a7f0-975e4a3af033" status: 202 len: 0 microversion: 2.1 time: 0.251438 Oct 29 02:58:13.646225 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1621/3172] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:58:13 2022] DELETE /compute/v2.1/os-security-groups/9e266144-8b64-4500-a7f0-975e4a3af033 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:58:13.658006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-da5e769c-d271-4fbe-b746-f3ba66a26d79 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] Calling method '.version_select at 0x7fe1a3fb90d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:13.753000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-987e1994-8d05-443d-8f78-ac7e48f4e482 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:13.763343 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-987e1994-8d05-443d-8f78-ac7e48f4e482 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1316 microversion: 2.1 time: 0.245821 Oct 29 02:58:13.778204 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1552/3173] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:13 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:13.870033 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-da5e769c-d271-4fbe-b746-f3ba66a26d79 tempest-SecurityGroupsTestJSON-1174189544 tempest-SecurityGroupsTestJSON-1174189544-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/167dd4c5-e052-47b5-b1d6-009a7cd10c15" status: 202 len: 0 microversion: 2.1 time: 0.216887 Oct 29 02:58:13.871589 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1622/3174] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 02:58:13 2022] DELETE /compute/v2.1/os-security-groups/167dd4c5-e052-47b5-b1d6-009a7cd10c15 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:58:13.894705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0739d377-0ac1-448f-bc61-39b2b273c252 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:13.895235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0739d377-0ac1-448f-bc61-39b2b273c252 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:13.907015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0739d377-0ac1-448f-bc61-39b2b273c252 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.907849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0739d377-0ac1-448f-bc61-39b2b273c252 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.908504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0739d377-0ac1-448f-bc61-39b2b273c252 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.910189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0739d377-0ac1-448f-bc61-39b2b273c252 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.910904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0739d377-0ac1-448f-bc61-39b2b273c252 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.911527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0739d377-0ac1-448f-bc61-39b2b273c252 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.972941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cfe76ff9-748f-4a2e-b14d-c5daa1b9b297 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:13.973834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cfe76ff9-748f-4a2e-b14d-c5daa1b9b297 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:13.983165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe76ff9-748f-4a2e-b14d-c5daa1b9b297 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.984032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe76ff9-748f-4a2e-b14d-c5daa1b9b297 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.984823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe76ff9-748f-4a2e-b14d-c5daa1b9b297 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.985888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe76ff9-748f-4a2e-b14d-c5daa1b9b297 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.986592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe76ff9-748f-4a2e-b14d-c5daa1b9b297 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.987281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe76ff9-748f-4a2e-b14d-c5daa1b9b297 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.184143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0739d377-0ac1-448f-bc61-39b2b273c252 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.197281 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0739d377-0ac1-448f-bc61-39b2b273c252 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1292 microversion: 2.1 time: 0.318508 Oct 29 02:58:14.201285 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1553/3175] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:13 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1292 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:14.214354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:14.215103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:14.228166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cfe76ff9-748f-4a2e-b14d-c5daa1b9b297 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.228571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.229073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.229503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.230845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.231451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.232398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.246177 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cfe76ff9-748f-4a2e-b14d-c5daa1b9b297 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1476 microversion: 2.1 time: 0.277622 Oct 29 02:58:14.249320 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1623/3176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:13 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1476 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:14.264700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:14.268616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:14.282310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.283094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.283847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.285031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.285989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.287005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.357169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.373847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.375270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.376994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.379120 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d1ea097d-e801-42cc-b6bf-b880746f9776 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.176722 Oct 29 02:58:14.380258 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1554/3177] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:14 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:14.385592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b171dfcf-b89a-4f83-8039-e61f734762d3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:14.385886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.386692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b171dfcf-b89a-4f83-8039-e61f734762d3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:14.387937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.389786 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-95d96709-a781-4eb2-9ce6-97358b100aec tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.137880 Oct 29 02:58:14.390907 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1624/3178] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:14 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:14.393135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b171dfcf-b89a-4f83-8039-e61f734762d3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.393780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b171dfcf-b89a-4f83-8039-e61f734762d3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.394450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b171dfcf-b89a-4f83-8039-e61f734762d3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.395383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b171dfcf-b89a-4f83-8039-e61f734762d3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.396186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b171dfcf-b89a-4f83-8039-e61f734762d3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.396805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b171dfcf-b89a-4f83-8039-e61f734762d3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.612267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=16 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:14.639371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=32 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:14.670122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b171dfcf-b89a-4f83-8039-e61f734762d3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.683089 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b171dfcf-b89a-4f83-8039-e61f734762d3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.301555 Oct 29 02:58:14.686260 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1555/3179] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:14 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:14.793143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c91000b-d0ba-4246-9f9a-6f72f197e814 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:14.793841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c91000b-d0ba-4246-9f9a-6f72f197e814 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:14.804044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c91000b-d0ba-4246-9f9a-6f72f197e814 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.805413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c91000b-d0ba-4246-9f9a-6f72f197e814 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.806276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c91000b-d0ba-4246-9f9a-6f72f197e814 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.807202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c91000b-d0ba-4246-9f9a-6f72f197e814 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.809271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c91000b-d0ba-4246-9f9a-6f72f197e814 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.810483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c91000b-d0ba-4246-9f9a-6f72f197e814 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.965266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5c91000b-d0ba-4246-9f9a-6f72f197e814 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.974579 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c91000b-d0ba-4246-9f9a-6f72f197e814 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1316 microversion: 2.1 time: 0.187291 Oct 29 02:58:14.975616 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1625/3180] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:14 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:15.224193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-369ce6c6-eadc-4aa4-8dff-d0b6cc781cce tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:15.224840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-369ce6c6-eadc-4aa4-8dff-d0b6cc781cce tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:15.244597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369ce6c6-eadc-4aa4-8dff-d0b6cc781cce tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.245100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369ce6c6-eadc-4aa4-8dff-d0b6cc781cce tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.245534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369ce6c6-eadc-4aa4-8dff-d0b6cc781cce tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.246493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369ce6c6-eadc-4aa4-8dff-d0b6cc781cce tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.246839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369ce6c6-eadc-4aa4-8dff-d0b6cc781cce tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.247172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369ce6c6-eadc-4aa4-8dff-d0b6cc781cce tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.277286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9adcffe2-8e99-4aac-81ac-613f5ddfbf1b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:15.278106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9adcffe2-8e99-4aac-81ac-613f5ddfbf1b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:15.288716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adcffe2-8e99-4aac-81ac-613f5ddfbf1b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.291575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adcffe2-8e99-4aac-81ac-613f5ddfbf1b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.292174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adcffe2-8e99-4aac-81ac-613f5ddfbf1b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.293927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adcffe2-8e99-4aac-81ac-613f5ddfbf1b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.294464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adcffe2-8e99-4aac-81ac-613f5ddfbf1b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.296177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adcffe2-8e99-4aac-81ac-613f5ddfbf1b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.305236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:15.530381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9adcffe2-8e99-4aac-81ac-613f5ddfbf1b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:15.540577 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9adcffe2-8e99-4aac-81ac-613f5ddfbf1b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1476 microversion: 2.1 time: 0.267284 Oct 29 02:58:15.554826 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1626/3181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:15 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1476 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:15.563288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:15.564810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:15.572537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.573306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.573966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.575170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.575806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.576228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.659343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:15.670010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:15.671877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:15.673472 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-abccaa31-2cec-4665-9ea7-82eef3d4189d tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.117315 Oct 29 02:58:15.674893 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1627/3182] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:15 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:15.682487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:15.683297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:15.691566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.692061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.692493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.693187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.693711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.694167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.765520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:15.771005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:15.786800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:15.788554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:15.789996 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-154a1fa7-100e-4e57-ac99-0435b1b0297b tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.113908 Oct 29 02:58:15.790898 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1628/3183] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:15 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:15.795829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c713a6c1-945b-4bfd-a20a-38f1ef98e969 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:15.796597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c713a6c1-945b-4bfd-a20a-38f1ef98e969 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:15.803813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c713a6c1-945b-4bfd-a20a-38f1ef98e969 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.805229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c713a6c1-945b-4bfd-a20a-38f1ef98e969 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.806962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c713a6c1-945b-4bfd-a20a-38f1ef98e969 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.807941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c713a6c1-945b-4bfd-a20a-38f1ef98e969 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.808610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c713a6c1-945b-4bfd-a20a-38f1ef98e969 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.809243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c713a6c1-945b-4bfd-a20a-38f1ef98e969 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.986217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c713a6c1-945b-4bfd-a20a-38f1ef98e969 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:15.996680 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c713a6c1-945b-4bfd-a20a-38f1ef98e969 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.204550 Oct 29 02:58:16.010440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-369ce6c6-eadc-4aa4-8dff-d0b6cc781cce tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:16.011149 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1629/3184] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:15 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:16.019417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-31fa8f0c-12c7-4bcf-94d8-e4260cbba965 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:16.020244 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-369ce6c6-eadc-4aa4-8dff-d0b6cc781cce tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1292 microversion: 2.1 time: 0.799844 Oct 29 02:58:16.020627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-31fa8f0c-12c7-4bcf-94d8-e4260cbba965 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:16.027901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31fa8f0c-12c7-4bcf-94d8-e4260cbba965 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.029070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31fa8f0c-12c7-4bcf-94d8-e4260cbba965 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.030001 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1556/3185] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:15 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1292 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:16.030797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31fa8f0c-12c7-4bcf-94d8-e4260cbba965 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.032605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31fa8f0c-12c7-4bcf-94d8-e4260cbba965 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.033462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31fa8f0c-12c7-4bcf-94d8-e4260cbba965 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.034149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31fa8f0c-12c7-4bcf-94d8-e4260cbba965 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.242931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-31fa8f0c-12c7-4bcf-94d8-e4260cbba965 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:16.254795 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-31fa8f0c-12c7-4bcf-94d8-e4260cbba965 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1316 microversion: 2.1 time: 0.242002 Oct 29 02:58:16.256646 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1630/3186] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:16 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:16.563440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ef119cd3-4b1d-440f-bfbf-fc71fac2179c req-99f0eb84-88a4-4ef2-a117-b96f940fbc4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373da2a7-dc50-4f64-bb50-98e9be4e00ea", "name": "network-vif-plugged", "status": "completed", "tag": "2a519e5a-0fce-4f47-84d2-9cab1c919527"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:16.568833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-516cf08b-9883-444d-a411-4c9fdca7a905 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:16.569670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-516cf08b-9883-444d-a411-4c9fdca7a905 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:16.585266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ef119cd3-4b1d-440f-bfbf-fc71fac2179c req-99f0eb84-88a4-4ef2-a117-b96f940fbc4e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.587510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ef119cd3-4b1d-440f-bfbf-fc71fac2179c req-99f0eb84-88a4-4ef2-a117-b96f940fbc4e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.588442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-516cf08b-9883-444d-a411-4c9fdca7a905 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.588800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ef119cd3-4b1d-440f-bfbf-fc71fac2179c req-99f0eb84-88a4-4ef2-a117-b96f940fbc4e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.588946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-516cf08b-9883-444d-a411-4c9fdca7a905 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.589360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-516cf08b-9883-444d-a411-4c9fdca7a905 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.590169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-516cf08b-9883-444d-a411-4c9fdca7a905 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.590624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-516cf08b-9883-444d-a411-4c9fdca7a905 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.591067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-516cf08b-9883-444d-a411-4c9fdca7a905 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.628582 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ef119cd3-4b1d-440f-bfbf-fc71fac2179c req-99f0eb84-88a4-4ef2-a117-b96f940fbc4e service nova] Creating event network-vif-plugged:2a519e5a-0fce-4f47-84d2-9cab1c919527 for instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea on n-h1-862964-4 Oct 29 02:58:16.638010 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ef119cd3-4b1d-440f-bfbf-fc71fac2179c req-99f0eb84-88a4-4ef2-a117-b96f940fbc4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078928 Oct 29 02:58:16.642247 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1557/3187] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:16.705842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:16.706807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:16.729500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.730404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.731053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.732613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.733341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.738094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.754092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:16.989691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.000522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.010097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.015463 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-36da6f06-267f-4321-8862-e71a1231d4fc tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.314340 Oct 29 02:58:17.018797 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1558/3188] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:16 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:17.041554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:17.043069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:17.065087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:17.071337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:17.074615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:17.075708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:17.076771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:17.082058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:17.091510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-516cf08b-9883-444d-a411-4c9fdca7a905 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.109581 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-516cf08b-9883-444d-a411-4c9fdca7a905 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1476 microversion: 2.1 time: 0.546491 Oct 29 02:58:17.110271 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1631/3189] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:16 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1476 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:17.127927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51771ec8-771e-4284-9b8f-488ce34b12bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:17.128550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-51771ec8-771e-4284-9b8f-488ce34b12bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:17.161368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51771ec8-771e-4284-9b8f-488ce34b12bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:17.161890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51771ec8-771e-4284-9b8f-488ce34b12bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:17.162295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51771ec8-771e-4284-9b8f-488ce34b12bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:17.172653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51771ec8-771e-4284-9b8f-488ce34b12bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:17.173152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51771ec8-771e-4284-9b8f-488ce34b12bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:17.176483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51771ec8-771e-4284-9b8f-488ce34b12bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:17.282984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.304468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.306322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.307880 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a9ce398f-0ed2-4491-97d7-6c04c8459b40 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.287484 Oct 29 02:58:17.321014 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1559/3190] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:17 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:17.331911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-25717b8d-99ed-4b72-be77-861ad62a3b7e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:17.332437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-25717b8d-99ed-4b72-be77-861ad62a3b7e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:17.349642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25717b8d-99ed-4b72-be77-861ad62a3b7e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:17.350513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25717b8d-99ed-4b72-be77-861ad62a3b7e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:17.355676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25717b8d-99ed-4b72-be77-861ad62a3b7e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:17.358954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25717b8d-99ed-4b72-be77-861ad62a3b7e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:17.362871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25717b8d-99ed-4b72-be77-861ad62a3b7e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:17.369637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25717b8d-99ed-4b72-be77-861ad62a3b7e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:17.550118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-51771ec8-771e-4284-9b8f-488ce34b12bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.564444 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-51771ec8-771e-4284-9b8f-488ce34b12bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1506 microversion: 2.1 time: 0.448725 Oct 29 02:58:17.565112 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1632/3191] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:17 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:17.588239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37ca0e2d-5d3e-475b-87b5-c2f010b636c9 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:17.589425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37ca0e2d-5d3e-475b-87b5-c2f010b636c9 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:17.596349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ca0e2d-5d3e-475b-87b5-c2f010b636c9 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:17.597262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ca0e2d-5d3e-475b-87b5-c2f010b636c9 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:17.597992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ca0e2d-5d3e-475b-87b5-c2f010b636c9 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:17.598943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ca0e2d-5d3e-475b-87b5-c2f010b636c9 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:17.600217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ca0e2d-5d3e-475b-87b5-c2f010b636c9 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:17.600858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ca0e2d-5d3e-475b-87b5-c2f010b636c9 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:17.788855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37ca0e2d-5d3e-475b-87b5-c2f010b636c9 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.801599 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37ca0e2d-5d3e-475b-87b5-c2f010b636c9 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1316 microversion: 2.1 time: 0.218875 Oct 29 02:58:17.820332 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1633/3192] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:17 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:17.882429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-25717b8d-99ed-4b72-be77-861ad62a3b7e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.892124 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-25717b8d-99ed-4b72-be77-861ad62a3b7e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1292 microversion: 2.1 time: 0.570228 Oct 29 02:58:17.892714 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1560/3193] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:17 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1292 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:18.046835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:18.047778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:18.085501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.086426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.087391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.088540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.089119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.089719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.142629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c094255c-a117-4c93-8ccd-8520a1bfc85c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:18.144008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c094255c-a117-4c93-8ccd-8520a1bfc85c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:18.161967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c094255c-a117-4c93-8ccd-8520a1bfc85c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.165970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c094255c-a117-4c93-8ccd-8520a1bfc85c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.168576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c094255c-a117-4c93-8ccd-8520a1bfc85c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.169556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c094255c-a117-4c93-8ccd-8520a1bfc85c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.170362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c094255c-a117-4c93-8ccd-8520a1bfc85c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.172090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c094255c-a117-4c93-8ccd-8520a1bfc85c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.214349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:18.224268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:18.225766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:18.227050 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-931d2b1a-c93f-42af-8e61-d16a60275797 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.185928 Oct 29 02:58:18.228247 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1634/3194] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:18 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:18.339471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:18.340158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:18.350864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.354414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.354950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.356634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.359111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.360819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.530743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:18.542244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:18.545041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:18.546585 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-64033526-9333-412a-8fac-1bd2cc1b1113 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.212283 Oct 29 02:58:18.547666 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1635/3195] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:18 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:58:18.594429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7b0c1b5-bcd8-47f3-85fe-aab020198aac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:18.595770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7b0c1b5-bcd8-47f3-85fe-aab020198aac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:18.624104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b0c1b5-bcd8-47f3-85fe-aab020198aac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.624949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b0c1b5-bcd8-47f3-85fe-aab020198aac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.625543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b0c1b5-bcd8-47f3-85fe-aab020198aac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.626504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b0c1b5-bcd8-47f3-85fe-aab020198aac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.627102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b0c1b5-bcd8-47f3-85fe-aab020198aac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.627984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b0c1b5-bcd8-47f3-85fe-aab020198aac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.673866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c094255c-a117-4c93-8ccd-8520a1bfc85c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:18.685906 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c094255c-a117-4c93-8ccd-8520a1bfc85c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1476 microversion: 2.1 time: 0.547155 Oct 29 02:58:18.687163 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1561/3196] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:18 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1476 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:18.702796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-50e1fea6-b8cc-4f77-bd05-c6186e946397 req-ce1fe5e8-24e1-4f7d-ab3a-45d95ec9c799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b13893-1eca-43c0-b826-a35650183201", "name": "network-vif-plugged", "status": "completed", "tag": "82024e5d-6393-4421-bd98-5bae0e521412"}, {"server_uuid": "75e3883b-cb09-4f23-a780-addd0b95fa66", "name": "network-vif-plugged", "status": "completed", "tag": "c4c51b61-fc93-44e8-96b1-b8cc31e8bf3c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:18.719761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-50e1fea6-b8cc-4f77-bd05-c6186e946397 req-ce1fe5e8-24e1-4f7d-ab3a-45d95ec9c799 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.720625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-50e1fea6-b8cc-4f77-bd05-c6186e946397 req-ce1fe5e8-24e1-4f7d-ab3a-45d95ec9c799 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.721309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-50e1fea6-b8cc-4f77-bd05-c6186e946397 req-ce1fe5e8-24e1-4f7d-ab3a-45d95ec9c799 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.738921 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-50e1fea6-b8cc-4f77-bd05-c6186e946397 req-ce1fe5e8-24e1-4f7d-ab3a-45d95ec9c799 service nova] Creating event network-vif-plugged:82024e5d-6393-4421-bd98-5bae0e521412 for instance e1b13893-1eca-43c0-b826-a35650183201 on n-h2-862964-4 Oct 29 02:58:18.740930 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-50e1fea6-b8cc-4f77-bd05-c6186e946397 req-ce1fe5e8-24e1-4f7d-ab3a-45d95ec9c799 service nova] Creating event network-vif-plugged:c4c51b61-fc93-44e8-96b1-b8cc31e8bf3c for instance 75e3883b-cb09-4f23-a780-addd0b95fa66 on n-h2-862964-4 Oct 29 02:58:18.756440 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-50e1fea6-b8cc-4f77-bd05-c6186e946397 req-ce1fe5e8-24e1-4f7d-ab3a-45d95ec9c799 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067567 Oct 29 02:58:18.756980 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1562/3197] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:18.827136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7c426e4-e6a1-4162-9c6d-135ff7abf25d tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:18.828075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7c426e4-e6a1-4162-9c6d-135ff7abf25d tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:18.843312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c426e4-e6a1-4162-9c6d-135ff7abf25d tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.849321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c426e4-e6a1-4162-9c6d-135ff7abf25d tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.850100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c426e4-e6a1-4162-9c6d-135ff7abf25d tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.852535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c426e4-e6a1-4162-9c6d-135ff7abf25d tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.854463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c426e4-e6a1-4162-9c6d-135ff7abf25d tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.855092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c426e4-e6a1-4162-9c6d-135ff7abf25d tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.013636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c7b0c1b5-bcd8-47f3-85fe-aab020198aac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.029676 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7b0c1b5-bcd8-47f3-85fe-aab020198aac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1527 microversion: 2.1 time: 0.441271 Oct 29 02:58:19.030305 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1636/3198] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:18 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1527 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:19.039680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-39b5ecec-9399-421e-b9fb-ddf1781bb50c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:19.040726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-39b5ecec-9399-421e-b9fb-ddf1781bb50c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:19.056152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b5ecec-9399-421e-b9fb-ddf1781bb50c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.056889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b5ecec-9399-421e-b9fb-ddf1781bb50c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.057504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b5ecec-9399-421e-b9fb-ddf1781bb50c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.058382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b5ecec-9399-421e-b9fb-ddf1781bb50c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.059017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b5ecec-9399-421e-b9fb-ddf1781bb50c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.059638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b5ecec-9399-421e-b9fb-ddf1781bb50c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.201581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a7c426e4-e6a1-4162-9c6d-135ff7abf25d tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.213520 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7c426e4-e6a1-4162-9c6d-135ff7abf25d tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1316 microversion: 2.1 time: 0.390101 Oct 29 02:58:19.217985 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1563/3199] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:18 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:19.255199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:19.256397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:19.269626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-39b5ecec-9399-421e-b9fb-ddf1781bb50c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.279067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.279664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.280676 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-39b5ecec-9399-421e-b9fb-ddf1781bb50c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1292 microversion: 2.1 time: 0.248840 Oct 29 02:58:19.284516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.284516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.284516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.284516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.294514 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1637/3200] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:19 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1292 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:19.379354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.416955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.422536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.424357 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-04af21a6-5b7f-4b77-9e94-1ff49bdceea8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.173709 Oct 29 02:58:19.426721 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1564/3201] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:19 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:58:19.581483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:19.585324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:19.591976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.592763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.593450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.605064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.605856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.606289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.686776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.696958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.699167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.700361 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fa1b381a-ab51-4828-8370-85bf49270d77 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.122789 Oct 29 02:58:19.713844 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1638/3202] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:19 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:19.720100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-43ed9d81-36bb-4ea9-af8c-fd3cca350e18 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:19.720100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-43ed9d81-36bb-4ea9-af8c-fd3cca350e18 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:19.732834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43ed9d81-36bb-4ea9-af8c-fd3cca350e18 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.733494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43ed9d81-36bb-4ea9-af8c-fd3cca350e18 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.734070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43ed9d81-36bb-4ea9-af8c-fd3cca350e18 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.735212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43ed9d81-36bb-4ea9-af8c-fd3cca350e18 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.735774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43ed9d81-36bb-4ea9-af8c-fd3cca350e18 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.736294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43ed9d81-36bb-4ea9-af8c-fd3cca350e18 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.024596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-43ed9d81-36bb-4ea9-af8c-fd3cca350e18 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:20.033954 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-43ed9d81-36bb-4ea9-af8c-fd3cca350e18 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1462 microversion: 2.1 time: 0.323355 Oct 29 02:58:20.034866 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1565/3203] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:19 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1462 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:20.064259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9935e0f-23b5-49f1-8a87-50d3c3eb17d2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:20.068040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c9935e0f-23b5-49f1-8a87-50d3c3eb17d2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:20.068305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-02674825-e8e0-42a9-b98f-73a5ca7bc54a tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:20.069029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-02674825-e8e0-42a9-b98f-73a5ca7bc54a tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:20.081132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9935e0f-23b5-49f1-8a87-50d3c3eb17d2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.081132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9935e0f-23b5-49f1-8a87-50d3c3eb17d2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.081132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9935e0f-23b5-49f1-8a87-50d3c3eb17d2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.083495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9935e0f-23b5-49f1-8a87-50d3c3eb17d2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.085708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9935e0f-23b5-49f1-8a87-50d3c3eb17d2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.087091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9935e0f-23b5-49f1-8a87-50d3c3eb17d2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.095204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02674825-e8e0-42a9-b98f-73a5ca7bc54a tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.095204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02674825-e8e0-42a9-b98f-73a5ca7bc54a tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.096426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02674825-e8e0-42a9-b98f-73a5ca7bc54a tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.098234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02674825-e8e0-42a9-b98f-73a5ca7bc54a tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.098757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02674825-e8e0-42a9-b98f-73a5ca7bc54a tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.099536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02674825-e8e0-42a9-b98f-73a5ca7bc54a tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.342278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c9935e0f-23b5-49f1-8a87-50d3c3eb17d2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:20.356118 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c9935e0f-23b5-49f1-8a87-50d3c3eb17d2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1527 microversion: 2.1 time: 0.300769 Oct 29 02:58:20.372621 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1639/3204] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:20 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1527 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:20.372621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-79da6b41-1876-4bb5-95e2-b88bc5f0fffd tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:20.372621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-79da6b41-1876-4bb5-95e2-b88bc5f0fffd tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:20.372855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-02674825-e8e0-42a9-b98f-73a5ca7bc54a tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:20.375007 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-02674825-e8e0-42a9-b98f-73a5ca7bc54a tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1462 microversion: 2.1 time: 0.312562 Oct 29 02:58:20.375743 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1566/3205] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:20 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1462 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:20.377005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79da6b41-1876-4bb5-95e2-b88bc5f0fffd tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.380906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79da6b41-1876-4bb5-95e2-b88bc5f0fffd tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.382343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79da6b41-1876-4bb5-95e2-b88bc5f0fffd tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.385090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79da6b41-1876-4bb5-95e2-b88bc5f0fffd tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.385577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79da6b41-1876-4bb5-95e2-b88bc5f0fffd tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.386048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79da6b41-1876-4bb5-95e2-b88bc5f0fffd tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.398993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c4860e2e-c507-453e-bd4e-b71d8c1afc40 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:20.399721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c4860e2e-c507-453e-bd4e-b71d8c1afc40 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:20.413715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4860e2e-c507-453e-bd4e-b71d8c1afc40 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.414508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4860e2e-c507-453e-bd4e-b71d8c1afc40 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.415630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4860e2e-c507-453e-bd4e-b71d8c1afc40 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.416399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4860e2e-c507-453e-bd4e-b71d8c1afc40 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.416902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4860e2e-c507-453e-bd4e-b71d8c1afc40 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.417572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4860e2e-c507-453e-bd4e-b71d8c1afc40 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.711060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c4860e2e-c507-453e-bd4e-b71d8c1afc40 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:20.720342 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c4860e2e-c507-453e-bd4e-b71d8c1afc40 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1292 microversion: 2.1 time: 0.343320 Oct 29 02:58:20.738169 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1567/3206] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:20 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1292 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:20.744732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:20.747946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:20.756856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.757638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.758444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.759548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.760290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.760886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.956814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:58:20.957552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:58:20.958884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:58:20.959529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:58:20.960121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:58:21.140433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:21.154788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.155535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.156131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.157021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.157624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.158233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.227169 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b0923f7-f739-4e2c-a13d-eeb6f8a78cce tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action" status: 202 len: 1066 microversion: 2.1 time: 0.485017 Oct 29 02:58:21.236746 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1568/3207] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:58:20 2022] POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action => generated 1066 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 02:58:21.251597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:21.259266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:21.273120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.273963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.274806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.277190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.284512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.285201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.415162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-79da6b41-1876-4bb5-95e2-b88bc5f0fffd tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.428631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.446608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.448741 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-79da6b41-1876-4bb5-95e2-b88bc5f0fffd tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1316 microversion: 2.1 time: 1.086469 Oct 29 02:58:21.449381 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1640/3208] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:20 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1316 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:21.449825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.451314 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6791e05b-c6e2-4c12-9c46-f3c692249081 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.212941 Oct 29 02:58:21.452294 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1569/3209] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:21 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:21.475037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:21.477834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:21.480866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-221fba8e-2d17-4ba8-bd8b-e71fd4252cd2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:21.481493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-221fba8e-2d17-4ba8-bd8b-e71fd4252cd2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:21.487599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.488502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.489091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.489983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.490583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.491158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.495050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-221fba8e-2d17-4ba8-bd8b-e71fd4252cd2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.495697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-221fba8e-2d17-4ba8-bd8b-e71fd4252cd2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.496151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-221fba8e-2d17-4ba8-bd8b-e71fd4252cd2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.497046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-221fba8e-2d17-4ba8-bd8b-e71fd4252cd2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.497504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-221fba8e-2d17-4ba8-bd8b-e71fd4252cd2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.497963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-221fba8e-2d17-4ba8-bd8b-e71fd4252cd2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.609640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.621950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.623618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.625507 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a729cdb8-cc0e-4727-90f5-c1509a33040a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.161388 Oct 29 02:58:21.626354 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1641/3210] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:21 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:21.639936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ed19626d-938c-4abf-b9b6-b3ff9595de52 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:21.641466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ed19626d-938c-4abf-b9b6-b3ff9595de52 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:21.654882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed19626d-938c-4abf-b9b6-b3ff9595de52 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.657196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed19626d-938c-4abf-b9b6-b3ff9595de52 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.659020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed19626d-938c-4abf-b9b6-b3ff9595de52 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.659953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed19626d-938c-4abf-b9b6-b3ff9595de52 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.660411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed19626d-938c-4abf-b9b6-b3ff9595de52 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.660983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed19626d-938c-4abf-b9b6-b3ff9595de52 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.757963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-221fba8e-2d17-4ba8-bd8b-e71fd4252cd2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.787682 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-221fba8e-2d17-4ba8-bd8b-e71fd4252cd2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 0.328820 Oct 29 02:58:21.789338 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1570/3211] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:21 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:21.813094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ed770d89-c3e3-4487-9943-1eb995f26ed1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:21.815075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ed770d89-c3e3-4487-9943-1eb995f26ed1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:21.835561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed770d89-c3e3-4487-9943-1eb995f26ed1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.842728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed770d89-c3e3-4487-9943-1eb995f26ed1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.843267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed770d89-c3e3-4487-9943-1eb995f26ed1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.845117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed770d89-c3e3-4487-9943-1eb995f26ed1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.847010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed770d89-c3e3-4487-9943-1eb995f26ed1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.851198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed770d89-c3e3-4487-9943-1eb995f26ed1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.933846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ed19626d-938c-4abf-b9b6-b3ff9595de52 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.944387 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ed19626d-938c-4abf-b9b6-b3ff9595de52 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.315077 Oct 29 02:58:21.945605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1642/3212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:21 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:22.126632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ed770d89-c3e3-4487-9943-1eb995f26ed1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:22.137632 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ed770d89-c3e3-4487-9943-1eb995f26ed1 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1483 microversion: 2.1 time: 0.345330 Oct 29 02:58:22.139367 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1571/3213] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:21 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1483 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:22.167060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25183e4e-9bf6-4e12-9eaf-7ec083e3a960 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:22.168109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25183e4e-9bf6-4e12-9eaf-7ec083e3a960 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:22.184516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25183e4e-9bf6-4e12-9eaf-7ec083e3a960 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.185039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25183e4e-9bf6-4e12-9eaf-7ec083e3a960 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.185471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25183e4e-9bf6-4e12-9eaf-7ec083e3a960 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.188872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25183e4e-9bf6-4e12-9eaf-7ec083e3a960 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.189274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25183e4e-9bf6-4e12-9eaf-7ec083e3a960 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.189728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25183e4e-9bf6-4e12-9eaf-7ec083e3a960 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.231589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-714a92d2-1e7c-4811-902e-429f5b267f39 req-6e4be544-74cb-4a30-944b-2f18bab1146e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a570891-4387-4f63-a59a-aa60fe7360db", "name": "network-vif-plugged", "status": "completed", "tag": "96a84e8f-b1fc-4584-a5f1-6409732df05f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:22.269907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-714a92d2-1e7c-4811-902e-429f5b267f39 req-6e4be544-74cb-4a30-944b-2f18bab1146e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.273619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-714a92d2-1e7c-4811-902e-429f5b267f39 req-6e4be544-74cb-4a30-944b-2f18bab1146e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.274913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-714a92d2-1e7c-4811-902e-429f5b267f39 req-6e4be544-74cb-4a30-944b-2f18bab1146e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.325579 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-714a92d2-1e7c-4811-902e-429f5b267f39 req-6e4be544-74cb-4a30-944b-2f18bab1146e service nova] Creating event network-vif-plugged:96a84e8f-b1fc-4584-a5f1-6409732df05f for instance 3a570891-4387-4f63-a59a-aa60fe7360db on n-h1-862964-4 Oct 29 02:58:22.347279 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-714a92d2-1e7c-4811-902e-429f5b267f39 req-6e4be544-74cb-4a30-944b-2f18bab1146e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120604 Oct 29 02:58:22.347696 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25183e4e-9bf6-4e12-9eaf-7ec083e3a960 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189928 Oct 29 02:58:22.348613 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1643/3214] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 02:58:22 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:58:22.350104 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1572/3215] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:58:22.475140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b57f1450-27cf-4256-9473-2085dee30f80 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:22.476161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b57f1450-27cf-4256-9473-2085dee30f80 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:22.483055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:22.485331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:22.497419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.497920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.499124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57f1450-27cf-4256-9473-2085dee30f80 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.499749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.499902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57f1450-27cf-4256-9473-2085dee30f80 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.500544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57f1450-27cf-4256-9473-2085dee30f80 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.502183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.502849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.503337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57f1450-27cf-4256-9473-2085dee30f80 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.504022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57f1450-27cf-4256-9473-2085dee30f80 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.504747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57f1450-27cf-4256-9473-2085dee30f80 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.526824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.679835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:22.690619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:22.698818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:22.700448 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-170bd55b-5047-4d29-b361-b70bee882a81 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.221746 Oct 29 02:58:22.705663 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1573/3216] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:22 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:22.725181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:22.728606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:22.750397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.751907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.755583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.761257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.764673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.765909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.772937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:22.928232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b57f1450-27cf-4256-9473-2085dee30f80 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:22.937405 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b57f1450-27cf-4256-9473-2085dee30f80 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1504 microversion: 2.1 time: 0.467390 Oct 29 02:58:22.941938 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1644/3217] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:22 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1504 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:22.952404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:22.965958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:22.966809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8a9ce69-6ca5-426d-9753-d416c8d9117c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:22.969072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8a9ce69-6ca5-426d-9753-d416c8d9117c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:22.975190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:22.979213 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-86a45abc-1fb3-4cf9-8788-7095f246813f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.272298 Oct 29 02:58:22.984252 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1574/3218] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:22 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:22.991236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a9ce69-6ca5-426d-9753-d416c8d9117c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.994413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a9ce69-6ca5-426d-9753-d416c8d9117c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.996909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-153f6fe0-f63e-4ddd-92c1-399d47352228 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:22.998801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a9ce69-6ca5-426d-9753-d416c8d9117c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.999747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a9ce69-6ca5-426d-9753-d416c8d9117c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.000747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a9ce69-6ca5-426d-9753-d416c8d9117c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.002824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8a9ce69-6ca5-426d-9753-d416c8d9117c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:23.003926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-153f6fe0-f63e-4ddd-92c1-399d47352228 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:23.031295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-153f6fe0-f63e-4ddd-92c1-399d47352228 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.031967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-153f6fe0-f63e-4ddd-92c1-399d47352228 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.033462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-153f6fe0-f63e-4ddd-92c1-399d47352228 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:23.034745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-153f6fe0-f63e-4ddd-92c1-399d47352228 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.035398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-153f6fe0-f63e-4ddd-92c1-399d47352228 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.036836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-153f6fe0-f63e-4ddd-92c1-399d47352228 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:23.119864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-153f6fe0-f63e-4ddd-92c1-399d47352228 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:58:23.219098 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-153f6fe0-f63e-4ddd-92c1-399d47352228 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 204 len: 0 microversion: 2.1 time: 0.229871 Oct 29 02:58:23.220438 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1575/3219] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:58:22 2022] DELETE /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:58:23.232215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-00f24921-ac3c-4bce-a86b-d0a24d05e0c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:23.236126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-00f24921-ac3c-4bce-a86b-d0a24d05e0c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:23.245969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00f24921-ac3c-4bce-a86b-d0a24d05e0c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.246765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00f24921-ac3c-4bce-a86b-d0a24d05e0c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.247360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00f24921-ac3c-4bce-a86b-d0a24d05e0c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:23.248265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00f24921-ac3c-4bce-a86b-d0a24d05e0c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.249292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00f24921-ac3c-4bce-a86b-d0a24d05e0c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.249961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00f24921-ac3c-4bce-a86b-d0a24d05e0c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:23.705150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8a9ce69-6ca5-426d-9753-d416c8d9117c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:23.715325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:23.745859 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8a9ce69-6ca5-426d-9753-d416c8d9117c tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 0.802386 Oct 29 02:58:23.765963 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1645/3220] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:22 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:23.771349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-00f24921-ac3c-4bce-a86b-d0a24d05e0c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:23.778986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e611d3ce-24a3-4c1b-b912-76fba9ab2555 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:23.780106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e611d3ce-24a3-4c1b-b912-76fba9ab2555 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:23.782825 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-00f24921-ac3c-4bce-a86b-d0a24d05e0c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.556698 Oct 29 02:58:23.787427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e611d3ce-24a3-4c1b-b912-76fba9ab2555 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.788270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e611d3ce-24a3-4c1b-b912-76fba9ab2555 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.788961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e611d3ce-24a3-4c1b-b912-76fba9ab2555 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:23.790213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e611d3ce-24a3-4c1b-b912-76fba9ab2555 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.792158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e611d3ce-24a3-4c1b-b912-76fba9ab2555 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.794200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e611d3ce-24a3-4c1b-b912-76fba9ab2555 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:23.803678 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1576/3221] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:23 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:23.809354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:23.810005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:23.823494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.823989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.824426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:23.825135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.825586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.826033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:24.198376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e611d3ce-24a3-4c1b-b912-76fba9ab2555 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:24.215186 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e611d3ce-24a3-4c1b-b912-76fba9ab2555 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1510 microversion: 2.1 time: 0.453723 Oct 29 02:58:24.233615 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1646/3222] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:23 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1510 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:24.238961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:24.244623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:24.271397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:24.272192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:24.272823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:24.274375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:24.275120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:24.275736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:24.347228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:24.365215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:24.366426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:24.367625 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c53612a4-4c2d-4211-bd15-ecb2c7b3649c tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.562870 Oct 29 02:58:24.368219 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1577/3223] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:23 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:24.472397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:24.501397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:24.511550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:24.517775 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3b951d98-d4bf-4591-8964-2bc43a0bc795 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.281322 Oct 29 02:58:24.537936 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1647/3224] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:24 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:24.780266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aecfc76c-998f-460e-8bc0-ecb883c9757f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:24.788721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aecfc76c-998f-460e-8bc0-ecb883c9757f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:24.799798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecfc76c-998f-460e-8bc0-ecb883c9757f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:24.800703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecfc76c-998f-460e-8bc0-ecb883c9757f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:24.802706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecfc76c-998f-460e-8bc0-ecb883c9757f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:24.806816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecfc76c-998f-460e-8bc0-ecb883c9757f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:24.807797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecfc76c-998f-460e-8bc0-ecb883c9757f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:24.810448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecfc76c-998f-460e-8bc0-ecb883c9757f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:24.812271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6072c6db-247b-48ea-9b33-68c6426a7d4e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:24.812964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6072c6db-247b-48ea-9b33-68c6426a7d4e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:24.834918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6072c6db-247b-48ea-9b33-68c6426a7d4e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:24.835536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6072c6db-247b-48ea-9b33-68c6426a7d4e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:24.836046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6072c6db-247b-48ea-9b33-68c6426a7d4e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:24.837020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6072c6db-247b-48ea-9b33-68c6426a7d4e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:24.837884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6072c6db-247b-48ea-9b33-68c6426a7d4e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:24.838514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6072c6db-247b-48ea-9b33-68c6426a7d4e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:25.116125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6072c6db-247b-48ea-9b33-68c6426a7d4e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:25.132417 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6072c6db-247b-48ea-9b33-68c6426a7d4e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.325039 Oct 29 02:58:25.147807 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1648/3225] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:24 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:25.241771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8c292dfb-67eb-4953-b0d9-63234bf07d26 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:25.242744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8c292dfb-67eb-4953-b0d9-63234bf07d26 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:25.254541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c292dfb-67eb-4953-b0d9-63234bf07d26 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:25.258937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c292dfb-67eb-4953-b0d9-63234bf07d26 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:25.262162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c292dfb-67eb-4953-b0d9-63234bf07d26 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:25.263988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c292dfb-67eb-4953-b0d9-63234bf07d26 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:25.265612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c292dfb-67eb-4953-b0d9-63234bf07d26 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:25.267737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c292dfb-67eb-4953-b0d9-63234bf07d26 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:25.295982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aecfc76c-998f-460e-8bc0-ecb883c9757f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:25.306098 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aecfc76c-998f-460e-8bc0-ecb883c9757f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 0.529546 Oct 29 02:58:25.327473 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1578/3226] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:24 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:25.495467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:25.496228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:25.511610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:25.513346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:25.515095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:25.517696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:25.519466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:25.521330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:25.901004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:25.920324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:25.922085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:25.927213 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8e0d41b6-3e40-4006-b15e-9e275ee49b59 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.437213 Oct 29 02:58:25.929588 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1579/3227] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:25 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:58:25.941880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:25.942511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:25.965351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:25.966841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:25.967742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:25.969795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:25.972820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:25.973449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:26.024927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c292dfb-67eb-4953-b0d9-63234bf07d26 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:26.042384 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8c292dfb-67eb-4953-b0d9-63234bf07d26 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1510 microversion: 2.1 time: 0.800925 Oct 29 02:58:26.045767 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1649/3228] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:25 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1510 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:26.160522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c1cb69b-07bd-427a-bcc5-c3405991eb7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:26.161581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1c1cb69b-07bd-427a-bcc5-c3405991eb7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:26.172495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c1cb69b-07bd-427a-bcc5-c3405991eb7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:26.174673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c1cb69b-07bd-427a-bcc5-c3405991eb7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:26.175800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c1cb69b-07bd-427a-bcc5-c3405991eb7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:26.178778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c1cb69b-07bd-427a-bcc5-c3405991eb7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:26.180085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c1cb69b-07bd-427a-bcc5-c3405991eb7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:26.182613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c1cb69b-07bd-427a-bcc5-c3405991eb7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:26.622164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1c1cb69b-07bd-427a-bcc5-c3405991eb7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:26.633452 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1c1cb69b-07bd-427a-bcc5-c3405991eb7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.477826 Oct 29 02:58:26.651870 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1650/3229] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:26 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:26.666259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-96112264-0c8a-4873-a40b-a5d5bbc82c85 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:26.667944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-96112264-0c8a-4873-a40b-a5d5bbc82c85 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:26.682603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96112264-0c8a-4873-a40b-a5d5bbc82c85 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:26.683119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96112264-0c8a-4873-a40b-a5d5bbc82c85 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:26.683582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96112264-0c8a-4873-a40b-a5d5bbc82c85 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:26.684323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96112264-0c8a-4873-a40b-a5d5bbc82c85 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:26.689073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96112264-0c8a-4873-a40b-a5d5bbc82c85 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:26.689531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96112264-0c8a-4873-a40b-a5d5bbc82c85 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:26.839375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:26.851841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:26.860997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:26.864387 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-59a2f9f6-490c-488b-bf91-fded7a8ea08d tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1603 microversion: 2.32 time: 0.930266 Oct 29 02:58:26.867133 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1580/3230] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:25 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1603 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:26.892228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-377afb4b-a7a1-4e82-a611-73a715811021 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:26.892228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-377afb4b-a7a1-4e82-a611-73a715811021 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:26.915522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-377afb4b-a7a1-4e82-a611-73a715811021 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:26.916408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-377afb4b-a7a1-4e82-a611-73a715811021 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:26.916408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-377afb4b-a7a1-4e82-a611-73a715811021 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:26.917084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-377afb4b-a7a1-4e82-a611-73a715811021 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:26.917536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-377afb4b-a7a1-4e82-a611-73a715811021 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:26.924203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-377afb4b-a7a1-4e82-a611-73a715811021 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:26.944841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-96112264-0c8a-4873-a40b-a5d5bbc82c85 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:26.957834 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-96112264-0c8a-4873-a40b-a5d5bbc82c85 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 0.304042 Oct 29 02:58:26.959036 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1651/3231] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:26 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:26.967951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:26.970984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:26.983321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:26.984304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:26.984984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:26.986921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:26.988452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:26.989100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:27.094127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:27.112123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:27.114656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:27.116535 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e3e17c56-8d36-4c5c-867f-cd38ee64b2e8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.155895 Oct 29 02:58:27.133936 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1652/3232] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:26 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:27.144611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-887f8506-e6ea-44b3-8708-770b1f9baf5c req-a573d9b5-6944-4ed8-9968-f460b08426e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b13893-1eca-43c0-b826-a35650183201", "tag": "82024e5d-6393-4421-bd98-5bae0e521412"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:27.158061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-887f8506-e6ea-44b3-8708-770b1f9baf5c req-a573d9b5-6944-4ed8-9968-f460b08426e3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:27.158963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-887f8506-e6ea-44b3-8708-770b1f9baf5c req-a573d9b5-6944-4ed8-9968-f460b08426e3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:27.159606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-887f8506-e6ea-44b3-8708-770b1f9baf5c req-a573d9b5-6944-4ed8-9968-f460b08426e3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:27.175270 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-887f8506-e6ea-44b3-8708-770b1f9baf5c req-a573d9b5-6944-4ed8-9968-f460b08426e3 service nova] Creating event network-changed:82024e5d-6393-4421-bd98-5bae0e521412 for instance e1b13893-1eca-43c0-b826-a35650183201 on n-h2-862964-4 Oct 29 02:58:27.183070 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-887f8506-e6ea-44b3-8708-770b1f9baf5c req-a573d9b5-6944-4ed8-9968-f460b08426e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046374 Oct 29 02:58:27.184812 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1653/3233] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:27.191149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90862f9a-ae30-4734-83fc-81a1372a225c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:27.192170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-90862f9a-ae30-4734-83fc-81a1372a225c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:27.202350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90862f9a-ae30-4734-83fc-81a1372a225c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:27.203591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90862f9a-ae30-4734-83fc-81a1372a225c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:27.204296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90862f9a-ae30-4734-83fc-81a1372a225c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:27.206987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90862f9a-ae30-4734-83fc-81a1372a225c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:27.207751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90862f9a-ae30-4734-83fc-81a1372a225c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:27.208419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90862f9a-ae30-4734-83fc-81a1372a225c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:27.705625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-90862f9a-ae30-4734-83fc-81a1372a225c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:27.719078 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-90862f9a-ae30-4734-83fc-81a1372a225c tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1510 microversion: 2.1 time: 0.532519 Oct 29 02:58:27.722103 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1654/3234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:27 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1510 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:27.731571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5517ce31-98ba-4624-ab02-cc87c218c3cc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:27.734028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5517ce31-98ba-4624-ab02-cc87c218c3cc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:27.751457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5517ce31-98ba-4624-ab02-cc87c218c3cc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:27.753140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5517ce31-98ba-4624-ab02-cc87c218c3cc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:27.755787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5517ce31-98ba-4624-ab02-cc87c218c3cc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:27.757684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5517ce31-98ba-4624-ab02-cc87c218c3cc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:27.759697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5517ce31-98ba-4624-ab02-cc87c218c3cc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:27.762363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5517ce31-98ba-4624-ab02-cc87c218c3cc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.060642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5517ce31-98ba-4624-ab02-cc87c218c3cc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:28.070267 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5517ce31-98ba-4624-ab02-cc87c218c3cc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.346423 Oct 29 02:58:28.071155 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1655/3235] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:27 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:28.081594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:28.082525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:28.107777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.109088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.109859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.111364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.112063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.113204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.202776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.203345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.208624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-377afb4b-a7a1-4e82-a611-73a715811021 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:28.223443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.223443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lazy-loading 'fault' on Instance uuid 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:58:28.230241 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-377afb4b-a7a1-4e82-a611-73a715811021 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1483 microversion: 2.1 time: 1.350019 Oct 29 02:58:28.230910 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1581/3236] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:26 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1483 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:28.260383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef8bb9a5-960c-4f56-bdd6-0b559c758396 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:28.271286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ef8bb9a5-960c-4f56-bdd6-0b559c758396 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:28.312088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef8bb9a5-960c-4f56-bdd6-0b559c758396 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.315361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef8bb9a5-960c-4f56-bdd6-0b559c758396 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.319262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef8bb9a5-960c-4f56-bdd6-0b559c758396 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.320636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef8bb9a5-960c-4f56-bdd6-0b559c758396 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.321337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef8bb9a5-960c-4f56-bdd6-0b559c758396 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.325684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef8bb9a5-960c-4f56-bdd6-0b559c758396 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.395717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:28.411441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:28.424457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b95983a06784c0092841b61efd66ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c813a6b4d51c4c268e9871a292ac33b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:28.425932 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a73329e5-54e8-4fb7-bf64-63eeaf66736f tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 200 len: 1608 microversion: 2.32 time: 0.353314 Oct 29 02:58:28.443079 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1656/3237] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:28 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 1608 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:28.450991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:28.459512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:28.488863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.494389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.494808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.498787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.499283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.503914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.720404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:28.745411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:28.749876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:28.752447 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d0d8fb8d-a5fe-49f9-ae38-808a3a27e742 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.307180 Oct 29 02:58:28.754847 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1657/3238] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:28 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:28.762556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a3ee62e-153f-4845-b89d-45c1b5ffe30f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:28.767645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6a3ee62e-153f-4845-b89d-45c1b5ffe30f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:28.804524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ee62e-153f-4845-b89d-45c1b5ffe30f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.805303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ee62e-153f-4845-b89d-45c1b5ffe30f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.806615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ee62e-153f-4845-b89d-45c1b5ffe30f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.807978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ee62e-153f-4845-b89d-45c1b5ffe30f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.812783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ee62e-153f-4845-b89d-45c1b5ffe30f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.813994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ee62e-153f-4845-b89d-45c1b5ffe30f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.148661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a3ee62e-153f-4845-b89d-45c1b5ffe30f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:29.159387 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a3ee62e-153f-4845-b89d-45c1b5ffe30f tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1468 microversion: 2.1 time: 0.402257 Oct 29 02:58:29.164112 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1658/3239] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:28 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1468 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:29.176162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a6a1b72-d092-47d4-9bc6-a47fd717879a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:29.178692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6a6a1b72-d092-47d4-9bc6-a47fd717879a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:29.192738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b72-d092-47d4-9bc6-a47fd717879a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.194491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b72-d092-47d4-9bc6-a47fd717879a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.195098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b72-d092-47d4-9bc6-a47fd717879a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.198465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b72-d092-47d4-9bc6-a47fd717879a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.199340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b72-d092-47d4-9bc6-a47fd717879a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.202325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a6a1b72-d092-47d4-9bc6-a47fd717879a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.506587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a6a1b72-d092-47d4-9bc6-a47fd717879a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:29.521141 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a6a1b72-d092-47d4-9bc6-a47fd717879a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.354786 Oct 29 02:58:29.540595 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1659/3240] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:29 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:29.550404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:29.553958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:29.569057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.569777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.570355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.571212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.574882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.574882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.637912 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] HTTP exception thrown: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Request method failure captured: Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 HTTP/1.1 Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJVISh5KiZhzyqa3t3RSNxkf8WS8SmN1yW-zENJ2mfpCRu6nxNmDWv-TlOGMwoFLtDloVWKO-x7-Kq0FWRdjgD2Fkzinq9LdXV_NI1Qogc8dRA62y6MyAM2mR39EJ2VeEhVAQxzkPB2ctVqDgshUDiZpnZ598IVwHjMPdu08TotHWcc Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c813a6b4d51c4c268e9871a292ac33b8 Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TaggedBootDevicesTest-1570790207 Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c813a6b4d51c4c268e9871a292ac33b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c813a6b4d51c4c268e9871a292ac33b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c813a6b4d51c4c268e9871a292ac33b8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c813a6b4d51c4c268e9871a292ac33b8"}]}] Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TaggedBootDevicesTest-1570790207 Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c813a6b4d51c4c268e9871a292ac33b8 Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1570790207 Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TaggedBootDevicesTest-1570790207-project Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3b95983a06784c0092841b61efd66ba4 Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TaggedBootDevicesTest-1570790207-project Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '064a2fd2-d8fa-4598-bd7b-d67ea792a9d9'} Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:29.647642 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:29.652621 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:29.652621 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:29.652621 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:29.652621 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:29.652621 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:29.652621 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:29.652621 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:29.652621 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:29.653953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Returning 404 to user: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:29.658976 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bde0d2de-81b3-4875-8556-7da1c356d283 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 404 len: 111 microversion: 2.32 time: 0.118161 Oct 29 02:58:29.663558 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1660/3241] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:29 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:58:29.678904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a444ba96-8c7c-46da-8ffc-b7d2c5540861 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '.version_select at 0x7fe1a87cd700>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:29.742309 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a444ba96-8c7c-46da-8ffc-b7d2c5540861 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-88122665" status: 204 len: 0 microversion: 2.32 time: 0.077233 Oct 29 02:58:29.753514 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1661/3242] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 02:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-88122665 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:58:29.792723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:29.793514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:29.815125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.817269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.818069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.819684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.820251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.820708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.856146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ef8bb9a5-960c-4f56-bdd6-0b559c758396 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:29.870557 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ef8bb9a5-960c-4f56-bdd6-0b559c758396 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 1.631808 Oct 29 02:58:29.872204 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1582/3243] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:28 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:29.888463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-16712de0-0954-431b-a401-bca83f294911 req-af40a6c0-e08a-4167-8a9d-94b81c18c8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e3883b-cb09-4f23-a780-addd0b95fa66", "name": "network-vif-deleted", "tag": "c4c51b61-fc93-44e8-96b1-b8cc31e8bf3c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:29.936199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-16712de0-0954-431b-a401-bca83f294911 req-af40a6c0-e08a-4167-8a9d-94b81c18c8c8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.936681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-16712de0-0954-431b-a401-bca83f294911 req-af40a6c0-e08a-4167-8a9d-94b81c18c8c8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.937102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-16712de0-0954-431b-a401-bca83f294911 req-af40a6c0-e08a-4167-8a9d-94b81c18c8c8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.972043 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-16712de0-0954-431b-a401-bca83f294911 req-af40a6c0-e08a-4167-8a9d-94b81c18c8c8 service nova] Creating event network-vif-deleted:c4c51b61-fc93-44e8-96b1-b8cc31e8bf3c for instance 75e3883b-cb09-4f23-a780-addd0b95fa66 on n-h2-862964-4 Oct 29 02:58:29.980216 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-16712de0-0954-431b-a401-bca83f294911 req-af40a6c0-e08a-4167-8a9d-94b81c18c8c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106458 Oct 29 02:58:29.980845 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1583/3244] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:30.197307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:30.200273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:30.211233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:30.218540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.225724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.226363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:30.228679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.229546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.231334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:30.232577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.234175 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-383c0568-bcc3-4095-aa7b-c6dae4f13c17 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.446168 Oct 29 02:58:30.234753 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1662/3245] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:29 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:30.234907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.379927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:30.396434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.399843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.400468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.403918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lazy-loading 'fault' on Instance uuid 75e3883b-cb09-4f23-a780-addd0b95fa66 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:58:30.536373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7518ee5c6e334b768c9881ebb6e30559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2541b0313460463f87257f0cc735f973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:30.565572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-63189bcc-039b-4278-a483-890102bc4273 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:30.567826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-63189bcc-039b-4278-a483-890102bc4273 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:30.585657 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-14f4f692-7d7b-4d2a-9f5e-c36e8bbbac86 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 200 len: 1306 microversion: 2.1 time: 0.397902 Oct 29 02:58:30.586338 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1584/3246] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:30 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 1306 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:30.595677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63189bcc-039b-4278-a483-890102bc4273 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.599793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63189bcc-039b-4278-a483-890102bc4273 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.607595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63189bcc-039b-4278-a483-890102bc4273 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.617995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63189bcc-039b-4278-a483-890102bc4273 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.621712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63189bcc-039b-4278-a483-890102bc4273 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.622235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63189bcc-039b-4278-a483-890102bc4273 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.899145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c90405a-4ae7-4e78-b8ab-a5ec7dcf8edb tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:30.900219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0c90405a-4ae7-4e78-b8ab-a5ec7dcf8edb tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:30.908883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c90405a-4ae7-4e78-b8ab-a5ec7dcf8edb tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.917176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c90405a-4ae7-4e78-b8ab-a5ec7dcf8edb tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.919315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c90405a-4ae7-4e78-b8ab-a5ec7dcf8edb tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.923927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c90405a-4ae7-4e78-b8ab-a5ec7dcf8edb tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.924706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c90405a-4ae7-4e78-b8ab-a5ec7dcf8edb tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.926186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c90405a-4ae7-4e78-b8ab-a5ec7dcf8edb tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.090236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-63189bcc-039b-4278-a483-890102bc4273 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:31.098535 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-63189bcc-039b-4278-a483-890102bc4273 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.547657 Oct 29 02:58:31.103866 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1663/3247] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:30 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:31.266092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:31.266725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:31.281268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.283453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.284074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.284829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.285291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.286381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.311874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:31.491146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:31.500865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:31.502663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:31.504537 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94c9dc78-772a-4432-b561-573b87c7f233 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.243671 Oct 29 02:58:31.505994 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1664/3248] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:31 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:31.614989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:31.616500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:31.635567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.636482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.639046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.639830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.644989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.645578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.678618 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] HTTP exception thrown: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Request method failure captured: Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 HTTP/1.1 Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJa6EXLO5kOrSFSdEv87r_lKYY9NoJDIVujHwxXbOypHrtxcOeq1ZOmFHeUEvGo3w7eH1AKPykvVWJlTUaGwMBp5G2CDIFH5UW4-2lZ07fHzzJv51Ef8FYvk3I8gSFXbr80WpRQBYqQzvV3JyjmLAZqmvT-OzPJ2_czI7WzTa0Iox34 Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2541b0313460463f87257f0cc735f973"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2541b0313460463f87257f0cc735f973", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}] Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 7518ee5c6e334b768c9881ebb6e30559 Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '75e3883b-cb09-4f23-a780-addd0b95fa66'} Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.683651 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.689933 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.689933 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.689933 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.689933 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:31.689933 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:31.689933 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.689933 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.691278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Returning 404 to user: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:31.703561 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-40b5e6e6-1296-4a22-afec-198e65e32b27 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 404 len: 111 microversion: 2.1 time: 0.094609 Oct 29 02:58:31.704949 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1665/3249] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:31 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:58:31.714095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-421257517", "metadata": {"image_type": "test"}}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:31.720654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:31.734961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.739468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.741310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.754919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.755407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.756027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.777234 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] HTTP exception thrown: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Request method failure captured: Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66/action HTTP/1.1 Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 111 Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJa6EXLO5kOrSFSdEv87r_lKYY9NoJDIVujHwxXbOypHrtxcOeq1ZOmFHeUEvGo3w7eH1AKPykvVWJlTUaGwMBp5G2CDIFH5UW4-2lZ07fHzzJv51Ef8FYvk3I8gSFXbr80WpRQBYqQzvV3JyjmLAZqmvT-OzPJ2_czI7WzTa0Iox34 Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2541b0313460463f87257f0cc735f973"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2541b0313460463f87257f0cc735f973", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}] Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 7518ee5c6e334b768c9881ebb6e30559 Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-421257517", "metadata": {"image_type": "test"}}} Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '75e3883b-cb09-4f23-a780-addd0b95fa66', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-421257517', 'metadata': {'image_type': 'test'}}}} Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:58:31.791415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Returning 404 to user: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-219d3cb0-cf75-4777-bb27-86269daa0087 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "POST /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66/action" status: 404 len: 111 microversion: 2.1 time: 0.083765 Oct 29 02:58:31.795349 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1666/3250] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Oct 29 02:58:31 2022] POST /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:31.806367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90c6fc7c-60e4-4754-95bc-85be0318dac4 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-678326091", "metadata": {"image_type": "test"}}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:31.808923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-90c6fc7c-60e4-4754-95bc-85be0318dac4 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Failed to fetch instance by id tempest-invalid-1278787823 {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 02:58:31.809439 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-90c6fc7c-60e4-4754-95bc-85be0318dac4 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] HTTP exception thrown: Instance tempest-invalid-1278787823 could not be found. Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90c6fc7c-60e4-4754-95bc-85be0318dac4 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Request method failure captured: Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/tempest-invalid-1278787823/action HTTP/1.1 Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 111 Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJa6EXLO5kOrSFSdEv87r_lKYY9NoJDIVujHwxXbOypHrtxcOeq1ZOmFHeUEvGo3w7eH1AKPykvVWJlTUaGwMBp5G2CDIFH5UW4-2lZ07fHzzJv51Ef8FYvk3I8gSFXbr80WpRQBYqQzvV3JyjmLAZqmvT-OzPJ2_czI7WzTa0Iox34 Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2541b0313460463f87257f0cc735f973"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2541b0313460463f87257f0cc735f973", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}] Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 7518ee5c6e334b768c9881ebb6e30559 Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-678326091", "metadata": {"image_type": "test"}}} Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance tempest-invalid-1278787823 could not be found. Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'tempest-invalid-1278787823', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-678326091', 'metadata': {'image_type': 'test'}}}} Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1278787823 could not be found. Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:31.811194 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1278787823 could not be found. Oct 29 02:58:31.815400 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.815400 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.815400 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.815400 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.815400 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.815400 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.815400 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:31.815400 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:31.815400 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1278787823 could not be found. Oct 29 02:58:31.815400 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.826781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90c6fc7c-60e4-4754-95bc-85be0318dac4 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Returning 404 to user: Instance tempest-invalid-1278787823 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:31.827832 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-90c6fc7c-60e4-4754-95bc-85be0318dac4 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-1278787823/action" status: 404 len: 101 microversion: 2.1 time: 0.025734 Oct 29 02:58:31.829634 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1667/3251] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 02:58:31 2022] POST /compute/v2.1/servers/tempest-invalid-1278787823/action => generated 101 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:58:31.852199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51cc2e7d-3d87-4435-a918-0158c2e279ce tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1001229149"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:31.856441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-51cc2e7d-3d87-4435-a918-0158c2e279ce tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 02:58:31.857319 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-51cc2e7d-3d87-4435-a918-0158c2e279ce tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51cc2e7d-3d87-4435-a918-0158c2e279ce tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Request method failure captured: Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 57 Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJa6EXLO5kOrSFSdEv87r_lKYY9NoJDIVujHwxXbOypHrtxcOeq1ZOmFHeUEvGo3w7eH1AKPykvVWJlTUaGwMBp5G2CDIFH5UW4-2lZ07fHzzJv51Ef8FYvk3I8gSFXbr80WpRQBYqQzvV3JyjmLAZqmvT-OzPJ2_czI7WzTa0Iox34 Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2541b0313460463f87257f0cc735f973"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2541b0313460463f87257f0cc735f973", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}] Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 7518ee5c6e334b768c9881ebb6e30559 Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: {"createImage": {"name": "tempest-test-snap-1001229149"}} Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1001229149'}}} Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:58:31.862527 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.866778 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.866778 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.866778 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.866778 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.866778 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.866778 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:31.866778 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:31.866778 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:58:31.866778 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.868874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51cc2e7d-3d87-4435-a918-0158c2e279ce tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:31.870602 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-51cc2e7d-3d87-4435-a918-0158c2e279ce tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.030238 Oct 29 02:58:31.872235 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1668/3252] 10.222.0.16 () {60 vars in 1275 bytes} [Sat Oct 29 02:58:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:31.887718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3c71820-a616-4ce9-b313-00f24794d543 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1753748179"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:31.891255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a3c71820-a616-4ce9-b313-00f24794d543 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 02:58:31.892323 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-a3c71820-a616-4ce9-b313-00f24794d543 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3c71820-a616-4ce9-b313-00f24794d543 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Request method failure captured: Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 57 Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJa6EXLO5kOrSFSdEv87r_lKYY9NoJDIVujHwxXbOypHrtxcOeq1ZOmFHeUEvGo3w7eH1AKPykvVWJlTUaGwMBp5G2CDIFH5UW4-2lZ07fHzzJv51Ef8FYvk3I8gSFXbr80WpRQBYqQzvV3JyjmLAZqmvT-OzPJ2_czI7WzTa0Iox34 Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2541b0313460463f87257f0cc735f973"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2541b0313460463f87257f0cc735f973", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}] Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 7518ee5c6e334b768c9881ebb6e30559 Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: {"createImage": {"name": "tempest-test-snap-1753748179"}} Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1753748179'}}} Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:58:31.894425 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.900691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.900691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.900691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.900691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.900691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.900691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:31.900691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:31.900691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:58:31.900691 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.903402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3c71820-a616-4ce9-b313-00f24794d543 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:31.904997 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3c71820-a616-4ce9-b313-00f24794d543 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.027698 Oct 29 02:58:31.906320 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1669/3253] 10.222.0.16 () {60 vars in 1281 bytes} [Sat Oct 29 02:58:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:31.919669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:31.920532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:31.925657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:31.934376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.935384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.936039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.937618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.938320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.938938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.961825 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] HTTP exception thrown: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Request method failure captured: Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 HTTP/1.1 Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJa6EXLO5kOrSFSdEv87r_lKYY9NoJDIVujHwxXbOypHrtxcOeq1ZOmFHeUEvGo3w7eH1AKPykvVWJlTUaGwMBp5G2CDIFH5UW4-2lZ07fHzzJv51Ef8FYvk3I8gSFXbr80WpRQBYqQzvV3JyjmLAZqmvT-OzPJ2_czI7WzTa0Iox34 Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2541b0313460463f87257f0cc735f973"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2541b0313460463f87257f0cc735f973", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}] Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 7518ee5c6e334b768c9881ebb6e30559 Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '75e3883b-cb09-4f23-a780-addd0b95fa66'} Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:31.969677 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:31.978997 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.978997 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.978997 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:31.978997 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.978997 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:31.978997 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:31.978997 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:31.978997 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:31.978997 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:31.978997 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:31.978997 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:31.992056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Returning 404 to user: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:31.998159 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-780c4bbc-26de-441e-a142-9f5936cf9293 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 404 len: 111 microversion: 2.1 time: 0.082320 Oct 29 02:58:32.000552 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1670/3254] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:58:31 2022] DELETE /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:32.010417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:32.011477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] [instance: 75e3883b-cb09-4f23-a780-addd0b95fa66] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:32.019121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:32.019851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:32.020485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:32.021370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:32.022204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:32.023157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:32.044093 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] HTTP exception thrown: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Request method failure captured: Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 HTTP/1.1 Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJa6EXLO5kOrSFSdEv87r_lKYY9NoJDIVujHwxXbOypHrtxcOeq1ZOmFHeUEvGo3w7eH1AKPykvVWJlTUaGwMBp5G2CDIFH5UW4-2lZ07fHzzJv51Ef8FYvk3I8gSFXbr80WpRQBYqQzvV3JyjmLAZqmvT-OzPJ2_czI7WzTa0Iox34 Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2541b0313460463f87257f0cc735f973"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2541b0313460463f87257f0cc735f973", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2541b0313460463f87257f0cc735f973"}]}] Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2541b0313460463f87257f0cc735f973 Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-179818091 Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 7518ee5c6e334b768c9881ebb6e30559 Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ImagesNegativeTestJSON-179818091-project Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '75e3883b-cb09-4f23-a780-addd0b95fa66'} Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:32.046426 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:32.052119 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:32.052119 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:32.052119 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:32.052119 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:32.052119 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:32.052119 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. Oct 29 02:58:32.052119 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:32.055812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] Returning 404 to user: Instance 75e3883b-cb09-4f23-a780-addd0b95fa66 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:32.057900 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-45604311-1318-4b71-8650-0d4c681b2da2 tempest-ImagesNegativeTestJSON-179818091 tempest-ImagesNegativeTestJSON-179818091-project] 10.222.0.16 "GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66" status: 404 len: 111 microversion: 2.1 time: 0.052414 Oct 29 02:58:32.058951 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1671/3255] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:32 2022] GET /compute/v2.1/servers/75e3883b-cb09-4f23-a780-addd0b95fa66 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:32.133629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cddfc892-3f5c-44eb-a4f8-5718e696ef31 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:32.135837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cddfc892-3f5c-44eb-a4f8-5718e696ef31 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:32.145310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddfc892-3f5c-44eb-a4f8-5718e696ef31 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:32.146178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddfc892-3f5c-44eb-a4f8-5718e696ef31 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:32.146876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddfc892-3f5c-44eb-a4f8-5718e696ef31 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:32.148027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddfc892-3f5c-44eb-a4f8-5718e696ef31 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:32.148790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddfc892-3f5c-44eb-a4f8-5718e696ef31 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:32.149498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddfc892-3f5c-44eb-a4f8-5718e696ef31 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:32.231910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0c90405a-4ae7-4e78-b8ab-a5ec7dcf8edb tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:32.246428 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0c90405a-4ae7-4e78-b8ab-a5ec7dcf8edb tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 1.352121 Oct 29 02:58:32.253333 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1585/3256] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:30 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:32.475726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cddfc892-3f5c-44eb-a4f8-5718e696ef31 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:32.488028 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cddfc892-3f5c-44eb-a4f8-5718e696ef31 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.361145 Oct 29 02:58:32.489856 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1672/3257] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:32 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:32.535276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:32.535893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:32.555806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:32.556428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:32.556866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:32.557588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:32.570376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:32.570914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:32.754041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:32.768695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:32.772722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:32.782492 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ee4987d-5da5-4e8f-aa14-6f442750573a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.253674 Oct 29 02:58:32.783822 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1586/3258] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:32 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:33.274153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3b7f4fd5-e94c-48ac-80fa-ff1aba2410e5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:33.275124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b7f4fd5-e94c-48ac-80fa-ff1aba2410e5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:33.290923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b7f4fd5-e94c-48ac-80fa-ff1aba2410e5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:33.294050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b7f4fd5-e94c-48ac-80fa-ff1aba2410e5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:33.294692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b7f4fd5-e94c-48ac-80fa-ff1aba2410e5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:33.299107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b7f4fd5-e94c-48ac-80fa-ff1aba2410e5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:33.299811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b7f4fd5-e94c-48ac-80fa-ff1aba2410e5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:33.300954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b7f4fd5-e94c-48ac-80fa-ff1aba2410e5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:33.514690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4fe63879-7e65-4c6f-81f8-0b0f35d738ef tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:33.515240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4fe63879-7e65-4c6f-81f8-0b0f35d738ef tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:33.534054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fe63879-7e65-4c6f-81f8-0b0f35d738ef tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:33.534602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fe63879-7e65-4c6f-81f8-0b0f35d738ef tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:33.547465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fe63879-7e65-4c6f-81f8-0b0f35d738ef tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:33.551257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fe63879-7e65-4c6f-81f8-0b0f35d738ef tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:33.551945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fe63879-7e65-4c6f-81f8-0b0f35d738ef tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:33.553823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fe63879-7e65-4c6f-81f8-0b0f35d738ef tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:33.652861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b7f4fd5-e94c-48ac-80fa-ff1aba2410e5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:33.663021 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3b7f4fd5-e94c-48ac-80fa-ff1aba2410e5 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 0.394031 Oct 29 02:58:33.683832 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1673/3259] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:33 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:33.814643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:33.815712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:33.841612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:33.868265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:33.870496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:33.873188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:33.876204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:33.878601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:34.338539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4fe63879-7e65-4c6f-81f8-0b0f35d738ef tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:34.348915 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4fe63879-7e65-4c6f-81f8-0b0f35d738ef tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.837572 Oct 29 02:58:34.358045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:34.364270 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1587/3260] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:33 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:34.372847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:34.387300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:34.388851 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-513a6fa9-3b0b-41dd-a3b2-36673c731186 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.582240 Oct 29 02:58:34.393497 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1674/3261] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:33 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:34.691364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f6d45979-4992-4bc5-ac2a-793429733882 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:34.692941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f6d45979-4992-4bc5-ac2a-793429733882 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:34.716578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d45979-4992-4bc5-ac2a-793429733882 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:34.717535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d45979-4992-4bc5-ac2a-793429733882 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:34.718414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d45979-4992-4bc5-ac2a-793429733882 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:34.719370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d45979-4992-4bc5-ac2a-793429733882 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:34.723205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d45979-4992-4bc5-ac2a-793429733882 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:34.734278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d45979-4992-4bc5-ac2a-793429733882 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:35.378226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-605a2183-2fb6-4982-873b-2a5c83389692 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:35.379796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-605a2183-2fb6-4982-873b-2a5c83389692 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:35.401622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-605a2183-2fb6-4982-873b-2a5c83389692 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:35.402679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-605a2183-2fb6-4982-873b-2a5c83389692 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:35.403941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-605a2183-2fb6-4982-873b-2a5c83389692 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:35.406948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-605a2183-2fb6-4982-873b-2a5c83389692 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:35.407433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-605a2183-2fb6-4982-873b-2a5c83389692 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:35.407882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-605a2183-2fb6-4982-873b-2a5c83389692 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:35.758834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-605a2183-2fb6-4982-873b-2a5c83389692 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:35.772133 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-605a2183-2fb6-4982-873b-2a5c83389692 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.397434 Oct 29 02:58:35.772804 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1675/3262] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:35 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:35.805776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:35.808989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:35.822714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:35.825592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:35.826154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:35.829137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:35.832307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:35.833024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:36.005205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f6d45979-4992-4bc5-ac2a-793429733882 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:36.019574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:36.031091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:36.031999 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f6d45979-4992-4bc5-ac2a-793429733882 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 1.342454 Oct 29 02:58:36.051263 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1588/3263] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:34 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:36.059463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:36.065412 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-38a5836f-ce85-452c-9095-9527313497c7 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.273068 Oct 29 02:58:36.069701 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1676/3264] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:35 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:36.798044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-74ae515e-47c6-44f6-acfb-7593113701fb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:36.798959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-74ae515e-47c6-44f6-acfb-7593113701fb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:36.816782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ae515e-47c6-44f6-acfb-7593113701fb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:36.821874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ae515e-47c6-44f6-acfb-7593113701fb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:36.822431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ae515e-47c6-44f6-acfb-7593113701fb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:36.823245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ae515e-47c6-44f6-acfb-7593113701fb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:36.823721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ae515e-47c6-44f6-acfb-7593113701fb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:36.824155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74ae515e-47c6-44f6-acfb-7593113701fb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:36.915196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:37.078227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2fe99a64-2601-4702-a681-705d34326c16 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:37.078867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2fe99a64-2601-4702-a681-705d34326c16 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:37.097387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe99a64-2601-4702-a681-705d34326c16 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:37.107186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe99a64-2601-4702-a681-705d34326c16 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:37.112283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe99a64-2601-4702-a681-705d34326c16 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:37.113686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe99a64-2601-4702-a681-705d34326c16 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:37.114399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe99a64-2601-4702-a681-705d34326c16 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:37.115037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe99a64-2601-4702-a681-705d34326c16 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:37.217250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-74ae515e-47c6-44f6-acfb-7593113701fb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:37.239884 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-74ae515e-47c6-44f6-acfb-7593113701fb tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.446730 Oct 29 02:58:37.251045 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1589/3265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:36 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:37.267628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:37.268239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:37.289701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:37.296381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:37.297124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:37.300817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:37.301476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:37.302318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:37.558537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:37.576388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:37.586094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:37.588184 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ae4676b9-3ff7-40d6-a7c7-d244b956f631 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1365 microversion: 2.47 time: 0.335981 Oct 29 02:58:37.597888 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1590/3266] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:37 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:37.744295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2fe99a64-2601-4702-a681-705d34326c16 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:37.753197 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2fe99a64-2601-4702-a681-705d34326c16 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 0.679145 Oct 29 02:58:37.762652 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1677/3267] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:37 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:38.266462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9eb0eca9-6671-4bf4-8f8f-1827b9dcff48 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:38.267130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9eb0eca9-6671-4bf4-8f8f-1827b9dcff48 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:38.288682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9eb0eca9-6671-4bf4-8f8f-1827b9dcff48 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:38.289430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9eb0eca9-6671-4bf4-8f8f-1827b9dcff48 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:38.290158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9eb0eca9-6671-4bf4-8f8f-1827b9dcff48 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:38.298798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9eb0eca9-6671-4bf4-8f8f-1827b9dcff48 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:38.301299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9eb0eca9-6671-4bf4-8f8f-1827b9dcff48 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:38.302910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9eb0eca9-6671-4bf4-8f8f-1827b9dcff48 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:38.617981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:38.620174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:38.639457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:38.641424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:38.641902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:38.642631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:38.645163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:38.645600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:39.039230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:39.057520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:39.059094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:39.076454 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6c2ee3e8-93e4-4273-8780-bee49e436453 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1371 microversion: 2.47 time: 0.463381 Oct 29 02:58:39.081973 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1678/3268] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:38 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1371 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:39.101642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8fc9c105-9cfb-43af-8231-eea582564af9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:39.114468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8fc9c105-9cfb-43af-8231-eea582564af9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:39.145042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc9c105-9cfb-43af-8231-eea582564af9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:39.150405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc9c105-9cfb-43af-8231-eea582564af9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:39.152197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc9c105-9cfb-43af-8231-eea582564af9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:39.158823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc9c105-9cfb-43af-8231-eea582564af9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:39.160964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc9c105-9cfb-43af-8231-eea582564af9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:39.165612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc9c105-9cfb-43af-8231-eea582564af9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:39.536513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9eb0eca9-6671-4bf4-8f8f-1827b9dcff48 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:39.554107 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9eb0eca9-6671-4bf4-8f8f-1827b9dcff48 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 1.291668 Oct 29 02:58:39.558730 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1591/3269] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:38 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:39.917599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8fc9c105-9cfb-43af-8231-eea582564af9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:39.931074 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8fc9c105-9cfb-43af-8231-eea582564af9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 0.847399 Oct 29 02:58:39.934983 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1679/3270] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:39 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:40.108477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:40.109099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:40.126807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:40.127328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:40.127774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:40.129158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:40.129621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:40.130074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:40.431346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:40.483297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:40.491442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:40.500994 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a176aa7b-5dbc-4b16-af12-da530305f0b8 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1371 microversion: 2.47 time: 0.394156 Oct 29 02:58:40.503579 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1592/3271] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:40 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1371 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:40.584494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2019b44d-c283-4d8c-9b39-6458349cb8ab tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:40.585132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2019b44d-c283-4d8c-9b39-6458349cb8ab tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:40.607670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2019b44d-c283-4d8c-9b39-6458349cb8ab tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:40.608161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2019b44d-c283-4d8c-9b39-6458349cb8ab tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:40.608600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2019b44d-c283-4d8c-9b39-6458349cb8ab tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:40.609311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2019b44d-c283-4d8c-9b39-6458349cb8ab tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:40.609758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2019b44d-c283-4d8c-9b39-6458349cb8ab tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:40.610206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2019b44d-c283-4d8c-9b39-6458349cb8ab tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:40.896423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5b4b1009-ebaf-4aa0-9b8e-7c002f2f7174 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Action: 'create', calling method: .version_select at 0x7fe1a8a3b4c0>, body: {"keypair": {"name": "tempest-keypair-565323496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFOk9t9PB3eggPDDJJ6ni12Dx65pBlO/+hq7MWL6ZaI9QuqlvlkqMkyaIPgSedCTyfAWg3EfsCODwFmZvM4Thns48pzbO1K9q6OuZW8bcL+iSxBwsS3mrgGiJew9nlyBA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:40.956461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5b4b1009-ebaf-4aa0-9b8e-7c002f2f7174 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Getting quotas for project 7eb1bb96119d42f3900af93321db08bf. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:58:40.979490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5b4b1009-ebaf-4aa0-9b8e-7c002f2f7174 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Getting quotas for user baa5908625524366a62c614bd2113894 and project 7eb1bb96119d42f3900af93321db08bf. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:58:41.034064 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5b4b1009-ebaf-4aa0-9b8e-7c002f2f7174 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.435291 Oct 29 02:58:41.035251 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1593/3272] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:58:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:41.044376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45164896-2d41-4b8a-9db9-21c07ac2d458 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:41.047332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-45164896-2d41-4b8a-9db9-21c07ac2d458 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:41.061903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45164896-2d41-4b8a-9db9-21c07ac2d458 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:41.063032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45164896-2d41-4b8a-9db9-21c07ac2d458 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:41.066474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45164896-2d41-4b8a-9db9-21c07ac2d458 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:41.067472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45164896-2d41-4b8a-9db9-21c07ac2d458 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:41.068106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45164896-2d41-4b8a-9db9-21c07ac2d458 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:41.070623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45164896-2d41-4b8a-9db9-21c07ac2d458 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:41.419629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2019b44d-c283-4d8c-9b39-6458349cb8ab tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:41.430144 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2019b44d-c283-4d8c-9b39-6458349cb8ab tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.849471 Oct 29 02:58:41.446774 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1680/3273] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:40 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:41.528565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:41.529625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:41.570642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:41.576921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:41.578643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:41.588504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:41.591899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:41.594395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:41.604277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-45164896-2d41-4b8a-9db9-21c07ac2d458 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:41.616613 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-45164896-2d41-4b8a-9db9-21c07ac2d458 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 0.579967 Oct 29 02:58:41.617229 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1594/3274] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:41 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:42.037621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:42.052033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:42.079426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:42.091790 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-16b136e1-20c1-4ae5-9a4f-ce0185dc8dec tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1356 microversion: 2.47 time: 0.564242 Oct 29 02:58:42.114026 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1681/3275] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:41 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1356 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:58:42.128892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:42.159871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:42.161012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Searching by: {'deleted': False, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:58:42.180416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:42.188400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:42.189080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:42.193123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:42.194298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:42.194959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:42.467596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bc99de2d-19e3-4214-b2b4-5671663f26c2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:42.470002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bc99de2d-19e3-4214-b2b4-5671663f26c2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:42.478331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc99de2d-19e3-4214-b2b4-5671663f26c2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:42.481929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc99de2d-19e3-4214-b2b4-5671663f26c2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:42.482774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc99de2d-19e3-4214-b2b4-5671663f26c2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:42.486039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc99de2d-19e3-4214-b2b4-5671663f26c2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:42.486798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc99de2d-19e3-4214-b2b4-5671663f26c2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:42.488627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc99de2d-19e3-4214-b2b4-5671663f26c2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:42.678453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:58:43.088932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:43.107170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:43.111108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:43.116517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:43.152450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bc99de2d-19e3-4214-b2b4-5671663f26c2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:43.162244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:43.166826 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bc99de2d-19e3-4214-b2b4-5671663f26c2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.704267 Oct 29 02:58:43.168475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:43.172642 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1682/3276] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:42 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:43.188924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-11430e0a-e61d-4d5c-8965-99815331a1af tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:43.189562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-11430e0a-e61d-4d5c-8965-99815331a1af tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:43.212119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11430e0a-e61d-4d5c-8965-99815331a1af tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:43.213763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11430e0a-e61d-4d5c-8965-99815331a1af tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:43.214273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11430e0a-e61d-4d5c-8965-99815331a1af tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:43.219220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11430e0a-e61d-4d5c-8965-99815331a1af tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:43.224551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11430e0a-e61d-4d5c-8965-99815331a1af tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:43.225063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11430e0a-e61d-4d5c-8965-99815331a1af tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:43.310253 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-42d73905-dfbd-4652-a5e3-3ba35d8dbf11 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 1.186666 Oct 29 02:58:43.321830 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1595/3277] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Oct 29 02:58:42 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:43.329304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:43.334273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:43.359653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:43.366450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:43.370603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:43.371607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:43.372231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:43.372806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:43.418340 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] HTTP exception thrown: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Request method failure captured: Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 HTTP/1.1 Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJVISh5KiZhzyqa3t3RSNxkf8WS8SmN1yW-zENJ2mfpCRu6nxNmDWv-TlOGMwoFLtDloVWKO-x7-Kq0FWRdjgD2Fkzinq9LdXV_NI1Qogc8dRA62y6MyAM2mR39EJ2VeEhVAQxzkPB2ctVqDgshUDiZpnZ598IVwHjMPdu08TotHWcc Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c813a6b4d51c4c268e9871a292ac33b8 Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TaggedBootDevicesTest-1570790207 Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c813a6b4d51c4c268e9871a292ac33b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c813a6b4d51c4c268e9871a292ac33b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c813a6b4d51c4c268e9871a292ac33b8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c813a6b4d51c4c268e9871a292ac33b8"}]}] Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TaggedBootDevicesTest-1570790207 Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c813a6b4d51c4c268e9871a292ac33b8 Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1570790207 Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TaggedBootDevicesTest-1570790207-project Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 3b95983a06784c0092841b61efd66ba4 Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TaggedBootDevicesTest-1570790207-project Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '064a2fd2-d8fa-4598-bd7b-d67ea792a9d9'} Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:43.420516 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:43.425564 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:43.425564 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:43.425564 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:43.425564 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:43.425564 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:43.425564 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:43.425564 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:43.425564 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:43.425564 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:43.425564 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:43.425564 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:43.431330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Returning 404 to user: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:43.435500 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8ab554f0-25c7-4f10-8217-80a7b0deb2a4 tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 404 len: 111 microversion: 2.32 time: 0.123008 Oct 29 02:58:43.439108 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1596/3278] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:58:43 2022] DELETE /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:58:43.452432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8efa740d-5c60-4b03-9cd4-10f0dee273f6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:43.459028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8efa740d-5c60-4b03-9cd4-10f0dee273f6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:43.481023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8efa740d-5c60-4b03-9cd4-10f0dee273f6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:43.483112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8efa740d-5c60-4b03-9cd4-10f0dee273f6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:43.487629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8efa740d-5c60-4b03-9cd4-10f0dee273f6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:43.496567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8efa740d-5c60-4b03-9cd4-10f0dee273f6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:43.497507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8efa740d-5c60-4b03-9cd4-10f0dee273f6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:43.498202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8efa740d-5c60-4b03-9cd4-10f0dee273f6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:43.597422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8efa740d-5c60-4b03-9cd4-10f0dee273f6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:58:43.647277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-11430e0a-e61d-4d5c-8965-99815331a1af tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:43.688195 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-11430e0a-e61d-4d5c-8965-99815331a1af tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 0.511658 Oct 29 02:58:43.689230 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1683/3279] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:43 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:43.710407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:43.712631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] [instance: 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:43.727948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:43.728873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:43.733223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:43.738278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:43.739525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:43.741563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:43.825089 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] HTTP exception thrown: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Request method failure captured: Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 HTTP/1.1 Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJVISh5KiZhzyqa3t3RSNxkf8WS8SmN1yW-zENJ2mfpCRu6nxNmDWv-TlOGMwoFLtDloVWKO-x7-Kq0FWRdjgD2Fkzinq9LdXV_NI1Qogc8dRA62y6MyAM2mR39EJ2VeEhVAQxzkPB2ctVqDgshUDiZpnZ598IVwHjMPdu08TotHWcc Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c813a6b4d51c4c268e9871a292ac33b8 Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TaggedBootDevicesTest-1570790207 Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c813a6b4d51c4c268e9871a292ac33b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c813a6b4d51c4c268e9871a292ac33b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c813a6b4d51c4c268e9871a292ac33b8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c813a6b4d51c4c268e9871a292ac33b8"}]}] Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TaggedBootDevicesTest-1570790207 Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c813a6b4d51c4c268e9871a292ac33b8 Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1570790207 Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TaggedBootDevicesTest-1570790207-project Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3b95983a06784c0092841b61efd66ba4 Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TaggedBootDevicesTest-1570790207-project Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '064a2fd2-d8fa-4598-bd7b-d67ea792a9d9'} Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:43.835769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:43.841570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:43.841570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:43.841570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:43.841570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:43.841570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:43.841570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:43.841570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. Oct 29 02:58:43.841570 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:43.844116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] Returning 404 to user: Instance 064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:43.844253 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8efa740d-5c60-4b03-9cd4-10f0dee273f6 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 204 len: 0 microversion: 2.47 time: 0.397955 Oct 29 02:58:43.846959 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1597/3280] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:58:43 2022] DELETE /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:58:43.848217 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7b20f09a-2b6d-4ab2-9391-93620b74fe4a tempest-TaggedBootDevicesTest-1570790207 tempest-TaggedBootDevicesTest-1570790207-project] 10.222.0.16 "GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9" status: 404 len: 111 microversion: 2.32 time: 0.156160 Oct 29 02:58:43.850176 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1684/3281] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:43 2022] GET /compute/v2.1/servers/064a2fd2-d8fa-4598-bd7b-d67ea792a9d9 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:58:43.863550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:43.869650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:43.886854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:43.890105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:43.891090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:43.892581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:43.897552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:43.898474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:44.204560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37edc823-2ad8-4bb6-98a4-c0d756b764e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:44.205438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37edc823-2ad8-4bb6-98a4-c0d756b764e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:44.216931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edc823-2ad8-4bb6-98a4-c0d756b764e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:44.224420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edc823-2ad8-4bb6-98a4-c0d756b764e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:44.225576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edc823-2ad8-4bb6-98a4-c0d756b764e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:44.226519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edc823-2ad8-4bb6-98a4-c0d756b764e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:44.231028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edc823-2ad8-4bb6-98a4-c0d756b764e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:44.239718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edc823-2ad8-4bb6-98a4-c0d756b764e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:44.500271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:44.537185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:44.539210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:44.573767 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8eb29935-c89b-47ac-9a8f-496992b1e661 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1362 microversion: 2.47 time: 0.720061 Oct 29 02:58:44.606516 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1598/3282] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:43 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1362 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:44.713595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-965b92f7-8945-47b9-9de9-727b0e704516 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:44.714968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-965b92f7-8945-47b9-9de9-727b0e704516 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:44.732979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-965b92f7-8945-47b9-9de9-727b0e704516 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:44.733470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-965b92f7-8945-47b9-9de9-727b0e704516 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:44.741407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-965b92f7-8945-47b9-9de9-727b0e704516 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:44.742394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-965b92f7-8945-47b9-9de9-727b0e704516 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:44.742956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-965b92f7-8945-47b9-9de9-727b0e704516 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:44.743546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-965b92f7-8945-47b9-9de9-727b0e704516 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.000490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37edc823-2ad8-4bb6-98a4-c0d756b764e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:45.011398 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37edc823-2ad8-4bb6-98a4-c0d756b764e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.810543 Oct 29 02:58:45.017253 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1685/3283] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:44 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:45.133010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-965b92f7-8945-47b9-9de9-727b0e704516 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:45.142954 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-965b92f7-8945-47b9-9de9-727b0e704516 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 0.433988 Oct 29 02:58:45.147266 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1599/3284] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:44 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:45.618660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:45.619573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:45.635994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.636479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.637120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.638030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.638628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.639273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.859510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:45.877503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:45.881004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:45.881507 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a3ad390-ceeb-4e10-8aed-f896008a3cbe tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1362 microversion: 2.47 time: 0.266746 Oct 29 02:58:45.889904 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1686/3285] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:45 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:45.941017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "43e19034-27a2-467d-ad22-e0d075d7dafc"}], "security_groups": [{"name": "tempest-securitygroup--1730930869"}], "key_name": "tempest-keypair-565323496", "user_data": "}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:46.037348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c7472f8-0e1b-4ec2-8d04-57a4c9cfb9de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:46.044823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c7472f8-0e1b-4ec2-8d04-57a4c9cfb9de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:46.066069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7472f8-0e1b-4ec2-8d04-57a4c9cfb9de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.066590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7472f8-0e1b-4ec2-8d04-57a4c9cfb9de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.071216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7472f8-0e1b-4ec2-8d04-57a4c9cfb9de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:46.072431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7472f8-0e1b-4ec2-8d04-57a4c9cfb9de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.073026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7472f8-0e1b-4ec2-8d04-57a4c9cfb9de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.073624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c7472f8-0e1b-4ec2-8d04-57a4c9cfb9de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:46.122479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:46.245411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] validate_networks() for [('43e19034-27a2-467d-ad22-e0d075d7dafc', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:58:46.588456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5c7472f8-0e1b-4ec2-8d04-57a4c9cfb9de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:46.604154 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c7472f8-0e1b-4ec2-8d04-57a4c9cfb9de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.570785 Oct 29 02:58:46.609673 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1687/3286] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:46 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:46.645778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dc992c9d-5bb8-4af5-830f-c463697b1223 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:46.646404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dc992c9d-5bb8-4af5-830f-c463697b1223 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:46.683933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc992c9d-5bb8-4af5-830f-c463697b1223 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.686400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc992c9d-5bb8-4af5-830f-c463697b1223 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.688394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc992c9d-5bb8-4af5-830f-c463697b1223 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:46.692313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc992c9d-5bb8-4af5-830f-c463697b1223 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.695042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc992c9d-5bb8-4af5-830f-c463697b1223 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.698991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc992c9d-5bb8-4af5-830f-c463697b1223 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.282979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:58:47.284343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:58:47.284973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:58:47.286246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:58:47.287178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:58:47.302253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.302967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.303558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.304905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.305573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.306278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.335567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Getting quotas for project 7eb1bb96119d42f3900af93321db08bf. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:58:47.351015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Getting quotas for user baa5908625524366a62c614bd2113894 and project 7eb1bb96119d42f3900af93321db08bf. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:58:47.413741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:58:47.416829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:58:47.560194 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3e333150-2ec5-4612-abe9-0355d0b24083 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.623688 Oct 29 02:58:47.563579 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1600/3287] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:58:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:58:47.584605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:47.590408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:47.604541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.605630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.619612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.619612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.620103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.620526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.747723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.750234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.751009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.751867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lazy-loading 'fault' on Instance uuid d520542f-e66b-47fa-ab75-6408fde07d43 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:58:47.804507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:47.821555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:47.830801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:47.832167 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c7d5f806-7e21-449d-a578-21cb34bcd368 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 200 len: 1367 microversion: 2.47 time: 0.266608 Oct 29 02:58:47.832783 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1601/3288] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:47 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:47.865330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bdbe0802-214b-4611-aa11-740e97d272a3 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:47.865995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bdbe0802-214b-4611-aa11-740e97d272a3 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:48.012468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bdbe0802-214b-4611-aa11-740e97d272a3 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:48.024907 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bdbe0802-214b-4611-aa11-740e97d272a3 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1225 microversion: 2.1 time: 0.167928 Oct 29 02:58:48.043063 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1602/3289] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:47 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1225 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:48.051101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-235c2111-0f13-4b05-8a64-b8506be226e1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:48.052139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-235c2111-0f13-4b05-8a64-b8506be226e1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:48.062303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-235c2111-0f13-4b05-8a64-b8506be226e1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.063303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-235c2111-0f13-4b05-8a64-b8506be226e1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.064479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-235c2111-0f13-4b05-8a64-b8506be226e1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.066197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-235c2111-0f13-4b05-8a64-b8506be226e1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.066948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-235c2111-0f13-4b05-8a64-b8506be226e1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.067517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-235c2111-0f13-4b05-8a64-b8506be226e1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.300023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-235c2111-0f13-4b05-8a64-b8506be226e1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:48.319449 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-235c2111-0f13-4b05-8a64-b8506be226e1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.273342 Oct 29 02:58:48.328385 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1603/3290] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:48 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:48.518431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dc992c9d-5bb8-4af5-830f-c463697b1223 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:48.540808 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dc992c9d-5bb8-4af5-830f-c463697b1223 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1471 microversion: 2.1 time: 1.927351 Oct 29 02:58:48.541433 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1688/3291] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:46 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1471 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:48.865402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:48.866607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: d520542f-e66b-47fa-ab75-6408fde07d43] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:48.892221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.894563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.895114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.898153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.901260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.901831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.946668 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] HTTP exception thrown: Instance d520542f-e66b-47fa-ab75-6408fde07d43 could not be found. Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Request method failure captured: Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 HTTP/1.1 Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJaz3JDf-9nJ0J4_4Fd8--Jh-p1-STkD_JAPHYxuhsI9hq_XecAC2ar-CuhAZVpPKjnz732JS7pOuBrc0pvHi80Uz5IWM8aO2Yd8TXL8yrsa85Kw_pL33sg4bVM4B22bnGpPz2R995nlaJZDG7ribI5hzV9fS0jWDiaiQ2Pp0PdVdiQ Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 34130dd0aa5d43c9846cf1a7fdb8d27d Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerShowV247Test-438877926 Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34130dd0aa5d43c9846cf1a7fdb8d27d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34130dd0aa5d43c9846cf1a7fdb8d27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34130dd0aa5d43c9846cf1a7fdb8d27d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34130dd0aa5d43c9846cf1a7fdb8d27d"}]}] Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerShowV247Test-438877926 Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 34130dd0aa5d43c9846cf1a7fdb8d27d Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerShowV247Test-438877926 Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerShowV247Test-438877926-project Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a1c2e0d8efb54a128b52722a2dcb3d7b Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerShowV247Test-438877926-project Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance d520542f-e66b-47fa-ab75-6408fde07d43 could not be found. Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'd520542f-e66b-47fa-ab75-6408fde07d43'} Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d520542f-e66b-47fa-ab75-6408fde07d43 could not be found. Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d520542f-e66b-47fa-ab75-6408fde07d43 could not be found. Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:48.948384 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:48.953191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:48.953191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:48.953191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:48.953191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:48.953191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:48.953191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d520542f-e66b-47fa-ab75-6408fde07d43 could not be found. Oct 29 02:58:48.953191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:58:48.953191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Returning 404 to user: Instance d520542f-e66b-47fa-ab75-6408fde07d43 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:48.953191 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-da2e3d43-a498-476c-b426-fbcd1b77fe55 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43" status: 404 len: 111 microversion: 2.47 time: 0.090423 Oct 29 02:58:48.965531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cbe5d0ea-5262-44ed-82b2-f9aef066c9aa tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:48.966227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cbe5d0ea-5262-44ed-82b2-f9aef066c9aa tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: e73b32c1-3d4e-434c-9369-3fade59133b3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:48.972286 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1604/3292] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:48 2022] GET /compute/v2.1/servers/d520542f-e66b-47fa-ab75-6408fde07d43 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:58:48.979452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cbe5d0ea-5262-44ed-82b2-f9aef066c9aa tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.979985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cbe5d0ea-5262-44ed-82b2-f9aef066c9aa tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.980616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cbe5d0ea-5262-44ed-82b2-f9aef066c9aa tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.981348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cbe5d0ea-5262-44ed-82b2-f9aef066c9aa tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.981794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cbe5d0ea-5262-44ed-82b2-f9aef066c9aa tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.982234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cbe5d0ea-5262-44ed-82b2-f9aef066c9aa tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.050956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-32dad3ff-616c-4dc4-9cad-e32126a1b920 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:49.051689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-32dad3ff-616c-4dc4-9cad-e32126a1b920 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:49.064137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dad3ff-616c-4dc4-9cad-e32126a1b920 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.064621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dad3ff-616c-4dc4-9cad-e32126a1b920 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.065047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dad3ff-616c-4dc4-9cad-e32126a1b920 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.065765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dad3ff-616c-4dc4-9cad-e32126a1b920 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.066241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dad3ff-616c-4dc4-9cad-e32126a1b920 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.070001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cbe5d0ea-5262-44ed-82b2-f9aef066c9aa tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: e73b32c1-3d4e-434c-9369-3fade59133b3] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:58:49.075629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dad3ff-616c-4dc4-9cad-e32126a1b920 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.309063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-32dad3ff-616c-4dc4-9cad-e32126a1b920 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:49.343819 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cbe5d0ea-5262-44ed-82b2-f9aef066c9aa tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3" status: 204 len: 0 microversion: 2.47 time: 0.383805 Oct 29 02:58:49.347515 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1689/3293] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 02:58:48 2022] DELETE /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:58:49.361916 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-32dad3ff-616c-4dc4-9cad-e32126a1b920 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1229 microversion: 2.1 time: 0.314988 Oct 29 02:58:49.364051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5f4f3c9f-80c7-461b-9cc6-3bee403a0cc4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:49.365020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5f4f3c9f-80c7-461b-9cc6-3bee403a0cc4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:49.367757 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1605/3294] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:49 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1229 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:49.382936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f4f3c9f-80c7-461b-9cc6-3bee403a0cc4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.383672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f4f3c9f-80c7-461b-9cc6-3bee403a0cc4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.384258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f4f3c9f-80c7-461b-9cc6-3bee403a0cc4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.385113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f4f3c9f-80c7-461b-9cc6-3bee403a0cc4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.385702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f4f3c9f-80c7-461b-9cc6-3bee403a0cc4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.386993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f4f3c9f-80c7-461b-9cc6-3bee403a0cc4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.387122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:49.392018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: e73b32c1-3d4e-434c-9369-3fade59133b3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:49.400508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.402034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.406966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.408862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.409349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.409880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.748069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:49.761598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:49.765466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:49.766609 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cae5c65f-b9c8-4f7c-97af-5f5870f97079 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3" status: 200 len: 1363 microversion: 2.47 time: 0.395288 Oct 29 02:58:49.766886 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1606/3295] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:49 2022] GET /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:49.798065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3542678e-84cd-4645-a7a0-d826d0faadaa tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:49.798696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3542678e-84cd-4645-a7a0-d826d0faadaa tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:49.910165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3542678e-84cd-4645-a7a0-d826d0faadaa tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.910741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3542678e-84cd-4645-a7a0-d826d0faadaa tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.911189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3542678e-84cd-4645-a7a0-d826d0faadaa tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.911931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3542678e-84cd-4645-a7a0-d826d0faadaa tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.912388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3542678e-84cd-4645-a7a0-d826d0faadaa tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.912802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3542678e-84cd-4645-a7a0-d826d0faadaa tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.960876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:50.203615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5f4f3c9f-80c7-461b-9cc6-3bee403a0cc4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:50.219789 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5f4f3c9f-80c7-461b-9cc6-3bee403a0cc4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.865261 Oct 29 02:58:50.222003 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1690/3296] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:49 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:50.285145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3542678e-84cd-4645-a7a0-d826d0faadaa tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:50.296676 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3542678e-84cd-4645-a7a0-d826d0faadaa tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1477 microversion: 2.1 time: 0.528064 Oct 29 02:58:50.300269 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1607/3297] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:49 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1477 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:50.394320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-68d15177-5936-4b45-98d6-ae226bc39931 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:50.395334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-68d15177-5936-4b45-98d6-ae226bc39931 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:50.408436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d15177-5936-4b45-98d6-ae226bc39931 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.410966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d15177-5936-4b45-98d6-ae226bc39931 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.412890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d15177-5936-4b45-98d6-ae226bc39931 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.414288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d15177-5936-4b45-98d6-ae226bc39931 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.417537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d15177-5936-4b45-98d6-ae226bc39931 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.418370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68d15177-5936-4b45-98d6-ae226bc39931 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.798786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:50.799463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: e73b32c1-3d4e-434c-9369-3fade59133b3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:50.811801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.812358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.812797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.813518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.824078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.824912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.994792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:51.009921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:51.013379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:51.015094 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90af184b-da39-40f2-b356-98412845173a tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3" status: 200 len: 1363 microversion: 2.47 time: 0.220475 Oct 29 02:58:51.016260 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1608/3298] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:50 2022] GET /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:51.209491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-68d15177-5936-4b45-98d6-ae226bc39931 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:51.221297 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-68d15177-5936-4b45-98d6-ae226bc39931 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1285 microversion: 2.1 time: 0.831803 Oct 29 02:58:51.225130 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1691/3299] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:50 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1285 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:51.247953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e72a1cdb-5e00-4f7b-9aa6-c748742cb77b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:51.248749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e72a1cdb-5e00-4f7b-9aa6-c748742cb77b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:51.257170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e72a1cdb-5e00-4f7b-9aa6-c748742cb77b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.258000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e72a1cdb-5e00-4f7b-9aa6-c748742cb77b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.258669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e72a1cdb-5e00-4f7b-9aa6-c748742cb77b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.259672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e72a1cdb-5e00-4f7b-9aa6-c748742cb77b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.260320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e72a1cdb-5e00-4f7b-9aa6-c748742cb77b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.260959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e72a1cdb-5e00-4f7b-9aa6-c748742cb77b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.322724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-378e7141-101c-44f9-87a0-ef95fea49662 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:51.323714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-378e7141-101c-44f9-87a0-ef95fea49662 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:51.331062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378e7141-101c-44f9-87a0-ef95fea49662 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.333020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378e7141-101c-44f9-87a0-ef95fea49662 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.334025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378e7141-101c-44f9-87a0-ef95fea49662 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.335074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378e7141-101c-44f9-87a0-ef95fea49662 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.335925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378e7141-101c-44f9-87a0-ef95fea49662 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.337935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378e7141-101c-44f9-87a0-ef95fea49662 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.506749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e72a1cdb-5e00-4f7b-9aa6-c748742cb77b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:51.518034 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e72a1cdb-5e00-4f7b-9aa6-c748742cb77b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1522 microversion: 2.1 time: 0.274311 Oct 29 02:58:51.536004 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1609/3300] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:51 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:51.854499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-378e7141-101c-44f9-87a0-ef95fea49662 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:51.866496 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-378e7141-101c-44f9-87a0-ef95fea49662 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1477 microversion: 2.1 time: 0.547590 Oct 29 02:58:51.867098 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1692/3301] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:51 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1477 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:52.050881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:52.052102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: e73b32c1-3d4e-434c-9369-3fade59133b3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:52.065023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.065769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.066447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.068799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.070470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.073303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.250762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e10fd9b7-f415-4190-9b22-33d1ad2efbf4 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:52.252373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e10fd9b7-f415-4190-9b22-33d1ad2efbf4 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:52.268374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10fd9b7-f415-4190-9b22-33d1ad2efbf4 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.268913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10fd9b7-f415-4190-9b22-33d1ad2efbf4 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.269378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10fd9b7-f415-4190-9b22-33d1ad2efbf4 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.270285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10fd9b7-f415-4190-9b22-33d1ad2efbf4 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.270854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10fd9b7-f415-4190-9b22-33d1ad2efbf4 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.271466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10fd9b7-f415-4190-9b22-33d1ad2efbf4 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.419098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e10fd9b7-f415-4190-9b22-33d1ad2efbf4 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:52.428449 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e10fd9b7-f415-4190-9b22-33d1ad2efbf4 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1283 microversion: 2.1 time: 0.181541 Oct 29 02:58:52.447863 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1693/3302] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:52 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1283 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:52.452853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ca422a5c-2372-410d-92d3-9e36592b7068 req-4d928c0e-365e-4a82-a699-5b23f9187c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373da2a7-dc50-4f64-bb50-98e9be4e00ea", "name": "network-vif-unplugged", "status": "completed", "tag": "2a519e5a-0fce-4f47-84d2-9cab1c919527"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:52.472775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ca422a5c-2372-410d-92d3-9e36592b7068 req-4d928c0e-365e-4a82-a699-5b23f9187c16 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.473036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ca422a5c-2372-410d-92d3-9e36592b7068 req-4d928c0e-365e-4a82-a699-5b23f9187c16 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.473865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ca422a5c-2372-410d-92d3-9e36592b7068 req-4d928c0e-365e-4a82-a699-5b23f9187c16 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.489854 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ca422a5c-2372-410d-92d3-9e36592b7068 req-4d928c0e-365e-4a82-a699-5b23f9187c16 service nova] Creating event network-vif-unplugged:2a519e5a-0fce-4f47-84d2-9cab1c919527 for instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea on n-h1-862964-4 Oct 29 02:58:52.497761 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ca422a5c-2372-410d-92d3-9e36592b7068 req-4d928c0e-365e-4a82-a699-5b23f9187c16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048502 Oct 29 02:58:52.499150 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1694/3303] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:52.552960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-735064d7-1af7-4d6d-89cb-02fb840ef9f5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:52.554021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-735064d7-1af7-4d6d-89cb-02fb840ef9f5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:52.568236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-735064d7-1af7-4d6d-89cb-02fb840ef9f5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.579844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:52.581057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-735064d7-1af7-4d6d-89cb-02fb840ef9f5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.584185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-735064d7-1af7-4d6d-89cb-02fb840ef9f5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.585180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-735064d7-1af7-4d6d-89cb-02fb840ef9f5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.585863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-735064d7-1af7-4d6d-89cb-02fb840ef9f5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.588810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-735064d7-1af7-4d6d-89cb-02fb840ef9f5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.594368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:52.595843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1c2e0d8efb54a128b52722a2dcb3d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:52.597076 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a3f39952-9685-4571-8c4f-728255d2e1ce tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3" status: 200 len: 1363 microversion: 2.47 time: 0.560218 Oct 29 02:58:52.597656 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1610/3304] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:52 2022] GET /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3 => generated 1363 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:52.894466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7a892466-9a8c-46b3-b586-b0296d81a7c6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:52.895437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7a892466-9a8c-46b3-b586-b0296d81a7c6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:52.907925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a892466-9a8c-46b3-b586-b0296d81a7c6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.908760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a892466-9a8c-46b3-b586-b0296d81a7c6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.910852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a892466-9a8c-46b3-b586-b0296d81a7c6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.912673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a892466-9a8c-46b3-b586-b0296d81a7c6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.914335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a892466-9a8c-46b3-b586-b0296d81a7c6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.915456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a892466-9a8c-46b3-b586-b0296d81a7c6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.323204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-735064d7-1af7-4d6d-89cb-02fb840ef9f5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:53.336481 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-735064d7-1af7-4d6d-89cb-02fb840ef9f5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1504 microversion: 2.1 time: 0.796037 Oct 29 02:58:53.337192 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1695/3305] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:52 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1504 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:53.463120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-946cb7c2-b8ae-496b-86b9-38424c578a53 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:53.463737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-946cb7c2-b8ae-496b-86b9-38424c578a53 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:53.473832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-946cb7c2-b8ae-496b-86b9-38424c578a53 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.474718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-946cb7c2-b8ae-496b-86b9-38424c578a53 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.474718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-946cb7c2-b8ae-496b-86b9-38424c578a53 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.480653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-946cb7c2-b8ae-496b-86b9-38424c578a53 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.481063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-946cb7c2-b8ae-496b-86b9-38424c578a53 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.484102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-946cb7c2-b8ae-496b-86b9-38424c578a53 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.856763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-946cb7c2-b8ae-496b-86b9-38424c578a53 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:53.867100 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-946cb7c2-b8ae-496b-86b9-38424c578a53 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1283 microversion: 2.1 time: 0.407902 Oct 29 02:58:53.874876 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1696/3306] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:53 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1283 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:53.883704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:53.888052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] [instance: e73b32c1-3d4e-434c-9369-3fade59133b3] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:53.897186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.906748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.907449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.908516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.909164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.909745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.947179 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] HTTP exception thrown: Instance e73b32c1-3d4e-434c-9369-3fade59133b3 could not be found. Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Request method failure captured: Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3 HTTP/1.1 Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJaz3JDf-9nJ0J4_4Fd8--Jh-p1-STkD_JAPHYxuhsI9hq_XecAC2ar-CuhAZVpPKjnz732JS7pOuBrc0pvHi80Uz5IWM8aO2Yd8TXL8yrsa85Kw_pL33sg4bVM4B22bnGpPz2R995nlaJZDG7ribI5hzV9fS0jWDiaiQ2Pp0PdVdiQ Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 34130dd0aa5d43c9846cf1a7fdb8d27d Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerShowV247Test-438877926 Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34130dd0aa5d43c9846cf1a7fdb8d27d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34130dd0aa5d43c9846cf1a7fdb8d27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34130dd0aa5d43c9846cf1a7fdb8d27d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34130dd0aa5d43c9846cf1a7fdb8d27d"}]}] Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerShowV247Test-438877926 Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 34130dd0aa5d43c9846cf1a7fdb8d27d Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerShowV247Test-438877926 Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerShowV247Test-438877926-project Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a1c2e0d8efb54a128b52722a2dcb3d7b Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerShowV247Test-438877926-project Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance e73b32c1-3d4e-434c-9369-3fade59133b3 could not be found. Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'e73b32c1-3d4e-434c-9369-3fade59133b3'} Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e73b32c1-3d4e-434c-9369-3fade59133b3 could not be found. Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e73b32c1-3d4e-434c-9369-3fade59133b3 could not be found. Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:53.950324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:53.954396 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:53.954396 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:53.954396 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:53.954396 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:53.954396 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:53.954396 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e73b32c1-3d4e-434c-9369-3fade59133b3 could not be found. Oct 29 02:58:53.954396 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:58:53.954396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] Returning 404 to user: Instance e73b32c1-3d4e-434c-9369-3fade59133b3 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:53.954396 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ba39ca9-31fe-4d47-ba2e-6001e99a0b32 tempest-ServerShowV247Test-438877926 tempest-ServerShowV247Test-438877926-project] 10.222.0.16 "GET /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3" status: 404 len: 111 microversion: 2.47 time: 0.074846 Oct 29 02:58:53.954396 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1697/3307] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:53 2022] GET /compute/v2.1/servers/e73b32c1-3d4e-434c-9369-3fade59133b3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:58:54.018934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7a892466-9a8c-46b3-b586-b0296d81a7c6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.031755 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7a892466-9a8c-46b3-b586-b0296d81a7c6 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1477 microversion: 2.1 time: 1.143059 Oct 29 02:58:54.046261 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1611/3308] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:52 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1477 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:54.366428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3cc5011b-3460-4ecf-9183-4fb66c0a5388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:54.367080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3cc5011b-3460-4ecf-9183-4fb66c0a5388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:54.387342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cc5011b-3460-4ecf-9183-4fb66c0a5388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.388149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cc5011b-3460-4ecf-9183-4fb66c0a5388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.389795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cc5011b-3460-4ecf-9183-4fb66c0a5388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.390757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cc5011b-3460-4ecf-9183-4fb66c0a5388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.393171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cc5011b-3460-4ecf-9183-4fb66c0a5388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.393858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cc5011b-3460-4ecf-9183-4fb66c0a5388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.901013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4cbc87f2-6b2f-47c4-8765-5f6ad27b68e9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:54.901919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4cbc87f2-6b2f-47c4-8765-5f6ad27b68e9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:54.916613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cbc87f2-6b2f-47c4-8765-5f6ad27b68e9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.920334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cbc87f2-6b2f-47c4-8765-5f6ad27b68e9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.922957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cbc87f2-6b2f-47c4-8765-5f6ad27b68e9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.931648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cbc87f2-6b2f-47c4-8765-5f6ad27b68e9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.932386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cbc87f2-6b2f-47c4-8765-5f6ad27b68e9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.932984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cbc87f2-6b2f-47c4-8765-5f6ad27b68e9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.975478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3cc5011b-3460-4ecf-9183-4fb66c0a5388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.986003 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3cc5011b-3460-4ecf-9183-4fb66c0a5388 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1504 microversion: 2.1 time: 0.623764 Oct 29 02:58:54.992159 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1698/3309] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:54 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1504 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:55.062625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ab56a5c8-a9d4-47c4-87d6-013b5b346a1f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:55.063443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ab56a5c8-a9d4-47c4-87d6-013b5b346a1f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:55.080523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab56a5c8-a9d4-47c4-87d6-013b5b346a1f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.083479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab56a5c8-a9d4-47c4-87d6-013b5b346a1f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.087128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab56a5c8-a9d4-47c4-87d6-013b5b346a1f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.089947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab56a5c8-a9d4-47c4-87d6-013b5b346a1f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.091750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab56a5c8-a9d4-47c4-87d6-013b5b346a1f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.095515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab56a5c8-a9d4-47c4-87d6-013b5b346a1f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.433168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cbc87f2-6b2f-47c4-8765-5f6ad27b68e9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.447625 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4cbc87f2-6b2f-47c4-8765-5f6ad27b68e9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1351 microversion: 2.1 time: 0.550651 Oct 29 02:58:55.448242 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1612/3310] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:54 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1351 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:55.454938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-1996e2ae-b0da-4371-82d0-d30f0e4ec6db req-aae23c6b-9b4f-4bdd-b935-eac86a3ddd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373da2a7-dc50-4f64-bb50-98e9be4e00ea", "name": "network-vif-plugged", "status": "completed", "tag": "2a519e5a-0fce-4f47-84d2-9cab1c919527"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:55.480700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1996e2ae-b0da-4371-82d0-d30f0e4ec6db req-aae23c6b-9b4f-4bdd-b935-eac86a3ddd1e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.481585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1996e2ae-b0da-4371-82d0-d30f0e4ec6db req-aae23c6b-9b4f-4bdd-b935-eac86a3ddd1e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.482667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1996e2ae-b0da-4371-82d0-d30f0e4ec6db req-aae23c6b-9b4f-4bdd-b935-eac86a3ddd1e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.507554 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1996e2ae-b0da-4371-82d0-d30f0e4ec6db req-aae23c6b-9b4f-4bdd-b935-eac86a3ddd1e service nova] Creating event network-vif-plugged:2a519e5a-0fce-4f47-84d2-9cab1c919527 for instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea on n-h1-862964-4 Oct 29 02:58:55.532053 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-1996e2ae-b0da-4371-82d0-d30f0e4ec6db req-aae23c6b-9b4f-4bdd-b935-eac86a3ddd1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081677 Oct 29 02:58:55.532718 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1613/3311] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:55.837616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ab56a5c8-a9d4-47c4-87d6-013b5b346a1f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.854492 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ab56a5c8-a9d4-47c4-87d6-013b5b346a1f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1477 microversion: 2.1 time: 0.798071 Oct 29 02:58:55.855818 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1699/3312] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:55 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1477 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:56.021089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e317ea78-9030-4699-8669-bf1536bc2f78 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:56.022356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e317ea78-9030-4699-8669-bf1536bc2f78 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:56.042953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e317ea78-9030-4699-8669-bf1536bc2f78 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:56.043597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e317ea78-9030-4699-8669-bf1536bc2f78 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:56.044250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e317ea78-9030-4699-8669-bf1536bc2f78 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:56.045147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e317ea78-9030-4699-8669-bf1536bc2f78 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:56.045839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e317ea78-9030-4699-8669-bf1536bc2f78 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:56.048323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e317ea78-9030-4699-8669-bf1536bc2f78 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:56.477475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-05b12aa2-338e-48ff-817d-fdb87226fa1e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:56.478317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-05b12aa2-338e-48ff-817d-fdb87226fa1e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:56.496507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b12aa2-338e-48ff-817d-fdb87226fa1e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:56.499133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b12aa2-338e-48ff-817d-fdb87226fa1e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:56.499816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b12aa2-338e-48ff-817d-fdb87226fa1e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:56.502492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b12aa2-338e-48ff-817d-fdb87226fa1e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:56.503194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b12aa2-338e-48ff-817d-fdb87226fa1e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:56.506639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b12aa2-338e-48ff-817d-fdb87226fa1e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:56.654137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e317ea78-9030-4699-8669-bf1536bc2f78 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:56.663530 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e317ea78-9030-4699-8669-bf1536bc2f78 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1504 microversion: 2.1 time: 0.646575 Oct 29 02:58:56.674736 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1614/3313] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:56 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1504 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:56.883006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-862d6bd6-f259-4c61-8e8a-4c222ed3ddb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:56.884044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-862d6bd6-f259-4c61-8e8a-4c222ed3ddb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:56.892650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:56.898691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-862d6bd6-f259-4c61-8e8a-4c222ed3ddb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:56.902501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-862d6bd6-f259-4c61-8e8a-4c222ed3ddb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:56.904610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-862d6bd6-f259-4c61-8e8a-4c222ed3ddb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:56.905550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-862d6bd6-f259-4c61-8e8a-4c222ed3ddb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:56.907478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-862d6bd6-f259-4c61-8e8a-4c222ed3ddb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:56.908664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-862d6bd6-f259-4c61-8e8a-4c222ed3ddb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.094663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-05b12aa2-338e-48ff-817d-fdb87226fa1e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.122690 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-05b12aa2-338e-48ff-817d-fdb87226fa1e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1351 microversion: 2.1 time: 0.650851 Oct 29 02:58:57.127983 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1700/3314] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:56 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1351 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:57.153138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4299b999-7049-4534-ac52-9aab2e8b4851 req-f1b407f9-eacb-42ae-8430-52aa955d8c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c050ba52-abdb-4119-8647-6d005ac7efd4", "tag": "eb22a250-842e-44b9-ade9-bb7025c87969"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:57.189401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4299b999-7049-4534-ac52-9aab2e8b4851 req-f1b407f9-eacb-42ae-8430-52aa955d8c44 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.191563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4299b999-7049-4534-ac52-9aab2e8b4851 req-f1b407f9-eacb-42ae-8430-52aa955d8c44 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.192987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4299b999-7049-4534-ac52-9aab2e8b4851 req-f1b407f9-eacb-42ae-8430-52aa955d8c44 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.246759 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4299b999-7049-4534-ac52-9aab2e8b4851 req-f1b407f9-eacb-42ae-8430-52aa955d8c44 service nova] Creating event network-changed:eb22a250-842e-44b9-ade9-bb7025c87969 for instance c050ba52-abdb-4119-8647-6d005ac7efd4 on n-h2-862964-4 Oct 29 02:58:57.264984 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4299b999-7049-4534-ac52-9aab2e8b4851 req-f1b407f9-eacb-42ae-8430-52aa955d8c44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131717 Oct 29 02:58:57.267514 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1701/3315] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:57.326253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:57.499045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-862d6bd6-f259-4c61-8e8a-4c222ed3ddb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.521021 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-862d6bd6-f259-4c61-8e8a-4c222ed3ddb7 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1477 microversion: 2.1 time: 0.643158 Oct 29 02:58:57.536313 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1615/3316] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:56 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1477 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:57.575337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4d214b96-c008-44d8-9600-fddc0ad12db8 req-343a2db0-4c96-4fb8-8eb0-f9fcd0f9c9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a570891-4387-4f63-a59a-aa60fe7360db", "name": "network-vif-unplugged", "status": "completed", "tag": "96a84e8f-b1fc-4584-a5f1-6409732df05f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:57.654882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4d214b96-c008-44d8-9600-fddc0ad12db8 req-343a2db0-4c96-4fb8-8eb0-f9fcd0f9c9ec service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.662222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4d214b96-c008-44d8-9600-fddc0ad12db8 req-343a2db0-4c96-4fb8-8eb0-f9fcd0f9c9ec service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.668065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4d214b96-c008-44d8-9600-fddc0ad12db8 req-343a2db0-4c96-4fb8-8eb0-f9fcd0f9c9ec service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.701514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fab6c6f4-03f8-486a-a980-1b147ff2fe3c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:57.702180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fab6c6f4-03f8-486a-a980-1b147ff2fe3c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:57.720746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fab6c6f4-03f8-486a-a980-1b147ff2fe3c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.721548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fab6c6f4-03f8-486a-a980-1b147ff2fe3c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.722292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fab6c6f4-03f8-486a-a980-1b147ff2fe3c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.723452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fab6c6f4-03f8-486a-a980-1b147ff2fe3c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.724208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fab6c6f4-03f8-486a-a980-1b147ff2fe3c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.724860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fab6c6f4-03f8-486a-a980-1b147ff2fe3c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.741344 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4d214b96-c008-44d8-9600-fddc0ad12db8 req-343a2db0-4c96-4fb8-8eb0-f9fcd0f9c9ec service nova] Creating event network-vif-unplugged:96a84e8f-b1fc-4584-a5f1-6409732df05f for instance 3a570891-4387-4f63-a59a-aa60fe7360db on n-h1-862964-4 Oct 29 02:58:57.767671 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4d214b96-c008-44d8-9600-fddc0ad12db8 req-343a2db0-4c96-4fb8-8eb0-f9fcd0f9c9ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.197705 Oct 29 02:58:57.778543 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1702/3317] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:58.023276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=14 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:58.164742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-14111424-af7d-4cf4-81f7-26217e69caaf tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:58.175281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-14111424-af7d-4cf4-81f7-26217e69caaf tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:58.201653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14111424-af7d-4cf4-81f7-26217e69caaf tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.203496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14111424-af7d-4cf4-81f7-26217e69caaf tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.205427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14111424-af7d-4cf4-81f7-26217e69caaf tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.207633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14111424-af7d-4cf4-81f7-26217e69caaf tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.209412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14111424-af7d-4cf4-81f7-26217e69caaf tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.210083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14111424-af7d-4cf4-81f7-26217e69caaf tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.640238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-14111424-af7d-4cf4-81f7-26217e69caaf tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:58.654987 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-14111424-af7d-4cf4-81f7-26217e69caaf tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1351 microversion: 2.1 time: 0.501214 Oct 29 02:58:58.666452 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1703/3318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:58 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1351 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:58.685206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-252184ad-24a5-49ae-8d2e-2fd224ec5725 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:58.688100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-252184ad-24a5-49ae-8d2e-2fd224ec5725 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:58.704217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252184ad-24a5-49ae-8d2e-2fd224ec5725 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.706103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252184ad-24a5-49ae-8d2e-2fd224ec5725 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.707186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252184ad-24a5-49ae-8d2e-2fd224ec5725 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.709677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252184ad-24a5-49ae-8d2e-2fd224ec5725 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.711301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252184ad-24a5-49ae-8d2e-2fd224ec5725 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.713167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-252184ad-24a5-49ae-8d2e-2fd224ec5725 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.983842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fab6c6f4-03f8-486a-a980-1b147ff2fe3c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:59.008913 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fab6c6f4-03f8-486a-a980-1b147ff2fe3c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 200 len: 1507 microversion: 2.1 time: 1.309132 Oct 29 02:58:59.011782 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1616/3319] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:57 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 1507 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:59.037130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:59.037634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:59.056658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:59.057258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:59.057701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:59.058513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:59.058918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:59.059340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:59.155271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:58:59.164565 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.compute.api [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Working on deleting snapshot d3900633-f01a-4b64-98c8-111d63e3e0b2 from shelved instance... Oct 29 02:59:00.228412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-252184ad-24a5-49ae-8d2e-2fd224ec5725 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:00.237519 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-252184ad-24a5-49ae-8d2e-2fd224ec5725 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1477 microversion: 2.1 time: 1.560475 Oct 29 02:59:00.238143 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1704/3320] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:58 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1477 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:00.387384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Doing local delete in cell 6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) {{(pid=127042) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 29 02:59:00.391319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:00.394066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:00.395571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:00.397457 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.compute.api [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 29 02:59:00.410484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] deallocate_for_instance() {{(pid=127042) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 29 02:59:00.912703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1378495819", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "b84d4357-2c49-45ad-a541-2fe93a1783c7"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:01.031140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] validate_networks() for [('b84d4357-2c49-45ad-a541-2fe93a1783c7', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:59:01.830302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Updating instance_info_cache with network_info: [] {{(pid=127042) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:59:02.104007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:59:02.104590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:59:02.105541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:59:02.106524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:59:02.107636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:59:02.112735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:02.125012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.126279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.127226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.129007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.129884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.130622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.159417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:02.176127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Getting quotas for project c7a3da1a632d443aba8f5cf3b741714b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:59:02.184255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Getting quotas for user adb51369444c42c190b1b7bf5e23ddb9 and project c7a3da1a632d443aba8f5cf3b741714b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:59:02.214379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:59:02.220155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:59:02.332759 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d850f0ef-fd18-452e-aa1c-487b089c922a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.093538 Oct 29 02:59:02.339977 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1705/3321] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:59:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:59:02.345262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b7dd3713-4e9f-45ba-b6cb-277aaa9717b8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:02.346128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b7dd3713-4e9f-45ba-b6cb-277aaa9717b8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:02.352996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7dd3713-4e9f-45ba-b6cb-277aaa9717b8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.353709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7dd3713-4e9f-45ba-b6cb-277aaa9717b8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.354317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7dd3713-4e9f-45ba-b6cb-277aaa9717b8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.355223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7dd3713-4e9f-45ba-b6cb-277aaa9717b8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.356387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7dd3713-4e9f-45ba-b6cb-277aaa9717b8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.357598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7dd3713-4e9f-45ba-b6cb-277aaa9717b8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.661070 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-942b1a7b-8144-4e0a-b4db-931735c5039e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 204 len: 0 microversion: 2.1 time: 3.627951 Oct 29 02:59:02.663630 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1617/3322] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:58:59 2022] DELETE /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 0 bytes in 3631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:59:02.675497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0723f5f1-84c2-4424-96ff-8fa78a384e2b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:02.676669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0723f5f1-84c2-4424-96ff-8fa78a384e2b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:02.693444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0723f5f1-84c2-4424-96ff-8fa78a384e2b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.695170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0723f5f1-84c2-4424-96ff-8fa78a384e2b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.695760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0723f5f1-84c2-4424-96ff-8fa78a384e2b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.696612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0723f5f1-84c2-4424-96ff-8fa78a384e2b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.698520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0723f5f1-84c2-4424-96ff-8fa78a384e2b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.699625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0723f5f1-84c2-4424-96ff-8fa78a384e2b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.734384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:02.840265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b7dd3713-4e9f-45ba-b6cb-277aaa9717b8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:02.849548 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b7dd3713-4e9f-45ba-b6cb-277aaa9717b8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1351 microversion: 2.1 time: 0.508093 Oct 29 02:59:02.854690 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1706/3323] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:02 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1351 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:02.886686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3626baca-cd48-40d4-8cec-d41b602738e0 req-5587ded8-7461-481f-b323-5c9393b6ea67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a570891-4387-4f63-a59a-aa60fe7360db", "name": "network-vif-deleted", "tag": "96a84e8f-b1fc-4584-a5f1-6409732df05f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:02.948913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3626baca-cd48-40d4-8cec-d41b602738e0 req-5587ded8-7461-481f-b323-5c9393b6ea67 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.949397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3626baca-cd48-40d4-8cec-d41b602738e0 req-5587ded8-7461-481f-b323-5c9393b6ea67 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.962039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3626baca-cd48-40d4-8cec-d41b602738e0 req-5587ded8-7461-481f-b323-5c9393b6ea67 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.010075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.compute.server_external_events [req-3626baca-cd48-40d4-8cec-d41b602738e0 req-5587ded8-7461-481f-b323-5c9393b6ea67 service nova] Unable to find a host for instance 3a570891-4387-4f63-a59a-aa60fe7360db. Dropping event network-vif-deleted {{(pid=127041) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 02:59:03.011448 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3626baca-cd48-40d4-8cec-d41b602738e0 req-5587ded8-7461-481f-b323-5c9393b6ea67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.139627 Oct 29 02:59:03.012776 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1707/3324] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 157 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 02:59:03.020288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4a24a466-71ba-451b-b418-08c1c3b569c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:03.026229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4a24a466-71ba-451b-b418-08c1c3b569c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:03.251868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4a24a466-71ba-451b-b418-08c1c3b569c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:03.263958 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4a24a466-71ba-451b-b418-08c1c3b569c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1218 microversion: 2.1 time: 0.247746 Oct 29 02:59:03.265002 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1708/3325] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:03 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1218 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:03.283205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:03.284393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:03.307053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.307548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.308199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.322589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.325199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.325661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.422162 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db HTTP/1.1 Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '3a570891-4387-4f63-a59a-aa60fe7360db'} Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:03.429421 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:03.434656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:03.434656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:03.434656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:03.434656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:03.434656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:03.434656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 02:59:03.434656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:03.434656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:03.434656 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-efcedd06-9639-42f3-b548-c2fa49cf965a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 404 len: 111 microversion: 2.1 time: 0.162438 Oct 29 02:59:03.464507 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1709/3326] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:03 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:03.766930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1637956497", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "206445a3-72bd-4ae4-a1d4-4c994350bfbb"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:03.768262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0723f5f1-84c2-4424-96ff-8fa78a384e2b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:03.781574 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0723f5f1-84c2-4424-96ff-8fa78a384e2b tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1462 microversion: 2.1 time: 1.115130 Oct 29 02:59:03.782859 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1618/3327] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:02 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1462 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:03.816554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79ef8d72-cdc9-49e4-9d04-5011b5021f86 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:03.819716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79ef8d72-cdc9-49e4-9d04-5011b5021f86 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:03.856660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ef8d72-cdc9-49e4-9d04-5011b5021f86 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.858853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ef8d72-cdc9-49e4-9d04-5011b5021f86 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.861090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ef8d72-cdc9-49e4-9d04-5011b5021f86 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.863100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ef8d72-cdc9-49e4-9d04-5011b5021f86 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.864493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ef8d72-cdc9-49e4-9d04-5011b5021f86 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.867539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ef8d72-cdc9-49e4-9d04-5011b5021f86 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.968961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] validate_networks() for [('206445a3-72bd-4ae4-a1d4-4c994350bfbb', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:59:04.050854 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79ef8d72-cdc9-49e4-9d04-5011b5021f86 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action" status: 202 len: 0 microversion: 2.1 time: 0.238273 Oct 29 02:59:04.052208 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1619/3328] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:59:03 2022] POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:59:04.063650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3ae32f47-9d70-45e0-920a-cb5e29cca42e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:04.065149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3ae32f47-9d70-45e0-920a-cb5e29cca42e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:04.092070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ae32f47-9d70-45e0-920a-cb5e29cca42e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:04.100530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ae32f47-9d70-45e0-920a-cb5e29cca42e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:04.103226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ae32f47-9d70-45e0-920a-cb5e29cca42e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:04.106780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ae32f47-9d70-45e0-920a-cb5e29cca42e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:04.108641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ae32f47-9d70-45e0-920a-cb5e29cca42e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:04.110158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ae32f47-9d70-45e0-920a-cb5e29cca42e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:04.439653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ae32f47-9d70-45e0-920a-cb5e29cca42e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:04.470281 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3ae32f47-9d70-45e0-920a-cb5e29cca42e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1351 microversion: 2.1 time: 0.409097 Oct 29 02:59:04.477614 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1620/3329] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:04 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1351 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:04.493625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:04.494960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:04.512084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:04.512581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:04.514478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:04.521064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:04.522700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:04.523840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:04.617664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:04.621240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:04.621964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:04.623960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lazy-loading 'fault' on Instance uuid 373da2a7-dc50-4f64-bb50-98e9be4e00ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:59:05.310533 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dab7ce09-2534-474c-90e3-f026197857a6 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1596 microversion: 2.1 time: 0.830296 Oct 29 02:59:05.313650 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1621/3330] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:04 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1596 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:05.328808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f9119fa-0999-4505-a137-079ed790c429 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:05.332805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5f9119fa-0999-4505-a137-079ed790c429 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:05.343201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f9119fa-0999-4505-a137-079ed790c429 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.344071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f9119fa-0999-4505-a137-079ed790c429 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.344702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f9119fa-0999-4505-a137-079ed790c429 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.345601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f9119fa-0999-4505-a137-079ed790c429 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.346218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f9119fa-0999-4505-a137-079ed790c429 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.347885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f9119fa-0999-4505-a137-079ed790c429 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.527118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5f9119fa-0999-4505-a137-079ed790c429 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:05.560839 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f9119fa-0999-4505-a137-079ed790c429 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1276 microversion: 2.1 time: 0.242442 Oct 29 02:59:05.572975 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1622/3331] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:05 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1276 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:05.597754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76027b63-5d0c-493b-906e-d4e2cf65b932 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:05.612479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-76027b63-5d0c-493b-906e-d4e2cf65b932 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:05.638884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76027b63-5d0c-493b-906e-d4e2cf65b932 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.640607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76027b63-5d0c-493b-906e-d4e2cf65b932 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.640994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76027b63-5d0c-493b-906e-d4e2cf65b932 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.642001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76027b63-5d0c-493b-906e-d4e2cf65b932 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.642518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76027b63-5d0c-493b-906e-d4e2cf65b932 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.643095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76027b63-5d0c-493b-906e-d4e2cf65b932 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.804874 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-76027b63-5d0c-493b-906e-d4e2cf65b932 tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action" status: 202 len: 0 microversion: 2.1 time: 0.229075 Oct 29 02:59:05.805884 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1623/3332] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:59:05 2022] POST /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:59:05.817482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a453ed0e-9258-4c9b-9910-115c1ba4b412 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:05.824969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a453ed0e-9258-4c9b-9910-115c1ba4b412 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:05.846557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a453ed0e-9258-4c9b-9910-115c1ba4b412 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.847264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a453ed0e-9258-4c9b-9910-115c1ba4b412 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.848962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a453ed0e-9258-4c9b-9910-115c1ba4b412 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.851566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a453ed0e-9258-4c9b-9910-115c1ba4b412 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.853835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a453ed0e-9258-4c9b-9910-115c1ba4b412 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.855716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a453ed0e-9258-4c9b-9910-115c1ba4b412 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:06.087897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:59:06.088543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:59:06.088936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:59:06.089411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:59:06.089945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:59:06.108574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:06.109141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:06.109643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:06.110478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:06.110997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:06.111480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:06.164488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:59:06.170995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for user fceb096cc5414b3a9d7300fefeb90dff and project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:59:06.203928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:59:06.216956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:59:06.336109 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-941b55c3-00e1-45e0-8250-f5545d0664c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.581431 Oct 29 02:59:06.337557 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1710/3333] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:59:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 02:59:06.345544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-46994c93-1fd7-4c1f-9176-de6edfe7e01c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:06.353448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-46994c93-1fd7-4c1f-9176-de6edfe7e01c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:06.368327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46994c93-1fd7-4c1f-9176-de6edfe7e01c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:06.369394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46994c93-1fd7-4c1f-9176-de6edfe7e01c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:06.374657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46994c93-1fd7-4c1f-9176-de6edfe7e01c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:06.375541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46994c93-1fd7-4c1f-9176-de6edfe7e01c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:06.378382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46994c93-1fd7-4c1f-9176-de6edfe7e01c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:06.380863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46994c93-1fd7-4c1f-9176-de6edfe7e01c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:06.424233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a453ed0e-9258-4c9b-9910-115c1ba4b412 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:06.433773 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a453ed0e-9258-4c9b-9910-115c1ba4b412 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1351 microversion: 2.1 time: 0.624998 Oct 29 02:59:06.459711 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1624/3334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:05 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1351 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:06.468390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-69c3d2f9-4cde-4e8f-b531-33838800477a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:06.482621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-69c3d2f9-4cde-4e8f-b531-33838800477a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:06.764585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69c3d2f9-4cde-4e8f-b531-33838800477a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:06.772373 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-69c3d2f9-4cde-4e8f-b531-33838800477a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1215 microversion: 2.1 time: 0.311350 Oct 29 02:59:06.777612 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1625/3335] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:06 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:06.783550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9319a4b9-8573-40be-b399-a30bab29e5bb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:06.787604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9319a4b9-8573-40be-b399-a30bab29e5bb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:06.809188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9319a4b9-8573-40be-b399-a30bab29e5bb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:06.818215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9319a4b9-8573-40be-b399-a30bab29e5bb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:06.819123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9319a4b9-8573-40be-b399-a30bab29e5bb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:06.820091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9319a4b9-8573-40be-b399-a30bab29e5bb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:06.821169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9319a4b9-8573-40be-b399-a30bab29e5bb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:06.821848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9319a4b9-8573-40be-b399-a30bab29e5bb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.036420 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-46994c93-1fd7-4c1f-9176-de6edfe7e01c tempest-ServersAdminTestJSON-2020707310 tempest-ServersAdminTestJSON-2020707310-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1613 microversion: 2.1 time: 0.697435 Oct 29 02:59:07.040789 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1711/3336] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:06 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1613 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:07.064091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-db029903-d3ec-4f51-ae8c-d00b152c3c81 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:07.064757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db029903-d3ec-4f51-ae8c-d00b152c3c81 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:07.092687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db029903-d3ec-4f51-ae8c-d00b152c3c81 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.093298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db029903-d3ec-4f51-ae8c-d00b152c3c81 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.103524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db029903-d3ec-4f51-ae8c-d00b152c3c81 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.105069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db029903-d3ec-4f51-ae8c-d00b152c3c81 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.107330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db029903-d3ec-4f51-ae8c-d00b152c3c81 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.107981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db029903-d3ec-4f51-ae8c-d00b152c3c81 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.198211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db029903-d3ec-4f51-ae8c-d00b152c3c81 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:59:07.350017 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-db029903-d3ec-4f51-ae8c-d00b152c3c81 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 204 len: 0 microversion: 2.1 time: 0.289280 Oct 29 02:59:07.354456 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1712/3337] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:07 2022] DELETE /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:59:07.358911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9319a4b9-8573-40be-b399-a30bab29e5bb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:07.367189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ea60e006-7164-4f49-a16b-c41fc88b46d9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:07.368528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ea60e006-7164-4f49-a16b-c41fc88b46d9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:07.377285 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9319a4b9-8573-40be-b399-a30bab29e5bb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1318 microversion: 2.1 time: 0.598177 Oct 29 02:59:07.382143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea60e006-7164-4f49-a16b-c41fc88b46d9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.390628 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1626/3338] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:06 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:07.391580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea60e006-7164-4f49-a16b-c41fc88b46d9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.392206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea60e006-7164-4f49-a16b-c41fc88b46d9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.392992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea60e006-7164-4f49-a16b-c41fc88b46d9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.393457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea60e006-7164-4f49-a16b-c41fc88b46d9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.393887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea60e006-7164-4f49-a16b-c41fc88b46d9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.472451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b62e340d-3c8f-419e-b034-d597cddf719d tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:07.473758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b62e340d-3c8f-419e-b034-d597cddf719d tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:07.486323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62e340d-3c8f-419e-b034-d597cddf719d tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.498730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62e340d-3c8f-419e-b034-d597cddf719d tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.499482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62e340d-3c8f-419e-b034-d597cddf719d tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.500406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62e340d-3c8f-419e-b034-d597cddf719d tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.501051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62e340d-3c8f-419e-b034-d597cddf719d tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.501632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b62e340d-3c8f-419e-b034-d597cddf719d tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.889549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ea60e006-7164-4f49-a16b-c41fc88b46d9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:07.910899 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ea60e006-7164-4f49-a16b-c41fc88b46d9 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1470 microversion: 2.1 time: 0.543719 Oct 29 02:59:07.911648 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1713/3339] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:07 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1470 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:07.930810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-a7fb51e8-88ec-4594-a281-f0cceaf33efb req-123f34b8-0ed6-46d0-af19-5c61e9f09c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c050ba52-abdb-4119-8647-6d005ac7efd4", "name": "network-vif-plugged", "status": "completed", "tag": "eb22a250-842e-44b9-ade9-bb7025c87969"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:07.955324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a7fb51e8-88ec-4594-a281-f0cceaf33efb req-123f34b8-0ed6-46d0-af19-5c61e9f09c49 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.957784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a7fb51e8-88ec-4594-a281-f0cceaf33efb req-123f34b8-0ed6-46d0-af19-5c61e9f09c49 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.958531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a7fb51e8-88ec-4594-a281-f0cceaf33efb req-123f34b8-0ed6-46d0-af19-5c61e9f09c49 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.999792 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-a7fb51e8-88ec-4594-a281-f0cceaf33efb req-123f34b8-0ed6-46d0-af19-5c61e9f09c49 service nova] Creating event network-vif-plugged:eb22a250-842e-44b9-ade9-bb7025c87969 for instance c050ba52-abdb-4119-8647-6d005ac7efd4 on n-h2-862964-4 Oct 29 02:59:08.016036 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-a7fb51e8-88ec-4594-a281-f0cceaf33efb req-123f34b8-0ed6-46d0-af19-5c61e9f09c49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100634 Oct 29 02:59:08.019197 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1714/3340] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:08.049860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-265ce762-c795-4bb6-af31-ae31c3a0a9e3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:08.050603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-265ce762-c795-4bb6-af31-ae31c3a0a9e3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:08.068966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ce762-c795-4bb6-af31-ae31c3a0a9e3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.083593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ce762-c795-4bb6-af31-ae31c3a0a9e3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.086146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ce762-c795-4bb6-af31-ae31c3a0a9e3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:08.094308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ce762-c795-4bb6-af31-ae31c3a0a9e3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.098028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ce762-c795-4bb6-af31-ae31c3a0a9e3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.098882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-265ce762-c795-4bb6-af31-ae31c3a0a9e3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:08.252412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b62e340d-3c8f-419e-b034-d597cddf719d tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:08.264724 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b62e340d-3c8f-419e-b034-d597cddf719d tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1351 microversion: 2.1 time: 0.796227 Oct 29 02:59:08.268454 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1627/3341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:07 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1351 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:08.350628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-265ce762-c795-4bb6-af31-ae31c3a0a9e3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:08.360730 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-265ce762-c795-4bb6-af31-ae31c3a0a9e3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1267 microversion: 2.1 time: 0.338988 Oct 29 02:59:08.361522 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1715/3342] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:08 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1267 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:08.413393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7dd25669-a0c2-4132-8c78-e509a8ef5c75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:08.414424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7dd25669-a0c2-4132-8c78-e509a8ef5c75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:08.422204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dd25669-a0c2-4132-8c78-e509a8ef5c75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.426489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dd25669-a0c2-4132-8c78-e509a8ef5c75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.427181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dd25669-a0c2-4132-8c78-e509a8ef5c75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:08.428862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dd25669-a0c2-4132-8c78-e509a8ef5c75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.431154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dd25669-a0c2-4132-8c78-e509a8ef5c75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.433144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7dd25669-a0c2-4132-8c78-e509a8ef5c75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:08.941789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d562672a-ebfc-4207-b5d1-7119cc40df2d tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:08.943617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d562672a-ebfc-4207-b5d1-7119cc40df2d tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:08.959585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d562672a-ebfc-4207-b5d1-7119cc40df2d tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.963247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d562672a-ebfc-4207-b5d1-7119cc40df2d tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.964017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d562672a-ebfc-4207-b5d1-7119cc40df2d tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:08.965020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d562672a-ebfc-4207-b5d1-7119cc40df2d tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.969998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d562672a-ebfc-4207-b5d1-7119cc40df2d tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.970939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d562672a-ebfc-4207-b5d1-7119cc40df2d tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:09.542198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d562672a-ebfc-4207-b5d1-7119cc40df2d tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:09.554553 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d562672a-ebfc-4207-b5d1-7119cc40df2d tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1470 microversion: 2.1 time: 0.620000 Oct 29 02:59:09.556464 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1716/3343] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:08 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1470 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:09.568584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9d82515d-a511-41e0-8ccf-7338d0f015ea req-c2f124a5-06ae-4272-9053-b664bfe45664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd", "tag": "2e875c98-0ebb-41fc-8873-531820912123"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:09.596226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9d82515d-a511-41e0-8ccf-7338d0f015ea req-c2f124a5-06ae-4272-9053-b664bfe45664 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:09.597319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9d82515d-a511-41e0-8ccf-7338d0f015ea req-c2f124a5-06ae-4272-9053-b664bfe45664 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:09.597970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9d82515d-a511-41e0-8ccf-7338d0f015ea req-c2f124a5-06ae-4272-9053-b664bfe45664 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:09.630232 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9d82515d-a511-41e0-8ccf-7338d0f015ea req-c2f124a5-06ae-4272-9053-b664bfe45664 service nova] Creating event network-changed:2e875c98-0ebb-41fc-8873-531820912123 for instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd on n-h1-862964-4 Oct 29 02:59:09.640655 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9d82515d-a511-41e0-8ccf-7338d0f015ea req-c2f124a5-06ae-4272-9053-b664bfe45664 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080413 Oct 29 02:59:09.643311 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1717/3344] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:09.644725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7dd25669-a0c2-4132-8c78-e509a8ef5c75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:09.660516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-865970b9-abb5-486c-953e-ece5fbbc92a8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:09.661480 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7dd25669-a0c2-4132-8c78-e509a8ef5c75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1318 microversion: 2.1 time: 1.252072 Oct 29 02:59:09.662547 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1628/3345] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:08 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1318 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:09.663727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-865970b9-abb5-486c-953e-ece5fbbc92a8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:09.669556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f51b21e-e52a-45ba-b66d-7bde22f6c7df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:09.673566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1f51b21e-e52a-45ba-b66d-7bde22f6c7df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:09.677834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-865970b9-abb5-486c-953e-ece5fbbc92a8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:09.682864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-865970b9-abb5-486c-953e-ece5fbbc92a8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:09.683314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-865970b9-abb5-486c-953e-ece5fbbc92a8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:09.684161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-865970b9-abb5-486c-953e-ece5fbbc92a8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:09.684775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-865970b9-abb5-486c-953e-ece5fbbc92a8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:09.686403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-865970b9-abb5-486c-953e-ece5fbbc92a8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:09.691192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f51b21e-e52a-45ba-b66d-7bde22f6c7df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:09.693675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f51b21e-e52a-45ba-b66d-7bde22f6c7df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:09.694289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f51b21e-e52a-45ba-b66d-7bde22f6c7df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:09.695195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f51b21e-e52a-45ba-b66d-7bde22f6c7df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:09.697415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f51b21e-e52a-45ba-b66d-7bde22f6c7df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:09.698023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f51b21e-e52a-45ba-b66d-7bde22f6c7df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:09.938275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-865970b9-abb5-486c-953e-ece5fbbc92a8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:09.949006 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-865970b9-abb5-486c-953e-ece5fbbc92a8 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1351 microversion: 2.1 time: 0.302536 Oct 29 02:59:09.964849 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1718/3346] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:09 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1351 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:09.979362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1f51b21e-e52a-45ba-b66d-7bde22f6c7df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:09.991053 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1f51b21e-e52a-45ba-b66d-7bde22f6c7df tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1273 microversion: 2.1 time: 0.327088 Oct 29 02:59:09.994521 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1629/3347] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:09 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1273 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:10.589783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-68b86e86-c4c6-47bf-9d31-217fc55d9350 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:10.590548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-68b86e86-c4c6-47bf-9d31-217fc55d9350 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:10.598441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68b86e86-c4c6-47bf-9d31-217fc55d9350 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:10.599313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68b86e86-c4c6-47bf-9d31-217fc55d9350 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:10.600196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68b86e86-c4c6-47bf-9d31-217fc55d9350 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:10.601158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68b86e86-c4c6-47bf-9d31-217fc55d9350 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:10.602270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68b86e86-c4c6-47bf-9d31-217fc55d9350 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:10.603035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68b86e86-c4c6-47bf-9d31-217fc55d9350 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:10.705594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ea0193b-5a53-49b5-9151-9deae168f8a4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:10.708853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ea0193b-5a53-49b5-9151-9deae168f8a4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:10.726166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0193b-5a53-49b5-9151-9deae168f8a4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:10.730484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0193b-5a53-49b5-9151-9deae168f8a4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:10.731657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0193b-5a53-49b5-9151-9deae168f8a4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:10.733245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0193b-5a53-49b5-9151-9deae168f8a4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:10.735605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0193b-5a53-49b5-9151-9deae168f8a4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:10.736450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ea0193b-5a53-49b5-9151-9deae168f8a4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:10.925166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-68b86e86-c4c6-47bf-9d31-217fc55d9350 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:10.939725 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-68b86e86-c4c6-47bf-9d31-217fc55d9350 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1470 microversion: 2.1 time: 0.360937 Oct 29 02:59:10.940376 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1719/3348] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:10 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1470 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:10.974542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-27a4236d-a39a-4a0f-93f1-93fff90c873c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:10.975226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-27a4236d-a39a-4a0f-93f1-93fff90c873c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:10.988413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27a4236d-a39a-4a0f-93f1-93fff90c873c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:10.989176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27a4236d-a39a-4a0f-93f1-93fff90c873c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:10.989776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27a4236d-a39a-4a0f-93f1-93fff90c873c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:10.990892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27a4236d-a39a-4a0f-93f1-93fff90c873c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:10.991522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27a4236d-a39a-4a0f-93f1-93fff90c873c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:10.992192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27a4236d-a39a-4a0f-93f1-93fff90c873c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:11.307095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-27a4236d-a39a-4a0f-93f1-93fff90c873c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:11.323537 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-27a4236d-a39a-4a0f-93f1-93fff90c873c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1540 microversion: 2.1 time: 0.353254 Oct 29 02:59:11.324913 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1720/3349] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:10 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1540 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:11.331172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c1f53f5f-c3a0-461b-9cf9-59a035984e90 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:11.332796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c1f53f5f-c3a0-461b-9cf9-59a035984e90 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:11.345066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1f53f5f-c3a0-461b-9cf9-59a035984e90 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:11.345932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1f53f5f-c3a0-461b-9cf9-59a035984e90 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:11.350218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1f53f5f-c3a0-461b-9cf9-59a035984e90 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:11.351127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1f53f5f-c3a0-461b-9cf9-59a035984e90 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:11.351651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1f53f5f-c3a0-461b-9cf9-59a035984e90 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:11.352126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1f53f5f-c3a0-461b-9cf9-59a035984e90 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:11.690710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c1f53f5f-c3a0-461b-9cf9-59a035984e90 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:11.700946 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c1f53f5f-c3a0-461b-9cf9-59a035984e90 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.374874 Oct 29 02:59:11.702215 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1721/3350] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:11 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:11.728145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ae848896-afbe-4859-a512-09ef94251c1c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:11.728640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ae848896-afbe-4859-a512-09ef94251c1c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:11.735597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae848896-afbe-4859-a512-09ef94251c1c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:11.736083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae848896-afbe-4859-a512-09ef94251c1c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:11.736520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae848896-afbe-4859-a512-09ef94251c1c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:11.737219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae848896-afbe-4859-a512-09ef94251c1c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:11.737728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae848896-afbe-4859-a512-09ef94251c1c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:11.738087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae848896-afbe-4859-a512-09ef94251c1c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:11.738984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ea0193b-5a53-49b5-9151-9deae168f8a4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:11.750254 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ea0193b-5a53-49b5-9151-9deae168f8a4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1318 microversion: 2.1 time: 1.066116 Oct 29 02:59:11.754935 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1630/3351] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:10 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1318 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:11.886454 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ae848896-afbe-4859-a512-09ef94251c1c tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175924 Oct 29 02:59:11.887829 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1722/3352] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 02:59:11 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:11.974336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2f3f864d-715e-4513-aae6-37c4c18828cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:11.975384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2f3f864d-715e-4513-aae6-37c4c18828cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:11.991235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f3f864d-715e-4513-aae6-37c4c18828cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:11.998945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f3f864d-715e-4513-aae6-37c4c18828cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:12.000093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f3f864d-715e-4513-aae6-37c4c18828cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:12.001221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f3f864d-715e-4513-aae6-37c4c18828cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:12.002324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f3f864d-715e-4513-aae6-37c4c18828cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:12.003306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f3f864d-715e-4513-aae6-37c4c18828cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:12.490287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8cad0627-8cc9-4240-8420-60ffd8a670fc req-fdbe3d13-985f-40f9-929a-4cc9a096e4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2304c2-394d-4a8c-bae0-dc41bcd00d60", "name": "network-vif-unplugged", "status": "completed", "tag": "8b369caa-616a-4f1f-9461-78559ca7296c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:12.521450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8cad0627-8cc9-4240-8420-60ffd8a670fc req-fdbe3d13-985f-40f9-929a-4cc9a096e4d6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:12.522672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8cad0627-8cc9-4240-8420-60ffd8a670fc req-fdbe3d13-985f-40f9-929a-4cc9a096e4d6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:12.523815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8cad0627-8cc9-4240-8420-60ffd8a670fc req-fdbe3d13-985f-40f9-929a-4cc9a096e4d6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:12.551058 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8cad0627-8cc9-4240-8420-60ffd8a670fc req-fdbe3d13-985f-40f9-929a-4cc9a096e4d6 service nova] Creating event network-vif-unplugged:8b369caa-616a-4f1f-9461-78559ca7296c for instance 8f2304c2-394d-4a8c-bae0-dc41bcd00d60 on n-h1-862964-4 Oct 29 02:59:12.573086 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8cad0627-8cc9-4240-8420-60ffd8a670fc req-fdbe3d13-985f-40f9-929a-4cc9a096e4d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089178 Oct 29 02:59:12.574375 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1723/3353] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:59:12.731840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-72dd2666-d04e-448b-a1dc-346ad45fcd0d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:12.734528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-72dd2666-d04e-448b-a1dc-346ad45fcd0d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:12.753110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72dd2666-d04e-448b-a1dc-346ad45fcd0d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:12.754132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72dd2666-d04e-448b-a1dc-346ad45fcd0d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:12.754806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72dd2666-d04e-448b-a1dc-346ad45fcd0d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:12.755458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f3f864d-715e-4513-aae6-37c4c18828cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:12.756516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72dd2666-d04e-448b-a1dc-346ad45fcd0d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:12.757306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72dd2666-d04e-448b-a1dc-346ad45fcd0d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:12.758021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72dd2666-d04e-448b-a1dc-346ad45fcd0d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:12.770062 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2f3f864d-715e-4513-aae6-37c4c18828cc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1470 microversion: 2.1 time: 0.799659 Oct 29 02:59:12.770753 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1631/3354] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:11 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1470 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:12.791577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49bba8cc-c8f2-4f4d-a7e4-be3139678dea tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:12.792649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49bba8cc-c8f2-4f4d-a7e4-be3139678dea tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:12.800808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49bba8cc-c8f2-4f4d-a7e4-be3139678dea tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:12.803040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49bba8cc-c8f2-4f4d-a7e4-be3139678dea tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:12.803659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49bba8cc-c8f2-4f4d-a7e4-be3139678dea tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:12.804614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49bba8cc-c8f2-4f4d-a7e4-be3139678dea tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:12.807640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49bba8cc-c8f2-4f4d-a7e4-be3139678dea tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:12.808295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49bba8cc-c8f2-4f4d-a7e4-be3139678dea tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:12.959821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-72dd2666-d04e-448b-a1dc-346ad45fcd0d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:12.974780 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-72dd2666-d04e-448b-a1dc-346ad45fcd0d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.252462 Oct 29 02:59:12.975727 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1724/3355] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:12 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:13.800887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ed21b657-501d-48e4-9984-f0406170deec tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:13.802344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ed21b657-501d-48e4-9984-f0406170deec tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:13.820173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed21b657-501d-48e4-9984-f0406170deec tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:13.822491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed21b657-501d-48e4-9984-f0406170deec tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:13.823644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed21b657-501d-48e4-9984-f0406170deec tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:13.825005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed21b657-501d-48e4-9984-f0406170deec tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:13.828050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed21b657-501d-48e4-9984-f0406170deec tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:13.828674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed21b657-501d-48e4-9984-f0406170deec tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.047432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ed21b657-501d-48e4-9984-f0406170deec tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:14.092219 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ed21b657-501d-48e4-9984-f0406170deec tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1428 microversion: 2.1 time: 0.293177 Oct 29 02:59:14.096302 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1725/3356] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:13 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1428 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:14.111479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e3dc05ea-723e-4f49-878e-e2acbecdd752 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:14.112398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e3dc05ea-723e-4f49-878e-e2acbecdd752 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:14.127225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3dc05ea-723e-4f49-878e-e2acbecdd752 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.128026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3dc05ea-723e-4f49-878e-e2acbecdd752 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.128622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3dc05ea-723e-4f49-878e-e2acbecdd752 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.129530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3dc05ea-723e-4f49-878e-e2acbecdd752 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.134390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3dc05ea-723e-4f49-878e-e2acbecdd752 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.135003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3dc05ea-723e-4f49-878e-e2acbecdd752 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.145230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:14.442593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-49bba8cc-c8f2-4f4d-a7e4-be3139678dea tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:14.455628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:14.475730 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-49bba8cc-c8f2-4f4d-a7e4-be3139678dea tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1318 microversion: 2.1 time: 1.702161 Oct 29 02:59:14.476600 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1632/3357] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:12 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1318 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:14.498637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9877e0c3-07f8-487c-9b86-0b1ce5088bbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:14.503857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9877e0c3-07f8-487c-9b86-0b1ce5088bbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:14.512546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9877e0c3-07f8-487c-9b86-0b1ce5088bbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Searching by: {'deleted': False, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:59:14.522461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9877e0c3-07f8-487c-9b86-0b1ce5088bbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.524151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9877e0c3-07f8-487c-9b86-0b1ce5088bbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.524759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9877e0c3-07f8-487c-9b86-0b1ce5088bbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.532947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9877e0c3-07f8-487c-9b86-0b1ce5088bbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.534467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9877e0c3-07f8-487c-9b86-0b1ce5088bbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.535132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9877e0c3-07f8-487c-9b86-0b1ce5088bbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.600027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e3dc05ea-723e-4f49-878e-e2acbecdd752 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:14.609309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-9877e0c3-07f8-487c-9b86-0b1ce5088bbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:59:14.621775 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e3dc05ea-723e-4f49-878e-e2acbecdd752 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.522065 Oct 29 02:59:14.625364 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1726/3358] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:14 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:14.650429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-25f1665b-8ef1-4094-9c80-9c8ee7393a12 req-85772914-0bfc-4964-83cb-57f3c5107128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2304c2-394d-4a8c-bae0-dc41bcd00d60", "name": "network-vif-deleted", "tag": "8b369caa-616a-4f1f-9461-78559ca7296c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:14.665538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-25f1665b-8ef1-4094-9c80-9c8ee7393a12 req-85772914-0bfc-4964-83cb-57f3c5107128 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.666362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-25f1665b-8ef1-4094-9c80-9c8ee7393a12 req-85772914-0bfc-4964-83cb-57f3c5107128 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.667056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-25f1665b-8ef1-4094-9c80-9c8ee7393a12 req-85772914-0bfc-4964-83cb-57f3c5107128 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.680341 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9877e0c3-07f8-487c-9b86-0b1ce5088bbe tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.195081 Oct 29 02:59:14.681257 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1633/3359] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 02:59:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:14.685336 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-25f1665b-8ef1-4094-9c80-9c8ee7393a12 req-85772914-0bfc-4964-83cb-57f3c5107128 service nova] Creating event network-vif-deleted:8b369caa-616a-4f1f-9461-78559ca7296c for instance 8f2304c2-394d-4a8c-bae0-dc41bcd00d60 on n-h1-862964-4 Oct 29 02:59:14.693692 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-25f1665b-8ef1-4094-9c80-9c8ee7393a12 req-85772914-0bfc-4964-83cb-57f3c5107128 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048798 Oct 29 02:59:14.694634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:14.698581 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1727/3360] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:14.705040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:14.710779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Searching by: {'deleted': False, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:59:14.718903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b4ba6626-bb19-4e1b-aee6-0c7a10039450 req-877efc15-29b5-4a33-baa5-e892e7f1bc45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd", "name": "network-vif-plugged", "status": "completed", "tag": "2e875c98-0ebb-41fc-8873-531820912123"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:14.720561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.722264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.724387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.730079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.731310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.732394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.732806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b4ba6626-bb19-4e1b-aee6-0c7a10039450 req-877efc15-29b5-4a33-baa5-e892e7f1bc45 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.733606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b4ba6626-bb19-4e1b-aee6-0c7a10039450 req-877efc15-29b5-4a33-baa5-e892e7f1bc45 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.734230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b4ba6626-bb19-4e1b-aee6-0c7a10039450 req-877efc15-29b5-4a33-baa5-e892e7f1bc45 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.796230 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b4ba6626-bb19-4e1b-aee6-0c7a10039450 req-877efc15-29b5-4a33-baa5-e892e7f1bc45 service nova] Creating event network-vif-plugged:2e875c98-0ebb-41fc-8873-531820912123 for instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd on n-h1-862964-4 Oct 29 02:59:14.799513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:59:14.825242 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b4ba6626-bb19-4e1b-aee6-0c7a10039450 req-877efc15-29b5-4a33-baa5-e892e7f1bc45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117932 Oct 29 02:59:14.826735 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1728/3361] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:14.835395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1b29ddfb-b51b-4634-8640-6cae06e1e90a req-01899f3e-4fd5-4fa4-abc5-67ffcc0def4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c050ba52-abdb-4119-8647-6d005ac7efd4", "tag": "eb22a250-842e-44b9-ade9-bb7025c87969"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:14.854142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1b29ddfb-b51b-4634-8640-6cae06e1e90a req-01899f3e-4fd5-4fa4-abc5-67ffcc0def4c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.855330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1b29ddfb-b51b-4634-8640-6cae06e1e90a req-01899f3e-4fd5-4fa4-abc5-67ffcc0def4c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.856352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1b29ddfb-b51b-4634-8640-6cae06e1e90a req-01899f3e-4fd5-4fa4-abc5-67ffcc0def4c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.886639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:14.914305 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1b29ddfb-b51b-4634-8640-6cae06e1e90a req-01899f3e-4fd5-4fa4-abc5-67ffcc0def4c service nova] Creating event network-changed:eb22a250-842e-44b9-ade9-bb7025c87969 for instance c050ba52-abdb-4119-8647-6d005ac7efd4 on n-h2-862964-4 Oct 29 02:59:14.916186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.916702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.917183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.941285 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1b29ddfb-b51b-4634-8640-6cae06e1e90a req-01899f3e-4fd5-4fa4-abc5-67ffcc0def4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112873 Oct 29 02:59:14.946920 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1729/3362] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:15.124736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:15.125449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:15.138438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:15.138871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:15.139299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:15.140018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:15.140474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:15.140966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:15.322149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:15.322634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:15.323081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:15.323552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lazy-loading 'fault' on Instance uuid 8f2304c2-394d-4a8c-bae0-dc41bcd00d60 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:59:15.617546 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9260dc46-657a-4e3f-97ea-16a917e38f32 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.927079 Oct 29 02:59:15.623819 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1634/3363] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 02:59:14 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:15.644560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b3918226-8252-4d6c-b42c-665e7a8090dd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:15.646667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b3918226-8252-4d6c-b42c-665e7a8090dd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:15.690637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3918226-8252-4d6c-b42c-665e7a8090dd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:15.694134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3918226-8252-4d6c-b42c-665e7a8090dd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:15.694754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3918226-8252-4d6c-b42c-665e7a8090dd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:15.698743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3918226-8252-4d6c-b42c-665e7a8090dd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:15.699442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3918226-8252-4d6c-b42c-665e7a8090dd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:15.701159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3918226-8252-4d6c-b42c-665e7a8090dd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:16.055055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:16.071059 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1a14bdb2-3d22-4027-b31e-90c4b8b8b570 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 200 len: 1304 microversion: 2.1 time: 0.946020 Oct 29 02:59:16.072876 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1730/3364] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:15 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 1304 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:16.081446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6cb7edb2-34cc-459e-922c-31ba3fde4ea6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:16.083768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6cb7edb2-34cc-459e-922c-31ba3fde4ea6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:16.101945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb7edb2-34cc-459e-922c-31ba3fde4ea6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:16.110666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb7edb2-34cc-459e-922c-31ba3fde4ea6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:16.111394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb7edb2-34cc-459e-922c-31ba3fde4ea6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:16.112340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb7edb2-34cc-459e-922c-31ba3fde4ea6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:16.112956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb7edb2-34cc-459e-922c-31ba3fde4ea6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:16.113542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb7edb2-34cc-459e-922c-31ba3fde4ea6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:16.144158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:16.186600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=14 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:16.350874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3918226-8252-4d6c-b42c-665e7a8090dd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:16.362997 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b3918226-8252-4d6c-b42c-665e7a8090dd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1318 microversion: 2.1 time: 0.735271 Oct 29 02:59:16.364572 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1635/3365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:15 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1318 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:16.372589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dfab4429-7db3-4138-959c-72cf0b438b0e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:16.392942 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dfab4429-7db3-4138-959c-72cf0b438b0e tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026567 Oct 29 02:59:16.394684 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1636/3366] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 02:59:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:16.463995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6cb7edb2-34cc-459e-922c-31ba3fde4ea6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:16.477934 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6cb7edb2-34cc-459e-922c-31ba3fde4ea6 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.403244 Oct 29 02:59:16.482531 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1731/3367] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:16 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:16.741365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c338c304-0d69-48f6-a446-e60940d2cd41 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:16.742262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c338c304-0d69-48f6-a446-e60940d2cd41 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:16.754241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6a6fcbf0-c117-4fa9-8d98-3e274d990c3f req-416534e0-07e2-4fb8-a204-57915da35e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e46368f-b3d8-43ea-967f-ac129d25db58", "tag": "b08fb32d-76ee-416c-888b-4b38e5277a63"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:16.762112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c338c304-0d69-48f6-a446-e60940d2cd41 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:16.763070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c338c304-0d69-48f6-a446-e60940d2cd41 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:16.763767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c338c304-0d69-48f6-a446-e60940d2cd41 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:16.764732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c338c304-0d69-48f6-a446-e60940d2cd41 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:16.765408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c338c304-0d69-48f6-a446-e60940d2cd41 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:16.766483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c338c304-0d69-48f6-a446-e60940d2cd41 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:16.798958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6a6fcbf0-c117-4fa9-8d98-3e274d990c3f req-416534e0-07e2-4fb8-a204-57915da35e21 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:16.823614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6a6fcbf0-c117-4fa9-8d98-3e274d990c3f req-416534e0-07e2-4fb8-a204-57915da35e21 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:16.824062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6a6fcbf0-c117-4fa9-8d98-3e274d990c3f req-416534e0-07e2-4fb8-a204-57915da35e21 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:16.839064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c338c304-0d69-48f6-a446-e60940d2cd41 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:59:16.881912 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6a6fcbf0-c117-4fa9-8d98-3e274d990c3f req-416534e0-07e2-4fb8-a204-57915da35e21 service nova] Creating event network-changed:b08fb32d-76ee-416c-888b-4b38e5277a63 for instance 1e46368f-b3d8-43ea-967f-ac129d25db58 on n-h2-862964-4 Oct 29 02:59:16.894684 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6a6fcbf0-c117-4fa9-8d98-3e274d990c3f req-416534e0-07e2-4fb8-a204-57915da35e21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144091 Oct 29 02:59:16.901667 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1732/3368] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:17.093764 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c338c304-0d69-48f6-a446-e60940d2cd41 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 204 len: 0 microversion: 2.1 time: 0.355538 Oct 29 02:59:17.102812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.104110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 8f2304c2-394d-4a8c-bae0-dc41bcd00d60] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:17.109633 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1637/3369] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:16 2022] DELETE /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:59:17.123842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-df44d6eb-802a-4b8f-956e-6dec24ebf9cd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.124928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-df44d6eb-802a-4b8f-956e-6dec24ebf9cd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:17.127721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.128307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.129060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.130220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.130654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.131085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.134336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df44d6eb-802a-4b8f-956e-6dec24ebf9cd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.135448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df44d6eb-802a-4b8f-956e-6dec24ebf9cd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.136049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df44d6eb-802a-4b8f-956e-6dec24ebf9cd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.136901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df44d6eb-802a-4b8f-956e-6dec24ebf9cd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.139243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df44d6eb-802a-4b8f-956e-6dec24ebf9cd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.139761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df44d6eb-802a-4b8f-956e-6dec24ebf9cd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.165258 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] HTTP exception thrown: Instance 8f2304c2-394d-4a8c-bae0-dc41bcd00d60 could not be found. Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Request method failure captured: Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 HTTP/1.1 Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZ3C6Kw-FfiOt6R1rA981oXQPPN1-KnLw3U7qHjK8n44SmQqq8bJyXS7kARPIzaKAoG5J-DbVaNYsT0tPUCaRCuUuMcnu28bUtZimximwuXIK2GsbUP8roJtbMltlbLAhZ9WOiN7_ZrTRAcu_pwKXPDTRkCt9k8M1fgTRWqCbKn-tE Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: fc4a5146b4134f11af39e82d9ae9f03b Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersAdminTestJSON-682144455 Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc4a5146b4134f11af39e82d9ae9f03b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc4a5146b4134f11af39e82d9ae9f03b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc4a5146b4134f11af39e82d9ae9f03b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc4a5146b4134f11af39e82d9ae9f03b"}]}] Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersAdminTestJSON-682144455 Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: fc4a5146b4134f11af39e82d9ae9f03b Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersAdminTestJSON-682144455 Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersAdminTestJSON-682144455-project Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: eeff83f3646947109a6a670d0711398f Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersAdminTestJSON-682144455-project Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 8f2304c2-394d-4a8c-bae0-dc41bcd00d60 could not be found. Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '8f2304c2-394d-4a8c-bae0-dc41bcd00d60'} Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f2304c2-394d-4a8c-bae0-dc41bcd00d60 could not be found. Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f2304c2-394d-4a8c-bae0-dc41bcd00d60 could not be found. Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:17.167004 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:17.171784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:17.171784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:17.171784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:17.171784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:17.171784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:17.171784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f2304c2-394d-4a8c-bae0-dc41bcd00d60 could not be found. Oct 29 02:59:17.171784 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:17.172995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Returning 404 to user: Instance 8f2304c2-394d-4a8c-bae0-dc41bcd00d60 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:17.174587 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8eb59d4-2f46-412d-ad53-d8a3c3a88f3f tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60" status: 404 len: 111 microversion: 2.1 time: 0.078475 Oct 29 02:59:17.175424 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1733/3370] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:17 2022] GET /compute/v2.1/servers/8f2304c2-394d-4a8c-bae0-dc41bcd00d60 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:59:17.184423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5bc34563-0af4-4024-80d8-c4fa81f4f590 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.186385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5bc34563-0af4-4024-80d8-c4fa81f4f590 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:17.204005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bc34563-0af4-4024-80d8-c4fa81f4f590 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.207451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bc34563-0af4-4024-80d8-c4fa81f4f590 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.207957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bc34563-0af4-4024-80d8-c4fa81f4f590 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.208654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bc34563-0af4-4024-80d8-c4fa81f4f590 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.209180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bc34563-0af4-4024-80d8-c4fa81f4f590 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.209550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bc34563-0af4-4024-80d8-c4fa81f4f590 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.242780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5bc34563-0af4-4024-80d8-c4fa81f4f590 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:59:17.330635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:17.341256 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5bc34563-0af4-4024-80d8-c4fa81f4f590 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 204 len: 0 microversion: 2.1 time: 0.160978 Oct 29 02:59:17.342327 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1734/3371] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:17 2022] DELETE /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:59:17.357465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37b417d1-c376-4875-8159-4f1709b8fe83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.358441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37b417d1-c376-4875-8159-4f1709b8fe83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:17.367535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b417d1-c376-4875-8159-4f1709b8fe83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.368543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b417d1-c376-4875-8159-4f1709b8fe83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.369599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b417d1-c376-4875-8159-4f1709b8fe83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.370518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b417d1-c376-4875-8159-4f1709b8fe83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.371155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b417d1-c376-4875-8159-4f1709b8fe83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.371759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37b417d1-c376-4875-8159-4f1709b8fe83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.489116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-df44d6eb-802a-4b8f-956e-6dec24ebf9cd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:17.504950 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-df44d6eb-802a-4b8f-956e-6dec24ebf9cd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1608 microversion: 2.1 time: 0.390662 Oct 29 02:59:17.509479 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1638/3372] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:17 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1608 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:17.520322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-78fa8780-1e34-4c60-8ab7-8687b764f34d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.521344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-78fa8780-1e34-4c60-8ab7-8687b764f34d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:17.540633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78fa8780-1e34-4c60-8ab7-8687b764f34d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.541436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78fa8780-1e34-4c60-8ab7-8687b764f34d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.541916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78fa8780-1e34-4c60-8ab7-8687b764f34d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.551491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78fa8780-1e34-4c60-8ab7-8687b764f34d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.552001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78fa8780-1e34-4c60-8ab7-8687b764f34d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.552437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78fa8780-1e34-4c60-8ab7-8687b764f34d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.804535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37b417d1-c376-4875-8159-4f1709b8fe83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:17.826189 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37b417d1-c376-4875-8159-4f1709b8fe83 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1468 microversion: 2.1 time: 0.471056 Oct 29 02:59:17.826836 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1735/3373] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:17 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1468 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:17.831652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ee0b026-f72c-4bca-888b-fff82e8af7fc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.832299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3ee0b026-f72c-4bca-888b-fff82e8af7fc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:17.857594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ee0b026-f72c-4bca-888b-fff82e8af7fc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.858121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ee0b026-f72c-4bca-888b-fff82e8af7fc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.858558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ee0b026-f72c-4bca-888b-fff82e8af7fc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.859281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ee0b026-f72c-4bca-888b-fff82e8af7fc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.859754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ee0b026-f72c-4bca-888b-fff82e8af7fc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.860156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ee0b026-f72c-4bca-888b-fff82e8af7fc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.115590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3ee0b026-f72c-4bca-888b-fff82e8af7fc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:18.125442 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3ee0b026-f72c-4bca-888b-fff82e8af7fc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.297513 Oct 29 02:59:18.128877 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1736/3374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:17 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:18.318927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d504876-b23b-4f2e-a74e-d4f5b770bd67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Action: 'create', calling method: .version_select at 0x7fe1a9431940>, body: {"keypair": {"name": "tempest-keypair-851759898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA07fBwSHdw6SqRRRXu/bSgAJH02wizOHZ2fYWMUKetpJC9Rz183Gc+TjiXP/Ms6RIMQ/b5DiVh0UXOr0SkIxHNZ9zpwIb4O23hXmBtCriEzuAJEZpd/BmHhukqsF7S3g=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:18.319646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-78fa8780-1e34-4c60-8ab7-8687b764f34d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:18.329748 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-78fa8780-1e34-4c60-8ab7-8687b764f34d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1508 microversion: 2.1 time: 0.818684 Oct 29 02:59:18.330828 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1639/3375] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:17 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1508 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:18.339044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-7d504876-b23b-4f2e-a74e-d4f5b770bd67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Getting quotas for project 3ef09834b750437e9fa350df7b4bb0f3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:59:18.344967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-7d504876-b23b-4f2e-a74e-d4f5b770bd67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Getting quotas for user 801730a89d33490d8d6f425f20ce5b1d and project 3ef09834b750437e9fa350df7b4bb0f3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:59:18.367184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d9a7ace-31f0-4b80-9ddc-68b79f4d245a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:18.367967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d9a7ace-31f0-4b80-9ddc-68b79f4d245a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:18.375345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ace-31f0-4b80-9ddc-68b79f4d245a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.377301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ace-31f0-4b80-9ddc-68b79f4d245a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.377947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ace-31f0-4b80-9ddc-68b79f4d245a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.379133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ace-31f0-4b80-9ddc-68b79f4d245a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.379964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ace-31f0-4b80-9ddc-68b79f4d245a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.381548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ace-31f0-4b80-9ddc-68b79f4d245a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.390231 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d504876-b23b-4f2e-a74e-d4f5b770bd67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.258596 Oct 29 02:59:18.399472 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1737/3376] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Oct 29 02:59:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 270 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:59:18.535818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-403eed93-3fa2-4daa-958c-dc0e5ba8b44c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:18.537226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-403eed93-3fa2-4daa-958c-dc0e5ba8b44c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:18.548630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-403eed93-3fa2-4daa-958c-dc0e5ba8b44c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.549714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-403eed93-3fa2-4daa-958c-dc0e5ba8b44c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.551113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-403eed93-3fa2-4daa-958c-dc0e5ba8b44c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.552858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-403eed93-3fa2-4daa-958c-dc0e5ba8b44c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.553923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-403eed93-3fa2-4daa-958c-dc0e5ba8b44c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.556451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-403eed93-3fa2-4daa-958c-dc0e5ba8b44c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.861841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d9a7ace-31f0-4b80-9ddc-68b79f4d245a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:18.870085 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d9a7ace-31f0-4b80-9ddc-68b79f4d245a tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1508 microversion: 2.1 time: 0.517623 Oct 29 02:59:18.891371 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1640/3377] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:18 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1508 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:18.895751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-403eed93-3fa2-4daa-958c-dc0e5ba8b44c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:18.904724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c232bc4-32b3-4653-95ac-2f7c1141f4fc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:18.905341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4c232bc4-32b3-4653-95ac-2f7c1141f4fc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:18.920647 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-403eed93-3fa2-4daa-958c-dc0e5ba8b44c tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1608 microversion: 2.1 time: 0.391656 Oct 29 02:59:18.921586 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1738/3378] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:18 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1608 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:18.923693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c232bc4-32b3-4653-95ac-2f7c1141f4fc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.924191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c232bc4-32b3-4653-95ac-2f7c1141f4fc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.924625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c232bc4-32b3-4653-95ac-2f7c1141f4fc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.925333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c232bc4-32b3-4653-95ac-2f7c1141f4fc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.925787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c232bc4-32b3-4653-95ac-2f7c1141f4fc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.926240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c232bc4-32b3-4653-95ac-2f7c1141f4fc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.928165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:18.931413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:18.937939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.938841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.939529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.940501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.941116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.941611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.034480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:59:19.035201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:59:19.035848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:59:19.036410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:59:19.036979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:59:19.127902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:19.140753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.141242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.141706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.147540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.148058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.148496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.203673 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e2f8a11-2793-4c37-b64b-65e8123cb03b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "POST /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd/action" status: 202 len: 1110 microversion: 2.1 time: 0.279974 Oct 29 02:59:19.205223 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1739/3379] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:59:18 2022] POST /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd/action => generated 1110 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 02:59:19.216600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15faa370-7357-492b-8948-aa61b2f07fc5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:19.218568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-15faa370-7357-492b-8948-aa61b2f07fc5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:19.234560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15faa370-7357-492b-8948-aa61b2f07fc5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.235182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15faa370-7357-492b-8948-aa61b2f07fc5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.235682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15faa370-7357-492b-8948-aa61b2f07fc5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.236501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15faa370-7357-492b-8948-aa61b2f07fc5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.237017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15faa370-7357-492b-8948-aa61b2f07fc5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.237537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15faa370-7357-492b-8948-aa61b2f07fc5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.448826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15faa370-7357-492b-8948-aa61b2f07fc5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:19.467076 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-15faa370-7357-492b-8948-aa61b2f07fc5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.258125 Oct 29 02:59:19.467769 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1740/3380] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:19 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:19.478139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-344c8f70-215f-45b0-aa6c-b3c100a0a808 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:19.478782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-344c8f70-215f-45b0-aa6c-b3c100a0a808 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:19.498439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4c232bc4-32b3-4653-95ac-2f7c1141f4fc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:19.514928 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4c232bc4-32b3-4653-95ac-2f7c1141f4fc tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1468 microversion: 2.1 time: 0.622345 Oct 29 02:59:19.515535 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1641/3381] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:18 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1468 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:19.517199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-344c8f70-215f-45b0-aa6c-b3c100a0a808 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.517714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-344c8f70-215f-45b0-aa6c-b3c100a0a808 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.518167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-344c8f70-215f-45b0-aa6c-b3c100a0a808 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.518951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-344c8f70-215f-45b0-aa6c-b3c100a0a808 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.519323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-344c8f70-215f-45b0-aa6c-b3c100a0a808 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.519741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-344c8f70-215f-45b0-aa6c-b3c100a0a808 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.865155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-344c8f70-215f-45b0-aa6c-b3c100a0a808 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:19.874646 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-344c8f70-215f-45b0-aa6c-b3c100a0a808 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.403541 Oct 29 02:59:19.876410 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1741/3382] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:19 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:19.947924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dfb12595-884f-4248-a12d-85910b598d96 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:19.948975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dfb12595-884f-4248-a12d-85910b598d96 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:19.959275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb12595-884f-4248-a12d-85910b598d96 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.960813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb12595-884f-4248-a12d-85910b598d96 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.962261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb12595-884f-4248-a12d-85910b598d96 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.966757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb12595-884f-4248-a12d-85910b598d96 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.967901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb12595-884f-4248-a12d-85910b598d96 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.968578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfb12595-884f-4248-a12d-85910b598d96 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.231658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dfb12595-884f-4248-a12d-85910b598d96 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:20.241423 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dfb12595-884f-4248-a12d-85910b598d96 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1608 microversion: 2.1 time: 0.297883 Oct 29 02:59:20.242762 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1642/3383] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:19 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1608 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:20.495887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b366ff75-a6ae-4d54-8f2a-977164a820c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:20.496355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b366ff75-a6ae-4d54-8f2a-977164a820c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:20.503085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b366ff75-a6ae-4d54-8f2a-977164a820c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.503813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b366ff75-a6ae-4d54-8f2a-977164a820c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.504403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b366ff75-a6ae-4d54-8f2a-977164a820c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.505431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b366ff75-a6ae-4d54-8f2a-977164a820c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.506087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b366ff75-a6ae-4d54-8f2a-977164a820c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.506513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b366ff75-a6ae-4d54-8f2a-977164a820c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.540307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-47dcdc90-ed1c-4791-8ff6-0ff5f8741181 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:20.541539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-47dcdc90-ed1c-4791-8ff6-0ff5f8741181 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:20.570054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47dcdc90-ed1c-4791-8ff6-0ff5f8741181 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.572138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47dcdc90-ed1c-4791-8ff6-0ff5f8741181 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.573725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47dcdc90-ed1c-4791-8ff6-0ff5f8741181 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.574504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47dcdc90-ed1c-4791-8ff6-0ff5f8741181 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.575096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47dcdc90-ed1c-4791-8ff6-0ff5f8741181 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.575374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47dcdc90-ed1c-4791-8ff6-0ff5f8741181 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.753029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b366ff75-a6ae-4d54-8f2a-977164a820c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:20.765328 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b366ff75-a6ae-4d54-8f2a-977164a820c5 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.275042 Oct 29 02:59:20.769360 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1742/3384] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:20 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:20.837213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-47dcdc90-ed1c-4791-8ff6-0ff5f8741181 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:20.849753 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-47dcdc90-ed1c-4791-8ff6-0ff5f8741181 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1468 microversion: 2.1 time: 0.313690 Oct 29 02:59:20.875515 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1643/3385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:20 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1468 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:20.900013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f111306b-80a4-4bca-b548-34d41389de64 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:20.900942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f111306b-80a4-4bca-b548-34d41389de64 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:20.922647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f111306b-80a4-4bca-b548-34d41389de64 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.923417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f111306b-80a4-4bca-b548-34d41389de64 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.924087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f111306b-80a4-4bca-b548-34d41389de64 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.924996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f111306b-80a4-4bca-b548-34d41389de64 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.925612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f111306b-80a4-4bca-b548-34d41389de64 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.926216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f111306b-80a4-4bca-b548-34d41389de64 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.934879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:21.079564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-759051117", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddb54ae3-7305-4ded-8923-bc026bdef80c"}], "security_groups": [{"name": "tempest-securitygroup--584225498"}], "key_name": "tempest-keypair-851759898", "user_data": "}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:21.151967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f111306b-80a4-4bca-b548-34d41389de64 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:21.167939 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f111306b-80a4-4bca-b548-34d41389de64 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.272235 Oct 29 02:59:21.171658 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1743/3386] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:20 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:21.266498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fbaaa1d4-4ea7-4c0c-bd37-f16d4f7f4937 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:21.267120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fbaaa1d4-4ea7-4c0c-bd37-f16d4f7f4937 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:21.280293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbaaa1d4-4ea7-4c0c-bd37-f16d4f7f4937 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:21.281343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbaaa1d4-4ea7-4c0c-bd37-f16d4f7f4937 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:21.284933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbaaa1d4-4ea7-4c0c-bd37-f16d4f7f4937 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:21.286120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbaaa1d4-4ea7-4c0c-bd37-f16d4f7f4937 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:21.288433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbaaa1d4-4ea7-4c0c-bd37-f16d4f7f4937 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:21.289197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbaaa1d4-4ea7-4c0c-bd37-f16d4f7f4937 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:21.291465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] validate_networks() for [('ddb54ae3-7305-4ded-8923-bc026bdef80c', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:59:21.442904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fbaaa1d4-4ea7-4c0c-bd37-f16d4f7f4937 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:21.452620 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fbaaa1d4-4ea7-4c0c-bd37-f16d4f7f4937 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1608 microversion: 2.1 time: 0.190181 Oct 29 02:59:21.465322 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1744/3387] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:21 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1608 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:21.792044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-48924459-8b52-46d2-848c-dc0bfd9843b2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:21.792742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-48924459-8b52-46d2-848c-dc0bfd9843b2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:21.807274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48924459-8b52-46d2-848c-dc0bfd9843b2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:21.807772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48924459-8b52-46d2-848c-dc0bfd9843b2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:21.808210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48924459-8b52-46d2-848c-dc0bfd9843b2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:21.808919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48924459-8b52-46d2-848c-dc0bfd9843b2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:21.811663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48924459-8b52-46d2-848c-dc0bfd9843b2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:21.814396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48924459-8b52-46d2-848c-dc0bfd9843b2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:22.075445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-48924459-8b52-46d2-848c-dc0bfd9843b2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:22.085653 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-48924459-8b52-46d2-848c-dc0bfd9843b2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.297297 Oct 29 02:59:22.108860 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1745/3388] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:21 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:22.108860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d9651070-6013-48fd-ad1c-cbeaa975b0ed tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:22.108860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d9651070-6013-48fd-ad1c-cbeaa975b0ed tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:22.125856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9651070-6013-48fd-ad1c-cbeaa975b0ed tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.127523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9651070-6013-48fd-ad1c-cbeaa975b0ed tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.130604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9651070-6013-48fd-ad1c-cbeaa975b0ed tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:22.131803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9651070-6013-48fd-ad1c-cbeaa975b0ed tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.135143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9651070-6013-48fd-ad1c-cbeaa975b0ed tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.135703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d9651070-6013-48fd-ad1c-cbeaa975b0ed tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:22.511832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d9651070-6013-48fd-ad1c-cbeaa975b0ed tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:22.522586 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d9651070-6013-48fd-ad1c-cbeaa975b0ed tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1468 microversion: 2.1 time: 0.425692 Oct 29 02:59:22.539568 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1746/3389] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:22 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1468 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:22.545206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90ecb08a-5ef7-4e3f-ade4-8fd2b917dd39 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:22.546140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-90ecb08a-5ef7-4e3f-ade4-8fd2b917dd39 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:22.565117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90ecb08a-5ef7-4e3f-ade4-8fd2b917dd39 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.565405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90ecb08a-5ef7-4e3f-ade4-8fd2b917dd39 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.566163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90ecb08a-5ef7-4e3f-ade4-8fd2b917dd39 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:22.568092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90ecb08a-5ef7-4e3f-ade4-8fd2b917dd39 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.568795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90ecb08a-5ef7-4e3f-ade4-8fd2b917dd39 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.569374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90ecb08a-5ef7-4e3f-ade4-8fd2b917dd39 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:22.949296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-90ecb08a-5ef7-4e3f-ade4-8fd2b917dd39 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:22.960441 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-90ecb08a-5ef7-4e3f-ade4-8fd2b917dd39 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.417157 Oct 29 02:59:22.961580 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1747/3390] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:22 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:22.968287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6949a9e1-ff00-4ff9-a071-1a249af25e29 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:22.969041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6949a9e1-ff00-4ff9-a071-1a249af25e29 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:22.988740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6949a9e1-ff00-4ff9-a071-1a249af25e29 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.989598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6949a9e1-ff00-4ff9-a071-1a249af25e29 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.990840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6949a9e1-ff00-4ff9-a071-1a249af25e29 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:22.995922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6949a9e1-ff00-4ff9-a071-1a249af25e29 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.996570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6949a9e1-ff00-4ff9-a071-1a249af25e29 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.997110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6949a9e1-ff00-4ff9-a071-1a249af25e29 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:23.159482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:59:23.160064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:59:23.160359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:59:23.160760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:59:23.161164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:59:23.183504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:23.183728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:23.184884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:23.186162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:23.186788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:23.187370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:23.199642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6949a9e1-ff00-4ff9-a071-1a249af25e29 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:23.211081 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6949a9e1-ff00-4ff9-a071-1a249af25e29 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1541 microversion: 2.1 time: 0.245773 Oct 29 02:59:23.213928 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1748/3391] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:22 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1541 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:23.228337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b7782af-2cc3-41a5-b1df-83cb86c4b7dc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:23.229117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8b7782af-2cc3-41a5-b1df-83cb86c4b7dc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:23.238844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7782af-2cc3-41a5-b1df-83cb86c4b7dc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:23.239709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7782af-2cc3-41a5-b1df-83cb86c4b7dc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:23.240419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7782af-2cc3-41a5-b1df-83cb86c4b7dc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:23.241045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Getting quotas for project 3ef09834b750437e9fa350df7b4bb0f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:59:23.243444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7782af-2cc3-41a5-b1df-83cb86c4b7dc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:23.244637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7782af-2cc3-41a5-b1df-83cb86c4b7dc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:23.248321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7782af-2cc3-41a5-b1df-83cb86c4b7dc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:23.249765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Getting quotas for user 801730a89d33490d8d6f425f20ce5b1d and project 3ef09834b750437e9fa350df7b4bb0f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:59:23.312482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:59:23.314893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:59:23.409516 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1b1bb7e6-3e35-4fd5-a731-b3f000e03fa1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.345950 Oct 29 02:59:23.424603 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1644/3392] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 02:59:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:59:23.429886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bce4cabe-fde8-49fe-8137-02f55c72b6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:23.430508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bce4cabe-fde8-49fe-8137-02f55c72b6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:23.628004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bce4cabe-fde8-49fe-8137-02f55c72b6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:23.641276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bce4cabe-fde8-49fe-8137-02f55c72b6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:23.642760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bce4cabe-fde8-49fe-8137-02f55c72b6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:23.643911 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bce4cabe-fde8-49fe-8137-02f55c72b6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1280 microversion: 2.20 time: 0.218145 Oct 29 02:59:23.656439 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1645/3393] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:23 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1280 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:23.661355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5b22d2a7-65e1-4dc9-b0f5-cd2a95219df4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:23.661992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5b22d2a7-65e1-4dc9-b0f5-cd2a95219df4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:23.678324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:23.679985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b22d2a7-65e1-4dc9-b0f5-cd2a95219df4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:23.680477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b22d2a7-65e1-4dc9-b0f5-cd2a95219df4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:23.682618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b22d2a7-65e1-4dc9-b0f5-cd2a95219df4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:23.683603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b22d2a7-65e1-4dc9-b0f5-cd2a95219df4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:23.689346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b22d2a7-65e1-4dc9-b0f5-cd2a95219df4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:23.689814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b22d2a7-65e1-4dc9-b0f5-cd2a95219df4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:23.921531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8b7782af-2cc3-41a5-b1df-83cb86c4b7dc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:23.936161 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b7782af-2cc3-41a5-b1df-83cb86c4b7dc tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.720833 Oct 29 02:59:23.938285 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1749/3394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:23 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:23.991120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-91b6b6e1-3564-46c6-8896-0c028b67801b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:23.992343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-91b6b6e1-3564-46c6-8896-0c028b67801b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:24.007453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b6b6e1-3564-46c6-8896-0c028b67801b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:24.011863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b6b6e1-3564-46c6-8896-0c028b67801b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:24.012790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b6b6e1-3564-46c6-8896-0c028b67801b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:24.014381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b6b6e1-3564-46c6-8896-0c028b67801b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:24.016842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b6b6e1-3564-46c6-8896-0c028b67801b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:24.018061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b6b6e1-3564-46c6-8896-0c028b67801b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:24.139616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5b22d2a7-65e1-4dc9-b0f5-cd2a95219df4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:24.156477 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5b22d2a7-65e1-4dc9-b0f5-cd2a95219df4 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1468 microversion: 2.1 time: 0.498678 Oct 29 02:59:24.157781 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1646/3395] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:23 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1468 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:24.236429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-26c7eb0c-449b-4d10-965c-97ae2937888b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:24.237783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-26c7eb0c-449b-4d10-965c-97ae2937888b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:24.250376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c7eb0c-449b-4d10-965c-97ae2937888b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:24.251188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c7eb0c-449b-4d10-965c-97ae2937888b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:24.251940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c7eb0c-449b-4d10-965c-97ae2937888b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:24.254397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c7eb0c-449b-4d10-965c-97ae2937888b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:24.255042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c7eb0c-449b-4d10-965c-97ae2937888b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:24.258662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26c7eb0c-449b-4d10-965c-97ae2937888b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:24.452992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-26c7eb0c-449b-4d10-965c-97ae2937888b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:24.480988 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-26c7eb0c-449b-4d10-965c-97ae2937888b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1541 microversion: 2.1 time: 0.248504 Oct 29 02:59:24.487482 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1647/3396] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:24 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1541 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:24.508936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-fcde1fc5-8cfa-4159-be49-54d2e954d1ac req-378c4fe4-0fc2-4f12-95f9-edddb758e62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b92520-a832-4a78-8a12-b5d5db32dbe1", "name": "network-vif-deleted", "tag": "a5677ae1-09cc-40c2-9504-6c3659e606f3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:24.551400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fcde1fc5-8cfa-4159-be49-54d2e954d1ac req-378c4fe4-0fc2-4f12-95f9-edddb758e62d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:24.553056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fcde1fc5-8cfa-4159-be49-54d2e954d1ac req-378c4fe4-0fc2-4f12-95f9-edddb758e62d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:24.553673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fcde1fc5-8cfa-4159-be49-54d2e954d1ac req-378c4fe4-0fc2-4f12-95f9-edddb758e62d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:24.590092 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-fcde1fc5-8cfa-4159-be49-54d2e954d1ac req-378c4fe4-0fc2-4f12-95f9-edddb758e62d service nova] Creating event network-vif-deleted:a5677ae1-09cc-40c2-9504-6c3659e606f3 for instance b4b92520-a832-4a78-8a12-b5d5db32dbe1 on n-h2-862964-4 Oct 29 02:59:24.599681 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-fcde1fc5-8cfa-4159-be49-54d2e954d1ac req-378c4fe4-0fc2-4f12-95f9-edddb758e62d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110642 Oct 29 02:59:24.607908 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1648/3397] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:24.672799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:24.673516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:24.695592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:24.699262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:24.699878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:24.700682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:24.701139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:24.701559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:24.900966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:24.934234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:24.936018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:24.937369 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2639e25-5fed-49a8-9ebf-a084ec0d8246 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1276 microversion: 2.20 time: 0.270379 Oct 29 02:59:24.953173 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1649/3398] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:24 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1276 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:24.970755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-27cdbb55-c733-4537-bc14-1baef2281a68 req-88ef60e1-70e7-46ac-9ca2-7c28f55bd549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b13893-1eca-43c0-b826-a35650183201", "name": "network-vif-deleted", "tag": "82024e5d-6393-4421-bd98-5bae0e521412"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:24.998620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-27cdbb55-c733-4537-bc14-1baef2281a68 req-88ef60e1-70e7-46ac-9ca2-7c28f55bd549 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:24.999397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-27cdbb55-c733-4537-bc14-1baef2281a68 req-88ef60e1-70e7-46ac-9ca2-7c28f55bd549 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:25.000339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-27cdbb55-c733-4537-bc14-1baef2281a68 req-88ef60e1-70e7-46ac-9ca2-7c28f55bd549 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:25.016881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:25.048658 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-27cdbb55-c733-4537-bc14-1baef2281a68 req-88ef60e1-70e7-46ac-9ca2-7c28f55bd549 service nova] Creating event network-vif-deleted:82024e5d-6393-4421-bd98-5bae0e521412 for instance e1b13893-1eca-43c0-b826-a35650183201 on n-h2-862964-4 Oct 29 02:59:25.054673 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-27cdbb55-c733-4537-bc14-1baef2281a68 req-88ef60e1-70e7-46ac-9ca2-7c28f55bd549 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099412 Oct 29 02:59:25.055826 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1650/3399] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:25.063460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-59417de3-e595-49f4-ae23-f8ba986282ec tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:25.064356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-59417de3-e595-49f4-ae23-f8ba986282ec tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:25.074468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59417de3-e595-49f4-ae23-f8ba986282ec tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:25.075345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59417de3-e595-49f4-ae23-f8ba986282ec tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:25.076033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59417de3-e595-49f4-ae23-f8ba986282ec tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:25.077719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59417de3-e595-49f4-ae23-f8ba986282ec tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:25.078711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59417de3-e595-49f4-ae23-f8ba986282ec tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:25.079355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59417de3-e595-49f4-ae23-f8ba986282ec tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:25.352538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-59417de3-e595-49f4-ae23-f8ba986282ec tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:25.364945 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-59417de3-e595-49f4-ae23-f8ba986282ec tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.307250 Oct 29 02:59:25.367540 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1651/3400] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:25 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:25.373877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:25.374811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:25.382768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:25.383739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:25.384435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:25.385542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:25.386330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:25.387821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:25.428865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:25.430126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:25.430782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:25.431769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lazy-loading 'fault' on Instance uuid b4b92520-a832-4a78-8a12-b5d5db32dbe1 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:59:25.515589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:25.527753 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-45c03646-eae0-446f-9829-a7d184f1d5d2 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 200 len: 1302 microversion: 2.1 time: 0.158228 Oct 29 02:59:25.529176 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1652/3401] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:25 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 1302 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:25.537304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5d08de14-33a8-4d02-ac1f-a11acf4c7a83 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:25.570895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5d08de14-33a8-4d02-ac1f-a11acf4c7a83 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:25.593550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d08de14-33a8-4d02-ac1f-a11acf4c7a83 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:25.596569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d08de14-33a8-4d02-ac1f-a11acf4c7a83 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:25.600391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d08de14-33a8-4d02-ac1f-a11acf4c7a83 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:25.602818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d08de14-33a8-4d02-ac1f-a11acf4c7a83 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:25.604751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d08de14-33a8-4d02-ac1f-a11acf4c7a83 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:25.606559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d08de14-33a8-4d02-ac1f-a11acf4c7a83 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:25.664608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-91b6b6e1-3564-46c6-8896-0c028b67801b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:25.678050 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-91b6b6e1-3564-46c6-8896-0c028b67801b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 1.693284 Oct 29 02:59:25.680199 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1750/3402] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:23 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:25.919369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5d08de14-33a8-4d02-ac1f-a11acf4c7a83 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:25.934178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5d08de14-33a8-4d02-ac1f-a11acf4c7a83 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1252 microversion: 2.1 time: 0.401645 Oct 29 02:59:25.934813 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1653/3403] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:25 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1252 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:25.972454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:25.973407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:26.004556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:26.005170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:26.005621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:26.014748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:26.015251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:26.015698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:26.171755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:26.206590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:26.210472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:26.216407 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1b1b7cba-ca09-440b-b524-93fa17546791 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1338 microversion: 2.20 time: 0.245097 Oct 29 02:59:26.217181 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1751/3404] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:25 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1338 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:26.393474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7286fefd-b7d4-4bf8-9efd-1de7164e3637 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:26.397220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7286fefd-b7d4-4bf8-9efd-1de7164e3637 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:26.406769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7286fefd-b7d4-4bf8-9efd-1de7164e3637 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:26.407448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7286fefd-b7d4-4bf8-9efd-1de7164e3637 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:26.408066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7286fefd-b7d4-4bf8-9efd-1de7164e3637 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:26.409244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7286fefd-b7d4-4bf8-9efd-1de7164e3637 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:26.410264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7286fefd-b7d4-4bf8-9efd-1de7164e3637 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:26.410857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7286fefd-b7d4-4bf8-9efd-1de7164e3637 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:26.563993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:26.565266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: b4b92520-a832-4a78-8a12-b5d5db32dbe1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:26.577546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:26.578354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:26.579057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:26.579931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:26.581080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:26.581987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:26.605540 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] HTTP exception thrown: Instance b4b92520-a832-4a78-8a12-b5d5db32dbe1 could not be found. Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Request method failure captured: Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 HTTP/1.1 Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZ3C6Kw-FfiOt6R1rA981oXQPPN1-KnLw3U7qHjK8n44SmQqq8bJyXS7kARPIzaKAoG5J-DbVaNYsT0tPUCaRCuUuMcnu28bUtZimximwuXIK2GsbUP8roJtbMltlbLAhZ9WOiN7_ZrTRAcu_pwKXPDTRkCt9k8M1fgTRWqCbKn-tE Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: fc4a5146b4134f11af39e82d9ae9f03b Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersAdminTestJSON-682144455 Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc4a5146b4134f11af39e82d9ae9f03b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc4a5146b4134f11af39e82d9ae9f03b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc4a5146b4134f11af39e82d9ae9f03b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc4a5146b4134f11af39e82d9ae9f03b"}]}] Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersAdminTestJSON-682144455 Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: fc4a5146b4134f11af39e82d9ae9f03b Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersAdminTestJSON-682144455 Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersAdminTestJSON-682144455-project Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: eeff83f3646947109a6a670d0711398f Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersAdminTestJSON-682144455-project Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance b4b92520-a832-4a78-8a12-b5d5db32dbe1 could not be found. Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'b4b92520-a832-4a78-8a12-b5d5db32dbe1'} Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b92520-a832-4a78-8a12-b5d5db32dbe1 could not be found. Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b92520-a832-4a78-8a12-b5d5db32dbe1 could not be found. Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:26.607670 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:26.612919 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:26.612919 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:26.612919 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:26.612919 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:26.612919 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:26.612919 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b92520-a832-4a78-8a12-b5d5db32dbe1 could not be found. Oct 29 02:59:26.612919 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:26.615283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Returning 404 to user: Instance b4b92520-a832-4a78-8a12-b5d5db32dbe1 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:26.616836 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bea1c661-71f9-4189-a599-451b43944ec1 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1" status: 404 len: 111 microversion: 2.1 time: 0.059375 Oct 29 02:59:26.618080 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1752/3405] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:26 2022] GET /compute/v2.1/servers/b4b92520-a832-4a78-8a12-b5d5db32dbe1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:26.628740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b314f7bd-6dff-415f-afa5-bf0305906ab3 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:26.629685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b314f7bd-6dff-415f-afa5-bf0305906ab3 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:26.639453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b314f7bd-6dff-415f-afa5-bf0305906ab3 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:26.641337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b314f7bd-6dff-415f-afa5-bf0305906ab3 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:26.641988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b314f7bd-6dff-415f-afa5-bf0305906ab3 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:26.642916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b314f7bd-6dff-415f-afa5-bf0305906ab3 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:26.643528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b314f7bd-6dff-415f-afa5-bf0305906ab3 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:26.644134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b314f7bd-6dff-415f-afa5-bf0305906ab3 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:26.693993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b314f7bd-6dff-415f-afa5-bf0305906ab3 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:59:26.883337 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b314f7bd-6dff-415f-afa5-bf0305906ab3 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "DELETE /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 204 len: 0 microversion: 2.1 time: 0.259919 Oct 29 02:59:26.886889 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1753/3406] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:26 2022] DELETE /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:59:26.890503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5eeec7fa-cd25-4fa8-8ec3-6d0db58b033d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:26.891165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5eeec7fa-cd25-4fa8-8ec3-6d0db58b033d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:26.900080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5eeec7fa-cd25-4fa8-8ec3-6d0db58b033d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:26.901215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5eeec7fa-cd25-4fa8-8ec3-6d0db58b033d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:26.902019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5eeec7fa-cd25-4fa8-8ec3-6d0db58b033d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:26.903542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5eeec7fa-cd25-4fa8-8ec3-6d0db58b033d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:26.904412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5eeec7fa-cd25-4fa8-8ec3-6d0db58b033d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:26.905223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5eeec7fa-cd25-4fa8-8ec3-6d0db58b033d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:27.040473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7286fefd-b7d4-4bf8-9efd-1de7164e3637 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:27.051927 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7286fefd-b7d4-4bf8-9efd-1de7164e3637 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.662953 Oct 29 02:59:27.054378 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1654/3407] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:26 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:27.064014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-62952bf3-88d6-4d35-a1f4-86841f0c0b17 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:27.066443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-62952bf3-88d6-4d35-a1f4-86841f0c0b17 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:27.078632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62952bf3-88d6-4d35-a1f4-86841f0c0b17 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:27.082572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62952bf3-88d6-4d35-a1f4-86841f0c0b17 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:27.083427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62952bf3-88d6-4d35-a1f4-86841f0c0b17 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:27.085033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62952bf3-88d6-4d35-a1f4-86841f0c0b17 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:27.086679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62952bf3-88d6-4d35-a1f4-86841f0c0b17 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:27.087776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62952bf3-88d6-4d35-a1f4-86841f0c0b17 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:27.264557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5eeec7fa-cd25-4fa8-8ec3-6d0db58b033d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:27.288512 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5eeec7fa-cd25-4fa8-8ec3-6d0db58b033d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.402901 Oct 29 02:59:27.292554 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1754/3408] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:26 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:27.308938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2c478c2d-a276-46ff-9700-2cf5b9a3b4b7 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:27.309570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2c478c2d-a276-46ff-9700-2cf5b9a3b4b7 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:27.347345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c478c2d-a276-46ff-9700-2cf5b9a3b4b7 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:27.348041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c478c2d-a276-46ff-9700-2cf5b9a3b4b7 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:27.352710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c478c2d-a276-46ff-9700-2cf5b9a3b4b7 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:27.356652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c478c2d-a276-46ff-9700-2cf5b9a3b4b7 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:27.358779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c478c2d-a276-46ff-9700-2cf5b9a3b4b7 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:27.360030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c478c2d-a276-46ff-9700-2cf5b9a3b4b7 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:27.505400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c478c2d-a276-46ff-9700-2cf5b9a3b4b7 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:27.517299 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2c478c2d-a276-46ff-9700-2cf5b9a3b4b7 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1252 microversion: 2.1 time: 0.223398 Oct 29 02:59:27.519189 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1755/3409] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:27 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1252 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:27.531988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:27.532764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:27.550381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:27.551174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:27.551724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:27.552563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:27.553607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:27.555943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:27.729965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:27.740486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:27.746895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:27.753058 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ccfd12b-a5f8-4ae9-b4c1-32c0283d30ca tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1338 microversion: 2.20 time: 0.231812 Oct 29 02:59:27.754901 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1756/3410] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:27 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1338 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:27.775502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3c4e89b1-d956-4bb2-9ec8-d07d7dfe419c req-83757ed7-9f56-4d42-a83e-20fd5269e209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46368f-b3d8-43ea-967f-ac129d25db58", "name": "network-vif-plugged", "status": "completed", "tag": "b08fb32d-76ee-416c-888b-4b38e5277a63"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:27.791879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c4e89b1-d956-4bb2-9ec8-d07d7dfe419c req-83757ed7-9f56-4d42-a83e-20fd5269e209 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:27.793595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c4e89b1-d956-4bb2-9ec8-d07d7dfe419c req-83757ed7-9f56-4d42-a83e-20fd5269e209 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:27.794832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c4e89b1-d956-4bb2-9ec8-d07d7dfe419c req-83757ed7-9f56-4d42-a83e-20fd5269e209 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:27.817207 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3c4e89b1-d956-4bb2-9ec8-d07d7dfe419c req-83757ed7-9f56-4d42-a83e-20fd5269e209 service nova] Creating event network-vif-plugged:b08fb32d-76ee-416c-888b-4b38e5277a63 for instance 1e46368f-b3d8-43ea-967f-ac129d25db58 on n-h2-862964-4 Oct 29 02:59:27.829134 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3c4e89b1-d956-4bb2-9ec8-d07d7dfe419c req-83757ed7-9f56-4d42-a83e-20fd5269e209 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071596 Oct 29 02:59:27.831595 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1757/3411] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:27.988699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-62952bf3-88d6-4d35-a1f4-86841f0c0b17 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:28.003052 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-62952bf3-88d6-4d35-a1f4-86841f0c0b17 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1468 microversion: 2.1 time: 0.943220 Oct 29 02:59:28.004152 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1655/3412] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:27 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1468 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:28.080518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6131d257-86e9-435b-b0cb-4d1db426cbb1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:28.081616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6131d257-86e9-435b-b0cb-4d1db426cbb1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:28.098293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6131d257-86e9-435b-b0cb-4d1db426cbb1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.098909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6131d257-86e9-435b-b0cb-4d1db426cbb1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.101667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6131d257-86e9-435b-b0cb-4d1db426cbb1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.102833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6131d257-86e9-435b-b0cb-4d1db426cbb1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.105207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6131d257-86e9-435b-b0cb-4d1db426cbb1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.105926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6131d257-86e9-435b-b0cb-4d1db426cbb1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.323996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7517f82f-55a5-49b7-b7e3-0801e548654f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:28.327173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7517f82f-55a5-49b7-b7e3-0801e548654f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:28.347822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7517f82f-55a5-49b7-b7e3-0801e548654f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.347822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7517f82f-55a5-49b7-b7e3-0801e548654f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.348417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7517f82f-55a5-49b7-b7e3-0801e548654f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.349192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7517f82f-55a5-49b7-b7e3-0801e548654f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.349714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7517f82f-55a5-49b7-b7e3-0801e548654f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.350265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7517f82f-55a5-49b7-b7e3-0801e548654f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.361100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:28.496784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6131d257-86e9-435b-b0cb-4d1db426cbb1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:28.507553 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6131d257-86e9-435b-b0cb-4d1db426cbb1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.431722 Oct 29 02:59:28.509833 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1758/3413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:28 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:28.541886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bc4b251c-85d3-448b-821b-11bec68c6206 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:28.543479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bc4b251c-85d3-448b-821b-11bec68c6206 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:28.555991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4b251c-85d3-448b-821b-11bec68c6206 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.559337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4b251c-85d3-448b-821b-11bec68c6206 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.559997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4b251c-85d3-448b-821b-11bec68c6206 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.561346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4b251c-85d3-448b-821b-11bec68c6206 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.562609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4b251c-85d3-448b-821b-11bec68c6206 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.564678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc4b251c-85d3-448b-821b-11bec68c6206 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.588870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:28.758877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7517f82f-55a5-49b7-b7e3-0801e548654f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:28.768539 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7517f82f-55a5-49b7-b7e3-0801e548654f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.456294 Oct 29 02:59:28.769766 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1656/3414] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:28 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:28.789611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:28.791925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:28.807788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.808433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.808984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.810873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.811441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.812751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.925214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bc4b251c-85d3-448b-821b-11bec68c6206 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:28.935955 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bc4b251c-85d3-448b-821b-11bec68c6206 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1252 microversion: 2.1 time: 0.398624 Oct 29 02:59:28.939396 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1759/3415] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:28 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1252 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:29.038005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-28602c04-a806-437d-a8b4-cc47a9dad1e0 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:29.039460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-28602c04-a806-437d-a8b4-cc47a9dad1e0 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:29.050127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28602c04-a806-437d-a8b4-cc47a9dad1e0 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.050856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28602c04-a806-437d-a8b4-cc47a9dad1e0 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.051462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28602c04-a806-437d-a8b4-cc47a9dad1e0 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.052556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28602c04-a806-437d-a8b4-cc47a9dad1e0 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.053181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28602c04-a806-437d-a8b4-cc47a9dad1e0 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.053854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28602c04-a806-437d-a8b4-cc47a9dad1e0 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.604660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-28602c04-a806-437d-a8b4-cc47a9dad1e0 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:29.613472 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-28602c04-a806-437d-a8b4-cc47a9dad1e0 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1468 microversion: 2.1 time: 0.579882 Oct 29 02:59:29.630394 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1760/3416] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:29 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1468 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:29.646313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-457e5324-ee56-45f3-821d-5b4d21e6fef1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:29.647576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-457e5324-ee56-45f3-821d-5b4d21e6fef1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:29.654799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-457e5324-ee56-45f3-821d-5b4d21e6fef1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.658611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-457e5324-ee56-45f3-821d-5b4d21e6fef1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.659356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-457e5324-ee56-45f3-821d-5b4d21e6fef1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.660270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-457e5324-ee56-45f3-821d-5b4d21e6fef1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.660886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-457e5324-ee56-45f3-821d-5b4d21e6fef1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.672931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-457e5324-ee56-45f3-821d-5b4d21e6fef1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.815320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:29.831777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:29.843265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:29.844304 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-857c98c0-af02-4179-8d0f-94e73d30a13f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1405 microversion: 2.20 time: 1.062037 Oct 29 02:59:29.845471 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1657/3417] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:28 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1405 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:29.851487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5602873d-110c-4556-8908-3188fd77a6d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:29.852251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5602873d-110c-4556-8908-3188fd77a6d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:29.858957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5602873d-110c-4556-8908-3188fd77a6d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.859799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5602873d-110c-4556-8908-3188fd77a6d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.860459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5602873d-110c-4556-8908-3188fd77a6d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.861384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5602873d-110c-4556-8908-3188fd77a6d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.862089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5602873d-110c-4556-8908-3188fd77a6d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.862738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5602873d-110c-4556-8908-3188fd77a6d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.036152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-457e5324-ee56-45f3-821d-5b4d21e6fef1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:30.045311 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-457e5324-ee56-45f3-821d-5b4d21e6fef1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1315 microversion: 2.1 time: 0.413555 Oct 29 02:59:30.051284 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1761/3418] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:29 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:30.063270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3f919727-3c16-47a4-841d-06e65af44631 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:30.070849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3f919727-3c16-47a4-841d-06e65af44631 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:30.078267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f919727-3c16-47a4-841d-06e65af44631 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.080390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f919727-3c16-47a4-841d-06e65af44631 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.086955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f919727-3c16-47a4-841d-06e65af44631 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.087951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f919727-3c16-47a4-841d-06e65af44631 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.088576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f919727-3c16-47a4-841d-06e65af44631 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.089162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f919727-3c16-47a4-841d-06e65af44631 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.225139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3f919727-3c16-47a4-841d-06e65af44631 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:30.237039 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3f919727-3c16-47a4-841d-06e65af44631 tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1252 microversion: 2.1 time: 0.184236 Oct 29 02:59:30.237553 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1762/3419] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:30 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1252 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:30.259054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b198312a-7724-4556-a966-4352f0e59826 req-b2215971-9507-4426-8311-0032ff8682a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373da2a7-dc50-4f64-bb50-98e9be4e00ea", "name": "network-vif-deleted", "tag": "2a519e5a-0fce-4f47-84d2-9cab1c919527"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:30.278913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b198312a-7724-4556-a966-4352f0e59826 req-b2215971-9507-4426-8311-0032ff8682a2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.279743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b198312a-7724-4556-a966-4352f0e59826 req-b2215971-9507-4426-8311-0032ff8682a2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.282232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b198312a-7724-4556-a966-4352f0e59826 req-b2215971-9507-4426-8311-0032ff8682a2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.299288 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b198312a-7724-4556-a966-4352f0e59826 req-b2215971-9507-4426-8311-0032ff8682a2 service nova] Creating event network-vif-deleted:2a519e5a-0fce-4f47-84d2-9cab1c919527 for instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea on n-h1-862964-4 Oct 29 02:59:30.306987 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b198312a-7724-4556-a966-4352f0e59826 req-b2215971-9507-4426-8311-0032ff8682a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067115 Oct 29 02:59:30.308327 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1763/3420] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:30.330848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5602873d-110c-4556-8908-3188fd77a6d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:30.349783 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5602873d-110c-4556-8908-3188fd77a6d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.502669 Oct 29 02:59:30.353362 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1658/3421] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:29 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:30.573257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-389bf9aa-bf60-4b5b-ba9d-0e1908544b9a req-b6aefacd-7a5a-4b65-a35d-3db2bc778a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31241403-2a17-4f40-818d-fc8caca85e4b", "tag": "e6f1a4fa-984f-49dc-a400-07b55f9cbbeb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:30.593524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-389bf9aa-bf60-4b5b-ba9d-0e1908544b9a req-b6aefacd-7a5a-4b65-a35d-3db2bc778a32 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.594153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-389bf9aa-bf60-4b5b-ba9d-0e1908544b9a req-b6aefacd-7a5a-4b65-a35d-3db2bc778a32 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.594594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-389bf9aa-bf60-4b5b-ba9d-0e1908544b9a req-b6aefacd-7a5a-4b65-a35d-3db2bc778a32 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.629880 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-389bf9aa-bf60-4b5b-ba9d-0e1908544b9a req-b6aefacd-7a5a-4b65-a35d-3db2bc778a32 service nova] Creating event network-changed:e6f1a4fa-984f-49dc-a400-07b55f9cbbeb for instance 31241403-2a17-4f40-818d-fc8caca85e4b on n-h1-862964-4 Oct 29 02:59:30.644178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:30.644806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:30.650588 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-389bf9aa-bf60-4b5b-ba9d-0e1908544b9a req-b6aefacd-7a5a-4b65-a35d-3db2bc778a32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079530 Oct 29 02:59:30.652878 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1764/3422] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:30.654638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.655135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.655570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.659727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.665308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.665784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.708517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.709015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.709452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.709942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lazy-loading 'fault' on Instance uuid 373da2a7-dc50-4f64-bb50-98e9be4e00ea {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:59:30.793957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeff83f3646947109a6a670d0711398f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4a5146b4134f11af39e82d9ae9f03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:30.803391 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-161d6173-eb8d-45a7-a988-d2fca2241f74 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 200 len: 1303 microversion: 2.1 time: 0.163653 Oct 29 02:59:30.804631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1659/3423] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:30 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:30.876787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:30.878101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:30.907314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.918573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.919546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.923541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.924356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.925053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.078163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e8598681-04cb-45bf-a30c-2712348b2b7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:31.078904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e8598681-04cb-45bf-a30c-2712348b2b7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:31.091455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8598681-04cb-45bf-a30c-2712348b2b7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.093202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8598681-04cb-45bf-a30c-2712348b2b7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.093976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8598681-04cb-45bf-a30c-2712348b2b7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.095096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8598681-04cb-45bf-a30c-2712348b2b7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.096046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8598681-04cb-45bf-a30c-2712348b2b7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.096862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8598681-04cb-45bf-a30c-2712348b2b7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.220440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:31.230393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:31.232447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:31.233992 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bbc97a7d-8a35-44c7-b8fb-90af75391f1e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1405 microversion: 2.20 time: 0.367674 Oct 29 02:59:31.252481 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1765/3424] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:30 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1405 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:31.279481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0c44d432-cfdb-4495-994b-ed44a44fcb1b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:31.286434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0c44d432-cfdb-4495-994b-ed44a44fcb1b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:31.295203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c44d432-cfdb-4495-994b-ed44a44fcb1b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.299474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c44d432-cfdb-4495-994b-ed44a44fcb1b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.299953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c44d432-cfdb-4495-994b-ed44a44fcb1b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.300862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c44d432-cfdb-4495-994b-ed44a44fcb1b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.304446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c44d432-cfdb-4495-994b-ed44a44fcb1b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.304953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c44d432-cfdb-4495-994b-ed44a44fcb1b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.438101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0c44d432-cfdb-4495-994b-ed44a44fcb1b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:31.464488 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0c44d432-cfdb-4495-994b-ed44a44fcb1b tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1252 microversion: 2.1 time: 0.207114 Oct 29 02:59:31.465021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e8598681-04cb-45bf-a30c-2712348b2b7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:31.467446 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1766/3425] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:31 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1252 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:31.473653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51bfaab2-ecad-47eb-a181-506a6b30ac75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:31.476215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-51bfaab2-ecad-47eb-a181-506a6b30ac75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:31.485585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51bfaab2-ecad-47eb-a181-506a6b30ac75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.486405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51bfaab2-ecad-47eb-a181-506a6b30ac75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.487826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51bfaab2-ecad-47eb-a181-506a6b30ac75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.488839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51bfaab2-ecad-47eb-a181-506a6b30ac75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.490731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51bfaab2-ecad-47eb-a181-506a6b30ac75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.493507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51bfaab2-ecad-47eb-a181-506a6b30ac75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.495921 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e8598681-04cb-45bf-a30c-2712348b2b7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1500 microversion: 2.1 time: 0.419617 Oct 29 02:59:31.496600 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1660/3426] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:31 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1500 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:31.538103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0aec4680-06bf-48da-bc84-5f07c187739c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:31.545875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0aec4680-06bf-48da-bc84-5f07c187739c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.546863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0aec4680-06bf-48da-bc84-5f07c187739c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.547824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0aec4680-06bf-48da-bc84-5f07c187739c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.608141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0aec4680-06bf-48da-bc84-5f07c187739c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Going to try to stop instance {{(pid=127042) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 02:59:31.694645 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0aec4680-06bf-48da-bc84-5f07c187739c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58/action" status: 202 len: 0 microversion: 2.1 time: 0.170963 Oct 29 02:59:31.695288 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1661/3427] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 02:59:31 2022] POST /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:59:31.703955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a860c597-e3cd-47d8-bd77-0fd7876d9e0c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:31.704993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a860c597-e3cd-47d8-bd77-0fd7876d9e0c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:31.723621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a860c597-e3cd-47d8-bd77-0fd7876d9e0c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.724406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a860c597-e3cd-47d8-bd77-0fd7876d9e0c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.725067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a860c597-e3cd-47d8-bd77-0fd7876d9e0c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.726056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a860c597-e3cd-47d8-bd77-0fd7876d9e0c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.726727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a860c597-e3cd-47d8-bd77-0fd7876d9e0c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.727360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a860c597-e3cd-47d8-bd77-0fd7876d9e0c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.845678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-51bfaab2-ecad-47eb-a181-506a6b30ac75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:31.858373 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-51bfaab2-ecad-47eb-a181-506a6b30ac75 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.389637 Oct 29 02:59:31.860312 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1767/3428] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:31 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:31.866634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:31.867489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] [instance: 373da2a7-dc50-4f64-bb50-98e9be4e00ea] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:31.875275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.875960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.876568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.877304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.877901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.878506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.893682 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] HTTP exception thrown: Instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea could not be found. Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Request method failure captured: Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea HTTP/1.1 Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJZ3C6Kw-FfiOt6R1rA981oXQPPN1-KnLw3U7qHjK8n44SmQqq8bJyXS7kARPIzaKAoG5J-DbVaNYsT0tPUCaRCuUuMcnu28bUtZimximwuXIK2GsbUP8roJtbMltlbLAhZ9WOiN7_ZrTRAcu_pwKXPDTRkCt9k8M1fgTRWqCbKn-tE Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: fc4a5146b4134f11af39e82d9ae9f03b Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersAdminTestJSON-682144455 Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc4a5146b4134f11af39e82d9ae9f03b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc4a5146b4134f11af39e82d9ae9f03b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc4a5146b4134f11af39e82d9ae9f03b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc4a5146b4134f11af39e82d9ae9f03b"}]}] Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersAdminTestJSON-682144455 Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: fc4a5146b4134f11af39e82d9ae9f03b Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersAdminTestJSON-682144455 Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersAdminTestJSON-682144455-project Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: eeff83f3646947109a6a670d0711398f Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersAdminTestJSON-682144455-project Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea could not be found. Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '373da2a7-dc50-4f64-bb50-98e9be4e00ea'} Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea could not be found. Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea could not be found. Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:31.895627 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.900789 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:31.900789 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:31.900789 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:31.900789 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:31.900789 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:31.900789 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea could not be found. Oct 29 02:59:31.900789 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.900789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] Returning 404 to user: Instance 373da2a7-dc50-4f64-bb50-98e9be4e00ea could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:31.900789 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce1e2197-f976-4eda-9f48-2ed16e350d12 tempest-ServersAdminTestJSON-682144455 tempest-ServersAdminTestJSON-682144455-project] 10.222.0.16 "GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea" status: 404 len: 111 microversion: 2.1 time: 0.035575 Oct 29 02:59:31.900789 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1768/3429] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:31 2022] GET /compute/v2.1/servers/373da2a7-dc50-4f64-bb50-98e9be4e00ea => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:32.261606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:32.262584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:32.285300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:32.297642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:32.298104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:32.298856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:32.299339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:32.299764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:32.325637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a860c597-e3cd-47d8-bd77-0fd7876d9e0c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:32.335749 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a860c597-e3cd-47d8-bd77-0fd7876d9e0c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.635683 Oct 29 02:59:32.337614 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1662/3430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:31 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:32.496057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6c049a69-02b7-41d4-8035-075982ce13fc tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:32.497402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6c049a69-02b7-41d4-8035-075982ce13fc tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:32.509789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c049a69-02b7-41d4-8035-075982ce13fc tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:32.512054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c049a69-02b7-41d4-8035-075982ce13fc tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:32.513651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c049a69-02b7-41d4-8035-075982ce13fc tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:32.516416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c049a69-02b7-41d4-8035-075982ce13fc tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:32.517229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c049a69-02b7-41d4-8035-075982ce13fc tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:32.519171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c049a69-02b7-41d4-8035-075982ce13fc tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:32.550959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:32.624331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:32.634666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:32.637320 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f0e0597-1003-4850-80a0-2845684b8f46 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1405 microversion: 2.20 time: 0.381535 Oct 29 02:59:32.641018 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1769/3431] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:32 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1405 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:32.659282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6c049a69-02b7-41d4-8035-075982ce13fc tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaa0b3debf041098f1f188124050dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9a72e5d3ea460ebdb09420824ba04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:32.677197 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6c049a69-02b7-41d4-8035-075982ce13fc tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 200 len: 1252 microversion: 2.1 time: 0.187131 Oct 29 02:59:32.682484 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1663/3432] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:32 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 1252 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:32.887136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a4695d9f-2af2-4b65-98bc-78d1e8b2d48d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:32.888277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a4695d9f-2af2-4b65-98bc-78d1e8b2d48d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:32.899759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4695d9f-2af2-4b65-98bc-78d1e8b2d48d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:32.903857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4695d9f-2af2-4b65-98bc-78d1e8b2d48d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:32.904209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4695d9f-2af2-4b65-98bc-78d1e8b2d48d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:32.907471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4695d9f-2af2-4b65-98bc-78d1e8b2d48d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:32.909239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4695d9f-2af2-4b65-98bc-78d1e8b2d48d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:32.911501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4695d9f-2af2-4b65-98bc-78d1e8b2d48d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:33.114131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a4695d9f-2af2-4b65-98bc-78d1e8b2d48d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:33.122534 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a4695d9f-2af2-4b65-98bc-78d1e8b2d48d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.242980 Oct 29 02:59:33.130587 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1770/3433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:32 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:33.362155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5fac89a2-370c-42cf-a492-2ce34759e837 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:33.362811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5fac89a2-370c-42cf-a492-2ce34759e837 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:33.373115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:33.374902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fac89a2-370c-42cf-a492-2ce34759e837 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:33.390302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fac89a2-370c-42cf-a492-2ce34759e837 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:33.392433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fac89a2-370c-42cf-a492-2ce34759e837 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:33.393374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fac89a2-370c-42cf-a492-2ce34759e837 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:33.396411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fac89a2-370c-42cf-a492-2ce34759e837 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:33.397063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fac89a2-370c-42cf-a492-2ce34759e837 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:33.633151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=12 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:33.676064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:33.676767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:33.701087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:33.703272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:33.704418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:33.707479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:33.708336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:33.710789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:33.778491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5fac89a2-370c-42cf-a492-2ce34759e837 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:33.789377 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5fac89a2-370c-42cf-a492-2ce34759e837 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.431394 Oct 29 02:59:33.790904 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1664/3434] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:33 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:33.801291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:33.803059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] [instance: e1b13893-1eca-43c0-b826-a35650183201] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:33.825434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:33.826306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:33.829296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:33.830347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:33.831017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:33.832695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:33.911439 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] HTTP exception thrown: Instance e1b13893-1eca-43c0-b826-a35650183201 could not be found. Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Request method failure captured: Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 HTTP/1.1 Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJaFBoJO3wVli6yMGy9MOuItgKOqwkMj20J1CTFT2yYiqvwZjOzZLX1WnpPH9UXsBO6gx29GZMV2A9Lqc6h8LyZaVjJ7sS5P0RGzI3quGX1hZe7NgIvO8ANxUbgM1yRVBCwO_SRgk7AzXE3vIVt8XMsMjqv4vG8XmQxSau9g8sE8EvQ Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: fa9a72e5d3ea460ebdb09420824ba04b Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestBootFromVolume-620911608 Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fa9a72e5d3ea460ebdb09420824ba04b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa9a72e5d3ea460ebdb09420824ba04b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fa9a72e5d3ea460ebdb09420824ba04b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa9a72e5d3ea460ebdb09420824ba04b"}]}] Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestBootFromVolume-620911608 Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: fa9a72e5d3ea460ebdb09420824ba04b Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestBootFromVolume-620911608 Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestBootFromVolume-620911608-project Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: eaaa0b3debf041098f1f188124050dad Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestBootFromVolume-620911608-project Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance e1b13893-1eca-43c0-b826-a35650183201 could not be found. Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'e1b13893-1eca-43c0-b826-a35650183201'} Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b13893-1eca-43c0-b826-a35650183201 could not be found. Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b13893-1eca-43c0-b826-a35650183201 could not be found. Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:33.920410 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:59:33.924938 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:33.924938 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:33.924938 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:33.924938 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:33.924938 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:33.924938 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b13893-1eca-43c0-b826-a35650183201 could not be found. Oct 29 02:59:33.924938 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 02:59:33.929232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:33.934486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Returning 404 to user: Instance e1b13893-1eca-43c0-b826-a35650183201 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:33.935613 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2abb9945-f3e9-43e1-8acb-b105c3747dbd tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201" status: 404 len: 111 microversion: 2.1 time: 0.142992 Oct 29 02:59:33.939332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:33.939713 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1665/3435] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:33 2022] GET /compute/v2.1/servers/e1b13893-1eca-43c0-b826-a35650183201 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:33.943989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:33.949261 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18b0f3f8-48e3-4b00-8226-a16e5c956303 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1405 microversion: 2.20 time: 0.280190 Oct 29 02:59:33.952992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b171670-2f47-43e4-a6c5-64a8a25bfb3a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] Calling method '.version_select at 0x7fe1a89444c0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:33.962547 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1771/3436] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:33 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1405 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:33.995208 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b171670-2f47-43e4-a6c5-64a8a25bfb3a tempest-ServersTestBootFromVolume-620911608 tempest-ServersTestBootFromVolume-620911608-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245804504" status: 202 len: 0 microversion: 2.1 time: 0.050915 Oct 29 02:59:33.998183 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1666/3437] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 02:59:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245804504 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:59:34.148400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54f84d76-457e-4cdd-b8ce-e2fd5f8088b8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:34.149029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54f84d76-457e-4cdd-b8ce-e2fd5f8088b8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:34.168907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f84d76-457e-4cdd-b8ce-e2fd5f8088b8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:34.169484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f84d76-457e-4cdd-b8ce-e2fd5f8088b8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:34.171187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f84d76-457e-4cdd-b8ce-e2fd5f8088b8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:34.171999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f84d76-457e-4cdd-b8ce-e2fd5f8088b8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:34.172550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f84d76-457e-4cdd-b8ce-e2fd5f8088b8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:34.172886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f84d76-457e-4cdd-b8ce-e2fd5f8088b8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:34.482147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-54f84d76-457e-4cdd-b8ce-e2fd5f8088b8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:34.492752 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54f84d76-457e-4cdd-b8ce-e2fd5f8088b8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.349647 Oct 29 02:59:34.494196 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1772/3438] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:34 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:34.819027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e9d655e-f8be-4bc5-bde1-54be5add9b6c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:34.819837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e9d655e-f8be-4bc5-bde1-54be5add9b6c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:34.836412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e9d655e-f8be-4bc5-bde1-54be5add9b6c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:34.839120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e9d655e-f8be-4bc5-bde1-54be5add9b6c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:34.839690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e9d655e-f8be-4bc5-bde1-54be5add9b6c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:34.840759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e9d655e-f8be-4bc5-bde1-54be5add9b6c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:34.844820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e9d655e-f8be-4bc5-bde1-54be5add9b6c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:34.849221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e9d655e-f8be-4bc5-bde1-54be5add9b6c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:34.903025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:34.979853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:34.985212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:35.012538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:35.016384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:35.016898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:35.018364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:35.018835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:35.019283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:35.239565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3e9d655e-f8be-4bc5-bde1-54be5add9b6c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:35.248152 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3e9d655e-f8be-4bc5-bde1-54be5add9b6c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.433853 Oct 29 02:59:35.251386 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1667/3439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:34 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:35.481705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:35.495425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:35.498134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:35.500772 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e10f7c81-96cd-42f0-bcf0-cc0f69530d5f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1405 microversion: 2.20 time: 0.526463 Oct 29 02:59:35.504974 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1773/3440] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:34 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1405 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:35.520820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-112d0df9-1d77-4652-b66f-d32716798b99 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:35.521719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-112d0df9-1d77-4652-b66f-d32716798b99 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:35.528991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-112d0df9-1d77-4652-b66f-d32716798b99 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:35.538667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-112d0df9-1d77-4652-b66f-d32716798b99 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:35.539396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-112d0df9-1d77-4652-b66f-d32716798b99 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:35.540304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-112d0df9-1d77-4652-b66f-d32716798b99 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:35.540946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-112d0df9-1d77-4652-b66f-d32716798b99 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:35.541699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-112d0df9-1d77-4652-b66f-d32716798b99 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:35.761895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-112d0df9-1d77-4652-b66f-d32716798b99 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:35.770959 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-112d0df9-1d77-4652-b66f-d32716798b99 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.254098 Oct 29 02:59:35.772143 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1668/3441] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:35 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:36.275989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8274018c-4832-4cb7-b930-96d5e6264a7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:36.277115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8274018c-4832-4cb7-b930-96d5e6264a7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:36.286800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:36.323431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8274018c-4832-4cb7-b930-96d5e6264a7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:36.323934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8274018c-4832-4cb7-b930-96d5e6264a7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:36.324376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8274018c-4832-4cb7-b930-96d5e6264a7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:36.325100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8274018c-4832-4cb7-b930-96d5e6264a7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:36.325580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8274018c-4832-4cb7-b930-96d5e6264a7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:36.326002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8274018c-4832-4cb7-b930-96d5e6264a7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:36.541131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:36.543044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:36.561080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:36.564935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:36.565498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:36.566338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:36.574756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:36.575291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:36.779044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8274018c-4832-4cb7-b930-96d5e6264a7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:36.804552 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8274018c-4832-4cb7-b930-96d5e6264a7b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.533906 Oct 29 02:59:36.805383 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1774/3442] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:36 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:37.024033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-83537252", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:37.108715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:37.121207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:37.122696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:37.130667 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-10eae5ec-9010-4db0-acd5-f1929a1fec1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1405 microversion: 2.20 time: 0.593379 Oct 29 02:59:37.131166 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1669/3443] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:36 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1405 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:37.133470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:59:37.155359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9f9486ce-0c57-4551-8be9-ba2762647bf0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:37.156075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9f9486ce-0c57-4551-8be9-ba2762647bf0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:37.162907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f9486ce-0c57-4551-8be9-ba2762647bf0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:37.163777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f9486ce-0c57-4551-8be9-ba2762647bf0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:37.164637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f9486ce-0c57-4551-8be9-ba2762647bf0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:37.165364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f9486ce-0c57-4551-8be9-ba2762647bf0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:37.165864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f9486ce-0c57-4551-8be9-ba2762647bf0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:37.166288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f9486ce-0c57-4551-8be9-ba2762647bf0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:37.433061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9f9486ce-0c57-4551-8be9-ba2762647bf0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:37.448013 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9f9486ce-0c57-4551-8be9-ba2762647bf0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.300117 Oct 29 02:59:37.448620 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1670/3444] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:37 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:37.703132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:59:37.704183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:59:37.706049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:59:37.706637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:59:37.707218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:59:37.725660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:37.726571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:37.728934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:37.729985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:37.731467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:37.732086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:37.782495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Getting quotas for project 5d85e030cdfd49bfa36d55f2aa1a074c. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:59:37.796181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Getting quotas for user a3151f4e39a646e1a3ba3585bc00b2ab and project 5d85e030cdfd49bfa36d55f2aa1a074c. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:59:37.829778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db935bc4-6b58-447e-936f-6242ec1240fe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:37.830985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-db935bc4-6b58-447e-936f-6242ec1240fe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:37.850175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:59:37.853039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:59:37.853689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db935bc4-6b58-447e-936f-6242ec1240fe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:37.854625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db935bc4-6b58-447e-936f-6242ec1240fe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:37.855500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db935bc4-6b58-447e-936f-6242ec1240fe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:37.857104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db935bc4-6b58-447e-936f-6242ec1240fe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:37.866027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db935bc4-6b58-447e-936f-6242ec1240fe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:37.866964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db935bc4-6b58-447e-936f-6242ec1240fe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:37.989171 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c1cad0ce-f851-4971-b136-e687a3e4fcf0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182636 Oct 29 02:59:37.990305 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1775/3445] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 02:59:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:59:38.008286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8c5d08ed-e3e8-408b-a731-e2cd707568cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:38.008993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8c5d08ed-e3e8-408b-a731-e2cd707568cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:38.334719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-db935bc4-6b58-447e-936f-6242ec1240fe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:38.345730 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-db935bc4-6b58-447e-936f-6242ec1240fe tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.520417 Oct 29 02:59:38.346357 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1671/3446] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:37 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:38.355803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:38.356274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:38.387714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:38.388228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:38.388656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:38.390137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:38.390599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:38.394708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:38.663310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c5d08ed-e3e8-408b-a731-e2cd707568cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:38.672726 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8c5d08ed-e3e8-408b-a731-e2cd707568cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1220 microversion: 2.1 time: 0.673595 Oct 29 02:59:38.691516 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1776/3447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:37 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1220 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:38.696168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-14543e52-e143-4c00-93e1-ddebe3741514 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:38.696782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-14543e52-e143-4c00-93e1-ddebe3741514 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:38.703247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14543e52-e143-4c00-93e1-ddebe3741514 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:38.703889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14543e52-e143-4c00-93e1-ddebe3741514 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:38.704153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14543e52-e143-4c00-93e1-ddebe3741514 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:38.705203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14543e52-e143-4c00-93e1-ddebe3741514 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:38.705834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14543e52-e143-4c00-93e1-ddebe3741514 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:38.706517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14543e52-e143-4c00-93e1-ddebe3741514 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:39.072147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:39.089844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:39.095423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:39.099173 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cdcf4f59-7d63-477d-8ef0-a582e169bd08 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1405 microversion: 2.20 time: 0.749231 Oct 29 02:59:39.103095 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1672/3448] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:38 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1405 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:39.167829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-14543e52-e143-4c00-93e1-ddebe3741514 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:39.176305 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-14543e52-e143-4c00-93e1-ddebe3741514 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.484251 Oct 29 02:59:39.179071 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1777/3449] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:38 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:39.375264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4eded8d4-b2fb-4716-9bf6-5fc21bccdcc2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:39.375947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4eded8d4-b2fb-4716-9bf6-5fc21bccdcc2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:39.387975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eded8d4-b2fb-4716-9bf6-5fc21bccdcc2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:39.397422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eded8d4-b2fb-4716-9bf6-5fc21bccdcc2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:39.398205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eded8d4-b2fb-4716-9bf6-5fc21bccdcc2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:39.399272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eded8d4-b2fb-4716-9bf6-5fc21bccdcc2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:39.404102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eded8d4-b2fb-4716-9bf6-5fc21bccdcc2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:39.404816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eded8d4-b2fb-4716-9bf6-5fc21bccdcc2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:39.701088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02f61105-e785-46ed-9b8b-7f1b0a631fa3 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:39.702008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-02f61105-e785-46ed-9b8b-7f1b0a631fa3 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:39.716170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02f61105-e785-46ed-9b8b-7f1b0a631fa3 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:39.716795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02f61105-e785-46ed-9b8b-7f1b0a631fa3 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:39.719894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02f61105-e785-46ed-9b8b-7f1b0a631fa3 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:39.721964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02f61105-e785-46ed-9b8b-7f1b0a631fa3 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:39.726085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02f61105-e785-46ed-9b8b-7f1b0a631fa3 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:39.726871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02f61105-e785-46ed-9b8b-7f1b0a631fa3 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:39.796683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4eded8d4-b2fb-4716-9bf6-5fc21bccdcc2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:39.811482 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4eded8d4-b2fb-4716-9bf6-5fc21bccdcc2 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.440698 Oct 29 02:59:39.812350 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1673/3450] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:39 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:39.877851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02f61105-e785-46ed-9b8b-7f1b0a631fa3 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:39.888838 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02f61105-e785-46ed-9b8b-7f1b0a631fa3 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1272 microversion: 2.1 time: 0.191782 Oct 29 02:59:39.891446 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1778/3451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:39 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:40.128829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:40.129457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:40.141861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:40.146055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:40.147354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:40.148188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:40.148650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:40.149074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:40.207064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b96a2d6c-9911-44b1-b815-3370a0b1899f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:40.208292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b96a2d6c-9911-44b1-b815-3370a0b1899f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:40.237925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b96a2d6c-9911-44b1-b815-3370a0b1899f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:40.239340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b96a2d6c-9911-44b1-b815-3370a0b1899f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:40.240629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b96a2d6c-9911-44b1-b815-3370a0b1899f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:40.243290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b96a2d6c-9911-44b1-b815-3370a0b1899f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:40.244318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b96a2d6c-9911-44b1-b815-3370a0b1899f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:40.246341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b96a2d6c-9911-44b1-b815-3370a0b1899f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:40.428600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:40.443094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:40.445948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:40.447137 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-786886c7-96ee-49d5-9eb3-d807dbc250a4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1405 microversion: 2.20 time: 0.322409 Oct 29 02:59:40.448728 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1674/3452] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:40 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1405 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:40.809044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b96a2d6c-9911-44b1-b815-3370a0b1899f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:40.811691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:40.819000 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b96a2d6c-9911-44b1-b815-3370a0b1899f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.616429 Oct 29 02:59:40.835477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-885b8e45-f3b7-4309-a1e0-d78a421e971a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:40.836182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-885b8e45-f3b7-4309-a1e0-d78a421e971a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:40.841136 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1779/3453] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:40 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:40.843440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-885b8e45-f3b7-4309-a1e0-d78a421e971a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:40.843946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-885b8e45-f3b7-4309-a1e0-d78a421e971a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:40.844381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-885b8e45-f3b7-4309-a1e0-d78a421e971a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:40.845086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-885b8e45-f3b7-4309-a1e0-d78a421e971a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:40.845731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-885b8e45-f3b7-4309-a1e0-d78a421e971a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:40.846403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-885b8e45-f3b7-4309-a1e0-d78a421e971a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:40.915495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-71ccce0d-71cc-41b7-9070-b863f60031a4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:40.916118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-71ccce0d-71cc-41b7-9070-b863f60031a4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:40.924873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71ccce0d-71cc-41b7-9070-b863f60031a4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:40.937091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71ccce0d-71cc-41b7-9070-b863f60031a4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:40.937756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71ccce0d-71cc-41b7-9070-b863f60031a4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:40.938561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71ccce0d-71cc-41b7-9070-b863f60031a4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:40.939038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71ccce0d-71cc-41b7-9070-b863f60031a4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:40.939461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71ccce0d-71cc-41b7-9070-b863f60031a4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:41.111875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-885b8e45-f3b7-4309-a1e0-d78a421e971a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:41.123944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-885b8e45-f3b7-4309-a1e0-d78a421e971a tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.292405 Oct 29 02:59:41.124657 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1675/3454] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:40 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:41.159772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-71ccce0d-71cc-41b7-9070-b863f60031a4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:41.174503 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-71ccce0d-71cc-41b7-9070-b863f60031a4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1278 microversion: 2.1 time: 0.261295 Oct 29 02:59:41.175720 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1780/3455] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:40 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1278 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:41.203303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-eb3dac69-bf81-4023-bf29-3a4b2519d384 req-08c52181-6bef-43a2-b183-a6ceef726752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31241403-2a17-4f40-818d-fc8caca85e4b", "name": "network-vif-plugged", "status": "completed", "tag": "e6f1a4fa-984f-49dc-a400-07b55f9cbbeb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:41.215620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-eb3dac69-bf81-4023-bf29-3a4b2519d384 req-08c52181-6bef-43a2-b183-a6ceef726752 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:41.216458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-eb3dac69-bf81-4023-bf29-3a4b2519d384 req-08c52181-6bef-43a2-b183-a6ceef726752 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:41.217078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-eb3dac69-bf81-4023-bf29-3a4b2519d384 req-08c52181-6bef-43a2-b183-a6ceef726752 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:41.231431 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-eb3dac69-bf81-4023-bf29-3a4b2519d384 req-08c52181-6bef-43a2-b183-a6ceef726752 service nova] Creating event network-vif-plugged:e6f1a4fa-984f-49dc-a400-07b55f9cbbeb for instance 31241403-2a17-4f40-818d-fc8caca85e4b on n-h1-862964-4 Oct 29 02:59:41.237312 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-eb3dac69-bf81-4023-bf29-3a4b2519d384 req-08c52181-6bef-43a2-b183-a6ceef726752 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038234 Oct 29 02:59:41.238745 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1676/3456] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:41.478570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:41.479389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:41.498775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:41.502768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:41.503361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:41.505881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:41.507779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:41.511326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:41.849438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1941b889-2b5a-44bb-a50b-5c396b3a88b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:41.850560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1941b889-2b5a-44bb-a50b-5c396b3a88b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:41.871492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1941b889-2b5a-44bb-a50b-5c396b3a88b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:41.874497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1941b889-2b5a-44bb-a50b-5c396b3a88b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:41.875203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1941b889-2b5a-44bb-a50b-5c396b3a88b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:41.876084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1941b889-2b5a-44bb-a50b-5c396b3a88b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:41.878728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1941b889-2b5a-44bb-a50b-5c396b3a88b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:41.879330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1941b889-2b5a-44bb-a50b-5c396b3a88b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:42.053019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:42.063767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:42.068023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:42.074258 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4287f832-6a27-4a6e-9237-71a0142e5a93 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1405 microversion: 2.20 time: 0.600981 Oct 29 02:59:42.076054 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1781/3457] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:41 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1405 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:42.163027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-71822206-9ba5-4c87-8c1d-6f7bd07f26a3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:42.165433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-71822206-9ba5-4c87-8c1d-6f7bd07f26a3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:42.183930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71822206-9ba5-4c87-8c1d-6f7bd07f26a3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:42.184900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71822206-9ba5-4c87-8c1d-6f7bd07f26a3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:42.185564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71822206-9ba5-4c87-8c1d-6f7bd07f26a3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:42.186700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71822206-9ba5-4c87-8c1d-6f7bd07f26a3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:42.187381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71822206-9ba5-4c87-8c1d-6f7bd07f26a3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:42.188310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71822206-9ba5-4c87-8c1d-6f7bd07f26a3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:42.394188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1941b889-2b5a-44bb-a50b-5c396b3a88b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:42.410750 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1941b889-2b5a-44bb-a50b-5c396b3a88b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.564823 Oct 29 02:59:42.411631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1677/3458] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:41 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:42.426181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c1cd0be4-1a09-479a-a7ed-97aa2d52f5e7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:42.434000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c1cd0be4-1a09-479a-a7ed-97aa2d52f5e7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:42.447207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1cd0be4-1a09-479a-a7ed-97aa2d52f5e7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:42.451334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1cd0be4-1a09-479a-a7ed-97aa2d52f5e7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:42.452745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1cd0be4-1a09-479a-a7ed-97aa2d52f5e7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:42.454535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1cd0be4-1a09-479a-a7ed-97aa2d52f5e7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:42.456399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1cd0be4-1a09-479a-a7ed-97aa2d52f5e7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:42.457073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1cd0be4-1a09-479a-a7ed-97aa2d52f5e7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:42.628192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c1cd0be4-1a09-479a-a7ed-97aa2d52f5e7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:42.639178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c1cd0be4-1a09-479a-a7ed-97aa2d52f5e7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1278 microversion: 2.1 time: 0.226147 Oct 29 02:59:42.641761 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1678/3459] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:42 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1278 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:43.000030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-71822206-9ba5-4c87-8c1d-6f7bd07f26a3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:43.017206 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-71822206-9ba5-4c87-8c1d-6f7bd07f26a3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.871826 Oct 29 02:59:43.019104 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1782/3460] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:42 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:43.105708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:43.106459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:43.114200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:43.114701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:43.115135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:43.116159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:43.116884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:43.117287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:43.438874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7223e1fd-6857-4daa-9fed-9c713f8593aa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:43.439491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7223e1fd-6857-4daa-9fed-9c713f8593aa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:43.452667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7223e1fd-6857-4daa-9fed-9c713f8593aa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:43.453427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7223e1fd-6857-4daa-9fed-9c713f8593aa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:43.454340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7223e1fd-6857-4daa-9fed-9c713f8593aa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:43.455226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7223e1fd-6857-4daa-9fed-9c713f8593aa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:43.455833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7223e1fd-6857-4daa-9fed-9c713f8593aa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:43.458175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7223e1fd-6857-4daa-9fed-9c713f8593aa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:43.913129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7223e1fd-6857-4daa-9fed-9c713f8593aa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:43.930402 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7223e1fd-6857-4daa-9fed-9c713f8593aa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.491400 Oct 29 02:59:43.931520 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1783/3461] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:43 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:43.948692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-08b5f952-2feb-414d-8795-f667e552edb0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:43.949629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-08b5f952-2feb-414d-8795-f667e552edb0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:43.964942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f952-2feb-414d-8795-f667e552edb0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:43.965706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f952-2feb-414d-8795-f667e552edb0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:43.966850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f952-2feb-414d-8795-f667e552edb0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:43.967755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f952-2feb-414d-8795-f667e552edb0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:43.968478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f952-2feb-414d-8795-f667e552edb0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:43.969071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f952-2feb-414d-8795-f667e552edb0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:44.228073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:44.240497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:44.245146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:44.246427 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-58801ae4-57b7-47b2-8bd9-40095780db01 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1596 microversion: 2.20 time: 1.144835 Oct 29 02:59:44.252307 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1679/3462] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:43 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1596 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:44.281271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb311f73-c401-460b-9851-0af830be51bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:44.284477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bb311f73-c401-460b-9851-0af830be51bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:44.309700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb311f73-c401-460b-9851-0af830be51bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:44.313114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb311f73-c401-460b-9851-0af830be51bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:44.313561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb311f73-c401-460b-9851-0af830be51bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:44.314341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb311f73-c401-460b-9851-0af830be51bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:44.318313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb311f73-c401-460b-9851-0af830be51bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:44.318752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb311f73-c401-460b-9851-0af830be51bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:44.637736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-08b5f952-2feb-414d-8795-f667e552edb0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:44.650482 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-08b5f952-2feb-414d-8795-f667e552edb0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1320 microversion: 2.1 time: 0.717364 Oct 29 02:59:44.665839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1784/3463] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:43 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1320 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:44.671705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-46500c0a-611a-405c-a28e-5f00f374158a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:44.672206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-46500c0a-611a-405c-a28e-5f00f374158a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:44.704278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46500c0a-611a-405c-a28e-5f00f374158a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:44.704942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46500c0a-611a-405c-a28e-5f00f374158a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:44.705371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46500c0a-611a-405c-a28e-5f00f374158a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:44.706314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46500c0a-611a-405c-a28e-5f00f374158a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:44.711878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46500c0a-611a-405c-a28e-5f00f374158a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:44.712598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46500c0a-611a-405c-a28e-5f00f374158a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:44.870200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bb311f73-c401-460b-9851-0af830be51bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:44.890636 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb311f73-c401-460b-9851-0af830be51bd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.633449 Oct 29 02:59:44.891014 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1680/3464] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:44 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:44.956976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-325e3c47-bd9a-494e-9f2f-3f3e4c02a99d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:44.958000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-325e3c47-bd9a-494e-9f2f-3f3e4c02a99d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:44.969219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-325e3c47-bd9a-494e-9f2f-3f3e4c02a99d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:44.969824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-325e3c47-bd9a-494e-9f2f-3f3e4c02a99d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:44.972690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-325e3c47-bd9a-494e-9f2f-3f3e4c02a99d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:44.975322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-325e3c47-bd9a-494e-9f2f-3f3e4c02a99d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:44.978039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-325e3c47-bd9a-494e-9f2f-3f3e4c02a99d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:44.978660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-325e3c47-bd9a-494e-9f2f-3f3e4c02a99d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:45.406705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-325e3c47-bd9a-494e-9f2f-3f3e4c02a99d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:45.416724 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-325e3c47-bd9a-494e-9f2f-3f3e4c02a99d tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1515 microversion: 2.1 time: 0.464576 Oct 29 02:59:45.440718 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1681/3465] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:44 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1515 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:45.623412 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-46500c0a-611a-405c-a28e-5f00f374158a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.968431 Oct 29 02:59:45.624790 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1785/3466] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Oct 29 02:59:44 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-interface => generated 284 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:59:45.680497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6ba60a3b-8cab-44ac-a95c-122654347dea tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:45.681988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6ba60a3b-8cab-44ac-a95c-122654347dea tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:45.694397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ba60a3b-8cab-44ac-a95c-122654347dea tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:45.698926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ba60a3b-8cab-44ac-a95c-122654347dea tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:45.702148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ba60a3b-8cab-44ac-a95c-122654347dea tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:45.705683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ba60a3b-8cab-44ac-a95c-122654347dea tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:45.706455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ba60a3b-8cab-44ac-a95c-122654347dea tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:45.706995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ba60a3b-8cab-44ac-a95c-122654347dea tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:45.920564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c4de0463-1170-4374-ba72-cdae44121336 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:45.922266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c4de0463-1170-4374-ba72-cdae44121336 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:45.930097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4de0463-1170-4374-ba72-cdae44121336 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:45.930864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4de0463-1170-4374-ba72-cdae44121336 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:45.932042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4de0463-1170-4374-ba72-cdae44121336 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:45.932910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4de0463-1170-4374-ba72-cdae44121336 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:45.933510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4de0463-1170-4374-ba72-cdae44121336 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:45.934104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4de0463-1170-4374-ba72-cdae44121336 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:46.086947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6ba60a3b-8cab-44ac-a95c-122654347dea tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:46.101037 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6ba60a3b-8cab-44ac-a95c-122654347dea tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1320 microversion: 2.1 time: 0.426811 Oct 29 02:59:46.104746 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1682/3467] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:45 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1320 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:46.449480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cff4212e-5ae3-45ed-8d2a-53dd56967484 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:46.451047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cff4212e-5ae3-45ed-8d2a-53dd56967484 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:46.495888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cff4212e-5ae3-45ed-8d2a-53dd56967484 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:46.497197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cff4212e-5ae3-45ed-8d2a-53dd56967484 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:46.497907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cff4212e-5ae3-45ed-8d2a-53dd56967484 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:46.499520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cff4212e-5ae3-45ed-8d2a-53dd56967484 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:46.500040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cff4212e-5ae3-45ed-8d2a-53dd56967484 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:46.500547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cff4212e-5ae3-45ed-8d2a-53dd56967484 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:46.572524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c4de0463-1170-4374-ba72-cdae44121336 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:46.598704 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c4de0463-1170-4374-ba72-cdae44121336 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.682635 Oct 29 02:59:46.599687 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1786/3468] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:45 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:46.758282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cff4212e-5ae3-45ed-8d2a-53dd56967484 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:46.766784 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cff4212e-5ae3-45ed-8d2a-53dd56967484 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1521 microversion: 2.1 time: 0.322343 Oct 29 02:59:46.782614 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1683/3469] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:46 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:47.130653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c53eb10b-cff1-4914-a284-dbe7bc212db7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:47.131256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c53eb10b-cff1-4914-a284-dbe7bc212db7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:47.141054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c53eb10b-cff1-4914-a284-dbe7bc212db7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:47.141545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c53eb10b-cff1-4914-a284-dbe7bc212db7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:47.142012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c53eb10b-cff1-4914-a284-dbe7bc212db7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:47.142713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c53eb10b-cff1-4914-a284-dbe7bc212db7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:47.143163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c53eb10b-cff1-4914-a284-dbe7bc212db7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:47.143581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c53eb10b-cff1-4914-a284-dbe7bc212db7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:47.569665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c53eb10b-cff1-4914-a284-dbe7bc212db7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:47.572194 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c53eb10b-cff1-4914-a284-dbe7bc212db7 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1320 microversion: 2.1 time: 0.445273 Oct 29 02:59:47.575457 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1787/3470] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:47 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1320 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:47.624513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-805d8bf7-1169-4dd6-a8dc-5750b4d07b8c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:47.625136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-805d8bf7-1169-4dd6-a8dc-5750b4d07b8c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:47.641133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-805d8bf7-1169-4dd6-a8dc-5750b4d07b8c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:47.641632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-805d8bf7-1169-4dd6-a8dc-5750b4d07b8c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:47.642110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-805d8bf7-1169-4dd6-a8dc-5750b4d07b8c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:47.642826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-805d8bf7-1169-4dd6-a8dc-5750b4d07b8c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:47.643278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-805d8bf7-1169-4dd6-a8dc-5750b4d07b8c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:47.643699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-805d8bf7-1169-4dd6-a8dc-5750b4d07b8c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:47.790373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6831a6e1-e938-4bd4-818b-c4b5c4b967e2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:47.791246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6831a6e1-e938-4bd4-818b-c4b5c4b967e2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:47.799999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:47.807470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6831a6e1-e938-4bd4-818b-c4b5c4b967e2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:47.808286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6831a6e1-e938-4bd4-818b-c4b5c4b967e2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:47.808941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6831a6e1-e938-4bd4-818b-c4b5c4b967e2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:47.809972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6831a6e1-e938-4bd4-818b-c4b5c4b967e2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:47.810673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6831a6e1-e938-4bd4-818b-c4b5c4b967e2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:47.811305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6831a6e1-e938-4bd4-818b-c4b5c4b967e2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:48.115299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-805d8bf7-1169-4dd6-a8dc-5750b4d07b8c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:48.128744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:48.162837 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-805d8bf7-1169-4dd6-a8dc-5750b4d07b8c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.542886 Oct 29 02:59:48.168235 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1684/3471] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:47 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:48.183911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-6597ff33-b892-4c1d-8966-03c48c83ab7b req-c68e10b1-c148-4c50-9d58-aed8a8eaf126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586d2052-3b4d-4539-9947-189e93c1dd8b", "tag": "373fe05f-fb29-499c-9f41-39ba5d81768b"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:48.225201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6597ff33-b892-4c1d-8966-03c48c83ab7b req-c68e10b1-c148-4c50-9d58-aed8a8eaf126 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:48.225641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6597ff33-b892-4c1d-8966-03c48c83ab7b req-c68e10b1-c148-4c50-9d58-aed8a8eaf126 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:48.229973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6597ff33-b892-4c1d-8966-03c48c83ab7b req-c68e10b1-c148-4c50-9d58-aed8a8eaf126 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:48.274920 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-6597ff33-b892-4c1d-8966-03c48c83ab7b req-c68e10b1-c148-4c50-9d58-aed8a8eaf126 service nova] Creating event network-changed:373fe05f-fb29-499c-9f41-39ba5d81768b for instance 586d2052-3b4d-4539-9947-189e93c1dd8b on n-h2-862964-4 Oct 29 02:59:48.285411 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-6597ff33-b892-4c1d-8966-03c48c83ab7b req-c68e10b1-c148-4c50-9d58-aed8a8eaf126 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115689 Oct 29 02:59:48.287499 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1685/3472] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:48.603375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-569ce765-f3d8-48ba-aed2-d00bed3e6f07 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:48.604378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-569ce765-f3d8-48ba-aed2-d00bed3e6f07 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:48.616725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-569ce765-f3d8-48ba-aed2-d00bed3e6f07 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:48.617827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-569ce765-f3d8-48ba-aed2-d00bed3e6f07 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:48.620239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-569ce765-f3d8-48ba-aed2-d00bed3e6f07 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:48.623437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-569ce765-f3d8-48ba-aed2-d00bed3e6f07 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:48.624565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-569ce765-f3d8-48ba-aed2-d00bed3e6f07 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:48.626864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-569ce765-f3d8-48ba-aed2-d00bed3e6f07 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:48.673154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:48.973750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-569ce765-f3d8-48ba-aed2-d00bed3e6f07 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:48.986259 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-569ce765-f3d8-48ba-aed2-d00bed3e6f07 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1320 microversion: 2.1 time: 0.387512 Oct 29 02:59:49.010960 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1686/3473] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:48 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1320 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:49.104489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6831a6e1-e938-4bd4-818b-c4b5c4b967e2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:49.114024 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6831a6e1-e938-4bd4-818b-c4b5c4b967e2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1521 microversion: 2.1 time: 1.327789 Oct 29 02:59:49.119048 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1788/3474] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:47 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1521 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:49.214609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-587071ad-7d9a-4d96-8a9c-1b679a5772e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:49.214609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-587071ad-7d9a-4d96-8a9c-1b679a5772e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:49.225259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-587071ad-7d9a-4d96-8a9c-1b679a5772e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:49.225878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-587071ad-7d9a-4d96-8a9c-1b679a5772e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:49.237400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-587071ad-7d9a-4d96-8a9c-1b679a5772e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:49.238268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-587071ad-7d9a-4d96-8a9c-1b679a5772e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:49.238749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-587071ad-7d9a-4d96-8a9c-1b679a5772e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:49.239180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-587071ad-7d9a-4d96-8a9c-1b679a5772e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:49.691296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-587071ad-7d9a-4d96-8a9c-1b679a5772e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:49.701678 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-587071ad-7d9a-4d96-8a9c-1b679a5772e0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.499463 Oct 29 02:59:49.733833 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1687/3475] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:49 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:50.020606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5b7947b-a29e-4e81-bd1e-bfa33b19c1de tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:50.021189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f5b7947b-a29e-4e81-bd1e-bfa33b19c1de tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:50.031473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5b7947b-a29e-4e81-bd1e-bfa33b19c1de tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:50.035918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5b7947b-a29e-4e81-bd1e-bfa33b19c1de tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:50.036537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5b7947b-a29e-4e81-bd1e-bfa33b19c1de tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:50.037461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5b7947b-a29e-4e81-bd1e-bfa33b19c1de tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:50.040410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5b7947b-a29e-4e81-bd1e-bfa33b19c1de tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:50.041058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5b7947b-a29e-4e81-bd1e-bfa33b19c1de tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:50.145781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7aeb4c7a-2394-4b56-9bca-ceb58912fe8c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:50.146429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7aeb4c7a-2394-4b56-9bca-ceb58912fe8c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:50.159912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7aeb4c7a-2394-4b56-9bca-ceb58912fe8c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:50.160392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7aeb4c7a-2394-4b56-9bca-ceb58912fe8c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:50.160815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7aeb4c7a-2394-4b56-9bca-ceb58912fe8c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:50.161516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7aeb4c7a-2394-4b56-9bca-ceb58912fe8c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:50.161990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7aeb4c7a-2394-4b56-9bca-ceb58912fe8c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:50.162403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7aeb4c7a-2394-4b56-9bca-ceb58912fe8c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:50.305456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f5b7947b-a29e-4e81-bd1e-bfa33b19c1de tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:50.322173 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5b7947b-a29e-4e81-bd1e-bfa33b19c1de tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1320 microversion: 2.1 time: 0.296839 Oct 29 02:59:50.345034 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1789/3476] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:50 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:50.373712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-066d48b5-52e0-48fb-95cc-dd984ca45066 req-f5af6668-78bb-46a4-a5d9-2574fb151a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31241403-2a17-4f40-818d-fc8caca85e4b", "tag": "e6f1a4fa-984f-49dc-a400-07b55f9cbbeb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:50.409069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-066d48b5-52e0-48fb-95cc-dd984ca45066 req-f5af6668-78bb-46a4-a5d9-2574fb151a25 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:50.415675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-066d48b5-52e0-48fb-95cc-dd984ca45066 req-f5af6668-78bb-46a4-a5d9-2574fb151a25 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:50.416386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-066d48b5-52e0-48fb-95cc-dd984ca45066 req-f5af6668-78bb-46a4-a5d9-2574fb151a25 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:50.443668 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-066d48b5-52e0-48fb-95cc-dd984ca45066 req-f5af6668-78bb-46a4-a5d9-2574fb151a25 service nova] Creating event network-changed:e6f1a4fa-984f-49dc-a400-07b55f9cbbeb for instance 31241403-2a17-4f40-818d-fc8caca85e4b on n-h1-862964-4 Oct 29 02:59:50.456995 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-066d48b5-52e0-48fb-95cc-dd984ca45066 req-f5af6668-78bb-46a4-a5d9-2574fb151a25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109464 Oct 29 02:59:50.457631 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1790/3477] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:50.687618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7aeb4c7a-2394-4b56-9bca-ceb58912fe8c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:50.698591 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7aeb4c7a-2394-4b56-9bca-ceb58912fe8c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1521 microversion: 2.1 time: 0.556550 Oct 29 02:59:50.710191 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1688/3478] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:50 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1521 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:50.773325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-61447985-cb4f-4e2a-ae74-5c62a40fc8de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:50.775662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-61447985-cb4f-4e2a-ae74-5c62a40fc8de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:50.796837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61447985-cb4f-4e2a-ae74-5c62a40fc8de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:50.797507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61447985-cb4f-4e2a-ae74-5c62a40fc8de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:50.806713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61447985-cb4f-4e2a-ae74-5c62a40fc8de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:50.806713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61447985-cb4f-4e2a-ae74-5c62a40fc8de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:50.808261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61447985-cb4f-4e2a-ae74-5c62a40fc8de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:50.822133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61447985-cb4f-4e2a-ae74-5c62a40fc8de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:51.144425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-543c8d77-b898-46a4-818f-a631957ad1a0 req-13c8d71d-96c6-44ea-a5f5-37119fcb1f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd", "name": "network-vif-unplugged", "status": "completed", "tag": "2e875c98-0ebb-41fc-8873-531820912123"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:51.168243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-543c8d77-b898-46a4-818f-a631957ad1a0 req-13c8d71d-96c6-44ea-a5f5-37119fcb1f73 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:51.174262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-543c8d77-b898-46a4-818f-a631957ad1a0 req-13c8d71d-96c6-44ea-a5f5-37119fcb1f73 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:51.177606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-543c8d77-b898-46a4-818f-a631957ad1a0 req-13c8d71d-96c6-44ea-a5f5-37119fcb1f73 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:51.248306 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-543c8d77-b898-46a4-818f-a631957ad1a0 req-13c8d71d-96c6-44ea-a5f5-37119fcb1f73 service nova] Creating event network-vif-unplugged:2e875c98-0ebb-41fc-8873-531820912123 for instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd on n-h1-862964-4 Oct 29 02:59:51.260821 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-543c8d77-b898-46a4-818f-a631957ad1a0 req-13c8d71d-96c6-44ea-a5f5-37119fcb1f73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120445 Oct 29 02:59:51.266534 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1689/3479] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:51.350015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3240036a-7c43-4039-98d7-bcf6f2e6a318 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:51.350857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3240036a-7c43-4039-98d7-bcf6f2e6a318 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:51.365764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3240036a-7c43-4039-98d7-bcf6f2e6a318 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:51.369434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3240036a-7c43-4039-98d7-bcf6f2e6a318 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:51.370035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3240036a-7c43-4039-98d7-bcf6f2e6a318 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:51.376839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3240036a-7c43-4039-98d7-bcf6f2e6a318 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:51.379549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3240036a-7c43-4039-98d7-bcf6f2e6a318 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:51.380100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3240036a-7c43-4039-98d7-bcf6f2e6a318 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:51.521451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-61447985-cb4f-4e2a-ae74-5c62a40fc8de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:51.544241 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-61447985-cb4f-4e2a-ae74-5c62a40fc8de tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.792994 Oct 29 02:59:51.576635 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1791/3480] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:50 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:51.729340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6bf5f7df-2eda-41a8-8754-e6f35b57d53e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:51.737998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6bf5f7df-2eda-41a8-8754-e6f35b57d53e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:51.802278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf5f7df-2eda-41a8-8754-e6f35b57d53e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:51.802975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf5f7df-2eda-41a8-8754-e6f35b57d53e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:51.808285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf5f7df-2eda-41a8-8754-e6f35b57d53e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:51.809137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf5f7df-2eda-41a8-8754-e6f35b57d53e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:51.809613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf5f7df-2eda-41a8-8754-e6f35b57d53e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:51.814438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf5f7df-2eda-41a8-8754-e6f35b57d53e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:52.179265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3240036a-7c43-4039-98d7-bcf6f2e6a318 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:52.195264 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3240036a-7c43-4039-98d7-bcf6f2e6a318 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1320 microversion: 2.1 time: 0.851262 Oct 29 02:59:52.218768 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1690/3481] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:51 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1320 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:52.573858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eacbb2b3-583c-4ce7-a5cd-21f4b90b40a4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:52.574493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eacbb2b3-583c-4ce7-a5cd-21f4b90b40a4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:52.590525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eacbb2b3-583c-4ce7-a5cd-21f4b90b40a4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:52.591340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eacbb2b3-583c-4ce7-a5cd-21f4b90b40a4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:52.592035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eacbb2b3-583c-4ce7-a5cd-21f4b90b40a4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:52.600880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eacbb2b3-583c-4ce7-a5cd-21f4b90b40a4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:52.601964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eacbb2b3-583c-4ce7-a5cd-21f4b90b40a4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:52.605266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eacbb2b3-583c-4ce7-a5cd-21f4b90b40a4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:52.627104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6bf5f7df-2eda-41a8-8754-e6f35b57d53e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:52.649012 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6bf5f7df-2eda-41a8-8754-e6f35b57d53e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1521 microversion: 2.1 time: 0.929103 Oct 29 02:59:52.649621 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1792/3482] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:51 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1521 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:53.246024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a0d9d751-e2d7-481d-ab2f-791e7c372449 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:53.247107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a0d9d751-e2d7-481d-ab2f-791e7c372449 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:53.278531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0d9d751-e2d7-481d-ab2f-791e7c372449 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:53.279306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0d9d751-e2d7-481d-ab2f-791e7c372449 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:53.280042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0d9d751-e2d7-481d-ab2f-791e7c372449 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:53.282070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0d9d751-e2d7-481d-ab2f-791e7c372449 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:53.282798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0d9d751-e2d7-481d-ab2f-791e7c372449 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:53.283572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0d9d751-e2d7-481d-ab2f-791e7c372449 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:53.427015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eacbb2b3-583c-4ce7-a5cd-21f4b90b40a4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:53.442990 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eacbb2b3-583c-4ce7-a5cd-21f4b90b40a4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.872333 Oct 29 02:59:53.461941 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1691/3483] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:52 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:53.614113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a0d9d751-e2d7-481d-ab2f-791e7c372449 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:53.627428 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a0d9d751-e2d7-481d-ab2f-791e7c372449 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1320 microversion: 2.1 time: 0.388900 Oct 29 02:59:53.629594 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1793/3484] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:53 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1320 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:53.680183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fd05ae93-bfda-4441-bf88-e1a14d3092ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:53.680871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fd05ae93-bfda-4441-bf88-e1a14d3092ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:53.699616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd05ae93-bfda-4441-bf88-e1a14d3092ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:53.700243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd05ae93-bfda-4441-bf88-e1a14d3092ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:53.700756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd05ae93-bfda-4441-bf88-e1a14d3092ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:53.703552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd05ae93-bfda-4441-bf88-e1a14d3092ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:53.704234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd05ae93-bfda-4441-bf88-e1a14d3092ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:53.704873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd05ae93-bfda-4441-bf88-e1a14d3092ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:54.295971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fd05ae93-bfda-4441-bf88-e1a14d3092ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:54.315457 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fd05ae93-bfda-4441-bf88-e1a14d3092ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1521 microversion: 2.1 time: 0.640701 Oct 29 02:59:54.318111 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1692/3485] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:53 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1521 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:54.472604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e402b23-7ee5-4516-b075-f6fcc02928e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:54.474154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e402b23-7ee5-4516-b075-f6fcc02928e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:54.488764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e402b23-7ee5-4516-b075-f6fcc02928e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:54.491400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e402b23-7ee5-4516-b075-f6fcc02928e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:54.495024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e402b23-7ee5-4516-b075-f6fcc02928e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:54.498944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e402b23-7ee5-4516-b075-f6fcc02928e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:54.499646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e402b23-7ee5-4516-b075-f6fcc02928e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:54.502005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e402b23-7ee5-4516-b075-f6fcc02928e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:54.653496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fe862a2b-0bfd-47a2-87c5-a568bb86a1da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:54.655204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fe862a2b-0bfd-47a2-87c5-a568bb86a1da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:54.664489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:54.666465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe862a2b-0bfd-47a2-87c5-a568bb86a1da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:54.667738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe862a2b-0bfd-47a2-87c5-a568bb86a1da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:54.668452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe862a2b-0bfd-47a2-87c5-a568bb86a1da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:54.669400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe862a2b-0bfd-47a2-87c5-a568bb86a1da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:54.670194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe862a2b-0bfd-47a2-87c5-a568bb86a1da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:54.670859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe862a2b-0bfd-47a2-87c5-a568bb86a1da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:55.084704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2e402b23-7ee5-4516-b075-f6fcc02928e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:55.098360 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e402b23-7ee5-4516-b075-f6fcc02928e9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.633088 Oct 29 02:59:55.100856 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1794/3486] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:54 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:55.345165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bb1a7746-b020-434d-8710-d4e43dd48fe2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:55.345789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bb1a7746-b020-434d-8710-d4e43dd48fe2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:55.361969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb1a7746-b020-434d-8710-d4e43dd48fe2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:55.363538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb1a7746-b020-434d-8710-d4e43dd48fe2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:55.364797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb1a7746-b020-434d-8710-d4e43dd48fe2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:55.369696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb1a7746-b020-434d-8710-d4e43dd48fe2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:55.370319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb1a7746-b020-434d-8710-d4e43dd48fe2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:55.370808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb1a7746-b020-434d-8710-d4e43dd48fe2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:55.819347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fe862a2b-0bfd-47a2-87c5-a568bb86a1da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:55.835339 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fe862a2b-0bfd-47a2-87c5-a568bb86a1da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1320 microversion: 2.1 time: 1.187449 Oct 29 02:59:55.836178 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1693/3487] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:54 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1320 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:55.852282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-7d4f7ff6-53e3-46c9-b9b4-e1efbafcba54 req-ec3840bd-15c3-4258-83e6-a01958fa2ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd", "name": "network-vif-plugged", "status": "completed", "tag": "2e875c98-0ebb-41fc-8873-531820912123"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:55.872004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7d4f7ff6-53e3-46c9-b9b4-e1efbafcba54 req-ec3840bd-15c3-4258-83e6-a01958fa2ebe service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:55.872611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7d4f7ff6-53e3-46c9-b9b4-e1efbafcba54 req-ec3840bd-15c3-4258-83e6-a01958fa2ebe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:55.872892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7d4f7ff6-53e3-46c9-b9b4-e1efbafcba54 req-ec3840bd-15c3-4258-83e6-a01958fa2ebe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:55.897141 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-7d4f7ff6-53e3-46c9-b9b4-e1efbafcba54 req-ec3840bd-15c3-4258-83e6-a01958fa2ebe service nova] Creating event network-vif-plugged:2e875c98-0ebb-41fc-8873-531820912123 for instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd on n-h1-862964-4 Oct 29 02:59:55.914049 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-7d4f7ff6-53e3-46c9-b9b4-e1efbafcba54 req-ec3840bd-15c3-4258-83e6-a01958fa2ebe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075327 Oct 29 02:59:55.915161 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1694/3488] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:55.920186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bb1a7746-b020-434d-8710-d4e43dd48fe2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:55.935680 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bb1a7746-b020-434d-8710-d4e43dd48fe2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1521 microversion: 2.1 time: 0.591745 Oct 29 02:59:55.936346 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1795/3489] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:55 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:56.136147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6ae9fb64-c692-48ff-9df7-2ca2f0697a7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:56.137126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6ae9fb64-c692-48ff-9df7-2ca2f0697a7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:56.156135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae9fb64-c692-48ff-9df7-2ca2f0697a7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:56.156903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae9fb64-c692-48ff-9df7-2ca2f0697a7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:56.157507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae9fb64-c692-48ff-9df7-2ca2f0697a7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:56.158429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae9fb64-c692-48ff-9df7-2ca2f0697a7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:56.162796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae9fb64-c692-48ff-9df7-2ca2f0697a7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:56.167917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae9fb64-c692-48ff-9df7-2ca2f0697a7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:56.844680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6ae9fb64-c692-48ff-9df7-2ca2f0697a7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:56.863907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4665c017-7f8f-407a-a7d9-3c0c87fb8b51 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:56.864498 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6ae9fb64-c692-48ff-9df7-2ca2f0697a7f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.738183 Oct 29 02:59:56.871790 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1695/3490] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:56 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:56.874971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4665c017-7f8f-407a-a7d9-3c0c87fb8b51 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:56.891246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4665c017-7f8f-407a-a7d9-3c0c87fb8b51 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:56.898688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4665c017-7f8f-407a-a7d9-3c0c87fb8b51 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:56.899139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4665c017-7f8f-407a-a7d9-3c0c87fb8b51 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:56.899888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4665c017-7f8f-407a-a7d9-3c0c87fb8b51 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:56.900333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4665c017-7f8f-407a-a7d9-3c0c87fb8b51 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:56.900747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4665c017-7f8f-407a-a7d9-3c0c87fb8b51 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:56.959399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dd089d43-4a53-47dd-8c93-a3942017871c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:56.960411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd089d43-4a53-47dd-8c93-a3942017871c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:56.973437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd089d43-4a53-47dd-8c93-a3942017871c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:56.977420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd089d43-4a53-47dd-8c93-a3942017871c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:56.978769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd089d43-4a53-47dd-8c93-a3942017871c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:56.985169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd089d43-4a53-47dd-8c93-a3942017871c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:56.987934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd089d43-4a53-47dd-8c93-a3942017871c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:56.992799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd089d43-4a53-47dd-8c93-a3942017871c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:57.358066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd089d43-4a53-47dd-8c93-a3942017871c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:57.369644 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dd089d43-4a53-47dd-8c93-a3942017871c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1521 microversion: 2.1 time: 0.412957 Oct 29 02:59:57.371434 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1696/3491] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:56 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:57.502276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4665c017-7f8f-407a-a7d9-3c0c87fb8b51 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:57.519640 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4665c017-7f8f-407a-a7d9-3c0c87fb8b51 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1320 microversion: 2.1 time: 0.658161 Oct 29 02:59:57.523776 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1796/3492] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:56 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1320 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:57.894636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7ebbbb25-aae8-4856-bf22-22e1742e490c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:57.895397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7ebbbb25-aae8-4856-bf22-22e1742e490c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:57.929585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ebbbb25-aae8-4856-bf22-22e1742e490c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:57.930684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ebbbb25-aae8-4856-bf22-22e1742e490c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:57.930684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ebbbb25-aae8-4856-bf22-22e1742e490c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:57.939413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ebbbb25-aae8-4856-bf22-22e1742e490c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:57.940076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ebbbb25-aae8-4856-bf22-22e1742e490c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:57.940755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ebbbb25-aae8-4856-bf22-22e1742e490c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:57.966077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-e7915c17-a4a2-4a2c-8e0d-3d092037c2ca req-2914e6c3-556d-4586-9ff2-323b73208b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586d2052-3b4d-4539-9947-189e93c1dd8b", "name": "network-vif-plugged", "status": "completed", "tag": "373fe05f-fb29-499c-9f41-39ba5d81768b"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:57.992125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e7915c17-a4a2-4a2c-8e0d-3d092037c2ca req-2914e6c3-556d-4586-9ff2-323b73208b61 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:57.997678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e7915c17-a4a2-4a2c-8e0d-3d092037c2ca req-2914e6c3-556d-4586-9ff2-323b73208b61 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.005178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e7915c17-a4a2-4a2c-8e0d-3d092037c2ca req-2914e6c3-556d-4586-9ff2-323b73208b61 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.051951 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-e7915c17-a4a2-4a2c-8e0d-3d092037c2ca req-2914e6c3-556d-4586-9ff2-323b73208b61 service nova] Creating event network-vif-plugged:373fe05f-fb29-499c-9f41-39ba5d81768b for instance 586d2052-3b4d-4539-9947-189e93c1dd8b on n-h2-862964-4 Oct 29 02:59:58.073572 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-e7915c17-a4a2-4a2c-8e0d-3d092037c2ca req-2914e6c3-556d-4586-9ff2-323b73208b61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111832 Oct 29 02:59:58.074963 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1797/3493] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:58.270162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0b4768db-51c4-461b-b0ba-91e151ddae9e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:58.271290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0b4768db-51c4-461b-b0ba-91e151ddae9e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:58.283349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b4768db-51c4-461b-b0ba-91e151ddae9e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.286779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b4768db-51c4-461b-b0ba-91e151ddae9e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.287693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b4768db-51c4-461b-b0ba-91e151ddae9e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.290737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b4768db-51c4-461b-b0ba-91e151ddae9e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.295149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b4768db-51c4-461b-b0ba-91e151ddae9e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.297874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b4768db-51c4-461b-b0ba-91e151ddae9e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.375155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:58.396612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0b4768db-51c4-461b-b0ba-91e151ddae9e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:59:58.652514 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0b4768db-51c4-461b-b0ba-91e151ddae9e tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 204 len: 0 microversion: 2.1 time: 0.386417 Oct 29 02:59:58.653463 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1798/3494] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:58 2022] DELETE /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:59:58.669973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5656f3f5-4a31-4194-b708-5ccde6004b1f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:58.670692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5656f3f5-4a31-4194-b708-5ccde6004b1f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:58.696989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5656f3f5-4a31-4194-b708-5ccde6004b1f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.697736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5656f3f5-4a31-4194-b708-5ccde6004b1f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.702442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5656f3f5-4a31-4194-b708-5ccde6004b1f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.705614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5656f3f5-4a31-4194-b708-5ccde6004b1f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.706146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5656f3f5-4a31-4194-b708-5ccde6004b1f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.706590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5656f3f5-4a31-4194-b708-5ccde6004b1f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.966555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7ebbbb25-aae8-4856-bf22-22e1742e490c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:58.989236 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7ebbbb25-aae8-4856-bf22-22e1742e490c tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 1.096007 Oct 29 02:59:58.994347 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1697/3495] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:57 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:59.008480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a4cb32c4-f46b-4237-9739-42adf32bafd4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:59.010209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a4cb32c4-f46b-4237-9739-42adf32bafd4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:59.051624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4cb32c4-f46b-4237-9739-42adf32bafd4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:59.052374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4cb32c4-f46b-4237-9739-42adf32bafd4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:59.052969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4cb32c4-f46b-4237-9739-42adf32bafd4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:59.053930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4cb32c4-f46b-4237-9739-42adf32bafd4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:59.054533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4cb32c4-f46b-4237-9739-42adf32bafd4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:59.055108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4cb32c4-f46b-4237-9739-42adf32bafd4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:59.369404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a4cb32c4-f46b-4237-9739-42adf32bafd4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:59.384837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5656f3f5-4a31-4194-b708-5ccde6004b1f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:59.386595 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a4cb32c4-f46b-4237-9739-42adf32bafd4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1320 microversion: 2.1 time: 0.390821 Oct 29 02:59:59.387217 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1698/3496] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:58 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1320 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:59.399148 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5656f3f5-4a31-4194-b708-5ccde6004b1f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1506 microversion: 2.1 time: 0.744361 Oct 29 02:59:59.406580 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1799/3497] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:58 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1506 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:59.413770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eaa831b2-52e9-4bb0-9c4a-856188461938 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:59.414418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eaa831b2-52e9-4bb0-9c4a-856188461938 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:59.424756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaa831b2-52e9-4bb0-9c4a-856188461938 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:59.425499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaa831b2-52e9-4bb0-9c4a-856188461938 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:59.426276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaa831b2-52e9-4bb0-9c4a-856188461938 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:59.427137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaa831b2-52e9-4bb0-9c4a-856188461938 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:59.427746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaa831b2-52e9-4bb0-9c4a-856188461938 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:59.433502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0216a564-221e-4093-98cd-190bfe695977 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:59.440286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaa831b2-52e9-4bb0-9c4a-856188461938 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:59.445353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0216a564-221e-4093-98cd-190bfe695977 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:59.463202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0216a564-221e-4093-98cd-190bfe695977 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:59.467263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0216a564-221e-4093-98cd-190bfe695977 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:59.467950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0216a564-221e-4093-98cd-190bfe695977 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:59.468852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0216a564-221e-4093-98cd-190bfe695977 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:59.472010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0216a564-221e-4093-98cd-190bfe695977 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:59.475483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0216a564-221e-4093-98cd-190bfe695977 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:59.744522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eaa831b2-52e9-4bb0-9c4a-856188461938 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:59.755607 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eaa831b2-52e9-4bb0-9c4a-856188461938 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1664 microversion: 2.1 time: 0.367317 Oct 29 02:59:59.761052 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1699/3498] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:59 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1664 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:59.905130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0216a564-221e-4093-98cd-190bfe695977 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:59.916580 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0216a564-221e-4093-98cd-190bfe695977 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 200 len: 1506 microversion: 2.1 time: 0.487700 Oct 29 02:59:59.935164 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1800/3499] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:59 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:59.946625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be3d7ab5-a39b-416f-ae90-cc4caeb4f6f0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:59.948979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be3d7ab5-a39b-416f-ae90-cc4caeb4f6f0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:59.958074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be3d7ab5-a39b-416f-ae90-cc4caeb4f6f0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:59.958847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be3d7ab5-a39b-416f-ae90-cc4caeb4f6f0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:59.959527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be3d7ab5-a39b-416f-ae90-cc4caeb4f6f0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:59.960534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be3d7ab5-a39b-416f-ae90-cc4caeb4f6f0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:59.961152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be3d7ab5-a39b-416f-ae90-cc4caeb4f6f0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:59.961738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be3d7ab5-a39b-416f-ae90-cc4caeb4f6f0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:59.999570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be3d7ab5-a39b-416f-ae90-cc4caeb4f6f0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:00:00.005117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2d1879fa-f8a1-4749-bd6e-cceb708bb721 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Action: 'create', calling method: .version_select at 0x7fe1a89445e0>, body: {"keypair": {"name": "tempest-keypair-551927145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNRR4+DZt/xtO75gEp3JkGDH+Vecan7Us2oRuEjaUNhyDyBom8avr83dXHmBtdkTsctV+g7HmTgyduPXlLc1M6FnTF/3SzO29chYJS95NPYuic8udOURapTT8go9l7+GA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:00.041598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-2d1879fa-f8a1-4749-bd6e-cceb708bb721 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Getting quotas for project 548a0a34ffec4fe8959e88faab0fb154. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:00.059278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-2d1879fa-f8a1-4749-bd6e-cceb708bb721 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Getting quotas for user a878e1202c3d442fb55052e841589eb7 and project 548a0a34ffec4fe8959e88faab0fb154. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:00.126811 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-be3d7ab5-a39b-416f-ae90-cc4caeb4f6f0 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 204 len: 0 microversion: 2.1 time: 0.183285 Oct 29 03:00:00.130002 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1801/3500] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:59 2022] DELETE /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:00:00.175444 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2d1879fa-f8a1-4749-bd6e-cceb708bb721 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.412521 Oct 29 03:00:00.177164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-35d3e388-486a-4e88-a8aa-e67f5201d09e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:00.178724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-35d3e388-486a-4e88-a8aa-e67f5201d09e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:00.199248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d3e388-486a-4e88-a8aa-e67f5201d09e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:00.199750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d3e388-486a-4e88-a8aa-e67f5201d09e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:00.199889 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1700/3501] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 02:59:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:00.200185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d3e388-486a-4e88-a8aa-e67f5201d09e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:00.200896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d3e388-486a-4e88-a8aa-e67f5201d09e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:00.208728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d3e388-486a-4e88-a8aa-e67f5201d09e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:00.209366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35d3e388-486a-4e88-a8aa-e67f5201d09e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:00.329575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1348686432", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "b84d4357-2c49-45ad-a541-2fe93a1783c7"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:00.449255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] validate_networks() for [('b84d4357-2c49-45ad-a541-2fe93a1783c7', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:00:00.461024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-35d3e388-486a-4e88-a8aa-e67f5201d09e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:00.473850 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-35d3e388-486a-4e88-a8aa-e67f5201d09e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.338012 Oct 29 03:00:00.475199 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1802/3502] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:00 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:00.503545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ceaab31-f983-4745-b091-87bfa5319e54 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:00.505158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ceaab31-f983-4745-b091-87bfa5319e54 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:00.520371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ceaab31-f983-4745-b091-87bfa5319e54 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:00.520864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ceaab31-f983-4745-b091-87bfa5319e54 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:00.521293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ceaab31-f983-4745-b091-87bfa5319e54 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:00.525853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ceaab31-f983-4745-b091-87bfa5319e54 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:00.526355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ceaab31-f983-4745-b091-87bfa5319e54 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:00.526753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ceaab31-f983-4745-b091-87bfa5319e54 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:00.905954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ceaab31-f983-4745-b091-87bfa5319e54 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:00.917130 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ceaab31-f983-4745-b091-87bfa5319e54 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1320 microversion: 2.1 time: 0.440177 Oct 29 03:00:00.918341 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1803/3503] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:00 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1320 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:00.928429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-26a36120-3681-4329-a3ed-70ec48e9470a tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:00.929454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-26a36120-3681-4329-a3ed-70ec48e9470a tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:00.981308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26a36120-3681-4329-a3ed-70ec48e9470a tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:00.981819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26a36120-3681-4329-a3ed-70ec48e9470a tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.013156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26a36120-3681-4329-a3ed-70ec48e9470a tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.015325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26a36120-3681-4329-a3ed-70ec48e9470a tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.015939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26a36120-3681-4329-a3ed-70ec48e9470a tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.016995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26a36120-3681-4329-a3ed-70ec48e9470a tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.442674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-26a36120-3681-4329-a3ed-70ec48e9470a tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:01.451993 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-26a36120-3681-4329-a3ed-70ec48e9470a tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1664 microversion: 2.1 time: 0.530493 Oct 29 03:00:01.456358 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1804/3504] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:00 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1664 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:01.492718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:00:01.493262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:00:01.493931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:00:01.496164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:00:01.496594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:00:01.499639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-112fb682-cad1-4e66-beeb-162e5034512b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:01.500435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-112fb682-cad1-4e66-beeb-162e5034512b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:01.510016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.510885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.511517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.513282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-112fb682-cad1-4e66-beeb-162e5034512b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.513843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-112fb682-cad1-4e66-beeb-162e5034512b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.518801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-112fb682-cad1-4e66-beeb-162e5034512b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.519699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-112fb682-cad1-4e66-beeb-162e5034512b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.520173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-112fb682-cad1-4e66-beeb-162e5034512b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.520608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-112fb682-cad1-4e66-beeb-162e5034512b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.526938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.528482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.529428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.605124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Getting quotas for project c7a3da1a632d443aba8f5cf3b741714b. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:01.612454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Getting quotas for user adb51369444c42c190b1b7bf5e23ddb9 and project c7a3da1a632d443aba8f5cf3b741714b. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:01.655312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:00:01.657670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:00:01.706919 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-49e947d6-11fe-4f74-ba7e-c63bd4485a98 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.381101 Oct 29 03:00:01.708879 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1701/3505] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:00:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:00:01.719685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dd4a2e95-64a4-4011-ab98-1913aa4e5704 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:01.720295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd4a2e95-64a4-4011-ab98-1913aa4e5704 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:01.934892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd4a2e95-64a4-4011-ab98-1913aa4e5704 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:01.958198 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dd4a2e95-64a4-4011-ab98-1913aa4e5704 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1218 microversion: 2.1 time: 0.241778 Oct 29 03:00:01.960444 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1702/3506] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:01 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:01.996750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eec62c84-b8fe-4b1a-a782-f257b1adc4af tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:01.999566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eec62c84-b8fe-4b1a-a782-f257b1adc4af tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:02.033926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec62c84-b8fe-4b1a-a782-f257b1adc4af tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:02.034436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec62c84-b8fe-4b1a-a782-f257b1adc4af tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:02.034879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec62c84-b8fe-4b1a-a782-f257b1adc4af tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:02.035592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec62c84-b8fe-4b1a-a782-f257b1adc4af tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:02.043566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec62c84-b8fe-4b1a-a782-f257b1adc4af tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:02.047890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec62c84-b8fe-4b1a-a782-f257b1adc4af tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:02.214451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-112fb682-cad1-4e66-beeb-162e5034512b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:02.225868 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-112fb682-cad1-4e66-beeb-162e5034512b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.731030 Oct 29 03:00:02.253144 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1805/3507] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:01 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:02.448299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eec62c84-b8fe-4b1a-a782-f257b1adc4af tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:02.463987 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eec62c84-b8fe-4b1a-a782-f257b1adc4af tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1470 microversion: 2.1 time: 0.500427 Oct 29 03:00:02.466939 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1703/3508] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:01 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1470 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:02.489741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-77cd43dc-423f-414c-9719-780e5bdc81de tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:02.490785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-77cd43dc-423f-414c-9719-780e5bdc81de tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:02.507425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77cd43dc-423f-414c-9719-780e5bdc81de tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:02.507982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77cd43dc-423f-414c-9719-780e5bdc81de tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:02.508345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77cd43dc-423f-414c-9719-780e5bdc81de tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:02.509103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77cd43dc-423f-414c-9719-780e5bdc81de tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:02.509554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77cd43dc-423f-414c-9719-780e5bdc81de tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:02.509997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77cd43dc-423f-414c-9719-780e5bdc81de tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:02.734578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7a235a4-bc45-4248-85f0-f3b0222c4ca9 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:02.735287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7a235a4-bc45-4248-85f0-f3b0222c4ca9 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] [instance: 76db3165-bf1b-4aaf-997f-c0d22d2b6147] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:02.754131 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a7a235a4-bc45-4248-85f0-f3b0222c4ca9 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] HTTP exception thrown: Instance 76db3165-bf1b-4aaf-997f-c0d22d2b6147 could not be found. Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7a235a4-bc45-4248-85f0-f3b0222c4ca9 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Request method failure captured: Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/76db3165-bf1b-4aaf-997f-c0d22d2b6147/action HTTP/1.1 Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 15 Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJcYwmOSHPGa1kBMpXU9BKN8790NHJTmndBvH6dJ-kZ04djuWMTRNwgYv7j06XgZFhp90kPlKRG2ivI6UGaiOgfXuSQx2XM6YlrB4Tv2AKplcrPPxiNCUBkXVK64DMhZGX4t3Cz6qxXwziaR3EIZgXmPErdG5lu2szyeDJ9XNnvLMSM Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 97cd5cd1287c4e5182d6485358b33d24 Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/97cd5cd1287c4e5182d6485358b33d24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97cd5cd1287c4e5182d6485358b33d24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_97cd5cd1287c4e5182d6485358b33d24", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97cd5cd1287c4e5182d6485358b33d24"}]}] Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 97cd5cd1287c4e5182d6485358b33d24 Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersAdminNegativeTestJSON-200255818-project-admin Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 985a3b7f43be4a66b55b1375fcc47b94 Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersAdminNegativeTestJSON-200255818-project-admin Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: {"migrate": {}} Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 76db3165-bf1b-4aaf-997f-c0d22d2b6147 could not be found. Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '76db3165-bf1b-4aaf-997f-c0d22d2b6147', 'body': {'migrate': {}}} Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76db3165-bf1b-4aaf-997f-c0d22d2b6147 could not be found. Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76db3165-bf1b-4aaf-997f-c0d22d2b6147 could not be found. Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:02.756222 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:02.761570 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:02.761570 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:02.761570 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:02.761570 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:02.761570 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76db3165-bf1b-4aaf-997f-c0d22d2b6147 could not be found. Oct 29 03:00:02.761570 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:02.762262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7a235a4-bc45-4248-85f0-f3b0222c4ca9 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Returning 404 to user: Instance 76db3165-bf1b-4aaf-997f-c0d22d2b6147 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:02.764112 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7a235a4-bc45-4248-85f0-f3b0222c4ca9 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/76db3165-bf1b-4aaf-997f-c0d22d2b6147/action" status: 404 len: 111 microversion: 2.1 time: 0.276366 Oct 29 03:00:02.767534 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1704/3509] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:02 2022] POST /compute/v2.1/servers/76db3165-bf1b-4aaf-997f-c0d22d2b6147/action => generated 111 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:00:02.983285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db47acfa-fcc7-4776-a83a-d7231e66b2ca tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:02.984301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-db47acfa-fcc7-4776-a83a-d7231e66b2ca tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:03.001698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db47acfa-fcc7-4776-a83a-d7231e66b2ca tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:03.002625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db47acfa-fcc7-4776-a83a-d7231e66b2ca tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:03.003285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db47acfa-fcc7-4776-a83a-d7231e66b2ca tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:03.004404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db47acfa-fcc7-4776-a83a-d7231e66b2ca tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:03.005332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db47acfa-fcc7-4776-a83a-d7231e66b2ca tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:03.006008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db47acfa-fcc7-4776-a83a-d7231e66b2ca tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:03.131287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-db47acfa-fcc7-4776-a83a-d7231e66b2ca tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:03.141007 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-db47acfa-fcc7-4776-a83a-d7231e66b2ca tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1222 microversion: 2.1 time: 0.161623 Oct 29 03:00:03.143520 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1705/3510] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:02 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:03.155650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9e25ac6a-0c76-4bb4-9104-8f7a532516b1 req-ca1ec9bf-ffbc-49c1-bae8-2e76263e5937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd", "name": "network-vif-deleted", "tag": "2e875c98-0ebb-41fc-8873-531820912123"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:03.180092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9e25ac6a-0c76-4bb4-9104-8f7a532516b1 req-ca1ec9bf-ffbc-49c1-bae8-2e76263e5937 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:03.184834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9e25ac6a-0c76-4bb4-9104-8f7a532516b1 req-ca1ec9bf-ffbc-49c1-bae8-2e76263e5937 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:03.185595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9e25ac6a-0c76-4bb4-9104-8f7a532516b1 req-ca1ec9bf-ffbc-49c1-bae8-2e76263e5937 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:03.205519 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9e25ac6a-0c76-4bb4-9104-8f7a532516b1 req-ca1ec9bf-ffbc-49c1-bae8-2e76263e5937 service nova] Creating event network-vif-deleted:2e875c98-0ebb-41fc-8873-531820912123 for instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd on n-h1-862964-4 Oct 29 03:00:03.223753 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9e25ac6a-0c76-4bb4-9104-8f7a532516b1 req-ca1ec9bf-ffbc-49c1-bae8-2e76263e5937 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077954 Oct 29 03:00:03.228920 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1706/3511] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:03.257972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-309205078", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:03.277612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-77cd43dc-423f-414c-9719-780e5bdc81de tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:03.326681 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-77cd43dc-423f-414c-9719-780e5bdc81de tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1664 microversion: 2.1 time: 0.841071 Oct 29 03:00:03.332056 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1806/3512] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:02 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1664 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:03.441988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:00:03.727020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e8f5dd9f-48da-414a-b444-bdd5c5ef1d39 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:03.728529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e8f5dd9f-48da-414a-b444-bdd5c5ef1d39 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:03.739902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8f5dd9f-48da-414a-b444-bdd5c5ef1d39 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:03.743399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8f5dd9f-48da-414a-b444-bdd5c5ef1d39 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:03.746501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8f5dd9f-48da-414a-b444-bdd5c5ef1d39 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:03.752855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8f5dd9f-48da-414a-b444-bdd5c5ef1d39 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:03.756703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8f5dd9f-48da-414a-b444-bdd5c5ef1d39 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:03.757920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8f5dd9f-48da-414a-b444-bdd5c5ef1d39 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.172570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:00:04.173590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:00:04.174394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:00:04.175095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:00:04.175804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:00:04.199087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.199874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.202789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.203840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.204464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.206035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.267259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Getting quotas for project 5d85e030cdfd49bfa36d55f2aa1a074c. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:04.299307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Getting quotas for user a3151f4e39a646e1a3ba3585bc00b2ab and project 5d85e030cdfd49bfa36d55f2aa1a074c. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:04.341706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e8f5dd9f-48da-414a-b444-bdd5c5ef1d39 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:04.347095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:00:04.350688 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e8f5dd9f-48da-414a-b444-bdd5c5ef1d39 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 1.017524 Oct 29 03:00:04.351876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:00:04.383708 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1807/3513] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:03 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:04.403625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e6539c77-3ef8-4843-afb3-7c4b2a4ee707 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:04.408132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e6539c77-3ef8-4843-afb3-7c4b2a4ee707 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:04.421849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6539c77-3ef8-4843-afb3-7c4b2a4ee707 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.426313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6539c77-3ef8-4843-afb3-7c4b2a4ee707 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.427044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6539c77-3ef8-4843-afb3-7c4b2a4ee707 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.428185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6539c77-3ef8-4843-afb3-7c4b2a4ee707 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.428811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6539c77-3ef8-4843-afb3-7c4b2a4ee707 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.429613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6539c77-3ef8-4843-afb3-7c4b2a4ee707 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.519816 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fafaf5ed-21f5-43e2-9712-441804a6b9e2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.287573 Oct 29 03:00:04.522836 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1707/3514] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:00:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:00:04.536800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f0b0a975-0fad-4511-b89f-b757b9ff97f9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:04.548026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f0b0a975-0fad-4511-b89f-b757b9ff97f9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:04.572774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0b0a975-0fad-4511-b89f-b757b9ff97f9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.576607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0b0a975-0fad-4511-b89f-b757b9ff97f9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.577842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0b0a975-0fad-4511-b89f-b757b9ff97f9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.579967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0b0a975-0fad-4511-b89f-b757b9ff97f9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.583110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0b0a975-0fad-4511-b89f-b757b9ff97f9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.593636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0b0a975-0fad-4511-b89f-b757b9ff97f9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.637839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:04.655419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e6539c77-3ef8-4843-afb3-7c4b2a4ee707 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:04.664333 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e6539c77-3ef8-4843-afb3-7c4b2a4ee707 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1270 microversion: 2.1 time: 0.279397 Oct 29 03:00:04.673352 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1808/3515] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:04 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:04.678659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-09f6ac72-ddcb-4642-a379-4f505c7aa8da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:04.679552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-09f6ac72-ddcb-4642-a379-4f505c7aa8da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:04.722135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:04.858651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-09f6ac72-ddcb-4642-a379-4f505c7aa8da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:04.871528 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-09f6ac72-ddcb-4642-a379-4f505c7aa8da tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1221 microversion: 2.1 time: 0.196712 Oct 29 03:00:04.872127 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1809/3516] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:04 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1221 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:04.887018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f0b0a975-0fad-4511-b89f-b757b9ff97f9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:04.902915 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f0b0a975-0fad-4511-b89f-b757b9ff97f9 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1596 microversion: 2.1 time: 0.377985 Oct 29 03:00:04.904675 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1708/3517] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:04 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1596 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:05.131222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1a0be770-86fb-4f42-a915-badcd2b0132b req-028420aa-7f96-4b06-bfd6-2781f77faabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c050ba52-abdb-4119-8647-6d005ac7efd4", "name": "network-vif-deleted", "tag": "eb22a250-842e-44b9-ade9-bb7025c87969"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:05.193097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a0be770-86fb-4f42-a915-badcd2b0132b req-028420aa-7f96-4b06-bfd6-2781f77faabc service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.196080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a0be770-86fb-4f42-a915-badcd2b0132b req-028420aa-7f96-4b06-bfd6-2781f77faabc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.196721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a0be770-86fb-4f42-a915-badcd2b0132b req-028420aa-7f96-4b06-bfd6-2781f77faabc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.259560 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1a0be770-86fb-4f42-a915-badcd2b0132b req-028420aa-7f96-4b06-bfd6-2781f77faabc service nova] Creating event network-vif-deleted:eb22a250-842e-44b9-ade9-bb7025c87969 for instance c050ba52-abdb-4119-8647-6d005ac7efd4 on n-h2-862964-4 Oct 29 03:00:05.282177 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1a0be770-86fb-4f42-a915-badcd2b0132b req-028420aa-7f96-4b06-bfd6-2781f77faabc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171477 Oct 29 03:00:05.287922 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1810/3518] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:05.391018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4957ae31-93d8-474c-9cb7-9699cb81baaf tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:05.392431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4957ae31-93d8-474c-9cb7-9699cb81baaf tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:05.407928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4957ae31-93d8-474c-9cb7-9699cb81baaf tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.408573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4957ae31-93d8-474c-9cb7-9699cb81baaf tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.409103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4957ae31-93d8-474c-9cb7-9699cb81baaf tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.411792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4957ae31-93d8-474c-9cb7-9699cb81baaf tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.412740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4957ae31-93d8-474c-9cb7-9699cb81baaf tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.414213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4957ae31-93d8-474c-9cb7-9699cb81baaf tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.701855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-797b6c6d-887d-4fb5-9be0-3eef6bd799da tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:05.702579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-797b6c6d-887d-4fb5-9be0-3eef6bd799da tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:05.717148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-797b6c6d-887d-4fb5-9be0-3eef6bd799da tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.718132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-797b6c6d-887d-4fb5-9be0-3eef6bd799da tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.718594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-797b6c6d-887d-4fb5-9be0-3eef6bd799da tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.720858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-797b6c6d-887d-4fb5-9be0-3eef6bd799da tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.721343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-797b6c6d-887d-4fb5-9be0-3eef6bd799da tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.725481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-797b6c6d-887d-4fb5-9be0-3eef6bd799da tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.921000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-797b6c6d-887d-4fb5-9be0-3eef6bd799da tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:05.943133 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-797b6c6d-887d-4fb5-9be0-3eef6bd799da tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1276 microversion: 2.1 time: 0.245876 Oct 29 03:00:05.948220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4957ae31-93d8-474c-9cb7-9699cb81baaf tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:05.973822 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1811/3519] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:05 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:05.978277 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4957ae31-93d8-474c-9cb7-9699cb81baaf tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.591507 Oct 29 03:00:05.986825 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1709/3520] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:05 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:05.989826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-87f3e919-fdb1-42c8-8efc-bb95c4c1c565 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:05.994504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:05.995258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-87f3e919-fdb1-42c8-8efc-bb95c4c1c565 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:05.999134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:06.006052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87f3e919-fdb1-42c8-8efc-bb95c4c1c565 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:06.010059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87f3e919-fdb1-42c8-8efc-bb95c4c1c565 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:06.011608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87f3e919-fdb1-42c8-8efc-bb95c4c1c565 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:06.016862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87f3e919-fdb1-42c8-8efc-bb95c4c1c565 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:06.019615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87f3e919-fdb1-42c8-8efc-bb95c4c1c565 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:06.020238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87f3e919-fdb1-42c8-8efc-bb95c4c1c565 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:06.021324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:06.023620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:06.026010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:06.027029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:06.028510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:06.029703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:06.188517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:06.189022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:06.191290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:06.191749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lazy-loading 'fault' on Instance uuid c050ba52-abdb-4119-8647-6d005ac7efd4 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:06.225192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-87f3e919-fdb1-42c8-8efc-bb95c4c1c565 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:06.240169 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-87f3e919-fdb1-42c8-8efc-bb95c4c1c565 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1225 microversion: 2.1 time: 0.260138 Oct 29 03:00:06.240987 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1812/3521] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:05 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1225 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:06.341527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa5908625524366a62c614bd2113894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb1bb96119d42f3900af93321db08bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:06.362767 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0c03ba9a-6861-41de-9d08-535719e2c950 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 200 len: 1315 microversion: 2.1 time: 0.371100 Oct 29 03:00:06.363430 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1710/3522] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:05 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:06.503562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-750638651", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "26a031e5-eb5e-4a39-bb32-1fa69ee92873"}], "security_groups": [{"name": "tempest-securitygroup--299171699"}], "key_name": "tempest-keypair-551927145", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:06.700164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] validate_networks() for [('26a031e5-eb5e-4a39-bb32-1fa69ee92873', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:00:06.985290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8206e419-0844-4742-a61f-ecdc9dac43d9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:06.986026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8206e419-0844-4742-a61f-ecdc9dac43d9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:07.014424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8206e419-0844-4742-a61f-ecdc9dac43d9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:07.014870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8206e419-0844-4742-a61f-ecdc9dac43d9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:07.020574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8206e419-0844-4742-a61f-ecdc9dac43d9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:07.021423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8206e419-0844-4742-a61f-ecdc9dac43d9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:07.021997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8206e419-0844-4742-a61f-ecdc9dac43d9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:07.031037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8206e419-0844-4742-a61f-ecdc9dac43d9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:07.567796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8206e419-0844-4742-a61f-ecdc9dac43d9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:07.580114 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8206e419-0844-4742-a61f-ecdc9dac43d9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1318 microversion: 2.1 time: 0.598268 Oct 29 03:00:07.585132 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1711/3523] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:06 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1318 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:07.590463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6ed07ebc-ccdc-4187-a478-f30f05387669 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:07.598865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6ed07ebc-ccdc-4187-a478-f30f05387669 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:07.608767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ed07ebc-ccdc-4187-a478-f30f05387669 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:07.609717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ed07ebc-ccdc-4187-a478-f30f05387669 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:07.611675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ed07ebc-ccdc-4187-a478-f30f05387669 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:07.617190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ed07ebc-ccdc-4187-a478-f30f05387669 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:07.618077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ed07ebc-ccdc-4187-a478-f30f05387669 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:07.619072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ed07ebc-ccdc-4187-a478-f30f05387669 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.052103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6ed07ebc-ccdc-4187-a478-f30f05387669 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:08.068166 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6ed07ebc-ccdc-4187-a478-f30f05387669 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.481585 Oct 29 03:00:08.083089 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1712/3524] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:07 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:08.091323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-19292638-9f90-4e3f-906b-eebeaf25bbd5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:08.092224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-19292638-9f90-4e3f-906b-eebeaf25bbd5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:08.099421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19292638-9f90-4e3f-906b-eebeaf25bbd5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.100309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19292638-9f90-4e3f-906b-eebeaf25bbd5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.100997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19292638-9f90-4e3f-906b-eebeaf25bbd5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.102210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19292638-9f90-4e3f-906b-eebeaf25bbd5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.103069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19292638-9f90-4e3f-906b-eebeaf25bbd5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.103726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19292638-9f90-4e3f-906b-eebeaf25bbd5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.192242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Getting quotas for project 548a0a34ffec4fe8959e88faab0fb154. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:08.210710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Getting quotas for user a878e1202c3d442fb55052e841589eb7 and project 548a0a34ffec4fe8959e88faab0fb154. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:08.231070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:00:08.231842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:00:08.232906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:00:08.233919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:00:08.234565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:00:08.271749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.272192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-19292638-9f90-4e3f-906b-eebeaf25bbd5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:08.272995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.274137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.275127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.275842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.277276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.293541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:08.297240 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-19292638-9f90-4e3f-906b-eebeaf25bbd5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1279 microversion: 2.1 time: 0.209860 Oct 29 03:00:08.299283 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1713/3525] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:08 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1279 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:08.315156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:08.316167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] [instance: c050ba52-abdb-4119-8647-6d005ac7efd4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:08.318218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Getting quotas for project 548a0a34ffec4fe8959e88faab0fb154. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:08.327865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Getting quotas for user a878e1202c3d442fb55052e841589eb7 and project 548a0a34ffec4fe8959e88faab0fb154. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:08.340628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.341859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.348390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.349013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:00:08.350166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.352784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.353513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.358458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:00:08.400098 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] HTTP exception thrown: Instance c050ba52-abdb-4119-8647-6d005ac7efd4 could not be found. Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Request method failure captured: Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 HTTP/1.1 Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJbga9KF5aTXhQY5abPVVdxni-uevi7BzSM2rrJL275hwyz2g0ONAoRiEbpsmxwu5U_p8FzMlWJt0eMNJeLT58NPiQxNO5kCj_tKdjQmeIIljVJaKKJ3SQF2jE-1qw1BwVJRNBHRWLrR1dsKghu6O1ECijvZLdneQxU4TnzJXFSPD4Q Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 7eb1bb96119d42f3900af93321db08bf Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestFqdnHostnames-1061948322 Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7eb1bb96119d42f3900af93321db08bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7eb1bb96119d42f3900af93321db08bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7eb1bb96119d42f3900af93321db08bf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7eb1bb96119d42f3900af93321db08bf"}]}] Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestFqdnHostnames-1061948322 Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 7eb1bb96119d42f3900af93321db08bf Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1061948322 Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestFqdnHostnames-1061948322-project Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: baa5908625524366a62c614bd2113894 Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestFqdnHostnames-1061948322-project Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance c050ba52-abdb-4119-8647-6d005ac7efd4 could not be found. Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c050ba52-abdb-4119-8647-6d005ac7efd4'} Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c050ba52-abdb-4119-8647-6d005ac7efd4 could not be found. Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c050ba52-abdb-4119-8647-6d005ac7efd4 could not be found. Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:08.405491 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:08.410394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:08.410394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:08.410394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:08.410394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:08.410394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:08.410394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c050ba52-abdb-4119-8647-6d005ac7efd4 could not be found. Oct 29 03:00:08.410394 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:08.415020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Returning 404 to user: Instance c050ba52-abdb-4119-8647-6d005ac7efd4 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:08.416804 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d48d1990-0003-4922-a4e1-1d54d25e84eb tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4" status: 404 len: 111 microversion: 2.1 time: 0.112607 Oct 29 03:00:08.424653 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1714/3526] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:08 2022] GET /compute/v2.1/servers/c050ba52-abdb-4119-8647-6d005ac7efd4 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:08.436953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-183a50d8-8f29-4449-bafb-11b5d2cdb3e1 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] Calling method '.version_select at 0x7fe1a8a10040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:08.447681 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9cebdb47-0cfb-449b-8712-e4c529120f63 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.947193 Oct 29 03:00:08.448390 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1813/3527] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:00:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:00:08.462845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-13151f44-3ec0-4b69-b231-1940ee321bdd tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:08.464475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-13151f44-3ec0-4b69-b231-1940ee321bdd tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:08.477645 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-183a50d8-8f29-4449-bafb-11b5d2cdb3e1 tempest-ServersTestFqdnHostnames-1061948322 tempest-ServersTestFqdnHostnames-1061948322-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-565323496" status: 202 len: 0 microversion: 2.1 time: 0.051412 Oct 29 03:00:08.479121 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1715/3528] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 03:00:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-565323496 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:00:08.609387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-12e635be-ba4d-4818-a959-a841b0b3a784 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:08.610488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-12e635be-ba4d-4818-a959-a841b0b3a784 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:08.624166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12e635be-ba4d-4818-a959-a841b0b3a784 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.625042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12e635be-ba4d-4818-a959-a841b0b3a784 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.627277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12e635be-ba4d-4818-a959-a841b0b3a784 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.631455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12e635be-ba4d-4818-a959-a841b0b3a784 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.632250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12e635be-ba4d-4818-a959-a841b0b3a784 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.632930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12e635be-ba4d-4818-a959-a841b0b3a784 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.662873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-13151f44-3ec0-4b69-b231-1940ee321bdd tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:08.690653 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-13151f44-3ec0-4b69-b231-1940ee321bdd tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1268 microversion: 2.1 time: 0.233267 Oct 29 03:00:08.691516 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1814/3529] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:08 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1268 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:09.101959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f4fefbab-282b-4b8b-b9cc-7b0045cc5c12 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:09.104206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f4fefbab-282b-4b8b-b9cc-7b0045cc5c12 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:09.117961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fefbab-282b-4b8b-b9cc-7b0045cc5c12 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.120300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fefbab-282b-4b8b-b9cc-7b0045cc5c12 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.121291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fefbab-282b-4b8b-b9cc-7b0045cc5c12 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.124225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fefbab-282b-4b8b-b9cc-7b0045cc5c12 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.124987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fefbab-282b-4b8b-b9cc-7b0045cc5c12 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.125689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fefbab-282b-4b8b-b9cc-7b0045cc5c12 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.336920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-12e635be-ba4d-4818-a959-a841b0b3a784 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:09.367174 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-12e635be-ba4d-4818-a959-a841b0b3a784 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1318 microversion: 2.1 time: 0.762962 Oct 29 03:00:09.367790 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1716/3530] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:08 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1318 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:09.397488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6621283-eff4-46cf-bed7-4af9b282e003 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:09.398497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c6621283-eff4-46cf-bed7-4af9b282e003 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:09.424961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6621283-eff4-46cf-bed7-4af9b282e003 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.428540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6621283-eff4-46cf-bed7-4af9b282e003 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.433063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6621283-eff4-46cf-bed7-4af9b282e003 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.436470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6621283-eff4-46cf-bed7-4af9b282e003 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.441125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6621283-eff4-46cf-bed7-4af9b282e003 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.442024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6621283-eff4-46cf-bed7-4af9b282e003 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.552739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f4fefbab-282b-4b8b-b9cc-7b0045cc5c12 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:09.575800 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f4fefbab-282b-4b8b-b9cc-7b0045cc5c12 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 0.484377 Oct 29 03:00:09.592083 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1815/3531] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:09 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:09.625875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c6621283-eff4-46cf-bed7-4af9b282e003 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:09.636362 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c6621283-eff4-46cf-bed7-4af9b282e003 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1279 microversion: 2.1 time: 0.267490 Oct 29 03:00:09.640497 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1717/3532] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:09 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1279 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:09.713531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3343d84a-46d1-4a90-9d0a-068ab3622d99 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:09.714193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3343d84a-46d1-4a90-9d0a-068ab3622d99 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:09.729852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3343d84a-46d1-4a90-9d0a-068ab3622d99 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.730343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3343d84a-46d1-4a90-9d0a-068ab3622d99 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.734569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3343d84a-46d1-4a90-9d0a-068ab3622d99 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.735474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3343d84a-46d1-4a90-9d0a-068ab3622d99 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.735958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3343d84a-46d1-4a90-9d0a-068ab3622d99 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.736385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3343d84a-46d1-4a90-9d0a-068ab3622d99 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.910657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3343d84a-46d1-4a90-9d0a-068ab3622d99 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:09.931300 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3343d84a-46d1-4a90-9d0a-068ab3622d99 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1272 microversion: 2.1 time: 0.221908 Oct 29 03:00:09.945796 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1816/3533] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:09 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:10.392571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b1c854f-73b4-4e14-a501-92d8a0bc3fe6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:10.393180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0b1c854f-73b4-4e14-a501-92d8a0bc3fe6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:10.419139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b1c854f-73b4-4e14-a501-92d8a0bc3fe6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:10.419641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b1c854f-73b4-4e14-a501-92d8a0bc3fe6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:10.420081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b1c854f-73b4-4e14-a501-92d8a0bc3fe6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:10.426468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b1c854f-73b4-4e14-a501-92d8a0bc3fe6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:10.427008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b1c854f-73b4-4e14-a501-92d8a0bc3fe6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:10.427460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b1c854f-73b4-4e14-a501-92d8a0bc3fe6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:10.605622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ec3d786-e4ec-49b9-804b-d2d5289c7fb0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:10.607435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ec3d786-e4ec-49b9-804b-d2d5289c7fb0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:10.625589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ec3d786-e4ec-49b9-804b-d2d5289c7fb0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:10.627582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ec3d786-e4ec-49b9-804b-d2d5289c7fb0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:10.630045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ec3d786-e4ec-49b9-804b-d2d5289c7fb0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:10.631076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ec3d786-e4ec-49b9-804b-d2d5289c7fb0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:10.632663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ec3d786-e4ec-49b9-804b-d2d5289c7fb0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:10.634265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ec3d786-e4ec-49b9-804b-d2d5289c7fb0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:11.255120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b1c854f-73b4-4e14-a501-92d8a0bc3fe6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:11.266261 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b1c854f-73b4-4e14-a501-92d8a0bc3fe6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1318 microversion: 2.1 time: 0.877467 Oct 29 03:00:11.274223 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1718/3534] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:10 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1318 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:11.279452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6b7a16c5-33d7-4de8-b6a7-809fd074b140 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:11.283032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6b7a16c5-33d7-4de8-b6a7-809fd074b140 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:11.297158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7a16c5-33d7-4de8-b6a7-809fd074b140 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:11.300510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7a16c5-33d7-4de8-b6a7-809fd074b140 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:11.301154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7a16c5-33d7-4de8-b6a7-809fd074b140 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:11.304115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7a16c5-33d7-4de8-b6a7-809fd074b140 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:11.304827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7a16c5-33d7-4de8-b6a7-809fd074b140 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:11.305447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7a16c5-33d7-4de8-b6a7-809fd074b140 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:11.697497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ec3d786-e4ec-49b9-804b-d2d5289c7fb0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:11.706156 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ec3d786-e4ec-49b9-804b-d2d5289c7fb0 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1510 microversion: 2.1 time: 1.106997 Oct 29 03:00:11.710557 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1817/3535] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:10 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1510 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:11.724540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-397dd03e-1717-4c49-8d4f-3b2fdde1b083 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:11.725591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-397dd03e-1717-4c49-8d4f-3b2fdde1b083 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:11.736432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397dd03e-1717-4c49-8d4f-3b2fdde1b083 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:11.737156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397dd03e-1717-4c49-8d4f-3b2fdde1b083 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:11.742533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397dd03e-1717-4c49-8d4f-3b2fdde1b083 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:11.743974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397dd03e-1717-4c49-8d4f-3b2fdde1b083 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:11.744737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397dd03e-1717-4c49-8d4f-3b2fdde1b083 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:11.745213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-397dd03e-1717-4c49-8d4f-3b2fdde1b083 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:11.791859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6b7a16c5-33d7-4de8-b6a7-809fd074b140 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:11.800311 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6b7a16c5-33d7-4de8-b6a7-809fd074b140 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1321 microversion: 2.1 time: 0.524491 Oct 29 03:00:11.804858 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1719/3536] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:11 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1321 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:11.814595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-551f0de9-d5fb-4043-b721-450e501f565d req-29634641-628e-412c-ba90-a5179ae62310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011b0dd6-a90d-4ee3-ad93-d4b22a12148e", "tag": "158289ef-ac46-428b-8096-bada975e064f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:11.832822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-551f0de9-d5fb-4043-b721-450e501f565d req-29634641-628e-412c-ba90-a5179ae62310 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:11.833310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-551f0de9-d5fb-4043-b721-450e501f565d req-29634641-628e-412c-ba90-a5179ae62310 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:11.833877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-551f0de9-d5fb-4043-b721-450e501f565d req-29634641-628e-412c-ba90-a5179ae62310 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:11.863567 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-551f0de9-d5fb-4043-b721-450e501f565d req-29634641-628e-412c-ba90-a5179ae62310 service nova] Creating event network-changed:158289ef-ac46-428b-8096-bada975e064f for instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e on n-h2-862964-4 Oct 29 03:00:11.879768 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-551f0de9-d5fb-4043-b721-450e501f565d req-29634641-628e-412c-ba90-a5179ae62310 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073449 Oct 29 03:00:11.880740 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1720/3537] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:11.956396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-397dd03e-1717-4c49-8d4f-3b2fdde1b083 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:11.964959 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-397dd03e-1717-4c49-8d4f-3b2fdde1b083 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1326 microversion: 2.1 time: 0.252914 Oct 29 03:00:11.967860 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1818/3538] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:11 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1326 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:12.301386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9e1c4276-b9d3-4b4b-8cfe-c60ae582f468 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:12.302228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9e1c4276-b9d3-4b4b-8cfe-c60ae582f468 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:12.304482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:12.330765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e1c4276-b9d3-4b4b-8cfe-c60ae582f468 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:12.333557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e1c4276-b9d3-4b4b-8cfe-c60ae582f468 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:12.334316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e1c4276-b9d3-4b4b-8cfe-c60ae582f468 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:12.335346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e1c4276-b9d3-4b4b-8cfe-c60ae582f468 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:12.337630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e1c4276-b9d3-4b4b-8cfe-c60ae582f468 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:12.338358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e1c4276-b9d3-4b4b-8cfe-c60ae582f468 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:12.742245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-552c6b99-7574-427d-bfc3-e2dc86809d56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:12.743037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-552c6b99-7574-427d-bfc3-e2dc86809d56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:12.765566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-552c6b99-7574-427d-bfc3-e2dc86809d56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:12.766346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-552c6b99-7574-427d-bfc3-e2dc86809d56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:12.766795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-552c6b99-7574-427d-bfc3-e2dc86809d56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:12.770808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-552c6b99-7574-427d-bfc3-e2dc86809d56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:12.771291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-552c6b99-7574-427d-bfc3-e2dc86809d56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:12.771792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-552c6b99-7574-427d-bfc3-e2dc86809d56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:12.965744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9e1c4276-b9d3-4b4b-8cfe-c60ae582f468 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:12.977213 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9e1c4276-b9d3-4b4b-8cfe-c60ae582f468 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1318 microversion: 2.1 time: 0.677625 Oct 29 03:00:12.977864 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1721/3539] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:12 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:12.991117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3779a671-594b-4e78-87b1-f610d4a37265 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:12.991484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3779a671-594b-4e78-87b1-f610d4a37265 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:13.026373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3779a671-594b-4e78-87b1-f610d4a37265 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.026868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3779a671-594b-4e78-87b1-f610d4a37265 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.027303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3779a671-594b-4e78-87b1-f610d4a37265 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.028019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3779a671-594b-4e78-87b1-f610d4a37265 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.038486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3779a671-594b-4e78-87b1-f610d4a37265 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.038946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3779a671-594b-4e78-87b1-f610d4a37265 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.117886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-552c6b99-7574-427d-bfc3-e2dc86809d56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:13.129386 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-552c6b99-7574-427d-bfc3-e2dc86809d56 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1487 microversion: 2.1 time: 0.396564 Oct 29 03:00:13.131846 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1819/3540] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:12 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1487 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:13.156495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-db356ffb-cc14-4a89-bac1-38e6eea10be8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:13.158041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db356ffb-cc14-4a89-bac1-38e6eea10be8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:13.189123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db356ffb-cc14-4a89-bac1-38e6eea10be8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.189625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db356ffb-cc14-4a89-bac1-38e6eea10be8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.190127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db356ffb-cc14-4a89-bac1-38e6eea10be8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.190855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db356ffb-cc14-4a89-bac1-38e6eea10be8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.191306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db356ffb-cc14-4a89-bac1-38e6eea10be8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.191728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db356ffb-cc14-4a89-bac1-38e6eea10be8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.322799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3779a671-594b-4e78-87b1-f610d4a37265 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:13.330927 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3779a671-594b-4e78-87b1-f610d4a37265 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1321 microversion: 2.1 time: 0.351142 Oct 29 03:00:13.334887 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1722/3541] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:12 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:13.343112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-86502540-5de9-4a6f-9c29-88dacc459304 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:13.346128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86502540-5de9-4a6f-9c29-88dacc459304 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:13.358855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86502540-5de9-4a6f-9c29-88dacc459304 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.359772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86502540-5de9-4a6f-9c29-88dacc459304 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.360992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86502540-5de9-4a6f-9c29-88dacc459304 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.364593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86502540-5de9-4a6f-9c29-88dacc459304 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.365307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86502540-5de9-4a6f-9c29-88dacc459304 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.366174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86502540-5de9-4a6f-9c29-88dacc459304 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.417453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86502540-5de9-4a6f-9c29-88dacc459304 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:00:13.443069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-db356ffb-cc14-4a89-bac1-38e6eea10be8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:13.464677 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-db356ffb-cc14-4a89-bac1-38e6eea10be8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1326 microversion: 2.1 time: 0.320873 Oct 29 03:00:13.466543 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1820/3542] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:13 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1326 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:13.578474 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-86502540-5de9-4a6f-9c29-88dacc459304 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 204 len: 0 microversion: 2.1 time: 0.241898 Oct 29 03:00:13.580263 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1723/3543] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:13 2022] DELETE /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:00:13.593513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7e17a44e-f39c-4422-87b7-1bccd4742fd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:13.595117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7e17a44e-f39c-4422-87b7-1bccd4742fd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:13.612135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e17a44e-f39c-4422-87b7-1bccd4742fd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.614001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e17a44e-f39c-4422-87b7-1bccd4742fd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.622408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e17a44e-f39c-4422-87b7-1bccd4742fd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.623461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e17a44e-f39c-4422-87b7-1bccd4742fd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.624939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e17a44e-f39c-4422-87b7-1bccd4742fd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.627091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e17a44e-f39c-4422-87b7-1bccd4742fd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.922666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-cf13a23c-4ad3-4a97-a7f9-315e9bdbc38f req-1c556ca3-9912-4024-8023-63e2ad090b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307ea4d3-0a4b-4e45-8e60-166f6f2f34b9", "tag": "e77f2ab9-9058-4555-808a-abd1a7d3096f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:13.945090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cf13a23c-4ad3-4a97-a7f9-315e9bdbc38f req-1c556ca3-9912-4024-8023-63e2ad090b6d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.946782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cf13a23c-4ad3-4a97-a7f9-315e9bdbc38f req-1c556ca3-9912-4024-8023-63e2ad090b6d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.947219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cf13a23c-4ad3-4a97-a7f9-315e9bdbc38f req-1c556ca3-9912-4024-8023-63e2ad090b6d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.979701 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-cf13a23c-4ad3-4a97-a7f9-315e9bdbc38f req-1c556ca3-9912-4024-8023-63e2ad090b6d service nova] Creating event network-changed:e77f2ab9-9058-4555-808a-abd1a7d3096f for instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 on n-h1-862964-4 Oct 29 03:00:13.992636 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-cf13a23c-4ad3-4a97-a7f9-315e9bdbc38f req-1c556ca3-9912-4024-8023-63e2ad090b6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072965 Oct 29 03:00:13.994129 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1724/3544] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:00:14.006240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ca75304-4706-4e58-8515-25e14fa3d22b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:14.011644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8ca75304-4706-4e58-8515-25e14fa3d22b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:14.035891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ca75304-4706-4e58-8515-25e14fa3d22b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:14.037568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ca75304-4706-4e58-8515-25e14fa3d22b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:14.039858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ca75304-4706-4e58-8515-25e14fa3d22b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:14.040816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ca75304-4706-4e58-8515-25e14fa3d22b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:14.043632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ca75304-4706-4e58-8515-25e14fa3d22b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:14.044579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ca75304-4706-4e58-8515-25e14fa3d22b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:14.222197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:14.321636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=18 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:14.437103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8ca75304-4706-4e58-8515-25e14fa3d22b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:14.446459 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8ca75304-4706-4e58-8515-25e14fa3d22b tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1318 microversion: 2.1 time: 0.447085 Oct 29 03:00:14.448625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7e17a44e-f39c-4422-87b7-1bccd4742fd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:14.459418 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7e17a44e-f39c-4422-87b7-1bccd4742fd8 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1493 microversion: 2.1 time: 0.873996 Oct 29 03:00:14.468813 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1725/3545] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:13 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:14.471914 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1821/3546] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:13 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1493 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:14.479300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2ff3fbaa-2476-46d2-8d85-626f9523aee9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:14.480828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2ff3fbaa-2476-46d2-8d85-626f9523aee9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:14.496146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff3fbaa-2476-46d2-8d85-626f9523aee9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:14.498230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff3fbaa-2476-46d2-8d85-626f9523aee9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:14.498891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff3fbaa-2476-46d2-8d85-626f9523aee9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:14.501570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff3fbaa-2476-46d2-8d85-626f9523aee9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:14.504260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff3fbaa-2476-46d2-8d85-626f9523aee9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:14.506640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff3fbaa-2476-46d2-8d85-626f9523aee9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:14.509896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-67c3777a-a301-4bb1-bd9b-b1ecdcd174fa tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:14.510522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-67c3777a-a301-4bb1-bd9b-b1ecdcd174fa tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:14.515482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:14.527708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c3777a-a301-4bb1-bd9b-b1ecdcd174fa tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:14.529162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c3777a-a301-4bb1-bd9b-b1ecdcd174fa tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:14.529820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c3777a-a301-4bb1-bd9b-b1ecdcd174fa tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:14.531732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c3777a-a301-4bb1-bd9b-b1ecdcd174fa tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:14.532426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c3777a-a301-4bb1-bd9b-b1ecdcd174fa tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:14.533020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67c3777a-a301-4bb1-bd9b-b1ecdcd174fa tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:14.773361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2ff3fbaa-2476-46d2-8d85-626f9523aee9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:14.805048 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2ff3fbaa-2476-46d2-8d85-626f9523aee9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1321 microversion: 2.1 time: 0.323234 Oct 29 03:00:14.806326 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1726/3547] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:14 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:14.968283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-67c3777a-a301-4bb1-bd9b-b1ecdcd174fa tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:14.993233 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-67c3777a-a301-4bb1-bd9b-b1ecdcd174fa tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1393 microversion: 2.1 time: 0.499840 Oct 29 03:00:14.995177 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1822/3548] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:14 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1393 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:15.476432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4805709a-92a1-4613-89cd-669028570445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:15.477836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4805709a-92a1-4613-89cd-669028570445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:15.489584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4805709a-92a1-4613-89cd-669028570445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:15.491342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4805709a-92a1-4613-89cd-669028570445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:15.492482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4805709a-92a1-4613-89cd-669028570445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:15.494919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4805709a-92a1-4613-89cd-669028570445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:15.497483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4805709a-92a1-4613-89cd-669028570445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:15.498220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4805709a-92a1-4613-89cd-669028570445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:15.504038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f37c7b46-5141-4b8d-965b-03855189dc57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:15.505689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f37c7b46-5141-4b8d-965b-03855189dc57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:15.521054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f37c7b46-5141-4b8d-965b-03855189dc57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:15.521770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f37c7b46-5141-4b8d-965b-03855189dc57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:15.523600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f37c7b46-5141-4b8d-965b-03855189dc57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:15.524818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f37c7b46-5141-4b8d-965b-03855189dc57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:15.526739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f37c7b46-5141-4b8d-965b-03855189dc57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:15.529489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f37c7b46-5141-4b8d-965b-03855189dc57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:15.983922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f37c7b46-5141-4b8d-965b-03855189dc57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:16.002367 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f37c7b46-5141-4b8d-965b-03855189dc57 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1493 microversion: 2.1 time: 0.501933 Oct 29 03:00:16.007201 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1823/3549] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:15 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1493 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:16.041535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2abd0301-3e31-45ef-902d-1204ffb9dab4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:16.044193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2abd0301-3e31-45ef-902d-1204ffb9dab4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:16.064278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2abd0301-3e31-45ef-902d-1204ffb9dab4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:16.065116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2abd0301-3e31-45ef-902d-1204ffb9dab4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:16.066746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2abd0301-3e31-45ef-902d-1204ffb9dab4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:16.068649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2abd0301-3e31-45ef-902d-1204ffb9dab4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:16.070575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2abd0301-3e31-45ef-902d-1204ffb9dab4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:16.071846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2abd0301-3e31-45ef-902d-1204ffb9dab4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:16.149570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4805709a-92a1-4613-89cd-669028570445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:16.177481 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4805709a-92a1-4613-89cd-669028570445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1318 microversion: 2.1 time: 0.704875 Oct 29 03:00:16.181650 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1727/3550] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:15 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:16.193414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f640a169-b4f6-44a8-ad8f-ea69d4f51693 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:16.195269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f640a169-b4f6-44a8-ad8f-ea69d4f51693 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:16.202836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f640a169-b4f6-44a8-ad8f-ea69d4f51693 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:16.209429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f640a169-b4f6-44a8-ad8f-ea69d4f51693 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:16.210494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f640a169-b4f6-44a8-ad8f-ea69d4f51693 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:16.211726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f640a169-b4f6-44a8-ad8f-ea69d4f51693 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:16.213830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f640a169-b4f6-44a8-ad8f-ea69d4f51693 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:16.214493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f640a169-b4f6-44a8-ad8f-ea69d4f51693 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:16.605675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2abd0301-3e31-45ef-902d-1204ffb9dab4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:16.617089 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2abd0301-3e31-45ef-902d-1204ffb9dab4 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1321 microversion: 2.1 time: 0.607515 Oct 29 03:00:16.629828 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1824/3551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:16 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1321 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:16.941028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1f60dd2d-3b30-43f1-843b-9a2a631c2a9f req-57d008b7-f93a-4cf9-98f0-5e8c22942cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46368f-b3d8-43ea-967f-ac129d25db58", "name": "network-vif-deleted", "tag": "b08fb32d-76ee-416c-888b-4b38e5277a63"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:16.985164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1f60dd2d-3b30-43f1-843b-9a2a631c2a9f req-57d008b7-f93a-4cf9-98f0-5e8c22942cfd service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:16.995901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1f60dd2d-3b30-43f1-843b-9a2a631c2a9f req-57d008b7-f93a-4cf9-98f0-5e8c22942cfd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:16.996542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1f60dd2d-3b30-43f1-843b-9a2a631c2a9f req-57d008b7-f93a-4cf9-98f0-5e8c22942cfd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.042066 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1f60dd2d-3b30-43f1-843b-9a2a631c2a9f req-57d008b7-f93a-4cf9-98f0-5e8c22942cfd service nova] Creating event network-vif-deleted:b08fb32d-76ee-416c-888b-4b38e5277a63 for instance 1e46368f-b3d8-43ea-967f-ac129d25db58 on n-h2-862964-4 Oct 29 03:00:17.043699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f640a169-b4f6-44a8-ad8f-ea69d4f51693 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:17.054597 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f640a169-b4f6-44a8-ad8f-ea69d4f51693 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1393 microversion: 2.1 time: 0.871514 Oct 29 03:00:17.055927 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1f60dd2d-3b30-43f1-843b-9a2a631c2a9f req-57d008b7-f93a-4cf9-98f0-5e8c22942cfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120640 Oct 29 03:00:17.059069 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1825/3552] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:00:17.067839 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1728/3553] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:16 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1393 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:17.093021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:17.105141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:17.124627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.125471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.127521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.128312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.128783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.133533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.214171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cfd1363a-6050-4d1a-aab0-b7aaf6b41bfd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:17.215116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cfd1363a-6050-4d1a-aab0-b7aaf6b41bfd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:17.226323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd1363a-6050-4d1a-aab0-b7aaf6b41bfd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.226821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd1363a-6050-4d1a-aab0-b7aaf6b41bfd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.227262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd1363a-6050-4d1a-aab0-b7aaf6b41bfd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.229680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.230460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd1363a-6050-4d1a-aab0-b7aaf6b41bfd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.234025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.234410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd1363a-6050-4d1a-aab0-b7aaf6b41bfd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.237101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd1363a-6050-4d1a-aab0-b7aaf6b41bfd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.238939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.239421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lazy-loading 'fault' on Instance uuid 1e46368f-b3d8-43ea-967f-ac129d25db58 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:17.393747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:17.410530 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cdaaf814-ebff-4436-ba0e-1aaf80858387 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 200 len: 1305 microversion: 2.1 time: 0.333766 Oct 29 03:00:17.425002 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1826/3554] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:17 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 1305 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:17.644176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dab45079-bf7f-4dc8-851e-b2bfe7b8f2f2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:17.644869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dab45079-bf7f-4dc8-851e-b2bfe7b8f2f2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:17.655380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dab45079-bf7f-4dc8-851e-b2bfe7b8f2f2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.655887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dab45079-bf7f-4dc8-851e-b2bfe7b8f2f2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.656325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dab45079-bf7f-4dc8-851e-b2bfe7b8f2f2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.657053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dab45079-bf7f-4dc8-851e-b2bfe7b8f2f2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.657511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dab45079-bf7f-4dc8-851e-b2bfe7b8f2f2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.657979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dab45079-bf7f-4dc8-851e-b2bfe7b8f2f2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:18.035699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dab45079-bf7f-4dc8-851e-b2bfe7b8f2f2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:18.051775 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dab45079-bf7f-4dc8-851e-b2bfe7b8f2f2 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1321 microversion: 2.1 time: 0.411459 Oct 29 03:00:18.053692 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1827/3555] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:17 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:18.073164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9e0f7642-b97a-47a6-a90e-4b00f746157c req-b2298905-34d4-4c99-850f-bebab1c21b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011b0dd6-a90d-4ee3-ad93-d4b22a12148e", "name": "network-vif-plugged", "status": "completed", "tag": "158289ef-ac46-428b-8096-bada975e064f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:18.094217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9e0f7642-b97a-47a6-a90e-4b00f746157c req-b2298905-34d4-4c99-850f-bebab1c21b48 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:18.095037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9e0f7642-b97a-47a6-a90e-4b00f746157c req-b2298905-34d4-4c99-850f-bebab1c21b48 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:18.095697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9e0f7642-b97a-47a6-a90e-4b00f746157c req-b2298905-34d4-4c99-850f-bebab1c21b48 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:18.127634 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9e0f7642-b97a-47a6-a90e-4b00f746157c req-b2298905-34d4-4c99-850f-bebab1c21b48 service nova] Creating event network-vif-plugged:158289ef-ac46-428b-8096-bada975e064f for instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e on n-h2-862964-4 Oct 29 03:00:18.133210 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9e0f7642-b97a-47a6-a90e-4b00f746157c req-b2298905-34d4-4c99-850f-bebab1c21b48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069012 Oct 29 03:00:18.133965 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1828/3556] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:00:18.140267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6e3837db-b801-4a06-a4a0-f88df9e1e6d8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:18.141030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6e3837db-b801-4a06-a4a0-f88df9e1e6d8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:18.148590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e3837db-b801-4a06-a4a0-f88df9e1e6d8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:18.149147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e3837db-b801-4a06-a4a0-f88df9e1e6d8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:18.149692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e3837db-b801-4a06-a4a0-f88df9e1e6d8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:18.150416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e3837db-b801-4a06-a4a0-f88df9e1e6d8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:18.151179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e3837db-b801-4a06-a4a0-f88df9e1e6d8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:18.151797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e3837db-b801-4a06-a4a0-f88df9e1e6d8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:18.293651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:18.410326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cfd1363a-6050-4d1a-aab0-b7aaf6b41bfd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:18.423477 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cfd1363a-6050-4d1a-aab0-b7aaf6b41bfd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1318 microversion: 2.1 time: 1.219049 Oct 29 03:00:18.425371 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1729/3557] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:17 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1318 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:18.445964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:18.449791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:18.463673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6e3837db-b801-4a06-a4a0-f88df9e1e6d8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:18.467842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:18.471351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:18.471977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:18.475453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:18.475799 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6e3837db-b801-4a06-a4a0-f88df9e1e6d8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1393 microversion: 2.1 time: 0.338346 Oct 29 03:00:18.476323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:18.478554 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1829/3558] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:18 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1393 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:18.482501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:18.520034 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 HTTP/1.1 Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1e46368f-b3d8-43ea-967f-ac129d25db58'} Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:18.521864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:18.526400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:18.526400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:18.526400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:18.526400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:18.526400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:18.526400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:18.526400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:18.534765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:18.540733 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d7cbb513-00a5-422f-afbf-e20b5401d563 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 404 len: 111 microversion: 2.1 time: 0.100753 Oct 29 03:00:18.545634 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1730/3559] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:18 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:18.623011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2024517449", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "206445a3-72bd-4ae4-a1d4-4c994350bfbb"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:18.678138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=14 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:18.766239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] validate_networks() for [('206445a3-72bd-4ae4-a1d4-4c994350bfbb', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:00:19.083507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3fac79b1-a301-415d-8557-93a27f33eb2d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:19.084186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3fac79b1-a301-415d-8557-93a27f33eb2d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:19.096002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fac79b1-a301-415d-8557-93a27f33eb2d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.102180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fac79b1-a301-415d-8557-93a27f33eb2d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.111187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fac79b1-a301-415d-8557-93a27f33eb2d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.112866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fac79b1-a301-415d-8557-93a27f33eb2d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.113423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fac79b1-a301-415d-8557-93a27f33eb2d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.113891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fac79b1-a301-415d-8557-93a27f33eb2d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.353949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:00:19.354373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:00:19.354841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:00:19.355244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:00:19.356353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:00:19.367746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.368755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.369397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.370374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.372447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.374785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.399955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:19.409320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Getting quotas for user fceb096cc5414b3a9d7300fefeb90dff and project 616962eaa7c0469bb81953b54e70afad. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:19.425477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:00:19.428706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:00:19.500914 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8776e2e1-e90f-48ba-b2ca-2eb2aa3d3c85 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882783 Oct 29 03:00:19.501844 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1830/3560] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:00:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:00:19.509754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3fac79b1-a301-415d-8557-93a27f33eb2d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:19.510482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3c4f5f27-1c5e-4919-ad8b-cf94550a0fb7 req-c346c1f4-cc7c-4c18-b75d-5f937337cb3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff3fc3b-c65f-417e-9978-1a7b1179de2d", "tag": "08892328-92a2-491f-bdba-c4be5bc285d2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:19.519161 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3fac79b1-a301-415d-8557-93a27f33eb2d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1321 microversion: 2.1 time: 0.442575 Oct 29 03:00:19.525689 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1731/3561] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:19 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1321 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:19.541897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e397b5d7-3982-40c6-afeb-69d087d02fcb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:19.547984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e397b5d7-3982-40c6-afeb-69d087d02fcb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:19.569505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c4f5f27-1c5e-4919-ad8b-cf94550a0fb7 req-c346c1f4-cc7c-4c18-b75d-5f937337cb3c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.570667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c4f5f27-1c5e-4919-ad8b-cf94550a0fb7 req-c346c1f4-cc7c-4c18-b75d-5f937337cb3c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.570816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e397b5d7-3982-40c6-afeb-69d087d02fcb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.571254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e397b5d7-3982-40c6-afeb-69d087d02fcb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.571403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c4f5f27-1c5e-4919-ad8b-cf94550a0fb7 req-c346c1f4-cc7c-4c18-b75d-5f937337cb3c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.571709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e397b5d7-3982-40c6-afeb-69d087d02fcb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.572443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e397b5d7-3982-40c6-afeb-69d087d02fcb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.572905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e397b5d7-3982-40c6-afeb-69d087d02fcb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.573327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e397b5d7-3982-40c6-afeb-69d087d02fcb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.588782 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3c4f5f27-1c5e-4919-ad8b-cf94550a0fb7 req-c346c1f4-cc7c-4c18-b75d-5f937337cb3c service nova] Creating event network-changed:08892328-92a2-491f-bdba-c4be5bc285d2 for instance eff3fc3b-c65f-417e-9978-1a7b1179de2d on n-h1-862964-4 Oct 29 03:00:19.595639 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3c4f5f27-1c5e-4919-ad8b-cf94550a0fb7 req-c346c1f4-cc7c-4c18-b75d-5f937337cb3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091870 Oct 29 03:00:19.596922 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1831/3562] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:19.605416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f2d124e7-bf68-47a3-9f89-9c7db1448720 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:19.606633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f2d124e7-bf68-47a3-9f89-9c7db1448720 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:19.614574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2d124e7-bf68-47a3-9f89-9c7db1448720 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.615311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2d124e7-bf68-47a3-9f89-9c7db1448720 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.615899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2d124e7-bf68-47a3-9f89-9c7db1448720 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.616727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2d124e7-bf68-47a3-9f89-9c7db1448720 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.617717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2d124e7-bf68-47a3-9f89-9c7db1448720 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.618729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2d124e7-bf68-47a3-9f89-9c7db1448720 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.935755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f2d124e7-bf68-47a3-9f89-9c7db1448720 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:19.948257 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f2d124e7-bf68-47a3-9f89-9c7db1448720 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1393 microversion: 2.1 time: 0.349766 Oct 29 03:00:19.950478 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1832/3563] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:19 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1393 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:19.966819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb85ab76-b4e4-4a7b-bb7a-15220016eb03 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:19.967739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eb85ab76-b4e4-4a7b-bb7a-15220016eb03 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:20.102965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eb85ab76-b4e4-4a7b-bb7a-15220016eb03 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:20.120419 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eb85ab76-b4e4-4a7b-bb7a-15220016eb03 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1215 microversion: 2.1 time: 0.165574 Oct 29 03:00:20.121322 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1833/3564] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:19 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:20.248593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e397b5d7-3982-40c6-afeb-69d087d02fcb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:20.273641 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e397b5d7-3982-40c6-afeb-69d087d02fcb tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1318 microversion: 2.1 time: 0.741341 Oct 29 03:00:20.291607 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1732/3565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:19 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1318 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:20.551901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a2ae5215-2ffe-4b5f-be33-4e5a1f3b2380 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:20.552763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a2ae5215-2ffe-4b5f-be33-4e5a1f3b2380 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:20.571895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2ae5215-2ffe-4b5f-be33-4e5a1f3b2380 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:20.572400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2ae5215-2ffe-4b5f-be33-4e5a1f3b2380 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:20.574066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2ae5215-2ffe-4b5f-be33-4e5a1f3b2380 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:20.574802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2ae5215-2ffe-4b5f-be33-4e5a1f3b2380 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:20.575302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2ae5215-2ffe-4b5f-be33-4e5a1f3b2380 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:20.575673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2ae5215-2ffe-4b5f-be33-4e5a1f3b2380 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:20.976585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-96232c68-5219-46c4-a37f-fb4671b428e8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:20.977423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-96232c68-5219-46c4-a37f-fb4671b428e8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:21.001379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96232c68-5219-46c4-a37f-fb4671b428e8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.002683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96232c68-5219-46c4-a37f-fb4671b428e8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.003373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96232c68-5219-46c4-a37f-fb4671b428e8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.004334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96232c68-5219-46c4-a37f-fb4671b428e8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.005075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96232c68-5219-46c4-a37f-fb4671b428e8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.005893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96232c68-5219-46c4-a37f-fb4671b428e8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.013239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a2ae5215-2ffe-4b5f-be33-4e5a1f3b2380 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:21.022333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:21.027240 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a2ae5215-2ffe-4b5f-be33-4e5a1f3b2380 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1321 microversion: 2.1 time: 0.480282 Oct 29 03:00:21.027875 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1834/3566] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:20 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:21.061282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18c37a35-8de2-4555-b0fd-b3595d8a1fdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:21.066570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18c37a35-8de2-4555-b0fd-b3595d8a1fdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:21.084407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18c37a35-8de2-4555-b0fd-b3595d8a1fdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.087749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18c37a35-8de2-4555-b0fd-b3595d8a1fdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.088446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18c37a35-8de2-4555-b0fd-b3595d8a1fdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.089573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18c37a35-8de2-4555-b0fd-b3595d8a1fdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.091561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18c37a35-8de2-4555-b0fd-b3595d8a1fdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.092219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18c37a35-8de2-4555-b0fd-b3595d8a1fdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.157346 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18c37a35-8de2-4555-b0fd-b3595d8a1fdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/ips" status: 200 len: 151 microversion: 2.20 time: 0.101914 Oct 29 03:00:21.168020 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1835/3567] 10.222.0.16 () {60 vars in 1289 bytes} [Sat Oct 29 03:00:21 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/ips => generated 151 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:00:21.180197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-712f3cdd-1687-472a-899f-1ddc2af01864 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:21.187711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-712f3cdd-1687-472a-899f-1ddc2af01864 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:21.213178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712f3cdd-1687-472a-899f-1ddc2af01864 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.213564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712f3cdd-1687-472a-899f-1ddc2af01864 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.214093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712f3cdd-1687-472a-899f-1ddc2af01864 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.214895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712f3cdd-1687-472a-899f-1ddc2af01864 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.215476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712f3cdd-1687-472a-899f-1ddc2af01864 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.215871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712f3cdd-1687-472a-899f-1ddc2af01864 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.374361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-96232c68-5219-46c4-a37f-fb4671b428e8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:21.385428 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-96232c68-5219-46c4-a37f-fb4671b428e8 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1393 microversion: 2.1 time: 0.413623 Oct 29 03:00:21.386799 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1733/3568] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:20 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1393 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:21.393005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-53f77aeb-d6ca-492a-9c91-ac0dac3a3ac7 req-61821d12-2688-4270-903d-19628016b49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307ea4d3-0a4b-4e45-8e60-166f6f2f34b9", "name": "network-vif-plugged", "status": "completed", "tag": "e77f2ab9-9058-4555-808a-abd1a7d3096f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:21.411307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-53f77aeb-d6ca-492a-9c91-ac0dac3a3ac7 req-61821d12-2688-4270-903d-19628016b49e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.412754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-53f77aeb-d6ca-492a-9c91-ac0dac3a3ac7 req-61821d12-2688-4270-903d-19628016b49e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.413453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-53f77aeb-d6ca-492a-9c91-ac0dac3a3ac7 req-61821d12-2688-4270-903d-19628016b49e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.430666 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-53f77aeb-d6ca-492a-9c91-ac0dac3a3ac7 req-61821d12-2688-4270-903d-19628016b49e service nova] Creating event network-vif-plugged:e77f2ab9-9058-4555-808a-abd1a7d3096f for instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 on n-h1-862964-4 Oct 29 03:00:21.438345 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-53f77aeb-d6ca-492a-9c91-ac0dac3a3ac7 req-61821d12-2688-4270-903d-19628016b49e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049706 Oct 29 03:00:21.439923 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1734/3569] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:21.448168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a6228cd6-93d8-4212-afaa-3de2eced2cf1 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:21.450101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a6228cd6-93d8-4212-afaa-3de2eced2cf1 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:21.457644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6228cd6-93d8-4212-afaa-3de2eced2cf1 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.459040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6228cd6-93d8-4212-afaa-3de2eced2cf1 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.460148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6228cd6-93d8-4212-afaa-3de2eced2cf1 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.461367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6228cd6-93d8-4212-afaa-3de2eced2cf1 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.462086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6228cd6-93d8-4212-afaa-3de2eced2cf1 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.462616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6228cd6-93d8-4212-afaa-3de2eced2cf1 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.464553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-712f3cdd-1687-472a-899f-1ddc2af01864 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:21.479522 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-712f3cdd-1687-472a-899f-1ddc2af01864 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1267 microversion: 2.1 time: 0.308973 Oct 29 03:00:21.480812 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1836/3570] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:21 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1267 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:21.885219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6228cd6-93d8-4212-afaa-3de2eced2cf1 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:21.898684 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a6228cd6-93d8-4212-afaa-3de2eced2cf1 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1508 microversion: 2.1 time: 0.457240 Oct 29 03:00:21.903505 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1735/3571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:21 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1508 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:21.938124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bcdd0fe2-f832-442f-88ae-ed99641de4e7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:21.940700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bcdd0fe2-f832-442f-88ae-ed99641de4e7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:21.955343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:21.972867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcdd0fe2-f832-442f-88ae-ed99641de4e7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.978045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcdd0fe2-f832-442f-88ae-ed99641de4e7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.978879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcdd0fe2-f832-442f-88ae-ed99641de4e7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.979650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcdd0fe2-f832-442f-88ae-ed99641de4e7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.980116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcdd0fe2-f832-442f-88ae-ed99641de4e7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.982725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcdd0fe2-f832-442f-88ae-ed99641de4e7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.055883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7184673d-6e0c-4205-b4e0-e850e470adc9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:22.056844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7184673d-6e0c-4205-b4e0-e850e470adc9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:22.125038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7184673d-6e0c-4205-b4e0-e850e470adc9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.126049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7184673d-6e0c-4205-b4e0-e850e470adc9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.127823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7184673d-6e0c-4205-b4e0-e850e470adc9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.130103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7184673d-6e0c-4205-b4e0-e850e470adc9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.134272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7184673d-6e0c-4205-b4e0-e850e470adc9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.135106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7184673d-6e0c-4205-b4e0-e850e470adc9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.363936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bcdd0fe2-f832-442f-88ae-ed99641de4e7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:22.375573 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bcdd0fe2-f832-442f-88ae-ed99641de4e7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1508 microversion: 2.1 time: 0.442733 Oct 29 03:00:22.377888 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1837/3572] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:21 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1508 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:22.401562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dd52bc60-6885-4aef-99a1-a32e4bac3894 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:22.404355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dd52bc60-6885-4aef-99a1-a32e4bac3894 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:22.416391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd52bc60-6885-4aef-99a1-a32e4bac3894 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.419004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd52bc60-6885-4aef-99a1-a32e4bac3894 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.419541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd52bc60-6885-4aef-99a1-a32e4bac3894 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.426955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd52bc60-6885-4aef-99a1-a32e4bac3894 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.427698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd52bc60-6885-4aef-99a1-a32e4bac3894 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.428231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd52bc60-6885-4aef-99a1-a32e4bac3894 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.522318 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dd52bc60-6885-4aef-99a1-a32e4bac3894 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "PUT /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1080 microversion: 2.1 time: 0.125860 Oct 29 03:00:22.526680 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1838/3573] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 03:00:22 2022] PUT /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1080 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:22.536401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7184673d-6e0c-4205-b4e0-e850e470adc9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:22.539473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-60d8b0e6-ae8b-4f2e-943c-0ccf7c607c92 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:22.542940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-60d8b0e6-ae8b-4f2e-943c-0ccf7c607c92 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:22.560203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60d8b0e6-ae8b-4f2e-943c-0ccf7c607c92 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.560704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60d8b0e6-ae8b-4f2e-943c-0ccf7c607c92 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.561143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60d8b0e6-ae8b-4f2e-943c-0ccf7c607c92 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.561885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60d8b0e6-ae8b-4f2e-943c-0ccf7c607c92 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.562336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60d8b0e6-ae8b-4f2e-943c-0ccf7c607c92 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.562961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60d8b0e6-ae8b-4f2e-943c-0ccf7c607c92 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.584369 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7184673d-6e0c-4205-b4e0-e850e470adc9 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1321 microversion: 2.1 time: 0.533462 Oct 29 03:00:22.587839 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1736/3574] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:22 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1321 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:22.596484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3cbd254-39ad-4613-b7b0-b45073e69390 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:22.597090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d3cbd254-39ad-4613-b7b0-b45073e69390 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:22.612513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3cbd254-39ad-4613-b7b0-b45073e69390 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.613022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3cbd254-39ad-4613-b7b0-b45073e69390 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.613538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3cbd254-39ad-4613-b7b0-b45073e69390 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.614248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3cbd254-39ad-4613-b7b0-b45073e69390 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.614693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3cbd254-39ad-4613-b7b0-b45073e69390 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.615357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3cbd254-39ad-4613-b7b0-b45073e69390 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.807046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d3cbd254-39ad-4613-b7b0-b45073e69390 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:22.817458 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3cbd254-39ad-4613-b7b0-b45073e69390 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1273 microversion: 2.1 time: 0.228510 Oct 29 03:00:22.836346 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1737/3575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:22 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1273 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:22.848024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-93f710ac-840d-47d1-82b4-d8f2fdfa51ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:22.850246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-93f710ac-840d-47d1-82b4-d8f2fdfa51ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:22.894647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93f710ac-840d-47d1-82b4-d8f2fdfa51ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.895155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93f710ac-840d-47d1-82b4-d8f2fdfa51ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.895595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93f710ac-840d-47d1-82b4-d8f2fdfa51ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.903843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93f710ac-840d-47d1-82b4-d8f2fdfa51ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.904335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93f710ac-840d-47d1-82b4-d8f2fdfa51ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.904773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93f710ac-840d-47d1-82b4-d8f2fdfa51ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.367561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-93f710ac-840d-47d1-82b4-d8f2fdfa51ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:23.381717 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-93f710ac-840d-47d1-82b4-d8f2fdfa51ce tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1506 microversion: 2.1 time: 0.544139 Oct 29 03:00:23.386641 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1738/3576] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:22 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:23.416920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b9bc74e-74a2-486f-a828-4eef0a5cb319 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:23.417747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b9bc74e-74a2-486f-a828-4eef0a5cb319 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:23.449765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9bc74e-74a2-486f-a828-4eef0a5cb319 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.450548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9bc74e-74a2-486f-a828-4eef0a5cb319 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.458443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9bc74e-74a2-486f-a828-4eef0a5cb319 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.460169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9bc74e-74a2-486f-a828-4eef0a5cb319 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.461177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9bc74e-74a2-486f-a828-4eef0a5cb319 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.461835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b9bc74e-74a2-486f-a828-4eef0a5cb319 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.479812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-60d8b0e6-ae8b-4f2e-943c-0ccf7c607c92 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:23.502001 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-60d8b0e6-ae8b-4f2e-943c-0ccf7c607c92 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1393 microversion: 2.1 time: 0.972055 Oct 29 03:00:23.504659 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1839/3577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:22 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1393 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:23.518642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3cf8d2ef-2167-47d7-9dd5-d5ccfb58a9e7 req-16a95184-7099-4c66-9bee-599231d93f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff3fc3b-c65f-417e-9978-1a7b1179de2d", "name": "network-vif-plugged", "status": "completed", "tag": "08892328-92a2-491f-bdba-c4be5bc285d2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:23.544527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3cf8d2ef-2167-47d7-9dd5-d5ccfb58a9e7 req-16a95184-7099-4c66-9bee-599231d93f10 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.545016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3cf8d2ef-2167-47d7-9dd5-d5ccfb58a9e7 req-16a95184-7099-4c66-9bee-599231d93f10 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.545441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3cf8d2ef-2167-47d7-9dd5-d5ccfb58a9e7 req-16a95184-7099-4c66-9bee-599231d93f10 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.587779 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3cf8d2ef-2167-47d7-9dd5-d5ccfb58a9e7 req-16a95184-7099-4c66-9bee-599231d93f10 service nova] Creating event network-vif-plugged:08892328-92a2-491f-bdba-c4be5bc285d2 for instance eff3fc3b-c65f-417e-9978-1a7b1179de2d on n-h1-862964-4 Oct 29 03:00:23.598411 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3cf8d2ef-2167-47d7-9dd5-d5ccfb58a9e7 req-16a95184-7099-4c66-9bee-599231d93f10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092323 Oct 29 03:00:23.604705 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1840/3578] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:23.615860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2d0c34f0-5c40-4b6d-99a8-d424f18eff83 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:23.620950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2d0c34f0-5c40-4b6d-99a8-d424f18eff83 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:23.652155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d0c34f0-5c40-4b6d-99a8-d424f18eff83 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.657477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d0c34f0-5c40-4b6d-99a8-d424f18eff83 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.658701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d0c34f0-5c40-4b6d-99a8-d424f18eff83 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.661088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d0c34f0-5c40-4b6d-99a8-d424f18eff83 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.663304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d0c34f0-5c40-4b6d-99a8-d424f18eff83 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.665888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d0c34f0-5c40-4b6d-99a8-d424f18eff83 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.743254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9b9bc74e-74a2-486f-a828-4eef0a5cb319 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:23.753122 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b9bc74e-74a2-486f-a828-4eef0a5cb319 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1506 microversion: 2.1 time: 0.345195 Oct 29 03:00:23.770528 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1739/3579] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:23 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:23.783932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:23.795740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:23.808838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.811383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.812592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.814814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.818264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.819537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.009597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:00:24.011033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:00:24.014507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:00:24.015311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:00:24.016448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:00:24.164972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:24.177931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.180649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.181005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.181740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.186266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.186975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.282475 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-78047a7e-4468-4b88-9746-96017cb316b7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "POST /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e/action" status: 202 len: 1112 microversion: 2.1 time: 0.503538 Oct 29 03:00:24.289353 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1740/3580] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:23 2022] POST /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e/action => generated 1112 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 03:00:24.300219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-441a1d6c-c4f8-4dfc-82e0-31cdfe19a0c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:24.301233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-441a1d6c-c4f8-4dfc-82e0-31cdfe19a0c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:24.309706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a1d6c-c4f8-4dfc-82e0-31cdfe19a0c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.310512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a1d6c-c4f8-4dfc-82e0-31cdfe19a0c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.311210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a1d6c-c4f8-4dfc-82e0-31cdfe19a0c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.312277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a1d6c-c4f8-4dfc-82e0-31cdfe19a0c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.313018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a1d6c-c4f8-4dfc-82e0-31cdfe19a0c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.313912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-441a1d6c-c4f8-4dfc-82e0-31cdfe19a0c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.426368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2d0c34f0-5c40-4b6d-99a8-d424f18eff83 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:24.448946 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2d0c34f0-5c40-4b6d-99a8-d424f18eff83 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1471 microversion: 2.1 time: 0.842630 Oct 29 03:00:24.449568 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1841/3581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:23 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1471 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:24.458330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3abc7405-b76f-4978-bec8-6d7bed27cea4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:24.458996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3abc7405-b76f-4978-bec8-6d7bed27cea4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:24.466080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3abc7405-b76f-4978-bec8-6d7bed27cea4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.468295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3abc7405-b76f-4978-bec8-6d7bed27cea4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.475915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3abc7405-b76f-4978-bec8-6d7bed27cea4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.477965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3abc7405-b76f-4978-bec8-6d7bed27cea4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.478453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3abc7405-b76f-4978-bec8-6d7bed27cea4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.478919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3abc7405-b76f-4978-bec8-6d7bed27cea4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.538229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-441a1d6c-c4f8-4dfc-82e0-31cdfe19a0c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:24.554124 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-441a1d6c-c4f8-4dfc-82e0-31cdfe19a0c4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1315 microversion: 2.1 time: 0.258420 Oct 29 03:00:24.555116 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1741/3582] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:24 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:24.562872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-645db2f4-7684-4984-99f3-0b10d46adbec tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:24.565938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-645db2f4-7684-4984-99f3-0b10d46adbec tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:24.579220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-645db2f4-7684-4984-99f3-0b10d46adbec tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.580336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-645db2f4-7684-4984-99f3-0b10d46adbec tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.581148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-645db2f4-7684-4984-99f3-0b10d46adbec tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.584297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-645db2f4-7684-4984-99f3-0b10d46adbec tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.585179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-645db2f4-7684-4984-99f3-0b10d46adbec tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.586892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-645db2f4-7684-4984-99f3-0b10d46adbec tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.593352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:24.623015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-645db2f4-7684-4984-99f3-0b10d46adbec tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lazy-loading 'flavor' on Instance uuid 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:24.713708 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-645db2f4-7684-4984-99f3-0b10d46adbec tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9/action" status: 202 len: 0 microversion: 2.1 time: 0.156374 Oct 29 03:00:24.715270 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1742/3583] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:24 2022] POST /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:00:24.724106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-835edc2b-e811-4cc2-bb6b-013e8e1786d3 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:24.725376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-835edc2b-e811-4cc2-bb6b-013e8e1786d3 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:24.734751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-835edc2b-e811-4cc2-bb6b-013e8e1786d3 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.735696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-835edc2b-e811-4cc2-bb6b-013e8e1786d3 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.736476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-835edc2b-e811-4cc2-bb6b-013e8e1786d3 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.737677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-835edc2b-e811-4cc2-bb6b-013e8e1786d3 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.738738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-835edc2b-e811-4cc2-bb6b-013e8e1786d3 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.739636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-835edc2b-e811-4cc2-bb6b-013e8e1786d3 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.826538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3abc7405-b76f-4978-bec8-6d7bed27cea4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:24.841211 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3abc7405-b76f-4978-bec8-6d7bed27cea4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.390496 Oct 29 03:00:24.845586 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1842/3584] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:24 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:24.969371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-835edc2b-e811-4cc2-bb6b-013e8e1786d3 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:24.989595 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-835edc2b-e811-4cc2-bb6b-013e8e1786d3 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1393 microversion: 2.1 time: 0.269428 Oct 29 03:00:24.990300 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1743/3585] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:24 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1393 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:25.006452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-163e260e-895e-456c-8d9c-f3ef7303c77a tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:25.006863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-163e260e-895e-456c-8d9c-f3ef7303c77a tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:25.016027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e260e-895e-456c-8d9c-f3ef7303c77a tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.016513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e260e-895e-456c-8d9c-f3ef7303c77a tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.016943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e260e-895e-456c-8d9c-f3ef7303c77a tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.017643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e260e-895e-456c-8d9c-f3ef7303c77a tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.018124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e260e-895e-456c-8d9c-f3ef7303c77a tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.018542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-163e260e-895e-456c-8d9c-f3ef7303c77a tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.038362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1461416820", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": "none"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:25.121335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:00:25.122258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:00:25.123047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:00:25.123722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:00:25.124620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:00:25.142329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.143231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.144355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.145374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.146139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.146904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.169704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Getting quotas for project 870f44bf140f4b62828ffe0ce571f77f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:25.176850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Getting quotas for user 8ae01397259c42adbdf5dc6aa8ee1871 and project 870f44bf140f4b62828ffe0ce571f77f. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:25.233238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:00:25.238533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:00:25.343162 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5078cab1-97a6-4795-9b45-60896cff42cf tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.496042 Oct 29 03:00:25.345363 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1843/3586] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 03:00:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:00:25.355842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-de4ba717-d988-4fd8-a2b3-4580b05dc722 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:25.360055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-de4ba717-d988-4fd8-a2b3-4580b05dc722 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:25.612573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de4ba717-d988-4fd8-a2b3-4580b05dc722 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:25.635470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de4ba717-d988-4fd8-a2b3-4580b05dc722 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:25.674526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de4ba717-d988-4fd8-a2b3-4580b05dc722 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:25.677022 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-163e260e-895e-456c-8d9c-f3ef7303c77a tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1630 microversion: 2.1 time: 0.683542 Oct 29 03:00:25.680209 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1744/3587] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:24 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1630 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:25.681288 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-de4ba717-d988-4fd8-a2b3-4580b05dc722 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 200 len: 1281 microversion: 2.47 time: 0.329381 Oct 29 03:00:25.681911 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1844/3588] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:25 2022] GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 1281 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:00:25.713514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-10b9330e-4f48-4e46-b0e9-7241746e7c19 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:25.714442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-10b9330e-4f48-4e46-b0e9-7241746e7c19 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:25.744350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10b9330e-4f48-4e46-b0e9-7241746e7c19 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.747762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10b9330e-4f48-4e46-b0e9-7241746e7c19 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.748416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10b9330e-4f48-4e46-b0e9-7241746e7c19 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.749377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10b9330e-4f48-4e46-b0e9-7241746e7c19 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.762227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10b9330e-4f48-4e46-b0e9-7241746e7c19 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.762796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10b9330e-4f48-4e46-b0e9-7241746e7c19 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.873402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9f33314c-6341-46c9-b61f-9998775fabfa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:25.874903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9f33314c-6341-46c9-b61f-9998775fabfa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:25.892863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f33314c-6341-46c9-b61f-9998775fabfa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.893395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f33314c-6341-46c9-b61f-9998775fabfa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.893965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f33314c-6341-46c9-b61f-9998775fabfa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.897605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f33314c-6341-46c9-b61f-9998775fabfa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.899304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f33314c-6341-46c9-b61f-9998775fabfa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.899859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f33314c-6341-46c9-b61f-9998775fabfa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.064839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-10b9330e-4f48-4e46-b0e9-7241746e7c19 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.082718 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-10b9330e-4f48-4e46-b0e9-7241746e7c19 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1315 microversion: 2.1 time: 0.399311 Oct 29 03:00:26.085625 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1745/3589] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:25 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:26.106471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7753680d-bb1b-4bd8-a417-30c64dc717c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:26.107002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7753680d-bb1b-4bd8-a417-30c64dc717c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:26.122007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7753680d-bb1b-4bd8-a417-30c64dc717c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.122839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7753680d-bb1b-4bd8-a417-30c64dc717c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.123463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7753680d-bb1b-4bd8-a417-30c64dc717c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.124337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7753680d-bb1b-4bd8-a417-30c64dc717c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.130609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7753680d-bb1b-4bd8-a417-30c64dc717c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.131096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7753680d-bb1b-4bd8-a417-30c64dc717c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.191492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-7753680d-bb1b-4bd8-a417-30c64dc717c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lazy-loading 'flavor' on Instance uuid 31241403-2a17-4f40-818d-fc8caca85e4b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:26.295087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9f33314c-6341-46c9-b61f-9998775fabfa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.311893 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9f33314c-6341-46c9-b61f-9998775fabfa tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.446666 Oct 29 03:00:26.315676 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1845/3590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:25 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:26.329962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e1c48074-3fc3-4e4a-8570-84adf14e2024 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:26.330922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e1c48074-3fc3-4e4a-8570-84adf14e2024 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:26.347424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1c48074-3fc3-4e4a-8570-84adf14e2024 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.348247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1c48074-3fc3-4e4a-8570-84adf14e2024 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.348909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1c48074-3fc3-4e4a-8570-84adf14e2024 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.355823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1c48074-3fc3-4e4a-8570-84adf14e2024 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.356567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1c48074-3fc3-4e4a-8570-84adf14e2024 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.357003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1c48074-3fc3-4e4a-8570-84adf14e2024 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.485514 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7753680d-bb1b-4bd8-a417-30c64dc717c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "POST /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/action" status: 202 len: 0 microversion: 2.20 time: 0.396207 Oct 29 03:00:26.486342 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1746/3591] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 03:00:26 2022] POST /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:00:26.493138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-eaa7552d-528c-43c4-93da-7d16195730ca req-11b80c55-4c0d-40ff-9c5e-37c286abf0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a", "tag": "e4625ea7-a638-4eb4-80bf-1b9a17436058"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:26.532328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-eaa7552d-528c-43c4-93da-7d16195730ca req-11b80c55-4c0d-40ff-9c5e-37c286abf0d1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.533166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-eaa7552d-528c-43c4-93da-7d16195730ca req-11b80c55-4c0d-40ff-9c5e-37c286abf0d1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.533865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-eaa7552d-528c-43c4-93da-7d16195730ca req-11b80c55-4c0d-40ff-9c5e-37c286abf0d1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.550248 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-eaa7552d-528c-43c4-93da-7d16195730ca req-11b80c55-4c0d-40ff-9c5e-37c286abf0d1 service nova] Creating event network-changed:e4625ea7-a638-4eb4-80bf-1b9a17436058 for instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a on n-h2-862964-4 Oct 29 03:00:26.560987 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-eaa7552d-528c-43c4-93da-7d16195730ca req-11b80c55-4c0d-40ff-9c5e-37c286abf0d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072434 Oct 29 03:00:26.564167 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1747/3592] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:26.576797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:26.579460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:26.590504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.591245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.591808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.592617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.593303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.595145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.757267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.771727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.773933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.775463 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20133df5-337b-4598-a657-afc1eabbcbd7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1721 microversion: 2.20 time: 0.209002 Oct 29 03:00:26.786239 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1748/3593] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:26 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:26.791492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76f9e245-9760-4b88-8896-010359004524 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:26.792356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-76f9e245-9760-4b88-8896-010359004524 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:26.798919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f9e245-9760-4b88-8896-010359004524 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.799639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f9e245-9760-4b88-8896-010359004524 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.800316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f9e245-9760-4b88-8896-010359004524 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.801275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f9e245-9760-4b88-8896-010359004524 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.802080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f9e245-9760-4b88-8896-010359004524 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.802877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f9e245-9760-4b88-8896-010359004524 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.913712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e1c48074-3fc3-4e4a-8570-84adf14e2024 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.923876 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e1c48074-3fc3-4e4a-8570-84adf14e2024 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1574 microversion: 2.1 time: 0.605980 Oct 29 03:00:26.924424 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1846/3594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:26 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1574 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:26.947004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:26.952662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:26.966173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.967894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.969353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.972026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.972407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.973969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.019690 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-76f9e245-9760-4b88-8896-010359004524 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1613 microversion: 2.1 time: 0.231990 Oct 29 03:00:27.023068 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1749/3595] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:26 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1613 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:27.032636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7c6a2b21-28bd-4bf5-a7d4-2cd84b2ab601 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:27.033352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7c6a2b21-28bd-4bf5-a7d4-2cd84b2ab601 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:27.041901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c6a2b21-28bd-4bf5-a7d4-2cd84b2ab601 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.043761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c6a2b21-28bd-4bf5-a7d4-2cd84b2ab601 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.044623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c6a2b21-28bd-4bf5-a7d4-2cd84b2ab601 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.045762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c6a2b21-28bd-4bf5-a7d4-2cd84b2ab601 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.046592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c6a2b21-28bd-4bf5-a7d4-2cd84b2ab601 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.047741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c6a2b21-28bd-4bf5-a7d4-2cd84b2ab601 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.130324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:27.149363 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7c6a2b21-28bd-4bf5-a7d4-2cd84b2ab601 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123187 Oct 29 03:00:27.152568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:27.154822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:27.156479 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-708fbc32-e2d4-4652-a0c1-b9ecab754b0a tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 200 len: 1333 microversion: 2.47 time: 0.230866 Oct 29 03:00:27.157889 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1750/3596] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:00:27 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:27.167037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:27.169167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:27.169872 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1847/3597] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:26 2022] GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 1333 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:27.197928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3890fe4a-c6f4-4e89-8344-ee01377fdbf1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:27.198851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3890fe4a-c6f4-4e89-8344-ee01377fdbf1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:27.205329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3890fe4a-c6f4-4e89-8344-ee01377fdbf1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.206065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3890fe4a-c6f4-4e89-8344-ee01377fdbf1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.206653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3890fe4a-c6f4-4e89-8344-ee01377fdbf1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.207502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3890fe4a-c6f4-4e89-8344-ee01377fdbf1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.208127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3890fe4a-c6f4-4e89-8344-ee01377fdbf1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.208807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3890fe4a-c6f4-4e89-8344-ee01377fdbf1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.210127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.216479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.217020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.217868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.218409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.218892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.392996 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] HTTP exception thrown: Cannot 'migrate' instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 while it is in vm_state suspended Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Request method failure captured: Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9/action HTTP/1.1 Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 15 Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJcYwmOSHPGa1kBMpXU9BKN8790NHJTmndBvH6dJ-kZ04djuWMTRNwgYv7j06XgZFhp90kPlKRG2ivI6UGaiOgfXuSQx2XM6YlrB4Tv2AKplcrPPxiNCUBkXVK64DMhZGX4t3Cz6qxXwziaR3EIZgXmPErdG5lu2szyeDJ9XNnvLMSM Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 97cd5cd1287c4e5182d6485358b33d24 Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/97cd5cd1287c4e5182d6485358b33d24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97cd5cd1287c4e5182d6485358b33d24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_97cd5cd1287c4e5182d6485358b33d24", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97cd5cd1287c4e5182d6485358b33d24"}]}] Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 97cd5cd1287c4e5182d6485358b33d24 Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersAdminNegativeTestJSON-200255818-project-admin Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 985a3b7f43be4a66b55b1375fcc47b94 Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersAdminNegativeTestJSON-200255818-project-admin Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: {"migrate": {}} Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: exception: Cannot 'migrate' instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 while it is in vm_state suspended Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '307ea4d3-0a4b-4e45-8e60-166f6f2f34b9', 'body': {'migrate': {}}} Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 in vm_state suspended. Cannot resize while the instance is in this state. Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:27.395139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 while it is in vm_state suspended Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 while it is in vm_state suspended Oct 29 03:00:27.402100 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.405936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Returning 409 to user: Cannot 'migrate' instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 while it is in vm_state suspended {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:27.407096 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-82f76c63-7b17-4ff6-8866-2eb7492832fe tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9/action" status: 409 len: 148 microversion: 2.1 time: 0.247739 Oct 29 03:00:27.408458 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1751/3598] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:27 2022] POST /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9/action => generated 148 bytes in 250 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:00:27.421666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6d64316-d0ff-482d-aa22-472bdc606960 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:27.422719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b6d64316-d0ff-482d-aa22-472bdc606960 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:27.432365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d64316-d0ff-482d-aa22-472bdc606960 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.433172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d64316-d0ff-482d-aa22-472bdc606960 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.433783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d64316-d0ff-482d-aa22-472bdc606960 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.434851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d64316-d0ff-482d-aa22-472bdc606960 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.435458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d64316-d0ff-482d-aa22-472bdc606960 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.436033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d64316-d0ff-482d-aa22-472bdc606960 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.561596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3890fe4a-c6f4-4e89-8344-ee01377fdbf1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:27.572608 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3890fe4a-c6f4-4e89-8344-ee01377fdbf1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1315 microversion: 2.1 time: 0.379786 Oct 29 03:00:27.576033 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1848/3599] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:27 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:27.585234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-982e48bf-122f-45e5-9ac0-3df8cbdab229 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-982e48bf-122f-45e5-9ac0-3df8cbdab229 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Request method failure captured: Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b/action HTTP/1.1 Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 39 Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJcYwmOSHPGa1kBMpXU9BKN8790NHJTmndBvH6dJ-kZ04djuWMTRNwgYv7j06XgZFhp90kPlKRG2ivI6UGaiOgfXuSQx2XM6YlrB4Tv2AKplcrPPxiNCUBkXVK64DMhZGX4t3Cz6qxXwziaR3EIZgXmPErdG5lu2szyeDJ9XNnvLMSM Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 97cd5cd1287c4e5182d6485358b33d24 Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/97cd5cd1287c4e5182d6485358b33d24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97cd5cd1287c4e5182d6485358b33d24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_97cd5cd1287c4e5182d6485358b33d24", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97cd5cd1287c4e5182d6485358b33d24"}]}] Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 97cd5cd1287c4e5182d6485358b33d24 Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersAdminNegativeTestJSON-200255818-project-admin Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 985a3b7f43be4a66b55b1375fcc47b94 Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersAdminNegativeTestJSON-200255818-project-admin Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: {"os-resetState": {"state": "invalid"}} Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '586d2052-3b4d-4539-9947-189e93c1dd8b', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:00:27.597680 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-982e48bf-122f-45e5-9ac0-3df8cbdab229 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:27.605210 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-982e48bf-122f-45e5-9ac0-3df8cbdab229 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b/action" status: 400 len: 144 microversion: 2.1 time: 0.025316 Oct 29 03:00:27.612102 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1849/3600] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:27 2022] POST /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b/action => generated 144 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:00:27.617142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2149dc8d-41e1-43f1-af7f-053874bb0cf9 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2149dc8d-41e1-43f1-af7f-053874bb0cf9 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Request method failure captured: Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b/action HTTP/1.1 Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 31 Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJcYwmOSHPGa1kBMpXU9BKN8790NHJTmndBvH6dJ-kZ04djuWMTRNwgYv7j06XgZFhp90kPlKRG2ivI6UGaiOgfXuSQx2XM6YlrB4Tv2AKplcrPPxiNCUBkXVK64DMhZGX4t3Cz6qxXwziaR3EIZgXmPErdG5lu2szyeDJ9XNnvLMSM Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 97cd5cd1287c4e5182d6485358b33d24 Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/97cd5cd1287c4e5182d6485358b33d24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97cd5cd1287c4e5182d6485358b33d24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_97cd5cd1287c4e5182d6485358b33d24", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97cd5cd1287c4e5182d6485358b33d24"}]}] Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 97cd5cd1287c4e5182d6485358b33d24 Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersAdminNegativeTestJSON-200255818-project-admin Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 985a3b7f43be4a66b55b1375fcc47b94 Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersAdminNegativeTestJSON-200255818-project-admin Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: {"os-resetState": {"state": 1}} Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '586d2052-3b4d-4539-9947-189e93c1dd8b', 'body': {'os-resetState': {'state': 1}}} Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 1 Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 03:00:27.643694 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.649638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:27.649638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.649638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.649638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:27.649638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:27.649638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:00:27.649638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:00:27.649638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 03:00:27.649638 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.649638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2149dc8d-41e1-43f1-af7f-053874bb0cf9 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:27.649638 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2149dc8d-41e1-43f1-af7f-053874bb0cf9 tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b/action" status: 400 len: 120 microversion: 2.1 time: 0.033416 Oct 29 03:00:27.650840 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1850/3601] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:27 2022] POST /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b/action => generated 120 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:00:27.664767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8cbba689-5214-4e5e-a2a1-65bbf106646c tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:27.672840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8cbba689-5214-4e5e-a2a1-65bbf106646c tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Failed to fetch instance by id 999 {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 03:00:27.673744 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-8cbba689-5214-4e5e-a2a1-65bbf106646c tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8cbba689-5214-4e5e-a2a1-65bbf106646c tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Request method failure captured: Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 37 Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJcYwmOSHPGa1kBMpXU9BKN8790NHJTmndBvH6dJ-kZ04djuWMTRNwgYv7j06XgZFhp90kPlKRG2ivI6UGaiOgfXuSQx2XM6YlrB4Tv2AKplcrPPxiNCUBkXVK64DMhZGX4t3Cz6qxXwziaR3EIZgXmPErdG5lu2szyeDJ9XNnvLMSM Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 97cd5cd1287c4e5182d6485358b33d24 Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/97cd5cd1287c4e5182d6485358b33d24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97cd5cd1287c4e5182d6485358b33d24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_97cd5cd1287c4e5182d6485358b33d24", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97cd5cd1287c4e5182d6485358b33d24"}]}] Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 97cd5cd1287c4e5182d6485358b33d24 Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-200255818 Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersAdminNegativeTestJSON-200255818-project-admin Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 985a3b7f43be4a66b55b1375fcc47b94 Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersAdminNegativeTestJSON-200255818-project-admin Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: {"os-resetState": {"state": "error"}} Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 999 could not be found. Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:27.683243 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:27.687843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:27.687843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 29 03:00:27.687843 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:27.689552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8cbba689-5214-4e5e-a2a1-65bbf106646c tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:27.690749 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8cbba689-5214-4e5e-a2a1-65bbf106646c tempest-ServersAdminNegativeTestJSON-200255818 tempest-ServersAdminNegativeTestJSON-200255818-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.031559 Oct 29 03:00:27.691890 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1851/3602] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Oct 29 03:00:27 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:00:27.701978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d1ac3acc-d0de-4c9d-9909-247a2f79d17c tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:27.702744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d1ac3acc-d0de-4c9d-9909-247a2f79d17c tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:27.712650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1ac3acc-d0de-4c9d-9909-247a2f79d17c tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.713400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1ac3acc-d0de-4c9d-9909-247a2f79d17c tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.715785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1ac3acc-d0de-4c9d-9909-247a2f79d17c tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.716690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1ac3acc-d0de-4c9d-9909-247a2f79d17c tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.718229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1ac3acc-d0de-4c9d-9909-247a2f79d17c tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.718833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1ac3acc-d0de-4c9d-9909-247a2f79d17c tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.743222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b6d64316-d0ff-482d-aa22-472bdc606960 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:27.754782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d1ac3acc-d0de-4c9d-9909-247a2f79d17c tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:00:27.756928 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6d64316-d0ff-482d-aa22-472bdc606960 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.347167 Oct 29 03:00:27.770481 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1752/3603] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:27 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:27.820156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:27.821260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:27.828272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.829180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.829783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.830727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.831644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.832239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.865839 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d1ac3acc-d0de-4c9d-9909-247a2f79d17c tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "DELETE /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 204 len: 0 microversion: 2.1 time: 0.166785 Oct 29 03:00:27.868675 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1852/3604] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:27 2022] DELETE /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:00:27.879805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-932debac-97d8-4c09-96a1-791e49a66352 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:27.880557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-932debac-97d8-4c09-96a1-791e49a66352 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:27.887151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932debac-97d8-4c09-96a1-791e49a66352 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.887642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932debac-97d8-4c09-96a1-791e49a66352 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.888093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932debac-97d8-4c09-96a1-791e49a66352 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.888787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932debac-97d8-4c09-96a1-791e49a66352 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.889429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932debac-97d8-4c09-96a1-791e49a66352 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.890058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932debac-97d8-4c09-96a1-791e49a66352 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.047740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:28.057676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:28.059260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:28.060749 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ab323564-25b0-4b45-aa59-cc22ddf866cc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1721 microversion: 2.20 time: 0.244719 Oct 29 03:00:28.075214 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1753/3605] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:27 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:28.137545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-932debac-97d8-4c09-96a1-791e49a66352 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:28.151234 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-932debac-97d8-4c09-96a1-791e49a66352 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1468 microversion: 2.1 time: 0.277848 Oct 29 03:00:28.152061 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1853/3606] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:27 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1468 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:28.200304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:28.201974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:28.212752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.213632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.214315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.215261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.215930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.216586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.303632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:28.313024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:28.314815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:28.316118 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6c19a41b-32bc-4c02-8a47-696e2537806f tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 200 len: 1339 microversion: 2.47 time: 0.121800 Oct 29 03:00:28.331785 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1754/3607] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:28 2022] GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 1339 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:00:28.600211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-098c89d6-ef34-4eca-9daf-0e25deb6ed5f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:28.600818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-098c89d6-ef34-4eca-9daf-0e25deb6ed5f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:28.609344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-098c89d6-ef34-4eca-9daf-0e25deb6ed5f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.609860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-098c89d6-ef34-4eca-9daf-0e25deb6ed5f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.610624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-098c89d6-ef34-4eca-9daf-0e25deb6ed5f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.611587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-098c89d6-ef34-4eca-9daf-0e25deb6ed5f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.612377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-098c89d6-ef34-4eca-9daf-0e25deb6ed5f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.612959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-098c89d6-ef34-4eca-9daf-0e25deb6ed5f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.792833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1e868bf7-34b1-4916-989c-add55290ab55 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:28.793474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1e868bf7-34b1-4916-989c-add55290ab55 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:28.824430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e868bf7-34b1-4916-989c-add55290ab55 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.826218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e868bf7-34b1-4916-989c-add55290ab55 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.826682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e868bf7-34b1-4916-989c-add55290ab55 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.827418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e868bf7-34b1-4916-989c-add55290ab55 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.827869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e868bf7-34b1-4916-989c-add55290ab55 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.828291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e868bf7-34b1-4916-989c-add55290ab55 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.218044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1e868bf7-34b1-4916-989c-add55290ab55 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.237992 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1e868bf7-34b1-4916-989c-add55290ab55 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.450610 Oct 29 03:00:29.264606 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1755/3608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:28 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:29.271549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:29.283567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:29.310178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.310679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.311112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.311822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.312268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.312692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.336601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-098c89d6-ef34-4eca-9daf-0e25deb6ed5f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.340395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:29.355460 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-098c89d6-ef34-4eca-9daf-0e25deb6ed5f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1315 microversion: 2.1 time: 0.759816 Oct 29 03:00:29.359453 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1854/3609] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:28 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:29.377385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d21378bd-842f-47e6-8e05-7dd375ca96c8 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:29.378137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d21378bd-842f-47e6-8e05-7dd375ca96c8 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:29.385796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:29.408788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21378bd-842f-47e6-8e05-7dd375ca96c8 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.409694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21378bd-842f-47e6-8e05-7dd375ca96c8 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.410766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21378bd-842f-47e6-8e05-7dd375ca96c8 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.411787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21378bd-842f-47e6-8e05-7dd375ca96c8 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.412355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21378bd-842f-47e6-8e05-7dd375ca96c8 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.413000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21378bd-842f-47e6-8e05-7dd375ca96c8 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.612828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.622973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.626277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.627593 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-63aaaaa3-cb36-4c9e-8f64-bc443216194d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1721 microversion: 2.20 time: 0.362385 Oct 29 03:00:29.641908 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1756/3610] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:29 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1721 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:29.641908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:29.641908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:29.644611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.650063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.650063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.650063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.650063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.650063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.755757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.767024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.769237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.770825 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5fb88d96-3742-48b3-bf42-0171a48cbe51 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 200 len: 1339 microversion: 2.47 time: 0.140567 Oct 29 03:00:29.772181 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1757/3611] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:29 2022] GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 1339 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:29.857119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d21378bd-842f-47e6-8e05-7dd375ca96c8 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.869294 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d21378bd-842f-47e6-8e05-7dd375ca96c8 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1468 microversion: 2.1 time: 0.500843 Oct 29 03:00:29.879425 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1855/3612] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:29 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1468 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:30.011570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83affa1d-1422-4b25-905f-2fade44b2a96 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:30.012695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-83affa1d-1422-4b25-905f-2fade44b2a96 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:30.020285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83affa1d-1422-4b25-905f-2fade44b2a96 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.020561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-73ca7d3d-494f-401b-b9bc-5c2c9475c5da req-5c48c480-5139-488e-9f39-16808eeb5801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff3fc3b-c65f-417e-9978-1a7b1179de2d", "tag": "08892328-92a2-491f-bdba-c4be5bc285d2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:30.021716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83affa1d-1422-4b25-905f-2fade44b2a96 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.022486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83affa1d-1422-4b25-905f-2fade44b2a96 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.023343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83affa1d-1422-4b25-905f-2fade44b2a96 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.023946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83affa1d-1422-4b25-905f-2fade44b2a96 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.024587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83affa1d-1422-4b25-905f-2fade44b2a96 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.036401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-73ca7d3d-494f-401b-b9bc-5c2c9475c5da req-5c48c480-5139-488e-9f39-16808eeb5801 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.037132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-73ca7d3d-494f-401b-b9bc-5c2c9475c5da req-5c48c480-5139-488e-9f39-16808eeb5801 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.038076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-73ca7d3d-494f-401b-b9bc-5c2c9475c5da req-5c48c480-5139-488e-9f39-16808eeb5801 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.070854 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-73ca7d3d-494f-401b-b9bc-5c2c9475c5da req-5c48c480-5139-488e-9f39-16808eeb5801 service nova] Creating event network-changed:08892328-92a2-491f-bdba-c4be5bc285d2 for instance eff3fc3b-c65f-417e-9978-1a7b1179de2d on n-h1-862964-4 Oct 29 03:00:30.080317 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-73ca7d3d-494f-401b-b9bc-5c2c9475c5da req-5c48c480-5139-488e-9f39-16808eeb5801 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061866 Oct 29 03:00:30.081190 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1856/3613] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:00:30.260676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-83affa1d-1422-4b25-905f-2fade44b2a96 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:30.278898 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-83affa1d-1422-4b25-905f-2fade44b2a96 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1574 microversion: 2.1 time: 0.273259 Oct 29 03:00:30.282956 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1758/3614] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:30 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1574 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:30.299028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89660dde-1546-4383-8c0b-8030a2c321e3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:30.299993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89660dde-1546-4383-8c0b-8030a2c321e3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:30.328972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89660dde-1546-4383-8c0b-8030a2c321e3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.329474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89660dde-1546-4383-8c0b-8030a2c321e3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.329938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89660dde-1546-4383-8c0b-8030a2c321e3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.335847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89660dde-1546-4383-8c0b-8030a2c321e3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.342074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89660dde-1546-4383-8c0b-8030a2c321e3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.343435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89660dde-1546-4383-8c0b-8030a2c321e3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.384716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-37225921-a17a-4b9f-8d33-d4812e2dc1b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:30.385838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-37225921-a17a-4b9f-8d33-d4812e2dc1b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:30.402399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37225921-a17a-4b9f-8d33-d4812e2dc1b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.403575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37225921-a17a-4b9f-8d33-d4812e2dc1b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.404204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37225921-a17a-4b9f-8d33-d4812e2dc1b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.412379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37225921-a17a-4b9f-8d33-d4812e2dc1b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.422044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37225921-a17a-4b9f-8d33-d4812e2dc1b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.422927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37225921-a17a-4b9f-8d33-d4812e2dc1b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.666321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-89660dde-1546-4383-8c0b-8030a2c321e3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:30.684278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-37225921-a17a-4b9f-8d33-d4812e2dc1b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:30.686113 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89660dde-1546-4383-8c0b-8030a2c321e3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.410600 Oct 29 03:00:30.701835 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-37225921-a17a-4b9f-8d33-d4812e2dc1b4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1315 microversion: 2.1 time: 0.319188 Oct 29 03:00:30.701835 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1759/3615] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:30 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:30.709117 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1857/3616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:30 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:30.711593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:30.715109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:30.722750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.726561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.727189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.728320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.729048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.729656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.803037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:30.803923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:30.813991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.817838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.836460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.838808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.842665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.846487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.188396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.205909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.207462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.208863 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cab41746-8eb7-4b0a-bd03-51e8fcd1508c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 200 len: 1339 microversion: 2.47 time: 0.410012 Oct 29 03:00:31.209855 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1858/3617] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:30 2022] GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 1339 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:31.237619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1cad01fd-5bd6-45a7-8804-f188725a5689 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:31.238319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1cad01fd-5bd6-45a7-8804-f188725a5689 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:31.285851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cad01fd-5bd6-45a7-8804-f188725a5689 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.286905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cad01fd-5bd6-45a7-8804-f188725a5689 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.291965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cad01fd-5bd6-45a7-8804-f188725a5689 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.295491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cad01fd-5bd6-45a7-8804-f188725a5689 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.299255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cad01fd-5bd6-45a7-8804-f188725a5689 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.299959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cad01fd-5bd6-45a7-8804-f188725a5689 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.430445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.450021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.451926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.454017 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bbfb891e-bff5-4b74-8b04-d92118aa28d9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1721 microversion: 2.20 time: 0.750767 Oct 29 03:00:31.455684 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1760/3618] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:30 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1721 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:31.461711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e5f70582-2109-4e11-8810-70cd05cb0608 req-c530a299-78ef-43ec-85dd-59693173ea42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a", "name": "network-vif-plugged", "status": "completed", "tag": "e4625ea7-a638-4eb4-80bf-1b9a17436058"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:31.480300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e5f70582-2109-4e11-8810-70cd05cb0608 req-c530a299-78ef-43ec-85dd-59693173ea42 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.480722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e5f70582-2109-4e11-8810-70cd05cb0608 req-c530a299-78ef-43ec-85dd-59693173ea42 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.481162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e5f70582-2109-4e11-8810-70cd05cb0608 req-c530a299-78ef-43ec-85dd-59693173ea42 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.496353 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e5f70582-2109-4e11-8810-70cd05cb0608 req-c530a299-78ef-43ec-85dd-59693173ea42 service nova] Creating event network-vif-plugged:e4625ea7-a638-4eb4-80bf-1b9a17436058 for instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a on n-h2-862964-4 Oct 29 03:00:31.504834 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e5f70582-2109-4e11-8810-70cd05cb0608 req-c530a299-78ef-43ec-85dd-59693173ea42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047386 Oct 29 03:00:31.506055 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1761/3619] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:31.722616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c9658ffc-984e-4ff5-b556-965a8303adad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:31.724069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c9658ffc-984e-4ff5-b556-965a8303adad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:31.735420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9658ffc-984e-4ff5-b556-965a8303adad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.736070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9658ffc-984e-4ff5-b556-965a8303adad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.736611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9658ffc-984e-4ff5-b556-965a8303adad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.738132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9658ffc-984e-4ff5-b556-965a8303adad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.738719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9658ffc-984e-4ff5-b556-965a8303adad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.739941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9658ffc-984e-4ff5-b556-965a8303adad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.921944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1cad01fd-5bd6-45a7-8804-f188725a5689 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.933848 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1cad01fd-5bd6-45a7-8804-f188725a5689 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1468 microversion: 2.1 time: 0.712402 Oct 29 03:00:31.935541 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1859/3620] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:31 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1468 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:31.988463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8af50cd1-2878-4667-82ce-491af5ad7eac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:31.992638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8af50cd1-2878-4667-82ce-491af5ad7eac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:32.002082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af50cd1-2878-4667-82ce-491af5ad7eac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.004463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af50cd1-2878-4667-82ce-491af5ad7eac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.005016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af50cd1-2878-4667-82ce-491af5ad7eac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.006020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af50cd1-2878-4667-82ce-491af5ad7eac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.006859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af50cd1-2878-4667-82ce-491af5ad7eac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.007442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af50cd1-2878-4667-82ce-491af5ad7eac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.100942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c9658ffc-984e-4ff5-b556-965a8303adad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:32.113369 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c9658ffc-984e-4ff5-b556-965a8303adad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.398366 Oct 29 03:00:32.139436 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1762/3621] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:31 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:32.239344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:32.240009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:32.253858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.254357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.254776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.255504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.259889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.260383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.408895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:32.424923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:32.426993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:32.428668 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-545b3325-1754-4908-ad6e-42183a6229a1 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 200 len: 1360 microversion: 2.47 time: 0.194408 Oct 29 03:00:32.429549 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1763/3622] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:32 2022] GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 1360 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:00:32.459627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a30352be-d1f8-4768-8d0b-2d49c0453dab tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-995934686"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:32.462777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a30352be-d1f8-4768-8d0b-2d49c0453dab tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:32.477035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a30352be-d1f8-4768-8d0b-2d49c0453dab tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.480395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a30352be-d1f8-4768-8d0b-2d49c0453dab tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.480830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a30352be-d1f8-4768-8d0b-2d49c0453dab tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.483656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a30352be-d1f8-4768-8d0b-2d49c0453dab tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.484185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a30352be-d1f8-4768-8d0b-2d49c0453dab tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.484752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a30352be-d1f8-4768-8d0b-2d49c0453dab tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.586685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8af50cd1-2878-4667-82ce-491af5ad7eac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:32.599354 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8af50cd1-2878-4667-82ce-491af5ad7eac tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1315 microversion: 2.1 time: 0.662534 Oct 29 03:00:32.614904 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1860/3623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:31 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:32.623837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:32.624455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:32.639541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.640037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.640474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.641186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.641639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.642093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.763259 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a30352be-d1f8-4768-8d0b-2d49c0453dab tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "POST /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e/action" status: 202 len: 52 microversion: 2.47 time: 0.309367 Oct 29 03:00:32.764068 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1764/3624] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 03:00:32 2022] POST /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e/action => generated 52 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 29 03:00:32.781181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b33d9b3c-6b62-4917-b92d-14da1f6e7cf0 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:32.784762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b33d9b3c-6b62-4917-b92d-14da1f6e7cf0 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:32.798696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b33d9b3c-6b62-4917-b92d-14da1f6e7cf0 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.799190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b33d9b3c-6b62-4917-b92d-14da1f6e7cf0 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.799793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b33d9b3c-6b62-4917-b92d-14da1f6e7cf0 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.800812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b33d9b3c-6b62-4917-b92d-14da1f6e7cf0 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.801426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b33d9b3c-6b62-4917-b92d-14da1f6e7cf0 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.802729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b33d9b3c-6b62-4917-b92d-14da1f6e7cf0 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.836304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b33d9b3c-6b62-4917-b92d-14da1f6e7cf0 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:00:32.921347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:32.953959 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b33d9b3c-6b62-4917-b92d-14da1f6e7cf0 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 204 len: 0 microversion: 2.47 time: 0.182280 Oct 29 03:00:32.956787 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1765/3625] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:00:32 2022] DELETE /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:00:32.963689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fd98d114-a898-4b8a-a5d0-0915bb0fc4cf tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:32.964496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fd98d114-a898-4b8a-a5d0-0915bb0fc4cf tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:32.971757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd98d114-a898-4b8a-a5d0-0915bb0fc4cf tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.972343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd98d114-a898-4b8a-a5d0-0915bb0fc4cf tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.972802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd98d114-a898-4b8a-a5d0-0915bb0fc4cf tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.974156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd98d114-a898-4b8a-a5d0-0915bb0fc4cf tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.974612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd98d114-a898-4b8a-a5d0-0915bb0fc4cf tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.975032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd98d114-a898-4b8a-a5d0-0915bb0fc4cf tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.076806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fd98d114-a898-4b8a-a5d0-0915bb0fc4cf tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.087494 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fd98d114-a898-4b8a-a5d0-0915bb0fc4cf tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1426 microversion: 2.1 time: 0.129033 Oct 29 03:00:33.088318 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1766/3626] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:32 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1426 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:33.118212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:33.119929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:33.127579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.128440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.129634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.130565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.132408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.133892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.193757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.208962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.213135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.214906 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9f5138f8-3fc0-4aca-aa02-07a73a24b319 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1721 microversion: 2.20 time: 0.598627 Oct 29 03:00:33.219052 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1861/3627] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:32 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1721 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:33.227553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ed826089-50ac-4d01-af93-fbed94d738f7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:33.228520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ed826089-50ac-4d01-af93-fbed94d738f7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:33.235175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed826089-50ac-4d01-af93-fbed94d738f7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.243234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed826089-50ac-4d01-af93-fbed94d738f7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.246133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed826089-50ac-4d01-af93-fbed94d738f7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.252808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed826089-50ac-4d01-af93-fbed94d738f7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.254386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed826089-50ac-4d01-af93-fbed94d738f7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.255067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed826089-50ac-4d01-af93-fbed94d738f7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.343482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.360086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.363386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.366051 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6021203f-baf8-4df1-9d15-ccf7c3e807be tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 200 len: 1366 microversion: 2.47 time: 0.258942 Oct 29 03:00:33.367416 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1767/3628] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:33 2022] GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:33.373248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-792412a8-fe39-4db8-a4d7-a36ee4566206 req-86bd3f34-dcba-4e01-ad2f-c941cff77108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307ea4d3-0a4b-4e45-8e60-166f6f2f34b9", "name": "network-vif-deleted", "tag": "e77f2ab9-9058-4555-808a-abd1a7d3096f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:33.384644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-792412a8-fe39-4db8-a4d7-a36ee4566206 req-86bd3f34-dcba-4e01-ad2f-c941cff77108 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.389043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-792412a8-fe39-4db8-a4d7-a36ee4566206 req-86bd3f34-dcba-4e01-ad2f-c941cff77108 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.390344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-792412a8-fe39-4db8-a4d7-a36ee4566206 req-86bd3f34-dcba-4e01-ad2f-c941cff77108 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.404237 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-792412a8-fe39-4db8-a4d7-a36ee4566206 req-86bd3f34-dcba-4e01-ad2f-c941cff77108 service nova] Creating event network-vif-deleted:e77f2ab9-9058-4555-808a-abd1a7d3096f for instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 on n-h1-862964-4 Oct 29 03:00:33.423359 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-792412a8-fe39-4db8-a4d7-a36ee4566206 req-86bd3f34-dcba-4e01-ad2f-c941cff77108 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053644 Oct 29 03:00:33.424297 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1768/3629] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:33.507505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ed826089-50ac-4d01-af93-fbed94d738f7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.539560 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ed826089-50ac-4d01-af93-fbed94d738f7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.319081 Oct 29 03:00:33.547955 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1862/3630] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:33 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:33.639169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-73cc5fcc-2679-49a2-81b3-76754ba18091 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:33.640886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-73cc5fcc-2679-49a2-81b3-76754ba18091 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:33.654144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73cc5fcc-2679-49a2-81b3-76754ba18091 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.655120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73cc5fcc-2679-49a2-81b3-76754ba18091 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.655859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73cc5fcc-2679-49a2-81b3-76754ba18091 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.658438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73cc5fcc-2679-49a2-81b3-76754ba18091 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.658902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73cc5fcc-2679-49a2-81b3-76754ba18091 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.659326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73cc5fcc-2679-49a2-81b3-76754ba18091 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.886999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-73cc5fcc-2679-49a2-81b3-76754ba18091 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.895942 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-73cc5fcc-2679-49a2-81b3-76754ba18091 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1500 microversion: 2.1 time: 0.263724 Oct 29 03:00:33.896740 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1769/3631] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:33 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:33.919889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4af3a358-7483-47d9-bbad-537207276f04 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:33.921153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4af3a358-7483-47d9-bbad-537207276f04 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:33.927517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4af3a358-7483-47d9-bbad-537207276f04 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.928721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4af3a358-7483-47d9-bbad-537207276f04 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.929231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4af3a358-7483-47d9-bbad-537207276f04 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.930053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4af3a358-7483-47d9-bbad-537207276f04 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.930794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4af3a358-7483-47d9-bbad-537207276f04 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.931316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4af3a358-7483-47d9-bbad-537207276f04 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.957074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-4af3a358-7483-47d9-bbad-537207276f04 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lazy-loading 'flavor' on Instance uuid 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:34.037276 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4af3a358-7483-47d9-bbad-537207276f04 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "POST /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a/action" status: 202 len: 0 microversion: 2.1 time: 0.120189 Oct 29 03:00:34.046867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-557181ec-f601-489a-ab83-f686d0f403ee tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:34.047749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-557181ec-f601-489a-ab83-f686d0f403ee tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:34.050557 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1863/3632] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:33 2022] POST /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:00:34.054838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557181ec-f601-489a-ab83-f686d0f403ee tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.055385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557181ec-f601-489a-ab83-f686d0f403ee tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.055820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557181ec-f601-489a-ab83-f686d0f403ee tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.056686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557181ec-f601-489a-ab83-f686d0f403ee tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.057143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557181ec-f601-489a-ab83-f686d0f403ee tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.057562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557181ec-f601-489a-ab83-f686d0f403ee tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.115260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:34.116167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:34.123223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.123708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.124345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.125050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.125497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.125942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.164946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.165397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.166049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.166665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lazy-loading 'fault' on Instance uuid 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:34.212015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:34.220623 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ebc097e7-8c6e-4bae-b8ed-a67684892350 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1311 microversion: 2.1 time: 0.110585 Oct 29 03:00:34.221196 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1864/3633] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:34 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:34.250372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:34.251133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:34.257408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.258914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.259749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.260730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.261302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.261792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.430694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-557181ec-f601-489a-ab83-f686d0f403ee tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:34.442331 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-557181ec-f601-489a-ab83-f686d0f403ee tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1508 microversion: 2.1 time: 0.400741 Oct 29 03:00:34.443612 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1770/3634] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:34 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:34.449040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:34.449956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:34.458061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.459031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.459668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.460588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.461046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.461470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.486426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:34.533399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:34.545155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:34.555585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:34.557733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:34.559147 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9a4af47d-6ff2-4caa-9f91-bca82f5af705 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 200 len: 1366 microversion: 2.47 time: 0.114262 Oct 29 03:00:34.559896 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1771/3635] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:34 2022] GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:34.575160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:34.577225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:34.579743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-248e6af9-f856-4249-bc37-cbf3b43f4c90 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:34.580348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-248e6af9-f856-4249-bc37-cbf3b43f4c90 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:34.580919 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cddebea4-153e-40ca-afaf-2b506aeee665 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1721 microversion: 2.20 time: 0.335102 Oct 29 03:00:34.583461 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1865/3636] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:34 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:00:34.589497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-248e6af9-f856-4249-bc37-cbf3b43f4c90 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.590265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-248e6af9-f856-4249-bc37-cbf3b43f4c90 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.590946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-248e6af9-f856-4249-bc37-cbf3b43f4c90 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.591910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-248e6af9-f856-4249-bc37-cbf3b43f4c90 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.592515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-248e6af9-f856-4249-bc37-cbf3b43f4c90 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.593095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-248e6af9-f856-4249-bc37-cbf3b43f4c90 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.972206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-248e6af9-f856-4249-bc37-cbf3b43f4c90 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:34.982892 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-248e6af9-f856-4249-bc37-cbf3b43f4c90 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.406831 Oct 29 03:00:34.991187 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1772/3637] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:34 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:35.244515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:35.245115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:35.253696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:35.260838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.261334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.261767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.262486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.262933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.263336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.307078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.307826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.308969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.309861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lazy-loading 'fault' on Instance uuid 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:35.469744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d2052d78-14dd-40ef-9355-1fdbf79a4d82 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:35.470858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d2052d78-14dd-40ef-9355-1fdbf79a4d82 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:35.479684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2052d78-14dd-40ef-9355-1fdbf79a4d82 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.480429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2052d78-14dd-40ef-9355-1fdbf79a4d82 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.481319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2052d78-14dd-40ef-9355-1fdbf79a4d82 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.482274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2052d78-14dd-40ef-9355-1fdbf79a4d82 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.483203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2052d78-14dd-40ef-9355-1fdbf79a4d82 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.483840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2052d78-14dd-40ef-9355-1fdbf79a4d82 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.630532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=16 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:35.651390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:35.663885 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50b7b879-ad25-4bfe-98c1-4b9a59ebe1cd tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 200 len: 1311 microversion: 2.1 time: 0.423573 Oct 29 03:00:35.665541 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1866/3638] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:35 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 1311 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:35.670312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:35.671100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:35.688935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.689433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.692919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.694300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.697689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.698372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.788615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d2052d78-14dd-40ef-9355-1fdbf79a4d82 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:35.802127 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d2052d78-14dd-40ef-9355-1fdbf79a4d82 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1491 microversion: 2.1 time: 0.337551 Oct 29 03:00:35.821197 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1773/3639] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:35 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1491 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:35.850067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:35.853890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:35.856279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:35.864087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:35.865108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.865898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.866542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.868137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.869159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.869739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.870080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:35.871340 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-99ce7d60-eec2-4222-a679-c9b0a244d41c tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 200 len: 1366 microversion: 2.47 time: 0.204661 Oct 29 03:00:35.880092 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1867/3640] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:35 2022] GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:35.900743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2b89114e-8ca3-40cd-af56-f8abb5174a37 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:35.902477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2b89114e-8ca3-40cd-af56-f8abb5174a37 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:35.910466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b89114e-8ca3-40cd-af56-f8abb5174a37 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.911261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b89114e-8ca3-40cd-af56-f8abb5174a37 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.912625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b89114e-8ca3-40cd-af56-f8abb5174a37 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.913592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b89114e-8ca3-40cd-af56-f8abb5174a37 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.914247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b89114e-8ca3-40cd-af56-f8abb5174a37 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.914830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b89114e-8ca3-40cd-af56-f8abb5174a37 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.971863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2b89114e-8ca3-40cd-af56-f8abb5174a37 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:00:36.055254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:36.147769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:36.161375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:36.165041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:36.168749 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2f95d054-8125-4e06-b757-641057fe3435 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1721 microversion: 2.20 time: 0.345862 Oct 29 03:00:36.175149 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1774/3641] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:35 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1721 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:36.185358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-92728e62-3622-432e-9bcf-6115b5acbd91 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:36.188152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-92728e62-3622-432e-9bcf-6115b5acbd91 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:36.190337 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2b89114e-8ca3-40cd-af56-f8abb5174a37 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 204 len: 0 microversion: 2.1 time: 0.293687 Oct 29 03:00:36.191151 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1868/3642] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:35 2022] DELETE /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:00:36.197987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92728e62-3622-432e-9bcf-6115b5acbd91 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.198630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92728e62-3622-432e-9bcf-6115b5acbd91 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.199152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92728e62-3622-432e-9bcf-6115b5acbd91 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.200310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92728e62-3622-432e-9bcf-6115b5acbd91 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.201265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92728e62-3622-432e-9bcf-6115b5acbd91 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.201782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92728e62-3622-432e-9bcf-6115b5acbd91 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.205160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2dd7da32-c71b-4ede-8f6a-fca00f8d65c7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:36.206097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2dd7da32-c71b-4ede-8f6a-fca00f8d65c7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:36.228675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dd7da32-c71b-4ede-8f6a-fca00f8d65c7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.229433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dd7da32-c71b-4ede-8f6a-fca00f8d65c7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.230076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dd7da32-c71b-4ede-8f6a-fca00f8d65c7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.230935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dd7da32-c71b-4ede-8f6a-fca00f8d65c7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.231748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dd7da32-c71b-4ede-8f6a-fca00f8d65c7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.233738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dd7da32-c71b-4ede-8f6a-fca00f8d65c7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.433450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-92728e62-3622-432e-9bcf-6115b5acbd91 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:36.443361 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-92728e62-3622-432e-9bcf-6115b5acbd91 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.265134 Oct 29 03:00:36.444723 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1775/3643] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:36 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:36.582507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2dd7da32-c71b-4ede-8f6a-fca00f8d65c7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:36.592128 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2dd7da32-c71b-4ede-8f6a-fca00f8d65c7 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1497 microversion: 2.1 time: 0.392922 Oct 29 03:00:36.592726 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1869/3644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:36 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1497 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:36.687710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:36.688314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:36.703188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.703680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.704312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.712036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.712623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.713278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.731098 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] HTTP exception thrown: Instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 could not be found. Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Request method failure captured: Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 HTTP/1.1 Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJcX4sZ4oD175nG_PsTKo0OOgnNS8LmgOv6zV-rrQPBIy_RnpImRU2Q-GUn7TcGNsz-Agz3RLBRL3sPRD6CFB1PcpE_ab5L8sZh0-OnNMzPuCZBX1OM_osSYHjPy1ksFqBqdU9SITm5gE24ht3maICyISJ69PG8LOQjweyOlWFf292U Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 5d85e030cdfd49bfa36d55f2aa1a074c Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-665001369 Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d85e030cdfd49bfa36d55f2aa1a074c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d85e030cdfd49bfa36d55f2aa1a074c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d85e030cdfd49bfa36d55f2aa1a074c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d85e030cdfd49bfa36d55f2aa1a074c"}]}] Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersAdminNegativeTestJSON-665001369 Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 5d85e030cdfd49bfa36d55f2aa1a074c Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-665001369 Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersAdminNegativeTestJSON-665001369-project Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a3151f4e39a646e1a3ba3585bc00b2ab Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersAdminNegativeTestJSON-665001369-project Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 could not be found. Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '307ea4d3-0a4b-4e45-8e60-166f6f2f34b9'} Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 could not be found. Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 could not be found. Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:36.734211 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:36.740065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:36.740065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:36.740065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:36.740065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:36.740065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:36.740065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:36.740065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 could not be found. Oct 29 03:00:36.740065 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:36.741228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Returning 404 to user: Instance 307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:36.742222 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1bed93c1-b63e-4359-b952-030d590abad0 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9" status: 404 len: 111 microversion: 2.1 time: 0.058347 Oct 29 03:00:36.754527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1da60b04-c962-4db1-954a-b5256b5a9b5d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:36.755047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1da60b04-c962-4db1-954a-b5256b5a9b5d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:36.758029 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1776/3645] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:36 2022] GET /compute/v2.1/servers/307ea4d3-0a4b-4e45-8e60-166f6f2f34b9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:36.762613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1da60b04-c962-4db1-954a-b5256b5a9b5d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.763098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1da60b04-c962-4db1-954a-b5256b5a9b5d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.763526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1da60b04-c962-4db1-954a-b5256b5a9b5d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.764225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1da60b04-c962-4db1-954a-b5256b5a9b5d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.764674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1da60b04-c962-4db1-954a-b5256b5a9b5d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.765092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1da60b04-c962-4db1-954a-b5256b5a9b5d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.799129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1da60b04-c962-4db1-954a-b5256b5a9b5d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:00:36.907033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:36.907786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:36.918462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.922278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.922931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.923811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.924430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.925074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.931883 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1da60b04-c962-4db1-954a-b5256b5a9b5d tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "DELETE /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 204 len: 0 microversion: 2.1 time: 0.181401 Oct 29 03:00:36.940134 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1870/3646] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:36 2022] DELETE /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:00:36.951413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-288479b1-4ed9-4f3a-bdc0-2b60b91c0802 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:36.952667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-288479b1-4ed9-4f3a-bdc0-2b60b91c0802 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:36.958319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:36.978191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.978674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.979339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.979757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lazy-loading 'fault' on Instance uuid b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:36.986240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-288479b1-4ed9-4f3a-bdc0-2b60b91c0802 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.988339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-288479b1-4ed9-4f3a-bdc0-2b60b91c0802 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.990473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-288479b1-4ed9-4f3a-bdc0-2b60b91c0802 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.992750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-288479b1-4ed9-4f3a-bdc0-2b60b91c0802 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.994433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-288479b1-4ed9-4f3a-bdc0-2b60b91c0802 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.998086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-288479b1-4ed9-4f3a-bdc0-2b60b91c0802 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.035142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.044606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.046495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ae01397259c42adbdf5dc6aa8ee1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870f44bf140f4b62828ffe0ce571f77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.047791 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7fa3054e-0178-46b8-a516-24a0a77e47e3 tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 200 len: 1371 microversion: 2.47 time: 0.144770 Oct 29 03:00:37.049357 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1777/3647] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:36 2022] GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:37.195710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:37.196390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:37.203034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:37.203524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:37.203958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.204678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:37.205130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:37.205554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.347464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-288479b1-4ed9-4f3a-bdc0-2b60b91c0802 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.349214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.358265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.358562 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-288479b1-4ed9-4f3a-bdc0-2b60b91c0802 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1476 microversion: 2.1 time: 0.413511 Oct 29 03:00:37.361007 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1871/3648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:36 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1476 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:37.362412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.363799 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7b388305-9129-4467-9402-138474ade501 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1742 microversion: 2.20 time: 0.172528 Oct 29 03:00:37.364654 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1778/3649] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:37 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:37.467115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e4a3427b-cf00-42ba-8988-70da4115fab8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:37.467727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e4a3427b-cf00-42ba-8988-70da4115fab8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:37.477147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4a3427b-cf00-42ba-8988-70da4115fab8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:37.477538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4a3427b-cf00-42ba-8988-70da4115fab8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:37.478014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4a3427b-cf00-42ba-8988-70da4115fab8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.478725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4a3427b-cf00-42ba-8988-70da4115fab8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:37.479171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4a3427b-cf00-42ba-8988-70da4115fab8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:37.479588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e4a3427b-cf00-42ba-8988-70da4115fab8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.617656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b63a2173-f7ca-4fff-a5a8-154f9ab9c34e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:37.618300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b63a2173-f7ca-4fff-a5a8-154f9ab9c34e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:37.636068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b63a2173-f7ca-4fff-a5a8-154f9ab9c34e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:37.636469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b63a2173-f7ca-4fff-a5a8-154f9ab9c34e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:37.639371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b63a2173-f7ca-4fff-a5a8-154f9ab9c34e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.640612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b63a2173-f7ca-4fff-a5a8-154f9ab9c34e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:37.641247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b63a2173-f7ca-4fff-a5a8-154f9ab9c34e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:37.647551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b63a2173-f7ca-4fff-a5a8-154f9ab9c34e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.798214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e4a3427b-cf00-42ba-8988-70da4115fab8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.809185 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e4a3427b-cf00-42ba-8988-70da4115fab8 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.345629 Oct 29 03:00:37.809818 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1872/3650] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:37 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:38.078506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:38.079235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] [instance: b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:38.087987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b63a2173-f7ca-4fff-a5a8-154f9ab9c34e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:38.097155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.097649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.098103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.098802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.099358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.099778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.102973 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b63a2173-f7ca-4fff-a5a8-154f9ab9c34e tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1497 microversion: 2.1 time: 0.488131 Oct 29 03:00:38.107582 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1779/3651] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:37 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1497 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:38.149697 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] HTTP exception thrown: Instance b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e could not be found. Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Request method failure captured: Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e HTTP/1.1 Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJdIrsfyqEtFrtns0lSjvL6lkX6VokT3ehtxByc35fMF0tWaZCp2UGegLX3Cv2njSMLiIKtwXQAm9anhA7_Fu1spcHya2yU9QqfSBAgbZYhJGqjdwnh_mWlZk-6piajghXaskgg4zQch2ElRe6rv81omk5LHd6vF-bkxyUpeemaws7c Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 870f44bf140f4b62828ffe0ce571f77f Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersAaction247Test-127373744 Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/870f44bf140f4b62828ffe0ce571f77f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/870f44bf140f4b62828ffe0ce571f77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_870f44bf140f4b62828ffe0ce571f77f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/870f44bf140f4b62828ffe0ce571f77f"}]}] Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersAaction247Test-127373744 Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 870f44bf140f4b62828ffe0ce571f77f Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersAaction247Test-127373744 Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersAaction247Test-127373744-project Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 8ae01397259c42adbdf5dc6aa8ee1871 Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersAaction247Test-127373744-project Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e could not be found. Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e'} Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e could not be found. Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e could not be found. Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:38.151507 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:38.156250 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:38.156250 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:38.156250 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:38.156250 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:38.156250 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:38.156250 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e could not be found. Oct 29 03:00:38.156250 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:38.156250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] Returning 404 to user: Instance b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:38.156250 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e9791f03-9469-49e8-9ddb-f455a6f0787b tempest-ServersAaction247Test-127373744 tempest-ServersAaction247Test-127373744-project] 10.222.0.16 "GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e" status: 404 len: 111 microversion: 2.47 time: 0.079845 Oct 29 03:00:38.157647 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1873/3652] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:38 2022] GET /compute/v2.1/servers/b0f4feeb-7eeb-4a12-bc3d-cf3494338d6e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:00:38.384237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-77977b75-0519-4253-8a3d-f38b9e0f2cf5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:38.385492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-77977b75-0519-4253-8a3d-f38b9e0f2cf5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:38.392062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:38.392934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:38.394529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77977b75-0519-4253-8a3d-f38b9e0f2cf5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.398487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77977b75-0519-4253-8a3d-f38b9e0f2cf5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.399042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77977b75-0519-4253-8a3d-f38b9e0f2cf5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.399849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77977b75-0519-4253-8a3d-f38b9e0f2cf5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.402308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77977b75-0519-4253-8a3d-f38b9e0f2cf5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.402885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77977b75-0519-4253-8a3d-f38b9e0f2cf5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.405674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.412253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.412974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.415444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.416127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.416719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.700266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:38.713782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:38.718268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:38.719779 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eff0b6f8-7c01-4ab1-bca3-c25887e912ae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1742 microversion: 2.20 time: 0.332546 Oct 29 03:00:38.722505 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1874/3653] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:38 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1742 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:00:38.828267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77977b75-0519-4253-8a3d-f38b9e0f2cf5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:38.833768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44bfd9f0-d31b-475f-a9ad-3bf460f6eb84 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:38.834413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-44bfd9f0-d31b-475f-a9ad-3bf460f6eb84 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:38.843578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44bfd9f0-d31b-475f-a9ad-3bf460f6eb84 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.844077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44bfd9f0-d31b-475f-a9ad-3bf460f6eb84 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.844359 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-77977b75-0519-4253-8a3d-f38b9e0f2cf5 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1476 microversion: 2.1 time: 0.464094 Oct 29 03:00:38.844506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44bfd9f0-d31b-475f-a9ad-3bf460f6eb84 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.845287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44bfd9f0-d31b-475f-a9ad-3bf460f6eb84 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.846491 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1780/3654] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:38 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1476 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:38.858031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44bfd9f0-d31b-475f-a9ad-3bf460f6eb84 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.858675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44bfd9f0-d31b-475f-a9ad-3bf460f6eb84 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:39.134251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-704784f1-3ead-469b-b2ff-9fe2fb02518d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:39.135239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-704784f1-3ead-469b-b2ff-9fe2fb02518d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:39.148434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704784f1-3ead-469b-b2ff-9fe2fb02518d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:39.148682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-44bfd9f0-d31b-475f-a9ad-3bf460f6eb84 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:39.149473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704784f1-3ead-469b-b2ff-9fe2fb02518d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:39.151430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704784f1-3ead-469b-b2ff-9fe2fb02518d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:39.153422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704784f1-3ead-469b-b2ff-9fe2fb02518d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:39.155179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704784f1-3ead-469b-b2ff-9fe2fb02518d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:39.157333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704784f1-3ead-469b-b2ff-9fe2fb02518d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:39.160109 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-44bfd9f0-d31b-475f-a9ad-3bf460f6eb84 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.331021 Oct 29 03:00:39.187544 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1875/3655] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:38 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:39.586678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-704784f1-3ead-469b-b2ff-9fe2fb02518d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:39.603670 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-704784f1-3ead-469b-b2ff-9fe2fb02518d tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1497 microversion: 2.1 time: 0.474699 Oct 29 03:00:39.632074 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1781/3656] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:39 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1497 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:39.756688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:39.757704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:39.783484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:39.786829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:39.788290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:39.791449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:39.793126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:39.793724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:39.872229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79883a98-1b88-4488-a840-a7c82b709638 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:39.875767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79883a98-1b88-4488-a840-a7c82b709638 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:39.914936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79883a98-1b88-4488-a840-a7c82b709638 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:39.915635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79883a98-1b88-4488-a840-a7c82b709638 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:39.918214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79883a98-1b88-4488-a840-a7c82b709638 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:39.919130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79883a98-1b88-4488-a840-a7c82b709638 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:39.919754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79883a98-1b88-4488-a840-a7c82b709638 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:39.921779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79883a98-1b88-4488-a840-a7c82b709638 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:40.652406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:40.661367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:40.666534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:40.669518 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37edfc51-00cf-4b87-8eb7-1a9c5e379a76 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.923539 Oct 29 03:00:40.673032 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1876/3657] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:39 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:40.687163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-529286c8-30a7-4199-aa0a-bc649ccc849c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:40.687950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-529286c8-30a7-4199-aa0a-bc649ccc849c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:40.711762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529286c8-30a7-4199-aa0a-bc649ccc849c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:40.714467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529286c8-30a7-4199-aa0a-bc649ccc849c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:40.715153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529286c8-30a7-4199-aa0a-bc649ccc849c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:40.719768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529286c8-30a7-4199-aa0a-bc649ccc849c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:40.720457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529286c8-30a7-4199-aa0a-bc649ccc849c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:40.721179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529286c8-30a7-4199-aa0a-bc649ccc849c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:40.787063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-79883a98-1b88-4488-a840-a7c82b709638 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:40.799223 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79883a98-1b88-4488-a840-a7c82b709638 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1476 microversion: 2.1 time: 0.933902 Oct 29 03:00:40.800476 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1782/3658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:39 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1476 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:40.807088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e91752f6-1482-4833-b42f-bb83f6939c29 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:40.807879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e91752f6-1482-4833-b42f-bb83f6939c29 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:40.816398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e91752f6-1482-4833-b42f-bb83f6939c29 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:40.817440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e91752f6-1482-4833-b42f-bb83f6939c29 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:40.818365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e91752f6-1482-4833-b42f-bb83f6939c29 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:40.819860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e91752f6-1482-4833-b42f-bb83f6939c29 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:40.820493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e91752f6-1482-4833-b42f-bb83f6939c29 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:40.821136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e91752f6-1482-4833-b42f-bb83f6939c29 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:41.202711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-529286c8-30a7-4199-aa0a-bc649ccc849c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:41.211705 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-529286c8-30a7-4199-aa0a-bc649ccc849c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.537456 Oct 29 03:00:41.233968 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1877/3659] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:40 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:41.448450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e91752f6-1482-4833-b42f-bb83f6939c29 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:41.465534 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e91752f6-1482-4833-b42f-bb83f6939c29 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1497 microversion: 2.1 time: 0.661128 Oct 29 03:00:41.471969 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1783/3660] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:40 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1497 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:41.699810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:41.700422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:41.712258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:41.722630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:41.723405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:41.727138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:41.727857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:41.728567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:41.830210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49c016cb-fe26-4a65-981b-4cdc8c904b31 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:41.830811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49c016cb-fe26-4a65-981b-4cdc8c904b31 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:41.854062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49c016cb-fe26-4a65-981b-4cdc8c904b31 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:41.862159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49c016cb-fe26-4a65-981b-4cdc8c904b31 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:41.867382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49c016cb-fe26-4a65-981b-4cdc8c904b31 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:41.873548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49c016cb-fe26-4a65-981b-4cdc8c904b31 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:41.877088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49c016cb-fe26-4a65-981b-4cdc8c904b31 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:41.882724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49c016cb-fe26-4a65-981b-4cdc8c904b31 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:42.295036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-49c016cb-fe26-4a65-981b-4cdc8c904b31 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:42.316268 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-49c016cb-fe26-4a65-981b-4cdc8c904b31 tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1434 microversion: 2.1 time: 0.490362 Oct 29 03:00:42.319448 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1784/3661] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:41 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1434 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:42.328607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-61f441e2-5a7f-4310-aa1d-3315b8a17abe tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:42.329503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-61f441e2-5a7f-4310-aa1d-3315b8a17abe tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:42.345496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61f441e2-5a7f-4310-aa1d-3315b8a17abe tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:42.346356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61f441e2-5a7f-4310-aa1d-3315b8a17abe tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:42.346975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61f441e2-5a7f-4310-aa1d-3315b8a17abe tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:42.347884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61f441e2-5a7f-4310-aa1d-3315b8a17abe tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:42.348513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61f441e2-5a7f-4310-aa1d-3315b8a17abe tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:42.349488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61f441e2-5a7f-4310-aa1d-3315b8a17abe tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:42.623434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:42.632401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:42.633854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:42.635069 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ea1a53d6-9338-4146-86ba-a5663656548d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.939417 Oct 29 03:00:42.652935 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1878/3662] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:41 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:42.678634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-5a191adf-a93b-4252-8d47-7d840ce69ce0 req-87b74df7-ee02-464a-b105-5e87555d50f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586d2052-3b4d-4539-9947-189e93c1dd8b", "name": "network-vif-deleted", "tag": "373fe05f-fb29-499c-9f41-39ba5d81768b"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:42.725547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5a191adf-a93b-4252-8d47-7d840ce69ce0 req-87b74df7-ee02-464a-b105-5e87555d50f9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:42.740487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5a191adf-a93b-4252-8d47-7d840ce69ce0 req-87b74df7-ee02-464a-b105-5e87555d50f9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:42.744038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5a191adf-a93b-4252-8d47-7d840ce69ce0 req-87b74df7-ee02-464a-b105-5e87555d50f9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:42.820949 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-5a191adf-a93b-4252-8d47-7d840ce69ce0 req-87b74df7-ee02-464a-b105-5e87555d50f9 service nova] Creating event network-vif-deleted:373fe05f-fb29-499c-9f41-39ba5d81768b for instance 586d2052-3b4d-4539-9947-189e93c1dd8b on n-h2-862964-4 Oct 29 03:00:42.837692 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-5a191adf-a93b-4252-8d47-7d840ce69ce0 req-87b74df7-ee02-464a-b105-5e87555d50f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182902 Oct 29 03:00:42.848210 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1879/3663] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:42.882404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4097715f-652b-41c4-90c9-b14f3bc64b6f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:42.886467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4097715f-652b-41c4-90c9-b14f3bc64b6f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:42.914707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4097715f-652b-41c4-90c9-b14f3bc64b6f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:42.926498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4097715f-652b-41c4-90c9-b14f3bc64b6f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:42.930424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4097715f-652b-41c4-90c9-b14f3bc64b6f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:42.934021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4097715f-652b-41c4-90c9-b14f3bc64b6f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:42.938511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4097715f-652b-41c4-90c9-b14f3bc64b6f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:42.946388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4097715f-652b-41c4-90c9-b14f3bc64b6f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:43.204840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-61f441e2-5a7f-4310-aa1d-3315b8a17abe tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:43.217649 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-61f441e2-5a7f-4310-aa1d-3315b8a17abe tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.896810 Oct 29 03:00:43.219266 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1785/3664] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:42 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:43.225367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-dd374995-5c4d-4376-9ddb-ffee2c8be4f4 req-e80926c2-16ec-454b-8876-b6df1afc7ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a", "name": "network-vif-deleted", "tag": "e4625ea7-a638-4eb4-80bf-1b9a17436058"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:43.235770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-dd374995-5c4d-4376-9ddb-ffee2c8be4f4 req-e80926c2-16ec-454b-8876-b6df1afc7ce1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:43.236625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-dd374995-5c4d-4376-9ddb-ffee2c8be4f4 req-e80926c2-16ec-454b-8876-b6df1afc7ce1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:43.237271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-dd374995-5c4d-4376-9ddb-ffee2c8be4f4 req-e80926c2-16ec-454b-8876-b6df1afc7ce1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:43.279735 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-dd374995-5c4d-4376-9ddb-ffee2c8be4f4 req-e80926c2-16ec-454b-8876-b6df1afc7ce1 service nova] Creating event network-vif-deleted:e4625ea7-a638-4eb4-80bf-1b9a17436058 for instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a on n-h2-862964-4 Oct 29 03:00:43.299074 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-dd374995-5c4d-4376-9ddb-ffee2c8be4f4 req-e80926c2-16ec-454b-8876-b6df1afc7ce1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078232 Oct 29 03:00:43.302851 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1786/3665] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:43.318608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-6e40e3ab-cbda-4362-bcd9-4481d9503bee req-1a0b4bff-3c3d-47ee-a24d-3d74d5d5e787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31241403-2a17-4f40-818d-fc8caca85e4b", "name": "network-vif-plugged", "status": "completed", "tag": "e6f1a4fa-984f-49dc-a400-07b55f9cbbeb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:43.349920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6e40e3ab-cbda-4362-bcd9-4481d9503bee req-1a0b4bff-3c3d-47ee-a24d-3d74d5d5e787 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:43.350777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6e40e3ab-cbda-4362-bcd9-4481d9503bee req-1a0b4bff-3c3d-47ee-a24d-3d74d5d5e787 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:43.351472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6e40e3ab-cbda-4362-bcd9-4481d9503bee req-1a0b4bff-3c3d-47ee-a24d-3d74d5d5e787 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:43.359911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4097715f-652b-41c4-90c9-b14f3bc64b6f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fceb096cc5414b3a9d7300fefeb90dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616962eaa7c0469bb81953b54e70afad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:43.371707 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4097715f-652b-41c4-90c9-b14f3bc64b6f tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 200 len: 1455 microversion: 2.1 time: 0.521738 Oct 29 03:00:43.379967 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1880/3666] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:42 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 1455 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:43.398035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:43.402831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:43.408601 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-6e40e3ab-cbda-4362-bcd9-4481d9503bee req-1a0b4bff-3c3d-47ee-a24d-3d74d5d5e787 service nova] Creating event network-vif-plugged:e6f1a4fa-984f-49dc-a400-07b55f9cbbeb for instance 31241403-2a17-4f40-818d-fc8caca85e4b on n-h1-862964-4 Oct 29 03:00:43.430702 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-6e40e3ab-cbda-4362-bcd9-4481d9503bee req-1a0b4bff-3c3d-47ee-a24d-3d74d5d5e787 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125908 Oct 29 03:00:43.432300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:43.432904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:43.435059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:43.438092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:43.438376 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1787/3667] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:43.438964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:43.440613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:43.584678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:43.592765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:43.593515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:43.599144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lazy-loading 'fault' on Instance uuid 586d2052-3b4d-4539-9947-189e93c1dd8b {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:43.680391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:43.682241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:43.702472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:43.703796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:43.705735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:43.708997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:43.709769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:43.710458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.054238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3151f4e39a646e1a3ba3585bc00b2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d85e030cdfd49bfa36d55f2aa1a074c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:44.133891 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ca305899-2be1-48da-81b4-db474029250b tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 200 len: 1310 microversion: 2.1 time: 0.750339 Oct 29 03:00:44.144478 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1881/3668] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:43 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 1310 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:44.176581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:44.214894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:44.219408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:44.221927 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fb46b89e-8a5f-475c-90db-60c87c4af412 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.546533 Oct 29 03:00:44.223148 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1788/3669] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:43 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:44.258836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac980c43-03ef-461a-8b69-d968e568dce9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:44.260498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac980c43-03ef-461a-8b69-d968e568dce9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:44.282377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac980c43-03ef-461a-8b69-d968e568dce9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.283195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac980c43-03ef-461a-8b69-d968e568dce9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.283678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac980c43-03ef-461a-8b69-d968e568dce9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.284437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac980c43-03ef-461a-8b69-d968e568dce9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.284887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac980c43-03ef-461a-8b69-d968e568dce9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.285307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac980c43-03ef-461a-8b69-d968e568dce9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.409781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:44.410534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:44.426006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.426260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.426746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.436997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.437779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.438404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.487595 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a HTTP/1.1 Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a'} Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:44.494504 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.499786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.499786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:44.499786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:44.499786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:44.499786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:44.499786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.499786 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.506731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:44.510543 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cfbdc0fe-edc1-4016-82dd-81ed64603a2b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 404 len: 111 microversion: 2.1 time: 0.105765 Oct 29 03:00:44.519209 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1789/3670] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:44 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:44.531837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:44.533927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:44.562997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.563772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.564396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.570951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.571749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.572626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.624777 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a HTTP/1.1 Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a'} Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:44.626895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:44.632209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.632209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.632209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:44.632209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.632209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.632209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:44.632209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:44.632209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:44.632209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:44.632209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.632209 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.634054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:44.635092 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-21d97de1-efc6-4fe5-8374-536e0fe6beb4 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 404 len: 111 microversion: 2.1 time: 0.107338 Oct 29 03:00:44.642340 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1790/3671] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:44 2022] DELETE /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:00:44.651238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:44.656390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:44.671797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.672716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.673344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.678268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.679008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.679731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.695374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:44.724516 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a HTTP/1.1 Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a'} Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:44.726576 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.731968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.731968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:44.731968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:44.731968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:44.731968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:44.731968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. Oct 29 03:00:44.731968 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.736973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:44.738210 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cbeee1f7-544f-4411-a9a1-01cc2f6dc828 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a" status: 404 len: 111 microversion: 2.1 time: 0.094605 Oct 29 03:00:44.746184 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1791/3672] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:44 2022] GET /compute/v2.1/servers/758182bd-3f4f-4f8e-a3b1-9cd6abe9b12a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:44.766933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:44.770149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:44.786885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.788980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.791970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.792999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.794290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.799631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.839157 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 HTTP/1.1 Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1e46368f-b3d8-43ea-967f-ac129d25db58'} Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:44.844526 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:44.850992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:44.850992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.850992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:44.850992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.850992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.850992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:44.850992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:44.850992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:44.850992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:44.850992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:44.850992 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.853924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:44.856800 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c837a734-2d68-43c2-8a9b-f9af5f22f56b tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 404 len: 111 microversion: 2.1 time: 0.096275 Oct 29 03:00:44.857600 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1792/3673] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:44 2022] DELETE /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:44.875589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:44.884009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1e46368f-b3d8-43ea-967f-ac129d25db58] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:44.896294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.901549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.902884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.905753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.906264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.906690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.945238 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 HTTP/1.1 Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1e46368f-b3d8-43ea-967f-ac129d25db58'} Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:44.947502 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.952956 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:44.952956 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:44.952956 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:44.952956 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:44.952956 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:44.952956 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. Oct 29 03:00:44.952956 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:44.954609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 1e46368f-b3d8-43ea-967f-ac129d25db58 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:44.955946 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7e6125ff-19b8-49e4-9097-eeb757b7f5cd tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58" status: 404 len: 111 microversion: 2.1 time: 0.085686 Oct 29 03:00:44.963186 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1793/3674] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:44 2022] GET /compute/v2.1/servers/1e46368f-b3d8-43ea-967f-ac129d25db58 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:44.981277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:44.984854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:45.008180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.008998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.009675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.010648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.011271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.011858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.031147 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db HTTP/1.1 Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3a570891-4387-4f63-a59a-aa60fe7360db'} Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:45.032988 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:45.038215 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 03:00:45.038215 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.038215 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.038215 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.038215 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.038215 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.038215 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.038215 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:45.038215 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:45.038215 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 03:00:45.038215 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.040603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:45.041659 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-22d09e6a-3611-4779-8e43-a58fd86e8d16 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 404 len: 111 microversion: 2.1 time: 0.074379 Oct 29 03:00:45.046293 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1794/3675] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:44 2022] DELETE /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:45.052810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:45.053760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3a570891-4387-4f63-a59a-aa60fe7360db] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:45.060803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.061546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.062250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.063167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.063900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.064488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.105139 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db HTTP/1.1 Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3a570891-4387-4f63-a59a-aa60fe7360db'} Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.107370 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.112903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.112903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.112903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.112903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:45.112903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:45.112903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. Oct 29 03:00:45.112903 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.116401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 3a570891-4387-4f63-a59a-aa60fe7360db could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:45.119466 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f01562c5-428f-4bb0-9e89-f338d3b8aaa3 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db" status: 404 len: 111 microversion: 2.1 time: 0.071550 Oct 29 03:00:45.126572 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1795/3676] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:45 2022] GET /compute/v2.1/servers/3a570891-4387-4f63-a59a-aa60fe7360db => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:45.137182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:45.138046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:45.148904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.149594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.151449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.152533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.153400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.154154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.199719 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 HTTP/1.1 Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1'} Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:45.206188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:45.211875 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 03:00:45.211875 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.211875 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.211875 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.211875 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.211875 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.211875 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.211875 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:45.211875 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:45.211875 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 03:00:45.211875 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.215716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:45.217460 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7eafae97-26fe-469b-9caa-a62b6cd243c9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 404 len: 111 microversion: 2.1 time: 0.088936 Oct 29 03:00:45.225722 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1796/3677] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:45 2022] DELETE /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:45.241699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:45.242433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] [instance: 586d2052-3b4d-4539-9947-189e93c1dd8b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:45.255038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.257945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.258517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.260525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.261778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.262808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.297915 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] HTTP exception thrown: Instance 586d2052-3b4d-4539-9947-189e93c1dd8b could not be found. Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Request method failure captured: Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b HTTP/1.1 Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJcX4sZ4oD175nG_PsTKo0OOgnNS8LmgOv6zV-rrQPBIy_RnpImRU2Q-GUn7TcGNsz-Agz3RLBRL3sPRD6CFB1PcpE_ab5L8sZh0-OnNMzPuCZBX1OM_osSYHjPy1ksFqBqdU9SITm5gE24ht3maICyISJ69PG8LOQjweyOlWFf292U Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 5d85e030cdfd49bfa36d55f2aa1a074c Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-665001369 Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d85e030cdfd49bfa36d55f2aa1a074c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d85e030cdfd49bfa36d55f2aa1a074c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d85e030cdfd49bfa36d55f2aa1a074c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d85e030cdfd49bfa36d55f2aa1a074c"}]}] Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersAdminNegativeTestJSON-665001369 Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 5d85e030cdfd49bfa36d55f2aa1a074c Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-665001369 Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersAdminNegativeTestJSON-665001369-project Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a3151f4e39a646e1a3ba3585bc00b2ab Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersAdminNegativeTestJSON-665001369-project Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 586d2052-3b4d-4539-9947-189e93c1dd8b could not be found. Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '586d2052-3b4d-4539-9947-189e93c1dd8b'} Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586d2052-3b4d-4539-9947-189e93c1dd8b could not be found. Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586d2052-3b4d-4539-9947-189e93c1dd8b could not be found. Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.299617 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.306006 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.306006 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.306006 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.306006 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.306006 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:45.306006 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:45.306006 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586d2052-3b4d-4539-9947-189e93c1dd8b could not be found. Oct 29 03:00:45.306006 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.306006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] Returning 404 to user: Instance 586d2052-3b4d-4539-9947-189e93c1dd8b could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:45.309077 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3fc00e7a-1761-4c15-b058-5e6eb955cafa tempest-ServersAdminNegativeTestJSON-665001369 tempest-ServersAdminNegativeTestJSON-665001369-project] 10.222.0.16 "GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b" status: 404 len: 111 microversion: 2.1 time: 0.079048 Oct 29 03:00:45.313924 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1797/3678] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:45 2022] GET /compute/v2.1/servers/586d2052-3b4d-4539-9947-189e93c1dd8b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:45.322103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:45.322897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:45.345767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.350787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.351347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.352437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.358533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.360093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.414366 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 HTTP/1.1 Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1'} Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.416091 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.425087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.425087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.425087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.425087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:45.425087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:45.425087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. Oct 29 03:00:45.425087 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.425087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:45.425087 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8535c855-3b30-438d-b065-7f1a06f3bc17 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1" status: 404 len: 111 microversion: 2.1 time: 0.109294 Oct 29 03:00:45.437855 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1798/3679] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:45 2022] GET /compute/v2.1/servers/2d4a157a-a8d3-40a6-b4f1-72f7380ab5e1 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:45.449669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:45.450469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:45.470506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.478938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.479675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.480525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.481177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.481794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.855796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:45.872089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:45.874007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:45.877307 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8973f5a3-fe1c-4220-8c64-a9671b1e736e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.438249 Oct 29 03:00:45.892722 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1799/3680] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:45 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:45.905313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b6976bc-fcfe-4f7c-9a0a-224ea83e93a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:45.914254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b6976bc-fcfe-4f7c-9a0a-224ea83e93a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3d515818-9b5a-4016-93ba-e06ae489d4b3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:45.935300 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-2b6976bc-fcfe-4f7c-9a0a-224ea83e93a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b6976bc-fcfe-4f7c-9a0a-224ea83e93a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3 HTTP/1.1 Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3d515818-9b5a-4016-93ba-e06ae489d4b3'} Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.936895 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.944941 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.944941 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.944941 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.944941 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.944941 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:45.944941 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:45.944941 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 03:00:45.944941 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.944941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b6976bc-fcfe-4f7c-9a0a-224ea83e93a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:45.944941 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b6976bc-fcfe-4f7c-9a0a-224ea83e93a9 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3" status: 404 len: 111 microversion: 2.1 time: 0.049350 Oct 29 03:00:45.954766 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1800/3681] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:45 2022] DELETE /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:45.971674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-47927721-4197-4b6c-91f6-699a9587cb88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:45.972345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-47927721-4197-4b6c-91f6-699a9587cb88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 3d515818-9b5a-4016-93ba-e06ae489d4b3] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:45.994915 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-47927721-4197-4b6c-91f6-699a9587cb88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-47927721-4197-4b6c-91f6-699a9587cb88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3 HTTP/1.1 Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3d515818-9b5a-4016-93ba-e06ae489d4b3'} Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:45.996455 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:46.003472 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:46.003472 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:46.003472 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:46.003472 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. Oct 29 03:00:46.003472 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:46.003472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-47927721-4197-4b6c-91f6-699a9587cb88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 3d515818-9b5a-4016-93ba-e06ae489d4b3 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:46.005166 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-47927721-4197-4b6c-91f6-699a9587cb88 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3" status: 404 len: 111 microversion: 2.1 time: 0.048141 Oct 29 03:00:46.008381 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1801/3682] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:45 2022] GET /compute/v2.1/servers/3d515818-9b5a-4016-93ba-e06ae489d4b3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:46.453932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac980c43-03ef-461a-8b69-d968e568dce9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:46.485947 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac980c43-03ef-461a-8b69-d968e568dce9 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 2.231046 Oct 29 03:00:46.517320 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1882/3683] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:44 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:46.906864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:46.907833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:46.932651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:46.936744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:46.937364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:46.938394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:46.939335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:46.950733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:47.534662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59f86c4c-2a75-4262-861a-4b4d85eaa27c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:47.538616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59f86c4c-2a75-4262-861a-4b4d85eaa27c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:47.632416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f86c4c-2a75-4262-861a-4b4d85eaa27c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:47.641123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f86c4c-2a75-4262-861a-4b4d85eaa27c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:47.643144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f86c4c-2a75-4262-861a-4b4d85eaa27c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:47.670164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f86c4c-2a75-4262-861a-4b4d85eaa27c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:47.675995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f86c4c-2a75-4262-861a-4b4d85eaa27c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:47.676565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f86c4c-2a75-4262-861a-4b4d85eaa27c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:47.805271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:47.817971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:47.823416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:47.828322 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ae5c5fad-5fa6-45d9-95cf-d2ed471d6a98 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.928740 Oct 29 03:00:47.832462 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1802/3684] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:46 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:48.518964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59f86c4c-2a75-4262-861a-4b4d85eaa27c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:48.589203 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59f86c4c-2a75-4262-861a-4b4d85eaa27c tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 1.052278 Oct 29 03:00:48.594267 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1883/3685] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:47 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:48.857759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:48.859134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:48.866595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:48.872153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:48.876658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:48.877833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:48.879097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:48.879770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:49.617389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3c2c3e6c-b28a-424c-983e-4c6b9981b374 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:49.618025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3c2c3e6c-b28a-424c-983e-4c6b9981b374 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:49.641445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2c3e6c-b28a-424c-983e-4c6b9981b374 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:49.643101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2c3e6c-b28a-424c-983e-4c6b9981b374 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:49.646299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2c3e6c-b28a-424c-983e-4c6b9981b374 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:49.647593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2c3e6c-b28a-424c-983e-4c6b9981b374 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:49.648235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2c3e6c-b28a-424c-983e-4c6b9981b374 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:49.648918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c2c3e6c-b28a-424c-983e-4c6b9981b374 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:49.728274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:49.974830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:49.994004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:50.000324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:50.004791 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ebb97be-3ae7-4443-8e75-290f6345d9aa tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 1.148053 Oct 29 03:00:50.005675 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1803/3686] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:48 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:50.076733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c2c3e6c-b28a-424c-983e-4c6b9981b374 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:50.129641 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3c2c3e6c-b28a-424c-983e-4c6b9981b374 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.516888 Oct 29 03:00:50.133434 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1884/3687] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:49 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:51.040750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:51.042545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:51.071837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.072767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.075135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.077838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.081968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.082794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.160797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4c8b1892-e053-46c6-8884-9fdfb9e2e566 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:51.166673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4c8b1892-e053-46c6-8884-9fdfb9e2e566 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:51.193731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8b1892-e053-46c6-8884-9fdfb9e2e566 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.196578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8b1892-e053-46c6-8884-9fdfb9e2e566 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.198687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8b1892-e053-46c6-8884-9fdfb9e2e566 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.205520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8b1892-e053-46c6-8884-9fdfb9e2e566 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.208420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8b1892-e053-46c6-8884-9fdfb9e2e566 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.209066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8b1892-e053-46c6-8884-9fdfb9e2e566 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.815255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:51.836162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:51.839482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:51.840736 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ec689870-a97c-4d5b-9cbf-5cb4fae8d6e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.806402 Oct 29 03:00:51.871307 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1804/3688] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:51 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:52.805186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-89e1e482-d637-408a-b4ed-630b19dca11a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Action: 'create', calling method: .version_select at 0x7fe1a8475d30>, body: {"keypair": {"name": "tempest-keypair-2130320404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzeFcyNrcbcHVw4zMfrmUlHIu5T6cw9YmCtigZr9z7czCNUQ2dO7/tCAqy4czIG6XphIICNxtI26FnxRZDMxiFzceYBI2Jai8lqK9zLxET9cllJL7HOEucMBcn1s6yeqA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:52.843765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-89e1e482-d637-408a-b4ed-630b19dca11a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Getting quotas for project bf7809d4281c4efa9330464b86c1ee27. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:52.874348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-89e1e482-d637-408a-b4ed-630b19dca11a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Getting quotas for user 0bb215bc0435419eb2659aceb19ea58a and project bf7809d4281c4efa9330464b86c1ee27. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:52.962186 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-89e1e482-d637-408a-b4ed-630b19dca11a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.160961 Oct 29 03:00:52.973485 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1805/3689] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Oct 29 03:00:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 03:00:52.993242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:53.003919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4c8b1892-e053-46c6-8884-9fdfb9e2e566 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:53.012650 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4c8b1892-e053-46c6-8884-9fdfb9e2e566 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 1.857204 Oct 29 03:00:53.017907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:53.021722 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1885/3690] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:51 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:53.046718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:53.049119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:53.056927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:53.057711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:53.058240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:53.069648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.049375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-43324542-bb0e-45a2-9bf0-a05704e581ee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:54.049939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-43324542-bb0e-45a2-9bf0-a05704e581ee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:54.096745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43324542-bb0e-45a2-9bf0-a05704e581ee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.097287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43324542-bb0e-45a2-9bf0-a05704e581ee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.097729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43324542-bb0e-45a2-9bf0-a05704e581ee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.098486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43324542-bb0e-45a2-9bf0-a05704e581ee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.099278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43324542-bb0e-45a2-9bf0-a05704e581ee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.115885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43324542-bb0e-45a2-9bf0-a05704e581ee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.145476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:54.156279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:54.158586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:54.160862 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d5456c4-b923-48b5-9db0-3052ca322d9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 1.184227 Oct 29 03:00:54.166684 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1806/3691] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:52 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:54.528044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-04e98fc1-852d-4b21-b825-38405238b379 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:54.532812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04e98fc1-852d-4b21-b825-38405238b379 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.534320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04e98fc1-852d-4b21-b825-38405238b379 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.538987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04e98fc1-852d-4b21-b825-38405238b379 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.541814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04e98fc1-852d-4b21-b825-38405238b379 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.542598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04e98fc1-852d-4b21-b825-38405238b379 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.545436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04e98fc1-852d-4b21-b825-38405238b379 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.583813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:54.624641 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-04e98fc1-852d-4b21-b825-38405238b379 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.441103 Oct 29 03:00:54.628100 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1807/3692] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 03:00:54 2022] GET /compute/v2.1/os-services => generated 944 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:54.638762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:54.644643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:54.671510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.672887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.673526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.680184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.681082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.681689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.740354 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 HTTP/1.1 Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1615ba83-e03b-4936-9ea2-f08ea0436ec9'} Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:54.746054 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:54.751781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 03:00:54.751781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:54.751781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:54.751781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:54.751781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:54.751781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:54.751781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:54.751781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:54.751781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:54.751781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 03:00:54.751781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:54.756512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:54.762104 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-535db5a1-4562-4600-b418-507e3065cade tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 404 len: 111 microversion: 2.1 time: 0.132359 Oct 29 03:00:54.764920 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1808/3693] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:54 2022] DELETE /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:54.785562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7ff559e6-b1a0-4afa-b6df-ab4c3351d157 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:54.803768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff559e6-b1a0-4afa-b6df-ab4c3351d157 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.812434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff559e6-b1a0-4afa-b6df-ab4c3351d157 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.814396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff559e6-b1a0-4afa-b6df-ab4c3351d157 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.815467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff559e6-b1a0-4afa-b6df-ab4c3351d157 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.817718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff559e6-b1a0-4afa-b6df-ab4c3351d157 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.819474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff559e6-b1a0-4afa-b6df-ab4c3351d157 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.931325 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7ff559e6-b1a0-4afa-b6df-ab4c3351d157 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.155772 Oct 29 03:00:54.936969 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1809/3694] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Oct 29 03:00:54 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:54.949905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:54.953015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 1615ba83-e03b-4936-9ea2-f08ea0436ec9] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:54.971632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.974879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.975622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.977634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.979835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.980543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.021762 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 HTTP/1.1 Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1615ba83-e03b-4936-9ea2-f08ea0436ec9'} Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:55.030787 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:55.037258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:55.037258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:55.037258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:55.037258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:55.037258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:55.037258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. Oct 29 03:00:55.037258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:55.039422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 1615ba83-e03b-4936-9ea2-f08ea0436ec9 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:55.040553 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-82e0f9a6-2e26-49f4-9caa-a0d50a26b609 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9" status: 404 len: 111 microversion: 2.1 time: 0.101992 Oct 29 03:00:55.045915 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1810/3695] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:54 2022] GET /compute/v2.1/servers/1615ba83-e03b-4936-9ea2-f08ea0436ec9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:55.064008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2705f7a3-fc7e-419d-aa08-5b571cdfb80e tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:55.070024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2705f7a3-fc7e-419d-aa08-5b571cdfb80e tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.075262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2705f7a3-fc7e-419d-aa08-5b571cdfb80e tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.077911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2705f7a3-fc7e-419d-aa08-5b571cdfb80e tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.079496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2705f7a3-fc7e-419d-aa08-5b571cdfb80e tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.082108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2705f7a3-fc7e-419d-aa08-5b571cdfb80e tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.082838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2705f7a3-fc7e-419d-aa08-5b571cdfb80e tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.149127 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2705f7a3-fc7e-419d-aa08-5b571cdfb80e tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.101713 Oct 29 03:00:55.171870 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1811/3696] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 03:00:55 2022] GET /compute/v2.1/os-services => generated 944 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:55.176887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:55.182209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:55.202335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.202833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.203266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.203982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.204414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.204828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.255075 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 HTTP/1.1 Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '59fa09ed-b246-47b4-91a8-408031ac5835'} Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:55.261458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:55.265744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 03:00:55.265744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:55.265744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:55.265744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:55.265744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:55.265744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:55.265744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:55.265744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:55.265744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:55.265744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 03:00:55.265744 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:00:55.269774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:55.273534 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-094d19b4-d2cc-4fea-a1a2-7c98111afe58 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 404 len: 111 microversion: 2.1 time: 0.100505 Oct 29 03:00:55.279654 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1812/3697] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:55 2022] DELETE /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:55.284830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-181dc066-43ac-4794-990e-137f10f7e41c tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:55.294356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-181dc066-43ac-4794-990e-137f10f7e41c tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.297527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-181dc066-43ac-4794-990e-137f10f7e41c tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.301038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-181dc066-43ac-4794-990e-137f10f7e41c tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.304519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-181dc066-43ac-4794-990e-137f10f7e41c tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.305268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-181dc066-43ac-4794-990e-137f10f7e41c tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.305968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-181dc066-43ac-4794-990e-137f10f7e41c tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.366856 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-181dc066-43ac-4794-990e-137f10f7e41c tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-862964-4&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.085364 Oct 29 03:00:55.378302 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1813/3698] 10.222.0.16 () {58 vars in 1194 bytes} [Sat Oct 29 03:00:55 2022] GET /compute/v2.1/os-services?host=n-d-862964-4&binary=xxx => generated 16 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:00:55.391945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:55.392964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:55.404436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.406337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.408896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.418691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.419686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.420375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:56.330660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-43324542-bb0e-45a2-9bf0-a05704e581ee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:56.353317 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-43324542-bb0e-45a2-9bf0-a05704e581ee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 2.308974 Oct 29 03:00:56.354772 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1886/3699] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:54 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 2311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:00:56.393655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:56.394783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] [instance: 59fa09ed-b246-47b4-91a8-408031ac5835] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:56.417151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:56.418735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:56.419434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:56.420577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:56.421249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:56.421939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:56.453966 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] HTTP exception thrown: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Request method failure captured: Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 HTTP/1.1 Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJYFjagqP2SKOYPKireVmBCtQ254v_A9M3XFBcgYvEJdImhdBGPKzikseLKARKBcPDRxEi8I_9xfws02l2sZz3yIcFbQHECjGWRxkZWqa8S3nYZ0B1Es4JgNuk3tgptYYmdj1wy_27P1ljDrAsEA6Sdo6bhXahGaPocSLp5oT3RJrZo Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_616962eaa7c0469bb81953b54e70afad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/616962eaa7c0469bb81953b54e70afad"}]}] Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 616962eaa7c0469bb81953b54e70afad Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-DeleteServersTestJSON-1000708950 Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: fceb096cc5414b3a9d7300fefeb90dff Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-DeleteServersTestJSON-1000708950-project Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '59fa09ed-b246-47b4-91a8-408031ac5835'} Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:56.458723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:56.463274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:56.463274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:56.463274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:56.463274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:56.463274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:56.463274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. Oct 29 03:00:56.463274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:56.469289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] Returning 404 to user: Instance 59fa09ed-b246-47b4-91a8-408031ac5835 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:56.470565 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-658dd647-88b5-448a-ac9c-4187d901f4d1 tempest-DeleteServersTestJSON-1000708950 tempest-DeleteServersTestJSON-1000708950-project] 10.222.0.16 "GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835" status: 404 len: 111 microversion: 2.1 time: 0.089087 Oct 29 03:00:56.472883 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1887/3700] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:56 2022] GET /compute/v2.1/servers/59fa09ed-b246-47b4-91a8-408031ac5835 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:56.480033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7bb078ad-8663-42e1-a0aa-e42e4b52b10b tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:56.492898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bb078ad-8663-42e1-a0aa-e42e4b52b10b tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:56.496621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bb078ad-8663-42e1-a0aa-e42e4b52b10b tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:56.497407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bb078ad-8663-42e1-a0aa-e42e4b52b10b tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:56.498515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bb078ad-8663-42e1-a0aa-e42e4b52b10b tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:56.500670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bb078ad-8663-42e1-a0aa-e42e4b52b10b tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:56.501709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bb078ad-8663-42e1-a0aa-e42e4b52b10b tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:56.601425 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7bb078ad-8663-42e1-a0aa-e42e4b52b10b tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.127079 Oct 29 03:00:56.609689 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1888/3701] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 03:00:56 2022] GET /compute/v2.1/os-services => generated 944 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:56.620364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f0eff327-31ee-4355-92d7-3d2ca3d39c34 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:56.636393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0eff327-31ee-4355-92d7-3d2ca3d39c34 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:56.637321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0eff327-31ee-4355-92d7-3d2ca3d39c34 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:56.638021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0eff327-31ee-4355-92d7-3d2ca3d39c34 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:56.639164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0eff327-31ee-4355-92d7-3d2ca3d39c34 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:56.640445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0eff327-31ee-4355-92d7-3d2ca3d39c34 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:56.642165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0eff327-31ee-4355-92d7-3d2ca3d39c34 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:56.711240 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f0eff327-31ee-4355-92d7-3d2ca3d39c34 tempest-ServicesAdminNegativeTestJSON-1678809706 tempest-ServicesAdminNegativeTestJSON-1678809706-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.095378 Oct 29 03:00:56.726527 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1889/3702] 10.222.0.16 () {58 vars in 1198 bytes} [Sat Oct 29 03:00:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:00:57.040555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d09a09a4-bb87-4001-bcab-7e9b719fe361 tempest-ServicesAdminNegativeTestJSON-820658454 tempest-ServicesAdminNegativeTestJSON-820658454-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:57.045099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d09a09a4-bb87-4001-bcab-7e9b719fe361 tempest-ServicesAdminNegativeTestJSON-820658454 tempest-ServicesAdminNegativeTestJSON-820658454-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'caa0257cf6a6466a8ec5e5dd98da6289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b39d3645764c74ab59a8e0e1f11cdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d09a09a4-bb87-4001-bcab-7e9b719fe361 tempest-ServicesAdminNegativeTestJSON-820658454 tempest-ServicesAdminNegativeTestJSON-820658454-project] Request method failure captured: Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJdk2nqCERqqQGK_bmc2hZ3K2QqcO_19vrEvXllTifbU6ohcM2jaW-GyyCZ_gZlY_1kOBqRDdNqli0otQ2Xlz4_2uZRvJqL--uzo8xB980Ks5OuMcn80wQLlrGgF9CopeQ3Mir5bYRran45eupfCCxkiYiPAWksfIrSdYvZCChwQCWQ Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 40b39d3645764c74ab59a8e0e1f11cdb Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-820658454 Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40b39d3645764c74ab59a8e0e1f11cdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40b39d3645764c74ab59a8e0e1f11cdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40b39d3645764c74ab59a8e0e1f11cdb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40b39d3645764c74ab59a8e0e1f11cdb"}]}] Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-820658454 Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 40b39d3645764c74ab59a8e0e1f11cdb Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-820658454 Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServicesAdminNegativeTestJSON-820658454-project Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: caa0257cf6a6466a8ec5e5dd98da6289 Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-820658454-project Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: action_args: {} Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 03:00:57.048846 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:57.055145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:57.055145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:57.055145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:57.055145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:57.055145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:57.055145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 03:00:57.055145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 03:00:57.055145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 03:00:57.055145 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:00:57.067558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d09a09a4-bb87-4001-bcab-7e9b719fe361 tempest-ServicesAdminNegativeTestJSON-820658454 tempest-ServicesAdminNegativeTestJSON-820658454-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:57.069626 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d09a09a4-bb87-4001-bcab-7e9b719fe361 tempest-ServicesAdminNegativeTestJSON-820658454 tempest-ServicesAdminNegativeTestJSON-820658454-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.341755 Oct 29 03:00:57.072156 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1890/3703] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 03:00:56 2022] GET /compute/v2.1/os-services => generated 112 bytes in 345 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:57.083494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:57.095490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:57.096942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:57.103587 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7c4888b5-2a98-4651-9f1b-26e07bacd8d4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 1.718541 Oct 29 03:00:57.104259 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1814/3704] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:55 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:57.383136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-49cbfb88-34ca-4da9-abe0-93d5bc65a3e6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:57.384971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-49cbfb88-34ca-4da9-abe0-93d5bc65a3e6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:57.417330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49cbfb88-34ca-4da9-abe0-93d5bc65a3e6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:57.418720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49cbfb88-34ca-4da9-abe0-93d5bc65a3e6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:57.419780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49cbfb88-34ca-4da9-abe0-93d5bc65a3e6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:57.423999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49cbfb88-34ca-4da9-abe0-93d5bc65a3e6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:57.425902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49cbfb88-34ca-4da9-abe0-93d5bc65a3e6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:57.426635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49cbfb88-34ca-4da9-abe0-93d5bc65a3e6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:58.001428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-49cbfb88-34ca-4da9-abe0-93d5bc65a3e6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:58.010405 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-49cbfb88-34ca-4da9-abe0-93d5bc65a3e6 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1517 microversion: 2.1 time: 0.632722 Oct 29 03:00:58.014203 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1891/3705] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:57 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1517 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:58.138278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:58.139035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:58.154047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:58.154744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:58.157181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:58.160847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:58.162360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:58.162975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:58.759366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:58.768881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:58.770446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:58.771634 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d6c3fcf1-ce82-41c7-b34a-897c97cb141e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.637530 Oct 29 03:00:58.772205 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1815/3706] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:58 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:59.038690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-016f54dc-9238-4eaa-92bc-1126233efe48 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:59.039651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-016f54dc-9238-4eaa-92bc-1126233efe48 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:59.054649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-016f54dc-9238-4eaa-92bc-1126233efe48 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:59.055781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-016f54dc-9238-4eaa-92bc-1126233efe48 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:59.065447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-016f54dc-9238-4eaa-92bc-1126233efe48 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:59.072257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-016f54dc-9238-4eaa-92bc-1126233efe48 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:59.075191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-016f54dc-9238-4eaa-92bc-1126233efe48 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:59.077628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-016f54dc-9238-4eaa-92bc-1126233efe48 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:59.803522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:59.807142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:59.814994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:59.824246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:59.824916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:59.825856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:59.826409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:59.827964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:00.128211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-016f54dc-9238-4eaa-92bc-1126233efe48 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:00.151764 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-016f54dc-9238-4eaa-92bc-1126233efe48 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1523 microversion: 2.1 time: 1.119762 Oct 29 03:01:00.152375 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1892/3707] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:59 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1523 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:00.308383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:00.331175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:00.333515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:00.335461 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b4759fa9-2e76-4561-bbe4-00d69a3a1262 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.538029 Oct 29 03:01:00.336356 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1816/3708] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:59 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:00.956490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1620517015", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e4d037b2-f132-4864-b484-22fd23f5c373"}, {"port": "bdbee0eb-ffe5-46aa-bf13-64202754d2b4", "tag": "port-1"}, {"port": "278acd07-af3d-45fa-b282-64d5acdc531b", "tag": "port-2"}, {"uuid": "46ec54fe-a7ee-4c75-af2e-822729930f47", "tag": "net-1"}, {"uuid": "46ec54fe-a7ee-4c75-af2e-822729930f47"}, {"uuid": "0373d36a-10fd-470d-9db7-6e895bbaa225", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0373d36a-10fd-470d-9db7-6e895bbaa225", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "be83f702-cf40-4b7a-b071-289214d41f22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "657402ce-3a83-4d28-8c50-4a52ff787f44", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ec0fd410-e170-4956-97ea-fed13f85c474", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--835020602"}], "key_name": "tempest-keypair-2130320404", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:01.432633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1860739160", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:01.459413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] validate_networks() for [('e4d037b2-f132-4864-b484-22fd23f5c373', None, None, None, None, None), (None, None, 'bdbee0eb-ffe5-46aa-bf13-64202754d2b4', None, None, None), (None, None, '278acd07-af3d-45fa-b282-64d5acdc531b', None, None, None), ('46ec54fe-a7ee-4c75-af2e-822729930f47', None, None, None, None, None), ('46ec54fe-a7ee-4c75-af2e-822729930f47', None, None, None, None, None), ('0373d36a-10fd-470d-9db7-6e895bbaa225', '10.2.2.100', None, None, None, None), ('0373d36a-10fd-470d-9db7-6e895bbaa225', '10.2.2.200', None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:01:01.594369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] validate_networks() for [('122727e1-3472-41cb-8cbc-137789a0f19f', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:01:02.776579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:01:02.777172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:01:02.777678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:01:02.778497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:01:02.778627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:01:02.795649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:02.796139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:02.806214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:02.808137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:02.808541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:02.808979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:02.854805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Getting quotas for project 189356634b6049a3a44bb701d8529d13. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:02.874975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Getting quotas for user 541c48e9a20d4b04a33018145c1fce9f and project 189356634b6049a3a44bb701d8529d13. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:02.929882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:01:02.938884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:01:03.127231 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b83664d2-e069-4e10-9248-563e93326cf6 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.042988 Oct 29 03:01:03.133919 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1817/3709] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:01:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:01:03.151294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dd6863b3-6410-490d-9798-59003dfb5494 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:03.153365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd6863b3-6410-490d-9798-59003dfb5494 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:03.171223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd6863b3-6410-490d-9798-59003dfb5494 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:03.171899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd6863b3-6410-490d-9798-59003dfb5494 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:03.172154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd6863b3-6410-490d-9798-59003dfb5494 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:03.186785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd6863b3-6410-490d-9798-59003dfb5494 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:03.187571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd6863b3-6410-490d-9798-59003dfb5494 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:03.188184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd6863b3-6410-490d-9798-59003dfb5494 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:03.655640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd6863b3-6410-490d-9798-59003dfb5494 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:03.669452 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dd6863b3-6410-490d-9798-59003dfb5494 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1523 microversion: 2.1 time: 0.534288 Oct 29 03:01:03.677543 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1818/3710] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:03 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:03.690920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:03.691527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:03.719285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:03.727513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:03.728142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:03.728907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:03.729374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:03.729831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:04.094431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:04.108407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:04.112984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:04.115634 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-12741ea2-d7f6-4c75-aeca-48410e2f2c21 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.434630 Oct 29 03:01:04.129858 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1819/3711] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:03 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:04.129858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e22cdf7f-1fde-4afb-8426-b3881c1d124f req-427ec06d-9bee-457d-af34-58165b02cd36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011b0dd6-a90d-4ee3-ad93-d4b22a12148e", "name": "network-vif-unplugged", "status": "completed", "tag": "158289ef-ac46-428b-8096-bada975e064f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:04.156148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e22cdf7f-1fde-4afb-8426-b3881c1d124f req-427ec06d-9bee-457d-af34-58165b02cd36 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:04.156549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e22cdf7f-1fde-4afb-8426-b3881c1d124f req-427ec06d-9bee-457d-af34-58165b02cd36 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:04.163935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e22cdf7f-1fde-4afb-8426-b3881c1d124f req-427ec06d-9bee-457d-af34-58165b02cd36 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:04.185638 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e22cdf7f-1fde-4afb-8426-b3881c1d124f req-427ec06d-9bee-457d-af34-58165b02cd36 service nova] Creating event network-vif-unplugged:158289ef-ac46-428b-8096-bada975e064f for instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e on n-h2-862964-4 Oct 29 03:01:04.198447 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e22cdf7f-1fde-4afb-8426-b3881c1d124f req-427ec06d-9bee-457d-af34-58165b02cd36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078156 Oct 29 03:01:04.199636 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1820/3712] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:04.221827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f62a46b3-3fd7-4834-b72b-abeccc367ec7 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:04.222595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f62a46b3-3fd7-4834-b72b-abeccc367ec7 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:04.378292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f62a46b3-3fd7-4834-b72b-abeccc367ec7 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:04.392495 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f62a46b3-3fd7-4834-b72b-abeccc367ec7 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1214 microversion: 2.1 time: 0.191427 Oct 29 03:01:04.396468 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1821/3713] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:04 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:04.705951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce2fe824-2aa8-49e8-9e8f-870f8695b4c4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:04.706556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ce2fe824-2aa8-49e8-9e8f-870f8695b4c4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:04.720028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce2fe824-2aa8-49e8-9e8f-870f8695b4c4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:04.720522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce2fe824-2aa8-49e8-9e8f-870f8695b4c4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:04.720943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce2fe824-2aa8-49e8-9e8f-870f8695b4c4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:04.721641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce2fe824-2aa8-49e8-9e8f-870f8695b4c4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:04.722111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce2fe824-2aa8-49e8-9e8f-870f8695b4c4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:04.729301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce2fe824-2aa8-49e8-9e8f-870f8695b4c4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.342780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ce2fe824-2aa8-49e8-9e8f-870f8695b4c4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:05.366713 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ce2fe824-2aa8-49e8-9e8f-870f8695b4c4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1523 microversion: 2.1 time: 0.664586 Oct 29 03:01:05.368826 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1822/3714] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:04 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1523 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:05.783092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-04ac0294-4b45-4d5d-ae1d-81c6240db19a tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1413179528", "availability_zone": "foo_zone"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:05.790629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.aggregate [None req-04ac0294-4b45-4d5d-ae1d-81c6240db19a tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Generated uuid 97880101-80a6-4187-8cf3-0bcb6fb1139b for aggregate {{(pid=127042) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 03:01:05.919156 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-04ac0294-4b45-4d5d-ae1d-81c6240db19a tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.545343 Oct 29 03:01:05.929741 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1823/3715] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Oct 29 03:01:05 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:05.939424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:05.942198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:05.964389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:05.964934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:05.968618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.970642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:05.974140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:05.976725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.997735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:06.489126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:06.510158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:06.512976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:06.518690 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-56e562e5-841c-43a0-bf85-dccd2acb5b67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.587775 Oct 29 03:01:06.534981 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1824/3716] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:05 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:06.569702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-252681ec-97ae-4652-8bfc-0d6c6f7fc6dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:06.573201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-252681ec-97ae-4652-8bfc-0d6c6f7fc6dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:06.603234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-252681ec-97ae-4652-8bfc-0d6c6f7fc6dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.608412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-252681ec-97ae-4652-8bfc-0d6c6f7fc6dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.609064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-252681ec-97ae-4652-8bfc-0d6c6f7fc6dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.611337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-252681ec-97ae-4652-8bfc-0d6c6f7fc6dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.613788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-252681ec-97ae-4652-8bfc-0d6c6f7fc6dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.620924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-252681ec-97ae-4652-8bfc-0d6c6f7fc6dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.676631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:06.800644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-252681ec-97ae-4652-8bfc-0d6c6f7fc6dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:06.814680 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-252681ec-97ae-4652-8bfc-0d6c6f7fc6dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1272 microversion: 2.1 time: 0.277586 Oct 29 03:01:06.819544 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1825/3717] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:06 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:06.840586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6c24f052-38e6-4ada-8333-99066184b897 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:06.866308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6c24f052-38e6-4ada-8333-99066184b897 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:06.872053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6c24f052-38e6-4ada-8333-99066184b897 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Searching by: {'deleted': False, 'project_id': '548a0a34ffec4fe8959e88faab0fb154'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:06.893625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c24f052-38e6-4ada-8333-99066184b897 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.897129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c24f052-38e6-4ada-8333-99066184b897 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.897596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c24f052-38e6-4ada-8333-99066184b897 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.898447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c24f052-38e6-4ada-8333-99066184b897 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.898911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c24f052-38e6-4ada-8333-99066184b897 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.899333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c24f052-38e6-4ada-8333-99066184b897 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.966579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-6c24f052-38e6-4ada-8333-99066184b897 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:01:07.099077 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6c24f052-38e6-4ada-8333-99066184b897 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.275980 Oct 29 03:01:07.101072 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1826/3718] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 03:01:06 2022] GET /compute/v2.1/servers => generated 333 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:07.126578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-73f1b9fc-1c31-4c7e-81b3-6cb1b04687eb tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:07.234289 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-73f1b9fc-1c31-4c7e-81b3-6cb1b04687eb tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.124984 Oct 29 03:01:07.238030 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1827/3719] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 03:01:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:07.255366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be97bcd8-97ea-4547-8a5d-5ebc084eadee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:07.257575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-be97bcd8-97ea-4547-8a5d-5ebc084eadee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:07.268213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be97bcd8-97ea-4547-8a5d-5ebc084eadee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:07.269212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be97bcd8-97ea-4547-8a5d-5ebc084eadee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:07.270129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be97bcd8-97ea-4547-8a5d-5ebc084eadee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:07.271123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be97bcd8-97ea-4547-8a5d-5ebc084eadee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:07.271881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be97bcd8-97ea-4547-8a5d-5ebc084eadee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:07.272522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be97bcd8-97ea-4547-8a5d-5ebc084eadee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:07.835381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-be97bcd8-97ea-4547-8a5d-5ebc084eadee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:07.848953 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be97bcd8-97ea-4547-8a5d-5ebc084eadee tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1523 microversion: 2.1 time: 0.606508 Oct 29 03:01:07.850862 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1828/3720] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:07 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1523 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:07.870071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-77c75229-58b4-4e41-a0e9-2cbf662f6916 req-1a60ecf9-0feb-49b2-8da0-5e6a48181fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011b0dd6-a90d-4ee3-ad93-d4b22a12148e", "name": "network-vif-plugged", "status": "completed", "tag": "158289ef-ac46-428b-8096-bada975e064f"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:07.896529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-77c75229-58b4-4e41-a0e9-2cbf662f6916 req-1a60ecf9-0feb-49b2-8da0-5e6a48181fb1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:07.900645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-77c75229-58b4-4e41-a0e9-2cbf662f6916 req-1a60ecf9-0feb-49b2-8da0-5e6a48181fb1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:07.901836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-77c75229-58b4-4e41-a0e9-2cbf662f6916 req-1a60ecf9-0feb-49b2-8da0-5e6a48181fb1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:07.934015 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-77c75229-58b4-4e41-a0e9-2cbf662f6916 req-1a60ecf9-0feb-49b2-8da0-5e6a48181fb1 service nova] Creating event network-vif-plugged:158289ef-ac46-428b-8096-bada975e064f for instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e on n-h2-862964-4 Oct 29 03:01:07.947215 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-77c75229-58b4-4e41-a0e9-2cbf662f6916 req-1a60ecf9-0feb-49b2-8da0-5e6a48181fb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094700 Oct 29 03:01:07.948610 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1829/3721] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:07.988859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:08.017155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:08.033156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Searching by: {'deleted': False, 'project_id': '548a0a34ffec4fe8959e88faab0fb154'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:08.047758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.048428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.048982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.070632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.073331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.074236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.146138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:01:08.249637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:08.264775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.269742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.270489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.752685 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-05f01239-8fd7-4e0d-9153-d3714524bd91 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.802540 Oct 29 03:01:08.753741 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1830/3722] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 03:01:07 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:08.760412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c4a63b0a-d86a-4ab9-826f-f48338282260 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:08.768010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a63b0a-d86a-4ab9-826f-f48338282260 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.768617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a63b0a-d86a-4ab9-826f-f48338282260 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.769357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a63b0a-d86a-4ab9-826f-f48338282260 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.770279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a63b0a-d86a-4ab9-826f-f48338282260 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.775507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a63b0a-d86a-4ab9-826f-f48338282260 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.776055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c4a63b0a-d86a-4ab9-826f-f48338282260 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.854358 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c4a63b0a-d86a-4ab9-826f-f48338282260 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.097011 Oct 29 03:01:08.856300 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1831/3723] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Oct 29 03:01:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:08.861553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:08.862510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:08.871682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.872817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.873583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.874493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.882530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.883214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:09.208352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:09.224286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:09.226499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:09.231661 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0c6092f8-8ef9-48b1-acdd-1ae478facac3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.371731 Oct 29 03:01:09.232732 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1832/3724] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:08 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:09.240156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90482cf8-c837-4581-88c4-fd844f89c2f9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:09.241052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-90482cf8-c837-4581-88c4-fd844f89c2f9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:09.254092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90482cf8-c837-4581-88c4-fd844f89c2f9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:09.266166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90482cf8-c837-4581-88c4-fd844f89c2f9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:09.270679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90482cf8-c837-4581-88c4-fd844f89c2f9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:09.272559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90482cf8-c837-4581-88c4-fd844f89c2f9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:09.274396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90482cf8-c837-4581-88c4-fd844f89c2f9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:09.278435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90482cf8-c837-4581-88c4-fd844f89c2f9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:09.504826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-90482cf8-c837-4581-88c4-fd844f89c2f9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:09.515536 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90482cf8-c837-4581-88c4-fd844f89c2f9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1314 microversion: 2.1 time: 0.281552 Oct 29 03:01:09.519455 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1833/3725] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:09 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:09.538142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4a7c8500-6c0e-41da-a0fa-1cee3af76f3e tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:09.552859 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4a7c8500-6c0e-41da-a0fa-1cee3af76f3e tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025339 Oct 29 03:01:09.557555 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1834/3726] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 03:01:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:09.565504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09fba2e4-063c-452d-a225-a47411d6d8c0 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:09.603241 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-09fba2e4-063c-452d-a225-a47411d6d8c0 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.044164 Oct 29 03:01:09.611437 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1835/3727] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 03:01:09 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:09.621172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-293a6970-0eae-4560-9657-03c0e8f62910 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:09.626791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-293a6970-0eae-4560-9657-03c0e8f62910 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:09.635324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-293a6970-0eae-4560-9657-03c0e8f62910 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:09.635863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-293a6970-0eae-4560-9657-03c0e8f62910 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:09.636287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-293a6970-0eae-4560-9657-03c0e8f62910 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:09.636987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-293a6970-0eae-4560-9657-03c0e8f62910 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:09.637503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-293a6970-0eae-4560-9657-03c0e8f62910 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:09.638088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-293a6970-0eae-4560-9657-03c0e8f62910 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.140570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=35 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:10.145542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-293a6970-0eae-4560-9657-03c0e8f62910 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:10.161063 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-293a6970-0eae-4560-9657-03c0e8f62910 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1523 microversion: 2.1 time: 0.542830 Oct 29 03:01:10.162541 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1836/3728] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:09 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1523 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:10.179119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9e31fece-2d7b-422f-b8d1-0642d4cbd830 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862964-4"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:10.195785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e31fece-2d7b-422f-b8d1-0642d4cbd830 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.196946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e31fece-2d7b-422f-b8d1-0642d4cbd830 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.197467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e31fece-2d7b-422f-b8d1-0642d4cbd830 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.214791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:10.590569 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9e31fece-2d7b-422f-b8d1-0642d4cbd830 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.426575 Oct 29 03:01:10.592187 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1837/3729] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 03:01:10 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:10.690257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d249525e-9be5-4507-951e-00cc76b7795f req-d9f00a04-7cf0-40dc-bb7b-46ad956cb071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78d43b3b-0f39-48ec-bf51-a60f96b594d4", "tag": "b18cee08-14e4-4616-8284-11e58ca702a0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:10.702570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d249525e-9be5-4507-951e-00cc76b7795f req-d9f00a04-7cf0-40dc-bb7b-46ad956cb071 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.703048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d249525e-9be5-4507-951e-00cc76b7795f req-d9f00a04-7cf0-40dc-bb7b-46ad956cb071 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.703679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d249525e-9be5-4507-951e-00cc76b7795f req-d9f00a04-7cf0-40dc-bb7b-46ad956cb071 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.719988 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d249525e-9be5-4507-951e-00cc76b7795f req-d9f00a04-7cf0-40dc-bb7b-46ad956cb071 service nova] Creating event network-changed:b18cee08-14e4-4616-8284-11e58ca702a0 for instance 78d43b3b-0f39-48ec-bf51-a60f96b594d4 on n-h1-862964-4 Oct 29 03:01:10.726732 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d249525e-9be5-4507-951e-00cc76b7795f req-d9f00a04-7cf0-40dc-bb7b-46ad956cb071 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122110 Oct 29 03:01:10.727869 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1838/3730] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:10.734205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-630facbb-73f1-411e-aa02-57bf91e96781 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:10.734794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-630facbb-73f1-411e-aa02-57bf91e96781 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:10.743529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-630facbb-73f1-411e-aa02-57bf91e96781 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.744145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-630facbb-73f1-411e-aa02-57bf91e96781 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.744586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-630facbb-73f1-411e-aa02-57bf91e96781 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.745287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-630facbb-73f1-411e-aa02-57bf91e96781 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.745733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-630facbb-73f1-411e-aa02-57bf91e96781 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.747493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-630facbb-73f1-411e-aa02-57bf91e96781 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.823548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-630facbb-73f1-411e-aa02-57bf91e96781 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:11.069977 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-630facbb-73f1-411e-aa02-57bf91e96781 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 204 len: 0 microversion: 2.1 time: 0.340141 Oct 29 03:01:11.072858 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1839/3731] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:10 2022] DELETE /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:11.081683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:11.083321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:11.093224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.093943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.094613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.095483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.096094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.096695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.603072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:11.621050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:11.630052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:11.631826 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dd464473-6fa2-48c3-b415-b913c5ddb4bd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.556779 Oct 29 03:01:11.635288 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1840/3732] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:11 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:11.648836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f0f2b3fe-6f2a-4336-8f57-7f89b0d86ad3 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:11.649863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f0f2b3fe-6f2a-4336-8f57-7f89b0d86ad3 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:11.667413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0f2b3fe-6f2a-4336-8f57-7f89b0d86ad3 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.668117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0f2b3fe-6f2a-4336-8f57-7f89b0d86ad3 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.668727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0f2b3fe-6f2a-4336-8f57-7f89b0d86ad3 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.669622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0f2b3fe-6f2a-4336-8f57-7f89b0d86ad3 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.670262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0f2b3fe-6f2a-4336-8f57-7f89b0d86ad3 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.674473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0f2b3fe-6f2a-4336-8f57-7f89b0d86ad3 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.039555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f0f2b3fe-6f2a-4336-8f57-7f89b0d86ad3 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:12.048144 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f0f2b3fe-6f2a-4336-8f57-7f89b0d86ad3 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1314 microversion: 2.1 time: 0.411469 Oct 29 03:01:12.061832 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1841/3733] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:11 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:12.063195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb3f59f2-5c03-43d8-a779-da218c3fe3d8 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:12.079660 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fb3f59f2-5c03-43d8-a779-da218c3fe3d8 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.023381 Oct 29 03:01:12.081733 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1842/3734] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 03:01:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:12.095401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dc71229e-fc79-4380-9aef-91e627de1fba tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:12.096015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dc71229e-fc79-4380-9aef-91e627de1fba tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:12.132938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc71229e-fc79-4380-9aef-91e627de1fba tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.133473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc71229e-fc79-4380-9aef-91e627de1fba tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.133942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc71229e-fc79-4380-9aef-91e627de1fba tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.134668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc71229e-fc79-4380-9aef-91e627de1fba tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.146770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc71229e-fc79-4380-9aef-91e627de1fba tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.147318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc71229e-fc79-4380-9aef-91e627de1fba tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.595889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dc71229e-fc79-4380-9aef-91e627de1fba tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:12.605636 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dc71229e-fc79-4380-9aef-91e627de1fba tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1698 microversion: 2.1 time: 0.522789 Oct 29 03:01:12.607510 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1843/3735] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:12 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1698 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:12.619011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-61efda70-f826-4b34-94ac-bbf734d90802 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:12.619464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-61efda70-f826-4b34-94ac-bbf734d90802 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:12.644369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61efda70-f826-4b34-94ac-bbf734d90802 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.647634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61efda70-f826-4b34-94ac-bbf734d90802 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.648116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61efda70-f826-4b34-94ac-bbf734d90802 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.648866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61efda70-f826-4b34-94ac-bbf734d90802 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.649322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61efda70-f826-4b34-94ac-bbf734d90802 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.649745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61efda70-f826-4b34-94ac-bbf734d90802 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.705412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:12.866509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:01:12.869481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:01:12.873600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:01:12.877604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:01:12.878909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:01:12.890239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=52 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:12.913894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.914508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.916105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.917674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.918386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.919168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.945027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Getting quotas for project bf7809d4281c4efa9330464b86c1ee27. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:12.952016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Getting quotas for user 0bb215bc0435419eb2659aceb19ea58a and project bf7809d4281c4efa9330464b86c1ee27. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:13.121243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-61efda70-f826-4b34-94ac-bbf734d90802 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:13.133668 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-61efda70-f826-4b34-94ac-bbf734d90802 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1512 microversion: 2.1 time: 0.524829 Oct 29 03:01:13.135303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1844/3736] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:12 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:13.141297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-43053e37-e6d3-4c68-87f5-26e771478b3e tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-854548699", "availability_zone": "foo_zone"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:13.278231 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-43053e37-e6d3-4c68-87f5-26e771478b3e tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.140221 Oct 29 03:01:13.278868 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1845/3737] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Oct 29 03:01:13 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:13.292809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:13.294536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:13.303618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.304205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.304828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:13.305760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.306408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.306999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:13.309088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:01:13.313022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='be83f702-cf40-4b7a-b071-289214d41f22',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='657402ce-3a83-4d28-8c50-4a52ff787f44',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ec0fd410-e170-4956-97ea-fed13f85c474',volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:01:13.594292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:13.604098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:13.605554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:13.606781 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-55214115-6705-44ee-8c42-304725e80dad tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1737 microversion: 2.20 time: 0.324475 Oct 29 03:01:13.607411 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1846/3738] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:13 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1737 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:13.626327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-36b90b3e-29f7-4962-a1e3-9cf4125e636a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:13.626938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-36b90b3e-29f7-4962-a1e3-9cf4125e636a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:13.639598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36b90b3e-29f7-4962-a1e3-9cf4125e636a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.640092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36b90b3e-29f7-4962-a1e3-9cf4125e636a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.640527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36b90b3e-29f7-4962-a1e3-9cf4125e636a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:13.641236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36b90b3e-29f7-4962-a1e3-9cf4125e636a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.641686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36b90b3e-29f7-4962-a1e3-9cf4125e636a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.642133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36b90b3e-29f7-4962-a1e3-9cf4125e636a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:13.820994 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c414be0-9a8a-4fc6-9ab3-53cb704a6273 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 12.872339 Oct 29 03:01:13.825074 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1893/3739] 10.222.0.16 () {62 vars in 1189 bytes} [Sat Oct 29 03:01:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 12877 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:01:13.841233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ea416df6-a5fc-4487-9187-e87ade6280a3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:13.842229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ea416df6-a5fc-4487-9187-e87ade6280a3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:13.857207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea416df6-a5fc-4487-9187-e87ade6280a3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.858077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea416df6-a5fc-4487-9187-e87ade6280a3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.858852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea416df6-a5fc-4487-9187-e87ade6280a3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:13.859777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea416df6-a5fc-4487-9187-e87ade6280a3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.860676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea416df6-a5fc-4487-9187-e87ade6280a3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.861259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea416df6-a5fc-4487-9187-e87ade6280a3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:13.990752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-36b90b3e-29f7-4962-a1e3-9cf4125e636a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:14.009506 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-36b90b3e-29f7-4962-a1e3-9cf4125e636a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1314 microversion: 2.1 time: 0.401080 Oct 29 03:01:14.010146 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1847/3740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:13 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:14.015017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-172dafab-50c0-4534-ac77-4be90e77411f tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:14.055478 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-172dafab-50c0-4534-ac77-4be90e77411f tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.043911 Oct 29 03:01:14.057673 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1848/3741] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 03:01:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:14.064465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a323757d-dca9-4a21-a0d6-1ba19adac81f tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:14.065486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a323757d-dca9-4a21-a0d6-1ba19adac81f tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:14.076071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a323757d-dca9-4a21-a0d6-1ba19adac81f tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.078456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a323757d-dca9-4a21-a0d6-1ba19adac81f tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.079734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a323757d-dca9-4a21-a0d6-1ba19adac81f tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.080890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a323757d-dca9-4a21-a0d6-1ba19adac81f tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.082040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a323757d-dca9-4a21-a0d6-1ba19adac81f tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.082930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a323757d-dca9-4a21-a0d6-1ba19adac81f tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.876332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a323757d-dca9-4a21-a0d6-1ba19adac81f tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:14.899402 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a323757d-dca9-4a21-a0d6-1ba19adac81f tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1698 microversion: 2.1 time: 0.838997 Oct 29 03:01:14.902167 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1849/3742] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:14 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1698 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:14.921326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9128188f-4f4a-4cbb-9c8f-badc99f89564 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:14.923157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9128188f-4f4a-4cbb-9c8f-badc99f89564 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:15.008736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ea416df6-a5fc-4487-9187-e87ade6280a3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.018777 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ea416df6-a5fc-4487-9187-e87ade6280a3 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 200 len: 1512 microversion: 2.1 time: 1.192356 Oct 29 03:01:15.031090 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1894/3743] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:13 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 1512 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:15.049731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5edbb5d8-d8ff-45f0-ba7f-b00c447a6f3b tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:15.068671 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5edbb5d8-d8ff-45f0-ba7f-b00c447a6f3b tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.033866 Oct 29 03:01:15.070794 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1895/3744] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 03:01:15 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:15.084484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:15.086372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:15.101512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.102760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9128188f-4f4a-4cbb-9c8f-badc99f89564 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.104161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.105402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.105653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=15 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:15.106576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.109028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.109584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.119949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9128188f-4f4a-4cbb-9c8f-badc99f89564 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.123206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9128188f-4f4a-4cbb-9c8f-badc99f89564 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.128399 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9128188f-4f4a-4cbb-9c8f-badc99f89564 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1286 microversion: 2.42 time: 0.221056 Oct 29 03:01:15.131055 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1850/3745] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:14 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1286 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:15.156804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-785d858f-b725-4e35-b5ff-9b0d2368f62c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:15.164410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-785d858f-b725-4e35-b5ff-9b0d2368f62c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:15.176580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-785d858f-b725-4e35-b5ff-9b0d2368f62c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.177543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-785d858f-b725-4e35-b5ff-9b0d2368f62c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.178922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-785d858f-b725-4e35-b5ff-9b0d2368f62c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.180160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-785d858f-b725-4e35-b5ff-9b0d2368f62c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.180991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-785d858f-b725-4e35-b5ff-9b0d2368f62c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.182262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-785d858f-b725-4e35-b5ff-9b0d2368f62c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.415375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-785d858f-b725-4e35-b5ff-9b0d2368f62c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.424984 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-785d858f-b725-4e35-b5ff-9b0d2368f62c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1314 microversion: 2.1 time: 0.290661 Oct 29 03:01:15.430728 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1851/3746] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:15 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:15.446939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ec32f065-2c86-4b58-be35-19c7a8aa6e8f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:15.449558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ec32f065-2c86-4b58-be35-19c7a8aa6e8f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:15.463240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec32f065-2c86-4b58-be35-19c7a8aa6e8f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.467597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec32f065-2c86-4b58-be35-19c7a8aa6e8f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.469436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec32f065-2c86-4b58-be35-19c7a8aa6e8f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.470646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec32f065-2c86-4b58-be35-19c7a8aa6e8f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.472714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec32f065-2c86-4b58-be35-19c7a8aa6e8f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.474047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec32f065-2c86-4b58-be35-19c7a8aa6e8f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.530272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ec32f065-2c86-4b58-be35-19c7a8aa6e8f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:15.637186 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ec32f065-2c86-4b58-be35-19c7a8aa6e8f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 204 len: 0 microversion: 2.1 time: 0.202285 Oct 29 03:01:15.643480 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1852/3747] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:15 2022] DELETE /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:15.658404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6869ccf9-13fa-4b98-a702-66fee2bd8fe6 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862964-4"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:15.682186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6869ccf9-13fa-4b98-a702-66fee2bd8fe6 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.685433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6869ccf9-13fa-4b98-a702-66fee2bd8fe6 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.686012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6869ccf9-13fa-4b98-a702-66fee2bd8fe6 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.927395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.950179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.955535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.960412 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-69388c78-3466-4f1e-baf6-61fcbc8ed2e4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1719 microversion: 2.20 time: 0.887312 Oct 29 03:01:15.977950 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1896/3748] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:15 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1719 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:15.979360 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6869ccf9-13fa-4b98-a702-66fee2bd8fe6 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.327258 Oct 29 03:01:15.979360 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1853/3749] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Oct 29 03:01:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:15.984189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1585328542", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "b84d4357-2c49-45ad-a541-2fe93a1783c7"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:15.989431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09bc355f-665d-4c24-a44c-cb6355df85d6 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:15.995399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-09bc355f-665d-4c24-a44c-cb6355df85d6 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:16.016917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09bc355f-665d-4c24-a44c-cb6355df85d6 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.017428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09bc355f-665d-4c24-a44c-cb6355df85d6 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.017931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09bc355f-665d-4c24-a44c-cb6355df85d6 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.018668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09bc355f-665d-4c24-a44c-cb6355df85d6 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.019127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09bc355f-665d-4c24-a44c-cb6355df85d6 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.019585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09bc355f-665d-4c24-a44c-cb6355df85d6 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.091969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] validate_networks() for [('b84d4357-2c49-45ad-a541-2fe93a1783c7', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:01:16.174222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-09bc355f-665d-4c24-a44c-cb6355df85d6 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:16.197518 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-09bc355f-665d-4c24-a44c-cb6355df85d6 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1631 microversion: 2.1 time: 0.220836 Oct 29 03:01:16.217846 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1854/3750] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:15 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1631 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:16.234745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7bd1ad49-4af5-461f-970e-a8c298346794 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:16.291935 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7bd1ad49-4af5-461f-970e-a8c298346794 tempest-TestAggregatesBasicOps-16702729 tempest-TestAggregatesBasicOps-16702729-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.072820 Oct 29 03:01:16.302685 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1855/3751] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 03:01:16 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 03:01:16.314786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:16.315603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:16.324102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.324844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.325445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.326350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.326952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.327569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.570327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:16.593997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:16.598548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:16.600572 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-641374a9-81e7-4cae-96e9-d57a1934b624 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1532 microversion: 2.42 time: 0.296814 Oct 29 03:01:16.602256 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1856/3752] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:16 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1532 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:16.608683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-57ce5afb-66f8-4c19-8fde-da19779c0603 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:16.618648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-57ce5afb-66f8-4c19-8fde-da19779c0603 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:16.635118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57ce5afb-66f8-4c19-8fde-da19779c0603 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.636032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57ce5afb-66f8-4c19-8fde-da19779c0603 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.636527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57ce5afb-66f8-4c19-8fde-da19779c0603 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.637730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57ce5afb-66f8-4c19-8fde-da19779c0603 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.638323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57ce5afb-66f8-4c19-8fde-da19779c0603 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.638855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57ce5afb-66f8-4c19-8fde-da19779c0603 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.849455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-57ce5afb-66f8-4c19-8fde-da19779c0603 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:16.857520 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-57ce5afb-66f8-4c19-8fde-da19779c0603 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1314 microversion: 2.1 time: 0.254008 Oct 29 03:01:16.875077 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1857/3753] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:16 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:17.011350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:17.014698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:17.034042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.034858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.035479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.036411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.037070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.037792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.681556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:17.701187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:17.702666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:17.703863 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e00c05b5-44fe-476f-8d45-9522c4fd34e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1719 microversion: 2.20 time: 0.700399 Oct 29 03:01:17.708139 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1858/3754] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:17 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1719 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:01:17.725099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cf42deb4-dca9-47ff-a1ef-062d9c703927 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:17.725733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cf42deb4-dca9-47ff-a1ef-062d9c703927 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:17.745313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf42deb4-dca9-47ff-a1ef-062d9c703927 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.745837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf42deb4-dca9-47ff-a1ef-062d9c703927 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.746283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf42deb4-dca9-47ff-a1ef-062d9c703927 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.747003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf42deb4-dca9-47ff-a1ef-062d9c703927 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.747458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf42deb4-dca9-47ff-a1ef-062d9c703927 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.747967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf42deb4-dca9-47ff-a1ef-062d9c703927 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.944525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cf42deb4-dca9-47ff-a1ef-062d9c703927 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a878e1202c3d442fb55052e841589eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a0a34ffec4fe8959e88faab0fb154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:17.957795 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cf42deb4-dca9-47ff-a1ef-062d9c703927 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 200 len: 1631 microversion: 2.1 time: 0.246662 Oct 29 03:01:17.959804 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1859/3755] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:17 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 1631 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:17.989687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:17.992655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:18.015906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.018324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.019131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.020964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.023369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.024602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.234844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:18.248822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:18.252666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:18.256623 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f1e9d66c-3c0c-4639-a7fe-63e083b59630 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1584 microversion: 2.42 time: 0.294651 Oct 29 03:01:18.273740 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1860/3756] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:17 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1584 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:18.289159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-066cc5c9-a964-44e1-872c-e7c55bd5b999 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:18.294675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-066cc5c9-a964-44e1-872c-e7c55bd5b999 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:18.311332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-066cc5c9-a964-44e1-872c-e7c55bd5b999 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.312114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-066cc5c9-a964-44e1-872c-e7c55bd5b999 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.312692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-066cc5c9-a964-44e1-872c-e7c55bd5b999 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.313538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-066cc5c9-a964-44e1-872c-e7c55bd5b999 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.318262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-066cc5c9-a964-44e1-872c-e7c55bd5b999 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.318262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-066cc5c9-a964-44e1-872c-e7c55bd5b999 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.802201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=16 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:19.041114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-066cc5c9-a964-44e1-872c-e7c55bd5b999 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:19.056693 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-066cc5c9-a964-44e1-872c-e7c55bd5b999 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1314 microversion: 2.1 time: 0.781520 Oct 29 03:01:19.060844 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1861/3757] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:18 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:19.080789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-6c97f25c-68c9-4696-9200-dc599139fb9c req-92ebdeea-fdec-4ddb-a616-fdd1665f52c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d43b3b-0f39-48ec-bf51-a60f96b594d4", "name": "network-vif-plugged", "status": "completed", "tag": "b18cee08-14e4-4616-8284-11e58ca702a0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:19.108680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6c97f25c-68c9-4696-9200-dc599139fb9c req-92ebdeea-fdec-4ddb-a616-fdd1665f52c2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.109240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6c97f25c-68c9-4696-9200-dc599139fb9c req-92ebdeea-fdec-4ddb-a616-fdd1665f52c2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.109718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6c97f25c-68c9-4696-9200-dc599139fb9c req-92ebdeea-fdec-4ddb-a616-fdd1665f52c2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.144560 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-6c97f25c-68c9-4696-9200-dc599139fb9c req-92ebdeea-fdec-4ddb-a616-fdd1665f52c2 service nova] Creating event network-vif-plugged:b18cee08-14e4-4616-8284-11e58ca702a0 for instance 78d43b3b-0f39-48ec-bf51-a60f96b594d4 on n-h1-862964-4 Oct 29 03:01:19.164776 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-6c97f25c-68c9-4696-9200-dc599139fb9c req-92ebdeea-fdec-4ddb-a616-fdd1665f52c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101091 Oct 29 03:01:19.165403 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1862/3758] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:19.187131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-12a0d55d-d5f8-4d28-a287-d9c253ac0567 req-3a72e77f-2b5e-465b-9f4e-45ae47f74d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff3fc3b-c65f-417e-9978-1a7b1179de2d", "name": "network-vif-deleted", "tag": "08892328-92a2-491f-bdba-c4be5bc285d2"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:19.225424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-12a0d55d-d5f8-4d28-a287-d9c253ac0567 req-3a72e77f-2b5e-465b-9f4e-45ae47f74d68 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.227230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-12a0d55d-d5f8-4d28-a287-d9c253ac0567 req-3a72e77f-2b5e-465b-9f4e-45ae47f74d68 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.230639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-12a0d55d-d5f8-4d28-a287-d9c253ac0567 req-3a72e77f-2b5e-465b-9f4e-45ae47f74d68 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.262872 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-12a0d55d-d5f8-4d28-a287-d9c253ac0567 req-3a72e77f-2b5e-465b-9f4e-45ae47f74d68 service nova] Creating event network-vif-deleted:08892328-92a2-491f-bdba-c4be5bc285d2 for instance eff3fc3b-c65f-417e-9978-1a7b1179de2d on n-h1-862964-4 Oct 29 03:01:19.277288 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-12a0d55d-d5f8-4d28-a287-d9c253ac0567 req-3a72e77f-2b5e-465b-9f4e-45ae47f74d68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102830 Oct 29 03:01:19.279783 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1863/3759] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:19.299598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.303338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:19.310746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:19.331555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.337742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.338806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.341484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.342749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.343437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.510919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:01:19.512005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:01:19.512648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:01:19.514213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:01:19.516506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:01:19.560249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.565081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.565586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.569680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.570257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.570712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.639119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Getting quotas for project c7a3da1a632d443aba8f5cf3b741714b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:19.655489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Getting quotas for user adb51369444c42c190b1b7bf5e23ddb9 and project c7a3da1a632d443aba8f5cf3b741714b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:19.686628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:01:19.691262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:01:19.814369 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-732cefa5-5547-4889-9a7d-85e6bd50663f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.844119 Oct 29 03:01:19.815370 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1897/3760] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:01:19.822942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.826416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] [instance: eff3fc3b-c65f-417e-9978-1a7b1179de2d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:19.835124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.836022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.836706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.837668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.838393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.839076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.866059 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] HTTP exception thrown: Instance eff3fc3b-c65f-417e-9978-1a7b1179de2d could not be found. Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Request method failure captured: Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d HTTP/1.1 Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJcvDbM7RSI7ODBhrzKhy8Hc8qkYtwdeOn3y8pIJt9rAicOx85nsvDJTtJRMHoje7lvWXTX3h7zw9aox9ff-8um8X0dtXgxVs4tFA6KF4DTeNyvtMC94DbtOdnZWV7uJ6MiOh8e-mlU8R_rH8qYO6HFOgogm_dKshqflv8koXx04M2w Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 548a0a34ffec4fe8959e88faab0fb154 Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-182795625 Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/548a0a34ffec4fe8959e88faab0fb154"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/548a0a34ffec4fe8959e88faab0fb154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_548a0a34ffec4fe8959e88faab0fb154", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/548a0a34ffec4fe8959e88faab0fb154"}]}] Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-182795625 Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 548a0a34ffec4fe8959e88faab0fb154 Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-182795625 Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-182795625-project Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a878e1202c3d442fb55052e841589eb7 Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-182795625-project Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance eff3fc3b-c65f-417e-9978-1a7b1179de2d could not be found. Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'eff3fc3b-c65f-417e-9978-1a7b1179de2d'} Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eff3fc3b-c65f-417e-9978-1a7b1179de2d could not be found. Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eff3fc3b-c65f-417e-9978-1a7b1179de2d could not be found. Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:19.873353 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:19.879643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:19.879643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:19.879643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:19.879643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:19.879643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eff3fc3b-c65f-417e-9978-1a7b1179de2d could not be found. Oct 29 03:01:19.879643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:19.889387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Returning 404 to user: Instance eff3fc3b-c65f-417e-9978-1a7b1179de2d could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:19.895122 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ee8738c-dd18-4f9d-b0f9-bd11d8b8ce36 tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d" status: 404 len: 111 microversion: 2.1 time: 0.078388 Oct 29 03:01:19.903607 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1898/3761] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/servers/eff3fc3b-c65f-417e-9978-1a7b1179de2d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:19.910588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.923170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:19.950007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.950510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.950972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.951752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.952386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.952978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.171408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:20.185771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:20.187343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:20.191313 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ece9aaf-145d-4646-a27e-3367a9f62349 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1722 microversion: 2.20 time: 0.909240 Oct 29 03:01:20.194510 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1864/3762] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1722 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:20.199508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-61f84bbf-ab2c-491d-bf1c-7665d9e831ac tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:20.214785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-61f84bbf-ab2c-491d-bf1c-7665d9e831ac tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:20.322318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:20.333744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:20.337614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-61f84bbf-ab2c-491d-bf1c-7665d9e831ac tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:20.350056 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-61f84bbf-ab2c-491d-bf1c-7665d9e831ac tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1218 microversion: 2.1 time: 0.154063 Oct 29 03:01:20.350939 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1865/3763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:20 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:20.354070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:20.361614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79f47b62-70a5-4454-8529-a3f3c80d890b tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] Calling method '.version_select at 0x7fe1a833a550>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:20.367493 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8e549754-5f4e-4956-a9c2-87b4111f794b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1594 microversion: 2.42 time: 0.456295 Oct 29 03:01:20.368722 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1899/3764] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1594 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:20.381589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7e025602-2ccb-43c3-9f48-fdbd0f557401 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:20.390249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7e025602-2ccb-43c3-9f48-fdbd0f557401 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:20.414038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e025602-2ccb-43c3-9f48-fdbd0f557401 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.414770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e025602-2ccb-43c3-9f48-fdbd0f557401 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.418356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e025602-2ccb-43c3-9f48-fdbd0f557401 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.419527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e025602-2ccb-43c3-9f48-fdbd0f557401 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.420110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e025602-2ccb-43c3-9f48-fdbd0f557401 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.420649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e025602-2ccb-43c3-9f48-fdbd0f557401 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.437220 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79f47b62-70a5-4454-8529-a3f3c80d890b tempest-ServersTestJSON-182795625 tempest-ServersTestJSON-182795625-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551927145" status: 202 len: 0 microversion: 2.1 time: 0.085023 Oct 29 03:01:20.441786 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1866/3765] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 03:01:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551927145 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:01:20.453895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a8023ecc-e0c2-4269-957b-fd00b1f9a7ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45074da4-1dc0-4d50-8020-4484c1ad4c16"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:20.458417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a8023ecc-e0c2-4269-957b-fd00b1f9a7ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:20.472862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8023ecc-e0c2-4269-957b-fd00b1f9a7ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.473643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8023ecc-e0c2-4269-957b-fd00b1f9a7ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.474162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8023ecc-e0c2-4269-957b-fd00b1f9a7ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.474872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8023ecc-e0c2-4269-957b-fd00b1f9a7ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.475311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8023ecc-e0c2-4269-957b-fd00b1f9a7ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.481064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8023ecc-e0c2-4269-957b-fd00b1f9a7ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.491533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:21.139595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7e025602-2ccb-43c3-9f48-fdbd0f557401 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:21.160847 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7e025602-2ccb-43c3-9f48-fdbd0f557401 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1314 microversion: 2.1 time: 0.784094 Oct 29 03:01:21.162141 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1900/3766] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:20 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:21.357481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3ad405a0-4274-4a4f-87fd-6b0a7464e7e9 req-9cf678aa-40d6-450d-9f20-ceee15a40b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011b0dd6-a90d-4ee3-ad93-d4b22a12148e", "name": "network-vif-deleted", "tag": "158289ef-ac46-428b-8096-bada975e064f"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:21.361533 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a8023ecc-e0c2-4269-957b-fd00b1f9a7ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "POST /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.917852 Oct 29 03:01:21.375913 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1867/3767] 10.222.0.16 () {62 vars in 1364 bytes} [Sat Oct 29 03:01:20 2022] POST /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments => generated 188 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:01:21.388074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3ad405a0-4274-4a4f-87fd-6b0a7464e7e9 req-9cf678aa-40d6-450d-9f20-ceee15a40b70 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:21.389321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3ad405a0-4274-4a4f-87fd-6b0a7464e7e9 req-9cf678aa-40d6-450d-9f20-ceee15a40b70 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:21.389759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3ad405a0-4274-4a4f-87fd-6b0a7464e7e9 req-9cf678aa-40d6-450d-9f20-ceee15a40b70 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:21.403251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b3181ecd-625b-4edd-824b-6f872fc59d73 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:21.404054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b3181ecd-625b-4edd-824b-6f872fc59d73 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:21.424856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3181ecd-625b-4edd-824b-6f872fc59d73 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:21.425605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3181ecd-625b-4edd-824b-6f872fc59d73 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:21.428247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3181ecd-625b-4edd-824b-6f872fc59d73 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:21.429030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3181ecd-625b-4edd-824b-6f872fc59d73 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:21.429502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3181ecd-625b-4edd-824b-6f872fc59d73 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:21.432349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3181ecd-625b-4edd-824b-6f872fc59d73 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:21.435611 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3ad405a0-4274-4a4f-87fd-6b0a7464e7e9 req-9cf678aa-40d6-450d-9f20-ceee15a40b70 service nova] Creating event network-vif-deleted:158289ef-ac46-428b-8096-bada975e064f for instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e on n-h2-862964-4 Oct 29 03:01:21.450427 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3ad405a0-4274-4a4f-87fd-6b0a7464e7e9 req-9cf678aa-40d6-450d-9f20-ceee15a40b70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098161 Oct 29 03:01:21.454301 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1901/3768] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:01:21.467765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:21.472050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:21.489055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:21.489872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:21.492250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:21.495671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:21.498351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:21.500379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:21.767180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3181ecd-625b-4edd-824b-6f872fc59d73 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:21.778447 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b3181ecd-625b-4edd-824b-6f872fc59d73 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1214 microversion: 2.1 time: 0.400563 Oct 29 03:01:21.782857 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1868/3769] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:21 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1214 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:22.015852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:22.035909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:22.042631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:22.045885 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b8d5f23e-0791-40d2-b64e-5bf3cfe41f7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1594 microversion: 2.42 time: 0.589812 Oct 29 03:01:22.052174 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1902/3770] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:21 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1594 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:22.066408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-578f5312-29b9-4062-b482-4eab7bee1822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:22.067468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-578f5312-29b9-4062-b482-4eab7bee1822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:22.078555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-578f5312-29b9-4062-b482-4eab7bee1822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.080266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-578f5312-29b9-4062-b482-4eab7bee1822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.080935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-578f5312-29b9-4062-b482-4eab7bee1822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.085322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-578f5312-29b9-4062-b482-4eab7bee1822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.090805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-578f5312-29b9-4062-b482-4eab7bee1822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.091648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-578f5312-29b9-4062-b482-4eab7bee1822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.152528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-221b7a41-ae8f-4c2c-8684-7f02731f83ac req-362e6f5e-2fc9-485d-b33e-f8bc00b78f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31241403-2a17-4f40-818d-fc8caca85e4b", "name": "network-vif-unplugged", "status": "completed", "tag": "e6f1a4fa-984f-49dc-a400-07b55f9cbbeb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:22.201351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-578f5312-29b9-4062-b482-4eab7bee1822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127041) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 03:01:22.202002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-221b7a41-ae8f-4c2c-8684-7f02731f83ac req-362e6f5e-2fc9-485d-b33e-f8bc00b78f80 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.202464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-221b7a41-ae8f-4c2c-8684-7f02731f83ac req-362e6f5e-2fc9-485d-b33e-f8bc00b78f80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.203009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-221b7a41-ae8f-4c2c-8684-7f02731f83ac req-362e6f5e-2fc9-485d-b33e-f8bc00b78f80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.254863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.compute.server_external_events [req-221b7a41-ae8f-4c2c-8684-7f02731f83ac req-362e6f5e-2fc9-485d-b33e-f8bc00b78f80 service nova] Unable to find a host for instance 31241403-2a17-4f40-818d-fc8caca85e4b. Dropping event network-vif-unplugged {{(pid=127042) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 03:01:22.263221 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-221b7a41-ae8f-4c2c-8684-7f02731f83ac req-362e6f5e-2fc9-485d-b33e-f8bc00b78f80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.478985 Oct 29 03:01:22.264946 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1869/3771] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 482 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 03:01:22.274049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6e7c99a9-1560-4a5b-8d08-68e4c84bc22f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:22.282137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6e7c99a9-1560-4a5b-8d08-68e4c84bc22f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:22.314297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7c99a9-1560-4a5b-8d08-68e4c84bc22f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.315129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7c99a9-1560-4a5b-8d08-68e4c84bc22f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.317218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7c99a9-1560-4a5b-8d08-68e4c84bc22f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.320708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7c99a9-1560-4a5b-8d08-68e4c84bc22f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.324956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7c99a9-1560-4a5b-8d08-68e4c84bc22f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.325540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e7c99a9-1560-4a5b-8d08-68e4c84bc22f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.336950 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-578f5312-29b9-4062-b482-4eab7bee1822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "POST /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/action" status: 202 len: 0 microversion: 2.20 time: 0.283408 Oct 29 03:01:22.338219 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1903/3772] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 03:01:22 2022] POST /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:22.347399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:22.348492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:22.356098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.366727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.367471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.368776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.369443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.370101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.790244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6e7c99a9-1560-4a5b-8d08-68e4c84bc22f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:22.802754 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6e7c99a9-1560-4a5b-8d08-68e4c84bc22f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1500 microversion: 2.1 time: 0.536585 Oct 29 03:01:22.804154 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1870/3773] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:22 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1500 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:22.810473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-229ef57b-63ef-434b-96d4-e3f479bd9532 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:22.811301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-229ef57b-63ef-434b-96d4-e3f479bd9532 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:22.819672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-229ef57b-63ef-434b-96d4-e3f479bd9532 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.820626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-229ef57b-63ef-434b-96d4-e3f479bd9532 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.821279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-229ef57b-63ef-434b-96d4-e3f479bd9532 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.822392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-229ef57b-63ef-434b-96d4-e3f479bd9532 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.822996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-229ef57b-63ef-434b-96d4-e3f479bd9532 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.823570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-229ef57b-63ef-434b-96d4-e3f479bd9532 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.062214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:23.078734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:23.082230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-229ef57b-63ef-434b-96d4-e3f479bd9532 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:23.083345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:23.088655 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29720cd3-a078-41ac-ae28-e57799001bff tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1748 microversion: 2.20 time: 0.746177 Oct 29 03:01:23.089986 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1904/3774] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:22 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1748 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:01:23.108798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-73036f46-e874-4210-bc95-00e6291e7ceb tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:23.115723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-73036f46-e874-4210-bc95-00e6291e7ceb tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:23.135479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73036f46-e874-4210-bc95-00e6291e7ceb tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.138501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73036f46-e874-4210-bc95-00e6291e7ceb tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.142038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73036f46-e874-4210-bc95-00e6291e7ceb tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.143156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73036f46-e874-4210-bc95-00e6291e7ceb tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.143845 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-229ef57b-63ef-434b-96d4-e3f479bd9532 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1276 microversion: 2.1 time: 0.338369 Oct 29 03:01:23.144315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73036f46-e874-4210-bc95-00e6291e7ceb tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.145281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-73036f46-e874-4210-bc95-00e6291e7ceb tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.146170 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1871/3775] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:22 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1276 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:23.158651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:23.159552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:23.172105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.173162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.173783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.174854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.175474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.177089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.203403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-73036f46-e874-4210-bc95-00e6291e7ceb tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lazy-loading 'flavor' on Instance uuid 78d43b3b-0f39-48ec-bf51-a60f96b594d4 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:01:23.355043 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-73036f46-e874-4210-bc95-00e6291e7ceb tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "POST /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4/action" status: 200 len: 32 microversion: 2.1 time: 0.263608 Oct 29 03:01:23.355985 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1905/3776] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:01:23 2022] POST /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4/action => generated 32 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:01:23.366608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-84026d3b-f14f-4a8f-8e53-36d5df7c7e27 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:23.367649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-84026d3b-f14f-4a8f-8e53-36d5df7c7e27 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:23.374991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84026d3b-f14f-4a8f-8e53-36d5df7c7e27 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.385678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84026d3b-f14f-4a8f-8e53-36d5df7c7e27 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.386355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84026d3b-f14f-4a8f-8e53-36d5df7c7e27 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.387311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84026d3b-f14f-4a8f-8e53-36d5df7c7e27 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.387946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84026d3b-f14f-4a8f-8e53-36d5df7c7e27 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.389478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84026d3b-f14f-4a8f-8e53-36d5df7c7e27 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:24.045203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:24.060282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:24.063486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:24.067609 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4b4792af-688a-416e-8b54-c3e7fe2c12af tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1661 microversion: 2.42 time: 0.918642 Oct 29 03:01:24.070597 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1872/3777] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:23 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1661 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:24.123938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:24.124902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:24.135192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:24.136093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:24.137589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:24.140576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:24.141375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:24.148440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:24.517502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-84026d3b-f14f-4a8f-8e53-36d5df7c7e27 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:24.535018 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-84026d3b-f14f-4a8f-8e53-36d5df7c7e27 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1506 microversion: 2.1 time: 1.171214 Oct 29 03:01:24.536564 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1906/3778] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:23 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1506 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:24.554822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fe558f18-46d5-485f-b83e-38f0ebbf27d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:24.555897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fe558f18-46d5-485f-b83e-38f0ebbf27d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:24.573240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe558f18-46d5-485f-b83e-38f0ebbf27d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:24.574735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe558f18-46d5-485f-b83e-38f0ebbf27d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:24.579766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe558f18-46d5-485f-b83e-38f0ebbf27d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:24.580823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe558f18-46d5-485f-b83e-38f0ebbf27d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:24.581525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe558f18-46d5-485f-b83e-38f0ebbf27d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:24.584567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe558f18-46d5-485f-b83e-38f0ebbf27d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:24.983868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fe558f18-46d5-485f-b83e-38f0ebbf27d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:24.994301 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fe558f18-46d5-485f-b83e-38f0ebbf27d2 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1276 microversion: 2.1 time: 0.453154 Oct 29 03:01:25.002847 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1907/3779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:24 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1276 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:25.109188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:25.110071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:25.129869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:25.132919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:25.138510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:25.139711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:25.142506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:25.143072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:25.766326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:25.795089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:25.797930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:25.799405 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5dd1ef91-0c9d-4112-9b4b-981974071606 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1661 microversion: 2.42 time: 0.699539 Oct 29 03:01:25.800605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1908/3780] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:25 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1661 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:25.815454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a85f6708-91c6-4fff-8ea5-3c0291ceae39 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:25.819193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a85f6708-91c6-4fff-8ea5-3c0291ceae39 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:25.829853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a85f6708-91c6-4fff-8ea5-3c0291ceae39 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:25.830666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a85f6708-91c6-4fff-8ea5-3c0291ceae39 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:25.831182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a85f6708-91c6-4fff-8ea5-3c0291ceae39 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:25.832433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a85f6708-91c6-4fff-8ea5-3c0291ceae39 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:25.833273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a85f6708-91c6-4fff-8ea5-3c0291ceae39 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:25.834029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a85f6708-91c6-4fff-8ea5-3c0291ceae39 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.175580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:26.197304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:26.205969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:26.211037 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ccaba44b-d220-4f6b-80dc-f1976797e421 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1748 microversion: 2.20 time: 2.091051 Oct 29 03:01:26.213913 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1873/3781] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:24 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1748 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:26.224770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b002ad9-a408-480d-8672-b7acc693df9e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:26.236677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3b002ad9-a408-480d-8672-b7acc693df9e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:26.255583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b002ad9-a408-480d-8672-b7acc693df9e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.261999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b002ad9-a408-480d-8672-b7acc693df9e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.262786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b002ad9-a408-480d-8672-b7acc693df9e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.263824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b002ad9-a408-480d-8672-b7acc693df9e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.267448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b002ad9-a408-480d-8672-b7acc693df9e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.269193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b002ad9-a408-480d-8672-b7acc693df9e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.553138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a85f6708-91c6-4fff-8ea5-3c0291ceae39 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:26.568618 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a85f6708-91c6-4fff-8ea5-3c0291ceae39 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1506 microversion: 2.1 time: 0.766627 Oct 29 03:01:26.581177 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1909/3782] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:25 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1506 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:26.832120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:26.834176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:26.853462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.855574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.857073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.858563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.861571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.862666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.931449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:27.637601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:27.656762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:27.659486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:27.666123 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e0d16693-8d90-4db1-9a61-747ebf57d431 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1661 microversion: 2.42 time: 0.841277 Oct 29 03:01:27.670730 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1910/3783] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:26 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1661 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:01:27.687721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:27.688338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:27.705105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:27.707117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:27.708066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:27.711758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:27.712460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:27.716772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.034923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b002ad9-a408-480d-8672-b7acc693df9e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:28.045173 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3b002ad9-a408-480d-8672-b7acc693df9e tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1318 microversion: 2.1 time: 1.829015 Oct 29 03:01:28.045764 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1874/3784] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:26 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1318 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:28.059372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-34e9e771-6498-4910-8d04-e09683f61032 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:28.065851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-34e9e771-6498-4910-8d04-e09683f61032 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:28.083615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34e9e771-6498-4910-8d04-e09683f61032 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.086854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34e9e771-6498-4910-8d04-e09683f61032 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.090954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34e9e771-6498-4910-8d04-e09683f61032 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.091998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34e9e771-6498-4910-8d04-e09683f61032 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.092637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34e9e771-6498-4910-8d04-e09683f61032 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.093255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34e9e771-6498-4910-8d04-e09683f61032 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.332788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:28.345559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:28.354737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:28.356324 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f894f405-4e24-43f7-a6d1-157b04f192c2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1750 microversion: 2.20 time: 0.684259 Oct 29 03:01:28.381163 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1911/3785] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:27 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1750 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:28.712280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:28.715098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:28.750070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.752736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.753838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.758064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.761331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.763495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.875247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-34e9e771-6498-4910-8d04-e09683f61032 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:28.893119 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-34e9e771-6498-4910-8d04-e09683f61032 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1506 microversion: 2.1 time: 0.840910 Oct 29 03:01:28.894484 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1875/3786] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:28 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1506 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:29.509502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-07650d1d-520c-400c-96a5-e98884d4d80b req-79d4fb94-3b0a-4dbb-ba44-2e84ab813104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e2bba2-c1ed-4fb4-8481-765464243ed7", "tag": "8316fa62-e63c-4308-9bde-f1c1f823ffae"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:29.541858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-07650d1d-520c-400c-96a5-e98884d4d80b req-79d4fb94-3b0a-4dbb-ba44-2e84ab813104 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:29.564620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-07650d1d-520c-400c-96a5-e98884d4d80b req-79d4fb94-3b0a-4dbb-ba44-2e84ab813104 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:29.566286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-07650d1d-520c-400c-96a5-e98884d4d80b req-79d4fb94-3b0a-4dbb-ba44-2e84ab813104 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:29.600760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:29.625541 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-07650d1d-520c-400c-96a5-e98884d4d80b req-79d4fb94-3b0a-4dbb-ba44-2e84ab813104 service nova] Creating event network-changed:8316fa62-e63c-4308-9bde-f1c1f823ffae for instance e5e2bba2-c1ed-4fb4-8481-765464243ed7 on n-h1-862964-4 Oct 29 03:01:29.650990 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-07650d1d-520c-400c-96a5-e98884d4d80b req-79d4fb94-3b0a-4dbb-ba44-2e84ab813104 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.657753 Oct 29 03:01:29.651945 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1876/3787] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:29.665921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-316dba1e-18b7-4abb-b5bb-63d0857dd2d5 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:29.666630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-316dba1e-18b7-4abb-b5bb-63d0857dd2d5 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:29.670977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=12 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:29.692074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-316dba1e-18b7-4abb-b5bb-63d0857dd2d5 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:29.692825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-316dba1e-18b7-4abb-b5bb-63d0857dd2d5 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:29.693419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-316dba1e-18b7-4abb-b5bb-63d0857dd2d5 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:29.694429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-316dba1e-18b7-4abb-b5bb-63d0857dd2d5 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:29.700040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-316dba1e-18b7-4abb-b5bb-63d0857dd2d5 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:29.700790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-316dba1e-18b7-4abb-b5bb-63d0857dd2d5 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:29.786506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:29.811646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:29.816246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:29.820451 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0dc2da06-3b79-48d7-8f43-6a813737569f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1707 microversion: 2.42 time: 1.123346 Oct 29 03:01:29.822292 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1912/3788] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:28 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1707 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:29.855539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:29.856684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:29.872567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:29.873446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:29.874096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:29.875207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:29.875962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:29.876574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:30.342578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:30.468820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:30.481069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:30.491192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:30.492494 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fc154a88-62a3-4517-95e7-2a029a0c19f0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1750 microversion: 2.20 time: 0.668646 Oct 29 03:01:30.493087 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1913/3789] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:29 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1750 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:30.518642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7203bd74-3778-4ec7-bcd0-2922900d713a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:30.520309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7203bd74-3778-4ec7-bcd0-2922900d713a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:30.531545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7203bd74-3778-4ec7-bcd0-2922900d713a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:30.532620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7203bd74-3778-4ec7-bcd0-2922900d713a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:30.533262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7203bd74-3778-4ec7-bcd0-2922900d713a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:30.534235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7203bd74-3778-4ec7-bcd0-2922900d713a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:30.534849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7203bd74-3778-4ec7-bcd0-2922900d713a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:30.535681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7203bd74-3778-4ec7-bcd0-2922900d713a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:31.150319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7203bd74-3778-4ec7-bcd0-2922900d713a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:31.159748 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7203bd74-3778-4ec7-bcd0-2922900d713a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1506 microversion: 2.1 time: 0.661057 Oct 29 03:01:31.163031 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1914/3790] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:30 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:31.181919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:31.182896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:31.192075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:31.193318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:31.194752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:31.197363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:31.198747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:31.200177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:31.541179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-316dba1e-18b7-4abb-b5bb-63d0857dd2d5 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:31.571591 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-316dba1e-18b7-4abb-b5bb-63d0857dd2d5 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1318 microversion: 2.1 time: 1.918310 Oct 29 03:01:31.572889 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1877/3791] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:29 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1318 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:31.587612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:31.588332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:31.603807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:31.604423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:31.604928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:31.617948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:31.619025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:31.619476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:31.897394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:31.911602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:31.915185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:31.919972 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ea35762-99e6-4348-a39c-d1efcfdf48e3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1707 microversion: 2.42 time: 0.754603 Oct 29 03:01:31.921780 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1915/3792] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:31 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1707 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:32.185674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3e97365d-69df-454c-b2c7-56e5737bf40e tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:32.186304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3e97365d-69df-454c-b2c7-56e5737bf40e tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:32.200592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e97365d-69df-454c-b2c7-56e5737bf40e tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:32.201087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e97365d-69df-454c-b2c7-56e5737bf40e tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:32.201521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e97365d-69df-454c-b2c7-56e5737bf40e tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:32.202261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e97365d-69df-454c-b2c7-56e5737bf40e tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:32.202703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e97365d-69df-454c-b2c7-56e5737bf40e tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:32.203116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e97365d-69df-454c-b2c7-56e5737bf40e tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.003277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:33.022225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:33.028662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:33.032486 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1a76b7f6-911d-4312-a65a-8e27131bfebc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1750 microversion: 2.20 time: 1.458075 Oct 29 03:01:33.036915 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1878/3793] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:31 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1750 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:33.061846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-706cf0f7-048a-4ac6-a7c5-8eea8e945130 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:33.069792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-706cf0f7-048a-4ac6-a7c5-8eea8e945130 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:33.084062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706cf0f7-048a-4ac6-a7c5-8eea8e945130 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:33.084589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706cf0f7-048a-4ac6-a7c5-8eea8e945130 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:33.085028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706cf0f7-048a-4ac6-a7c5-8eea8e945130 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.085742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706cf0f7-048a-4ac6-a7c5-8eea8e945130 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:33.090131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706cf0f7-048a-4ac6-a7c5-8eea8e945130 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:33.090792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706cf0f7-048a-4ac6-a7c5-8eea8e945130 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.123188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3e97365d-69df-454c-b2c7-56e5737bf40e tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:33.139082 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3e97365d-69df-454c-b2c7-56e5737bf40e tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1506 microversion: 2.1 time: 0.957225 Oct 29 03:01:33.147702 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1916/3794] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:32 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1506 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:33.167086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:33.168409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:33.179111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:33.180007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:33.180662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.193983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:33.194669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:33.200521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.752646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:33.762823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:33.770763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:33.772110 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-57f5c172-f1d0-4f55-9972-c6a3df80968f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1753 microversion: 2.42 time: 0.623016 Oct 29 03:01:33.775102 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1917/3795] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:33 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1753 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:34.061838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:34.062754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:34.080252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.081127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.081634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.082517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.083121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.083606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.159534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-706cf0f7-048a-4ac6-a7c5-8eea8e945130 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:34.169885 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-706cf0f7-048a-4ac6-a7c5-8eea8e945130 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1318 microversion: 2.1 time: 1.131527 Oct 29 03:01:34.180691 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1879/3796] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:33 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1318 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:34.194041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d7b90941-e59e-46f6-8e15-6dfdbafcd29a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:34.194655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d7b90941-e59e-46f6-8e15-6dfdbafcd29a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:34.219998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7b90941-e59e-46f6-8e15-6dfdbafcd29a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.220565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7b90941-e59e-46f6-8e15-6dfdbafcd29a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.221129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7b90941-e59e-46f6-8e15-6dfdbafcd29a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.221992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7b90941-e59e-46f6-8e15-6dfdbafcd29a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.222407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7b90941-e59e-46f6-8e15-6dfdbafcd29a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.223033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7b90941-e59e-46f6-8e15-6dfdbafcd29a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.946164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:34.959564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:34.961202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:34.962928 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-915d1fde-b010-4750-8656-1968564899fc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1750 microversion: 2.20 time: 0.905151 Oct 29 03:01:34.969039 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1918/3797] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:34 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1750 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:34.974285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:34.978612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:34.988751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:34.993064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.994117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.994725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.998812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.999297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.999939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.012322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d7b90941-e59e-46f6-8e15-6dfdbafcd29a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:35.027388 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d7b90941-e59e-46f6-8e15-6dfdbafcd29a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1506 microversion: 2.1 time: 0.843643 Oct 29 03:01:35.043674 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1880/3798] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:34 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1506 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:35.208563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1353e98a-6b78-4db7-91c3-0100c01fa3c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:35.210665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1353e98a-6b78-4db7-91c3-0100c01fa3c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:35.222736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1353e98a-6b78-4db7-91c3-0100c01fa3c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.223766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1353e98a-6b78-4db7-91c3-0100c01fa3c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.225726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1353e98a-6b78-4db7-91c3-0100c01fa3c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.226784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1353e98a-6b78-4db7-91c3-0100c01fa3c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.228861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1353e98a-6b78-4db7-91c3-0100c01fa3c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.229500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1353e98a-6b78-4db7-91c3-0100c01fa3c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.518233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:35.564790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:35.566893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:35.568950 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-070e61af-054e-48ce-ac1e-7ddc75cccc38 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1753 microversion: 2.42 time: 0.598480 Oct 29 03:01:35.584820 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1919/3799] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:34 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1753 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:36.000074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:36.001360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:36.023303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.024901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.025531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.026881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.027508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.028130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.176729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1353e98a-6b78-4db7-91c3-0100c01fa3c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:36.190724 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1353e98a-6b78-4db7-91c3-0100c01fa3c7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1318 microversion: 2.1 time: 0.987206 Oct 29 03:01:36.211717 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1881/3800] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:35 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1318 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:36.217915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eff80218-1033-434c-bee8-66611150a40f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:36.223506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eff80218-1033-434c-bee8-66611150a40f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:36.239833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eff80218-1033-434c-bee8-66611150a40f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.240872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eff80218-1033-434c-bee8-66611150a40f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.242119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eff80218-1033-434c-bee8-66611150a40f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.243839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eff80218-1033-434c-bee8-66611150a40f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.251719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eff80218-1033-434c-bee8-66611150a40f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.252510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eff80218-1033-434c-bee8-66611150a40f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.302174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:36.757949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:36.794994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:36.801213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:36.819782 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1dc1bf3c-5186-4f8d-b8eb-8178c471fc56 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1750 microversion: 2.20 time: 0.824590 Oct 29 03:01:36.825313 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1920/3801] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:35 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1750 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:01:36.855774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:36.856703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:36.878099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.878768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.883402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.884292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.885025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.885627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.749065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eff80218-1033-434c-bee8-66611150a40f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:37.768090 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eff80218-1033-434c-bee8-66611150a40f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1506 microversion: 2.1 time: 1.554334 Oct 29 03:01:37.769118 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1882/3802] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:36 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1506 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:37.777381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-5ea60e9d-6df9-4816-bec2-ed2a50d1b47d req-7263862f-45ad-4d93-8f2f-b6065df43811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e2bba2-c1ed-4fb4-8481-765464243ed7", "name": "network-vif-plugged", "status": "completed", "tag": "8316fa62-e63c-4308-9bde-f1c1f823ffae"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:37.793716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5ea60e9d-6df9-4816-bec2-ed2a50d1b47d req-7263862f-45ad-4d93-8f2f-b6065df43811 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.794789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5ea60e9d-6df9-4816-bec2-ed2a50d1b47d req-7263862f-45ad-4d93-8f2f-b6065df43811 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.795618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5ea60e9d-6df9-4816-bec2-ed2a50d1b47d req-7263862f-45ad-4d93-8f2f-b6065df43811 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.827205 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-5ea60e9d-6df9-4816-bec2-ed2a50d1b47d req-7263862f-45ad-4d93-8f2f-b6065df43811 service nova] Creating event network-vif-plugged:8316fa62-e63c-4308-9bde-f1c1f823ffae for instance e5e2bba2-c1ed-4fb4-8481-765464243ed7 on n-h1-862964-4 Oct 29 03:01:37.834644 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-5ea60e9d-6df9-4816-bec2-ed2a50d1b47d req-7263862f-45ad-4d93-8f2f-b6065df43811 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063340 Oct 29 03:01:37.839896 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1883/3803] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:37.846541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b3dd4ec-5be5-4355-bd13-86c56fe31a03 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:37.847571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b3dd4ec-5be5-4355-bd13-86c56fe31a03 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:37.854961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b3dd4ec-5be5-4355-bd13-86c56fe31a03 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.855662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b3dd4ec-5be5-4355-bd13-86c56fe31a03 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.856289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b3dd4ec-5be5-4355-bd13-86c56fe31a03 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.859820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b3dd4ec-5be5-4355-bd13-86c56fe31a03 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.860224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b3dd4ec-5be5-4355-bd13-86c56fe31a03 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.860660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b3dd4ec-5be5-4355-bd13-86c56fe31a03 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:38.434890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9b3dd4ec-5be5-4355-bd13-86c56fe31a03 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:38.466675 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b3dd4ec-5be5-4355-bd13-86c56fe31a03 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1318 microversion: 2.1 time: 0.624148 Oct 29 03:01:38.496215 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1884/3804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:37 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:38.500317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:38.501641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:38.523856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:38.530981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:38.532133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:38.533107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:38.534697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:38.536756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:38.693862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:38.705405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:38.721585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:38.723490 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-65b4b468-6d8f-440c-839b-5cbac2264b79 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1799 microversion: 2.42 time: 1.895395 Oct 29 03:01:38.730220 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1921/3805] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:36 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1799 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:38.797183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d61c7f7-45ec-4f5e-aa19-3006e5643a6c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:38.797818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7d61c7f7-45ec-4f5e-aa19-3006e5643a6c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:38.809879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d61c7f7-45ec-4f5e-aa19-3006e5643a6c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:38.810275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d61c7f7-45ec-4f5e-aa19-3006e5643a6c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:38.820030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d61c7f7-45ec-4f5e-aa19-3006e5643a6c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:38.824655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d61c7f7-45ec-4f5e-aa19-3006e5643a6c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:38.825213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d61c7f7-45ec-4f5e-aa19-3006e5643a6c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:38.825716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d61c7f7-45ec-4f5e-aa19-3006e5643a6c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.146597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:39.164902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:39.170520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:39.172096 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a1bf1023-80a7-4581-895c-476e53b4e2f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1750 microversion: 2.20 time: 0.679631 Oct 29 03:01:39.174716 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1885/3806] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:38 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1750 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:39.277308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98374108-e8f9-4386-9206-60202e04fab9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'create', calling method: .version_select at 0x7fe1a81cddc0>, body: {"keypair": {"name": "tempest-keypair-745139463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNr9XDgmFHiey7YH+bc3v/detJ2IH0GtLILW3rlWtt0zgnx9l2bTt4UT7ooRkirxzMEgYqMX/J2Kl6BQQopM8c0HD0iousOXA6Z+hgPuxMHLY9MDhFc3MukQzNrWw/J7lw=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:39.316805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-98374108-e8f9-4386-9206-60202e04fab9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for project d4193e4464b7488b9b3bb4064afb0288. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:39.337695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-98374108-e8f9-4386-9206-60202e04fab9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for user dc4e17d222e0426698d1ef9a17921d64 and project d4193e4464b7488b9b3bb4064afb0288. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:39.402719 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-98374108-e8f9-4386-9206-60202e04fab9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.226575 Oct 29 03:01:39.403589 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1886/3807] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:01:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:39.461569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d61c7f7-45ec-4f5e-aa19-3006e5643a6c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:39.478352 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d61c7f7-45ec-4f5e-aa19-3006e5643a6c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1506 microversion: 2.1 time: 0.677405 Oct 29 03:01:39.479166 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1922/3808] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:38 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1506 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:39.499464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-500d0da2-3f84-4060-8f67-b94cadc791ad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:39.500071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-500d0da2-3f84-4060-8f67-b94cadc791ad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:39.510749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-500d0da2-3f84-4060-8f67-b94cadc791ad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.511670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-500d0da2-3f84-4060-8f67-b94cadc791ad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.512282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-500d0da2-3f84-4060-8f67-b94cadc791ad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.513178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-500d0da2-3f84-4060-8f67-b94cadc791ad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.513785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-500d0da2-3f84-4060-8f67-b94cadc791ad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.514585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-500d0da2-3f84-4060-8f67-b94cadc791ad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.757179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:39.758072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:39.776042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.776543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.777014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.777829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.778321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.778650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.398002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-500d0da2-3f84-4060-8f67-b94cadc791ad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:40.417890 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-500d0da2-3f84-4060-8f67-b94cadc791ad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1318 microversion: 2.1 time: 0.920313 Oct 29 03:01:40.435962 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1887/3809] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:39 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1318 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:40.435962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:40.435962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:40.467824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.470536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.471376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.472549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.474050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.480147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.714104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:40.734261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:40.739873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:40.741252 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-046fe6d9-d4b1-483a-8482-671d496e0c17 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1845 microversion: 2.42 time: 0.989380 Oct 29 03:01:40.747810 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1923/3810] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:39 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1845 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:40.767538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aae90d2f-0aac-4ade-beb9-fffd36af9b47 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:40.768240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aae90d2f-0aac-4ade-beb9-fffd36af9b47 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:40.785557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae90d2f-0aac-4ade-beb9-fffd36af9b47 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.786103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae90d2f-0aac-4ade-beb9-fffd36af9b47 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.786551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae90d2f-0aac-4ade-beb9-fffd36af9b47 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.787384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae90d2f-0aac-4ade-beb9-fffd36af9b47 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.787740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae90d2f-0aac-4ade-beb9-fffd36af9b47 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.788172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae90d2f-0aac-4ade-beb9-fffd36af9b47 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:41.478433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:41.503522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:41.514064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:41.515578 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-77b0f9a0-08ed-4efc-a6dd-e16e31a8e18f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1750 microversion: 2.20 time: 1.086264 Oct 29 03:01:41.526340 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1888/3811] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:40 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1750 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:41.539964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cca93973-d451-46ae-bd4f-035491d4ef3f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:41.539964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cca93973-d451-46ae-bd4f-035491d4ef3f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:41.571847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca93973-d451-46ae-bd4f-035491d4ef3f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:41.572344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca93973-d451-46ae-bd4f-035491d4ef3f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:41.572775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca93973-d451-46ae-bd4f-035491d4ef3f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:41.573517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca93973-d451-46ae-bd4f-035491d4ef3f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:41.574000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca93973-d451-46ae-bd4f-035491d4ef3f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:41.574417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca93973-d451-46ae-bd4f-035491d4ef3f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:41.949825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aae90d2f-0aac-4ade-beb9-fffd36af9b47 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:41.966702 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aae90d2f-0aac-4ade-beb9-fffd36af9b47 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1506 microversion: 2.1 time: 1.217717 Oct 29 03:01:41.974461 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1924/3812] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:40 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1506 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:41.979557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:41.989145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:42.012525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.013409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.014142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.015226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.015905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.016562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.047217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cca93973-d451-46ae-bd4f-035491d4ef3f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:42.060178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cca93973-d451-46ae-bd4f-035491d4ef3f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1509 microversion: 2.1 time: 0.536511 Oct 29 03:01:42.069118 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1889/3813] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:41 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1509 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:42.095220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6f0792d3-7beb-44ad-a469-280b361451d7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:42.097378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6f0792d3-7beb-44ad-a469-280b361451d7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:42.114321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0792d3-7beb-44ad-a469-280b361451d7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.115978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0792d3-7beb-44ad-a469-280b361451d7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.118622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0792d3-7beb-44ad-a469-280b361451d7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.124435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0792d3-7beb-44ad-a469-280b361451d7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.125646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0792d3-7beb-44ad-a469-280b361451d7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.128079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0792d3-7beb-44ad-a469-280b361451d7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.551770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f0792d3-7beb-44ad-a469-280b361451d7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:42.567092 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6f0792d3-7beb-44ad-a469-280b361451d7 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1509 microversion: 2.1 time: 0.477213 Oct 29 03:01:42.568343 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1890/3814] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:42 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:42.579297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:42.583205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:42.593528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.599368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.600424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.603944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.604630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.606586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.063785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:43.073854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:43.078780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:43.080986 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a6269c85-e386-4559-aa3c-cd18fa61dda7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1750 microversion: 2.20 time: 0.510588 Oct 29 03:01:43.083916 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1891/3815] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:42 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1750 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:43.090964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-46f142f1-7eeb-40e7-bd84-7f87d258b445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:43.093760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-46f142f1-7eeb-40e7-bd84-7f87d258b445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:43.107799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46f142f1-7eeb-40e7-bd84-7f87d258b445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.108762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46f142f1-7eeb-40e7-bd84-7f87d258b445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.109398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46f142f1-7eeb-40e7-bd84-7f87d258b445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.111521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46f142f1-7eeb-40e7-bd84-7f87d258b445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.113621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46f142f1-7eeb-40e7-bd84-7f87d258b445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.115829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46f142f1-7eeb-40e7-bd84-7f87d258b445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.266857 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-46f142f1-7eeb-40e7-bd84-7f87d258b445 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "PUT /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1081 microversion: 2.1 time: 0.179835 Oct 29 03:01:43.267792 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1892/3816] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 03:01:43 2022] PUT /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1081 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:43.272664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d805be8a-b91e-4a17-9270-5ca150d4e366 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:43.278257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d805be8a-b91e-4a17-9270-5ca150d4e366 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:43.292773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d805be8a-b91e-4a17-9270-5ca150d4e366 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.293440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d805be8a-b91e-4a17-9270-5ca150d4e366 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.294042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d805be8a-b91e-4a17-9270-5ca150d4e366 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.294879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d805be8a-b91e-4a17-9270-5ca150d4e366 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.295453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d805be8a-b91e-4a17-9270-5ca150d4e366 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.298227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d805be8a-b91e-4a17-9270-5ca150d4e366 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.594492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d805be8a-b91e-4a17-9270-5ca150d4e366 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:43.622339 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d805be8a-b91e-4a17-9270-5ca150d4e366 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1506 microversion: 2.1 time: 0.352908 Oct 29 03:01:43.640197 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1893/3817] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:43 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:43.642370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bd08d3ad-711d-4bc1-a883-1168396d3fc4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:43.643378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bd08d3ad-711d-4bc1-a883-1168396d3fc4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:43.656689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd08d3ad-711d-4bc1-a883-1168396d3fc4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.658288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd08d3ad-711d-4bc1-a883-1168396d3fc4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.658849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd08d3ad-711d-4bc1-a883-1168396d3fc4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.660062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd08d3ad-711d-4bc1-a883-1168396d3fc4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.660910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd08d3ad-711d-4bc1-a883-1168396d3fc4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.661585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd08d3ad-711d-4bc1-a883-1168396d3fc4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.057470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bd08d3ad-711d-4bc1-a883-1168396d3fc4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:44.067873 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bd08d3ad-711d-4bc1-a883-1168396d3fc4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1507 microversion: 2.1 time: 0.438582 Oct 29 03:01:44.077964 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1894/3818] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:43 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1507 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:44.087080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-59bc39d3-9209-42ae-9900-f6cd325edc5e req-01d93fe5-a934-4b42-a0f9-42655e33448e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "tag": "ad65712e-7434-443f-9bb6-d42e2e4152d0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:44.110989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-59bc39d3-9209-42ae-9900-f6cd325edc5e req-01d93fe5-a934-4b42-a0f9-42655e33448e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.111471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-59bc39d3-9209-42ae-9900-f6cd325edc5e req-01d93fe5-a934-4b42-a0f9-42655e33448e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.111898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-59bc39d3-9209-42ae-9900-f6cd325edc5e req-01d93fe5-a934-4b42-a0f9-42655e33448e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.142495 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-59bc39d3-9209-42ae-9900-f6cd325edc5e req-01d93fe5-a934-4b42-a0f9-42655e33448e service nova] Creating event network-changed:ad65712e-7434-443f-9bb6-d42e2e4152d0 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:01:44.154187 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-59bc39d3-9209-42ae-9900-f6cd325edc5e req-01d93fe5-a934-4b42-a0f9-42655e33448e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078481 Oct 29 03:01:44.155126 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1895/3819] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:44.172761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a5da4567-bd8e-449f-b861-92e72059a3be tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:44.173471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a5da4567-bd8e-449f-b861-92e72059a3be tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:44.188786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5da4567-bd8e-449f-b861-92e72059a3be tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.189451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5da4567-bd8e-449f-b861-92e72059a3be tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.190038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5da4567-bd8e-449f-b861-92e72059a3be tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.191088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5da4567-bd8e-449f-b861-92e72059a3be tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.191875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5da4567-bd8e-449f-b861-92e72059a3be tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.192528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5da4567-bd8e-449f-b861-92e72059a3be tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.240700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:44.268962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:44.277212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:44.280607 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bbd6a5e3-78e1-4358-aee4-bd1ef7f0daf7 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1845 microversion: 2.42 time: 2.304749 Oct 29 03:01:44.283068 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1925/3820] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:41 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1845 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:44.288989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:44.289836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:44.303899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.304812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.305413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.306314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.308378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.309025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.703252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a5da4567-bd8e-449f-b861-92e72059a3be tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:44.713307 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a5da4567-bd8e-449f-b861-92e72059a3be tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1507 microversion: 2.1 time: 0.556955 Oct 29 03:01:44.721857 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1896/3821] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:44 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1507 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:44.735808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b9831fa8-c684-4047-8b41-3b40083ea4f8 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:44.737139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b9831fa8-c684-4047-8b41-3b40083ea4f8 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:44.751965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9831fa8-c684-4047-8b41-3b40083ea4f8 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.752734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9831fa8-c684-4047-8b41-3b40083ea4f8 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.753413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9831fa8-c684-4047-8b41-3b40083ea4f8 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.754459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9831fa8-c684-4047-8b41-3b40083ea4f8 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.758446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9831fa8-c684-4047-8b41-3b40083ea4f8 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.759148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9831fa8-c684-4047-8b41-3b40083ea4f8 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.840953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:44.848300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:44.857848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:44.861691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:44.870063 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ad75b360-3e43-4084-8963-f7150dc75f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.585549 Oct 29 03:01:44.870906 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1926/3822] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:44 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:44.875757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-62479aae-c52d-4171-9c27-5f41e0f881ba tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:44.884837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-62479aae-c52d-4171-9c27-5f41e0f881ba tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:44.906832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62479aae-c52d-4171-9c27-5f41e0f881ba tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.907767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62479aae-c52d-4171-9c27-5f41e0f881ba tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.908422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62479aae-c52d-4171-9c27-5f41e0f881ba tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.909390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62479aae-c52d-4171-9c27-5f41e0f881ba tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.910154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62479aae-c52d-4171-9c27-5f41e0f881ba tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.910833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62479aae-c52d-4171-9c27-5f41e0f881ba tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.031836 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-62479aae-c52d-4171-9c27-5f41e0f881ba tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "PUT /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1083 microversion: 2.1 time: 0.159461 Oct 29 03:01:45.034648 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1927/3823] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 03:01:44 2022] PUT /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1083 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:45.055877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-23de4f2d-47ff-4e0b-b5fa-a7f28e8d1dbd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.056487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-23de4f2d-47ff-4e0b-b5fa-a7f28e8d1dbd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:45.072475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23de4f2d-47ff-4e0b-b5fa-a7f28e8d1dbd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.073135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23de4f2d-47ff-4e0b-b5fa-a7f28e8d1dbd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.073766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23de4f2d-47ff-4e0b-b5fa-a7f28e8d1dbd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.074689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23de4f2d-47ff-4e0b-b5fa-a7f28e8d1dbd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.075514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23de4f2d-47ff-4e0b-b5fa-a7f28e8d1dbd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.075929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23de4f2d-47ff-4e0b-b5fa-a7f28e8d1dbd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.195146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b9831fa8-c684-4047-8b41-3b40083ea4f8 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:45.207428 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b9831fa8-c684-4047-8b41-3b40083ea4f8 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1506 microversion: 2.1 time: 0.482551 Oct 29 03:01:45.208283 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1897/3824] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:44 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:45.312458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.316699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:45.335840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.336631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.337516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.339165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.340433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.341108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.725773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:45.755539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:45.758496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-23de4f2d-47ff-4e0b-b5fa-a7f28e8d1dbd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:45.762512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:45.764185 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0382e645-a1d2-426c-930b-e75521bdb618 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1866 microversion: 2.42 time: 0.455596 Oct 29 03:01:45.769965 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-23de4f2d-47ff-4e0b-b5fa-a7f28e8d1dbd tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1509 microversion: 2.1 time: 0.718137 Oct 29 03:01:45.772441 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1898/3825] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:45 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1866 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:45.772890 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1928/3826] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:45 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1509 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:45.820498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-89c7ffa9-7144-4fea-80ea-86c6867ddfef tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.821294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-89c7ffa9-7144-4fea-80ea-86c6867ddfef tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:45.848259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89c7ffa9-7144-4fea-80ea-86c6867ddfef tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.849228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89c7ffa9-7144-4fea-80ea-86c6867ddfef tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.849921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89c7ffa9-7144-4fea-80ea-86c6867ddfef tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.851692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89c7ffa9-7144-4fea-80ea-86c6867ddfef tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.852520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89c7ffa9-7144-4fea-80ea-86c6867ddfef tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.853844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89c7ffa9-7144-4fea-80ea-86c6867ddfef tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.898964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.899572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:45.917278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.919989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.920603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.924772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.925706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.930607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.566731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-89c7ffa9-7144-4fea-80ea-86c6867ddfef tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:46.576916 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-89c7ffa9-7144-4fea-80ea-86c6867ddfef tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1509 microversion: 2.1 time: 0.763982 Oct 29 03:01:46.580517 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1899/3827] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:45 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1509 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:46.595207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f1ec2b3-1828-46fa-9ae2-3fc8e19bf2e9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:46.595207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f1ec2b3-1828-46fa-9ae2-3fc8e19bf2e9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:46.605970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:46.616921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:46.622356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:46.627518 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-145cf7e4-a1bd-462a-82b8-c363a3f34cdb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.732534 Oct 29 03:01:46.627677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1ec2b3-1828-46fa-9ae2-3fc8e19bf2e9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.628241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1ec2b3-1828-46fa-9ae2-3fc8e19bf2e9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.628384 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1929/3828] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:45 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:46.629656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1ec2b3-1828-46fa-9ae2-3fc8e19bf2e9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.630404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1ec2b3-1828-46fa-9ae2-3fc8e19bf2e9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.631665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1ec2b3-1828-46fa-9ae2-3fc8e19bf2e9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.631665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1ec2b3-1828-46fa-9ae2-3fc8e19bf2e9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.641386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6b4aafe1-ac37-4f74-9d4b-6b012dde55b2 req-cd11bddb-b9ed-47f0-94da-52f2700179c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "tag": "bdbee0eb-ffe5-46aa-bf13-64202754d2b4"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:46.662391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6b4aafe1-ac37-4f74-9d4b-6b012dde55b2 req-cd11bddb-b9ed-47f0-94da-52f2700179c5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.662900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6b4aafe1-ac37-4f74-9d4b-6b012dde55b2 req-cd11bddb-b9ed-47f0-94da-52f2700179c5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.663311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6b4aafe1-ac37-4f74-9d4b-6b012dde55b2 req-cd11bddb-b9ed-47f0-94da-52f2700179c5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.700029 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6b4aafe1-ac37-4f74-9d4b-6b012dde55b2 req-cd11bddb-b9ed-47f0-94da-52f2700179c5 service nova] Creating event network-changed:bdbee0eb-ffe5-46aa-bf13-64202754d2b4 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:01:46.706460 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6b4aafe1-ac37-4f74-9d4b-6b012dde55b2 req-cd11bddb-b9ed-47f0-94da-52f2700179c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077013 Oct 29 03:01:46.714710 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1930/3829] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:46.720830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dba87715-5828-43d1-a415-83eddd2bcf0f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:46.721613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dba87715-5828-43d1-a415-83eddd2bcf0f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:46.735640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dba87715-5828-43d1-a415-83eddd2bcf0f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.739467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dba87715-5828-43d1-a415-83eddd2bcf0f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.740081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dba87715-5828-43d1-a415-83eddd2bcf0f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.741695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dba87715-5828-43d1-a415-83eddd2bcf0f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.742547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dba87715-5828-43d1-a415-83eddd2bcf0f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.743628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dba87715-5828-43d1-a415-83eddd2bcf0f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.773463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dba87715-5828-43d1-a415-83eddd2bcf0f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:46.901656 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dba87715-5828-43d1-a415-83eddd2bcf0f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 204 len: 0 microversion: 2.1 time: 0.185150 Oct 29 03:01:46.902596 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1931/3830] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:46 2022] DELETE /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:46.913075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:46.916783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:46.929075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.930936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.931629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.932759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.935576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.936196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:47.586651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:47.600163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:47.601624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:47.608969 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02d6a540-4933-4053-b930-7419f649e07d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1866 microversion: 2.42 time: 0.704913 Oct 29 03:01:47.611868 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1932/3831] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:46 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1866 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:47.620542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eec26835-95ef-4bc5-8bad-3cc7cc1464ff tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:47.628193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eec26835-95ef-4bc5-8bad-3cc7cc1464ff tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:47.644827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec26835-95ef-4bc5-8bad-3cc7cc1464ff tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:47.647445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec26835-95ef-4bc5-8bad-3cc7cc1464ff tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:47.648351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec26835-95ef-4bc5-8bad-3cc7cc1464ff tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:47.649262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec26835-95ef-4bc5-8bad-3cc7cc1464ff tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:47.650171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec26835-95ef-4bc5-8bad-3cc7cc1464ff tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:47.653841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eec26835-95ef-4bc5-8bad-3cc7cc1464ff tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:47.725299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eec26835-95ef-4bc5-8bad-3cc7cc1464ff tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:47.809627 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.compute.api [None req-eec26835-95ef-4bc5-8bad-3cc7cc1464ff tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Instance is already in deleting state, ignoring this request Oct 29 03:01:47.811455 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eec26835-95ef-4bc5-8bad-3cc7cc1464ff tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 204 len: 0 microversion: 2.1 time: 0.197800 Oct 29 03:01:47.812964 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1933/3832] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:47 2022] DELETE /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:47.825699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:47.826973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:47.834299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:47.835163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:47.836029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:47.837817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:47.838733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:47.840487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:48.195322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:48.233050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:48.241344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:48.242962 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b9949246-c559-4708-a7ce-ee6964379869 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.428772 Oct 29 03:01:48.250778 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1934/3833] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:47 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:48.258749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-569729e0-7296-4fa7-a0d1-852448ae9645 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:48.262591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-569729e0-7296-4fa7-a0d1-852448ae9645 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:48.281015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-569729e0-7296-4fa7-a0d1-852448ae9645 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:48.281881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-569729e0-7296-4fa7-a0d1-852448ae9645 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:48.282545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-569729e0-7296-4fa7-a0d1-852448ae9645 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:48.283472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-569729e0-7296-4fa7-a0d1-852448ae9645 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:48.284125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-569729e0-7296-4fa7-a0d1-852448ae9645 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:48.286953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-569729e0-7296-4fa7-a0d1-852448ae9645 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:48.672064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8f1ec2b3-1828-46fa-9ae2-3fc8e19bf2e9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:48.685251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:48.694872 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f1ec2b3-1828-46fa-9ae2-3fc8e19bf2e9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1486 microversion: 2.1 time: 2.111262 Oct 29 03:01:48.695870 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1900/3834] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:46 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1486 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:48.708363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1859953805", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c699032f-5e15-4569-a5f2-71386fa3ff27"}], "security_groups": [{"name": "tempest-securitygroup--1300032383"}], "key_name": "tempest-keypair-745139463", "user_data": "}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:49.382891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:49.492529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] validate_networks() for [('c699032f-5e15-4569-a5f2-71386fa3ff27', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:01:49.586584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-569729e0-7296-4fa7-a0d1-852448ae9645 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb51369444c42c190b1b7bf5e23ddb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a3da1a632d443aba8f5cf3b741714b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:49.603233 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-569729e0-7296-4fa7-a0d1-852448ae9645 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 200 len: 1515 microversion: 2.1 time: 1.350828 Oct 29 03:01:49.617415 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1935/3835] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:48 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 1515 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:49.635045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:49.638907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:49.657223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:49.661989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:49.663005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:49.666211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:49.666972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:49.667804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:50.196496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:50.215610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:50.217724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:50.220009 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a7d83533-b4b3-4db2-8e6d-700c913ca206 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1887 microversion: 2.42 time: 0.600732 Oct 29 03:01:50.248858 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1936/3836] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:49 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1887 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:50.257538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1031102553", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:50.393229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] validate_networks() for [('122727e1-3472-41cb-8cbc-137789a0f19f', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:01:50.724122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:52.876952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:01:52.878227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:01:52.879051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:01:52.879782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:01:52.880619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:01:52.912277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:52.918337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:52.919178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:52.920182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:52.924828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:52.925556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.021190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for project d4193e4464b7488b9b3bb4064afb0288. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:53.048391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for user dc4e17d222e0426698d1ef9a17921d64 and project d4193e4464b7488b9b3bb4064afb0288. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:53.086711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:01:53.095421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:01:53.274683 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-49ed8175-c908-4eae-aace-2684f9eb3128 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.557473 Oct 29 03:01:53.277408 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1901/3837] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:01:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 4581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:01:53.284572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:01:53.285907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:01:53.286600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:01:53.287784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:01:53.288374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:01:53.309494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:53.314985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.315484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.315974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.320760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:53.334457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.338046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.341043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.360481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.366125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.368017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.373025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.377279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.378336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.462311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Getting quotas for project 189356634b6049a3a44bb701d8529d13. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:53.497242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Getting quotas for user 541c48e9a20d4b04a33018145c1fce9f and project 189356634b6049a3a44bb701d8529d13. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:53.604200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:01:53.616819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:01:53.778408 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-11148484-4901-4c75-975c-a866c50350ea tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.528002 Oct 29 03:01:53.779989 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1937/3838] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:01:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:01:53.784743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-2ed547dd-89b9-44c1-bed1-1c9dda8f091c req-4619e083-8c0f-4afb-baa9-44b2fefe7f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31241403-2a17-4f40-818d-fc8caca85e4b", "tag": "e6f1a4fa-984f-49dc-a400-07b55f9cbbeb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:53.811500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2ed547dd-89b9-44c1-bed1-1c9dda8f091c req-4619e083-8c0f-4afb-baa9-44b2fefe7f2d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.813634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2ed547dd-89b9-44c1-bed1-1c9dda8f091c req-4619e083-8c0f-4afb-baa9-44b2fefe7f2d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.815570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2ed547dd-89b9-44c1-bed1-1c9dda8f091c req-4619e083-8c0f-4afb-baa9-44b2fefe7f2d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.876721 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-2ed547dd-89b9-44c1-bed1-1c9dda8f091c req-4619e083-8c0f-4afb-baa9-44b2fefe7f2d service nova] Creating event network-changed:e6f1a4fa-984f-49dc-a400-07b55f9cbbeb for instance 31241403-2a17-4f40-818d-fc8caca85e4b on n-h2-862964-4 Oct 29 03:01:53.923558 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-2ed547dd-89b9-44c1-bed1-1c9dda8f091c req-4619e083-8c0f-4afb-baa9-44b2fefe7f2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137982 Oct 29 03:01:53.929049 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1938/3839] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:53.958110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:53.958861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: e5e2bba2-c1ed-4fb4-8481-765464243ed7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:54.000100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:54.000591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:54.009363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:54.013105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:54.013600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:54.014047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:54.087616 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] HTTP exception thrown: Instance e5e2bba2-c1ed-4fb4-8481-765464243ed7 could not be found. Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Request method failure captured: Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 HTTP/1.1 Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJbzpx2ds46IIvOmGVrIWHjDlHa3bMgf3uqhEXZGs4Aw-2OxnuWLKTrr4kSt8XhBqBROaDkZi7NFv7mT25eNvWAcjFOdBn7DyRJ0wWdoWY1unMUzgxGpP5sCpK5ZI5a-88SnSiI7RlQTt-BKcfShIpQEbNSnRMZqb1xcTRKXDINlaHQ Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c7a3da1a632d443aba8f5cf3b741714b Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7a3da1a632d443aba8f5cf3b741714b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7a3da1a632d443aba8f5cf3b741714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7a3da1a632d443aba8f5cf3b741714b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7a3da1a632d443aba8f5cf3b741714b"}]}] Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c7a3da1a632d443aba8f5cf3b741714b Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerDiskConfigTestJSON-541182015-project Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: adb51369444c42c190b1b7bf5e23ddb9 Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerDiskConfigTestJSON-541182015-project Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance e5e2bba2-c1ed-4fb4-8481-765464243ed7 could not be found. Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'e5e2bba2-c1ed-4fb4-8481-765464243ed7'} Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e2bba2-c1ed-4fb4-8481-765464243ed7 could not be found. Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e2bba2-c1ed-4fb4-8481-765464243ed7 could not be found. Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:54.089307 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:54.096946 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:54.096946 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:54.096946 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:54.096946 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:54.096946 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:54.096946 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e2bba2-c1ed-4fb4-8481-765464243ed7 could not be found. Oct 29 03:01:54.096946 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:54.113434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Returning 404 to user: Instance e5e2bba2-c1ed-4fb4-8481-765464243ed7 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:54.114835 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-831e4d2b-eeec-48ea-9e5c-1ad007d83fd4 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7" status: 404 len: 111 microversion: 2.1 time: 0.183495 Oct 29 03:01:54.119272 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1939/3840] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:53 2022] GET /compute/v2.1/servers/e5e2bba2-c1ed-4fb4-8481-765464243ed7 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:54.145620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:54.162815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:54.188794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:54.189291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:54.189727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:54.190462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:54.191028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:54.191452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:55.231205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:55.254249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:55.255926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:55.264085 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1b3040bf-dd9f-4722-af30-5ae85e21d4d8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 1.984081 Oct 29 03:01:55.289559 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1902/3841] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:53 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:55.319953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-3cbd56ae-1ddb-4bea-9e91-611092a57cde req-3a65d7b0-7e84-4b02-9f10-a77ac6dd79b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "tag": "278acd07-af3d-45fa-b282-64d5acdc531b"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:55.362098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3cbd56ae-1ddb-4bea-9e91-611092a57cde req-3a65d7b0-7e84-4b02-9f10-a77ac6dd79b4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:55.362462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3cbd56ae-1ddb-4bea-9e91-611092a57cde req-3a65d7b0-7e84-4b02-9f10-a77ac6dd79b4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:55.362913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3cbd56ae-1ddb-4bea-9e91-611092a57cde req-3a65d7b0-7e84-4b02-9f10-a77ac6dd79b4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:55.464065 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-3cbd56ae-1ddb-4bea-9e91-611092a57cde req-3a65d7b0-7e84-4b02-9f10-a77ac6dd79b4 service nova] Creating event network-changed:278acd07-af3d-45fa-b282-64d5acdc531b for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:01:55.470816 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-3cbd56ae-1ddb-4bea-9e91-611092a57cde req-3a65d7b0-7e84-4b02-9f10-a77ac6dd79b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179733 Oct 29 03:01:55.475682 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1903/3842] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:55.488919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c925e2ee-ae39-440c-abdd-dc8b880d3972 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:55.502320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c925e2ee-ae39-440c-abdd-dc8b880d3972 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:55.519951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c925e2ee-ae39-440c-abdd-dc8b880d3972 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:55.520429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c925e2ee-ae39-440c-abdd-dc8b880d3972 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:55.520854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c925e2ee-ae39-440c-abdd-dc8b880d3972 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:55.521560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c925e2ee-ae39-440c-abdd-dc8b880d3972 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:55.535324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c925e2ee-ae39-440c-abdd-dc8b880d3972 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:55.535889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c925e2ee-ae39-440c-abdd-dc8b880d3972 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:55.987963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c925e2ee-ae39-440c-abdd-dc8b880d3972 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:56.007921 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c925e2ee-ae39-440c-abdd-dc8b880d3972 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1234 microversion: 2.1 time: 0.524788 Oct 29 03:01:56.021135 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1904/3843] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:55 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1234 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:56.050518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f20ef6d-72b5-4b07-aad6-e9fc7c5c7d76 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:56.051437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f20ef6d-72b5-4b07-aad6-e9fc7c5c7d76 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:56.079887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20ef6d-72b5-4b07-aad6-e9fc7c5c7d76 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:56.081762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20ef6d-72b5-4b07-aad6-e9fc7c5c7d76 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:56.084618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20ef6d-72b5-4b07-aad6-e9fc7c5c7d76 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:56.085614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20ef6d-72b5-4b07-aad6-e9fc7c5c7d76 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:56.092613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20ef6d-72b5-4b07-aad6-e9fc7c5c7d76 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:56.102532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20ef6d-72b5-4b07-aad6-e9fc7c5c7d76 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:56.428415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f20ef6d-72b5-4b07-aad6-e9fc7c5c7d76 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:56.438857 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f20ef6d-72b5-4b07-aad6-e9fc7c5c7d76 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1210 microversion: 2.1 time: 0.416166 Oct 29 03:01:56.450219 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1905/3844] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:56 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1210 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:56.455247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:56.474638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:56.498391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:56.506705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:56.507743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:56.508674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:56.512809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:56.513530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:56.564036 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] HTTP exception thrown: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Request method failure captured: Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e HTTP/1.1 Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJbzpx2ds46IIvOmGVrIWHjDlHa3bMgf3uqhEXZGs4Aw-2OxnuWLKTrr4kSt8XhBqBROaDkZi7NFv7mT25eNvWAcjFOdBn7DyRJ0wWdoWY1unMUzgxGpP5sCpK5ZI5a-88SnSiI7RlQTt-BKcfShIpQEbNSnRMZqb1xcTRKXDINlaHQ Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c7a3da1a632d443aba8f5cf3b741714b Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7a3da1a632d443aba8f5cf3b741714b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7a3da1a632d443aba8f5cf3b741714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7a3da1a632d443aba8f5cf3b741714b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7a3da1a632d443aba8f5cf3b741714b"}]}] Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c7a3da1a632d443aba8f5cf3b741714b Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerDiskConfigTestJSON-541182015-project Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: adb51369444c42c190b1b7bf5e23ddb9 Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerDiskConfigTestJSON-541182015-project Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '011b0dd6-a90d-4ee3-ad93-d4b22a12148e'} Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:56.575882 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:56.581159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. Oct 29 03:01:56.581159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:56.581159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:56.581159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:56.581159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:56.581159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:56.581159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:56.581159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:56.581159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:56.581159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. Oct 29 03:01:56.581159 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:56.586986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Returning 404 to user: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:56.588050 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-65adafec-b618-4e25-ad3a-4a8ef8230652 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 404 len: 111 microversion: 2.1 time: 0.136579 Oct 29 03:01:56.589114 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1906/3845] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:56 2022] DELETE /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:56.599870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:56.616723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:56.625246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:56.632092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:56.634935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:56.635888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:56.636515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:56.638808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:56.754007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:56.783821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:56.786708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:56.788363 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c2f70f86-2dd8-4724-944d-4848c094294b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1887 microversion: 2.42 time: 2.668014 Oct 29 03:01:56.801756 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1940/3846] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:54 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1887 bytes in 2682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:56.816037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:56.817892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 011b0dd6-a90d-4ee3-ad93-d4b22a12148e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:57.718987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:57.719500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:57.719924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:57.720641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:57.721110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:57.721508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:57.778630 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] HTTP exception thrown: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Request method failure captured: Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e HTTP/1.1 Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJbzpx2ds46IIvOmGVrIWHjDlHa3bMgf3uqhEXZGs4Aw-2OxnuWLKTrr4kSt8XhBqBROaDkZi7NFv7mT25eNvWAcjFOdBn7DyRJ0wWdoWY1unMUzgxGpP5sCpK5ZI5a-88SnSiI7RlQTt-BKcfShIpQEbNSnRMZqb1xcTRKXDINlaHQ Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: c7a3da1a632d443aba8f5cf3b741714b Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7a3da1a632d443aba8f5cf3b741714b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7a3da1a632d443aba8f5cf3b741714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7a3da1a632d443aba8f5cf3b741714b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7a3da1a632d443aba8f5cf3b741714b"}]}] Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: c7a3da1a632d443aba8f5cf3b741714b Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerDiskConfigTestJSON-541182015-project Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: adb51369444c42c190b1b7bf5e23ddb9 Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerDiskConfigTestJSON-541182015-project Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '011b0dd6-a90d-4ee3-ad93-d4b22a12148e'} Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:57.792084 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:57.797411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:57.797411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:57.797411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:57.797411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:57.797411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:57.797411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. Oct 29 03:01:57.797411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:01:57.819525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Returning 404 to user: Instance 011b0dd6-a90d-4ee3-ad93-d4b22a12148e could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:57.823075 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1888154f-c87b-4241-a10b-4db1ccca1f7f tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e" status: 404 len: 111 microversion: 2.1 time: 1.019661 Oct 29 03:01:57.831907 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1941/3847] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:56 2022] GET /compute/v2.1/servers/011b0dd6-a90d-4ee3-ad93-d4b22a12148e => generated 111 bytes in 1028 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:57.838692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f19e18ad-a0c9-43eb-9646-b79f6c9a26c0 req-b18f45b2-8a15-4b9b-9c25-2478ba2125e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e2bba2-c1ed-4fb4-8481-765464243ed7", "name": "network-vif-deleted", "tag": "8316fa62-e63c-4308-9bde-f1c1f823ffae"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:57.930224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f19e18ad-a0c9-43eb-9646-b79f6c9a26c0 req-b18f45b2-8a15-4b9b-9c25-2478ba2125e6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:57.930704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f19e18ad-a0c9-43eb-9646-b79f6c9a26c0 req-b18f45b2-8a15-4b9b-9c25-2478ba2125e6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:57.941578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f19e18ad-a0c9-43eb-9646-b79f6c9a26c0 req-b18f45b2-8a15-4b9b-9c25-2478ba2125e6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.031955 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f19e18ad-a0c9-43eb-9646-b79f6c9a26c0 req-b18f45b2-8a15-4b9b-9c25-2478ba2125e6 service nova] Creating event network-vif-deleted:8316fa62-e63c-4308-9bde-f1c1f823ffae for instance e5e2bba2-c1ed-4fb4-8481-765464243ed7 on n-h1-862964-4 Oct 29 03:01:58.035969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:58.048627 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f19e18ad-a0c9-43eb-9646-b79f6c9a26c0 req-b18f45b2-8a15-4b9b-9c25-2478ba2125e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215055 Oct 29 03:01:58.049229 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1942/3848] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:58.063003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1b36ebec-dc84-4b2b-9b8d-98be517abb7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:58.076320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1b36ebec-dc84-4b2b-9b8d-98be517abb7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:58.113919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:58.117969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:58.121061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b36ebec-dc84-4b2b-9b8d-98be517abb7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.122646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b36ebec-dc84-4b2b-9b8d-98be517abb7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.124913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b36ebec-dc84-4b2b-9b8d-98be517abb7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.127830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b36ebec-dc84-4b2b-9b8d-98be517abb7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.130437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b36ebec-dc84-4b2b-9b8d-98be517abb7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.138779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b36ebec-dc84-4b2b-9b8d-98be517abb7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.141835 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-14664189-e734-46a4-97f8-ce29a4bcf644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 1.551118 Oct 29 03:01:58.195031 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1907/3849] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:56 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:58.237050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8db00ee0-dd91-4b2c-a62e-5cfaf85a80a1 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:58.248831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8db00ee0-dd91-4b2c-a62e-5cfaf85a80a1 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:58.291260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db00ee0-dd91-4b2c-a62e-5cfaf85a80a1 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.294194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db00ee0-dd91-4b2c-a62e-5cfaf85a80a1 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.295347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db00ee0-dd91-4b2c-a62e-5cfaf85a80a1 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.297019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db00ee0-dd91-4b2c-a62e-5cfaf85a80a1 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.299453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db00ee0-dd91-4b2c-a62e-5cfaf85a80a1 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.301079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8db00ee0-dd91-4b2c-a62e-5cfaf85a80a1 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.477302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b36ebec-dc84-4b2b-9b8d-98be517abb7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:58.493776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:58.530286 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1b36ebec-dc84-4b2b-9b8d-98be517abb7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1296 microversion: 2.1 time: 0.457371 Oct 29 03:01:58.536222 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1943/3850] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:58 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1296 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:58.559909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:58.560605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:58.633643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.636812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.637589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.641760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.646053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.647192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.710627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8db00ee0-dd91-4b2c-a62e-5cfaf85a80a1 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:58.749219 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8db00ee0-dd91-4b2c-a62e-5cfaf85a80a1 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1274 microversion: 2.1 time: 0.545905 Oct 29 03:01:58.758406 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1908/3851] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:58 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1274 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:58.781661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:58.803168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:58.835302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.838950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.839429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.848547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.852031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.852490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.902432 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] HTTP exception thrown: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Request method failure captured: Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd HTTP/1.1 Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJbzpx2ds46IIvOmGVrIWHjDlHa3bMgf3uqhEXZGs4Aw-2OxnuWLKTrr4kSt8XhBqBROaDkZi7NFv7mT25eNvWAcjFOdBn7DyRJ0wWdoWY1unMUzgxGpP5sCpK5ZI5a-88SnSiI7RlQTt-BKcfShIpQEbNSnRMZqb1xcTRKXDINlaHQ Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c7a3da1a632d443aba8f5cf3b741714b Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7a3da1a632d443aba8f5cf3b741714b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7a3da1a632d443aba8f5cf3b741714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7a3da1a632d443aba8f5cf3b741714b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7a3da1a632d443aba8f5cf3b741714b"}]}] Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c7a3da1a632d443aba8f5cf3b741714b Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerDiskConfigTestJSON-541182015-project Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: adb51369444c42c190b1b7bf5e23ddb9 Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerDiskConfigTestJSON-541182015-project Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd'} Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:58.907004 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:58.912880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. Oct 29 03:01:58.912880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:58.912880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:58.912880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:58.912880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:58.912880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:58.912880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:58.912880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:58.912880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:58.912880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. Oct 29 03:01:58.912880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:58.915285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Returning 404 to user: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:58.918759 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-49963db0-f93c-4c80-814b-e66e9c5e0dad tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 404 len: 111 microversion: 2.1 time: 0.157561 Oct 29 03:01:58.920952 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1909/3852] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:58 2022] DELETE /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:58.941726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:58.943564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] [instance: 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:58.959959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.962908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.963556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.966863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.973659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.974741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:59.032943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] HTTP exception thrown: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Request method failure captured: Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd HTTP/1.1 Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJbzpx2ds46IIvOmGVrIWHjDlHa3bMgf3uqhEXZGs4Aw-2OxnuWLKTrr4kSt8XhBqBROaDkZi7NFv7mT25eNvWAcjFOdBn7DyRJ0wWdoWY1unMUzgxGpP5sCpK5ZI5a-88SnSiI7RlQTt-BKcfShIpQEbNSnRMZqb1xcTRKXDINlaHQ Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c7a3da1a632d443aba8f5cf3b741714b Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7a3da1a632d443aba8f5cf3b741714b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7a3da1a632d443aba8f5cf3b741714b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7a3da1a632d443aba8f5cf3b741714b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7a3da1a632d443aba8f5cf3b741714b"}]}] Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c7a3da1a632d443aba8f5cf3b741714b Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-541182015 Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerDiskConfigTestJSON-541182015-project Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: adb51369444c42c190b1b7bf5e23ddb9 Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerDiskConfigTestJSON-541182015-project Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd'} Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:59.044880 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:59.050024 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:59.050024 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:59.050024 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:59.050024 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:59.050024 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:59.050024 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. Oct 29 03:01:59.050024 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:01:59.050024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] Returning 404 to user: Instance 5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:59.050024 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0a9d21f9-8814-424f-9128-10cfd5ecc600 tempest-ServerDiskConfigTestJSON-541182015 tempest-ServerDiskConfigTestJSON-541182015-project] 10.222.0.16 "GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd" status: 404 len: 111 microversion: 2.1 time: 0.123157 Oct 29 03:01:59.054717 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1910/3853] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:58 2022] GET /compute/v2.1/servers/5bc7c56c-dfd7-4a01-b2de-fcce7d4697cd => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:59.224608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:59.225212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:59.241659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:59.244666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:59.245217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:59.252620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:59.253293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:59.253738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:00.511218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:00.575864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:00.580462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:00.585969 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-abada4ad-3542-483c-bacb-bbe850382a7a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1887 microversion: 2.42 time: 2.046838 Oct 29 03:02:00.597198 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1944/3854] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:58 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1887 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:00.632934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-79a24406-8fb0-4dce-a9cc-352c28d4ad9a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:00.638190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-79a24406-8fb0-4dce-a9cc-352c28d4ad9a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:00.673649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79a24406-8fb0-4dce-a9cc-352c28d4ad9a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:00.680716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79a24406-8fb0-4dce-a9cc-352c28d4ad9a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:00.684528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79a24406-8fb0-4dce-a9cc-352c28d4ad9a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:00.685487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79a24406-8fb0-4dce-a9cc-352c28d4ad9a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:00.686010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79a24406-8fb0-4dce-a9cc-352c28d4ad9a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:00.686475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79a24406-8fb0-4dce-a9cc-352c28d4ad9a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:00.910540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:00.926395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:00.933840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:00.935104 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd1e5062-9007-468c-8beb-d11da80a493b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 1.715248 Oct 29 03:02:00.944524 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1911/3855] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:59 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:02:00.949759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fbaeeaef-c6ba-46d1-9e2c-bc6e28436b18 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:00.964567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fbaeeaef-c6ba-46d1-9e2c-bc6e28436b18 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:00.992401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbaeeaef-c6ba-46d1-9e2c-bc6e28436b18 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:00.994423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbaeeaef-c6ba-46d1-9e2c-bc6e28436b18 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:00.996922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbaeeaef-c6ba-46d1-9e2c-bc6e28436b18 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:00.997570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbaeeaef-c6ba-46d1-9e2c-bc6e28436b18 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:01.002721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbaeeaef-c6ba-46d1-9e2c-bc6e28436b18 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:01.005442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbaeeaef-c6ba-46d1-9e2c-bc6e28436b18 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:01.021305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-79a24406-8fb0-4dce-a9cc-352c28d4ad9a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:01.042076 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-79a24406-8fb0-4dce-a9cc-352c28d4ad9a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1296 microversion: 2.1 time: 0.443271 Oct 29 03:02:01.043253 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1945/3856] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:00 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1296 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:01.448689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-55c03f99-5ab2-4580-a314-0195e0aa4319 req-1ba954c7-8ddb-4445-b131-11b4fe58a690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "tag": "1a6f0f9a-363c-4cc7-bac2-3ec7fe2158ed"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:01.467012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55c03f99-5ab2-4580-a314-0195e0aa4319 req-1ba954c7-8ddb-4445-b131-11b4fe58a690 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:01.483236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55c03f99-5ab2-4580-a314-0195e0aa4319 req-1ba954c7-8ddb-4445-b131-11b4fe58a690 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:01.484031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55c03f99-5ab2-4580-a314-0195e0aa4319 req-1ba954c7-8ddb-4445-b131-11b4fe58a690 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:01.516696 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-55c03f99-5ab2-4580-a314-0195e0aa4319 req-1ba954c7-8ddb-4445-b131-11b4fe58a690 service nova] Creating event network-changed:1a6f0f9a-363c-4cc7-bac2-3ec7fe2158ed for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:02:01.528992 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-55c03f99-5ab2-4580-a314-0195e0aa4319 req-1ba954c7-8ddb-4445-b131-11b4fe58a690 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083697 Oct 29 03:02:01.529851 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1946/3857] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:02:01.627849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:01.628768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:01.640101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:01.646963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:01.647511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:01.648271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:01.648737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:01.649154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:01.742408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fbaeeaef-c6ba-46d1-9e2c-bc6e28436b18 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:01.754973 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fbaeeaef-c6ba-46d1-9e2c-bc6e28436b18 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1272 microversion: 2.1 time: 0.809092 Oct 29 03:02:01.782366 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1912/3858] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:00 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1272 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:01.968975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:01.969670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:01.990305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:01.990824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:01.991265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:02.002614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:02.013217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:02.013991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:02.903737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:02.923069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:02.931718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:02.933231 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b07307c2-5970-4310-9691-c344106ea3c4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.969432 Oct 29 03:02:02.950289 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1913/3859] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:01 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:02.965487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-561b4171-a68b-4c44-9f7a-9822b3616ef4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:02.966435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-561b4171-a68b-4c44-9f7a-9822b3616ef4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:02.982555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:02.984901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-561b4171-a68b-4c44-9f7a-9822b3616ef4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:02.985580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-561b4171-a68b-4c44-9f7a-9822b3616ef4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:02.986274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-561b4171-a68b-4c44-9f7a-9822b3616ef4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:02.987165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-561b4171-a68b-4c44-9f7a-9822b3616ef4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:02.987831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-561b4171-a68b-4c44-9f7a-9822b3616ef4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:02.988441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-561b4171-a68b-4c44-9f7a-9822b3616ef4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:03.070900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:03.410384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:03.593073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:03.792921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-561b4171-a68b-4c44-9f7a-9822b3616ef4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:03.801650 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-561b4171-a68b-4c44-9f7a-9822b3616ef4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1364 microversion: 2.1 time: 0.849691 Oct 29 03:02:03.804850 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1914/3860] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:02 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1364 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:03.833219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-635bf834-8b37-441d-91d4-c7e597e8fd0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:03.843873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-635bf834-8b37-441d-91d4-c7e597e8fd0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:03.852074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-635bf834-8b37-441d-91d4-c7e597e8fd0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:03.856371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-635bf834-8b37-441d-91d4-c7e597e8fd0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:03.857100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-635bf834-8b37-441d-91d4-c7e597e8fd0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:03.858393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-635bf834-8b37-441d-91d4-c7e597e8fd0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:03.859078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-635bf834-8b37-441d-91d4-c7e597e8fd0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:03.866152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-635bf834-8b37-441d-91d4-c7e597e8fd0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:04.419636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-635bf834-8b37-441d-91d4-c7e597e8fd0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:04.431501 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-635bf834-8b37-441d-91d4-c7e597e8fd0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1314 microversion: 2.1 time: 0.606593 Oct 29 03:02:04.433528 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1915/3861] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:03 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:04.446074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:04.446974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:04.470388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:04.470954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:04.471437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:04.472531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:04.473264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:04.477675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:04.622492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:04.641215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:04.655169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:04.662448 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f1272a6b-7653-46fc-850e-53ae27ae5dc5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1887 microversion: 2.42 time: 3.039878 Oct 29 03:02:04.666189 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1947/3862] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:01 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1887 bytes in 3044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:02:04.836807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f42e45c4-ea17-4a3c-bca8-cb9bd7f9f4e8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:04.837567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f42e45c4-ea17-4a3c-bca8-cb9bd7f9f4e8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:04.853455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f42e45c4-ea17-4a3c-bca8-cb9bd7f9f4e8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:04.854934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f42e45c4-ea17-4a3c-bca8-cb9bd7f9f4e8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:04.857061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f42e45c4-ea17-4a3c-bca8-cb9bd7f9f4e8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:04.858090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f42e45c4-ea17-4a3c-bca8-cb9bd7f9f4e8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:04.858862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f42e45c4-ea17-4a3c-bca8-cb9bd7f9f4e8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:04.860957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f42e45c4-ea17-4a3c-bca8-cb9bd7f9f4e8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:04.939649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:04.952707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:04.954276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:04.961762 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-02685b54-2b07-4c52-992d-923f118ebb48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.525656 Oct 29 03:02:04.966412 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1916/3863] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:04 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:05.350409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f42e45c4-ea17-4a3c-bca8-cb9bd7f9f4e8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:05.361107 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f42e45c4-ea17-4a3c-bca8-cb9bd7f9f4e8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1364 microversion: 2.1 time: 0.528949 Oct 29 03:02:05.378138 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1948/3864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:04 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1364 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:05.458471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-31455d4a-2032-4451-9fd7-61cd64ddc5ee tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:05.459070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-31455d4a-2032-4451-9fd7-61cd64ddc5ee tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:05.470238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31455d4a-2032-4451-9fd7-61cd64ddc5ee tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:05.470735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31455d4a-2032-4451-9fd7-61cd64ddc5ee tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:05.471166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31455d4a-2032-4451-9fd7-61cd64ddc5ee tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:05.471913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31455d4a-2032-4451-9fd7-61cd64ddc5ee tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:05.472630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31455d4a-2032-4451-9fd7-61cd64ddc5ee tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:05.473414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31455d4a-2032-4451-9fd7-61cd64ddc5ee tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:05.635047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-713492ce-6d53-4813-83ca-4d5ba404e273 req-61ae106c-7cd8-412d-8ef4-c8e6747d3d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "tag": "5b15b418-d44c-4472-af06-882104b0a0b6"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:05.659304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:05.662250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-713492ce-6d53-4813-83ca-4d5ba404e273 req-61ae106c-7cd8-412d-8ef4-c8e6747d3d55 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:05.662943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-713492ce-6d53-4813-83ca-4d5ba404e273 req-61ae106c-7cd8-412d-8ef4-c8e6747d3d55 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:05.663568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-713492ce-6d53-4813-83ca-4d5ba404e273 req-61ae106c-7cd8-412d-8ef4-c8e6747d3d55 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:05.694619 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-713492ce-6d53-4813-83ca-4d5ba404e273 req-61ae106c-7cd8-412d-8ef4-c8e6747d3d55 service nova] Creating event network-changed:5b15b418-d44c-4472-af06-882104b0a0b6 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:02:05.706881 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-713492ce-6d53-4813-83ca-4d5ba404e273 req-61ae106c-7cd8-412d-8ef4-c8e6747d3d55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075850 Oct 29 03:02:05.712862 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1949/3865] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:05.727021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:05.729142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:05.754513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:05.756884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:05.757527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:05.759865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:05.761216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:05.763252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:06.553636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-31455d4a-2032-4451-9fd7-61cd64ddc5ee tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:06.575206 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-31455d4a-2032-4451-9fd7-61cd64ddc5ee tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1314 microversion: 2.1 time: 1.120966 Oct 29 03:02:06.590576 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1917/3866] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:05 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1314 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:06.601687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:06.602763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:06.609628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:06.611081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:06.613173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:06.616207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:06.617034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:06.617732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:07.482864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:07.513337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:07.519342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:07.524786 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c5dc2f7a-7ace-49ac-9351-69eff29ec41b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.931639 Oct 29 03:02:07.530342 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1918/3867] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:06 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:07.549655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2ff73d05-f0c3-4114-aec7-d1295fe848b1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:07.558736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2ff73d05-f0c3-4114-aec7-d1295fe848b1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:07.569840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff73d05-f0c3-4114-aec7-d1295fe848b1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:07.570642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff73d05-f0c3-4114-aec7-d1295fe848b1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:07.571244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff73d05-f0c3-4114-aec7-d1295fe848b1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:07.572125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff73d05-f0c3-4114-aec7-d1295fe848b1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:07.572742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff73d05-f0c3-4114-aec7-d1295fe848b1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:07.573149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff73d05-f0c3-4114-aec7-d1295fe848b1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:07.883369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:07.904897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:07.910567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:07.914935 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-10d03a64-1e69-4f38-b333-e497d96301a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 2.199791 Oct 29 03:02:07.920192 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1950/3868] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:05 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:07.928259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2ff73d05-f0c3-4114-aec7-d1295fe848b1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:07.945927 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2ff73d05-f0c3-4114-aec7-d1295fe848b1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1364 microversion: 2.1 time: 0.411369 Oct 29 03:02:07.946912 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1919/3869] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:07 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1364 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:07.953842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-40b39d11-c6b2-49fc-a108-b416a2f94a65 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:07.957543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-40b39d11-c6b2-49fc-a108-b416a2f94a65 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:07.978453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b39d11-c6b2-49fc-a108-b416a2f94a65 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:07.979281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b39d11-c6b2-49fc-a108-b416a2f94a65 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:07.979891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b39d11-c6b2-49fc-a108-b416a2f94a65 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:07.980811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b39d11-c6b2-49fc-a108-b416a2f94a65 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:07.981423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b39d11-c6b2-49fc-a108-b416a2f94a65 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:07.982057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40b39d11-c6b2-49fc-a108-b416a2f94a65 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:08.553442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:08.554062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:08.568345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:08.569018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:08.569327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:08.570090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:08.570748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:08.571161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:08.607573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-40b39d11-c6b2-49fc-a108-b416a2f94a65 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:08.618448 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-40b39d11-c6b2-49fc-a108-b416a2f94a65 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1314 microversion: 2.1 time: 0.671554 Oct 29 03:02:08.648128 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1951/3870] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:07 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:08.950426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:08.951118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:08.983766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:08.984266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:08.994583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:08.997152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:09.001077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:09.001930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:09.798011 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:02:09.798011 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:02:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 (ip 10.222.0.16) !!! Oct 29 03:02:09.807463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:09.812752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:09.827482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:09.851446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:09.852711 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b2bd454a-ee37-455e-b95d-690bdc3597c9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 1.304029 Oct 29 03:02:09.884730 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1920/3871] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:08 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:09.890646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de1fed97-0efe-4736-9591-ea874ed6f077 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:09.895324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-de1fed97-0efe-4736-9591-ea874ed6f077 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:09.916024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de1fed97-0efe-4736-9591-ea874ed6f077 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:09.920116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de1fed97-0efe-4736-9591-ea874ed6f077 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:09.920784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de1fed97-0efe-4736-9591-ea874ed6f077 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:09.922710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de1fed97-0efe-4736-9591-ea874ed6f077 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:09.925447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de1fed97-0efe-4736-9591-ea874ed6f077 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:09.926205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de1fed97-0efe-4736-9591-ea874ed6f077 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:10.621833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:10.646009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:10.647799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:10.649182 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f454c0bd-e972-4848-98c7-318cb513e587 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 1.703100 Oct 29 03:02:10.649852 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1952/3872] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:08 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:02:10.686218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-2147f464-d289-4401-914d-0770489eb516 req-4d560dde-2a23-4642-92b7-f4490583aab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e7e466-df5f-45f5-9e45-dc3c16e888b7", "tag": "4f85a0f7-faab-45b5-be06-7a79452c31af"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:10.731841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2147f464-d289-4401-914d-0770489eb516 req-4d560dde-2a23-4642-92b7-f4490583aab9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:10.732337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2147f464-d289-4401-914d-0770489eb516 req-4d560dde-2a23-4642-92b7-f4490583aab9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:10.738496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2147f464-d289-4401-914d-0770489eb516 req-4d560dde-2a23-4642-92b7-f4490583aab9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:10.775542 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-2147f464-d289-4401-914d-0770489eb516 req-4d560dde-2a23-4642-92b7-f4490583aab9 service nova] Creating event network-changed:4f85a0f7-faab-45b5-be06-7a79452c31af for instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 on n-h1-862964-4 Oct 29 03:02:10.803261 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-2147f464-d289-4401-914d-0770489eb516 req-4d560dde-2a23-4642-92b7-f4490583aab9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152097 Oct 29 03:02:10.803888 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1953/3873] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:10.827715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-602443e9-fd09-40fd-a752-aab38b253493 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:10.828639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-602443e9-fd09-40fd-a752-aab38b253493 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:10.864490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-602443e9-fd09-40fd-a752-aab38b253493 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:10.864995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-602443e9-fd09-40fd-a752-aab38b253493 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:10.865437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-602443e9-fd09-40fd-a752-aab38b253493 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:10.866180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-602443e9-fd09-40fd-a752-aab38b253493 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:10.866637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-602443e9-fd09-40fd-a752-aab38b253493 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:10.867063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-602443e9-fd09-40fd-a752-aab38b253493 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:11.538569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de1fed97-0efe-4736-9591-ea874ed6f077 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:11.582377 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de1fed97-0efe-4736-9591-ea874ed6f077 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1364 microversion: 2.1 time: 1.693188 Oct 29 03:02:11.583731 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1921/3874] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:09 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1364 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:11.589645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d44b5d48-269c-4a3c-b57f-3bb6a1971df1 req-e76fc875-e2a3-4525-9f1e-cb8e576850b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "tag": "8dab038a-c463-4da0-a1b0-270182ca43e7"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:11.602970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d44b5d48-269c-4a3c-b57f-3bb6a1971df1 req-e76fc875-e2a3-4525-9f1e-cb8e576850b7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:11.603955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d44b5d48-269c-4a3c-b57f-3bb6a1971df1 req-e76fc875-e2a3-4525-9f1e-cb8e576850b7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:11.604708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d44b5d48-269c-4a3c-b57f-3bb6a1971df1 req-e76fc875-e2a3-4525-9f1e-cb8e576850b7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:11.621365 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d44b5d48-269c-4a3c-b57f-3bb6a1971df1 req-e76fc875-e2a3-4525-9f1e-cb8e576850b7 service nova] Creating event network-changed:8dab038a-c463-4da0-a1b0-270182ca43e7 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:02:11.634570 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d44b5d48-269c-4a3c-b57f-3bb6a1971df1 req-e76fc875-e2a3-4525-9f1e-cb8e576850b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046911 Oct 29 03:02:11.636249 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1922/3875] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:11.645487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:11.694879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:11.730589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:11.730993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:11.733865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:11.734860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:11.741883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:11.746591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:12.570166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:12.613678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:12.616784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:12.619232 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-68a95394-24dd-4aba-8fbf-b52707f06513 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.978324 Oct 29 03:02:12.655552 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1923/3876] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:11 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:12.681425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:12.684106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:12.714445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:12.717358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:12.721200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:12.722758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:12.723238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:12.732073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:13.338731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-602443e9-fd09-40fd-a752-aab38b253493 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:13.358369 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-602443e9-fd09-40fd-a752-aab38b253493 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1314 microversion: 2.1 time: 2.551018 Oct 29 03:02:13.361446 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1954/3877] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:10 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1314 bytes in 2557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:13.394675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-47833e95-7252-443d-984d-8a26e804a253 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:13.397103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-47833e95-7252-443d-984d-8a26e804a253 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:13.414743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47833e95-7252-443d-984d-8a26e804a253 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:13.416828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47833e95-7252-443d-984d-8a26e804a253 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:13.427428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47833e95-7252-443d-984d-8a26e804a253 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:13.429396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47833e95-7252-443d-984d-8a26e804a253 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:13.431757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47833e95-7252-443d-984d-8a26e804a253 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:13.433245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47833e95-7252-443d-984d-8a26e804a253 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:14.217627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:14.235055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:14.242286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:14.244333 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-991d4e0b-a211-4c31-89a4-23b656fca39b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 1.585951 Oct 29 03:02:14.246104 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1924/3878] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:12 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:14.262043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-47c0361a-4721-46a9-a3d4-d1ae90682c35 req-0bb2e9e6-958d-4dbb-8e86-bf951fa582a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ca75b7e-d4ac-4231-915f-4f4901ad6758", "tag": "d7fdaa44-f26c-4b44-aa90-2d55bac35b0a"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:14.280355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-47c0361a-4721-46a9-a3d4-d1ae90682c35 req-0bb2e9e6-958d-4dbb-8e86-bf951fa582a9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:14.281529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-47c0361a-4721-46a9-a3d4-d1ae90682c35 req-0bb2e9e6-958d-4dbb-8e86-bf951fa582a9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:14.286459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-47c0361a-4721-46a9-a3d4-d1ae90682c35 req-0bb2e9e6-958d-4dbb-8e86-bf951fa582a9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:14.315136 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-47c0361a-4721-46a9-a3d4-d1ae90682c35 req-0bb2e9e6-958d-4dbb-8e86-bf951fa582a9 service nova] Creating event network-changed:d7fdaa44-f26c-4b44-aa90-2d55bac35b0a for instance 1ca75b7e-d4ac-4231-915f-4f4901ad6758 on n-h1-862964-4 Oct 29 03:02:14.325533 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-47c0361a-4721-46a9-a3d4-d1ae90682c35 req-0bb2e9e6-958d-4dbb-8e86-bf951fa582a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077935 Oct 29 03:02:14.326786 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1925/3879] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:14.335253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:14.336247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:14.347339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:14.348437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:14.352369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:14.354563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:14.355212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:14.355823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:14.587211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-47833e95-7252-443d-984d-8a26e804a253 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:14.610373 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-47833e95-7252-443d-984d-8a26e804a253 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1364 microversion: 2.1 time: 1.247080 Oct 29 03:02:14.614328 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1955/3880] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:13 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1364 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:14.645400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-330144d0-2947-4098-9e07-be0aaff59a4a req-6291c917-5055-4223-a98d-e2a8f9b1c017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "tag": "2925f2d5-baca-47fa-9f36-1c4849e3e7e4"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:14.704869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-330144d0-2947-4098-9e07-be0aaff59a4a req-6291c917-5055-4223-a98d-e2a8f9b1c017 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:14.705378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-330144d0-2947-4098-9e07-be0aaff59a4a req-6291c917-5055-4223-a98d-e2a8f9b1c017 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:14.708584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-330144d0-2947-4098-9e07-be0aaff59a4a req-6291c917-5055-4223-a98d-e2a8f9b1c017 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:14.751147 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-330144d0-2947-4098-9e07-be0aaff59a4a req-6291c917-5055-4223-a98d-e2a8f9b1c017 service nova] Creating event network-changed:2925f2d5-baca-47fa-9f36-1c4849e3e7e4 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:02:14.778233 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-330144d0-2947-4098-9e07-be0aaff59a4a req-6291c917-5055-4223-a98d-e2a8f9b1c017 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152973 Oct 29 03:02:14.783758 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1956/3881] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:14.807140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-264f75da-291e-43bd-a3a4-45cb373f0f85 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:14.816426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-264f75da-291e-43bd-a3a4-45cb373f0f85 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:14.830073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-264f75da-291e-43bd-a3a4-45cb373f0f85 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:14.830564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-264f75da-291e-43bd-a3a4-45cb373f0f85 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:14.841623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-264f75da-291e-43bd-a3a4-45cb373f0f85 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:14.842607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-264f75da-291e-43bd-a3a4-45cb373f0f85 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:14.843093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-264f75da-291e-43bd-a3a4-45cb373f0f85 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:14.843520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-264f75da-291e-43bd-a3a4-45cb373f0f85 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:15.245148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:15.260569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:15.283613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:15.287741 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4cac32d1-a311-4470-a85a-bd8d6710b5cf tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.958194 Oct 29 03:02:15.289950 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1926/3882] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:14 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:15.296720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:15.298040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:15.306070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:15.307230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:15.308265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:15.309388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:15.310043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:15.311163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:15.754395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:15.771678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:15.775664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:15.779179 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9788b920-f7ac-4ae7-96dc-a07f337e8036 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.487854 Oct 29 03:02:15.782807 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1927/3883] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:15 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:15.797577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-10c4f49b-51e4-4463-b26f-c0bb609a2bdf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:15.802127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-10c4f49b-51e4-4463-b26f-c0bb609a2bdf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:15.820781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c4f49b-51e4-4463-b26f-c0bb609a2bdf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:15.822395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c4f49b-51e4-4463-b26f-c0bb609a2bdf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:15.822851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c4f49b-51e4-4463-b26f-c0bb609a2bdf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:15.823579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c4f49b-51e4-4463-b26f-c0bb609a2bdf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:15.824077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c4f49b-51e4-4463-b26f-c0bb609a2bdf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:15.824524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c4f49b-51e4-4463-b26f-c0bb609a2bdf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:16.227672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-10c4f49b-51e4-4463-b26f-c0bb609a2bdf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:16.239275 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-10c4f49b-51e4-4463-b26f-c0bb609a2bdf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1364 microversion: 2.1 time: 0.455233 Oct 29 03:02:16.239892 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1928/3884] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:15 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1364 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:16.584425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1359697355", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "9beca06d-4a72-4e38-a9c5-9f33a0c36f22"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:16.610909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-264f75da-291e-43bd-a3a4-45cb373f0f85 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:16.629114 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-264f75da-291e-43bd-a3a4-45cb373f0f85 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1314 microversion: 2.1 time: 1.843374 Oct 29 03:02:16.642605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1957/3885] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:14 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1314 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:16.651187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:16.651809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:16.669121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:16.669665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:16.670153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:16.670851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:16.671305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:16.671727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:17.978292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:17.997112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:18.000572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:18.002276 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e1631b6a-300a-4f4b-91fb-5ccc757498e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 1.358211 Oct 29 03:02:18.011417 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1958/3886] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:16 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:18.026649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:18.030123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:18.066579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:18.078266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:18.079118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:18.081394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:18.084635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:18.085420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:18.192663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] validate_networks() for [('9beca06d-4a72-4e38-a9c5-9f33a0c36f22', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:02:18.746132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:18.769191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:18.775701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:18.779613 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9439dd84-beb1-4b50-bf3e-46c7d70c121e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.766298 Oct 29 03:02:18.785166 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1959/3887] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:18 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:18.797603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0b8c30e3-2e20-48f2-908b-765254761836 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:18.798603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0b8c30e3-2e20-48f2-908b-765254761836 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:18.825710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8c30e3-2e20-48f2-908b-765254761836 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:18.829227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8c30e3-2e20-48f2-908b-765254761836 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:18.831248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8c30e3-2e20-48f2-908b-765254761836 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:18.832296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8c30e3-2e20-48f2-908b-765254761836 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:18.834394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8c30e3-2e20-48f2-908b-765254761836 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:18.835007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b8c30e3-2e20-48f2-908b-765254761836 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:18.966531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:02:18.967286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:02:18.968325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:02:18.968907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:02:18.970200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:02:18.995849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:18.996527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:18.998032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:19.000027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:19.001109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:19.001725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:19.055509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Getting quotas for project ff2d630709a746e386bbb39de2d56cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:19.062459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Getting quotas for user 8c62bd2c7acf4c5ea9f7a9edae332de0 and project ff2d630709a746e386bbb39de2d56cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:19.098529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:02:19.101728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:19.185701 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-da1d2e13-4784-42f4-aeeb-ff336d8ea05f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.944661 Oct 29 03:02:19.188630 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1929/3888] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:02:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:02:19.223388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a67e3daa-cf06-4da0-a84b-9b93fba3ab75 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:19.224838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a67e3daa-cf06-4da0-a84b-9b93fba3ab75 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:19.263941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a67e3daa-cf06-4da0-a84b-9b93fba3ab75 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:19.264736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a67e3daa-cf06-4da0-a84b-9b93fba3ab75 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:19.266407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a67e3daa-cf06-4da0-a84b-9b93fba3ab75 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:19.267393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a67e3daa-cf06-4da0-a84b-9b93fba3ab75 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:19.268345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a67e3daa-cf06-4da0-a84b-9b93fba3ab75 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:19.269224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a67e3daa-cf06-4da0-a84b-9b93fba3ab75 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:19.396677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0b8c30e3-2e20-48f2-908b-765254761836 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:19.412783 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0b8c30e3-2e20-48f2-908b-765254761836 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1364 microversion: 2.1 time: 0.625780 Oct 29 03:02:19.413691 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1960/3889] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:18 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1364 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:19.421898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:19.436620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:19.480051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:19.480872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:19.481491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:19.482396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:19.483010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:19.486415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:19.671244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a67e3daa-cf06-4da0-a84b-9b93fba3ab75 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:19.686997 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a67e3daa-cf06-4da0-a84b-9b93fba3ab75 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1314 microversion: 2.1 time: 0.488609 Oct 29 03:02:19.687646 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1930/3890] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:19 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:19.701716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fc823599-e156-417b-bb0a-cb61bb013312 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:19.702572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fc823599-e156-417b-bb0a-cb61bb013312 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:19.827686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fc823599-e156-417b-bb0a-cb61bb013312 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:19.835628 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fc823599-e156-417b-bb0a-cb61bb013312 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1225 microversion: 2.1 time: 0.146383 Oct 29 03:02:19.852536 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1931/3891] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:19 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1225 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:20.226850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20274d3c-3d46-459d-a7ed-85979099c94f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Action: 'create', calling method: .version_select at 0x7fe1a8a10ee0>, body: {"keypair": {"name": "tempest-keypair-1402253981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPcYkBFY/XwDIYwGkveOeszH1szwfdSDAByG1mOOY2Kehb61GAP9rfMI385r9j5syeYkF8Is5NDviLqh+g0SBmU6AEePYctr1kRQGGmQO8GluLy3RHcNXU5cbDNyq6uvQ=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:20.260367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-20274d3c-3d46-459d-a7ed-85979099c94f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Getting quotas for project 6f701d727812417a860406464cf0f757. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:20.266737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:20.268256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-20274d3c-3d46-459d-a7ed-85979099c94f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Getting quotas for user aa0f9eced1ff41e281ed82bb0465a58b and project 6f701d727812417a860406464cf0f757. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:20.311680 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20274d3c-3d46-459d-a7ed-85979099c94f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.457865 Oct 29 03:02:20.312247 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1932/3892] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:02:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:20.321632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ba1d46d0-18e1-45c2-a62c-9d54999a0a8a req-65091871-742a-45a6-83c4-18f9ed501393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e7e466-df5f-45f5-9e45-dc3c16e888b7", "name": "network-vif-plugged", "status": "completed", "tag": "4f85a0f7-faab-45b5-be06-7a79452c31af"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:20.335706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ba1d46d0-18e1-45c2-a62c-9d54999a0a8a req-65091871-742a-45a6-83c4-18f9ed501393 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.336945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ba1d46d0-18e1-45c2-a62c-9d54999a0a8a req-65091871-742a-45a6-83c4-18f9ed501393 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.337586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ba1d46d0-18e1-45c2-a62c-9d54999a0a8a req-65091871-742a-45a6-83c4-18f9ed501393 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.355123 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ba1d46d0-18e1-45c2-a62c-9d54999a0a8a req-65091871-742a-45a6-83c4-18f9ed501393 service nova] Creating event network-vif-plugged:4f85a0f7-faab-45b5-be06-7a79452c31af for instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 on n-h1-862964-4 Oct 29 03:02:20.366491 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ba1d46d0-18e1-45c2-a62c-9d54999a0a8a req-65091871-742a-45a6-83c4-18f9ed501393 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049728 Oct 29 03:02:20.368382 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1933/3893] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:20.378366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:20.379442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:20.387038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.387907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.388577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.389684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.390317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.390900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.523372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:20.532948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:20.535493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:20.537018 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-542b5d20-457c-4493-b0bc-83ed242b6b4d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 1.119042 Oct 29 03:02:20.538331 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1961/3894] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:19 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:20.543245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-955c58f0-19ff-46d3-91e0-cdd2a55ac9f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:20.544164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-955c58f0-19ff-46d3-91e0-cdd2a55ac9f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:20.550896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-955c58f0-19ff-46d3-91e0-cdd2a55ac9f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.551691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-955c58f0-19ff-46d3-91e0-cdd2a55ac9f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.552379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-955c58f0-19ff-46d3-91e0-cdd2a55ac9f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.553422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-955c58f0-19ff-46d3-91e0-cdd2a55ac9f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.554151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-955c58f0-19ff-46d3-91e0-cdd2a55ac9f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.554858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-955c58f0-19ff-46d3-91e0-cdd2a55ac9f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:21.140452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:21.157596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:21.172652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:21.174196 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-77ac2047-ed76-47b3-b0b2-e49422770b0f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.804273 Oct 29 03:02:21.176920 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1934/3895] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:20 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:21.197582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3039d297-4dc3-46ec-8405-001b22079ae2 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:21.198551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3039d297-4dc3-46ec-8405-001b22079ae2 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:21.208461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3039d297-4dc3-46ec-8405-001b22079ae2 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:21.209670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3039d297-4dc3-46ec-8405-001b22079ae2 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:21.210332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3039d297-4dc3-46ec-8405-001b22079ae2 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:21.211886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3039d297-4dc3-46ec-8405-001b22079ae2 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:21.212567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3039d297-4dc3-46ec-8405-001b22079ae2 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:21.213325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3039d297-4dc3-46ec-8405-001b22079ae2 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:21.382689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-955c58f0-19ff-46d3-91e0-cdd2a55ac9f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:21.390770 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-955c58f0-19ff-46d3-91e0-cdd2a55ac9f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1364 microversion: 2.1 time: 0.851103 Oct 29 03:02:21.393383 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1962/3896] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:20 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1364 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:21.412841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54fe7278-5335-42e0-b2dc-a9e03c5ce0d3 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:21.413450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54fe7278-5335-42e0-b2dc-a9e03c5ce0d3 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:21.420510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54fe7278-5335-42e0-b2dc-a9e03c5ce0d3 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:21.421000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54fe7278-5335-42e0-b2dc-a9e03c5ce0d3 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:21.422042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54fe7278-5335-42e0-b2dc-a9e03c5ce0d3 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:21.422962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54fe7278-5335-42e0-b2dc-a9e03c5ce0d3 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:21.424068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54fe7278-5335-42e0-b2dc-a9e03c5ce0d3 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:21.424703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54fe7278-5335-42e0-b2dc-a9e03c5ce0d3 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:21.453016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:21.589785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-54fe7278-5335-42e0-b2dc-a9e03c5ce0d3 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:21.602088 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54fe7278-5335-42e0-b2dc-a9e03c5ce0d3 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1283 microversion: 2.1 time: 0.207081 Oct 29 03:02:21.604334 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1963/3897] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:21 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1283 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:21.623987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:21.624900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:21.639387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:21.640237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:21.640866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:21.641771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:21.642463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:21.645101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:21.662584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3039d297-4dc3-46ec-8405-001b22079ae2 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:21.671991 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3039d297-4dc3-46ec-8405-001b22079ae2 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1314 microversion: 2.1 time: 0.493526 Oct 29 03:02:21.674757 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1935/3898] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:21 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:22.100477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:22.119862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:22.121306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:22.122521 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f1d26954-18f0-4ed7-b2f0-1cff9bf1cd07 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.516981 Oct 29 03:02:22.138537 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1964/3899] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:21 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:22.202930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:22.204277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:22.214086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.215067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.215935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.216859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.217618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.218299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.416923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f612f465-a9bc-4fe8-99f6-e2a29516071e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:22.417714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f612f465-a9bc-4fe8-99f6-e2a29516071e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:22.432861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f612f465-a9bc-4fe8-99f6-e2a29516071e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.433358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f612f465-a9bc-4fe8-99f6-e2a29516071e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.433826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f612f465-a9bc-4fe8-99f6-e2a29516071e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.434544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f612f465-a9bc-4fe8-99f6-e2a29516071e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.435289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f612f465-a9bc-4fe8-99f6-e2a29516071e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.435721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f612f465-a9bc-4fe8-99f6-e2a29516071e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.786495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f612f465-a9bc-4fe8-99f6-e2a29516071e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:22.798634 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f612f465-a9bc-4fe8-99f6-e2a29516071e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1364 microversion: 2.1 time: 0.386404 Oct 29 03:02:22.799563 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1965/3900] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:22 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1364 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:22.810096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3f3f9296-1a00-4cb9-9510-cbf3b68f4158 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:22.813486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3f3f9296-1a00-4cb9-9510-cbf3b68f4158 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:22.825782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3f9296-1a00-4cb9-9510-cbf3b68f4158 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.831240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3f9296-1a00-4cb9-9510-cbf3b68f4158 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.831696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3f9296-1a00-4cb9-9510-cbf3b68f4158 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.832786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3f9296-1a00-4cb9-9510-cbf3b68f4158 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.833419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3f9296-1a00-4cb9-9510-cbf3b68f4158 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.834061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3f9296-1a00-4cb9-9510-cbf3b68f4158 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.989524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:23.002273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:23.004822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:23.006845 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8e51094d-e649-476f-b735-efa762428dd4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.809920 Oct 29 03:02:23.008267 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1936/3901] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:22 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:23.023660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-df314ce2-9a34-49f7-8ee1-3fb91fbd5c80 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:23.024751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-df314ce2-9a34-49f7-8ee1-3fb91fbd5c80 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:23.036150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df314ce2-9a34-49f7-8ee1-3fb91fbd5c80 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.037086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df314ce2-9a34-49f7-8ee1-3fb91fbd5c80 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.038118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df314ce2-9a34-49f7-8ee1-3fb91fbd5c80 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.039637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df314ce2-9a34-49f7-8ee1-3fb91fbd5c80 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.040343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df314ce2-9a34-49f7-8ee1-3fb91fbd5c80 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.040991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df314ce2-9a34-49f7-8ee1-3fb91fbd5c80 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.409702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-df314ce2-9a34-49f7-8ee1-3fb91fbd5c80 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:23.418635 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-df314ce2-9a34-49f7-8ee1-3fb91fbd5c80 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1314 microversion: 2.1 time: 0.408576 Oct 29 03:02:23.439057 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1937/3902] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:23 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:23.455259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:23.456716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:23.464456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.465241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.466004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.466873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.468168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.469838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.499177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3f3f9296-1a00-4cb9-9510-cbf3b68f4158 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:23.511008 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3f3f9296-1a00-4cb9-9510-cbf3b68f4158 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1325 microversion: 2.1 time: 0.707797 Oct 29 03:02:23.513739 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1966/3903] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:22 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1325 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:23.743770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4346548b-a82e-4e27-a6b5-fb9a5a3d78ed req-24e7d61c-832a-4f44-a521-47d0b1c7995c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca75b7e-d4ac-4231-915f-4f4901ad6758", "name": "network-vif-plugged", "status": "completed", "tag": "d7fdaa44-f26c-4b44-aa90-2d55bac35b0a"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:23.755494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4346548b-a82e-4e27-a6b5-fb9a5a3d78ed req-24e7d61c-832a-4f44-a521-47d0b1c7995c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.756680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4346548b-a82e-4e27-a6b5-fb9a5a3d78ed req-24e7d61c-832a-4f44-a521-47d0b1c7995c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.756680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4346548b-a82e-4e27-a6b5-fb9a5a3d78ed req-24e7d61c-832a-4f44-a521-47d0b1c7995c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.776597 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4346548b-a82e-4e27-a6b5-fb9a5a3d78ed req-24e7d61c-832a-4f44-a521-47d0b1c7995c service nova] Creating event network-vif-plugged:d7fdaa44-f26c-4b44-aa90-2d55bac35b0a for instance 1ca75b7e-d4ac-4231-915f-4f4901ad6758 on n-h1-862964-4 Oct 29 03:02:23.782626 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4346548b-a82e-4e27-a6b5-fb9a5a3d78ed req-24e7d61c-832a-4f44-a521-47d0b1c7995c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043065 Oct 29 03:02:23.783891 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1967/3904] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:02:23.830253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d164be3c-f60e-4b22-934d-d95428c9ea91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:23.831084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d164be3c-f60e-4b22-934d-d95428c9ea91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:23.870417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d164be3c-f60e-4b22-934d-d95428c9ea91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.871232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d164be3c-f60e-4b22-934d-d95428c9ea91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.872777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d164be3c-f60e-4b22-934d-d95428c9ea91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.874935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d164be3c-f60e-4b22-934d-d95428c9ea91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.876440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d164be3c-f60e-4b22-934d-d95428c9ea91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.877697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d164be3c-f60e-4b22-934d-d95428c9ea91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.916971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:23.944122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:23.946765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:23.949101 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b52a9d97-228b-42a1-b1b7-2125ee26ca12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.514220 Oct 29 03:02:23.954294 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1938/3905] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:23 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:24.038377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:24.044425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:24.052551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:24.053289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:24.054110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:24.055179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:24.055836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:24.056507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:24.496330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:24.506944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:24.508836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:24.510454 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-223db683-131d-4abb-a6ff-4e8a704b50bf tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.477567 Oct 29 03:02:24.522620 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1939/3906] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:24 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:02:24.538629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a34fe38d-ffd4-461d-a9ba-59ce7d9ccf73 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:24.539770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a34fe38d-ffd4-461d-a9ba-59ce7d9ccf73 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:24.560817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34fe38d-ffd4-461d-a9ba-59ce7d9ccf73 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:24.561535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34fe38d-ffd4-461d-a9ba-59ce7d9ccf73 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:24.562258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34fe38d-ffd4-461d-a9ba-59ce7d9ccf73 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:24.563327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34fe38d-ffd4-461d-a9ba-59ce7d9ccf73 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:24.563957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34fe38d-ffd4-461d-a9ba-59ce7d9ccf73 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:24.564549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34fe38d-ffd4-461d-a9ba-59ce7d9ccf73 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:24.719119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d164be3c-f60e-4b22-934d-d95428c9ea91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:24.730940 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d164be3c-f60e-4b22-934d-d95428c9ea91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1552 microversion: 2.1 time: 0.906652 Oct 29 03:02:24.732097 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1968/3907] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:23 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1552 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:24.741185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-411bad0e-d3d3-48f0-8083-67cab03740ef tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:24.743407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-411bad0e-d3d3-48f0-8083-67cab03740ef tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:24.751020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411bad0e-d3d3-48f0-8083-67cab03740ef tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:24.752082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411bad0e-d3d3-48f0-8083-67cab03740ef tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:24.752989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411bad0e-d3d3-48f0-8083-67cab03740ef tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:24.755030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411bad0e-d3d3-48f0-8083-67cab03740ef tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:24.757006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411bad0e-d3d3-48f0-8083-67cab03740ef tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:24.757545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-411bad0e-d3d3-48f0-8083-67cab03740ef tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:24.915367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a34fe38d-ffd4-461d-a9ba-59ce7d9ccf73 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:24.929102 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a34fe38d-ffd4-461d-a9ba-59ce7d9ccf73 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1314 microversion: 2.1 time: 0.405106 Oct 29 03:02:24.932128 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1940/3908] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:24 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:24.939877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1244116725", "imageRef": "74602fda-f09e-4e89-93c3-4461672f2d79", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f6a56508-dcc8-4e3f-906e-240c922fc321"}], "security_groups": [{"name": "tempest-securitygroup--1818720831"}], "key_name": "tempest-keypair-1402253981", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:25.146303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-411bad0e-d3d3-48f0-8083-67cab03740ef tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:25.156660 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-411bad0e-d3d3-48f0-8083-67cab03740ef tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1325 microversion: 2.1 time: 0.422543 Oct 29 03:02:25.182930 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1969/3909] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:24 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1325 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:25.189706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-2d43bcbe-324a-466c-ba5c-be4d0e3aa98a req-134e47ff-605a-4a37-a893-db233871953c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fae7d5-c7f2-41de-a789-4c81a4159773", "tag": "e33899ff-ebb2-4758-857c-42c8799776a5"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:25.200877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2d43bcbe-324a-466c-ba5c-be4d0e3aa98a req-134e47ff-605a-4a37-a893-db233871953c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.201361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2d43bcbe-324a-466c-ba5c-be4d0e3aa98a req-134e47ff-605a-4a37-a893-db233871953c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.201829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2d43bcbe-324a-466c-ba5c-be4d0e3aa98a req-134e47ff-605a-4a37-a893-db233871953c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.214667 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-2d43bcbe-324a-466c-ba5c-be4d0e3aa98a req-134e47ff-605a-4a37-a893-db233871953c service nova] Creating event network-changed:e33899ff-ebb2-4758-857c-42c8799776a5 for instance e9fae7d5-c7f2-41de-a789-4c81a4159773 on n-h2-862964-4 Oct 29 03:02:25.219798 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-2d43bcbe-324a-466c-ba5c-be4d0e3aa98a req-134e47ff-605a-4a37-a893-db233871953c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035225 Oct 29 03:02:25.220766 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1970/3910] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:25.223265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] validate_networks() for [('f6a56508-dcc8-4e3f-906e-240c922fc321', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:02:25.226572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-80a23a8f-1557-437d-8ac1-653bc1eb072e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:25.227155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-80a23a8f-1557-437d-8ac1-653bc1eb072e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:25.234518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a23a8f-1557-437d-8ac1-653bc1eb072e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.235008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a23a8f-1557-437d-8ac1-653bc1eb072e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.235435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a23a8f-1557-437d-8ac1-653bc1eb072e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.236136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a23a8f-1557-437d-8ac1-653bc1eb072e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.236583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a23a8f-1557-437d-8ac1-653bc1eb072e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.237075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a23a8f-1557-437d-8ac1-653bc1eb072e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.436642 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-80a23a8f-1557-437d-8ac1-653bc1eb072e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.214561 Oct 29 03:02:25.445730 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1971/3911] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:02:25 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/os-interface => generated 285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:25.451684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:25.452680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:25.465618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.469958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.470486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.471556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.472380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.472904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.913999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:25.927512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:25.929177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:25.932530 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0c194f09-eb32-436f-b8ef-c0d9b132d1c0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.485209 Oct 29 03:02:25.935002 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1972/3912] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:25 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:25.941136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:25.946905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:25.965115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.965877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.966513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.967470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.968119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.968740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:26.424648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:26.441930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:26.444272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:26.445726 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cc5b715f-d594-4707-9ebb-884e6540e3db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.508550 Oct 29 03:02:26.460187 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1973/3913] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:25 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:26.473543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2f1fb053-6f30-4db6-87d1-0552f475bb58 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:26.475024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2f1fb053-6f30-4db6-87d1-0552f475bb58 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:26.484162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f1fb053-6f30-4db6-87d1-0552f475bb58 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:26.484802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f1fb053-6f30-4db6-87d1-0552f475bb58 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:26.485414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f1fb053-6f30-4db6-87d1-0552f475bb58 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:26.488084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f1fb053-6f30-4db6-87d1-0552f475bb58 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:26.488688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f1fb053-6f30-4db6-87d1-0552f475bb58 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:26.489230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f1fb053-6f30-4db6-87d1-0552f475bb58 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.134097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2f1fb053-6f30-4db6-87d1-0552f475bb58 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:27.149534 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2f1fb053-6f30-4db6-87d1-0552f475bb58 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1499 microversion: 2.1 time: 0.691876 Oct 29 03:02:27.152952 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1974/3914] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:26 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1499 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:27.169350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-767b6a68-c14a-4334-9380-82f400da4b9d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:27.170928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-767b6a68-c14a-4334-9380-82f400da4b9d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:27.179398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:02:27.180095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:02:27.180263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:02:27.180862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:02:27.180999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-767b6a68-c14a-4334-9380-82f400da4b9d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.181691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:02:27.182189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-767b6a68-c14a-4334-9380-82f400da4b9d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.182920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-767b6a68-c14a-4334-9380-82f400da4b9d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.184234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-767b6a68-c14a-4334-9380-82f400da4b9d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.185593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-767b6a68-c14a-4334-9380-82f400da4b9d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.186474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-767b6a68-c14a-4334-9380-82f400da4b9d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.203716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.204197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.205380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.209765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.210725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.211337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.235134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Getting quotas for project 6f701d727812417a860406464cf0f757. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:27.244514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Getting quotas for user aa0f9eced1ff41e281ed82bb0465a58b and project 6f701d727812417a860406464cf0f757. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:27.277467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:02:27.281500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74602fda-f09e-4e89-93c3-4461672f2d79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:27.374096 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-59406802-2ede-4303-88a7-cb448ef3aa04 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.438662 Oct 29 03:02:27.390254 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1941/3915] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:02:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 2457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:02:27.415642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:27.417595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:27.424598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.425614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.426269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.427245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.427906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.428491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.492242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-767b6a68-c14a-4334-9380-82f400da4b9d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:27.505161 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-767b6a68-c14a-4334-9380-82f400da4b9d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1325 microversion: 2.1 time: 0.350200 Oct 29 03:02:27.505768 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1975/3916] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:27 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1325 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:27.530528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bca8dd7d-b6f5-490e-a6fc-81bd66a2c87f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:27.539552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bca8dd7d-b6f5-490e-a6fc-81bd66a2c87f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:27.554895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bca8dd7d-b6f5-490e-a6fc-81bd66a2c87f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.555626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bca8dd7d-b6f5-490e-a6fc-81bd66a2c87f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.556263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bca8dd7d-b6f5-490e-a6fc-81bd66a2c87f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.558775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bca8dd7d-b6f5-490e-a6fc-81bd66a2c87f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.559419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bca8dd7d-b6f5-490e-a6fc-81bd66a2c87f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.560047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bca8dd7d-b6f5-490e-a6fc-81bd66a2c87f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.624522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-bca8dd7d-b6f5-490e-a6fc-81bd66a2c87f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lazy-loading 'flavor' on Instance uuid 1ca75b7e-d4ac-4231-915f-4f4901ad6758 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:02:27.825021 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bca8dd7d-b6f5-490e-a6fc-81bd66a2c87f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "POST /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758/action" status: 200 len: 32 microversion: 2.1 time: 0.313459 Oct 29 03:02:27.831645 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1976/3917] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:02:27 2022] POST /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758/action => generated 32 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:02:27.839065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e995355d-621b-4b94-852b-7fca403d71c3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:27.841179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e995355d-621b-4b94-852b-7fca403d71c3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:27.899705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:27.921682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e995355d-621b-4b94-852b-7fca403d71c3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:27.934269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:27.938175 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e995355d-621b-4b94-852b-7fca403d71c3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1246 microversion: 2.1 time: 0.103611 Oct 29 03:02:27.941097 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1977/3918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:27 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1246 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:27.946475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:27.950327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:27.951879 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cc0d3e7c-d2fc-4618-b782-6c18fefc4198 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.560271 Oct 29 03:02:27.953195 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1942/3919] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:27 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:27.968493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:27.969554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:27.982306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aa758163-83fa-4488-8548-27a8e09c177b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:27.984797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aa758163-83fa-4488-8548-27a8e09c177b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:27.991414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.994501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.995277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.998123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.999386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.000723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.007326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa758163-83fa-4488-8548-27a8e09c177b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.007964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa758163-83fa-4488-8548-27a8e09c177b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.008477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa758163-83fa-4488-8548-27a8e09c177b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.011711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa758163-83fa-4488-8548-27a8e09c177b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.012409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa758163-83fa-4488-8548-27a8e09c177b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.013014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa758163-83fa-4488-8548-27a8e09c177b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.689111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:28.708125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:28.709766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:28.711375 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8c9281fa-7256-47de-a269-b04013ffb69d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.766975 Oct 29 03:02:28.712428 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1978/3920] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:27 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:28.717465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-fe2e3f48-cf87-43da-99f0-af084876e884 req-05ba8501-229a-44e3-82ea-041626abaffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e7e466-df5f-45f5-9e45-dc3c16e888b7", "tag": "4f85a0f7-faab-45b5-be06-7a79452c31af"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:28.728357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aa758163-83fa-4488-8548-27a8e09c177b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:28.746196 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aa758163-83fa-4488-8548-27a8e09c177b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.790016 Oct 29 03:02:28.746355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fe2e3f48-cf87-43da-99f0-af084876e884 req-05ba8501-229a-44e3-82ea-041626abaffb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.746824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fe2e3f48-cf87-43da-99f0-af084876e884 req-05ba8501-229a-44e3-82ea-041626abaffb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.747464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fe2e3f48-cf87-43da-99f0-af084876e884 req-05ba8501-229a-44e3-82ea-041626abaffb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.749429 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1943/3921] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:27 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:28.766277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d36b5627-ef69-4231-bf4c-c00f7ec4326c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:28.769516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d36b5627-ef69-4231-bf4c-c00f7ec4326c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:28.789247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d36b5627-ef69-4231-bf4c-c00f7ec4326c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.791868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d36b5627-ef69-4231-bf4c-c00f7ec4326c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.793497 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-fe2e3f48-cf87-43da-99f0-af084876e884 req-05ba8501-229a-44e3-82ea-041626abaffb service nova] Creating event network-changed:4f85a0f7-faab-45b5-be06-7a79452c31af for instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 on n-h1-862964-4 Oct 29 03:02:28.794339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d36b5627-ef69-4231-bf4c-c00f7ec4326c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.799617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d36b5627-ef69-4231-bf4c-c00f7ec4326c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.800408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d36b5627-ef69-4231-bf4c-c00f7ec4326c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.801535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d36b5627-ef69-4231-bf4c-c00f7ec4326c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.810400 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-fe2e3f48-cf87-43da-99f0-af084876e884 req-05ba8501-229a-44e3-82ea-041626abaffb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095735 Oct 29 03:02:28.814153 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1979/3922] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:28.962660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d03f8828-8e5d-4f60-a2e1-429e85490608 req-efa1125a-eff2-4e32-b094-68d1f32230c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31241403-2a17-4f40-818d-fc8caca85e4b", "name": "network-vif-plugged", "status": "completed", "tag": "e6f1a4fa-984f-49dc-a400-07b55f9cbbeb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:28.990809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d03f8828-8e5d-4f60-a2e1-429e85490608 req-efa1125a-eff2-4e32-b094-68d1f32230c2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.992509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d03f8828-8e5d-4f60-a2e1-429e85490608 req-efa1125a-eff2-4e32-b094-68d1f32230c2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.994194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d03f8828-8e5d-4f60-a2e1-429e85490608 req-efa1125a-eff2-4e32-b094-68d1f32230c2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.032972 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d03f8828-8e5d-4f60-a2e1-429e85490608 req-efa1125a-eff2-4e32-b094-68d1f32230c2 service nova] Creating event network-vif-plugged:e6f1a4fa-984f-49dc-a400-07b55f9cbbeb for instance 31241403-2a17-4f40-818d-fc8caca85e4b on n-h2-862964-4 Oct 29 03:02:29.036537 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d03f8828-8e5d-4f60-a2e1-429e85490608 req-efa1125a-eff2-4e32-b094-68d1f32230c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079307 Oct 29 03:02:29.038014 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1980/3923] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:29.055923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8aa5cdb0-5b17-47f5-a31d-ebc2f53b67af tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:29.057027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8aa5cdb0-5b17-47f5-a31d-ebc2f53b67af tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:29.064315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa5cdb0-5b17-47f5-a31d-ebc2f53b67af tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.065757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa5cdb0-5b17-47f5-a31d-ebc2f53b67af tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.066655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa5cdb0-5b17-47f5-a31d-ebc2f53b67af tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.074917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa5cdb0-5b17-47f5-a31d-ebc2f53b67af tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.075825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa5cdb0-5b17-47f5-a31d-ebc2f53b67af tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.076428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa5cdb0-5b17-47f5-a31d-ebc2f53b67af tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.188034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d36b5627-ef69-4231-bf4c-c00f7ec4326c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:29.203189 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d36b5627-ef69-4231-bf4c-c00f7ec4326c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1325 microversion: 2.1 time: 0.445742 Oct 29 03:02:29.206387 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1944/3924] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:28 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1325 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:29.225237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:29.226775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:29.287738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8aa5cdb0-5b17-47f5-a31d-ebc2f53b67af tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:29.291316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.292356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:29.293361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.298765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.302600 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8aa5cdb0-5b17-47f5-a31d-ebc2f53b67af tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1298 microversion: 2.1 time: 0.263154 Oct 29 03:02:29.302842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.303278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.309976 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1981/3925] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:29 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1298 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:29.322488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.742732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:29.744307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:29.753269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.759254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.759976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.760921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.761561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.762178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.582784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:30.596925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:30.603300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:30.607443 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d178a9eb-9768-4306-9594-feed68d4c185 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 1.398286 Oct 29 03:02:30.615303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1945/3926] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:29 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:30.621171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-34084ea4-2386-49af-8a9b-d2d477e801df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:30.622040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-34084ea4-2386-49af-8a9b-d2d477e801df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:30.649374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34084ea4-2386-49af-8a9b-d2d477e801df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.651253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34084ea4-2386-49af-8a9b-d2d477e801df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.660442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34084ea4-2386-49af-8a9b-d2d477e801df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.663434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34084ea4-2386-49af-8a9b-d2d477e801df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.664250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34084ea4-2386-49af-8a9b-d2d477e801df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.665096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34084ea4-2386-49af-8a9b-d2d477e801df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.026546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-34084ea4-2386-49af-8a9b-d2d477e801df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:31.049926 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-34084ea4-2386-49af-8a9b-d2d477e801df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.429964 Oct 29 03:02:31.049926 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1946/3927] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:30 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:31.069538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e63418fe-dc3d-475d-b611-a099eaa9c593 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:31.070187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e63418fe-dc3d-475d-b611-a099eaa9c593 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:31.095546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63418fe-dc3d-475d-b611-a099eaa9c593 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:31.096811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63418fe-dc3d-475d-b611-a099eaa9c593 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:31.097599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63418fe-dc3d-475d-b611-a099eaa9c593 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.098611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63418fe-dc3d-475d-b611-a099eaa9c593 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:31.099300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63418fe-dc3d-475d-b611-a099eaa9c593 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:31.099951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63418fe-dc3d-475d-b611-a099eaa9c593 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.372653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:31.395179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:31.407688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:31.426234 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2bf9f76b-bd67-452b-82f8-03796a67e5cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 1.686712 Oct 29 03:02:31.432369 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1982/3928] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:29 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:02:31.447162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e63418fe-dc3d-475d-b611-a099eaa9c593 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:31.448864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a6d4ceea-4786-4d44-a4d9-c7ad8f8b0b9f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:31.449482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a6d4ceea-4786-4d44-a4d9-c7ad8f8b0b9f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:31.459748 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e63418fe-dc3d-475d-b611-a099eaa9c593 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1325 microversion: 2.1 time: 0.410069 Oct 29 03:02:31.476036 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1947/3929] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:31 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1325 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:31.476311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6d4ceea-4786-4d44-a4d9-c7ad8f8b0b9f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:31.476311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6d4ceea-4786-4d44-a4d9-c7ad8f8b0b9f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:31.476311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6d4ceea-4786-4d44-a4d9-c7ad8f8b0b9f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.476311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6d4ceea-4786-4d44-a4d9-c7ad8f8b0b9f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:31.476311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6d4ceea-4786-4d44-a4d9-c7ad8f8b0b9f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:31.476311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6d4ceea-4786-4d44-a4d9-c7ad8f8b0b9f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.642602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:31.643577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:31.657375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:31.657997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:31.658498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.659361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:31.661889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:31.662393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.765425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a6d4ceea-4786-4d44-a4d9-c7ad8f8b0b9f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:31.780574 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a6d4ceea-4786-4d44-a4d9-c7ad8f8b0b9f tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1304 microversion: 2.1 time: 0.344101 Oct 29 03:02:31.801693 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1983/3930] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:31 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1304 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:32.075209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-901019d8-4cac-4c9f-9277-55e6ac500645 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:32.076363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-901019d8-4cac-4c9f-9277-55e6ac500645 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:32.092751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-901019d8-4cac-4c9f-9277-55e6ac500645 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.095501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-901019d8-4cac-4c9f-9277-55e6ac500645 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.096663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-901019d8-4cac-4c9f-9277-55e6ac500645 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.101333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-901019d8-4cac-4c9f-9277-55e6ac500645 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.113460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-901019d8-4cac-4c9f-9277-55e6ac500645 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.115672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-901019d8-4cac-4c9f-9277-55e6ac500645 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.121454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:32.135363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:32.136916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:32.151299 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-03b78cd7-6cde-49f6-b192-c25ed4cfca48 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.516942 Oct 29 03:02:32.161738 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1948/3931] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:31 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:32.461585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:32.463558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:32.478006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.480165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.482818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.484136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.486556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.488447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.701389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-901019d8-4cac-4c9f-9277-55e6ac500645 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:32.715029 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-901019d8-4cac-4c9f-9277-55e6ac500645 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.646134 Oct 29 03:02:32.717093 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1984/3932] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:32 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:32.730394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b29f871f-5fb4-4b12-8f8e-58d5a30122af tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:32.731368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b29f871f-5fb4-4b12-8f8e-58d5a30122af tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:32.756825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29f871f-5fb4-4b12-8f8e-58d5a30122af tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.757910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29f871f-5fb4-4b12-8f8e-58d5a30122af tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.761529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29f871f-5fb4-4b12-8f8e-58d5a30122af tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.762780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29f871f-5fb4-4b12-8f8e-58d5a30122af tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.763490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29f871f-5fb4-4b12-8f8e-58d5a30122af tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.764157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b29f871f-5fb4-4b12-8f8e-58d5a30122af tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.214458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:33.229277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:33.247944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:33.249969 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e237bd6d-0bfa-4040-8d3b-aa0967b9f5f0 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.792327 Oct 29 03:02:33.261265 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1949/3933] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:32 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:33.272562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d40314d-68b2-4b53-83b0-7657091b89d5 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:33.273606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d40314d-68b2-4b53-83b0-7657091b89d5 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:33.289541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d40314d-68b2-4b53-83b0-7657091b89d5 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.292756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d40314d-68b2-4b53-83b0-7657091b89d5 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.296694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d40314d-68b2-4b53-83b0-7657091b89d5 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.297862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d40314d-68b2-4b53-83b0-7657091b89d5 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.298651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d40314d-68b2-4b53-83b0-7657091b89d5 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.299539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d40314d-68b2-4b53-83b0-7657091b89d5 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.391751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b29f871f-5fb4-4b12-8f8e-58d5a30122af tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:33.401404 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b29f871f-5fb4-4b12-8f8e-58d5a30122af tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1325 microversion: 2.1 time: 0.680051 Oct 29 03:02:33.406665 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1985/3934] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:32 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1325 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:33.418093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:33.418093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:33.426467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.426978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.427415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.428147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.450813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.451288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.604663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d40314d-68b2-4b53-83b0-7657091b89d5 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:33.614684 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d40314d-68b2-4b53-83b0-7657091b89d5 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.358334 Oct 29 03:02:33.615284 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1950/3935] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:33 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:33.742330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a0c34ba4-3079-4750-920a-212be0ae68cf tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:33.743492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a0c34ba4-3079-4750-920a-212be0ae68cf tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:33.751864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0c34ba4-3079-4750-920a-212be0ae68cf tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.753221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0c34ba4-3079-4750-920a-212be0ae68cf tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.754035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0c34ba4-3079-4750-920a-212be0ae68cf tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.754787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0c34ba4-3079-4750-920a-212be0ae68cf tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.755237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0c34ba4-3079-4750-920a-212be0ae68cf tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.755902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0c34ba4-3079-4750-920a-212be0ae68cf tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.009707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a0c34ba4-3079-4750-920a-212be0ae68cf tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:34.023393 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a0c34ba4-3079-4750-920a-212be0ae68cf tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.286541 Oct 29 03:02:34.023996 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1951/3936] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:33 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:34.279338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:34.280654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:34.291876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.302911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.303441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.304633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.305077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.305570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.664271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:34.674348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:34.681206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:34.682652 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a2ad3d81-eadb-47ec-9b82-4a1013eef082 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.407437 Oct 29 03:02:34.683224 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1952/3937] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:34 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:02:34.697953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d5c5daa8-c15d-4799-b307-99fed436d751 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:34.697953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d5c5daa8-c15d-4799-b307-99fed436d751 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:34.698885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5c5daa8-c15d-4799-b307-99fed436d751 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.699648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5c5daa8-c15d-4799-b307-99fed436d751 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.700308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5c5daa8-c15d-4799-b307-99fed436d751 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.701395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5c5daa8-c15d-4799-b307-99fed436d751 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.702129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5c5daa8-c15d-4799-b307-99fed436d751 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.702774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5c5daa8-c15d-4799-b307-99fed436d751 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.757652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:34.767549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:34.769091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:34.775087 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9b0abb51-e9ce-4a04-aa3a-d144c85e2b2c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 1.367329 Oct 29 03:02:34.782915 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1986/3938] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:33 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:34.788342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1f45d3c6-04f8-4879-b1bf-5ec6c77b69eb req-68309902-cdab-4126-abd6-48c7845f7241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fae7d5-c7f2-41de-a789-4c81a4159773", "name": "network-vif-plugged", "status": "completed", "tag": "e33899ff-ebb2-4758-857c-42c8799776a5"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:34.808568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1f45d3c6-04f8-4879-b1bf-5ec6c77b69eb req-68309902-cdab-4126-abd6-48c7845f7241 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.809053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1f45d3c6-04f8-4879-b1bf-5ec6c77b69eb req-68309902-cdab-4126-abd6-48c7845f7241 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.809482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1f45d3c6-04f8-4879-b1bf-5ec6c77b69eb req-68309902-cdab-4126-abd6-48c7845f7241 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.828245 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1f45d3c6-04f8-4879-b1bf-5ec6c77b69eb req-68309902-cdab-4126-abd6-48c7845f7241 service nova] Creating event network-vif-plugged:e33899ff-ebb2-4758-857c-42c8799776a5 for instance e9fae7d5-c7f2-41de-a789-4c81a4159773 on n-h2-862964-4 Oct 29 03:02:34.838293 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1f45d3c6-04f8-4879-b1bf-5ec6c77b69eb req-68309902-cdab-4126-abd6-48c7845f7241 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053286 Oct 29 03:02:34.839611 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1987/3939] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:34.849728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f4d77c31-42e9-44f5-8d72-32135168b33a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:34.850956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f4d77c31-42e9-44f5-8d72-32135168b33a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:34.874277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4d77c31-42e9-44f5-8d72-32135168b33a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.875029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4d77c31-42e9-44f5-8d72-32135168b33a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.875807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4d77c31-42e9-44f5-8d72-32135168b33a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.877042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4d77c31-42e9-44f5-8d72-32135168b33a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.879642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4d77c31-42e9-44f5-8d72-32135168b33a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.880365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4d77c31-42e9-44f5-8d72-32135168b33a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.028421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d5c5daa8-c15d-4799-b307-99fed436d751 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:35.037188 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d5c5daa8-c15d-4799-b307-99fed436d751 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1325 microversion: 2.1 time: 0.351176 Oct 29 03:02:35.039217 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1953/3940] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:34 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1325 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:35.054021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9365de23-d0dd-47fe-8a81-a908ae73a53b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.055428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9365de23-d0dd-47fe-8a81-a908ae73a53b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.062817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9365de23-d0dd-47fe-8a81-a908ae73a53b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.063305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9365de23-d0dd-47fe-8a81-a908ae73a53b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.063734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9365de23-d0dd-47fe-8a81-a908ae73a53b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.064634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9365de23-d0dd-47fe-8a81-a908ae73a53b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.065346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9365de23-d0dd-47fe-8a81-a908ae73a53b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.066248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9365de23-d0dd-47fe-8a81-a908ae73a53b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.241358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9365de23-d0dd-47fe-8a81-a908ae73a53b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:35.250806 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9365de23-d0dd-47fe-8a81-a908ae73a53b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.203449 Oct 29 03:02:35.251968 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1954/3941] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:35 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:35.358754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f4d77c31-42e9-44f5-8d72-32135168b33a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:35.369073 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f4d77c31-42e9-44f5-8d72-32135168b33a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.527999 Oct 29 03:02:35.378048 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1988/3942] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:34 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:35.714961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.715549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.726489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.726489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.728967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.730609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.732580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.734198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.812610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.817329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.820337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=94 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:35.842588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.843091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.843537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.844257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.844711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.845140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:36.054247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:36.072878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:36.074371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:36.075785 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8b7b34f1-7ce8-4c53-ba3b-3bcce3274da3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.365212 Oct 29 03:02:36.076887 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1955/3943] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:35 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:36.082082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-323c9fbd-b34d-4f62-b3fc-fc1273fa828c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:36.082909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-323c9fbd-b34d-4f62-b3fc-fc1273fa828c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:36.089603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-323c9fbd-b34d-4f62-b3fc-fc1273fa828c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:36.090451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-323c9fbd-b34d-4f62-b3fc-fc1273fa828c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:36.091135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-323c9fbd-b34d-4f62-b3fc-fc1273fa828c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:36.092078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-323c9fbd-b34d-4f62-b3fc-fc1273fa828c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:36.092752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-323c9fbd-b34d-4f62-b3fc-fc1273fa828c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:36.093413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-323c9fbd-b34d-4f62-b3fc-fc1273fa828c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:36.298714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:36.308710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:36.322961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:36.327323 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b0bbdcad-8640-49d2-baf2-df687528ac4f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 0.518943 Oct 29 03:02:36.337949 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1989/3944] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:35 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:36.338275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c4b4033a-a43e-4a4e-975f-d80da01b3afc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:36.347098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c4b4033a-a43e-4a4e-975f-d80da01b3afc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:36.389020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4b4033a-a43e-4a4e-975f-d80da01b3afc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:36.389509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4b4033a-a43e-4a4e-975f-d80da01b3afc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:36.390968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4b4033a-a43e-4a4e-975f-d80da01b3afc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:36.394306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4b4033a-a43e-4a4e-975f-d80da01b3afc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:36.396636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4b4033a-a43e-4a4e-975f-d80da01b3afc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:36.401191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4b4033a-a43e-4a4e-975f-d80da01b3afc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:36.478344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-323c9fbd-b34d-4f62-b3fc-fc1273fa828c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:36.495076 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-323c9fbd-b34d-4f62-b3fc-fc1273fa828c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1325 microversion: 2.1 time: 0.416861 Oct 29 03:02:36.503267 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1956/3945] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:36 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1325 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:36.523334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f393209-5f49-4492-b646-7e2a05c7189b tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:36.523946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5f393209-5f49-4492-b646-7e2a05c7189b tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:36.562835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f393209-5f49-4492-b646-7e2a05c7189b tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:36.563507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f393209-5f49-4492-b646-7e2a05c7189b tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:36.569172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f393209-5f49-4492-b646-7e2a05c7189b tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:36.570541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f393209-5f49-4492-b646-7e2a05c7189b tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:36.571026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f393209-5f49-4492-b646-7e2a05c7189b tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:36.571463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f393209-5f49-4492-b646-7e2a05c7189b tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:36.727239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c4b4033a-a43e-4a4e-975f-d80da01b3afc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:36.735678 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c4b4033a-a43e-4a4e-975f-d80da01b3afc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.404903 Oct 29 03:02:36.740487 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1990/3946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:36 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:37.055369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5f393209-5f49-4492-b646-7e2a05c7189b tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:37.070538 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f393209-5f49-4492-b646-7e2a05c7189b tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.563559 Oct 29 03:02:37.071750 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1957/3947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:36 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:37.104342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:37.105593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:37.119495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:37.120325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:37.120990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:37.122397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:37.123702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:37.126421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:37.362845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:37.363464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:37.377429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:37.379410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=18 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:37.384867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:37.388659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:37.406277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:37.410763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:37.411477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:37.412523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:37.926775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:38.103202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:38.121377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:38.129612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:38.134905 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c3f320e7-08cb-456f-8973-d6e73b3d907c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 1.034399 Oct 29 03:02:38.137149 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1991/3948] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:37 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:38.152888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e710c1c-567b-4330-8d75-ae00f156c365 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:38.158457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0e710c1c-567b-4330-8d75-ae00f156c365 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:38.187212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e710c1c-567b-4330-8d75-ae00f156c365 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:38.192587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e710c1c-567b-4330-8d75-ae00f156c365 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:38.193414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e710c1c-567b-4330-8d75-ae00f156c365 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:38.194727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e710c1c-567b-4330-8d75-ae00f156c365 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:38.197936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e710c1c-567b-4330-8d75-ae00f156c365 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:38.198857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e710c1c-567b-4330-8d75-ae00f156c365 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:38.587900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:38.598752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:38.605543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:38.625057 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f8b019df-d40d-48f6-92af-c1d9d7868346 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 1.257292 Oct 29 03:02:38.626080 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1958/3949] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:37 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:02:38.653578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bee765b9-a91b-48ad-8135-85450cd3724b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:38.654353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bee765b9-a91b-48ad-8135-85450cd3724b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:38.667462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bee765b9-a91b-48ad-8135-85450cd3724b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:38.670942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bee765b9-a91b-48ad-8135-85450cd3724b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:38.672206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bee765b9-a91b-48ad-8135-85450cd3724b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:38.674380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bee765b9-a91b-48ad-8135-85450cd3724b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:38.677296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bee765b9-a91b-48ad-8135-85450cd3724b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:38.679223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bee765b9-a91b-48ad-8135-85450cd3724b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:38.775458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:38.790664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0e710c1c-567b-4330-8d75-ae00f156c365 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:38.801866 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e710c1c-567b-4330-8d75-ae00f156c365 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1325 microversion: 2.1 time: 0.660628 Oct 29 03:02:38.818592 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1992/3950] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:38 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1325 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:38.825106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d07f5f47-1394-47d4-b75e-13c45189f980 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:38.830701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d07f5f47-1394-47d4-b75e-13c45189f980 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:38.843622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d07f5f47-1394-47d4-b75e-13c45189f980 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:38.846824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d07f5f47-1394-47d4-b75e-13c45189f980 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:38.847632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d07f5f47-1394-47d4-b75e-13c45189f980 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:38.848794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d07f5f47-1394-47d4-b75e-13c45189f980 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:38.858799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d07f5f47-1394-47d4-b75e-13c45189f980 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:38.861056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d07f5f47-1394-47d4-b75e-13c45189f980 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:39.450378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d07f5f47-1394-47d4-b75e-13c45189f980 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:39.469474 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d07f5f47-1394-47d4-b75e-13c45189f980 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.648781 Oct 29 03:02:39.469754 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1993/3951] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:38 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:39.493528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:39.494286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:39.502736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:39.503794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:39.504403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:39.505381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:39.507285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:39.507997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.064682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bee765b9-a91b-48ad-8135-85450cd3724b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:40.083862 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bee765b9-a91b-48ad-8135-85450cd3724b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 1.456587 Oct 29 03:02:40.102046 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1959/3952] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:38 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:40.107843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:40.108717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:40.117520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.118701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.119322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.120215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.121411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.122304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.323656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:40.359659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:40.364980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:40.366285 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af0b5323-fe0e-45c8-81cd-d62337ac66db tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.878411 Oct 29 03:02:40.372614 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1994/3953] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:39 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:40.391369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a472ed18-66e1-44fe-8764-e0974c1884e1 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:40.395467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a472ed18-66e1-44fe-8764-e0974c1884e1 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:40.424231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a472ed18-66e1-44fe-8764-e0974c1884e1 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.427936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a472ed18-66e1-44fe-8764-e0974c1884e1 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.431724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a472ed18-66e1-44fe-8764-e0974c1884e1 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.436815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a472ed18-66e1-44fe-8764-e0974c1884e1 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.439681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a472ed18-66e1-44fe-8764-e0974c1884e1 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.442744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a472ed18-66e1-44fe-8764-e0974c1884e1 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.853911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a472ed18-66e1-44fe-8764-e0974c1884e1 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:40.867155 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a472ed18-66e1-44fe-8764-e0974c1884e1 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1325 microversion: 2.1 time: 0.484662 Oct 29 03:02:40.868276 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1995/3954] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:40 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1325 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:40.896261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7dbfcb4f-a6f7-4e00-ac3b-bced12e594bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:40.896872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7dbfcb4f-a6f7-4e00-ac3b-bced12e594bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:40.919068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dbfcb4f-a6f7-4e00-ac3b-bced12e594bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.919068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dbfcb4f-a6f7-4e00-ac3b-bced12e594bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.919068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dbfcb4f-a6f7-4e00-ac3b-bced12e594bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.924661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dbfcb4f-a6f7-4e00-ac3b-bced12e594bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.926339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dbfcb4f-a6f7-4e00-ac3b-bced12e594bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.927179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dbfcb4f-a6f7-4e00-ac3b-bced12e594bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:41.483276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7dbfcb4f-a6f7-4e00-ac3b-bced12e594bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:41.493536 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7dbfcb4f-a6f7-4e00-ac3b-bced12e594bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.607252 Oct 29 03:02:41.509790 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1996/3955] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:40 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:41.514609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fea98a58-bb60-49a3-bb38-22cb4b3a0527 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:41.515219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fea98a58-bb60-49a3-bb38-22cb4b3a0527 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:41.571394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fea98a58-bb60-49a3-bb38-22cb4b3a0527 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:41.572206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fea98a58-bb60-49a3-bb38-22cb4b3a0527 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:41.572849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fea98a58-bb60-49a3-bb38-22cb4b3a0527 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:41.573756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fea98a58-bb60-49a3-bb38-22cb4b3a0527 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:41.574403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fea98a58-bb60-49a3-bb38-22cb4b3a0527 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:41.575019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fea98a58-bb60-49a3-bb38-22cb4b3a0527 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:41.629203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:41.643217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:41.645568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:41.648024 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-93780da1-a602-4f8d-bd3a-7bed2e25e5ab tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1806 microversion: 2.20 time: 1.544470 Oct 29 03:02:41.650170 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1960/3956] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:40 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1806 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:41.657179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:41.659025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:41.668492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:41.669469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:41.670214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:41.671165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:41.671939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:41.672598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:42.184976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fea98a58-bb60-49a3-bb38-22cb4b3a0527 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:42.201867 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fea98a58-bb60-49a3-bb38-22cb4b3a0527 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.690885 Oct 29 03:02:42.205918 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1997/3957] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:41 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:42.222809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-393486f5-a40e-4436-b8b1-c7dca0a8a2ba tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:42.223957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-393486f5-a40e-4436-b8b1-c7dca0a8a2ba tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:42.234102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-393486f5-a40e-4436-b8b1-c7dca0a8a2ba tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:42.243337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-393486f5-a40e-4436-b8b1-c7dca0a8a2ba tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:42.250281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-393486f5-a40e-4436-b8b1-c7dca0a8a2ba tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:42.251441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-393486f5-a40e-4436-b8b1-c7dca0a8a2ba tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:42.252277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-393486f5-a40e-4436-b8b1-c7dca0a8a2ba tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:42.253152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-393486f5-a40e-4436-b8b1-c7dca0a8a2ba tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:42.794451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:42.809441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:42.811328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:42.812719 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4c8c4385-b521-4878-9a28-ecffa73f0b67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 1.161025 Oct 29 03:02:42.813470 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1961/3958] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:41 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:42.818501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ff2bc958-a129-4722-a49d-cef732597c28 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:42.819534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ff2bc958-a129-4722-a49d-cef732597c28 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:42.827587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff2bc958-a129-4722-a49d-cef732597c28 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:42.828367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff2bc958-a129-4722-a49d-cef732597c28 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:42.828979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff2bc958-a129-4722-a49d-cef732597c28 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:42.829914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff2bc958-a129-4722-a49d-cef732597c28 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:42.830785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff2bc958-a129-4722-a49d-cef732597c28 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:42.831375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff2bc958-a129-4722-a49d-cef732597c28 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:42.998095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-393486f5-a40e-4436-b8b1-c7dca0a8a2ba tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:43.008046 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-393486f5-a40e-4436-b8b1-c7dca0a8a2ba tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1325 microversion: 2.1 time: 0.800614 Oct 29 03:02:43.027525 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1998/3959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:42 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1325 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:43.037075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:43.037697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:43.055669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.056181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.056622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.057345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.057841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.058247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.071602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:43.334768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ff2bc958-a129-4722-a49d-cef732597c28 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:43.347021 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ff2bc958-a129-4722-a49d-cef732597c28 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.531938 Oct 29 03:02:43.362932 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1962/3960] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:42 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:43.372663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8405acca-c27e-4c27-a8f4-53e506212cdc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:43.378960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8405acca-c27e-4c27-a8f4-53e506212cdc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:43.391410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8405acca-c27e-4c27-a8f4-53e506212cdc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.394760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8405acca-c27e-4c27-a8f4-53e506212cdc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.395445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8405acca-c27e-4c27-a8f4-53e506212cdc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.398785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8405acca-c27e-4c27-a8f4-53e506212cdc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.399443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8405acca-c27e-4c27-a8f4-53e506212cdc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.400041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8405acca-c27e-4c27-a8f4-53e506212cdc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.765988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:43.798532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:43.806449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:43.810548 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e6f217ee-f482-4acf-bf18-7d92da209556 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1793 microversion: 2.20 time: 0.779089 Oct 29 03:02:43.811468 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 1999/3961] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:43 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1793 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:43.861532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-7e7dab46-d2d0-44ad-9e95-0678569f7ec5 req-7de3e8c4-9dc6-437a-99c5-eb1bce421a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545c705b-dd48-4669-9ae6-8c27bab5c2c8", "tag": "816c9b1c-4652-462c-b2dc-e510bdd5ea77"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:43.892019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7e7dab46-d2d0-44ad-9e95-0678569f7ec5 req-7de3e8c4-9dc6-437a-99c5-eb1bce421a2c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.892645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7e7dab46-d2d0-44ad-9e95-0678569f7ec5 req-7de3e8c4-9dc6-437a-99c5-eb1bce421a2c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.897193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7e7dab46-d2d0-44ad-9e95-0678569f7ec5 req-7de3e8c4-9dc6-437a-99c5-eb1bce421a2c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.921507 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-7e7dab46-d2d0-44ad-9e95-0678569f7ec5 req-7de3e8c4-9dc6-437a-99c5-eb1bce421a2c service nova] Creating event network-changed:816c9b1c-4652-462c-b2dc-e510bdd5ea77 for instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 on n-h2-862964-4 Oct 29 03:02:43.936176 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-7e7dab46-d2d0-44ad-9e95-0678569f7ec5 req-7de3e8c4-9dc6-437a-99c5-eb1bce421a2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089200 Oct 29 03:02:43.936807 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2000/3962] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:43.948378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:43.948804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:43.967954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.968402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.969049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.970179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.970980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.972511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.169458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8405acca-c27e-4c27-a8f4-53e506212cdc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:44.182360 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8405acca-c27e-4c27-a8f4-53e506212cdc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.817499 Oct 29 03:02:44.183228 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1963/3963] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:43 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:44.191633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c3434dca-e8d1-4767-92ba-0df99d80119d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:44.193041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c3434dca-e8d1-4767-92ba-0df99d80119d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:44.200986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:44.203141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3434dca-e8d1-4767-92ba-0df99d80119d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.204101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3434dca-e8d1-4767-92ba-0df99d80119d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.204758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3434dca-e8d1-4767-92ba-0df99d80119d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.205542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3434dca-e8d1-4767-92ba-0df99d80119d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.206162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3434dca-e8d1-4767-92ba-0df99d80119d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.206779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3434dca-e8d1-4767-92ba-0df99d80119d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.355737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:44.369645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:44.371212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:44.372536 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1e7f8b0f-8442-46c2-9b6e-9325a4c71db5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.434641 Oct 29 03:02:44.373587 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2001/3964] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:43 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:44.382025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7f60e6c4-5ad3-4e87-9f4c-a188d2639906 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:44.384102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7f60e6c4-5ad3-4e87-9f4c-a188d2639906 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:44.392369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f60e6c4-5ad3-4e87-9f4c-a188d2639906 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.393438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f60e6c4-5ad3-4e87-9f4c-a188d2639906 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.394104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f60e6c4-5ad3-4e87-9f4c-a188d2639906 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.400142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f60e6c4-5ad3-4e87-9f4c-a188d2639906 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.400870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f60e6c4-5ad3-4e87-9f4c-a188d2639906 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.401504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f60e6c4-5ad3-4e87-9f4c-a188d2639906 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.489129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c3434dca-e8d1-4767-92ba-0df99d80119d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:44.497919 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c3434dca-e8d1-4767-92ba-0df99d80119d tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1522 microversion: 2.1 time: 0.312709 Oct 29 03:02:44.500840 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1964/3965] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:44 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:44.527354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:44.528586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:44.541451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.543735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.544462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.545286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.546757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.548796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.600990 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] HTTP exception thrown: Action 999 not found Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Request method failure captured: Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773/os-instance-actions/999 HTTP/1.1 Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJe3ApLe7SMF_c_sunbXGQD6trHJwkn6DRqY3-qW1OVB1ohIIq5rGyj6k3Ca4GxqDUBlmW9ciAUjZp9iYy6ecU5uHCqR9ifojbxqJ8YeAZBt4RHj-jsoCurHPqIwiQ1z8Ci2fUTIjRSIRL8lzPeVJDq7ns5kPDWCWmzMTcouOVWJHEc Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: ff2d630709a746e386bbb39de2d56cfa Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1581913171 Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ff2d630709a746e386bbb39de2d56cfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff2d630709a746e386bbb39de2d56cfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ff2d630709a746e386bbb39de2d56cfa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff2d630709a746e386bbb39de2d56cfa"}]}] Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1581913171 Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: ff2d630709a746e386bbb39de2d56cfa Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1581913171 Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-InstanceActionsNegativeTestJSON-1581913171-project Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 8c62bd2c7acf4c5ea9f7a9edae332de0 Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1581913171-project Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: exception: Action 999 not found Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': 'e9fae7d5-c7f2-41de-a789-4c81a4159773', 'id': '999'} Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 29 03:02:44.612811 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:02:44.620380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Returning 404 to user: Action 999 not found {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:44.620380 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-668e2aad-6580-4f0a-b084-7c21d857a8fb tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.090866 Oct 29 03:02:44.622342 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1965/3966] 10.222.0.16 () {58 vars in 1308 bytes} [Sat Oct 29 03:02:44 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773/os-instance-actions/999 => generated 66 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:02:44.635031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de25d8ed-876f-4a8d-8c50-63f24f5fc86f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '.version_select at 0x7fe1a84e6670>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:44.635921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-de25d8ed-876f-4a8d-8c50-63f24f5fc86f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: d0058bb4-729a-49d4-b924-57e56ffb1f45] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:44.652261 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-de25d8ed-876f-4a8d-8c50-63f24f5fc86f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] HTTP exception thrown: Instance d0058bb4-729a-49d4-b924-57e56ffb1f45 could not be found. Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de25d8ed-876f-4a8d-8c50-63f24f5fc86f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Request method failure captured: Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/d0058bb4-729a-49d4-b924-57e56ffb1f45/os-instance-actions HTTP/1.1 Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJe3ApLe7SMF_c_sunbXGQD6trHJwkn6DRqY3-qW1OVB1ohIIq5rGyj6k3Ca4GxqDUBlmW9ciAUjZp9iYy6ecU5uHCqR9ifojbxqJ8YeAZBt4RHj-jsoCurHPqIwiQ1z8Ci2fUTIjRSIRL8lzPeVJDq7ns5kPDWCWmzMTcouOVWJHEc Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: ff2d630709a746e386bbb39de2d56cfa Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1581913171 Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ff2d630709a746e386bbb39de2d56cfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff2d630709a746e386bbb39de2d56cfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ff2d630709a746e386bbb39de2d56cfa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff2d630709a746e386bbb39de2d56cfa"}]}] Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1581913171 Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: ff2d630709a746e386bbb39de2d56cfa Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1581913171 Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-InstanceActionsNegativeTestJSON-1581913171-project Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 8c62bd2c7acf4c5ea9f7a9edae332de0 Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1581913171-project Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance d0058bb4-729a-49d4-b924-57e56ffb1f45 could not be found. Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': 'd0058bb4-729a-49d4-b924-57e56ffb1f45'} Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0058bb4-729a-49d4-b924-57e56ffb1f45 could not be found. Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:44.653891 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0058bb4-729a-49d4-b924-57e56ffb1f45 could not be found. Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0058bb4-729a-49d4-b924-57e56ffb1f45 could not be found. Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de25d8ed-876f-4a8d-8c50-63f24f5fc86f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Returning 404 to user: Instance d0058bb4-729a-49d4-b924-57e56ffb1f45 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de25d8ed-876f-4a8d-8c50-63f24f5fc86f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/d0058bb4-729a-49d4-b924-57e56ffb1f45/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.032165 Oct 29 03:02:44.659543 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1966/3967] 10.222.0.16 () {58 vars in 1296 bytes} [Sat Oct 29 03:02:44 2022] GET /compute/v2.1/servers/d0058bb4-729a-49d4-b924-57e56ffb1f45/os-instance-actions => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:44.798016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7f60e6c4-5ad3-4e87-9f4c-a188d2639906 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:44.810496 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7f60e6c4-5ad3-4e87-9f4c-a188d2639906 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.433572 Oct 29 03:02:44.811102 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2002/3968] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:44 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:44.823076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-03c21014-5cdb-4ce5-9cf3-02f43379f445 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:44.824374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-03c21014-5cdb-4ce5-9cf3-02f43379f445 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:44.843742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c21014-5cdb-4ce5-9cf3-02f43379f445 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.844278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c21014-5cdb-4ce5-9cf3-02f43379f445 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.844848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c21014-5cdb-4ce5-9cf3-02f43379f445 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.845567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c21014-5cdb-4ce5-9cf3-02f43379f445 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.846593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c21014-5cdb-4ce5-9cf3-02f43379f445 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.847334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03c21014-5cdb-4ce5-9cf3-02f43379f445 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.871196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1304864809", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "ca4ba601-ee11-4f9d-96e1-7b11a1a9b8f2"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:44.901843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-03c21014-5cdb-4ce5-9cf3-02f43379f445 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:44.962021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] validate_networks() for [('ca4ba601-ee11-4f9d-96e1-7b11a1a9b8f2', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:02:45.033044 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-03c21014-5cdb-4ce5-9cf3-02f43379f445 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 204 len: 0 microversion: 2.1 time: 0.220228 Oct 29 03:02:45.038501 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2003/3969] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:44 2022] DELETE /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:45.047754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-24196431-3299-43e9-ac12-e48b0b59f18f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:45.049279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-24196431-3299-43e9-ac12-e48b0b59f18f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:45.056805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24196431-3299-43e9-ac12-e48b0b59f18f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.057666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24196431-3299-43e9-ac12-e48b0b59f18f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.058506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24196431-3299-43e9-ac12-e48b0b59f18f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:45.059615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24196431-3299-43e9-ac12-e48b0b59f18f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.060483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24196431-3299-43e9-ac12-e48b0b59f18f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.061351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24196431-3299-43e9-ac12-e48b0b59f18f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:45.602111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-24196431-3299-43e9-ac12-e48b0b59f18f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:45.620364 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-24196431-3299-43e9-ac12-e48b0b59f18f tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1528 microversion: 2.1 time: 0.575415 Oct 29 03:02:45.621318 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2004/3970] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:45 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1528 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:45.625066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:02:45.625574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:02:45.626189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:02:45.627049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:02:45.627520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:02:45.635537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-054d1b81-326b-4d61-bfc5-0c109bdc35dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:45.637136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-054d1b81-326b-4d61-bfc5-0c109bdc35dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:45.645027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.646164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.646420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:45.647626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.648686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.648686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:45.653604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-054d1b81-326b-4d61-bfc5-0c109bdc35dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.654367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-054d1b81-326b-4d61-bfc5-0c109bdc35dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.655020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-054d1b81-326b-4d61-bfc5-0c109bdc35dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:45.655956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-054d1b81-326b-4d61-bfc5-0c109bdc35dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.656570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-054d1b81-326b-4d61-bfc5-0c109bdc35dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.658411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-054d1b81-326b-4d61-bfc5-0c109bdc35dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:45.671283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Getting quotas for project fba7db05cea44f799b8dc23ed0203668. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:45.677492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Getting quotas for user 38fa0f91e15c40678663e11e150016a4 and project fba7db05cea44f799b8dc23ed0203668. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:45.691760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:02:45.694200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:45.757629 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-504e5631-31db-4665-91a2-48caa1004759 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.097949 Oct 29 03:02:45.758819 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1967/3971] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 03:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:02:45.763504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:45.764318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:45.774731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.775456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.776051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:45.776931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.777526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.778150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:46.120409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:46.151691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:46.154483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:46.156516 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-640a46b6-77e8-402a-81b6-9dfed1169fb2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.396331 Oct 29 03:02:46.158518 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1968/3972] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:45 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:46.163720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-946d29a9-d957-4044-a5c5-5386dc64a39a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:46.164593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-946d29a9-d957-4044-a5c5-5386dc64a39a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:46.238785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-054d1b81-326b-4d61-bfc5-0c109bdc35dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:46.244695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-946d29a9-d957-4044-a5c5-5386dc64a39a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:46.250323 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-054d1b81-326b-4d61-bfc5-0c109bdc35dc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.626356 Oct 29 03:02:46.266593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-946d29a9-d957-4044-a5c5-5386dc64a39a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:46.266593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-946d29a9-d957-4044-a5c5-5386dc64a39a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:46.266593 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-946d29a9-d957-4044-a5c5-5386dc64a39a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1262 microversion: 2.26 time: 0.100219 Oct 29 03:02:46.266593 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1969/3973] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:46 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1262 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:46.272504 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2005/3974] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:45 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:46.272726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5b93993c-4a3a-4fd5-9e36-9c0b75d6e7b2 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:46.273003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5b93993c-4a3a-4fd5-9e36-9c0b75d6e7b2 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:46.289663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b93993c-4a3a-4fd5-9e36-9c0b75d6e7b2 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:46.290183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b93993c-4a3a-4fd5-9e36-9c0b75d6e7b2 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:46.290615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b93993c-4a3a-4fd5-9e36-9c0b75d6e7b2 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:46.291311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b93993c-4a3a-4fd5-9e36-9c0b75d6e7b2 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:46.291998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b93993c-4a3a-4fd5-9e36-9c0b75d6e7b2 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:46.292486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b93993c-4a3a-4fd5-9e36-9c0b75d6e7b2 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:46.629659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5b93993c-4a3a-4fd5-9e36-9c0b75d6e7b2 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:46.642193 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5b93993c-4a3a-4fd5-9e36-9c0b75d6e7b2 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.380402 Oct 29 03:02:46.647098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-df0b7a56-60c5-4620-85f4-1f2c0b268a3c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:46.648625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-df0b7a56-60c5-4620-85f4-1f2c0b268a3c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:46.658867 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1970/3975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:46 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:46.674460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df0b7a56-60c5-4620-85f4-1f2c0b268a3c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:46.677942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df0b7a56-60c5-4620-85f4-1f2c0b268a3c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:46.678691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df0b7a56-60c5-4620-85f4-1f2c0b268a3c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:46.679707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df0b7a56-60c5-4620-85f4-1f2c0b268a3c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:46.681020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df0b7a56-60c5-4620-85f4-1f2c0b268a3c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:46.702077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-df0b7a56-60c5-4620-85f4-1f2c0b268a3c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.099624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-df0b7a56-60c5-4620-85f4-1f2c0b268a3c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:47.107612 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-df0b7a56-60c5-4620-85f4-1f2c0b268a3c tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1528 microversion: 2.1 time: 0.464949 Oct 29 03:02:47.108526 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2006/3976] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:46 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1528 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:47.188560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:47.189547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:47.198211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.199225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.199987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.200880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.201491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.202098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.280519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ff842be3-a0be-4a80-bd6f-4426c03d8299 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:47.283462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ff842be3-a0be-4a80-bd6f-4426c03d8299 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:47.291754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff842be3-a0be-4a80-bd6f-4426c03d8299 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.292696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff842be3-a0be-4a80-bd6f-4426c03d8299 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.293297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff842be3-a0be-4a80-bd6f-4426c03d8299 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.296867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff842be3-a0be-4a80-bd6f-4426c03d8299 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.297522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff842be3-a0be-4a80-bd6f-4426c03d8299 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.298165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff842be3-a0be-4a80-bd6f-4426c03d8299 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.546773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:47.566734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:47.568299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:47.569538 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b65d06a2-7d7a-49a7-8570-dc3d132666f9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.386068 Oct 29 03:02:47.577107 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1971/3977] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:47 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:47.582422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:47.583268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:47.591923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.592610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.593431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.594988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.595893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.596567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.677071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:47.687084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:47.688917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:47.690426 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-32e15d6b-ebe5-4f1a-9cbf-55205f68bc6a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1314 microversion: 2.26 time: 0.111929 Oct 29 03:02:47.691201 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1972/3978] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:47 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1314 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:47.696699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c32875d1-9ad0-4797-a0b7-4b83551b3b61 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:47.697592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c32875d1-9ad0-4797-a0b7-4b83551b3b61 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:47.704862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c32875d1-9ad0-4797-a0b7-4b83551b3b61 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.705658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c32875d1-9ad0-4797-a0b7-4b83551b3b61 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.706467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c32875d1-9ad0-4797-a0b7-4b83551b3b61 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.707427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c32875d1-9ad0-4797-a0b7-4b83551b3b61 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.708050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c32875d1-9ad0-4797-a0b7-4b83551b3b61 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.708672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c32875d1-9ad0-4797-a0b7-4b83551b3b61 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.811472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ff842be3-a0be-4a80-bd6f-4426c03d8299 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:47.823107 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ff842be3-a0be-4a80-bd6f-4426c03d8299 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.546260 Oct 29 03:02:47.826363 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2007/3979] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:47 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:47.918773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c32875d1-9ad0-4797-a0b7-4b83551b3b61 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:47.927428 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c32875d1-9ad0-4797-a0b7-4b83551b3b61 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.234490 Oct 29 03:02:47.930203 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1973/3980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:47 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:48.132519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8a95315e-100b-46c2-abd0-6c689980a8de tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:48.133397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8a95315e-100b-46c2-abd0-6c689980a8de tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:48.139897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a95315e-100b-46c2-abd0-6c689980a8de tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:48.140460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a95315e-100b-46c2-abd0-6c689980a8de tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:48.141172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a95315e-100b-46c2-abd0-6c689980a8de tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:48.142034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a95315e-100b-46c2-abd0-6c689980a8de tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:48.142602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a95315e-100b-46c2-abd0-6c689980a8de tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:48.143311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a95315e-100b-46c2-abd0-6c689980a8de tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:48.601036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:48.601310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:48.612222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8a95315e-100b-46c2-abd0-6c689980a8de tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:48.615502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:48.615998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:48.616435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:48.620994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:48.622619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:48.623260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:48.634305 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8a95315e-100b-46c2-abd0-6c689980a8de tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1528 microversion: 2.1 time: 0.505449 Oct 29 03:02:48.637503 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2008/3981] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:48 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1528 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:48.723235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:48.724130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:48.747147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:48.747915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:48.748548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:48.749423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:48.750063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:48.750646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:48.925237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:48.939110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:48.941497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:48.943075 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-be020c51-18ba-49cc-beed-f38ee38596b4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1320 microversion: 2.26 time: 0.225335 Oct 29 03:02:48.944847 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2009/3982] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:48 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:02:48.952356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-22cb6a62-884b-4e4f-9a68-a2161578ae5f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:48.953370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-22cb6a62-884b-4e4f-9a68-a2161578ae5f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:48.965265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22cb6a62-884b-4e4f-9a68-a2161578ae5f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:48.966192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22cb6a62-884b-4e4f-9a68-a2161578ae5f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:48.967189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22cb6a62-884b-4e4f-9a68-a2161578ae5f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:48.968200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22cb6a62-884b-4e4f-9a68-a2161578ae5f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:48.968857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22cb6a62-884b-4e4f-9a68-a2161578ae5f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:48.970641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22cb6a62-884b-4e4f-9a68-a2161578ae5f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:49.308832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:49.319815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:49.321532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:49.323653 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b7753ccf-8c36-4042-9fa0-9b82e28c2be8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.727913 Oct 29 03:02:49.324421 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1974/3983] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:48 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:02:49.337067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c5e96582-8297-49ad-8a0a-3177fedfcbb7 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:49.337685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c5e96582-8297-49ad-8a0a-3177fedfcbb7 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:49.347844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e96582-8297-49ad-8a0a-3177fedfcbb7 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:49.348689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e96582-8297-49ad-8a0a-3177fedfcbb7 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:49.349357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e96582-8297-49ad-8a0a-3177fedfcbb7 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:49.350310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e96582-8297-49ad-8a0a-3177fedfcbb7 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:49.350964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e96582-8297-49ad-8a0a-3177fedfcbb7 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:49.351587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e96582-8297-49ad-8a0a-3177fedfcbb7 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:49.586890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c5e96582-8297-49ad-8a0a-3177fedfcbb7 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:49.595483 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c5e96582-8297-49ad-8a0a-3177fedfcbb7 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.269695 Oct 29 03:02:49.596724 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1975/3984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:49 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:49.660676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1eaa3c6d-8fe2-4547-a3f2-2cc8ae435ffc tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:49.661577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1eaa3c6d-8fe2-4547-a3f2-2cc8ae435ffc tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:49.672915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eaa3c6d-8fe2-4547-a3f2-2cc8ae435ffc tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:49.673908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eaa3c6d-8fe2-4547-a3f2-2cc8ae435ffc tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:49.675277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eaa3c6d-8fe2-4547-a3f2-2cc8ae435ffc tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:49.676316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eaa3c6d-8fe2-4547-a3f2-2cc8ae435ffc tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:49.677156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eaa3c6d-8fe2-4547-a3f2-2cc8ae435ffc tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:49.678042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eaa3c6d-8fe2-4547-a3f2-2cc8ae435ffc tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:49.686081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-22cb6a62-884b-4e4f-9a68-a2161578ae5f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:49.697288 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-22cb6a62-884b-4e4f-9a68-a2161578ae5f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.750545 Oct 29 03:02:49.711568 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2010/3985] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:48 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:49.839243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1eaa3c6d-8fe2-4547-a3f2-2cc8ae435ffc tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:49.849161 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1eaa3c6d-8fe2-4547-a3f2-2cc8ae435ffc tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1486 microversion: 2.1 time: 0.193279 Oct 29 03:02:49.883369 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1976/3986] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:49 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1486 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:49.972930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:49.973554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:49.989857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-afec4207-5976-4837-873c-27ea95fb40c6 req-429e1163-4687-4aaa-baae-6c8189c8b1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fae7d5-c7f2-41de-a789-4c81a4159773", "name": "network-vif-deleted", "tag": "e33899ff-ebb2-4758-857c-42c8799776a5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:50.003527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.005744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.006289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:50.007232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.007501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.007956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:50.012121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-afec4207-5976-4837-873c-27ea95fb40c6 req-429e1163-4687-4aaa-baae-6c8189c8b1e4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.012617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-afec4207-5976-4837-873c-27ea95fb40c6 req-429e1163-4687-4aaa-baae-6c8189c8b1e4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.013050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-afec4207-5976-4837-873c-27ea95fb40c6 req-429e1163-4687-4aaa-baae-6c8189c8b1e4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:50.039379 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-afec4207-5976-4837-873c-27ea95fb40c6 req-429e1163-4687-4aaa-baae-6c8189c8b1e4 service nova] Creating event network-vif-deleted:e33899ff-ebb2-4758-857c-42c8799776a5 for instance e9fae7d5-c7f2-41de-a789-4c81a4159773 on n-h2-862964-4 Oct 29 03:02:50.052465 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-afec4207-5976-4837-873c-27ea95fb40c6 req-429e1163-4687-4aaa-baae-6c8189c8b1e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066858 Oct 29 03:02:50.055540 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1977/3987] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:50.350678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:50.351533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:50.367346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.367845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.368590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:50.369295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.369747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.370190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:50.370585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:50.388338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:50.394919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:50.396725 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d16190b5-182d-4c99-89ca-f49106300f86 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1362 microversion: 2.26 time: 0.427976 Oct 29 03:02:50.417353 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2011/3988] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:49 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1362 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:50.619491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b9addb92-06a4-4070-ba5a-fa4cb7c241d9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:50.620181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b9addb92-06a4-4070-ba5a-fa4cb7c241d9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:50.630382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9addb92-06a4-4070-ba5a-fa4cb7c241d9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.634055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9addb92-06a4-4070-ba5a-fa4cb7c241d9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.636227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9addb92-06a4-4070-ba5a-fa4cb7c241d9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:50.637056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9addb92-06a4-4070-ba5a-fa4cb7c241d9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.637716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9addb92-06a4-4070-ba5a-fa4cb7c241d9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.639667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9addb92-06a4-4070-ba5a-fa4cb7c241d9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:50.722625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:50.734951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:50.738103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:50.740096 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-477a0eee-1507-4aa2-bbd0-63f842e61274 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.394123 Oct 29 03:02:50.741250 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1978/3989] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:50 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:02:50.747053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4b4d713a-a54f-452b-abce-d76a3272b221 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:50.747872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4b4d713a-a54f-452b-abce-d76a3272b221 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:50.755098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4d713a-a54f-452b-abce-d76a3272b221 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.755992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4d713a-a54f-452b-abce-d76a3272b221 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.756791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4d713a-a54f-452b-abce-d76a3272b221 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:50.757842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4d713a-a54f-452b-abce-d76a3272b221 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.758584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4d713a-a54f-452b-abce-d76a3272b221 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.759397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b4d713a-a54f-452b-abce-d76a3272b221 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:50.783555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:50.991440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4b4d713a-a54f-452b-abce-d76a3272b221 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:51.002948 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4b4d713a-a54f-452b-abce-d76a3272b221 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.260252 Oct 29 03:02:51.004183 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1979/3990] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:50 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:51.009887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ec4d1f13-63bf-434f-b7ec-5432e6895d83 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:51.010788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ec4d1f13-63bf-434f-b7ec-5432e6895d83 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:51.017352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec4d1f13-63bf-434f-b7ec-5432e6895d83 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:51.017925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec4d1f13-63bf-434f-b7ec-5432e6895d83 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:51.018568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec4d1f13-63bf-434f-b7ec-5432e6895d83 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:51.019454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec4d1f13-63bf-434f-b7ec-5432e6895d83 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:51.020073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec4d1f13-63bf-434f-b7ec-5432e6895d83 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:51.020941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec4d1f13-63bf-434f-b7ec-5432e6895d83 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:51.098875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec4d1f13-63bf-434f-b7ec-5432e6895d83 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c62bd2c7acf4c5ea9f7a9edae332de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2d630709a746e386bbb39de2d56cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:51.108649 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ec4d1f13-63bf-434f-b7ec-5432e6895d83 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 200 len: 1486 microversion: 2.1 time: 0.102854 Oct 29 03:02:51.109817 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1980/3991] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:51 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 1486 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:51.155033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b9addb92-06a4-4070-ba5a-fa4cb7c241d9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:51.166822 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b9addb92-06a4-4070-ba5a-fa4cb7c241d9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.551563 Oct 29 03:02:51.168077 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2012/3992] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:50 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:51.428914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:51.430159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:51.438348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:51.438909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:51.439408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:51.440390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:51.440938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:51.443185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:51.665170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:51.675280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:51.676740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:51.678077 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9e45068a-2b84-4684-82e6-be7479aed8bc tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1362 microversion: 2.26 time: 0.258750 Oct 29 03:02:51.694331 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1981/3993] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:51 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:51.767579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:51.768628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:51.779182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:51.779681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:51.780122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:51.780836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:51.781294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:51.781718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.028448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0eaf729-a780-4322-b7be-9c4edd6930cc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:52.029048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b0eaf729-a780-4322-b7be-9c4edd6930cc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:52.049360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0eaf729-a780-4322-b7be-9c4edd6930cc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.050581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0eaf729-a780-4322-b7be-9c4edd6930cc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.051403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0eaf729-a780-4322-b7be-9c4edd6930cc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.053908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0eaf729-a780-4322-b7be-9c4edd6930cc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.054358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0eaf729-a780-4322-b7be-9c4edd6930cc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.054790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0eaf729-a780-4322-b7be-9c4edd6930cc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.211604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:52.233026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:52.238671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:52.243799 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b24fe7a7-d78a-4977-976f-96a6b616aa1f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.479857 Oct 29 03:02:52.245361 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2013/3994] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:51 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:52.252465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-92d39ed4-e83b-48ea-ab2b-a3959b97495f req-6648b6cd-e480-49ae-b616-08a3aa56cda3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545c705b-dd48-4669-9ae6-8c27bab5c2c8", "name": "network-vif-plugged", "status": "completed", "tag": "816c9b1c-4652-462c-b2dc-e510bdd5ea77"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:52.300313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-92d39ed4-e83b-48ea-ab2b-a3959b97495f req-6648b6cd-e480-49ae-b616-08a3aa56cda3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.300847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-92d39ed4-e83b-48ea-ab2b-a3959b97495f req-6648b6cd-e480-49ae-b616-08a3aa56cda3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.301276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-92d39ed4-e83b-48ea-ab2b-a3959b97495f req-6648b6cd-e480-49ae-b616-08a3aa56cda3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.320284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b0eaf729-a780-4322-b7be-9c4edd6930cc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:52.330014 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b0eaf729-a780-4322-b7be-9c4edd6930cc tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.304275 Oct 29 03:02:52.331746 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1982/3995] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:52 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:52.337415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-bd5095ad-f812-4374-9195-81cf18e797b1 req-8c052c34-793d-4f85-878a-fa515555b36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b", "tag": "915c48df-5be6-4e32-9ea8-b28cd2075729"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:52.349704 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-92d39ed4-e83b-48ea-ab2b-a3959b97495f req-6648b6cd-e480-49ae-b616-08a3aa56cda3 service nova] Creating event network-vif-plugged:816c9b1c-4652-462c-b2dc-e510bdd5ea77 for instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 on n-h2-862964-4 Oct 29 03:02:52.357877 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-92d39ed4-e83b-48ea-ab2b-a3959b97495f req-6648b6cd-e480-49ae-b616-08a3aa56cda3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109922 Oct 29 03:02:52.359647 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2014/3996] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:52.360256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bd5095ad-f812-4374-9195-81cf18e797b1 req-8c052c34-793d-4f85-878a-fa515555b36f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.360982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bd5095ad-f812-4374-9195-81cf18e797b1 req-8c052c34-793d-4f85-878a-fa515555b36f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.367533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bd5095ad-f812-4374-9195-81cf18e797b1 req-8c052c34-793d-4f85-878a-fa515555b36f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.386082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:52.388604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] [instance: e9fae7d5-c7f2-41de-a789-4c81a4159773] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:52.393132 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-bd5095ad-f812-4374-9195-81cf18e797b1 req-8c052c34-793d-4f85-878a-fa515555b36f service nova] Creating event network-changed:915c48df-5be6-4e32-9ea8-b28cd2075729 for instance ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b on n-h1-862964-4 Oct 29 03:02:52.404285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.405245 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-bd5095ad-f812-4374-9195-81cf18e797b1 req-8c052c34-793d-4f85-878a-fa515555b36f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071002 Oct 29 03:02:52.407325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.409508 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1983/3997] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:52.409883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.412472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.413279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.414770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.419401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49a7705d-a58f-48cd-8ce0-63180a1f7dda tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:52.421179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49a7705d-a58f-48cd-8ce0-63180a1f7dda tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:52.432626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49a7705d-a58f-48cd-8ce0-63180a1f7dda tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.433930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49a7705d-a58f-48cd-8ce0-63180a1f7dda tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.434615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49a7705d-a58f-48cd-8ce0-63180a1f7dda tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.435619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49a7705d-a58f-48cd-8ce0-63180a1f7dda tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.436240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49a7705d-a58f-48cd-8ce0-63180a1f7dda tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.437090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49a7705d-a58f-48cd-8ce0-63180a1f7dda tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.448137 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] HTTP exception thrown: Instance e9fae7d5-c7f2-41de-a789-4c81a4159773 could not be found. Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Request method failure captured: Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 HTTP/1.1 Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJe3ApLe7SMF_c_sunbXGQD6trHJwkn6DRqY3-qW1OVB1ohIIq5rGyj6k3Ca4GxqDUBlmW9ciAUjZp9iYy6ecU5uHCqR9ifojbxqJ8YeAZBt4RHj-jsoCurHPqIwiQ1z8Ci2fUTIjRSIRL8lzPeVJDq7ns5kPDWCWmzMTcouOVWJHEc Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: ff2d630709a746e386bbb39de2d56cfa Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1581913171 Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ff2d630709a746e386bbb39de2d56cfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff2d630709a746e386bbb39de2d56cfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ff2d630709a746e386bbb39de2d56cfa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff2d630709a746e386bbb39de2d56cfa"}]}] Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1581913171 Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: ff2d630709a746e386bbb39de2d56cfa Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1581913171 Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-InstanceActionsNegativeTestJSON-1581913171-project Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 8c62bd2c7acf4c5ea9f7a9edae332de0 Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1581913171-project Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance e9fae7d5-c7f2-41de-a789-4c81a4159773 could not be found. Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'e9fae7d5-c7f2-41de-a789-4c81a4159773'} Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9fae7d5-c7f2-41de-a789-4c81a4159773 could not be found. Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9fae7d5-c7f2-41de-a789-4c81a4159773 could not be found. Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:02:52.452996 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:52.461498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:02:52.461498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:52.461498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:52.461498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:52.461498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:52.461498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:52.461498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9fae7d5-c7f2-41de-a789-4c81a4159773 could not be found. Oct 29 03:02:52.461498 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:02:52.461498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] Returning 404 to user: Instance e9fae7d5-c7f2-41de-a789-4c81a4159773 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:52.461498 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3ea15aed-ac1d-4b4e-9c63-17e9ea878bb5 tempest-InstanceActionsNegativeTestJSON-1581913171 tempest-InstanceActionsNegativeTestJSON-1581913171-project] 10.222.0.16 "GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773" status: 404 len: 111 microversion: 2.1 time: 0.093163 Oct 29 03:02:52.461498 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2015/3998] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:52 2022] GET /compute/v2.1/servers/e9fae7d5-c7f2-41de-a789-4c81a4159773 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:52.704316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:52.705015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:52.713017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.713515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.714028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.725325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.725843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.726289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.731098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:52.765869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-49a7705d-a58f-48cd-8ce0-63180a1f7dda tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:52.774113 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-49a7705d-a58f-48cd-8ce0-63180a1f7dda tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.359386 Oct 29 03:02:52.777287 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1984/3999] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:52 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:53.013295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:53.023566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:53.032997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:53.036976 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-be9ae994-8f5f-4f44-ab7e-904bddfb7181 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1362 microversion: 2.26 time: 0.335774 Oct 29 03:02:53.039224 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2016/4000] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:52 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:53.276029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:53.277196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:53.287545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:53.288834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:53.289757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:53.291016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:53.291932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:53.292894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:53.358996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-78c000e2-8dc0-4a45-b338-c72e0f187484 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:53.360275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-78c000e2-8dc0-4a45-b338-c72e0f187484 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:53.374836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c000e2-8dc0-4a45-b338-c72e0f187484 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:53.375588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c000e2-8dc0-4a45-b338-c72e0f187484 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:53.377910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c000e2-8dc0-4a45-b338-c72e0f187484 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:53.378971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c000e2-8dc0-4a45-b338-c72e0f187484 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:53.379619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c000e2-8dc0-4a45-b338-c72e0f187484 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:53.380247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c000e2-8dc0-4a45-b338-c72e0f187484 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:53.575044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-78c000e2-8dc0-4a45-b338-c72e0f187484 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:53.583423 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-78c000e2-8dc0-4a45-b338-c72e0f187484 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.229755 Oct 29 03:02:53.584571 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2017/4001] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:53 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:53.732969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:53.753852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:53.755727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:53.756972 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e52216e4-7d1c-4133-9f2a-09e64d9076c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.485425 Oct 29 03:02:53.757537 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1985/4002] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:53 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:53.800117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-49d13411-3d14-4e46-89d9-cf9c03050afb tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:53.801619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-49d13411-3d14-4e46-89d9-cf9c03050afb tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:53.811872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d13411-3d14-4e46-89d9-cf9c03050afb tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:53.822599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d13411-3d14-4e46-89d9-cf9c03050afb tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:53.823402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d13411-3d14-4e46-89d9-cf9c03050afb tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:53.824393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d13411-3d14-4e46-89d9-cf9c03050afb tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:53.825358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d13411-3d14-4e46-89d9-cf9c03050afb tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:53.826057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d13411-3d14-4e46-89d9-cf9c03050afb tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:54.064070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:54.065018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:54.078294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:54.078925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:54.079374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:54.080299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:54.080809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:54.081281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:54.127803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-49d13411-3d14-4e46-89d9-cf9c03050afb tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:54.144461 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-49d13411-3d14-4e46-89d9-cf9c03050afb tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1372 microversion: 2.1 time: 0.342834 Oct 29 03:02:54.145250 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2018/4003] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:53 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1372 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:54.612635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6039fa63-dc4e-47bf-baa9-47962b6160df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:54.613242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6039fa63-dc4e-47bf-baa9-47962b6160df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:54.622127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6039fa63-dc4e-47bf-baa9-47962b6160df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:54.622629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6039fa63-dc4e-47bf-baa9-47962b6160df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:54.623245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6039fa63-dc4e-47bf-baa9-47962b6160df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:54.624376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6039fa63-dc4e-47bf-baa9-47962b6160df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:54.625239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6039fa63-dc4e-47bf-baa9-47962b6160df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:54.626015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6039fa63-dc4e-47bf-baa9-47962b6160df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:54.743999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:54.758431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:54.760152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:54.763523 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1faa1aa3-df20-4fa0-a21e-4f1134a4ad63 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1362 microversion: 2.26 time: 0.704497 Oct 29 03:02:54.764303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1986/4004] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:54 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1362 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:02:54.789526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:54.790625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:54.797243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:54.797960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:54.798824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:54.799772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:54.800359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:54.800909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:54.887532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6039fa63-dc4e-47bf-baa9-47962b6160df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:54.901607 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6039fa63-dc4e-47bf-baa9-47962b6160df tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.293008 Oct 29 03:02:54.902709 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2019/4005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:54 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:55.138006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:55.150357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:55.151990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:55.153435 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4cdd8a32-1bb3-4261-bc38-c277e6327100 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.369529 Oct 29 03:02:55.154731 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1987/4006] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:54 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:55.173044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc4e6b79-dfe0-4b2d-9f03-aa1bcd22c7ce tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:55.174639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fc4e6b79-dfe0-4b2d-9f03-aa1bcd22c7ce tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:55.196562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4e6b79-dfe0-4b2d-9f03-aa1bcd22c7ce tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.198057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4e6b79-dfe0-4b2d-9f03-aa1bcd22c7ce tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.200967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4e6b79-dfe0-4b2d-9f03-aa1bcd22c7ce tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.202608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4e6b79-dfe0-4b2d-9f03-aa1bcd22c7ce tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.205426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4e6b79-dfe0-4b2d-9f03-aa1bcd22c7ce tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.206783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc4e6b79-dfe0-4b2d-9f03-aa1bcd22c7ce tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.239235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d489bbd7-6448-45b6-9801-e4eddf5829aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:55.240073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d489bbd7-6448-45b6-9801-e4eddf5829aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:55.257173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d489bbd7-6448-45b6-9801-e4eddf5829aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.257678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d489bbd7-6448-45b6-9801-e4eddf5829aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.258144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d489bbd7-6448-45b6-9801-e4eddf5829aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.258872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d489bbd7-6448-45b6-9801-e4eddf5829aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.259327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d489bbd7-6448-45b6-9801-e4eddf5829aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.259749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d489bbd7-6448-45b6-9801-e4eddf5829aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.587855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fc4e6b79-dfe0-4b2d-9f03-aa1bcd22c7ce tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:55.600494 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fc4e6b79-dfe0-4b2d-9f03-aa1bcd22c7ce tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1559 microversion: 2.1 time: 0.431303 Oct 29 03:02:55.601167 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2020/4007] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:55 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1559 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:55.627764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fde75aa1-7253-4a91-ad0d-b4bcd4f86e82 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:55.629778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fde75aa1-7253-4a91-ad0d-b4bcd4f86e82 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:55.641274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fde75aa1-7253-4a91-ad0d-b4bcd4f86e82 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.644966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fde75aa1-7253-4a91-ad0d-b4bcd4f86e82 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.646417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fde75aa1-7253-4a91-ad0d-b4bcd4f86e82 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.648896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fde75aa1-7253-4a91-ad0d-b4bcd4f86e82 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.649536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fde75aa1-7253-4a91-ad0d-b4bcd4f86e82 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.651375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fde75aa1-7253-4a91-ad0d-b4bcd4f86e82 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.651629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d489bbd7-6448-45b6-9801-e4eddf5829aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:55.661154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:55.664138 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d489bbd7-6448-45b6-9801-e4eddf5829aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.429058 Oct 29 03:02:55.664732 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1988/4008] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:55 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:55.687651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac7d90de-307d-4daa-b796-58cb1aa03704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:55.688489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ac7d90de-307d-4daa-b796-58cb1aa03704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:55.702318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7d90de-307d-4daa-b796-58cb1aa03704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.702803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7d90de-307d-4daa-b796-58cb1aa03704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.703253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7d90de-307d-4daa-b796-58cb1aa03704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.703928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7d90de-307d-4daa-b796-58cb1aa03704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.704374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7d90de-307d-4daa-b796-58cb1aa03704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.704790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac7d90de-307d-4daa-b796-58cb1aa03704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.891263 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fde75aa1-7253-4a91-ad0d-b4bcd4f86e82 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.267600 Oct 29 03:02:55.901745 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2021/4009] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:02:55 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-interface => generated 285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:02:55.902295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:55.903430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:55.929447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.930315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.930777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.931515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.931945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.939818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:56.010430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ac7d90de-307d-4daa-b796-58cb1aa03704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:56.021269 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ac7d90de-307d-4daa-b796-58cb1aa03704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.337760 Oct 29 03:02:56.022676 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1989/4010] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:55 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:56.040955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4fbcb25c-8025-4690-8d79-628c85d79561 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:56.041575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4fbcb25c-8025-4690-8d79-628c85d79561 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:56.085055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fbcb25c-8025-4690-8d79-628c85d79561 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:56.087686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fbcb25c-8025-4690-8d79-628c85d79561 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:56.089208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fbcb25c-8025-4690-8d79-628c85d79561 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:56.091023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fbcb25c-8025-4690-8d79-628c85d79561 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:56.096939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fbcb25c-8025-4690-8d79-628c85d79561 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:56.100567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fbcb25c-8025-4690-8d79-628c85d79561 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:56.248770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:56.430872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4fbcb25c-8025-4690-8d79-628c85d79561 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:56.434049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:56.441840 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4fbcb25c-8025-4690-8d79-628c85d79561 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.418033 Oct 29 03:02:56.443742 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1990/4011] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:56 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:56.450046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d58be29-ec86-4ba2-8c29-6d46e99e579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:56.458021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d58be29-ec86-4ba2-8c29-6d46e99e579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:56.465268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:56.470038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d58be29-ec86-4ba2-8c29-6d46e99e579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:56.473214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:56.473827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d58be29-ec86-4ba2-8c29-6d46e99e579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:56.474415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d58be29-ec86-4ba2-8c29-6d46e99e579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:56.475508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d58be29-ec86-4ba2-8c29-6d46e99e579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:56.476169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d58be29-ec86-4ba2-8c29-6d46e99e579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:56.477241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d58be29-ec86-4ba2-8c29-6d46e99e579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:56.477355 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8fb0629-dc39-4581-8958-22046dd5c175 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1362 microversion: 2.26 time: 0.579757 Oct 29 03:02:56.477864 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2022/4012] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:55 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:56.497389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:56.507626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:56.521194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:56.522031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:56.534536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:56.538945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:56.540860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:56.542293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:57.037641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:57.047482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:57.057581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:57.059724 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-301d31a6-2967-4b7a-bf6f-7b1628388207 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.573497 Oct 29 03:02:57.060321 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2023/4013] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:56 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:57.468326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-741e9159-b9d0-4389-aaab-95c7161bc076 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:57.469014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-741e9159-b9d0-4389-aaab-95c7161bc076 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:57.480745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-741e9159-b9d0-4389-aaab-95c7161bc076 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:57.483640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-741e9159-b9d0-4389-aaab-95c7161bc076 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:57.486684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-741e9159-b9d0-4389-aaab-95c7161bc076 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:57.489438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-741e9159-b9d0-4389-aaab-95c7161bc076 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:57.490112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-741e9159-b9d0-4389-aaab-95c7161bc076 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:57.491590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-741e9159-b9d0-4389-aaab-95c7161bc076 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:57.610604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d58be29-ec86-4ba2-8c29-6d46e99e579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:57.623105 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d58be29-ec86-4ba2-8c29-6d46e99e579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 1.177964 Oct 29 03:02:57.623622 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1991/4014] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:56 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:57.631873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:57.632688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:57.676078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:57.676589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:57.677022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:57.677736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:57.678212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:57.678631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:57.856010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-741e9159-b9d0-4389-aaab-95c7161bc076 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:57.864992 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-741e9159-b9d0-4389-aaab-95c7161bc076 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.401509 Oct 29 03:02:57.881912 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2024/4015] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:57 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:57.904454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0a8a670c-0f63-4e75-bb41-bf32c606a246 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1207814826"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:57.913701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0a8a670c-0f63-4e75-bb41-bf32c606a246 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:57.937981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8a670c-0f63-4e75-bb41-bf32c606a246 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:57.938618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8a670c-0f63-4e75-bb41-bf32c606a246 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:57.940563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8a670c-0f63-4e75-bb41-bf32c606a246 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:57.942517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8a670c-0f63-4e75-bb41-bf32c606a246 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:57.946808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8a670c-0f63-4e75-bb41-bf32c606a246 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:57.947374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8a670c-0f63-4e75-bb41-bf32c606a246 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.007148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:58.021643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:58.025228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:58.030292 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-546012c5-b880-48ba-b3af-169c24741373 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1362 microversion: 2.26 time: 0.402403 Oct 29 03:02:58.034077 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1992/4016] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:57 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:58.088643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.089476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.104640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.105352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.106009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.106872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.107465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.108027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.340057 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0a8a670c-0f63-4e75-bb41-bf32c606a246 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.448063 Oct 29 03:02:58.343475 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2025/4017] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:02:57 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 29 03:02:58.374465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-01f11c7d-3539-4420-9703-76e23d46d354 req-1c43502d-25ca-44af-9577-906d8c659fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545c705b-dd48-4669-9ae6-8c27bab5c2c8", "tag": "816c9b1c-4652-462c-b2dc-e510bdd5ea77"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:58.399803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-01f11c7d-3539-4420-9703-76e23d46d354 req-1c43502d-25ca-44af-9577-906d8c659fe1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.402306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-01f11c7d-3539-4420-9703-76e23d46d354 req-1c43502d-25ca-44af-9577-906d8c659fe1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.403671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-01f11c7d-3539-4420-9703-76e23d46d354 req-1c43502d-25ca-44af-9577-906d8c659fe1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.436619 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-01f11c7d-3539-4420-9703-76e23d46d354 req-1c43502d-25ca-44af-9577-906d8c659fe1 service nova] Creating event network-changed:816c9b1c-4652-462c-b2dc-e510bdd5ea77 for instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 on n-h2-862964-4 Oct 29 03:02:58.463740 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-01f11c7d-3539-4420-9703-76e23d46d354 req-1c43502d-25ca-44af-9577-906d8c659fe1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102253 Oct 29 03:02:58.467582 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2026/4018] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:58.536844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:58.550031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:58.552088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:58.554420 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3ddfc567-f70a-4729-891f-924882b263d5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.472019 Oct 29 03:02:58.555565 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1993/4019] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:58 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:58.902226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f3221b12-fe81-465f-bac0-1f251334fc81 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.903120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f3221b12-fe81-465f-bac0-1f251334fc81 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.919416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3221b12-fe81-465f-bac0-1f251334fc81 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.922627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3221b12-fe81-465f-bac0-1f251334fc81 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.923274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3221b12-fe81-465f-bac0-1f251334fc81 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.924315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3221b12-fe81-465f-bac0-1f251334fc81 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.925673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3221b12-fe81-465f-bac0-1f251334fc81 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.928833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3221b12-fe81-465f-bac0-1f251334fc81 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.066280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:59.070300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:59.081576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.083680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.084635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.086047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.086969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.089019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.283164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:59.294507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:59.301719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:59.305265 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8003402b-9cec-46dc-8847-4ea22901de88 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1362 microversion: 2.26 time: 0.244416 Oct 29 03:02:59.306728 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1994/4020] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:59 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:59.493274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f3221b12-fe81-465f-bac0-1f251334fc81 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:59.511654 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f3221b12-fe81-465f-bac0-1f251334fc81 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1485 microversion: 2.1 time: 0.616415 Oct 29 03:02:59.512454 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2027/4021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:58 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1485 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:59.537098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5d20d227-7148-40f7-a791-ad54faaa640b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:59.537930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5d20d227-7148-40f7-a791-ad54faaa640b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:59.545763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d20d227-7148-40f7-a791-ad54faaa640b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.546534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d20d227-7148-40f7-a791-ad54faaa640b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.546988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d20d227-7148-40f7-a791-ad54faaa640b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.550155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d20d227-7148-40f7-a791-ad54faaa640b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.550965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d20d227-7148-40f7-a791-ad54faaa640b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.551719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d20d227-7148-40f7-a791-ad54faaa640b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.587219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:59.588136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:59.599607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.600564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.601271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.602260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.603127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.603731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.630353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:59.644019 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5d20d227-7148-40f7-a791-ad54faaa640b tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "POST /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758/action" status: 202 len: 0 microversion: 2.1 time: 0.111010 Oct 29 03:02:59.649078 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1995/4022] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:02:59 2022] POST /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:02:59.657232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a28f74e2-3e93-4fab-88ae-b2cf2c4088bd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:59.659781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a28f74e2-3e93-4fab-88ae-b2cf2c4088bd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:59.667547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a28f74e2-3e93-4fab-88ae-b2cf2c4088bd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.668198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a28f74e2-3e93-4fab-88ae-b2cf2c4088bd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.669289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a28f74e2-3e93-4fab-88ae-b2cf2c4088bd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.670414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a28f74e2-3e93-4fab-88ae-b2cf2c4088bd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.671136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a28f74e2-3e93-4fab-88ae-b2cf2c4088bd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.671922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a28f74e2-3e93-4fab-88ae-b2cf2c4088bd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.863542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a28f74e2-3e93-4fab-88ae-b2cf2c4088bd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:59.873174 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a28f74e2-3e93-4fab-88ae-b2cf2c4088bd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1493 microversion: 2.1 time: 0.222260 Oct 29 03:02:59.874294 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1996/4023] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:59 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1493 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:00.093616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:00.112340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:00.114154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:00.115609 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-65dc6efa-f628-4f0a-91ea-6edef40e388a tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.535241 Oct 29 03:03:00.138712 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2028/4024] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:59 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:00.336503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:00.337087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:00.343766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:00.345255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:00.346558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:00.347258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:00.347710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:00.348139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:00.528169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:00.541944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:00.544237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:00.546051 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aff13fd3-2796-4eaa-8b77-cff6a0342f91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1362 microversion: 2.26 time: 0.213614 Oct 29 03:03:00.547523 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1997/4025] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:00 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:00.571172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-dbab02d6-9c86-4202-b302-e00ad79382a6 req-9305d353-ff9c-4b06-8b3e-3ff4ef3883a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b", "name": "network-vif-plugged", "status": "completed", "tag": "915c48df-5be6-4e32-9ea8-b28cd2075729"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:00.583150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-dbab02d6-9c86-4202-b302-e00ad79382a6 req-9305d353-ff9c-4b06-8b3e-3ff4ef3883a1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:00.583630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-dbab02d6-9c86-4202-b302-e00ad79382a6 req-9305d353-ff9c-4b06-8b3e-3ff4ef3883a1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:00.584056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-dbab02d6-9c86-4202-b302-e00ad79382a6 req-9305d353-ff9c-4b06-8b3e-3ff4ef3883a1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:00.607217 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-dbab02d6-9c86-4202-b302-e00ad79382a6 req-9305d353-ff9c-4b06-8b3e-3ff4ef3883a1 service nova] Creating event network-vif-plugged:915c48df-5be6-4e32-9ea8-b28cd2075729 for instance ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b on n-h1-862964-4 Oct 29 03:03:00.614351 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-dbab02d6-9c86-4202-b302-e00ad79382a6 req-9305d353-ff9c-4b06-8b3e-3ff4ef3883a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046789 Oct 29 03:03:00.615941 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2029/4026] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:00.898851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f79c060-ea01-420f-906b-0f94a2146a7c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:00.900536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5f79c060-ea01-420f-906b-0f94a2146a7c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:00.912539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f79c060-ea01-420f-906b-0f94a2146a7c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:00.913341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f79c060-ea01-420f-906b-0f94a2146a7c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:00.914028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f79c060-ea01-420f-906b-0f94a2146a7c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:00.915047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f79c060-ea01-420f-906b-0f94a2146a7c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:00.916059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f79c060-ea01-420f-906b-0f94a2146a7c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:00.916915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f79c060-ea01-420f-906b-0f94a2146a7c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:01.075688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5f79c060-ea01-420f-906b-0f94a2146a7c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:01.083657 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f79c060-ea01-420f-906b-0f94a2146a7c tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1493 microversion: 2.1 time: 0.190274 Oct 29 03:03:01.084384 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1998/4027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:00 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1493 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:01.148157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:01.148868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:01.150875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:01.156754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:01.157244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:01.157694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:01.159638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:01.160230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:01.160747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:01.382219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:01.392496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:01.394330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:01.395823 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f7ef63d2-55e1-4617-a0dc-659d6fa4f380 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.253205 Oct 29 03:03:01.396425 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2030/4028] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:01 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:01.575008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:01.576387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:01.580064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:01.585023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:01.585943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:01.586864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:01.588215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:01.589352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:01.590544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:01.745664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:01.756056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:01.757595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:01.758804 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0eac7a07-a9c2-41a8-85f4-62ad59213c91 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1362 microversion: 2.26 time: 0.189088 Oct 29 03:03:01.759370 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 1999/4029] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:01 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:02.106968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0582a3dd-b465-4796-98b6-23075cc1db60 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:02.108084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0582a3dd-b465-4796-98b6-23075cc1db60 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:02.119119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0582a3dd-b465-4796-98b6-23075cc1db60 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:02.119890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0582a3dd-b465-4796-98b6-23075cc1db60 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:02.120951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0582a3dd-b465-4796-98b6-23075cc1db60 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:02.121833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0582a3dd-b465-4796-98b6-23075cc1db60 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:02.122458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0582a3dd-b465-4796-98b6-23075cc1db60 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:02.123046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0582a3dd-b465-4796-98b6-23075cc1db60 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:02.351950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0582a3dd-b465-4796-98b6-23075cc1db60 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:02.360430 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0582a3dd-b465-4796-98b6-23075cc1db60 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1493 microversion: 2.1 time: 0.257147 Oct 29 03:03:02.370248 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2031/4030] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:02 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1493 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:02.425126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:02.425899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:02.432840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:02.433563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:02.434198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:02.435066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:02.435796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:02.436846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:02.695496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:02.707271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:02.709654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:02.711090 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b6b5ab1-12fb-47fc-a6b2-6bfaf8de1b52 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.290312 Oct 29 03:03:02.711953 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2000/4031] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:02 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:02.784943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:02.786110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:02.794616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:02.795493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:02.796350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:02.797591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:02.798305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:02.799190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:03.011347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:03.020498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:03.021944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:03.023102 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-217409a3-be28-498b-bd2d-039c6efbfd52 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1362 microversion: 2.26 time: 0.243264 Oct 29 03:03:03.024017 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2032/4032] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:02 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:03.158871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-200701745", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "eb0e8550-6333-42ee-9b9f-13b60ac354f9"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:03.274005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] validate_networks() for [('eb0e8550-6333-42ee-9b9f-13b60ac354f9', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:03:03.383325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89da09f8-d97d-455c-85f7-1c64d2addc00 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:03.383926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89da09f8-d97d-455c-85f7-1c64d2addc00 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:03.391710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89da09f8-d97d-455c-85f7-1c64d2addc00 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:03.392663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89da09f8-d97d-455c-85f7-1c64d2addc00 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:03.393099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89da09f8-d97d-455c-85f7-1c64d2addc00 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:03.393860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89da09f8-d97d-455c-85f7-1c64d2addc00 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:03.394484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89da09f8-d97d-455c-85f7-1c64d2addc00 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:03.395066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89da09f8-d97d-455c-85f7-1c64d2addc00 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:03.400153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:03.625587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-89da09f8-d97d-455c-85f7-1c64d2addc00 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:03.635369 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89da09f8-d97d-455c-85f7-1c64d2addc00 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1493 microversion: 2.1 time: 0.255741 Oct 29 03:03:03.635984 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2033/4033] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:03 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1493 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:03.743193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:03.744149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:03.755895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:03.761254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:03.761657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:03.762791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:03.763427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:03.764083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:03.863801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:03:03.866047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:03:03.866725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:03:03.867147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:03:03.867562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:03:03.917794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:03.918566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:03.919147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:03.920033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:03.920626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:03.921295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:03.948448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Getting quotas for project d573dd77f3b24ee4b650ca45e657e307. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:03:03.961840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Getting quotas for user cab4906c7a3748b4b0a1df38423d82a9 and project d573dd77f3b24ee4b650ca45e657e307. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:03:03.980427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:03:03.982735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:03:04.051101 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-07660ddd-3fbf-4801-8385-7be3630e3b99 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.081925 Oct 29 03:03:04.059584 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2001/4034] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:03:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:03:04.080556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:04.081785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:04.093267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.094568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.095368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:04.097177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.099305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.100050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:04.127984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:04.139538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:04.141439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:04.143677 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-299a525a-acf5-4641-8189-12265460803d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.407642 Oct 29 03:03:04.144734 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2034/4035] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:03 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:04.151456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-92489893", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "eb0e8550-6333-42ee-9b9f-13b60ac354f9"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:04.407348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:04.419856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:04.421544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:04.424427 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7b87648b-015e-4e7b-b790-183565f09410 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1546 microversion: 2.26 time: 0.362106 Oct 29 03:03:04.424427 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2002/4036] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:04 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1546 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:04.456077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8beedc0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:04.471350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.472897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.476192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:04.477128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:04.485463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.487023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.487467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:04.488398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.488856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.489340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:04.524328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.524845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.525745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:04.580208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.584179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.584944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:04.643375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:04.693053 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3367dbf9-ea15-44b7-979d-2b560f436c98 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-1445576537" status: 201 len: 0 microversion: 2.26 time: 0.241027 Oct 29 03:03:04.703655 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2003/4037] 10.222.0.16 () {62 vars in 1380 bytes} [Sat Oct 29 03:03:04 2022] PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-1445576537 => generated 0 bytes in 255 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 29 03:03:04.713889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-0fb4c4b4-a266-42de-8f3a-3084cb2a35ef req-e65e7f00-fd2a-42d4-ad9a-dcc6c584eae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e7e466-df5f-45f5-9e45-dc3c16e888b7", "name": "network-vif-plugged", "status": "completed", "tag": "4f85a0f7-faab-45b5-be06-7a79452c31af"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:04.731919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0fb4c4b4-a266-42de-8f3a-3084cb2a35ef req-e65e7f00-fd2a-42d4-ad9a-dcc6c584eae2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.732655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0fb4c4b4-a266-42de-8f3a-3084cb2a35ef req-e65e7f00-fd2a-42d4-ad9a-dcc6c584eae2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.733497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0fb4c4b4-a266-42de-8f3a-3084cb2a35ef req-e65e7f00-fd2a-42d4-ad9a-dcc6c584eae2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:04.752919 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-0fb4c4b4-a266-42de-8f3a-3084cb2a35ef req-e65e7f00-fd2a-42d4-ad9a-dcc6c584eae2 service nova] Creating event network-vif-plugged:4f85a0f7-faab-45b5-be06-7a79452c31af for instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 on n-h1-862964-4 Oct 29 03:03:04.759088 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-0fb4c4b4-a266-42de-8f3a-3084cb2a35ef req-e65e7f00-fd2a-42d4-ad9a-dcc6c584eae2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053737 Oct 29 03:03:04.760332 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2004/4038] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:04.768772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98b65201-cd54-42aa-9a3b-17c7fddc7f42 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:04.769646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-98b65201-cd54-42aa-9a3b-17c7fddc7f42 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:04.777906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98b65201-cd54-42aa-9a3b-17c7fddc7f42 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.778880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98b65201-cd54-42aa-9a3b-17c7fddc7f42 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.779538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98b65201-cd54-42aa-9a3b-17c7fddc7f42 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:04.781023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98b65201-cd54-42aa-9a3b-17c7fddc7f42 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.781670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98b65201-cd54-42aa-9a3b-17c7fddc7f42 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.782296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98b65201-cd54-42aa-9a3b-17c7fddc7f42 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.083401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-98b65201-cd54-42aa-9a3b-17c7fddc7f42 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:05.089121 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-98b65201-cd54-42aa-9a3b-17c7fddc7f42 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1499 microversion: 2.1 time: 0.327219 Oct 29 03:03:05.089993 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2005/4039] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:04 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1499 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:05.111736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83f91991-1579-464d-b201-87676e3ee9c8 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a918fb80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:05.145614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83f91991-1579-464d-b201-87676e3ee9c8 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.146146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83f91991-1579-464d-b201-87676e3ee9c8 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.146586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83f91991-1579-464d-b201-87676e3ee9c8 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.162530 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-83f91991-1579-464d-b201-87676e3ee9c8 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-1445576537" status: 204 len: 0 microversion: 2.26 time: 0.070413 Oct 29 03:03:05.163525 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2006/4040] 10.222.0.16 () {60 vars in 1361 bytes} [Sat Oct 29 03:03:05 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-1445576537 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:03:05.177226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d89cf97a-cb00-4e0c-8909-b90cf9d65e0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:05.177970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d89cf97a-cb00-4e0c-8909-b90cf9d65e0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:05.186295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89cf97a-cb00-4e0c-8909-b90cf9d65e0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.186820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89cf97a-cb00-4e0c-8909-b90cf9d65e0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.187254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89cf97a-cb00-4e0c-8909-b90cf9d65e0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.188133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89cf97a-cb00-4e0c-8909-b90cf9d65e0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.189012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89cf97a-cb00-4e0c-8909-b90cf9d65e0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.189977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89cf97a-cb00-4e0c-8909-b90cf9d65e0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.227099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d89cf97a-cb00-4e0c-8909-b90cf9d65e0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:03:05.365716 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d89cf97a-cb00-4e0c-8909-b90cf9d65e0a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 204 len: 0 microversion: 2.1 time: 0.200450 Oct 29 03:03:05.370759 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2007/4041] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:03:05 2022] DELETE /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:03:05.380331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8473ca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:05.400756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.401453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.402099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.403079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:05.410030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.410930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.411653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.412782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.413541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.414250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.444412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.445195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.445980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.468774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:05.519134 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6359cb81-ca61-45cf-ba40-ac850c6344a1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags" status: 204 len: 0 microversion: 2.26 time: 0.146270 Oct 29 03:03:05.519982 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2008/4042] 10.222.0.16 () {60 vars in 1295 bytes} [Sat Oct 29 03:03:05 2022] DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:03:05.532918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:05.536165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:05.549176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.549914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.550513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.551368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.551958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.566937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.873278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:05.885205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:05.887566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:05.889476 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-53c08921-97e7-42b1-a41c-086f1e27b716 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.368543 Oct 29 03:03:05.906780 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2009/4043] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:05 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:05.913953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6a22d3e9-c64b-462f-bdfd-17ff9cb3ee59 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:05.914744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6a22d3e9-c64b-462f-bdfd-17ff9cb3ee59 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:05.922279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a22d3e9-c64b-462f-bdfd-17ff9cb3ee59 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.922975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a22d3e9-c64b-462f-bdfd-17ff9cb3ee59 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.923794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a22d3e9-c64b-462f-bdfd-17ff9cb3ee59 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.924655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a22d3e9-c64b-462f-bdfd-17ff9cb3ee59 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.925251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a22d3e9-c64b-462f-bdfd-17ff9cb3ee59 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.925882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a22d3e9-c64b-462f-bdfd-17ff9cb3ee59 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.961521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:06.205294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6a22d3e9-c64b-462f-bdfd-17ff9cb3ee59 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:06.217863 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6a22d3e9-c64b-462f-bdfd-17ff9cb3ee59 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.309758 Oct 29 03:03:06.218954 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2010/4044] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:05 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:06.238881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ab70084-9c63-496c-8a40-827349d469ee tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8beea60>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:06.275574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ab70084-9c63-496c-8a40-827349d469ee tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.276030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ab70084-9c63-496c-8a40-827349d469ee tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.276506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ab70084-9c63-496c-8a40-827349d469ee tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.306774 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8ab70084-9c63-496c-8a40-827349d469ee tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags" status: 200 len: 12 microversion: 2.26 time: 0.086452 Oct 29 03:03:06.309247 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2011/4045] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Oct 29 03:03:06 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags => generated 12 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:06.329949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a873e9d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:06.359265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.359265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.378414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.380684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:06.416358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.418681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.419208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.426602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.427108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.427556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.533428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.534195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.534776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.560904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.560904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.560904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.611578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:06.640219 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-28109b65-c9da-462f-9084-766f6fa82bcd tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-479599476" status: 201 len: 0 microversion: 2.26 time: 0.323102 Oct 29 03:03:06.642986 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2012/4046] 10.222.0.16 () {62 vars in 1377 bytes} [Sat Oct 29 03:03:06 2022] PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-479599476 => generated 0 bytes in 327 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 29 03:03:06.653773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f3b045b-1e1d-41e1-a275-8e6e87cb3078 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8c22040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:06.677313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f3b045b-1e1d-41e1-a275-8e6e87cb3078 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.677828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f3b045b-1e1d-41e1-a275-8e6e87cb3078 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.678257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f3b045b-1e1d-41e1-a275-8e6e87cb3078 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.702769 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1f3b045b-1e1d-41e1-a275-8e6e87cb3078 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags" status: 200 len: 35 microversion: 2.26 time: 0.054618 Oct 29 03:03:06.703754 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2013/4047] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Oct 29 03:03:06 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags => generated 35 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:06.714003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8730550>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:06.729083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.732007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.732617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.733245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:06.742742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.743781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.744362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.745213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.745822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.746849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.774249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.774896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.775468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.809366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:06.828759 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-56c51fd5-9bbc-423d-ab75-d14d75e50ae5 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-479599476" status: 204 len: 0 microversion: 2.26 time: 0.117952 Oct 29 03:03:06.833132 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2014/4048] 10.222.0.16 () {60 vars in 1361 bytes} [Sat Oct 29 03:03:06 2022] DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-479599476 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 03:03:06.841535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-c8388a46-5086-4681-815b-bd70b5baf6b3 req-7696dd58-76c8-4b7d-a3d3-c4503b417009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-plugged", "status": "completed", "tag": "1a6f0f9a-363c-4cc7-bac2-3ec7fe2158ed"}, {"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-plugged", "status": "completed", "tag": "5b15b418-d44c-4472-af06-882104b0a0b6"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:06.854876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c8388a46-5086-4681-815b-bd70b5baf6b3 req-7696dd58-76c8-4b7d-a3d3-c4503b417009 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.855610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c8388a46-5086-4681-815b-bd70b5baf6b3 req-7696dd58-76c8-4b7d-a3d3-c4503b417009 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.856176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c8388a46-5086-4681-815b-bd70b5baf6b3 req-7696dd58-76c8-4b7d-a3d3-c4503b417009 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.870488 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c8388a46-5086-4681-815b-bd70b5baf6b3 req-7696dd58-76c8-4b7d-a3d3-c4503b417009 service nova] Creating event network-vif-plugged:1a6f0f9a-363c-4cc7-bac2-3ec7fe2158ed for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:03:06.871251 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c8388a46-5086-4681-815b-bd70b5baf6b3 req-7696dd58-76c8-4b7d-a3d3-c4503b417009 service nova] Creating event network-vif-plugged:5b15b418-d44c-4472-af06-882104b0a0b6 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:03:06.877883 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-c8388a46-5086-4681-815b-bd70b5baf6b3 req-7696dd58-76c8-4b7d-a3d3-c4503b417009 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042646 Oct 29 03:03:06.879201 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2015/4049] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:06.886203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-99f8ab20-1620-4f16-bfda-838719e0a3b1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8944e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:06.897979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99f8ab20-1620-4f16-bfda-838719e0a3b1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.898476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99f8ab20-1620-4f16-bfda-838719e0a3b1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.899050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99f8ab20-1620-4f16-bfda-838719e0a3b1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.917416 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-99f8ab20-1620-4f16-bfda-838719e0a3b1 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags" status: 200 len: 12 microversion: 2.26 time: 0.036742 Oct 29 03:03:06.918660 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2016/4050] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Oct 29 03:03:06 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags => generated 12 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:06.924769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:06.925870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:06.938217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.939030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.939799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.940751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.941335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.941908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.389466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:07.404333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:07.405896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:07.407128 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a668860f-6710-41a8-8b82-7cf58d2d247f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.487251 Oct 29 03:03:07.410287 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2017/4051] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:06 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:07.416650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8c078b0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:07.433009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.433500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.436230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.436729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:07.443258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.444027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.444463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.445175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.445627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.446085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.479308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.479621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.480041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.497507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:07.545659 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d47fe1bb-6157-4a6d-9f13-490d52a383d6 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags" status: 204 len: 0 microversion: 2.26 time: 0.133406 Oct 29 03:03:07.550732 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2018/4052] 10.222.0.16 () {60 vars in 1295 bytes} [Sat Oct 29 03:03:07 2022] DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:03:07.561041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-81553296-9fd9-4690-b96e-d6361324d3f0 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:07.568750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-81553296-9fd9-4690-b96e-d6361324d3f0 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:07.597894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81553296-9fd9-4690-b96e-d6361324d3f0 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.597894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81553296-9fd9-4690-b96e-d6361324d3f0 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.597894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81553296-9fd9-4690-b96e-d6361324d3f0 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.597894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81553296-9fd9-4690-b96e-d6361324d3f0 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.597894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81553296-9fd9-4690-b96e-d6361324d3f0 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.597894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81553296-9fd9-4690-b96e-d6361324d3f0 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.844797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-81553296-9fd9-4690-b96e-d6361324d3f0 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:07.859676 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-81553296-9fd9-4690-b96e-d6361324d3f0 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.311855 Oct 29 03:03:07.865892 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2019/4053] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:07 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:07.879539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8c07b80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:07.923808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.924482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.925016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.925625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:07.938521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.941184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.942930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.945076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.947646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.948286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.018743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.019558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.020111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.021892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] validate_networks() for [('eb0e8550-6333-42ee-9b9f-13b60ac354f9', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:03:08.030940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.031669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.032356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.068661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:08.149590 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1656dc84-20d0-47a8-ac21-cbcabbd7f68d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-1630485930" status: 201 len: 0 microversion: 2.26 time: 0.282255 Oct 29 03:03:08.151848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2020/4054] 10.222.0.16 () {62 vars in 1380 bytes} [Sat Oct 29 03:03:07 2022] PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-1630485930 => generated 0 bytes in 285 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 29 03:03:08.168340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8a30700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:08.188520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.190599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.191278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.192311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:08.219280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.220358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.227542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.230342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.231906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.233499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.281183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.282818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.283273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.296957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.297621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.298058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.339551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:08.369840 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-735e6bea-cd19-4c1b-b6f0-a34ae779eed4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-180514617" status: 201 len: 0 microversion: 2.26 time: 0.210239 Oct 29 03:03:08.371205 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2021/4055] 10.222.0.16 () {62 vars in 1377 bytes} [Sat Oct 29 03:03:08 2022] PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-180514617 => generated 0 bytes in 214 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 29 03:03:08.386542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8beea60>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:08.404485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.405120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.405389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.416573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:08.423471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.423878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.424308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.425017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.433792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.434274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.464163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:08.467344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.467972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.468618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.491390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:08.541936 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7c81487-0254-4531-b65c-567fac911937 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags" status: 204 len: 0 microversion: 2.26 time: 0.161464 Oct 29 03:03:08.543423 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2022/4056] 10.222.0.16 () {60 vars in 1295 bytes} [Sat Oct 29 03:03:08 2022] DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:03:08.552694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:08.558554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:08.572744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.573229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.573663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.580051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.582166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.584707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.006520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:09.019779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:09.021864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:09.023181 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-001abb04-96d9-4601-aeb1-d974f568e243 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.478806 Oct 29 03:03:09.023841 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2023/4057] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:08 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:09.049646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3c0d3f1-b481-44ee-a241-8b520d21fbff tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8bee1f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:09.060539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3c0d3f1-b481-44ee-a241-8b520d21fbff tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.061131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3c0d3f1-b481-44ee-a241-8b520d21fbff tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.062111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3c0d3f1-b481-44ee-a241-8b520d21fbff tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.072927 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3c0d3f1-b481-44ee-a241-8b520d21fbff tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags" status: 200 len: 12 microversion: 2.26 time: 0.028074 Oct 29 03:03:09.078616 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2024/4058] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Oct 29 03:03:09 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:09.079798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1051c159-3112-45d9-a95f-dc7872f9d3c5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:09.080845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1051c159-3112-45d9-a95f-dc7872f9d3c5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:09.088305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1051c159-3112-45d9-a95f-dc7872f9d3c5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.088895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1051c159-3112-45d9-a95f-dc7872f9d3c5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.089405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1051c159-3112-45d9-a95f-dc7872f9d3c5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.090267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1051c159-3112-45d9-a95f-dc7872f9d3c5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.090802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1051c159-3112-45d9-a95f-dc7872f9d3c5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.091313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1051c159-3112-45d9-a95f-dc7872f9d3c5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.310346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1051c159-3112-45d9-a95f-dc7872f9d3c5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:09.320101 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1051c159-3112-45d9-a95f-dc7872f9d3c5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1505 microversion: 2.1 time: 0.244208 Oct 29 03:03:09.320695 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2025/4059] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:09 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:09.334584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-6d18c55e-d897-471e-8cfb-7fbcc3d04853 req-bb9eefa0-721c-48a6-9f4a-0b2dc220a327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-plugged", "status": "completed", "tag": "ad65712e-7434-443f-9bb6-d42e2e4152d0"}, {"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-plugged", "status": "completed", "tag": "bdbee0eb-ffe5-46aa-bf13-64202754d2b4"}, {"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-plugged", "status": "completed", "tag": "2925f2d5-baca-47fa-9f36-1c4849e3e7e4"}, {"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-plugged", "status": "completed", "tag": "278acd07-af3d-45fa-b282-64d5acdc531b"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:09.348423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6d18c55e-d897-471e-8cfb-7fbcc3d04853 req-bb9eefa0-721c-48a6-9f4a-0b2dc220a327 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.348896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6d18c55e-d897-471e-8cfb-7fbcc3d04853 req-bb9eefa0-721c-48a6-9f4a-0b2dc220a327 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.349324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6d18c55e-d897-471e-8cfb-7fbcc3d04853 req-bb9eefa0-721c-48a6-9f4a-0b2dc220a327 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.365294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-6d18c55e-d897-471e-8cfb-7fbcc3d04853 req-bb9eefa0-721c-48a6-9f4a-0b2dc220a327 service nova] Creating event network-vif-plugged:ad65712e-7434-443f-9bb6-d42e2e4152d0 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:03:09.366095 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-6d18c55e-d897-471e-8cfb-7fbcc3d04853 req-bb9eefa0-721c-48a6-9f4a-0b2dc220a327 service nova] Creating event network-vif-plugged:bdbee0eb-ffe5-46aa-bf13-64202754d2b4 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:03:09.366374 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-6d18c55e-d897-471e-8cfb-7fbcc3d04853 req-bb9eefa0-721c-48a6-9f4a-0b2dc220a327 service nova] Creating event network-vif-plugged:2925f2d5-baca-47fa-9f36-1c4849e3e7e4 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:03:09.366873 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-6d18c55e-d897-471e-8cfb-7fbcc3d04853 req-bb9eefa0-721c-48a6-9f4a-0b2dc220a327 service nova] Creating event network-vif-plugged:278acd07-af3d-45fa-b282-64d5acdc531b for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:03:09.374159 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-6d18c55e-d897-471e-8cfb-7fbcc3d04853 req-bb9eefa0-721c-48a6-9f4a-0b2dc220a327 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.044632 Oct 29 03:03:09.375170 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2026/4060] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:09.382026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8a30280>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:09.384728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:09.395185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.395675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.396239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.396931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:09.405777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.406406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.406763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.407835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.408381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.409085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.435934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.436398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.437048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.450767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:09.468895 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-779a09b0-ce22-49ff-8e55-6aaffb2f847e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags" status: 204 len: 0 microversion: 2.26 time: 0.092512 Oct 29 03:03:09.472734 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2027/4061] 10.222.0.16 () {60 vars in 1295 bytes} [Sat Oct 29 03:03:09 2022] DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:03:09.483189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8529a60>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:09.495313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.496071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.496696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.497356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:09.514127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.515055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.515662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.516551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.517303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.517933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.549988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.550670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.551289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.561749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.563062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.563840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.594598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:09.613151 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-758be523-e988-47f1-bc79-107b2bcde7d0 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-1269016616" status: 201 len: 0 microversion: 2.26 time: 0.134126 Oct 29 03:03:09.614370 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2028/4062] 10.222.0.16 () {62 vars in 1380 bytes} [Sat Oct 29 03:03:09 2022] PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-1269016616 => generated 0 bytes in 136 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 29 03:03:09.624209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a8c1dee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:09.638251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.638251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.638251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.639587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:09.650730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.651136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.651676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.652483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.656946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.658619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.735440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.740155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.740747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.758936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.762515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.765926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.819141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:09.855041 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-89d0e078-c2a2-454a-b026-b9bbecb96b54 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-157612998" status: 201 len: 0 microversion: 2.26 time: 0.234962 Oct 29 03:03:09.856230 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2029/4063] 10.222.0.16 () {62 vars in 1377 bytes} [Sat Oct 29 03:03:09 2022] PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags/tempest-tag-157612998 => generated 0 bytes in 237 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 29 03:03:09.870032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Action: 'update_all', calling method: .version_select at 0x7fe1a84e6700>, body: {"tags": ["tempest-tag-414552009", "tempest-tag-290161819"]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:09.880712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.881482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.882046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.882618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:09.891885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.892620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.893148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.894135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.894811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.895344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.934371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.934806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.942880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.976836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:09.978538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:03:09.979072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:03:09.979600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:03:09.980005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:03:09.980527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:03:10.008312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.010261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.012401 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a099c806-a461-4867-9418-db51bdd00b4b tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags" status: 200 len: 60 microversion: 2.26 time: 0.150564 Oct 29 03:03:10.012819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.014369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.014839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.015262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.015602 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2030/4064] 10.222.0.16 () {62 vars in 1312 bytes} [Sat Oct 29 03:03:09 2022] PUT /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags => generated 60 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:10.028139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-57beed18-c710-46c1-8460-0c9b398e4b70 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1a84e6820>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:10.042250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57beed18-c710-46c1-8460-0c9b398e4b70 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.047825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57beed18-c710-46c1-8460-0c9b398e4b70 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.050202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Getting quotas for project d573dd77f3b24ee4b650ca45e657e307. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:03:10.050482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57beed18-c710-46c1-8460-0c9b398e4b70 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.071512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Getting quotas for user cab4906c7a3748b4b0a1df38423d82a9 and project d573dd77f3b24ee4b650ca45e657e307. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:03:10.076147 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-57beed18-c710-46c1-8460-0c9b398e4b70 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags" status: 200 len: 60 microversion: 2.26 time: 0.053665 Oct 29 03:03:10.076788 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2031/4065] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Oct 29 03:03:10 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags => generated 60 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:10.089749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:10.090523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:10.099408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:03:10.104086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.104445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 51e97f20-bb71-4576-b4a3-6673ade724a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:03:10.106056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.107325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.113105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.113741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.114316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.272492 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bfa94b9e-3f22-4a01-bbe7-60f3e29e9a40 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.124427 Oct 29 03:03:10.273322 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2035/4066] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:03:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 6128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:03:10.293347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '.version_select at 0x7fe1acc27ca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:10.311838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.313115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.313502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.317636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:10.340339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.341596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.342069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.344509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.345325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.345759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.418448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.419059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.422967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.447761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'flavor' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:10.471912 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2f305a6e-687a-4152-b5c3-afc74955ac1a tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags" status: 204 len: 0 microversion: 2.26 time: 0.183558 Oct 29 03:03:10.472982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2036/4067] 10.222.0.16 () {60 vars in 1295 bytes} [Sat Oct 29 03:03:10 2022] DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b/tags => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:03:10.480407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d43f458e-cd87-4f86-a5b3-13ab03add8b8 req-b623b57e-7e51-413c-94fd-dc0a8965bd01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b441cf-f5a0-4f54-90f4-915a2ece9984", "tag": "09f30aad-17f6-4891-b116-438911dbd738"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:10.486784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:10.501757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:10.507397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:10.509487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d43f458e-cd87-4f86-a5b3-13ab03add8b8 req-b623b57e-7e51-413c-94fd-dc0a8965bd01 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.510680 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c449cf09-1703-4871-b5e5-21f6afb8fa16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.432837 Oct 29 03:03:10.511351 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2032/4068] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:10 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:10.512032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d43f458e-cd87-4f86-a5b3-13ab03add8b8 req-b623b57e-7e51-413c-94fd-dc0a8965bd01 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.513628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d43f458e-cd87-4f86-a5b3-13ab03add8b8 req-b623b57e-7e51-413c-94fd-dc0a8965bd01 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.522482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-046f6976-5bfb-4045-a15e-f7244b4ee3f5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:10.523305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-046f6976-5bfb-4045-a15e-f7244b4ee3f5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:10.540955 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d43f458e-cd87-4f86-a5b3-13ab03add8b8 req-b623b57e-7e51-413c-94fd-dc0a8965bd01 service nova] Creating event network-changed:09f30aad-17f6-4891-b116-438911dbd738 for instance 77b441cf-f5a0-4f54-90f4-915a2ece9984 on n-h2-862964-4 Oct 29 03:03:10.544366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-046f6976-5bfb-4045-a15e-f7244b4ee3f5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.544366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-046f6976-5bfb-4045-a15e-f7244b4ee3f5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.544366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-046f6976-5bfb-4045-a15e-f7244b4ee3f5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.549217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-046f6976-5bfb-4045-a15e-f7244b4ee3f5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.549784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-046f6976-5bfb-4045-a15e-f7244b4ee3f5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.550439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-046f6976-5bfb-4045-a15e-f7244b4ee3f5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.552033 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d43f458e-cd87-4f86-a5b3-13ab03add8b8 req-b623b57e-7e51-413c-94fd-dc0a8965bd01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077597 Oct 29 03:03:10.553620 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2037/4069] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:10.570729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1764745515", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "451", "networks": [{"uuid": "eb0e8550-6333-42ee-9b9f-13b60ac354f9"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:10.688301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] validate_networks() for [('eb0e8550-6333-42ee-9b9f-13b60ac354f9', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:03:10.696170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-046f6976-5bfb-4045-a15e-f7244b4ee3f5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:10.708620 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-046f6976-5bfb-4045-a15e-f7244b4ee3f5 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1463 microversion: 2.1 time: 0.195511 Oct 29 03:03:10.709230 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2033/4070] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:10 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1463 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:10.727248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d5a5a74e-a7c1-45f1-9c66-dccb74d94a00 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:10.728191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d5a5a74e-a7c1-45f1-9c66-dccb74d94a00 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:10.734825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a5a74e-a7c1-45f1-9c66-dccb74d94a00 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.735586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a5a74e-a7c1-45f1-9c66-dccb74d94a00 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.744495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a5a74e-a7c1-45f1-9c66-dccb74d94a00 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.745492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a5a74e-a7c1-45f1-9c66-dccb74d94a00 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.746139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a5a74e-a7c1-45f1-9c66-dccb74d94a00 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.746704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a5a74e-a7c1-45f1-9c66-dccb74d94a00 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.804491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d5a5a74e-a7c1-45f1-9c66-dccb74d94a00 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:03:10.809252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:10.975187 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d5a5a74e-a7c1-45f1-9c66-dccb74d94a00 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 204 len: 0 microversion: 2.26 time: 0.264114 Oct 29 03:03:10.979317 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2034/4071] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:03:10 2022] DELETE /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:03:10.985293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:10.991017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:11.003074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.014670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.015401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.016303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.016904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.017538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.272706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:11.283588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:11.285993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:11.287723 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b8856b0b-6f0f-4286-b4d5-5f2d131a719e tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1552 microversion: 2.26 time: 0.306717 Oct 29 03:03:11.289438 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2035/4072] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:10 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1552 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:11.397704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-8351e16b-ed24-4ff8-aecf-b3e28863d5a3 req-e3000d8b-9dbe-46ef-ba60-4720a8f755a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-plugged", "status": "completed", "tag": "8dab038a-c463-4da0-a1b0-270182ca43e7"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:11.415685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8351e16b-ed24-4ff8-aecf-b3e28863d5a3 req-e3000d8b-9dbe-46ef-ba60-4720a8f755a6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.416207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8351e16b-ed24-4ff8-aecf-b3e28863d5a3 req-e3000d8b-9dbe-46ef-ba60-4720a8f755a6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.416632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8351e16b-ed24-4ff8-aecf-b3e28863d5a3 req-e3000d8b-9dbe-46ef-ba60-4720a8f755a6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.458975 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-8351e16b-ed24-4ff8-aecf-b3e28863d5a3 req-e3000d8b-9dbe-46ef-ba60-4720a8f755a6 service nova] Creating event network-vif-plugged:8dab038a-c463-4da0-a1b0-270182ca43e7 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:03:11.473306 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-8351e16b-ed24-4ff8-aecf-b3e28863d5a3 req-e3000d8b-9dbe-46ef-ba60-4720a8f755a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080890 Oct 29 03:03:11.481627 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2036/4073] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:03:11.551246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:11.553033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:11.585645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.586349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.586859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.591400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.592001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.592608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.647883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:03:11.649649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:03:11.650315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:03:11.650888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:03:11.651572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:03:11.664839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.665585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.666386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.667298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.667767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.668182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.691671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Getting quotas for project d573dd77f3b24ee4b650ca45e657e307. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:03:11.698329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Getting quotas for user cab4906c7a3748b4b0a1df38423d82a9 and project d573dd77f3b24ee4b650ca45e657e307. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:03:11.712597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:03:11.716043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:03:11.794341 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce311fb7-6805-47f9-8b69-8a86f1e20632 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239165 Oct 29 03:03:11.795159 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2038/4074] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:03:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:03:11.800793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:11.801596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:11.811509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.811999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.812575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.814422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.815121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.815562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.856947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.857442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.858007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.858943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lazy-loading 'fault' on Instance uuid 1ca75b7e-d4ac-4231-915f-4f4901ad6758 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:11.905326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:11.916073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:11.928239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:11.929861 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6ca9347-78f8-4c8e-9dd8-10d67c77f168 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.390277 Oct 29 03:03:11.945827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:11.946453 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2037/4075] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:11 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:03:11.954223 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cfc01173-340f-4b8e-bbdd-6bc8115f5d89 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1304 microversion: 2.1 time: 0.157672 Oct 29 03:03:11.955990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ee643d7-4131-4b88-aa66-fc32b61d8f77 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:11.956801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ee643d7-4131-4b88-aa66-fc32b61d8f77 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:11.969840 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2039/4076] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:11 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:12.048481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ee643d7-4131-4b88-aa66-fc32b61d8f77 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:12.056313 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ee643d7-4131-4b88-aa66-fc32b61d8f77 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1221 microversion: 2.1 time: 0.108554 Oct 29 03:03:12.059045 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2038/4077] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:11 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:12.317843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:12.318703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:12.335116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:12.335938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:12.336740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:12.337867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:12.338395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:12.339862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:12.599292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4bfe8c43-eb19-4762-bd27-282ad700ece3 req-ca73693a-673e-4b62-894c-9044bf550cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca75b7e-d4ac-4231-915f-4f4901ad6758", "name": "network-vif-deleted", "tag": "d7fdaa44-f26c-4b44-aa90-2d55bac35b0a"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:12.620307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4bfe8c43-eb19-4762-bd27-282ad700ece3 req-ca73693a-673e-4b62-894c-9044bf550cfc service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:12.620962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4bfe8c43-eb19-4762-bd27-282ad700ece3 req-ca73693a-673e-4b62-894c-9044bf550cfc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:12.621578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4bfe8c43-eb19-4762-bd27-282ad700ece3 req-ca73693a-673e-4b62-894c-9044bf550cfc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:12.637294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4bfe8c43-eb19-4762-bd27-282ad700ece3 req-ca73693a-673e-4b62-894c-9044bf550cfc service nova] Creating event network-vif-deleted:d7fdaa44-f26c-4b44-aa90-2d55bac35b0a for instance 1ca75b7e-d4ac-4231-915f-4f4901ad6758 on n-h1-862964-4 Oct 29 03:03:12.644322 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4bfe8c43-eb19-4762-bd27-282ad700ece3 req-ca73693a-673e-4b62-894c-9044bf550cfc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049837 Oct 29 03:03:12.645391 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2039/4078] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:03:12.696733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:12.711796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:12.716605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:12.719137 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e5e9b3b2-b741-40ba-921c-bf376cc053a7 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1552 microversion: 2.26 time: 0.405289 Oct 29 03:03:12.719737 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2040/4079] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:12 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1552 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:12.961362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:12.962300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:12.973491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:12.974355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:12.974998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:12.975917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:12.978156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:12.979834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:12.983444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:12.984066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:12.993571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:12.994087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:12.994521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:12.995225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:12.995675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:12.996094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.075682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.076630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.077428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.078480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lazy-loading 'fault' on Instance uuid 1ca75b7e-d4ac-4231-915f-4f4901ad6758 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:13.272824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:13.288262 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-025da49b-7aeb-4f17-a568-6b74b7c0e52f tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 200 len: 1304 microversion: 2.1 time: 0.308267 Oct 29 03:03:13.303613 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2041/4080] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:12 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 1304 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:13.312448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9f142c5c-6641-4f41-adce-17c437c8278f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:13.313678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9f142c5c-6641-4f41-adce-17c437c8278f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:13.325651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f142c5c-6641-4f41-adce-17c437c8278f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.329161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f142c5c-6641-4f41-adce-17c437c8278f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.329923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f142c5c-6641-4f41-adce-17c437c8278f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.334364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f142c5c-6641-4f41-adce-17c437c8278f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.338288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f142c5c-6641-4f41-adce-17c437c8278f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.339941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f142c5c-6641-4f41-adce-17c437c8278f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.419969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:13.434581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:13.436736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:13.438379 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fc4a10d5-e33c-4cd6-91ec-8dbaff9f774f tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.481689 Oct 29 03:03:13.450499 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2040/4081] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:12 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:13.533126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9f142c5c-6641-4f41-adce-17c437c8278f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:13.549486 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9f142c5c-6641-4f41-adce-17c437c8278f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1217 microversion: 2.1 time: 0.243242 Oct 29 03:03:13.557859 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2042/4082] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:13 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1217 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:13.748369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:13.748988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:13.759565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.760061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.760497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.761209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.761665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.762126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.857208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:13.868295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:13.870873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:13.872261 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a2700979-cdaf-469a-aabb-e54fd34896b3 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1510 microversion: 2.26 time: 0.128164 Oct 29 03:03:13.873292 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2041/4083] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:13 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1510 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:14.323958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:14.324638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 1ca75b7e-d4ac-4231-915f-4f4901ad6758] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:14.338691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.339541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.340192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.341120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.341770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.342415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.366691 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] HTTP exception thrown: Instance 1ca75b7e-d4ac-4231-915f-4f4901ad6758 could not be found. Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Request method failure captured: Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 HTTP/1.1 Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJds4vIm5IVp5gafj7jzShB3a1hBPuMwNkK_5i7YnVJdPCKiUKU398o2CE8XJ5m2fqPDH4yXvFR1NgL5oiHcoxQSlFb5Dl6sePfg91qntsVcYlLzR1vkhOsuDaQEdirBKI2gfO3tWi0ilMUjAfY4MKj8XpjXlY472OasFlfPhSH4Wtc Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 189356634b6049a3a44bb701d8529d13 Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerRescueTestJSON-838206160 Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/189356634b6049a3a44bb701d8529d13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189356634b6049a3a44bb701d8529d13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_189356634b6049a3a44bb701d8529d13", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189356634b6049a3a44bb701d8529d13"}]}] Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerRescueTestJSON-838206160 Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 189356634b6049a3a44bb701d8529d13 Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerRescueTestJSON-838206160 Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerRescueTestJSON-838206160-project Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 541c48e9a20d4b04a33018145c1fce9f Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerRescueTestJSON-838206160-project Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 1ca75b7e-d4ac-4231-915f-4f4901ad6758 could not be found. Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1ca75b7e-d4ac-4231-915f-4f4901ad6758'} Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ca75b7e-d4ac-4231-915f-4f4901ad6758 could not be found. Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca75b7e-d4ac-4231-915f-4f4901ad6758 could not be found. Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:14.368942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:03:14.372195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:14.372195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:14.372195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:14.372195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:03:14.372195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:03:14.372195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca75b7e-d4ac-4231-915f-4f4901ad6758 could not be found. Oct 29 03:03:14.372195 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:03:14.392943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Returning 404 to user: Instance 1ca75b7e-d4ac-4231-915f-4f4901ad6758 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:03:14.395361 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c5581bef-f826-46b1-9d55-731b6793d9dd tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758" status: 404 len: 111 microversion: 2.1 time: 0.076936 Oct 29 03:03:14.396481 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2043/4084] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:14 2022] GET /compute/v2.1/servers/1ca75b7e-d4ac-4231-915f-4f4901ad6758 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:03:14.404548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a17f456a-3b3e-4181-804d-b3dd33dd4ef9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:14.405029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a17f456a-3b3e-4181-804d-b3dd33dd4ef9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:14.407093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:14.418880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a17f456a-3b3e-4181-804d-b3dd33dd4ef9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.419413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a17f456a-3b3e-4181-804d-b3dd33dd4ef9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.419850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a17f456a-3b3e-4181-804d-b3dd33dd4ef9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.420567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a17f456a-3b3e-4181-804d-b3dd33dd4ef9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.421020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a17f456a-3b3e-4181-804d-b3dd33dd4ef9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.421443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a17f456a-3b3e-4181-804d-b3dd33dd4ef9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.462807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a17f456a-3b3e-4181-804d-b3dd33dd4ef9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:03:14.478327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:14.478965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:14.495851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.496360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.496771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.497477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.497953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.498372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.674574 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a17f456a-3b3e-4181-804d-b3dd33dd4ef9 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 204 len: 0 microversion: 2.1 time: 0.273512 Oct 29 03:03:14.678594 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2042/4085] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:03:14 2022] DELETE /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:03:14.684151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-226837e3-eeee-4aa0-988e-4cba304f9c8a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:14.685137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-226837e3-eeee-4aa0-988e-4cba304f9c8a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:14.693867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-226837e3-eeee-4aa0-988e-4cba304f9c8a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.694736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-226837e3-eeee-4aa0-988e-4cba304f9c8a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.695370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-226837e3-eeee-4aa0-988e-4cba304f9c8a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.696287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-226837e3-eeee-4aa0-988e-4cba304f9c8a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.696937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-226837e3-eeee-4aa0-988e-4cba304f9c8a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.697557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-226837e3-eeee-4aa0-988e-4cba304f9c8a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.768023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-226837e3-eeee-4aa0-988e-4cba304f9c8a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:14.777611 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-226837e3-eeee-4aa0-988e-4cba304f9c8a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1273 microversion: 2.1 time: 0.097504 Oct 29 03:03:14.779557 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2043/4086] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:14 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:14.785376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-23a10ce8-a174-477f-9dda-a837a3d62e61 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:14.786360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-23a10ce8-a174-477f-9dda-a837a3d62e61 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:14.792728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23a10ce8-a174-477f-9dda-a837a3d62e61 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.793481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23a10ce8-a174-477f-9dda-a837a3d62e61 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.794155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23a10ce8-a174-477f-9dda-a837a3d62e61 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.795208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23a10ce8-a174-477f-9dda-a837a3d62e61 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.795894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23a10ce8-a174-477f-9dda-a837a3d62e61 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.797092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23a10ce8-a174-477f-9dda-a837a3d62e61 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.959349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-23a10ce8-a174-477f-9dda-a837a3d62e61 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:14.967996 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-23a10ce8-a174-477f-9dda-a837a3d62e61 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1492 microversion: 2.1 time: 0.187179 Oct 29 03:03:14.969822 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2044/4087] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:14 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1492 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:14.998233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-687d5547-c72c-448f-932f-af78ce7d9082 req-bd9f78f9-ee7b-49f6-a920-8ed844e37a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b", "name": "network-vif-deleted", "tag": "915c48df-5be6-4e32-9ea8-b28cd2075729"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:15.022912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-687d5547-c72c-448f-932f-af78ce7d9082 req-bd9f78f9-ee7b-49f6-a920-8ed844e37a6e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:15.023423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-687d5547-c72c-448f-932f-af78ce7d9082 req-bd9f78f9-ee7b-49f6-a920-8ed844e37a6e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:15.023920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-687d5547-c72c-448f-932f-af78ce7d9082 req-bd9f78f9-ee7b-49f6-a920-8ed844e37a6e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:15.037294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-687d5547-c72c-448f-932f-af78ce7d9082 req-bd9f78f9-ee7b-49f6-a920-8ed844e37a6e service nova] Creating event network-vif-deleted:915c48df-5be6-4e32-9ea8-b28cd2075729 for instance ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b on n-h1-862964-4 Oct 29 03:03:15.042787 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-687d5547-c72c-448f-932f-af78ce7d9082 req-bd9f78f9-ee7b-49f6-a920-8ed844e37a6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055844 Oct 29 03:03:15.043867 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2045/4088] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:15.049497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:15.050337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:15.057548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:15.058192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:15.058707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:15.059521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:15.060184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:15.060687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:15.111727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:15.112321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:15.112864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:15.113418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'fault' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:15.167336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:15.177354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:15.179300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:15.180994 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-babf8520-c648-41ec-b028-1ec45aaf01da tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1352 microversion: 2.26 time: 0.135912 Oct 29 03:03:15.182126 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2046/4089] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:15 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:15.350489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:15.372203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:15.377954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:15.378702 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6cf8c2da-11a2-4e3f-a861-2321a5e27c4b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1875 microversion: 2.42 time: 0.912472 Oct 29 03:03:15.379540 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2044/4090] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:14 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1875 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:03:15.805903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2f2a4ae2-97ec-4a6d-8720-cd09eb006738 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:15.805903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2f2a4ae2-97ec-4a6d-8720-cd09eb006738 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:15.813556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f2a4ae2-97ec-4a6d-8720-cd09eb006738 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:15.814430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f2a4ae2-97ec-4a6d-8720-cd09eb006738 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:15.815002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f2a4ae2-97ec-4a6d-8720-cd09eb006738 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:15.816061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f2a4ae2-97ec-4a6d-8720-cd09eb006738 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:15.816171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f2a4ae2-97ec-4a6d-8720-cd09eb006738 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:15.816595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f2a4ae2-97ec-4a6d-8720-cd09eb006738 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:15.923410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f2a4ae2-97ec-4a6d-8720-cd09eb006738 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:15.939077 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2f2a4ae2-97ec-4a6d-8720-cd09eb006738 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1281 microversion: 2.1 time: 0.138098 Oct 29 03:03:15.955338 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2047/4091] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:15 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1281 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:16.010204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3da1b3ab-670c-4052-910f-96aa55a51e1a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:16.012798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3da1b3ab-670c-4052-910f-96aa55a51e1a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:16.024709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da1b3ab-670c-4052-910f-96aa55a51e1a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:16.025209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da1b3ab-670c-4052-910f-96aa55a51e1a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:16.026148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da1b3ab-670c-4052-910f-96aa55a51e1a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:16.027040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da1b3ab-670c-4052-910f-96aa55a51e1a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:16.027703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da1b3ab-670c-4052-910f-96aa55a51e1a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:16.028523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3da1b3ab-670c-4052-910f-96aa55a51e1a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:16.213730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:16.214912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:16.229528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:16.230445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:16.231982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:16.232996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:16.235429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:16.238029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:16.328904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:16.329317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:16.344312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:16.345138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lazy-loading 'fault' on Instance uuid ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:16.435476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3da1b3ab-670c-4052-910f-96aa55a51e1a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:16.461407 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3da1b3ab-670c-4052-910f-96aa55a51e1a tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1492 microversion: 2.1 time: 0.459902 Oct 29 03:03:16.462946 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2045/4092] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:15 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1492 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:16.481085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:16.483834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:16.492155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:16.503183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:16.507918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:16.514943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:16.517783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:16.521848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:16.522937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:16.523823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:16.546346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38fa0f91e15c40678663e11e150016a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba7db05cea44f799b8dc23ed0203668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:16.552764 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-41026cb2-4fd5-4a65-839e-c15e52c133f4 tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 200 len: 1352 microversion: 2.26 time: 0.343859 Oct 29 03:03:16.559827 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2048/4093] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:16 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 1352 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:16.980641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b31b440-0197-4c0d-9f14-060f085add63 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:16.981323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0b31b440-0197-4c0d-9f14-060f085add63 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:17.006491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b31b440-0197-4c0d-9f14-060f085add63 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.006981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b31b440-0197-4c0d-9f14-060f085add63 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.007621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b31b440-0197-4c0d-9f14-060f085add63 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.008484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b31b440-0197-4c0d-9f14-060f085add63 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.009088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b31b440-0197-4c0d-9f14-060f085add63 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.009655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b31b440-0197-4c0d-9f14-060f085add63 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.086573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:17.109388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b31b440-0197-4c0d-9f14-060f085add63 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:17.120339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:17.121840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:17.130249 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b31b440-0197-4c0d-9f14-060f085add63 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1281 microversion: 2.1 time: 0.155313 Oct 29 03:03:17.216780 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8cab858e-f367-4df4-b6c9-e082d24f0237 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2831 microversion: 2.42 time: 0.666740 Oct 29 03:03:17.216780 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2046/4095] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:16 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2831 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:17.217093 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2049/4095] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:16 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:17.247695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f6a9abf2-5646-4c2c-90d8-513ffc14ef15 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:17.248616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f6a9abf2-5646-4c2c-90d8-513ffc14ef15 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:17.256816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6a9abf2-5646-4c2c-90d8-513ffc14ef15 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.257331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6a9abf2-5646-4c2c-90d8-513ffc14ef15 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.257759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6a9abf2-5646-4c2c-90d8-513ffc14ef15 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.258481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6a9abf2-5646-4c2c-90d8-513ffc14ef15 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.258926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6a9abf2-5646-4c2c-90d8-513ffc14ef15 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.259343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6a9abf2-5646-4c2c-90d8-513ffc14ef15 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.491737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f5e9402-8497-4636-af8b-c73ee2f55d78 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:17.492670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0f5e9402-8497-4636-af8b-c73ee2f55d78 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:17.506142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f5e9402-8497-4636-af8b-c73ee2f55d78 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.506773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f5e9402-8497-4636-af8b-c73ee2f55d78 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.508681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f5e9402-8497-4636-af8b-c73ee2f55d78 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.509930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f5e9402-8497-4636-af8b-c73ee2f55d78 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.513958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f5e9402-8497-4636-af8b-c73ee2f55d78 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.513958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f5e9402-8497-4636-af8b-c73ee2f55d78 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.573538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:17.765636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f5e9402-8497-4636-af8b-c73ee2f55d78 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541c48e9a20d4b04a33018145c1fce9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189356634b6049a3a44bb701d8529d13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:17.777858 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f5e9402-8497-4636-af8b-c73ee2f55d78 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 200 len: 1450 microversion: 2.1 time: 0.290629 Oct 29 03:03:17.778468 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2050/4096] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:17 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 1450 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:17.789065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:17.792859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] [instance: ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:17.804003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.804537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.807382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.809511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.810120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.810464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.843578 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] HTTP exception thrown: Instance ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b could not be found. Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Request method failure captured: Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b HTTP/1.1 Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJfU88I1mPoB1JSUA29sMj9EJRogyZEc5d4qwpxHg7Y6CkU17gydScOxRyZdHVu7vlMDP1Up4_0lIPWWDR38q0oGmH-ETP7yx0uTbV-BmUARHnwATh3jVov9WUPVu-2O-tOEIsS40HOKvOg0OKu6Fx_N0q5x4BW1dnMqqz2fuPjtTPE Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.26 Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: fba7db05cea44f799b8dc23ed0203668 Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerTagsTestJSON-1823497540 Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fba7db05cea44f799b8dc23ed0203668"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fba7db05cea44f799b8dc23ed0203668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fba7db05cea44f799b8dc23ed0203668", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fba7db05cea44f799b8dc23ed0203668"}]}] Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerTagsTestJSON-1823497540 Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: fba7db05cea44f799b8dc23ed0203668 Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerTagsTestJSON-1823497540 Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerTagsTestJSON-1823497540-project Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 38fa0f91e15c40678663e11e150016a4 Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerTagsTestJSON-1823497540-project Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b could not be found. Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b'} Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b could not be found. Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b could not be found. Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:17.849471 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:03:17.852738 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:17.852738 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:17.852738 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:17.852738 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:03:17.852738 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:03:17.852738 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b could not be found. Oct 29 03:03:17.852738 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:03:17.852738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] Returning 404 to user: Instance ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:03:17.852738 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-41fe821a-edfe-4714-83dd-fff95892cc1d tempest-ServerTagsTestJSON-1823497540 tempest-ServerTagsTestJSON-1823497540-project] 10.222.0.16 "GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b" status: 404 len: 111 microversion: 2.26 time: 0.071535 Oct 29 03:03:17.852738 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2051/4097] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:17 2022] GET /compute/v2.1/servers/ddd2b3bc-46d2-44b4-a8eb-1fa364fa141b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:03:17.885715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b07f26f9-09ce-4260-a991-d4e4d167122e req-208e7521-59c6-44b4-9d70-06678767523a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d43b3b-0f39-48ec-bf51-a60f96b594d4", "name": "network-vif-deleted", "tag": "b18cee08-14e4-4616-8284-11e58ca702a0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:17.895279 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f6a9abf2-5646-4c2c-90d8-513ffc14ef15 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.650735 Oct 29 03:03:17.906165 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2047/4098] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Oct 29 03:03:17 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1/os-interface => generated 1832 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:03:17.918044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b07f26f9-09ce-4260-a991-d4e4d167122e req-208e7521-59c6-44b4-9d70-06678767523a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.922882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b07f26f9-09ce-4260-a991-d4e4d167122e req-208e7521-59c6-44b4-9d70-06678767523a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.923788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b07f26f9-09ce-4260-a991-d4e4d167122e req-208e7521-59c6-44b4-9d70-06678767523a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.964159 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b07f26f9-09ce-4260-a991-d4e4d167122e req-208e7521-59c6-44b4-9d70-06678767523a service nova] Creating event network-vif-deleted:b18cee08-14e4-4616-8284-11e58ca702a0 for instance 78d43b3b-0f39-48ec-bf51-a60f96b594d4 on n-h1-862964-4 Oct 29 03:03:17.972962 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b07f26f9-09ce-4260-a991-d4e4d167122e req-208e7521-59c6-44b4-9d70-06678767523a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090806 Oct 29 03:03:17.979473 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2052/4099] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:03:18.255124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9c2499cf-0775-4bae-b732-cb02a3b26a9b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:18.256254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9c2499cf-0775-4bae-b732-cb02a3b26a9b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:18.275007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c2499cf-0775-4bae-b732-cb02a3b26a9b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:18.277513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c2499cf-0775-4bae-b732-cb02a3b26a9b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:18.279219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c2499cf-0775-4bae-b732-cb02a3b26a9b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:18.280169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c2499cf-0775-4bae-b732-cb02a3b26a9b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:18.280878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c2499cf-0775-4bae-b732-cb02a3b26a9b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:18.283418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c2499cf-0775-4bae-b732-cb02a3b26a9b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:18.376861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4374366e-0aab-414a-8d90-d2b8811d7b3f req-70b91bcf-28e3-4fcb-add8-82cd0684b223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b441cf-f5a0-4f54-90f4-915a2ece9984", "name": "network-vif-plugged", "status": "completed", "tag": "09f30aad-17f6-4891-b116-438911dbd738"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:18.393699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4374366e-0aab-414a-8d90-d2b8811d7b3f req-70b91bcf-28e3-4fcb-add8-82cd0684b223 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:18.394481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4374366e-0aab-414a-8d90-d2b8811d7b3f req-70b91bcf-28e3-4fcb-add8-82cd0684b223 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:18.395044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4374366e-0aab-414a-8d90-d2b8811d7b3f req-70b91bcf-28e3-4fcb-add8-82cd0684b223 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:18.419846 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4374366e-0aab-414a-8d90-d2b8811d7b3f req-70b91bcf-28e3-4fcb-add8-82cd0684b223 service nova] Creating event network-vif-plugged:09f30aad-17f6-4891-b116-438911dbd738 for instance 77b441cf-f5a0-4f54-90f4-915a2ece9984 on n-h2-862964-4 Oct 29 03:03:18.427930 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4374366e-0aab-414a-8d90-d2b8811d7b3f req-70b91bcf-28e3-4fcb-add8-82cd0684b223 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055864 Oct 29 03:03:18.437144 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2053/4100] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:03:18.584104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9c2499cf-0775-4bae-b732-cb02a3b26a9b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:18.599832 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9c2499cf-0775-4bae-b732-cb02a3b26a9b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1279 microversion: 2.1 time: 0.353273 Oct 29 03:03:18.600616 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2048/4101] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:18 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1279 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:18.810928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:18.815019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] [instance: 78d43b3b-0f39-48ec-bf51-a60f96b594d4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:18.833292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:18.838806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:18.839756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:18.840859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:18.845749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:18.847018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:18.880166 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] HTTP exception thrown: Instance 78d43b3b-0f39-48ec-bf51-a60f96b594d4 could not be found. Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Request method failure captured: Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 HTTP/1.1 Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJds4vIm5IVp5gafj7jzShB3a1hBPuMwNkK_5i7YnVJdPCKiUKU398o2CE8XJ5m2fqPDH4yXvFR1NgL5oiHcoxQSlFb5Dl6sePfg91qntsVcYlLzR1vkhOsuDaQEdirBKI2gfO3tWi0ilMUjAfY4MKj8XpjXlY472OasFlfPhSH4Wtc Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 189356634b6049a3a44bb701d8529d13 Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerRescueTestJSON-838206160 Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/189356634b6049a3a44bb701d8529d13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189356634b6049a3a44bb701d8529d13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_189356634b6049a3a44bb701d8529d13", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189356634b6049a3a44bb701d8529d13"}]}] Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerRescueTestJSON-838206160 Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 189356634b6049a3a44bb701d8529d13 Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerRescueTestJSON-838206160 Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerRescueTestJSON-838206160-project Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 541c48e9a20d4b04a33018145c1fce9f Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerRescueTestJSON-838206160-project Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 78d43b3b-0f39-48ec-bf51-a60f96b594d4 could not be found. Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '78d43b3b-0f39-48ec-bf51-a60f96b594d4'} Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78d43b3b-0f39-48ec-bf51-a60f96b594d4 could not be found. Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78d43b3b-0f39-48ec-bf51-a60f96b594d4 could not be found. Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:18.882244 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:03:18.885352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:18.885352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:18.885352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:18.885352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:03:18.885352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:03:18.885352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78d43b3b-0f39-48ec-bf51-a60f96b594d4 could not be found. Oct 29 03:03:18.885352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:03:18.890771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] Returning 404 to user: Instance 78d43b3b-0f39-48ec-bf51-a60f96b594d4 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:03:18.893996 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8a09e431-7bd1-432c-99ee-eb9b3be60269 tempest-ServerRescueTestJSON-838206160 tempest-ServerRescueTestJSON-838206160-project] 10.222.0.16 "GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4" status: 404 len: 111 microversion: 2.1 time: 0.087445 Oct 29 03:03:18.898256 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2054/4102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:18 2022] GET /compute/v2.1/servers/78d43b3b-0f39-48ec-bf51-a60f96b594d4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:03:19.624697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6dfe1b4c-3798-4ae9-a395-4061862fdbf4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:19.625309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6dfe1b4c-3798-4ae9-a395-4061862fdbf4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:19.650827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dfe1b4c-3798-4ae9-a395-4061862fdbf4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:19.658627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dfe1b4c-3798-4ae9-a395-4061862fdbf4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:19.659588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dfe1b4c-3798-4ae9-a395-4061862fdbf4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:19.660941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dfe1b4c-3798-4ae9-a395-4061862fdbf4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:19.661647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dfe1b4c-3798-4ae9-a395-4061862fdbf4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:19.662254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dfe1b4c-3798-4ae9-a395-4061862fdbf4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:19.853027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6dfe1b4c-3798-4ae9-a395-4061862fdbf4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:19.866172 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6dfe1b4c-3798-4ae9-a395-4061862fdbf4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1279 microversion: 2.1 time: 0.244690 Oct 29 03:03:19.873715 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2049/4103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:19 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1279 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:20.111897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-5c7e8c30-e48c-4f2e-bca6-f8e99b7a0302 req-d3e14729-8ccd-413e-9b4a-f9543bbc83b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e97f20-bb71-4576-b4a3-6673ade724a5", "tag": "73419146-73a9-49da-8499-ad30aa72e6c3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:20.129266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5c7e8c30-e48c-4f2e-bca6-f8e99b7a0302 req-d3e14729-8ccd-413e-9b4a-f9543bbc83b5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:20.129742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5c7e8c30-e48c-4f2e-bca6-f8e99b7a0302 req-d3e14729-8ccd-413e-9b4a-f9543bbc83b5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:20.130200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5c7e8c30-e48c-4f2e-bca6-f8e99b7a0302 req-d3e14729-8ccd-413e-9b4a-f9543bbc83b5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:20.158321 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-5c7e8c30-e48c-4f2e-bca6-f8e99b7a0302 req-d3e14729-8ccd-413e-9b4a-f9543bbc83b5 service nova] Creating event network-changed:73419146-73a9-49da-8499-ad30aa72e6c3 for instance 51e97f20-bb71-4576-b4a3-6673ade724a5 on n-h1-862964-4 Oct 29 03:03:20.168624 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-5c7e8c30-e48c-4f2e-bca6-f8e99b7a0302 req-d3e14729-8ccd-413e-9b4a-f9543bbc83b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060651 Oct 29 03:03:20.170164 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2055/4104] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:20.895142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cf230f0e-2804-43e1-827f-0cb8fb948389 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:20.896373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cf230f0e-2804-43e1-827f-0cb8fb948389 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:20.917016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf230f0e-2804-43e1-827f-0cb8fb948389 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:20.923891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf230f0e-2804-43e1-827f-0cb8fb948389 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:20.924802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf230f0e-2804-43e1-827f-0cb8fb948389 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:20.926543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf230f0e-2804-43e1-827f-0cb8fb948389 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:20.930565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf230f0e-2804-43e1-827f-0cb8fb948389 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:20.931870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf230f0e-2804-43e1-827f-0cb8fb948389 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:21.288839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cf230f0e-2804-43e1-827f-0cb8fb948389 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:21.300681 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cf230f0e-2804-43e1-827f-0cb8fb948389 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1321 microversion: 2.1 time: 0.406945 Oct 29 03:03:21.322579 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2050/4105] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:20 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:22.260259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-fe66a896-d9ed-4891-8ffa-18bac5ea3f2e req-b01624d2-c83d-4afe-a0df-90eb18acc996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "tag": "ad65712e-7434-443f-9bb6-d42e2e4152d0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:22.279543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:22.282200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fe66a896-d9ed-4891-8ffa-18bac5ea3f2e req-b01624d2-c83d-4afe-a0df-90eb18acc996 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:22.286421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fe66a896-d9ed-4891-8ffa-18bac5ea3f2e req-b01624d2-c83d-4afe-a0df-90eb18acc996 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:22.287087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fe66a896-d9ed-4891-8ffa-18bac5ea3f2e req-b01624d2-c83d-4afe-a0df-90eb18acc996 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:22.328471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-26e2b9eb-ce9a-418e-b2ea-8c915ddc09ae tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:22.330606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-26e2b9eb-ce9a-418e-b2ea-8c915ddc09ae tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:22.335758 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-fe66a896-d9ed-4891-8ffa-18bac5ea3f2e req-b01624d2-c83d-4afe-a0df-90eb18acc996 service nova] Creating event network-changed:ad65712e-7434-443f-9bb6-d42e2e4152d0 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:03:22.345471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:22.348599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=12 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:22.358564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26e2b9eb-ce9a-418e-b2ea-8c915ddc09ae tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:22.360111 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-fe66a896-d9ed-4891-8ffa-18bac5ea3f2e req-b01624d2-c83d-4afe-a0df-90eb18acc996 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104623 Oct 29 03:03:22.364271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26e2b9eb-ce9a-418e-b2ea-8c915ddc09ae tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:22.365307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26e2b9eb-ce9a-418e-b2ea-8c915ddc09ae tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:22.365470 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2056/4106] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:22.369130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26e2b9eb-ce9a-418e-b2ea-8c915ddc09ae tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:22.370215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26e2b9eb-ce9a-418e-b2ea-8c915ddc09ae tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:22.372462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26e2b9eb-ce9a-418e-b2ea-8c915ddc09ae tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:22.891991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-617e41ec-1bd6-4737-8c56-8e92b0828393 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:22.893047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-617e41ec-1bd6-4737-8c56-8e92b0828393 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:22.904626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-617e41ec-1bd6-4737-8c56-8e92b0828393 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:22.908365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-617e41ec-1bd6-4737-8c56-8e92b0828393 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:22.912293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-617e41ec-1bd6-4737-8c56-8e92b0828393 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:22.913450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-617e41ec-1bd6-4737-8c56-8e92b0828393 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:22.919589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-617e41ec-1bd6-4737-8c56-8e92b0828393 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:22.920317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-617e41ec-1bd6-4737-8c56-8e92b0828393 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:22.996148 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-617e41ec-1bd6-4737-8c56-8e92b0828393 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments/45074da4-1dc0-4d50-8020-4484c1ad4c16" status: 200 len: 194 microversion: 2.20 time: 0.110742 Oct 29 03:03:23.002236 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2057/4107] 10.222.0.16 () {60 vars in 1454 bytes} [Sat Oct 29 03:03:22 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments/45074da4-1dc0-4d50-8020-4484c1ad4c16 => generated 194 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:03:23.184230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-62702e25-8077-4279-893f-b5355c11bfbd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:23.184754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-62702e25-8077-4279-893f-b5355c11bfbd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:23.192277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62702e25-8077-4279-893f-b5355c11bfbd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:23.200325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62702e25-8077-4279-893f-b5355c11bfbd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:23.205709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62702e25-8077-4279-893f-b5355c11bfbd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:23.208527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62702e25-8077-4279-893f-b5355c11bfbd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:23.210746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62702e25-8077-4279-893f-b5355c11bfbd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:23.213413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62702e25-8077-4279-893f-b5355c11bfbd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:23.472561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-62702e25-8077-4279-893f-b5355c11bfbd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lazy-loading 'services' on Instance uuid 31241403-2a17-4f40-818d-fc8caca85e4b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:23.661483 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-62702e25-8077-4279-893f-b5355c11bfbd tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "DELETE /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments/45074da4-1dc0-4d50-8020-4484c1ad4c16" status: 202 len: 0 microversion: 2.20 time: 0.483152 Oct 29 03:03:23.665377 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2058/4108] 10.222.0.16 () {60 vars in 1457 bytes} [Sat Oct 29 03:03:23 2022] DELETE /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments/45074da4-1dc0-4d50-8020-4484c1ad4c16 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:03:23.698932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3881970-4f3c-4131-a01d-6a437b6b5ac4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:23.709378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d3881970-4f3c-4131-a01d-6a437b6b5ac4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:23.733077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3881970-4f3c-4131-a01d-6a437b6b5ac4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:23.735535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3881970-4f3c-4131-a01d-6a437b6b5ac4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:23.737395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3881970-4f3c-4131-a01d-6a437b6b5ac4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:23.739139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3881970-4f3c-4131-a01d-6a437b6b5ac4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:23.739762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3881970-4f3c-4131-a01d-6a437b6b5ac4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:23.740528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3881970-4f3c-4131-a01d-6a437b6b5ac4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:23.818239 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3881970-4f3c-4131-a01d-6a437b6b5ac4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.150675 Oct 29 03:03:23.820183 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2059/4109] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 03:03:23 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:03:24.164668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-26e2b9eb-ce9a-418e-b2ea-8c915ddc09ae tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:24.172177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=99,nova_cell1:DELETE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:24.190600 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-26e2b9eb-ce9a-418e-b2ea-8c915ddc09ae tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1321 microversion: 2.1 time: 1.866391 Oct 29 03:03:24.198952 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2051/4110] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:22 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1321 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:24.833017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-25f8a91e-301b-47e4-b8bf-ad2e7e807429 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:24.835478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-25f8a91e-301b-47e4-b8bf-ad2e7e807429 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:24.848950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25f8a91e-301b-47e4-b8bf-ad2e7e807429 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:24.848950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25f8a91e-301b-47e4-b8bf-ad2e7e807429 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:24.849217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25f8a91e-301b-47e4-b8bf-ad2e7e807429 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:24.855205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25f8a91e-301b-47e4-b8bf-ad2e7e807429 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:24.855926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25f8a91e-301b-47e4-b8bf-ad2e7e807429 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:24.856381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-25f8a91e-301b-47e4-b8bf-ad2e7e807429 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:24.926343 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-25f8a91e-301b-47e4-b8bf-ad2e7e807429 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097982 Oct 29 03:03:24.927666 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2060/4111] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 03:03:24 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:03:25.229913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-27928971-9055-41a1-87cb-90f690c9a504 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:25.234328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-27928971-9055-41a1-87cb-90f690c9a504 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:25.247826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27928971-9055-41a1-87cb-90f690c9a504 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:25.248471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27928971-9055-41a1-87cb-90f690c9a504 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:25.249188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27928971-9055-41a1-87cb-90f690c9a504 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:25.250076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27928971-9055-41a1-87cb-90f690c9a504 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:25.250666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27928971-9055-41a1-87cb-90f690c9a504 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:25.251303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27928971-9055-41a1-87cb-90f690c9a504 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:25.941017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ae9a86eb-88c2-4d74-b46d-6405dc766a0e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:25.944031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ae9a86eb-88c2-4d74-b46d-6405dc766a0e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:25.964050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:25.966356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae9a86eb-88c2-4d74-b46d-6405dc766a0e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:25.970649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae9a86eb-88c2-4d74-b46d-6405dc766a0e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:25.971310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae9a86eb-88c2-4d74-b46d-6405dc766a0e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:25.978836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae9a86eb-88c2-4d74-b46d-6405dc766a0e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:25.979491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae9a86eb-88c2-4d74-b46d-6405dc766a0e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:25.980080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae9a86eb-88c2-4d74-b46d-6405dc766a0e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:26.100608 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ae9a86eb-88c2-4d74-b46d-6405dc766a0e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161779 Oct 29 03:03:26.109144 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2061/4112] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 03:03:25 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:03:26.143883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-27928971-9055-41a1-87cb-90f690c9a504 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:26.157177 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-27928971-9055-41a1-87cb-90f690c9a504 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1321 microversion: 2.1 time: 0.934968 Oct 29 03:03:26.159821 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2052/4113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:25 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1321 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:26.197164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9ddd889f-c45b-4d8f-a09f-68992ca43f7f req-407f07b4-d65c-4b98-ba1a-7e315d1e49f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5201f0a-eea0-4c6f-8304-9371561ae2ef", "tag": "31b135af-c4a0-429c-af33-3b6e78e0a511"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:26.229316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ddd889f-c45b-4d8f-a09f-68992ca43f7f req-407f07b4-d65c-4b98-ba1a-7e315d1e49f3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:26.230024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ddd889f-c45b-4d8f-a09f-68992ca43f7f req-407f07b4-d65c-4b98-ba1a-7e315d1e49f3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:26.231794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ddd889f-c45b-4d8f-a09f-68992ca43f7f req-407f07b4-d65c-4b98-ba1a-7e315d1e49f3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:26.273711 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9ddd889f-c45b-4d8f-a09f-68992ca43f7f req-407f07b4-d65c-4b98-ba1a-7e315d1e49f3 service nova] Creating event network-changed:31b135af-c4a0-429c-af33-3b6e78e0a511 for instance c5201f0a-eea0-4c6f-8304-9371561ae2ef on n-h1-862964-4 Oct 29 03:03:26.289213 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9ddd889f-c45b-4d8f-a09f-68992ca43f7f req-407f07b4-d65c-4b98-ba1a-7e315d1e49f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096066 Oct 29 03:03:26.290611 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2062/4114] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:27.117556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7fff69c3-dc0a-491a-8ea4-bc7b52546925 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:27.120433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7fff69c3-dc0a-491a-8ea4-bc7b52546925 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:27.139555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fff69c3-dc0a-491a-8ea4-bc7b52546925 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:27.142285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fff69c3-dc0a-491a-8ea4-bc7b52546925 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:27.142908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fff69c3-dc0a-491a-8ea4-bc7b52546925 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:27.143830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fff69c3-dc0a-491a-8ea4-bc7b52546925 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:27.149345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fff69c3-dc0a-491a-8ea4-bc7b52546925 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:27.149935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fff69c3-dc0a-491a-8ea4-bc7b52546925 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:27.185053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-56f02038-a784-45cc-aefb-d315f0611310 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:27.185772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-56f02038-a784-45cc-aefb-d315f0611310 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:27.202839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f02038-a784-45cc-aefb-d315f0611310 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:27.203327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f02038-a784-45cc-aefb-d315f0611310 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:27.203759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f02038-a784-45cc-aefb-d315f0611310 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:27.204697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f02038-a784-45cc-aefb-d315f0611310 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:27.205443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f02038-a784-45cc-aefb-d315f0611310 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:27.205906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56f02038-a784-45cc-aefb-d315f0611310 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:27.219443 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7fff69c3-dc0a-491a-8ea4-bc7b52546925 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105821 Oct 29 03:03:27.228017 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2053/4115] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 03:03:27 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:03:27.380718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-56f02038-a784-45cc-aefb-d315f0611310 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:27.389448 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-56f02038-a784-45cc-aefb-d315f0611310 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1321 microversion: 2.1 time: 0.210250 Oct 29 03:03:27.393933 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2063/4116] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:27 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:27.980274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6dd381e2-cfa7-465b-b25e-5c3ab9630c02 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:27.981084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6dd381e2-cfa7-465b-b25e-5c3ab9630c02 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:27.991695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd381e2-cfa7-465b-b25e-5c3ab9630c02 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:27.992527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd381e2-cfa7-465b-b25e-5c3ab9630c02 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:27.994562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd381e2-cfa7-465b-b25e-5c3ab9630c02 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:27.995549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd381e2-cfa7-465b-b25e-5c3ab9630c02 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:27.998650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd381e2-cfa7-465b-b25e-5c3ab9630c02 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:27.999313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6dd381e2-cfa7-465b-b25e-5c3ab9630c02 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:28.233467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-08ea666a-b07c-4376-88a8-ca093eff9bf4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:28.237844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-08ea666a-b07c-4376-88a8-ca093eff9bf4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:28.254373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08ea666a-b07c-4376-88a8-ca093eff9bf4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:28.255157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08ea666a-b07c-4376-88a8-ca093eff9bf4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:28.258307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08ea666a-b07c-4376-88a8-ca093eff9bf4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:28.259126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08ea666a-b07c-4376-88a8-ca093eff9bf4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:28.259895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08ea666a-b07c-4376-88a8-ca093eff9bf4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:28.261457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08ea666a-b07c-4376-88a8-ca093eff9bf4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:28.276798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6dd381e2-cfa7-465b-b25e-5c3ab9630c02 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:28.286802 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6dd381e2-cfa7-465b-b25e-5c3ab9630c02 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.310655 Oct 29 03:03:28.288635 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2054/4117] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:27 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:28.318526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-903156a6-3a23-4009-ac6b-a9e9f330abee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-492803362"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:28.327700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-903156a6-3a23-4009-ac6b-a9e9f330abee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:28.345496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903156a6-3a23-4009-ac6b-a9e9f330abee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:28.346124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903156a6-3a23-4009-ac6b-a9e9f330abee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:28.347043 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-08ea666a-b07c-4376-88a8-ca093eff9bf4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.118007 Oct 29 03:03:28.347747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903156a6-3a23-4009-ac6b-a9e9f330abee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:28.350095 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2064/4118] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 03:03:28 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:03:28.350480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903156a6-3a23-4009-ac6b-a9e9f330abee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:28.351126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903156a6-3a23-4009-ac6b-a9e9f330abee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:28.351746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903156a6-3a23-4009-ac6b-a9e9f330abee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:28.415041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40bf7144-0369-497c-8924-e1693f2b3996 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:28.415766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40bf7144-0369-497c-8924-e1693f2b3996 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:28.425969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40bf7144-0369-497c-8924-e1693f2b3996 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:28.426763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40bf7144-0369-497c-8924-e1693f2b3996 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:28.428411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40bf7144-0369-497c-8924-e1693f2b3996 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:28.430653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40bf7144-0369-497c-8924-e1693f2b3996 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:28.433824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40bf7144-0369-497c-8924-e1693f2b3996 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:28.435941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40bf7144-0369-497c-8924-e1693f2b3996 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:28.792771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40bf7144-0369-497c-8924-e1693f2b3996 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:28.807604 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40bf7144-0369-497c-8924-e1693f2b3996 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1321 microversion: 2.1 time: 0.393824 Oct 29 03:03:28.822848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2065/4119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:28 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:28.858875 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-903156a6-3a23-4009-ac6b-a9e9f330abee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.545164 Oct 29 03:03:28.864119 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2055/4120] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:03:28 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 29 03:03:28.947443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4deedab4-99d5-4fa3-aff5-6848f498529e req-c1fbfcdd-bb93-4c70-afca-8806d20424b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e97f20-bb71-4576-b4a3-6673ade724a5", "name": "network-vif-plugged", "status": "completed", "tag": "73419146-73a9-49da-8499-ad30aa72e6c3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:28.966681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4deedab4-99d5-4fa3-aff5-6848f498529e req-c1fbfcdd-bb93-4c70-afca-8806d20424b9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:28.968473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4deedab4-99d5-4fa3-aff5-6848f498529e req-c1fbfcdd-bb93-4c70-afca-8806d20424b9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:28.970518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4deedab4-99d5-4fa3-aff5-6848f498529e req-c1fbfcdd-bb93-4c70-afca-8806d20424b9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:29.001016 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4deedab4-99d5-4fa3-aff5-6848f498529e req-c1fbfcdd-bb93-4c70-afca-8806d20424b9 service nova] Creating event network-vif-plugged:73419146-73a9-49da-8499-ad30aa72e6c3 for instance 51e97f20-bb71-4576-b4a3-6673ade724a5 on n-h1-862964-4 Oct 29 03:03:29.019902 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4deedab4-99d5-4fa3-aff5-6848f498529e req-c1fbfcdd-bb93-4c70-afca-8806d20424b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078873 Oct 29 03:03:29.024910 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2066/4121] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:29.363134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-78f0c26c-c271-4b3e-8d0c-fca492aae77f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:29.373650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-78f0c26c-c271-4b3e-8d0c-fca492aae77f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:29.414393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78f0c26c-c271-4b3e-8d0c-fca492aae77f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:29.420053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78f0c26c-c271-4b3e-8d0c-fca492aae77f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:29.421270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78f0c26c-c271-4b3e-8d0c-fca492aae77f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:29.424461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78f0c26c-c271-4b3e-8d0c-fca492aae77f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:29.425999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78f0c26c-c271-4b3e-8d0c-fca492aae77f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:29.426627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78f0c26c-c271-4b3e-8d0c-fca492aae77f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:29.480683 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-78f0c26c-c271-4b3e-8d0c-fca492aae77f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123474 Oct 29 03:03:29.481428 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2056/4122] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 03:03:29 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:03:29.836640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5013de0-eedd-449f-83fa-9536520c7840 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:29.837441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b5013de0-eedd-449f-83fa-9536520c7840 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:29.856825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5013de0-eedd-449f-83fa-9536520c7840 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:29.857311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5013de0-eedd-449f-83fa-9536520c7840 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:29.859286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5013de0-eedd-449f-83fa-9536520c7840 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:29.860213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5013de0-eedd-449f-83fa-9536520c7840 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:29.860895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5013de0-eedd-449f-83fa-9536520c7840 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:29.861347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5013de0-eedd-449f-83fa-9536520c7840 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:30.128218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b5013de0-eedd-449f-83fa-9536520c7840 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:30.138326 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b5013de0-eedd-449f-83fa-9536520c7840 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1321 microversion: 2.1 time: 0.305858 Oct 29 03:03:30.141871 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2067/4123] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:29 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:30.495218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8a74f7dd-9834-4e52-b165-9b1d2877c1fe tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:30.497550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8a74f7dd-9834-4e52-b165-9b1d2877c1fe tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:30.514434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a74f7dd-9834-4e52-b165-9b1d2877c1fe tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:30.514925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a74f7dd-9834-4e52-b165-9b1d2877c1fe tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:30.516373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a74f7dd-9834-4e52-b165-9b1d2877c1fe tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:30.519279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a74f7dd-9834-4e52-b165-9b1d2877c1fe tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:30.519939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a74f7dd-9834-4e52-b165-9b1d2877c1fe tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:30.520594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a74f7dd-9834-4e52-b165-9b1d2877c1fe tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:30.615142 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8a74f7dd-9834-4e52-b165-9b1d2877c1fe tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121215 Oct 29 03:03:30.616226 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2057/4124] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 03:03:30 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:03:31.162487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ffde364-ecc2-49e3-98ea-19aa70123d64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:31.163805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1ffde364-ecc2-49e3-98ea-19aa70123d64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:31.173759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffde364-ecc2-49e3-98ea-19aa70123d64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:31.178516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffde364-ecc2-49e3-98ea-19aa70123d64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:31.179082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffde364-ecc2-49e3-98ea-19aa70123d64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:31.179941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffde364-ecc2-49e3-98ea-19aa70123d64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:31.181320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffde364-ecc2-49e3-98ea-19aa70123d64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:31.182644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffde364-ecc2-49e3-98ea-19aa70123d64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:31.475065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ffde364-ecc2-49e3-98ea-19aa70123d64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:31.489374 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ffde364-ecc2-49e3-98ea-19aa70123d64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1321 microversion: 2.1 time: 0.328783 Oct 29 03:03:31.493882 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2068/4125] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:31 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:31.639360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d3dd1c16-52d7-4da7-9c5f-6cea9743a9ed tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:31.650342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d3dd1c16-52d7-4da7-9c5f-6cea9743a9ed tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:31.669467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:31.693426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3dd1c16-52d7-4da7-9c5f-6cea9743a9ed tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:31.694923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3dd1c16-52d7-4da7-9c5f-6cea9743a9ed tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:31.696474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3dd1c16-52d7-4da7-9c5f-6cea9743a9ed tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:31.698757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3dd1c16-52d7-4da7-9c5f-6cea9743a9ed tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:31.700279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3dd1c16-52d7-4da7-9c5f-6cea9743a9ed tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:31.701131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3dd1c16-52d7-4da7-9c5f-6cea9743a9ed tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:31.784582 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d3dd1c16-52d7-4da7-9c5f-6cea9743a9ed tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159742 Oct 29 03:03:31.786107 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2058/4126] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 03:03:31 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:03:32.517749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6c08345d-80f9-4fb2-b5b3-b928b4c7c6fa tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:32.519181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6c08345d-80f9-4fb2-b5b3-b928b4c7c6fa tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:32.528490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c08345d-80f9-4fb2-b5b3-b928b4c7c6fa tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:32.529298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c08345d-80f9-4fb2-b5b3-b928b4c7c6fa tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:32.530131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c08345d-80f9-4fb2-b5b3-b928b4c7c6fa tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:32.531098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c08345d-80f9-4fb2-b5b3-b928b4c7c6fa tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:32.531708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c08345d-80f9-4fb2-b5b3-b928b4c7c6fa tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:32.532530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c08345d-80f9-4fb2-b5b3-b928b4c7c6fa tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:32.810079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b3449d92-0e6c-4525-8872-39238d0ff48a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:32.814112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b3449d92-0e6c-4525-8872-39238d0ff48a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:32.825278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3449d92-0e6c-4525-8872-39238d0ff48a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:32.826137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3449d92-0e6c-4525-8872-39238d0ff48a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:32.827109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3449d92-0e6c-4525-8872-39238d0ff48a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:32.828825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3449d92-0e6c-4525-8872-39238d0ff48a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:32.829897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3449d92-0e6c-4525-8872-39238d0ff48a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:32.830583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3449d92-0e6c-4525-8872-39238d0ff48a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:32.869081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6c08345d-80f9-4fb2-b5b3-b928b4c7c6fa tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:32.883484 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b3449d92-0e6c-4525-8872-39238d0ff48a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.088746 Oct 29 03:03:32.884122 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6c08345d-80f9-4fb2-b5b3-b928b4c7c6fa tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1321 microversion: 2.1 time: 0.370806 Oct 29 03:03:32.886805 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2069/4127] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:32 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:32.899670 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2059/4128] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 03:03:32 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:33.006436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-efa27098-33e4-43f9-8126-911d0bb20037 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:33.007652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-efa27098-33e4-43f9-8126-911d0bb20037 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:33.017407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa27098-33e4-43f9-8126-911d0bb20037 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:33.018356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa27098-33e4-43f9-8126-911d0bb20037 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:33.019132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa27098-33e4-43f9-8126-911d0bb20037 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:33.020013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa27098-33e4-43f9-8126-911d0bb20037 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:33.020752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa27098-33e4-43f9-8126-911d0bb20037 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:33.021445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa27098-33e4-43f9-8126-911d0bb20037 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:33.081428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-efa27098-33e4-43f9-8126-911d0bb20037 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:03:33.205232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:33.338100 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-efa27098-33e4-43f9-8126-911d0bb20037 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "DELETE /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 204 len: 0 microversion: 2.20 time: 0.332246 Oct 29 03:03:33.348180 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2070/4129] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:03:32 2022] DELETE /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:03:33.355332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:33.356114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:33.367111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:33.368111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:33.370635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:33.371926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:33.377053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:33.378293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:33.677390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:33.710776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:33.719800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:33.735867 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-96d42744-ae29-4222-b5c5-cc4db4e16644 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1721 microversion: 2.20 time: 0.386106 Oct 29 03:03:33.740623 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2060/4130] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:33 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1721 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:33.915837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5ade18ec-acdf-4a39-9ef0-c0a48d76368a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:33.916549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5ade18ec-acdf-4a39-9ef0-c0a48d76368a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:33.928486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ade18ec-acdf-4a39-9ef0-c0a48d76368a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:33.931975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ade18ec-acdf-4a39-9ef0-c0a48d76368a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:33.932567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ade18ec-acdf-4a39-9ef0-c0a48d76368a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:33.933449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ade18ec-acdf-4a39-9ef0-c0a48d76368a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:33.934229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ade18ec-acdf-4a39-9ef0-c0a48d76368a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:33.935444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ade18ec-acdf-4a39-9ef0-c0a48d76368a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:34.453203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5ade18ec-acdf-4a39-9ef0-c0a48d76368a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:34.468435 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5ade18ec-acdf-4a39-9ef0-c0a48d76368a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1321 microversion: 2.1 time: 0.556791 Oct 29 03:03:34.481864 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2071/4131] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:33 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1321 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:34.559060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4f8def44-2805-4813-98d6-24d0a5a2011f req-d2e89a8c-35e0-4201-b32c-03303d8d58e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5201f0a-eea0-4c6f-8304-9371561ae2ef", "name": "network-vif-plugged", "status": "completed", "tag": "31b135af-c4a0-429c-af33-3b6e78e0a511"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:34.589706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4f8def44-2805-4813-98d6-24d0a5a2011f req-d2e89a8c-35e0-4201-b32c-03303d8d58e7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:34.591668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4f8def44-2805-4813-98d6-24d0a5a2011f req-d2e89a8c-35e0-4201-b32c-03303d8d58e7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:34.592238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4f8def44-2805-4813-98d6-24d0a5a2011f req-d2e89a8c-35e0-4201-b32c-03303d8d58e7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:34.644196 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4f8def44-2805-4813-98d6-24d0a5a2011f req-d2e89a8c-35e0-4201-b32c-03303d8d58e7 service nova] Creating event network-vif-plugged:31b135af-c4a0-429c-af33-3b6e78e0a511 for instance c5201f0a-eea0-4c6f-8304-9371561ae2ef on n-h1-862964-4 Oct 29 03:03:34.667780 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4f8def44-2805-4813-98d6-24d0a5a2011f req-d2e89a8c-35e0-4201-b32c-03303d8d58e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113054 Oct 29 03:03:34.676235 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2061/4132] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:34.772069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:34.772908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:34.785484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:34.791603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:34.792376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:34.793263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:34.793980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:34.794514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:35.276332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:35.287828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:35.294078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:35.296122 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f2d9049-251a-4b8b-a702-a6feba77b4a6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1721 microversion: 2.20 time: 0.529728 Oct 29 03:03:35.297973 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2072/4133] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:34 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1721 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:35.510473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4635221b-0a35-4895-8a71-e4f141ea513d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:35.511515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4635221b-0a35-4895-8a71-e4f141ea513d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:35.532870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4635221b-0a35-4895-8a71-e4f141ea513d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:35.534749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4635221b-0a35-4895-8a71-e4f141ea513d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:35.539345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4635221b-0a35-4895-8a71-e4f141ea513d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:35.540391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4635221b-0a35-4895-8a71-e4f141ea513d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:35.542347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4635221b-0a35-4895-8a71-e4f141ea513d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:35.559418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4635221b-0a35-4895-8a71-e4f141ea513d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:36.328415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:36.330277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:36.378141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:36.380721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:36.382496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:36.387446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:36.389287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:36.392297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:36.877825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:36.898650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:36.900776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:36.903165 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-50f0040b-d48b-4b06-ba08-6d340a55b2d6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1721 microversion: 2.20 time: 0.578745 Oct 29 03:03:36.904297 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2073/4134] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:36 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1721 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:37.091382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4635221b-0a35-4895-8a71-e4f141ea513d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:37.102867 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4635221b-0a35-4895-8a71-e4f141ea513d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1321 microversion: 2.1 time: 1.611984 Oct 29 03:03:37.108737 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2062/4135] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:35 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1321 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:37.852668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-2909e372-33fe-4b29-809e-2a1a7479aa8c req-252f04ea-6bfa-4201-98c1-949c3a862af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e7e466-df5f-45f5-9e45-dc3c16e888b7", "name": "network-vif-plugged", "status": "completed", "tag": "4f85a0f7-faab-45b5-be06-7a79452c31af"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:37.902737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2909e372-33fe-4b29-809e-2a1a7479aa8c req-252f04ea-6bfa-4201-98c1-949c3a862af9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:37.905152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2909e372-33fe-4b29-809e-2a1a7479aa8c req-252f04ea-6bfa-4201-98c1-949c3a862af9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:37.929125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2909e372-33fe-4b29-809e-2a1a7479aa8c req-252f04ea-6bfa-4201-98c1-949c3a862af9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:37.941052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:37.941962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:37.954119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:37.955286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:37.957527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:37.958477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:37.961385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:37.962409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:37.983631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-2909e372-33fe-4b29-809e-2a1a7479aa8c req-252f04ea-6bfa-4201-98c1-949c3a862af9 service nova] Creating event network-vif-plugged:4f85a0f7-faab-45b5-be06-7a79452c31af for instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 on n-h1-862964-4 Oct 29 03:03:38.007477 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-2909e372-33fe-4b29-809e-2a1a7479aa8c req-252f04ea-6bfa-4201-98c1-949c3a862af9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157033 Oct 29 03:03:38.012298 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2074/4136] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:38.132323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-003fe926-b553-4628-b426-80222606dbee tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:38.133255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-003fe926-b553-4628-b426-80222606dbee tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:38.148672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003fe926-b553-4628-b426-80222606dbee tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:38.149461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003fe926-b553-4628-b426-80222606dbee tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:38.150131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003fe926-b553-4628-b426-80222606dbee tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:38.151048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003fe926-b553-4628-b426-80222606dbee tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:38.153513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003fe926-b553-4628-b426-80222606dbee tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:38.155580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003fe926-b553-4628-b426-80222606dbee tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:38.508699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:38.518832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:38.546106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:38.553673 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-24c46568-a0cc-4df9-aa7d-1005222bf4f9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1721 microversion: 2.20 time: 0.616504 Oct 29 03:03:38.554774 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2063/4137] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:37 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1721 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:38.914315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-003fe926-b553-4628-b426-80222606dbee tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:38.922556 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-003fe926-b553-4628-b426-80222606dbee tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1512 microversion: 2.1 time: 0.794513 Oct 29 03:03:38.929124 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2075/4138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:38 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1512 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:38.955266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d9bd252-2a2d-440a-b1b1-13d4cbab3573 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:38.956149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7d9bd252-2a2d-440a-b1b1-13d4cbab3573 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:38.968848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d9bd252-2a2d-440a-b1b1-13d4cbab3573 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:38.969384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d9bd252-2a2d-440a-b1b1-13d4cbab3573 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:38.969841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d9bd252-2a2d-440a-b1b1-13d4cbab3573 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:38.971082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d9bd252-2a2d-440a-b1b1-13d4cbab3573 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:38.971082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d9bd252-2a2d-440a-b1b1-13d4cbab3573 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:38.971413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d9bd252-2a2d-440a-b1b1-13d4cbab3573 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:39.581485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:39.582130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:39.595475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:39.595973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:39.596410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:39.597123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:39.597577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:39.598030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:39.884861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:39.897970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:39.903126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:39.904525 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b48110dc-d10f-4946-b09d-c6664fac4d67 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1654 microversion: 2.20 time: 0.327427 Oct 29 03:03:39.907975 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2076/4139] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:39 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1654 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:40.767822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-41d171ed-f2dd-4398-803e-cc3762b905cf req-8d9a36d2-fcc2-49a0-83d7-b39f8f73d0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31241403-2a17-4f40-818d-fc8caca85e4b", "name": "network-vif-deleted", "tag": "e6f1a4fa-984f-49dc-a400-07b55f9cbbeb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:40.811412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-41d171ed-f2dd-4398-803e-cc3762b905cf req-8d9a36d2-fcc2-49a0-83d7-b39f8f73d0be service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:40.812215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-41d171ed-f2dd-4398-803e-cc3762b905cf req-8d9a36d2-fcc2-49a0-83d7-b39f8f73d0be service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:40.812985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-41d171ed-f2dd-4398-803e-cc3762b905cf req-8d9a36d2-fcc2-49a0-83d7-b39f8f73d0be service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:40.850921 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-41d171ed-f2dd-4398-803e-cc3762b905cf req-8d9a36d2-fcc2-49a0-83d7-b39f8f73d0be service nova] Creating event network-vif-deleted:e6f1a4fa-984f-49dc-a400-07b55f9cbbeb for instance 31241403-2a17-4f40-818d-fc8caca85e4b on n-h2-862964-4 Oct 29 03:03:40.861511 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-41d171ed-f2dd-4398-803e-cc3762b905cf req-8d9a36d2-fcc2-49a0-83d7-b39f8f73d0be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098191 Oct 29 03:03:40.862737 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2077/4140] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:03:40.928657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d9bd252-2a2d-440a-b1b1-13d4cbab3573 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:40.936758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:40.941628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:40.964172 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d9bd252-2a2d-440a-b1b1-13d4cbab3573 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1511 microversion: 2.1 time: 2.013860 Oct 29 03:03:40.968857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:40.983106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:40.983799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:40.986577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:40.987221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:40.991286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:40.998675 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2064/4141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:38 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1511 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:41.012467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fd6a6ef1-2d44-45f8-99ae-f53cca07bf20 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:41.015333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fd6a6ef1-2d44-45f8-99ae-f53cca07bf20 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 51e97f20-bb71-4576-b4a3-6673ade724a5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:41.041742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd6a6ef1-2d44-45f8-99ae-f53cca07bf20 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:41.042925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd6a6ef1-2d44-45f8-99ae-f53cca07bf20 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:41.043528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd6a6ef1-2d44-45f8-99ae-f53cca07bf20 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:41.044397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd6a6ef1-2d44-45f8-99ae-f53cca07bf20 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:41.044989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd6a6ef1-2d44-45f8-99ae-f53cca07bf20 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:41.046936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd6a6ef1-2d44-45f8-99ae-f53cca07bf20 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:41.127090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:41.127595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:41.128053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:41.128522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lazy-loading 'fault' on Instance uuid 31241403-2a17-4f40-818d-fc8caca85e4b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:41.286377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:41.300590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:41.311702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:41.315699 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-68f5b639-2ec5-4438-ad2a-797a0f6b97e7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 200 len: 1370 microversion: 2.20 time: 0.385217 Oct 29 03:03:41.319785 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2078/4142] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:40 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 1370 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:41.690824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fd6a6ef1-2d44-45f8-99ae-f53cca07bf20 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:41.706089 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fd6a6ef1-2d44-45f8-99ae-f53cca07bf20 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5" status: 200 len: 1509 microversion: 2.1 time: 0.701817 Oct 29 03:03:41.706810 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2065/4143] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:40 2022] GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5 => generated 1509 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:41.729466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:41.749472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:41.752481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:03:41.793460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:41.794315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:41.796827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:41.797949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:41.799650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:41.802526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:42.005707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1923028691", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "204a19c0-c3a9-46eb-85da-9d12d0451025"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:42.066577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:03:42.254679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] validate_networks() for [('204a19c0-c3a9-46eb-85da-9d12d0451025', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:03:42.278243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:42.317011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:42.317697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:42.318173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:42.881485 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ee4a867-b664-4ac9-a77d-2d24ec66f68e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.156096 Oct 29 03:03:42.882409 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2066/4144] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Oct 29 03:03:41 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:42.901914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:42.902788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:42.910545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:42.912666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:42.914056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:42.918732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:42.919447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:42.920058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:42.957263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:42.958915 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] HTTP exception thrown: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Request method failure captured: Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b HTTP/1.1 Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJcFBAFNOzU5bzfWkuUBjVkhOJXnzhig8t8LcAOK7ycm1RbRBHoLtshT33gQycjj5u9FKeLnTdU7rAhWEPnXnC--n33vtx4jMryneJ9QCYGXQFPhM_50vTdZF825N-Oiy5P2q8Uohu2OHC53MugGSsrWovjBGj5aAvOErRVeHhsZFP4 Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ef09834b750437e9fa350df7b4bb0f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}] Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 801730a89d33490d8d6f425f20ce5b1d Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '31241403-2a17-4f40-818d-fc8caca85e4b'} Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:03:42.962254 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:42.966322 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:03:42.966322 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:42.966322 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:42.966322 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:42.966322 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:03:42.966322 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:03:42.966322 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:03:42.966322 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:03:42.975181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Returning 404 to user: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:03:42.977901 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e5ba3b8e-7eea-4198-89af-6843404e707d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 404 len: 111 microversion: 2.20 time: 0.094352 Oct 29 03:03:42.982571 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2067/4145] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:42 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:03:43.010319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:43.027418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:43.031523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-200701745', 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:03:43.055025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:43.055871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:43.058282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:43.062905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:43.067223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:43.068453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:43.395015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:03:43.569732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:03:43.570226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:03:43.570703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:03:43.571107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:03:43.572008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:03:43.604148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:43.604898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:43.605763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:43.609053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:43.610235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:43.611019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:43.618780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:43.639497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:43.640032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:43.640473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:43.658405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:03:43.672672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for user cecadca739554f858c269b85690b5cec and project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:03:43.703920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:03:43.713012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:03:43.883677 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d802f3d5-27bf-4815-bd91-0becf6be71bc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.269883 Oct 29 03:03:43.894108 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2079/4146] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:03:43.925695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8a9d3acd-ece4-45e6-923e-6dd19829bb06 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '.version_select at 0x7fe1a88e0040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:43.983578 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8a9d3acd-ece4-45e6-923e-6dd19829bb06 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-851759898" status: 204 len: 0 microversion: 2.20 time: 0.086844 Oct 29 03:03:43.984385 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2080/4147] 10.222.0.16 () {60 vars in 1259 bytes} [Sat Oct 29 03:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-851759898 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:03:43.999618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6b4c6adf-3874-499a-9e6f-0edffd1af285 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:44.004451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6b4c6adf-3874-499a-9e6f-0edffd1af285 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:44.206503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6b4c6adf-3874-499a-9e6f-0edffd1af285 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:44.214812 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6b4c6adf-3874-499a-9e6f-0edffd1af285 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1193 microversion: 2.1 time: 0.225154 Oct 29 03:03:44.253421 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2081/4148] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:43 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1193 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:44.664488 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aac5c5b2-299b-4baa-9320-ef04a2ca257a tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-200701745" status: 200 len: 1514 microversion: 2.1 time: 1.680290 Oct 29 03:03:44.665180 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2068/4149] 10.222.0.16 () {58 vars in 1261 bytes} [Sat Oct 29 03:03:42 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-200701745 => generated 1514 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:44.696344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:44.708314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:44.713255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:03:44.764160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:44.764628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:44.765054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:44.765776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:44.778230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:44.778683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:45.243218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e207a47-6059-48f4-b98a-4ba7729b694f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:45.244190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e207a47-6059-48f4-b98a-4ba7729b694f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:45.261031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e207a47-6059-48f4-b98a-4ba7729b694f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:45.261700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e207a47-6059-48f4-b98a-4ba7729b694f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:45.262423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e207a47-6059-48f4-b98a-4ba7729b694f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:45.263372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e207a47-6059-48f4-b98a-4ba7729b694f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:45.264071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e207a47-6059-48f4-b98a-4ba7729b694f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:45.264705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e207a47-6059-48f4-b98a-4ba7729b694f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:45.288190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:03:45.491339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:45.503390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2e207a47-6059-48f4-b98a-4ba7729b694f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:45.517609 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e207a47-6059-48f4-b98a-4ba7729b694f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1197 microversion: 2.1 time: 0.278777 Oct 29 03:03:45.526551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:45.527053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:45.527485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:45.528397 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2069/4150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:45 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1197 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:46.164404 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb826ec0-fc3b-4fd9-8701-b6b311f775e0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 1.472150 Oct 29 03:03:46.165890 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2082/4151] 10.222.0.16 () {58 vars in 1173 bytes} [Sat Oct 29 03:03:44 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:46.197148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:46.207206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:46.209976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.compute.servers [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Removing options 'limit' from query {{(pid=127041) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 03:03:46.216548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:03:46.231656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:46.235331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:46.235824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:46.236642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:46.237102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:46.237526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:46.323445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:46.338622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:46.342410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:46.343151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:46.557269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c107dd6-8976-4f56-bff9-b37323504e83 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:46.558072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4c107dd6-8976-4f56-bff9-b37323504e83 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:46.585885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c107dd6-8976-4f56-bff9-b37323504e83 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:46.586423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c107dd6-8976-4f56-bff9-b37323504e83 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:46.591012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c107dd6-8976-4f56-bff9-b37323504e83 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:46.591813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c107dd6-8976-4f56-bff9-b37323504e83 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:46.592285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c107dd6-8976-4f56-bff9-b37323504e83 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:46.601347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c107dd6-8976-4f56-bff9-b37323504e83 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:46.769622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4c107dd6-8976-4f56-bff9-b37323504e83 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:46.781071 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4c107dd6-8976-4f56-bff9-b37323504e83 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1253 microversion: 2.1 time: 0.230922 Oct 29 03:03:46.791682 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2083/4152] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:46 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1253 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:46.817415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d90a34c5-d562-4ca5-942e-66b0afef100a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Action: 'create', calling method: .version_select at 0x7fe1a8c991f0>, body: {"keypair": {"name": "tempest-keypair-1253269865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAmhH0KfQq/HW/s2GacRfzGpJTQ08EBNokvjF8JgOwio1x/UWlwF9szgf5iw/SMm1QD7vdTeXniv0T/9P0fyhhl00i5eegH7lAneMcAQCAZEIn2FiEI5Ww381CXnbx/vQ=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:46.865575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d90a34c5-d562-4ca5-942e-66b0afef100a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Getting quotas for project 3ef09834b750437e9fa350df7b4bb0f3. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:03:46.878399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d90a34c5-d562-4ca5-942e-66b0afef100a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Getting quotas for user 801730a89d33490d8d6f425f20ce5b1d and project 3ef09834b750437e9fa350df7b4bb0f3. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:03:46.937551 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d90a34c5-d562-4ca5-942e-66b0afef100a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.127303 Oct 29 03:03:46.957584 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2084/4153] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Oct 29 03:03:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 03:03:47.431754 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e47eb18f-3bc5-469b-8296-757fbac56888 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 1.238680 Oct 29 03:03:47.432100 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2070/4154] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 03:03:46 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:47.462369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-52ec2311-7faf-4ce7-b4f7-e5f88427109d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:47.467710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52ec2311-7faf-4ce7-b4f7-e5f88427109d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:47.495927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-52ec2311-7faf-4ce7-b4f7-e5f88427109d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:03:47.515961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52ec2311-7faf-4ce7-b4f7-e5f88427109d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:47.515961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52ec2311-7faf-4ce7-b4f7-e5f88427109d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:47.515961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52ec2311-7faf-4ce7-b4f7-e5f88427109d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:47.517020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52ec2311-7faf-4ce7-b4f7-e5f88427109d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:47.517414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52ec2311-7faf-4ce7-b4f7-e5f88427109d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:47.525184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52ec2311-7faf-4ce7-b4f7-e5f88427109d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:47.815596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f0f45e4d-55eb-4031-bef4-22ecb5013a04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:47.816447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f0f45e4d-55eb-4031-bef4-22ecb5013a04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:47.826390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f45e4d-55eb-4031-bef4-22ecb5013a04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:47.834606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f45e4d-55eb-4031-bef4-22ecb5013a04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:47.835295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f45e4d-55eb-4031-bef4-22ecb5013a04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:47.836195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f45e4d-55eb-4031-bef4-22ecb5013a04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:47.838381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f45e4d-55eb-4031-bef4-22ecb5013a04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:47.838965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f0f45e4d-55eb-4031-bef4-22ecb5013a04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:47.865693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-52ec2311-7faf-4ce7-b4f7-e5f88427109d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:03:48.097113 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-52ec2311-7faf-4ce7-b4f7-e5f88427109d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.625014 Oct 29 03:03:48.102506 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2085/4155] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 03:03:47 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:48.124587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:48.141309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:48.141768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.compute.servers [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Removing options 'limit' from query {{(pid=127042) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 03:03:48.142511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:03:48.155270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.155749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.156175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.156925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.157374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.157915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.261725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:03:48.334233 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3a0e3f8a-dc3b-4d68-9418-eaf7e6238b6c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.220786 Oct 29 03:03:48.344345 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2086/4156] 10.222.0.16 () {58 vars in 1150 bytes} [Sat Oct 29 03:03:48 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:48.354463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7785d440-b957-4898-886d-3ea7814c5376 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:48.360049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7785d440-b957-4898-886d-3ea7814c5376 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:48.361406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7785d440-b957-4898-886d-3ea7814c5376 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:03:48.368922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7785d440-b957-4898-886d-3ea7814c5376 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.370106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7785d440-b957-4898-886d-3ea7814c5376 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.371077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7785d440-b957-4898-886d-3ea7814c5376 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.372052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7785d440-b957-4898-886d-3ea7814c5376 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.373323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7785d440-b957-4898-886d-3ea7814c5376 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.373991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7785d440-b957-4898-886d-3ea7814c5376 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.409948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-7785d440-b957-4898-886d-3ea7814c5376 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:03:48.457197 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7785d440-b957-4898-886d-3ea7814c5376 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.114447 Oct 29 03:03:48.460153 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2087/4157] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 03:03:48 2022] GET /compute/v2.1/servers => generated 1009 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:48.475707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e3d16af9-3a78-46b7-8d8b-62343cd48f89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:48.488890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e3d16af9-3a78-46b7-8d8b-62343cd48f89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:48.494098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e3d16af9-3a78-46b7-8d8b-62343cd48f89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:03:48.551395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d16af9-3a78-46b7-8d8b-62343cd48f89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.553065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d16af9-3a78-46b7-8d8b-62343cd48f89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.555835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d16af9-3a78-46b7-8d8b-62343cd48f89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.559327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d16af9-3a78-46b7-8d8b-62343cd48f89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.560198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d16af9-3a78-46b7-8d8b-62343cd48f89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.560830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d16af9-3a78-46b7-8d8b-62343cd48f89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.682545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f0f45e4d-55eb-4031-bef4-22ecb5013a04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:48.699770 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f0f45e4d-55eb-4031-bef4-22ecb5013a04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1251 microversion: 2.1 time: 0.886672 Oct 29 03:03:48.701073 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2071/4158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:47 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1251 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:48.802109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-e3d16af9-3a78-46b7-8d8b-62343cd48f89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:03:49.074041 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e3d16af9-3a78-46b7-8d8b-62343cd48f89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.603448 Oct 29 03:03:49.075525 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2088/4159] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 03:03:48 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:49.090760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25f7bdf6-779c-40cd-8016-a5f39cb6b160 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:49.099846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25f7bdf6-779c-40cd-8016-a5f39cb6b160 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:49.100224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.compute.servers [None req-25f7bdf6-779c-40cd-8016-a5f39cb6b160 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Removing options 'limit' from query {{(pid=127041) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 03:03:49.109844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25f7bdf6-779c-40cd-8016-a5f39cb6b160 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:03:49.123893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f7bdf6-779c-40cd-8016-a5f39cb6b160 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:49.124537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f7bdf6-779c-40cd-8016-a5f39cb6b160 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:49.125113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f7bdf6-779c-40cd-8016-a5f39cb6b160 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.126114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f7bdf6-779c-40cd-8016-a5f39cb6b160 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:49.126720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f7bdf6-779c-40cd-8016-a5f39cb6b160 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:49.127330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f7bdf6-779c-40cd-8016-a5f39cb6b160 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.210048 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25f7bdf6-779c-40cd-8016-a5f39cb6b160 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.122871 Oct 29 03:03:49.218551 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2072/4160] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Oct 29 03:03:49 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:49.223663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c2d2c81-6fda-4784-8a27-451b0301bbd7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:49.229353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c2d2c81-6fda-4784-8a27-451b0301bbd7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:49.230050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c2d2c81-6fda-4784-8a27-451b0301bbd7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-200701745', 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:03:49.245978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c2d2c81-6fda-4784-8a27-451b0301bbd7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:49.246455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c2d2c81-6fda-4784-8a27-451b0301bbd7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:49.246878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c2d2c81-6fda-4784-8a27-451b0301bbd7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.247590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c2d2c81-6fda-4784-8a27-451b0301bbd7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:49.248023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c2d2c81-6fda-4784-8a27-451b0301bbd7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:49.248431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c2d2c81-6fda-4784-8a27-451b0301bbd7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.465432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-2c2d2c81-6fda-4784-8a27-451b0301bbd7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:03:49.477962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:49.664878 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c2d2c81-6fda-4784-8a27-451b0301bbd7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-200701745" status: 200 len: 345 microversion: 2.1 time: 0.445149 Oct 29 03:03:49.672498 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2089/4161] 10.222.0.16 () {58 vars in 1240 bytes} [Sat Oct 29 03:03:49 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-200701745 => generated 345 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:03:49.685517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2b485ee3-e224-4931-a6b8-15a1f25900c1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:49.705967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b485ee3-e224-4931-a6b8-15a1f25900c1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:49.706441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b485ee3-e224-4931-a6b8-15a1f25900c1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:49.726051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b485ee3-e224-4931-a6b8-15a1f25900c1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.730526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-741b93ee-74de-44a2-a845-6ebcd6d35b9d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:49.731290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-741b93ee-74de-44a2-a845-6ebcd6d35b9d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:49.744651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741b93ee-74de-44a2-a845-6ebcd6d35b9d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:49.746218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741b93ee-74de-44a2-a845-6ebcd6d35b9d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:49.747210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741b93ee-74de-44a2-a845-6ebcd6d35b9d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.748697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741b93ee-74de-44a2-a845-6ebcd6d35b9d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:49.749407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741b93ee-74de-44a2-a845-6ebcd6d35b9d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:49.750126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-741b93ee-74de-44a2-a845-6ebcd6d35b9d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.939179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-741b93ee-74de-44a2-a845-6ebcd6d35b9d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:49.948977 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-741b93ee-74de-44a2-a845-6ebcd6d35b9d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1251 microversion: 2.1 time: 0.222717 Oct 29 03:03:49.970626 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2090/4162] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:49 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1251 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:50.029240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2b485ee3-e224-4931-a6b8-15a1f25900c1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Going to try to stop instance {{(pid=127041) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:03:50.120773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1448035402", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddb54ae3-7305-4ded-8923-bc026bdef80c"}], "security_groups": [{"name": "tempest-securitygroup--1719789816"}], "key_name": "tempest-keypair-1253269865", "user_data": "}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:50.152418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:50.213739 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2b485ee3-e224-4931-a6b8-15a1f25900c1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "POST /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984/action" status: 202 len: 0 microversion: 2.1 time: 0.525733 Oct 29 03:03:50.217471 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2073/4163] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:03:49 2022] POST /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:03:50.238935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f10a63b0-0d4e-41bb-ba68-40a2fd78922e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:50.242527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f10a63b0-0d4e-41bb-ba68-40a2fd78922e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:50.267878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f10a63b0-0d4e-41bb-ba68-40a2fd78922e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:50.270716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f10a63b0-0d4e-41bb-ba68-40a2fd78922e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:50.271240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f10a63b0-0d4e-41bb-ba68-40a2fd78922e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:50.272050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f10a63b0-0d4e-41bb-ba68-40a2fd78922e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:50.276097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f10a63b0-0d4e-41bb-ba68-40a2fd78922e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:50.277255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f10a63b0-0d4e-41bb-ba68-40a2fd78922e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:50.479830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] validate_networks() for [('ddb54ae3-7305-4ded-8923-bc026bdef80c', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:03:51.257545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:03:51.258295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:03:51.258918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:03:51.259513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:03:51.260621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:03:51.272960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:51.273690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:51.274388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:51.275311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:51.275976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:51.276538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:51.308384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Getting quotas for project 3ef09834b750437e9fa350df7b4bb0f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:03:51.314856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Getting quotas for user 801730a89d33490d8d6f425f20ce5b1d and project 3ef09834b750437e9fa350df7b4bb0f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:03:51.351763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:03:51.361876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:03:51.449260 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c37512ca-df54-4531-b3e0-494898266bae tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.341862 Oct 29 03:03:51.450586 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2091/4164] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 03:03:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:03:51.456466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b401b439-7834-40f7-945e-6ac229787a03 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:51.457416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b401b439-7834-40f7-945e-6ac229787a03 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:51.465354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b401b439-7834-40f7-945e-6ac229787a03 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:51.466275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b401b439-7834-40f7-945e-6ac229787a03 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:51.466861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b401b439-7834-40f7-945e-6ac229787a03 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:51.468023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b401b439-7834-40f7-945e-6ac229787a03 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:51.468657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b401b439-7834-40f7-945e-6ac229787a03 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:51.469606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b401b439-7834-40f7-945e-6ac229787a03 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:51.740239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f10a63b0-0d4e-41bb-ba68-40a2fd78922e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:51.753550 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f10a63b0-0d4e-41bb-ba68-40a2fd78922e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1521 microversion: 2.1 time: 1.527984 Oct 29 03:03:51.754938 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2074/4165] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:50 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1521 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:51.765166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-91e13dd2-b9f8-4d6c-bfd9-23415871f2eb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:51.768738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-91e13dd2-b9f8-4d6c-bfd9-23415871f2eb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:51.886487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b401b439-7834-40f7-945e-6ac229787a03 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:51.897192 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b401b439-7834-40f7-945e-6ac229787a03 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1293 microversion: 2.1 time: 0.444981 Oct 29 03:03:51.903010 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2092/4166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:51 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1293 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:52.136307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-91e13dd2-b9f8-4d6c-bfd9-23415871f2eb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:52.144780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-91e13dd2-b9f8-4d6c-bfd9-23415871f2eb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:52.155995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-91e13dd2-b9f8-4d6c-bfd9-23415871f2eb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:52.157395 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-91e13dd2-b9f8-4d6c-bfd9-23415871f2eb tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1282 microversion: 2.20 time: 0.400993 Oct 29 03:03:52.161934 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2075/4167] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:51 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1282 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:52.785780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-df77a613-d142-4c4e-9c61-c109975e2874 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:52.786894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-df77a613-d142-4c4e-9c61-c109975e2874 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:52.810506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df77a613-d142-4c4e-9c61-c109975e2874 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:52.811368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df77a613-d142-4c4e-9c61-c109975e2874 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:52.812186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df77a613-d142-4c4e-9c61-c109975e2874 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:52.814147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df77a613-d142-4c4e-9c61-c109975e2874 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:52.815974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df77a613-d142-4c4e-9c61-c109975e2874 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:52.824058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df77a613-d142-4c4e-9c61-c109975e2874 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:52.934571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6649a211-e5d5-41aa-a4e6-38050f45bf85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:52.935934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6649a211-e5d5-41aa-a4e6-38050f45bf85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:52.959404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6649a211-e5d5-41aa-a4e6-38050f45bf85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:52.962180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6649a211-e5d5-41aa-a4e6-38050f45bf85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:52.963368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6649a211-e5d5-41aa-a4e6-38050f45bf85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:52.966889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6649a211-e5d5-41aa-a4e6-38050f45bf85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:52.967362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6649a211-e5d5-41aa-a4e6-38050f45bf85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:52.968561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6649a211-e5d5-41aa-a4e6-38050f45bf85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:53.098053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-df77a613-d142-4c4e-9c61-c109975e2874 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:53.108052 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-df77a613-d142-4c4e-9c61-c109975e2874 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1521 microversion: 2.1 time: 0.328551 Oct 29 03:03:53.114492 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2093/4168] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:52 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:53.183473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:53.184185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:53.198026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:53.198959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:53.199669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:53.206275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:53.207053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:53.207629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:53.359050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:53.374481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:53.377151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:53.383905 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fffe27f8-a1d7-43c8-9322-e6f7c4d761b3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1278 microversion: 2.20 time: 0.205164 Oct 29 03:03:53.386945 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2094/4169] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:53 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:03:53.818543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-241880012", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:53.927826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] validate_networks() for [('58a9eca5-efd9-4c67-9627-237802e0f75c', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:03:54.216461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6649a211-e5d5-41aa-a4e6-38050f45bf85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:54.231974 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6649a211-e5d5-41aa-a4e6-38050f45bf85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1293 microversion: 2.1 time: 1.303773 Oct 29 03:03:54.233133 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2076/4170] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:52 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1293 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:54.245820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e955eae3-96c4-4e07-8af7-b2e64cce8abb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:54.249213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e955eae3-96c4-4e07-8af7-b2e64cce8abb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:54.269705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e955eae3-96c4-4e07-8af7-b2e64cce8abb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:54.271355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e955eae3-96c4-4e07-8af7-b2e64cce8abb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:54.282886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e955eae3-96c4-4e07-8af7-b2e64cce8abb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:54.284020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e955eae3-96c4-4e07-8af7-b2e64cce8abb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:54.284735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e955eae3-96c4-4e07-8af7-b2e64cce8abb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:54.285381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e955eae3-96c4-4e07-8af7-b2e64cce8abb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:54.828652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:03:54.830107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:03:54.830887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:03:54.831896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:03:54.832666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:03:54.847324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:54.852836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:54.853601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:54.854794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:54.857209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:54.869693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:54.886717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e955eae3-96c4-4e07-8af7-b2e64cce8abb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:54.907045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Getting quotas for project 70b925f5ecdb42e7a2f410c41f9f9cfc. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:03:54.912854 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e955eae3-96c4-4e07-8af7-b2e64cce8abb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1521 microversion: 2.1 time: 0.673962 Oct 29 03:03:54.919874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Getting quotas for user 9d1b1de72f9d4fd3b3165588054a0a90 and project 70b925f5ecdb42e7a2f410c41f9f9cfc. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:03:54.932475 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2077/4171] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:54 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1521 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:54.944859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:54.945989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:54.962016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:03:54.967940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:03:54.973425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:54.974488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:54.976724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:54.979843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:54.981006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:54.982630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.149962 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7c0f0535-5c9f-4944-9fdc-ace2897e0294 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454531 Oct 29 03:03:55.160390 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2095/4172] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:03:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:03:55.172679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c3f53666-4b1a-444b-9c23-9584edfc770c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:55.174504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c3f53666-4b1a-444b-9c23-9584edfc770c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:55.401194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c3f53666-4b1a-444b-9c23-9584edfc770c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:55.409565 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c3f53666-4b1a-444b-9c23-9584edfc770c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1216 microversion: 2.1 time: 0.247991 Oct 29 03:03:55.427149 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2096/4173] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:55 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1216 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:55.444329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f31205a3-78f7-443a-a7b8-cf152514fcc5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:55.444932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f31205a3-78f7-443a-a7b8-cf152514fcc5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:55.467733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f31205a3-78f7-443a-a7b8-cf152514fcc5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.484146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f31205a3-78f7-443a-a7b8-cf152514fcc5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.484316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f31205a3-78f7-443a-a7b8-cf152514fcc5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.485502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f31205a3-78f7-443a-a7b8-cf152514fcc5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.498161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f31205a3-78f7-443a-a7b8-cf152514fcc5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.498799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f31205a3-78f7-443a-a7b8-cf152514fcc5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.515498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:55.525278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:55.540802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:55.547203 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cfa8d81c-767d-43ea-9471-4fa9d2050cee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1340 microversion: 2.20 time: 0.613385 Oct 29 03:03:55.550116 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2078/4174] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:54 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1340 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:55.945630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37f1aab7-9524-4216-a368-e1434774b507 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:55.946500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37f1aab7-9524-4216-a368-e1434774b507 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:55.963718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f31205a3-78f7-443a-a7b8-cf152514fcc5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:55.974242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37f1aab7-9524-4216-a368-e1434774b507 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.975069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37f1aab7-9524-4216-a368-e1434774b507 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.976482 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f31205a3-78f7-443a-a7b8-cf152514fcc5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1293 microversion: 2.1 time: 0.548140 Oct 29 03:03:55.979288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37f1aab7-9524-4216-a368-e1434774b507 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.979749 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2097/4175] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:55 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1293 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:55.982147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37f1aab7-9524-4216-a368-e1434774b507 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.983176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37f1aab7-9524-4216-a368-e1434774b507 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.987488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37f1aab7-9524-4216-a368-e1434774b507 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:56.440997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d1c82df4-dc98-440a-bb75-a17efffed3f2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:56.441846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d1c82df4-dc98-440a-bb75-a17efffed3f2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:56.452670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37f1aab7-9524-4216-a368-e1434774b507 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:56.462846 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37f1aab7-9524-4216-a368-e1434774b507 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1521 microversion: 2.1 time: 0.521981 Oct 29 03:03:56.468545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c82df4-dc98-440a-bb75-a17efffed3f2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:56.498173 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2079/4176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:55 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1521 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:56.498952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c82df4-dc98-440a-bb75-a17efffed3f2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:56.499408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c82df4-dc98-440a-bb75-a17efffed3f2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:56.500202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c82df4-dc98-440a-bb75-a17efffed3f2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:56.500802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c82df4-dc98-440a-bb75-a17efffed3f2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:56.501229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c82df4-dc98-440a-bb75-a17efffed3f2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:56.582365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:56.583005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:56.597153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:56.597645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:56.609163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:56.610002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:56.610479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:56.610903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:56.756694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1c82df4-dc98-440a-bb75-a17efffed3f2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:56.765079 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d1c82df4-dc98-440a-bb75-a17efffed3f2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1220 microversion: 2.1 time: 0.330873 Oct 29 03:03:56.768184 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2098/4177] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:56 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1220 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:56.783576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-7333246a-f518-4638-8e4f-9e166689b910 req-f9043ed4-1917-4fe3-beb0-dced73587019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aef61b2-712e-4f92-a0f4-161ebe964609", "tag": "fda11e41-7f15-4760-9834-d65bf8eed0f5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:56.804385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7333246a-f518-4638-8e4f-9e166689b910 req-f9043ed4-1917-4fe3-beb0-dced73587019 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:56.807122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7333246a-f518-4638-8e4f-9e166689b910 req-f9043ed4-1917-4fe3-beb0-dced73587019 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:56.807567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7333246a-f518-4638-8e4f-9e166689b910 req-f9043ed4-1917-4fe3-beb0-dced73587019 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:56.833662 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-7333246a-f518-4638-8e4f-9e166689b910 req-f9043ed4-1917-4fe3-beb0-dced73587019 service nova] Creating event network-changed:fda11e41-7f15-4760-9834-d65bf8eed0f5 for instance 3aef61b2-712e-4f92-a0f4-161ebe964609 on n-h1-862964-4 Oct 29 03:03:56.851727 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-7333246a-f518-4638-8e4f-9e166689b910 req-f9043ed4-1917-4fe3-beb0-dced73587019 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082017 Oct 29 03:03:56.854058 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2099/4178] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:57.008777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c1cae60-d5d4-416f-a437-88e128cb378b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:57.010169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c1cae60-d5d4-416f-a437-88e128cb378b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:57.013959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:57.025602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:57.045364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1cae60-d5d4-416f-a437-88e128cb378b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:57.051195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1cae60-d5d4-416f-a437-88e128cb378b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:57.051786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1cae60-d5d4-416f-a437-88e128cb378b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:57.051980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:57.052767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1cae60-d5d4-416f-a437-88e128cb378b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:57.053240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1cae60-d5d4-416f-a437-88e128cb378b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:57.053671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1cae60-d5d4-416f-a437-88e128cb378b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:57.062114 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-00f67270-99d8-437a-b733-24eec58862a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1340 microversion: 2.20 time: 0.480348 Oct 29 03:03:57.063432 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2080/4179] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:56 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1340 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:57.474115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c1cae60-d5d4-416f-a437-88e128cb378b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:57.488282 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c1cae60-d5d4-416f-a437-88e128cb378b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1293 microversion: 2.1 time: 0.485153 Oct 29 03:03:57.498344 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2100/4180] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:57 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1293 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:57.520294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89851281-5581-4b08-bba0-50b643315a37 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:57.521027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89851281-5581-4b08-bba0-50b643315a37 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:57.551185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89851281-5581-4b08-bba0-50b643315a37 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:57.552877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89851281-5581-4b08-bba0-50b643315a37 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:57.553795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89851281-5581-4b08-bba0-50b643315a37 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:57.556029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89851281-5581-4b08-bba0-50b643315a37 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:57.573530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89851281-5581-4b08-bba0-50b643315a37 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:57.576408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89851281-5581-4b08-bba0-50b643315a37 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:57.823440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-531bff9d-e91d-4090-8ff6-d757c9ee7a4a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:57.824205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-531bff9d-e91d-4090-8ff6-d757c9ee7a4a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:57.850942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-531bff9d-e91d-4090-8ff6-d757c9ee7a4a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:57.853264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-531bff9d-e91d-4090-8ff6-d757c9ee7a4a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:57.855192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-531bff9d-e91d-4090-8ff6-d757c9ee7a4a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:57.856185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-531bff9d-e91d-4090-8ff6-d757c9ee7a4a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:57.861302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-531bff9d-e91d-4090-8ff6-d757c9ee7a4a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:57.868775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-531bff9d-e91d-4090-8ff6-d757c9ee7a4a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:58.018218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-531bff9d-e91d-4090-8ff6-d757c9ee7a4a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:58.028411 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-531bff9d-e91d-4090-8ff6-d757c9ee7a4a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1276 microversion: 2.1 time: 0.240923 Oct 29 03:03:58.036841 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2101/4181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:57 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:58.095243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:58.096101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:58.108694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:58.109396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:58.113079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:58.115545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:58.116273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:58.116918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:58.447658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:58.465634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:58.474086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:58.479803 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-67b4f48c-ba90-4741-91b4-19db28a2f015 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.390457 Oct 29 03:03:58.480581 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2102/4182] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:58 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:58.523962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-93e204bd-e780-45e0-83eb-07a5ed5fdd07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:58.525059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-93e204bd-e780-45e0-83eb-07a5ed5fdd07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:58.541276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93e204bd-e780-45e0-83eb-07a5ed5fdd07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:58.543638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93e204bd-e780-45e0-83eb-07a5ed5fdd07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:58.544904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93e204bd-e780-45e0-83eb-07a5ed5fdd07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:58.548043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93e204bd-e780-45e0-83eb-07a5ed5fdd07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:58.548824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93e204bd-e780-45e0-83eb-07a5ed5fdd07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:58.549617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93e204bd-e780-45e0-83eb-07a5ed5fdd07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:58.911298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-93e204bd-e780-45e0-83eb-07a5ed5fdd07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:58.919385 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-93e204bd-e780-45e0-83eb-07a5ed5fdd07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1293 microversion: 2.1 time: 0.400369 Oct 29 03:03:58.934760 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2103/4183] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:58 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1293 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:58.949607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5cc4a4fe-60d2-4d0e-86e2-5c55d700f86e tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b2d19af-6952-4ade-9fb8-0da8f7ac1a31"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:58.957644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5cc4a4fe-60d2-4d0e-86e2-5c55d700f86e tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:58.974710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc4a4fe-60d2-4d0e-86e2-5c55d700f86e tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:58.978096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc4a4fe-60d2-4d0e-86e2-5c55d700f86e tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:58.978681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc4a4fe-60d2-4d0e-86e2-5c55d700f86e tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:58.980373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc4a4fe-60d2-4d0e-86e2-5c55d700f86e tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:58.981022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc4a4fe-60d2-4d0e-86e2-5c55d700f86e tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:58.982123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc4a4fe-60d2-4d0e-86e2-5c55d700f86e tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:59.092288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-89851281-5581-4b08-bba0-50b643315a37 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:59.106929 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89851281-5581-4b08-bba0-50b643315a37 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1521 microversion: 2.1 time: 1.608280 Oct 29 03:03:59.107543 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2081/4184] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:57 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1521 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:59.125752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fe6caf44-2297-46b3-8f20-854368901649 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:59.134621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fe6caf44-2297-46b3-8f20-854368901649 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:59.151823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6caf44-2297-46b3-8f20-854368901649 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:59.153394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6caf44-2297-46b3-8f20-854368901649 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:59.154739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6caf44-2297-46b3-8f20-854368901649 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:59.156744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6caf44-2297-46b3-8f20-854368901649 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:59.160106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6caf44-2297-46b3-8f20-854368901649 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:59.160748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6caf44-2297-46b3-8f20-854368901649 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:59.163412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:59.295840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fe6caf44-2297-46b3-8f20-854368901649 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:59.311705 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fe6caf44-2297-46b3-8f20-854368901649 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1274 microversion: 2.1 time: 0.197455 Oct 29 03:03:59.314114 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2082/4185] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:59 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:59.510924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:59.512800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:59.525077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:59.525856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:59.527652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:59.528756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:59.529585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:59.530432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:59.545422 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5cc4a4fe-60d2-4d0e-86e2-5c55d700f86e tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "POST /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.602145 Oct 29 03:03:59.551174 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2104/4186] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:03:58 2022] POST /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-volume_attachments => generated 194 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:59.966910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-814f17ba-2dc2-46b9-84eb-ed74086f3061 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:59.968140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-814f17ba-2dc2-46b9-84eb-ed74086f3061 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:00.002887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814f17ba-2dc2-46b9-84eb-ed74086f3061 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:00.003652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814f17ba-2dc2-46b9-84eb-ed74086f3061 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:00.004098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814f17ba-2dc2-46b9-84eb-ed74086f3061 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:00.004822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814f17ba-2dc2-46b9-84eb-ed74086f3061 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:00.005265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814f17ba-2dc2-46b9-84eb-ed74086f3061 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:00.005688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814f17ba-2dc2-46b9-84eb-ed74086f3061 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:00.343711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-814f17ba-2dc2-46b9-84eb-ed74086f3061 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:00.352449 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-814f17ba-2dc2-46b9-84eb-ed74086f3061 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1293 microversion: 2.1 time: 0.390887 Oct 29 03:04:00.353040 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2105/4187] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:59 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1293 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:00.365937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-802abbe9-5537-425e-9761-f71b04ee6278 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:00.369328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-802abbe9-5537-425e-9761-f71b04ee6278 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:00.380571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-802abbe9-5537-425e-9761-f71b04ee6278 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:00.386375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-802abbe9-5537-425e-9761-f71b04ee6278 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:00.387048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-802abbe9-5537-425e-9761-f71b04ee6278 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:00.387949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-802abbe9-5537-425e-9761-f71b04ee6278 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:00.388684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-802abbe9-5537-425e-9761-f71b04ee6278 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:00.389269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-802abbe9-5537-425e-9761-f71b04ee6278 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:00.438256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:00.447461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:00.455530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:00.457786 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cf15a91b-255a-4d24-a837-7ac0c5c55c50 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.951714 Oct 29 03:04:00.459929 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2083/4188] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:59 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:00.492180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1baaa2e2-feb1-4455-9ae9-1b7efa1a9c9d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:00.493819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1baaa2e2-feb1-4455-9ae9-1b7efa1a9c9d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:00.512716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1baaa2e2-feb1-4455-9ae9-1b7efa1a9c9d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:00.530563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1baaa2e2-feb1-4455-9ae9-1b7efa1a9c9d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:00.531031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1baaa2e2-feb1-4455-9ae9-1b7efa1a9c9d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:00.531844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1baaa2e2-feb1-4455-9ae9-1b7efa1a9c9d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:00.532459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1baaa2e2-feb1-4455-9ae9-1b7efa1a9c9d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:00.533045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1baaa2e2-feb1-4455-9ae9-1b7efa1a9c9d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:00.599863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:00.689647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-802abbe9-5537-425e-9761-f71b04ee6278 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:00.701659 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-802abbe9-5537-425e-9761-f71b04ee6278 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1521 microversion: 2.1 time: 0.347571 Oct 29 03:04:00.703394 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2106/4189] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:00 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:01.384694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-321dc504-2cbb-4d0e-be05-cebf62fab693 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:01.386308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-321dc504-2cbb-4d0e-be05-cebf62fab693 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:01.410159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-321dc504-2cbb-4d0e-be05-cebf62fab693 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.411102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-321dc504-2cbb-4d0e-be05-cebf62fab693 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.414941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-321dc504-2cbb-4d0e-be05-cebf62fab693 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.421508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-321dc504-2cbb-4d0e-be05-cebf62fab693 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.426363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-321dc504-2cbb-4d0e-be05-cebf62fab693 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.430386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-321dc504-2cbb-4d0e-be05-cebf62fab693 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.521509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:01.562198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1baaa2e2-feb1-4455-9ae9-1b7efa1a9c9d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:01.576996 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1baaa2e2-feb1-4455-9ae9-1b7efa1a9c9d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1316 microversion: 2.1 time: 1.110198 Oct 29 03:04:01.580934 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2084/4190] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:00 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1316 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:01.606458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:01.610371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:01.625851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.627275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.628649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.629647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.630790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.632179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.809301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-321dc504-2cbb-4d0e-be05-cebf62fab693 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:01.821212 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-321dc504-2cbb-4d0e-be05-cebf62fab693 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1293 microversion: 2.1 time: 0.439722 Oct 29 03:04:01.822414 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2107/4191] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:01 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1293 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:01.827857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f633c1b1-c863-4b83-b743-f07d440f5e5d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:01.829666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f633c1b1-c863-4b83-b743-f07d440f5e5d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:01.837817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f633c1b1-c863-4b83-b743-f07d440f5e5d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.838690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f633c1b1-c863-4b83-b743-f07d440f5e5d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.839374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f633c1b1-c863-4b83-b743-f07d440f5e5d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.841413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f633c1b1-c863-4b83-b743-f07d440f5e5d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.842136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f633c1b1-c863-4b83-b743-f07d440f5e5d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.842762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f633c1b1-c863-4b83-b743-f07d440f5e5d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:02.036531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f633c1b1-c863-4b83-b743-f07d440f5e5d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:02.047773 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f633c1b1-c863-4b83-b743-f07d440f5e5d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1498 microversion: 2.1 time: 0.223905 Oct 29 03:04:02.051254 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2108/4192] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:01 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1498 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:02.082309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98d962b0-e094-4286-a2ee-ef4b9d1d5348 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:02.092719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-98d962b0-e094-4286-a2ee-ef4b9d1d5348 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:02.093785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-98d962b0-e094-4286-a2ee-ef4b9d1d5348 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:04:02.109700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98d962b0-e094-4286-a2ee-ef4b9d1d5348 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:02.111442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98d962b0-e094-4286-a2ee-ef4b9d1d5348 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:02.112258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98d962b0-e094-4286-a2ee-ef4b9d1d5348 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:02.115564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98d962b0-e094-4286-a2ee-ef4b9d1d5348 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:02.116097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98d962b0-e094-4286-a2ee-ef4b9d1d5348 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:02.116595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98d962b0-e094-4286-a2ee-ef4b9d1d5348 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:02.140450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:02.182375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-98d962b0-e094-4286-a2ee-ef4b9d1d5348 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:04:02.278225 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-98d962b0-e094-4286-a2ee-ef4b9d1d5348 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.201732 Oct 29 03:04:02.278932 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2109/4193] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Oct 29 03:04:02 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:02.292926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ca70880-2c76-4d0d-ab0e-d9460ae2a515 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:02.315075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ca70880-2c76-4d0d-ab0e-d9460ae2a515 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:02.315567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ca70880-2c76-4d0d-ab0e-d9460ae2a515 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:02.316000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ca70880-2c76-4d0d-ab0e-d9460ae2a515 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:02.374821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1ca70880-2c76-4d0d-ab0e-d9460ae2a515 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Going to try to start instance {{(pid=127042) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:04:02.455379 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ca70880-2c76-4d0d-ab0e-d9460ae2a515 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "POST /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984/action" status: 202 len: 0 microversion: 2.1 time: 0.167620 Oct 29 03:04:02.458864 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2110/4194] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:04:02 2022] POST /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:04:02.484268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-80822506-b1bc-4822-89c7-e3b27db3744d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:02.486924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-80822506-b1bc-4822-89c7-e3b27db3744d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:02.502851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80822506-b1bc-4822-89c7-e3b27db3744d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:02.502851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80822506-b1bc-4822-89c7-e3b27db3744d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:02.503184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80822506-b1bc-4822-89c7-e3b27db3744d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:02.506054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80822506-b1bc-4822-89c7-e3b27db3744d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:02.507084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80822506-b1bc-4822-89c7-e3b27db3744d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:02.507084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80822506-b1bc-4822-89c7-e3b27db3744d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:02.977144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-80822506-b1bc-4822-89c7-e3b27db3744d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:02.989117 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-80822506-b1bc-4822-89c7-e3b27db3744d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1507 microversion: 2.1 time: 0.525245 Oct 29 03:04:02.991240 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2111/4195] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:02 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1507 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:03.005832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f0eee5c6-90fc-4590-b405-edd8b0755a48 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:03.013290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f0eee5c6-90fc-4590-b405-edd8b0755a48 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:03.036331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eee5c6-90fc-4590-b405-edd8b0755a48 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:03.036816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eee5c6-90fc-4590-b405-edd8b0755a48 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:03.037397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eee5c6-90fc-4590-b405-edd8b0755a48 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:03.054829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eee5c6-90fc-4590-b405-edd8b0755a48 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:03.060684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eee5c6-90fc-4590-b405-edd8b0755a48 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:03.063063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eee5c6-90fc-4590-b405-edd8b0755a48 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:03.185216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:03.206203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:03.221354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:03.225844 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b0be2880-6e64-43d3-aa3e-f52adf736cde tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 1.635892 Oct 29 03:04:03.228112 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2085/4196] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:01 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:03.239052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d245a772-a6dd-4791-aea2-e5112403d2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:03.247541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d245a772-a6dd-4791-aea2-e5112403d2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:03.250490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=66 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:03.270517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d245a772-a6dd-4791-aea2-e5112403d2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:03.271363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d245a772-a6dd-4791-aea2-e5112403d2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:03.272945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d245a772-a6dd-4791-aea2-e5112403d2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:03.274600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d245a772-a6dd-4791-aea2-e5112403d2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:03.276684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d245a772-a6dd-4791-aea2-e5112403d2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:03.279492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d245a772-a6dd-4791-aea2-e5112403d2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:03.564685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f0eee5c6-90fc-4590-b405-edd8b0755a48 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:03.598036 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f0eee5c6-90fc-4590-b405-edd8b0755a48 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1316 microversion: 2.1 time: 0.596088 Oct 29 03:04:03.613953 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2112/4197] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:02 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:03.929221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-329c48db-3afc-4a34-9bad-0ea45e548ad6 req-6f30734d-d554-4fdc-a7d1-623b95cf0a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aef61b2-712e-4f92-a0f4-161ebe964609", "name": "network-vif-plugged", "status": "completed", "tag": "fda11e41-7f15-4760-9834-d65bf8eed0f5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:03.950194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-329c48db-3afc-4a34-9bad-0ea45e548ad6 req-6f30734d-d554-4fdc-a7d1-623b95cf0a73 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:03.950784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-329c48db-3afc-4a34-9bad-0ea45e548ad6 req-6f30734d-d554-4fdc-a7d1-623b95cf0a73 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:03.951214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-329c48db-3afc-4a34-9bad-0ea45e548ad6 req-6f30734d-d554-4fdc-a7d1-623b95cf0a73 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:03.963005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d245a772-a6dd-4791-aea2-e5112403d2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:03.979170 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d245a772-a6dd-4791-aea2-e5112403d2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1293 microversion: 2.1 time: 0.748336 Oct 29 03:04:03.981984 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2086/4198] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:03 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1293 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:03.982922 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-329c48db-3afc-4a34-9bad-0ea45e548ad6 req-6f30734d-d554-4fdc-a7d1-623b95cf0a73 service nova] Creating event network-vif-plugged:fda11e41-7f15-4760-9834-d65bf8eed0f5 for instance 3aef61b2-712e-4f92-a0f4-161ebe964609 on n-h1-862964-4 Oct 29 03:04:03.995071 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-329c48db-3afc-4a34-9bad-0ea45e548ad6 req-6f30734d-d554-4fdc-a7d1-623b95cf0a73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073870 Oct 29 03:04:03.995860 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2113/4199] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:04:04.014574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-12461041-94ad-484c-bf88-1dff3cc25b64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:04.015206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-12461041-94ad-484c-bf88-1dff3cc25b64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:04.027554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12461041-94ad-484c-bf88-1dff3cc25b64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:04.028322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12461041-94ad-484c-bf88-1dff3cc25b64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:04.033246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12461041-94ad-484c-bf88-1dff3cc25b64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.037191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12461041-94ad-484c-bf88-1dff3cc25b64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:04.037787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12461041-94ad-484c-bf88-1dff3cc25b64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:04.038261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-12461041-94ad-484c-bf88-1dff3cc25b64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.262954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:04.263644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:04.279534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:04.280031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:04.280471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.283060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:04.283464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:04.286889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.475467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-12461041-94ad-484c-bf88-1dff3cc25b64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:04.489131 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-12461041-94ad-484c-bf88-1dff3cc25b64 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1507 microversion: 2.1 time: 0.478992 Oct 29 03:04:04.496672 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2087/4200] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:04 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:04.515092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9abe6f6a-ce44-4256-8e09-c2c0be7a8664 req-920ae276-c862-4c4f-aff3-39919fff68c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f439b2b6-1302-414a-93d3-f162321fd6c6", "tag": "291472dd-c560-4f62-ae19-0af367acb98e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:04.547182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9abe6f6a-ce44-4256-8e09-c2c0be7a8664 req-920ae276-c862-4c4f-aff3-39919fff68c8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:04.548429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9abe6f6a-ce44-4256-8e09-c2c0be7a8664 req-920ae276-c862-4c4f-aff3-39919fff68c8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:04.549011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9abe6f6a-ce44-4256-8e09-c2c0be7a8664 req-920ae276-c862-4c4f-aff3-39919fff68c8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.577730 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9abe6f6a-ce44-4256-8e09-c2c0be7a8664 req-920ae276-c862-4c4f-aff3-39919fff68c8 service nova] Creating event network-changed:291472dd-c560-4f62-ae19-0af367acb98e for instance f439b2b6-1302-414a-93d3-f162321fd6c6 on n-h1-862964-4 Oct 29 03:04:04.591971 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9abe6f6a-ce44-4256-8e09-c2c0be7a8664 req-920ae276-c862-4c4f-aff3-39919fff68c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096227 Oct 29 03:04:04.601189 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2088/4201] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:04.621876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e7d35eb8-de1b-407a-9c53-3ba63206a365 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:04.622914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e7d35eb8-de1b-407a-9c53-3ba63206a365 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:04.635277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7d35eb8-de1b-407a-9c53-3ba63206a365 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:04.636096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7d35eb8-de1b-407a-9c53-3ba63206a365 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:04.636731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7d35eb8-de1b-407a-9c53-3ba63206a365 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.642459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7d35eb8-de1b-407a-9c53-3ba63206a365 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:04.643209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7d35eb8-de1b-407a-9c53-3ba63206a365 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:04.644532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7d35eb8-de1b-407a-9c53-3ba63206a365 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.652918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:04.674142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:04.677031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:04.678425 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6605764f-bc17-478b-bf43-1f1f1afdb679 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.419755 Oct 29 03:04:04.679453 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2114/4202] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:04 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:04:04.831112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6b2b39b4-5ac7-4eaf-b6a4-3e83bb1b5bf4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:04.832076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6b2b39b4-5ac7-4eaf-b6a4-3e83bb1b5bf4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:04.848459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b2b39b4-5ac7-4eaf-b6a4-3e83bb1b5bf4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:04.848938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b2b39b4-5ac7-4eaf-b6a4-3e83bb1b5bf4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:04.850719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b2b39b4-5ac7-4eaf-b6a4-3e83bb1b5bf4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.851455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b2b39b4-5ac7-4eaf-b6a4-3e83bb1b5bf4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:04.852065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b2b39b4-5ac7-4eaf-b6a4-3e83bb1b5bf4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:04.852485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b2b39b4-5ac7-4eaf-b6a4-3e83bb1b5bf4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.992184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e7d35eb8-de1b-407a-9c53-3ba63206a365 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:05.004387 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e7d35eb8-de1b-407a-9c53-3ba63206a365 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1316 microversion: 2.1 time: 0.387349 Oct 29 03:04:05.005019 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2089/4203] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:04 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:05.011430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af4c5fbe-e0a5-4156-a4b0-472990befff5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:05.012281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-af4c5fbe-e0a5-4156-a4b0-472990befff5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:05.020130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbe-e0a5-4156-a4b0-472990befff5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.020839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbe-e0a5-4156-a4b0-472990befff5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.031836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbe-e0a5-4156-a4b0-472990befff5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.033327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbe-e0a5-4156-a4b0-472990befff5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.033990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbe-e0a5-4156-a4b0-472990befff5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.042794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af4c5fbe-e0a5-4156-a4b0-472990befff5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.044288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6b2b39b4-5ac7-4eaf-b6a4-3e83bb1b5bf4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:05.056943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6b2b39b4-5ac7-4eaf-b6a4-3e83bb1b5bf4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.229800 Oct 29 03:04:05.074823 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2115/4204] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:04 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:05.084787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b2f6697-961d-4a37-9a68-9b40fcf3270d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1902705450"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:05.087910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b2f6697-961d-4a37-9a68-9b40fcf3270d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:05.096308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2f6697-961d-4a37-9a68-9b40fcf3270d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.097151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2f6697-961d-4a37-9a68-9b40fcf3270d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.097820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2f6697-961d-4a37-9a68-9b40fcf3270d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.099435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2f6697-961d-4a37-9a68-9b40fcf3270d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.100094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2f6697-961d-4a37-9a68-9b40fcf3270d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.100718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2f6697-961d-4a37-9a68-9b40fcf3270d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.341549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-af4c5fbe-e0a5-4156-a4b0-472990befff5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:05.351728 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af4c5fbe-e0a5-4156-a4b0-472990befff5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1293 microversion: 2.1 time: 0.345479 Oct 29 03:04:05.353026 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2090/4205] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:05 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1293 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:05.407623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=28 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:05.428307 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b2f6697-961d-4a37-9a68-9b40fcf3270d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.347483 Oct 29 03:04:05.429319 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2116/4206] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:04:05 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 29 03:04:05.437494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9e6aac2-6d2e-4f3a-b0e5-047831ddbe99 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:05.438393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c9e6aac2-6d2e-4f3a-b0e5-047831ddbe99 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:05.444409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9e6aac2-6d2e-4f3a-b0e5-047831ddbe99 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.444892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9e6aac2-6d2e-4f3a-b0e5-047831ddbe99 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.445327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9e6aac2-6d2e-4f3a-b0e5-047831ddbe99 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.446221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9e6aac2-6d2e-4f3a-b0e5-047831ddbe99 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.446672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9e6aac2-6d2e-4f3a-b0e5-047831ddbe99 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.447092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9e6aac2-6d2e-4f3a-b0e5-047831ddbe99 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.517704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd7cb8be-a588-4d15-b52d-6a7eaa7ffe3f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:05.518353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cd7cb8be-a588-4d15-b52d-6a7eaa7ffe3f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:05.538428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd7cb8be-a588-4d15-b52d-6a7eaa7ffe3f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.538931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd7cb8be-a588-4d15-b52d-6a7eaa7ffe3f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.539356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd7cb8be-a588-4d15-b52d-6a7eaa7ffe3f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.540059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd7cb8be-a588-4d15-b52d-6a7eaa7ffe3f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.540506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd7cb8be-a588-4d15-b52d-6a7eaa7ffe3f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.540922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd7cb8be-a588-4d15-b52d-6a7eaa7ffe3f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.775043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd7cb8be-a588-4d15-b52d-6a7eaa7ffe3f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:05.790209 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd7cb8be-a588-4d15-b52d-6a7eaa7ffe3f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1511 microversion: 2.1 time: 0.275813 Oct 29 03:04:05.791520 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2117/4207] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:05 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:05.799489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:05.800449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:05.809185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.814000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.814700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.815913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.817674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.818751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.829678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c9e6aac2-6d2e-4f3a-b0e5-047831ddbe99 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:05.847802 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c9e6aac2-6d2e-4f3a-b0e5-047831ddbe99 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.413992 Oct 29 03:04:05.848400 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2091/4208] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:05 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:05.879533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d54134d2-8580-4842-a4b4-cffd6d75445e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:05.887580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d54134d2-8580-4842-a4b4-cffd6d75445e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:05.888021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.compute.servers [None req-d54134d2-8580-4842-a4b4-cffd6d75445e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Removing options 'limit' from query {{(pid=127041) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 03:04:05.889066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d54134d2-8580-4842-a4b4-cffd6d75445e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:04:05.890360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d54134d2-8580-4842-a4b4-cffd6d75445e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.890865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d54134d2-8580-4842-a4b4-cffd6d75445e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.891322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d54134d2-8580-4842-a4b4-cffd6d75445e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.892094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d54134d2-8580-4842-a4b4-cffd6d75445e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.892542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d54134d2-8580-4842-a4b4-cffd6d75445e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.893060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d54134d2-8580-4842-a4b4-cffd6d75445e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.896398 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d54134d2-8580-4842-a4b4-cffd6d75445e tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.033106 Oct 29 03:04:05.908894 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2092/4209] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Oct 29 03:04:05 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:04:05.915785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-31275ea9-d5e9-48fd-aa71-904670dc9da9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:05.917204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-31275ea9-d5e9-48fd-aa71-904670dc9da9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:05.924578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31275ea9-d5e9-48fd-aa71-904670dc9da9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.925354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31275ea9-d5e9-48fd-aa71-904670dc9da9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.926334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31275ea9-d5e9-48fd-aa71-904670dc9da9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.927182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31275ea9-d5e9-48fd-aa71-904670dc9da9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.928685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31275ea9-d5e9-48fd-aa71-904670dc9da9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.929255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31275ea9-d5e9-48fd-aa71-904670dc9da9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.079126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.088344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.091097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.093294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d49de3f-3ff5-4697-b098-1387c79b2f65 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.300267 Oct 29 03:04:06.094921 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2118/4210] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:05 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:06.102969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-14a1aacc-53f6-45be-b23c-38f0cfee750f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:06.104005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-14a1aacc-53f6-45be-b23c-38f0cfee750f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:06.111257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14a1aacc-53f6-45be-b23c-38f0cfee750f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.111998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14a1aacc-53f6-45be-b23c-38f0cfee750f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.112567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14a1aacc-53f6-45be-b23c-38f0cfee750f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.113417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14a1aacc-53f6-45be-b23c-38f0cfee750f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.114172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14a1aacc-53f6-45be-b23c-38f0cfee750f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.114726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14a1aacc-53f6-45be-b23c-38f0cfee750f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.144044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-31275ea9-d5e9-48fd-aa71-904670dc9da9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.152719 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-31275ea9-d5e9-48fd-aa71-904670dc9da9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1511 microversion: 2.1 time: 0.242323 Oct 29 03:04:06.160975 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2093/4211] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:05 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:06.189204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce4420e0-9156-4ac8-bf8e-6b4e5d2a26d0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:06.190086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce4420e0-9156-4ac8-bf8e-6b4e5d2a26d0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 51e97f20-bb71-4576-b4a3-6673ade724a5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:06.200949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4420e0-9156-4ac8-bf8e-6b4e5d2a26d0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.201728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4420e0-9156-4ac8-bf8e-6b4e5d2a26d0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.202422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4420e0-9156-4ac8-bf8e-6b4e5d2a26d0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.205070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4420e0-9156-4ac8-bf8e-6b4e5d2a26d0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.205749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4420e0-9156-4ac8-bf8e-6b4e5d2a26d0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.206343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4420e0-9156-4ac8-bf8e-6b4e5d2a26d0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.342708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-14a1aacc-53f6-45be-b23c-38f0cfee750f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.352719 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-14a1aacc-53f6-45be-b23c-38f0cfee750f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1316 microversion: 2.1 time: 0.255467 Oct 29 03:04:06.353929 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2119/4212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:06 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:06.386653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a2b866c2-ba3c-42df-9772-49ced9c5ba81 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:06.394996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a2b866c2-ba3c-42df-9772-49ced9c5ba81 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:06.409651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2b866c2-ba3c-42df-9772-49ced9c5ba81 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.410125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2b866c2-ba3c-42df-9772-49ced9c5ba81 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.412029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2b866c2-ba3c-42df-9772-49ced9c5ba81 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.412756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2b866c2-ba3c-42df-9772-49ced9c5ba81 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.413513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2b866c2-ba3c-42df-9772-49ced9c5ba81 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.413651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2b866c2-ba3c-42df-9772-49ced9c5ba81 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.480351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce4420e0-9156-4ac8-bf8e-6b4e5d2a26d0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.494510 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce4420e0-9156-4ac8-bf8e-6b4e5d2a26d0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5" status: 200 len: 1509 microversion: 2.1 time: 0.309414 Oct 29 03:04:06.495649 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2094/4213] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:06 2022] GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:06.545291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fb55daac-4f17-455a-be04-b578ce5365bc tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:06.548566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fb55daac-4f17-455a-be04-b578ce5365bc tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:06.571822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb55daac-4f17-455a-be04-b578ce5365bc tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.573071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb55daac-4f17-455a-be04-b578ce5365bc tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.574190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb55daac-4f17-455a-be04-b578ce5365bc tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.577216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb55daac-4f17-455a-be04-b578ce5365bc tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.578330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb55daac-4f17-455a-be04-b578ce5365bc tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.579115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb55daac-4f17-455a-be04-b578ce5365bc tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.635623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a2b866c2-ba3c-42df-9772-49ced9c5ba81 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.647067 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a2b866c2-ba3c-42df-9772-49ced9c5ba81 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1475 microversion: 2.1 time: 0.264229 Oct 29 03:04:06.662465 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2120/4214] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:06 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1475 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:06.667840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-cacb6af9-a8ef-4c50-8726-b9a0a22d8c81 req-5c22869c-f939-4241-8fc3-78eb891748d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bbab455-c481-40ea-a59c-4ec9c15d935e", "tag": "c7aca24a-a353-4021-bdca-25ce655729ae"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:06.689739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cacb6af9-a8ef-4c50-8726-b9a0a22d8c81 req-5c22869c-f939-4241-8fc3-78eb891748d7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.690241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cacb6af9-a8ef-4c50-8726-b9a0a22d8c81 req-5c22869c-f939-4241-8fc3-78eb891748d7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.690665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cacb6af9-a8ef-4c50-8726-b9a0a22d8c81 req-5c22869c-f939-4241-8fc3-78eb891748d7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.702933 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-cacb6af9-a8ef-4c50-8726-b9a0a22d8c81 req-5c22869c-f939-4241-8fc3-78eb891748d7 service nova] Creating event network-changed:c7aca24a-a353-4021-bdca-25ce655729ae for instance 2bbab455-c481-40ea-a59c-4ec9c15d935e on n-h2-862964-4 Oct 29 03:04:06.708425 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-cacb6af9-a8ef-4c50-8726-b9a0a22d8c81 req-5c22869c-f939-4241-8fc3-78eb891748d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044591 Oct 29 03:04:06.709404 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2121/4215] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:06.748840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1569001074", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:06.773294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fb55daac-4f17-455a-be04-b578ce5365bc tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.782539 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fb55daac-4f17-455a-be04-b578ce5365bc tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1512 microversion: 2.1 time: 0.255794 Oct 29 03:04:06.784094 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2095/4216] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:06 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1512 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:06.807626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0732994d-3bea-4f87-9786-442e5de851f7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:06.812999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0732994d-3bea-4f87-9786-442e5de851f7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.813764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0732994d-3bea-4f87-9786-442e5de851f7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:04:06.815293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] validate_networks() for [('204a19c0-c3a9-46eb-85da-9d12d0451025', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:04:06.942241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0732994d-3bea-4f87-9786-442e5de851f7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.942720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0732994d-3bea-4f87-9786-442e5de851f7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.943317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0732994d-3bea-4f87-9786-442e5de851f7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.944048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0732994d-3bea-4f87-9786-442e5de851f7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.944664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0732994d-3bea-4f87-9786-442e5de851f7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.945239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0732994d-3bea-4f87-9786-442e5de851f7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.040163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-0732994d-3bea-4f87-9786-442e5de851f7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:04:07.101081 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0732994d-3bea-4f87-9786-442e5de851f7 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.297252 Oct 29 03:04:07.102019 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2096/4217] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Oct 29 03:04:06 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:04:07.106539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b5fb47cb-41a2-4ec7-9146-25a040b0978b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:07.107154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b5fb47cb-41a2-4ec7-9146-25a040b0978b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:07.118806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fb47cb-41a2-4ec7-9146-25a040b0978b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.119234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fb47cb-41a2-4ec7-9146-25a040b0978b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.120337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fb47cb-41a2-4ec7-9146-25a040b0978b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.121046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fb47cb-41a2-4ec7-9146-25a040b0978b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.121494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fb47cb-41a2-4ec7-9146-25a040b0978b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.122402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fb47cb-41a2-4ec7-9146-25a040b0978b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.267618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:07.268114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:07.268495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:07.268899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:07.269306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:07.275703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b5fb47cb-41a2-4ec7-9146-25a040b0978b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:07.278421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.278902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.279331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.280414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.280532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.280897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.284799 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b5fb47cb-41a2-4ec7-9146-25a040b0978b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.181768 Oct 29 03:04:07.289642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=21 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:07.301315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:07.302741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:07.302942 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2097/4218] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:07 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:07.308266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-00925590-ff49-4f74-bbdc-6036afee0f67 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:07.308950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-00925590-ff49-4f74-bbdc-6036afee0f67 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:07.311934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for user cecadca739554f858c269b85690b5cec and project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:07.316424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00925590-ff49-4f74-bbdc-6036afee0f67 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.316898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00925590-ff49-4f74-bbdc-6036afee0f67 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.317303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00925590-ff49-4f74-bbdc-6036afee0f67 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.318023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00925590-ff49-4f74-bbdc-6036afee0f67 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.318462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00925590-ff49-4f74-bbdc-6036afee0f67 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.318990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00925590-ff49-4f74-bbdc-6036afee0f67 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.331357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:04:07.334094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:07.401159 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cf00a5e1-4d71-4080-b874-249cf19d0836 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657163 Oct 29 03:04:07.402390 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2122/4219] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:04:07.408120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:07.408796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:07.416632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.418242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.418674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.419424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.419982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.420398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.446500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:07.522833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-00925590-ff49-4f74-bbdc-6036afee0f67 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:07.538888 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-00925590-ff49-4f74-bbdc-6036afee0f67 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1511 microversion: 2.1 time: 0.233253 Oct 29 03:04:07.539961 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2098/4220] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:07 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:07.544723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-04484534-f983-4a18-9f2c-7692704678c2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:07.545324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-04484534-f983-4a18-9f2c-7692704678c2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:07.559567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04484534-f983-4a18-9f2c-7692704678c2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.560159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04484534-f983-4a18-9f2c-7692704678c2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.560596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04484534-f983-4a18-9f2c-7692704678c2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.561366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04484534-f983-4a18-9f2c-7692704678c2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.561997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04484534-f983-4a18-9f2c-7692704678c2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.562528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04484534-f983-4a18-9f2c-7692704678c2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.718356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:07.732104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:07.735028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:07.738325 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-04f6e8b0-82b2-4f07-8f15-c4e69e45226a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.334506 Oct 29 03:04:07.739476 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2123/4221] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:07 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:07.749975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d53f7ee-a01a-43db-b209-4751e5828ce0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:07.751668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9d53f7ee-a01a-43db-b209-4751e5828ce0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:07.789348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9d53f7ee-a01a-43db-b209-4751e5828ce0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:04:07.864902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-04484534-f983-4a18-9f2c-7692704678c2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:07.880153 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-04484534-f983-4a18-9f2c-7692704678c2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1316 microversion: 2.1 time: 0.338945 Oct 29 03:04:07.881395 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2099/4222] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:07 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:07.894263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-87d2289f-6f36-4f31-b721-f3e303f326a9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:07.895186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-87d2289f-6f36-4f31-b721-f3e303f326a9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 51e97f20-bb71-4576-b4a3-6673ade724a5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:07.917184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d2289f-6f36-4f31-b721-f3e303f326a9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.917677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d2289f-6f36-4f31-b721-f3e303f326a9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.932106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d2289f-6f36-4f31-b721-f3e303f326a9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.932985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d2289f-6f36-4f31-b721-f3e303f326a9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.933640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d2289f-6f36-4f31-b721-f3e303f326a9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.934253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d2289f-6f36-4f31-b721-f3e303f326a9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:08.158769 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.scheduler.client.report [None req-9d53f7ee-a01a-43db-b209-4751e5828ce0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Deleted allocations for instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 Oct 29 03:04:08.164751 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.compute.api [None req-9d53f7ee-a01a-43db-b209-4751e5828ce0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0] Instance Mapping does not exist while attempting local delete cleanup. Oct 29 03:04:08.165794 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9d53f7ee-a01a-43db-b209-4751e5828ce0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3b74d997-be16-4f01-aba0-2b1bb0f0b5d0" status: 204 len: 0 microversion: 2.1 time: 0.424614 Oct 29 03:04:08.170283 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2124/4223] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:04:07 2022] DELETE /compute/v2.1/servers/3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:04:08.177714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a5678b8a-3555-4a0f-a246-ddec41a66072 req-4559282d-1d56-481f-acfd-5485717648e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e7e466-df5f-45f5-9e45-dc3c16e888b7", "name": "network-vif-unplugged", "status": "completed", "tag": "4f85a0f7-faab-45b5-be06-7a79452c31af"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:08.188355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a5678b8a-3555-4a0f-a246-ddec41a66072 req-4559282d-1d56-481f-acfd-5485717648e1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:08.189219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a5678b8a-3555-4a0f-a246-ddec41a66072 req-4559282d-1d56-481f-acfd-5485717648e1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:08.189872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a5678b8a-3555-4a0f-a246-ddec41a66072 req-4559282d-1d56-481f-acfd-5485717648e1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:08.205054 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a5678b8a-3555-4a0f-a246-ddec41a66072 req-4559282d-1d56-481f-acfd-5485717648e1 service nova] Creating event network-vif-unplugged:4f85a0f7-faab-45b5-be06-7a79452c31af for instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 on n-h1-862964-4 Oct 29 03:04:08.210826 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a5678b8a-3555-4a0f-a246-ddec41a66072 req-4559282d-1d56-481f-acfd-5485717648e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038849 Oct 29 03:04:08.215795 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2125/4224] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:08.221951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76cef4c1-e3d9-4284-961d-7eaf9d270cd0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:08.222863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-76cef4c1-e3d9-4284-961d-7eaf9d270cd0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:08.229069 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-76cef4c1-e3d9-4284-961d-7eaf9d270cd0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76cef4c1-e3d9-4284-961d-7eaf9d270cd0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 HTTP/1.1 Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3b74d997-be16-4f01-aba0-2b1bb0f0b5d0'} Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:08.231056 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:08.235305 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:08.235305 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:08.235305 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:04:08.235305 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:08.236489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76cef4c1-e3d9-4284-961d-7eaf9d270cd0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:08.237587 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-76cef4c1-e3d9-4284-961d-7eaf9d270cd0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3b74d997-be16-4f01-aba0-2b1bb0f0b5d0" status: 404 len: 111 microversion: 2.1 time: 0.020396 Oct 29 03:04:08.249336 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2126/4225] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:08 2022] GET /compute/v2.1/servers/3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:08.336421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-914f5b20-0e76-4513-a41a-f9c33437ac57 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:08.342474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-914f5b20-0e76-4513-a41a-f9c33437ac57 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:08.377490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-914f5b20-0e76-4513-a41a-f9c33437ac57 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:08.378068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-914f5b20-0e76-4513-a41a-f9c33437ac57 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:08.378518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-914f5b20-0e76-4513-a41a-f9c33437ac57 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:08.381351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-914f5b20-0e76-4513-a41a-f9c33437ac57 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:08.382569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-914f5b20-0e76-4513-a41a-f9c33437ac57 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:08.383025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-914f5b20-0e76-4513-a41a-f9c33437ac57 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:08.589683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-87d2289f-6f36-4f31-b721-f3e303f326a9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:08.593694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-914f5b20-0e76-4513-a41a-f9c33437ac57 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:08.607067 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-87d2289f-6f36-4f31-b721-f3e303f326a9 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5" status: 200 len: 1509 microversion: 2.1 time: 0.724284 Oct 29 03:04:08.608381 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2100/4226] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:07 2022] GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5 => generated 1509 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:08.617082 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-914f5b20-0e76-4513-a41a-f9c33437ac57 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1688 microversion: 2.1 time: 0.309476 Oct 29 03:04:08.620013 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2127/4227] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:08 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1688 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:08.623366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-119543422", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "204a19c0-c3a9-46eb-85da-9d12d0451025"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:08.661550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2879a866-869a-43f7-971a-256e0b1866b1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:08.662576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2879a866-869a-43f7-971a-256e0b1866b1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:08.676916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2879a866-869a-43f7-971a-256e0b1866b1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:08.678783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2879a866-869a-43f7-971a-256e0b1866b1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:08.679223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2879a866-869a-43f7-971a-256e0b1866b1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:08.679937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2879a866-869a-43f7-971a-256e0b1866b1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:08.680391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2879a866-869a-43f7-971a-256e0b1866b1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:08.685057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2879a866-869a-43f7-971a-256e0b1866b1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:08.724435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] validate_networks() for [('204a19c0-c3a9-46eb-85da-9d12d0451025', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:04:08.854891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2879a866-869a-43f7-971a-256e0b1866b1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:08.864200 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2879a866-869a-43f7-971a-256e0b1866b1 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1512 microversion: 2.1 time: 0.207493 Oct 29 03:04:08.864817 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2128/4228] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:08 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:08.870514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:08.871110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:08.878503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:08.879613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:08.880216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:08.881111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:08.881762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:08.882333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.040599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:09.056098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:09.057822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:09.058998 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1f7297c8-e591-4c4b-8e0d-7b1c2de2aa84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.193090 Oct 29 03:04:09.070070 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2129/4229] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:08 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:09.070070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:09.070496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:09.071260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:04:09.079652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.080195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.080626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.081408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.082039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.082460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.117639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:04:09.160214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:09.167601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.168091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.168514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.323419 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b2dd56f-1703-44c8-a8d1-c0e14664d78d tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.262579 Oct 29 03:04:09.324908 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2130/4230] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 03:04:09 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:09.331014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83540243-66f3-4ea0-af87-6c985a2f7ff4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:09.333083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-83540243-66f3-4ea0-af87-6c985a2f7ff4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:09.342640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83540243-66f3-4ea0-af87-6c985a2f7ff4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.345311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83540243-66f3-4ea0-af87-6c985a2f7ff4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.346315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83540243-66f3-4ea0-af87-6c985a2f7ff4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.347846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83540243-66f3-4ea0-af87-6c985a2f7ff4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.348554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83540243-66f3-4ea0-af87-6c985a2f7ff4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.349568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83540243-66f3-4ea0-af87-6c985a2f7ff4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.513072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-83540243-66f3-4ea0-af87-6c985a2f7ff4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:09.521255 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-83540243-66f3-4ea0-af87-6c985a2f7ff4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1316 microversion: 2.1 time: 0.195020 Oct 29 03:04:09.521989 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2131/4231] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:09 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:09.526633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d4c4133-c1a6-4f6e-befb-e5f22311cc72 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:09.531893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d4c4133-c1a6-4f6e-befb-e5f22311cc72 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:09.532577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d4c4133-c1a6-4f6e-befb-e5f22311cc72 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:04:09.691795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d4c4133-c1a6-4f6e-befb-e5f22311cc72 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.692268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d4c4133-c1a6-4f6e-befb-e5f22311cc72 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.692692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d4c4133-c1a6-4f6e-befb-e5f22311cc72 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.693410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d4c4133-c1a6-4f6e-befb-e5f22311cc72 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.693946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d4c4133-c1a6-4f6e-befb-e5f22311cc72 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.694818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d4c4133-c1a6-4f6e-befb-e5f22311cc72 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.732560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:09.733076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:09.733423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:09.733931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:09.734349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:09.746919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.747441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.747866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.748591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.749156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.749588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.769631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:09.775365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for user cecadca739554f858c269b85690b5cec and project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:09.791767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:04:09.794291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:09.837267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-1d4c4133-c1a6-4f6e-befb-e5f22311cc72 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:04:09.858242 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d269fdc0-4d3b-4f75-a306-b3408b64d80f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.242687 Oct 29 03:04:09.865589 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2101/4232] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:04:09.866818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-86c32ae7-70ed-4107-a4d6-22a11dc46079 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:09.867427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-86c32ae7-70ed-4107-a4d6-22a11dc46079 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:09.875104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86c32ae7-70ed-4107-a4d6-22a11dc46079 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.875598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86c32ae7-70ed-4107-a4d6-22a11dc46079 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.876440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86c32ae7-70ed-4107-a4d6-22a11dc46079 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.877324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86c32ae7-70ed-4107-a4d6-22a11dc46079 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.878280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86c32ae7-70ed-4107-a4d6-22a11dc46079 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.879246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86c32ae7-70ed-4107-a4d6-22a11dc46079 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.940087 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d4c4133-c1a6-4f6e-befb-e5f22311cc72 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.417016 Oct 29 03:04:09.949088 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2132/4233] 10.222.0.16 () {58 vars in 1150 bytes} [Sat Oct 29 03:04:09 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:09.955274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a5d684d2-0d03-4112-a4fd-b89ddfcc324e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:09.955976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a5d684d2-0d03-4112-a4fd-b89ddfcc324e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:10.018754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a5d684d2-0d03-4112-a4fd-b89ddfcc324e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.026153 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a5d684d2-0d03-4112-a4fd-b89ddfcc324e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1220 microversion: 2.1 time: 0.075088 Oct 29 03:04:10.042285 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2133/4234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:09 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:10.047227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-37ed0086-1056-4859-81bb-ed31c2986723 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:10.052834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-37ed0086-1056-4859-81bb-ed31c2986723 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.053708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-37ed0086-1056-4859-81bb-ed31c2986723 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:04:10.059251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37ed0086-1056-4859-81bb-ed31c2986723 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.059812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37ed0086-1056-4859-81bb-ed31c2986723 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.060331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37ed0086-1056-4859-81bb-ed31c2986723 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.061236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37ed0086-1056-4859-81bb-ed31c2986723 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.061750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37ed0086-1056-4859-81bb-ed31c2986723 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.062682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37ed0086-1056-4859-81bb-ed31c2986723 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.157562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-86c32ae7-70ed-4107-a4d6-22a11dc46079 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.167830 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-86c32ae7-70ed-4107-a4d6-22a11dc46079 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1688 microversion: 2.1 time: 0.306433 Oct 29 03:04:10.178480 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2102/4235] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:09 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1688 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:10.188712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-37ed0086-1056-4859-81bb-ed31c2986723 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:04:10.190275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:10.190788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:10.197946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.199883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.200785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.201597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.202143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.202748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.208041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:10.280637 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-37ed0086-1056-4859-81bb-ed31c2986723 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.236797 Oct 29 03:04:10.281892 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2134/4236] 10.222.0.16 () {58 vars in 1212 bytes} [Sat Oct 29 03:04:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:10.297398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-551f2c8c-952d-4863-a52f-0e01037f40eb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:10.305138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-551f2c8c-952d-4863-a52f-0e01037f40eb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.306121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-551f2c8c-952d-4863-a52f-0e01037f40eb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:04:10.312862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-551f2c8c-952d-4863-a52f-0e01037f40eb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.313605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-551f2c8c-952d-4863-a52f-0e01037f40eb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.314405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-551f2c8c-952d-4863-a52f-0e01037f40eb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.315227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-551f2c8c-952d-4863-a52f-0e01037f40eb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.316019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-551f2c8c-952d-4863-a52f-0e01037f40eb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.316524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-551f2c8c-952d-4863-a52f-0e01037f40eb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.467454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-551f2c8c-952d-4863-a52f-0e01037f40eb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:04:10.469034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.481164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.484316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.486080 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1e19d1bc-7c01-485b-a27a-3c363f73b52c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.306333 Oct 29 03:04:10.506758 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2103/4237] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:10 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:10.550662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a4ad5a4d-8874-4206-8cae-8d0fa3abad49 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:10.551635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a4ad5a4d-8874-4206-8cae-8d0fa3abad49 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:10.577273 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-551f2c8c-952d-4863-a52f-0e01037f40eb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.285644 Oct 29 03:04:10.580615 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2135/4238] 10.222.0.16 () {58 vars in 1196 bytes} [Sat Oct 29 03:04:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:10.587892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4ad5a4d-8874-4206-8cae-8d0fa3abad49 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.588610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4ad5a4d-8874-4206-8cae-8d0fa3abad49 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.592584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4ad5a4d-8874-4206-8cae-8d0fa3abad49 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.593923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4ad5a4d-8874-4206-8cae-8d0fa3abad49 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.597227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4ad5a4d-8874-4206-8cae-8d0fa3abad49 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.597829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4ad5a4d-8874-4206-8cae-8d0fa3abad49 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.602656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-910ecf1e-416e-4e06-bc4e-121ee1a90fb3 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:10.607738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-910ecf1e-416e-4e06-bc4e-121ee1a90fb3 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.614645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-910ecf1e-416e-4e06-bc4e-121ee1a90fb3 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'name': '-200701745', 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:04:10.625542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-910ecf1e-416e-4e06-bc4e-121ee1a90fb3 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.628662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-910ecf1e-416e-4e06-bc4e-121ee1a90fb3 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.630058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-910ecf1e-416e-4e06-bc4e-121ee1a90fb3 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.631274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-910ecf1e-416e-4e06-bc4e-121ee1a90fb3 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.633536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-910ecf1e-416e-4e06-bc4e-121ee1a90fb3 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.633666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-910ecf1e-416e-4e06-bc4e-121ee1a90fb3 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.773315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-910ecf1e-416e-4e06-bc4e-121ee1a90fb3 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:04:10.932695 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-910ecf1e-416e-4e06-bc4e-121ee1a90fb3 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-200701745" status: 200 len: 345 microversion: 2.1 time: 0.345458 Oct 29 03:04:10.948006 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2136/4239] 10.222.0.16 () {58 vars in 1156 bytes} [Sat Oct 29 03:04:10 2022] GET /compute/v2.1/servers?name=-200701745 => generated 345 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:10.955267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af638075-7a9e-480d-b7b0-926c235eab54 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:10.962804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a4ad5a4d-8874-4206-8cae-8d0fa3abad49 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.971687 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a4ad5a4d-8874-4206-8cae-8d0fa3abad49 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1316 microversion: 2.1 time: 0.427303 Oct 29 03:04:10.972284 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2104/4240] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:10 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:10.976962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-af638075-7a9e-480d-b7b0-926c235eab54 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.978092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-af638075-7a9e-480d-b7b0-926c235eab54 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:04:10.985291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af638075-7a9e-480d-b7b0-926c235eab54 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.986037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af638075-7a9e-480d-b7b0-926c235eab54 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.986340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af638075-7a9e-480d-b7b0-926c235eab54 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.987657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af638075-7a9e-480d-b7b0-926c235eab54 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.988271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af638075-7a9e-480d-b7b0-926c235eab54 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.988942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af638075-7a9e-480d-b7b0-926c235eab54 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.048608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d53de27a-1ef5-4f60-8450-fa342699f620 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:11.049499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d53de27a-1ef5-4f60-8450-fa342699f620 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:11.069271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d53de27a-1ef5-4f60-8450-fa342699f620 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.069782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d53de27a-1ef5-4f60-8450-fa342699f620 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.070237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d53de27a-1ef5-4f60-8450-fa342699f620 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.070946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d53de27a-1ef5-4f60-8450-fa342699f620 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.071387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d53de27a-1ef5-4f60-8450-fa342699f620 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.078454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d53de27a-1ef5-4f60-8450-fa342699f620 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.171223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-af638075-7a9e-480d-b7b0-926c235eab54 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:04:11.216253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d53de27a-1ef5-4f60-8450-fa342699f620 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:11.241409 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d53de27a-1ef5-4f60-8450-fa342699f620 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1272 microversion: 2.1 time: 0.193585 Oct 29 03:04:11.244313 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2105/4241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:11 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:11.256974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0a8de4cf-d28b-435e-805e-30a9e5addbad tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:11.257740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0a8de4cf-d28b-435e-805e-30a9e5addbad tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:11.266516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8de4cf-d28b-435e-805e-30a9e5addbad tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.267281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8de4cf-d28b-435e-805e-30a9e5addbad tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.267959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8de4cf-d28b-435e-805e-30a9e5addbad tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.268755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8de4cf-d28b-435e-805e-30a9e5addbad tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.269366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8de4cf-d28b-435e-805e-30a9e5addbad tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.270384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a8de4cf-d28b-435e-805e-30a9e5addbad tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.350335 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-af638075-7a9e-480d-b7b0-926c235eab54 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.397512 Oct 29 03:04:11.351058 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2137/4242] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Oct 29 03:04:10 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:11.364148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-42048882-0a27-40b8-a1c9-db2636365e26 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:11.369932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-42048882-0a27-40b8-a1c9-db2636365e26 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:11.370595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-42048882-0a27-40b8-a1c9-db2636365e26 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-20070174', 'deleted': False, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:04:11.382787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42048882-0a27-40b8-a1c9-db2636365e26 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.383256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42048882-0a27-40b8-a1c9-db2636365e26 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.387275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42048882-0a27-40b8-a1c9-db2636365e26 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.387275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42048882-0a27-40b8-a1c9-db2636365e26 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.387275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42048882-0a27-40b8-a1c9-db2636365e26 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.387275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42048882-0a27-40b8-a1c9-db2636365e26 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.519564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-42048882-0a27-40b8-a1c9-db2636365e26 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:04:11.598150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0a8de4cf-d28b-435e-805e-30a9e5addbad tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:11.618999 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0a8de4cf-d28b-435e-805e-30a9e5addbad tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.373052 Oct 29 03:04:11.620048 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2106/4243] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:11 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:11.624749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:11.625410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:11.636503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.636995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.637426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.638179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.638679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.639103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.004037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:12.013146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:12.019688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:12.023952 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4b395172-8aa5-4c04-a612-924a11c0f79c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.402042 Oct 29 03:04:12.025995 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2107/4244] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:11 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:12.036785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cde5d867-0641-4082-9646-59dac1907dcf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:12.037742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cde5d867-0641-4082-9646-59dac1907dcf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:12.060104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cde5d867-0641-4082-9646-59dac1907dcf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.060856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cde5d867-0641-4082-9646-59dac1907dcf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.061483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cde5d867-0641-4082-9646-59dac1907dcf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.062541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cde5d867-0641-4082-9646-59dac1907dcf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.068771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cde5d867-0641-4082-9646-59dac1907dcf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.069449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cde5d867-0641-4082-9646-59dac1907dcf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.312544 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-42048882-0a27-40b8-a1c9-db2636365e26 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-20070174" status: 200 len: 345 microversion: 2.1 time: 0.952200 Oct 29 03:04:12.313666 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2138/4245] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Oct 29 03:04:11 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-20070174 => generated 345 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:04:12.321415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-61db6728-9e5c-4802-93b0-8b2c4da066c7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:12.322424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-61db6728-9e5c-4802-93b0-8b2c4da066c7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:12.329051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61db6728-9e5c-4802-93b0-8b2c4da066c7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.329525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61db6728-9e5c-4802-93b0-8b2c4da066c7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.330033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61db6728-9e5c-4802-93b0-8b2c4da066c7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.330975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61db6728-9e5c-4802-93b0-8b2c4da066c7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.331434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61db6728-9e5c-4802-93b0-8b2c4da066c7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.332222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61db6728-9e5c-4802-93b0-8b2c4da066c7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.408830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-61db6728-9e5c-4802-93b0-8b2c4da066c7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:12.420597 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-61db6728-9e5c-4802-93b0-8b2c4da066c7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1278 microversion: 2.1 time: 0.105758 Oct 29 03:04:12.423481 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2139/4246] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:12 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1278 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:12.435501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cde5d867-0641-4082-9646-59dac1907dcf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:12.443039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7b6039b-5e1f-4629-9c6d-3f1ba69dff89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:12.455260 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cde5d867-0641-4082-9646-59dac1907dcf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1316 microversion: 2.1 time: 0.425712 Oct 29 03:04:12.458224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7b6039b-5e1f-4629-9c6d-3f1ba69dff89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:12.461827 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2108/4247] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:12 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:12.480569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b6039b-5e1f-4629-9c6d-3f1ba69dff89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.482289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b6039b-5e1f-4629-9c6d-3f1ba69dff89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.483447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b6039b-5e1f-4629-9c6d-3f1ba69dff89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.484417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b6039b-5e1f-4629-9c6d-3f1ba69dff89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.485650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b6039b-5e1f-4629-9c6d-3f1ba69dff89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.486999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b6039b-5e1f-4629-9c6d-3f1ba69dff89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.534801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7b6039b-5e1f-4629-9c6d-3f1ba69dff89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:04:12.552944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:12.648652 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7b6039b-5e1f-4629-9c6d-3f1ba69dff89 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 204 len: 0 microversion: 2.1 time: 0.222750 Oct 29 03:04:12.649380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-185d5503-8ccd-485d-aa3c-8975fb1a7954 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:12.649852 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2140/4248] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:04:12 2022] DELETE /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:04:12.650441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-185d5503-8ccd-485d-aa3c-8975fb1a7954 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:12.659510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-379d551c-d3a9-49bf-94a2-6767c28b6e5b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:12.660740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-379d551c-d3a9-49bf-94a2-6767c28b6e5b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:12.668808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-185d5503-8ccd-485d-aa3c-8975fb1a7954 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.669193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-379d551c-d3a9-49bf-94a2-6767c28b6e5b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.669326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-185d5503-8ccd-485d-aa3c-8975fb1a7954 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.669714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-185d5503-8ccd-485d-aa3c-8975fb1a7954 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.670322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-379d551c-d3a9-49bf-94a2-6767c28b6e5b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.670462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-185d5503-8ccd-485d-aa3c-8975fb1a7954 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.671432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-379d551c-d3a9-49bf-94a2-6767c28b6e5b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.672635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-379d551c-d3a9-49bf-94a2-6767c28b6e5b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.673464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-379d551c-d3a9-49bf-94a2-6767c28b6e5b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.674102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-379d551c-d3a9-49bf-94a2-6767c28b6e5b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.682566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-185d5503-8ccd-485d-aa3c-8975fb1a7954 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.686113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-185d5503-8ccd-485d-aa3c-8975fb1a7954 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.911132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-379d551c-d3a9-49bf-94a2-6767c28b6e5b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:12.935228 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-379d551c-d3a9-49bf-94a2-6767c28b6e5b tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1518 microversion: 2.1 time: 0.280234 Oct 29 03:04:12.949838 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2141/4249] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:12 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1518 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:12.957108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-34ec58fc-c4a1-48d5-9f7a-fd3891a8efad req-8723e5d9-f4ca-496d-8842-f755e8034d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e7e466-df5f-45f5-9e45-dc3c16e888b7", "name": "network-vif-plugged", "status": "completed", "tag": "4f85a0f7-faab-45b5-be06-7a79452c31af"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:12.967641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-34ec58fc-c4a1-48d5-9f7a-fd3891a8efad req-8723e5d9-f4ca-496d-8842-f755e8034d81 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.968126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-34ec58fc-c4a1-48d5-9f7a-fd3891a8efad req-8723e5d9-f4ca-496d-8842-f755e8034d81 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.968595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-34ec58fc-c4a1-48d5-9f7a-fd3891a8efad req-8723e5d9-f4ca-496d-8842-f755e8034d81 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.990898 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-34ec58fc-c4a1-48d5-9f7a-fd3891a8efad req-8723e5d9-f4ca-496d-8842-f755e8034d81 service nova] Creating event network-vif-plugged:4f85a0f7-faab-45b5-be06-7a79452c31af for instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 on n-h1-862964-4 Oct 29 03:04:13.002746 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-34ec58fc-c4a1-48d5-9f7a-fd3891a8efad req-8723e5d9-f4ca-496d-8842-f755e8034d81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049677 Oct 29 03:04:13.003745 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2142/4250] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:13.055628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:13.056320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:13.069284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.069787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.070267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.070962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.071408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.071824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.093770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-185d5503-8ccd-485d-aa3c-8975fb1a7954 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:13.122092 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-185d5503-8ccd-485d-aa3c-8975fb1a7954 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.478857 Oct 29 03:04:13.126073 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2109/4251] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:12 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:13.412532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:13.422238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:13.431828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:13.440147 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3f9aa149-8285-48c8-a809-3fa7045d61a7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.385685 Oct 29 03:04:13.441759 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2143/4252] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:13 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:04:13.446157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f654a868-ba2e-4262-9525-adbb9064114a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:13.446841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f654a868-ba2e-4262-9525-adbb9064114a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:13.458216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f654a868-ba2e-4262-9525-adbb9064114a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.464138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f654a868-ba2e-4262-9525-adbb9064114a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.466852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f654a868-ba2e-4262-9525-adbb9064114a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.479702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f654a868-ba2e-4262-9525-adbb9064114a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.484835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f654a868-ba2e-4262-9525-adbb9064114a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.486962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f654a868-ba2e-4262-9525-adbb9064114a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.490164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cfb3b7b8-2f94-4e86-9f83-dfbd11e5e76b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:13.490629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cfb3b7b8-2f94-4e86-9f83-dfbd11e5e76b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:13.508996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfb3b7b8-2f94-4e86-9f83-dfbd11e5e76b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.509545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfb3b7b8-2f94-4e86-9f83-dfbd11e5e76b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.570971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfb3b7b8-2f94-4e86-9f83-dfbd11e5e76b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.061s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.579470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfb3b7b8-2f94-4e86-9f83-dfbd11e5e76b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.580057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfb3b7b8-2f94-4e86-9f83-dfbd11e5e76b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.580962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfb3b7b8-2f94-4e86-9f83-dfbd11e5e76b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.907536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cfb3b7b8-2f94-4e86-9f83-dfbd11e5e76b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:13.915676 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cfb3b7b8-2f94-4e86-9f83-dfbd11e5e76b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1316 microversion: 2.1 time: 0.432464 Oct 29 03:04:13.919533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f654a868-ba2e-4262-9525-adbb9064114a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:13.934280 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2144/4253] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:13 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:13.948022 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f654a868-ba2e-4262-9525-adbb9064114a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1320 microversion: 2.1 time: 0.507159 Oct 29 03:04:13.948919 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2110/4254] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:13 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1320 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:13.969548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bae35e7b-59ba-45d8-944e-287d0f77117f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:13.970300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bae35e7b-59ba-45d8-944e-287d0f77117f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:13.980269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bae35e7b-59ba-45d8-944e-287d0f77117f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.981131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bae35e7b-59ba-45d8-944e-287d0f77117f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.981775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bae35e7b-59ba-45d8-944e-287d0f77117f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.984447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bae35e7b-59ba-45d8-944e-287d0f77117f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.985316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bae35e7b-59ba-45d8-944e-287d0f77117f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.987738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bae35e7b-59ba-45d8-944e-287d0f77117f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:14.147502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dcfce7b1-4cb1-43da-b8f0-ca8da94639db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:14.148691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dcfce7b1-4cb1-43da-b8f0-ca8da94639db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:14.152087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bae35e7b-59ba-45d8-944e-287d0f77117f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:14.157634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfce7b1-4cb1-43da-b8f0-ca8da94639db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:14.158154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfce7b1-4cb1-43da-b8f0-ca8da94639db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:14.158593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfce7b1-4cb1-43da-b8f0-ca8da94639db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:14.159277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfce7b1-4cb1-43da-b8f0-ca8da94639db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:14.161479 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bae35e7b-59ba-45d8-944e-287d0f77117f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1518 microversion: 2.1 time: 0.196245 Oct 29 03:04:14.163704 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2145/4255] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:13 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:14.175021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfce7b1-4cb1-43da-b8f0-ca8da94639db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:14.176403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcfce7b1-4cb1-43da-b8f0-ca8da94639db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:14.467686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:14.468291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:14.474577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:14.475342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:14.475996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:14.476925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:14.477583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:14.478489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:14.708529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:14.718787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:14.721024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:14.722442 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f096d518-9ddb-4f53-990d-19292092663d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.259221 Oct 29 03:04:14.723571 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2146/4256] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:14 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:14.761989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dcfce7b1-4cb1-43da-b8f0-ca8da94639db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:14.774733 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dcfce7b1-4cb1-43da-b8f0-ca8da94639db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.631642 Oct 29 03:04:14.775979 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2111/4257] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:14 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:14.944049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eec01b71-b9c3-48d6-8775-05c3d948604f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:14.944947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eec01b71-b9c3-48d6-8775-05c3d948604f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:14.958374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec01b71-b9c3-48d6-8775-05c3d948604f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:14.962569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec01b71-b9c3-48d6-8775-05c3d948604f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:14.963336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec01b71-b9c3-48d6-8775-05c3d948604f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:14.973618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a7d99444-7b4c-4258-8732-018bbf143bc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:14.974499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a7d99444-7b4c-4258-8732-018bbf143bc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:14.981168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec01b71-b9c3-48d6-8775-05c3d948604f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:14.992527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec01b71-b9c3-48d6-8775-05c3d948604f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:14.993310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eec01b71-b9c3-48d6-8775-05c3d948604f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.000224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d99444-7b4c-4258-8732-018bbf143bc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.001075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d99444-7b4c-4258-8732-018bbf143bc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.001521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d99444-7b4c-4258-8732-018bbf143bc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.002741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d99444-7b4c-4258-8732-018bbf143bc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.003205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d99444-7b4c-4258-8732-018bbf143bc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.003632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d99444-7b4c-4258-8732-018bbf143bc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.251707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eec01b71-b9c3-48d6-8775-05c3d948604f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:15.261564 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eec01b71-b9c3-48d6-8775-05c3d948604f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1316 microversion: 2.1 time: 0.322617 Oct 29 03:04:15.262361 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2147/4258] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:14 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:15.267100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a7d99444-7b4c-4258-8732-018bbf143bc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:15.268706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9b958e21-4052-4666-a7c8-04fd60306c32 req-5982309c-649c-41e9-979a-7628a0f1e86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f439b2b6-1302-414a-93d3-f162321fd6c6", "name": "network-vif-plugged", "status": "completed", "tag": "291472dd-c560-4f62-ae19-0af367acb98e"}, {"server_uuid": "2bbab455-c481-40ea-a59c-4ec9c15d935e", "name": "network-vif-plugged", "status": "completed", "tag": "c7aca24a-a353-4021-bdca-25ce655729ae"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:15.279038 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a7d99444-7b4c-4258-8732-018bbf143bc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1320 microversion: 2.1 time: 0.311031 Oct 29 03:04:15.282742 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2112/4259] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:14 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:15.289213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-45a057f4-3cb0-44eb-88d1-52f06c9dc769 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:15.292134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9b958e21-4052-4666-a7c8-04fd60306c32 req-5982309c-649c-41e9-979a-7628a0f1e86d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.292632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9b958e21-4052-4666-a7c8-04fd60306c32 req-5982309c-649c-41e9-979a-7628a0f1e86d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.293072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9b958e21-4052-4666-a7c8-04fd60306c32 req-5982309c-649c-41e9-979a-7628a0f1e86d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.296933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-45a057f4-3cb0-44eb-88d1-52f06c9dc769 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:15.308524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45a057f4-3cb0-44eb-88d1-52f06c9dc769 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.313284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45a057f4-3cb0-44eb-88d1-52f06c9dc769 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.314690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45a057f4-3cb0-44eb-88d1-52f06c9dc769 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.314940 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9b958e21-4052-4666-a7c8-04fd60306c32 req-5982309c-649c-41e9-979a-7628a0f1e86d service nova] Creating event network-vif-plugged:291472dd-c560-4f62-ae19-0af367acb98e for instance f439b2b6-1302-414a-93d3-f162321fd6c6 on n-h1-862964-4 Oct 29 03:04:15.315684 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9b958e21-4052-4666-a7c8-04fd60306c32 req-5982309c-649c-41e9-979a-7628a0f1e86d service nova] Creating event network-vif-plugged:c7aca24a-a353-4021-bdca-25ce655729ae for instance 2bbab455-c481-40ea-a59c-4ec9c15d935e on n-h2-862964-4 Oct 29 03:04:15.315899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45a057f4-3cb0-44eb-88d1-52f06c9dc769 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.317880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45a057f4-3cb0-44eb-88d1-52f06c9dc769 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.320300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45a057f4-3cb0-44eb-88d1-52f06c9dc769 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.326362 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9b958e21-4052-4666-a7c8-04fd60306c32 req-5982309c-649c-41e9-979a-7628a0f1e86d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062511 Oct 29 03:04:15.327924 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2148/4260] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:15.570665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-31cd5d6d-cbed-490f-bc56-8484cce76035 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:15.573780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-31cd5d6d-cbed-490f-bc56-8484cce76035 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:15.601134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31cd5d6d-cbed-490f-bc56-8484cce76035 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.602315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31cd5d6d-cbed-490f-bc56-8484cce76035 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.602948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31cd5d6d-cbed-490f-bc56-8484cce76035 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.603865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31cd5d6d-cbed-490f-bc56-8484cce76035 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.604643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31cd5d6d-cbed-490f-bc56-8484cce76035 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.609049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31cd5d6d-cbed-490f-bc56-8484cce76035 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.664197 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-31cd5d6d-cbed-490f-bc56-8484cce76035 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101934 Oct 29 03:04:15.670999 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2149/4261] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:04:15 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:15.678933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a6146d18-0fb5-435e-b56f-f1b9529b50b0 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:15.679726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a6146d18-0fb5-435e-b56f-f1b9529b50b0 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:15.686733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6146d18-0fb5-435e-b56f-f1b9529b50b0 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.687720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6146d18-0fb5-435e-b56f-f1b9529b50b0 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.688317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6146d18-0fb5-435e-b56f-f1b9529b50b0 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.689191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6146d18-0fb5-435e-b56f-f1b9529b50b0 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.689791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6146d18-0fb5-435e-b56f-f1b9529b50b0 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.690385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6146d18-0fb5-435e-b56f-f1b9529b50b0 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.829185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-a6146d18-0fb5-435e-b56f-f1b9529b50b0 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lazy-loading 'services' on Instance uuid 545c705b-dd48-4669-9ae6-8c27bab5c2c8 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:15.924423 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a6146d18-0fb5-435e-b56f-f1b9529b50b0 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "DELETE /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-volume_attachments/0b2d19af-6952-4ade-9fb8-0da8f7ac1a31" status: 202 len: 0 microversion: 2.1 time: 0.251642 Oct 29 03:04:15.925378 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2150/4262] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:04:15 2022] DELETE /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-volume_attachments/0b2d19af-6952-4ade-9fb8-0da8f7ac1a31 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:04:15.959991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:15.964189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:15.981053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.983046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.985300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.986376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.987224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.990778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:16.236399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:16.255379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:16.256831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:16.258105 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b2e48da3-43dd-4748-9092-2f7506877e86 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.307137 Oct 29 03:04:16.258702 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2151/4263] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:15 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:16.263198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b1ba976b-22d6-4944-a021-efa2518e054a req-9a5735dd-8912-4d4c-8278-bbdc85dc68f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796202dc-3a57-414c-bb69-53b9dbeb8fcb", "tag": "2acf83c7-0475-49c5-b9d3-60a9c70bfc7d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:16.284235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b1ba976b-22d6-4944-a021-efa2518e054a req-9a5735dd-8912-4d4c-8278-bbdc85dc68f6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:16.284718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b1ba976b-22d6-4944-a021-efa2518e054a req-9a5735dd-8912-4d4c-8278-bbdc85dc68f6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:16.285144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b1ba976b-22d6-4944-a021-efa2518e054a req-9a5735dd-8912-4d4c-8278-bbdc85dc68f6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:16.299174 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b1ba976b-22d6-4944-a021-efa2518e054a req-9a5735dd-8912-4d4c-8278-bbdc85dc68f6 service nova] Creating event network-changed:2acf83c7-0475-49c5-b9d3-60a9c70bfc7d for instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb on n-h2-862964-4 Oct 29 03:04:16.306570 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b1ba976b-22d6-4944-a021-efa2518e054a req-9a5735dd-8912-4d4c-8278-bbdc85dc68f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046566 Oct 29 03:04:16.307523 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2152/4264] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:16.312644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f6323a5b-ff3d-466e-9d14-a7d87ca6b9fe tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:16.313438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f6323a5b-ff3d-466e-9d14-a7d87ca6b9fe tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:16.319943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6323a5b-ff3d-466e-9d14-a7d87ca6b9fe tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:16.320432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6323a5b-ff3d-466e-9d14-a7d87ca6b9fe tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:16.320863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6323a5b-ff3d-466e-9d14-a7d87ca6b9fe tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:16.321571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6323a5b-ff3d-466e-9d14-a7d87ca6b9fe tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:16.322061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6323a5b-ff3d-466e-9d14-a7d87ca6b9fe tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:16.322487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6323a5b-ff3d-466e-9d14-a7d87ca6b9fe tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:16.525087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f6323a5b-ff3d-466e-9d14-a7d87ca6b9fe tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:16.536049 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f6323a5b-ff3d-466e-9d14-a7d87ca6b9fe tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.227304 Oct 29 03:04:16.537183 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2153/4265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:16 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:16.542954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0ca99c0-d036-4aaf-a16e-fdaa447b7e5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:16.543790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0ca99c0-d036-4aaf-a16e-fdaa447b7e5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:16.559656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0ca99c0-d036-4aaf-a16e-fdaa447b7e5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:16.560960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0ca99c0-d036-4aaf-a16e-fdaa447b7e5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:16.562869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0ca99c0-d036-4aaf-a16e-fdaa447b7e5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:16.564599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0ca99c0-d036-4aaf-a16e-fdaa447b7e5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:16.565928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0ca99c0-d036-4aaf-a16e-fdaa447b7e5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:16.567283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0ca99c0-d036-4aaf-a16e-fdaa447b7e5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:16.590146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-45a057f4-3cb0-44eb-88d1-52f06c9dc769 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:16.609923 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-45a057f4-3cb0-44eb-88d1-52f06c9dc769 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1518 microversion: 2.1 time: 1.323653 Oct 29 03:04:16.611091 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2113/4266] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:15 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1518 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:16.624183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ad7b014a-046c-41c2-b19b-e7f4a2f36021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:16.627089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ad7b014a-046c-41c2-b19b-e7f4a2f36021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:16.640487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad7b014a-046c-41c2-b19b-e7f4a2f36021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:16.641752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad7b014a-046c-41c2-b19b-e7f4a2f36021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:16.644595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad7b014a-046c-41c2-b19b-e7f4a2f36021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:16.645533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad7b014a-046c-41c2-b19b-e7f4a2f36021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:16.647290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad7b014a-046c-41c2-b19b-e7f4a2f36021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:16.649001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad7b014a-046c-41c2-b19b-e7f4a2f36021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:16.721146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d0ca99c0-d036-4aaf-a16e-fdaa447b7e5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:16.730251 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d0ca99c0-d036-4aaf-a16e-fdaa447b7e5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1316 microversion: 2.1 time: 0.191561 Oct 29 03:04:16.731228 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2154/4267] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:16 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:16.926716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ad7b014a-046c-41c2-b19b-e7f4a2f36021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:16.935774 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ad7b014a-046c-41c2-b19b-e7f4a2f36021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1320 microversion: 2.1 time: 0.323772 Oct 29 03:04:16.937391 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2114/4268] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:16 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:17.285662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:17.286977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:17.297174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.298934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.301098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.302254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.303145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.304876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.566321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a7d6088c-410e-4937-8d61-360c07517910 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:17.566998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a7d6088c-410e-4937-8d61-360c07517910 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:17.608572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d6088c-410e-4937-8d61-360c07517910 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.609257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d6088c-410e-4937-8d61-360c07517910 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.609521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d6088c-410e-4937-8d61-360c07517910 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.617495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d6088c-410e-4937-8d61-360c07517910 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.618338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d6088c-410e-4937-8d61-360c07517910 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.618798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d6088c-410e-4937-8d61-360c07517910 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.631243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:17.644064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:17.645732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:17.662063 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4653492b-d667-417a-b0bf-27972289bca8 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1408 microversion: 2.20 time: 0.367169 Oct 29 03:04:17.662063 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2155/4269] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:17 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1408 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:17.662063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:17.662063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:17.662063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.662063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.662063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.662686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.667085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.667085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.700424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.700855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.701294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.701761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lazy-loading 'fault' on Instance uuid c5201f0a-eea0-4c6f-8304-9371561ae2ef {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:17.783481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:17.799813 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4f5a6843-8bd0-4a61-872c-8159052ac68f tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 200 len: 1311 microversion: 2.1 time: 0.151063 Oct 29 03:04:17.805671 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2156/4270] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:17 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 1311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:17.810939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3343e2f1-7d70-4c5c-a34c-57c2dc5f9f50 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:17.811552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3343e2f1-7d70-4c5c-a34c-57c2dc5f9f50 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:17.830660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3343e2f1-7d70-4c5c-a34c-57c2dc5f9f50 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.831149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3343e2f1-7d70-4c5c-a34c-57c2dc5f9f50 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.831630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3343e2f1-7d70-4c5c-a34c-57c2dc5f9f50 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.835660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3343e2f1-7d70-4c5c-a34c-57c2dc5f9f50 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.839084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3343e2f1-7d70-4c5c-a34c-57c2dc5f9f50 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.839611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3343e2f1-7d70-4c5c-a34c-57c2dc5f9f50 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.907078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:17.922601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a7d6088c-410e-4937-8d61-360c07517910 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:17.934112 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a7d6088c-410e-4937-8d61-360c07517910 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.372514 Oct 29 03:04:17.935681 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2115/4271] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:17 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:17.969217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8ce6fe06-ac1b-418b-ba22-984d94334401 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:17.969843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8ce6fe06-ac1b-418b-ba22-984d94334401 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:17.992043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce6fe06-ac1b-418b-ba22-984d94334401 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.992566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce6fe06-ac1b-418b-ba22-984d94334401 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.993518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce6fe06-ac1b-418b-ba22-984d94334401 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.998674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce6fe06-ac1b-418b-ba22-984d94334401 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.999701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce6fe06-ac1b-418b-ba22-984d94334401 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.000376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce6fe06-ac1b-418b-ba22-984d94334401 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:18.219891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3343e2f1-7d70-4c5c-a34c-57c2dc5f9f50 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:18.250362 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3343e2f1-7d70-4c5c-a34c-57c2dc5f9f50 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.432833 Oct 29 03:04:18.251319 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2157/4272] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:17 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:18.390956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-25aebbd0-6804-4d19-a1f5-d4c0c830e94d req-9b1c3529-d0b3-4a0e-a122-2a832633141c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5201f0a-eea0-4c6f-8304-9371561ae2ef", "name": "network-vif-deleted", "tag": "31b135af-c4a0-429c-af33-3b6e78e0a511"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:18.402306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:18.415235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-25aebbd0-6804-4d19-a1f5-d4c0c830e94d req-9b1c3529-d0b3-4a0e-a122-2a832633141c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:18.415979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-25aebbd0-6804-4d19-a1f5-d4c0c830e94d req-9b1c3529-d0b3-4a0e-a122-2a832633141c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.419767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-25aebbd0-6804-4d19-a1f5-d4c0c830e94d req-9b1c3529-d0b3-4a0e-a122-2a832633141c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:18.453173 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-25aebbd0-6804-4d19-a1f5-d4c0c830e94d req-9b1c3529-d0b3-4a0e-a122-2a832633141c service nova] Creating event network-vif-deleted:31b135af-c4a0-429c-af33-3b6e78e0a511 for instance c5201f0a-eea0-4c6f-8304-9371561ae2ef on n-h1-862964-4 Oct 29 03:04:18.465556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8ce6fe06-ac1b-418b-ba22-984d94334401 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:18.479219 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-25aebbd0-6804-4d19-a1f5-d4c0c830e94d req-9b1c3529-d0b3-4a0e-a122-2a832633141c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097320 Oct 29 03:04:18.479502 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8ce6fe06-ac1b-418b-ba22-984d94334401 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1320 microversion: 2.1 time: 0.519347 Oct 29 03:04:18.480800 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2116/4273] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:17 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1320 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:18.483450 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2158/4274] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:04:18.493935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1792501109", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:18.561982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] validate_networks() for [('58a9eca5-efd9-4c67-9627-237802e0f75c', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:04:18.764753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:18.766254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:18.779632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:18.783840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.784418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:18.785274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:18.792398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.793096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.069603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:19.086786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:19.089618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:19.093047 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c867c7d8-3cb1-4ef7-9b04-55fe4b615660 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1599 microversion: 2.20 time: 0.415252 Oct 29 03:04:19.093952 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2159/4275] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:18 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1599 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:04:19.115444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:19.116493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:19.117135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:19.117542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:19.118294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:19.128429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.128941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:19.129315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.129822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: c5201f0a-eea0-4c6f-8304-9371561ae2ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:19.130086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.130985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.131734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.132331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.140512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.156381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.157029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.158092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.158537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.159090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.161920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Getting quotas for project 70b925f5ecdb42e7a2f410c41f9f9cfc. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:19.169178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Getting quotas for user 9d1b1de72f9d4fd3b3165588054a0a90 and project 70b925f5ecdb42e7a2f410c41f9f9cfc. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:19.184058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:04:19.186529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:19.195174 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] HTTP exception thrown: Instance c5201f0a-eea0-4c6f-8304-9371561ae2ef could not be found. Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Request method failure captured: Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef HTTP/1.1 Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJfm3KomrxfdqSfpOMRJ91Sa-UvqNIIH6LBs6gomrtZLesuEcLUt6b5emDSJAb9fzuJ6twCmQh-Fpbv31LHJ2Z3E_p-wYd_KfUgbCTR4preko0UrLE6obT-b5HdrjB98dKHNESuIM_2medvhIAGXC1sMRlroNmxHFbHQiFdGdYnywYk Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: d573dd77f3b24ee4b650ca45e657e307 Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ListServerFiltersTestJSON-307812601 Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d573dd77f3b24ee4b650ca45e657e307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d573dd77f3b24ee4b650ca45e657e307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d573dd77f3b24ee4b650ca45e657e307", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d573dd77f3b24ee4b650ca45e657e307"}]}] Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ListServerFiltersTestJSON-307812601 Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: d573dd77f3b24ee4b650ca45e657e307 Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-307812601 Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ListServerFiltersTestJSON-307812601-project Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cab4906c7a3748b4b0a1df38423d82a9 Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ListServerFiltersTestJSON-307812601-project Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance c5201f0a-eea0-4c6f-8304-9371561ae2ef could not be found. Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c5201f0a-eea0-4c6f-8304-9371561ae2ef'} Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5201f0a-eea0-4c6f-8304-9371561ae2ef could not be found. Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5201f0a-eea0-4c6f-8304-9371561ae2ef could not be found. Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:19.201579 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:19.206405 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:19.206405 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:19.206405 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:19.206405 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:19.206405 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:19.206405 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5201f0a-eea0-4c6f-8304-9371561ae2ef could not be found. Oct 29 03:04:19.206405 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:19.217465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Returning 404 to user: Instance c5201f0a-eea0-4c6f-8304-9371561ae2ef could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:19.221973 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-42354bb9-b85f-40e8-80af-c1f09af3b3b0 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef" status: 404 len: 111 microversion: 2.1 time: 0.108103 Oct 29 03:04:19.224823 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2160/4276] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:19 2022] GET /compute/v2.1/servers/c5201f0a-eea0-4c6f-8304-9371561ae2ef => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:19.237677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49ec039e-51c5-48cb-bc8d-6b941cd5656c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:19.238731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49ec039e-51c5-48cb-bc8d-6b941cd5656c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:19.247553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ec039e-51c5-48cb-bc8d-6b941cd5656c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.248487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ec039e-51c5-48cb-bc8d-6b941cd5656c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.249140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ec039e-51c5-48cb-bc8d-6b941cd5656c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.250541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ec039e-51c5-48cb-bc8d-6b941cd5656c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.251381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ec039e-51c5-48cb-bc8d-6b941cd5656c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.252038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49ec039e-51c5-48cb-bc8d-6b941cd5656c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.291988 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-57237dc8-91c3-45f8-93a8-07533ee9c2b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809225 Oct 29 03:04:19.305313 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2117/4277] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:04:19.312554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c4f4541b-21a8-4536-bbf4-86fc3ea7adf2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:19.313362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c4f4541b-21a8-4536-bbf4-86fc3ea7adf2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:19.330609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f4541b-21a8-4536-bbf4-86fc3ea7adf2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.331119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f4541b-21a8-4536-bbf4-86fc3ea7adf2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.331559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f4541b-21a8-4536-bbf4-86fc3ea7adf2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.332269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f4541b-21a8-4536-bbf4-86fc3ea7adf2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.332738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f4541b-21a8-4536-bbf4-86fc3ea7adf2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.333146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4f4541b-21a8-4536-bbf4-86fc3ea7adf2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.502483 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c4f4541b-21a8-4536-bbf4-86fc3ea7adf2 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.195977 Oct 29 03:04:19.511059 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2118/4278] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Oct 29 03:04:19 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:04:19.516248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3697194e-d27e-44d8-b0ed-c32c82323798 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:19.516645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3697194e-d27e-44d8-b0ed-c32c82323798 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 51e97f20-bb71-4576-b4a3-6673ade724a5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:19.529981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3697194e-d27e-44d8-b0ed-c32c82323798 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.530511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3697194e-d27e-44d8-b0ed-c32c82323798 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.531567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3697194e-d27e-44d8-b0ed-c32c82323798 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.534489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3697194e-d27e-44d8-b0ed-c32c82323798 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.534962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3697194e-d27e-44d8-b0ed-c32c82323798 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.535389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3697194e-d27e-44d8-b0ed-c32c82323798 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.557178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-49ec039e-51c5-48cb-bc8d-6b941cd5656c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:19.566689 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-49ec039e-51c5-48cb-bc8d-6b941cd5656c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.340522 Oct 29 03:04:19.568674 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2161/4279] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:19 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:19.574000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-65a712f5-294e-4481-9107-24e1844e3124 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:19.574933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-65a712f5-294e-4481-9107-24e1844e3124 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:19.655476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3697194e-d27e-44d8-b0ed-c32c82323798 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 51e97f20-bb71-4576-b4a3-6673ade724a5] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:04:19.687767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-65a712f5-294e-4481-9107-24e1844e3124 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:19.700676 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-65a712f5-294e-4481-9107-24e1844e3124 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1217 microversion: 2.1 time: 0.129856 Oct 29 03:04:19.714445 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2162/4280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:19 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:19.732099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cb60f000-2963-493c-82f4-808e946ac7ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:19.733707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cb60f000-2963-493c-82f4-808e946ac7ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:19.741527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:19.768257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb60f000-2963-493c-82f4-808e946ac7ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.768779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb60f000-2963-493c-82f4-808e946ac7ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.769200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb60f000-2963-493c-82f4-808e946ac7ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.772156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb60f000-2963-493c-82f4-808e946ac7ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.773485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb60f000-2963-493c-82f4-808e946ac7ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.773956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb60f000-2963-493c-82f4-808e946ac7ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.838547 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3697194e-d27e-44d8-b0ed-c32c82323798 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5" status: 204 len: 0 microversion: 2.1 time: 0.326075 Oct 29 03:04:19.839832 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2119/4281] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:04:19 2022] DELETE /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:04:19.889928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0d092da8-5b7f-4bdd-859b-3c158d6812b4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:19.896823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0d092da8-5b7f-4bdd-859b-3c158d6812b4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 51e97f20-bb71-4576-b4a3-6673ade724a5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:19.919450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d092da8-5b7f-4bdd-859b-3c158d6812b4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.920395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d092da8-5b7f-4bdd-859b-3c158d6812b4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.921146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d092da8-5b7f-4bdd-859b-3c158d6812b4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.922471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d092da8-5b7f-4bdd-859b-3c158d6812b4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.923211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d092da8-5b7f-4bdd-859b-3c158d6812b4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.924303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d092da8-5b7f-4bdd-859b-3c158d6812b4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:20.050800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cb60f000-2963-493c-82f4-808e946ac7ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:20.060957 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cb60f000-2963-493c-82f4-808e946ac7ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1320 microversion: 2.1 time: 0.344277 Oct 29 03:04:20.062277 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2163/4282] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:19 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:20.602062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7cbca6b-fc9b-41b7-b15a-f16c97d30bc2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:20.603011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7cbca6b-fc9b-41b7-b15a-f16c97d30bc2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:20.616250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7cbca6b-fc9b-41b7-b15a-f16c97d30bc2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:20.618677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7cbca6b-fc9b-41b7-b15a-f16c97d30bc2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:20.619135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7cbca6b-fc9b-41b7-b15a-f16c97d30bc2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:20.622096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7cbca6b-fc9b-41b7-b15a-f16c97d30bc2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:20.622660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7cbca6b-fc9b-41b7-b15a-f16c97d30bc2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:20.624224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7cbca6b-fc9b-41b7-b15a-f16c97d30bc2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:20.881319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0d092da8-5b7f-4bdd-859b-3c158d6812b4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:20.887356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a7cbca6b-fc9b-41b7-b15a-f16c97d30bc2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:20.894805 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0d092da8-5b7f-4bdd-859b-3c158d6812b4 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5" status: 200 len: 1515 microversion: 2.1 time: 1.049503 Oct 29 03:04:20.900267 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7cbca6b-fc9b-41b7-b15a-f16c97d30bc2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.303802 Oct 29 03:04:20.913831 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2164/4283] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:20 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:20.914024 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2120/4284] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:19 2022] GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5 => generated 1515 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:20.924948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fe323b96-c2e8-4782-a961-66fe12fe76a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:20.925566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fe323b96-c2e8-4782-a961-66fe12fe76a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:20.940071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe323b96-c2e8-4782-a961-66fe12fe76a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:20.940551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe323b96-c2e8-4782-a961-66fe12fe76a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:20.942079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe323b96-c2e8-4782-a961-66fe12fe76a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:20.943172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe323b96-c2e8-4782-a961-66fe12fe76a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:20.943675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe323b96-c2e8-4782-a961-66fe12fe76a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:20.944166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe323b96-c2e8-4782-a961-66fe12fe76a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:21.089919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9da84ae9-33ce-462c-a4f3-c5e77cd2ad62 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:21.090137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fe323b96-c2e8-4782-a961-66fe12fe76a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:21.090747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9da84ae9-33ce-462c-a4f3-c5e77cd2ad62 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:21.094312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:21.104323 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fe323b96-c2e8-4782-a961-66fe12fe76a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1221 microversion: 2.1 time: 0.182201 Oct 29 03:04:21.107066 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2165/4285] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:20 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1221 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:21.112394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9da84ae9-33ce-462c-a4f3-c5e77cd2ad62 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:21.113123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9da84ae9-33ce-462c-a4f3-c5e77cd2ad62 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:21.113692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9da84ae9-33ce-462c-a4f3-c5e77cd2ad62 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:21.115143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9da84ae9-33ce-462c-a4f3-c5e77cd2ad62 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:21.118014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9da84ae9-33ce-462c-a4f3-c5e77cd2ad62 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:21.121451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9da84ae9-33ce-462c-a4f3-c5e77cd2ad62 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:21.924334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a5e4797d-469e-4af6-8283-1e320a25855f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:21.925658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a5e4797d-469e-4af6-8283-1e320a25855f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:21.934656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=15 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:21.938961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5e4797d-469e-4af6-8283-1e320a25855f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:21.943416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5e4797d-469e-4af6-8283-1e320a25855f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:21.945785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5e4797d-469e-4af6-8283-1e320a25855f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:21.950432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5e4797d-469e-4af6-8283-1e320a25855f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:21.951235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5e4797d-469e-4af6-8283-1e320a25855f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:21.951991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5e4797d-469e-4af6-8283-1e320a25855f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.243882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a5e4797d-469e-4af6-8283-1e320a25855f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:22.256331 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a5e4797d-469e-4af6-8283-1e320a25855f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.336604 Oct 29 03:04:22.275768 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2166/4286] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:21 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:22.282017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c377cc1e-2686-4e59-a7a5-25a156ccce0c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:22.282912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c377cc1e-2686-4e59-a7a5-25a156ccce0c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 51e97f20-bb71-4576-b4a3-6673ade724a5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:22.290741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c377cc1e-2686-4e59-a7a5-25a156ccce0c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:22.291540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c377cc1e-2686-4e59-a7a5-25a156ccce0c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:22.292178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c377cc1e-2686-4e59-a7a5-25a156ccce0c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.293111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c377cc1e-2686-4e59-a7a5-25a156ccce0c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:22.293767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c377cc1e-2686-4e59-a7a5-25a156ccce0c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:22.294445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c377cc1e-2686-4e59-a7a5-25a156ccce0c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.567721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c377cc1e-2686-4e59-a7a5-25a156ccce0c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:22.582636 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c377cc1e-2686-4e59-a7a5-25a156ccce0c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5" status: 200 len: 1515 microversion: 2.1 time: 0.305305 Oct 29 03:04:22.586797 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2167/4287] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:22 2022] GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5 => generated 1515 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:22.597323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b677c27-ad7d-4673-90d3-aa60767fea89 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:22.598336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b677c27-ad7d-4673-90d3-aa60767fea89 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:22.616609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b677c27-ad7d-4673-90d3-aa60767fea89 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:22.617419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b677c27-ad7d-4673-90d3-aa60767fea89 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:22.618652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b677c27-ad7d-4673-90d3-aa60767fea89 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.622123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b677c27-ad7d-4673-90d3-aa60767fea89 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:22.622608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b677c27-ad7d-4673-90d3-aa60767fea89 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:22.623046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b677c27-ad7d-4673-90d3-aa60767fea89 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.758805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2b677c27-ad7d-4673-90d3-aa60767fea89 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:22.767594 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b677c27-ad7d-4673-90d3-aa60767fea89 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1275 microversion: 2.1 time: 0.179606 Oct 29 03:04:22.768178 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2168/4288] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:22 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:22.804349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-05db9408-b94c-43a6-8a25-44eac498ef67 req-56f68815-6c0c-4110-9b70-61f30501e110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f439b2b6-1302-414a-93d3-f162321fd6c6", "tag": "291472dd-c560-4f62-ae19-0af367acb98e"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:22.837390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-05db9408-b94c-43a6-8a25-44eac498ef67 req-56f68815-6c0c-4110-9b70-61f30501e110 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:22.838227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-05db9408-b94c-43a6-8a25-44eac498ef67 req-56f68815-6c0c-4110-9b70-61f30501e110 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:22.841630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-05db9408-b94c-43a6-8a25-44eac498ef67 req-56f68815-6c0c-4110-9b70-61f30501e110 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.894887 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-05db9408-b94c-43a6-8a25-44eac498ef67 req-56f68815-6c0c-4110-9b70-61f30501e110 service nova] Creating event network-changed:291472dd-c560-4f62-ae19-0af367acb98e for instance f439b2b6-1302-414a-93d3-f162321fd6c6 on n-h1-862964-4 Oct 29 03:04:22.903588 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-05db9408-b94c-43a6-8a25-44eac498ef67 req-56f68815-6c0c-4110-9b70-61f30501e110 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111932 Oct 29 03:04:22.906412 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2169/4289] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 29 03:04:23.055156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9da84ae9-33ce-462c-a4f3-c5e77cd2ad62 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:23.074031 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9da84ae9-33ce-462c-a4f3-c5e77cd2ad62 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1320 microversion: 2.1 time: 1.983209 Oct 29 03:04:23.076074 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2121/4290] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:21 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1320 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:23.283395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20efe89e-054f-465f-8b87-437b5f0d4b91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:23.285632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-20efe89e-054f-465f-8b87-437b5f0d4b91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:23.308889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20efe89e-054f-465f-8b87-437b5f0d4b91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:23.309383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20efe89e-054f-465f-8b87-437b5f0d4b91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:23.309849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20efe89e-054f-465f-8b87-437b5f0d4b91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:23.310556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20efe89e-054f-465f-8b87-437b5f0d4b91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:23.311004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20efe89e-054f-465f-8b87-437b5f0d4b91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:23.320787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20efe89e-054f-465f-8b87-437b5f0d4b91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:23.608832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-473c46b0-d63e-440a-9b37-1131524c54cb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:23.609742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-473c46b0-d63e-440a-9b37-1131524c54cb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 51e97f20-bb71-4576-b4a3-6673ade724a5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:23.623835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-473c46b0-d63e-440a-9b37-1131524c54cb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:23.624333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-473c46b0-d63e-440a-9b37-1131524c54cb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:23.624835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-473c46b0-d63e-440a-9b37-1131524c54cb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:23.625550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-473c46b0-d63e-440a-9b37-1131524c54cb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:23.626036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-473c46b0-d63e-440a-9b37-1131524c54cb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:23.626454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-473c46b0-d63e-440a-9b37-1131524c54cb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:23.883809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20efe89e-054f-465f-8b87-437b5f0d4b91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:23.919659 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20efe89e-054f-465f-8b87-437b5f0d4b91 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.636439 Oct 29 03:04:23.939757 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2170/4291] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:23 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:23.958650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-567bcc5a-da8a-4690-bc88-39a61f790912 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:23.961705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-567bcc5a-da8a-4690-bc88-39a61f790912 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:23.983896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-567bcc5a-da8a-4690-bc88-39a61f790912 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:24.012950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-567bcc5a-da8a-4690-bc88-39a61f790912 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:24.013479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-567bcc5a-da8a-4690-bc88-39a61f790912 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:24.021723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-567bcc5a-da8a-4690-bc88-39a61f790912 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:24.024221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-567bcc5a-da8a-4690-bc88-39a61f790912 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:24.024702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-567bcc5a-da8a-4690-bc88-39a61f790912 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:24.408893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-567bcc5a-da8a-4690-bc88-39a61f790912 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:24.419698 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-567bcc5a-da8a-4690-bc88-39a61f790912 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1275 microversion: 2.1 time: 0.476753 Oct 29 03:04:24.420290 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2171/4292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:23 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1275 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:24.428071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-7d9ceca2-ca81-402e-bf49-642937423cad req-bfd36f51-176b-482d-a9af-1c165c7c105c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796202dc-3a57-414c-bb69-53b9dbeb8fcb", "name": "network-vif-plugged", "status": "completed", "tag": "2acf83c7-0475-49c5-b9d3-60a9c70bfc7d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:24.461124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7d9ceca2-ca81-402e-bf49-642937423cad req-bfd36f51-176b-482d-a9af-1c165c7c105c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:24.461683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7d9ceca2-ca81-402e-bf49-642937423cad req-bfd36f51-176b-482d-a9af-1c165c7c105c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:24.465211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7d9ceca2-ca81-402e-bf49-642937423cad req-bfd36f51-176b-482d-a9af-1c165c7c105c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:24.529043 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-7d9ceca2-ca81-402e-bf49-642937423cad req-bfd36f51-176b-482d-a9af-1c165c7c105c service nova] Creating event network-vif-plugged:2acf83c7-0475-49c5-b9d3-60a9c70bfc7d for instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb on n-h2-862964-4 Oct 29 03:04:24.566467 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-7d9ceca2-ca81-402e-bf49-642937423cad req-bfd36f51-176b-482d-a9af-1c165c7c105c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129363 Oct 29 03:04:24.567744 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2172/4293] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:24.574398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c43ffbf3-becf-465e-a4f0-b2f48e2451c4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:24.575413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c43ffbf3-becf-465e-a4f0-b2f48e2451c4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:24.584951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c43ffbf3-becf-465e-a4f0-b2f48e2451c4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:24.585625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c43ffbf3-becf-465e-a4f0-b2f48e2451c4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:24.586297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c43ffbf3-becf-465e-a4f0-b2f48e2451c4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:24.587080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c43ffbf3-becf-465e-a4f0-b2f48e2451c4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:24.587645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c43ffbf3-becf-465e-a4f0-b2f48e2451c4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:24.588435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c43ffbf3-becf-465e-a4f0-b2f48e2451c4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:24.616378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-473c46b0-d63e-440a-9b37-1131524c54cb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:24.627069 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-473c46b0-d63e-440a-9b37-1131524c54cb tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5" status: 200 len: 1473 microversion: 2.1 time: 1.022329 Oct 29 03:04:24.650423 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2122/4294] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:23 2022] GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5 => generated 1473 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:24.955242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c43ffbf3-becf-465e-a4f0-b2f48e2451c4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:24.955994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a34cce4b-c2b1-4498-9536-c7444a17c5ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:24.956747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a34cce4b-c2b1-4498-9536-c7444a17c5ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:24.966515 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c43ffbf3-becf-465e-a4f0-b2f48e2451c4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1320 microversion: 2.1 time: 0.397284 Oct 29 03:04:24.974757 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2173/4295] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:24 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1320 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:24.983241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34cce4b-c2b1-4498-9536-c7444a17c5ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.000732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34cce4b-c2b1-4498-9536-c7444a17c5ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.001186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34cce4b-c2b1-4498-9536-c7444a17c5ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.013972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34cce4b-c2b1-4498-9536-c7444a17c5ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.014631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34cce4b-c2b1-4498-9536-c7444a17c5ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.015171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34cce4b-c2b1-4498-9536-c7444a17c5ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.305440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-0477b7bb-afdc-4449-9cb2-9b4153dcbc2c req-f501f544-29f7-4e3b-be2d-35b23e322478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e97f20-bb71-4576-b4a3-6673ade724a5", "name": "network-vif-deleted", "tag": "73419146-73a9-49da-8499-ad30aa72e6c3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:25.336285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0477b7bb-afdc-4449-9cb2-9b4153dcbc2c req-f501f544-29f7-4e3b-be2d-35b23e322478 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.336767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0477b7bb-afdc-4449-9cb2-9b4153dcbc2c req-f501f544-29f7-4e3b-be2d-35b23e322478 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.337201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0477b7bb-afdc-4449-9cb2-9b4153dcbc2c req-f501f544-29f7-4e3b-be2d-35b23e322478 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.445367 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-0477b7bb-afdc-4449-9cb2-9b4153dcbc2c req-f501f544-29f7-4e3b-be2d-35b23e322478 service nova] Creating event network-vif-deleted:73419146-73a9-49da-8499-ad30aa72e6c3 for instance 51e97f20-bb71-4576-b4a3-6673ade724a5 on n-h1-862964-4 Oct 29 03:04:25.475008 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-0477b7bb-afdc-4449-9cb2-9b4153dcbc2c req-f501f544-29f7-4e3b-be2d-35b23e322478 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169373 Oct 29 03:04:25.494153 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2174/4296] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:04:25.513638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2f5dadec-99e0-46b6-9da8-6fbb0c258dc7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:25.522310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2f5dadec-99e0-46b6-9da8-6fbb0c258dc7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:25.542965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f5dadec-99e0-46b6-9da8-6fbb0c258dc7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.548419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f5dadec-99e0-46b6-9da8-6fbb0c258dc7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.549349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f5dadec-99e0-46b6-9da8-6fbb0c258dc7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.550722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f5dadec-99e0-46b6-9da8-6fbb0c258dc7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.554953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f5dadec-99e0-46b6-9da8-6fbb0c258dc7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.555674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2f5dadec-99e0-46b6-9da8-6fbb0c258dc7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.652420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a34cce4b-c2b1-4498-9536-c7444a17c5ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:25.669658 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a34cce4b-c2b1-4498-9536-c7444a17c5ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.716667 Oct 29 03:04:25.690151 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2123/4297] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:24 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:25.695084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:25.696372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 51e97f20-bb71-4576-b4a3-6673ade724a5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:25.705352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.705884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.706475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.707342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.707930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.708486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.803240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.803752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.811584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.815609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lazy-loading 'fault' on Instance uuid 51e97f20-bb71-4576-b4a3-6673ade724a5 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:25.883391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2f5dadec-99e0-46b6-9da8-6fbb0c258dc7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:25.896346 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2f5dadec-99e0-46b6-9da8-6fbb0c258dc7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1317 microversion: 2.1 time: 0.399562 Oct 29 03:04:25.918217 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2175/4298] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:25 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:25.976226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:25.985557 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81848230-b38a-4513-ada2-a6f8c764965c tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5" status: 200 len: 1309 microversion: 2.1 time: 0.294272 Oct 29 03:04:25.995110 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2124/4299] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:25 2022] GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5 => generated 1309 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:26.010814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f25e543b-c350-4733-8077-e312799802c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:26.011774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f25e543b-c350-4733-8077-e312799802c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:26.023641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25e543b-c350-4733-8077-e312799802c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:26.024924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25e543b-c350-4733-8077-e312799802c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:26.025486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25e543b-c350-4733-8077-e312799802c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:26.030732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25e543b-c350-4733-8077-e312799802c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:26.032392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25e543b-c350-4733-8077-e312799802c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:26.032958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f25e543b-c350-4733-8077-e312799802c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:26.373246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f25e543b-c350-4733-8077-e312799802c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:26.388628 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f25e543b-c350-4733-8077-e312799802c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1320 microversion: 2.1 time: 0.385653 Oct 29 03:04:26.390297 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2176/4300] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:26 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1320 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:26.696969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3e7b5afd-c293-48c7-9c9f-2b2ad0f35857 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:26.697631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3e7b5afd-c293-48c7-9c9f-2b2ad0f35857 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:26.707551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e7b5afd-c293-48c7-9c9f-2b2ad0f35857 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:26.708040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e7b5afd-c293-48c7-9c9f-2b2ad0f35857 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:26.710323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e7b5afd-c293-48c7-9c9f-2b2ad0f35857 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:26.711223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e7b5afd-c293-48c7-9c9f-2b2ad0f35857 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:26.714238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e7b5afd-c293-48c7-9c9f-2b2ad0f35857 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:26.714853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e7b5afd-c293-48c7-9c9f-2b2ad0f35857 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:26.920682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-052bd64d-4c26-443a-92e0-3a73f261a1dd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:26.922725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-052bd64d-4c26-443a-92e0-3a73f261a1dd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:26.931200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-052bd64d-4c26-443a-92e0-3a73f261a1dd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:26.935477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-052bd64d-4c26-443a-92e0-3a73f261a1dd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:26.936126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-052bd64d-4c26-443a-92e0-3a73f261a1dd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:26.937061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-052bd64d-4c26-443a-92e0-3a73f261a1dd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:26.940814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-052bd64d-4c26-443a-92e0-3a73f261a1dd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:26.941492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-052bd64d-4c26-443a-92e0-3a73f261a1dd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:26.978489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3e7b5afd-c293-48c7-9c9f-2b2ad0f35857 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:26.997493 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3e7b5afd-c293-48c7-9c9f-2b2ad0f35857 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.304449 Oct 29 03:04:26.999716 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2125/4301] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:26 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:27.011811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:27.012647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 51e97f20-bb71-4576-b4a3-6673ade724a5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:27.020079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.020804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.021446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.022322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.023582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.024185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.042955 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] HTTP exception thrown: Instance 51e97f20-bb71-4576-b4a3-6673ade724a5 could not be found. Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Request method failure captured: Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5 HTTP/1.1 Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJfm3KomrxfdqSfpOMRJ91Sa-UvqNIIH6LBs6gomrtZLesuEcLUt6b5emDSJAb9fzuJ6twCmQh-Fpbv31LHJ2Z3E_p-wYd_KfUgbCTR4preko0UrLE6obT-b5HdrjB98dKHNESuIM_2medvhIAGXC1sMRlroNmxHFbHQiFdGdYnywYk Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: d573dd77f3b24ee4b650ca45e657e307 Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ListServerFiltersTestJSON-307812601 Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d573dd77f3b24ee4b650ca45e657e307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d573dd77f3b24ee4b650ca45e657e307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d573dd77f3b24ee4b650ca45e657e307", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d573dd77f3b24ee4b650ca45e657e307"}]}] Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ListServerFiltersTestJSON-307812601 Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: d573dd77f3b24ee4b650ca45e657e307 Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-307812601 Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ListServerFiltersTestJSON-307812601-project Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cab4906c7a3748b4b0a1df38423d82a9 Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ListServerFiltersTestJSON-307812601-project Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 51e97f20-bb71-4576-b4a3-6673ade724a5 could not be found. Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '51e97f20-bb71-4576-b4a3-6673ade724a5'} Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e97f20-bb71-4576-b4a3-6673ade724a5 could not be found. Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e97f20-bb71-4576-b4a3-6673ade724a5 could not be found. Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:27.045169 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:27.049715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:27.049715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:27.049715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:27.049715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:27.049715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:27.049715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e97f20-bb71-4576-b4a3-6673ade724a5 could not be found. Oct 29 03:04:27.049715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:27.051151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Returning 404 to user: Instance 51e97f20-bb71-4576-b4a3-6673ade724a5 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:27.052203 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a0a99a41-88b2-4fe3-a37a-a2d2628428db tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5" status: 404 len: 111 microversion: 2.1 time: 0.047576 Oct 29 03:04:27.053291 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2126/4302] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:27 2022] GET /compute/v2.1/servers/51e97f20-bb71-4576-b4a3-6673ade724a5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:04:27.067416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89559f88-c1a0-4275-a59e-b2ee0bef7b75 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:27.068208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89559f88-c1a0-4275-a59e-b2ee0bef7b75 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:27.075588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89559f88-c1a0-4275-a59e-b2ee0bef7b75 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.076484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89559f88-c1a0-4275-a59e-b2ee0bef7b75 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.077111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89559f88-c1a0-4275-a59e-b2ee0bef7b75 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.078281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89559f88-c1a0-4275-a59e-b2ee0bef7b75 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.078929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89559f88-c1a0-4275-a59e-b2ee0bef7b75 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.079538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89559f88-c1a0-4275-a59e-b2ee0bef7b75 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.137967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89559f88-c1a0-4275-a59e-b2ee0bef7b75 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:04:27.204758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-052bd64d-4c26-443a-92e0-3a73f261a1dd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:27.223181 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-052bd64d-4c26-443a-92e0-3a73f261a1dd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1317 microversion: 2.1 time: 0.306355 Oct 29 03:04:27.226136 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2177/4303] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:26 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:27.298036 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89559f88-c1a0-4275-a59e-b2ee0bef7b75 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "DELETE /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 204 len: 0 microversion: 2.1 time: 0.237267 Oct 29 03:04:27.299308 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2127/4304] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:04:27 2022] DELETE /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:04:27.307729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6f52a1b8-d2cc-43da-a426-d3187d972552 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:27.308443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6f52a1b8-d2cc-43da-a426-d3187d972552 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:27.321471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f52a1b8-d2cc-43da-a426-d3187d972552 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.323004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f52a1b8-d2cc-43da-a426-d3187d972552 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.323656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f52a1b8-d2cc-43da-a426-d3187d972552 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.325921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f52a1b8-d2cc-43da-a426-d3187d972552 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.329145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f52a1b8-d2cc-43da-a426-d3187d972552 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.329971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f52a1b8-d2cc-43da-a426-d3187d972552 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.407430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:27.421139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0f733eff-afdf-4bae-acdb-5f4beb41e7e2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:27.422130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0f733eff-afdf-4bae-acdb-5f4beb41e7e2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:27.432089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f733eff-afdf-4bae-acdb-5f4beb41e7e2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.434901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f733eff-afdf-4bae-acdb-5f4beb41e7e2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.435547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f733eff-afdf-4bae-acdb-5f4beb41e7e2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.437509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f733eff-afdf-4bae-acdb-5f4beb41e7e2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.438363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f733eff-afdf-4bae-acdb-5f4beb41e7e2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.443691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f733eff-afdf-4bae-acdb-5f4beb41e7e2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.648253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f52a1b8-d2cc-43da-a426-d3187d972552 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:27.660170 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6f52a1b8-d2cc-43da-a426-d3187d972552 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1517 microversion: 2.1 time: 0.356577 Oct 29 03:04:27.661142 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2178/4305] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:27 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1517 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:27.675284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da46e9fd-a58a-45cb-8ace-600c535e44c9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:27.687651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-da46e9fd-a58a-45cb-8ace-600c535e44c9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:27.694681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da46e9fd-a58a-45cb-8ace-600c535e44c9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.697682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da46e9fd-a58a-45cb-8ace-600c535e44c9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.698153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da46e9fd-a58a-45cb-8ace-600c535e44c9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.698904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da46e9fd-a58a-45cb-8ace-600c535e44c9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.699367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da46e9fd-a58a-45cb-8ace-600c535e44c9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.699788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da46e9fd-a58a-45cb-8ace-600c535e44c9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.750276 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-da46e9fd-a58a-45cb-8ace-600c535e44c9 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087924 Oct 29 03:04:27.751455 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2179/4306] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:04:27 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:04:27.756071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a8857828-f0a3-45ca-9d31-b5fb90b2df32 req-04343452-c4d2-4ede-8400-8e63d198c0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db54eba0-267c-4806-b337-72d0ccf62f9d", "tag": "944eac58-0eae-42eb-a399-4e18ac946e56"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:27.772300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a8857828-f0a3-45ca-9d31-b5fb90b2df32 req-04343452-c4d2-4ede-8400-8e63d198c0dd service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.773339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a8857828-f0a3-45ca-9d31-b5fb90b2df32 req-04343452-c4d2-4ede-8400-8e63d198c0dd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.774492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a8857828-f0a3-45ca-9d31-b5fb90b2df32 req-04343452-c4d2-4ede-8400-8e63d198c0dd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.789505 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a8857828-f0a3-45ca-9d31-b5fb90b2df32 req-04343452-c4d2-4ede-8400-8e63d198c0dd service nova] Creating event network-changed:944eac58-0eae-42eb-a399-4e18ac946e56 for instance db54eba0-267c-4806-b337-72d0ccf62f9d on n-h1-862964-4 Oct 29 03:04:27.792122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0f733eff-afdf-4bae-acdb-5f4beb41e7e2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:27.796545 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a8857828-f0a3-45ca-9d31-b5fb90b2df32 req-04343452-c4d2-4ede-8400-8e63d198c0dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043233 Oct 29 03:04:27.797830 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2180/4307] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:27.803954 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0f733eff-afdf-4bae-acdb-5f4beb41e7e2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1502 microversion: 2.1 time: 0.394749 Oct 29 03:04:27.805829 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2128/4308] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:27 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:27.831544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5a4b084-0f5d-4cf3-8368-42d433829425 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:27.833283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b5a4b084-0f5d-4cf3-8368-42d433829425 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:27.841129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5a4b084-0f5d-4cf3-8368-42d433829425 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.841748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5a4b084-0f5d-4cf3-8368-42d433829425 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.842308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5a4b084-0f5d-4cf3-8368-42d433829425 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.843544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5a4b084-0f5d-4cf3-8368-42d433829425 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.844201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5a4b084-0f5d-4cf3-8368-42d433829425 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.844738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5a4b084-0f5d-4cf3-8368-42d433829425 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.857389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f153350-4c13-4f7c-882d-b458117b1de3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:27.859910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f153350-4c13-4f7c-882d-b458117b1de3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:27.866928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f153350-4c13-4f7c-882d-b458117b1de3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.867423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f153350-4c13-4f7c-882d-b458117b1de3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.868172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f153350-4c13-4f7c-882d-b458117b1de3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.868880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f153350-4c13-4f7c-882d-b458117b1de3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.869320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f153350-4c13-4f7c-882d-b458117b1de3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.869954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f153350-4c13-4f7c-882d-b458117b1de3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.907197 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f153350-4c13-4f7c-882d-b458117b1de3 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055778 Oct 29 03:04:27.913582 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2129/4309] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:04:27 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 03:04:27.993368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:27.993778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:28.017871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.017871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.017871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.021577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.028858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.029305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.131076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b5a4b084-0f5d-4cf3-8368-42d433829425 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:28.139825 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b5a4b084-0f5d-4cf3-8368-42d433829425 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1502 microversion: 2.1 time: 0.312895 Oct 29 03:04:28.144093 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2181/4310] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:27 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:28.150363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eb25dd75-8bad-46e8-8c5c-bdbd425710cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:28.151304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eb25dd75-8bad-46e8-8c5c-bdbd425710cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:28.158819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb25dd75-8bad-46e8-8c5c-bdbd425710cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.159645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb25dd75-8bad-46e8-8c5c-bdbd425710cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.160303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb25dd75-8bad-46e8-8c5c-bdbd425710cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.161235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb25dd75-8bad-46e8-8c5c-bdbd425710cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.161935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb25dd75-8bad-46e8-8c5c-bdbd425710cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.162591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb25dd75-8bad-46e8-8c5c-bdbd425710cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.370419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eb25dd75-8bad-46e8-8c5c-bdbd425710cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:28.379395 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eb25dd75-8bad-46e8-8c5c-bdbd425710cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.233592 Oct 29 03:04:28.379593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:28.380339 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2182/4311] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:28 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:28.385352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c24c65b-c51a-43cc-934b-aee79e73e954 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:28.386054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0c24c65b-c51a-43cc-934b-aee79e73e954 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:28.390131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:28.392700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:28.394217 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6fdd9162-a6a6-4dfa-8511-1b1accb6ac6e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2950 microversion: 2.42 time: 0.405289 Oct 29 03:04:28.395192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c24c65b-c51a-43cc-934b-aee79e73e954 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.395438 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2130/4312] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:27 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2950 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:04:28.396123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c24c65b-c51a-43cc-934b-aee79e73e954 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.396738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c24c65b-c51a-43cc-934b-aee79e73e954 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.397629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c24c65b-c51a-43cc-934b-aee79e73e954 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.398274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c24c65b-c51a-43cc-934b-aee79e73e954 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.398865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c24c65b-c51a-43cc-934b-aee79e73e954 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.400536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b3674fca-1259-4936-a54e-b755500408d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:28.401095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b3674fca-1259-4936-a54e-b755500408d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:28.411253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3674fca-1259-4936-a54e-b755500408d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.412043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3674fca-1259-4936-a54e-b755500408d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.412944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3674fca-1259-4936-a54e-b755500408d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.413996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3674fca-1259-4936-a54e-b755500408d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.414621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3674fca-1259-4936-a54e-b755500408d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.415361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3674fca-1259-4936-a54e-b755500408d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.446418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0c24c65b-c51a-43cc-934b-aee79e73e954 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:04:28.469566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b3674fca-1259-4936-a54e-b755500408d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:04:28.566406 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0c24c65b-c51a-43cc-934b-aee79e73e954 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "DELETE /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 204 len: 0 microversion: 2.1 time: 0.184406 Oct 29 03:04:28.568174 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2183/4313] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:04:28 2022] DELETE /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:04:28.573482 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b3674fca-1259-4936-a54e-b755500408d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 204 len: 0 microversion: 2.1 time: 0.176303 Oct 29 03:04:28.574535 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2131/4314] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:04:28 2022] DELETE /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:04:28.581083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-99fd02f6-08cc-47da-9af9-813cbdf70b12 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:28.582007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-99fd02f6-08cc-47da-9af9-813cbdf70b12 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:28.588590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99fd02f6-08cc-47da-9af9-813cbdf70b12 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.589080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99fd02f6-08cc-47da-9af9-813cbdf70b12 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.589508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99fd02f6-08cc-47da-9af9-813cbdf70b12 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.590271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99fd02f6-08cc-47da-9af9-813cbdf70b12 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.590720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99fd02f6-08cc-47da-9af9-813cbdf70b12 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.591143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99fd02f6-08cc-47da-9af9-813cbdf70b12 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.594017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f6400854-23ec-4eae-b23e-29b1990ed164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:28.594737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f6400854-23ec-4eae-b23e-29b1990ed164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:28.605349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6400854-23ec-4eae-b23e-29b1990ed164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.605864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6400854-23ec-4eae-b23e-29b1990ed164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.606423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6400854-23ec-4eae-b23e-29b1990ed164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.607127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6400854-23ec-4eae-b23e-29b1990ed164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.607570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6400854-23ec-4eae-b23e-29b1990ed164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.608157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6400854-23ec-4eae-b23e-29b1990ed164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.804310 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-99fd02f6-08cc-47da-9af9-813cbdf70b12 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.228278 Oct 29 03:04:28.805555 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2132/4315] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Oct 29 03:04:28 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1/os-interface => generated 1832 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:28.811049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e6a50b7-6ddc-4a5c-a79c-3ba7f5cd8515 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:28.816747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9e6a50b7-6ddc-4a5c-a79c-3ba7f5cd8515 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:28.818583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f6400854-23ec-4eae-b23e-29b1990ed164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:28.827255 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f6400854-23ec-4eae-b23e-29b1990ed164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1317 microversion: 2.1 time: 0.257526 Oct 29 03:04:28.828879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6a50b7-6ddc-4a5c-a79c-3ba7f5cd8515 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.830154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6a50b7-6ddc-4a5c-a79c-3ba7f5cd8515 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.831155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6a50b7-6ddc-4a5c-a79c-3ba7f5cd8515 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.832524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6a50b7-6ddc-4a5c-a79c-3ba7f5cd8515 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.833054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6a50b7-6ddc-4a5c-a79c-3ba7f5cd8515 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.834168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e6a50b7-6ddc-4a5c-a79c-3ba7f5cd8515 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.838788 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2184/4316] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:28 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:28.840165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:28.844797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8463185e-a8d8-4045-bf8d-a0c5813e6734 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:28.845438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8463185e-a8d8-4045-bf8d-a0c5813e6734 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:28.860668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8463185e-a8d8-4045-bf8d-a0c5813e6734 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.860668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8463185e-a8d8-4045-bf8d-a0c5813e6734 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.860668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8463185e-a8d8-4045-bf8d-a0c5813e6734 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.860668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8463185e-a8d8-4045-bf8d-a0c5813e6734 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.860668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8463185e-a8d8-4045-bf8d-a0c5813e6734 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.860668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8463185e-a8d8-4045-bf8d-a0c5813e6734 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.042249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9e6a50b7-6ddc-4a5c-a79c-3ba7f5cd8515 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.051992 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9e6a50b7-6ddc-4a5c-a79c-3ba7f5cd8515 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1683 microversion: 2.1 time: 0.244794 Oct 29 03:04:29.052581 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2133/4317] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:28 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1683 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:29.057497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f68da1f2-51c2-4a35-871a-f001808b9cde tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:29.058121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f68da1f2-51c2-4a35-871a-f001808b9cde tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:29.064844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68da1f2-51c2-4a35-871a-f001808b9cde tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.065339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68da1f2-51c2-4a35-871a-f001808b9cde tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.065775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68da1f2-51c2-4a35-871a-f001808b9cde tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.066597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68da1f2-51c2-4a35-871a-f001808b9cde tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.067175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68da1f2-51c2-4a35-871a-f001808b9cde tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.067606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68da1f2-51c2-4a35-871a-f001808b9cde tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.078601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8463185e-a8d8-4045-bf8d-a0c5813e6734 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.088255 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8463185e-a8d8-4045-bf8d-a0c5813e6734 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1508 microversion: 2.1 time: 0.248327 Oct 29 03:04:29.105837 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2185/4318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:28 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:29.144312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:29.178869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=12 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:29.254992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f68da1f2-51c2-4a35-871a-f001808b9cde tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.263741 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f68da1f2-51c2-4a35-871a-f001808b9cde tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1517 microversion: 2.1 time: 0.210070 Oct 29 03:04:29.276344 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2134/4319] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:29 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:29.409498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-06276e7d-983e-4302-8949-58594d8648c3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:29.410134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-06276e7d-983e-4302-8949-58594d8648c3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:29.427128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06276e7d-983e-4302-8949-58594d8648c3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.427938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06276e7d-983e-4302-8949-58594d8648c3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.428522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06276e7d-983e-4302-8949-58594d8648c3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.432251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06276e7d-983e-4302-8949-58594d8648c3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.434334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06276e7d-983e-4302-8949-58594d8648c3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.434927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06276e7d-983e-4302-8949-58594d8648c3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.693035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-06276e7d-983e-4302-8949-58594d8648c3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.707738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=14 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:29.715100 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-06276e7d-983e-4302-8949-58594d8648c3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.310767 Oct 29 03:04:29.717212 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2186/4320] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:29 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:29.861013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95f86a79-ab96-49c8-afa0-0676babec609 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:29.862381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-95f86a79-ab96-49c8-afa0-0676babec609 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:29.902792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f86a79-ab96-49c8-afa0-0676babec609 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.903649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f86a79-ab96-49c8-afa0-0676babec609 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.904232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f86a79-ab96-49c8-afa0-0676babec609 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.905122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f86a79-ab96-49c8-afa0-0676babec609 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.905776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f86a79-ab96-49c8-afa0-0676babec609 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.906364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95f86a79-ab96-49c8-afa0-0676babec609 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.085173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dda90519-7e22-4b31-89e4-5bf4c2601f84 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:30.086172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dda90519-7e22-4b31-89e4-5bf4c2601f84 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:30.098948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dda90519-7e22-4b31-89e4-5bf4c2601f84 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.099637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dda90519-7e22-4b31-89e4-5bf4c2601f84 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.100245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dda90519-7e22-4b31-89e4-5bf4c2601f84 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.101199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dda90519-7e22-4b31-89e4-5bf4c2601f84 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.102536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dda90519-7e22-4b31-89e4-5bf4c2601f84 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.108028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dda90519-7e22-4b31-89e4-5bf4c2601f84 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.318422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dda90519-7e22-4b31-89e4-5bf4c2601f84 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:30.329540 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dda90519-7e22-4b31-89e4-5bf4c2601f84 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1683 microversion: 2.1 time: 0.247930 Oct 29 03:04:30.330396 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2187/4321] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:30 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1683 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:30.349578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a5cb13e9-026a-4cdb-9621-b7bc9dd5ff80 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:30.350402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a5cb13e9-026a-4cdb-9621-b7bc9dd5ff80 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:30.359996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5cb13e9-026a-4cdb-9621-b7bc9dd5ff80 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.360751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5cb13e9-026a-4cdb-9621-b7bc9dd5ff80 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.361419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5cb13e9-026a-4cdb-9621-b7bc9dd5ff80 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.362434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5cb13e9-026a-4cdb-9621-b7bc9dd5ff80 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.363047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5cb13e9-026a-4cdb-9621-b7bc9dd5ff80 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.363656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5cb13e9-026a-4cdb-9621-b7bc9dd5ff80 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.521880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-95f86a79-ab96-49c8-afa0-0676babec609 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:30.535409 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-95f86a79-ab96-49c8-afa0-0676babec609 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1317 microversion: 2.1 time: 0.680219 Oct 29 03:04:30.536900 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2135/4322] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:29 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1317 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:30.538700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a5cb13e9-026a-4cdb-9621-b7bc9dd5ff80 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:30.549353 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a5cb13e9-026a-4cdb-9621-b7bc9dd5ff80 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1508 microversion: 2.1 time: 0.217754 Oct 29 03:04:30.550338 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2188/4323] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:30 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1508 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:30.564115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a2d4b23e-1164-43c3-b144-4401c1ae87cf tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:30.564738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a2d4b23e-1164-43c3-b144-4401c1ae87cf tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:30.573570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2d4b23e-1164-43c3-b144-4401c1ae87cf tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.574326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2d4b23e-1164-43c3-b144-4401c1ae87cf tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.574937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2d4b23e-1164-43c3-b144-4401c1ae87cf tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.582318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2d4b23e-1164-43c3-b144-4401c1ae87cf tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.583065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2d4b23e-1164-43c3-b144-4401c1ae87cf tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.584303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2d4b23e-1164-43c3-b144-4401c1ae87cf tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.768009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a2635af6-e11c-46d2-b4ff-304657176cc7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:30.769113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a2635af6-e11c-46d2-b4ff-304657176cc7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:30.780588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2635af6-e11c-46d2-b4ff-304657176cc7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.784577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2635af6-e11c-46d2-b4ff-304657176cc7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.785088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2635af6-e11c-46d2-b4ff-304657176cc7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.785872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2635af6-e11c-46d2-b4ff-304657176cc7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.786339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2635af6-e11c-46d2-b4ff-304657176cc7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.786766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a2635af6-e11c-46d2-b4ff-304657176cc7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.808716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a2d4b23e-1164-43c3-b144-4401c1ae87cf tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:30.827457 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a2d4b23e-1164-43c3-b144-4401c1ae87cf tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1517 microversion: 2.1 time: 0.288398 Oct 29 03:04:30.838773 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2136/4324] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:30 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1517 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:31.016651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a2635af6-e11c-46d2-b4ff-304657176cc7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:31.029320 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a2635af6-e11c-46d2-b4ff-304657176cc7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.265257 Oct 29 03:04:31.033845 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2189/4325] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:30 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:31.356758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5e25f71-9149-4ae7-a06b-78d33fee24bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:31.357408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5e25f71-9149-4ae7-a06b-78d33fee24bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:31.373179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e25f71-9149-4ae7-a06b-78d33fee24bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.373956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e25f71-9149-4ae7-a06b-78d33fee24bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.374582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e25f71-9149-4ae7-a06b-78d33fee24bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.375180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e25f71-9149-4ae7-a06b-78d33fee24bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.375676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e25f71-9149-4ae7-a06b-78d33fee24bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.376097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5e25f71-9149-4ae7-a06b-78d33fee24bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.576987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af7834d8-bcc3-4573-ae6a-5f911c6131a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:31.577843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-af7834d8-bcc3-4573-ae6a-5f911c6131a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:31.586685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af7834d8-bcc3-4573-ae6a-5f911c6131a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.587468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af7834d8-bcc3-4573-ae6a-5f911c6131a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.587967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af7834d8-bcc3-4573-ae6a-5f911c6131a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.588738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af7834d8-bcc3-4573-ae6a-5f911c6131a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.589283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af7834d8-bcc3-4573-ae6a-5f911c6131a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.589841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af7834d8-bcc3-4573-ae6a-5f911c6131a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.592234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e5e25f71-9149-4ae7-a06b-78d33fee24bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:31.628945 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e5e25f71-9149-4ae7-a06b-78d33fee24bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1683 microversion: 2.1 time: 0.274657 Oct 29 03:04:31.629772 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2137/4326] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:31 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1683 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:31.644311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b603ffe2-7680-4f6a-828a-ee2a686fc926 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:31.646883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b603ffe2-7680-4f6a-828a-ee2a686fc926 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:31.657285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b603ffe2-7680-4f6a-828a-ee2a686fc926 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.657772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b603ffe2-7680-4f6a-828a-ee2a686fc926 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.658226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b603ffe2-7680-4f6a-828a-ee2a686fc926 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.658922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b603ffe2-7680-4f6a-828a-ee2a686fc926 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.659362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b603ffe2-7680-4f6a-828a-ee2a686fc926 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.659956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b603ffe2-7680-4f6a-828a-ee2a686fc926 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.786174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-af7834d8-bcc3-4573-ae6a-5f911c6131a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:31.797408 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-af7834d8-bcc3-4573-ae6a-5f911c6131a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1317 microversion: 2.1 time: 0.224632 Oct 29 03:04:31.805911 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2190/4327] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:31 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:31.858308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4eb09848-3793-49be-8d00-b34965f41075 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:31.859509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4eb09848-3793-49be-8d00-b34965f41075 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:31.875696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eb09848-3793-49be-8d00-b34965f41075 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.876601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eb09848-3793-49be-8d00-b34965f41075 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.877209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eb09848-3793-49be-8d00-b34965f41075 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.878135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eb09848-3793-49be-8d00-b34965f41075 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.878768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eb09848-3793-49be-8d00-b34965f41075 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.879362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4eb09848-3793-49be-8d00-b34965f41075 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.881344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b603ffe2-7680-4f6a-828a-ee2a686fc926 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:31.899543 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b603ffe2-7680-4f6a-828a-ee2a686fc926 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1508 microversion: 2.1 time: 0.259734 Oct 29 03:04:31.900822 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2138/4328] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:31 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:32.038398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-54352b57-c96a-45bb-bbe6-8b1bb5562724 req-09e1a452-9c0c-4991-a163-37735304902a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db54eba0-267c-4806-b337-72d0ccf62f9d", "name": "network-vif-plugged", "status": "completed", "tag": "944eac58-0eae-42eb-a399-4e18ac946e56"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:32.049304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-54352b57-c96a-45bb-bbe6-8b1bb5562724 req-09e1a452-9c0c-4991-a163-37735304902a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:32.049304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-54352b57-c96a-45bb-bbe6-8b1bb5562724 req-09e1a452-9c0c-4991-a163-37735304902a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:32.049304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-54352b57-c96a-45bb-bbe6-8b1bb5562724 req-09e1a452-9c0c-4991-a163-37735304902a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:32.052806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4eb09848-3793-49be-8d00-b34965f41075 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:32.062980 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4eb09848-3793-49be-8d00-b34965f41075 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1517 microversion: 2.1 time: 0.212122 Oct 29 03:04:32.065861 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-54352b57-c96a-45bb-bbe6-8b1bb5562724 req-09e1a452-9c0c-4991-a163-37735304902a service nova] Creating event network-vif-plugged:944eac58-0eae-42eb-a399-4e18ac946e56 for instance db54eba0-267c-4806-b337-72d0ccf62f9d on n-h1-862964-4 Oct 29 03:04:32.077443 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-54352b57-c96a-45bb-bbe6-8b1bb5562724 req-09e1a452-9c0c-4991-a163-37735304902a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043608 Oct 29 03:04:32.078739 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2139/4329] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:04:32.083894 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2191/4330] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:31 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:32.087252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-68a34db3-49b6-4f05-a30e-9a36e9013def tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:32.088156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-68a34db3-49b6-4f05-a30e-9a36e9013def tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:32.097890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68a34db3-49b6-4f05-a30e-9a36e9013def tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:32.098387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68a34db3-49b6-4f05-a30e-9a36e9013def tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:32.098865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68a34db3-49b6-4f05-a30e-9a36e9013def tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:32.099954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68a34db3-49b6-4f05-a30e-9a36e9013def tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:32.101031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68a34db3-49b6-4f05-a30e-9a36e9013def tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:32.101473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-68a34db3-49b6-4f05-a30e-9a36e9013def tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:32.318174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-68a34db3-49b6-4f05-a30e-9a36e9013def tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:32.336043 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-68a34db3-49b6-4f05-a30e-9a36e9013def tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1683 microversion: 2.1 time: 0.255328 Oct 29 03:04:32.337008 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2140/4331] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:32 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1683 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:32.656781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3bc793a-c6b4-4410-9c26-b3865ba25827 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:32.657559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a3bc793a-c6b4-4410-9c26-b3865ba25827 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:32.673390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc793a-c6b4-4410-9c26-b3865ba25827 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:32.673923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc793a-c6b4-4410-9c26-b3865ba25827 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:32.674365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc793a-c6b4-4410-9c26-b3865ba25827 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:32.675088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc793a-c6b4-4410-9c26-b3865ba25827 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:32.675541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc793a-c6b4-4410-9c26-b3865ba25827 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:32.676035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc793a-c6b4-4410-9c26-b3865ba25827 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:32.826406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9cf286b-1542-4b55-b1f2-73d71b2c829c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:32.827068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c9cf286b-1542-4b55-b1f2-73d71b2c829c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:32.836441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9cf286b-1542-4b55-b1f2-73d71b2c829c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:32.837084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9cf286b-1542-4b55-b1f2-73d71b2c829c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:32.837637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9cf286b-1542-4b55-b1f2-73d71b2c829c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:32.839690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9cf286b-1542-4b55-b1f2-73d71b2c829c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:32.840454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9cf286b-1542-4b55-b1f2-73d71b2c829c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:32.841136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9cf286b-1542-4b55-b1f2-73d71b2c829c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:32.891315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a3bc793a-c6b4-4410-9c26-b3865ba25827 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:32.903333 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a3bc793a-c6b4-4410-9c26-b3865ba25827 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1683 microversion: 2.1 time: 0.252056 Oct 29 03:04:32.917794 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2192/4332] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:32 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1683 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:32.930107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ad6d0301-fe29-4c06-bddf-596e70f8f469 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:32.930714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ad6d0301-fe29-4c06-bddf-596e70f8f469 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:32.942643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad6d0301-fe29-4c06-bddf-596e70f8f469 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:32.943451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad6d0301-fe29-4c06-bddf-596e70f8f469 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:32.943891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad6d0301-fe29-4c06-bddf-596e70f8f469 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:32.944601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad6d0301-fe29-4c06-bddf-596e70f8f469 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:32.945137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad6d0301-fe29-4c06-bddf-596e70f8f469 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:32.945562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad6d0301-fe29-4c06-bddf-596e70f8f469 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.017271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c9cf286b-1542-4b55-b1f2-73d71b2c829c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:33.031640 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c9cf286b-1542-4b55-b1f2-73d71b2c829c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1317 microversion: 2.1 time: 0.210378 Oct 29 03:04:33.032237 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2141/4333] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:32 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:33.090644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-637d6bb9-2925-4813-a88e-20b476df6837 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:33.091589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-637d6bb9-2925-4813-a88e-20b476df6837 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:33.097986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637d6bb9-2925-4813-a88e-20b476df6837 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.098573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637d6bb9-2925-4813-a88e-20b476df6837 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.099094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637d6bb9-2925-4813-a88e-20b476df6837 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.099874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637d6bb9-2925-4813-a88e-20b476df6837 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.100435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637d6bb9-2925-4813-a88e-20b476df6837 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.100943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-637d6bb9-2925-4813-a88e-20b476df6837 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.129638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ad6d0301-fe29-4c06-bddf-596e70f8f469 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:33.147739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:33.150619 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ad6d0301-fe29-4c06-bddf-596e70f8f469 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1508 microversion: 2.1 time: 0.225588 Oct 29 03:04:33.151226 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2193/4334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:32 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:33.250496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-637d6bb9-2925-4813-a88e-20b476df6837 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:33.259372 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-637d6bb9-2925-4813-a88e-20b476df6837 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1517 microversion: 2.1 time: 0.172718 Oct 29 03:04:33.259937 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2142/4335] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:33 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:33.364988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cbec81ff-b1ec-4b7e-8d34-c962967a72ef tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:33.365597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cbec81ff-b1ec-4b7e-8d34-c962967a72ef tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:33.373994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbec81ff-b1ec-4b7e-8d34-c962967a72ef tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.374565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbec81ff-b1ec-4b7e-8d34-c962967a72ef tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.375006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbec81ff-b1ec-4b7e-8d34-c962967a72ef tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.375702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbec81ff-b1ec-4b7e-8d34-c962967a72ef tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.376149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbec81ff-b1ec-4b7e-8d34-c962967a72ef tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.376571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbec81ff-b1ec-4b7e-8d34-c962967a72ef tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.526297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cbec81ff-b1ec-4b7e-8d34-c962967a72ef tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:33.534420 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cbec81ff-b1ec-4b7e-8d34-c962967a72ef tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.173555 Oct 29 03:04:33.535024 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2194/4336] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:33 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:33.610006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-485b8513-a9c3-4a84-b7cf-1df7fde3a8d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:33.610618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-485b8513-a9c3-4a84-b7cf-1df7fde3a8d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:33.617043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-485b8513-a9c3-4a84-b7cf-1df7fde3a8d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.618029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-485b8513-a9c3-4a84-b7cf-1df7fde3a8d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.618462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-485b8513-a9c3-4a84-b7cf-1df7fde3a8d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.619151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-485b8513-a9c3-4a84-b7cf-1df7fde3a8d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.619601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-485b8513-a9c3-4a84-b7cf-1df7fde3a8d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.620007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-485b8513-a9c3-4a84-b7cf-1df7fde3a8d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.757931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-485b8513-a9c3-4a84-b7cf-1df7fde3a8d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:33.766454 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-485b8513-a9c3-4a84-b7cf-1df7fde3a8d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.160423 Oct 29 03:04:33.767222 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2143/4337] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:33 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:33.931022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af9712bb-a630-4a59-a790-bfeaf99c40bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:33.932634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-af9712bb-a630-4a59-a790-bfeaf99c40bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:33.940430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af9712bb-a630-4a59-a790-bfeaf99c40bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.940996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af9712bb-a630-4a59-a790-bfeaf99c40bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.941589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af9712bb-a630-4a59-a790-bfeaf99c40bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.942637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af9712bb-a630-4a59-a790-bfeaf99c40bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.943239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af9712bb-a630-4a59-a790-bfeaf99c40bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.943879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af9712bb-a630-4a59-a790-bfeaf99c40bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.058866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-712e34e0-f556-493e-8f6b-7eba70857665 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:34.060770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-712e34e0-f556-493e-8f6b-7eba70857665 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:34.071208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712e34e0-f556-493e-8f6b-7eba70857665 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.071930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712e34e0-f556-493e-8f6b-7eba70857665 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.072694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712e34e0-f556-493e-8f6b-7eba70857665 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.073639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712e34e0-f556-493e-8f6b-7eba70857665 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.074377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712e34e0-f556-493e-8f6b-7eba70857665 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.074993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-712e34e0-f556-493e-8f6b-7eba70857665 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.103549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-af9712bb-a630-4a59-a790-bfeaf99c40bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:34.114272 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-af9712bb-a630-4a59-a790-bfeaf99c40bc tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1683 microversion: 2.1 time: 0.188360 Oct 29 03:04:34.115517 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2195/4338] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:33 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:34.176037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef587153-1c2d-40bd-90be-a150b56f75ac tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:34.176913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ef587153-1c2d-40bd-90be-a150b56f75ac tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:34.183423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef587153-1c2d-40bd-90be-a150b56f75ac tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.184283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef587153-1c2d-40bd-90be-a150b56f75ac tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.184872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef587153-1c2d-40bd-90be-a150b56f75ac tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.185748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef587153-1c2d-40bd-90be-a150b56f75ac tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.187266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef587153-1c2d-40bd-90be-a150b56f75ac tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.187884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef587153-1c2d-40bd-90be-a150b56f75ac tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.245584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-712e34e0-f556-493e-8f6b-7eba70857665 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:34.254417 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-712e34e0-f556-493e-8f6b-7eba70857665 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1506 microversion: 2.1 time: 0.202898 Oct 29 03:04:34.270159 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2144/4339] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:34 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:34.283436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-774c4e29-bdb2-4030-bda2-20318a05d90c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:34.283932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-774c4e29-bdb2-4030-bda2-20318a05d90c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:34.291588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-774c4e29-bdb2-4030-bda2-20318a05d90c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.292073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-774c4e29-bdb2-4030-bda2-20318a05d90c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.292498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-774c4e29-bdb2-4030-bda2-20318a05d90c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.293204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-774c4e29-bdb2-4030-bda2-20318a05d90c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.293652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-774c4e29-bdb2-4030-bda2-20318a05d90c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.294098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-774c4e29-bdb2-4030-bda2-20318a05d90c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.322164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-774c4e29-bdb2-4030-bda2-20318a05d90c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:04:34.446499 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-774c4e29-bdb2-4030-bda2-20318a05d90c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 204 len: 0 microversion: 2.1 time: 0.168723 Oct 29 03:04:34.448200 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2145/4340] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:04:34 2022] DELETE /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:04:34.455084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b1a6b84b-95c9-4cf3-9a56-5dd6defb7d92 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:34.455911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b1a6b84b-95c9-4cf3-9a56-5dd6defb7d92 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:34.466949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1a6b84b-95c9-4cf3-9a56-5dd6defb7d92 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.467872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1a6b84b-95c9-4cf3-9a56-5dd6defb7d92 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.468551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1a6b84b-95c9-4cf3-9a56-5dd6defb7d92 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.469348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1a6b84b-95c9-4cf3-9a56-5dd6defb7d92 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.469960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1a6b84b-95c9-4cf3-9a56-5dd6defb7d92 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.470452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1a6b84b-95c9-4cf3-9a56-5dd6defb7d92 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.601160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ef587153-1c2d-40bd-90be-a150b56f75ac tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:34.615214 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ef587153-1c2d-40bd-90be-a150b56f75ac tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1508 microversion: 2.1 time: 0.443027 Oct 29 03:04:34.630730 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2196/4341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:34 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:34.641321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-410c2de5-e0a1-4271-a413-a96fe969c541 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:34.642634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-410c2de5-e0a1-4271-a413-a96fe969c541 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:34.652228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-410c2de5-e0a1-4271-a413-a96fe969c541 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.653597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-410c2de5-e0a1-4271-a413-a96fe969c541 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.654282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-410c2de5-e0a1-4271-a413-a96fe969c541 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.655167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-410c2de5-e0a1-4271-a413-a96fe969c541 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.655847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-410c2de5-e0a1-4271-a413-a96fe969c541 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.656544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-410c2de5-e0a1-4271-a413-a96fe969c541 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.866003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b1a6b84b-95c9-4cf3-9a56-5dd6defb7d92 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:34.874833 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b1a6b84b-95c9-4cf3-9a56-5dd6defb7d92 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1517 microversion: 2.1 time: 0.425236 Oct 29 03:04:34.889877 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2146/4342] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:34 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1517 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:34.940442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-77b97f04-d90f-4a36-acab-6795cce28b6f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:34.941059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-77b97f04-d90f-4a36-acab-6795cce28b6f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:34.960171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b97f04-d90f-4a36-acab-6795cce28b6f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.960655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b97f04-d90f-4a36-acab-6795cce28b6f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.961083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b97f04-d90f-4a36-acab-6795cce28b6f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.961795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b97f04-d90f-4a36-acab-6795cce28b6f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.962344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b97f04-d90f-4a36-acab-6795cce28b6f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.962692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77b97f04-d90f-4a36-acab-6795cce28b6f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.986839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-410c2de5-e0a1-4271-a413-a96fe969c541 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:34.995656 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-410c2de5-e0a1-4271-a413-a96fe969c541 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1512 microversion: 2.1 time: 0.363475 Oct 29 03:04:35.010150 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2197/4343] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:34 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:35.141329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d8c610e-b735-4491-8738-d9f8983b16ea tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:35.141875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7d8c610e-b735-4491-8738-d9f8983b16ea tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:35.149273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8c610e-b735-4491-8738-d9f8983b16ea tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.150160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8c610e-b735-4491-8738-d9f8983b16ea tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.150796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8c610e-b735-4491-8738-d9f8983b16ea tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.151689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8c610e-b735-4491-8738-d9f8983b16ea tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.152321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8c610e-b735-4491-8738-d9f8983b16ea tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.152921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8c610e-b735-4491-8738-d9f8983b16ea tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.194749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-77b97f04-d90f-4a36-acab-6795cce28b6f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.229500 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-77b97f04-d90f-4a36-acab-6795cce28b6f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.292840 Oct 29 03:04:35.230980 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2147/4344] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:34 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:35.254367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16c1e2c9-17d7-4e7d-b7f8-38faa833d699 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:35.255047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-16c1e2c9-17d7-4e7d-b7f8-38faa833d699 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:35.264568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c1e2c9-17d7-4e7d-b7f8-38faa833d699 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.269328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c1e2c9-17d7-4e7d-b7f8-38faa833d699 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.270274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c1e2c9-17d7-4e7d-b7f8-38faa833d699 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.270787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c1e2c9-17d7-4e7d-b7f8-38faa833d699 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.271304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c1e2c9-17d7-4e7d-b7f8-38faa833d699 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.280008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c1e2c9-17d7-4e7d-b7f8-38faa833d699 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.474784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-16c1e2c9-17d7-4e7d-b7f8-38faa833d699 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.481829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:35.485418 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-16c1e2c9-17d7-4e7d-b7f8-38faa833d699 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.235205 Oct 29 03:04:35.486563 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2148/4345] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:35 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:35.491372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-0789ddf8-371d-42c7-a8c8-9e12a4e60a2a req-d544f833-8a25-4af9-9d47-04ca6bfb73d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b441cf-f5a0-4f54-90f4-915a2ece9984", "name": "network-vif-deleted", "tag": "09f30aad-17f6-4891-b116-438911dbd738"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:35.504447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0789ddf8-371d-42c7-a8c8-9e12a4e60a2a req-d544f833-8a25-4af9-9d47-04ca6bfb73d0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.505195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0789ddf8-371d-42c7-a8c8-9e12a4e60a2a req-d544f833-8a25-4af9-9d47-04ca6bfb73d0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.505619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0789ddf8-371d-42c7-a8c8-9e12a4e60a2a req-d544f833-8a25-4af9-9d47-04ca6bfb73d0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.521260 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-0789ddf8-371d-42c7-a8c8-9e12a4e60a2a req-d544f833-8a25-4af9-9d47-04ca6bfb73d0 service nova] Creating event network-vif-deleted:09f30aad-17f6-4891-b116-438911dbd738 for instance 77b441cf-f5a0-4f54-90f4-915a2ece9984 on n-h2-862964-4 Oct 29 03:04:35.527055 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-0789ddf8-371d-42c7-a8c8-9e12a4e60a2a req-d544f833-8a25-4af9-9d47-04ca6bfb73d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039062 Oct 29 03:04:35.527831 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2149/4346] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:35.534889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fe6b262f-e21b-4535-b04b-4c958976b604 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:35.536234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fe6b262f-e21b-4535-b04b-4c958976b604 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:35.558988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6b262f-e21b-4535-b04b-4c958976b604 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.559480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6b262f-e21b-4535-b04b-4c958976b604 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.566079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6b262f-e21b-4535-b04b-4c958976b604 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.566889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6b262f-e21b-4535-b04b-4c958976b604 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.567371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6b262f-e21b-4535-b04b-4c958976b604 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.567806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe6b262f-e21b-4535-b04b-4c958976b604 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.754551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fe6b262f-e21b-4535-b04b-4c958976b604 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.763986 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fe6b262f-e21b-4535-b04b-4c958976b604 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.234626 Oct 29 03:04:35.764630 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2150/4347] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:35 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:35.770037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9a30187d-4e25-4f3a-ba40-586dcc557366 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:35.770649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9a30187d-4e25-4f3a-ba40-586dcc557366 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:35.776707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a30187d-4e25-4f3a-ba40-586dcc557366 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.777196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a30187d-4e25-4f3a-ba40-586dcc557366 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.777630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a30187d-4e25-4f3a-ba40-586dcc557366 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.778367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a30187d-4e25-4f3a-ba40-586dcc557366 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.778932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a30187d-4e25-4f3a-ba40-586dcc557366 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.779477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a30187d-4e25-4f3a-ba40-586dcc557366 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.859663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7d8c610e-b735-4491-8738-d9f8983b16ea tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.871935 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7d8c610e-b735-4491-8738-d9f8983b16ea tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1683 microversion: 2.1 time: 0.735369 Oct 29 03:04:35.875466 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2198/4348] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:35 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1683 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:35.884996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f6032005-8112-48be-97c1-d4e4ce9ec9df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:35.905170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f6032005-8112-48be-97c1-d4e4ce9ec9df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:35.919392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6032005-8112-48be-97c1-d4e4ce9ec9df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.920444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6032005-8112-48be-97c1-d4e4ce9ec9df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.921861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6032005-8112-48be-97c1-d4e4ce9ec9df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.922948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6032005-8112-48be-97c1-d4e4ce9ec9df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.923637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6032005-8112-48be-97c1-d4e4ce9ec9df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.924266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6032005-8112-48be-97c1-d4e4ce9ec9df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.983271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9a30187d-4e25-4f3a-ba40-586dcc557366 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:36.000267 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9a30187d-4e25-4f3a-ba40-586dcc557366 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1508 microversion: 2.1 time: 0.234418 Oct 29 03:04:36.000941 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2151/4349] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:35 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:36.006993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:36.006993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:36.021658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.022178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.025987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.026691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.027186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.027631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.046532 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f6032005-8112-48be-97c1-d4e4ce9ec9df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.168325 Oct 29 03:04:36.051109 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2199/4350] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:04:35 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:04:36.069892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7a3db325-ae12-42fe-99ee-ac0c3308d0af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:36.070637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7a3db325-ae12-42fe-99ee-ac0c3308d0af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:36.097927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a3db325-ae12-42fe-99ee-ac0c3308d0af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.098432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a3db325-ae12-42fe-99ee-ac0c3308d0af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.098876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a3db325-ae12-42fe-99ee-ac0c3308d0af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.099596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a3db325-ae12-42fe-99ee-ac0c3308d0af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.100056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a3db325-ae12-42fe-99ee-ac0c3308d0af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.100487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a3db325-ae12-42fe-99ee-ac0c3308d0af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.119894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.120385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.120823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.121526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lazy-loading 'fault' on Instance uuid 77b441cf-f5a0-4f54-90f4-915a2ece9984 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:36.344318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab4906c7a3748b4b0a1df38423d82a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd573dd77f3b24ee4b650ca45e657e307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:36.352239 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7dcf83db-4b5e-4315-9a3e-ed00b7814b06 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 200 len: 1310 microversion: 2.1 time: 0.350277 Oct 29 03:04:36.384703 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2152/4351] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:36 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 1310 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:36.389919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-26efb741-c63a-442a-800f-78b58cc324f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:36.390837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-26efb741-c63a-442a-800f-78b58cc324f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:36.405792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26efb741-c63a-442a-800f-78b58cc324f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.410587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26efb741-c63a-442a-800f-78b58cc324f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.411285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26efb741-c63a-442a-800f-78b58cc324f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.412235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26efb741-c63a-442a-800f-78b58cc324f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.412845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26efb741-c63a-442a-800f-78b58cc324f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.413447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26efb741-c63a-442a-800f-78b58cc324f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.513911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7a3db325-ae12-42fe-99ee-ac0c3308d0af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:36.532078 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7a3db325-ae12-42fe-99ee-ac0c3308d0af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1512 microversion: 2.1 time: 0.476556 Oct 29 03:04:36.546581 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2200/4352] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:36 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:36.576837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4e3ac6b8-dc3e-4e95-9074-44537168f4f8 req-f34c9c71-984e-466d-9bb3-e4478e847bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796202dc-3a57-414c-bb69-53b9dbeb8fcb", "name": "network-vif-deleted", "tag": "2acf83c7-0475-49c5-b9d3-60a9c70bfc7d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:36.592351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4e3ac6b8-dc3e-4e95-9074-44537168f4f8 req-f34c9c71-984e-466d-9bb3-e4478e847bfd service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.593260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4e3ac6b8-dc3e-4e95-9074-44537168f4f8 req-f34c9c71-984e-466d-9bb3-e4478e847bfd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.594144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4e3ac6b8-dc3e-4e95-9074-44537168f4f8 req-f34c9c71-984e-466d-9bb3-e4478e847bfd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.607440 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4e3ac6b8-dc3e-4e95-9074-44537168f4f8 req-f34c9c71-984e-466d-9bb3-e4478e847bfd service nova] Creating event network-vif-deleted:2acf83c7-0475-49c5-b9d3-60a9c70bfc7d for instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb on n-h2-862964-4 Oct 29 03:04:36.613304 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4e3ac6b8-dc3e-4e95-9074-44537168f4f8 req-f34c9c71-984e-466d-9bb3-e4478e847bfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064908 Oct 29 03:04:36.614201 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2201/4353] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:36.619902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-67809560-dbf8-4a6e-8afc-75884968d9e4 req-ebb65702-3cda-49c5-8bc6-ed7084119023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e7e466-df5f-45f5-9e45-dc3c16e888b7", "name": "network-vif-unplugged", "status": "completed", "tag": "4f85a0f7-faab-45b5-be06-7a79452c31af"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:36.632743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-67809560-dbf8-4a6e-8afc-75884968d9e4 req-ebb65702-3cda-49c5-8bc6-ed7084119023 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.633434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-67809560-dbf8-4a6e-8afc-75884968d9e4 req-ebb65702-3cda-49c5-8bc6-ed7084119023 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.634119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-67809560-dbf8-4a6e-8afc-75884968d9e4 req-ebb65702-3cda-49c5-8bc6-ed7084119023 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.646883 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-67809560-dbf8-4a6e-8afc-75884968d9e4 req-ebb65702-3cda-49c5-8bc6-ed7084119023 service nova] Creating event network-vif-unplugged:4f85a0f7-faab-45b5-be06-7a79452c31af for instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 on n-h1-862964-4 Oct 29 03:04:36.652526 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-67809560-dbf8-4a6e-8afc-75884968d9e4 req-ebb65702-3cda-49c5-8bc6-ed7084119023 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036805 Oct 29 03:04:36.653652 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2202/4354] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:36.916665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a02c8d5b-db59-4aed-bf42-3385e0138f0d tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:36.917774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a02c8d5b-db59-4aed-bf42-3385e0138f0d tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:36.929434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a02c8d5b-db59-4aed-bf42-3385e0138f0d tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.932131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a02c8d5b-db59-4aed-bf42-3385e0138f0d tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.933191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a02c8d5b-db59-4aed-bf42-3385e0138f0d tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.934572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a02c8d5b-db59-4aed-bf42-3385e0138f0d tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.934888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a02c8d5b-db59-4aed-bf42-3385e0138f0d tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.935421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a02c8d5b-db59-4aed-bf42-3385e0138f0d tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.044740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a02c8d5b-db59-4aed-bf42-3385e0138f0d tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.058173 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a02c8d5b-db59-4aed-bf42-3385e0138f0d tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1615 microversion: 2.1 time: 0.165437 Oct 29 03:04:37.058839 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2203/4355] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:36 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1615 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:37.074243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:37.074861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:37.076904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:37.106514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.106999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.114437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.115189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.115659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.116091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.218056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.219117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.219767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.220433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lazy-loading 'fault' on Instance uuid 796202dc-3a57-414c-bb69-53b9dbeb8fcb {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:37.281584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-26efb741-c63a-442a-800f-78b58cc324f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.298288 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-26efb741-c63a-442a-800f-78b58cc324f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1672 microversion: 2.1 time: 0.912237 Oct 29 03:04:37.300109 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2153/4356] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:36 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1672 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:37.331827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.352723 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5fec90f5-d9c4-42d7-bfe7-ca3f0c180e0d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 200 len: 1310 microversion: 2.1 time: 0.291445 Oct 29 03:04:37.355902 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2204/4357] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:37 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 1310 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:37.389661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:37.391099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] [instance: 77b441cf-f5a0-4f54-90f4-915a2ece9984] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:37.398955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.399598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.400041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.402639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.404897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.405590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.448263 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] HTTP exception thrown: Instance 77b441cf-f5a0-4f54-90f4-915a2ece9984 could not be found. Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Request method failure captured: Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 HTTP/1.1 Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJfm3KomrxfdqSfpOMRJ91Sa-UvqNIIH6LBs6gomrtZLesuEcLUt6b5emDSJAb9fzuJ6twCmQh-Fpbv31LHJ2Z3E_p-wYd_KfUgbCTR4preko0UrLE6obT-b5HdrjB98dKHNESuIM_2medvhIAGXC1sMRlroNmxHFbHQiFdGdYnywYk Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: d573dd77f3b24ee4b650ca45e657e307 Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ListServerFiltersTestJSON-307812601 Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d573dd77f3b24ee4b650ca45e657e307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d573dd77f3b24ee4b650ca45e657e307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d573dd77f3b24ee4b650ca45e657e307", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d573dd77f3b24ee4b650ca45e657e307"}]}] Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ListServerFiltersTestJSON-307812601 Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: d573dd77f3b24ee4b650ca45e657e307 Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-307812601 Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ListServerFiltersTestJSON-307812601-project Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cab4906c7a3748b4b0a1df38423d82a9 Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ListServerFiltersTestJSON-307812601-project Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 77b441cf-f5a0-4f54-90f4-915a2ece9984 could not be found. Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '77b441cf-f5a0-4f54-90f4-915a2ece9984'} Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b441cf-f5a0-4f54-90f4-915a2ece9984 could not be found. Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b441cf-f5a0-4f54-90f4-915a2ece9984 could not be found. Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:37.456656 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:37.460300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:37.460300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:37.460300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:37.460300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:37.460300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:37.460300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b441cf-f5a0-4f54-90f4-915a2ece9984 could not be found. Oct 29 03:04:37.460300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:37.463718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] Returning 404 to user: Instance 77b441cf-f5a0-4f54-90f4-915a2ece9984 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:37.464805 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ddd148d-3814-4527-9007-3af870f14290 tempest-ListServerFiltersTestJSON-307812601 tempest-ListServerFiltersTestJSON-307812601-project] 10.222.0.16 "GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984" status: 404 len: 111 microversion: 2.1 time: 0.080024 Oct 29 03:04:37.480866 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2154/4358] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:37 2022] GET /compute/v2.1/servers/77b441cf-f5a0-4f54-90f4-915a2ece9984 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:37.559654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b3d9d464-3563-4df7-a970-f33939d267d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:37.560417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b3d9d464-3563-4df7-a970-f33939d267d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:37.571178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3d9d464-3563-4df7-a970-f33939d267d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.571876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3d9d464-3563-4df7-a970-f33939d267d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.572498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3d9d464-3563-4df7-a970-f33939d267d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.573433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3d9d464-3563-4df7-a970-f33939d267d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.574156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3d9d464-3563-4df7-a970-f33939d267d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.575065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3d9d464-3563-4df7-a970-f33939d267d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.781825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3d9d464-3563-4df7-a970-f33939d267d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.796977 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b3d9d464-3563-4df7-a970-f33939d267d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1512 microversion: 2.1 time: 0.241194 Oct 29 03:04:37.798514 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2205/4359] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:37 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:38.031351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d6e363c6-5975-4b8c-a7fc-e5d5fcd5c2ef req-d4a16905-5e61-44e7-8452-f6c38222ea09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db54eba0-267c-4806-b337-72d0ccf62f9d", "name": "network-vif-deleted", "tag": "944eac58-0eae-42eb-a399-4e18ac946e56"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:38.086572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:38.087381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:38.100746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.101286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.101732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.102584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.103103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.103533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.111258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d6e363c6-5975-4b8c-a7fc-e5d5fcd5c2ef req-d4a16905-5e61-44e7-8452-f6c38222ea09 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.111865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d6e363c6-5975-4b8c-a7fc-e5d5fcd5c2ef req-d4a16905-5e61-44e7-8452-f6c38222ea09 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.112360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d6e363c6-5975-4b8c-a7fc-e5d5fcd5c2ef req-d4a16905-5e61-44e7-8452-f6c38222ea09 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.181660 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d6e363c6-5975-4b8c-a7fc-e5d5fcd5c2ef req-d4a16905-5e61-44e7-8452-f6c38222ea09 service nova] Creating event network-vif-deleted:944eac58-0eae-42eb-a399-4e18ac946e56 for instance db54eba0-267c-4806-b337-72d0ccf62f9d on n-h1-862964-4 Oct 29 03:04:38.215708 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d6e363c6-5975-4b8c-a7fc-e5d5fcd5c2ef req-d4a16905-5e61-44e7-8452-f6c38222ea09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187928 Oct 29 03:04:38.229909 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2155/4360] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:38.308166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.308664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.309109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.309585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lazy-loading 'fault' on Instance uuid 545c705b-dd48-4669-9ae6-8c27bab5c2c8 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:38.324272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6119b47e-7ea5-436d-8092-d32003708666 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:38.324945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6119b47e-7ea5-436d-8092-d32003708666 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:38.348096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6119b47e-7ea5-436d-8092-d32003708666 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.348600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6119b47e-7ea5-436d-8092-d32003708666 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.352556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6119b47e-7ea5-436d-8092-d32003708666 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.353546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6119b47e-7ea5-436d-8092-d32003708666 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.359897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6119b47e-7ea5-436d-8092-d32003708666 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.361610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6119b47e-7ea5-436d-8092-d32003708666 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.465379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0f9eced1ff41e281ed82bb0465a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f701d727812417a860406464cf0f757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:38.476084 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-94f8f536-b8fa-4034-b743-cb1f26c95e2a tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 200 len: 1332 microversion: 2.1 time: 0.394130 Oct 29 03:04:38.497704 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2206/4361] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:38 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 1332 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:38.512758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:38.513400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:38.529795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.531188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.534537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.535337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.535813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.536250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.592531 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb HTTP/1.1 Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '796202dc-3a57-414c-bb69-53b9dbeb8fcb'} Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:38.599300 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:38.603789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:38.603789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:38.603789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:38.603789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:38.603789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:04:38.603789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:38.603789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:38.603789 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-89826794-cfea-412b-a9ef-543c108be662 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 404 len: 111 microversion: 2.1 time: 0.102137 Oct 29 03:04:38.604700 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2207/4362] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:38 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:38.619608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fcdd5779-e0ff-4461-9794-b76a4c10a974 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'create', calling method: .version_select at 0x7fe1a89f20d0>, body: {"keypair": {"name": "tempest-key-135785120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj0jKLS+PReK2msXbVqWcG9H2mjZao08/+Lbx+Vah0907nmkRyFO/r7mBpSv38wRlEJJjBugut29lFND3BXbKn8F5tNvJIqcT7qmLpbXDDmd9fVjk0+pJ0Vn5fMMU3Y6g=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:38.672132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6119b47e-7ea5-436d-8092-d32003708666 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:38.680935 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6119b47e-7ea5-436d-8092-d32003708666 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1672 microversion: 2.1 time: 0.361504 Oct 29 03:04:38.690524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fcdd5779-e0ff-4461-9794-b76a4c10a974 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for project 9e1b05d7018447eebe74cc47de363ead. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:38.698567 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2156/4363] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:38 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1672 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:38.705560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-41b30d0b-80bf-4767-9e6e-3b06e99db603 req-56096a7e-7a1f-4815-af0e-f307aff73828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545c705b-dd48-4669-9ae6-8c27bab5c2c8", "name": "network-vif-deleted", "tag": "816c9b1c-4652-462c-b2dc-e510bdd5ea77"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:38.710572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fcdd5779-e0ff-4461-9794-b76a4c10a974 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for user cecadca739554f858c269b85690b5cec and project 9e1b05d7018447eebe74cc47de363ead. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:38.717031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-41b30d0b-80bf-4767-9e6e-3b06e99db603 req-56096a7e-7a1f-4815-af0e-f307aff73828 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.718167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-41b30d0b-80bf-4767-9e6e-3b06e99db603 req-56096a7e-7a1f-4815-af0e-f307aff73828 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.719979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-41b30d0b-80bf-4767-9e6e-3b06e99db603 req-56096a7e-7a1f-4815-af0e-f307aff73828 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.744872 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-41b30d0b-80bf-4767-9e6e-3b06e99db603 req-56096a7e-7a1f-4815-af0e-f307aff73828 service nova] Creating event network-vif-deleted:816c9b1c-4652-462c-b2dc-e510bdd5ea77 for instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 on n-h2-862964-4 Oct 29 03:04:38.751953 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-41b30d0b-80bf-4767-9e6e-3b06e99db603 req-56096a7e-7a1f-4815-af0e-f307aff73828 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051324 Oct 29 03:04:38.753001 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2157/4364] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:38.753885 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fcdd5779-e0ff-4461-9794-b76a4c10a974 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.138468 Oct 29 03:04:38.755192 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2208/4365] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:04:38 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:38.767685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a8a2917a-74a9-4928-8be0-2914022c90ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '.version_select at 0x7fe1a87884c0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:38.772787 n-d-862964-4 devstack@n-api.service[127041]: WARNING oslo_db.sqlalchemy.utils [None req-a8a2917a-74a9-4928-8be0-2914022c90ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 03:04:38.782067 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a8a2917a-74a9-4928-8be0-2914022c90ec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.019006 Oct 29 03:04:38.783388 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2158/4366] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 03:04:38 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:38.821902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:38.823372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:38.838534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.839200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.840540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.841400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.842150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.842726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.863273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-929006653", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "key_name": "tempest-key-135785120", "networks": [{"uuid": "204a19c0-c3a9-46eb-85da-9d12d0451025"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:38.904505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.905248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.910709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.911438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lazy-loading 'fault' on Instance uuid db54eba0-267c-4806-b337-72d0ccf62f9d {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:38.918888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:38.970838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:38.978058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] validate_networks() for [('204a19c0-c3a9-46eb-85da-9d12d0451025', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:04:38.981978 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-38f31457-41ea-4259-8e63-191ee044dbf6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1307 microversion: 2.1 time: 0.164861 Oct 29 03:04:38.982592 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2209/4367] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:38 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:39.504875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:39.505554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:39.506420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:39.506988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:39.508479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:39.509627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:39.510885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:39.516933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.518467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.519100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.520754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.521406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.522050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.527025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.527575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.528065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.529077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.529591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.530193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.541657 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] HTTP exception thrown: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Request method failure captured: Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 HTTP/1.1 Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJeGDxkL2wr4VVnn204nJIji9bzvVpdJSaG4VTbPU5Y3lvEMvqrzMkosP4cuXvdJpDHWr-YuvetJIExXfVIdyhj1oZ2Sd2QqFp28FDGYZOjdGviHTHliZgJuDfCJ-hoc6LRpvGy5x_i40oWmmjcu9PU5o4wBIUcybJp_mPpEdMEvuLE Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 6f701d727812417a860406464cf0f757 Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1023535424 Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f701d727812417a860406464cf0f757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f701d727812417a860406464cf0f757"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f701d727812417a860406464cf0f757", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f701d727812417a860406464cf0f757"}]}] Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1023535424 Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 6f701d727812417a860406464cf0f757 Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1023535424 Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachSCSIVolumeTestJSON-1023535424-project Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: aa0f9eced1ff41e281ed82bb0465a58b Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1023535424-project Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '545c705b-dd48-4669-9ae6-8c27bab5c2c8'} Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:39.551560 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:39.555073 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:39.555073 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:39.555073 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:39.555073 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:39.555073 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:39.555073 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:39.555073 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:39.555465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:39.560592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for user cecadca739554f858c269b85690b5cec and project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:39.564236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Returning 404 to user: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:39.566046 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9138b5e5-9162-4610-94b2-df9ab6a3aca6 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 404 len: 111 microversion: 2.1 time: 0.064682 Oct 29 03:04:39.573413 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2210/4368] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:39 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:04:39.578760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:04:39.580879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c874009c-c029-4a76-a907-6a45d6e5f427 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '.version_select at 0x7fe1a93f4ee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:39.581393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:39.606789 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c874009c-c029-4a76-a907-6a45d6e5f427 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402253981" status: 202 len: 0 microversion: 2.1 time: 0.031278 Oct 29 03:04:39.608156 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2211/4369] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:04:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402253981 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:04:39.656010 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81355fd1-6826-4171-b7f1-2bfb88fe6e69 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797493 Oct 29 03:04:39.661712 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2159/4370] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:04:39.671691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f09be627-6440-42b9-88a0-b559930f6e9a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:39.673144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f09be627-6440-42b9-88a0-b559930f6e9a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:39.711628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb8b1624-b09b-4a48-9680-4756c9f79bc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:39.712233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eb8b1624-b09b-4a48-9680-4756c9f79bc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:39.731148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb8b1624-b09b-4a48-9680-4756c9f79bc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.732511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb8b1624-b09b-4a48-9680-4756c9f79bc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.733484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb8b1624-b09b-4a48-9680-4756c9f79bc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.735036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb8b1624-b09b-4a48-9680-4756c9f79bc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.736021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb8b1624-b09b-4a48-9680-4756c9f79bc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.740628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb8b1624-b09b-4a48-9680-4756c9f79bc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.919360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f09be627-6440-42b9-88a0-b559930f6e9a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:39.930875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eb8b1624-b09b-4a48-9680-4756c9f79bc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:39.931843 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f09be627-6440-42b9-88a0-b559930f6e9a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1227 microversion: 2.1 time: 0.267485 Oct 29 03:04:39.932765 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2212/4371] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:39 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1227 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:39.955440 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eb8b1624-b09b-4a48-9680-4756c9f79bc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1677 microversion: 2.1 time: 0.248569 Oct 29 03:04:39.956336 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2160/4372] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:39 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:40.005119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:40.005865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:40.014809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:40.015722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:40.016231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:40.017017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:40.017663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:40.018114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:40.080160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:40.080691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:40.081108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:40.081581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lazy-loading 'fault' on Instance uuid db54eba0-267c-4806-b337-72d0ccf62f9d {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:40.170237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:40.180117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:40.190073 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-139afc54-64d4-4460-9ca7-0bae4a829491 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1307 microversion: 2.1 time: 0.188565 Oct 29 03:04:40.191209 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2213/4373] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:39 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:40.958617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9cb85f6-604c-4a57-9c16-a1de12045889 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:40.959774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9cb85f6-604c-4a57-9c16-a1de12045889 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:40.975407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb85f6-604c-4a57-9c16-a1de12045889 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:40.980267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb85f6-604c-4a57-9c16-a1de12045889 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:40.981246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb85f6-604c-4a57-9c16-a1de12045889 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:40.982734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb85f6-604c-4a57-9c16-a1de12045889 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:40.983846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb85f6-604c-4a57-9c16-a1de12045889 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:40.985600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9cb85f6-604c-4a57-9c16-a1de12045889 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:40.987330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd63975d-e6db-47bf-b8e3-3bac7c1d07e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:40.989278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cd63975d-e6db-47bf-b8e3-3bac7c1d07e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:41.013244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd63975d-e6db-47bf-b8e3-3bac7c1d07e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:41.015818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd63975d-e6db-47bf-b8e3-3bac7c1d07e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:41.017332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd63975d-e6db-47bf-b8e3-3bac7c1d07e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:41.020591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd63975d-e6db-47bf-b8e3-3bac7c1d07e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:41.025071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd63975d-e6db-47bf-b8e3-3bac7c1d07e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:41.026596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd63975d-e6db-47bf-b8e3-3bac7c1d07e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:41.127075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a9cb85f6-604c-4a57-9c16-a1de12045889 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:41.140140 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9cb85f6-604c-4a57-9c16-a1de12045889 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1279 microversion: 2.1 time: 0.187126 Oct 29 03:04:41.150561 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2161/4374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:40 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1279 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:41.219818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:41.237001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:41.253216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:41.261223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:41.262204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:41.265773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:41.266420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:41.266990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:41.355996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:41.356821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:41.357516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:41.358195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lazy-loading 'fault' on Instance uuid db54eba0-267c-4806-b337-72d0ccf62f9d {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:41.457970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:41.467698 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b1904793-36cf-4399-a367-c6e90e8ee3a3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1307 microversion: 2.1 time: 0.254990 Oct 29 03:04:41.474472 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2162/4375] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:41 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:42.038878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd63975d-e6db-47bf-b8e3-3bac7c1d07e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:42.048205 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd63975d-e6db-47bf-b8e3-3bac7c1d07e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1677 microversion: 2.1 time: 1.070303 Oct 29 03:04:42.054247 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2214/4376] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:40 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1677 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:42.176562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4cf507da-561a-4304-a082-325be95b715f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:42.177178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4cf507da-561a-4304-a082-325be95b715f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:42.201147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf507da-561a-4304-a082-325be95b715f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.204725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf507da-561a-4304-a082-325be95b715f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.206359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf507da-561a-4304-a082-325be95b715f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.209065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf507da-561a-4304-a082-325be95b715f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.218779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf507da-561a-4304-a082-325be95b715f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.223212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf507da-561a-4304-a082-325be95b715f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.496938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:42.497828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:42.513372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.514262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.514931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.516027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.516682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.517303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.591871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.592712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.593408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.594327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lazy-loading 'fault' on Instance uuid db54eba0-267c-4806-b337-72d0ccf62f9d {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:42.646099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4cf507da-561a-4304-a082-325be95b715f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:42.654791 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4cf507da-561a-4304-a082-325be95b715f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1285 microversion: 2.1 time: 0.483543 Oct 29 03:04:42.659594 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2163/4377] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:42 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1285 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:42.911845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:42.923197 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8baad51b-7cb0-4d1b-ad91-db09bdeecfe5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1307 microversion: 2.1 time: 0.430387 Oct 29 03:04:42.937830 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2215/4378] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:42 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1307 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:43.081823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-62e8a57d-23a1-4097-9833-8e5116db7b5f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:43.082029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-62e8a57d-23a1-4097-9833-8e5116db7b5f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:43.095546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62e8a57d-23a1-4097-9833-8e5116db7b5f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:43.096058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62e8a57d-23a1-4097-9833-8e5116db7b5f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:43.096502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62e8a57d-23a1-4097-9833-8e5116db7b5f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:43.097227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62e8a57d-23a1-4097-9833-8e5116db7b5f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:43.097679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62e8a57d-23a1-4097-9833-8e5116db7b5f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:43.098132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62e8a57d-23a1-4097-9833-8e5116db7b5f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:43.466354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-62e8a57d-23a1-4097-9833-8e5116db7b5f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:43.478218 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-62e8a57d-23a1-4097-9833-8e5116db7b5f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1677 microversion: 2.1 time: 0.402391 Oct 29 03:04:43.480297 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2164/4379] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:43 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1677 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:43.685307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63483268-373a-45a5-851d-f1878d950069 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:43.685967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-63483268-373a-45a5-851d-f1878d950069 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:43.693664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63483268-373a-45a5-851d-f1878d950069 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:43.704295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63483268-373a-45a5-851d-f1878d950069 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:43.704750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63483268-373a-45a5-851d-f1878d950069 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:43.708299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63483268-373a-45a5-851d-f1878d950069 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:43.708789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63483268-373a-45a5-851d-f1878d950069 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:43.709230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63483268-373a-45a5-851d-f1878d950069 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:43.952734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:43.953494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:43.968988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:43.975306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:43.976126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:43.976981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:43.979110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:43.980238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:44.068774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:44.069582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:44.070417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:44.072738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lazy-loading 'fault' on Instance uuid db54eba0-267c-4806-b337-72d0ccf62f9d {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:44.218236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-63483268-373a-45a5-851d-f1878d950069 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:44.231543 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-63483268-373a-45a5-851d-f1878d950069 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1327 microversion: 2.1 time: 0.550312 Oct 29 03:04:44.232407 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2216/4380] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:43 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1327 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:44.266350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:44.278899 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37a8ffa1-37d5-470a-aa40-2e12e17f564a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 200 len: 1307 microversion: 2.1 time: 0.331977 Oct 29 03:04:44.281259 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2165/4381] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:43 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 1307 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:44.505005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2adf7d33-9434-4e1c-a090-62683fe25342 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:44.506058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2adf7d33-9434-4e1c-a090-62683fe25342 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:44.515565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2adf7d33-9434-4e1c-a090-62683fe25342 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:44.518024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2adf7d33-9434-4e1c-a090-62683fe25342 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:44.520534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2adf7d33-9434-4e1c-a090-62683fe25342 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:44.521428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2adf7d33-9434-4e1c-a090-62683fe25342 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:44.523094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2adf7d33-9434-4e1c-a090-62683fe25342 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:44.524044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1f971c6a-f4f5-4d9f-ac33-e5d5cad206d6 req-cc09149d-9707-4276-9b33-6b94efd4cf64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d304e2-1429-4040-abb7-142f54881823", "tag": "4184e1fa-5d6b-406a-b454-2f8899df1d3a"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:44.524852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2adf7d33-9434-4e1c-a090-62683fe25342 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:44.571089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1f971c6a-f4f5-4d9f-ac33-e5d5cad206d6 req-cc09149d-9707-4276-9b33-6b94efd4cf64 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:44.574000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1f971c6a-f4f5-4d9f-ac33-e5d5cad206d6 req-cc09149d-9707-4276-9b33-6b94efd4cf64 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:44.574697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1f971c6a-f4f5-4d9f-ac33-e5d5cad206d6 req-cc09149d-9707-4276-9b33-6b94efd4cf64 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:44.607226 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1f971c6a-f4f5-4d9f-ac33-e5d5cad206d6 req-cc09149d-9707-4276-9b33-6b94efd4cf64 service nova] Creating event network-changed:4184e1fa-5d6b-406a-b454-2f8899df1d3a for instance 95d304e2-1429-4040-abb7-142f54881823 on n-h2-862964-4 Oct 29 03:04:44.633915 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1f971c6a-f4f5-4d9f-ac33-e5d5cad206d6 req-cc09149d-9707-4276-9b33-6b94efd4cf64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109890 Oct 29 03:04:44.635418 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2166/4382] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:04:45.017674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2adf7d33-9434-4e1c-a090-62683fe25342 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:45.026241 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2adf7d33-9434-4e1c-a090-62683fe25342 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1677 microversion: 2.1 time: 0.525456 Oct 29 03:04:45.032127 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2217/4383] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:44 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1677 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:45.260381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4cbcda65-cc84-47f2-a9b0-3c1e89c7a393 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:45.261519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4cbcda65-cc84-47f2-a9b0-3c1e89c7a393 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:45.275540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cbcda65-cc84-47f2-a9b0-3c1e89c7a393 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.290657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cbcda65-cc84-47f2-a9b0-3c1e89c7a393 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.290657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cbcda65-cc84-47f2-a9b0-3c1e89c7a393 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.290657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cbcda65-cc84-47f2-a9b0-3c1e89c7a393 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.291108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cbcda65-cc84-47f2-a9b0-3c1e89c7a393 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.291728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cbcda65-cc84-47f2-a9b0-3c1e89c7a393 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.307414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:45.308211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:45.326525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.327398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.327619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.349685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.350306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.354195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.411706 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d HTTP/1.1 Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'db54eba0-267c-4806-b337-72d0ccf62f9d'} Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:45.420575 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:45.428007 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:45.428007 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:45.428007 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:45.428007 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:45.428007 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:45.428007 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:04:45.428007 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:45.440483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:45.441468 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-17dffbd2-3bee-42ec-8505-9abd18fdcb7d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 404 len: 111 microversion: 2.1 time: 0.141364 Oct 29 03:04:45.466566 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2218/4384] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:45 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:04:45.488036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b4eb8e68-ee36-442f-a892-b81f7833ed14 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:45.490496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b4eb8e68-ee36-442f-a892-b81f7833ed14 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:45.515499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4eb8e68-ee36-442f-a892-b81f7833ed14 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.516452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4eb8e68-ee36-442f-a892-b81f7833ed14 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.517048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4eb8e68-ee36-442f-a892-b81f7833ed14 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.517941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4eb8e68-ee36-442f-a892-b81f7833ed14 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.518537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4eb8e68-ee36-442f-a892-b81f7833ed14 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.519105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4eb8e68-ee36-442f-a892-b81f7833ed14 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.837424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b4eb8e68-ee36-442f-a892-b81f7833ed14 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:45.848374 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b4eb8e68-ee36-442f-a892-b81f7833ed14 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.380344 Oct 29 03:04:45.849568 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2219/4385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:45 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:45.935051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4cbcda65-cc84-47f2-a9b0-3c1e89c7a393 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:45.951861 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4cbcda65-cc84-47f2-a9b0-3c1e89c7a393 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1327 microversion: 2.1 time: 0.691022 Oct 29 03:04:45.971080 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2167/4386] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:45 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1327 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:46.056804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87208426-76cb-4f42-8fab-638a2d0b4419 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:46.058122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-87208426-76cb-4f42-8fab-638a2d0b4419 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:46.068278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87208426-76cb-4f42-8fab-638a2d0b4419 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.072012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87208426-76cb-4f42-8fab-638a2d0b4419 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.072850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87208426-76cb-4f42-8fab-638a2d0b4419 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.073594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87208426-76cb-4f42-8fab-638a2d0b4419 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.079246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87208426-76cb-4f42-8fab-638a2d0b4419 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.079827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87208426-76cb-4f42-8fab-638a2d0b4419 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.141646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0161e40a-8c3d-4143-ac19-8f457fbb787c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0161e40a-8c3d-4143-ac19-8f457fbb787c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 163 Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: {"server": {"name": 12345, "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 12345 Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:04:46.153938 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 03:04:46.158578 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:46.160829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0161e40a-8c3d-4143-ac19-8f457fbb787c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:46.162218 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0161e40a-8c3d-4143-ac19-8f457fbb787c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.026179 Oct 29 03:04:46.163513 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2168/4387] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:46 2022] POST /compute/v2.1/servers => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:04:46.183008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af768e20-f932-4348-8b28-08bb3f0e7a24 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:46.185976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-af768e20-f932-4348-8b28-08bb3f0e7a24 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:46.214619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af768e20-f932-4348-8b28-08bb3f0e7a24 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.215130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af768e20-f932-4348-8b28-08bb3f0e7a24 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.215569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af768e20-f932-4348-8b28-08bb3f0e7a24 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.216283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af768e20-f932-4348-8b28-08bb3f0e7a24 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.217112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af768e20-f932-4348-8b28-08bb3f0e7a24 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.218646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af768e20-f932-4348-8b28-08bb3f0e7a24 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.462312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-af768e20-f932-4348-8b28-08bb3f0e7a24 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:46.485513 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af768e20-f932-4348-8b28-08bb3f0e7a24 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.313972 Oct 29 03:04:46.502683 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2169/4388] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:46 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:46.519538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eeab73fe-1aeb-49a6-a7f2-421316f3d59d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:46.521283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eeab73fe-1aeb-49a6-a7f2-421316f3d59d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:46.536156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeab73fe-1aeb-49a6-a7f2-421316f3d59d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.536730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeab73fe-1aeb-49a6-a7f2-421316f3d59d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.537375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeab73fe-1aeb-49a6-a7f2-421316f3d59d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.538313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeab73fe-1aeb-49a6-a7f2-421316f3d59d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.539072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeab73fe-1aeb-49a6-a7f2-421316f3d59d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.539596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeab73fe-1aeb-49a6-a7f2-421316f3d59d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.588961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:46.824155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eeab73fe-1aeb-49a6-a7f2-421316f3d59d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:46.834802 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eeab73fe-1aeb-49a6-a7f2-421316f3d59d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.319889 Oct 29 03:04:46.836093 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2170/4389] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:46 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:46.842938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-87208426-76cb-4f42-8fab-638a2d0b4419 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:46.852438 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-87208426-76cb-4f42-8fab-638a2d0b4419 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.799589 Oct 29 03:04:46.854064 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2220/4390] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:46 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:46.884019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-010b9cfb-3ed7-4af0-8bba-8d42f28a5e1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:46.886557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-010b9cfb-3ed7-4af0-8bba-8d42f28a5e1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:46.912029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-010b9cfb-3ed7-4af0-8bba-8d42f28a5e1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.916129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-010b9cfb-3ed7-4af0-8bba-8d42f28a5e1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.916620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-010b9cfb-3ed7-4af0-8bba-8d42f28a5e1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.917375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-010b9cfb-3ed7-4af0-8bba-8d42f28a5e1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.917856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-010b9cfb-3ed7-4af0-8bba-8d42f28a5e1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.922185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-010b9cfb-3ed7-4af0-8bba-8d42f28a5e1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.980362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20c6ec0f-4305-4bd5-a787-778e038ff833 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:46.980992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-20c6ec0f-4305-4bd5-a787-778e038ff833 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:47.000846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c6ec0f-4305-4bd5-a787-778e038ff833 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.001411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c6ec0f-4305-4bd5-a787-778e038ff833 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.001861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c6ec0f-4305-4bd5-a787-778e038ff833 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.008247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c6ec0f-4305-4bd5-a787-778e038ff833 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.009000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c6ec0f-4305-4bd5-a787-778e038ff833 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.010317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c6ec0f-4305-4bd5-a787-778e038ff833 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.058517 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-010b9cfb-3ed7-4af0-8bba-8d42f28a5e1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 200 len: 322 microversion: 2.1 time: 0.180389 Oct 29 03:04:47.064268 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2171/4391] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:04:46 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:47.071142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7163ff88-8afc-4d7d-941c-e9d02f351bf7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:47.073383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7163ff88-8afc-4d7d-941c-e9d02f351bf7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:47.100777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7163ff88-8afc-4d7d-941c-e9d02f351bf7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.101478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7163ff88-8afc-4d7d-941c-e9d02f351bf7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.103204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7163ff88-8afc-4d7d-941c-e9d02f351bf7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.106814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7163ff88-8afc-4d7d-941c-e9d02f351bf7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.107846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7163ff88-8afc-4d7d-941c-e9d02f351bf7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.108319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7163ff88-8afc-4d7d-941c-e9d02f351bf7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.450614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7163ff88-8afc-4d7d-941c-e9d02f351bf7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:47.459141 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7163ff88-8afc-4d7d-941c-e9d02f351bf7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.393307 Oct 29 03:04:47.464282 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2172/4392] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:47 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:47.501051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:47.501658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:47.538153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.538639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.540679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.541730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.550031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.569740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.578562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20c6ec0f-4305-4bd5-a787-778e038ff833 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:47.588626 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20c6ec0f-4305-4bd5-a787-778e038ff833 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1327 microversion: 2.1 time: 0.613237 Oct 29 03:04:47.590479 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2221/4393] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:46 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1327 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:47.600961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c5e2513e-eb3b-43cb-a207-d725399eb757 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:47.603800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c5e2513e-eb3b-43cb-a207-d725399eb757 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:47.616779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e2513e-eb3b-43cb-a207-d725399eb757 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.617284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e2513e-eb3b-43cb-a207-d725399eb757 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.618159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e2513e-eb3b-43cb-a207-d725399eb757 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.619004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e2513e-eb3b-43cb-a207-d725399eb757 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.619465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e2513e-eb3b-43cb-a207-d725399eb757 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.619943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e2513e-eb3b-43cb-a207-d725399eb757 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.637720 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] HTTP exception thrown: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Request method failure captured: Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 HTTP/1.1 Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJeGDxkL2wr4VVnn204nJIji9bzvVpdJSaG4VTbPU5Y3lvEMvqrzMkosP4cuXvdJpDHWr-YuvetJIExXfVIdyhj1oZ2Sd2QqFp28FDGYZOjdGviHTHliZgJuDfCJ-hoc6LRpvGy5x_i40oWmmjcu9PU5o4wBIUcybJp_mPpEdMEvuLE Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6f701d727812417a860406464cf0f757 Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1023535424 Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f701d727812417a860406464cf0f757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f701d727812417a860406464cf0f757"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f701d727812417a860406464cf0f757", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f701d727812417a860406464cf0f757"}]}] Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1023535424 Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6f701d727812417a860406464cf0f757 Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1023535424 Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachSCSIVolumeTestJSON-1023535424-project Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: aa0f9eced1ff41e281ed82bb0465a58b Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1023535424-project Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '545c705b-dd48-4669-9ae6-8c27bab5c2c8'} Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:47.639455 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:47.643700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:47.643700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:47.643700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:47.643700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:47.643700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:47.643700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:47.643700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:47.643700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:47.643700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:47.643700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:47.643700 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:47.652313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Returning 404 to user: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:47.653320 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cfc18489-3843-45df-8d38-fe7c3f8e2803 tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "DELETE /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 404 len: 111 microversion: 2.1 time: 0.178387 Oct 29 03:04:47.653924 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2173/4394] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:04:47 2022] DELETE /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:47.673658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:47.674299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] [instance: 545c705b-dd48-4669-9ae6-8c27bab5c2c8] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:47.691003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.691496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.691930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.692704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.693152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.693566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.729687 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] HTTP exception thrown: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Request method failure captured: Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 HTTP/1.1 Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJeGDxkL2wr4VVnn204nJIji9bzvVpdJSaG4VTbPU5Y3lvEMvqrzMkosP4cuXvdJpDHWr-YuvetJIExXfVIdyhj1oZ2Sd2QqFp28FDGYZOjdGviHTHliZgJuDfCJ-hoc6LRpvGy5x_i40oWmmjcu9PU5o4wBIUcybJp_mPpEdMEvuLE Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6f701d727812417a860406464cf0f757 Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1023535424 Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f701d727812417a860406464cf0f757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f701d727812417a860406464cf0f757"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f701d727812417a860406464cf0f757", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f701d727812417a860406464cf0f757"}]}] Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1023535424 Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6f701d727812417a860406464cf0f757 Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1023535424 Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachSCSIVolumeTestJSON-1023535424-project Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: aa0f9eced1ff41e281ed82bb0465a58b Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1023535424-project Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '545c705b-dd48-4669-9ae6-8c27bab5c2c8'} Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:47.732280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:47.736960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:47.736960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:47.736960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:47.736960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:47.736960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:47.736960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. Oct 29 03:04:47.736960 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:47.738171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] Returning 404 to user: Instance 545c705b-dd48-4669-9ae6-8c27bab5c2c8 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:47.739277 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2205a4c0-5062-4ded-bd8f-71cd4e02f7ef tempest-AttachSCSIVolumeTestJSON-1023535424 tempest-AttachSCSIVolumeTestJSON-1023535424-project] 10.222.0.16 "GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8" status: 404 len: 111 microversion: 2.1 time: 0.077223 Oct 29 03:04:47.740339 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2174/4395] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:47 2022] GET /compute/v2.1/servers/545c705b-dd48-4669-9ae6-8c27bab5c2c8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:48.318557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c5e2513e-eb3b-43cb-a207-d725399eb757 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:48.333608 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c5e2513e-eb3b-43cb-a207-d725399eb757 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.741823 Oct 29 03:04:48.334262 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2222/4396] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:47 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:48.360951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8d710a43-1644-4b46-9daf-d762a70787be tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:48.361564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8d710a43-1644-4b46-9daf-d762a70787be tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:48.378524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d710a43-1644-4b46-9daf-d762a70787be tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:48.379020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d710a43-1644-4b46-9daf-d762a70787be tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:48.381956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d710a43-1644-4b46-9daf-d762a70787be tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:48.382875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d710a43-1644-4b46-9daf-d762a70787be tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:48.383479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d710a43-1644-4b46-9daf-d762a70787be tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:48.385524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d710a43-1644-4b46-9daf-d762a70787be tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:48.615400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4f4c55a7-527d-4dbb-95af-e30f8a8d2726 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:48.617012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4f4c55a7-527d-4dbb-95af-e30f8a8d2726 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:48.656940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f4c55a7-527d-4dbb-95af-e30f8a8d2726 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:48.657788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f4c55a7-527d-4dbb-95af-e30f8a8d2726 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:48.658517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f4c55a7-527d-4dbb-95af-e30f8a8d2726 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:48.659422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f4c55a7-527d-4dbb-95af-e30f8a8d2726 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:48.660035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f4c55a7-527d-4dbb-95af-e30f8a8d2726 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:48.660615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f4c55a7-527d-4dbb-95af-e30f8a8d2726 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:48.800382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8d710a43-1644-4b46-9daf-d762a70787be tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:48.810910 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8d710a43-1644-4b46-9daf-d762a70787be tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.454361 Oct 29 03:04:48.819105 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2175/4397] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:48 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:48.838436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-786ba4fb-2cab-4b94-bccf-356f23cdf489 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:48.840276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-786ba4fb-2cab-4b94-bccf-356f23cdf489 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:48.860357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-786ba4fb-2cab-4b94-bccf-356f23cdf489 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:48.865746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-786ba4fb-2cab-4b94-bccf-356f23cdf489 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:48.866427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-786ba4fb-2cab-4b94-bccf-356f23cdf489 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:48.867349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-786ba4fb-2cab-4b94-bccf-356f23cdf489 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:48.868259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-786ba4fb-2cab-4b94-bccf-356f23cdf489 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:48.869754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-786ba4fb-2cab-4b94-bccf-356f23cdf489 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:49.113230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4f4c55a7-527d-4dbb-95af-e30f8a8d2726 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:49.122639 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4f4c55a7-527d-4dbb-95af-e30f8a8d2726 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1327 microversion: 2.1 time: 0.511496 Oct 29 03:04:49.123256 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2223/4398] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:48 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1327 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:49.259287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-786ba4fb-2cab-4b94-bccf-356f23cdf489 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:49.267893 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-786ba4fb-2cab-4b94-bccf-356f23cdf489 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.433408 Oct 29 03:04:49.271578 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2176/4399] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:48 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:49.601495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-228368158", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "c699032f-5e15-4569-a5f2-71386fa3ff27"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:49.748125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] validate_networks() for [('c699032f-5e15-4569-a5f2-71386fa3ff27', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:04:49.931142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:50.151608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-39b14094-2754-469e-b430-7148b0f1e5f2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:50.152224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-39b14094-2754-469e-b430-7148b0f1e5f2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:50.155472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:50.156892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:50.191515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b14094-2754-469e-b430-7148b0f1e5f2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:50.194560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b14094-2754-469e-b430-7148b0f1e5f2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:50.195076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b14094-2754-469e-b430-7148b0f1e5f2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:50.196502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b14094-2754-469e-b430-7148b0f1e5f2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:50.198411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b14094-2754-469e-b430-7148b0f1e5f2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:50.204833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-39b14094-2754-469e-b430-7148b0f1e5f2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:50.779572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-39b14094-2754-469e-b430-7148b0f1e5f2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:50.797157 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-39b14094-2754-469e-b430-7148b0f1e5f2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1327 microversion: 2.1 time: 0.649288 Oct 29 03:04:50.797768 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2177/4400] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:50 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1327 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:50.832453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7cb92289-9b6c-4d48-a03e-5fee4eca3456 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-514084339", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fb0a26c0-93a0-4232-80c5-785079686d28", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:50.960107 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-7cb92289-9b6c-4d48-a03e-5fee4eca3456 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Block Device fb0a26c0-93a0-4232-80c5-785079686d28 is not bootable. Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7cb92289-9b6c-4d48-a03e-5fee4eca3456 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 357 Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-514084339", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fb0a26c0-93a0-4232-80c5-785079686d28", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: exception: Block Device fb0a26c0-93a0-4232-80c5-785079686d28 is not bootable. Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-514084339', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'fb0a26c0-93a0-4232-80c5-785079686d28'}], 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device fb0a26c0-93a0-4232-80c5-785079686d28 is not bootable. Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:50.967719 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device fb0a26c0-93a0-4232-80c5-785079686d28 is not bootable. Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device fb0a26c0-93a0-4232-80c5-785079686d28 is not bootable. Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7cb92289-9b6c-4d48-a03e-5fee4eca3456 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Block Device fb0a26c0-93a0-4232-80c5-785079686d28 is not bootable. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:50.971090 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7cb92289-9b6c-4d48-a03e-5fee4eca3456 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.152063 Oct 29 03:04:50.973995 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2178/4401] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:50 2022] POST /compute/v2.1/servers => generated 110 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:04:50.980689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-22f34581-860b-44e4-976b-02c6dd110211 req-5fe3b5ef-b960-467f-901f-a4e993162b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d304e2-1429-4040-abb7-142f54881823", "name": "network-vif-plugged", "status": "completed", "tag": "4184e1fa-5d6b-406a-b454-2f8899df1d3a"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:51.004057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-22f34581-860b-44e4-976b-02c6dd110211 req-5fe3b5ef-b960-467f-901f-a4e993162b84 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.004552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-22f34581-860b-44e4-976b-02c6dd110211 req-5fe3b5ef-b960-467f-901f-a4e993162b84 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.004982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-22f34581-860b-44e4-976b-02c6dd110211 req-5fe3b5ef-b960-467f-901f-a4e993162b84 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.031570 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-22f34581-860b-44e4-976b-02c6dd110211 req-5fe3b5ef-b960-467f-901f-a4e993162b84 service nova] Creating event network-vif-plugged:4184e1fa-5d6b-406a-b454-2f8899df1d3a for instance 95d304e2-1429-4040-abb7-142f54881823 on n-h2-862964-4 Oct 29 03:04:51.041991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:51.043153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:51.043808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:51.044371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:51.044931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:51.053668 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-22f34581-860b-44e4-976b-02c6dd110211 req-5fe3b5ef-b960-467f-901f-a4e993162b84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078312 Oct 29 03:04:51.058534 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2179/4402] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:51.066116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.078780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.081644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.082708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.084585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5e7719c1-4ce4-4b05-af9f-9152158bb659 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:51.085288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5e7719c1-4ce4-4b05-af9f-9152158bb659 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:51.087804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.088086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.139526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e7719c1-4ce4-4b05-af9f-9152158bb659 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.140353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e7719c1-4ce4-4b05-af9f-9152158bb659 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.140807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e7719c1-4ce4-4b05-af9f-9152158bb659 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.150953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e7719c1-4ce4-4b05-af9f-9152158bb659 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.152118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e7719c1-4ce4-4b05-af9f-9152158bb659 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.154283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e7719c1-4ce4-4b05-af9f-9152158bb659 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.166671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for project d4193e4464b7488b9b3bb4064afb0288. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:51.175524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for user dc4e17d222e0426698d1ef9a17921d64 and project d4193e4464b7488b9b3bb4064afb0288. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:51.196292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:04:51.202146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:51.265943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c451aab6-6843-402b-bda0-d54dc21f2cdb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.668951 Oct 29 03:04:51.267335 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2224/4403] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:04:51.281691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5c2833cf-d66e-4277-ae7a-5e0fdfb5c053 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:51.285949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5c2833cf-d66e-4277-ae7a-5e0fdfb5c053 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:51.473070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5c2833cf-d66e-4277-ae7a-5e0fdfb5c053 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:51.484855 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5c2833cf-d66e-4277-ae7a-5e0fdfb5c053 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1214 microversion: 2.1 time: 0.209754 Oct 29 03:04:51.488296 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2225/4404] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:51 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:51.523956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5e7719c1-4ce4-4b05-af9f-9152158bb659 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:51.533968 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5e7719c1-4ce4-4b05-af9f-9152158bb659 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.472724 Oct 29 03:04:51.534552 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2180/4405] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:51 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:51.560793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7b9a6090-d6db-46ed-bf6c-4f72af60424f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:51.561731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7b9a6090-d6db-46ed-bf6c-4f72af60424f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:51.578097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b9a6090-d6db-46ed-bf6c-4f72af60424f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.578855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b9a6090-d6db-46ed-bf6c-4f72af60424f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.579462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b9a6090-d6db-46ed-bf6c-4f72af60424f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.583889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b9a6090-d6db-46ed-bf6c-4f72af60424f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.584528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b9a6090-d6db-46ed-bf6c-4f72af60424f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.585120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b9a6090-d6db-46ed-bf6c-4f72af60424f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.822666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-284fd5af-13ae-41b8-899f-79a889c701d7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:51.824404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-284fd5af-13ae-41b8-899f-79a889c701d7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:51.842376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284fd5af-13ae-41b8-899f-79a889c701d7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.845126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284fd5af-13ae-41b8-899f-79a889c701d7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.845730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284fd5af-13ae-41b8-899f-79a889c701d7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.853399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284fd5af-13ae-41b8-899f-79a889c701d7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.856756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284fd5af-13ae-41b8-899f-79a889c701d7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.860409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284fd5af-13ae-41b8-899f-79a889c701d7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:52.085590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b9a6090-d6db-46ed-bf6c-4f72af60424f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:52.101612 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7b9a6090-d6db-46ed-bf6c-4f72af60424f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.546483 Oct 29 03:04:52.103593 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2226/4406] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:51 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:52.516680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-113268445", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "a7ee32e3-26d8-4e11-baf6-af00585f8b4b"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:52.597595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-284fd5af-13ae-41b8-899f-79a889c701d7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:52.610967 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-284fd5af-13ae-41b8-899f-79a889c701d7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1327 microversion: 2.1 time: 0.794167 Oct 29 03:04:52.611560 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2181/4407] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:51 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1327 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:52.631057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-839e493e-4ad6-4589-9e04-4912b80f9989 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:52.631904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-839e493e-4ad6-4589-9e04-4912b80f9989 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:52.655183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] validate_networks() for [('a7ee32e3-26d8-4e11-baf6-af00585f8b4b', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:04:52.656508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-839e493e-4ad6-4589-9e04-4912b80f9989 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:52.657841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-839e493e-4ad6-4589-9e04-4912b80f9989 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:52.659377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-839e493e-4ad6-4589-9e04-4912b80f9989 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:52.660331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-839e493e-4ad6-4589-9e04-4912b80f9989 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:52.662640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-839e493e-4ad6-4589-9e04-4912b80f9989 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:52.663920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-839e493e-4ad6-4589-9e04-4912b80f9989 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:52.988313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-839e493e-4ad6-4589-9e04-4912b80f9989 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:53.003739 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-839e493e-4ad6-4589-9e04-4912b80f9989 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1210 microversion: 2.1 time: 0.388660 Oct 29 03:04:53.007973 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2182/4408] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:52 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1210 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:53.567103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:53.567644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:53.568005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:53.568407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:53.568991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:53.588265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:53.589011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:53.589634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:53.590566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:53.598631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:53.599325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:53.641198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-398093f6-84ab-4a25-918d-39a2d0bb1294 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:53.646787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-398093f6-84ab-4a25-918d-39a2d0bb1294 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:53.652548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Getting quotas for project 803f70c407f64cbc9818e1b856d60d2c. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:53.664309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-398093f6-84ab-4a25-918d-39a2d0bb1294 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:53.671589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-398093f6-84ab-4a25-918d-39a2d0bb1294 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:53.673956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-398093f6-84ab-4a25-918d-39a2d0bb1294 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:53.676946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Getting quotas for user a93753777d5f4b4885e4ce1e0b13ed98 and project 803f70c407f64cbc9818e1b856d60d2c. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:53.686185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-398093f6-84ab-4a25-918d-39a2d0bb1294 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:53.687112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-398093f6-84ab-4a25-918d-39a2d0bb1294 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:53.689463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-398093f6-84ab-4a25-918d-39a2d0bb1294 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:53.738513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Going to run 3 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:04:53.748890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:53.829256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:53.835423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 45eae659-6555-45bd-bfce-6dad956e267a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:53.910358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=45eae659-6555-45bd-bfce-6dad956e267a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:54.051920 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-09e607d2-c2b2-4c1a-a481-d63c80427e23 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.825319 Oct 29 03:04:54.059032 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2227/4409] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:04:54.061432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8c5020f3-c7c1-4390-afbc-534fee02e48d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:54.062087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8c5020f3-c7c1-4390-afbc-534fee02e48d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:54.083370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c5020f3-c7c1-4390-afbc-534fee02e48d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.083904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c5020f3-c7c1-4390-afbc-534fee02e48d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.084294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c5020f3-c7c1-4390-afbc-534fee02e48d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.085003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c5020f3-c7c1-4390-afbc-534fee02e48d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.085457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c5020f3-c7c1-4390-afbc-534fee02e48d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.085903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c5020f3-c7c1-4390-afbc-534fee02e48d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.221455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8c5020f3-c7c1-4390-afbc-534fee02e48d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:54.230478 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8c5020f3-c7c1-4390-afbc-534fee02e48d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1272 microversion: 2.1 time: 0.175584 Oct 29 03:04:54.233782 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2228/4410] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:54 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:54.245981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d23f05a3-a63d-4fc4-abf6-8bedfc349f32 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:54.260028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d23f05a3-a63d-4fc4-abf6-8bedfc349f32 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:54.260834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d23f05a3-a63d-4fc4-abf6-8bedfc349f32 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Searching by: {'deleted': False, 'project_id': '803f70c407f64cbc9818e1b856d60d2c'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:04:54.302298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d23f05a3-a63d-4fc4-abf6-8bedfc349f32 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.302789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d23f05a3-a63d-4fc4-abf6-8bedfc349f32 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.303254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d23f05a3-a63d-4fc4-abf6-8bedfc349f32 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.304043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d23f05a3-a63d-4fc4-abf6-8bedfc349f32 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.304430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d23f05a3-a63d-4fc4-abf6-8bedfc349f32 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.304843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d23f05a3-a63d-4fc4-abf6-8bedfc349f32 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.351531 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d23f05a3-a63d-4fc4-abf6-8bedfc349f32 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.116534 Oct 29 03:04:54.358014 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2229/4411] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 03:04:54 2022] GET /compute/v2.1/servers => generated 1015 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:54.370711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dc5c8a3d-2df3-4b7d-af6d-a3cc05b50810 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:54.371204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dc5c8a3d-2df3-4b7d-af6d-a3cc05b50810 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:54.487698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dc5c8a3d-2df3-4b7d-af6d-a3cc05b50810 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:54.498445 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dc5c8a3d-2df3-4b7d-af6d-a3cc05b50810 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1222 microversion: 2.1 time: 0.132262 Oct 29 03:04:54.504273 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2230/4412] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:54 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:54.728581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-398093f6-84ab-4a25-918d-39a2d0bb1294 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:54.743514 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-398093f6-84ab-4a25-918d-39a2d0bb1294 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1508 microversion: 2.1 time: 1.105017 Oct 29 03:04:54.765996 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2183/4413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:53 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1508 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:54.784089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-46a28a01-8206-4101-8e3f-86ecc69e3a22 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:54.785340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-46a28a01-8206-4101-8e3f-86ecc69e3a22 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:54.806916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46a28a01-8206-4101-8e3f-86ecc69e3a22 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.808450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46a28a01-8206-4101-8e3f-86ecc69e3a22 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.809693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46a28a01-8206-4101-8e3f-86ecc69e3a22 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.815007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46a28a01-8206-4101-8e3f-86ecc69e3a22 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.816071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46a28a01-8206-4101-8e3f-86ecc69e3a22 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.821100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46a28a01-8206-4101-8e3f-86ecc69e3a22 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:55.187057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9ff7650-6b80-4ba0-8073-135f6b85d86a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-916902477", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "destination_type": "local"}, {"source_type": "volume", "uuid": "1763ed85-6938-40ce-9660-17841d643bb8", "destination_type": "invalid"}], "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9ff7650-6b80-4ba0-8073-135f6b85d86a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 494 Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-916902477", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "destination_type": "local"}, {"source_type": "volume", "uuid": "1763ed85-6938-40ce-9660-17841d643bb8", "destination_type": "invalid"}], "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-916902477', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '1763ed85-6938-40ce-9660-17841d643bb8', 'destination_type': 'invalid'}], 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:55.191732 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9ff7650-6b80-4ba0-8073-135f6b85d86a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:55.195540 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f9ff7650-6b80-4ba0-8073-135f6b85d86a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010317 Oct 29 03:04:55.208501 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2184/4414] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:55 2022] POST /compute/v2.1/servers => generated 155 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:04:55.215040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-faa3b64b-0e13-4831-9725-137c7799b546 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:55.215656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-faa3b64b-0e13-4831-9725-137c7799b546 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:55.239590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faa3b64b-0e13-4831-9725-137c7799b546 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:55.246157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faa3b64b-0e13-4831-9725-137c7799b546 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:55.246920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faa3b64b-0e13-4831-9725-137c7799b546 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:55.248036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faa3b64b-0e13-4831-9725-137c7799b546 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:55.249139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faa3b64b-0e13-4831-9725-137c7799b546 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:55.249877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faa3b64b-0e13-4831-9725-137c7799b546 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:55.597554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-faa3b64b-0e13-4831-9725-137c7799b546 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:55.606466 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-faa3b64b-0e13-4831-9725-137c7799b546 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.396854 Oct 29 03:04:55.616363 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2185/4415] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:55 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:55.621938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-209b094a-bd5a-4113-b3bd-cbaf34976117 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:55.622725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-209b094a-bd5a-4113-b3bd-cbaf34976117 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:55.648054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-209b094a-bd5a-4113-b3bd-cbaf34976117 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:55.648552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-209b094a-bd5a-4113-b3bd-cbaf34976117 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:55.648980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-209b094a-bd5a-4113-b3bd-cbaf34976117 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:55.649685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-209b094a-bd5a-4113-b3bd-cbaf34976117 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:55.650159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-209b094a-bd5a-4113-b3bd-cbaf34976117 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:55.650593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-209b094a-bd5a-4113-b3bd-cbaf34976117 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.069690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-209b094a-bd5a-4113-b3bd-cbaf34976117 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:56.085086 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-209b094a-bd5a-4113-b3bd-cbaf34976117 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1314 microversion: 2.1 time: 0.465297 Oct 29 03:04:56.101158 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2186/4416] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:55 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:56.119161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c0fd3c58-78d3-4c83-9878-cc01c900a0ae tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:56.119801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c0fd3c58-78d3-4c83-9878-cc01c900a0ae tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:56.134019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0fd3c58-78d3-4c83-9878-cc01c900a0ae tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.134201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0fd3c58-78d3-4c83-9878-cc01c900a0ae tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.134639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0fd3c58-78d3-4c83-9878-cc01c900a0ae tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.135350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0fd3c58-78d3-4c83-9878-cc01c900a0ae tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.135802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0fd3c58-78d3-4c83-9878-cc01c900a0ae tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.136225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0fd3c58-78d3-4c83-9878-cc01c900a0ae tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.176915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-46a28a01-8206-4101-8e3f-86ecc69e3a22 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:56.186630 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-46a28a01-8206-4101-8e3f-86ecc69e3a22 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1508 microversion: 2.1 time: 1.412873 Oct 29 03:04:56.203077 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2231/4417] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:54 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1508 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:56.213388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a3c4a02-3c2a-4a83-9382-a1db5df9c875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:56.221089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1a3c4a02-3c2a-4a83-9382-a1db5df9c875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:56.232342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3c4a02-3c2a-4a83-9382-a1db5df9c875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.235615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3c4a02-3c2a-4a83-9382-a1db5df9c875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.236322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3c4a02-3c2a-4a83-9382-a1db5df9c875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.238062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3c4a02-3c2a-4a83-9382-a1db5df9c875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.243958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3c4a02-3c2a-4a83-9382-a1db5df9c875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.244550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3c4a02-3c2a-4a83-9382-a1db5df9c875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.313968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c0fd3c58-78d3-4c83-9878-cc01c900a0ae tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:56.334914 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c0fd3c58-78d3-4c83-9878-cc01c900a0ae tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1226 microversion: 2.1 time: 0.234035 Oct 29 03:04:56.348837 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2187/4418] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:56 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1226 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:56.362571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0d0db51c-31fd-471a-b008-fb5685ac4c7e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:56.376432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0d0db51c-31fd-471a-b008-fb5685ac4c7e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:56.392351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d0db51c-31fd-471a-b008-fb5685ac4c7e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.394472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d0db51c-31fd-471a-b008-fb5685ac4c7e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.395151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d0db51c-31fd-471a-b008-fb5685ac4c7e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.399202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d0db51c-31fd-471a-b008-fb5685ac4c7e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.400006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d0db51c-31fd-471a-b008-fb5685ac4c7e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.417110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d0db51c-31fd-471a-b008-fb5685ac4c7e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.456793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0d0db51c-31fd-471a-b008-fb5685ac4c7e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:04:56.502877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1a3c4a02-3c2a-4a83-9382-a1db5df9c875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:56.519373 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1a3c4a02-3c2a-4a83-9382-a1db5df9c875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.314599 Oct 29 03:04:56.521145 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2232/4419] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:56 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:56.650211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c46aa9c1-86c9-4abe-9dfa-a0f23b986fb8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1190541795", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:56.661276 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0d0db51c-31fd-471a-b008-fb5685ac4c7e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 204 len: 0 microversion: 2.1 time: 0.306994 Oct 29 03:04:56.663957 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2188/4420] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:04:56 2022] DELETE /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c46aa9c1-86c9-4abe-9dfa-a0f23b986fb8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 492 Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1190541795", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1190541795', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:56.664264 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 03:04:56.667449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:56.670410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c46aa9c1-86c9-4abe-9dfa-a0f23b986fb8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:56.674869 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c46aa9c1-86c9-4abe-9dfa-a0f23b986fb8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.029368 Oct 29 03:04:56.679916 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2233/4421] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:56 2022] POST /compute/v2.1/servers => generated 624 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:04:56.688241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-24710470-43b5-4835-811e-44afeb20b2a7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:56.688978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-24710470-43b5-4835-811e-44afeb20b2a7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:56.690303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-00ed7745-66e6-47b4-a796-cec9c230d550 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:56.691157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-00ed7745-66e6-47b4-a796-cec9c230d550 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:56.700194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ed7745-66e6-47b4-a796-cec9c230d550 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.703168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ed7745-66e6-47b4-a796-cec9c230d550 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.705682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ed7745-66e6-47b4-a796-cec9c230d550 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.707340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ed7745-66e6-47b4-a796-cec9c230d550 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.711103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ed7745-66e6-47b4-a796-cec9c230d550 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.712059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ed7745-66e6-47b4-a796-cec9c230d550 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.713482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24710470-43b5-4835-811e-44afeb20b2a7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.715329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24710470-43b5-4835-811e-44afeb20b2a7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.720102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24710470-43b5-4835-811e-44afeb20b2a7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.721940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24710470-43b5-4835-811e-44afeb20b2a7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.722682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24710470-43b5-4835-811e-44afeb20b2a7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.723328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24710470-43b5-4835-811e-44afeb20b2a7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.986534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-00ed7745-66e6-47b4-a796-cec9c230d550 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:56.998765 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-00ed7745-66e6-47b4-a796-cec9c230d550 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.314445 Oct 29 03:04:57.001017 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2234/4422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:56 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:57.022886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-00e38fdf-7bbf-4e98-80bf-18a1e96d32fa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:57.023865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-00e38fdf-7bbf-4e98-80bf-18a1e96d32fa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:57.031757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e38fdf-7bbf-4e98-80bf-18a1e96d32fa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.032533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e38fdf-7bbf-4e98-80bf-18a1e96d32fa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.033194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e38fdf-7bbf-4e98-80bf-18a1e96d32fa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:57.034313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e38fdf-7bbf-4e98-80bf-18a1e96d32fa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.034923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e38fdf-7bbf-4e98-80bf-18a1e96d32fa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.035557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e38fdf-7bbf-4e98-80bf-18a1e96d32fa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:57.281538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-00e38fdf-7bbf-4e98-80bf-18a1e96d32fa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:57.289495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:57.294091 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-00e38fdf-7bbf-4e98-80bf-18a1e96d32fa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.275224 Oct 29 03:04:57.295268 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2235/4423] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:57 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:57.302181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b3dadd06-feb4-4482-9268-26af21ed36d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:57.303207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b3dadd06-feb4-4482-9268-26af21ed36d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:57.354350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3dadd06-feb4-4482-9268-26af21ed36d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.356518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3dadd06-feb4-4482-9268-26af21ed36d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.356960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3dadd06-feb4-4482-9268-26af21ed36d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:57.364991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3dadd06-feb4-4482-9268-26af21ed36d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.365737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3dadd06-feb4-4482-9268-26af21ed36d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.372520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3dadd06-feb4-4482-9268-26af21ed36d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:57.698767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3dadd06-feb4-4482-9268-26af21ed36d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:57.721032 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b3dadd06-feb4-4482-9268-26af21ed36d8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1314 microversion: 2.1 time: 0.424240 Oct 29 03:04:57.722864 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2236/4424] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:57 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:57.743703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f536618-061b-4690-8c65-c51bfcf10e70 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:57.744568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f536618-061b-4690-8c65-c51bfcf10e70 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:57.755299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f536618-061b-4690-8c65-c51bfcf10e70 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.756032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f536618-061b-4690-8c65-c51bfcf10e70 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.756649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f536618-061b-4690-8c65-c51bfcf10e70 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:57.757516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f536618-061b-4690-8c65-c51bfcf10e70 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.771162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f536618-061b-4690-8c65-c51bfcf10e70 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.772648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f536618-061b-4690-8c65-c51bfcf10e70 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:57.826466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-24710470-43b5-4835-811e-44afeb20b2a7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:57.828374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:57.838138 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-24710470-43b5-4835-811e-44afeb20b2a7 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1514 microversion: 2.1 time: 1.168101 Oct 29 03:04:57.838737 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2189/4425] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:56 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1514 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:57.850713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-edbff9c0-77ce-4d13-94ae-72d894f2a631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-edbff9c0-77ce-4d13-94ae-72d894f2a631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 416 Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:57.860300 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-edbff9c0-77ce-4d13-94ae-72d894f2a631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-edbff9c0-77ce-4d13-94ae-72d894f2a631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.018988 Oct 29 03:04:57.863467 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2190/4426] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:57 2022] POST /compute/v2.1/servers => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:04:57.871209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e04b1e4a-8076-4cb4-87a5-60565a0bd54f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:57.872028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e04b1e4a-8076-4cb4-87a5-60565a0bd54f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:57.881177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f536618-061b-4690-8c65-c51bfcf10e70 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:57.882664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e04b1e4a-8076-4cb4-87a5-60565a0bd54f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.883157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e04b1e4a-8076-4cb4-87a5-60565a0bd54f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.883744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e04b1e4a-8076-4cb4-87a5-60565a0bd54f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:57.884624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e04b1e4a-8076-4cb4-87a5-60565a0bd54f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.885273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e04b1e4a-8076-4cb4-87a5-60565a0bd54f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.885939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e04b1e4a-8076-4cb4-87a5-60565a0bd54f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:57.894111 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f536618-061b-4690-8c65-c51bfcf10e70 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1218 microversion: 2.1 time: 0.155343 Oct 29 03:04:57.894828 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2237/4427] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:57 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:58.136699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-759ebb22-0542-448c-bfa1-26c836860758 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:58.137195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-759ebb22-0542-448c-bfa1-26c836860758 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:58.146239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-759ebb22-0542-448c-bfa1-26c836860758 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.146912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-759ebb22-0542-448c-bfa1-26c836860758 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.147500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-759ebb22-0542-448c-bfa1-26c836860758 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.148356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-759ebb22-0542-448c-bfa1-26c836860758 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.148976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-759ebb22-0542-448c-bfa1-26c836860758 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.149546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-759ebb22-0542-448c-bfa1-26c836860758 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.175125 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-759ebb22-0542-448c-bfa1-26c836860758 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/ips" status: 200 len: 151 microversion: 2.20 time: 0.042341 Oct 29 03:04:58.175608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e04b1e4a-8076-4cb4-87a5-60565a0bd54f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:58.176168 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2238/4428] 10.222.0.16 () {60 vars in 1289 bytes} [Sat Oct 29 03:04:58 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:04:58.185572 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e04b1e4a-8076-4cb4-87a5-60565a0bd54f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.318763 Oct 29 03:04:58.186238 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2191/4429] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:57 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:58.230350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-39fab2d6-86c8-49b9-84a1-b10ddc206597 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:58.231138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-39fab2d6-86c8-49b9-84a1-b10ddc206597 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:58.244605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39fab2d6-86c8-49b9-84a1-b10ddc206597 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.245210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39fab2d6-86c8-49b9-84a1-b10ddc206597 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.246247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39fab2d6-86c8-49b9-84a1-b10ddc206597 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.247063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39fab2d6-86c8-49b9-84a1-b10ddc206597 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.250848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39fab2d6-86c8-49b9-84a1-b10ddc206597 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.251390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39fab2d6-86c8-49b9-84a1-b10ddc206597 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.731894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-39fab2d6-86c8-49b9-84a1-b10ddc206597 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:58.746675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-41204b36-7258-41cb-965f-914434880f39 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:58.747623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-41204b36-7258-41cb-965f-914434880f39 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:58.751062 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-39fab2d6-86c8-49b9-84a1-b10ddc206597 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.533727 Oct 29 03:04:58.756242 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2239/4430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:58 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:58.767969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41204b36-7258-41cb-965f-914434880f39 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.771601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41204b36-7258-41cb-965f-914434880f39 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.772845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41204b36-7258-41cb-965f-914434880f39 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.775700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41204b36-7258-41cb-965f-914434880f39 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.778967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41204b36-7258-41cb-965f-914434880f39 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.781349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41204b36-7258-41cb-965f-914434880f39 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.848346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-019ab90b-4706-45ee-90eb-2fd30499fd15 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1861566277", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": -1, "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:58.878106 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-019ab90b-4706-45ee-90eb-2fd30499fd15 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Flavor -1 could not be found. Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-019ab90b-4706-45ee-90eb-2fd30499fd15 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 206 Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1861566277", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": -1, "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: exception: Flavor -1 could not be found. Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1861566277', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': -1, 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:58.890338 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 29 03:04:58.895388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:04:58.898670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-019ab90b-4706-45ee-90eb-2fd30499fd15 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:58.899784 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-019ab90b-4706-45ee-90eb-2fd30499fd15 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.056000 Oct 29 03:04:58.900893 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2240/4431] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:58 2022] POST /compute/v2.1/servers => generated 73 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 29 03:04:58.910545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aafcb12d-5b9f-4302-83aa-cb536424b8c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:58.915189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aafcb12d-5b9f-4302-83aa-cb536424b8c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:58.928917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aafcb12d-5b9f-4302-83aa-cb536424b8c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.931753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aafcb12d-5b9f-4302-83aa-cb536424b8c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.933136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aafcb12d-5b9f-4302-83aa-cb536424b8c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.936940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aafcb12d-5b9f-4302-83aa-cb536424b8c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.937932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aafcb12d-5b9f-4302-83aa-cb536424b8c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.938585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aafcb12d-5b9f-4302-83aa-cb536424b8c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.174778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aafcb12d-5b9f-4302-83aa-cb536424b8c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:59.183330 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aafcb12d-5b9f-4302-83aa-cb536424b8c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1514 microversion: 2.1 time: 0.281017 Oct 29 03:04:59.186656 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2241/4432] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:58 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1514 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:59.201337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0baae84c-9123-4d5d-80d1-4be8a5e07c1c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:59.202385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0baae84c-9123-4d5d-80d1-4be8a5e07c1c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:59.220526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baae84c-9123-4d5d-80d1-4be8a5e07c1c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.221359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baae84c-9123-4d5d-80d1-4be8a5e07c1c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.222115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baae84c-9123-4d5d-80d1-4be8a5e07c1c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.223047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baae84c-9123-4d5d-80d1-4be8a5e07c1c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.223880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baae84c-9123-4d5d-80d1-4be8a5e07c1c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.224305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0baae84c-9123-4d5d-80d1-4be8a5e07c1c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.623442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0baae84c-9123-4d5d-80d1-4be8a5e07c1c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:59.634696 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0baae84c-9123-4d5d-80d1-4be8a5e07c1c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.443378 Oct 29 03:04:59.635302 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2242/4433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:59 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:59.661604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b02e703c-4733-466b-bba3-f5c4b148cd37 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:59.669424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b02e703c-4733-466b-bba3-f5c4b148cd37 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:59.681212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b02e703c-4733-466b-bba3-f5c4b148cd37 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.681985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b02e703c-4733-466b-bba3-f5c4b148cd37 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.683474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b02e703c-4733-466b-bba3-f5c4b148cd37 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.684384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b02e703c-4733-466b-bba3-f5c4b148cd37 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.688572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b02e703c-4733-466b-bba3-f5c4b148cd37 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.689208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b02e703c-4733-466b-bba3-f5c4b148cd37 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.917126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b02e703c-4733-466b-bba3-f5c4b148cd37 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:59.926726 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b02e703c-4733-466b-bba3-f5c4b148cd37 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1274 microversion: 2.1 time: 0.276338 Oct 29 03:04:59.930153 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2243/4434] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:59 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:59.942458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21088342-154d-40d3-8e38-09f3d73518a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:59.943317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-21088342-154d-40d3-8e38-09f3d73518a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:59.958991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21088342-154d-40d3-8e38-09f3d73518a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.960347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21088342-154d-40d3-8e38-09f3d73518a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.961293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21088342-154d-40d3-8e38-09f3d73518a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.962275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21088342-154d-40d3-8e38-09f3d73518a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.962941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21088342-154d-40d3-8e38-09f3d73518a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.963569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21088342-154d-40d3-8e38-09f3d73518a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:00.093529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-41204b36-7258-41cb-965f-914434880f39 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:00.114742 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-41204b36-7258-41cb-965f-914434880f39 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1314 microversion: 2.1 time: 1.371716 Oct 29 03:05:00.115542 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2192/4435] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:58 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1314 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:00.151197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-063a46d4-b15e-40f5-8840-cedfcc7e9fdf req-f78fcbd9-1db9-4d8e-9305-bea96506cd00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd82f16-b3c9-4acb-bfec-cae607467d9f", "tag": "3f06b1c1-7ce1-4a4c-92b7-f3356b842207"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:00.168678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-063a46d4-b15e-40f5-8840-cedfcc7e9fdf req-f78fcbd9-1db9-4d8e-9305-bea96506cd00 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:00.169310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-063a46d4-b15e-40f5-8840-cedfcc7e9fdf req-f78fcbd9-1db9-4d8e-9305-bea96506cd00 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:00.169954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-063a46d4-b15e-40f5-8840-cedfcc7e9fdf req-f78fcbd9-1db9-4d8e-9305-bea96506cd00 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:00.192260 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-063a46d4-b15e-40f5-8840-cedfcc7e9fdf req-f78fcbd9-1db9-4d8e-9305-bea96506cd00 service nova] Creating event network-changed:3f06b1c1-7ce1-4a4c-92b7-f3356b842207 for instance 1cd82f16-b3c9-4acb-bfec-cae607467d9f on n-h1-862964-4 Oct 29 03:05:00.197082 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-063a46d4-b15e-40f5-8840-cedfcc7e9fdf req-f78fcbd9-1db9-4d8e-9305-bea96506cd00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053728 Oct 29 03:05:00.198285 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2193/4436] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:05:00.223405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5b57ce48-5a15-4af5-ae88-3b1150eb92d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:00.231940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5b57ce48-5a15-4af5-ae88-3b1150eb92d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:00.243564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b57ce48-5a15-4af5-ae88-3b1150eb92d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:00.246986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b57ce48-5a15-4af5-ae88-3b1150eb92d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:00.247670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b57ce48-5a15-4af5-ae88-3b1150eb92d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:00.248647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b57ce48-5a15-4af5-ae88-3b1150eb92d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:00.249347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b57ce48-5a15-4af5-ae88-3b1150eb92d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:00.250099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b57ce48-5a15-4af5-ae88-3b1150eb92d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:00.486610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-21088342-154d-40d3-8e38-09f3d73518a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:00.498445 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-21088342-154d-40d3-8e38-09f3d73518a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.559916 Oct 29 03:05:00.528474 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2244/4437] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:59 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:00.633149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-203d110b-592a-45cf-8693-407b869776b4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1980052467", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-203d110b-592a-45cf-8693-407b869776b4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 173 Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1980052467", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1980052467', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi -1 Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:05:00.637789 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 03:05:00.641651 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:00.644534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-203d110b-592a-45cf-8693-407b869776b4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:00.645702 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-203d110b-592a-45cf-8693-407b869776b4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.017838 Oct 29 03:05:00.651518 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2245/4438] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:05:00 2022] POST /compute/v2.1/servers => generated 145 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:05:00.657691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3ced77d0-6657-4189-9d80-1fdba990364b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:00.658426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3ced77d0-6657-4189-9d80-1fdba990364b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:00.667389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ced77d0-6657-4189-9d80-1fdba990364b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:00.668084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ced77d0-6657-4189-9d80-1fdba990364b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:00.668619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ced77d0-6657-4189-9d80-1fdba990364b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:00.669433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ced77d0-6657-4189-9d80-1fdba990364b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:00.669984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ced77d0-6657-4189-9d80-1fdba990364b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:00.670592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ced77d0-6657-4189-9d80-1fdba990364b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:00.872614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5b57ce48-5a15-4af5-ae88-3b1150eb92d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:00.899800 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5b57ce48-5a15-4af5-ae88-3b1150eb92d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 200 len: 1514 microversion: 2.1 time: 0.680858 Oct 29 03:05:00.902043 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2194/4439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:00 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 1514 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:00.954072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ced97da9-285b-4f61-a6eb-757de0bfd196 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:00.955460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ced97da9-285b-4f61-a6eb-757de0bfd196 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:00.969619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ced97da9-285b-4f61-a6eb-757de0bfd196 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:00.971024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ced97da9-285b-4f61-a6eb-757de0bfd196 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:00.972176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ced97da9-285b-4f61-a6eb-757de0bfd196 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:00.976788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ced97da9-285b-4f61-a6eb-757de0bfd196 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:00.979048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ced97da9-285b-4f61-a6eb-757de0bfd196 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:00.979977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ced97da9-285b-4f61-a6eb-757de0bfd196 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.179241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ced77d0-6657-4189-9d80-1fdba990364b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:01.211645 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3ced77d0-6657-4189-9d80-1fdba990364b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.558660 Oct 29 03:05:01.223142 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2246/4440] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:00 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:01.237070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-86b1ebe0-d20f-4086-95b4-a1d05205f308 req-af1247dd-bfa3-4624-8fc9-d54d52624bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d304e2-1429-4040-abb7-142f54881823", "name": "network-vif-deleted", "tag": "4184e1fa-5d6b-406a-b454-2f8899df1d3a"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:01.268903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86b1ebe0-d20f-4086-95b4-a1d05205f308 req-af1247dd-bfa3-4624-8fc9-d54d52624bf8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.269734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86b1ebe0-d20f-4086-95b4-a1d05205f308 req-af1247dd-bfa3-4624-8fc9-d54d52624bf8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.271175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86b1ebe0-d20f-4086-95b4-a1d05205f308 req-af1247dd-bfa3-4624-8fc9-d54d52624bf8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.303943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-86b1ebe0-d20f-4086-95b4-a1d05205f308 req-af1247dd-bfa3-4624-8fc9-d54d52624bf8 service nova] Creating event network-vif-deleted:4184e1fa-5d6b-406a-b454-2f8899df1d3a for instance 95d304e2-1429-4040-abb7-142f54881823 on n-h2-862964-4 Oct 29 03:05:01.334625 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-86b1ebe0-d20f-4086-95b4-a1d05205f308 req-af1247dd-bfa3-4624-8fc9-d54d52624bf8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107492 Oct 29 03:05:01.337196 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2247/4441] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:01.352072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8052f1e6-b2b3-4063-9378-3662c12f3ebc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:01.352888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8052f1e6-b2b3-4063-9378-3662c12f3ebc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:01.361138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8052f1e6-b2b3-4063-9378-3662c12f3ebc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.362008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8052f1e6-b2b3-4063-9378-3662c12f3ebc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.362659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8052f1e6-b2b3-4063-9378-3662c12f3ebc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.363799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8052f1e6-b2b3-4063-9378-3662c12f3ebc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.364980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8052f1e6-b2b3-4063-9378-3662c12f3ebc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.366139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8052f1e6-b2b3-4063-9378-3662c12f3ebc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.515101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ced97da9-285b-4f61-a6eb-757de0bfd196 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:01.536760 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ced97da9-285b-4f61-a6eb-757de0bfd196 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1280 microversion: 2.1 time: 0.587369 Oct 29 03:05:01.549955 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2195/4442] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:00 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1280 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:01.559143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5b152c23-8ace-4d58-be0d-5b060915a3b0 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:01.560016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5b152c23-8ace-4d58-be0d-5b060915a3b0 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:01.569199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b152c23-8ace-4d58-be0d-5b060915a3b0 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.570001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b152c23-8ace-4d58-be0d-5b060915a3b0 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.570612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b152c23-8ace-4d58-be0d-5b060915a3b0 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.571483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b152c23-8ace-4d58-be0d-5b060915a3b0 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.576969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b152c23-8ace-4d58-be0d-5b060915a3b0 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.577587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5b152c23-8ace-4d58-be0d-5b060915a3b0 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.852255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5b152c23-8ace-4d58-be0d-5b060915a3b0 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:01.872818 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5b152c23-8ace-4d58-be0d-5b060915a3b0 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.322972 Oct 29 03:05:01.873841 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2196/4443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:01 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:01.885738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c1e9c64-420a-4774-86aa-acf27dfe303a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:01.897149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6c1e9c64-420a-4774-86aa-acf27dfe303a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:01.919764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c1e9c64-420a-4774-86aa-acf27dfe303a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.923483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c1e9c64-420a-4774-86aa-acf27dfe303a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.925731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c1e9c64-420a-4774-86aa-acf27dfe303a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.930542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c1e9c64-420a-4774-86aa-acf27dfe303a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.931798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c1e9c64-420a-4774-86aa-acf27dfe303a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.932364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c1e9c64-420a-4774-86aa-acf27dfe303a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.983847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-6c1e9c64-420a-4774-86aa-acf27dfe303a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lazy-loading 'flavor' on Instance uuid f439b2b6-1302-414a-93d3-f162321fd6c6 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:05:02.277703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8052f1e6-b2b3-4063-9378-3662c12f3ebc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:02.284135 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6c1e9c64-420a-4774-86aa-acf27dfe303a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "POST /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/action" status: 202 len: 0 microversion: 2.20 time: 0.406874 Oct 29 03:05:02.289314 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2197/4444] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 03:05:01 2022] POST /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:02.289999 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8052f1e6-b2b3-4063-9378-3662c12f3ebc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1314 microversion: 2.1 time: 0.949402 Oct 29 03:05:02.292465 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2248/4445] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:01 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:02.298801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-72f96901-c61e-45f7-acc6-422aee140d29 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-436498329", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:02.301284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:02.305244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:02.310894 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-72f96901-c61e-45f7-acc6-422aee140d29 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-72f96901-c61e-45f7-acc6-422aee140d29 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 215 Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-436498329", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-436498329', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:02.314458 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:02.318739 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:02.318739 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:02.318739 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:02.318739 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:02.318739 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:02.318739 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:02.318739 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 03:05:02.318739 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:02.322433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-72f96901-c61e-45f7-acc6-422aee140d29 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:02.323890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.325215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.325896 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-72f96901-c61e-45f7-acc6-422aee140d29 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.030133 Oct 29 03:05:02.328030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.328606 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2249/4446] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:05:02 2022] POST /compute/v2.1/servers => generated 123 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:05:02.329472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.330444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.331125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.336260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:02.336881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:02.347065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.349661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.350863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.353426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.354220 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:05:02.354854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.355304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 HTTP/1.1 Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '95d304e2-1429-4040-abb7-142f54881823'} Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:02.357669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:02.363389 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:02.363389 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:02.363389 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:02.363389 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:02.363389 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:05:02.363389 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:02.365539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:02.369303 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-90902fa9-c61a-4498-85e8-322248f2cdd9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 404 len: 111 microversion: 2.1 time: 0.078675 Oct 29 03:05:02.370247 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2198/4447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:02 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:02.375909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0390f6c9-73d1-4502-854a-ef278fb8a3b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:02.395548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0390f6c9-73d1-4502-854a-ef278fb8a3b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:02.402787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:02.418437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0390f6c9-73d1-4502-854a-ef278fb8a3b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.418964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0390f6c9-73d1-4502-854a-ef278fb8a3b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.419411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0390f6c9-73d1-4502-854a-ef278fb8a3b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.420131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0390f6c9-73d1-4502-854a-ef278fb8a3b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.420647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0390f6c9-73d1-4502-854a-ef278fb8a3b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.423433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0390f6c9-73d1-4502-854a-ef278fb8a3b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.698137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0390f6c9-73d1-4502-854a-ef278fb8a3b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:02.709319 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0390f6c9-73d1-4502-854a-ef278fb8a3b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.336878 Oct 29 03:05:02.710697 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2199/4448] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:02 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:02.730081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-04eeb83a-200c-42dd-9793-6e446bab3c98 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '.version_select at 0x7fe1a8789940>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:02.767638 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-04eeb83a-200c-42dd-9793-6e446bab3c98 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-135785120" status: 202 len: 0 microversion: 2.1 time: 0.050986 Oct 29 03:05:02.768827 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2200/4449] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Oct 29 03:05:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-135785120 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:05:02.770364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:02.778696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dfe90228-6ff1-47e0-9466-627b64fc5449 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:02.779795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dfe90228-6ff1-47e0-9466-627b64fc5449 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:02.784733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:02.786214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:02.787427 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d21a69a8-0d21-4813-abcf-ab7921dbc1a3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.457683 Oct 29 03:05:02.787985 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2250/4450] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:02 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:02.789261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfe90228-6ff1-47e0-9466-627b64fc5449 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.790270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfe90228-6ff1-47e0-9466-627b64fc5449 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.794829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-620041c3-b639-4070-83da-0fe72b86ff54 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:02.795650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-620041c3-b639-4070-83da-0fe72b86ff54 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:02.803355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfe90228-6ff1-47e0-9466-627b64fc5449 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.805255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfe90228-6ff1-47e0-9466-627b64fc5449 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.807410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfe90228-6ff1-47e0-9466-627b64fc5449 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.808058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfe90228-6ff1-47e0-9466-627b64fc5449 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.817917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-620041c3-b639-4070-83da-0fe72b86ff54 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.822645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-620041c3-b639-4070-83da-0fe72b86ff54 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.823415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-620041c3-b639-4070-83da-0fe72b86ff54 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.824447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-620041c3-b639-4070-83da-0fe72b86ff54 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.825978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-620041c3-b639-4070-83da-0fe72b86ff54 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.826658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-620041c3-b639-4070-83da-0fe72b86ff54 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:03.216153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-620041c3-b639-4070-83da-0fe72b86ff54 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:03.225595 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-620041c3-b639-4070-83da-0fe72b86ff54 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.436561 Oct 29 03:05:03.226233 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2251/4451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:02 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:03.235476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1424632319", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "204a19c0-c3a9-46eb-85da-9d12d0451025"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:03.343340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] validate_networks() for [('204a19c0-c3a9-46eb-85da-9d12d0451025', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:05:03.376322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dfe90228-6ff1-47e0-9466-627b64fc5449 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:03.419676 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dfe90228-6ff1-47e0-9466-627b64fc5449 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.644644 Oct 29 03:05:03.420320 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2201/4452] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:02 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:03.454184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a698ca7-e6a1-4ba2-85c7-21c3747ccc24 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:03.457215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6a698ca7-e6a1-4ba2-85c7-21c3747ccc24 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:03.478066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a698ca7-e6a1-4ba2-85c7-21c3747ccc24 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.485207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a698ca7-e6a1-4ba2-85c7-21c3747ccc24 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.486149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a698ca7-e6a1-4ba2-85c7-21c3747ccc24 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:03.487374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a698ca7-e6a1-4ba2-85c7-21c3747ccc24 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.488665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a698ca7-e6a1-4ba2-85c7-21c3747ccc24 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.489282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a698ca7-e6a1-4ba2-85c7-21c3747ccc24 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.088025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:05:04.088456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:05:04.088936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:05:04.089493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:05:04.090009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:05:04.111653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.112151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.112591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.113342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.119013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.119607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.174117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:05:04.191108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for user cecadca739554f858c269b85690b5cec and project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:05:04.220071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:05:04.222801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:05:04.290966 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9f65e186-47a8-4938-8578-0c4f3354d538 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059226 Oct 29 03:05:04.299476 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2252/4453] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:05:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:05:04.304877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3709c0e1-eba6-4833-9ee0-172f707dd301 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1547801487", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "key_name": "tempest-key-1795382232", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:04.398647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-3709c0e1-eba6-4833-9ee0-172f707dd301 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] validate_networks() for [('58a9eca5-efd9-4c67-9627-237802e0f75c', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:05:04.715046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a698ca7-e6a1-4ba2-85c7-21c3747ccc24 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:04.723565 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a698ca7-e6a1-4ba2-85c7-21c3747ccc24 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1314 microversion: 2.1 time: 1.296352 Oct 29 03:05:04.738872 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2202/4454] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:03 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:04.745672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:04.746432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:04.784876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.785668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.787973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.789401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.795988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.796671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.956037 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-3709c0e1-eba6-4833-9ee0-172f707dd301 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Invalid key_name provided. Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3709c0e1-eba6-4833-9ee0-172f707dd301 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 247 Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1547801487", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "key_name": "tempest-key-1795382232", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid key_name provided. Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1547801487', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'key_name': 'tempest-key-1795382232', 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1795382232 not found for user 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:04.958055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:04.962257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3709c0e1-eba6-4833-9ee0-172f707dd301 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Invalid key_name provided. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:04.965410 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3709c0e1-eba6-4833-9ee0-172f707dd301 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.663887 Oct 29 03:05:04.967674 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2253/4455] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:05:04 2022] POST /compute/v2.1/servers => generated 70 bytes in 667 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 03:05:04.979650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-862143ca-b588-48d5-8d23-cb18cf59ace8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:04.981232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-862143ca-b588-48d5-8d23-cb18cf59ace8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:05.092922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-862143ca-b588-48d5-8d23-cb18cf59ace8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.105993 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-862143ca-b588-48d5-8d23-cb18cf59ace8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1209 microversion: 2.1 time: 0.133646 Oct 29 03:05:05.119237 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2254/4456] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:04 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1209 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:05.130294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6029b7d7-6a1a-482d-bf04-087cfa018f6a tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:05.131121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6029b7d7-6a1a-482d-bf04-087cfa018f6a tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:05.147695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6029b7d7-6a1a-482d-bf04-087cfa018f6a tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.148374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6029b7d7-6a1a-482d-bf04-087cfa018f6a tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.148875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6029b7d7-6a1a-482d-bf04-087cfa018f6a tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.150230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6029b7d7-6a1a-482d-bf04-087cfa018f6a tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.150751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6029b7d7-6a1a-482d-bf04-087cfa018f6a tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.151351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6029b7d7-6a1a-482d-bf04-087cfa018f6a tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.506591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.531564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6029b7d7-6a1a-482d-bf04-087cfa018f6a tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.561327 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6029b7d7-6a1a-482d-bf04-087cfa018f6a tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.440395 Oct 29 03:05:05.563300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.566493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.570407 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2255/4457] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:05 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:05.573318 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ffee0e57-3014-4f9d-b894-79d6ded6ab19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.833308 Oct 29 03:05:05.579621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b4170c1e-cf15-4002-968b-e6a6564db485 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:05.580708 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2203/4458] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:04 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:05.587493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b4170c1e-cf15-4002-968b-e6a6564db485 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:05.590093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9a78c531-cfd6-4ccd-b8ab-2a35c39fdf9c req-ef653f2f-0522-45d0-814a-f107dac8807d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca", "tag": "c4d39ef5-7494-4a08-9fe1-d5182e64380a"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:05.602069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4170c1e-cf15-4002-968b-e6a6564db485 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.602873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4170c1e-cf15-4002-968b-e6a6564db485 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.603307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4170c1e-cf15-4002-968b-e6a6564db485 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.604021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4170c1e-cf15-4002-968b-e6a6564db485 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.604473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4170c1e-cf15-4002-968b-e6a6564db485 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.604891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4170c1e-cf15-4002-968b-e6a6564db485 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.613079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9a78c531-cfd6-4ccd-b8ab-2a35c39fdf9c req-ef653f2f-0522-45d0-814a-f107dac8807d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.616859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9a78c531-cfd6-4ccd-b8ab-2a35c39fdf9c req-ef653f2f-0522-45d0-814a-f107dac8807d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.617470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9a78c531-cfd6-4ccd-b8ab-2a35c39fdf9c req-ef653f2f-0522-45d0-814a-f107dac8807d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.637242 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9a78c531-cfd6-4ccd-b8ab-2a35c39fdf9c req-ef653f2f-0522-45d0-814a-f107dac8807d service nova] Creating event network-changed:c4d39ef5-7494-4a08-9fe1-d5182e64380a for instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca on n-h2-862964-4 Oct 29 03:05:05.653565 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9a78c531-cfd6-4ccd-b8ab-2a35c39fdf9c req-ef653f2f-0522-45d0-814a-f107dac8807d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071401 Oct 29 03:05:05.656905 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2204/4459] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:05.751339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b3e3386e-89e3-414b-a159-60ec4a86d0d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:05.752144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b3e3386e-89e3-414b-a159-60ec4a86d0d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:05.762264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3e3386e-89e3-414b-a159-60ec4a86d0d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.763380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3e3386e-89e3-414b-a159-60ec4a86d0d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.763829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3e3386e-89e3-414b-a159-60ec4a86d0d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.766095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3e3386e-89e3-414b-a159-60ec4a86d0d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.766571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3e3386e-89e3-414b-a159-60ec4a86d0d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.767003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b3e3386e-89e3-414b-a159-60ec4a86d0d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.910897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b4170c1e-cf15-4002-968b-e6a6564db485 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.923443 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b4170c1e-cf15-4002-968b-e6a6564db485 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.351704 Oct 29 03:05:05.924275 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2256/4460] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:05 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:05.948608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-752a630f-f02b-46e7-a51f-1d308c9937ee tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:05.949941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-752a630f-f02b-46e7-a51f-1d308c9937ee tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:05.957044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-752a630f-f02b-46e7-a51f-1d308c9937ee tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.957530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-752a630f-f02b-46e7-a51f-1d308c9937ee tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.957998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-752a630f-f02b-46e7-a51f-1d308c9937ee tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.958854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-752a630f-f02b-46e7-a51f-1d308c9937ee tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.959447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-752a630f-f02b-46e7-a51f-1d308c9937ee tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.960012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-752a630f-f02b-46e7-a51f-1d308c9937ee tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.129320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b3e3386e-89e3-414b-a159-60ec4a86d0d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:06.158545 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b3e3386e-89e3-414b-a159-60ec4a86d0d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1314 microversion: 2.1 time: 0.410621 Oct 29 03:05:06.161642 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2205/4461] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:05 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:06.170497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-752a630f-f02b-46e7-a51f-1d308c9937ee tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:06.189847 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-752a630f-f02b-46e7-a51f-1d308c9937ee tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.245408 Oct 29 03:05:06.197084 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2257/4462] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:05 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:06.201009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b80a2e3e-e69e-431b-879e-28eda1436b6a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:06.204725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b80a2e3e-e69e-431b-879e-28eda1436b6a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:06.219706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b80a2e3e-e69e-431b-879e-28eda1436b6a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.252201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b80a2e3e-e69e-431b-879e-28eda1436b6a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.253433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b80a2e3e-e69e-431b-879e-28eda1436b6a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.258122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b80a2e3e-e69e-431b-879e-28eda1436b6a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.262915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b80a2e3e-e69e-431b-879e-28eda1436b6a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.263550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b80a2e3e-e69e-431b-879e-28eda1436b6a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.328806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c7267c33-e7da-4f23-b25b-eedef6cda2d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2116855175", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:06.470905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.security_group_api [None req-c7267c33-e7da-4f23-b25b-eedef6cda2d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Neutron security group does_not_exist not found {{(pid=127042) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 29 03:05:06.471714 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c7267c33-e7da-4f23-b25b-eedef6cda2d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c7267c33-e7da-4f23-b25b-eedef6cda2d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 258 Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2116855175", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2116855175', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 29 03:05:06.480109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:06.483827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c7267c33-e7da-4f23-b25b-eedef6cda2d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:06.491294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c7267c33-e7da-4f23-b25b-eedef6cda2d2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.157649 Oct 29 03:05:06.491294 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2258/4463] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:05:06 2022] POST /compute/v2.1/servers => generated 106 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:05:06.494909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e37d9144-6dae-4913-9e6c-4936dd0db64f req-5c48ca26-0fec-4b9d-abc2-6dc88530bdeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd82f16-b3c9-4acb-bfec-cae607467d9f", "name": "network-vif-plugged", "status": "completed", "tag": "3f06b1c1-7ce1-4a4c-92b7-f3356b842207"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:06.506282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e37d9144-6dae-4913-9e6c-4936dd0db64f req-5c48ca26-0fec-4b9d-abc2-6dc88530bdeb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.506845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e37d9144-6dae-4913-9e6c-4936dd0db64f req-5c48ca26-0fec-4b9d-abc2-6dc88530bdeb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.507362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e37d9144-6dae-4913-9e6c-4936dd0db64f req-5c48ca26-0fec-4b9d-abc2-6dc88530bdeb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.520123 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e37d9144-6dae-4913-9e6c-4936dd0db64f req-5c48ca26-0fec-4b9d-abc2-6dc88530bdeb service nova] Creating event network-vif-plugged:3f06b1c1-7ce1-4a4c-92b7-f3356b842207 for instance 1cd82f16-b3c9-4acb-bfec-cae607467d9f on n-h1-862964-4 Oct 29 03:05:06.526283 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e37d9144-6dae-4913-9e6c-4936dd0db64f req-5c48ca26-0fec-4b9d-abc2-6dc88530bdeb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038000 Oct 29 03:05:06.526996 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2259/4464] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:06.533010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-23556f2a-c39d-466c-a10a-46dbf166b469 req-2934e6ca-08ed-4818-9caf-520ff6a34784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45eae659-6555-45bd-bfce-6dad956e267a", "tag": "1fd7951b-046c-41bc-bf9f-e0127b2c9575"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:06.543470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-23556f2a-c39d-466c-a10a-46dbf166b469 req-2934e6ca-08ed-4818-9caf-520ff6a34784 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.544314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-23556f2a-c39d-466c-a10a-46dbf166b469 req-2934e6ca-08ed-4818-9caf-520ff6a34784 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.544966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-23556f2a-c39d-466c-a10a-46dbf166b469 req-2934e6ca-08ed-4818-9caf-520ff6a34784 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.569828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b80a2e3e-e69e-431b-879e-28eda1436b6a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:06.582945 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b80a2e3e-e69e-431b-879e-28eda1436b6a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1261 microversion: 2.1 time: 0.416897 Oct 29 03:05:06.586165 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2206/4465] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:06 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1261 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:06.594070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b57cdb51-f8b7-4b22-9cc4-61ffb3414cfa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:06.596417 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-23556f2a-c39d-466c-a10a-46dbf166b469 req-2934e6ca-08ed-4818-9caf-520ff6a34784 service nova] Creating event network-changed:1fd7951b-046c-41bc-bf9f-e0127b2c9575 for instance 45eae659-6555-45bd-bfce-6dad956e267a on n-h1-862964-4 Oct 29 03:05:06.599051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b57cdb51-f8b7-4b22-9cc4-61ffb3414cfa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:06.611535 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-23556f2a-c39d-466c-a10a-46dbf166b469 req-2934e6ca-08ed-4818-9caf-520ff6a34784 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082632 Oct 29 03:05:06.613872 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2260/4466] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:06.616244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57cdb51-f8b7-4b22-9cc4-61ffb3414cfa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.616735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57cdb51-f8b7-4b22-9cc4-61ffb3414cfa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.624214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57cdb51-f8b7-4b22-9cc4-61ffb3414cfa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.626851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57cdb51-f8b7-4b22-9cc4-61ffb3414cfa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.627941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57cdb51-f8b7-4b22-9cc4-61ffb3414cfa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.628379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b57cdb51-f8b7-4b22-9cc4-61ffb3414cfa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.632126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0519fb7c-033f-4c8f-9a65-6394fe23c3d9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:06.633462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0519fb7c-033f-4c8f-9a65-6394fe23c3d9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:06.648317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0519fb7c-033f-4c8f-9a65-6394fe23c3d9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.648815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0519fb7c-033f-4c8f-9a65-6394fe23c3d9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.649252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0519fb7c-033f-4c8f-9a65-6394fe23c3d9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.650046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0519fb7c-033f-4c8f-9a65-6394fe23c3d9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.650499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0519fb7c-033f-4c8f-9a65-6394fe23c3d9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.651053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0519fb7c-033f-4c8f-9a65-6394fe23c3d9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.674941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:06.815921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0519fb7c-033f-4c8f-9a65-6394fe23c3d9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:06.824465 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0519fb7c-033f-4c8f-9a65-6394fe23c3d9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.202926 Oct 29 03:05:06.825386 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2261/4467] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:06 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:06.830400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:06.830996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:06.840329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.841598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.841598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.841942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.842414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.842825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.005596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.016754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.018373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.020221 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-09784a91-0103-4a8e-aa18-5a031bc34811 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.193958 Oct 29 03:05:07.020863 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2262/4468] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:06 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:07.235467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b57cdb51-f8b7-4b22-9cc4-61ffb3414cfa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.244821 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b57cdb51-f8b7-4b22-9cc4-61ffb3414cfa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.657344 Oct 29 03:05:07.245409 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2207/4469] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:06 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:07.272351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-676ecc88-a4ae-4d5b-abb6-67f92a122e7c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:07.273250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-676ecc88-a4ae-4d5b-abb6-67f92a122e7c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:07.278067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-527c765f-d087-4191-828e-a90bf550c545 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:07.279087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-527c765f-d087-4191-828e-a90bf550c545 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:07.281847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-676ecc88-a4ae-4d5b-abb6-67f92a122e7c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.282472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-676ecc88-a4ae-4d5b-abb6-67f92a122e7c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.282966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-676ecc88-a4ae-4d5b-abb6-67f92a122e7c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.283819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-676ecc88-a4ae-4d5b-abb6-67f92a122e7c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.284336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-676ecc88-a4ae-4d5b-abb6-67f92a122e7c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.284820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-676ecc88-a4ae-4d5b-abb6-67f92a122e7c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.286219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-527c765f-d087-4191-828e-a90bf550c545 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.286707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-527c765f-d087-4191-828e-a90bf550c545 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.287147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-527c765f-d087-4191-828e-a90bf550c545 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.288264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-527c765f-d087-4191-828e-a90bf550c545 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.289029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-527c765f-d087-4191-828e-a90bf550c545 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.289608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-527c765f-d087-4191-828e-a90bf550c545 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.306909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:07.460079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-676ecc88-a4ae-4d5b-abb6-67f92a122e7c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.483033 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-676ecc88-a4ae-4d5b-abb6-67f92a122e7c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1314 microversion: 2.1 time: 0.215715 Oct 29 03:05:07.491770 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2263/4470] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:07 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:07.613477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-708e2b60-e4ec-490a-ae70-5619221a4756 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:07.614979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-708e2b60-e4ec-490a-ae70-5619221a4756 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:07.627882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-708e2b60-e4ec-490a-ae70-5619221a4756 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.628626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-708e2b60-e4ec-490a-ae70-5619221a4756 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.632244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-708e2b60-e4ec-490a-ae70-5619221a4756 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.633379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-708e2b60-e4ec-490a-ae70-5619221a4756 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.634090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-708e2b60-e4ec-490a-ae70-5619221a4756 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.634732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-708e2b60-e4ec-490a-ae70-5619221a4756 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.838112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-708e2b60-e4ec-490a-ae70-5619221a4756 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.849669 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-708e2b60-e4ec-490a-ae70-5619221a4756 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1279 microversion: 2.1 time: 0.240615 Oct 29 03:05:07.851000 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2264/4471] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:07 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1279 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:07.857055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2aa5b071-f27c-4ef8-979f-721381cfa904 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:07.859797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2aa5b071-f27c-4ef8-979f-721381cfa904 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:07.866797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aa5b071-f27c-4ef8-979f-721381cfa904 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.867963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aa5b071-f27c-4ef8-979f-721381cfa904 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.868596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aa5b071-f27c-4ef8-979f-721381cfa904 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.869680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aa5b071-f27c-4ef8-979f-721381cfa904 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.870363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aa5b071-f27c-4ef8-979f-721381cfa904 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.870981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2aa5b071-f27c-4ef8-979f-721381cfa904 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:08.175170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-527c765f-d087-4191-828e-a90bf550c545 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:08.190326 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-527c765f-d087-4191-828e-a90bf550c545 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.917170 Oct 29 03:05:08.193963 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2208/4472] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:07 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:08.201298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:08.206659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:08.215032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:08.216408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:08.218329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:08.219475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:08.220184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:08.220929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:08.263196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2aa5b071-f27c-4ef8-979f-721381cfa904 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:08.276725 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2aa5b071-f27c-4ef8-979f-721381cfa904 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.424373 Oct 29 03:05:08.279221 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2265/4473] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:07 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:08.286783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c96ae0a0-9a7b-4703-aaf8-7586817f2088 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:08.292869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c96ae0a0-9a7b-4703-aaf8-7586817f2088 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 95a98ca7-cf47-4382-8a1a-a411fea91b76] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:08.295058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=90 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:08.310680 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c96ae0a0-9a7b-4703-aaf8-7586817f2088 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance 95a98ca7-cf47-4382-8a1a-a411fea91b76 could not be found. Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c96ae0a0-9a7b-4703-aaf8-7586817f2088 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/95a98ca7-cf47-4382-8a1a-a411fea91b76 HTTP/1.1 Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 95a98ca7-cf47-4382-8a1a-a411fea91b76 could not be found. Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '95a98ca7-cf47-4382-8a1a-a411fea91b76'} Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a98ca7-cf47-4382-8a1a-a411fea91b76 could not be found. Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a98ca7-cf47-4382-8a1a-a411fea91b76 could not be found. Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:08.316251 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:08.319995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:08.319995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:08.319995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:08.319995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:08.319995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:08.319995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:08.319995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a98ca7-cf47-4382-8a1a-a411fea91b76 could not be found. Oct 29 03:05:08.319995 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:08.321849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c96ae0a0-9a7b-4703-aaf8-7586817f2088 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance 95a98ca7-cf47-4382-8a1a-a411fea91b76 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:08.322896 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c96ae0a0-9a7b-4703-aaf8-7586817f2088 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95a98ca7-cf47-4382-8a1a-a411fea91b76" status: 404 len: 111 microversion: 2.1 time: 0.042557 Oct 29 03:05:08.326950 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2266/4474] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:05:08 2022] DELETE /compute/v2.1/servers/95a98ca7-cf47-4382-8a1a-a411fea91b76 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:08.331935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-78344407-ba44-478c-a466-9f86738bc613 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:08.332769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-78344407-ba44-478c-a466-9f86738bc613 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:08.343841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78344407-ba44-478c-a466-9f86738bc613 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:08.345044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78344407-ba44-478c-a466-9f86738bc613 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:08.345700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78344407-ba44-478c-a466-9f86738bc613 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:08.346620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78344407-ba44-478c-a466-9f86738bc613 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:08.347245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78344407-ba44-478c-a466-9f86738bc613 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:08.347836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78344407-ba44-478c-a466-9f86738bc613 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:08.745122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:08.759323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:08.761759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:08.763778 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-80710b75-bc95-4e56-b2c1-0987ab363d59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.568447 Oct 29 03:05:08.765284 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2209/4475] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:08 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:08.776127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-427d93f9-85ef-4826-b893-31d28330d727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:08.778538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-427d93f9-85ef-4826-b893-31d28330d727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:08.802600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-427d93f9-85ef-4826-b893-31d28330d727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:08.803773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-427d93f9-85ef-4826-b893-31d28330d727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:08.804873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-427d93f9-85ef-4826-b893-31d28330d727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:08.806325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-427d93f9-85ef-4826-b893-31d28330d727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:08.807051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-427d93f9-85ef-4826-b893-31d28330d727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:08.813389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-427d93f9-85ef-4826-b893-31d28330d727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.077769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-78344407-ba44-478c-a466-9f86738bc613 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:09.088320 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-78344407-ba44-478c-a466-9f86738bc613 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.759977 Oct 29 03:05:09.088921 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2267/4476] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:08 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:09.111289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-2cceb6f2-1458-43b6-989d-af7ccb2940e6 req-a3c777a2-dbc2-471f-b1f6-3deb962fbb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92775b76-1fb7-497b-9f2c-5b9e682f8b2c", "tag": "e58c37a1-df9d-443f-a284-b47d6c3e85d1"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:09.122164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2cceb6f2-1458-43b6-989d-af7ccb2940e6 req-a3c777a2-dbc2-471f-b1f6-3deb962fbb78 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.122984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2cceb6f2-1458-43b6-989d-af7ccb2940e6 req-a3c777a2-dbc2-471f-b1f6-3deb962fbb78 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.123976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2cceb6f2-1458-43b6-989d-af7ccb2940e6 req-a3c777a2-dbc2-471f-b1f6-3deb962fbb78 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.147970 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-2cceb6f2-1458-43b6-989d-af7ccb2940e6 req-a3c777a2-dbc2-471f-b1f6-3deb962fbb78 service nova] Creating event network-changed:e58c37a1-df9d-443f-a284-b47d6c3e85d1 for instance 92775b76-1fb7-497b-9f2c-5b9e682f8b2c on n-h2-862964-4 Oct 29 03:05:09.160824 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-2cceb6f2-1458-43b6-989d-af7ccb2940e6 req-a3c777a2-dbc2-471f-b1f6-3deb962fbb78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052993 Oct 29 03:05:09.161738 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2268/4477] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:09.168093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7b71a2dc-b8c3-4950-8e37-d2bc3828eb92 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:09.169179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7b71a2dc-b8c3-4950-8e37-d2bc3828eb92 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:09.178789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b71a2dc-b8c3-4950-8e37-d2bc3828eb92 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.179894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b71a2dc-b8c3-4950-8e37-d2bc3828eb92 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.180528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b71a2dc-b8c3-4950-8e37-d2bc3828eb92 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.181446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b71a2dc-b8c3-4950-8e37-d2bc3828eb92 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.182138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b71a2dc-b8c3-4950-8e37-d2bc3828eb92 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.182757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b71a2dc-b8c3-4950-8e37-d2bc3828eb92 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.259693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-427d93f9-85ef-4826-b893-31d28330d727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:09.272575 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-427d93f9-85ef-4826-b893-31d28330d727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1502 microversion: 2.1 time: 0.505093 Oct 29 03:05:09.273532 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2210/4478] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:08 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1502 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:09.282657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dedf331e-b515-4352-baf2-cf41e5803d8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:09.287503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dedf331e-b515-4352-baf2-cf41e5803d8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:09.306703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dedf331e-b515-4352-baf2-cf41e5803d8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.307427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dedf331e-b515-4352-baf2-cf41e5803d8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.308142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dedf331e-b515-4352-baf2-cf41e5803d8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.309783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dedf331e-b515-4352-baf2-cf41e5803d8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.310977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dedf331e-b515-4352-baf2-cf41e5803d8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.311563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dedf331e-b515-4352-baf2-cf41e5803d8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.315527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b71a2dc-b8c3-4950-8e37-d2bc3828eb92 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:09.328284 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7b71a2dc-b8c3-4950-8e37-d2bc3828eb92 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1267 microversion: 2.1 time: 0.165266 Oct 29 03:05:09.329196 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2269/4479] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:09 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:09.338201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d6eeab6-dee2-4efb-aa6e-5438bda421b3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:09.355207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6eeab6-dee2-4efb-aa6e-5438bda421b3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.355694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6eeab6-dee2-4efb-aa6e-5438bda421b3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.356116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6eeab6-dee2-4efb-aa6e-5438bda421b3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.385572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d6eeab6-dee2-4efb-aa6e-5438bda421b3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Going to try to stop instance {{(pid=127042) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:05:09.450072 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d6eeab6-dee2-4efb-aa6e-5438bda421b3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f/action" status: 202 len: 0 microversion: 2.1 time: 0.117085 Oct 29 03:05:09.451233 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2270/4480] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:09 2022] POST /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:05:09.458222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8b7a4302-5aff-4606-b595-dc00cfde361e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:09.459178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8b7a4302-5aff-4606-b595-dc00cfde361e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:09.465922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7a4302-5aff-4606-b595-dc00cfde361e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.466667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7a4302-5aff-4606-b595-dc00cfde361e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.467326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7a4302-5aff-4606-b595-dc00cfde361e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.468245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7a4302-5aff-4606-b595-dc00cfde361e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.468890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7a4302-5aff-4606-b595-dc00cfde361e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.469505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b7a4302-5aff-4606-b595-dc00cfde361e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.668249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dedf331e-b515-4352-baf2-cf41e5803d8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:09.680019 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dedf331e-b515-4352-baf2-cf41e5803d8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.405134 Oct 29 03:05:09.688133 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2211/4481] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:09 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:09.708928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-61ce663f-890d-4148-baaa-d48cee3dc0df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:09.709933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-61ce663f-890d-4148-baaa-d48cee3dc0df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:09.729330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61ce663f-890d-4148-baaa-d48cee3dc0df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.730207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61ce663f-890d-4148-baaa-d48cee3dc0df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.731501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61ce663f-890d-4148-baaa-d48cee3dc0df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.732463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61ce663f-890d-4148-baaa-d48cee3dc0df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.733942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61ce663f-890d-4148-baaa-d48cee3dc0df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.734620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-61ce663f-890d-4148-baaa-d48cee3dc0df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.861130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8b7a4302-5aff-4606-b595-dc00cfde361e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:09.886631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8b7a4302-5aff-4606-b595-dc00cfde361e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.433361 Oct 29 03:05:09.886761 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2271/4482] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:09 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:09.912474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7caa6492-4f24-4cdc-9b79-5d89d116ae6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:09.912975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7caa6492-4f24-4cdc-9b79-5d89d116ae6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 03:05:09.913505 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-7caa6492-4f24-4cdc-9b79-5d89d116ae6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7caa6492-4f24-4cdc-9b79-5d89d116ae6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 9223372036854775808 could not be found. Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '9223372036854775808'} Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:09.915307 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:09.919649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:09.919649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:09.919649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:09.919649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 29 03:05:09.919649 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:09.919649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7caa6492-4f24-4cdc-9b79-5d89d116ae6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:09.920452 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7caa6492-4f24-4cdc-9b79-5d89d116ae6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.032653 Oct 29 03:05:09.921504 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2272/4483] 10.222.0.16 () {58 vars in 1188 bytes} [Sat Oct 29 03:05:09 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:05:09.932636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:09.936338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:09.953672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.954739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.955377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.956494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.957115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.957703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.221385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.230997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.250194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.252113 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3d7d34f1-1f26-49d7-a198-8d593e21b521 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.326447 Oct 29 03:05:10.252957 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2273/4484] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:09 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:10.258835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3ea13998-f0c0-4f55-95d4-30960064033c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:10.266558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3ea13998-f0c0-4f55-95d4-30960064033c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:10.272924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ea13998-f0c0-4f55-95d4-30960064033c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.279903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ea13998-f0c0-4f55-95d4-30960064033c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.280600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ea13998-f0c0-4f55-95d4-30960064033c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.281372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ea13998-f0c0-4f55-95d4-30960064033c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.281934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ea13998-f0c0-4f55-95d4-30960064033c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.282572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ea13998-f0c0-4f55-95d4-30960064033c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.297298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-61ce663f-890d-4148-baaa-d48cee3dc0df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.306138 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-61ce663f-890d-4148-baaa-d48cee3dc0df tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.614236 Oct 29 03:05:10.306924 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2212/4485] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:09 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:10.360247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4467999c-c547-4beb-bf4b-b1f7eac2242f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:10.360846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4467999c-c547-4beb-bf4b-b1f7eac2242f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:10.368636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4467999c-c547-4beb-bf4b-b1f7eac2242f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.369113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4467999c-c547-4beb-bf4b-b1f7eac2242f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.369538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4467999c-c547-4beb-bf4b-b1f7eac2242f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.370250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4467999c-c547-4beb-bf4b-b1f7eac2242f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.370692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4467999c-c547-4beb-bf4b-b1f7eac2242f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.371100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4467999c-c547-4beb-bf4b-b1f7eac2242f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.671038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ea13998-f0c0-4f55-95d4-30960064033c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.680593 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3ea13998-f0c0-4f55-95d4-30960064033c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.425980 Oct 29 03:05:10.681949 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2274/4486] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:10 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:10.708221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5aaa84c0-370d-4313-adc0-0392c95cbffb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:10.709076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5aaa84c0-370d-4313-adc0-0392c95cbffb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:10.716410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5aaa84c0-370d-4313-adc0-0392c95cbffb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.717230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5aaa84c0-370d-4313-adc0-0392c95cbffb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.718442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5aaa84c0-370d-4313-adc0-0392c95cbffb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.719339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5aaa84c0-370d-4313-adc0-0392c95cbffb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.720018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5aaa84c0-370d-4313-adc0-0392c95cbffb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.721110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5aaa84c0-370d-4313-adc0-0392c95cbffb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.778908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4467999c-c547-4beb-bf4b-b1f7eac2242f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.793191 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4467999c-c547-4beb-bf4b-b1f7eac2242f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1309 microversion: 2.1 time: 0.431923 Oct 29 03:05:10.793191 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2213/4487] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:10 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:10.913676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e76d5fe1-4ff6-4886-bcba-f5906fd98515 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:10.915408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e76d5fe1-4ff6-4886-bcba-f5906fd98515 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:10.926630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e76d5fe1-4ff6-4886-bcba-f5906fd98515 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.927521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e76d5fe1-4ff6-4886-bcba-f5906fd98515 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.928363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e76d5fe1-4ff6-4886-bcba-f5906fd98515 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.929445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e76d5fe1-4ff6-4886-bcba-f5906fd98515 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.930355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e76d5fe1-4ff6-4886-bcba-f5906fd98515 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.931017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e76d5fe1-4ff6-4886-bcba-f5906fd98515 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.208489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e76d5fe1-4ff6-4886-bcba-f5906fd98515 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.219274 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e76d5fe1-4ff6-4886-bcba-f5906fd98515 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.309942 Oct 29 03:05:11.220221 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2214/4488] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:10 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:11.221234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5aaa84c0-370d-4313-adc0-0392c95cbffb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.229273 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5aaa84c0-370d-4313-adc0-0392c95cbffb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.525330 Oct 29 03:05:11.230751 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2275/4489] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:10 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:11.255542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3a2ed51a-065e-436a-a299-0ce6d767f322 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:11.256396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3a2ed51a-065e-436a-a299-0ce6d767f322 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Failed to fetch instance by id -1 {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 03:05:11.257171 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-3a2ed51a-065e-436a-a299-0ce6d767f322 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance -1 could not be found. Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3a2ed51a-065e-436a-a299-0ce6d767f322 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance -1 could not be found. Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '-1'} Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:11.258953 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:11.262699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:11.262699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:11.262699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 29 03:05:11.262699 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:11.263763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3a2ed51a-065e-436a-a299-0ce6d767f322 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:11.265041 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3a2ed51a-065e-436a-a299-0ce6d767f322 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014434 Oct 29 03:05:11.265762 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2215/4490] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 03:05:11 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:05:11.274444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-934b30dc-a070-4f2f-af41-9b3b582b211b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:11.275588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-934b30dc-a070-4f2f-af41-9b3b582b211b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:11.283532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-934b30dc-a070-4f2f-af41-9b3b582b211b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.284272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-934b30dc-a070-4f2f-af41-9b3b582b211b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.284847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-934b30dc-a070-4f2f-af41-9b3b582b211b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.285752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-934b30dc-a070-4f2f-af41-9b3b582b211b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.286644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-934b30dc-a070-4f2f-af41-9b3b582b211b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.287212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-934b30dc-a070-4f2f-af41-9b3b582b211b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.289459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:11.290459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:11.321982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.322649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.325365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.329115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.330455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.330970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.536232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.551804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.555053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.557640 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2f987be7-718d-43d8-a67f-94ad77b9612e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.279870 Oct 29 03:05:11.558249 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2216/4491] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:11 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:11.565188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b7ff32b0-166a-405d-bab6-2b31f453f8f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:11.565913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b7ff32b0-166a-405d-bab6-2b31f453f8f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:11.580471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7ff32b0-166a-405d-bab6-2b31f453f8f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.580967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7ff32b0-166a-405d-bab6-2b31f453f8f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.581401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7ff32b0-166a-405d-bab6-2b31f453f8f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.582534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7ff32b0-166a-405d-bab6-2b31f453f8f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.582997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7ff32b0-166a-405d-bab6-2b31f453f8f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.583509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7ff32b0-166a-405d-bab6-2b31f453f8f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.629226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-934b30dc-a070-4f2f-af41-9b3b582b211b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.657406 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-934b30dc-a070-4f2f-af41-9b3b582b211b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.386910 Oct 29 03:05:11.661644 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2276/4492] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:11 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:11.691831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6c06697b-8c01-461b-9f40-ced767da6af6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:11.692769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6c06697b-8c01-461b-9f40-ced767da6af6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:11.699691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c06697b-8c01-461b-9f40-ced767da6af6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.700566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c06697b-8c01-461b-9f40-ced767da6af6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.701221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c06697b-8c01-461b-9f40-ced767da6af6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.702394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c06697b-8c01-461b-9f40-ced767da6af6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.702996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c06697b-8c01-461b-9f40-ced767da6af6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.703680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c06697b-8c01-461b-9f40-ced767da6af6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.850307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b7ff32b0-166a-405d-bab6-2b31f453f8f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.859894 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b7ff32b0-166a-405d-bab6-2b31f453f8f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.300591 Oct 29 03:05:11.870019 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2217/4493] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:11 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:11.880592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0631399a-cbd7-459d-a91d-708554ee1b85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:11.881243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0631399a-cbd7-459d-a91d-708554ee1b85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:11.887731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0631399a-cbd7-459d-a91d-708554ee1b85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.892770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0631399a-cbd7-459d-a91d-708554ee1b85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.893213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0631399a-cbd7-459d-a91d-708554ee1b85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.894175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0631399a-cbd7-459d-a91d-708554ee1b85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.894834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0631399a-cbd7-459d-a91d-708554ee1b85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.895414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0631399a-cbd7-459d-a91d-708554ee1b85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.026751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6c06697b-8c01-461b-9f40-ced767da6af6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.039066 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6c06697b-8c01-461b-9f40-ced767da6af6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.352607 Oct 29 03:05:12.040555 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2277/4494] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:11 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:12.067399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21eb63a5-2653-47db-bb59-1926430c6e21 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:12.067946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-21eb63a5-2653-47db-bb59-1926430c6e21 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: bbdde912-311f-4960-a9e3-8dcfe14ecd20] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:12.080873 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-21eb63a5-2653-47db-bb59-1926430c6e21 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance bbdde912-311f-4960-a9e3-8dcfe14ecd20 could not be found. Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21eb63a5-2653-47db-bb59-1926430c6e21 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/bbdde912-311f-4960-a9e3-8dcfe14ecd20/action HTTP/1.1 Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 19 Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: {"forceDelete": {}} Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance bbdde912-311f-4960-a9e3-8dcfe14ecd20 could not be found. Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'bbdde912-311f-4960-a9e3-8dcfe14ecd20', 'body': {'forceDelete': {}}} Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbdde912-311f-4960-a9e3-8dcfe14ecd20 could not be found. Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbdde912-311f-4960-a9e3-8dcfe14ecd20 could not be found. Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:12.095569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:12.103540 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:12.103540 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:12.103540 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbdde912-311f-4960-a9e3-8dcfe14ecd20 could not be found. Oct 29 03:05:12.103540 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:12.103540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21eb63a5-2653-47db-bb59-1926430c6e21 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance bbdde912-311f-4960-a9e3-8dcfe14ecd20 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:12.103540 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-21eb63a5-2653-47db-bb59-1926430c6e21 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/bbdde912-311f-4960-a9e3-8dcfe14ecd20/action" status: 404 len: 111 microversion: 2.1 time: 0.038591 Oct 29 03:05:12.103540 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2278/4495] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:12 2022] POST /compute/v2.1/servers/bbdde912-311f-4960-a9e3-8dcfe14ecd20/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:12.108998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63a75a6c-6178-4e0d-ab4c-a612fc716ec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:12.109853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-63a75a6c-6178-4e0d-ab4c-a612fc716ec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:12.114367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0631399a-cbd7-459d-a91d-708554ee1b85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.126503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63a75a6c-6178-4e0d-ab4c-a612fc716ec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.127654 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0631399a-cbd7-459d-a91d-708554ee1b85 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1309 microversion: 2.1 time: 0.256137 Oct 29 03:05:12.128746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63a75a6c-6178-4e0d-ab4c-a612fc716ec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.129616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63a75a6c-6178-4e0d-ab4c-a612fc716ec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.132429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63a75a6c-6178-4e0d-ab4c-a612fc716ec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.133104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63a75a6c-6178-4e0d-ab4c-a612fc716ec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.133227 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2218/4496] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:11 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1309 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:12.135122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63a75a6c-6178-4e0d-ab4c-a612fc716ec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.247082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ba52f2b-6d7f-4fbd-bb9f-504d82014131 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:12.247803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9ba52f2b-6d7f-4fbd-bb9f-504d82014131 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:12.262058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ba52f2b-6d7f-4fbd-bb9f-504d82014131 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.262605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ba52f2b-6d7f-4fbd-bb9f-504d82014131 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.263121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ba52f2b-6d7f-4fbd-bb9f-504d82014131 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.264012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ba52f2b-6d7f-4fbd-bb9f-504d82014131 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.264690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ba52f2b-6d7f-4fbd-bb9f-504d82014131 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.277899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ba52f2b-6d7f-4fbd-bb9f-504d82014131 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.437385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-63a75a6c-6178-4e0d-ab4c-a612fc716ec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.453136 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-63a75a6c-6178-4e0d-ab4c-a612fc716ec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.349572 Oct 29 03:05:12.490246 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2279/4497] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:12 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:12.498282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ed0f983a-3982-4809-94d2-b2509ece50cd req-b80074c8-ba9c-4bb3-a334-53c482c96ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54089ec6-4554-46bf-a61c-4a3423ae07f4", "tag": "77df88e9-5d35-4d92-b335-b3f542c8f6cd"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:12.513178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ed0f983a-3982-4809-94d2-b2509ece50cd req-b80074c8-ba9c-4bb3-a334-53c482c96ee5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.514038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ed0f983a-3982-4809-94d2-b2509ece50cd req-b80074c8-ba9c-4bb3-a334-53c482c96ee5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.515370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ed0f983a-3982-4809-94d2-b2509ece50cd req-b80074c8-ba9c-4bb3-a334-53c482c96ee5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.531675 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ed0f983a-3982-4809-94d2-b2509ece50cd req-b80074c8-ba9c-4bb3-a334-53c482c96ee5 service nova] Creating event network-changed:77df88e9-5d35-4d92-b335-b3f542c8f6cd for instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 on n-h2-862964-4 Oct 29 03:05:12.537469 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ed0f983a-3982-4809-94d2-b2509ece50cd req-b80074c8-ba9c-4bb3-a334-53c482c96ee5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045313 Oct 29 03:05:12.538840 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2280/4498] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:12.544154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ba52f2b-6d7f-4fbd-bb9f-504d82014131 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.555809 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ba52f2b-6d7f-4fbd-bb9f-504d82014131 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.315149 Oct 29 03:05:12.557112 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2219/4499] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:12 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:12.563454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-99877cd5-a6de-48fe-a986-3fc218cf7164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:12.564409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-99877cd5-a6de-48fe-a986-3fc218cf7164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:12.571667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99877cd5-a6de-48fe-a986-3fc218cf7164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.572725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99877cd5-a6de-48fe-a986-3fc218cf7164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.573397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99877cd5-a6de-48fe-a986-3fc218cf7164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.574240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99877cd5-a6de-48fe-a986-3fc218cf7164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.574632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99877cd5-a6de-48fe-a986-3fc218cf7164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.575052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99877cd5-a6de-48fe-a986-3fc218cf7164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.586498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:12.587877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:12.596204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:12.603769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.605355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.605355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.605929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.606549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.607505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.828571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-99877cd5-a6de-48fe-a986-3fc218cf7164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.838385 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-99877cd5-a6de-48fe-a986-3fc218cf7164 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.298125 Oct 29 03:05:12.843742 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2281/4500] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:12 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:12.870682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af5e9c0c-a007-4bdb-aa99-5da9056da433 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:12.874824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-af5e9c0c-a007-4bdb-aa99-5da9056da433 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: e4634b93-2c8a-4f35-a627-fc3a9730bcb5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:12.888447 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-af5e9c0c-a007-4bdb-aa99-5da9056da433 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance e4634b93-2c8a-4f35-a627-fc3a9730bcb5 could not be found. Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af5e9c0c-a007-4bdb-aa99-5da9056da433 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/e4634b93-2c8a-4f35-a627-fc3a9730bcb5/action HTTP/1.1 Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 39 Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: {"os-getConsoleOutput": {"length": 10}} Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance e4634b93-2c8a-4f35-a627-fc3a9730bcb5 could not be found. Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'e4634b93-2c8a-4f35-a627-fc3a9730bcb5', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4634b93-2c8a-4f35-a627-fc3a9730bcb5 could not be found. Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4634b93-2c8a-4f35-a627-fc3a9730bcb5 could not be found. Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:12.901675 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:12.906148 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:12.906148 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:12.906148 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:12.906148 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:12.906148 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4634b93-2c8a-4f35-a627-fc3a9730bcb5 could not be found. Oct 29 03:05:12.906148 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:12.908372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af5e9c0c-a007-4bdb-aa99-5da9056da433 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance e4634b93-2c8a-4f35-a627-fc3a9730bcb5 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:12.909449 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-af5e9c0c-a007-4bdb-aa99-5da9056da433 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/e4634b93-2c8a-4f35-a627-fc3a9730bcb5/action" status: 404 len: 111 microversion: 2.1 time: 0.044382 Oct 29 03:05:12.910996 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2282/4501] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:12 2022] POST /compute/v2.1/servers/e4634b93-2c8a-4f35-a627-fc3a9730bcb5/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:05:12.911635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.921978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.923265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f6ce2815-c1d5-44e0-8fec-96f4cf8a169b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:12.923739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.925214 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eb2bd5f9-c06d-4541-a4c0-5dad4b558c59 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.344354 Oct 29 03:05:12.926231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f6ce2815-c1d5-44e0-8fec-96f4cf8a169b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:12.937356 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2220/4502] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:12 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:05:12.944078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ce2815-c1d5-44e0-8fec-96f4cf8a169b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.946232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ce2815-c1d5-44e0-8fec-96f4cf8a169b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.946822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ce2815-c1d5-44e0-8fec-96f4cf8a169b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.948518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ce2815-c1d5-44e0-8fec-96f4cf8a169b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.949873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ce2815-c1d5-44e0-8fec-96f4cf8a169b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.950552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ce2815-c1d5-44e0-8fec-96f4cf8a169b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.953077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d4fa7735-c961-4016-aeea-a317c4fa7530 req-ead2dd14-ccaf-4cb9-bd26-cb4742e7fa8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca", "name": "network-vif-plugged", "status": "completed", "tag": "c4d39ef5-7494-4a08-9fe1-d5182e64380a"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:12.966052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d4fa7735-c961-4016-aeea-a317c4fa7530 req-ead2dd14-ccaf-4cb9-bd26-cb4742e7fa8a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.966781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d4fa7735-c961-4016-aeea-a317c4fa7530 req-ead2dd14-ccaf-4cb9-bd26-cb4742e7fa8a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.967585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d4fa7735-c961-4016-aeea-a317c4fa7530 req-ead2dd14-ccaf-4cb9-bd26-cb4742e7fa8a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.993403 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d4fa7735-c961-4016-aeea-a317c4fa7530 req-ead2dd14-ccaf-4cb9-bd26-cb4742e7fa8a service nova] Creating event network-vif-plugged:c4d39ef5-7494-4a08-9fe1-d5182e64380a for instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca on n-h2-862964-4 Oct 29 03:05:13.005982 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d4fa7735-c961-4016-aeea-a317c4fa7530 req-ead2dd14-ccaf-4cb9-bd26-cb4742e7fa8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067048 Oct 29 03:05:13.009068 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2221/4503] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:13.026841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a16322d7-de65-4139-afd4-93204eb9cc5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:13.027740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a16322d7-de65-4139-afd4-93204eb9cc5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:13.071692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a16322d7-de65-4139-afd4-93204eb9cc5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.073076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a16322d7-de65-4139-afd4-93204eb9cc5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.073775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a16322d7-de65-4139-afd4-93204eb9cc5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.074871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a16322d7-de65-4139-afd4-93204eb9cc5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.075485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a16322d7-de65-4139-afd4-93204eb9cc5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.076334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a16322d7-de65-4139-afd4-93204eb9cc5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.361044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a16322d7-de65-4139-afd4-93204eb9cc5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:13.370897 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a16322d7-de65-4139-afd4-93204eb9cc5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.358954 Oct 29 03:05:13.371487 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2222/4504] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:13 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:13.379148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3de3f4fc-ea09-4cdc-ab19-1894b0644531 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:13.379951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3de3f4fc-ea09-4cdc-ab19-1894b0644531 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:13.389118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3de3f4fc-ea09-4cdc-ab19-1894b0644531 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.389928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3de3f4fc-ea09-4cdc-ab19-1894b0644531 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.390549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3de3f4fc-ea09-4cdc-ab19-1894b0644531 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.391805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3de3f4fc-ea09-4cdc-ab19-1894b0644531 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.392826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3de3f4fc-ea09-4cdc-ab19-1894b0644531 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.393572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3de3f4fc-ea09-4cdc-ab19-1894b0644531 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.481388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f6ce2815-c1d5-44e0-8fec-96f4cf8a169b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:13.528729 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f6ce2815-c1d5-44e0-8fec-96f4cf8a169b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.610694 Oct 29 03:05:13.534733 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2283/4505] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:12 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:13.564867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d08c2d6-5163-49a0-a80f-746d9c09e6aa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:13.565757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d08c2d6-5163-49a0-a80f-746d9c09e6aa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:13.572806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d08c2d6-5163-49a0-a80f-746d9c09e6aa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.573929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d08c2d6-5163-49a0-a80f-746d9c09e6aa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.574582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d08c2d6-5163-49a0-a80f-746d9c09e6aa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.575698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d08c2d6-5163-49a0-a80f-746d9c09e6aa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.576398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d08c2d6-5163-49a0-a80f-746d9c09e6aa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.577074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d08c2d6-5163-49a0-a80f-746d9c09e6aa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.611362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3de3f4fc-ea09-4cdc-ab19-1894b0644531 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:13.621431 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3de3f4fc-ea09-4cdc-ab19-1894b0644531 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1309 microversion: 2.1 time: 0.248446 Oct 29 03:05:13.632291 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2223/4506] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:13 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1309 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:13.632291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eed3252d-195a-4986-9059-b1c350fe1b2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:13.632291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eed3252d-195a-4986-9059-b1c350fe1b2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:13.636496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eed3252d-195a-4986-9059-b1c350fe1b2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.637127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eed3252d-195a-4986-9059-b1c350fe1b2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.637557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eed3252d-195a-4986-9059-b1c350fe1b2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.638274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eed3252d-195a-4986-9059-b1c350fe1b2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.638951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eed3252d-195a-4986-9059-b1c350fe1b2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.639360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eed3252d-195a-4986-9059-b1c350fe1b2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.805167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eed3252d-195a-4986-9059-b1c350fe1b2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:13.815274 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eed3252d-195a-4986-9059-b1c350fe1b2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.190451 Oct 29 03:05:13.828024 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2224/4507] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:13 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:13.835150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d08c2d6-5163-49a0-a80f-746d9c09e6aa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:13.847906 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d08c2d6-5163-49a0-a80f-746d9c09e6aa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.310433 Oct 29 03:05:13.849155 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2284/4508] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:13 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:13.873081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9da2212d-39b6-4b6f-a9f1-705e3613b761 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:13.874095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9da2212d-39b6-4b6f-a9f1-705e3613b761 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: b5d83a20-9698-4d5d-977d-5e646633b060] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:13.881044 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-9da2212d-39b6-4b6f-a9f1-705e3613b761 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance b5d83a20-9698-4d5d-977d-5e646633b060 could not be found. Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9da2212d-39b6-4b6f-a9f1-705e3613b761 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/b5d83a20-9698-4d5d-977d-5e646633b060 HTTP/1.1 Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance b5d83a20-9698-4d5d-977d-5e646633b060 could not be found. Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'b5d83a20-9698-4d5d-977d-5e646633b060'} Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d83a20-9698-4d5d-977d-5e646633b060 could not be found. Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d83a20-9698-4d5d-977d-5e646633b060 could not be found. Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:13.883068 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:13.889643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:13.889643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:13.889643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:13.889643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d83a20-9698-4d5d-977d-5e646633b060 could not be found. Oct 29 03:05:13.889643 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:13.889643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9da2212d-39b6-4b6f-a9f1-705e3613b761 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance b5d83a20-9698-4d5d-977d-5e646633b060 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:13.889643 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9da2212d-39b6-4b6f-a9f1-705e3613b761 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/b5d83a20-9698-4d5d-977d-5e646633b060" status: 404 len: 111 microversion: 2.1 time: 0.018000 Oct 29 03:05:13.889643 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2225/4509] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:13 2022] GET /compute/v2.1/servers/b5d83a20-9698-4d5d-977d-5e646633b060 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:05:13.899825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-54005cf3-c516-47d4-95ab-d65d6435c01a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:13.900699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-54005cf3-c516-47d4-95ab-d65d6435c01a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:13.913580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54005cf3-c516-47d4-95ab-d65d6435c01a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.914537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54005cf3-c516-47d4-95ab-d65d6435c01a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.915240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54005cf3-c516-47d4-95ab-d65d6435c01a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.916345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54005cf3-c516-47d4-95ab-d65d6435c01a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.919993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54005cf3-c516-47d4-95ab-d65d6435c01a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.921069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-54005cf3-c516-47d4-95ab-d65d6435c01a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.958424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:13.959033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:13.966736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.967286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.967717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.968413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.968857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.969277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.137698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:14.142160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.151205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.152936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.154837 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e7ee6617-e285-4acc-8588-f4a2c477d929 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.200469 Oct 29 03:05:14.156022 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2226/4510] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:13 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:14.175143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-54005cf3-c516-47d4-95ab-d65d6435c01a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.185091 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-54005cf3-c516-47d4-95ab-d65d6435c01a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.290265 Oct 29 03:05:14.186459 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2285/4511] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:13 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:14.212426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9fd6136-2d3c-4e5e-8fe5-3818a7cebefa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:14.213068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f9fd6136-2d3c-4e5e-8fe5-3818a7cebefa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:14.221278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9fd6136-2d3c-4e5e-8fe5-3818a7cebefa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.221771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9fd6136-2d3c-4e5e-8fe5-3818a7cebefa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.222223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9fd6136-2d3c-4e5e-8fe5-3818a7cebefa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.222915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9fd6136-2d3c-4e5e-8fe5-3818a7cebefa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.223362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9fd6136-2d3c-4e5e-8fe5-3818a7cebefa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.223767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9fd6136-2d3c-4e5e-8fe5-3818a7cebefa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.384578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f9fd6136-2d3c-4e5e-8fe5-3818a7cebefa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.392573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:14.396414 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f9fd6136-2d3c-4e5e-8fe5-3818a7cebefa tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.188588 Oct 29 03:05:14.397782 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2227/4512] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:14 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:14.557600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bff3ecdc-18d6-411f-8725-829abe5c433b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-283293384", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:14.567545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7220601b-d81b-4590-82a3-b33b2de9798e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:14.568159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7220601b-d81b-4590-82a3-b33b2de9798e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:14.574782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7220601b-d81b-4590-82a3-b33b2de9798e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.575285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7220601b-d81b-4590-82a3-b33b2de9798e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.575709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7220601b-d81b-4590-82a3-b33b2de9798e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.576426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7220601b-d81b-4590-82a3-b33b2de9798e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.576868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7220601b-d81b-4590-82a3-b33b2de9798e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.577277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7220601b-d81b-4590-82a3-b33b2de9798e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bff3ecdc-18d6-411f-8725-829abe5c433b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 237 Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-283293384", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-283293384', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:14.582310 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 03:05:14.587198 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:14.590206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bff3ecdc-18d6-411f-8725-829abe5c433b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:14.590206 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bff3ecdc-18d6-411f-8725-829abe5c433b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.039681 Oct 29 03:05:14.593578 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2286/4513] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:05:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:05:14.601561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9143e2ed-c23b-40ac-8828-0772927409b6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:14.602278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9143e2ed-c23b-40ac-8828-0772927409b6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:14.612083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9143e2ed-c23b-40ac-8828-0772927409b6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.612943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9143e2ed-c23b-40ac-8828-0772927409b6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.613744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9143e2ed-c23b-40ac-8828-0772927409b6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.614772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9143e2ed-c23b-40ac-8828-0772927409b6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.615443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9143e2ed-c23b-40ac-8828-0772927409b6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.616077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9143e2ed-c23b-40ac-8828-0772927409b6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.765402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7220601b-d81b-4590-82a3-b33b2de9798e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.781370 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7220601b-d81b-4590-82a3-b33b2de9798e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.223373 Oct 29 03:05:14.799470 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2228/4514] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:14 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:14.809767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce19a6a5-fa6b-4612-aba9-2092aa94d35c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:14.812097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce19a6a5-fa6b-4612-aba9-2092aa94d35c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:14.820011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce19a6a5-fa6b-4612-aba9-2092aa94d35c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.820698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce19a6a5-fa6b-4612-aba9-2092aa94d35c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.821297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce19a6a5-fa6b-4612-aba9-2092aa94d35c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.822205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce19a6a5-fa6b-4612-aba9-2092aa94d35c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.822813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce19a6a5-fa6b-4612-aba9-2092aa94d35c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.823880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce19a6a5-fa6b-4612-aba9-2092aa94d35c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.895175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9143e2ed-c23b-40ac-8828-0772927409b6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.907396 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9143e2ed-c23b-40ac-8828-0772927409b6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.309841 Oct 29 03:05:14.908681 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2287/4515] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:14 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:14.913968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51bdc72e-e11a-4afc-b893-d311c09975b5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:14.914835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-51bdc72e-e11a-4afc-b893-d311c09975b5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:14.922160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51bdc72e-e11a-4afc-b893-d311c09975b5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.922955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51bdc72e-e11a-4afc-b893-d311c09975b5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.923571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51bdc72e-e11a-4afc-b893-d311c09975b5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.927037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51bdc72e-e11a-4afc-b893-d311c09975b5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.927901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51bdc72e-e11a-4afc-b893-d311c09975b5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.928637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51bdc72e-e11a-4afc-b893-d311c09975b5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.101083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=24 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:15.151205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-51bdc72e-e11a-4afc-b893-d311c09975b5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:15.162702 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-51bdc72e-e11a-4afc-b893-d311c09975b5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.252039 Oct 29 03:05:15.175940 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2288/4516] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:14 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:15.175940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-479015c2-d653-4cec-a294-70cb482126c1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:15.175940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-479015c2-d653-4cec-a294-70cb482126c1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:15.190125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-479015c2-d653-4cec-a294-70cb482126c1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.190451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-479015c2-d653-4cec-a294-70cb482126c1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.191599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-479015c2-d653-4cec-a294-70cb482126c1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.193526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce19a6a5-fa6b-4612-aba9-2092aa94d35c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:15.194003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-479015c2-d653-4cec-a294-70cb482126c1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.194764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-479015c2-d653-4cec-a294-70cb482126c1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.195420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-479015c2-d653-4cec-a294-70cb482126c1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.202518 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce19a6a5-fa6b-4612-aba9-2092aa94d35c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1309 microversion: 2.1 time: 0.401519 Oct 29 03:05:15.218886 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2229/4517] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:14 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1309 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:15.224389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-63ccd50d-37fe-4599-bf0f-1bf7060c24d9 req-6e0b1482-db6a-45b6-aa2d-3d25fd8d57b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45eae659-6555-45bd-bfce-6dad956e267a", "name": "network-vif-plugged", "status": "completed", "tag": "1fd7951b-046c-41bc-bf9f-e0127b2c9575"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:15.236732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-63ccd50d-37fe-4599-bf0f-1bf7060c24d9 req-6e0b1482-db6a-45b6-aa2d-3d25fd8d57b3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.237745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-63ccd50d-37fe-4599-bf0f-1bf7060c24d9 req-6e0b1482-db6a-45b6-aa2d-3d25fd8d57b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.237745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-63ccd50d-37fe-4599-bf0f-1bf7060c24d9 req-6e0b1482-db6a-45b6-aa2d-3d25fd8d57b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.261293 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-63ccd50d-37fe-4599-bf0f-1bf7060c24d9 req-6e0b1482-db6a-45b6-aa2d-3d25fd8d57b3 service nova] Creating event network-vif-plugged:1fd7951b-046c-41bc-bf9f-e0127b2c9575 for instance 45eae659-6555-45bd-bfce-6dad956e267a on n-h1-862964-4 Oct 29 03:05:15.267422 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-63ccd50d-37fe-4599-bf0f-1bf7060c24d9 req-6e0b1482-db6a-45b6-aa2d-3d25fd8d57b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047151 Oct 29 03:05:15.268573 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2230/4518] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:15.278102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:15.280150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:15.289701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.291046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.291046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.292678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.295362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.296077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.498124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-479015c2-d653-4cec-a294-70cb482126c1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:15.510683 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-479015c2-d653-4cec-a294-70cb482126c1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.344636 Oct 29 03:05:15.510868 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2289/4519] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:15 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:15.604402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98a720bf-05f6-4eff-b1fc-0e68b3002af8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1725005268", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98a720bf-05f6-4eff-b1fc-0e68b3002af8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 235 Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1725005268", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1725005268', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:15.609139 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98a720bf-05f6-4eff-b1fc-0e68b3002af8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-98a720bf-05f6-4eff-b1fc-0e68b3002af8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.010787 Oct 29 03:05:15.613081 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2290/4520] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:05:15 2022] POST /compute/v2.1/servers => generated 133 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:05:15.621956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d9e4e4a-74f1-4580-9940-9e4687e95393 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:15.622658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d9e4e4a-74f1-4580-9940-9e4687e95393 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:15.635242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e4a-74f1-4580-9940-9e4687e95393 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.635753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e4a-74f1-4580-9940-9e4687e95393 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.636317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e4a-74f1-4580-9940-9e4687e95393 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.637067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e4a-74f1-4580-9940-9e4687e95393 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.637526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e4a-74f1-4580-9940-9e4687e95393 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.638135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e4a-74f1-4580-9940-9e4687e95393 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.836257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d9e4e4a-74f1-4580-9940-9e4687e95393 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:15.849153 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d9e4e4a-74f1-4580-9940-9e4687e95393 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.232729 Oct 29 03:05:15.851364 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2291/4521] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:15 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:15.859414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f54f1ca-6fa1-4857-bba1-1e2e9c1819ca tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:15.860272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0f54f1ca-6fa1-4857-bba1-1e2e9c1819ca tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:15.869121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f54f1ca-6fa1-4857-bba1-1e2e9c1819ca tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.869892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f54f1ca-6fa1-4857-bba1-1e2e9c1819ca tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.872941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f54f1ca-6fa1-4857-bba1-1e2e9c1819ca tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.873824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f54f1ca-6fa1-4857-bba1-1e2e9c1819ca tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.874990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f54f1ca-6fa1-4857-bba1-1e2e9c1819ca tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.875526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f54f1ca-6fa1-4857-bba1-1e2e9c1819ca tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.118655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:16.138832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:16.140609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:16.142254 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-736002d3-62f7-44b1-9e26-3de51b30795b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.871736 Oct 29 03:05:16.142934 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2231/4522] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:15 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:16.149769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-07de3096-4295-4c51-916a-d4343b011bf8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:16.166570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-07de3096-4295-4c51-916a-d4343b011bf8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:16.196868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07de3096-4295-4c51-916a-d4343b011bf8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.196868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07de3096-4295-4c51-916a-d4343b011bf8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.196868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07de3096-4295-4c51-916a-d4343b011bf8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.196868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07de3096-4295-4c51-916a-d4343b011bf8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.196868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07de3096-4295-4c51-916a-d4343b011bf8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.196868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-07de3096-4295-4c51-916a-d4343b011bf8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.475822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-07de3096-4295-4c51-916a-d4343b011bf8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:16.487998 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-07de3096-4295-4c51-916a-d4343b011bf8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.342592 Oct 29 03:05:16.490120 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2232/4523] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:16 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:16.496818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-adaac2c3-867a-447d-ad4b-f27ceff41d89 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:16.497841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-adaac2c3-867a-447d-ad4b-f27ceff41d89 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:16.506760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adaac2c3-867a-447d-ad4b-f27ceff41d89 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.520923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adaac2c3-867a-447d-ad4b-f27ceff41d89 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.522200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adaac2c3-867a-447d-ad4b-f27ceff41d89 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.523578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adaac2c3-867a-447d-ad4b-f27ceff41d89 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.526024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adaac2c3-867a-447d-ad4b-f27ceff41d89 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.527551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adaac2c3-867a-447d-ad4b-f27ceff41d89 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.607935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f54f1ca-6fa1-4857-bba1-1e2e9c1819ca tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:16.617970 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f54f1ca-6fa1-4857-bba1-1e2e9c1819ca tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.764087 Oct 29 03:05:16.619408 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2292/4524] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:15 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:16.624737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-411983d6-7d5c-4ae5-a7a2-cc02dd127fad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:16.625605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-411983d6-7d5c-4ae5-a7a2-cc02dd127fad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:16.635126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-411983d6-7d5c-4ae5-a7a2-cc02dd127fad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.635852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-411983d6-7d5c-4ae5-a7a2-cc02dd127fad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.636459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-411983d6-7d5c-4ae5-a7a2-cc02dd127fad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.637333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-411983d6-7d5c-4ae5-a7a2-cc02dd127fad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.637964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-411983d6-7d5c-4ae5-a7a2-cc02dd127fad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.639327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-411983d6-7d5c-4ae5-a7a2-cc02dd127fad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.877137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-411983d6-7d5c-4ae5-a7a2-cc02dd127fad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:16.887422 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-411983d6-7d5c-4ae5-a7a2-cc02dd127fad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1309 microversion: 2.1 time: 0.266792 Oct 29 03:05:16.888562 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2293/4525] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:16 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1309 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:16.894279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6b886530-b9cd-4a64-bc9e-0d210c33e70d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:16.894993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6b886530-b9cd-4a64-bc9e-0d210c33e70d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: cc86e433-0e9b-4197-9cae-0c285ef99b91] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:16.903057 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-6b886530-b9cd-4a64-bc9e-0d210c33e70d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance cc86e433-0e9b-4197-9cae-0c285ef99b91 could not be found. Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6b886530-b9cd-4a64-bc9e-0d210c33e70d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/cc86e433-0e9b-4197-9cae-0c285ef99b91/action HTTP/1.1 Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 13 Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: {"pause": {}} Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance cc86e433-0e9b-4197-9cae-0c285ef99b91 could not be found. Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cc86e433-0e9b-4197-9cae-0c285ef99b91', 'body': {'pause': {}}} Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc86e433-0e9b-4197-9cae-0c285ef99b91 could not be found. Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc86e433-0e9b-4197-9cae-0c285ef99b91 could not be found. Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:16.910625 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:16.915336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:16.915336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:16.915336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc86e433-0e9b-4197-9cae-0c285ef99b91 could not be found. Oct 29 03:05:16.915336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:16.917556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6b886530-b9cd-4a64-bc9e-0d210c33e70d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance cc86e433-0e9b-4197-9cae-0c285ef99b91 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:16.924195 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6b886530-b9cd-4a64-bc9e-0d210c33e70d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/cc86e433-0e9b-4197-9cae-0c285ef99b91/action" status: 404 len: 111 microversion: 2.1 time: 0.034057 Oct 29 03:05:16.925074 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2294/4526] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:16 2022] POST /compute/v2.1/servers/cc86e433-0e9b-4197-9cae-0c285ef99b91/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:16.935041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-afa11014-3389-4e1d-ab14-2c042ce750f3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:16.936081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-afa11014-3389-4e1d-ab14-2c042ce750f3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:16.937297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-adaac2c3-867a-447d-ad4b-f27ceff41d89 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:16.944798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa11014-3389-4e1d-ab14-2c042ce750f3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.945497 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-adaac2c3-867a-447d-ad4b-f27ceff41d89 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.453900 Oct 29 03:05:16.945933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa11014-3389-4e1d-ab14-2c042ce750f3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.946122 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2233/4527] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:16 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:16.946650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa11014-3389-4e1d-ab14-2c042ce750f3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.947995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa11014-3389-4e1d-ab14-2c042ce750f3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.948593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa11014-3389-4e1d-ab14-2c042ce750f3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.949319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afa11014-3389-4e1d-ab14-2c042ce750f3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.160291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-afa11014-3389-4e1d-ab14-2c042ce750f3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.174455 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-afa11014-3389-4e1d-ab14-2c042ce750f3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.243612 Oct 29 03:05:17.175097 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2295/4528] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:16 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:17.176257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:17.177349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:17.187176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.187910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.188757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.189693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.196675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.197461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.199675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb39fd88-1b07-4e98-a2b3-aad783236c4c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:17.200471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fb39fd88-1b07-4e98-a2b3-aad783236c4c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:17.208162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb39fd88-1b07-4e98-a2b3-aad783236c4c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.208876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb39fd88-1b07-4e98-a2b3-aad783236c4c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.209467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb39fd88-1b07-4e98-a2b3-aad783236c4c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.210393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb39fd88-1b07-4e98-a2b3-aad783236c4c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.211176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb39fd88-1b07-4e98-a2b3-aad783236c4c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.211750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb39fd88-1b07-4e98-a2b3-aad783236c4c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.387591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fb39fd88-1b07-4e98-a2b3-aad783236c4c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.403960 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fb39fd88-1b07-4e98-a2b3-aad783236c4c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.203553 Oct 29 03:05:17.417834 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2296/4529] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:17 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:17.417834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9b1e6e79-440d-481b-a102-4c2d1ce62163 req-acc55fed-7f6f-4127-ab9c-25318b566af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92775b76-1fb7-497b-9f2c-5b9e682f8b2c", "name": "network-vif-plugged", "status": "completed", "tag": "e58c37a1-df9d-443f-a284-b47d6c3e85d1"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:17.427817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9b1e6e79-440d-481b-a102-4c2d1ce62163 req-acc55fed-7f6f-4127-ab9c-25318b566af2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.428307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9b1e6e79-440d-481b-a102-4c2d1ce62163 req-acc55fed-7f6f-4127-ab9c-25318b566af2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.428738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9b1e6e79-440d-481b-a102-4c2d1ce62163 req-acc55fed-7f6f-4127-ab9c-25318b566af2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.458470 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9b1e6e79-440d-481b-a102-4c2d1ce62163 req-acc55fed-7f6f-4127-ab9c-25318b566af2 service nova] Creating event network-vif-plugged:e58c37a1-df9d-443f-a284-b47d6c3e85d1 for instance 92775b76-1fb7-497b-9f2c-5b9e682f8b2c on n-h2-862964-4 Oct 29 03:05:17.464305 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9b1e6e79-440d-481b-a102-4c2d1ce62163 req-acc55fed-7f6f-4127-ab9c-25318b566af2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050930 Oct 29 03:05:17.464928 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2297/4530] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:17.478181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21e4fb5b-2dac-4420-acce-c0203ec14e52 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:17.478862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-21e4fb5b-2dac-4420-acce-c0203ec14e52 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:17.491008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21e4fb5b-2dac-4420-acce-c0203ec14e52 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.492041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21e4fb5b-2dac-4420-acce-c0203ec14e52 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.493488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21e4fb5b-2dac-4420-acce-c0203ec14e52 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.494473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21e4fb5b-2dac-4420-acce-c0203ec14e52 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.495203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21e4fb5b-2dac-4420-acce-c0203ec14e52 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.508538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21e4fb5b-2dac-4420-acce-c0203ec14e52 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.523394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.535570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.537080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.538319 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cc7e8d6c-3d8d-4a0c-afa7-a40a71acf191 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.369109 Oct 29 03:05:17.538887 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2234/4531] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:17 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:17.615425 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-21e4fb5b-2dac-4420-acce-c0203ec14e52 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 202 len: 0 microversion: 2.1 time: 0.147450 Oct 29 03:05:17.617240 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2298/4532] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:17 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:05:17.626308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a430c15d-9955-449e-b0ea-b5e0e687d70f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:17.627292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a430c15d-9955-449e-b0ea-b5e0e687d70f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:17.636059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a430c15d-9955-449e-b0ea-b5e0e687d70f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.639941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a430c15d-9955-449e-b0ea-b5e0e687d70f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.648761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a430c15d-9955-449e-b0ea-b5e0e687d70f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.649888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a430c15d-9955-449e-b0ea-b5e0e687d70f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.652383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a430c15d-9955-449e-b0ea-b5e0e687d70f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.666419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a430c15d-9955-449e-b0ea-b5e0e687d70f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.666641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0ff6314f-72ff-4989-8a4c-e462dfb50e3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:17.667606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0ff6314f-72ff-4989-8a4c-e462dfb50e3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:17.681827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ff6314f-72ff-4989-8a4c-e462dfb50e3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.682319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ff6314f-72ff-4989-8a4c-e462dfb50e3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.687178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ff6314f-72ff-4989-8a4c-e462dfb50e3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.689411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ff6314f-72ff-4989-8a4c-e462dfb50e3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.692011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ff6314f-72ff-4989-8a4c-e462dfb50e3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.692669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ff6314f-72ff-4989-8a4c-e462dfb50e3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.942345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0ff6314f-72ff-4989-8a4c-e462dfb50e3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.952608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a430c15d-9955-449e-b0ea-b5e0e687d70f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.952875 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0ff6314f-72ff-4989-8a4c-e462dfb50e3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.310436 Oct 29 03:05:17.954389 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2299/4533] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:17 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:17.961288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bfd5bbee-1cb0-4485-8d0a-e919b8c8525b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:17.962281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bfd5bbee-1cb0-4485-8d0a-e919b8c8525b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:17.965525 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a430c15d-9955-449e-b0ea-b5e0e687d70f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1511 microversion: 2.1 time: 0.343482 Oct 29 03:05:17.967537 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2235/4534] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:17 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:17.978868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfd5bbee-1cb0-4485-8d0a-e919b8c8525b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.979643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfd5bbee-1cb0-4485-8d0a-e919b8c8525b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.980452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfd5bbee-1cb0-4485-8d0a-e919b8c8525b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.981349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfd5bbee-1cb0-4485-8d0a-e919b8c8525b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.982205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfd5bbee-1cb0-4485-8d0a-e919b8c8525b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.983063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bfd5bbee-1cb0-4485-8d0a-e919b8c8525b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.983805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25b17ec3-e37e-42f4-a414-e201093d6b7d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:17.988007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25b17ec3-e37e-42f4-a414-e201093d6b7d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:18.002197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25b17ec3-e37e-42f4-a414-e201093d6b7d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:18.006437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25b17ec3-e37e-42f4-a414-e201093d6b7d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:18.007093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25b17ec3-e37e-42f4-a414-e201093d6b7d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:18.008500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25b17ec3-e37e-42f4-a414-e201093d6b7d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:18.008605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25b17ec3-e37e-42f4-a414-e201093d6b7d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:18.008990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25b17ec3-e37e-42f4-a414-e201093d6b7d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:18.215795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bfd5bbee-1cb0-4485-8d0a-e919b8c8525b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:18.232812 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bfd5bbee-1cb0-4485-8d0a-e919b8c8525b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1309 microversion: 2.1 time: 0.276578 Oct 29 03:05:18.234098 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2300/4535] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:17 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:18.305736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25b17ec3-e37e-42f4-a414-e201093d6b7d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:18.314306 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25b17ec3-e37e-42f4-a414-e201093d6b7d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.345476 Oct 29 03:05:18.321683 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2236/4536] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:17 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:18.568078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:18.568818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:18.575585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:18.576082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:18.576554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:18.577586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:18.578090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:18.578518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:18.808781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:18.813560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:18.822465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:18.824516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:18.825911 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-234adb55-7ee3-4f6b-9176-8f67de349045 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1745 microversion: 2.20 time: 0.261939 Oct 29 03:05:18.838450 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2301/4537] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:18 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1745 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:18.979082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac83a15a-2bab-473f-b71a-8124e60ba41f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:18.980245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac83a15a-2bab-473f-b71a-8124e60ba41f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:18.997194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac83a15a-2bab-473f-b71a-8124e60ba41f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:18.997692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac83a15a-2bab-473f-b71a-8124e60ba41f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:18.998212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac83a15a-2bab-473f-b71a-8124e60ba41f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.000535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0d7e1073-5480-4fd2-bc4d-86a5bebb98d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:19.002370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0d7e1073-5480-4fd2-bc4d-86a5bebb98d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:19.003909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac83a15a-2bab-473f-b71a-8124e60ba41f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.004399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac83a15a-2bab-473f-b71a-8124e60ba41f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.004837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac83a15a-2bab-473f-b71a-8124e60ba41f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.015429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d7e1073-5480-4fd2-bc4d-86a5bebb98d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.016281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d7e1073-5480-4fd2-bc4d-86a5bebb98d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.017341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d7e1073-5480-4fd2-bc4d-86a5bebb98d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.018397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d7e1073-5480-4fd2-bc4d-86a5bebb98d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.019062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d7e1073-5480-4fd2-bc4d-86a5bebb98d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.019741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d7e1073-5480-4fd2-bc4d-86a5bebb98d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.302145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac83a15a-2bab-473f-b71a-8124e60ba41f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:19.312778 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac83a15a-2bab-473f-b71a-8124e60ba41f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.338808 Oct 29 03:05:19.327243 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2237/4538] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:18 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:19.333291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0d7e1073-5480-4fd2-bc4d-86a5bebb98d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:19.339278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-05a834d6-8069-49c2-8bf1-c12a6ff9abb1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:19.339957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-05a834d6-8069-49c2-8bf1-c12a6ff9abb1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:19.349349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a834d6-8069-49c2-8bf1-c12a6ff9abb1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.349583 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0d7e1073-5480-4fd2-bc4d-86a5bebb98d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1491 microversion: 2.1 time: 0.360401 Oct 29 03:05:19.349886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a834d6-8069-49c2-8bf1-c12a6ff9abb1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.350368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a834d6-8069-49c2-8bf1-c12a6ff9abb1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.351085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a834d6-8069-49c2-8bf1-c12a6ff9abb1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.351541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a834d6-8069-49c2-8bf1-c12a6ff9abb1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.351959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a834d6-8069-49c2-8bf1-c12a6ff9abb1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.358664 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2302/4539] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:18 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1491 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:19.370102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8cde6d21-196f-4e98-a87c-58c60d2938d0 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:19.370800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8cde6d21-196f-4e98-a87c-58c60d2938d0 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:19.382960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cde6d21-196f-4e98-a87c-58c60d2938d0 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.383453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cde6d21-196f-4e98-a87c-58c60d2938d0 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.384056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cde6d21-196f-4e98-a87c-58c60d2938d0 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.384771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cde6d21-196f-4e98-a87c-58c60d2938d0 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.385215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cde6d21-196f-4e98-a87c-58c60d2938d0 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.385633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cde6d21-196f-4e98-a87c-58c60d2938d0 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.600376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-05a834d6-8069-49c2-8bf1-c12a6ff9abb1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:19.624574 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-05a834d6-8069-49c2-8bf1-c12a6ff9abb1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1309 microversion: 2.1 time: 0.295404 Oct 29 03:05:19.625491 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2238/4540] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:19 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:19.639156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:19.641871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:19.655439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.656206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.656916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.658532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.662444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.663414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.698260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8cde6d21-196f-4e98-a87c-58c60d2938d0 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:19.711263 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8cde6d21-196f-4e98-a87c-58c60d2938d0 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1322 microversion: 2.1 time: 0.351388 Oct 29 03:05:19.712306 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2303/4541] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:19 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:19.716817 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Cannot 'pause' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state paused Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action HTTP/1.1 Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 13 Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: {"pause": {}} Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: exception: Cannot 'pause' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state paused Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2bbab455-c481-40ea-a59c-4ec9c15d935e', 'body': {'pause': {}}} Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e in vm_state paused. Cannot pause while the instance is in this state. Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state paused Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:19.718804 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:19.722441 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:19.722441 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:19.722441 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:19.722441 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state paused Oct 29 03:05:19.722441 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:19.722737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-574bbc23-9bed-405b-998b-9e628913e0ee req-2df9d4dc-aaa9-4ae3-8094-adaf3b05128b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54089ec6-4554-46bf-a61c-4a3423ae07f4", "name": "network-vif-plugged", "status": "completed", "tag": "77df88e9-5d35-4d92-b335-b3f542c8f6cd"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:19.726813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 409 to user: Cannot 'pause' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state paused {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:19.728118 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-47de850c-d242-4242-9cc2-7ec9a7698515 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 409 len: 143 microversion: 2.1 time: 0.101428 Oct 29 03:05:19.728709 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2239/4542] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:19 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 143 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:05:19.737081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-84d8da7f-3c3b-47a3-baf4-77db9db35dcd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:19.737605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-84d8da7f-3c3b-47a3-baf4-77db9db35dcd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:19.746463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84d8da7f-3c3b-47a3-baf4-77db9db35dcd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.747059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-574bbc23-9bed-405b-998b-9e628913e0ee req-2df9d4dc-aaa9-4ae3-8094-adaf3b05128b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.747541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-574bbc23-9bed-405b-998b-9e628913e0ee req-2df9d4dc-aaa9-4ae3-8094-adaf3b05128b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.747685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84d8da7f-3c3b-47a3-baf4-77db9db35dcd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.747968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-574bbc23-9bed-405b-998b-9e628913e0ee req-2df9d4dc-aaa9-4ae3-8094-adaf3b05128b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.749838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84d8da7f-3c3b-47a3-baf4-77db9db35dcd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.750591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84d8da7f-3c3b-47a3-baf4-77db9db35dcd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.751080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84d8da7f-3c3b-47a3-baf4-77db9db35dcd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.752649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84d8da7f-3c3b-47a3-baf4-77db9db35dcd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.798858 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-574bbc23-9bed-405b-998b-9e628913e0ee req-2df9d4dc-aaa9-4ae3-8094-adaf3b05128b service nova] Creating event network-vif-plugged:77df88e9-5d35-4d92-b335-b3f542c8f6cd for instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 on n-h2-862964-4 Oct 29 03:05:19.808018 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-574bbc23-9bed-405b-998b-9e628913e0ee req-2df9d4dc-aaa9-4ae3-8094-adaf3b05128b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093252 Oct 29 03:05:19.808291 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2304/4543] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:19.853478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:19.854377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:19.872446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.872930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.873836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.874915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.875814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.876248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.887278 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-84d8da7f-3c3b-47a3-baf4-77db9db35dcd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 202 len: 0 microversion: 2.1 time: 0.153579 Oct 29 03:05:19.889767 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2240/4544] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:19 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:05:19.900835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3b0e4e7-324b-4293-87b1-035def5b944f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:19.901510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a3b0e4e7-324b-4293-87b1-035def5b944f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:19.909413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b0e4e7-324b-4293-87b1-035def5b944f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.910012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b0e4e7-324b-4293-87b1-035def5b944f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.910431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b0e4e7-324b-4293-87b1-035def5b944f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.911131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b0e4e7-324b-4293-87b1-035def5b944f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.911571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b0e4e7-324b-4293-87b1-035def5b944f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.911998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3b0e4e7-324b-4293-87b1-035def5b944f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:20.143991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3b0e4e7-324b-4293-87b1-035def5b944f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:20.160406 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3b0e4e7-324b-4293-87b1-035def5b944f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1498 microversion: 2.1 time: 0.265476 Oct 29 03:05:20.161500 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2241/4545] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:19 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1498 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:20.218396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:20.234412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:20.236171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:20.237417 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-001c8ee5-417c-40af-8f29-e78265947dd4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1745 microversion: 2.20 time: 0.388576 Oct 29 03:05:20.268108 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2305/4546] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:19 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1745 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:05:20.341205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c2404deb-204b-4483-90b5-f62679574261 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:20.342038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c2404deb-204b-4483-90b5-f62679574261 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:20.351290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2404deb-204b-4483-90b5-f62679574261 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:20.351935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2404deb-204b-4483-90b5-f62679574261 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:20.352795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2404deb-204b-4483-90b5-f62679574261 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:20.353265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2404deb-204b-4483-90b5-f62679574261 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:20.353923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2404deb-204b-4483-90b5-f62679574261 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:20.354349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2404deb-204b-4483-90b5-f62679574261 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:20.546468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c2404deb-204b-4483-90b5-f62679574261 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:20.560489 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c2404deb-204b-4483-90b5-f62679574261 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.221381 Oct 29 03:05:20.565746 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2242/4547] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:20 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:20.652191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-197a8f2b-ba10-4ed4-9907-ce80eba5ac1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:20.653121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-197a8f2b-ba10-4ed4-9907-ce80eba5ac1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:20.661978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-197a8f2b-ba10-4ed4-9907-ce80eba5ac1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:20.662754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-197a8f2b-ba10-4ed4-9907-ce80eba5ac1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:20.663362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-197a8f2b-ba10-4ed4-9907-ce80eba5ac1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:20.664382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-197a8f2b-ba10-4ed4-9907-ce80eba5ac1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:20.665035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-197a8f2b-ba10-4ed4-9907-ce80eba5ac1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:20.665603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-197a8f2b-ba10-4ed4-9907-ce80eba5ac1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:20.736296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fa251508-41b1-4721-9653-5b65bd3edda2 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:20.737152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fa251508-41b1-4721-9653-5b65bd3edda2 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:20.746740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa251508-41b1-4721-9653-5b65bd3edda2 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:20.746740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa251508-41b1-4721-9653-5b65bd3edda2 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:20.747202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa251508-41b1-4721-9653-5b65bd3edda2 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:20.751005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa251508-41b1-4721-9653-5b65bd3edda2 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:20.753576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa251508-41b1-4721-9653-5b65bd3edda2 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:20.754833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa251508-41b1-4721-9653-5b65bd3edda2 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.030294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-197a8f2b-ba10-4ed4-9907-ce80eba5ac1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:21.040099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fa251508-41b1-4721-9653-5b65bd3edda2 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:21.046743 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-197a8f2b-ba10-4ed4-9907-ce80eba5ac1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1309 microversion: 2.1 time: 0.397993 Oct 29 03:05:21.047363 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2306/4548] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:20 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1309 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:21.052686 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fa251508-41b1-4721-9653-5b65bd3edda2 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1516 microversion: 2.1 time: 0.321825 Oct 29 03:05:21.056864 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2243/4549] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:20 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1516 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:21.080288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cc465c03-0d26-4059-9246-3537ec7299a9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:21.081137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cc465c03-0d26-4059-9246-3537ec7299a9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 45eae659-6555-45bd-bfce-6dad956e267a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:21.094704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc465c03-0d26-4059-9246-3537ec7299a9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.095371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc465c03-0d26-4059-9246-3537ec7299a9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.095981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc465c03-0d26-4059-9246-3537ec7299a9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.096983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc465c03-0d26-4059-9246-3537ec7299a9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.097593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc465c03-0d26-4059-9246-3537ec7299a9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.098207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc465c03-0d26-4059-9246-3537ec7299a9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.184515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3521e8cb-8102-445e-8338-361c3b0826f5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:21.185298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3521e8cb-8102-445e-8338-361c3b0826f5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:21.193211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3521e8cb-8102-445e-8338-361c3b0826f5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.193695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3521e8cb-8102-445e-8338-361c3b0826f5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.194147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3521e8cb-8102-445e-8338-361c3b0826f5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.194876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3521e8cb-8102-445e-8338-361c3b0826f5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.195316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3521e8cb-8102-445e-8338-361c3b0826f5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.195729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3521e8cb-8102-445e-8338-361c3b0826f5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.245608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:21.458923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3521e8cb-8102-445e-8338-361c3b0826f5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:21.470471 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3521e8cb-8102-445e-8338-361c3b0826f5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.287979 Oct 29 03:05:21.471536 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2244/4550] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:21 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:21.480166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:21.483948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:21.497765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.498806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.499414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.500305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.500956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.502378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.575107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cc465c03-0d26-4059-9246-3537ec7299a9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:21.594083 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cc465c03-0d26-4059-9246-3537ec7299a9 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a" status: 200 len: 1515 microversion: 2.1 time: 0.517106 Oct 29 03:05:21.596825 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2307/4551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:21 2022] GET /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a => generated 1515 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:21.603115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-26a706ab-73ea-4411-a6a0-08da2cd7b25c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:21.604303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-26a706ab-73ea-4411-a6a0-08da2cd7b25c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:21.613584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a706ab-73ea-4411-a6a0-08da2cd7b25c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.614820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a706ab-73ea-4411-a6a0-08da2cd7b25c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.616549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a706ab-73ea-4411-a6a0-08da2cd7b25c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.617493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a706ab-73ea-4411-a6a0-08da2cd7b25c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.618461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a706ab-73ea-4411-a6a0-08da2cd7b25c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.620352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a706ab-73ea-4411-a6a0-08da2cd7b25c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.787219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:21.797747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:21.799214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:21.800831 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4c92fcd2-b6de-4fcd-af21-a5a8fbde2c78 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.324869 Oct 29 03:05:21.801362 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2245/4552] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:21 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:21.806247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8423099f-dbdf-4fe8-b358-640ab589feda tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:21.806850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8423099f-dbdf-4fe8-b358-640ab589feda tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:21.812907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8423099f-dbdf-4fe8-b358-640ab589feda tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.813390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8423099f-dbdf-4fe8-b358-640ab589feda tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.813852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8423099f-dbdf-4fe8-b358-640ab589feda tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.814550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8423099f-dbdf-4fe8-b358-640ab589feda tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.814985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8423099f-dbdf-4fe8-b358-640ab589feda tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.815909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8423099f-dbdf-4fe8-b358-640ab589feda tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.973707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-26a706ab-73ea-4411-a6a0-08da2cd7b25c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:21.985789 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-26a706ab-73ea-4411-a6a0-08da2cd7b25c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.387496 Oct 29 03:05:21.988750 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2308/4553] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:21 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:22.002669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-65c9d13d-793a-4941-a71a-c03f76c08e39 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:22.005823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-65c9d13d-793a-4941-a71a-c03f76c08e39 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:22.017271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65c9d13d-793a-4941-a71a-c03f76c08e39 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.020493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65c9d13d-793a-4941-a71a-c03f76c08e39 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.022684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65c9d13d-793a-4941-a71a-c03f76c08e39 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.023769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65c9d13d-793a-4941-a71a-c03f76c08e39 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.025041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65c9d13d-793a-4941-a71a-c03f76c08e39 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.026545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65c9d13d-793a-4941-a71a-c03f76c08e39 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.077990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8423099f-dbdf-4fe8-b358-640ab589feda tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:22.093476 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8423099f-dbdf-4fe8-b358-640ab589feda tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.290754 Oct 29 03:05:22.094358 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2246/4554] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:21 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:22.320482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-65c9d13d-793a-4941-a71a-c03f76c08e39 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:22.352764 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-65c9d13d-793a-4941-a71a-c03f76c08e39 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca" status: 200 len: 1516 microversion: 2.1 time: 0.361020 Oct 29 03:05:22.355857 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2309/4555] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:21 2022] GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca => generated 1516 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:22.365768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:22.369459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:22.379661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.380918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.381906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.383621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.385020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.385980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.409634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-22602be1-15d7-40f1-95cb-02e475d32b34 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Action: 'create', calling method: .version_select at 0x7fe1a3eac790>, body: {"pool": null} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:22.410298 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d/action HTTP/1.1 Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 28 Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: {"reboot": {"type": "SOFT"}} Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'db54eba0-267c-4806-b337-72d0ccf62f9d', 'body': {'reboot': {'type': 'SOFT'}}} Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:22.418063 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:22.422126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:05:22.422126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:22.422126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:22.422126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:22.422126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:22.422126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:22.422126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:22.422126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:22.422126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:22.422126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:05:22.422126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:22.424990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:22.427234 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-960c5eb8-a4d6-4afd-9308-682e920c35ff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d/action" status: 404 len: 111 microversion: 2.1 time: 0.070075 Oct 29 03:05:22.428447 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2310/4556] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:22 2022] POST /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:22.434581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6364095e-4df6-40bb-bdc9-f0f11b58a7f0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:22.436198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6364095e-4df6-40bb-bdc9-f0f11b58a7f0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:22.457554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6364095e-4df6-40bb-bdc9-f0f11b58a7f0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.458358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6364095e-4df6-40bb-bdc9-f0f11b58a7f0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.459079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6364095e-4df6-40bb-bdc9-f0f11b58a7f0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.460669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6364095e-4df6-40bb-bdc9-f0f11b58a7f0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.461328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6364095e-4df6-40bb-bdc9-f0f11b58a7f0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.463015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6364095e-4df6-40bb-bdc9-f0f11b58a7f0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.718736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6364095e-4df6-40bb-bdc9-f0f11b58a7f0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:22.728162 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6364095e-4df6-40bb-bdc9-f0f11b58a7f0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1490 microversion: 2.1 time: 0.298355 Oct 29 03:05:22.730202 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2311/4557] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:22 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1490 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:22.735842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b15bfc9f-9482-4e76-bba6-238cfe80d052 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:22.736555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b15bfc9f-9482-4e76-bba6-238cfe80d052 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:22.744180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b15bfc9f-9482-4e76-bba6-238cfe80d052 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.744860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b15bfc9f-9482-4e76-bba6-238cfe80d052 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.745441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b15bfc9f-9482-4e76-bba6-238cfe80d052 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.746323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b15bfc9f-9482-4e76-bba6-238cfe80d052 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.746947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b15bfc9f-9482-4e76-bba6-238cfe80d052 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.747519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b15bfc9f-9482-4e76-bba6-238cfe80d052 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.802012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b15bfc9f-9482-4e76-bba6-238cfe80d052 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:05:22.961795 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b15bfc9f-9482-4e76-bba6-238cfe80d052 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca" status: 204 len: 0 microversion: 2.1 time: 0.229832 Oct 29 03:05:22.970528 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2312/4558] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:05:22 2022] DELETE /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:22.983242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2264151c-0797-440c-8948-8063ea78fe32 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:22.983999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2264151c-0797-440c-8948-8063ea78fe32 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:22.994173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2264151c-0797-440c-8948-8063ea78fe32 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.994725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2264151c-0797-440c-8948-8063ea78fe32 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.995808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2264151c-0797-440c-8948-8063ea78fe32 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.996392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2264151c-0797-440c-8948-8063ea78fe32 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.997375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2264151c-0797-440c-8948-8063ea78fe32 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.997823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2264151c-0797-440c-8948-8063ea78fe32 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:23.194027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2264151c-0797-440c-8948-8063ea78fe32 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:23.206639 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2264151c-0797-440c-8948-8063ea78fe32 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.233882 Oct 29 03:05:23.207374 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2313/4559] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:22 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:23.222008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b459fa75-21cd-4892-b948-87eaecb8a7d3 req-1e9ff7d1-d943-4a7f-a91b-a36c7d584905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f439b2b6-1302-414a-93d3-f162321fd6c6", "name": "network-vif-plugged", "status": "completed", "tag": "291472dd-c560-4f62-ae19-0af367acb98e"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:23.234158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b459fa75-21cd-4892-b948-87eaecb8a7d3 req-1e9ff7d1-d943-4a7f-a91b-a36c7d584905 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:23.234980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b459fa75-21cd-4892-b948-87eaecb8a7d3 req-1e9ff7d1-d943-4a7f-a91b-a36c7d584905 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:23.235698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b459fa75-21cd-4892-b948-87eaecb8a7d3 req-1e9ff7d1-d943-4a7f-a91b-a36c7d584905 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:23.251187 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b459fa75-21cd-4892-b948-87eaecb8a7d3 req-1e9ff7d1-d943-4a7f-a91b-a36c7d584905 service nova] Creating event network-vif-plugged:291472dd-c560-4f62-ae19-0af367acb98e for instance f439b2b6-1302-414a-93d3-f162321fd6c6 on n-h1-862964-4 Oct 29 03:05:23.260093 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b459fa75-21cd-4892-b948-87eaecb8a7d3 req-1e9ff7d1-d943-4a7f-a91b-a36c7d584905 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049804 Oct 29 03:05:23.261391 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2314/4560] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:23.270062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:23.271581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:23.279935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:23.281269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:23.281893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:23.282905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:23.283506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:23.284087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:23.519310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:23.535161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:23.538450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:23.540027 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de31007d-b587-4118-b469-08c88cd3ea84 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.276754 Oct 29 03:05:23.540909 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2315/4561] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:23 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:23.565522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1424632319", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "204a19c0-c3a9-46eb-85da-9d12d0451025"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:23.578268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:23.709188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] validate_networks() for [('204a19c0-c3a9-46eb-85da-9d12d0451025', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:05:24.379749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:05:24.380396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:05:24.381095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:05:24.382072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:05:24.382641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:05:24.405393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.413769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.414405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:24.415349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.415921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.416467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:24.452662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:05:24.466847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for user cecadca739554f858c269b85690b5cec and project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:05:24.503880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:05:24.506998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:05:24.638773 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7e47d2c5-6e97-4ed7-a8e3-5a3603477433 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092346 Oct 29 03:05:24.642189 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2316/4562] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:05:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:05:24.673458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-93dbe980-b241-4c1a-beef-7852e67ccb31 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:24.678971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-93dbe980-b241-4c1a-beef-7852e67ccb31 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:24.717082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93dbe980-b241-4c1a-beef-7852e67ccb31 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.718268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93dbe980-b241-4c1a-beef-7852e67ccb31 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.718932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93dbe980-b241-4c1a-beef-7852e67ccb31 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:24.721541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93dbe980-b241-4c1a-beef-7852e67ccb31 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.722721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93dbe980-b241-4c1a-beef-7852e67ccb31 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.726441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93dbe980-b241-4c1a-beef-7852e67ccb31 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:24.776516 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-22602be1-15d7-40f1-95cb-02e475d32b34 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.680381 Oct 29 03:05:24.777501 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2247/4563] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Oct 29 03:05:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:24.793602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-35ed2516-df46-4562-ae1f-fa5f9c418d8f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:24.794248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-35ed2516-df46-4562-ae1f-fa5f9c418d8f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:24.808842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35ed2516-df46-4562-ae1f-fa5f9c418d8f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.810485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35ed2516-df46-4562-ae1f-fa5f9c418d8f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.811260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35ed2516-df46-4562-ae1f-fa5f9c418d8f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:24.814511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35ed2516-df46-4562-ae1f-fa5f9c418d8f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.818060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35ed2516-df46-4562-ae1f-fa5f9c418d8f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.818693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35ed2516-df46-4562-ae1f-fa5f9c418d8f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:25.111656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-35ed2516-df46-4562-ae1f-fa5f9c418d8f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:25.130636 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-35ed2516-df46-4562-ae1f-fa5f9c418d8f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.351040 Oct 29 03:05:25.132084 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2248/4564] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:24 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:25.136970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e3f233e-2568-490f-ae7c-02b043c5a22d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:25.139384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9e3f233e-2568-490f-ae7c-02b043c5a22d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:25.155853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3f233e-2568-490f-ae7c-02b043c5a22d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:25.156353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3f233e-2568-490f-ae7c-02b043c5a22d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:25.162576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3f233e-2568-490f-ae7c-02b043c5a22d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:25.165246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3f233e-2568-490f-ae7c-02b043c5a22d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:25.168336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3f233e-2568-490f-ae7c-02b043c5a22d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:25.169110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3f233e-2568-490f-ae7c-02b043c5a22d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:25.177725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-93dbe980-b241-4c1a-beef-7852e67ccb31 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:25.194368 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-93dbe980-b241-4c1a-beef-7852e67ccb31 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca" status: 200 len: 1522 microversion: 2.1 time: 0.531245 Oct 29 03:05:25.208787 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2317/4565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:24 2022] GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca => generated 1522 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:25.216451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:25.217506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:25.224880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:25.225755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:25.226439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:25.227444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:25.228175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:25.228813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:25.525455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:25.539552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:25.541033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:25.542313 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-72df8460-4627-4cd7-aa56-e174420302f7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.332089 Oct 29 03:05:25.543090 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2318/4566] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:25 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:25.569685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2d7596e8-d524-448e-811a-41cc0b5dd28c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:25.570323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2d7596e8-d524-448e-811a-41cc0b5dd28c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:25.578455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9e3f233e-2568-490f-ae7c-02b043c5a22d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:25.591129 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9e3f233e-2568-490f-ae7c-02b043c5a22d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.457727 Oct 29 03:05:25.595374 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2249/4567] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:25 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:25.603042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-63d044c7-3c93-43d2-a1f6-9d38df9d78ac tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Calling method '.version_select at 0x7fe1a3c7b0d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:26.103820 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-63d044c7-3c93-43d2-a1f6-9d38df9d78ac tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/3832c186-6e01-4e63-bbee-fe96b452f6e3" status: 200 len: 142 microversion: 2.1 time: 0.507146 Oct 29 03:05:26.105428 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2250/4568] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:05:25 2022] GET /compute/v2.1/os-floating-ips/3832c186-6e01-4e63-bbee-fe96b452f6e3 => generated 142 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:26.117940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fd3a3497-bd44-4ad0-a145-7e076462af6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:26.120956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fd3a3497-bd44-4ad0-a145-7e076462af6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: dab12d5d-85af-405c-9e9d-159e8ba838f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:26.134561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:26.144408 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-fd3a3497-bd44-4ad0-a145-7e076462af6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance dab12d5d-85af-405c-9e9d-159e8ba838f4 could not be found. Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fd3a3497-bd44-4ad0-a145-7e076462af6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/dab12d5d-85af-405c-9e9d-159e8ba838f4/action HTTP/1.1 Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 28 Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: {"reboot": {"type": "SOFT"}} Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance dab12d5d-85af-405c-9e9d-159e8ba838f4 could not be found. Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'dab12d5d-85af-405c-9e9d-159e8ba838f4', 'body': {'reboot': {'type': 'SOFT'}}} Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab12d5d-85af-405c-9e9d-159e8ba838f4 could not be found. Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab12d5d-85af-405c-9e9d-159e8ba838f4 could not be found. Oct 29 03:05:26.146598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:26.152526 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:26.152526 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:26.152526 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:26.152526 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:26.152526 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:26.152526 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:26.152526 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:26.152526 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab12d5d-85af-405c-9e9d-159e8ba838f4 could not be found. Oct 29 03:05:26.152526 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:26.155877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fd3a3497-bd44-4ad0-a145-7e076462af6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance dab12d5d-85af-405c-9e9d-159e8ba838f4 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:26.158305 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fd3a3497-bd44-4ad0-a145-7e076462af6c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/dab12d5d-85af-405c-9e9d-159e8ba838f4/action" status: 404 len: 111 microversion: 2.1 time: 0.050969 Oct 29 03:05:26.160549 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2251/4569] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:26 2022] POST /compute/v2.1/servers/dab12d5d-85af-405c-9e9d-159e8ba838f4/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:26.179015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-83bec33f-3f38-4b5f-af13-c9581bd48c69 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Calling method '.version_select at 0x7fe1a8858940>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:26.512049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d7596e8-d524-448e-811a-41cc0b5dd28c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:26.519478 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2d7596e8-d524-448e-811a-41cc0b5dd28c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1209 microversion: 2.1 time: 0.953668 Oct 29 03:05:26.524675 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2319/4570] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:25 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1209 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:26.529903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5704b3eb-38fb-48cd-aef5-318f8e942c4b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:26.548705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5704b3eb-38fb-48cd-aef5-318f8e942c4b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:26.589397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5704b3eb-38fb-48cd-aef5-318f8e942c4b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:26.589934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5704b3eb-38fb-48cd-aef5-318f8e942c4b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:26.593635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5704b3eb-38fb-48cd-aef5-318f8e942c4b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:26.596726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5704b3eb-38fb-48cd-aef5-318f8e942c4b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:26.600122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5704b3eb-38fb-48cd-aef5-318f8e942c4b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:26.602150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5704b3eb-38fb-48cd-aef5-318f8e942c4b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:26.655678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:26.765558 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-83bec33f-3f38-4b5f-af13-c9581bd48c69 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.597175 Oct 29 03:05:26.766206 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2252/4571] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Oct 29 03:05:26 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:26.777958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af70e362-99ef-4971-80ce-13f41c7bc8c4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:26.778581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-af70e362-99ef-4971-80ce-13f41c7bc8c4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:26.787944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af70e362-99ef-4971-80ce-13f41c7bc8c4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:26.791281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af70e362-99ef-4971-80ce-13f41c7bc8c4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:26.792251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af70e362-99ef-4971-80ce-13f41c7bc8c4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:26.793348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af70e362-99ef-4971-80ce-13f41c7bc8c4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:26.795541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af70e362-99ef-4971-80ce-13f41c7bc8c4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:26.796191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af70e362-99ef-4971-80ce-13f41c7bc8c4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.134839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5704b3eb-38fb-48cd-aef5-318f8e942c4b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:27.152391 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5704b3eb-38fb-48cd-aef5-318f8e942c4b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.625473 Oct 29 03:05:27.173632 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2320/4572] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:26 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:27.194888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-882e5faa-b986-476c-b72c-21912fae55bb tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:27.195526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-882e5faa-b986-476c-b72c-21912fae55bb tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:27.228387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-882e5faa-b986-476c-b72c-21912fae55bb tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.237387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-882e5faa-b986-476c-b72c-21912fae55bb tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.238083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-882e5faa-b986-476c-b72c-21912fae55bb tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.238854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-882e5faa-b986-476c-b72c-21912fae55bb tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.239327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-882e5faa-b986-476c-b72c-21912fae55bb tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.239754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-882e5faa-b986-476c-b72c-21912fae55bb tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.456184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-882e5faa-b986-476c-b72c-21912fae55bb tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:27.470203 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-882e5faa-b986-476c-b72c-21912fae55bb tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca" status: 200 len: 1480 microversion: 2.1 time: 0.292086 Oct 29 03:05:27.470825 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2321/4573] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:27 2022] GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca => generated 1480 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:27.483976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:27.484620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:27.507215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.507778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.508229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.508988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.509443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.509906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.841736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:27.858098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:27.860649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:27.862150 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1294c188-b497-445a-a311-98e806e7bbc5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.390356 Oct 29 03:05:27.863385 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2322/4574] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:27 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:27.871212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-00f60c15-5c02-4a2f-b966-75e36054a608 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Calling method '.version_select at 0x7fe1a854bb80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:27.929445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-af70e362-99ef-4971-80ce-13f41c7bc8c4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:27.943455 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af70e362-99ef-4971-80ce-13f41c7bc8c4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 1.174692 Oct 29 03:05:27.944783 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2253/4575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:26 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:27.951550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-7d723879-5fe7-45a8-ac71-24583c51ff5d req-67a129d4-eca8-496b-aa27-4c17568916c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca", "name": "network-vif-deleted", "tag": "c4d39ef5-7494-4a08-9fe1-d5182e64380a"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:27.984427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7d723879-5fe7-45a8-ac71-24583c51ff5d req-67a129d4-eca8-496b-aa27-4c17568916c6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.986143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7d723879-5fe7-45a8-ac71-24583c51ff5d req-67a129d4-eca8-496b-aa27-4c17568916c6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.986579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7d723879-5fe7-45a8-ac71-24583c51ff5d req-67a129d4-eca8-496b-aa27-4c17568916c6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:28.012220 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-7d723879-5fe7-45a8-ac71-24583c51ff5d req-67a129d4-eca8-496b-aa27-4c17568916c6 service nova] Creating event network-vif-deleted:c4d39ef5-7494-4a08-9fe1-d5182e64380a for instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca on n-h2-862964-4 Oct 29 03:05:28.026085 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-7d723879-5fe7-45a8-ac71-24583c51ff5d req-67a129d4-eca8-496b-aa27-4c17568916c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079423 Oct 29 03:05:28.027997 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2254/4576] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:28.051953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7e831313-55e3-4bf0-a0f0-993b52ab7e6d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:28.053113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7e831313-55e3-4bf0-a0f0-993b52ab7e6d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:28.061717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e831313-55e3-4bf0-a0f0-993b52ab7e6d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:28.074637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e831313-55e3-4bf0-a0f0-993b52ab7e6d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:28.075194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e831313-55e3-4bf0-a0f0-993b52ab7e6d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:28.077668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e831313-55e3-4bf0-a0f0-993b52ab7e6d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:28.078261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e831313-55e3-4bf0-a0f0-993b52ab7e6d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:28.079253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e831313-55e3-4bf0-a0f0-993b52ab7e6d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:28.294430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7e831313-55e3-4bf0-a0f0-993b52ab7e6d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:28.304797 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7e831313-55e3-4bf0-a0f0-993b52ab7e6d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1267 microversion: 2.1 time: 0.273318 Oct 29 03:05:28.322852 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2255/4577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:28 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:28.329315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e47195d5-53e7-48a8-8185-e9ca57e26631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:28.330244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e47195d5-53e7-48a8-8185-e9ca57e26631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:28.339843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47195d5-53e7-48a8-8185-e9ca57e26631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:28.340333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47195d5-53e7-48a8-8185-e9ca57e26631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:28.340758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47195d5-53e7-48a8-8185-e9ca57e26631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:28.341663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47195d5-53e7-48a8-8185-e9ca57e26631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:28.342314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47195d5-53e7-48a8-8185-e9ca57e26631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:28.342888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e47195d5-53e7-48a8-8185-e9ca57e26631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:28.674703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e47195d5-53e7-48a8-8185-e9ca57e26631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:28.687334 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e47195d5-53e7-48a8-8185-e9ca57e26631 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.363026 Oct 29 03:05:28.688629 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2256/4578] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:28 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:28.697612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d20db3aa-4cda-4027-be03-1e49b433a317 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:28.703664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d20db3aa-4cda-4027-be03-1e49b433a317 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:28.715635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d20db3aa-4cda-4027-be03-1e49b433a317 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:28.719896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d20db3aa-4cda-4027-be03-1e49b433a317 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:28.720612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d20db3aa-4cda-4027-be03-1e49b433a317 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:28.721708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d20db3aa-4cda-4027-be03-1e49b433a317 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:28.722416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d20db3aa-4cda-4027-be03-1e49b433a317 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:28.722987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d20db3aa-4cda-4027-be03-1e49b433a317 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:28.987170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d20db3aa-4cda-4027-be03-1e49b433a317 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:28.997036 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d20db3aa-4cda-4027-be03-1e49b433a317 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.307100 Oct 29 03:05:29.004058 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2257/4579] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:28 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:29.011615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:29.012518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:29.033080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.034365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.036222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.037506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.039324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.040658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.077782 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] HTTP exception thrown: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Request method failure captured: Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca HTTP/1.1 Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJhT2493DcQMc2C2j_75BvQZb6GqxGE71kgFRoHygAQwG7t9sx1WlfhJWC1zWKvqzeVwLu_YN6a6g0qqQ-siz3s_RhXSz7NnzBahUMBXbwQX6XvhFQU5XwCpQB-mfCTUJEK-mIp92G_guWS3qRG3lYdiHOlTz7algSsqsDELD2MbX3o Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803f70c407f64cbc9818e1b856d60d2c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}] Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a93753777d5f4b4885e4ce1e0b13ed98 Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca'} Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:29.082065 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:29.085660 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:29.085660 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:29.085660 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:29.085660 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:29.085660 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:29.085660 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:29.085660 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:29.085660 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:29.089468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Returning 404 to user: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:29.091544 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f9001d57-7d17-493a-869e-8865b78637e5 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca" status: 404 len: 111 microversion: 2.1 time: 0.085025 Oct 29 03:05:29.101284 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2258/4580] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:29 2022] GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:29.109671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:29.113277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:29.120163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.120956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.121853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.122887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.123756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.124389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.147672 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d/action HTTP/1.1 Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 65 Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'db54eba0-267c-4806-b337-72d0ccf62f9d', 'body': {'rebuild': {'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab'}}} Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 03:05:29.150185 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:05:29.154655 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:29.158613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:29.160304 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f257f14b-37cd-4a39-8d35-6ca88d7df04b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d/action" status: 404 len: 111 microversion: 2.1 time: 0.057251 Oct 29 03:05:29.161413 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2259/4581] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:29 2022] POST /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:29.170111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:29.171000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:29.180257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.181498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.182356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.183324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.184079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.184704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.498123 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-00f60c15-5c02-4a2f-b966-75e36054a608 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/3832c186-6e01-4e63-bbee-fe96b452f6e3" status: 202 len: 0 microversion: 2.1 time: 1.633215 Oct 29 03:05:29.506213 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2323/4582] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:05:27 2022] DELETE /compute/v2.1/os-floating-ips/3832c186-6e01-4e63-bbee-fe96b452f6e3 => generated 0 bytes in 1642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:05:29.512618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a8f57ae8-359f-4cea-9267-0ba5a5c28141 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:29.525273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a8f57ae8-359f-4cea-9267-0ba5a5c28141 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:29.527733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a8f57ae8-359f-4cea-9267-0ba5a5c28141 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '803f70c407f64cbc9818e1b856d60d2c'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:05:29.535928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8f57ae8-359f-4cea-9267-0ba5a5c28141 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.536837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8f57ae8-359f-4cea-9267-0ba5a5c28141 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.537404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8f57ae8-359f-4cea-9267-0ba5a5c28141 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.538282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8f57ae8-359f-4cea-9267-0ba5a5c28141 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.538998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8f57ae8-359f-4cea-9267-0ba5a5c28141 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.539968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8f57ae8-359f-4cea-9267-0ba5a5c28141 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.637413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:29.651902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:29.655604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:29.659789 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fdfeb291-1550-4f2b-a5dc-0e74a629927d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.496724 Oct 29 03:05:29.670205 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2260/4583] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:29 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:29.675319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5e7f1e0-f459-4a45-9fcf-c1d76a71ccce tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:29.686381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d5e7f1e0-f459-4a45-9fcf-c1d76a71ccce tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:29.699876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e7f1e0-f459-4a45-9fcf-c1d76a71ccce tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.702020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e7f1e0-f459-4a45-9fcf-c1d76a71ccce tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.707257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e7f1e0-f459-4a45-9fcf-c1d76a71ccce tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.710866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e7f1e0-f459-4a45-9fcf-c1d76a71ccce tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.711515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e7f1e0-f459-4a45-9fcf-c1d76a71ccce tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.714308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e7f1e0-f459-4a45-9fcf-c1d76a71ccce tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.733623 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a8f57ae8-359f-4cea-9267-0ba5a5c28141 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.225398 Oct 29 03:05:29.734656 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2324/4584] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:05:29 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:05:29.749954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a8b7e35d-ec16-4b58-83b9-e33dbc9513fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:29.756471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a8b7e35d-ec16-4b58-83b9-e33dbc9513fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:29.776080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8b7e35d-ec16-4b58-83b9-e33dbc9513fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.780115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8b7e35d-ec16-4b58-83b9-e33dbc9513fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.782677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8b7e35d-ec16-4b58-83b9-e33dbc9513fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.786036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8b7e35d-ec16-4b58-83b9-e33dbc9513fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.786837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8b7e35d-ec16-4b58-83b9-e33dbc9513fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.787467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8b7e35d-ec16-4b58-83b9-e33dbc9513fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:30.004405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a8b7e35d-ec16-4b58-83b9-e33dbc9513fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:30.012727 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a8b7e35d-ec16-4b58-83b9-e33dbc9513fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1309 microversion: 2.1 time: 0.276751 Oct 29 03:05:30.015189 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2325/4585] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:29 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:30.021097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8b29ba9d-8fcc-4cb8-9131-30850cb92f3c tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Action: 'create', calling method: .version_select at 0x7fe1a8596430>, body: {"pool": null} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:30.037327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5e7f1e0-f459-4a45-9fcf-c1d76a71ccce tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:30.055660 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5e7f1e0-f459-4a45-9fcf-c1d76a71ccce tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.384064 Oct 29 03:05:30.058600 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2261/4586] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:29 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:30.064280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-03f8ed00-fdc4-4080-96ef-582f4b800bd7 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-03f8ed00-fdc4-4080-96ef-582f4b800bd7 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Request method failure captured: Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJhT2493DcQMc2C2j_75BvQZb6GqxGE71kgFRoHygAQwG7t9sx1WlfhJWC1zWKvqzeVwLu_YN6a6g0qqQ-siz3s_RhXSz7NnzBahUMBXbwQX6XvhFQU5XwCpQB-mfCTUJEK-mIp92G_guWS3qRG3lYdiHOlTz7algSsqsDELD2MbX3o Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803f70c407f64cbc9818e1b856d60d2c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}] Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a93753777d5f4b4885e4ce1e0b13ed98 Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: action_args: {} Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 03:05:30.068336 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 03:05:30.072082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:30.077160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-03f8ed00-fdc4-4080-96ef-582f4b800bd7 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:30.078314 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-03f8ed00-fdc4-4080-96ef-582f4b800bd7 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.018645 Oct 29 03:05:30.079095 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2262/4587] 10.222.0.16 () {58 vars in 1182 bytes} [Sat Oct 29 03:05:30 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:05:30.094719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9227c569-63b5-474f-ae72-a8dda1a5ef1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:30.095679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9227c569-63b5-474f-ae72-a8dda1a5ef1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:30.113647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9227c569-63b5-474f-ae72-a8dda1a5ef1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:30.115132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9227c569-63b5-474f-ae72-a8dda1a5ef1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:30.126417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9227c569-63b5-474f-ae72-a8dda1a5ef1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:30.127336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9227c569-63b5-474f-ae72-a8dda1a5ef1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:30.127904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9227c569-63b5-474f-ae72-a8dda1a5ef1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:30.128402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9227c569-63b5-474f-ae72-a8dda1a5ef1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:30.392091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9227c569-63b5-474f-ae72-a8dda1a5ef1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:30.402353 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9227c569-63b5-474f-ae72-a8dda1a5ef1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.321693 Oct 29 03:05:30.420683 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2263/4588] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:30 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:30.427399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-65d1967b-ba32-479a-a467-bad09648b9fc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:30.428017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-65d1967b-ba32-479a-a467-bad09648b9fc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:30.443510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d1967b-ba32-479a-a467-bad09648b9fc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:30.444045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d1967b-ba32-479a-a467-bad09648b9fc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:30.444528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d1967b-ba32-479a-a467-bad09648b9fc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:30.445520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d1967b-ba32-479a-a467-bad09648b9fc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:30.445900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d1967b-ba32-479a-a467-bad09648b9fc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:30.446325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65d1967b-ba32-479a-a467-bad09648b9fc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:30.789571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65d1967b-ba32-479a-a467-bad09648b9fc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:30.800770 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-65d1967b-ba32-479a-a467-bad09648b9fc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.378869 Oct 29 03:05:30.804621 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2264/4589] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:30 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:30.834269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2c17832b-c32e-4068-aaea-611783b69f0d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:30.851814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c17832b-c32e-4068-aaea-611783b69f0d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:30.854621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2c17832b-c32e-4068-aaea-611783b69f0d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Searching by: {'deleted': False, 'project_id': '803f70c407f64cbc9818e1b856d60d2c'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:05:30.870703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c17832b-c32e-4068-aaea-611783b69f0d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:30.873621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c17832b-c32e-4068-aaea-611783b69f0d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:30.874356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c17832b-c32e-4068-aaea-611783b69f0d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:30.875372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c17832b-c32e-4068-aaea-611783b69f0d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:30.879575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c17832b-c32e-4068-aaea-611783b69f0d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:30.880249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c17832b-c32e-4068-aaea-611783b69f0d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:30.934038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-2c17832b-c32e-4068-aaea-611783b69f0d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:05:31.005274 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2c17832b-c32e-4068-aaea-611783b69f0d tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.183644 Oct 29 03:05:31.006700 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2265/4590] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 03:05:30 2022] GET /compute/v2.1/servers => generated 681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:31.012414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:31.013771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:31.027242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:31.030338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:31.031100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:31.032065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:31.032816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:31.033633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:31.331459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:31.347488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:31.349149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:31.350940 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-198f8a49-8874-41ed-b1f5-6afdb443bea0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.342822 Oct 29 03:05:31.351650 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2266/4591] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:31 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:31.358976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-589be48f-413a-4e9b-9c25-0c18cb202812 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:31.366462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-589be48f-413a-4e9b-9c25-0c18cb202812 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2f7397a2-e5f9-4701-98a4-15adac2ae66f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:31.379448 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-589be48f-413a-4e9b-9c25-0c18cb202812 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance 2f7397a2-e5f9-4701-98a4-15adac2ae66f could not be found. Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-589be48f-413a-4e9b-9c25-0c18cb202812 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/2f7397a2-e5f9-4701-98a4-15adac2ae66f/action HTTP/1.1 Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 65 Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 2f7397a2-e5f9-4701-98a4-15adac2ae66f could not be found. Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2f7397a2-e5f9-4701-98a4-15adac2ae66f', 'body': {'rebuild': {'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab'}}} Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7397a2-e5f9-4701-98a4-15adac2ae66f could not be found. Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 03:05:31.381991 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7397a2-e5f9-4701-98a4-15adac2ae66f could not be found. Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7397a2-e5f9-4701-98a4-15adac2ae66f could not be found. Oct 29 03:05:31.387299 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:31.395641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-589be48f-413a-4e9b-9c25-0c18cb202812 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance 2f7397a2-e5f9-4701-98a4-15adac2ae66f could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:31.396789 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-589be48f-413a-4e9b-9c25-0c18cb202812 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2f7397a2-e5f9-4701-98a4-15adac2ae66f/action" status: 404 len: 111 microversion: 2.1 time: 0.041897 Oct 29 03:05:31.399496 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2267/4592] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:31 2022] POST /compute/v2.1/servers/2f7397a2-e5f9-4701-98a4-15adac2ae66f/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:31.415622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:31.424238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:31.425015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.compute.servers [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Removing options 'limit' from query {{(pid=127041) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 03:05:31.434863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Searching by: {'deleted': False, 'project_id': '803f70c407f64cbc9818e1b856d60d2c'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:05:31.441215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:31.441980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:31.442603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:31.443498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:31.444113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:31.454570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:31.494984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:05:31.502327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:31.569104 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5d1f27ca-29bf-4163-b8ac-8f48bf374210 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.168256 Oct 29 03:05:31.573513 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2268/4593] 10.222.0.16 () {58 vars in 1144 bytes} [Sat Oct 29 03:05:31 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:31.580805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e6b59775-88db-45d5-a189-26a1186d348b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:31.584198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e6b59775-88db-45d5-a189-26a1186d348b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:31.597207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b59775-88db-45d5-a189-26a1186d348b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:31.597698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b59775-88db-45d5-a189-26a1186d348b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:31.598163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b59775-88db-45d5-a189-26a1186d348b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:31.598871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b59775-88db-45d5-a189-26a1186d348b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:31.599320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b59775-88db-45d5-a189-26a1186d348b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:31.599740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b59775-88db-45d5-a189-26a1186d348b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:31.888339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e6b59775-88db-45d5-a189-26a1186d348b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:31.899385 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e6b59775-88db-45d5-a189-26a1186d348b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1309 microversion: 2.1 time: 0.324435 Oct 29 03:05:31.903943 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2269/4594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:31 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1309 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:31.911781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-daa26d0c-5b1c-4176-bdba-38260a06d223 req-fbcdca6a-64e9-4b7e-a689-b831aafbd1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da", "tag": "53ecbb86-8b63-4c8d-8cf4-657e826d5d1c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:31.931704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-daa26d0c-5b1c-4176-bdba-38260a06d223 req-fbcdca6a-64e9-4b7e-a689-b831aafbd1b4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:31.932184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-daa26d0c-5b1c-4176-bdba-38260a06d223 req-fbcdca6a-64e9-4b7e-a689-b831aafbd1b4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:31.932612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-daa26d0c-5b1c-4176-bdba-38260a06d223 req-fbcdca6a-64e9-4b7e-a689-b831aafbd1b4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:31.942814 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8b29ba9d-8fcc-4cb8-9131-30850cb92f3c tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.926441 Oct 29 03:05:31.944345 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2326/4595] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Oct 29 03:05:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:31.955256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bf86d793-d0b2-45c2-81c9-bb6bda552514 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:31.955984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bf86d793-d0b2-45c2-81c9-bb6bda552514 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:31.959168 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-daa26d0c-5b1c-4176-bdba-38260a06d223 req-fbcdca6a-64e9-4b7e-a689-b831aafbd1b4 service nova] Creating event network-changed:53ecbb86-8b63-4c8d-8cf4-657e826d5d1c for instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da on n-h1-862964-4 Oct 29 03:05:31.965340 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-daa26d0c-5b1c-4176-bdba-38260a06d223 req-fbcdca6a-64e9-4b7e-a689-b831aafbd1b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059538 Oct 29 03:05:31.966587 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2270/4596] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:31.971989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c6c6a36-b7e9-421f-8bab-5e17ac2b1df5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:31.973093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c6c6a36-b7e9-421f-8bab-5e17ac2b1df5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:31.976358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf86d793-d0b2-45c2-81c9-bb6bda552514 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:31.976358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf86d793-d0b2-45c2-81c9-bb6bda552514 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:31.980208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6c6a36-b7e9-421f-8bab-5e17ac2b1df5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:31.980885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6c6a36-b7e9-421f-8bab-5e17ac2b1df5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:31.981486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6c6a36-b7e9-421f-8bab-5e17ac2b1df5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:31.982423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6c6a36-b7e9-421f-8bab-5e17ac2b1df5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:31.982635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf86d793-d0b2-45c2-81c9-bb6bda552514 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:31.983305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6c6a36-b7e9-421f-8bab-5e17ac2b1df5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:31.983889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6c6a36-b7e9-421f-8bab-5e17ac2b1df5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:31.984351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf86d793-d0b2-45c2-81c9-bb6bda552514 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:31.986526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf86d793-d0b2-45c2-81c9-bb6bda552514 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:31.987988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf86d793-d0b2-45c2-81c9-bb6bda552514 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.193040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5c6c6a36-b7e9-421f-8bab-5e17ac2b1df5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:32.199702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bf86d793-d0b2-45c2-81c9-bb6bda552514 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:32.222829 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c6c6a36-b7e9-421f-8bab-5e17ac2b1df5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.254789 Oct 29 03:05:32.223365 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bf86d793-d0b2-45c2-81c9-bb6bda552514 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.276779 Oct 29 03:05:32.224147 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2271/4597] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:31 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:32.225662 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2327/4598] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:31 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:32.236437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-036a27f9-e0af-4dcd-9083-6e26ea9097ea tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.237563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e9f7b107-9c1b-4d49-88f7-ad9ce1c0d733 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Calling method '.version_select at 0x7fe1a8596820>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-036a27f9-e0af-4dcd-9083-6e26ea9097ea tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Request method failure captured: Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJhT2493DcQMc2C2j_75BvQZb6GqxGE71kgFRoHygAQwG7t9sx1WlfhJWC1zWKvqzeVwLu_YN6a6g0qqQ-siz3s_RhXSz7NnzBahUMBXbwQX6XvhFQU5XwCpQB-mfCTUJEK-mIp92G_guWS3qRG3lYdiHOlTz7algSsqsDELD2MbX3o Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803f70c407f64cbc9818e1b856d60d2c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}] Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a93753777d5f4b4885e4ce1e0b13ed98 Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: action_args: {} Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi '-1' Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 03:05:32.246415 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 03:05:32.250636 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.257006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-036a27f9-e0af-4dcd-9083-6e26ea9097ea tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:32.260862 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-036a27f9-e0af-4dcd-9083-6e26ea9097ea tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.034074 Oct 29 03:05:32.262021 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2272/4599] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Oct 29 03:05:32 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:05:32.268085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ddb07f3-b9f7-4fce-853f-3564dfe29419 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.268857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ddb07f3-b9f7-4fce-853f-3564dfe29419 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:32.286887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddb07f3-b9f7-4fce-853f-3564dfe29419 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.287376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddb07f3-b9f7-4fce-853f-3564dfe29419 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.287811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddb07f3-b9f7-4fce-853f-3564dfe29419 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.294189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddb07f3-b9f7-4fce-853f-3564dfe29419 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.295601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddb07f3-b9f7-4fce-853f-3564dfe29419 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.296126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ddb07f3-b9f7-4fce-853f-3564dfe29419 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.587272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ddb07f3-b9f7-4fce-853f-3564dfe29419 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:32.603537 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ddb07f3-b9f7-4fce-853f-3564dfe29419 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.339586 Oct 29 03:05:32.609135 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2273/4600] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:32 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:32.614157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d60b02db-2a8a-4dd9-a3f4-189d4811ed97 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d60b02db-2a8a-4dd9-a3f4-189d4811ed97 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Request method failure captured: Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJhT2493DcQMc2C2j_75BvQZb6GqxGE71kgFRoHygAQwG7t9sx1WlfhJWC1zWKvqzeVwLu_YN6a6g0qqQ-siz3s_RhXSz7NnzBahUMBXbwQX6XvhFQU5XwCpQB-mfCTUJEK-mIp92G_guWS3qRG3lYdiHOlTz7algSsqsDELD2MbX3o Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803f70c407f64cbc9818e1b856d60d2c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}] Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a93753777d5f4b4885e4ce1e0b13ed98 Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: action_args: {} Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi 'testing' Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 03:05:32.625715 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d60b02db-2a8a-4dd9-a3f4-189d4811ed97 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d60b02db-2a8a-4dd9-a3f4-189d4811ed97 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016894 Oct 29 03:05:32.629899 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2274/4601] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 03:05:32 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:05:32.645157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.646087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:32.660027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.660582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.661077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.661830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.662279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.662706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.906097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:32.917200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:32.918723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:32.922928 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a4bfbf84-a5d9-47c4-b9eb-fa4da4fb9c1b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.286680 Oct 29 03:05:32.924594 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2275/4602] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:32 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:32.929602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54e035b3-f7e9-46f5-927d-51a7ad1bfa9f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:32.930359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54e035b3-f7e9-46f5-927d-51a7ad1bfa9f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2ca1668a-3624-44bd-9aac-08ab6af2603b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:32.936552 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-54e035b3-f7e9-46f5-927d-51a7ad1bfa9f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance 2ca1668a-3624-44bd-9aac-08ab6af2603b could not be found. Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54e035b3-f7e9-46f5-927d-51a7ad1bfa9f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/2ca1668a-3624-44bd-9aac-08ab6af2603b/action HTTP/1.1 Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 15 Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: {"restore": {}} Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 2ca1668a-3624-44bd-9aac-08ab6af2603b could not be found. Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2ca1668a-3624-44bd-9aac-08ab6af2603b', 'body': {'restore': {}}} Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca1668a-3624-44bd-9aac-08ab6af2603b could not be found. Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca1668a-3624-44bd-9aac-08ab6af2603b could not be found. Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:32.938413 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:32.942520 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:32.942520 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:32.942520 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca1668a-3624-44bd-9aac-08ab6af2603b could not be found. Oct 29 03:05:32.942520 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:32.942520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54e035b3-f7e9-46f5-927d-51a7ad1bfa9f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance 2ca1668a-3624-44bd-9aac-08ab6af2603b could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:32.942520 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54e035b3-f7e9-46f5-927d-51a7ad1bfa9f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2ca1668a-3624-44bd-9aac-08ab6af2603b/action" status: 404 len: 111 microversion: 2.1 time: 0.014267 Oct 29 03:05:32.945029 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2276/4603] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:32 2022] POST /compute/v2.1/servers/2ca1668a-3624-44bd-9aac-08ab6af2603b/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:32.950074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c022010e-8a73-4d72-ba6d-67cc8bee2d60 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.956698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c022010e-8a73-4d72-ba6d-67cc8bee2d60 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:32.957627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c022010e-8a73-4d72-ba6d-67cc8bee2d60 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '803f70c407f64cbc9818e1b856d60d2c'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:05:32.966974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.compute.servers [None req-c022010e-8a73-4d72-ba6d-67cc8bee2d60 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Flavor 'non_existing_flavor' could not be found {{(pid=127041) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 29 03:05:32.968111 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c022010e-8a73-4d72-ba6d-67cc8bee2d60 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.022043 Oct 29 03:05:32.979183 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2277/4604] 10.222.0.16 () {58 vars in 1178 bytes} [Sat Oct 29 03:05:32 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:05:32.984862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59b99ec5-94a4-40eb-85c6-2676b9ce1a65 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.985471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59b99ec5-94a4-40eb-85c6-2676b9ce1a65 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:32.992529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59b99ec5-94a4-40eb-85c6-2676b9ce1a65 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.993690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59b99ec5-94a4-40eb-85c6-2676b9ce1a65 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.994315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59b99ec5-94a4-40eb-85c6-2676b9ce1a65 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.995203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59b99ec5-94a4-40eb-85c6-2676b9ce1a65 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.995928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59b99ec5-94a4-40eb-85c6-2676b9ce1a65 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.996569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59b99ec5-94a4-40eb-85c6-2676b9ce1a65 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.184675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59b99ec5-94a4-40eb-85c6-2676b9ce1a65 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:33.200115 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59b99ec5-94a4-40eb-85c6-2676b9ce1a65 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1309 microversion: 2.1 time: 0.217114 Oct 29 03:05:33.203069 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2278/4605] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:32 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1309 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:33.219627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d21e7147-6be8-4a35-866d-c162c4047dd7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:33.221711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d21e7147-6be8-4a35-866d-c162c4047dd7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:33.241830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21e7147-6be8-4a35-866d-c162c4047dd7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.244902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21e7147-6be8-4a35-866d-c162c4047dd7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.245925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21e7147-6be8-4a35-866d-c162c4047dd7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.247615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21e7147-6be8-4a35-866d-c162c4047dd7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.250305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21e7147-6be8-4a35-866d-c162c4047dd7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.251837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d21e7147-6be8-4a35-866d-c162c4047dd7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.397269 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e9f7b107-9c1b-4d49-88f7-ad9ce1c0d733 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/d76382b5-c918-43a1-b515-7640bff464fd" status: 202 len: 0 microversion: 2.1 time: 1.169148 Oct 29 03:05:33.397893 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2328/4606] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:05:32 2022] DELETE /compute/v2.1/os-floating-ips/d76382b5-c918-43a1-b515-7640bff464fd => generated 0 bytes in 1171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:05:33.406048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-677de125-6e39-4b0c-bc9d-febd29d56d1f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:33.411035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-677de125-6e39-4b0c-bc9d-febd29d56d1f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:33.411703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-677de125-6e39-4b0c-bc9d-febd29d56d1f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '803f70c407f64cbc9818e1b856d60d2c'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:05:33.419715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-677de125-6e39-4b0c-bc9d-febd29d56d1f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.420330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-677de125-6e39-4b0c-bc9d-febd29d56d1f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.420988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-677de125-6e39-4b0c-bc9d-febd29d56d1f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.422196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-677de125-6e39-4b0c-bc9d-febd29d56d1f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.422966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-677de125-6e39-4b0c-bc9d-febd29d56d1f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.423930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-677de125-6e39-4b0c-bc9d-febd29d56d1f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.533443 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-677de125-6e39-4b0c-bc9d-febd29d56d1f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.133861 Oct 29 03:05:33.534396 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2329/4607] 10.222.0.16 () {58 vars in 1174 bytes} [Sat Oct 29 03:05:33 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:05:33.543189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-329d35e6-c59d-4f53-9259-38bec20183d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:33.543804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-329d35e6-c59d-4f53-9259-38bec20183d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:33.554184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329d35e6-c59d-4f53-9259-38bec20183d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.554384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329d35e6-c59d-4f53-9259-38bec20183d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.554820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329d35e6-c59d-4f53-9259-38bec20183d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.555575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329d35e6-c59d-4f53-9259-38bec20183d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.556346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329d35e6-c59d-4f53-9259-38bec20183d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.556946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-329d35e6-c59d-4f53-9259-38bec20183d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.584067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d21e7147-6be8-4a35-866d-c162c4047dd7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:33.601581 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d21e7147-6be8-4a35-866d-c162c4047dd7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.396214 Oct 29 03:05:33.606167 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2279/4608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:33 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:33.611908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ca8f4e9-2f81-434b-9f8c-24b06d0bb335 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Calling method '.version_select at 0x7fe1a3a04dc0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:33.714374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-2ca8f4e9-2f81-434b-9f8c-24b06d0bb335 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d76382b5-c918-43a1-b515-7640bff464fd could not be found", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 03:05:33.715093 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-2ca8f4e9-2f81-434b-9f8c-24b06d0bb335 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] HTTP exception thrown: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ca8f4e9-2f81-434b-9f8c-24b06d0bb335 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Request method failure captured: Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-floating-ips/d76382b5-c918-43a1-b515-7640bff464fd HTTP/1.1 Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJhxi6ik3NYE0GhuJvA5vmPq7Lmxj_mH2oai-a_0NbOVk-TPibCPBXXViWz5vgR2eTutPcGZIhZ-j8Q9pyAyLeKEpkVxr3D9kOglzPJ6C-6eagWPD8m3YPUnuvsuQeCbEUyI7k6VG7jziObzI63fgDdliCorTtbKVM0FRXM9suG4pto Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 5bf76541414e40fe9ac135e8ab1eb4f7 Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FloatingIPsTestJSON-1580496909 Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5bf76541414e40fe9ac135e8ab1eb4f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bf76541414e40fe9ac135e8ab1eb4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5bf76541414e40fe9ac135e8ab1eb4f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bf76541414e40fe9ac135e8ab1eb4f7"}]}] Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FloatingIPsTestJSON-1580496909 Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 5bf76541414e40fe9ac135e8ab1eb4f7 Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1580496909 Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FloatingIPsTestJSON-1580496909-project Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 0e351a850ca24abaa386e717b8acfbb8 Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FloatingIPsTestJSON-1580496909-project Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: exception: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'd76382b5-c918-43a1-b515-7640bff464fd'} Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d76382b5-c918-43a1-b515-7640bff464fd could not be found Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8be6ee62-d8f8-4927-b16c-09e41b0b0533'] Oct 29 03:05:33.717133 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd. Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ca8f4e9-2f81-434b-9f8c-24b06d0bb335 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Returning 404 to user: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ca8f4e9-2f81-434b-9f8c-24b06d0bb335 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/d76382b5-c918-43a1-b515-7640bff464fd" status: 404 len: 111 microversion: 2.1 time: 0.110677 Oct 29 03:05:33.721602 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2280/4609] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:05:33 2022] GET /compute/v2.1/os-floating-ips/d76382b5-c918-43a1-b515-7640bff464fd => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:33.727566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f90bb1b2-8e02-4488-8303-21f14d9a95d1 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:33.727701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-329d35e6-c59d-4f53-9259-38bec20183d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:33.737136 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-329d35e6-c59d-4f53-9259-38bec20183d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.201676 Oct 29 03:05:33.738261 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2330/4610] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:33 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:33.743626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c276cb0c-0922-4d95-bbde-6d3306923d63 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:33.744433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c276cb0c-0922-4d95-bbde-6d3306923d63 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:33.746093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f90bb1b2-8e02-4488-8303-21f14d9a95d1 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:33.746803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f90bb1b2-8e02-4488-8303-21f14d9a95d1 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '803f70c407f64cbc9818e1b856d60d2c'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:05:33.752137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c276cb0c-0922-4d95-bbde-6d3306923d63 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.752838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c276cb0c-0922-4d95-bbde-6d3306923d63 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.753453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c276cb0c-0922-4d95-bbde-6d3306923d63 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.754440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c276cb0c-0922-4d95-bbde-6d3306923d63 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.755033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c276cb0c-0922-4d95-bbde-6d3306923d63 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.755597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c276cb0c-0922-4d95-bbde-6d3306923d63 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.763861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f90bb1b2-8e02-4488-8303-21f14d9a95d1 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.764814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f90bb1b2-8e02-4488-8303-21f14d9a95d1 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.765975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f90bb1b2-8e02-4488-8303-21f14d9a95d1 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.767357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f90bb1b2-8e02-4488-8303-21f14d9a95d1 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.768117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f90bb1b2-8e02-4488-8303-21f14d9a95d1 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.768552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f90bb1b2-8e02-4488-8303-21f14d9a95d1 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.899196 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f90bb1b2-8e02-4488-8303-21f14d9a95d1 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.178053 Oct 29 03:05:33.908028 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2281/4611] 10.222.0.16 () {58 vars in 1184 bytes} [Sat Oct 29 03:05:33 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:05:33.914443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5ac8d2bb-2eb2-455a-853e-12ef0c9cabe6 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Calling method '.version_select at 0x7fe1a3a04d30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:33.999698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-5ac8d2bb-2eb2-455a-853e-12ef0c9cabe6 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d76382b5-c918-43a1-b515-7640bff464fd could not be found", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 03:05:34.000495 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-5ac8d2bb-2eb2-455a-853e-12ef0c9cabe6 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] HTTP exception thrown: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5ac8d2bb-2eb2-455a-853e-12ef0c9cabe6 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Request method failure captured: Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-floating-ips/d76382b5-c918-43a1-b515-7640bff464fd HTTP/1.1 Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJhxi6ik3NYE0GhuJvA5vmPq7Lmxj_mH2oai-a_0NbOVk-TPibCPBXXViWz5vgR2eTutPcGZIhZ-j8Q9pyAyLeKEpkVxr3D9kOglzPJ6C-6eagWPD8m3YPUnuvsuQeCbEUyI7k6VG7jziObzI63fgDdliCorTtbKVM0FRXM9suG4pto Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 5bf76541414e40fe9ac135e8ab1eb4f7 Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FloatingIPsTestJSON-1580496909 Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5bf76541414e40fe9ac135e8ab1eb4f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bf76541414e40fe9ac135e8ab1eb4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5bf76541414e40fe9ac135e8ab1eb4f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bf76541414e40fe9ac135e8ab1eb4f7"}]}] Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FloatingIPsTestJSON-1580496909 Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 5bf76541414e40fe9ac135e8ab1eb4f7 Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1580496909 Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FloatingIPsTestJSON-1580496909-project Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 0e351a850ca24abaa386e717b8acfbb8 Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FloatingIPsTestJSON-1580496909-project Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: exception: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'd76382b5-c918-43a1-b515-7640bff464fd'} Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d76382b5-c918-43a1-b515-7640bff464fd could not be found Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-553f433e-2139-46d8-bde7-6479139b87f0'] Oct 29 03:05:34.004340 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd. Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.008864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5ac8d2bb-2eb2-455a-853e-12ef0c9cabe6 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] Returning 404 to user: Floating IP not found for ID d76382b5-c918-43a1-b515-7640bff464fd {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:34.011336 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5ac8d2bb-2eb2-455a-853e-12ef0c9cabe6 tempest-FloatingIPsTestJSON-1580496909 tempest-FloatingIPsTestJSON-1580496909-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/d76382b5-c918-43a1-b515-7640bff464fd" status: 404 len: 111 microversion: 2.1 time: 0.107010 Oct 29 03:05:34.017270 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2282/4612] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:05:33 2022] DELETE /compute/v2.1/os-floating-ips/d76382b5-c918-43a1-b515-7640bff464fd => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:34.034538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:34.045710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c276cb0c-0922-4d95-bbde-6d3306923d63 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:34.053053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:34.055046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Searching by: {'deleted': False, 'project_id': '803f70c407f64cbc9818e1b856d60d2c'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:05:34.059241 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c276cb0c-0922-4d95-bbde-6d3306923d63 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.319757 Oct 29 03:05:34.060041 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2331/4613] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:33 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:34.065592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:34.066681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.067137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:34.067271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.067576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:34.068313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.068761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.069185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:34.075660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.076754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.077374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:34.078450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.083289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.084313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:34.127603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:05:34.195187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:34.202820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.203757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.203757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:34.378718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:34.392203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:34.393988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:34.401114 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5e31c111-e5bc-4a50-8994-5184edd4856a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.338932 Oct 29 03:05:34.402694 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2332/4614] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:34 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:34.409173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:34.410022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:34.418160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.418895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.419532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:34.420675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.421629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.422241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:34.475815 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Cannot 'restore' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action HTTP/1.1 Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 15 Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: {"restore": {}} Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: exception: Cannot 'restore' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2bbab455-c481-40ea-a59c-4ec9c15d935e', 'body': {'restore': {}}} Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e in vm_state active. Cannot restore while the instance is in this state. Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:34.477713 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:34.482305 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:34.482305 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:34.482305 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:34.482305 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:05:34.482305 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:34.482305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 409 to user: Cannot 'restore' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:34.482305 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-97c02d28-e58d-468d-b187-fc595604d348 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 409 len: 145 microversion: 2.1 time: 0.075390 Oct 29 03:05:34.488486 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2333/4615] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:34 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 145 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:05:34.493690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0a2612e-e8ae-407e-9c98-b5976f771567 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:34.496790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b0a2612e-e8ae-407e-9c98-b5976f771567 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:34.503720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0a2612e-e8ae-407e-9c98-b5976f771567 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.503912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0a2612e-e8ae-407e-9c98-b5976f771567 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.504643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0a2612e-e8ae-407e-9c98-b5976f771567 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:34.505569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0a2612e-e8ae-407e-9c98-b5976f771567 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.506070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0a2612e-e8ae-407e-9c98-b5976f771567 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.506507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0a2612e-e8ae-407e-9c98-b5976f771567 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:34.768812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b0a2612e-e8ae-407e-9c98-b5976f771567 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:34.783789 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b0a2612e-e8ae-407e-9c98-b5976f771567 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1309 microversion: 2.1 time: 0.294247 Oct 29 03:05:34.799114 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2334/4616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:34 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1309 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:34.807927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cb276507-23aa-4204-b8e8-4c8573f43e1d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:34.810254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cb276507-23aa-4204-b8e8-4c8573f43e1d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:34.824924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb276507-23aa-4204-b8e8-4c8573f43e1d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.825772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb276507-23aa-4204-b8e8-4c8573f43e1d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.826503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb276507-23aa-4204-b8e8-4c8573f43e1d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:34.827578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb276507-23aa-4204-b8e8-4c8573f43e1d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.828453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb276507-23aa-4204-b8e8-4c8573f43e1d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.829887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb276507-23aa-4204-b8e8-4c8573f43e1d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.118036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cb276507-23aa-4204-b8e8-4c8573f43e1d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:35.128988 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cb276507-23aa-4204-b8e8-4c8573f43e1d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.328396 Oct 29 03:05:35.130251 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2335/4617] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:34 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:35.135802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-637a4b36-71df-44bf-9aa4-402d1b4cb5ba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:35.136714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-637a4b36-71df-44bf-9aa4-402d1b4cb5ba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:35.145627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-637a4b36-71df-44bf-9aa4-402d1b4cb5ba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.146820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-637a4b36-71df-44bf-9aa4-402d1b4cb5ba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.147490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-637a4b36-71df-44bf-9aa4-402d1b4cb5ba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.148600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-637a4b36-71df-44bf-9aa4-402d1b4cb5ba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.149357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-637a4b36-71df-44bf-9aa4-402d1b4cb5ba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.150319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-637a4b36-71df-44bf-9aa4-402d1b4cb5ba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.352856 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-43338dde-4d18-4644-99e3-14cb76255f1b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 1.334230 Oct 29 03:05:35.353824 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2283/4618] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 03:05:34 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:35.386174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-637a4b36-71df-44bf-9aa4-402d1b4cb5ba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:35.396683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b12206a6-0fb5-4f5c-9985-781c1bd74ead tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:35.397644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b12206a6-0fb5-4f5c-9985-781c1bd74ead tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:35.400705 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-637a4b36-71df-44bf-9aa4-402d1b4cb5ba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.264892 Oct 29 03:05:35.419438 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2336/4619] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:35 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:35.428028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a4cb634e-f89e-4180-9763-b995d8effb3e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:35.429944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12206a6-0fb5-4f5c-9985-781c1bd74ead tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.431934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12206a6-0fb5-4f5c-9985-781c1bd74ead tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.432565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12206a6-0fb5-4f5c-9985-781c1bd74ead tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.433434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12206a6-0fb5-4f5c-9985-781c1bd74ead tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.433904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12206a6-0fb5-4f5c-9985-781c1bd74ead tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.438656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a4cb634e-f89e-4180-9763-b995d8effb3e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:35.439659 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a4cb634e-f89e-4180-9763-b995d8effb3e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.018368 Oct 29 03:05:35.442484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b12206a6-0fb5-4f5c-9985-781c1bd74ead tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.442719 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2337/4620] 10.222.0.16 () {58 vars in 1178 bytes} [Sat Oct 29 03:05:35 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:05:35.456998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:35.457610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:35.465105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.466892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.467444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.468420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.469063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.469618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.678755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:35.689760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:35.692077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:35.693463 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-41d9fc8e-ea1b-4e0f-80ca-933ca61fc83f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.249503 Oct 29 03:05:35.721506 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2338/4621] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:35 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:35.726602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e70b46c3-f827-48f9-8e5a-f332ed0ca2a6 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:35.731556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e70b46c3-f827-48f9-8e5a-f332ed0ca2a6 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:35.732252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e70b46c3-f827-48f9-8e5a-f332ed0ca2a6 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Searching by: {'deleted': False, 'project_id': '803f70c407f64cbc9818e1b856d60d2c'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:05:35.754633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e70b46c3-f827-48f9-8e5a-f332ed0ca2a6 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.755163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e70b46c3-f827-48f9-8e5a-f332ed0ca2a6 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.755778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e70b46c3-f827-48f9-8e5a-f332ed0ca2a6 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.758350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e70b46c3-f827-48f9-8e5a-f332ed0ca2a6 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.758993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e70b46c3-f827-48f9-8e5a-f332ed0ca2a6 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.759427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e70b46c3-f827-48f9-8e5a-f332ed0ca2a6 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.760197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b12206a6-0fb5-4f5c-9985-781c1bd74ead tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:35.771543 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b12206a6-0fb5-4f5c-9985-781c1bd74ead tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.391990 Oct 29 03:05:35.772380 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2284/4622] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:35 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:35.811824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-adc9f4b5-8886-4c23-8c2c-6690656701bf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:35.818357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-adc9f4b5-8886-4c23-8c2c-6690656701bf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 6db51f32-20da-47e0-9bad-a35852247b1e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:35.836687 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-adc9f4b5-8886-4c23-8c2c-6690656701bf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance 6db51f32-20da-47e0-9bad-a35852247b1e could not be found. Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-adc9f4b5-8886-4c23-8c2c-6690656701bf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/6db51f32-20da-47e0-9bad-a35852247b1e/action HTTP/1.1 Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 14 Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: {"resume": {}} Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 6db51f32-20da-47e0-9bad-a35852247b1e could not be found. Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '6db51f32-20da-47e0-9bad-a35852247b1e', 'body': {'resume': {}}} Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db51f32-20da-47e0-9bad-a35852247b1e could not be found. Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db51f32-20da-47e0-9bad-a35852247b1e could not be found. Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:35.842407 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:35.846956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:35.846956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:35.846956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db51f32-20da-47e0-9bad-a35852247b1e could not be found. Oct 29 03:05:35.846956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.848771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-adc9f4b5-8886-4c23-8c2c-6690656701bf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance 6db51f32-20da-47e0-9bad-a35852247b1e could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:35.854808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-e70b46c3-f827-48f9-8e5a-f332ed0ca2a6 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:05:35.855757 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-adc9f4b5-8886-4c23-8c2c-6690656701bf tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/6db51f32-20da-47e0-9bad-a35852247b1e/action" status: 404 len: 111 microversion: 2.1 time: 0.057425 Oct 29 03:05:35.856939 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2285/4623] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:35 2022] POST /compute/v2.1/servers/6db51f32-20da-47e0-9bad-a35852247b1e/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:35.865073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1175a0c7-d1c0-4e7b-8642-a4d90476f1d8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:35.870167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1175a0c7-d1c0-4e7b-8642-a4d90476f1d8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:35.885283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1175a0c7-d1c0-4e7b-8642-a4d90476f1d8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.889027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1175a0c7-d1c0-4e7b-8642-a4d90476f1d8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.891892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1175a0c7-d1c0-4e7b-8642-a4d90476f1d8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.898669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1175a0c7-d1c0-4e7b-8642-a4d90476f1d8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.899269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1175a0c7-d1c0-4e7b-8642-a4d90476f1d8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.899778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1175a0c7-d1c0-4e7b-8642-a4d90476f1d8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.978818 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e70b46c3-f827-48f9-8e5a-f332ed0ca2a6 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.250627 Oct 29 03:05:35.981409 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2339/4624] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 03:05:35 2022] GET /compute/v2.1/servers => generated 681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:36.019297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-24db13d8-66a6-42ae-8b9d-270a6a9fb2d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:36.021991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-24db13d8-66a6-42ae-8b9d-270a6a9fb2d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:36.031159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24db13d8-66a6-42ae-8b9d-270a6a9fb2d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.032162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24db13d8-66a6-42ae-8b9d-270a6a9fb2d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.032599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24db13d8-66a6-42ae-8b9d-270a6a9fb2d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.033309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24db13d8-66a6-42ae-8b9d-270a6a9fb2d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.034670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24db13d8-66a6-42ae-8b9d-270a6a9fb2d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.035099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24db13d8-66a6-42ae-8b9d-270a6a9fb2d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.259009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-24db13d8-66a6-42ae-8b9d-270a6a9fb2d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:36.272573 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-24db13d8-66a6-42ae-8b9d-270a6a9fb2d5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.276978 Oct 29 03:05:36.290681 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2340/4625] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:35 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:36.296994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:36.297499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:36.305169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.305660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.306166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.306870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.307334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.307733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.320025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1175a0c7-d1c0-4e7b-8642-a4d90476f1d8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:36.322719 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] HTTP exception thrown: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Request method failure captured: Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca HTTP/1.1 Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJhT2493DcQMc2C2j_75BvQZb6GqxGE71kgFRoHygAQwG7t9sx1WlfhJWC1zWKvqzeVwLu_YN6a6g0qqQ-siz3s_RhXSz7NnzBahUMBXbwQX6XvhFQU5XwCpQB-mfCTUJEK-mIp92G_guWS3qRG3lYdiHOlTz7algSsqsDELD2MbX3o Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803f70c407f64cbc9818e1b856d60d2c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}] Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a93753777d5f4b4885e4ce1e0b13ed98 Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca'} Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:36.324352 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Returning 404 to user: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:36.328046 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b4995744-353e-49c7-99e2-398acb0c7f2e tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca" status: 404 len: 111 microversion: 2.1 time: 0.034469 Oct 29 03:05:36.330883 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1175a0c7-d1c0-4e7b-8642-a4d90476f1d8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1309 microversion: 2.1 time: 0.470174 Oct 29 03:05:36.331516 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2341/4626] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:05:36 2022] DELETE /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:36.336987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3bc5da1-bc32-43a8-bdcb-fe0f9dbc16af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:36.337826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a3bc5da1-bc32-43a8-bdcb-fe0f9dbc16af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:36.344513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc5da1-bc32-43a8-bdcb-fe0f9dbc16af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.345259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc5da1-bc32-43a8-bdcb-fe0f9dbc16af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.345880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc5da1-bc32-43a8-bdcb-fe0f9dbc16af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.346789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc5da1-bc32-43a8-bdcb-fe0f9dbc16af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.347417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc5da1-bc32-43a8-bdcb-fe0f9dbc16af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.347996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3bc5da1-bc32-43a8-bdcb-fe0f9dbc16af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.352519 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2286/4627] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:35 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1309 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:36.372500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7193ed80-13b0-450f-bd0a-4c34e65d189b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:36.373414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7193ed80-13b0-450f-bd0a-4c34e65d189b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 45eae659-6555-45bd-bfce-6dad956e267a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:36.387947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7193ed80-13b0-450f-bd0a-4c34e65d189b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.398009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7193ed80-13b0-450f-bd0a-4c34e65d189b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.398923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7193ed80-13b0-450f-bd0a-4c34e65d189b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.399953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7193ed80-13b0-450f-bd0a-4c34e65d189b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.400708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7193ed80-13b0-450f-bd0a-4c34e65d189b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.401676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7193ed80-13b0-450f-bd0a-4c34e65d189b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.760039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7193ed80-13b0-450f-bd0a-4c34e65d189b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 45eae659-6555-45bd-bfce-6dad956e267a] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:05:36.762359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:36.763090 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7193ed80-13b0-450f-bd0a-4c34e65d189b tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "DELETE /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a" status: 204 len: 0 microversion: 2.1 time: 0.303983 Oct 29 03:05:36.763090 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2287/4628] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:05:36 2022] DELETE /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:36.763090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37d8682d-d965-434c-b2c7-809759c6907f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:36.763090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37d8682d-d965-434c-b2c7-809759c6907f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:36.763090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37d8682d-d965-434c-b2c7-809759c6907f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.763090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37d8682d-d965-434c-b2c7-809759c6907f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.763090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37d8682d-d965-434c-b2c7-809759c6907f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.763090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37d8682d-d965-434c-b2c7-809759c6907f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.763090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37d8682d-d965-434c-b2c7-809759c6907f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.763090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37d8682d-d965-434c-b2c7-809759c6907f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.816720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a3bc5da1-bc32-43a8-bdcb-fe0f9dbc16af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:36.825499 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a3bc5da1-bc32-43a8-bdcb-fe0f9dbc16af tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.492704 Oct 29 03:05:36.829277 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2342/4629] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:36 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:36.849919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-53ccbae9-5eee-455b-9231-23b15dfa437f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:36.859258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-53ccbae9-5eee-455b-9231-23b15dfa437f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:36.884149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53ccbae9-5eee-455b-9231-23b15dfa437f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.884812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53ccbae9-5eee-455b-9231-23b15dfa437f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.885367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53ccbae9-5eee-455b-9231-23b15dfa437f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.886300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53ccbae9-5eee-455b-9231-23b15dfa437f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.887623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53ccbae9-5eee-455b-9231-23b15dfa437f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.889418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53ccbae9-5eee-455b-9231-23b15dfa437f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.918364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:36.925170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-53ccbae9-5eee-455b-9231-23b15dfa437f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:05:37.099306 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-53ccbae9-5eee-455b-9231-23b15dfa437f tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 204 len: 0 microversion: 2.1 time: 0.252856 Oct 29 03:05:37.099970 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2343/4630] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:05:36 2022] DELETE /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:37.111721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9037c1e7-3878-4317-9eb8-4c5472f0e89a req-4fbbcb77-3d92-4d62-b35e-4fc4841f0ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da", "name": "network-vif-plugged", "status": "completed", "tag": "53ecbb86-8b63-4c8d-8cf4-657e826d5d1c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:37.127167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9037c1e7-3878-4317-9eb8-4c5472f0e89a req-4fbbcb77-3d92-4d62-b35e-4fc4841f0ee4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.127966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9037c1e7-3878-4317-9eb8-4c5472f0e89a req-4fbbcb77-3d92-4d62-b35e-4fc4841f0ee4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.128879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9037c1e7-3878-4317-9eb8-4c5472f0e89a req-4fbbcb77-3d92-4d62-b35e-4fc4841f0ee4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.158267 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9037c1e7-3878-4317-9eb8-4c5472f0e89a req-4fbbcb77-3d92-4d62-b35e-4fc4841f0ee4 service nova] Creating event network-vif-plugged:53ecbb86-8b63-4c8d-8cf4-657e826d5d1c for instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da on n-h1-862964-4 Oct 29 03:05:37.165105 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9037c1e7-3878-4317-9eb8-4c5472f0e89a req-4fbbcb77-3d92-4d62-b35e-4fc4841f0ee4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061649 Oct 29 03:05:37.169908 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2344/4631] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:37.178896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:37.181143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:37.194318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.195299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.196134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.197355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.200222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.201573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.424070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37d8682d-d965-434c-b2c7-809759c6907f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:37.426520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:37.435386 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37d8682d-d965-434c-b2c7-809759c6907f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.770908 Oct 29 03:05:37.439421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:37.441021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:37.442374 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8661751e-99c6-4115-b5ef-a7d28279b523 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.269475 Oct 29 03:05:37.453870 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2345/4632] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:37 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:37.454121 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2288/4633] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:36 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:37.454332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:37.454332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:37.464195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:37.464195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:37.464428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.464428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.464428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.464428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.464428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.464428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.465261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.466248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.467385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.468329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.468955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.469541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.486114 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] HTTP exception thrown: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Request method failure captured: Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca HTTP/1.1 Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJhT2493DcQMc2C2j_75BvQZb6GqxGE71kgFRoHygAQwG7t9sx1WlfhJWC1zWKvqzeVwLu_YN6a6g0qqQ-siz3s_RhXSz7NnzBahUMBXbwQX6XvhFQU5XwCpQB-mfCTUJEK-mIp92G_guWS3qRG3lYdiHOlTz7algSsqsDELD2MbX3o Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803f70c407f64cbc9818e1b856d60d2c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}] Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a93753777d5f4b4885e4ce1e0b13ed98 Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca'} Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:37.488283 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:37.491883 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:37.491883 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:37.491883 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:37.491883 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:37.491883 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:37.491883 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:37.491883 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. Oct 29 03:05:37.491883 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:37.494460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Returning 404 to user: Instance ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:37.495942 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8d1b9b70-5bb5-4840-8905-b88c518d4af8 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca" status: 404 len: 111 microversion: 2.1 time: 0.048436 Oct 29 03:05:37.501579 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2289/4634] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:37 2022] GET /compute/v2.1/servers/ba37e05a-ad8d-4e7e-a393-dd94d8d0e2ca => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:37.506871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89419a30-bbad-4bc7-b87c-c2482a49fe07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:37.507771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89419a30-bbad-4bc7-b87c-c2482a49fe07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:37.514555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89419a30-bbad-4bc7-b87c-c2482a49fe07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.515303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89419a30-bbad-4bc7-b87c-c2482a49fe07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.515910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89419a30-bbad-4bc7-b87c-c2482a49fe07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.516806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89419a30-bbad-4bc7-b87c-c2482a49fe07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.517430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89419a30-bbad-4bc7-b87c-c2482a49fe07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.517542 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Cannot 'resume' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:05:37.518164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89419a30-bbad-4bc7-b87c-c2482a49fe07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action HTTP/1.1 Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 14 Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: {"resume": {}} Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: exception: Cannot 'resume' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2bbab455-c481-40ea-a59c-4ec9c15d935e', 'body': {'resume': {}}} Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e in vm_state active. Cannot resume while the instance is in this state. Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:37.520095 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:37.523796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:37.523796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:37.523796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:37.523796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:37.523796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:37.523796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:05:37.523796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:37.523796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 409 to user: Cannot 'resume' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:37.523796 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1de4ed49-375e-446e-8eee-6e1be6edee94 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 409 len: 144 microversion: 2.1 time: 0.077041 Oct 29 03:05:37.523796 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2346/4635] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:37 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 144 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:05:37.529201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2a503e68-6885-4a22-aa7e-2cdc817c72bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:37.529201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2a503e68-6885-4a22-aa7e-2cdc817c72bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 45eae659-6555-45bd-bfce-6dad956e267a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:37.535302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a503e68-6885-4a22-aa7e-2cdc817c72bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.538731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a503e68-6885-4a22-aa7e-2cdc817c72bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.539280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a503e68-6885-4a22-aa7e-2cdc817c72bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.540177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a503e68-6885-4a22-aa7e-2cdc817c72bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.540580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a503e68-6885-4a22-aa7e-2cdc817c72bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.541163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a503e68-6885-4a22-aa7e-2cdc817c72bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.778829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2a503e68-6885-4a22-aa7e-2cdc817c72bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:37.788932 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2a503e68-6885-4a22-aa7e-2cdc817c72bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a" status: 200 len: 1521 microversion: 2.1 time: 0.265462 Oct 29 03:05:37.804617 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2347/4636] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:37 2022] GET /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:37.804617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cf1bab63-e560-46e0-99ef-a8964719e11b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:37.804617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cf1bab63-e560-46e0-99ef-a8964719e11b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:37.804617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf1bab63-e560-46e0-99ef-a8964719e11b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.804617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf1bab63-e560-46e0-99ef-a8964719e11b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.804617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf1bab63-e560-46e0-99ef-a8964719e11b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.804617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf1bab63-e560-46e0-99ef-a8964719e11b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.804617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf1bab63-e560-46e0-99ef-a8964719e11b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.805485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf1bab63-e560-46e0-99ef-a8964719e11b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.921440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-89419a30-bbad-4bc7-b87c-c2482a49fe07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:37.934036 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89419a30-bbad-4bc7-b87c-c2482a49fe07 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1309 microversion: 2.1 time: 0.426555 Oct 29 03:05:37.955000 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2290/4637] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:37 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1309 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:38.059121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cf1bab63-e560-46e0-99ef-a8964719e11b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:38.068631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cf1bab63-e560-46e0-99ef-a8964719e11b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.277395 Oct 29 03:05:38.070351 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2348/4638] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:37 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:38.096768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8619303-8268-4b7f-84d0-f3b121e86ad8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:38.097379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8619303-8268-4b7f-84d0-f3b121e86ad8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:38.109958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8619303-8268-4b7f-84d0-f3b121e86ad8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.110530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8619303-8268-4b7f-84d0-f3b121e86ad8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.111027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8619303-8268-4b7f-84d0-f3b121e86ad8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:38.114567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8619303-8268-4b7f-84d0-f3b121e86ad8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.125158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8619303-8268-4b7f-84d0-f3b121e86ad8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.125681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8619303-8268-4b7f-84d0-f3b121e86ad8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:38.464949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7b88fc5b-8cc4-4d21-89b6-f1cc4e16b283 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:38.465611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7b88fc5b-8cc4-4d21-89b6-f1cc4e16b283 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:38.476117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b88fc5b-8cc4-4d21-89b6-f1cc4e16b283 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.478097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b88fc5b-8cc4-4d21-89b6-f1cc4e16b283 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.479268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b88fc5b-8cc4-4d21-89b6-f1cc4e16b283 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:38.480739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b88fc5b-8cc4-4d21-89b6-f1cc4e16b283 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.481892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b88fc5b-8cc4-4d21-89b6-f1cc4e16b283 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.482751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b88fc5b-8cc4-4d21-89b6-f1cc4e16b283 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:38.603428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8619303-8268-4b7f-84d0-f3b121e86ad8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:38.608746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:38.624874 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8619303-8268-4b7f-84d0-f3b121e86ad8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.533147 Oct 29 03:05:38.639086 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2291/4639] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:38 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:38.658232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:38.658857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:38.670124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.670124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.670124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:38.670124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.671186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.671648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:38.908233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b88fc5b-8cc4-4d21-89b6-f1cc4e16b283 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:38.919835 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7b88fc5b-8cc4-4d21-89b6-f1cc4e16b283 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1512 microversion: 2.1 time: 0.459180 Oct 29 03:05:38.922303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2349/4640] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:38 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1512 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:38.932455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-95d567ae-cb66-4d97-83e5-8cd6fb47396f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-95d567ae-cb66-4d97-83e5-8cd6fb47396f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 160 Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "58a9eca5-efd9-4c67-9627-237802e0f75c"}]}} Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'networks': [{'uuid': '58a9eca5-efd9-4c67-9627-237802e0f75c'}]}}} Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi '' Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:05:38.937258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:05:38.941106 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:38.944190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-95d567ae-cb66-4d97-83e5-8cd6fb47396f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:38.945363 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-95d567ae-cb66-4d97-83e5-8cd6fb47396f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.020348 Oct 29 03:05:38.946635 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2350/4641] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:05:38 2022] POST /compute/v2.1/servers => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:05:38.954525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f45b81e-e853-4a43-934e-686041307634 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:38.955538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f45b81e-e853-4a43-934e-686041307634 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 45eae659-6555-45bd-bfce-6dad956e267a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:38.972098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f45b81e-e853-4a43-934e-686041307634 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.972995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f45b81e-e853-4a43-934e-686041307634 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.974120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f45b81e-e853-4a43-934e-686041307634 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:38.975798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f45b81e-e853-4a43-934e-686041307634 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.976490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f45b81e-e853-4a43-934e-686041307634 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.977177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f45b81e-e853-4a43-934e-686041307634 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:39.288230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8f45b81e-e853-4a43-934e-686041307634 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:39.318933 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f45b81e-e853-4a43-934e-686041307634 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a" status: 200 len: 1521 microversion: 2.1 time: 0.370059 Oct 29 03:05:39.327797 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2351/4642] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:38 2022] GET /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:39.333258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bffb1272-d645-4275-992d-02274ff37ccd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:39.334517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bffb1272-d645-4275-992d-02274ff37ccd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:39.352376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bffb1272-d645-4275-992d-02274ff37ccd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:39.353409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bffb1272-d645-4275-992d-02274ff37ccd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:39.354096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bffb1272-d645-4275-992d-02274ff37ccd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:39.355036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bffb1272-d645-4275-992d-02274ff37ccd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:39.355697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bffb1272-d645-4275-992d-02274ff37ccd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:39.356324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bffb1272-d645-4275-992d-02274ff37ccd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:39.430754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:39.445640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:39.447405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:39.452953 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ec50e49c-9503-4293-8edb-43c4c5882822 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.811072 Oct 29 03:05:39.461835 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2292/4643] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:38 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:39.467651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-716c5b7c-532d-4075-86f4-38ddf732331d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:39.468536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-716c5b7c-532d-4075-86f4-38ddf732331d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:39.500828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-716c5b7c-532d-4075-86f4-38ddf732331d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:39.501716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-716c5b7c-532d-4075-86f4-38ddf732331d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:39.504193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-716c5b7c-532d-4075-86f4-38ddf732331d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:39.505423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-716c5b7c-532d-4075-86f4-38ddf732331d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:39.506277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-716c5b7c-532d-4075-86f4-38ddf732331d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:39.510593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-716c5b7c-532d-4075-86f4-38ddf732331d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:40.322847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-716c5b7c-532d-4075-86f4-38ddf732331d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:40.337683 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-716c5b7c-532d-4075-86f4-38ddf732331d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1309 microversion: 2.1 time: 0.874138 Oct 29 03:05:40.343366 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2293/4644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:39 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1309 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:40.349189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c0ec9bc7-31b1-4748-9f34-c084b8c2cf1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:40.350103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c0ec9bc7-31b1-4748-9f34-c084b8c2cf1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:40.371482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ec9bc7-31b1-4748-9f34-c084b8c2cf1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:40.376759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ec9bc7-31b1-4748-9f34-c084b8c2cf1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:40.383595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ec9bc7-31b1-4748-9f34-c084b8c2cf1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:40.384727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ec9bc7-31b1-4748-9f34-c084b8c2cf1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:40.385414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ec9bc7-31b1-4748-9f34-c084b8c2cf1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:40.386380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0ec9bc7-31b1-4748-9f34-c084b8c2cf1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:40.828682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bffb1272-d645-4275-992d-02274ff37ccd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:40.871958 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bffb1272-d645-4275-992d-02274ff37ccd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 1.542255 Oct 29 03:05:40.873028 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2352/4645] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:39 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:40.915881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:40.917296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 45eae659-6555-45bd-bfce-6dad956e267a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:40.928236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:40.929389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:40.930388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:40.931797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:40.932667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:40.933845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:41.032742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:41.034981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:41.035587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:41.036190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lazy-loading 'fault' on Instance uuid 45eae659-6555-45bd-bfce-6dad956e267a {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:05:41.274342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:41.287514 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-13e394f6-e6a6-47cc-95b3-7241ab3920fd tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a" status: 200 len: 1312 microversion: 2.1 time: 0.395865 Oct 29 03:05:41.309426 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2353/4646] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:40 2022] GET /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a => generated 1312 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:41.323592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:41.324404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:41.338576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:41.347340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:41.348219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:41.349138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:41.349740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:41.350395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:42.096171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c0ec9bc7-31b1-4748-9f34-c084b8c2cf1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:42.111715 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c0ec9bc7-31b1-4748-9f34-c084b8c2cf1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1489 microversion: 2.1 time: 1.765358 Oct 29 03:05:42.116585 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2294/4647] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:40 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1489 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:42.126176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d3c4b15a-8ac6-4f52-8123-b248d949e426 req-cfddc364-93f6-4a2f-ac89-c660637a926f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45eae659-6555-45bd-bfce-6dad956e267a", "name": "network-vif-deleted", "tag": "1fd7951b-046c-41bc-bf9f-e0127b2c9575"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:42.189948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d3c4b15a-8ac6-4f52-8123-b248d949e426 req-cfddc364-93f6-4a2f-ac89-c660637a926f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:42.190597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d3c4b15a-8ac6-4f52-8123-b248d949e426 req-cfddc364-93f6-4a2f-ac89-c660637a926f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:42.198606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d3c4b15a-8ac6-4f52-8123-b248d949e426 req-cfddc364-93f6-4a2f-ac89-c660637a926f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:42.272928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:42.275229 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d3c4b15a-8ac6-4f52-8123-b248d949e426 req-cfddc364-93f6-4a2f-ac89-c660637a926f service nova] Creating event network-vif-deleted:1fd7951b-046c-41bc-bf9f-e0127b2c9575 for instance 45eae659-6555-45bd-bfce-6dad956e267a on n-h1-862964-4 Oct 29 03:05:42.298953 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d3c4b15a-8ac6-4f52-8123-b248d949e426 req-cfddc364-93f6-4a2f-ac89-c660637a926f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180742 Oct 29 03:05:42.300641 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2295/4648] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:42.323130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dcdc51e9-58d1-4660-833d-8c3d4bca394c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:42.324683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dcdc51e9-58d1-4660-833d-8c3d4bca394c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:42.326767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:42.342911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:42.349075 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b0c7e16a-9705-4e02-8670-383454bd0ba6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 1.037944 Oct 29 03:05:42.350914 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2354/4649] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:41 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:42.369065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcdc51e9-58d1-4660-833d-8c3d4bca394c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:42.369876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcdc51e9-58d1-4660-833d-8c3d4bca394c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:42.371852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-673f5610-5390-44f8-84ee-d55c65b73cf5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:42.372807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-673f5610-5390-44f8-84ee-d55c65b73cf5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:42.385501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-673f5610-5390-44f8-84ee-d55c65b73cf5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:42.387090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-673f5610-5390-44f8-84ee-d55c65b73cf5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:42.388436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-673f5610-5390-44f8-84ee-d55c65b73cf5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:42.389980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcdc51e9-58d1-4660-833d-8c3d4bca394c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:42.391246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-673f5610-5390-44f8-84ee-d55c65b73cf5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:42.391367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcdc51e9-58d1-4660-833d-8c3d4bca394c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:42.392103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcdc51e9-58d1-4660-833d-8c3d4bca394c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:42.394165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcdc51e9-58d1-4660-833d-8c3d4bca394c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:42.395175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-673f5610-5390-44f8-84ee-d55c65b73cf5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:42.397079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-673f5610-5390-44f8-84ee-d55c65b73cf5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:42.982005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dcdc51e9-58d1-4660-833d-8c3d4bca394c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:43.001206 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dcdc51e9-58d1-4660-833d-8c3d4bca394c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.694773 Oct 29 03:05:43.020164 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2296/4650] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:42 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:43.045865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4076806f-8613-4d44-b3c4-d3290386dd01 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:43.048782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4076806f-8613-4d44-b3c4-d3290386dd01 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:43.071866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4076806f-8613-4d44-b3c4-d3290386dd01 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:43.074685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4076806f-8613-4d44-b3c4-d3290386dd01 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:43.075254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4076806f-8613-4d44-b3c4-d3290386dd01 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:43.077930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4076806f-8613-4d44-b3c4-d3290386dd01 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:43.079731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4076806f-8613-4d44-b3c4-d3290386dd01 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:43.080314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4076806f-8613-4d44-b3c4-d3290386dd01 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:43.182675 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4076806f-8613-4d44-b3c4-d3290386dd01 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 200 len: 167 microversion: 2.1 time: 0.161133 Oct 29 03:05:43.185194 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2297/4651] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:43 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 167 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:43.195576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:43.196295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 45eae659-6555-45bd-bfce-6dad956e267a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:43.215696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:43.220657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:43.222333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:43.224871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:43.225508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:43.229635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:43.272996 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] HTTP exception thrown: Instance 45eae659-6555-45bd-bfce-6dad956e267a could not be found. Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Request method failure captured: Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a HTTP/1.1 Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJhT2493DcQMc2C2j_75BvQZb6GqxGE71kgFRoHygAQwG7t9sx1WlfhJWC1zWKvqzeVwLu_YN6a6g0qqQ-siz3s_RhXSz7NnzBahUMBXbwQX6XvhFQU5XwCpQB-mfCTUJEK-mIp92G_guWS3qRG3lYdiHOlTz7algSsqsDELD2MbX3o Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803f70c407f64cbc9818e1b856d60d2c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}] Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a93753777d5f4b4885e4ce1e0b13ed98 Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 45eae659-6555-45bd-bfce-6dad956e267a could not be found. Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '45eae659-6555-45bd-bfce-6dad956e267a'} Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45eae659-6555-45bd-bfce-6dad956e267a could not be found. Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45eae659-6555-45bd-bfce-6dad956e267a could not be found. Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:43.274956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:43.279769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:43.279769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:43.279769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:43.279769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:43.279769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:43.279769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:43.279769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45eae659-6555-45bd-bfce-6dad956e267a could not be found. Oct 29 03:05:43.279769 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:43.285184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Returning 404 to user: Instance 45eae659-6555-45bd-bfce-6dad956e267a could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:43.288377 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e0e4574-51f9-4122-913b-e7537060f9bf tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a" status: 404 len: 111 microversion: 2.1 time: 0.101964 Oct 29 03:05:43.290170 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2298/4652] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:43 2022] GET /compute/v2.1/servers/45eae659-6555-45bd-bfce-6dad956e267a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:43.302819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af722c14-4133-4043-9b63-453faaa056b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:43.303890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-af722c14-4133-4043-9b63-453faaa056b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 632dbfca-43a2-4842-b736-51c11f89810a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:43.346732 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-af722c14-4133-4043-9b63-453faaa056b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance 632dbfca-43a2-4842-b736-51c11f89810a could not be found. Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af722c14-4133-4043-9b63-453faaa056b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/632dbfca-43a2-4842-b736-51c11f89810a/action HTTP/1.1 Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 14 Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: {"shelve": {}} Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 632dbfca-43a2-4842-b736-51c11f89810a could not be found. Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '632dbfca-43a2-4842-b736-51c11f89810a', 'body': {'shelve': {}}} Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632dbfca-43a2-4842-b736-51c11f89810a could not be found. Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632dbfca-43a2-4842-b736-51c11f89810a could not be found. Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:43.358082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:43.363279 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:43.363279 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:43.363279 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632dbfca-43a2-4842-b736-51c11f89810a could not be found. Oct 29 03:05:43.363279 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:43.364688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-673f5610-5390-44f8-84ee-d55c65b73cf5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:43.369499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af722c14-4133-4043-9b63-453faaa056b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance 632dbfca-43a2-4842-b736-51c11f89810a could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:43.375327 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af722c14-4133-4043-9b63-453faaa056b9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/632dbfca-43a2-4842-b736-51c11f89810a/action" status: 404 len: 111 microversion: 2.1 time: 0.081514 Oct 29 03:05:43.379170 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2299/4653] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:43 2022] POST /compute/v2.1/servers/632dbfca-43a2-4842-b736-51c11f89810a/action => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:43.379739 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-673f5610-5390-44f8-84ee-d55c65b73cf5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1490 microversion: 2.1 time: 1.025989 Oct 29 03:05:43.380981 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2355/4654] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:42 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1490 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:43.406418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-afb3e398-e44b-4b6d-865c-fdd4b6292b29 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:43.407409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-afb3e398-e44b-4b6d-865c-fdd4b6292b29 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:43.416539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7a45aa62-5110-427f-830c-38111d265ff4 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:43.417214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7a45aa62-5110-427f-830c-38111d265ff4 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:43.419528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb3e398-e44b-4b6d-865c-fdd4b6292b29 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:43.426525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb3e398-e44b-4b6d-865c-fdd4b6292b29 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:43.427145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb3e398-e44b-4b6d-865c-fdd4b6292b29 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:43.427883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb3e398-e44b-4b6d-865c-fdd4b6292b29 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:43.428332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb3e398-e44b-4b6d-865c-fdd4b6292b29 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:43.428748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afb3e398-e44b-4b6d-865c-fdd4b6292b29 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:43.440490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a45aa62-5110-427f-830c-38111d265ff4 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:43.441158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a45aa62-5110-427f-830c-38111d265ff4 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:43.441619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a45aa62-5110-427f-830c-38111d265ff4 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:43.442431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a45aa62-5110-427f-830c-38111d265ff4 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:43.442908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a45aa62-5110-427f-830c-38111d265ff4 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:43.443343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a45aa62-5110-427f-830c-38111d265ff4 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:43.610743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7a45aa62-5110-427f-830c-38111d265ff4 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a93753777d5f4b4885e4ce1e0b13ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803f70c407f64cbc9818e1b856d60d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:43.624032 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7a45aa62-5110-427f-830c-38111d265ff4 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 200 len: 1307 microversion: 2.1 time: 0.241524 Oct 29 03:05:43.626033 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2356/4655] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:43 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:43.633409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4fa797d7-b5b3-448e-ae3f-547045aa3055 req-c8330460-04d7-4418-a7a1-13c94fe7b2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92775b76-1fb7-497b-9f2c-5b9e682f8b2c", "name": "network-vif-deleted", "tag": "e58c37a1-df9d-443f-a284-b47d6c3e85d1"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:43.648589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4fa797d7-b5b3-448e-ae3f-547045aa3055 req-c8330460-04d7-4418-a7a1-13c94fe7b2e2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:43.649219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4fa797d7-b5b3-448e-ae3f-547045aa3055 req-c8330460-04d7-4418-a7a1-13c94fe7b2e2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:43.651458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4fa797d7-b5b3-448e-ae3f-547045aa3055 req-c8330460-04d7-4418-a7a1-13c94fe7b2e2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:43.674504 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4fa797d7-b5b3-448e-ae3f-547045aa3055 req-c8330460-04d7-4418-a7a1-13c94fe7b2e2 service nova] Creating event network-vif-deleted:e58c37a1-df9d-443f-a284-b47d6c3e85d1 for instance 92775b76-1fb7-497b-9f2c-5b9e682f8b2c on n-h2-862964-4 Oct 29 03:05:43.735695 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4fa797d7-b5b3-448e-ae3f-547045aa3055 req-c8330460-04d7-4418-a7a1-13c94fe7b2e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099311 Oct 29 03:05:43.737132 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2357/4656] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:43.764854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7ff2619f-11dc-42fc-8120-1ec202776b3d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:43.766521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7ff2619f-11dc-42fc-8120-1ec202776b3d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:43.786941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff2619f-11dc-42fc-8120-1ec202776b3d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:43.789722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff2619f-11dc-42fc-8120-1ec202776b3d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:43.790267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff2619f-11dc-42fc-8120-1ec202776b3d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:43.794792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff2619f-11dc-42fc-8120-1ec202776b3d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:43.796593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff2619f-11dc-42fc-8120-1ec202776b3d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:43.797587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ff2619f-11dc-42fc-8120-1ec202776b3d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:44.108104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:44.167604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7ff2619f-11dc-42fc-8120-1ec202776b3d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:44.181533 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7ff2619f-11dc-42fc-8120-1ec202776b3d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.442759 Oct 29 03:05:44.189243 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2358/4657] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:43 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:44.194300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:44.207122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:44.207733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:44.220784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:44.240902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:44.246436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:44.247194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:44.250278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:44.251106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:44.253016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:44.295934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-afb3e398-e44b-4b6d-865c-fdd4b6292b29 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:44.308866 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-afb3e398-e44b-4b6d-865c-fdd4b6292b29 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.918630 Oct 29 03:05:44.312041 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2300/4658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:43 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:44.318047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-475c6c4b-ab0b-4c7a-b8a3-5435c4667b06 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:44.320030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-475c6c4b-ab0b-4c7a-b8a3-5435c4667b06 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:44.340268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-475c6c4b-ab0b-4c7a-b8a3-5435c4667b06 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:44.341050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-475c6c4b-ab0b-4c7a-b8a3-5435c4667b06 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:44.342393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-475c6c4b-ab0b-4c7a-b8a3-5435c4667b06 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:44.346797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-475c6c4b-ab0b-4c7a-b8a3-5435c4667b06 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:44.347504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-475c6c4b-ab0b-4c7a-b8a3-5435c4667b06 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:44.348091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-475c6c4b-ab0b-4c7a-b8a3-5435c4667b06 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:44.722042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:44.733319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:44.740860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:44.744390 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b82c3282-0aa0-422e-a2fb-65d6d998bdb4 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.551076 Oct 29 03:05:44.745459 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2359/4659] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:44 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:44.750913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-58faf33d-e8bb-4db6-93cc-2988dcab3db4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:44.764255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-58faf33d-e8bb-4db6-93cc-2988dcab3db4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:44.779469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58faf33d-e8bb-4db6-93cc-2988dcab3db4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:44.780333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58faf33d-e8bb-4db6-93cc-2988dcab3db4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:44.788172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58faf33d-e8bb-4db6-93cc-2988dcab3db4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:44.791326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58faf33d-e8bb-4db6-93cc-2988dcab3db4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:44.792225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58faf33d-e8bb-4db6-93cc-2988dcab3db4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:44.793518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58faf33d-e8bb-4db6-93cc-2988dcab3db4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:44.852597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:44.998340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-475c6c4b-ab0b-4c7a-b8a3-5435c4667b06 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:45.010498 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-475c6c4b-ab0b-4c7a-b8a3-5435c4667b06 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1490 microversion: 2.1 time: 0.697102 Oct 29 03:05:45.031703 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2301/4660] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:44 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1490 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:45.045263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-17167c16-ffd5-4948-a864-9255736052db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:45.051006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-17167c16-ffd5-4948-a864-9255736052db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:45.071648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17167c16-ffd5-4948-a864-9255736052db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:45.072137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17167c16-ffd5-4948-a864-9255736052db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:45.072571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17167c16-ffd5-4948-a864-9255736052db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:45.073396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17167c16-ffd5-4948-a864-9255736052db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:45.073788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17167c16-ffd5-4948-a864-9255736052db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:45.074245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17167c16-ffd5-4948-a864-9255736052db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:45.332469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-58faf33d-e8bb-4db6-93cc-2988dcab3db4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:45.370531 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-58faf33d-e8bb-4db6-93cc-2988dcab3db4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.623685 Oct 29 03:05:45.385304 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2360/4661] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:44 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:45.393406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:45.394266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] [instance: 92775b76-1fb7-497b-9f2c-5b9e682f8b2c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:45.402877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:45.403588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:45.404386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:45.405626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:45.406675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:45.407259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:45.438606 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] HTTP exception thrown: Instance 92775b76-1fb7-497b-9f2c-5b9e682f8b2c could not be found. Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Request method failure captured: Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c HTTP/1.1 Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJhT2493DcQMc2C2j_75BvQZb6GqxGE71kgFRoHygAQwG7t9sx1WlfhJWC1zWKvqzeVwLu_YN6a6g0qqQ-siz3s_RhXSz7NnzBahUMBXbwQX6XvhFQU5XwCpQB-mfCTUJEK-mIp92G_guWS3qRG3lYdiHOlTz7algSsqsDELD2MbX3o Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803f70c407f64cbc9818e1b856d60d2c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803f70c407f64cbc9818e1b856d60d2c"}]}] Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 803f70c407f64cbc9818e1b856d60d2c Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-204417753 Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a93753777d5f4b4885e4ce1e0b13ed98 Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ListServersNegativeTestJSON-204417753-project Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 92775b76-1fb7-497b-9f2c-5b9e682f8b2c could not be found. Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '92775b76-1fb7-497b-9f2c-5b9e682f8b2c'} Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92775b76-1fb7-497b-9f2c-5b9e682f8b2c could not be found. Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92775b76-1fb7-497b-9f2c-5b9e682f8b2c could not be found. Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:45.441322 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:45.445781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:45.445781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:45.445781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:45.445781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:45.445781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:45.445781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:45.445781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92775b76-1fb7-497b-9f2c-5b9e682f8b2c could not be found. Oct 29 03:05:45.445781 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:05:45.448768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] Returning 404 to user: Instance 92775b76-1fb7-497b-9f2c-5b9e682f8b2c could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:45.449846 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2212f9a0-f743-468f-859c-b605749f1317 tempest-ListServersNegativeTestJSON-204417753 tempest-ListServersNegativeTestJSON-204417753-project] 10.222.0.16 "GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c" status: 404 len: 111 microversion: 2.1 time: 0.062663 Oct 29 03:05:45.450970 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2361/4662] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:45 2022] GET /compute/v2.1/servers/92775b76-1fb7-497b-9f2c-5b9e682f8b2c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:45.458617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90c73304-63b9-4785-80a6-4f96e1b24fec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:45.459553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-90c73304-63b9-4785-80a6-4f96e1b24fec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:45.467355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c73304-63b9-4785-80a6-4f96e1b24fec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:45.468246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c73304-63b9-4785-80a6-4f96e1b24fec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:45.468843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c73304-63b9-4785-80a6-4f96e1b24fec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:45.469901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c73304-63b9-4785-80a6-4f96e1b24fec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:45.470517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c73304-63b9-4785-80a6-4f96e1b24fec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:45.471094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c73304-63b9-4785-80a6-4f96e1b24fec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:45.586643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-17167c16-ffd5-4948-a864-9255736052db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:45.596582 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-17167c16-ffd5-4948-a864-9255736052db tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.563409 Oct 29 03:05:45.620351 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2302/4663] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:45 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:45.625787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1d51f2bc-d2c2-4df8-b123-b986efb70875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:45.627276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1d51f2bc-d2c2-4df8-b123-b986efb70875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:45.633665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:45.637683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d51f2bc-d2c2-4df8-b123-b986efb70875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:45.638469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d51f2bc-d2c2-4df8-b123-b986efb70875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:45.640583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d51f2bc-d2c2-4df8-b123-b986efb70875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:45.641986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d51f2bc-d2c2-4df8-b123-b986efb70875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:45.642728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d51f2bc-d2c2-4df8-b123-b986efb70875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:45.643797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d51f2bc-d2c2-4df8-b123-b986efb70875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:45.696646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-1d51f2bc-d2c2-4df8-b123-b986efb70875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lazy-loading 'flavor' on Instance uuid 2bbab455-c481-40ea-a59c-4ec9c15d935e {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:05:45.799857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:45.968010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-90c73304-63b9-4785-80a6-4f96e1b24fec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:45.978908 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90c73304-63b9-4785-80a6-4f96e1b24fec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1490 microversion: 2.1 time: 0.525372 Oct 29 03:05:45.995184 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2362/4664] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:45 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1490 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:46.012138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2a204f2-7b12-4f9a-a440-910253621c1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:46.012980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f2a204f2-7b12-4f9a-a440-910253621c1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:46.021398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2a204f2-7b12-4f9a-a440-910253621c1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.022234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2a204f2-7b12-4f9a-a440-910253621c1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.022665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2a204f2-7b12-4f9a-a440-910253621c1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.023403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2a204f2-7b12-4f9a-a440-910253621c1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.023948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2a204f2-7b12-4f9a-a440-910253621c1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.024392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2a204f2-7b12-4f9a-a440-910253621c1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.074513 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1d51f2bc-d2c2-4df8-b123-b986efb70875 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 202 len: 0 microversion: 2.1 time: 0.452465 Oct 29 03:05:46.075452 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2303/4665] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:45 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:05:46.080850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:46.081784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:46.095712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.096540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.097115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.098012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.102627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.103257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.330384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:46.360190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:46.363900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:46.367271 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1b969138-042e-4d13-ab62-fd8a242632b9 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1740 microversion: 2.20 time: 0.290458 Oct 29 03:05:46.370492 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2304/4666] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:46 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:46.384321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54ffc844-38f9-4cc9-bb57-38acaaf8b267 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:46.385433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54ffc844-38f9-4cc9-bb57-38acaaf8b267 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:46.406703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f2a204f2-7b12-4f9a-a440-910253621c1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:46.408392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ffc844-38f9-4cc9-bb57-38acaaf8b267 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.409203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ffc844-38f9-4cc9-bb57-38acaaf8b267 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.409643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ffc844-38f9-4cc9-bb57-38acaaf8b267 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.410568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ffc844-38f9-4cc9-bb57-38acaaf8b267 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.414560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ffc844-38f9-4cc9-bb57-38acaaf8b267 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.415858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ffc844-38f9-4cc9-bb57-38acaaf8b267 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.432055 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f2a204f2-7b12-4f9a-a440-910253621c1e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.434952 Oct 29 03:05:46.433050 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2363/4667] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:45 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:46.438512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6f5dd39e-a7a5-4594-91f8-ca4803ae6e83 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:46.442616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6f5dd39e-a7a5-4594-91f8-ca4803ae6e83 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:46.459992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5dd39e-a7a5-4594-91f8-ca4803ae6e83 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.460651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5dd39e-a7a5-4594-91f8-ca4803ae6e83 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.461153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5dd39e-a7a5-4594-91f8-ca4803ae6e83 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.462051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5dd39e-a7a5-4594-91f8-ca4803ae6e83 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.462568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5dd39e-a7a5-4594-91f8-ca4803ae6e83 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.463051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f5dd39e-a7a5-4594-91f8-ca4803ae6e83 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.468505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54ffc844-38f9-4cc9-bb57-38acaaf8b267 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:05:46.598193 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54ffc844-38f9-4cc9-bb57-38acaaf8b267 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 204 len: 0 microversion: 2.1 time: 0.224145 Oct 29 03:05:46.599845 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2305/4668] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:05:46 2022] DELETE /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:46.608396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-53035291-20f2-4fd5-a8d9-1eff7d69bfb7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:46.609320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-53035291-20f2-4fd5-a8d9-1eff7d69bfb7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:46.616839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53035291-20f2-4fd5-a8d9-1eff7d69bfb7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.617882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53035291-20f2-4fd5-a8d9-1eff7d69bfb7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.618536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53035291-20f2-4fd5-a8d9-1eff7d69bfb7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.619500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53035291-20f2-4fd5-a8d9-1eff7d69bfb7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.620124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53035291-20f2-4fd5-a8d9-1eff7d69bfb7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.620721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53035291-20f2-4fd5-a8d9-1eff7d69bfb7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.778228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f5dd39e-a7a5-4594-91f8-ca4803ae6e83 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:46.794431 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6f5dd39e-a7a5-4594-91f8-ca4803ae6e83 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.351721 Oct 29 03:05:46.795248 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2364/4669] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:46 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:46.800457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-374d9e3c-e20f-463f-b456-839a3b37fd01 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:46.801755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-374d9e3c-e20f-463f-b456-839a3b37fd01 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:46.810065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-53035291-20f2-4fd5-a8d9-1eff7d69bfb7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:46.817100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-374d9e3c-e20f-463f-b456-839a3b37fd01 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.817873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-374d9e3c-e20f-463f-b456-839a3b37fd01 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.818518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-374d9e3c-e20f-463f-b456-839a3b37fd01 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.819411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-374d9e3c-e20f-463f-b456-839a3b37fd01 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:46.820164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-374d9e3c-e20f-463f-b456-839a3b37fd01 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:46.820546 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-53035291-20f2-4fd5-a8d9-1eff7d69bfb7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.218353 Oct 29 03:05:46.820913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-374d9e3c-e20f-463f-b456-839a3b37fd01 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:46.823313 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2306/4670] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:46 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:46.995309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1629124871", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "c699032f-5e15-4569-a5f2-71386fa3ff27"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:47.067676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] validate_networks() for [('c699032f-5e15-4569-a5f2-71386fa3ff27', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:05:47.229528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-374d9e3c-e20f-463f-b456-839a3b37fd01 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:47.266359 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-374d9e3c-e20f-463f-b456-839a3b37fd01 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1496 microversion: 2.1 time: 0.469609 Oct 29 03:05:47.272675 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2365/4671] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:46 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1496 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:47.398601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:47.399322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:47.411930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:47.415359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:47.423696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:47.425555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:47.427866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:47.433425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:47.580951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:05:47.581528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:05:47.582268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:05:47.582773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:05:47.583276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:05:47.594963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:47.595599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:47.596152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:47.597205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:47.597777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:47.598331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:47.633636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for project d4193e4464b7488b9b3bb4064afb0288. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:05:47.640675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for user dc4e17d222e0426698d1ef9a17921d64 and project d4193e4464b7488b9b3bb4064afb0288. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:05:47.656616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:05:47.659565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:05:47.729032 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a173dd6b-614e-4526-9a30-88ae5609b6d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736465 Oct 29 03:05:47.736329 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2307/4672] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:05:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:05:47.744606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a87a042a-4d33-4815-ab71-a29f46e42839 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:47.746826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a87a042a-4d33-4815-ab71-a29f46e42839 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:47.913658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a87a042a-4d33-4815-ab71-a29f46e42839 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:47.932972 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a87a042a-4d33-4815-ab71-a29f46e42839 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1215 microversion: 2.1 time: 0.195089 Oct 29 03:05:47.935058 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2308/4673] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:47 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1215 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:47.940889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f2f44f91-3553-440b-ada7-860cdb935a2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:47.940889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f2f44f91-3553-440b-ada7-860cdb935a2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:47.958591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f44f91-3553-440b-ada7-860cdb935a2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:47.959084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f44f91-3553-440b-ada7-860cdb935a2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:47.959508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f44f91-3553-440b-ada7-860cdb935a2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:47.960227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f44f91-3553-440b-ada7-860cdb935a2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:47.960650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f44f91-3553-440b-ada7-860cdb935a2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:47.961064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f44f91-3553-440b-ada7-860cdb935a2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:48.008791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:48.220160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:48.253550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:48.258970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:48.260430 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-629009e4-2ddc-4d80-a490-cbb7c558a7bc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1722 microversion: 2.20 time: 0.867634 Oct 29 03:05:48.265050 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2366/4674] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:47 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1722 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:48.292653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9a30ffa1-b1cf-49a5-9996-94617a637bf3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:48.296705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a30ffa1-b1cf-49a5-9996-94617a637bf3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:48.311473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a30ffa1-b1cf-49a5-9996-94617a637bf3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:48.312288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a30ffa1-b1cf-49a5-9996-94617a637bf3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:48.313058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a30ffa1-b1cf-49a5-9996-94617a637bf3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:48.313971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a30ffa1-b1cf-49a5-9996-94617a637bf3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:48.314604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a30ffa1-b1cf-49a5-9996-94617a637bf3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:48.315020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a30ffa1-b1cf-49a5-9996-94617a637bf3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:48.659733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9a30ffa1-b1cf-49a5-9996-94617a637bf3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:48.702527 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9a30ffa1-b1cf-49a5-9996-94617a637bf3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1496 microversion: 2.1 time: 0.413662 Oct 29 03:05:48.706645 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2367/4675] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:48 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1496 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:48.737737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-86e3b639-b48e-47c7-85c0-8d96ef3a4ad7 req-3056ecd4-c610-46ae-b529-7f3dbb0092db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f439b2b6-1302-414a-93d3-f162321fd6c6", "name": "network-vif-unplugged", "status": "completed", "tag": "291472dd-c560-4f62-ae19-0af367acb98e"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:48.766846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86e3b639-b48e-47c7-85c0-8d96ef3a4ad7 req-3056ecd4-c610-46ae-b529-7f3dbb0092db service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:48.767530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86e3b639-b48e-47c7-85c0-8d96ef3a4ad7 req-3056ecd4-c610-46ae-b529-7f3dbb0092db service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:48.768103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86e3b639-b48e-47c7-85c0-8d96ef3a4ad7 req-3056ecd4-c610-46ae-b529-7f3dbb0092db service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:48.781316 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-86e3b639-b48e-47c7-85c0-8d96ef3a4ad7 req-3056ecd4-c610-46ae-b529-7f3dbb0092db service nova] Creating event network-vif-unplugged:291472dd-c560-4f62-ae19-0af367acb98e for instance f439b2b6-1302-414a-93d3-f162321fd6c6 on n-h1-862964-4 Oct 29 03:05:48.789704 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-86e3b639-b48e-47c7-85c0-8d96ef3a4ad7 req-3056ecd4-c610-46ae-b529-7f3dbb0092db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081544 Oct 29 03:05:48.790935 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2368/4676] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:48.965472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-75aad4e4-8789-43d4-ae2a-8956957f7b19 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:48.966358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-75aad4e4-8789-43d4-ae2a-8956957f7b19 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:48.985915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75aad4e4-8789-43d4-ae2a-8956957f7b19 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:48.993128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75aad4e4-8789-43d4-ae2a-8956957f7b19 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:49.000015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75aad4e4-8789-43d4-ae2a-8956957f7b19 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:49.000983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75aad4e4-8789-43d4-ae2a-8956957f7b19 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:49.001468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75aad4e4-8789-43d4-ae2a-8956957f7b19 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:49.001932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75aad4e4-8789-43d4-ae2a-8956957f7b19 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:49.006654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f2f44f91-3553-440b-ada7-860cdb935a2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:49.029033 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f2f44f91-3553-440b-ada7-860cdb935a2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 1.092766 Oct 29 03:05:49.031517 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2309/4677] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:47 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:49.263460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-75aad4e4-8789-43d4-ae2a-8956957f7b19 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:49.273133 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-75aad4e4-8789-43d4-ae2a-8956957f7b19 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1267 microversion: 2.1 time: 0.314725 Oct 29 03:05:49.277498 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2369/4678] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:48 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1267 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:49.292299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:49.292920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:49.303353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:49.303859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:49.304296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:49.305014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:49.305465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:49.305913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:49.734071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ab3eab3-290b-47b9-8462-cd3e82c42bfc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:49.735650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1ab3eab3-290b-47b9-8462-cd3e82c42bfc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:49.758855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ab3eab3-290b-47b9-8462-cd3e82c42bfc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:49.761865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ab3eab3-290b-47b9-8462-cd3e82c42bfc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:49.762807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ab3eab3-290b-47b9-8462-cd3e82c42bfc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:49.764066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ab3eab3-290b-47b9-8462-cd3e82c42bfc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:49.764878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ab3eab3-290b-47b9-8462-cd3e82c42bfc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:49.765740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ab3eab3-290b-47b9-8462-cd3e82c42bfc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:50.021628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:50.044676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:50.050942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:50.062987 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b0b0ea79-489c-4d74-ba1d-ae402b377c12 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1722 microversion: 2.20 time: 0.775122 Oct 29 03:05:50.063595 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2310/4679] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:49 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1722 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:50.068384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5cdf3d3-a26a-43ed-bdb8-86c903e34aa5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:50.074655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d5cdf3d3-a26a-43ed-bdb8-86c903e34aa5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:50.085334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5cdf3d3-a26a-43ed-bdb8-86c903e34aa5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:50.090588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5cdf3d3-a26a-43ed-bdb8-86c903e34aa5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:50.091345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5cdf3d3-a26a-43ed-bdb8-86c903e34aa5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:50.092825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5cdf3d3-a26a-43ed-bdb8-86c903e34aa5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:50.093763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5cdf3d3-a26a-43ed-bdb8-86c903e34aa5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:50.094347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5cdf3d3-a26a-43ed-bdb8-86c903e34aa5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:50.213636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ab3eab3-290b-47b9-8462-cd3e82c42bfc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:50.223178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ab3eab3-290b-47b9-8462-cd3e82c42bfc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1496 microversion: 2.1 time: 0.495074 Oct 29 03:05:50.223779 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2370/4680] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:49 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1496 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:50.300358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1b65b530-0450-4c4b-9b05-ceeec0ab6d6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:50.301012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b65b530-0450-4c4b-9b05-ceeec0ab6d6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:50.310417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b65b530-0450-4c4b-9b05-ceeec0ab6d6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:50.310910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b65b530-0450-4c4b-9b05-ceeec0ab6d6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:50.311344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b65b530-0450-4c4b-9b05-ceeec0ab6d6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:50.312049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b65b530-0450-4c4b-9b05-ceeec0ab6d6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:50.312490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b65b530-0450-4c4b-9b05-ceeec0ab6d6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:50.323236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b65b530-0450-4c4b-9b05-ceeec0ab6d6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:50.544898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b65b530-0450-4c4b-9b05-ceeec0ab6d6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:50.557317 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1b65b530-0450-4c4b-9b05-ceeec0ab6d6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1273 microversion: 2.1 time: 0.260631 Oct 29 03:05:50.575183 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2371/4681] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:50 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:50.603860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5cdf3d3-a26a-43ed-bdb8-86c903e34aa5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:50.621465 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5cdf3d3-a26a-43ed-bdb8-86c903e34aa5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.556564 Oct 29 03:05:50.622653 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2311/4682] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:50 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:50.799347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-af270f76-d494-45b1-bc0c-59dbaf2ecb3f req-2c935e51-5623-411a-a637-f99c0ce75446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da", "name": "network-vif-deleted", "tag": "53ecbb86-8b63-4c8d-8cf4-657e826d5d1c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:50.824534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-af270f76-d494-45b1-bc0c-59dbaf2ecb3f req-2c935e51-5623-411a-a637-f99c0ce75446 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:50.825781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-af270f76-d494-45b1-bc0c-59dbaf2ecb3f req-2c935e51-5623-411a-a637-f99c0ce75446 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:50.837576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-af270f76-d494-45b1-bc0c-59dbaf2ecb3f req-2c935e51-5623-411a-a637-f99c0ce75446 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:50.864102 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-af270f76-d494-45b1-bc0c-59dbaf2ecb3f req-2c935e51-5623-411a-a637-f99c0ce75446 service nova] Creating event network-vif-deleted:53ecbb86-8b63-4c8d-8cf4-657e826d5d1c for instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da on n-h1-862964-4 Oct 29 03:05:50.871870 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-af270f76-d494-45b1-bc0c-59dbaf2ecb3f req-2c935e51-5623-411a-a637-f99c0ce75446 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077518 Oct 29 03:05:50.873262 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2372/4683] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:50.904916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-45e908a7-91f5-4c5c-9247-c458dda86f17 req-6d287fd4-e8a7-4e25-b491-2dd74c87dfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da", "name": "network-vif-unplugged", "status": "completed", "tag": "53ecbb86-8b63-4c8d-8cf4-657e826d5d1c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:50.924164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-45e908a7-91f5-4c5c-9247-c458dda86f17 req-6d287fd4-e8a7-4e25-b491-2dd74c87dfa2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:50.926274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-45e908a7-91f5-4c5c-9247-c458dda86f17 req-6d287fd4-e8a7-4e25-b491-2dd74c87dfa2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:50.926800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-45e908a7-91f5-4c5c-9247-c458dda86f17 req-6d287fd4-e8a7-4e25-b491-2dd74c87dfa2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:50.963328 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-45e908a7-91f5-4c5c-9247-c458dda86f17 req-6d287fd4-e8a7-4e25-b491-2dd74c87dfa2 service nova] Creating event network-vif-unplugged:53ecbb86-8b63-4c8d-8cf4-657e826d5d1c for instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da on n-h1-862964-4 Oct 29 03:05:50.971866 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-45e908a7-91f5-4c5c-9247-c458dda86f17 req-6d287fd4-e8a7-4e25-b491-2dd74c87dfa2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070914 Oct 29 03:05:50.975024 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2312/4684] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:51.100352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:51.101386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:51.112911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.116947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.119755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.120873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.121478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.122955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.249548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-10c0a6c0-3c86-4dab-8252-f4d0f49611fe tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:51.250887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-10c0a6c0-3c86-4dab-8252-f4d0f49611fe tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:51.275815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10c0a6c0-3c86-4dab-8252-f4d0f49611fe tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.275815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10c0a6c0-3c86-4dab-8252-f4d0f49611fe tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.275815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10c0a6c0-3c86-4dab-8252-f4d0f49611fe tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.275815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10c0a6c0-3c86-4dab-8252-f4d0f49611fe tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.275815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10c0a6c0-3c86-4dab-8252-f4d0f49611fe tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.276224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10c0a6c0-3c86-4dab-8252-f4d0f49611fe tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.516321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-10c0a6c0-3c86-4dab-8252-f4d0f49611fe tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:51.536309 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-10c0a6c0-3c86-4dab-8252-f4d0f49611fe tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1454 microversion: 2.1 time: 0.292067 Oct 29 03:05:51.564945 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2313/4685] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:51 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1454 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:51.593219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c65cbe68-5a1a-470d-a44e-0b8fb62ce4cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:51.595622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c65cbe68-5a1a-470d-a44e-0b8fb62ce4cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:51.615641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65cbe68-5a1a-470d-a44e-0b8fb62ce4cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.617208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65cbe68-5a1a-470d-a44e-0b8fb62ce4cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.646873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65cbe68-5a1a-470d-a44e-0b8fb62ce4cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.660916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65cbe68-5a1a-470d-a44e-0b8fb62ce4cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.666810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65cbe68-5a1a-470d-a44e-0b8fb62ce4cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.667569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c65cbe68-5a1a-470d-a44e-0b8fb62ce4cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.811903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:51.824188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:51.826330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:51.827524 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6f0430c3-9f1b-4b0d-8236-c875891171e6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1722 microversion: 2.20 time: 0.734444 Oct 29 03:05:51.831758 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2373/4686] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:51 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1722 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:51.847118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6ec2e96-db60-4307-a936-d1f6d9639977 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:51.848025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b6ec2e96-db60-4307-a936-d1f6d9639977 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:51.862391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ec2e96-db60-4307-a936-d1f6d9639977 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.869006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ec2e96-db60-4307-a936-d1f6d9639977 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.869620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ec2e96-db60-4307-a936-d1f6d9639977 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.870920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ec2e96-db60-4307-a936-d1f6d9639977 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.871243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ec2e96-db60-4307-a936-d1f6d9639977 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.871822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6ec2e96-db60-4307-a936-d1f6d9639977 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.949695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c65cbe68-5a1a-470d-a44e-0b8fb62ce4cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:51.964074 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c65cbe68-5a1a-470d-a44e-0b8fb62ce4cb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1273 microversion: 2.1 time: 0.380280 Oct 29 03:05:51.967790 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2314/4687] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:51 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1273 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:52.581928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:52.583827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:52.596697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:52.597827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:52.598665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:52.599668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:52.600272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:52.601115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:52.694773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:52.702840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:52.705913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:52.706592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lazy-loading 'fault' on Instance uuid d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:05:52.732287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b6ec2e96-db60-4307-a936-d1f6d9639977 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:52.751930 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6ec2e96-db60-4307-a936-d1f6d9639977 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.912307 Oct 29 03:05:52.757764 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2374/4688] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:51 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:52.841713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:52.857042 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7b96c82-0d02-4009-95c9-50536a032b19 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 200 len: 1299 microversion: 2.1 time: 0.282100 Oct 29 03:05:52.857429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:52.858621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:52.863046 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2315/4689] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:52 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 1299 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:52.870454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:52.872243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:52.873039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:52.874756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:52.877344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:52.878004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:52.988105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-812a167c-5356-4ab8-ac47-1777bf38c16e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:52.989435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-812a167c-5356-4ab8-ac47-1777bf38c16e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:52.999111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-812a167c-5356-4ab8-ac47-1777bf38c16e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:53.002468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-812a167c-5356-4ab8-ac47-1777bf38c16e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:53.003040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-812a167c-5356-4ab8-ac47-1777bf38c16e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:53.006314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-812a167c-5356-4ab8-ac47-1777bf38c16e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:53.006815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-812a167c-5356-4ab8-ac47-1777bf38c16e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:53.007402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-812a167c-5356-4ab8-ac47-1777bf38c16e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:53.295578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:53.317339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:53.319193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:53.320628 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-19c95ae6-d883-40e6-854f-dd249a4e7295 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1725 microversion: 2.20 time: 0.467400 Oct 29 03:05:53.321744 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2375/4690] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:52 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1725 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:53.350753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1db13c13-8c96-4065-a04a-0c5917842e11 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce450d02-40a0-4751-95c8-d0be2036fb85"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:53.353899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1db13c13-8c96-4065-a04a-0c5917842e11 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:53.364917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1db13c13-8c96-4065-a04a-0c5917842e11 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:53.365612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1db13c13-8c96-4065-a04a-0c5917842e11 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:53.366381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1db13c13-8c96-4065-a04a-0c5917842e11 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:53.367395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1db13c13-8c96-4065-a04a-0c5917842e11 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:53.369773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1db13c13-8c96-4065-a04a-0c5917842e11 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:53.370424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1db13c13-8c96-4065-a04a-0c5917842e11 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:54.011062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:54.015832 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1db13c13-8c96-4065-a04a-0c5917842e11 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "POST /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.670824 Oct 29 03:05:54.022228 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2376/4691] 10.222.0.16 () {62 vars in 1364 bytes} [Sat Oct 29 03:05:53 2022] POST /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/os-volume_attachments => generated 188 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:05:54.045313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be0ed517-2253-44a1-a102-0c8176296ae3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:54.046036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-be0ed517-2253-44a1-a102-0c8176296ae3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:54.072731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be0ed517-2253-44a1-a102-0c8176296ae3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:54.085274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be0ed517-2253-44a1-a102-0c8176296ae3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:54.094562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be0ed517-2253-44a1-a102-0c8176296ae3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:54.097687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be0ed517-2253-44a1-a102-0c8176296ae3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:54.098632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be0ed517-2253-44a1-a102-0c8176296ae3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:54.101962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-812a167c-5356-4ab8-ac47-1777bf38c16e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:54.111945 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-812a167c-5356-4ab8-ac47-1777bf38c16e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1315 microversion: 2.1 time: 1.127761 Oct 29 03:05:54.112540 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2316/4692] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:52 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1315 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:54.114030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be0ed517-2253-44a1-a102-0c8176296ae3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:54.147439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:54.151147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:54.169021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:54.170118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:54.171864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:54.174499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:54.175128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:54.176700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:54.212351 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da HTTP/1.1 Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'd7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da'} Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:54.223149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:54.228252 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:54.228252 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:54.228252 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:54.228252 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:54.228252 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:05:54.228252 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:05:54.228252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:54.228252 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-01e9c316-b887-4d2f-a25e-def408eeda02 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 404 len: 111 microversion: 2.1 time: 0.089971 Oct 29 03:05:54.228252 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2317/4693] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:54 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:54.244899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d774b04e-498b-417f-9135-fb499c304457 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:54.245399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d774b04e-498b-417f-9135-fb499c304457 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:54.261298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d774b04e-498b-417f-9135-fb499c304457 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:54.261795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d774b04e-498b-417f-9135-fb499c304457 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:54.263707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d774b04e-498b-417f-9135-fb499c304457 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:54.264477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d774b04e-498b-417f-9135-fb499c304457 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:54.267373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d774b04e-498b-417f-9135-fb499c304457 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:54.267829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d774b04e-498b-417f-9135-fb499c304457 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:54.334304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d774b04e-498b-417f-9135-fb499c304457 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:05:54.526921 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d774b04e-498b-417f-9135-fb499c304457 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 204 len: 0 microversion: 2.1 time: 0.289889 Oct 29 03:05:54.530188 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2318/4694] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:05:54 2022] DELETE /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:54.552272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7e1442de-9eb8-43db-9d15-c7d4b919b3a0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:54.552901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7e1442de-9eb8-43db-9d15-c7d4b919b3a0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:54.566722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e1442de-9eb8-43db-9d15-c7d4b919b3a0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:54.567207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e1442de-9eb8-43db-9d15-c7d4b919b3a0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:54.567637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e1442de-9eb8-43db-9d15-c7d4b919b3a0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:54.568408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e1442de-9eb8-43db-9d15-c7d4b919b3a0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:54.575287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e1442de-9eb8-43db-9d15-c7d4b919b3a0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:54.576034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e1442de-9eb8-43db-9d15-c7d4b919b3a0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:54.780682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-be0ed517-2253-44a1-a102-0c8176296ae3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:54.792091 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be0ed517-2253-44a1-a102-0c8176296ae3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.772418 Oct 29 03:05:54.831365 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2377/4695] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:54 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:54.836410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5db1f31e-a5bb-4979-beb6-2d460e15e086 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:54.837269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5db1f31e-a5bb-4979-beb6-2d460e15e086 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:54.844505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5db1f31e-a5bb-4979-beb6-2d460e15e086 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:54.845169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5db1f31e-a5bb-4979-beb6-2d460e15e086 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:54.845797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5db1f31e-a5bb-4979-beb6-2d460e15e086 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:54.846681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5db1f31e-a5bb-4979-beb6-2d460e15e086 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:54.847290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5db1f31e-a5bb-4979-beb6-2d460e15e086 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:54.848012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5db1f31e-a5bb-4979-beb6-2d460e15e086 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:55.060484 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7e1442de-9eb8-43db-9d15-c7d4b919b3a0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/os-volume_attachments/ce450d02-40a0-4751-95c8-d0be2036fb85" status: 202 len: 0 microversion: 2.20 time: 0.527248 Oct 29 03:05:55.061334 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2319/4696] 10.222.0.16 () {60 vars in 1457 bytes} [Sat Oct 29 03:05:54 2022] DELETE /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/os-volume_attachments/ce450d02-40a0-4751-95c8-d0be2036fb85 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:55.151631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b1ada145-a233-4ccd-a832-abf5a365e612 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:55.153170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b1ada145-a233-4ccd-a832-abf5a365e612 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:55.164398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1ada145-a233-4ccd-a832-abf5a365e612 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:55.164825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1ada145-a233-4ccd-a832-abf5a365e612 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:55.165261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1ada145-a233-4ccd-a832-abf5a365e612 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:55.166009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1ada145-a233-4ccd-a832-abf5a365e612 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:55.166464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1ada145-a233-4ccd-a832-abf5a365e612 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:55.166885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b1ada145-a233-4ccd-a832-abf5a365e612 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:55.411436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5db1f31e-a5bb-4979-beb6-2d460e15e086 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:55.429313 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5db1f31e-a5bb-4979-beb6-2d460e15e086 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1496 microversion: 2.1 time: 0.596421 Oct 29 03:05:55.434442 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2378/4697] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:54 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1496 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:55.444802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51ff2f6f-d79e-4cae-9c62-55ef5fa19f42 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:55.445671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-51ff2f6f-d79e-4cae-9c62-55ef5fa19f42 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:55.459499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ff2f6f-d79e-4cae-9c62-55ef5fa19f42 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:55.459992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ff2f6f-d79e-4cae-9c62-55ef5fa19f42 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:55.460420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ff2f6f-d79e-4cae-9c62-55ef5fa19f42 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:55.461119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ff2f6f-d79e-4cae-9c62-55ef5fa19f42 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:55.461563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ff2f6f-d79e-4cae-9c62-55ef5fa19f42 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:55.462015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ff2f6f-d79e-4cae-9c62-55ef5fa19f42 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:55.603858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-51ff2f6f-d79e-4cae-9c62-55ef5fa19f42 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127042) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 03:05:55.782763 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-51ff2f6f-d79e-4cae-9c62-55ef5fa19f42 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "POST /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/action" status: 202 len: 0 microversion: 2.20 time: 0.346859 Oct 29 03:05:55.783402 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2379/4698] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Oct 29 03:05:55 2022] POST /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:55.799536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:55.800154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:55.819300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b1ada145-a233-4ccd-a832-abf5a365e612 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:55.826050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:55.826889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:55.831576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:55.833719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:55.836391 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b1ada145-a233-4ccd-a832-abf5a365e612 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1315 microversion: 2.1 time: 0.687652 Oct 29 03:05:55.838446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:55.840798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:55.850512 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2320/4699] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:55 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:55.860791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d33bfe91-7e39-43bd-bedd-5782f7ad6630 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:55.861399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d33bfe91-7e39-43bd-bedd-5782f7ad6630 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:55.913358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d33bfe91-7e39-43bd-bedd-5782f7ad6630 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:55.914359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d33bfe91-7e39-43bd-bedd-5782f7ad6630 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:55.914488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d33bfe91-7e39-43bd-bedd-5782f7ad6630 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:55.915334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d33bfe91-7e39-43bd-bedd-5782f7ad6630 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:55.918233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d33bfe91-7e39-43bd-bedd-5782f7ad6630 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:55.918664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d33bfe91-7e39-43bd-bedd-5782f7ad6630 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:56.271526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:56.287338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:56.289032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:56.294345 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-02d2efeb-f7b1-4ff2-acbb-235429f91823 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1673 microversion: 2.20 time: 0.499450 Oct 29 03:05:56.326848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2380/4700] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:55 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1673 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:56.349320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4322cc44-5d72-4358-95cf-9b1f7367e190 req-427c2ef7-47e2-4d71-9c7c-b1102a007b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fdf9998-e29c-42b9-9f11-0ee63dd05901", "tag": "a9efba69-8d4a-400d-b346-7a0ea12c04fe"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:56.375647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4322cc44-5d72-4358-95cf-9b1f7367e190 req-427c2ef7-47e2-4d71-9c7c-b1102a007b8f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.380727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4322cc44-5d72-4358-95cf-9b1f7367e190 req-427c2ef7-47e2-4d71-9c7c-b1102a007b8f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.381261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4322cc44-5d72-4358-95cf-9b1f7367e190 req-427c2ef7-47e2-4d71-9c7c-b1102a007b8f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:56.400894 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4322cc44-5d72-4358-95cf-9b1f7367e190 req-427c2ef7-47e2-4d71-9c7c-b1102a007b8f service nova] Creating event network-changed:a9efba69-8d4a-400d-b346-7a0ea12c04fe for instance 6fdf9998-e29c-42b9-9f11-0ee63dd05901 on n-h1-862964-4 Oct 29 03:05:56.415388 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4322cc44-5d72-4358-95cf-9b1f7367e190 req-427c2ef7-47e2-4d71-9c7c-b1102a007b8f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086711 Oct 29 03:05:56.418204 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2381/4701] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:56.460885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7a6664fd-a616-4c8b-a27d-c679de8c5b04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:56.462581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7a6664fd-a616-4c8b-a27d-c679de8c5b04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:56.477114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a6664fd-a616-4c8b-a27d-c679de8c5b04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.478287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a6664fd-a616-4c8b-a27d-c679de8c5b04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.478950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a6664fd-a616-4c8b-a27d-c679de8c5b04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:56.479880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a6664fd-a616-4c8b-a27d-c679de8c5b04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.486575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a6664fd-a616-4c8b-a27d-c679de8c5b04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.487616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a6664fd-a616-4c8b-a27d-c679de8c5b04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:56.551528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d33bfe91-7e39-43bd-bedd-5782f7ad6630 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:56.597955 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d33bfe91-7e39-43bd-bedd-5782f7ad6630 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.741502 Oct 29 03:05:56.598811 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2321/4702] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:55 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:56.873016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3513f592-7370-4e2d-a144-17de6927a11d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:56.873662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3513f592-7370-4e2d-a144-17de6927a11d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:56.895420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3513f592-7370-4e2d-a144-17de6927a11d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.896037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3513f592-7370-4e2d-a144-17de6927a11d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.896490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3513f592-7370-4e2d-a144-17de6927a11d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:56.897241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3513f592-7370-4e2d-a144-17de6927a11d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.897697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3513f592-7370-4e2d-a144-17de6927a11d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.898146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3513f592-7370-4e2d-a144-17de6927a11d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:57.005384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:57.340472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7a6664fd-a616-4c8b-a27d-c679de8c5b04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:57.349400 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7a6664fd-a616-4c8b-a27d-c679de8c5b04 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1496 microversion: 2.1 time: 0.893097 Oct 29 03:05:57.353715 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2382/4703] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:56 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1496 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:57.364379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:57.374237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:57.381428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3513f592-7370-4e2d-a144-17de6927a11d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:57.381731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:57.382505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:57.383144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:57.384181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:57.384839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:57.386785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:57.390074 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3513f592-7370-4e2d-a144-17de6927a11d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1315 microversion: 2.1 time: 0.520965 Oct 29 03:05:57.390661 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2322/4704] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:56 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:57.628994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e56554b7-b27d-449a-aa50-486dcd441dd8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:57.630438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e56554b7-b27d-449a-aa50-486dcd441dd8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:57.635995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:57.637889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e56554b7-b27d-449a-aa50-486dcd441dd8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:57.638676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e56554b7-b27d-449a-aa50-486dcd441dd8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:57.639829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e56554b7-b27d-449a-aa50-486dcd441dd8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:57.640883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e56554b7-b27d-449a-aa50-486dcd441dd8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:57.641549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e56554b7-b27d-449a-aa50-486dcd441dd8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:57.642284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e56554b7-b27d-449a-aa50-486dcd441dd8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:57.922005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:58.173797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e56554b7-b27d-449a-aa50-486dcd441dd8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:58.189323 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e56554b7-b27d-449a-aa50-486dcd441dd8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.564413 Oct 29 03:05:58.211222 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2323/4705] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:57 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:58.381763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-49d42359-9099-49dc-9bcf-66c1c41ec041 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:58.382505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-49d42359-9099-49dc-9bcf-66c1c41ec041 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:58.398937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d42359-9099-49dc-9bcf-66c1c41ec041 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:58.400355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d42359-9099-49dc-9bcf-66c1c41ec041 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:58.400871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d42359-9099-49dc-9bcf-66c1c41ec041 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:58.401690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d42359-9099-49dc-9bcf-66c1c41ec041 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:58.402306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d42359-9099-49dc-9bcf-66c1c41ec041 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:58.402823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49d42359-9099-49dc-9bcf-66c1c41ec041 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:58.505356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:58.531789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:58.538446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:58.539921 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-84c5bbef-3f10-4b16-a5ac-30417314e83d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1673 microversion: 2.20 time: 1.185128 Oct 29 03:05:58.573630 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2383/4706] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:57 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1673 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:58.592694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d2d5cbe8-fb89-438c-aeb6-ec83251162f3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:58.593482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d2d5cbe8-fb89-438c-aeb6-ec83251162f3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:58.624329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2d5cbe8-fb89-438c-aeb6-ec83251162f3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:58.628803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2d5cbe8-fb89-438c-aeb6-ec83251162f3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:58.630539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2d5cbe8-fb89-438c-aeb6-ec83251162f3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:58.632850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2d5cbe8-fb89-438c-aeb6-ec83251162f3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:58.633756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2d5cbe8-fb89-438c-aeb6-ec83251162f3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:58.634250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2d5cbe8-fb89-438c-aeb6-ec83251162f3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:58.715277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-49d42359-9099-49dc-9bcf-66c1c41ec041 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:58.729756 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-49d42359-9099-49dc-9bcf-66c1c41ec041 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1454 microversion: 2.1 time: 0.353659 Oct 29 03:05:58.730724 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2324/4707] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:58 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1454 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:58.744487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ae4d8877-631f-4f23-9c3e-74a26ac0e708 req-34adcd34-5bd5-474d-8147-3b5147e04834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54089ec6-4554-46bf-a61c-4a3423ae07f4", "name": "network-vif-deleted", "tag": "77df88e9-5d35-4d92-b335-b3f542c8f6cd"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:58.787071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ae4d8877-631f-4f23-9c3e-74a26ac0e708 req-34adcd34-5bd5-474d-8147-3b5147e04834 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:58.787559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ae4d8877-631f-4f23-9c3e-74a26ac0e708 req-34adcd34-5bd5-474d-8147-3b5147e04834 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:58.789217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ae4d8877-631f-4f23-9c3e-74a26ac0e708 req-34adcd34-5bd5-474d-8147-3b5147e04834 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:58.849116 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ae4d8877-631f-4f23-9c3e-74a26ac0e708 req-34adcd34-5bd5-474d-8147-3b5147e04834 service nova] Creating event network-vif-deleted:77df88e9-5d35-4d92-b335-b3f542c8f6cd for instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 on n-h2-862964-4 Oct 29 03:05:58.902293 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ae4d8877-631f-4f23-9c3e-74a26ac0e708 req-34adcd34-5bd5-474d-8147-3b5147e04834 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166859 Oct 29 03:05:58.909191 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2325/4708] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:59.224640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f98e6c2-76ff-441c-a480-35b2f8b5b729 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:59.227513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f98e6c2-76ff-441c-a480-35b2f8b5b729 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:59.257085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f98e6c2-76ff-441c-a480-35b2f8b5b729 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:59.262236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d2d5cbe8-fb89-438c-aeb6-ec83251162f3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:59.266425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f98e6c2-76ff-441c-a480-35b2f8b5b729 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:59.267842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f98e6c2-76ff-441c-a480-35b2f8b5b729 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:59.268739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f98e6c2-76ff-441c-a480-35b2f8b5b729 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:59.270960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f98e6c2-76ff-441c-a480-35b2f8b5b729 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:59.271413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f98e6c2-76ff-441c-a480-35b2f8b5b729 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:59.276627 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d2d5cbe8-fb89-438c-aeb6-ec83251162f3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1315 microversion: 2.1 time: 0.698674 Oct 29 03:05:59.277564 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2384/4709] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:58 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:59.576384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:59.578701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:59.598590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:59.599088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:59.599513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:59.600208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:59.600647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:59.601058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:59.667790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f98e6c2-76ff-441c-a480-35b2f8b5b729 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:59.683708 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f98e6c2-76ff-441c-a480-35b2f8b5b729 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.461086 Oct 29 03:05:59.685886 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2326/4710] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:59 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:59.760774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:59.762258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:59.777961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:59.780895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:59.782085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:59.783859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:59.784629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:59.786166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:59.889139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:59.889636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:59.890443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:59.891040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lazy-loading 'fault' on Instance uuid 54089ec6-4554-46bf-a61c-4a3423ae07f4 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:06:00.060248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:00.068833 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4145c7c0-2148-46ed-a9d6-06e3ed1a453c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 200 len: 1299 microversion: 2.1 time: 0.313401 Oct 29 03:06:00.093283 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2327/4711] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:59 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 1299 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:00.257120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:00.284621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:00.286206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:00.287422 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0c5228ba-29a4-41b4-a71a-3611d86c2fc3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.721242 Oct 29 03:06:00.302485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-362b3b9d-c4c1-4622-9269-906906e163d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:00.303077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-362b3b9d-c4c1-4622-9269-906906e163d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:00.307303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2385/4712] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:59 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:00.332807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-362b3b9d-c4c1-4622-9269-906906e163d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.333356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-362b3b9d-c4c1-4622-9269-906906e163d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.333819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-362b3b9d-c4c1-4622-9269-906906e163d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:00.334563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-362b3b9d-c4c1-4622-9269-906906e163d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.335012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-362b3b9d-c4c1-4622-9269-906906e163d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.335434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-362b3b9d-c4c1-4622-9269-906906e163d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:00.667451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-362b3b9d-c4c1-4622-9269-906906e163d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:00.675691 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-362b3b9d-c4c1-4622-9269-906906e163d3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1315 microversion: 2.1 time: 0.377232 Oct 29 03:06:00.676288 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2328/4713] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:00 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:00.716593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6425187b-dbac-4162-bffb-09fb3a736d2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:00.717513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6425187b-dbac-4162-bffb-09fb3a736d2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:00.740114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6425187b-dbac-4162-bffb-09fb3a736d2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.742933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6425187b-dbac-4162-bffb-09fb3a736d2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.744593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6425187b-dbac-4162-bffb-09fb3a736d2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:00.748879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6425187b-dbac-4162-bffb-09fb3a736d2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.752301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6425187b-dbac-4162-bffb-09fb3a736d2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.753227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6425187b-dbac-4162-bffb-09fb3a736d2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:01.093301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:01.094209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:01.107727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:01.108242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:01.108660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:01.109362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:01.109827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:01.111242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:01.176948 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 HTTP/1.1 Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '54089ec6-4554-46bf-a61c-4a3423ae07f4'} Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:01.178956 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:01.183376 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:01.183376 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:01.183376 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:06:01.183376 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:06:01.183376 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:06:01.183376 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:01.183376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:01.183376 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5978303-8448-47bb-961b-23d02baa2876 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 404 len: 111 microversion: 2.1 time: 0.091395 Oct 29 03:06:01.183376 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2329/4714] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:01 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:06:01.383412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1646895756", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "c769d1c5-33b4-4c34-a25d-0963f6922b0d"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:01.467575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] validate_networks() for [('c769d1c5-33b4-4c34-a25d-0963f6922b0d', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:06:01.478151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6425187b-dbac-4162-bffb-09fb3a736d2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:01.488378 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6425187b-dbac-4162-bffb-09fb3a736d2e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.783338 Oct 29 03:06:01.491601 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2386/4715] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:00 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:01.505927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:01.506699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:01.517955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:01.518590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:01.519144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:01.519956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:01.524987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:01.525469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:01.934154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:01.957609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:01.959234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:01.960647 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0e208e06-5640-4286-89e7-d536a1f1bb7f tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.467792 Oct 29 03:06:01.961396 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2387/4716] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:01 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:01.967316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1013435301", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "204a19c0-c3a9-46eb-85da-9d12d0451025"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:02.077974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] validate_networks() for [('204a19c0-c3a9-46eb-85da-9d12d0451025', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:06:02.613448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:06:02.614077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:06:02.614360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:06:02.614765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:06:02.615169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:06:02.630533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:02.631021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:02.631452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:02.632178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:02.632631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:02.633051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:02.652003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Getting quotas for project 2e8d515c679e481b83d7001b99442d35. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:06:02.657966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Getting quotas for user 735d6338d29c46ee9b6065580413f201 and project 2e8d515c679e481b83d7001b99442d35. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:06:02.671859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:06:02.673962 n-d-862964-4 devstack@n-api.service[127041]: WARNING nova.utils [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1646895756 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-164689575 Oct 29 03:06:02.674714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:06:02.704117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:02.755208 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e710a03c-1433-4dfb-b43a-9e6f23f829b7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.568221 Oct 29 03:06:02.755801 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2330/4717] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:06:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:06:02.764462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d1336f6d-8f28-47b0-ab0c-d9d10d9ec19a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:02.765077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d1336f6d-8f28-47b0-ab0c-d9d10d9ec19a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:02.781432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1336f6d-8f28-47b0-ab0c-d9d10d9ec19a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:02.782097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1336f6d-8f28-47b0-ab0c-d9d10d9ec19a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:02.782561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1336f6d-8f28-47b0-ab0c-d9d10d9ec19a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:02.783267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1336f6d-8f28-47b0-ab0c-d9d10d9ec19a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:02.783718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1336f6d-8f28-47b0-ab0c-d9d10d9ec19a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:02.784136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1336f6d-8f28-47b0-ab0c-d9d10d9ec19a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:03.059144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d1336f6d-8f28-47b0-ab0c-d9d10d9ec19a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:03.073479 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d1336f6d-8f28-47b0-ab0c-d9d10d9ec19a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1315 microversion: 2.1 time: 0.315217 Oct 29 03:06:03.076152 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2331/4718] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:02 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:03.083703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-23db5269-da11-4ca3-8035-98b2ad58d83b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:03.084587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-23db5269-da11-4ca3-8035-98b2ad58d83b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:03.089072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:06:03.089634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:06:03.090138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:06:03.090733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:06:03.091226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:06:03.096842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db5269-da11-4ca3-8035-98b2ad58d83b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:03.097497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db5269-da11-4ca3-8035-98b2ad58d83b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:03.098392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db5269-da11-4ca3-8035-98b2ad58d83b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:03.099698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db5269-da11-4ca3-8035-98b2ad58d83b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:03.100641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db5269-da11-4ca3-8035-98b2ad58d83b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:03.101288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db5269-da11-4ca3-8035-98b2ad58d83b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:03.111155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:03.114869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:03.115967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:03.119701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:03.121772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:03.122463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:03.149824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:06:03.157040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for user cecadca739554f858c269b85690b5cec and project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:06:03.174015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:06:03.176552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:06:03.240088 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dfffd9c2-b49b-4e47-b3bf-98b103dfd6aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.277400 Oct 29 03:06:03.247184 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2388/4719] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:06:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:06:03.251179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-560b985c-8e52-467a-b3c8-5cbf1ecbc1ea tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:03.252037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-560b985c-8e52-467a-b3c8-5cbf1ecbc1ea tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:03.397928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-560b985c-8e52-467a-b3c8-5cbf1ecbc1ea tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:03.410332 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-560b985c-8e52-467a-b3c8-5cbf1ecbc1ea tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1232 microversion: 2.1 time: 0.163976 Oct 29 03:06:03.411022 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2389/4720] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:03 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1232 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:03.420150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:03.420933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:03.438972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:03.439388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:03.439838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:03.440535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:03.443253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:03.443697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:03.728781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-23db5269-da11-4ca3-8035-98b2ad58d83b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:03.753034 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-23db5269-da11-4ca3-8035-98b2ad58d83b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1533 microversion: 2.1 time: 0.667774 Oct 29 03:06:03.753711 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2332/4721] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:03 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1533 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:03.787875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1d5c0440-18cd-4b92-b9a9-8719b2cde330 req-e17fea4e-aa2d-401b-b6fc-c49de6e1a3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f439b2b6-1302-414a-93d3-f162321fd6c6", "tag": "291472dd-c560-4f62-ae19-0af367acb98e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:03.825384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1d5c0440-18cd-4b92-b9a9-8719b2cde330 req-e17fea4e-aa2d-401b-b6fc-c49de6e1a3c5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:03.826006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1d5c0440-18cd-4b92-b9a9-8719b2cde330 req-e17fea4e-aa2d-401b-b6fc-c49de6e1a3c5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:03.826444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1d5c0440-18cd-4b92-b9a9-8719b2cde330 req-e17fea4e-aa2d-401b-b6fc-c49de6e1a3c5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:03.845418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:03.856006 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1d5c0440-18cd-4b92-b9a9-8719b2cde330 req-e17fea4e-aa2d-401b-b6fc-c49de6e1a3c5 service nova] Creating event network-changed:291472dd-c560-4f62-ae19-0af367acb98e for instance f439b2b6-1302-414a-93d3-f162321fd6c6 on n-h2-862964-4 Oct 29 03:06:03.878232 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1d5c0440-18cd-4b92-b9a9-8719b2cde330 req-e17fea4e-aa2d-401b-b6fc-c49de6e1a3c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099263 Oct 29 03:06:03.881534 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2333/4722] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:03.885539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:03.888041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:03.889713 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4dd950db-2ef4-402c-ae9d-2acaa0cb0d19 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.476330 Oct 29 03:06:03.890317 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2390/4723] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:03 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:03.895710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-14b3bc3f-5051-4b2d-9eb7-bb1359b0bde8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:03.896608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-14b3bc3f-5051-4b2d-9eb7-bb1359b0bde8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:04.000506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-14b3bc3f-5051-4b2d-9eb7-bb1359b0bde8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:04.010214 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-14b3bc3f-5051-4b2d-9eb7-bb1359b0bde8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1209 microversion: 2.1 time: 0.124855 Oct 29 03:06:04.014837 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2334/4724] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:03 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1209 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:04.098911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4280818b-67fa-45c3-bc1c-963c0922a709 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:04.103383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4280818b-67fa-45c3-bc1c-963c0922a709 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:04.125625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4280818b-67fa-45c3-bc1c-963c0922a709 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:04.130523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4280818b-67fa-45c3-bc1c-963c0922a709 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:04.131191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4280818b-67fa-45c3-bc1c-963c0922a709 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:04.132157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4280818b-67fa-45c3-bc1c-963c0922a709 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:04.132768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4280818b-67fa-45c3-bc1c-963c0922a709 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:04.140418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4280818b-67fa-45c3-bc1c-963c0922a709 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:04.435036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ae67d820-989d-4ca4-8a1e-04ab7c7e4ab9 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:04.435663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ae67d820-989d-4ca4-8a1e-04ab7c7e4ab9 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:04.452030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae67d820-989d-4ca4-8a1e-04ab7c7e4ab9 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:04.452524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae67d820-989d-4ca4-8a1e-04ab7c7e4ab9 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:04.455336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae67d820-989d-4ca4-8a1e-04ab7c7e4ab9 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:04.456097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae67d820-989d-4ca4-8a1e-04ab7c7e4ab9 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:04.457310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae67d820-989d-4ca4-8a1e-04ab7c7e4ab9 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:04.457739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae67d820-989d-4ca4-8a1e-04ab7c7e4ab9 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:04.467187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4280818b-67fa-45c3-bc1c-963c0922a709 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:04.481950 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4280818b-67fa-45c3-bc1c-963c0922a709 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1315 microversion: 2.1 time: 0.383414 Oct 29 03:06:04.484601 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2391/4725] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:04 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:04.642243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ae67d820-989d-4ca4-8a1e-04ab7c7e4ab9 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:04.654271 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ae67d820-989d-4ca4-8a1e-04ab7c7e4ab9 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1284 microversion: 2.1 time: 0.224851 Oct 29 03:06:04.655544 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2335/4726] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:04 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:04.781915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5b58bc5f-c117-4ee6-b8fb-3ec06cd1c2df tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:04.782530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5b58bc5f-c117-4ee6-b8fb-3ec06cd1c2df tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:04.792086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b58bc5f-c117-4ee6-b8fb-3ec06cd1c2df tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:04.792572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b58bc5f-c117-4ee6-b8fb-3ec06cd1c2df tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:04.794136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b58bc5f-c117-4ee6-b8fb-3ec06cd1c2df tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:04.795918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b58bc5f-c117-4ee6-b8fb-3ec06cd1c2df tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:04.796711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b58bc5f-c117-4ee6-b8fb-3ec06cd1c2df tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:04.798837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b58bc5f-c117-4ee6-b8fb-3ec06cd1c2df tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:04.920224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:04.920850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:04.939407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:04.940295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:04.940743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:04.941566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:04.942075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:04.942506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:05.714043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:05.730046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:05.733306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:05.740808 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-294b1923-1493-40de-85b1-461a2bfb5302 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.829227 Oct 29 03:06:05.742298 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2336/4727] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:04 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:06:05.760914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9dd3607-d2a7-4337-80b2-36c4da8f491c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:05.764484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9dd3607-d2a7-4337-80b2-36c4da8f491c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:05.778879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9dd3607-d2a7-4337-80b2-36c4da8f491c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:05.780475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9dd3607-d2a7-4337-80b2-36c4da8f491c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:05.782554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9dd3607-d2a7-4337-80b2-36c4da8f491c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:05.784287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9dd3607-d2a7-4337-80b2-36c4da8f491c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:05.785822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9dd3607-d2a7-4337-80b2-36c4da8f491c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:05.788243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9dd3607-d2a7-4337-80b2-36c4da8f491c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:06.039155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5b58bc5f-c117-4ee6-b8fb-3ec06cd1c2df tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:06.065668 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5b58bc5f-c117-4ee6-b8fb-3ec06cd1c2df tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1528 microversion: 2.1 time: 1.288894 Oct 29 03:06:06.078468 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2392/4728] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:04 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1528 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:06.103866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7456416b-e4ca-4016-9a02-8bfaaa95ed04 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:06.108538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7456416b-e4ca-4016-9a02-8bfaaa95ed04 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:06.156469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7456416b-e4ca-4016-9a02-8bfaaa95ed04 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:06.157077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7456416b-e4ca-4016-9a02-8bfaaa95ed04 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:06.162259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7456416b-e4ca-4016-9a02-8bfaaa95ed04 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:06.171441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7456416b-e4ca-4016-9a02-8bfaaa95ed04 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:06.171996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7456416b-e4ca-4016-9a02-8bfaaa95ed04 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:06.179820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7456416b-e4ca-4016-9a02-8bfaaa95ed04 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:06.328573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a9dd3607-d2a7-4337-80b2-36c4da8f491c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:06.344553 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9dd3607-d2a7-4337-80b2-36c4da8f491c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1261 microversion: 2.1 time: 0.600555 Oct 29 03:06:06.349480 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2337/4729] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:05 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1261 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:06.377966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-abf5333b-9587-4565-bf98-f21eeda13a6f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:06.382217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-abf5333b-9587-4565-bf98-f21eeda13a6f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:06.401912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abf5333b-9587-4565-bf98-f21eeda13a6f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:06.404410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abf5333b-9587-4565-bf98-f21eeda13a6f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:06.409874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abf5333b-9587-4565-bf98-f21eeda13a6f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:06.411877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abf5333b-9587-4565-bf98-f21eeda13a6f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:06.412521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abf5333b-9587-4565-bf98-f21eeda13a6f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:06.413780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-abf5333b-9587-4565-bf98-f21eeda13a6f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:06.685431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-abf5333b-9587-4565-bf98-f21eeda13a6f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:06.695943 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-abf5333b-9587-4565-bf98-f21eeda13a6f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1290 microversion: 2.1 time: 0.342451 Oct 29 03:06:06.696548 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2338/4730] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:06 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1290 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:06.771550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:06.773089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:06.795385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:06.800240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:06.810593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:06.811661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:06.812284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:06.814301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:07.395813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:07.417441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:07.420434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:07.422418 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b2bd88be-ea72-4bb6-b2a0-c12133e3cf22 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.654826 Oct 29 03:06:07.423689 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2339/4731] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:06 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:07.442898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c19014d4-e48d-4a2f-9dda-cb84a47da870 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:07.443787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c19014d4-e48d-4a2f-9dda-cb84a47da870 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:07.451330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c19014d4-e48d-4a2f-9dda-cb84a47da870 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:07.454184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c19014d4-e48d-4a2f-9dda-cb84a47da870 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:07.454888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c19014d4-e48d-4a2f-9dda-cb84a47da870 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:07.455812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c19014d4-e48d-4a2f-9dda-cb84a47da870 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:07.456488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c19014d4-e48d-4a2f-9dda-cb84a47da870 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:07.457075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c19014d4-e48d-4a2f-9dda-cb84a47da870 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:07.513797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7456416b-e4ca-4016-9a02-8bfaaa95ed04 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:07.526371 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7456416b-e4ca-4016-9a02-8bfaaa95ed04 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1315 microversion: 2.1 time: 1.445980 Oct 29 03:06:07.526959 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2393/4732] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:06 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1315 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:07.551973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f614a0f0-d355-4f30-833e-a86b62d437cc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:07.570798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f614a0f0-d355-4f30-833e-a86b62d437cc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:07.586332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f614a0f0-d355-4f30-833e-a86b62d437cc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:07.586824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f614a0f0-d355-4f30-833e-a86b62d437cc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:07.587249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f614a0f0-d355-4f30-833e-a86b62d437cc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:07.608395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f614a0f0-d355-4f30-833e-a86b62d437cc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:07.609001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f614a0f0-d355-4f30-833e-a86b62d437cc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:07.609440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f614a0f0-d355-4f30-833e-a86b62d437cc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:07.649771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:07.888274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f614a0f0-d355-4f30-833e-a86b62d437cc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:07.899702 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f614a0f0-d355-4f30-833e-a86b62d437cc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1267 microversion: 2.1 time: 0.361679 Oct 29 03:06:07.926341 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2394/4733] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:07 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1267 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:07.933225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb5da4b3-8862-4bf9-be01-bd84d1d4595b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:07.944155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fb5da4b3-8862-4bf9-be01-bd84d1d4595b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:07.953362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb5da4b3-8862-4bf9-be01-bd84d1d4595b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:07.954084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c19014d4-e48d-4a2f-9dda-cb84a47da870 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:07.954531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb5da4b3-8862-4bf9-be01-bd84d1d4595b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:07.955181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb5da4b3-8862-4bf9-be01-bd84d1d4595b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:07.956742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb5da4b3-8862-4bf9-be01-bd84d1d4595b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:07.962465 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c19014d4-e48d-4a2f-9dda-cb84a47da870 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1528 microversion: 2.1 time: 0.533957 Oct 29 03:06:07.962801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb5da4b3-8862-4bf9-be01-bd84d1d4595b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:07.963110 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2340/4734] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:07 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1528 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:07.963722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb5da4b3-8862-4bf9-be01-bd84d1d4595b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:08.462887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:08.471938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:08.491477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:08.492141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:08.493086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:08.494184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:08.494783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:08.495416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:08.831971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fb5da4b3-8862-4bf9-be01-bd84d1d4595b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:08.844700 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fb5da4b3-8862-4bf9-be01-bd84d1d4595b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1332 microversion: 2.1 time: 0.915359 Oct 29 03:06:08.850207 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2395/4735] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:07 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1332 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:08.874734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4f1481c9-f027-47e4-84cc-32e378d80937 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:08.875751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4f1481c9-f027-47e4-84cc-32e378d80937 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:08.886950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1481c9-f027-47e4-84cc-32e378d80937 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:08.894283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1481c9-f027-47e4-84cc-32e378d80937 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:08.895058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1481c9-f027-47e4-84cc-32e378d80937 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:08.902969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1481c9-f027-47e4-84cc-32e378d80937 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:08.903813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1481c9-f027-47e4-84cc-32e378d80937 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:08.904460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f1481c9-f027-47e4-84cc-32e378d80937 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:09.305726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4f1481c9-f027-47e4-84cc-32e378d80937 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:09.316460 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4f1481c9-f027-47e4-84cc-32e378d80937 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1315 microversion: 2.1 time: 0.465021 Oct 29 03:06:09.318008 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2396/4736] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:08 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:09.328236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-10e8d6a3-4c21-4ae4-9c2f-37811784d0e4 req-d0aea561-5a2f-4f7e-9df4-ef4fbf17270d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbab455-c481-40ea-a59c-4ec9c15d935e", "name": "network-vif-plugged", "status": "completed", "tag": "c7aca24a-a353-4021-bdca-25ce655729ae"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:09.391878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-10e8d6a3-4c21-4ae4-9c2f-37811784d0e4 req-d0aea561-5a2f-4f7e-9df4-ef4fbf17270d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:09.393050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-10e8d6a3-4c21-4ae4-9c2f-37811784d0e4 req-d0aea561-5a2f-4f7e-9df4-ef4fbf17270d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:09.396292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-10e8d6a3-4c21-4ae4-9c2f-37811784d0e4 req-d0aea561-5a2f-4f7e-9df4-ef4fbf17270d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:09.444451 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-10e8d6a3-4c21-4ae4-9c2f-37811784d0e4 req-d0aea561-5a2f-4f7e-9df4-ef4fbf17270d service nova] Creating event network-vif-plugged:c7aca24a-a353-4021-bdca-25ce655729ae for instance 2bbab455-c481-40ea-a59c-4ec9c15d935e on n-h2-862964-4 Oct 29 03:06:09.475104 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-10e8d6a3-4c21-4ae4-9c2f-37811784d0e4 req-d0aea561-5a2f-4f7e-9df4-ef4fbf17270d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150584 Oct 29 03:06:09.477052 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2397/4737] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:09.492964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d5e3a6f-4ba5-413a-b7bd-5ad4bc45661e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:09.504283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d5e3a6f-4ba5-413a-b7bd-5ad4bc45661e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:09.541040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:09.568711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d5e3a6f-4ba5-413a-b7bd-5ad4bc45661e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:09.570680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d5e3a6f-4ba5-413a-b7bd-5ad4bc45661e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:09.571264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d5e3a6f-4ba5-413a-b7bd-5ad4bc45661e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:09.575696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d5e3a6f-4ba5-413a-b7bd-5ad4bc45661e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:09.578605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d5e3a6f-4ba5-413a-b7bd-5ad4bc45661e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:09.579245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d5e3a6f-4ba5-413a-b7bd-5ad4bc45661e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:09.740416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d5e3a6f-4ba5-413a-b7bd-5ad4bc45661e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:09.752120 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d5e3a6f-4ba5-413a-b7bd-5ad4bc45661e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1267 microversion: 2.1 time: 0.272656 Oct 29 03:06:09.752718 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2398/4738] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:09 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:09.761568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b990120e-f94c-4dd1-ae6f-c3625210dde2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:09.762542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b990120e-f94c-4dd1-ae6f-c3625210dde2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:09.782211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b990120e-f94c-4dd1-ae6f-c3625210dde2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:09.785006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b990120e-f94c-4dd1-ae6f-c3625210dde2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:09.793469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b990120e-f94c-4dd1-ae6f-c3625210dde2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:09.794874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b990120e-f94c-4dd1-ae6f-c3625210dde2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:09.795559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b990120e-f94c-4dd1-ae6f-c3625210dde2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:09.796161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b990120e-f94c-4dd1-ae6f-c3625210dde2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:10.081164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:10.100801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:10.107692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:10.114114 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5774f33f-a775-4b4a-8b66-16093d9820b1 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 1.665712 Oct 29 03:06:10.133277 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2341/4739] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:08 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:06:10.154889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f129c12d-fb6f-4f3b-99fb-6e1b28952aab tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:10.158903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f129c12d-fb6f-4f3b-99fb-6e1b28952aab tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:10.182813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f129c12d-fb6f-4f3b-99fb-6e1b28952aab tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:10.194366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f129c12d-fb6f-4f3b-99fb-6e1b28952aab tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:10.194932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f129c12d-fb6f-4f3b-99fb-6e1b28952aab tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:10.195798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f129c12d-fb6f-4f3b-99fb-6e1b28952aab tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:10.206572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f129c12d-fb6f-4f3b-99fb-6e1b28952aab tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:10.207347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f129c12d-fb6f-4f3b-99fb-6e1b28952aab tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:10.272413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:10.503570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b990120e-f94c-4dd1-ae6f-c3625210dde2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:10.536616 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b990120e-f94c-4dd1-ae6f-c3625210dde2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1528 microversion: 2.1 time: 0.771055 Oct 29 03:06:10.539641 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2399/4740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:09 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1528 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:10.561201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3f3c5c5a-33e4-4d46-a07c-d8d91c051a17 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:10.567636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3f3c5c5a-33e4-4d46-a07c-d8d91c051a17 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:10.618052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f3c5c5a-33e4-4d46-a07c-d8d91c051a17 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:10.620493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f3c5c5a-33e4-4d46-a07c-d8d91c051a17 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:10.620954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f3c5c5a-33e4-4d46-a07c-d8d91c051a17 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:10.621699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f3c5c5a-33e4-4d46-a07c-d8d91c051a17 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:10.626176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f3c5c5a-33e4-4d46-a07c-d8d91c051a17 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:10.630970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f3c5c5a-33e4-4d46-a07c-d8d91c051a17 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:10.957852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f129c12d-fb6f-4f3b-99fb-6e1b28952aab tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:10.966670 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f129c12d-fb6f-4f3b-99fb-6e1b28952aab tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1332 microversion: 2.1 time: 0.835747 Oct 29 03:06:10.996183 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2342/4741] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:10 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1332 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:11.001766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-396c070d-eaaa-4fc9-afc0-6629b2f614a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:11.002648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-396c070d-eaaa-4fc9-afc0-6629b2f614a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:11.010097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-396c070d-eaaa-4fc9-afc0-6629b2f614a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:11.015673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-396c070d-eaaa-4fc9-afc0-6629b2f614a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:11.016383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-396c070d-eaaa-4fc9-afc0-6629b2f614a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:11.017314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-396c070d-eaaa-4fc9-afc0-6629b2f614a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:11.018058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-396c070d-eaaa-4fc9-afc0-6629b2f614a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:11.022286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-396c070d-eaaa-4fc9-afc0-6629b2f614a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:11.252143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3f3c5c5a-33e4-4d46-a07c-d8d91c051a17 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:11.263821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-396c070d-eaaa-4fc9-afc0-6629b2f614a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:11.266686 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3f3c5c5a-33e4-4d46-a07c-d8d91c051a17 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1315 microversion: 2.1 time: 0.720494 Oct 29 03:06:11.268756 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2400/4742] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:10 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:11.272629 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-396c070d-eaaa-4fc9-afc0-6629b2f614a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1267 microversion: 2.1 time: 0.274866 Oct 29 03:06:11.273206 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2343/4743] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:10 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1267 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:11.282552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:11.283287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:11.342362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:11.346704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:11.346704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:11.354326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:11.358237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:11.358691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:11.527558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f2b438d3-6a09-498d-8511-9061f524ac18 req-234a2034-15c1-4941-a70a-41442a27b7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fdf9998-e29c-42b9-9f11-0ee63dd05901", "name": "network-vif-plugged", "status": "completed", "tag": "a9efba69-8d4a-400d-b346-7a0ea12c04fe"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:11.549108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f2b438d3-6a09-498d-8511-9061f524ac18 req-234a2034-15c1-4941-a70a-41442a27b7cd service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:11.550109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f2b438d3-6a09-498d-8511-9061f524ac18 req-234a2034-15c1-4941-a70a-41442a27b7cd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:11.553967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f2b438d3-6a09-498d-8511-9061f524ac18 req-234a2034-15c1-4941-a70a-41442a27b7cd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:11.584930 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f2b438d3-6a09-498d-8511-9061f524ac18 req-234a2034-15c1-4941-a70a-41442a27b7cd service nova] Creating event network-vif-plugged:a9efba69-8d4a-400d-b346-7a0ea12c04fe for instance 6fdf9998-e29c-42b9-9f11-0ee63dd05901 on n-h1-862964-4 Oct 29 03:06:11.595975 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f2b438d3-6a09-498d-8511-9061f524ac18 req-234a2034-15c1-4941-a70a-41442a27b7cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072032 Oct 29 03:06:11.598860 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2344/4744] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:06:11.610447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95759e7e-3d46-49fd-9f66-653756570123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:11.613056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-95759e7e-3d46-49fd-9f66-653756570123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:11.627055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95759e7e-3d46-49fd-9f66-653756570123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:11.630729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95759e7e-3d46-49fd-9f66-653756570123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:11.631417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95759e7e-3d46-49fd-9f66-653756570123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:11.635013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95759e7e-3d46-49fd-9f66-653756570123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:11.636430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95759e7e-3d46-49fd-9f66-653756570123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:11.637095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95759e7e-3d46-49fd-9f66-653756570123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:12.278902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:12.289396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:12.293001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:12.306025 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6b7f41dd-0d15-4f34-b38d-01a08e4a5c4b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 1.034687 Oct 29 03:06:12.307777 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2401/4745] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:11 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:12.426150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-95759e7e-3d46-49fd-9f66-653756570123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:12.452520 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-95759e7e-3d46-49fd-9f66-653756570123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1528 microversion: 2.1 time: 0.852206 Oct 29 03:06:12.456981 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2345/4746] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:11 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1528 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:12.473926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5213f9d5-5ca1-4710-b9bf-e6e93976ff49 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:12.480119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5213f9d5-5ca1-4710-b9bf-e6e93976ff49 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:12.508599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5213f9d5-5ca1-4710-b9bf-e6e93976ff49 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:12.509544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5213f9d5-5ca1-4710-b9bf-e6e93976ff49 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:12.517361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5213f9d5-5ca1-4710-b9bf-e6e93976ff49 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:12.518740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5213f9d5-5ca1-4710-b9bf-e6e93976ff49 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:12.521680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-864a14e2-4068-4e4f-a5c2-75382a757e6a req-ebea60ca-cfdd-4aa0-b956-84e5f95be5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4", "tag": "c596b5f8-cd42-45ed-b78f-8654fb1e1fbb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:12.522597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5213f9d5-5ca1-4710-b9bf-e6e93976ff49 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:12.523292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5213f9d5-5ca1-4710-b9bf-e6e93976ff49 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:12.549901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-864a14e2-4068-4e4f-a5c2-75382a757e6a req-ebea60ca-cfdd-4aa0-b956-84e5f95be5c6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:12.550667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-864a14e2-4068-4e4f-a5c2-75382a757e6a req-ebea60ca-cfdd-4aa0-b956-84e5f95be5c6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:12.551251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-864a14e2-4068-4e4f-a5c2-75382a757e6a req-ebea60ca-cfdd-4aa0-b956-84e5f95be5c6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:12.592493 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-864a14e2-4068-4e4f-a5c2-75382a757e6a req-ebea60ca-cfdd-4aa0-b956-84e5f95be5c6 service nova] Creating event network-changed:c596b5f8-cd42-45ed-b78f-8654fb1e1fbb for instance fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 on n-h2-862964-4 Oct 29 03:06:12.654820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:12.697374 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-864a14e2-4068-4e4f-a5c2-75382a757e6a req-ebea60ca-cfdd-4aa0-b956-84e5f95be5c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.388141 Oct 29 03:06:12.698344 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2402/4747] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:12.703898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3bc1d872-f200-46cf-8792-1b54a3d2755c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:12.704902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3bc1d872-f200-46cf-8792-1b54a3d2755c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:12.732153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc1d872-f200-46cf-8792-1b54a3d2755c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:12.733090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc1d872-f200-46cf-8792-1b54a3d2755c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:12.733779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc1d872-f200-46cf-8792-1b54a3d2755c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:12.734757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc1d872-f200-46cf-8792-1b54a3d2755c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:12.735438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc1d872-f200-46cf-8792-1b54a3d2755c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:12.736067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc1d872-f200-46cf-8792-1b54a3d2755c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:13.136327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:13.137486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5213f9d5-5ca1-4710-b9bf-e6e93976ff49 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:13.152989 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5213f9d5-5ca1-4710-b9bf-e6e93976ff49 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1332 microversion: 2.1 time: 0.694466 Oct 29 03:06:13.154115 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2346/4748] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:12 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1332 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:13.180119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50e25342-1bf4-47e3-acdc-384047d2f748 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:13.183684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-50e25342-1bf4-47e3-acdc-384047d2f748 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:13.220210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50e25342-1bf4-47e3-acdc-384047d2f748 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:13.220712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50e25342-1bf4-47e3-acdc-384047d2f748 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:13.221147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50e25342-1bf4-47e3-acdc-384047d2f748 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:13.221925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50e25342-1bf4-47e3-acdc-384047d2f748 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:13.222434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50e25342-1bf4-47e3-acdc-384047d2f748 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:13.222892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50e25342-1bf4-47e3-acdc-384047d2f748 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:13.408376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:13.869281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-50e25342-1bf4-47e3-acdc-384047d2f748 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:13.885711 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50e25342-1bf4-47e3-acdc-384047d2f748 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1309 microversion: 2.1 time: 0.720158 Oct 29 03:06:13.890565 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2347/4749] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:13 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1309 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:13.910024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:13.911140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:13.950859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:13.961635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:13.963647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:13.965541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:13.969769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:13.975521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:14.028907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:14.294022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3bc1d872-f200-46cf-8792-1b54a3d2755c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:14.304812 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3bc1d872-f200-46cf-8792-1b54a3d2755c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1315 microversion: 2.1 time: 1.604960 Oct 29 03:06:14.314983 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2403/4750] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:12 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1315 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:14.320176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-06a9c7fd-d886-42fd-a1eb-5f994aa2713b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:14.321060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-06a9c7fd-d886-42fd-a1eb-5f994aa2713b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:14.337522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a9c7fd-d886-42fd-a1eb-5f994aa2713b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:14.338576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a9c7fd-d886-42fd-a1eb-5f994aa2713b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:14.339315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a9c7fd-d886-42fd-a1eb-5f994aa2713b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:14.340408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a9c7fd-d886-42fd-a1eb-5f994aa2713b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:14.342108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a9c7fd-d886-42fd-a1eb-5f994aa2713b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:14.342904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a9c7fd-d886-42fd-a1eb-5f994aa2713b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:14.698934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-06a9c7fd-d886-42fd-a1eb-5f994aa2713b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:14.711961 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-06a9c7fd-d886-42fd-a1eb-5f994aa2713b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1528 microversion: 2.1 time: 0.395304 Oct 29 03:06:14.726123 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2404/4751] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:14 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1528 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:14.749937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6ec6823b-06d0-49f7-97b2-3f206a727173 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:14.750921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6ec6823b-06d0-49f7-97b2-3f206a727173 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:14.767409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ec6823b-06d0-49f7-97b2-3f206a727173 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:14.770400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ec6823b-06d0-49f7-97b2-3f206a727173 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:14.774208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ec6823b-06d0-49f7-97b2-3f206a727173 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:14.775378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ec6823b-06d0-49f7-97b2-3f206a727173 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:14.782650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ec6823b-06d0-49f7-97b2-3f206a727173 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:14.788314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ec6823b-06d0-49f7-97b2-3f206a727173 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:14.814639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:14.848528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:14.869406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:14.871499 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a83a2f11-d495-4163-bbfd-8c0a8bf90f6c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.978754 Oct 29 03:06:14.880809 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2348/4752] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:13 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:14.903197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-58abd62d-52d9-466b-a497-8610afe3f99d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Action: 'create', calling method: .version_select at 0x7fe1a86551f0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2117560397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyVqv/QnvfkF/3o5XFSm/nz0Pb7rzyDOhOyUEiXQKS/Hw5HWO7kSU0wzfmqciZ1OHfeNAlTRO6o4DivNryVLy+iDDJBRWyT2kYEKI0lI0nTI3IPRBAfXpkLlNilKO77ZQ=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:14.938418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-58abd62d-52d9-466b-a497-8610afe3f99d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Getting quotas for project 876cdb4084454584965a3f11aed5e79a. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:06:14.959514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-58abd62d-52d9-466b-a497-8610afe3f99d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Getting quotas for user 14aff6fe639d42bcb968efc58f7e9cad and project 876cdb4084454584965a3f11aed5e79a. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:06:15.004110 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-58abd62d-52d9-466b-a497-8610afe3f99d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.121971 Oct 29 03:06:15.009025 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2349/4753] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:06:14 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:15.026155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-95cacfeb-cdf3-4b21-b7a4-e399415c1cc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:15.026918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-95cacfeb-cdf3-4b21-b7a4-e399415c1cc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:15.041124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95cacfeb-cdf3-4b21-b7a4-e399415c1cc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:15.041629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95cacfeb-cdf3-4b21-b7a4-e399415c1cc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:15.042131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95cacfeb-cdf3-4b21-b7a4-e399415c1cc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:15.048660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95cacfeb-cdf3-4b21-b7a4-e399415c1cc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:15.050748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95cacfeb-cdf3-4b21-b7a4-e399415c1cc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:15.056670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-95cacfeb-cdf3-4b21-b7a4-e399415c1cc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:15.168748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6ec6823b-06d0-49f7-97b2-3f206a727173 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:15.185237 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6ec6823b-06d0-49f7-97b2-3f206a727173 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1332 microversion: 2.1 time: 0.456905 Oct 29 03:06:15.188579 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2405/4754] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:14 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1332 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:15.218086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e948cdcc-3a21-45ed-a7ae-ccae49c9d860 req-433ed80d-bdc4-46be-8ab5-922c8b0f2308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b", "tag": "63a811a7-784b-4f33-a455-ab65a0be0070"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:15.249421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e948cdcc-3a21-45ed-a7ae-ccae49c9d860 req-433ed80d-bdc4-46be-8ab5-922c8b0f2308 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:15.252477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e948cdcc-3a21-45ed-a7ae-ccae49c9d860 req-433ed80d-bdc4-46be-8ab5-922c8b0f2308 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:15.253144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e948cdcc-3a21-45ed-a7ae-ccae49c9d860 req-433ed80d-bdc4-46be-8ab5-922c8b0f2308 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:15.284638 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e948cdcc-3a21-45ed-a7ae-ccae49c9d860 req-433ed80d-bdc4-46be-8ab5-922c8b0f2308 service nova] Creating event network-changed:63a811a7-784b-4f33-a455-ab65a0be0070 for instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b on n-h2-862964-4 Oct 29 03:06:15.298154 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e948cdcc-3a21-45ed-a7ae-ccae49c9d860 req-433ed80d-bdc4-46be-8ab5-922c8b0f2308 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106713 Oct 29 03:06:15.302176 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2406/4755] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:15.339863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79dd012f-1e49-4ab8-ad18-a0641547970a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:15.344160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79dd012f-1e49-4ab8-ad18-a0641547970a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:15.364191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79dd012f-1e49-4ab8-ad18-a0641547970a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:15.365138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79dd012f-1e49-4ab8-ad18-a0641547970a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:15.366394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79dd012f-1e49-4ab8-ad18-a0641547970a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:15.367950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79dd012f-1e49-4ab8-ad18-a0641547970a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:15.368616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79dd012f-1e49-4ab8-ad18-a0641547970a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:15.370758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79dd012f-1e49-4ab8-ad18-a0641547970a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:15.493152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-95cacfeb-cdf3-4b21-b7a4-e399415c1cc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:15.503959 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-95cacfeb-cdf3-4b21-b7a4-e399415c1cc0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1309 microversion: 2.1 time: 0.491063 Oct 29 03:06:15.512985 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2350/4756] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:15 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1309 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:15.752726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-307c0366-acfe-4c50-8d65-bae40f8ed81d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:15.753532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-307c0366-acfe-4c50-8d65-bae40f8ed81d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:15.771086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307c0366-acfe-4c50-8d65-bae40f8ed81d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:15.771591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307c0366-acfe-4c50-8d65-bae40f8ed81d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:15.772031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307c0366-acfe-4c50-8d65-bae40f8ed81d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:15.772755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307c0366-acfe-4c50-8d65-bae40f8ed81d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:15.773205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307c0366-acfe-4c50-8d65-bae40f8ed81d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:15.773624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307c0366-acfe-4c50-8d65-bae40f8ed81d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:15.883227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-79dd012f-1e49-4ab8-ad18-a0641547970a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:15.900003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79dd012f-1e49-4ab8-ad18-a0641547970a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1502 microversion: 2.1 time: 0.565398 Oct 29 03:06:15.902532 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2407/4757] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:15 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1502 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:15.908970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:15.909582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:15.930808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:15.931333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:15.947569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:15.966148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:15.978181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:15.982024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:16.134760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-307c0366-acfe-4c50-8d65-bae40f8ed81d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:16.146520 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-307c0366-acfe-4c50-8d65-bae40f8ed81d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1528 microversion: 2.1 time: 0.397827 Oct 29 03:06:16.161829 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2351/4758] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:15 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1528 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:16.161829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-549ebf21-ee7b-4eb8-b053-185aea55c051 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:16.161829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-549ebf21-ee7b-4eb8-b053-185aea55c051 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:16.176501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-549ebf21-ee7b-4eb8-b053-185aea55c051 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:16.176944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-549ebf21-ee7b-4eb8-b053-185aea55c051 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:16.177557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-549ebf21-ee7b-4eb8-b053-185aea55c051 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:16.179164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-549ebf21-ee7b-4eb8-b053-185aea55c051 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:16.185726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-549ebf21-ee7b-4eb8-b053-185aea55c051 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:16.186479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-549ebf21-ee7b-4eb8-b053-185aea55c051 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:16.277999 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-549ebf21-ee7b-4eb8-b053-185aea55c051 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action" status: 200 len: 14 microversion: 2.1 time: 0.128491 Oct 29 03:06:16.282423 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2352/4759] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:16 2022] POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:06:16.287512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2baef350-e273-41b3-ab7d-81b5d48ba26f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:16.292258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2baef350-e273-41b3-ab7d-81b5d48ba26f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:16.313183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baef350-e273-41b3-ab7d-81b5d48ba26f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:16.313702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baef350-e273-41b3-ab7d-81b5d48ba26f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:16.314232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baef350-e273-41b3-ab7d-81b5d48ba26f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:16.323228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:16.323400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baef350-e273-41b3-ab7d-81b5d48ba26f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:16.323733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baef350-e273-41b3-ab7d-81b5d48ba26f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:16.324196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baef350-e273-41b3-ab7d-81b5d48ba26f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:16.345840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:16.347602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:16.350649 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d66e241-3527-4173-b58a-d67c0a08740b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.445536 Oct 29 03:06:16.351559 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2408/4760] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:15 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:16.530276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6d506af-2df1-4a31-81e8-6c15bf450623 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:16.530903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b6d506af-2df1-4a31-81e8-6c15bf450623 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:16.541285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d506af-2df1-4a31-81e8-6c15bf450623 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:16.545083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d506af-2df1-4a31-81e8-6c15bf450623 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:16.545770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d506af-2df1-4a31-81e8-6c15bf450623 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:16.547984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d506af-2df1-4a31-81e8-6c15bf450623 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:16.548668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d506af-2df1-4a31-81e8-6c15bf450623 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:16.564559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6d506af-2df1-4a31-81e8-6c15bf450623 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:16.703186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2baef350-e273-41b3-ab7d-81b5d48ba26f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:16.721372 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2baef350-e273-41b3-ab7d-81b5d48ba26f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1332 microversion: 2.1 time: 0.440887 Oct 29 03:06:16.722003 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2353/4761] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:16 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1332 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:17.180873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-655fe943-ad7f-4487-bc96-2baf99ec810c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:17.183450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-655fe943-ad7f-4487-bc96-2baf99ec810c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:17.211955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-655fe943-ad7f-4487-bc96-2baf99ec810c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:17.213521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-655fe943-ad7f-4487-bc96-2baf99ec810c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:17.218509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-655fe943-ad7f-4487-bc96-2baf99ec810c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:17.219537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-655fe943-ad7f-4487-bc96-2baf99ec810c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:17.230486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-655fe943-ad7f-4487-bc96-2baf99ec810c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:17.240334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-655fe943-ad7f-4487-bc96-2baf99ec810c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:17.244518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b6d506af-2df1-4a31-81e8-6c15bf450623 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:17.258918 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6d506af-2df1-4a31-81e8-6c15bf450623 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1309 microversion: 2.1 time: 0.733661 Oct 29 03:06:17.266488 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2409/4762] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:16 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1309 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:17.290490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3d994ec7-4d45-418f-bcb4-5336598f683d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:17.292901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3d994ec7-4d45-418f-bcb4-5336598f683d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:17.309038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d994ec7-4d45-418f-bcb4-5336598f683d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:17.318381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d994ec7-4d45-418f-bcb4-5336598f683d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:17.319118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d994ec7-4d45-418f-bcb4-5336598f683d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:17.320031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d994ec7-4d45-418f-bcb4-5336598f683d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:17.320645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d994ec7-4d45-418f-bcb4-5336598f683d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:17.321226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3d994ec7-4d45-418f-bcb4-5336598f683d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:17.513975 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3d994ec7-4d45-418f-bcb4-5336598f683d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action" status: 200 len: 14 microversion: 2.1 time: 0.227326 Oct 29 03:06:17.517481 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2410/4763] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:17 2022] POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action => generated 14 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 03:06:17.520106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:17.520787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:17.535379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:17.535874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:17.536304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:17.537005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:17.537451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:17.537893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:17.886370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-655fe943-ad7f-4487-bc96-2baf99ec810c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:17.910359 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-655fe943-ad7f-4487-bc96-2baf99ec810c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1528 microversion: 2.1 time: 0.729747 Oct 29 03:06:17.911559 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2354/4764] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:17 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1528 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:17.926483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9f17f3da-9007-4495-b39e-e4df9ba2e363 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:17.928266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9f17f3da-9007-4495-b39e-e4df9ba2e363 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:17.954247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f17f3da-9007-4495-b39e-e4df9ba2e363 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:17.954977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f17f3da-9007-4495-b39e-e4df9ba2e363 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:17.958522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f17f3da-9007-4495-b39e-e4df9ba2e363 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:17.959511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f17f3da-9007-4495-b39e-e4df9ba2e363 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:17.962118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f17f3da-9007-4495-b39e-e4df9ba2e363 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:17.962744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f17f3da-9007-4495-b39e-e4df9ba2e363 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:18.246322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:18.264120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:18.265929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:18.267749 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a6e84b61-df7d-4716-9556-b1900b535964 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.751710 Oct 29 03:06:18.270865 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2411/4765] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:17 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:18.302630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-774a7724-4a04-433a-92d4-c5ed157ed477 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:18.306879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-774a7724-4a04-433a-92d4-c5ed157ed477 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:18.332550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-774a7724-4a04-433a-92d4-c5ed157ed477 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.334887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-774a7724-4a04-433a-92d4-c5ed157ed477 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.338080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-774a7724-4a04-433a-92d4-c5ed157ed477 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:18.340991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-774a7724-4a04-433a-92d4-c5ed157ed477 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.342339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-774a7724-4a04-433a-92d4-c5ed157ed477 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.343474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-774a7724-4a04-433a-92d4-c5ed157ed477 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:18.620883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9f17f3da-9007-4495-b39e-e4df9ba2e363 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:18.642468 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9f17f3da-9007-4495-b39e-e4df9ba2e363 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1332 microversion: 2.1 time: 0.718153 Oct 29 03:06:18.645145 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2355/4766] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:17 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1332 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:18.650498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-737e851b-c70b-4dca-a4b7-091ce814411e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:18.652814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-737e851b-c70b-4dca-a4b7-091ce814411e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:18.687346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737e851b-c70b-4dca-a4b7-091ce814411e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.689965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737e851b-c70b-4dca-a4b7-091ce814411e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.691971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737e851b-c70b-4dca-a4b7-091ce814411e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:18.692762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737e851b-c70b-4dca-a4b7-091ce814411e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.693229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737e851b-c70b-4dca-a4b7-091ce814411e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.693669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-737e851b-c70b-4dca-a4b7-091ce814411e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:18.806846 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-737e851b-c70b-4dca-a4b7-091ce814411e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action" status: 200 len: 14 microversion: 2.1 time: 0.159760 Oct 29 03:06:18.810970 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2356/4767] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:18 2022] POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:06:18.937345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8fc45296-cb17-42ce-ac93-a715275e483d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:18.939877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8fc45296-cb17-42ce-ac93-a715275e483d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:18.952192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc45296-cb17-42ce-ac93-a715275e483d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.952698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc45296-cb17-42ce-ac93-a715275e483d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.957206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc45296-cb17-42ce-ac93-a715275e483d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:18.958073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc45296-cb17-42ce-ac93-a715275e483d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.958593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc45296-cb17-42ce-ac93-a715275e483d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.958992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8fc45296-cb17-42ce-ac93-a715275e483d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:19.208449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-774a7724-4a04-433a-92d4-c5ed157ed477 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:19.234715 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-774a7724-4a04-433a-92d4-c5ed157ed477 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1309 microversion: 2.1 time: 0.943416 Oct 29 03:06:19.235238 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2412/4768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:18 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1309 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:19.303539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:19.304236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:19.317286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:19.317782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:19.318653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:19.319403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:19.319855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:19.321426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:19.356629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:19.359049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8fc45296-cb17-42ce-ac93-a715275e483d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:19.370754 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8fc45296-cb17-42ce-ac93-a715275e483d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1528 microversion: 2.1 time: 0.436191 Oct 29 03:06:19.381908 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2357/4769] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:18 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1528 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:19.538822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1492247528", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3d3f3354-cfc8-44eb-b6d7-a6c4cebb8154", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2117560397", "security_groups": [{"name": "tempest-secgroup-smoke-512777385"}], "networks": [{"uuid": "d16a0f63-8da7-4cfd-a48f-d9c137f2d291"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:19.710257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:19.719684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:19.725905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:19.727407 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd163f9b-3d45-4f65-b67b-eb1a3254ea54 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.427956 Oct 29 03:06:19.731866 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2413/4770] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:19 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:06:19.739476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8dde8a59-0703-4265-baa8-abf53c669c20 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:19.740286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8dde8a59-0703-4265-baa8-abf53c669c20 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:19.751620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8dde8a59-0703-4265-baa8-abf53c669c20 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:19.752112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8dde8a59-0703-4265-baa8-abf53c669c20 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:19.752542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8dde8a59-0703-4265-baa8-abf53c669c20 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:19.753258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8dde8a59-0703-4265-baa8-abf53c669c20 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:19.753686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8dde8a59-0703-4265-baa8-abf53c669c20 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:19.754124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8dde8a59-0703-4265-baa8-abf53c669c20 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:19.807220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] validate_networks() for [('d16a0f63-8da7-4cfd-a48f-d9c137f2d291', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:06:20.034996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8dde8a59-0703-4265-baa8-abf53c669c20 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:20.051022 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8dde8a59-0703-4265-baa8-abf53c669c20 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1332 microversion: 2.1 time: 0.317831 Oct 29 03:06:20.083173 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2414/4771] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:19 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1332 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:20.103632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-865d40c3-c519-4fed-afef-a2c253f66204 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:20.110571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-865d40c3-c519-4fed-afef-a2c253f66204 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:20.122272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-865d40c3-c519-4fed-afef-a2c253f66204 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:20.126093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-865d40c3-c519-4fed-afef-a2c253f66204 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:20.129521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-865d40c3-c519-4fed-afef-a2c253f66204 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:20.130604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-865d40c3-c519-4fed-afef-a2c253f66204 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:20.131478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-865d40c3-c519-4fed-afef-a2c253f66204 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:20.133333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-865d40c3-c519-4fed-afef-a2c253f66204 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:20.228780 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-865d40c3-c519-4fed-afef-a2c253f66204 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action" status: 200 len: 14 microversion: 2.1 time: 0.144164 Oct 29 03:06:20.232733 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2415/4772] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:20 2022] POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:06:20.259815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b3392ad8-3b5f-43a6-812a-e73597675b18 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:20.260828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b3392ad8-3b5f-43a6-812a-e73597675b18 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:20.274886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3392ad8-3b5f-43a6-812a-e73597675b18 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:20.286596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3392ad8-3b5f-43a6-812a-e73597675b18 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:20.287398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3392ad8-3b5f-43a6-812a-e73597675b18 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:20.288352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3392ad8-3b5f-43a6-812a-e73597675b18 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:20.289003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3392ad8-3b5f-43a6-812a-e73597675b18 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:20.289778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3392ad8-3b5f-43a6-812a-e73597675b18 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:20.511792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3392ad8-3b5f-43a6-812a-e73597675b18 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:20.525146 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b3392ad8-3b5f-43a6-812a-e73597675b18 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1309 microversion: 2.1 time: 0.269307 Oct 29 03:06:20.550574 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2416/4773] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:20 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1309 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:20.567883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-61c8340a-546f-4b41-a942-040a254b54a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:20.568849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-61c8340a-546f-4b41-a942-040a254b54a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:20.578641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c8340a-546f-4b41-a942-040a254b54a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:20.579658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c8340a-546f-4b41-a942-040a254b54a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:20.580301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c8340a-546f-4b41-a942-040a254b54a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:20.581278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c8340a-546f-4b41-a942-040a254b54a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:20.581999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c8340a-546f-4b41-a942-040a254b54a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:20.582796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c8340a-546f-4b41-a942-040a254b54a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:20.761878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:06:20.763309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:06:20.764046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:06:20.764624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:06:20.765196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:06:20.781056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-61c8340a-546f-4b41-a942-040a254b54a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:20.783682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:20.784171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:20.787778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:20.788846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:20.789628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:20.790251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:20.793606 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-61c8340a-546f-4b41-a942-040a254b54a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1528 microversion: 2.1 time: 0.241065 Oct 29 03:06:20.795327 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2417/4774] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:20 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1528 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:20.841135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Getting quotas for project 876cdb4084454584965a3f11aed5e79a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:06:20.855806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Getting quotas for user 14aff6fe639d42bcb968efc58f7e9cad and project 876cdb4084454584965a3f11aed5e79a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:06:20.923624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-167634387", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "dde73cec-f46f-4168-9427-82dc2d2f1b24"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:20.968019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:06:20.970374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d3f3354-cfc8-44eb-b6d7-a6c4cebb8154',volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:06:21.339828 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-40e443a7-03a2-4d2d-8fca-b62ef4b9a384 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.801313 Oct 29 03:06:21.349381 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2358/4775] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:06:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:06:21.356128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:21.357302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:21.365128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:21.368628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:21.369321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:21.370470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:21.371136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:21.372310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:21.719207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:21.729948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:21.735398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:21.739405 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6e85d74d-4809-4069-87b8-bdd666236f2b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.385922 Oct 29 03:06:21.749718 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2359/4776] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:21 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:21.760306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-738ea3fa-9841-4108-a6d1-fa5397ca3392 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:21.761166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-738ea3fa-9841-4108-a6d1-fa5397ca3392 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:21.778215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-738ea3fa-9841-4108-a6d1-fa5397ca3392 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:21.779025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-738ea3fa-9841-4108-a6d1-fa5397ca3392 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:21.779764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-738ea3fa-9841-4108-a6d1-fa5397ca3392 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:21.780771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-738ea3fa-9841-4108-a6d1-fa5397ca3392 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:21.783277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-738ea3fa-9841-4108-a6d1-fa5397ca3392 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:21.783934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-738ea3fa-9841-4108-a6d1-fa5397ca3392 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:22.401754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-738ea3fa-9841-4108-a6d1-fa5397ca3392 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:22.474464 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-738ea3fa-9841-4108-a6d1-fa5397ca3392 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1332 microversion: 2.1 time: 0.722971 Oct 29 03:06:22.475475 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2360/4777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:21 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1332 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:22.481029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ed6c660b-b7c2-46d1-a192-eadc9d761f81 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:22.484936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ed6c660b-b7c2-46d1-a192-eadc9d761f81 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:22.528002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed6c660b-b7c2-46d1-a192-eadc9d761f81 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:22.531142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed6c660b-b7c2-46d1-a192-eadc9d761f81 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:22.532067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed6c660b-b7c2-46d1-a192-eadc9d761f81 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:22.533059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed6c660b-b7c2-46d1-a192-eadc9d761f81 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:22.536481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed6c660b-b7c2-46d1-a192-eadc9d761f81 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:22.537270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed6c660b-b7c2-46d1-a192-eadc9d761f81 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:22.666812 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ed6c660b-b7c2-46d1-a192-eadc9d761f81 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action" status: 200 len: 14 microversion: 2.1 time: 0.189767 Oct 29 03:06:22.669306 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2361/4778] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:22 2022] POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:06:22.676515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6559c424-8dd1-44dd-b134-27a20fcca668 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:22.679738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6559c424-8dd1-44dd-b134-27a20fcca668 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:22.886924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6559c424-8dd1-44dd-b134-27a20fcca668 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:22.899765 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6559c424-8dd1-44dd-b134-27a20fcca668 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1099 microversion: 2.1 time: 0.228021 Oct 29 03:06:22.914392 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2362/4779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:22 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1099 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:22.925508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4534b76e-45da-44a8-be43-627efdac64a4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:22.926568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4534b76e-45da-44a8-be43-627efdac64a4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:22.936083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4534b76e-45da-44a8-be43-627efdac64a4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:22.937062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4534b76e-45da-44a8-be43-627efdac64a4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:22.938217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4534b76e-45da-44a8-be43-627efdac64a4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:22.939734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4534b76e-45da-44a8-be43-627efdac64a4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:22.940700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4534b76e-45da-44a8-be43-627efdac64a4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:22.941495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4534b76e-45da-44a8-be43-627efdac64a4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:22.992990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:23.317216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4534b76e-45da-44a8-be43-627efdac64a4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:23.329654 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4534b76e-45da-44a8-be43-627efdac64a4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1309 microversion: 2.1 time: 0.412652 Oct 29 03:06:23.331164 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2363/4780] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:22 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1309 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:23.339283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4711ece8-b19a-4aa8-8395-e2da3175fa5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:23.340192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4711ece8-b19a-4aa8-8395-e2da3175fa5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:23.357178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4711ece8-b19a-4aa8-8395-e2da3175fa5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:23.357178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4711ece8-b19a-4aa8-8395-e2da3175fa5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:23.357671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4711ece8-b19a-4aa8-8395-e2da3175fa5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:23.358354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4711ece8-b19a-4aa8-8395-e2da3175fa5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:23.358877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4711ece8-b19a-4aa8-8395-e2da3175fa5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:23.359374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4711ece8-b19a-4aa8-8395-e2da3175fa5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:23.592182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4711ece8-b19a-4aa8-8395-e2da3175fa5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:23.618809 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4711ece8-b19a-4aa8-8395-e2da3175fa5a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1528 microversion: 2.1 time: 0.286379 Oct 29 03:06:23.622575 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2364/4781] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:23 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1528 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:23.641260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:23.642023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:23.647405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:23.660649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:23.667002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:23.667432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:23.673665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:23.675515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:23.675973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:23.987683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:24.025236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:24.031762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:24.033483 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-14efd3a0-bc1c-4b86-852e-f0fade0cba74 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.403765 Oct 29 03:06:24.062430 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2365/4782] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:23 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:24.087146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-862c3030-caa5-45e9-8fc5-37d32a3dc9a5 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:24.089604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-862c3030-caa5-45e9-8fc5-37d32a3dc9a5 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:24.100542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-862c3030-caa5-45e9-8fc5-37d32a3dc9a5 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:24.101073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-862c3030-caa5-45e9-8fc5-37d32a3dc9a5 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:24.101678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-862c3030-caa5-45e9-8fc5-37d32a3dc9a5 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:24.102846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-862c3030-caa5-45e9-8fc5-37d32a3dc9a5 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:24.103445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-862c3030-caa5-45e9-8fc5-37d32a3dc9a5 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:24.103973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-862c3030-caa5-45e9-8fc5-37d32a3dc9a5 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:24.513559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-862c3030-caa5-45e9-8fc5-37d32a3dc9a5 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:24.524018 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-862c3030-caa5-45e9-8fc5-37d32a3dc9a5 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1332 microversion: 2.1 time: 0.458900 Oct 29 03:06:24.542903 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2366/4783] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:24 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1332 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:24.575924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-adec0860-6ed2-4a51-b0b9-1b186d5aa5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:24.581544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-adec0860-6ed2-4a51-b0b9-1b186d5aa5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:24.598612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adec0860-6ed2-4a51-b0b9-1b186d5aa5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:24.599342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adec0860-6ed2-4a51-b0b9-1b186d5aa5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:24.599531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adec0860-6ed2-4a51-b0b9-1b186d5aa5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:24.600254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adec0860-6ed2-4a51-b0b9-1b186d5aa5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:24.600712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adec0860-6ed2-4a51-b0b9-1b186d5aa5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:24.601136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adec0860-6ed2-4a51-b0b9-1b186d5aa5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:24.714011 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-adec0860-6ed2-4a51-b0b9-1b186d5aa5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action" status: 200 len: 14 microversion: 2.1 time: 0.169555 Oct 29 03:06:24.719521 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2367/4784] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:24 2022] POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:06:24.930136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6b25ef70-5421-464f-b7aa-c4976f66569f req-e2b9a0a6-3c2e-4d84-944b-7eb7d7a9f15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4", "name": "network-vif-plugged", "status": "completed", "tag": "c596b5f8-cd42-45ed-b78f-8654fb1e1fbb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:24.952453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6b25ef70-5421-464f-b7aa-c4976f66569f req-e2b9a0a6-3c2e-4d84-944b-7eb7d7a9f15e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:24.952946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6b25ef70-5421-464f-b7aa-c4976f66569f req-e2b9a0a6-3c2e-4d84-944b-7eb7d7a9f15e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:24.954729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6b25ef70-5421-464f-b7aa-c4976f66569f req-e2b9a0a6-3c2e-4d84-944b-7eb7d7a9f15e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:24.982925 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6b25ef70-5421-464f-b7aa-c4976f66569f req-e2b9a0a6-3c2e-4d84-944b-7eb7d7a9f15e service nova] Creating event network-vif-plugged:c596b5f8-cd42-45ed-b78f-8654fb1e1fbb for instance fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 on n-h2-862964-4 Oct 29 03:06:25.005680 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6b25ef70-5421-464f-b7aa-c4976f66569f req-e2b9a0a6-3c2e-4d84-944b-7eb7d7a9f15e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279628 Oct 29 03:06:25.007715 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2368/4785] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:25.035492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-45b8c85c-beff-49ca-bca5-67036969fe27 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:25.042005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-45b8c85c-beff-49ca-bca5-67036969fe27 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:25.062865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45b8c85c-beff-49ca-bca5-67036969fe27 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:25.067562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45b8c85c-beff-49ca-bca5-67036969fe27 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:25.068029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45b8c85c-beff-49ca-bca5-67036969fe27 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:25.068778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45b8c85c-beff-49ca-bca5-67036969fe27 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:25.069413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45b8c85c-beff-49ca-bca5-67036969fe27 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:25.071325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45b8c85c-beff-49ca-bca5-67036969fe27 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:25.992213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-45b8c85c-beff-49ca-bca5-67036969fe27 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:26.003278 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-45b8c85c-beff-49ca-bca5-67036969fe27 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1215 microversion: 2.1 time: 0.993945 Oct 29 03:06:26.003874 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2369/4786] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:25 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1215 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:26.035338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-383a9bbd-8575-4661-8dae-8cf961b29e87 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:26.036017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-383a9bbd-8575-4661-8dae-8cf961b29e87 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:26.043990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383a9bbd-8575-4661-8dae-8cf961b29e87 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:26.045648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383a9bbd-8575-4661-8dae-8cf961b29e87 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:26.045648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383a9bbd-8575-4661-8dae-8cf961b29e87 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:26.046386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383a9bbd-8575-4661-8dae-8cf961b29e87 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:26.046992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383a9bbd-8575-4661-8dae-8cf961b29e87 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:26.047569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-383a9bbd-8575-4661-8dae-8cf961b29e87 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:26.447950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] validate_networks() for [('dde73cec-f46f-4168-9427-82dc2d2f1b24', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:06:26.565495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-383a9bbd-8575-4661-8dae-8cf961b29e87 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:26.591628 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-383a9bbd-8575-4661-8dae-8cf961b29e87 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1309 microversion: 2.1 time: 0.559065 Oct 29 03:06:26.592359 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2370/4787] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:26 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1309 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:26.620202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-da5f6e2c-40c5-4fc8-9821-bd0caf362fbc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:26.620817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-da5f6e2c-40c5-4fc8-9821-bd0caf362fbc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:26.640540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5f6e2c-40c5-4fc8-9821-bd0caf362fbc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:26.643355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5f6e2c-40c5-4fc8-9821-bd0caf362fbc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:26.644243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5f6e2c-40c5-4fc8-9821-bd0caf362fbc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:26.644995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5f6e2c-40c5-4fc8-9821-bd0caf362fbc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:26.645453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5f6e2c-40c5-4fc8-9821-bd0caf362fbc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:26.645900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da5f6e2c-40c5-4fc8-9821-bd0caf362fbc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:26.980949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-da5f6e2c-40c5-4fc8-9821-bd0caf362fbc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:27.008276 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-da5f6e2c-40c5-4fc8-9821-bd0caf362fbc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1528 microversion: 2.1 time: 0.398571 Oct 29 03:06:27.022638 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2371/4788] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:26 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1528 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:27.033851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:27.034659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:27.041331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.043063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.043920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.044846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.045458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.046272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.231100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:27.242924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:27.244370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:27.245544 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c47dbe2e-e4ed-467d-ad93-e14b25658bd3 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.221578 Oct 29 03:06:27.250751 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2372/4789] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:27 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:27.256943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-53b6e914-a32b-435f-846d-1d12a0a16c04 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:27.257658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-53b6e914-a32b-435f-846d-1d12a0a16c04 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:27.266212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b6e914-a32b-435f-846d-1d12a0a16c04 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.266623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b6e914-a32b-435f-846d-1d12a0a16c04 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.267052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b6e914-a32b-435f-846d-1d12a0a16c04 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.267748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b6e914-a32b-435f-846d-1d12a0a16c04 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.268189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b6e914-a32b-435f-846d-1d12a0a16c04 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.268807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b6e914-a32b-435f-846d-1d12a0a16c04 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.408622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-53b6e914-a32b-435f-846d-1d12a0a16c04 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:27.418543 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-53b6e914-a32b-435f-846d-1d12a0a16c04 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1332 microversion: 2.1 time: 0.166503 Oct 29 03:06:27.419328 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2373/4790] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:27 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1332 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:27.425018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-228cc24e-d4d1-4444-bbea-d6edc1d2f06f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:27.427764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-228cc24e-d4d1-4444-bbea-d6edc1d2f06f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:27.436831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-228cc24e-d4d1-4444-bbea-d6edc1d2f06f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.437537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-228cc24e-d4d1-4444-bbea-d6edc1d2f06f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.438120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-228cc24e-d4d1-4444-bbea-d6edc1d2f06f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.438936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-228cc24e-d4d1-4444-bbea-d6edc1d2f06f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.439497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-228cc24e-d4d1-4444-bbea-d6edc1d2f06f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.440138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-228cc24e-d4d1-4444-bbea-d6edc1d2f06f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.510893 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-228cc24e-d4d1-4444-bbea-d6edc1d2f06f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action" status: 200 len: 8205 microversion: 2.1 time: 0.089293 Oct 29 03:06:27.511649 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2374/4791] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:27 2022] POST /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901/action => generated 8205 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:27.517288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-04d8d680-79a3-48dd-a689-bd2625a3f0b2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:27.518274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-04d8d680-79a3-48dd-a689-bd2625a3f0b2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:27.526132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04d8d680-79a3-48dd-a689-bd2625a3f0b2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.526852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04d8d680-79a3-48dd-a689-bd2625a3f0b2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.527558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04d8d680-79a3-48dd-a689-bd2625a3f0b2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.528406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04d8d680-79a3-48dd-a689-bd2625a3f0b2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.529347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04d8d680-79a3-48dd-a689-bd2625a3f0b2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.530100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04d8d680-79a3-48dd-a689-bd2625a3f0b2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.586003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:06:27.586911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:06:27.587626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:06:27.588323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:06:27.588895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:06:27.599847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.601186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.602274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.603682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.604318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.604904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.632248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Getting quotas for project 515e073461f640f698fb302b4b9b0779. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:06:27.640020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Getting quotas for user cda37fbe7dd9480592f14e99d24296e6 and project 515e073461f640f698fb302b4b9b0779. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:06:27.660741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:06:27.664108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:06:27.721601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-04d8d680-79a3-48dd-a689-bd2625a3f0b2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:27.734974 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7852952e-60a8-4aa2-b26f-f1d5cc241338 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.937984 Oct 29 03:06:27.735951 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-04d8d680-79a3-48dd-a689-bd2625a3f0b2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1282 microversion: 2.1 time: 0.219550 Oct 29 03:06:27.743775 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2375/4792] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:27 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1282 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:27.744569 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2418/4793] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 6948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:06:27.750657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3f1c3ebc-679d-413d-9315-aab6d299127d req-791d9fa1-4b46-4f72-b4eb-0b8732b8aa38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b", "name": "network-vif-plugged", "status": "completed", "tag": "63a811a7-784b-4f33-a455-ab65a0be0070"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:27.757045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e904f8b-86c1-4e50-9ae8-fb0c137834e5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:27.758637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4e904f8b-86c1-4e50-9ae8-fb0c137834e5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:27.775688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3f1c3ebc-679d-413d-9315-aab6d299127d req-791d9fa1-4b46-4f72-b4eb-0b8732b8aa38 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.776566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3f1c3ebc-679d-413d-9315-aab6d299127d req-791d9fa1-4b46-4f72-b4eb-0b8732b8aa38 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.777179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3f1c3ebc-679d-413d-9315-aab6d299127d req-791d9fa1-4b46-4f72-b4eb-0b8732b8aa38 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.777551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e904f8b-86c1-4e50-9ae8-fb0c137834e5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.778218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e904f8b-86c1-4e50-9ae8-fb0c137834e5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.778938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e904f8b-86c1-4e50-9ae8-fb0c137834e5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.779786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e904f8b-86c1-4e50-9ae8-fb0c137834e5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.780360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e904f8b-86c1-4e50-9ae8-fb0c137834e5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.781118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e904f8b-86c1-4e50-9ae8-fb0c137834e5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.806552 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3f1c3ebc-679d-413d-9315-aab6d299127d req-791d9fa1-4b46-4f72-b4eb-0b8732b8aa38 service nova] Creating event network-vif-plugged:63a811a7-784b-4f33-a455-ab65a0be0070 for instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b on n-h2-862964-4 Oct 29 03:06:27.815874 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3f1c3ebc-679d-413d-9315-aab6d299127d req-791d9fa1-4b46-4f72-b4eb-0b8732b8aa38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069103 Oct 29 03:06:27.816892 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2376/4794] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:27.822986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bcb69ebd-3079-4ad1-afd0-6308638a23ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:27.823892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bcb69ebd-3079-4ad1-afd0-6308638a23ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:27.831701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb69ebd-3079-4ad1-afd0-6308638a23ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.832518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb69ebd-3079-4ad1-afd0-6308638a23ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.833254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb69ebd-3079-4ad1-afd0-6308638a23ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.834227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb69ebd-3079-4ad1-afd0-6308638a23ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.834843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb69ebd-3079-4ad1-afd0-6308638a23ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.835264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcb69ebd-3079-4ad1-afd0-6308638a23ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.037534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bcb69ebd-3079-4ad1-afd0-6308638a23ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:28.061144 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bcb69ebd-3079-4ad1-afd0-6308638a23ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1309 microversion: 2.1 time: 0.232856 Oct 29 03:06:28.065992 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2377/4795] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:27 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1309 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:28.076657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5d1af28-3bed-4689-bbd3-3bd65f916e8f tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:28.078291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d5d1af28-3bed-4689-bbd3-3bd65f916e8f tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:28.082029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4e904f8b-86c1-4e50-9ae8-fb0c137834e5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:28.100344 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4e904f8b-86c1-4e50-9ae8-fb0c137834e5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.354189 Oct 29 03:06:28.131639 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2419/4796] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:27 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:28.151706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-43bead9f-c0e4-4161-86fb-18f1e09fe50e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:28.152762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-43bead9f-c0e4-4161-86fb-18f1e09fe50e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:28.172766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5d1af28-3bed-4689-bbd3-3bd65f916e8f tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:28.176533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43bead9f-c0e4-4161-86fb-18f1e09fe50e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:28.177028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43bead9f-c0e4-4161-86fb-18f1e09fe50e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:28.177481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43bead9f-c0e4-4161-86fb-18f1e09fe50e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.178219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43bead9f-c0e4-4161-86fb-18f1e09fe50e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:28.178666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43bead9f-c0e4-4161-86fb-18f1e09fe50e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:28.179083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-43bead9f-c0e4-4161-86fb-18f1e09fe50e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.185595 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5d1af28-3bed-4689-bbd3-3bd65f916e8f tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1215 microversion: 2.1 time: 0.113109 Oct 29 03:06:28.186548 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2378/4797] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:28 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:28.209185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-899dc53c-32c7-4c8e-b78d-2de491db439e req-8de4167c-0c4a-4968-9e0d-7ea72c99cf0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfab3b11-01ce-4757-ba50-5d65796f9788", "tag": "224c0a5a-9063-4270-96f9-12450fb578dc"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:28.222738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-899dc53c-32c7-4c8e-b78d-2de491db439e req-8de4167c-0c4a-4968-9e0d-7ea72c99cf0d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:28.223221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-899dc53c-32c7-4c8e-b78d-2de491db439e req-8de4167c-0c4a-4968-9e0d-7ea72c99cf0d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:28.223697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-899dc53c-32c7-4c8e-b78d-2de491db439e req-8de4167c-0c4a-4968-9e0d-7ea72c99cf0d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.240982 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-899dc53c-32c7-4c8e-b78d-2de491db439e req-8de4167c-0c4a-4968-9e0d-7ea72c99cf0d service nova] Creating event network-changed:224c0a5a-9063-4270-96f9-12450fb578dc for instance cfab3b11-01ce-4757-ba50-5d65796f9788 on n-h1-862964-4 Oct 29 03:06:28.248012 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-899dc53c-32c7-4c8e-b78d-2de491db439e req-8de4167c-0c4a-4968-9e0d-7ea72c99cf0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043178 Oct 29 03:06:28.249076 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2379/4798] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:28.254970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-34197491-de93-4340-ae71-706f1082bde3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:28.255842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-34197491-de93-4340-ae71-706f1082bde3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:28.263019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34197491-de93-4340-ae71-706f1082bde3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:28.263534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34197491-de93-4340-ae71-706f1082bde3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:28.263975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34197491-de93-4340-ae71-706f1082bde3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.264689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34197491-de93-4340-ae71-706f1082bde3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:28.265201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34197491-de93-4340-ae71-706f1082bde3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:28.265670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34197491-de93-4340-ae71-706f1082bde3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.515994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34197491-de93-4340-ae71-706f1082bde3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:28.525483 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-34197491-de93-4340-ae71-706f1082bde3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.275192 Oct 29 03:06:28.526722 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2380/4799] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:28 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:28.534503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:28.535379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:28.545980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:28.546849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:28.547509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.548860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:28.549891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:28.550551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.768674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:28.779647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:28.781424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:28.783022 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3d5b399a-958b-457f-ae70-4671cf3d7f9e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.255191 Oct 29 03:06:28.784384 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2381/4800] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:28 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:28.789281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aad31d79-d93e-4621-a4be-546a55cc9f35 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:28.790101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aad31d79-d93e-4621-a4be-546a55cc9f35 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:28.797509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aad31d79-d93e-4621-a4be-546a55cc9f35 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:28.798326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aad31d79-d93e-4621-a4be-546a55cc9f35 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:28.798945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aad31d79-d93e-4621-a4be-546a55cc9f35 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.799890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aad31d79-d93e-4621-a4be-546a55cc9f35 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:28.800501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aad31d79-d93e-4621-a4be-546a55cc9f35 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:28.802028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aad31d79-d93e-4621-a4be-546a55cc9f35 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.986542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aad31d79-d93e-4621-a4be-546a55cc9f35 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:28.995679 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aad31d79-d93e-4621-a4be-546a55cc9f35 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1537 microversion: 2.1 time: 0.210076 Oct 29 03:06:29.006068 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2382/4801] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:28 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:29.006838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-43bead9f-c0e4-4161-86fb-18f1e09fe50e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:29.010909 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-43bead9f-c0e4-4161-86fb-18f1e09fe50e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1510 microversion: 2.1 time: 0.877320 Oct 29 03:06:29.013854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-92e429ca-2048-4af7-85a2-8ee746385a51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:29.014489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-92e429ca-2048-4af7-85a2-8ee746385a51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:29.018306 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2420/4802] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:28 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1510 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:29.026110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e429ca-2048-4af7-85a2-8ee746385a51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.026575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e429ca-2048-4af7-85a2-8ee746385a51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.029270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e429ca-2048-4af7-85a2-8ee746385a51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.030171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e429ca-2048-4af7-85a2-8ee746385a51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.030647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e429ca-2048-4af7-85a2-8ee746385a51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.031073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e429ca-2048-4af7-85a2-8ee746385a51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.031570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a343d5c-4441-4c61-aed9-9e4c29a22eed tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:29.032277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1a343d5c-4441-4c61-aed9-9e4c29a22eed tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:29.041275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a343d5c-4441-4c61-aed9-9e4c29a22eed tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.041853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a343d5c-4441-4c61-aed9-9e4c29a22eed tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.042497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a343d5c-4441-4c61-aed9-9e4c29a22eed tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.043416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a343d5c-4441-4c61-aed9-9e4c29a22eed tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.043964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a343d5c-4441-4c61-aed9-9e4c29a22eed tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.044483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a343d5c-4441-4c61-aed9-9e4c29a22eed tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.174068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-92e429ca-2048-4af7-85a2-8ee746385a51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:29.177757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:29.183723 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-92e429ca-2048-4af7-85a2-8ee746385a51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.186004 Oct 29 03:06:29.184726 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2383/4803] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:28 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:29.189679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-26d5cfe6-aa2f-47d8-94ef-97a808055785 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Action: 'create', calling method: .version_select at 0x7fe1acca25e0>, body: {"pool": "33d3c2b4-c2e6-474a-853d-aec58c82b226"} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:29.218716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1a343d5c-4441-4c61-aed9-9e4c29a22eed tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:29.227062 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1a343d5c-4441-4c61-aed9-9e4c29a22eed tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1282 microversion: 2.1 time: 0.207599 Oct 29 03:06:29.227641 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2421/4804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:29 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1282 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:29.232815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a240ee40-f081-4c2f-861f-e53ee188b3d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:29.233637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a240ee40-f081-4c2f-861f-e53ee188b3d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:29.240052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a240ee40-f081-4c2f-861f-e53ee188b3d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.240866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a240ee40-f081-4c2f-861f-e53ee188b3d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.241675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a240ee40-f081-4c2f-861f-e53ee188b3d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.242965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a240ee40-f081-4c2f-861f-e53ee188b3d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.243478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a240ee40-f081-4c2f-861f-e53ee188b3d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.243980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a240ee40-f081-4c2f-861f-e53ee188b3d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.436315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a240ee40-f081-4c2f-861f-e53ee188b3d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:29.445120 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a240ee40-f081-4c2f-861f-e53ee188b3d0 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1309 microversion: 2.1 time: 0.216151 Oct 29 03:06:29.454497 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2422/4805] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:29 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1309 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:29.473508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0e1b3ebe-d945-448f-b308-a7a8c441dbc5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:29.474422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0e1b3ebe-d945-448f-b308-a7a8c441dbc5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:29.483232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e1b3ebe-d945-448f-b308-a7a8c441dbc5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.483998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e1b3ebe-d945-448f-b308-a7a8c441dbc5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.484581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e1b3ebe-d945-448f-b308-a7a8c441dbc5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.485456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e1b3ebe-d945-448f-b308-a7a8c441dbc5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.486884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e1b3ebe-d945-448f-b308-a7a8c441dbc5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.487455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e1b3ebe-d945-448f-b308-a7a8c441dbc5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.699559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0e1b3ebe-d945-448f-b308-a7a8c441dbc5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:29.708456 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0e1b3ebe-d945-448f-b308-a7a8c441dbc5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.245655 Oct 29 03:06:29.709045 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2423/4806] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:29 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:29.715465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d36e9b1-0c9f-4b96-8ebe-b3a290cc6108 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:29.716354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d36e9b1-0c9f-4b96-8ebe-b3a290cc6108 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:29.722704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d36e9b1-0c9f-4b96-8ebe-b3a290cc6108 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.723620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d36e9b1-0c9f-4b96-8ebe-b3a290cc6108 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.724392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d36e9b1-0c9f-4b96-8ebe-b3a290cc6108 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.725258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d36e9b1-0c9f-4b96-8ebe-b3a290cc6108 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.726005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d36e9b1-0c9f-4b96-8ebe-b3a290cc6108 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.726652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d36e9b1-0c9f-4b96-8ebe-b3a290cc6108 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.838199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d36e9b1-0c9f-4b96-8ebe-b3a290cc6108 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:29.846666 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d36e9b1-0c9f-4b96-8ebe-b3a290cc6108 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1273 microversion: 2.1 time: 0.135694 Oct 29 03:06:29.847867 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2424/4807] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:29 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:29.852744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fe263582-b005-4ead-b03f-6869df2c5226 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:29.853507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fe263582-b005-4ead-b03f-6869df2c5226 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:29.860180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe263582-b005-4ead-b03f-6869df2c5226 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.860877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe263582-b005-4ead-b03f-6869df2c5226 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.861462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe263582-b005-4ead-b03f-6869df2c5226 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.862388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe263582-b005-4ead-b03f-6869df2c5226 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.863008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe263582-b005-4ead-b03f-6869df2c5226 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.863462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe263582-b005-4ead-b03f-6869df2c5226 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.912517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fe263582-b005-4ead-b03f-6869df2c5226 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Locking {{(pid=127042) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 29 03:06:29.995393 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fe263582-b005-4ead-b03f-6869df2c5226 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.146104 Oct 29 03:06:30.000050 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2425/4808] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:29 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:06:30.006215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:30.007600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:30.015231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.016022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.016674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.018294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.019648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.020227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.274018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:30.286220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:30.287884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:30.290925 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a4bd5403-247a-4f8c-bc08-bc23b91145b0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.292942 Oct 29 03:06:30.294805 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2426/4809] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:29 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:30.307231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b53a9937-5574-4e09-8a87-c3d45c0a40c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:30.308032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b53a9937-5574-4e09-8a87-c3d45c0a40c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:30.321081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53a9937-5574-4e09-8a87-c3d45c0a40c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.323639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53a9937-5574-4e09-8a87-c3d45c0a40c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.324329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53a9937-5574-4e09-8a87-c3d45c0a40c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.326380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53a9937-5574-4e09-8a87-c3d45c0a40c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.327054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53a9937-5574-4e09-8a87-c3d45c0a40c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.328886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b53a9937-5574-4e09-8a87-c3d45c0a40c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.543852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b53a9937-5574-4e09-8a87-c3d45c0a40c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:30.560407 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b53a9937-5574-4e09-8a87-c3d45c0a40c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.264178 Oct 29 03:06:30.561525 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2427/4810] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:30 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:30.569218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-30089375-cc4f-4c4f-8890-04cef2bfa651 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:30.569426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-30089375-cc4f-4c4f-8890-04cef2bfa651 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:30.581183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30089375-cc4f-4c4f-8890-04cef2bfa651 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.581672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30089375-cc4f-4c4f-8890-04cef2bfa651 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.582162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30089375-cc4f-4c4f-8890-04cef2bfa651 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.582843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30089375-cc4f-4c4f-8890-04cef2bfa651 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.583279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30089375-cc4f-4c4f-8890-04cef2bfa651 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.583694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30089375-cc4f-4c4f-8890-04cef2bfa651 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.733614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-30089375-cc4f-4c4f-8890-04cef2bfa651 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:30.737488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:30.745431 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-30089375-cc4f-4c4f-8890-04cef2bfa651 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1510 microversion: 2.1 time: 0.182717 Oct 29 03:06:30.746388 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2428/4811] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:30 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:30.753541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2dd395e-f259-4c99-91bd-34e635d39c2b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:30.753747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b2dd395e-f259-4c99-91bd-34e635d39c2b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:30.759959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2dd395e-f259-4c99-91bd-34e635d39c2b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.760581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2dd395e-f259-4c99-91bd-34e635d39c2b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.761188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2dd395e-f259-4c99-91bd-34e635d39c2b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.762198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2dd395e-f259-4c99-91bd-34e635d39c2b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.762644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2dd395e-f259-4c99-91bd-34e635d39c2b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.763057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2dd395e-f259-4c99-91bd-34e635d39c2b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.819989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:30.907727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2dd395e-f259-4c99-91bd-34e635d39c2b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:30.916196 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b2dd395e-f259-4c99-91bd-34e635d39c2b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1282 microversion: 2.1 time: 0.168722 Oct 29 03:06:30.930802 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2429/4812] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:30 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:30.937996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-8a2d5db2-7263-4554-8922-681d34a69c30 req-b5306dbf-015f-4b72-b0d2-a7f9c082af91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbab455-c481-40ea-a59c-4ec9c15d935e", "name": "network-vif-unplugged", "status": "completed", "tag": "c7aca24a-a353-4021-bdca-25ce655729ae"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:30.947928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8a2d5db2-7263-4554-8922-681d34a69c30 req-b5306dbf-015f-4b72-b0d2-a7f9c082af91 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.948400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8a2d5db2-7263-4554-8922-681d34a69c30 req-b5306dbf-015f-4b72-b0d2-a7f9c082af91 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.948826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8a2d5db2-7263-4554-8922-681d34a69c30 req-b5306dbf-015f-4b72-b0d2-a7f9c082af91 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.962867 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-8a2d5db2-7263-4554-8922-681d34a69c30 req-b5306dbf-015f-4b72-b0d2-a7f9c082af91 service nova] Creating event network-vif-unplugged:c7aca24a-a353-4021-bdca-25ce655729ae for instance 2bbab455-c481-40ea-a59c-4ec9c15d935e on n-h2-862964-4 Oct 29 03:06:30.968475 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-8a2d5db2-7263-4554-8922-681d34a69c30 req-b5306dbf-015f-4b72-b0d2-a7f9c082af91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036213 Oct 29 03:06:30.969437 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2430/4813] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:30.974771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2f82852-1d16-4d4d-bd36-f9de290c8332 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:30.975472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f2f82852-1d16-4d4d-bd36-f9de290c8332 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:30.982976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f82852-1d16-4d4d-bd36-f9de290c8332 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.983459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f82852-1d16-4d4d-bd36-f9de290c8332 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.983889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f82852-1d16-4d4d-bd36-f9de290c8332 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.984593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f82852-1d16-4d4d-bd36-f9de290c8332 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.985041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f82852-1d16-4d4d-bd36-f9de290c8332 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.985455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f82852-1d16-4d4d-bd36-f9de290c8332 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.173315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f2f82852-1d16-4d4d-bd36-f9de290c8332 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:31.184163 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f2f82852-1d16-4d4d-bd36-f9de290c8332 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1309 microversion: 2.1 time: 0.213287 Oct 29 03:06:31.185321 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2431/4814] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:30 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:31.190490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d338b341-58d4-4430-8c3f-9d0c2b22353f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:31.200948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d338b341-58d4-4430-8c3f-9d0c2b22353f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.201966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d338b341-58d4-4430-8c3f-9d0c2b22353f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.202622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d338b341-58d4-4430-8c3f-9d0c2b22353f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.239823 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d338b341-58d4-4430-8c3f-9d0c2b22353f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] HTTP exception thrown: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 is locked Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d338b341-58d4-4430-8c3f-9d0c2b22353f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Request method failure captured: Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action HTTP/1.1 Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 15 Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJeSr1oL0rONYcv9CfxIanIPbUeGw-s2Wl4VNA9GEpVCgEE4OiCenlJFf66TiN_-nkeJklfReLoMTtrJ83D7xezyaNkFbwK0U16CX_E0dK0DTvVDkg1lOik0BLuL1_K7VtLlWIKuOhFwA62qqiC9Oq-KCZnYhWwKlrztnOyVOmkou8Q Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d4193e4464b7488b9b3bb4064afb0288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}] Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: dc4e17d222e0426698d1ef9a17921d64 Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: {"os-stop": {}} Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 is locked Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '72e7e466-df5f-45f5-9e45-dc3c16e888b7', 'body': {'os-stop': {}}} Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 is locked Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 is locked Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 is locked Oct 29 03:06:31.242285 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:06:31.247584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d338b341-58d4-4430-8c3f-9d0c2b22353f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Returning 409 to user: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 is locked {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:31.247584 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d338b341-58d4-4430-8c3f-9d0c2b22353f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 409 len: 107 microversion: 2.1 time: 0.058867 Oct 29 03:06:31.249726 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2432/4815] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:31 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 107 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:06:31.261936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c02136f-5f19-42f1-8d63-5ddbceaf0035 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:31.262611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4c02136f-5f19-42f1-8d63-5ddbceaf0035 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:31.269728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c02136f-5f19-42f1-8d63-5ddbceaf0035 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.270260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c02136f-5f19-42f1-8d63-5ddbceaf0035 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.271069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c02136f-5f19-42f1-8d63-5ddbceaf0035 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.271789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c02136f-5f19-42f1-8d63-5ddbceaf0035 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.272363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c02136f-5f19-42f1-8d63-5ddbceaf0035 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.272644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c02136f-5f19-42f1-8d63-5ddbceaf0035 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.472251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4c02136f-5f19-42f1-8d63-5ddbceaf0035 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:31.485056 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4c02136f-5f19-42f1-8d63-5ddbceaf0035 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1315 microversion: 2.1 time: 0.231401 Oct 29 03:06:31.487048 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2433/4816] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:31 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:31.497083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3dd4cb1-0550-44a9-89ff-76e6818142d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:31.500573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a3dd4cb1-0550-44a9-89ff-76e6818142d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:31.511723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3dd4cb1-0550-44a9-89ff-76e6818142d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.512538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3dd4cb1-0550-44a9-89ff-76e6818142d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.513074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3dd4cb1-0550-44a9-89ff-76e6818142d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.513925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3dd4cb1-0550-44a9-89ff-76e6818142d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.514502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3dd4cb1-0550-44a9-89ff-76e6818142d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.515019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3dd4cb1-0550-44a9-89ff-76e6818142d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.593531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a3dd4cb1-0550-44a9-89ff-76e6818142d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Unlocking {{(pid=127042) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 29 03:06:31.651331 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a3dd4cb1-0550-44a9-89ff-76e6818142d4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.161518 Oct 29 03:06:31.655329 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2434/4817] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:31 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:06:31.657954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:31.658662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:31.666068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.666608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.667132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.667930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.668632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.669306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.810248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:31.819541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:31.820964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:31.822749 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ee8cac99-f01a-49a7-ad59-2517c184683a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.168403 Oct 29 03:06:31.823019 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2435/4818] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:31 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:31.829645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b627dd9-0ae3-4ad9-82c8-5bf4c8855831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:31.837481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b627dd9-0ae3-4ad9-82c8-5bf4c8855831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.837481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b627dd9-0ae3-4ad9-82c8-5bf4c8855831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.837852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b627dd9-0ae3-4ad9-82c8-5bf4c8855831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.861925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3b627dd9-0ae3-4ad9-82c8-5bf4c8855831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Going to try to stop instance {{(pid=127042) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:06:31.909558 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3b627dd9-0ae3-4ad9-82c8-5bf4c8855831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.084551 Oct 29 03:06:31.913950 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2436/4819] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:31 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:06:31.916348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-494beb4d-8704-437e-84fd-6b210bea3bd6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:31.916579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-494beb4d-8704-437e-84fd-6b210bea3bd6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:31.923474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494beb4d-8704-437e-84fd-6b210bea3bd6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.923962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494beb4d-8704-437e-84fd-6b210bea3bd6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.924390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494beb4d-8704-437e-84fd-6b210bea3bd6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.925716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494beb4d-8704-437e-84fd-6b210bea3bd6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.926196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494beb4d-8704-437e-84fd-6b210bea3bd6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.926616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-494beb4d-8704-437e-84fd-6b210bea3bd6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.979887 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-26d5cfe6-aa2f-47d8-94ef-97a808055785 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.794158 Oct 29 03:06:31.980594 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2384/4820] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Oct 29 03:06:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:31.985558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7053d2df-62e0-4e6d-b0d3-a4380921a5e2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:31.986207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7053d2df-62e0-4e6d-b0d3-a4380921a5e2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:31.997896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7053d2df-62e0-4e6d-b0d3-a4380921a5e2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.998755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7053d2df-62e0-4e6d-b0d3-a4380921a5e2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.999407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7053d2df-62e0-4e6d-b0d3-a4380921a5e2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.003462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7053d2df-62e0-4e6d-b0d3-a4380921a5e2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.004348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7053d2df-62e0-4e6d-b0d3-a4380921a5e2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.006325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7053d2df-62e0-4e6d-b0d3-a4380921a5e2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.099395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-494beb4d-8704-437e-84fd-6b210bea3bd6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:32.107939 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-494beb4d-8704-437e-84fd-6b210bea3bd6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1510 microversion: 2.1 time: 0.195996 Oct 29 03:06:32.108536 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2437/4821] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:31 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:32.113293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-71136469-748e-4439-a214-f411d7d1d77b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:32.113906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-71136469-748e-4439-a214-f411d7d1d77b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:32.124419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71136469-748e-4439-a214-f411d7d1d77b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.125052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71136469-748e-4439-a214-f411d7d1d77b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.125565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71136469-748e-4439-a214-f411d7d1d77b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.127780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71136469-748e-4439-a214-f411d7d1d77b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.128256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71136469-748e-4439-a214-f411d7d1d77b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.128677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71136469-748e-4439-a214-f411d7d1d77b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.258573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7053d2df-62e0-4e6d-b0d3-a4380921a5e2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:32.270148 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7053d2df-62e0-4e6d-b0d3-a4380921a5e2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.288106 Oct 29 03:06:32.271532 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2385/4822] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:31 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:32.276995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.209"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:32.280325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:32.291178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.291938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.292609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.293710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.294218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.294712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.321151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-71136469-748e-4439-a214-f411d7d1d77b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:32.324086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 03:06:32.325218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquired lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 03:06:32.330045 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-71136469-748e-4439-a214-f411d7d1d77b tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1282 microversion: 2.1 time: 0.220364 Oct 29 03:06:32.345151 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2438/4823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:32 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:32.345151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fbbbb0e6-e6ac-439a-a530-569c23fb6efd tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:32.345151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fbbbb0e6-e6ac-439a-a530-569c23fb6efd tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:32.345151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbbbb0e6-e6ac-439a-a530-569c23fb6efd tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.345151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbbbb0e6-e6ac-439a-a530-569c23fb6efd tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.345151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbbbb0e6-e6ac-439a-a530-569c23fb6efd tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.345151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbbbb0e6-e6ac-439a-a530-569c23fb6efd tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.345151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbbbb0e6-e6ac-439a-a530-569c23fb6efd tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.345977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fbbbb0e6-e6ac-439a-a530-569c23fb6efd tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.488778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fbbbb0e6-e6ac-439a-a530-569c23fb6efd tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:32.497758 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fbbbb0e6-e6ac-439a-a530-569c23fb6efd tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1491 microversion: 2.1 time: 0.165362 Oct 29 03:06:32.498641 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2439/4824] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:32 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1491 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:32.512395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-859dd296-4c1d-4ae9-a426-7075b9cb077a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:32.513547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-859dd296-4c1d-4ae9-a426-7075b9cb077a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:32.520341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859dd296-4c1d-4ae9-a426-7075b9cb077a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.521120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859dd296-4c1d-4ae9-a426-7075b9cb077a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.521526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859dd296-4c1d-4ae9-a426-7075b9cb077a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.522469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859dd296-4c1d-4ae9-a426-7075b9cb077a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.522918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859dd296-4c1d-4ae9-a426-7075b9cb077a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.523404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859dd296-4c1d-4ae9-a426-7075b9cb077a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.689305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-859dd296-4c1d-4ae9-a426-7075b9cb077a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:32.699271 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-859dd296-4c1d-4ae9-a426-7075b9cb077a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1315 microversion: 2.1 time: 0.191369 Oct 29 03:06:32.700159 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2440/4825] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:32 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:32.705128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0b6e03e-2edc-4a07-ac0c-04e0dd7503fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:32.707928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0b6e03e-2edc-4a07-ac0c-04e0dd7503fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:32.713607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:32.715621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b6e03e-2edc-4a07-ac0c-04e0dd7503fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.716164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b6e03e-2edc-4a07-ac0c-04e0dd7503fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.716596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b6e03e-2edc-4a07-ac0c-04e0dd7503fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.717324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b6e03e-2edc-4a07-ac0c-04e0dd7503fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.717834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b6e03e-2edc-4a07-ac0c-04e0dd7503fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.718304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0b6e03e-2edc-4a07-ac0c-04e0dd7503fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.786244 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d0b6e03e-2edc-4a07-ac0c-04e0dd7503fa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "PUT /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1086 microversion: 2.1 time: 0.084839 Oct 29 03:06:32.786888 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2441/4826] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 03:06:32 2022] PUT /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1086 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:32.805271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-35250004-6db5-49a1-9295-88b43720b189 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:32.805860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-35250004-6db5-49a1-9295-88b43720b189 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:32.812094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35250004-6db5-49a1-9295-88b43720b189 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.812550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35250004-6db5-49a1-9295-88b43720b189 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.812968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35250004-6db5-49a1-9295-88b43720b189 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.813639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35250004-6db5-49a1-9295-88b43720b189 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.814122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35250004-6db5-49a1-9295-88b43720b189 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.814530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35250004-6db5-49a1-9295-88b43720b189 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.818677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:32.957916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-35250004-6db5-49a1-9295-88b43720b189 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:32.966717 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-35250004-6db5-49a1-9295-88b43720b189 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1512 microversion: 2.1 time: 0.165157 Oct 29 03:06:32.967399 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2442/4827] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:32 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:32.972304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:32.973030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:32.979615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.980233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.980843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.981929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.982516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.983010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.116958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:33.126244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:33.127438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:33.128768 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3543451f-16f3-4778-a8ed-719e8032a2e5 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.160195 Oct 29 03:06:33.129422 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2443/4828] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:32 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:33.155289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f1ba5ec8-2366-46cc-a84b-3257b6497ebd req-58db3711-9f6c-4e27-9548-c15e8a4ed434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f439b2b6-1302-414a-93d3-f162321fd6c6", "name": "network-vif-plugged", "status": "completed", "tag": "291472dd-c560-4f62-ae19-0af367acb98e"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:33.165637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f1ba5ec8-2366-46cc-a84b-3257b6497ebd req-58db3711-9f6c-4e27-9548-c15e8a4ed434 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.166156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f1ba5ec8-2366-46cc-a84b-3257b6497ebd req-58db3711-9f6c-4e27-9548-c15e8a4ed434 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.166575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f1ba5ec8-2366-46cc-a84b-3257b6497ebd req-58db3711-9f6c-4e27-9548-c15e8a4ed434 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.180997 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f1ba5ec8-2366-46cc-a84b-3257b6497ebd req-58db3711-9f6c-4e27-9548-c15e8a4ed434 service nova] Creating event network-vif-plugged:291472dd-c560-4f62-ae19-0af367acb98e for instance f439b2b6-1302-414a-93d3-f162321fd6c6 on n-h2-862964-4 Oct 29 03:06:33.187515 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f1ba5ec8-2366-46cc-a84b-3257b6497ebd req-58db3711-9f6c-4e27-9548-c15e8a4ed434 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037752 Oct 29 03:06:33.188162 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2444/4829] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:33.193584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e3f6cd57-827c-40a4-870c-5b9e9c0b9112 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:33.194255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e3f6cd57-827c-40a4-870c-5b9e9c0b9112 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:33.201033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3f6cd57-827c-40a4-870c-5b9e9c0b9112 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.201507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3f6cd57-827c-40a4-870c-5b9e9c0b9112 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.201968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3f6cd57-827c-40a4-870c-5b9e9c0b9112 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.202663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3f6cd57-827c-40a4-870c-5b9e9c0b9112 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.203109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3f6cd57-827c-40a4-870c-5b9e9c0b9112 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.203528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3f6cd57-827c-40a4-870c-5b9e9c0b9112 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.339120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e3f6cd57-827c-40a4-870c-5b9e9c0b9112 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:33.347671 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e3f6cd57-827c-40a4-870c-5b9e9c0b9112 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1512 microversion: 2.1 time: 0.158291 Oct 29 03:06:33.348536 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2445/4830] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:33 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:33.353160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1888f2c5-6934-4461-9e3d-58d0b2868ecd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:33.353751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1888f2c5-6934-4461-9e3d-58d0b2868ecd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:33.360000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888f2c5-6934-4461-9e3d-58d0b2868ecd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.360479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888f2c5-6934-4461-9e3d-58d0b2868ecd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.360902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888f2c5-6934-4461-9e3d-58d0b2868ecd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.363340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888f2c5-6934-4461-9e3d-58d0b2868ecd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.363340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888f2c5-6934-4461-9e3d-58d0b2868ecd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.363340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888f2c5-6934-4461-9e3d-58d0b2868ecd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.503701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1888f2c5-6934-4461-9e3d-58d0b2868ecd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:33.511693 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1888f2c5-6934-4461-9e3d-58d0b2868ecd tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1510 microversion: 2.1 time: 0.162168 Oct 29 03:06:33.522389 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2446/4831] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:33 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:33.587240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-2a8ad7c9-89d8-4550-a111-f1a0e2f007ec req-6c137714-a5c9-4fa1-9768-f64f7bba4fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e4f42b-3d11-4cf6-9e75-6723897725ac", "tag": "2451fc4b-de69-4c5b-8ce9-145a7670adc4"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:33.597230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2a8ad7c9-89d8-4550-a111-f1a0e2f007ec req-6c137714-a5c9-4fa1-9768-f64f7bba4fd8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.597700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2a8ad7c9-89d8-4550-a111-f1a0e2f007ec req-6c137714-a5c9-4fa1-9768-f64f7bba4fd8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.598183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2a8ad7c9-89d8-4550-a111-f1a0e2f007ec req-6c137714-a5c9-4fa1-9768-f64f7bba4fd8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.609362 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-2a8ad7c9-89d8-4550-a111-f1a0e2f007ec req-6c137714-a5c9-4fa1-9768-f64f7bba4fd8 service nova] Creating event network-changed:2451fc4b-de69-4c5b-8ce9-145a7670adc4 for instance e2e4f42b-3d11-4cf6-9e75-6723897725ac on n-h1-862964-4 Oct 29 03:06:33.614120 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-2a8ad7c9-89d8-4550-a111-f1a0e2f007ec req-6c137714-a5c9-4fa1-9768-f64f7bba4fd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100205 Oct 29 03:06:33.614719 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2447/4832] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:33.620062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b4c7a54-9abb-4c96-b941-f135c2873ccd tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:33.620753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0b4c7a54-9abb-4c96-b941-f135c2873ccd tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:33.626998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b4c7a54-9abb-4c96-b941-f135c2873ccd tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.627487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b4c7a54-9abb-4c96-b941-f135c2873ccd tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.627940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b4c7a54-9abb-4c96-b941-f135c2873ccd tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.628680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b4c7a54-9abb-4c96-b941-f135c2873ccd tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.629122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b4c7a54-9abb-4c96-b941-f135c2873ccd tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.629537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b4c7a54-9abb-4c96-b941-f135c2873ccd tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.764356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b4c7a54-9abb-4c96-b941-f135c2873ccd tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:33.776907 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b4c7a54-9abb-4c96-b941-f135c2873ccd tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.160916 Oct 29 03:06:33.779391 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2448/4833] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:33 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:33.785884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6fe0adf4-6e46-4e02-b0fc-d7283d6df32d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:33.786602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6fe0adf4-6e46-4e02-b0fc-d7283d6df32d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:33.794505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fe0adf4-6e46-4e02-b0fc-d7283d6df32d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.795434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fe0adf4-6e46-4e02-b0fc-d7283d6df32d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.795733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fe0adf4-6e46-4e02-b0fc-d7283d6df32d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.796517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fe0adf4-6e46-4e02-b0fc-d7283d6df32d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.797065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fe0adf4-6e46-4e02-b0fc-d7283d6df32d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.797560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fe0adf4-6e46-4e02-b0fc-d7283d6df32d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.954791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6fe0adf4-6e46-4e02-b0fc-d7283d6df32d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:33.964180 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6fe0adf4-6e46-4e02-b0fc-d7283d6df32d tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1270 microversion: 2.1 time: 0.183711 Oct 29 03:06:33.964914 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2449/4834] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:33 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:33.970012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6688c4a2-d3db-4895-82ca-22f7ddc0bfbc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:33.971582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6688c4a2-d3db-4895-82ca-22f7ddc0bfbc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:33.978370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6688c4a2-d3db-4895-82ca-22f7ddc0bfbc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.978936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6688c4a2-d3db-4895-82ca-22f7ddc0bfbc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.979439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6688c4a2-d3db-4895-82ca-22f7ddc0bfbc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.980207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6688c4a2-d3db-4895-82ca-22f7ddc0bfbc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.980734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6688c4a2-d3db-4895-82ca-22f7ddc0bfbc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.981316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6688c4a2-d3db-4895-82ca-22f7ddc0bfbc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:34.017727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6688c4a2-d3db-4895-82ca-22f7ddc0bfbc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:06:34.114077 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6688c4a2-d3db-4895-82ca-22f7ddc0bfbc tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 204 len: 0 microversion: 2.1 time: 0.147553 Oct 29 03:06:34.114971 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2450/4835] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:06:33 2022] DELETE /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:06:34.124517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb33f897-e027-48ec-9699-768895e375eb tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:34.125253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fb33f897-e027-48ec-9699-768895e375eb tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:34.131468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb33f897-e027-48ec-9699-768895e375eb tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.131940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb33f897-e027-48ec-9699-768895e375eb tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.132358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb33f897-e027-48ec-9699-768895e375eb tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:34.133056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb33f897-e027-48ec-9699-768895e375eb tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.133492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb33f897-e027-48ec-9699-768895e375eb tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.133925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb33f897-e027-48ec-9699-768895e375eb tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:34.274706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fb33f897-e027-48ec-9699-768895e375eb tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:34.282765 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fb33f897-e027-48ec-9699-768895e375eb tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1315 microversion: 2.1 time: 0.166618 Oct 29 03:06:34.283385 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2451/4836] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:34 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:34.301457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40907b87-67ae-46bb-a08e-138ecd1bb581 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:34.302090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40907b87-67ae-46bb-a08e-138ecd1bb581 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:34.308585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40907b87-67ae-46bb-a08e-138ecd1bb581 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.309115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40907b87-67ae-46bb-a08e-138ecd1bb581 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.309549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40907b87-67ae-46bb-a08e-138ecd1bb581 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:34.310278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40907b87-67ae-46bb-a08e-138ecd1bb581 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.310719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40907b87-67ae-46bb-a08e-138ecd1bb581 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.311131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40907b87-67ae-46bb-a08e-138ecd1bb581 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:34.413617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Building network info cache for instance {{(pid=127041) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 03:06:34.457698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40907b87-67ae-46bb-a08e-138ecd1bb581 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:34.466289 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40907b87-67ae-46bb-a08e-138ecd1bb581 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1518 microversion: 2.1 time: 0.181905 Oct 29 03:06:34.467083 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2452/4837] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:34 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:34.487753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:34.488449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:34.495702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.496116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.497392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:34.498348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.499830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.499830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:34.652044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:34.660455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:34.661912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:34.663094 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-194fa438-0c50-417a-8dfb-b26e27e92281 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.180206 Oct 29 03:06:34.663862 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2453/4838] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:34 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:34.680788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e29abd77-e66c-449b-b69b-bece6e19e670 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:34.681393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e29abd77-e66c-449b-b69b-bece6e19e670 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:34.688015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29abd77-e66c-449b-b69b-bece6e19e670 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.688486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29abd77-e66c-449b-b69b-bece6e19e670 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.688913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29abd77-e66c-449b-b69b-bece6e19e670 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:34.689613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29abd77-e66c-449b-b69b-bece6e19e670 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.690091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29abd77-e66c-449b-b69b-bece6e19e670 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.690505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e29abd77-e66c-449b-b69b-bece6e19e670 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:34.831909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e29abd77-e66c-449b-b69b-bece6e19e670 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:34.841782 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e29abd77-e66c-449b-b69b-bece6e19e670 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1513 microversion: 2.1 time: 0.164749 Oct 29 03:06:34.842652 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2454/4839] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:34 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:34.848013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1e4edc55-dcd1-43d7-a27a-4f618100db79 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:34.848642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1e4edc55-dcd1-43d7-a27a-4f618100db79 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:34.854769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e4edc55-dcd1-43d7-a27a-4f618100db79 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.855360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e4edc55-dcd1-43d7-a27a-4f618100db79 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.856028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e4edc55-dcd1-43d7-a27a-4f618100db79 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:34.856898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e4edc55-dcd1-43d7-a27a-4f618100db79 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.857465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e4edc55-dcd1-43d7-a27a-4f618100db79 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.858023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e4edc55-dcd1-43d7-a27a-4f618100db79 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.017431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1e4edc55-dcd1-43d7-a27a-4f618100db79 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:35.028226 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1e4edc55-dcd1-43d7-a27a-4f618100db79 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.184459 Oct 29 03:06:35.032801 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2455/4840] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:34 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:35.036919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-06a5c160-04bc-4f39-92b5-ab644f3ae6a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:35.038130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-06a5c160-04bc-4f39-92b5-ab644f3ae6a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:35.044423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Updating instance_info_cache with network_info: [{"id": "c596b5f8-cd42-45ed-b78f-8654fb1e1fbb", "address": "fa:16:3e:31:e7:a3", "network": {"id": "c769d1c5-33b4-4c34-a25d-0963f6922b0d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1146303279-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2e8d515c679e481b83d7001b99442d35", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc596b5f8-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127041) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 03:06:35.046824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a5c160-04bc-4f39-92b5-ab644f3ae6a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.047323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a5c160-04bc-4f39-92b5-ab644f3ae6a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.047752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a5c160-04bc-4f39-92b5-ab644f3ae6a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.048977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a5c160-04bc-4f39-92b5-ab644f3ae6a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.049422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a5c160-04bc-4f39-92b5-ab644f3ae6a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.049874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06a5c160-04bc-4f39-92b5-ab644f3ae6a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.062675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Releasing lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 03:06:35.063656 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a090ca13-a497-49b3-88d8-a8d80ae9669e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action" status: 202 len: 0 microversion: 2.1 time: 2.791010 Oct 29 03:06:35.064502 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2386/4841] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:32 2022] POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action => generated 0 bytes in 2792 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 03:06:35.070114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8dae39ee-ebd6-4a95-bf1d-8ca2cc5bee78 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:35.071046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8dae39ee-ebd6-4a95-bf1d-8ca2cc5bee78 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:35.078557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dae39ee-ebd6-4a95-bf1d-8ca2cc5bee78 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.079432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dae39ee-ebd6-4a95-bf1d-8ca2cc5bee78 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.079899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dae39ee-ebd6-4a95-bf1d-8ca2cc5bee78 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.080603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dae39ee-ebd6-4a95-bf1d-8ca2cc5bee78 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.081055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dae39ee-ebd6-4a95-bf1d-8ca2cc5bee78 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.081547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dae39ee-ebd6-4a95-bf1d-8ca2cc5bee78 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.205435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-06a5c160-04bc-4f39-92b5-ab644f3ae6a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:35.218376 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-06a5c160-04bc-4f39-92b5-ab644f3ae6a4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1513 microversion: 2.1 time: 0.187629 Oct 29 03:06:35.236928 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2456/4842] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:35 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:35.245436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d52ff901-4b43-4a22-a01e-7dc590dbf3a7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Action: 'create', calling method: .version_select at 0x7fe1a8947310>, body: {"pool": "33d3c2b4-c2e6-474a-853d-aec58c82b226"} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:35.344555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8dae39ee-ebd6-4a95-bf1d-8ca2cc5bee78 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:35.353084 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8dae39ee-ebd6-4a95-bf1d-8ca2cc5bee78 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1270 microversion: 2.1 time: 0.287201 Oct 29 03:06:35.354012 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2387/4843] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:35 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1270 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:35.373607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:35.374266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:35.381394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.381914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.382344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.383045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.383488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.383898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.425469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lazy-loading 'flavor' on Instance uuid 2bbab455-c481-40ea-a59c-4ec9c15d935e {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:06:35.444435 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Cannot 'shelve' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state shelved_offloaded Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action HTTP/1.1 Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 14 Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: {"shelve": {}} Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: exception: Cannot 'shelve' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state shelved_offloaded Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2bbab455-c481-40ea-a59c-4ec9c15d935e', 'body': {'shelve': {}}} Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:06:35.446604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state shelved_offloaded Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state shelved_offloaded Oct 29 03:06:35.450774 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:35.453420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 409 to user: Cannot 'shelve' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state shelved_offloaded {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:35.454773 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ca70f2a-8086-4145-bed1-02a14f5b3fae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 409 len: 155 microversion: 2.1 time: 0.085304 Oct 29 03:06:35.455810 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2388/4844] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:35 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 155 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:06:35.460575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-26ef7e88-fd33-43ed-ab95-962185919556 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:35.461418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-26ef7e88-fd33-43ed-ab95-962185919556 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:35.469559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26ef7e88-fd33-43ed-ab95-962185919556 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.470267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26ef7e88-fd33-43ed-ab95-962185919556 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.470800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26ef7e88-fd33-43ed-ab95-962185919556 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.471608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26ef7e88-fd33-43ed-ab95-962185919556 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.472210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26ef7e88-fd33-43ed-ab95-962185919556 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.473201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26ef7e88-fd33-43ed-ab95-962185919556 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.750139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-26ef7e88-fd33-43ed-ab95-962185919556 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:35.758943 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-26ef7e88-fd33-43ed-ab95-962185919556 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1315 microversion: 2.1 time: 0.301638 Oct 29 03:06:35.760276 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2389/4845] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:35 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:35.890544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5252980d-ad9d-435e-b74d-cd05342b9e0d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:35.891272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5252980d-ad9d-435e-b74d-cd05342b9e0d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:35.897698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5252980d-ad9d-435e-b74d-cd05342b9e0d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.898225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5252980d-ad9d-435e-b74d-cd05342b9e0d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.898657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5252980d-ad9d-435e-b74d-cd05342b9e0d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.901160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5252980d-ad9d-435e-b74d-cd05342b9e0d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.901625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5252980d-ad9d-435e-b74d-cd05342b9e0d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.902073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5252980d-ad9d-435e-b74d-cd05342b9e0d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.929019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5252980d-ad9d-435e-b74d-cd05342b9e0d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:06:36.016028 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5252980d-ad9d-435e-b74d-cd05342b9e0d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "DELETE /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 204 len: 0 microversion: 2.42 time: 0.253442 Oct 29 03:06:36.016766 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2390/4846] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:06:35 2022] DELETE /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:06:36.024312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-399ebf21-35a7-4a10-bc77-6f185f419f73 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:36.025023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-399ebf21-35a7-4a10-bc77-6f185f419f73 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:36.031379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-399ebf21-35a7-4a10-bc77-6f185f419f73 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.031945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-399ebf21-35a7-4a10-bc77-6f185f419f73 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.033387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-399ebf21-35a7-4a10-bc77-6f185f419f73 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.034217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-399ebf21-35a7-4a10-bc77-6f185f419f73 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.035731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-399ebf21-35a7-4a10-bc77-6f185f419f73 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.036217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-399ebf21-35a7-4a10-bc77-6f185f419f73 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.072210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-399ebf21-35a7-4a10-bc77-6f185f419f73 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127041) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 03:06:36.141247 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-399ebf21-35a7-4a10-bc77-6f185f419f73 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 202 len: 0 microversion: 2.1 time: 0.123027 Oct 29 03:06:36.144896 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2391/4847] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:36 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:06:36.146695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4816ed32-0b9a-4763-9727-d6b80b8a21c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:36.147329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4816ed32-0b9a-4763-9727-d6b80b8a21c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:36.153976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4816ed32-0b9a-4763-9727-d6b80b8a21c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.154737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4816ed32-0b9a-4763-9727-d6b80b8a21c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.154978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4816ed32-0b9a-4763-9727-d6b80b8a21c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.155638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4816ed32-0b9a-4763-9727-d6b80b8a21c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.156042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4816ed32-0b9a-4763-9727-d6b80b8a21c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.156426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4816ed32-0b9a-4763-9727-d6b80b8a21c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.303559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4816ed32-0b9a-4763-9727-d6b80b8a21c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:36.313950 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4816ed32-0b9a-4763-9727-d6b80b8a21c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1518 microversion: 2.1 time: 0.170800 Oct 29 03:06:36.314690 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2392/4848] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:36 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:36.319043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-38f04900-1d0f-451a-a990-d022d3ff70ce req-4b2a3e5d-1b6a-4b4d-9e51-7813ddc8a460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4", "tag": "c596b5f8-cd42-45ed-b78f-8654fb1e1fbb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:36.329187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-38f04900-1d0f-451a-a990-d022d3ff70ce req-4b2a3e5d-1b6a-4b4d-9e51-7813ddc8a460 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.329671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-38f04900-1d0f-451a-a990-d022d3ff70ce req-4b2a3e5d-1b6a-4b4d-9e51-7813ddc8a460 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.330124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-38f04900-1d0f-451a-a990-d022d3ff70ce req-4b2a3e5d-1b6a-4b4d-9e51-7813ddc8a460 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.341725 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-38f04900-1d0f-451a-a990-d022d3ff70ce req-4b2a3e5d-1b6a-4b4d-9e51-7813ddc8a460 service nova] Creating event network-changed:c596b5f8-cd42-45ed-b78f-8654fb1e1fbb for instance fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 on n-h2-862964-4 Oct 29 03:06:36.346782 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-38f04900-1d0f-451a-a990-d022d3ff70ce req-4b2a3e5d-1b6a-4b4d-9e51-7813ddc8a460 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031076 Oct 29 03:06:36.347640 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2393/4849] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:36.352848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:36.353544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:36.359982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.360505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.360936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.361641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.362119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.362536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.510763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:36.520293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:36.522450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:36.523539 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cd99b4bf-f1a7-4c6d-967b-45d716abb718 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.175031 Oct 29 03:06:36.524577 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2394/4850] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:36 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:36.538437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:36.539173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:36.546058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.546646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.547175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.547978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.548693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.549212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.641691 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d52ff901-4b43-4a22-a01e-7dc590dbf3a7 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.404374 Oct 29 03:06:36.642597 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2457/4851] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Oct 29 03:06:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:36.647512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b205b548-bd13-4e20-a64b-b50b823faaf8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:36.648370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b205b548-bd13-4e20-a64b-b50b823faaf8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:36.656859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b205b548-bd13-4e20-a64b-b50b823faaf8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.657646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b205b548-bd13-4e20-a64b-b50b823faaf8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.658337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b205b548-bd13-4e20-a64b-b50b823faaf8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.659143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b205b548-bd13-4e20-a64b-b50b823faaf8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.659812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b205b548-bd13-4e20-a64b-b50b823faaf8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.660316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b205b548-bd13-4e20-a64b-b50b823faaf8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.771762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:36.783733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:36.785161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:36.786671 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d63232d-645d-4624-8ee5-e5d85c909e90 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2956 microversion: 2.42 time: 0.252599 Oct 29 03:06:36.787266 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2395/4852] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:36 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2956 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:36.792029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c3c5c188-b446-4ef3-8f88-96e3c1976d95 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:36.792816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c3c5c188-b446-4ef3-8f88-96e3c1976d95 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:36.799640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3c5c188-b446-4ef3-8f88-96e3c1976d95 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.800334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3c5c188-b446-4ef3-8f88-96e3c1976d95 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.801195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3c5c188-b446-4ef3-8f88-96e3c1976d95 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.802260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3c5c188-b446-4ef3-8f88-96e3c1976d95 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.803070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3c5c188-b446-4ef3-8f88-96e3c1976d95 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.803855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3c5c188-b446-4ef3-8f88-96e3c1976d95 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.806529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b205b548-bd13-4e20-a64b-b50b823faaf8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:36.817003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b205b548-bd13-4e20-a64b-b50b823faaf8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.172957 Oct 29 03:06:36.818110 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2458/4853] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:36 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:36.827670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c58fc29-8d20-4d1a-a88a-83fe5767c28a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:36.828418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c58fc29-8d20-4d1a-a88a-83fe5767c28a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:36.836101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c58fc29-8d20-4d1a-a88a-83fe5767c28a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.836589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c58fc29-8d20-4d1a-a88a-83fe5767c28a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.838330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c58fc29-8d20-4d1a-a88a-83fe5767c28a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.839237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c58fc29-8d20-4d1a-a88a-83fe5767c28a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.839767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c58fc29-8d20-4d1a-a88a-83fe5767c28a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.840338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c58fc29-8d20-4d1a-a88a-83fe5767c28a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.869136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:36.956699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c3c5c188-b446-4ef3-8f88-96e3c1976d95 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:36.967914 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c3c5c188-b446-4ef3-8f88-96e3c1976d95 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1521 microversion: 2.1 time: 0.179385 Oct 29 03:06:36.968824 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2396/4854] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:36 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:36.991313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.137"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:36.995831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:37.003405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.004250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.004687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:37.005396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.006037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.006614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:37.016135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c58fc29-8d20-4d1a-a88a-83fe5767c28a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:37.026953 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c58fc29-8d20-4d1a-a88a-83fe5767c28a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1270 microversion: 2.1 time: 0.206553 Oct 29 03:06:37.028506 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2459/4855] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:36 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1270 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:37.034044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ee4599c1-c1ac-4174-9e1e-4b5455f8596e tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:37.039039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ee4599c1-c1ac-4174-9e1e-4b5455f8596e tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:37.046518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4599c1-c1ac-4174-9e1e-4b5455f8596e tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.047077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4599c1-c1ac-4174-9e1e-4b5455f8596e tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.047607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4599c1-c1ac-4174-9e1e-4b5455f8596e tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:37.048441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4599c1-c1ac-4174-9e1e-4b5455f8596e tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.048932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 03:06:37.049086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4599c1-c1ac-4174-9e1e-4b5455f8596e tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.049338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquired lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 03:06:37.049679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee4599c1-c1ac-4174-9e1e-4b5455f8596e tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:37.190659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ee4599c1-c1ac-4174-9e1e-4b5455f8596e tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:37.198696 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ee4599c1-c1ac-4174-9e1e-4b5455f8596e tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1315 microversion: 2.1 time: 0.169202 Oct 29 03:06:37.199274 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2460/4856] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:37 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:37.338261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-18e785c0-d840-4800-a45d-b79343cc2021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:37.338779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-18e785c0-d840-4800-a45d-b79343cc2021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:37.345035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e785c0-d840-4800-a45d-b79343cc2021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.345524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e785c0-d840-4800-a45d-b79343cc2021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.345992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e785c0-d840-4800-a45d-b79343cc2021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:37.346692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e785c0-d840-4800-a45d-b79343cc2021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.347145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e785c0-d840-4800-a45d-b79343cc2021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.347564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e785c0-d840-4800-a45d-b79343cc2021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:37.437076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.137 (05408242-edea-4dae-84e9-1e4e0697fcf3) with port c596b5f8-cd42-45ed-b78f-8654fb1e1fbb using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 33d3c2b4-c2e6-474a-853d-aec58c82b226.", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 03:06:37.437692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Releasing lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 03:06:37.438280 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.137 (05408242-edea-4dae-84e9-1e4e0697fcf3) with port c596b5f8-cd42-45ed-b78f-8654fb1e1fbb using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 33d3c2b4-c2e6-474a-853d-aec58c82b226. Oct 29 03:06:37.438280 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-a833e558-cc51-481a-b1b7-5a1e0f244516'] Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Request method failure captured: Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action HTTP/1.1 Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 46 Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJiYn5SwNgRHX-3tY85od-I09wt-Q5-EMPZkNf2bzQs3_sLh5g8OMGrLTklXoP84XxdT9NdBQ2L4eRET55N22uzAg6k9_K9VqUFXvWt8RxUyCuHNcVVBWtC3QTTV3qFnzGTPElRp4nfQ3AGdqaBBba5Mpf7cVnd8RBC9e2B4g0od6-Q Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2e8d515c679e481b83d7001b99442d35 Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e8d515c679e481b83d7001b99442d35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e8d515c679e481b83d7001b99442d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e8d515c679e481b83d7001b99442d35", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e8d515c679e481b83d7001b99442d35"}]}] Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2e8d515c679e481b83d7001b99442d35 Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 735d6338d29c46ee9b6065580413f201 Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: {"addFloatingIp": {"address": "172.25.9.137"}} Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: exception: Cannot associate floating IP 172.25.9.137 (05408242-edea-4dae-84e9-1e4e0697fcf3) with port c596b5f8-cd42-45ed-b78f-8654fb1e1fbb using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 33d3c2b4-c2e6-474a-853d-aec58c82b226. Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-a833e558-cc51-481a-b1b7-5a1e0f244516'] Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4', 'body': {'addFloatingIp': {'address': '172.25.9.137'}}} Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 03:06:37.440505 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.137 (05408242-edea-4dae-84e9-1e4e0697fcf3) with port c596b5f8-cd42-45ed-b78f-8654fb1e1fbb using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 33d3c2b4-c2e6-474a-853d-aec58c82b226. Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a833e558-cc51-481a-b1b7-5a1e0f244516'] Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.137 (05408242-edea-4dae-84e9-1e4e0697fcf3) with port c596b5f8-cd42-45ed-b78f-8654fb1e1fbb using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 33d3c2b4-c2e6-474a-853d-aec58c82b226. Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a833e558-cc51-481a-b1b7-5a1e0f244516'] Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.137 (05408242-edea-4dae-84e9-1e4e0697fcf3) with port c596b5f8-cd42-45ed-b78f-8654fb1e1fbb using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 33d3c2b4-c2e6-474a-853d-aec58c82b226. Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a833e558-cc51-481a-b1b7-5a1e0f244516'] Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.137 (05408242-edea-4dae-84e9-1e4e0697fcf3) with port c596b5f8-cd42-45ed-b78f-8654fb1e1fbb using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 33d3c2b4-c2e6-474a-853d-aec58c82b226. Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a833e558-cc51-481a-b1b7-5a1e0f244516'] Oct 29 03:06:37.444979 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:37.448925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Returning 400 to user: Cannot associate floating IP 172.25.9.137 (05408242-edea-4dae-84e9-1e4e0697fcf3) with port c596b5f8-cd42-45ed-b78f-8654fb1e1fbb using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 33d3c2b4-c2e6-474a-853d-aec58c82b226. Oct 29 03:06:37.448925 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-a833e558-cc51-481a-b1b7-5a1e0f244516'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:37.448925 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8cca871b-4809-4058-9ab9-d0493a6251b2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action" status: 400 len: 382 microversion: 2.1 time: 0.459165 Oct 29 03:06:37.448925 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2397/4857] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:36 2022] POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action => generated 382 bytes in 465 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:06:37.451878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7978366f-5b7b-4e27-b6fc-fbfce6c6833f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '.version_select at 0x7fe1a89c98b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:37.493104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-18e785c0-d840-4800-a45d-b79343cc2021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:37.501444 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-18e785c0-d840-4800-a45d-b79343cc2021 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1518 microversion: 2.1 time: 0.167234 Oct 29 03:06:37.502063 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2461/4858] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:37 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:37.553068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:37.553679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:37.560611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.561507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.562387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:37.563314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.563858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.564429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:37.617984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:37.655658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:37.700654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:37.708860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:37.710320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:37.711491 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5e8b0046-b029-4944-81a7-842f58b9ca17 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.163545 Oct 29 03:06:37.712069 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2462/4859] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:37 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:37.816178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:37.816770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:37.823416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.823888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.824319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:37.825826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.826286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.826698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.016608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.026092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.027625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.028873 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-32b387f7-d41e-4d80-a9d6-82dd2eb96071 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2956 microversion: 2.42 time: 0.216657 Oct 29 03:06:38.029443 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2463/4860] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:37 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2956 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:06:38.033902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2b9ead0-195c-4397-a250-5a7e94ba03f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:38.034491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b2b9ead0-195c-4397-a250-5a7e94ba03f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:38.040355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2b9ead0-195c-4397-a250-5a7e94ba03f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.040842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2b9ead0-195c-4397-a250-5a7e94ba03f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.041268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2b9ead0-195c-4397-a250-5a7e94ba03f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.042619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2b9ead0-195c-4397-a250-5a7e94ba03f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.043411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2b9ead0-195c-4397-a250-5a7e94ba03f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.044040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2b9ead0-195c-4397-a250-5a7e94ba03f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.180044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=14 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:38.182923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2b9ead0-195c-4397-a250-5a7e94ba03f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.191777 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b2b9ead0-195c-4397-a250-5a7e94ba03f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.161297 Oct 29 03:06:38.192482 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2464/4861] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:38 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:38.200830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49cd5be5-a144-4fe9-b7e1-648ba802df3e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:38.200830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49cd5be5-a144-4fe9-b7e1-648ba802df3e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:38.205781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49cd5be5-a144-4fe9-b7e1-648ba802df3e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.206307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49cd5be5-a144-4fe9-b7e1-648ba802df3e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.206744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49cd5be5-a144-4fe9-b7e1-648ba802df3e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.207485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49cd5be5-a144-4fe9-b7e1-648ba802df3e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.207941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49cd5be5-a144-4fe9-b7e1-648ba802df3e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.208357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49cd5be5-a144-4fe9-b7e1-648ba802df3e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.223488 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7978366f-5b7b-4e27-b6fc-fbfce6c6833f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/05408242-edea-4dae-84e9-1e4e0697fcf3" status: 202 len: 0 microversion: 2.1 time: 0.775573 Oct 29 03:06:38.224246 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2398/4862] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:06:37 2022] DELETE /compute/v2.1/os-floating-ips/05408242-edea-4dae-84e9-1e4e0697fcf3 => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:06:38.228917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d0159be-f9d7-4e1a-a796-ffeaf96d35d3 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:38.229519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7d0159be-f9d7-4e1a-a796-ffeaf96d35d3 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:38.236927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0159be-f9d7-4e1a-a796-ffeaf96d35d3 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.237406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0159be-f9d7-4e1a-a796-ffeaf96d35d3 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.237860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0159be-f9d7-4e1a-a796-ffeaf96d35d3 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.238556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0159be-f9d7-4e1a-a796-ffeaf96d35d3 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.239003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0159be-f9d7-4e1a-a796-ffeaf96d35d3 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.239420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0159be-f9d7-4e1a-a796-ffeaf96d35d3 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.341571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-49cd5be5-a144-4fe9-b7e1-648ba802df3e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.349411 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-49cd5be5-a144-4fe9-b7e1-648ba802df3e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1521 microversion: 2.1 time: 0.155826 Oct 29 03:06:38.350110 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2465/4863] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:38 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:38.354568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ec019aaf-63ab-42e9-b17d-ab0129def0d0 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:38.355159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ec019aaf-63ab-42e9-b17d-ab0129def0d0 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:38.361143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec019aaf-63ab-42e9-b17d-ab0129def0d0 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.361979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec019aaf-63ab-42e9-b17d-ab0129def0d0 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.362511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec019aaf-63ab-42e9-b17d-ab0129def0d0 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.363467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec019aaf-63ab-42e9-b17d-ab0129def0d0 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.363751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec019aaf-63ab-42e9-b17d-ab0129def0d0 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.364162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec019aaf-63ab-42e9-b17d-ab0129def0d0 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.385101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d0159be-f9d7-4e1a-a796-ffeaf96d35d3 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.394192 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d0159be-f9d7-4e1a-a796-ffeaf96d35d3 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1270 microversion: 2.1 time: 0.169047 Oct 29 03:06:38.395036 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2399/4864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:38 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:38.405502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.209"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:38.502169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec019aaf-63ab-42e9-b17d-ab0129def0d0 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.510645 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ec019aaf-63ab-42e9-b17d-ab0129def0d0 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1315 microversion: 2.1 time: 0.159438 Oct 29 03:06:38.518294 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2466/4865] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:38 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:38.528199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1eedaa91-4469-4eea-b6a9-27eee28dd326 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:38.528797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1eedaa91-4469-4eea-b6a9-27eee28dd326 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:38.535011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eedaa91-4469-4eea-b6a9-27eee28dd326 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.535487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eedaa91-4469-4eea-b6a9-27eee28dd326 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.535912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eedaa91-4469-4eea-b6a9-27eee28dd326 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.536594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eedaa91-4469-4eea-b6a9-27eee28dd326 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.537201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eedaa91-4469-4eea-b6a9-27eee28dd326 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.537609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1eedaa91-4469-4eea-b6a9-27eee28dd326 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.568652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:38.575992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.576481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.576953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.577666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.578401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.579046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.584843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:38.696075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1eedaa91-4469-4eea-b6a9-27eee28dd326 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.703905 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1eedaa91-4469-4eea-b6a9-27eee28dd326 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1518 microversion: 2.1 time: 0.182085 Oct 29 03:06:38.704486 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2467/4866] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:38 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:38.708939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-c8c0b0b0-ef2a-401e-b9db-5d05d35f039e req-c3f068d8-2de0-446b-a1fc-83975dd6ec92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b", "name": "network-vif-unplugged", "status": "completed", "tag": "63a811a7-784b-4f33-a455-ab65a0be0070"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:38.718555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c8c0b0b0-ef2a-401e-b9db-5d05d35f039e req-c3f068d8-2de0-446b-a1fc-83975dd6ec92 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.719031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c8c0b0b0-ef2a-401e-b9db-5d05d35f039e req-c3f068d8-2de0-446b-a1fc-83975dd6ec92 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.719451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c8c0b0b0-ef2a-401e-b9db-5d05d35f039e req-c3f068d8-2de0-446b-a1fc-83975dd6ec92 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.730822 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c8c0b0b0-ef2a-401e-b9db-5d05d35f039e req-c3f068d8-2de0-446b-a1fc-83975dd6ec92 service nova] Creating event network-vif-unplugged:63a811a7-784b-4f33-a455-ab65a0be0070 for instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b on n-h2-862964-4 Oct 29 03:06:38.735741 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-c8c0b0b0-ef2a-401e-b9db-5d05d35f039e req-c3f068d8-2de0-446b-a1fc-83975dd6ec92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030141 Oct 29 03:06:38.736338 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2468/4867] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:38.744646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:38.745847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:38.752850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.753414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.753966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.754751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:38.755282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:38.755846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.793187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 03:06:38.793592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquired lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 03:06:38.911270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.919843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.921264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.922480 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b79a8056-aa54-4e20-a7eb-cb0c3e0c250b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.183291 Oct 29 03:06:38.925898 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2469/4868] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:38 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:39.056841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:39.057612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:39.064956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.065701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.066342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.067405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.067845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.068245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.262777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:39.272442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:39.273983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:39.275293 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e484bcaf-1815-4ad5-8fc9-ff01b88f9b16 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2956 microversion: 2.42 time: 0.222512 Oct 29 03:06:39.275869 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2470/4869] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:39 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2956 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:39.385512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d52b1ec5-bc68-4568-92c4-ff6254a67a10 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:39.386394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d52b1ec5-bc68-4568-92c4-ff6254a67a10 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:39.392955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d52b1ec5-bc68-4568-92c4-ff6254a67a10 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.393496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d52b1ec5-bc68-4568-92c4-ff6254a67a10 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.394027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d52b1ec5-bc68-4568-92c4-ff6254a67a10 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.394782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d52b1ec5-bc68-4568-92c4-ff6254a67a10 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.395292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d52b1ec5-bc68-4568-92c4-ff6254a67a10 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.395769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d52b1ec5-bc68-4568-92c4-ff6254a67a10 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.513831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Building network info cache for instance {{(pid=127041) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 03:06:39.589176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d52b1ec5-bc68-4568-92c4-ff6254a67a10 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:39.597437 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d52b1ec5-bc68-4568-92c4-ff6254a67a10 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.320390 Oct 29 03:06:39.598278 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2471/4870] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:39 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:39.606119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4baa4703-4cee-46fa-8c45-f75c977c2b68 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:39.607057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4baa4703-4cee-46fa-8c45-f75c977c2b68 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:39.614162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa4703-4cee-46fa-8c45-f75c977c2b68 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.615415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa4703-4cee-46fa-8c45-f75c977c2b68 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.615915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa4703-4cee-46fa-8c45-f75c977c2b68 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.616686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa4703-4cee-46fa-8c45-f75c977c2b68 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.617205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa4703-4cee-46fa-8c45-f75c977c2b68 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.618044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa4703-4cee-46fa-8c45-f75c977c2b68 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.753782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4baa4703-4cee-46fa-8c45-f75c977c2b68 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:39.762294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4baa4703-4cee-46fa-8c45-f75c977c2b68 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1521 microversion: 2.1 time: 0.162750 Oct 29 03:06:39.776235 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2472/4871] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:39 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:39.779333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7ef5bb62-6cd0-4a60-b58c-3217085a2982 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:39.780225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7ef5bb62-6cd0-4a60-b58c-3217085a2982 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:39.795228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ef5bb62-6cd0-4a60-b58c-3217085a2982 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.795727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ef5bb62-6cd0-4a60-b58c-3217085a2982 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.796162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ef5bb62-6cd0-4a60-b58c-3217085a2982 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.796877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ef5bb62-6cd0-4a60-b58c-3217085a2982 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.797328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ef5bb62-6cd0-4a60-b58c-3217085a2982 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.797747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ef5bb62-6cd0-4a60-b58c-3217085a2982 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.951804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7ef5bb62-6cd0-4a60-b58c-3217085a2982 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:39.961339 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7ef5bb62-6cd0-4a60-b58c-3217085a2982 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1270 microversion: 2.1 time: 0.197074 Oct 29 03:06:39.962332 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2473/4872] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:39 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:39.967126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f9110796-fb34-44c0-997b-9057efbfbe46 req-0d313619-7457-4d33-b345-baf6665ef0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4", "tag": "c596b5f8-cd42-45ed-b78f-8654fb1e1fbb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:39.977102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f9110796-fb34-44c0-997b-9057efbfbe46 req-0d313619-7457-4d33-b345-baf6665ef0b4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.977469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f9110796-fb34-44c0-997b-9057efbfbe46 req-0d313619-7457-4d33-b345-baf6665ef0b4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.977947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f9110796-fb34-44c0-997b-9057efbfbe46 req-0d313619-7457-4d33-b345-baf6665ef0b4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.990367 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f9110796-fb34-44c0-997b-9057efbfbe46 req-0d313619-7457-4d33-b345-baf6665ef0b4 service nova] Creating event network-changed:c596b5f8-cd42-45ed-b78f-8654fb1e1fbb for instance fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 on n-h2-862964-4 Oct 29 03:06:39.996150 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f9110796-fb34-44c0-997b-9057efbfbe46 req-0d313619-7457-4d33-b345-baf6665ef0b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032788 Oct 29 03:06:39.997169 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2474/4873] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:40.003326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-00c67766-66be-4489-9288-6c12b6ee9741 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:40.004042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-00c67766-66be-4489-9288-6c12b6ee9741 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:40.010597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00c67766-66be-4489-9288-6c12b6ee9741 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:40.011071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00c67766-66be-4489-9288-6c12b6ee9741 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:40.011491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00c67766-66be-4489-9288-6c12b6ee9741 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:40.012232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00c67766-66be-4489-9288-6c12b6ee9741 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:40.012816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00c67766-66be-4489-9288-6c12b6ee9741 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:40.013401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00c67766-66be-4489-9288-6c12b6ee9741 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:40.393037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-00c67766-66be-4489-9288-6c12b6ee9741 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:40.420790 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-00c67766-66be-4489-9288-6c12b6ee9741 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1315 microversion: 2.1 time: 0.417622 Oct 29 03:06:40.421836 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2475/4874] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:39 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:40.433907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-df688a32-93ee-41b3-9ed9-06ad986d2904 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:40.435600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-df688a32-93ee-41b3-9ed9-06ad986d2904 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:40.449610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df688a32-93ee-41b3-9ed9-06ad986d2904 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:40.450133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df688a32-93ee-41b3-9ed9-06ad986d2904 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:40.451714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df688a32-93ee-41b3-9ed9-06ad986d2904 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:40.452438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df688a32-93ee-41b3-9ed9-06ad986d2904 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:40.452889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df688a32-93ee-41b3-9ed9-06ad986d2904 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:40.453617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df688a32-93ee-41b3-9ed9-06ad986d2904 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:40.903885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Updating instance_info_cache with network_info: [{"id": "c596b5f8-cd42-45ed-b78f-8654fb1e1fbb", "address": "fa:16:3e:31:e7:a3", "network": {"id": "c769d1c5-33b4-4c34-a25d-0963f6922b0d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1146303279-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2e8d515c679e481b83d7001b99442d35", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc596b5f8-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127041) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 03:06:40.935056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Releasing lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 03:06:40.939358 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37dbc2a8-5c50-4474-97b4-3d52bc441fee tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action" status: 202 len: 0 microversion: 2.1 time: 2.538141 Oct 29 03:06:40.944335 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2400/4875] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:38 2022] POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action => generated 0 bytes in 2544 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 03:06:40.983015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:40.992828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:41.020483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:41.022427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:41.023498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:41.024713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:41.035864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:41.038063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:41.390751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-df688a32-93ee-41b3-9ed9-06ad986d2904 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:41.399969 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-df688a32-93ee-41b3-9ed9-06ad986d2904 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 200 len: 1518 microversion: 2.1 time: 0.976812 Oct 29 03:06:41.406511 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2476/4876] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:40 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 1518 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:41.411943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:41.417628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:41.443483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:41.444178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:41.444756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:41.445608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:41.446222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:41.446789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:41.491667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:41.736569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:41.767161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:41.773600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:41.776735 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-98e36b1d-f83a-4a54-a4db-fc86dc4eecf0 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1731 microversion: 2.20 time: 0.828410 Oct 29 03:06:41.777539 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2401/4877] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:40 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1731 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:41.783262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-927fa921-2038-4ab2-9348-081787245819 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:41.784195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-927fa921-2038-4ab2-9348-081787245819 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:41.791245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-927fa921-2038-4ab2-9348-081787245819 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:41.792040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-927fa921-2038-4ab2-9348-081787245819 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:41.801978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-927fa921-2038-4ab2-9348-081787245819 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:41.804317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-927fa921-2038-4ab2-9348-081787245819 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:41.806196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-927fa921-2038-4ab2-9348-081787245819 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:41.809951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-927fa921-2038-4ab2-9348-081787245819 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.038753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:42.050273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:42.052332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:42.053911 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-432bc704-d7c1-4bec-80bc-142abbf09595 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2956 microversion: 2.42 time: 0.645937 Oct 29 03:06:42.075415 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2477/4878] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:41 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2956 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:42.080734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-16f805f7-5e9c-4789-9182-80c3cbc74f91 req-97da10a6-970c-4106-b02c-5764016407d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e4f42b-3d11-4cf6-9e75-6723897725ac", "name": "network-vif-plugged", "status": "completed", "tag": "2451fc4b-de69-4c5b-8ce9-145a7670adc4"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:42.081928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-927fa921-2038-4ab2-9348-081787245819 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:42.091045 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-927fa921-2038-4ab2-9348-081787245819 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.311922 Oct 29 03:06:42.092257 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2402/4879] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:41 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:42.093652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-16f805f7-5e9c-4789-9182-80c3cbc74f91 req-97da10a6-970c-4106-b02c-5764016407d7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.094886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-16f805f7-5e9c-4789-9182-80c3cbc74f91 req-97da10a6-970c-4106-b02c-5764016407d7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.095464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-16f805f7-5e9c-4789-9182-80c3cbc74f91 req-97da10a6-970c-4106-b02c-5764016407d7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.097184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-80a7a7a3-ad9a-4371-af12-a01f168af83c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:42.097885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-80a7a7a3-ad9a-4371-af12-a01f168af83c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:42.104493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a7a7a3-ad9a-4371-af12-a01f168af83c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.105205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a7a7a3-ad9a-4371-af12-a01f168af83c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.106025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a7a7a3-ad9a-4371-af12-a01f168af83c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.106899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a7a7a3-ad9a-4371-af12-a01f168af83c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.107647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a7a7a3-ad9a-4371-af12-a01f168af83c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.108251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80a7a7a3-ad9a-4371-af12-a01f168af83c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.108841 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-16f805f7-5e9c-4789-9182-80c3cbc74f91 req-97da10a6-970c-4106-b02c-5764016407d7 service nova] Creating event network-vif-plugged:2451fc4b-de69-4c5b-8ce9-145a7670adc4 for instance e2e4f42b-3d11-4cf6-9e75-6723897725ac on n-h1-862964-4 Oct 29 03:06:42.115596 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-16f805f7-5e9c-4789-9182-80c3cbc74f91 req-97da10a6-970c-4106-b02c-5764016407d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038521 Oct 29 03:06:42.116417 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2478/4880] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:42.122794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90890f1f-0f73-4eb5-9f5c-2fb4605172fb tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '.version_select at 0x7fe1a33f2280>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:42.290382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-80a7a7a3-ad9a-4371-af12-a01f168af83c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:42.301019 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-80a7a7a3-ad9a-4371-af12-a01f168af83c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.207414 Oct 29 03:06:42.311636 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2403/4881] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:42 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:42.341881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ee383622-ff30-44f7-b4b0-724b5636b51a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:42.347435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ee383622-ff30-44f7-b4b0-724b5636b51a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:42.367099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee383622-ff30-44f7-b4b0-724b5636b51a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.370001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee383622-ff30-44f7-b4b0-724b5636b51a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.370646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee383622-ff30-44f7-b4b0-724b5636b51a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.373300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee383622-ff30-44f7-b4b0-724b5636b51a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.374072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee383622-ff30-44f7-b4b0-724b5636b51a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.375526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee383622-ff30-44f7-b4b0-724b5636b51a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.662379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ee383622-ff30-44f7-b4b0-724b5636b51a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:42.674332 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ee383622-ff30-44f7-b4b0-724b5636b51a tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1270 microversion: 2.1 time: 0.357280 Oct 29 03:06:42.675160 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2404/4882] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:42 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1270 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:42.681262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-64c5734c-4ff3-46ba-b0a8-04b6ac470723 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:42.683107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-64c5734c-4ff3-46ba-b0a8-04b6ac470723 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:42.691817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64c5734c-4ff3-46ba-b0a8-04b6ac470723 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.692449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64c5734c-4ff3-46ba-b0a8-04b6ac470723 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.692980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64c5734c-4ff3-46ba-b0a8-04b6ac470723 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.693915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64c5734c-4ff3-46ba-b0a8-04b6ac470723 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.694542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64c5734c-4ff3-46ba-b0a8-04b6ac470723 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.695551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64c5734c-4ff3-46ba-b0a8-04b6ac470723 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.855245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-64c5734c-4ff3-46ba-b0a8-04b6ac470723 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:42.865155 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-64c5734c-4ff3-46ba-b0a8-04b6ac470723 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1315 microversion: 2.1 time: 0.188685 Oct 29 03:06:42.866501 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2405/4883] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:42 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:42.872706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-66d96f19-1799-4e58-ba54-b5887c210bdf req-dc9a6864-bb84-4d84-b824-6cb5fb8ebebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b", "name": "network-vif-deleted", "tag": "63a811a7-784b-4f33-a455-ab65a0be0070"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:42.883719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-66d96f19-1799-4e58-ba54-b5887c210bdf req-dc9a6864-bb84-4d84-b824-6cb5fb8ebebc service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.884361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-66d96f19-1799-4e58-ba54-b5887c210bdf req-dc9a6864-bb84-4d84-b824-6cb5fb8ebebc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.884948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-66d96f19-1799-4e58-ba54-b5887c210bdf req-dc9a6864-bb84-4d84-b824-6cb5fb8ebebc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.900595 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-66d96f19-1799-4e58-ba54-b5887c210bdf req-dc9a6864-bb84-4d84-b824-6cb5fb8ebebc service nova] Creating event network-vif-deleted:63a811a7-784b-4f33-a455-ab65a0be0070 for instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b on n-h2-862964-4 Oct 29 03:06:42.906764 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-66d96f19-1799-4e58-ba54-b5887c210bdf req-dc9a6864-bb84-4d84-b824-6cb5fb8ebebc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038214 Oct 29 03:06:42.907508 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2406/4884] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:42.920001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:42.923421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:42.932236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.932611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.933094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.933971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.934473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.938514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.956607 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b HTTP/1.1 Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b'} Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:42.958653 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:42.963454 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:42.963454 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:42.963454 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:06:42.963454 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:06:42.963454 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:06:42.963454 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:42.963454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:42.965722 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7316cfa6-ca2c-47a6-a153-cc11176e58eb tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 404 len: 111 microversion: 2.1 time: 0.053980 Oct 29 03:06:42.967303 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2407/4885] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:42 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:06:42.982797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:42.982797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:42.982797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.982797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.982797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.982797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:42.982797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:42.982797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:43.165734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:43.180654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:43.182584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:43.184435 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ff51bc6-9ddf-4300-8e07-a27ec9df65f6 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1718 microversion: 2.20 time: 0.216662 Oct 29 03:06:43.199162 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2408/4886] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:42 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1718 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:43.212522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1948846225", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "204a19c0-c3a9-46eb-85da-9d12d0451025"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:43.235776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:43.295536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] validate_networks() for [('204a19c0-c3a9-46eb-85da-9d12d0451025', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:06:43.720311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:06:43.720908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:06:43.721402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:06:43.721925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:06:43.722404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:06:43.731652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:43.732201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:43.732703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:43.733478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:43.734041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:43.734527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:43.752895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:06:43.758643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Getting quotas for user cecadca739554f858c269b85690b5cec and project 9e1b05d7018447eebe74cc47de363ead. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:06:43.771850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:06:43.774305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:06:43.827078 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8be8f8df-828e-47c7-997d-b6ad8d90d043 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626507 Oct 29 03:06:43.829480 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2409/4887] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:06:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:06:43.836679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:43.837304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:43.846577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:43.847079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:43.848176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:43.848406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:43.848812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:43.849409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.082905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:44.094056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:44.095989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:44.097297 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9521a1e7-d0f7-4b3e-b08d-040984da2121 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2935 microversion: 2.42 time: 0.268234 Oct 29 03:06:44.111454 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2410/4888] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:43 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2935 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:44.127295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1378e5dd-31f8-49e7-bc12-c1a6236a8324 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:44.128091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1378e5dd-31f8-49e7-bc12-c1a6236a8324 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:44.137757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1378e5dd-31f8-49e7-bc12-c1a6236a8324 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.138546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1378e5dd-31f8-49e7-bc12-c1a6236a8324 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.139138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1378e5dd-31f8-49e7-bc12-c1a6236a8324 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.140014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1378e5dd-31f8-49e7-bc12-c1a6236a8324 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.140619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1378e5dd-31f8-49e7-bc12-c1a6236a8324 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.141193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1378e5dd-31f8-49e7-bc12-c1a6236a8324 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.313907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1378e5dd-31f8-49e7-bc12-c1a6236a8324 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:44.326471 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1378e5dd-31f8-49e7-bc12-c1a6236a8324 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1657 microversion: 2.1 time: 0.203145 Oct 29 03:06:44.341943 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2411/4889] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:44 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1657 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:44.357250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89c29868-57c0-4768-88dc-ce9393c7086a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:44.358248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89c29868-57c0-4768-88dc-ce9393c7086a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:44.379506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89c29868-57c0-4768-88dc-ce9393c7086a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.380030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89c29868-57c0-4768-88dc-ce9393c7086a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.380473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89c29868-57c0-4768-88dc-ce9393c7086a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.381502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89c29868-57c0-4768-88dc-ce9393c7086a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.382299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89c29868-57c0-4768-88dc-ce9393c7086a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.382891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89c29868-57c0-4768-88dc-ce9393c7086a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.546830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-89c29868-57c0-4768-88dc-ce9393c7086a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:44.565893 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89c29868-57c0-4768-88dc-ce9393c7086a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.220228 Oct 29 03:06:44.566504 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2412/4890] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:44 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:44.572334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38005e98-b1fc-436f-9a36-a0714c0dd684 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:44.573618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-38005e98-b1fc-436f-9a36-a0714c0dd684 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:44.581149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38005e98-b1fc-436f-9a36-a0714c0dd684 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.582241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38005e98-b1fc-436f-9a36-a0714c0dd684 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.583105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38005e98-b1fc-436f-9a36-a0714c0dd684 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.584346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38005e98-b1fc-436f-9a36-a0714c0dd684 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.585158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38005e98-b1fc-436f-9a36-a0714c0dd684 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.586103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38005e98-b1fc-436f-9a36-a0714c0dd684 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.774552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-38005e98-b1fc-436f-9a36-a0714c0dd684 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:44.786347 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-38005e98-b1fc-436f-9a36-a0714c0dd684 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1270 microversion: 2.1 time: 0.218240 Oct 29 03:06:44.797834 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2413/4891] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:44 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1270 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:44.797834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4c002d60-053c-4d78-9c06-7f992d4d2d3f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:44.797834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4c002d60-053c-4d78-9c06-7f992d4d2d3f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:44.802608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c002d60-053c-4d78-9c06-7f992d4d2d3f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.803082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c002d60-053c-4d78-9c06-7f992d4d2d3f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.803506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c002d60-053c-4d78-9c06-7f992d4d2d3f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.804300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c002d60-053c-4d78-9c06-7f992d4d2d3f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.804744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c002d60-053c-4d78-9c06-7f992d4d2d3f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.805157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c002d60-053c-4d78-9c06-7f992d4d2d3f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.858094 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90890f1f-0f73-4eb5-9f5c-2fb4605172fb tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/427f55fa-66b6-4845-8b15-c7f3a6fa659d" status: 202 len: 0 microversion: 2.1 time: 2.740010 Oct 29 03:06:44.858943 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2479/4892] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:06:42 2022] DELETE /compute/v2.1/os-floating-ips/427f55fa-66b6-4845-8b15-c7f3a6fa659d => generated 0 bytes in 2742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:06:44.865639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-570792dc-8170-4d04-ba39-b7a253a75865 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:44.866427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-570792dc-8170-4d04-ba39-b7a253a75865 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:44.884037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4c002d60-053c-4d78-9c06-7f992d4d2d3f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:44.895045 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4c002d60-053c-4d78-9c06-7f992d4d2d3f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1261 microversion: 2.1 time: 0.106542 Oct 29 03:06:44.896009 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2414/4893] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:44 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:44.901291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-53532c51-57d8-4574-8461-b70de65faf78 req-a14d0a2e-62e6-4545-a347-46c7e90175a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-unplugged", "status": "completed", "tag": "1a6f0f9a-363c-4cc7-bac2-3ec7fe2158ed"}, {"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-unplugged", "status": "completed", "tag": "5b15b418-d44c-4472-af06-882104b0a0b6"}, {"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-unplugged", "status": "completed", "tag": "ad65712e-7434-443f-9bb6-d42e2e4152d0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:44.917418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-53532c51-57d8-4574-8461-b70de65faf78 req-a14d0a2e-62e6-4545-a347-46c7e90175a8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.918079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-53532c51-57d8-4574-8461-b70de65faf78 req-a14d0a2e-62e6-4545-a347-46c7e90175a8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.918743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-53532c51-57d8-4574-8461-b70de65faf78 req-a14d0a2e-62e6-4545-a347-46c7e90175a8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.929785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570792dc-8170-4d04-ba39-b7a253a75865 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.930333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570792dc-8170-4d04-ba39-b7a253a75865 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.930771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570792dc-8170-4d04-ba39-b7a253a75865 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.931486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570792dc-8170-4d04-ba39-b7a253a75865 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.932625 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-53532c51-57d8-4574-8461-b70de65faf78 req-a14d0a2e-62e6-4545-a347-46c7e90175a8 service nova] Creating event network-vif-unplugged:1a6f0f9a-363c-4cc7-bac2-3ec7fe2158ed for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:06:44.933200 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-53532c51-57d8-4574-8461-b70de65faf78 req-a14d0a2e-62e6-4545-a347-46c7e90175a8 service nova] Creating event network-vif-unplugged:5b15b418-d44c-4472-af06-882104b0a0b6 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:06:44.933827 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-53532c51-57d8-4574-8461-b70de65faf78 req-a14d0a2e-62e6-4545-a347-46c7e90175a8 service nova] Creating event network-vif-unplugged:ad65712e-7434-443f-9bb6-d42e2e4152d0 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:06:44.938141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570792dc-8170-4d04-ba39-b7a253a75865 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.938794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570792dc-8170-4d04-ba39-b7a253a75865 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.940351 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-53532c51-57d8-4574-8461-b70de65faf78 req-a14d0a2e-62e6-4545-a347-46c7e90175a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.042409 Oct 29 03:06:44.941556 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2415/4894] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:44.949026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-67d997ee-0521-4328-a5cb-ba342d12f870 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:44.955852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67d997ee-0521-4328-a5cb-ba342d12f870 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.956335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67d997ee-0521-4328-a5cb-ba342d12f870 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.956786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67d997ee-0521-4328-a5cb-ba342d12f870 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.998381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-67d997ee-0521-4328-a5cb-ba342d12f870 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Going to try to start instance {{(pid=127041) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:06:45.050173 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-67d997ee-0521-4328-a5cb-ba342d12f870 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.105021 Oct 29 03:06:45.051361 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2416/4895] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:44 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:06:45.061589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-784041c6-8755-4ea6-b644-c4e66c826411 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-784041c6-8755-4ea6-b644-c4e66c826411 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Request method failure captured: Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action HTTP/1.1 Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 34 Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJiYn5SwNgRHX-3tY85od-I09wt-Q5-EMPZkNf2bzQs3_sLh5g8OMGrLTklXoP84XxdT9NdBQ2L4eRET55N22uzAg6k9_K9VqUFXvWt8RxUyCuHNcVVBWtC3QTTV3qFnzGTPElRp4nfQ3AGdqaBBba5Mpf7cVnd8RBC9e2B4g0od6-Q Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2e8d515c679e481b83d7001b99442d35 Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e8d515c679e481b83d7001b99442d35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e8d515c679e481b83d7001b99442d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e8d515c679e481b83d7001b99442d35", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e8d515c679e481b83d7001b99442d35"}]}] Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2e8d515c679e481b83d7001b99442d35 Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 735d6338d29c46ee9b6065580413f201 Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: {"addFloatingIp": {"address": ""}} Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4', 'body': {'addFloatingIp': {'address': ''}}} Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi '' Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:06:45.073395 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-784041c6-8755-4ea6-b644-c4e66c826411 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:45.077598 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-784041c6-8755-4ea6-b644-c4e66c826411 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action" status: 400 len: 142 microversion: 2.1 time: 0.018880 Oct 29 03:06:45.081034 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2417/4896] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:45 2022] POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action => generated 142 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:06:45.088451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f73fba56-fc1e-4319-af86-8bb48d75f71f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:45.089323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f73fba56-fc1e-4319-af86-8bb48d75f71f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:45.101423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f73fba56-fc1e-4319-af86-8bb48d75f71f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:45.101997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f73fba56-fc1e-4319-af86-8bb48d75f71f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:45.102865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f73fba56-fc1e-4319-af86-8bb48d75f71f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:45.103831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f73fba56-fc1e-4319-af86-8bb48d75f71f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:45.106317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f73fba56-fc1e-4319-af86-8bb48d75f71f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:45.109713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f73fba56-fc1e-4319-af86-8bb48d75f71f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:45.133791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:45.308230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-570792dc-8170-4d04-ba39-b7a253a75865 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:45.316816 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-570792dc-8170-4d04-ba39-b7a253a75865 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1503 microversion: 2.1 time: 0.456384 Oct 29 03:06:45.317550 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2480/4897] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:44 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1503 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:45.322525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:45.325665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:45.332756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:45.333847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:45.334551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:45.335961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:45.336497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:45.337002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:45.368715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f73fba56-fc1e-4319-af86-8bb48d75f71f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:45.373137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 03:06:45.373772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquired lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 03:06:45.380790 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f73fba56-fc1e-4319-af86-8bb48d75f71f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1666 microversion: 2.1 time: 0.298643 Oct 29 03:06:45.381710 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2418/4898] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:45 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1666 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:45.386335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:45.387118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:45.403136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:45.403989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:45.404429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:45.405145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:45.405595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:45.406037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:45.721677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:45.740210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:45.741719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:45.743313 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0d522b4e-5e43-4241-9160-02b3970f2604 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2914 microversion: 2.42 time: 0.360859 Oct 29 03:06:45.743865 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2419/4899] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:45 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2914 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:45.754817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Releasing lock "refresh_cache-fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 03:06:45.755845 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] HTTP exception thrown: floating IP not found Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Request method failure captured: Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action HTTP/1.1 Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 41 Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJiYn5SwNgRHX-3tY85od-I09wt-Q5-EMPZkNf2bzQs3_sLh5g8OMGrLTklXoP84XxdT9NdBQ2L4eRET55N22uzAg6k9_K9VqUFXvWt8RxUyCuHNcVVBWtC3QTTV3qFnzGTPElRp4nfQ3AGdqaBBba5Mpf7cVnd8RBC9e2B4g0od6-Q Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 2e8d515c679e481b83d7001b99442d35 Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e8d515c679e481b83d7001b99442d35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e8d515c679e481b83d7001b99442d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e8d515c679e481b83d7001b99442d35", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e8d515c679e481b83d7001b99442d35"}]}] Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 2e8d515c679e481b83d7001b99442d35 Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 735d6338d29c46ee9b6065580413f201 Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: exception: floating IP not found Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 29 03:06:45.759336 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.764105 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:45.764105 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.764105 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:45.764105 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:45.764105 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:45.764105 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:06:45.764105 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:06:45.764105 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 29 03:06:45.764105 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:06:45.764628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25d0b3b4-f2dd-458b-83ee-f43adb05a73a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:45.764628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25d0b3b4-f2dd-458b-83ee-f43adb05a73a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:45.768298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Returning 404 to user: floating IP not found {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:45.776139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25d0b3b4-f2dd-458b-83ee-f43adb05a73a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:45.776866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25d0b3b4-f2dd-458b-83ee-f43adb05a73a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:45.777678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25d0b3b4-f2dd-458b-83ee-f43adb05a73a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:45.777858 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d07f1aa4-05b5-48c4-88c1-a53a8ed12572 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action" status: 404 len: 67 microversion: 2.1 time: 0.458822 Oct 29 03:06:45.778830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25d0b3b4-f2dd-458b-83ee-f43adb05a73a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:45.779449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25d0b3b4-f2dd-458b-83ee-f43adb05a73a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:45.780031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25d0b3b4-f2dd-458b-83ee-f43adb05a73a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:45.783693 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2481/4900] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:45 2022] POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action => generated 67 bytes in 465 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:06:45.806980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5faedc4e-a001-4117-8005-fdb864bb9228 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:45.807599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5faedc4e-a001-4117-8005-fdb864bb9228 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:45.831864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5faedc4e-a001-4117-8005-fdb864bb9228 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:45.832347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5faedc4e-a001-4117-8005-fdb864bb9228 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:45.832771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5faedc4e-a001-4117-8005-fdb864bb9228 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:45.833478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5faedc4e-a001-4117-8005-fdb864bb9228 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:45.833948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5faedc4e-a001-4117-8005-fdb864bb9228 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:45.834359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5faedc4e-a001-4117-8005-fdb864bb9228 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:45.894950 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25d0b3b4-f2dd-458b-83ee-f43adb05a73a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.149706 Oct 29 03:06:45.896363 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2420/4901] 10.222.0.16 () {58 vars in 1296 bytes} [Sat Oct 29 03:06:45 2022] DELETE /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac/os-server-password => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:06:45.906159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-06f00a33-1272-44bd-9b0c-34aebafb5525 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:46.044538 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-06f00a33-1272-44bd-9b0c-34aebafb5525 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-06f00a33-1272-44bd-9b0c-34aebafb5525 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Request method failure captured: Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action HTTP/1.1 Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 44 Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJiYn5SwNgRHX-3tY85od-I09wt-Q5-EMPZkNf2bzQs3_sLh5g8OMGrLTklXoP84XxdT9NdBQ2L4eRET55N22uzAg6k9_K9VqUFXvWt8RxUyCuHNcVVBWtC3QTTV3qFnzGTPElRp4nfQ3AGdqaBBba5Mpf7cVnd8RBC9e2B4g0od6-Q Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2e8d515c679e481b83d7001b99442d35 Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e8d515c679e481b83d7001b99442d35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e8d515c679e481b83d7001b99442d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e8d515c679e481b83d7001b99442d35", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e8d515c679e481b83d7001b99442d35"}]}] Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2e8d515c679e481b83d7001b99442d35 Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 735d6338d29c46ee9b6065580413f201 Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: exception: Floating IP not found for address 0.0.0.0. Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 29 03:06:46.047048 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 29 03:06:46.051534 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 29 03:06:46.051534 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:46.051534 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:46.051534 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:46.051534 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:46.051534 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:46.051534 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:46.051534 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:06:46.051534 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:06:46.051534 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 29 03:06:46.051534 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:46.053687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-06f00a33-1272-44bd-9b0c-34aebafb5525 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:46.054870 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-06f00a33-1272-44bd-9b0c-34aebafb5525 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action" status: 404 len: 88 microversion: 2.1 time: 0.157321 Oct 29 03:06:46.055648 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2421/4902] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:45 2022] POST /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4/action => generated 88 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:06:46.068716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ad3f3d3-e9d1-4f34-ab9d-132cde9fee13 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:46.069627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9ad3f3d3-e9d1-4f34-ab9d-132cde9fee13 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:46.088690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad3f3d3-e9d1-4f34-ab9d-132cde9fee13 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.089870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad3f3d3-e9d1-4f34-ab9d-132cde9fee13 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.091871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad3f3d3-e9d1-4f34-ab9d-132cde9fee13 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.093836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad3f3d3-e9d1-4f34-ab9d-132cde9fee13 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.095764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad3f3d3-e9d1-4f34-ab9d-132cde9fee13 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.096784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad3f3d3-e9d1-4f34-ab9d-132cde9fee13 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.292854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5faedc4e-a001-4117-8005-fdb864bb9228 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:46.317283 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5faedc4e-a001-4117-8005-fdb864bb9228 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.532320 Oct 29 03:06:46.325182 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2482/4903] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:45 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:46.345139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-28bc8f7b-8dd2-4bfc-9fa8-2b66a5db3c3a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:46.346675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-28bc8f7b-8dd2-4bfc-9fa8-2b66a5db3c3a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:46.363657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28bc8f7b-8dd2-4bfc-9fa8-2b66a5db3c3a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.366204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28bc8f7b-8dd2-4bfc-9fa8-2b66a5db3c3a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.368244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28bc8f7b-8dd2-4bfc-9fa8-2b66a5db3c3a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.369375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28bc8f7b-8dd2-4bfc-9fa8-2b66a5db3c3a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.370981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28bc8f7b-8dd2-4bfc-9fa8-2b66a5db3c3a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.372578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28bc8f7b-8dd2-4bfc-9fa8-2b66a5db3c3a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.421069 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-28bc8f7b-8dd2-4bfc-9fa8-2b66a5db3c3a tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.094355 Oct 29 03:06:46.431606 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2483/4904] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Oct 29 03:06:46 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac/os-server-password => generated 16 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:06:46.441701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af1ec606-acd8-4149-b148-e14f36689df5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:46.448760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-af1ec606-acd8-4149-b148-e14f36689df5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:46.458026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af1ec606-acd8-4149-b148-e14f36689df5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.459033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af1ec606-acd8-4149-b148-e14f36689df5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.459687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af1ec606-acd8-4149-b148-e14f36689df5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.460928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af1ec606-acd8-4149-b148-e14f36689df5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.461544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af1ec606-acd8-4149-b148-e14f36689df5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.462413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af1ec606-acd8-4149-b148-e14f36689df5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.483768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ad3f3d3-e9d1-4f34-ab9d-132cde9fee13 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:46.494253 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ad3f3d3-e9d1-4f34-ab9d-132cde9fee13 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1270 microversion: 2.1 time: 0.436135 Oct 29 03:06:46.514266 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2422/4905] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:46 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1270 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:46.520409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-31efaa34-9c95-43c8-91c8-3178c6fa51d1 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:46.521283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-31efaa34-9c95-43c8-91c8-3178c6fa51d1 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:46.534480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31efaa34-9c95-43c8-91c8-3178c6fa51d1 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.535228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31efaa34-9c95-43c8-91c8-3178c6fa51d1 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.535823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31efaa34-9c95-43c8-91c8-3178c6fa51d1 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.536693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31efaa34-9c95-43c8-91c8-3178c6fa51d1 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.537302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31efaa34-9c95-43c8-91c8-3178c6fa51d1 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.538018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31efaa34-9c95-43c8-91c8-3178c6fa51d1 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.576358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-31efaa34-9c95-43c8-91c8-3178c6fa51d1 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:06:46.600086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-af1ec606-acd8-4149-b148-e14f36689df5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:46.618003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-af1ec606-acd8-4149-b148-e14f36689df5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1267 microversion: 2.1 time: 0.184716 Oct 29 03:06:46.618960 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2484/4906] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:46 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:46.625315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c651580f-d93c-41ec-ac9d-9db1afcfb704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:46.626271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c651580f-d93c-41ec-ac9d-9db1afcfb704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:46.633357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c651580f-d93c-41ec-ac9d-9db1afcfb704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.634189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c651580f-d93c-41ec-ac9d-9db1afcfb704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.634852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c651580f-d93c-41ec-ac9d-9db1afcfb704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.646209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c651580f-d93c-41ec-ac9d-9db1afcfb704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.646209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c651580f-d93c-41ec-ac9d-9db1afcfb704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.646209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c651580f-d93c-41ec-ac9d-9db1afcfb704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.706103 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-31efaa34-9c95-43c8-91c8-3178c6fa51d1 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 204 len: 0 microversion: 2.1 time: 0.188776 Oct 29 03:06:46.707325 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2423/4907] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:06:46 2022] DELETE /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:06:46.713439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e0d84fa-a5f4-4994-a58d-87192009aa0d tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:46.714029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e0d84fa-a5f4-4994-a58d-87192009aa0d tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:46.721818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e0d84fa-a5f4-4994-a58d-87192009aa0d tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.722334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e0d84fa-a5f4-4994-a58d-87192009aa0d tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.722767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e0d84fa-a5f4-4994-a58d-87192009aa0d tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.723530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e0d84fa-a5f4-4994-a58d-87192009aa0d tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.723985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e0d84fa-a5f4-4994-a58d-87192009aa0d tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.724411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e0d84fa-a5f4-4994-a58d-87192009aa0d tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.758818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e0d84fa-a5f4-4994-a58d-87192009aa0d tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:06:46.892590 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1e0d84fa-a5f4-4994-a58d-87192009aa0d tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 204 len: 0 microversion: 2.1 time: 0.182320 Oct 29 03:06:46.894099 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2424/4908] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:06:46 2022] DELETE /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:06:46.903008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b806cbdd-8a92-49a3-987c-ad6783f017c2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:46.904506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b806cbdd-8a92-49a3-987c-ad6783f017c2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:46.911492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b806cbdd-8a92-49a3-987c-ad6783f017c2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.911988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b806cbdd-8a92-49a3-987c-ad6783f017c2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.912403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b806cbdd-8a92-49a3-987c-ad6783f017c2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.913142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b806cbdd-8a92-49a3-987c-ad6783f017c2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.913837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b806cbdd-8a92-49a3-987c-ad6783f017c2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.914267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b806cbdd-8a92-49a3-987c-ad6783f017c2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.958176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c651580f-d93c-41ec-ac9d-9db1afcfb704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:46.966125 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c651580f-d93c-41ec-ac9d-9db1afcfb704 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1666 microversion: 2.1 time: 0.345595 Oct 29 03:06:46.966631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2485/4909] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:46 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1666 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:46.971208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:46.971801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:46.977700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.978214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.978642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.979520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.980134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.980729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.015299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:47.087137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b806cbdd-8a92-49a3-987c-ad6783f017c2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:47.095255 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b806cbdd-8a92-49a3-987c-ad6783f017c2 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1543 microversion: 2.1 time: 0.200061 Oct 29 03:06:47.095839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2425/4910] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:46 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1543 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:47.101200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-df4bf6e5-6b51-4605-be18-203215c908c8 req-696d111d-51d4-4367-8701-26e716a5d037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-deleted", "tag": "2925f2d5-baca-47fa-9f36-1c4849e3e7e4"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:47.113561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-df4bf6e5-6b51-4605-be18-203215c908c8 req-696d111d-51d4-4367-8701-26e716a5d037 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:47.114078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-df4bf6e5-6b51-4605-be18-203215c908c8 req-696d111d-51d4-4367-8701-26e716a5d037 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:47.114505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-df4bf6e5-6b51-4605-be18-203215c908c8 req-696d111d-51d4-4367-8701-26e716a5d037 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.129027 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-df4bf6e5-6b51-4605-be18-203215c908c8 req-696d111d-51d4-4367-8701-26e716a5d037 service nova] Creating event network-vif-deleted:2925f2d5-baca-47fa-9f36-1c4849e3e7e4 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:06:47.135018 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-df4bf6e5-6b51-4605-be18-203215c908c8 req-696d111d-51d4-4367-8701-26e716a5d037 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037631 Oct 29 03:06:47.135959 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2426/4911] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:47.142029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89b4431b-69bf-434e-bf58-0702864c8c62 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:47.142984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89b4431b-69bf-434e-bf58-0702864c8c62 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:47.149405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4431b-69bf-434e-bf58-0702864c8c62 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:47.149920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4431b-69bf-434e-bf58-0702864c8c62 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:47.150355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4431b-69bf-434e-bf58-0702864c8c62 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.151059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4431b-69bf-434e-bf58-0702864c8c62 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:47.151600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4431b-69bf-434e-bf58-0702864c8c62 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:47.152020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4431b-69bf-434e-bf58-0702864c8c62 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.187463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:47.206391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:47.207950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:47.209324 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-11c65ff8-df57-42e0-8ea1-0bc9e458c5c2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2868 microversion: 2.42 time: 0.241768 Oct 29 03:06:47.210295 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2486/4912] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:46 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2868 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:47.215577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-1feef818-ea33-4934-b6bf-b19b0b326118 req-1eabe7bd-3b8d-4fa2-b02b-786dedb1f252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-unplugged", "status": "completed", "tag": "2925f2d5-baca-47fa-9f36-1c4849e3e7e4"}, {"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-unplugged", "status": "completed", "tag": "278acd07-af3d-45fa-b282-64d5acdc531b"}, {"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-unplugged", "status": "completed", "tag": "8dab038a-c463-4da0-a1b0-270182ca43e7"}, {"server_uuid": "cfab3b11-01ce-4757-ba50-5d65796f9788", "name": "network-vif-plugged", "status": "completed", "tag": "224c0a5a-9063-4270-96f9-12450fb578dc"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:47.234681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1feef818-ea33-4934-b6bf-b19b0b326118 req-1eabe7bd-3b8d-4fa2-b02b-786dedb1f252 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:47.235165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1feef818-ea33-4934-b6bf-b19b0b326118 req-1eabe7bd-3b8d-4fa2-b02b-786dedb1f252 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:47.235651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1feef818-ea33-4934-b6bf-b19b0b326118 req-1eabe7bd-3b8d-4fa2-b02b-786dedb1f252 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.250261 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1feef818-ea33-4934-b6bf-b19b0b326118 req-1eabe7bd-3b8d-4fa2-b02b-786dedb1f252 service nova] Creating event network-vif-unplugged:2925f2d5-baca-47fa-9f36-1c4849e3e7e4 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:06:47.250877 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1feef818-ea33-4934-b6bf-b19b0b326118 req-1eabe7bd-3b8d-4fa2-b02b-786dedb1f252 service nova] Creating event network-vif-unplugged:278acd07-af3d-45fa-b282-64d5acdc531b for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:06:47.251442 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1feef818-ea33-4934-b6bf-b19b0b326118 req-1eabe7bd-3b8d-4fa2-b02b-786dedb1f252 service nova] Creating event network-vif-unplugged:8dab038a-c463-4da0-a1b0-270182ca43e7 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:06:47.251995 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1feef818-ea33-4934-b6bf-b19b0b326118 req-1eabe7bd-3b8d-4fa2-b02b-786dedb1f252 service nova] Creating event network-vif-plugged:224c0a5a-9063-4270-96f9-12450fb578dc for instance cfab3b11-01ce-4757-ba50-5d65796f9788 on n-h1-862964-4 Oct 29 03:06:47.261781 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-1feef818-ea33-4934-b6bf-b19b0b326118 req-1eabe7bd-3b8d-4fa2-b02b-786dedb1f252 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.050002 Oct 29 03:06:47.262770 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2487/4913] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:47.343385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-89b4431b-69bf-434e-bf58-0702864c8c62 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:47.351323 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89b4431b-69bf-434e-bf58-0702864c8c62 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1509 microversion: 2.1 time: 0.214187 Oct 29 03:06:47.351474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-590f8244-44e0-481b-8ff7-a40865f7f794 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:47.351908 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2427/4914] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:47 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:47.352082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-590f8244-44e0-481b-8ff7-a40865f7f794 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:47.358522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-590f8244-44e0-481b-8ff7-a40865f7f794 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:47.358947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-590f8244-44e0-481b-8ff7-a40865f7f794 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:47.359373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-590f8244-44e0-481b-8ff7-a40865f7f794 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.360065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-590f8244-44e0-481b-8ff7-a40865f7f794 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:47.360513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-590f8244-44e0-481b-8ff7-a40865f7f794 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:47.360931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-590f8244-44e0-481b-8ff7-a40865f7f794 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.498473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-590f8244-44e0-481b-8ff7-a40865f7f794 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:47.506876 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-590f8244-44e0-481b-8ff7-a40865f7f794 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.159584 Oct 29 03:06:47.507732 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2488/4915] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:47 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:47.518255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a342d7d-dd89-471d-96a0-bd98a58977f4 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:47.518855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a342d7d-dd89-471d-96a0-bd98a58977f4 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:47.525478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a342d7d-dd89-471d-96a0-bd98a58977f4 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:47.525987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a342d7d-dd89-471d-96a0-bd98a58977f4 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:47.526413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a342d7d-dd89-471d-96a0-bd98a58977f4 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.527094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a342d7d-dd89-471d-96a0-bd98a58977f4 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:47.528082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a342d7d-dd89-471d-96a0-bd98a58977f4 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:47.528557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a342d7d-dd89-471d-96a0-bd98a58977f4 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.653316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a0596be-cd82-4b31-abff-7d273afbc45a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:47.654198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3a0596be-cd82-4b31-abff-7d273afbc45a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:47.660711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0596be-cd82-4b31-abff-7d273afbc45a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:47.661500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0596be-cd82-4b31-abff-7d273afbc45a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:47.662101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0596be-cd82-4b31-abff-7d273afbc45a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.662952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0596be-cd82-4b31-abff-7d273afbc45a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:47.664393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0596be-cd82-4b31-abff-7d273afbc45a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:47.664816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0596be-cd82-4b31-abff-7d273afbc45a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.669106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2a342d7d-dd89-471d-96a0-bd98a58977f4 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:47.677155 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a342d7d-dd89-471d-96a0-bd98a58977f4 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1270 microversion: 2.1 time: 0.162858 Oct 29 03:06:47.680674 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2428/4916] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:47 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:47.732902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3a0596be-cd82-4b31-abff-7d273afbc45a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:47.740614 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3a0596be-cd82-4b31-abff-7d273afbc45a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1267 microversion: 2.1 time: 0.091404 Oct 29 03:06:47.741178 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2489/4917] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:47 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:47.990701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7e722028-340c-4ff4-ba76-bb4d8e3ceca2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:47.991304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7e722028-340c-4ff4-ba76-bb4d8e3ceca2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:47.998232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e722028-340c-4ff4-ba76-bb4d8e3ceca2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:47.998716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e722028-340c-4ff4-ba76-bb4d8e3ceca2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:47.999147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e722028-340c-4ff4-ba76-bb4d8e3ceca2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.999829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e722028-340c-4ff4-ba76-bb4d8e3ceca2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.000273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e722028-340c-4ff4-ba76-bb4d8e3ceca2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.000686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e722028-340c-4ff4-ba76-bb4d8e3ceca2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.120037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-91ee3306-5bd7-4d13-9647-311255a4cdff tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:48.121016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-91ee3306-5bd7-4d13-9647-311255a4cdff tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:48.132978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ee3306-5bd7-4d13-9647-311255a4cdff tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.133473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ee3306-5bd7-4d13-9647-311255a4cdff tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.133940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ee3306-5bd7-4d13-9647-311255a4cdff tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.134664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ee3306-5bd7-4d13-9647-311255a4cdff tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.135326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ee3306-5bd7-4d13-9647-311255a4cdff tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.135715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ee3306-5bd7-4d13-9647-311255a4cdff tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.174103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7e722028-340c-4ff4-ba76-bb4d8e3ceca2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:48.182089 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7e722028-340c-4ff4-ba76-bb4d8e3ceca2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1666 microversion: 2.1 time: 0.195322 Oct 29 03:06:48.182682 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2429/4918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:47 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1666 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:48.238800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:48.239677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:48.247403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.247827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.248258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.249329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.249991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.250417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.290597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-91ee3306-5bd7-4d13-9647-311255a4cdff tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:48.301562 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-91ee3306-5bd7-4d13-9647-311255a4cdff tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1543 microversion: 2.1 time: 0.187103 Oct 29 03:06:48.302234 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2490/4919] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:48 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1543 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:48.374729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c176345-8858-4c80-ad2a-caeb13c4ca0b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:48.376318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c176345-8858-4c80-ad2a-caeb13c4ca0b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:48.391926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c176345-8858-4c80-ad2a-caeb13c4ca0b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.392431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c176345-8858-4c80-ad2a-caeb13c4ca0b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.392858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c176345-8858-4c80-ad2a-caeb13c4ca0b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.393753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c176345-8858-4c80-ad2a-caeb13c4ca0b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.394382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c176345-8858-4c80-ad2a-caeb13c4ca0b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.394950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c176345-8858-4c80-ad2a-caeb13c4ca0b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.440749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:48.450592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:48.452039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:48.453307 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b62a4370-d39a-417c-bc56-36fb6d6538f5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2868 microversion: 2.42 time: 0.218680 Oct 29 03:06:48.454260 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2430/4920] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:48 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2868 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:48.533453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c35b01a5-b87e-48f2-9d77-ef93246308a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:48.534519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c35b01a5-b87e-48f2-9d77-ef93246308a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:48.550258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c35b01a5-b87e-48f2-9d77-ef93246308a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.555124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c35b01a5-b87e-48f2-9d77-ef93246308a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.555124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c35b01a5-b87e-48f2-9d77-ef93246308a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.555124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c35b01a5-b87e-48f2-9d77-ef93246308a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.555124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c35b01a5-b87e-48f2-9d77-ef93246308a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.555724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c35b01a5-b87e-48f2-9d77-ef93246308a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.581752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c176345-8858-4c80-ad2a-caeb13c4ca0b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:48.590865 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c176345-8858-4c80-ad2a-caeb13c4ca0b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1509 microversion: 2.1 time: 0.220183 Oct 29 03:06:48.591799 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2491/4921] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:48 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:48.704999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f8ced198-fd18-416b-9e73-260a5f2fb610 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:48.705602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f8ced198-fd18-416b-9e73-260a5f2fb610 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:48.719801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8ced198-fd18-416b-9e73-260a5f2fb610 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.720300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8ced198-fd18-416b-9e73-260a5f2fb610 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.720739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8ced198-fd18-416b-9e73-260a5f2fb610 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.721495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8ced198-fd18-416b-9e73-260a5f2fb610 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.721924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8ced198-fd18-416b-9e73-260a5f2fb610 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.722346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8ced198-fd18-416b-9e73-260a5f2fb610 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.851299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c35b01a5-b87e-48f2-9d77-ef93246308a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:48.861360 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c35b01a5-b87e-48f2-9d77-ef93246308a7 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.333704 Oct 29 03:06:48.862914 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2431/4922] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:48 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:48.868861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e0e2e774-d6fa-440f-9c6a-9dcd763237ca tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:48.870020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e0e2e774-d6fa-440f-9c6a-9dcd763237ca tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:48.880495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0e2e774-d6fa-440f-9c6a-9dcd763237ca tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.881192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0e2e774-d6fa-440f-9c6a-9dcd763237ca tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.881771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0e2e774-d6fa-440f-9c6a-9dcd763237ca tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.882647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0e2e774-d6fa-440f-9c6a-9dcd763237ca tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.883247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0e2e774-d6fa-440f-9c6a-9dcd763237ca tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.883982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0e2e774-d6fa-440f-9c6a-9dcd763237ca tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.891066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:48.961915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e0e2e774-d6fa-440f-9c6a-9dcd763237ca tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:48.972429 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e0e2e774-d6fa-440f-9c6a-9dcd763237ca tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1267 microversion: 2.1 time: 0.107070 Oct 29 03:06:48.973309 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2432/4923] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:48 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:48.976538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f8ced198-fd18-416b-9e73-260a5f2fb610 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:48.991373 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f8ced198-fd18-416b-9e73-260a5f2fb610 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1270 microversion: 2.1 time: 0.290833 Oct 29 03:06:48.992325 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2492/4924] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:48 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1270 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:49.205477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f62d99ea-a244-4a77-85c6-bcac417e8ce4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:49.206261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f62d99ea-a244-4a77-85c6-bcac417e8ce4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:49.212435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f62d99ea-a244-4a77-85c6-bcac417e8ce4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.212911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f62d99ea-a244-4a77-85c6-bcac417e8ce4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.213343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f62d99ea-a244-4a77-85c6-bcac417e8ce4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.214077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f62d99ea-a244-4a77-85c6-bcac417e8ce4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.214519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f62d99ea-a244-4a77-85c6-bcac417e8ce4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.215021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f62d99ea-a244-4a77-85c6-bcac417e8ce4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.324803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7d5f126-bc10-48d1-90bb-b88446b0e707 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:49.325416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b7d5f126-bc10-48d1-90bb-b88446b0e707 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:49.335111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7d5f126-bc10-48d1-90bb-b88446b0e707 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.335727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7d5f126-bc10-48d1-90bb-b88446b0e707 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.341207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7d5f126-bc10-48d1-90bb-b88446b0e707 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.342492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7d5f126-bc10-48d1-90bb-b88446b0e707 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.344728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7d5f126-bc10-48d1-90bb-b88446b0e707 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.345489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7d5f126-bc10-48d1-90bb-b88446b0e707 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.424993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f62d99ea-a244-4a77-85c6-bcac417e8ce4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:49.437419 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f62d99ea-a244-4a77-85c6-bcac417e8ce4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.236256 Oct 29 03:06:49.455711 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2433/4925] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:49 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:49.455711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-93e20471-ffa6-498c-a213-eab1727f79af req-693712e8-884d-46b5-814c-f4d5ef70f120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e4f42b-3d11-4cf6-9e75-6723897725ac", "name": "network-vif-deleted", "tag": "2451fc4b-de69-4c5b-8ce9-145a7670adc4"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:49.462177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-93e20471-ffa6-498c-a213-eab1727f79af req-693712e8-884d-46b5-814c-f4d5ef70f120 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.462661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-93e20471-ffa6-498c-a213-eab1727f79af req-693712e8-884d-46b5-814c-f4d5ef70f120 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.463086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-93e20471-ffa6-498c-a213-eab1727f79af req-693712e8-884d-46b5-814c-f4d5ef70f120 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.481706 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-93e20471-ffa6-498c-a213-eab1727f79af req-693712e8-884d-46b5-814c-f4d5ef70f120 service nova] Creating event network-vif-deleted:2451fc4b-de69-4c5b-8ce9-145a7670adc4 for instance e2e4f42b-3d11-4cf6-9e75-6723897725ac on n-h1-862964-4 Oct 29 03:06:49.487896 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-93e20471-ffa6-498c-a213-eab1727f79af req-693712e8-884d-46b5-814c-f4d5ef70f120 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048115 Oct 29 03:06:49.488829 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2434/4926] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:49.495981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3c94c4fe-b991-4493-91b0-e49116dba7f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:49.496908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3c94c4fe-b991-4493-91b0-e49116dba7f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:49.505341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c94c4fe-b991-4493-91b0-e49116dba7f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.505870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c94c4fe-b991-4493-91b0-e49116dba7f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.506339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c94c4fe-b991-4493-91b0-e49116dba7f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.507055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c94c4fe-b991-4493-91b0-e49116dba7f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.507517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c94c4fe-b991-4493-91b0-e49116dba7f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.507939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c94c4fe-b991-4493-91b0-e49116dba7f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.600148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b7d5f126-bc10-48d1-90bb-b88446b0e707 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:49.615321 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b7d5f126-bc10-48d1-90bb-b88446b0e707 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1543 microversion: 2.1 time: 0.294518 Oct 29 03:06:49.620574 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2493/4927] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:49 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1543 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:49.626284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:49.626908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:49.634642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.635138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.635575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.636281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.636794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.637215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.770271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c94c4fe-b991-4493-91b0-e49116dba7f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:49.779160 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3c94c4fe-b991-4493-91b0-e49116dba7f2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.289119 Oct 29 03:06:49.790134 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2435/4928] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:49 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:49.790134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:49.790134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:49.799892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.799892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.799892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.799892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.799892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.799892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.864083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:49.869255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.869753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.870196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.870648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lazy-loading 'fault' on Instance uuid e2e4f42b-3d11-4cf6-9e75-6723897725ac {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:06:49.878342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:49.880852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:49.882573 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c0380c41-d563-4f2d-bebb-63eafbc2ce91 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2868 microversion: 2.42 time: 0.261173 Oct 29 03:06:49.888529 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2494/4929] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:49 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2868 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:49.894239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d9e96d6-3854-4673-810e-28b1fa2f7f86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:49.895022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d9e96d6-3854-4673-810e-28b1fa2f7f86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:49.902637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9e96d6-3854-4673-810e-28b1fa2f7f86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.903893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9e96d6-3854-4673-810e-28b1fa2f7f86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.904539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9e96d6-3854-4673-810e-28b1fa2f7f86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.905429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9e96d6-3854-4673-810e-28b1fa2f7f86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.906193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9e96d6-3854-4673-810e-28b1fa2f7f86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.906766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9e96d6-3854-4673-810e-28b1fa2f7f86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.941853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda37fbe7dd9480592f14e99d24296e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e073461f640f698fb302b4b9b0779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:49.958908 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-36998a41-a2cb-42cc-b713-c3346745b104 tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 200 len: 1305 microversion: 2.1 time: 0.177494 Oct 29 03:06:49.970935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d9e96d6-3854-4673-810e-28b1fa2f7f86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Unlocking {{(pid=127042) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 29 03:06:49.972972 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2436/4930] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:49 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 1305 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:49.982462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e8db5ee9-49c9-4c44-bfba-1e87718104a9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:49.983207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e8db5ee9-49c9-4c44-bfba-1e87718104a9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:49.990946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8db5ee9-49c9-4c44-bfba-1e87718104a9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.991807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8db5ee9-49c9-4c44-bfba-1e87718104a9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.992793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8db5ee9-49c9-4c44-bfba-1e87718104a9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.993795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8db5ee9-49c9-4c44-bfba-1e87718104a9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.994489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8db5ee9-49c9-4c44-bfba-1e87718104a9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.995373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8db5ee9-49c9-4c44-bfba-1e87718104a9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.024129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:50.069963 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d9e96d6-3854-4673-810e-28b1fa2f7f86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.178114 Oct 29 03:06:50.082690 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2495/4931] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:49 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:06:50.090331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd3a74e0-2fbf-4bf8-ba33-62dbca3a4361 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:50.091258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cd3a74e0-2fbf-4bf8-ba33-62dbca3a4361 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:50.098829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd3a74e0-2fbf-4bf8-ba33-62dbca3a4361 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.099319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd3a74e0-2fbf-4bf8-ba33-62dbca3a4361 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.099748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd3a74e0-2fbf-4bf8-ba33-62dbca3a4361 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.100449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd3a74e0-2fbf-4bf8-ba33-62dbca3a4361 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.100997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd3a74e0-2fbf-4bf8-ba33-62dbca3a4361 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.101417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd3a74e0-2fbf-4bf8-ba33-62dbca3a4361 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.185535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e8db5ee9-49c9-4c44-bfba-1e87718104a9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:50.195978 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e8db5ee9-49c9-4c44-bfba-1e87718104a9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.221830 Oct 29 03:06:50.197965 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2437/4932] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:49 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:50.203212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd3a74e0-2fbf-4bf8-ba33-62dbca3a4361 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:50.203969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-348b92ee-aae9-48b5-9f1d-96854489030f tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:50.204986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-348b92ee-aae9-48b5-9f1d-96854489030f tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:50.217569 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd3a74e0-2fbf-4bf8-ba33-62dbca3a4361 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1267 microversion: 2.1 time: 0.143889 Oct 29 03:06:50.218795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-348b92ee-aae9-48b5-9f1d-96854489030f tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.219291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-348b92ee-aae9-48b5-9f1d-96854489030f tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.219983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-348b92ee-aae9-48b5-9f1d-96854489030f tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.220692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-348b92ee-aae9-48b5-9f1d-96854489030f tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.221299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-348b92ee-aae9-48b5-9f1d-96854489030f tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.221723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-348b92ee-aae9-48b5-9f1d-96854489030f tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.226638 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2496/4933] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:50 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:50.241033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e53c6fc5-f23d-44ae-9857-6bb6f0034070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:50.241720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e53c6fc5-f23d-44ae-9857-6bb6f0034070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:50.250196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e53c6fc5-f23d-44ae-9857-6bb6f0034070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.250780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e53c6fc5-f23d-44ae-9857-6bb6f0034070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.251303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e53c6fc5-f23d-44ae-9857-6bb6f0034070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.252114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e53c6fc5-f23d-44ae-9857-6bb6f0034070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.252656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e53c6fc5-f23d-44ae-9857-6bb6f0034070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.253246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e53c6fc5-f23d-44ae-9857-6bb6f0034070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.415189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e53c6fc5-f23d-44ae-9857-6bb6f0034070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:50.422657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-348b92ee-aae9-48b5-9f1d-96854489030f tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:50.423884 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e53c6fc5-f23d-44ae-9857-6bb6f0034070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.196024 Oct 29 03:06:50.428611 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2497/4934] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:50 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:50.431876 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-348b92ee-aae9-48b5-9f1d-96854489030f tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1458 microversion: 2.1 time: 0.232203 Oct 29 03:06:50.433222 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2438/4935] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:50 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1458 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:50.462565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f8634c5-0247-46a5-9072-2f6c9002048b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:50.463493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5f8634c5-0247-46a5-9072-2f6c9002048b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:50.465296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3f7c5e87-131c-4df2-89ee-a5ef7ac9a920 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:50.466045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3f7c5e87-131c-4df2-89ee-a5ef7ac9a920 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:50.469948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f8634c5-0247-46a5-9072-2f6c9002048b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.470424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f8634c5-0247-46a5-9072-2f6c9002048b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.470855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f8634c5-0247-46a5-9072-2f6c9002048b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.471547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f8634c5-0247-46a5-9072-2f6c9002048b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.471990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f8634c5-0247-46a5-9072-2f6c9002048b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.472093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f7c5e87-131c-4df2-89ee-a5ef7ac9a920 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.472402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f8634c5-0247-46a5-9072-2f6c9002048b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.472520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f7c5e87-131c-4df2-89ee-a5ef7ac9a920 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.473007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f7c5e87-131c-4df2-89ee-a5ef7ac9a920 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.473695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f7c5e87-131c-4df2-89ee-a5ef7ac9a920 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.474176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f7c5e87-131c-4df2-89ee-a5ef7ac9a920 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.474587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f7c5e87-131c-4df2-89ee-a5ef7ac9a920 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.618126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5f8634c5-0247-46a5-9072-2f6c9002048b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:50.626508 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f8634c5-0247-46a5-9072-2f6c9002048b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.167789 Oct 29 03:06:50.627166 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2498/4936] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:50 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:50.632534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3f7c5e87-131c-4df2-89ee-a5ef7ac9a920 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:50.642680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-19291022-ab0e-43a3-b10b-0e92eaff5720 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:50.642919 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3f7c5e87-131c-4df2-89ee-a5ef7ac9a920 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1458 microversion: 2.1 time: 0.181239 Oct 29 03:06:50.654414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-19291022-ab0e-43a3-b10b-0e92eaff5720 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:50.654781 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2439/4937] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:50 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1458 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:50.654884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19291022-ab0e-43a3-b10b-0e92eaff5720 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.654884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19291022-ab0e-43a3-b10b-0e92eaff5720 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.654884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19291022-ab0e-43a3-b10b-0e92eaff5720 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.654884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19291022-ab0e-43a3-b10b-0e92eaff5720 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.654884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19291022-ab0e-43a3-b10b-0e92eaff5720 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.654884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19291022-ab0e-43a3-b10b-0e92eaff5720 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.672165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9c353b9b-0ec2-4534-b42b-61a744fcfbaa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:50.672782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9c353b9b-0ec2-4534-b42b-61a744fcfbaa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:50.681285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c353b9b-0ec2-4534-b42b-61a744fcfbaa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.681796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c353b9b-0ec2-4534-b42b-61a744fcfbaa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.682432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c353b9b-0ec2-4534-b42b-61a744fcfbaa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.683147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c353b9b-0ec2-4534-b42b-61a744fcfbaa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.683679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c353b9b-0ec2-4534-b42b-61a744fcfbaa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.685291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c353b9b-0ec2-4534-b42b-61a744fcfbaa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.865388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9c353b9b-0ec2-4534-b42b-61a744fcfbaa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:50.875449 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9c353b9b-0ec2-4534-b42b-61a744fcfbaa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.218559 Oct 29 03:06:50.876658 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2440/4938] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:50 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:50.908126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a34258ee-81d7-4d51-b88a-da6c3ab389c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:50.908768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a34258ee-81d7-4d51-b88a-da6c3ab389c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:50.922300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34258ee-81d7-4d51-b88a-da6c3ab389c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.924364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34258ee-81d7-4d51-b88a-da6c3ab389c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.924965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34258ee-81d7-4d51-b88a-da6c3ab389c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.927173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34258ee-81d7-4d51-b88a-da6c3ab389c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:50.927790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34258ee-81d7-4d51-b88a-da6c3ab389c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:50.931937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a34258ee-81d7-4d51-b88a-da6c3ab389c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.052667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-19291022-ab0e-43a3-b10b-0e92eaff5720 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:51.061551 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-19291022-ab0e-43a3-b10b-0e92eaff5720 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1543 microversion: 2.1 time: 0.422438 Oct 29 03:06:51.062520 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2499/4939] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:50 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1543 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:51.077663 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a34258ee-81d7-4d51-b88a-da6c3ab389c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.173545 Oct 29 03:06:51.081353 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2441/4940] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:50 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:06:51.085904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:51.086744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:51.096015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.096895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.097639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.098761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.099592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.100185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.107927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:51.114044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] [instance: e2e4f42b-3d11-4cf6-9e75-6723897725ac] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:51.123817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.124305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.124742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.125453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.135807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.136563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.156428 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] HTTP exception thrown: Instance e2e4f42b-3d11-4cf6-9e75-6723897725ac could not be found. Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Request method failure captured: Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac HTTP/1.1 Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJisALdKWJbrLAJo1CCzom4wfFAzVoV33VNYDMGJZiq3_68Goz91MdhfU-a72y9Aee_LlSoIzYlcXGTdCpSlKQjLmVXRJMTDGK2afN8CGj-ofNIAz3y8YV87FzfFL8W4LcEVZsRMoRDsIkOiE61aseGe-0MB3zAS3BPERXxaR_Mnbzk Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 515e073461f640f698fb302b4b9b0779 Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerPasswordTestJSON-1392206545 Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/515e073461f640f698fb302b4b9b0779"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/515e073461f640f698fb302b4b9b0779"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_515e073461f640f698fb302b4b9b0779", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/515e073461f640f698fb302b4b9b0779"}]}] Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerPasswordTestJSON-1392206545 Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 515e073461f640f698fb302b4b9b0779 Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1392206545 Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerPasswordTestJSON-1392206545-project Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cda37fbe7dd9480592f14e99d24296e6 Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerPasswordTestJSON-1392206545-project Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance e2e4f42b-3d11-4cf6-9e75-6723897725ac could not be found. Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'e2e4f42b-3d11-4cf6-9e75-6723897725ac'} Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e4f42b-3d11-4cf6-9e75-6723897725ac could not be found. Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e4f42b-3d11-4cf6-9e75-6723897725ac could not be found. Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:51.158256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:51.163502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:51.163502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:51.163502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:51.163502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:06:51.163502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:06:51.163502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e4f42b-3d11-4cf6-9e75-6723897725ac could not be found. Oct 29 03:06:51.163502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:06:51.163502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] Returning 404 to user: Instance e2e4f42b-3d11-4cf6-9e75-6723897725ac could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:51.163502 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-08b5f8bf-24d3-4a2b-933a-cef43cd5a55b tempest-ServerPasswordTestJSON-1392206545 tempest-ServerPasswordTestJSON-1392206545-project] 10.222.0.16 "GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac" status: 404 len: 111 microversion: 2.1 time: 0.079692 Oct 29 03:06:51.164185 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2442/4941] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:51 2022] GET /compute/v2.1/servers/e2e4f42b-3d11-4cf6-9e75-6723897725ac => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:06:51.169434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d97a0c7e-41d9-4ca0-ab9b-63a271dc62af tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:51.170002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d97a0c7e-41d9-4ca0-ab9b-63a271dc62af tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:51.177086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d97a0c7e-41d9-4ca0-ab9b-63a271dc62af tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.177586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d97a0c7e-41d9-4ca0-ab9b-63a271dc62af tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.178733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d97a0c7e-41d9-4ca0-ab9b-63a271dc62af tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.179743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d97a0c7e-41d9-4ca0-ab9b-63a271dc62af tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.180207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d97a0c7e-41d9-4ca0-ab9b-63a271dc62af tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.180640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d97a0c7e-41d9-4ca0-ab9b-63a271dc62af tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.436017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d97a0c7e-41d9-4ca0-ab9b-63a271dc62af tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:51.445615 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d97a0c7e-41d9-4ca0-ab9b-63a271dc62af tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1675 microversion: 2.1 time: 0.280468 Oct 29 03:06:51.446252 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2443/4942] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:51 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1675 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:51.451307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f38f7a67-33cd-4d68-b15a-8231b6aa9638 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:51.451925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f38f7a67-33cd-4d68-b15a-8231b6aa9638 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:51.458112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:51.459666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f38f7a67-33cd-4d68-b15a-8231b6aa9638 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.460305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f38f7a67-33cd-4d68-b15a-8231b6aa9638 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.460807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f38f7a67-33cd-4d68-b15a-8231b6aa9638 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.461555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f38f7a67-33cd-4d68-b15a-8231b6aa9638 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.462054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f38f7a67-33cd-4d68-b15a-8231b6aa9638 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.462768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f38f7a67-33cd-4d68-b15a-8231b6aa9638 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.499643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:51.513444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:51.515940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:51.518851 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-87af778d-98bf-40ec-9525-09d0d3360c77 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2868 microversion: 2.42 time: 0.454638 Oct 29 03:06:51.522052 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2500/4943] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:51 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2868 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:51.527884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3fc313c9-f120-4b37-8303-df7ab8b26912 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:51.528734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3fc313c9-f120-4b37-8303-df7ab8b26912 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:51.535792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc313c9-f120-4b37-8303-df7ab8b26912 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.536469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc313c9-f120-4b37-8303-df7ab8b26912 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.537037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc313c9-f120-4b37-8303-df7ab8b26912 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.538036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc313c9-f120-4b37-8303-df7ab8b26912 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.538630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc313c9-f120-4b37-8303-df7ab8b26912 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.539222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fc313c9-f120-4b37-8303-df7ab8b26912 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.654846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3fc313c9-f120-4b37-8303-df7ab8b26912 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:51.665846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f38f7a67-33cd-4d68-b15a-8231b6aa9638 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:51.666168 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3fc313c9-f120-4b37-8303-df7ab8b26912 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1267 microversion: 2.1 time: 0.142380 Oct 29 03:06:51.667266 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2501/4944] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:51 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:51.678905 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f38f7a67-33cd-4d68-b15a-8231b6aa9638 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.231563 Oct 29 03:06:51.714376 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2444/4945] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:51 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:52.085513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2cdc2480-17f7-4c04-a5a1-b1e53433a64e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:52.087365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2cdc2480-17f7-4c04-a5a1-b1e53433a64e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:52.098376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2cdc2480-17f7-4c04-a5a1-b1e53433a64e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:52.103687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2cdc2480-17f7-4c04-a5a1-b1e53433a64e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:52.104334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2cdc2480-17f7-4c04-a5a1-b1e53433a64e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:52.105498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2cdc2480-17f7-4c04-a5a1-b1e53433a64e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:52.106371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2cdc2480-17f7-4c04-a5a1-b1e53433a64e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:52.106994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2cdc2480-17f7-4c04-a5a1-b1e53433a64e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:52.351471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2cdc2480-17f7-4c04-a5a1-b1e53433a64e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:52.359710 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2cdc2480-17f7-4c04-a5a1-b1e53433a64e tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1543 microversion: 2.1 time: 0.279037 Oct 29 03:06:52.360539 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2502/4946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:52 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1543 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:52.469510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-36996ffa-7092-49c5-bf32-2b1c6d187771 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:52.470389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-36996ffa-7092-49c5-bf32-2b1c6d187771 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:52.477653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36996ffa-7092-49c5-bf32-2b1c6d187771 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:52.478178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36996ffa-7092-49c5-bf32-2b1c6d187771 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:52.478628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36996ffa-7092-49c5-bf32-2b1c6d187771 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:52.479340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36996ffa-7092-49c5-bf32-2b1c6d187771 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:52.479797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36996ffa-7092-49c5-bf32-2b1c6d187771 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:52.480253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-36996ffa-7092-49c5-bf32-2b1c6d187771 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:52.556234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:52.557095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:52.567852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:52.575207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:52.576023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:52.576863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:52.577323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:52.578025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:52.833184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-36996ffa-7092-49c5-bf32-2b1c6d187771 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:52.844912 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-36996ffa-7092-49c5-bf32-2b1c6d187771 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1655 microversion: 2.1 time: 0.379473 Oct 29 03:06:52.848605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2445/4947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:52 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1655 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:52.862220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d058f9df-4f68-423b-b17c-d0187eb73a1a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:52.863847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d058f9df-4f68-423b-b17c-d0187eb73a1a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:52.882857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d058f9df-4f68-423b-b17c-d0187eb73a1a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:52.883280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d058f9df-4f68-423b-b17c-d0187eb73a1a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:52.883729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d058f9df-4f68-423b-b17c-d0187eb73a1a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:52.884448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d058f9df-4f68-423b-b17c-d0187eb73a1a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:52.884899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d058f9df-4f68-423b-b17c-d0187eb73a1a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:52.885320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d058f9df-4f68-423b-b17c-d0187eb73a1a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:53.039543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d058f9df-4f68-423b-b17c-d0187eb73a1a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:53.056111 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d058f9df-4f68-423b-b17c-d0187eb73a1a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1267 microversion: 2.1 time: 0.205979 Oct 29 03:06:53.065838 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2446/4948] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:52 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:53.065838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7daaa2db-feb8-4e17-bd6e-807b0d3de461 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:53.065838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7daaa2db-feb8-4e17-bd6e-807b0d3de461 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:53.073597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7daaa2db-feb8-4e17-bd6e-807b0d3de461 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:53.073597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7daaa2db-feb8-4e17-bd6e-807b0d3de461 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:53.073597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7daaa2db-feb8-4e17-bd6e-807b0d3de461 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:53.073597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7daaa2db-feb8-4e17-bd6e-807b0d3de461 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:53.073597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7daaa2db-feb8-4e17-bd6e-807b0d3de461 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:53.073597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7daaa2db-feb8-4e17-bd6e-807b0d3de461 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:53.205642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:53.217049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:53.218520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:53.219934 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-651d32f2-36b7-4728-a8e4-00541b53387d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2868 microversion: 2.42 time: 0.667759 Oct 29 03:06:53.226230 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2503/4949] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:52 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2868 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:53.237048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b144d96e-766f-4390-a112-b35af8a29589 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:53.242384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b144d96e-766f-4390-a112-b35af8a29589 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:53.252648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b144d96e-766f-4390-a112-b35af8a29589 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:53.254153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b144d96e-766f-4390-a112-b35af8a29589 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:53.254780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b144d96e-766f-4390-a112-b35af8a29589 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:53.263075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b144d96e-766f-4390-a112-b35af8a29589 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:53.263857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b144d96e-766f-4390-a112-b35af8a29589 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:53.264519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b144d96e-766f-4390-a112-b35af8a29589 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:53.433687 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b144d96e-766f-4390-a112-b35af8a29589 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.203670 Oct 29 03:06:53.438683 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2504/4950] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:53 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:06:53.447252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-19adb921-0d98-438c-818e-ec674b237af8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:53.447970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-19adb921-0d98-438c-818e-ec674b237af8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:53.458138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19adb921-0d98-438c-818e-ec674b237af8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:53.458639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19adb921-0d98-438c-818e-ec674b237af8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:53.459067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19adb921-0d98-438c-818e-ec674b237af8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:53.459774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19adb921-0d98-438c-818e-ec674b237af8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:53.460222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19adb921-0d98-438c-818e-ec674b237af8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:53.460641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19adb921-0d98-438c-818e-ec674b237af8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:53.742839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:53.770760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:53.839987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-19adb921-0d98-438c-818e-ec674b237af8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:53.857877 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-19adb921-0d98-438c-818e-ec674b237af8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1543 microversion: 2.1 time: 0.417249 Oct 29 03:06:53.858505 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2505/4951] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:53 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1543 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:53.882519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-81ce6fcb-55fe-4fca-b1df-7131056694b5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:53.883129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-81ce6fcb-55fe-4fca-b1df-7131056694b5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:53.903025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81ce6fcb-55fe-4fca-b1df-7131056694b5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:53.903696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81ce6fcb-55fe-4fca-b1df-7131056694b5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:53.904133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81ce6fcb-55fe-4fca-b1df-7131056694b5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:53.904840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81ce6fcb-55fe-4fca-b1df-7131056694b5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:53.905286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81ce6fcb-55fe-4fca-b1df-7131056694b5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:53.905701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81ce6fcb-55fe-4fca-b1df-7131056694b5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:54.155921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7daaa2db-feb8-4e17-bd6e-807b0d3de461 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:54.177611 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7daaa2db-feb8-4e17-bd6e-807b0d3de461 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 1.119188 Oct 29 03:06:54.178800 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2447/4952] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:53 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:54.199383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e835a32d-e0a7-4b1f-a598-23b2a44e027e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:54.200724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e835a32d-e0a7-4b1f-a598-23b2a44e027e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:54.229066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e835a32d-e0a7-4b1f-a598-23b2a44e027e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:54.232142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e835a32d-e0a7-4b1f-a598-23b2a44e027e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:54.232970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e835a32d-e0a7-4b1f-a598-23b2a44e027e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:54.235702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e835a32d-e0a7-4b1f-a598-23b2a44e027e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:54.238939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e835a32d-e0a7-4b1f-a598-23b2a44e027e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:54.239691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e835a32d-e0a7-4b1f-a598-23b2a44e027e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:54.637209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e835a32d-e0a7-4b1f-a598-23b2a44e027e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:54.641116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:54.649117 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e835a32d-e0a7-4b1f-a598-23b2a44e027e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1267 microversion: 2.1 time: 0.466034 Oct 29 03:06:54.665355 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2448/4953] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:54 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1267 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:54.665355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:54.665355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:54.679138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:54.679647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:54.680085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:54.683168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:54.684986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:54.685437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.002481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-81ce6fcb-55fe-4fca-b1df-7131056694b5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:55.015865 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-81ce6fcb-55fe-4fca-b1df-7131056694b5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 1.136824 Oct 29 03:06:55.016733 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2506/4954] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:53 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:55.034157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6040ed24-f490-46f3-bcb0-5ad69fbb2f80 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:55.036628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6040ed24-f490-46f3-bcb0-5ad69fbb2f80 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:55.057109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6040ed24-f490-46f3-bcb0-5ad69fbb2f80 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.058123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6040ed24-f490-46f3-bcb0-5ad69fbb2f80 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.064181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6040ed24-f490-46f3-bcb0-5ad69fbb2f80 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.065204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6040ed24-f490-46f3-bcb0-5ad69fbb2f80 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.065855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6040ed24-f490-46f3-bcb0-5ad69fbb2f80 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.066458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6040ed24-f490-46f3-bcb0-5ad69fbb2f80 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.160396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:55.183878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:55.185347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:55.186667 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-98323168-47e6-4299-8019-63f735ac4ed9 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2868 microversion: 2.42 time: 0.533393 Oct 29 03:06:55.214213 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2449/4955] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:54 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2868 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:55.219535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5f640256-8e87-4f90-9b95-9fb88295652f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:55.226901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5f640256-8e87-4f90-9b95-9fb88295652f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:55.243937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f640256-8e87-4f90-9b95-9fb88295652f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.244728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f640256-8e87-4f90-9b95-9fb88295652f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.250643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f640256-8e87-4f90-9b95-9fb88295652f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.251676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f640256-8e87-4f90-9b95-9fb88295652f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.252305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f640256-8e87-4f90-9b95-9fb88295652f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.252887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f640256-8e87-4f90-9b95-9fb88295652f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.537056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6040ed24-f490-46f3-bcb0-5ad69fbb2f80 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:55.560424 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6040ed24-f490-46f3-bcb0-5ad69fbb2f80 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1543 microversion: 2.1 time: 0.536039 Oct 29 03:06:55.569027 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2507/4956] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:55 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1543 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:55.580184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7c06b29-1ff9-451f-85ef-a36849a07e13 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:55.581136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7c06b29-1ff9-451f-85ef-a36849a07e13 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:55.592919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c06b29-1ff9-451f-85ef-a36849a07e13 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.594176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c06b29-1ff9-451f-85ef-a36849a07e13 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.594680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c06b29-1ff9-451f-85ef-a36849a07e13 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.595457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c06b29-1ff9-451f-85ef-a36849a07e13 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.595978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c06b29-1ff9-451f-85ef-a36849a07e13 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.596458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c06b29-1ff9-451f-85ef-a36849a07e13 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.644944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5f640256-8e87-4f90-9b95-9fb88295652f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:55.667035 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5f640256-8e87-4f90-9b95-9fb88295652f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.451371 Oct 29 03:06:55.669997 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2450/4957] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:55 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:55.689892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-7be899c2-65f5-4353-b575-fe57f91b5e27 req-be7a11b7-a675-4131-8d3e-a98178164d74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfab3b11-01ce-4757-ba50-5d65796f9788", "tag": "224c0a5a-9063-4270-96f9-12450fb578dc"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:55.701187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7be899c2-65f5-4353-b575-fe57f91b5e27 req-be7a11b7-a675-4131-8d3e-a98178164d74 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.701675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7be899c2-65f5-4353-b575-fe57f91b5e27 req-be7a11b7-a675-4131-8d3e-a98178164d74 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.702141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7be899c2-65f5-4353-b575-fe57f91b5e27 req-be7a11b7-a675-4131-8d3e-a98178164d74 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.715527 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-7be899c2-65f5-4353-b575-fe57f91b5e27 req-be7a11b7-a675-4131-8d3e-a98178164d74 service nova] Creating event network-changed:224c0a5a-9063-4270-96f9-12450fb578dc for instance cfab3b11-01ce-4757-ba50-5d65796f9788 on n-h1-862964-4 Oct 29 03:06:55.721207 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-7be899c2-65f5-4353-b575-fe57f91b5e27 req-be7a11b7-a675-4131-8d3e-a98178164d74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044855 Oct 29 03:06:55.722220 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2451/4958] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:55.728552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a28468f3-cd82-437d-a42b-805dd91fa55e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:55.729519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a28468f3-cd82-437d-a42b-805dd91fa55e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:55.737563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a28468f3-cd82-437d-a42b-805dd91fa55e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.738109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a28468f3-cd82-437d-a42b-805dd91fa55e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.738546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a28468f3-cd82-437d-a42b-805dd91fa55e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.739261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a28468f3-cd82-437d-a42b-805dd91fa55e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.739714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a28468f3-cd82-437d-a42b-805dd91fa55e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.740137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a28468f3-cd82-437d-a42b-805dd91fa55e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.837126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a28468f3-cd82-437d-a42b-805dd91fa55e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:55.845742 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a28468f3-cd82-437d-a42b-805dd91fa55e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1267 microversion: 2.1 time: 0.122059 Oct 29 03:06:55.858517 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2452/4959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:55 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1267 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:55.871410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-22a78925-8b81-4563-8338-1ef4b1c42b8d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:55.872154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-22a78925-8b81-4563-8338-1ef4b1c42b8d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:55.884333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22a78925-8b81-4563-8338-1ef4b1c42b8d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.885184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22a78925-8b81-4563-8338-1ef4b1c42b8d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.885738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22a78925-8b81-4563-8338-1ef4b1c42b8d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.887735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22a78925-8b81-4563-8338-1ef4b1c42b8d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.888261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22a78925-8b81-4563-8338-1ef4b1c42b8d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.888798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22a78925-8b81-4563-8338-1ef4b1c42b8d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.095567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-22a78925-8b81-4563-8338-1ef4b1c42b8d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:56.111798 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-22a78925-8b81-4563-8338-1ef4b1c42b8d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.251729 Oct 29 03:06:56.113018 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2453/4960] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:55 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:56.139509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7cd8d0a6-8649-42d0-8897-c42054ea2ad7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:56.148758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7cd8d0a6-8649-42d0-8897-c42054ea2ad7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:56.157548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cd8d0a6-8649-42d0-8897-c42054ea2ad7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.159410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cd8d0a6-8649-42d0-8897-c42054ea2ad7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.160175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cd8d0a6-8649-42d0-8897-c42054ea2ad7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.161069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cd8d0a6-8649-42d0-8897-c42054ea2ad7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.162142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cd8d0a6-8649-42d0-8897-c42054ea2ad7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.162764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cd8d0a6-8649-42d0-8897-c42054ea2ad7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.209607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a7c06b29-1ff9-451f-85ef-a36849a07e13 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:56.220354 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7c06b29-1ff9-451f-85ef-a36849a07e13 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.649906 Oct 29 03:06:56.233900 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2508/4961] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:55 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:56.240307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:56.241053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:56.260111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.260907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.261570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.263451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.264086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.264660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.370014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7cd8d0a6-8649-42d0-8897-c42054ea2ad7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:56.380145 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7cd8d0a6-8649-42d0-8897-c42054ea2ad7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.247526 Oct 29 03:06:56.381415 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2454/4962] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:56 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:56.403940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eaea31d8-d62c-4e93-8597-0a53ca380adb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:56.404472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eaea31d8-d62c-4e93-8597-0a53ca380adb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:56.412250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaea31d8-d62c-4e93-8597-0a53ca380adb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.413061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaea31d8-d62c-4e93-8597-0a53ca380adb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.413694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaea31d8-d62c-4e93-8597-0a53ca380adb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.414617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaea31d8-d62c-4e93-8597-0a53ca380adb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.415225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaea31d8-d62c-4e93-8597-0a53ca380adb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.415800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaea31d8-d62c-4e93-8597-0a53ca380adb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.591315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eaea31d8-d62c-4e93-8597-0a53ca380adb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:56.600591 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eaea31d8-d62c-4e93-8597-0a53ca380adb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.200740 Oct 29 03:06:56.601173 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2455/4963] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:56 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:56.617710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fb4f78ca-cd3a-49c5-85b5-e056e6bb014f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:56.618384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fb4f78ca-cd3a-49c5-85b5-e056e6bb014f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:56.626166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb4f78ca-cd3a-49c5-85b5-e056e6bb014f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.626655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb4f78ca-cd3a-49c5-85b5-e056e6bb014f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.627081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb4f78ca-cd3a-49c5-85b5-e056e6bb014f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.627988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb4f78ca-cd3a-49c5-85b5-e056e6bb014f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.628442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb4f78ca-cd3a-49c5-85b5-e056e6bb014f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.629039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb4f78ca-cd3a-49c5-85b5-e056e6bb014f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.774312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fb4f78ca-cd3a-49c5-85b5-e056e6bb014f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:56.786947 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fb4f78ca-cd3a-49c5-85b5-e056e6bb014f tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1543 microversion: 2.1 time: 0.174239 Oct 29 03:06:56.788137 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2456/4964] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:56 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1543 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:56.794133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cc1ac9a5-5ef6-4da9-a11d-662087983f55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:56.794919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cc1ac9a5-5ef6-4da9-a11d-662087983f55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:56.802478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc1ac9a5-5ef6-4da9-a11d-662087983f55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.803147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc1ac9a5-5ef6-4da9-a11d-662087983f55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.803883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc1ac9a5-5ef6-4da9-a11d-662087983f55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.804951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc1ac9a5-5ef6-4da9-a11d-662087983f55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.805555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc1ac9a5-5ef6-4da9-a11d-662087983f55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.806295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc1ac9a5-5ef6-4da9-a11d-662087983f55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.827943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:56.848986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:56.852970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:56.854739 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e043ba9b-0a33-43b9-ba14-a5df23982f67 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2868 microversion: 2.42 time: 0.620697 Oct 29 03:06:56.859197 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2509/4965] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:56 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2868 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:56.874740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6f12350f-ef09-4b1c-a5c8-4b7238cd1bc1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:56.875750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6f12350f-ef09-4b1c-a5c8-4b7238cd1bc1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:56.902992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f12350f-ef09-4b1c-a5c8-4b7238cd1bc1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.903737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f12350f-ef09-4b1c-a5c8-4b7238cd1bc1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.904994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f12350f-ef09-4b1c-a5c8-4b7238cd1bc1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.911036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f12350f-ef09-4b1c-a5c8-4b7238cd1bc1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.911844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f12350f-ef09-4b1c-a5c8-4b7238cd1bc1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.913081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6f12350f-ef09-4b1c-a5c8-4b7238cd1bc1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.970349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:57.133250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f12350f-ef09-4b1c-a5c8-4b7238cd1bc1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:57.146277 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6f12350f-ef09-4b1c-a5c8-4b7238cd1bc1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1267 microversion: 2.1 time: 0.276618 Oct 29 03:06:57.147036 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2510/4966] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:56 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:57.174338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc1ac9a5-5ef6-4da9-a11d-662087983f55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:57.182679 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cc1ac9a5-5ef6-4da9-a11d-662087983f55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.393268 Oct 29 03:06:57.183869 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2457/4967] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:56 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:57.247140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8923e760-8520-443c-9871-88522364012f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:57.247674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8923e760-8520-443c-9871-88522364012f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:57.254392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8923e760-8520-443c-9871-88522364012f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:57.254874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8923e760-8520-443c-9871-88522364012f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:57.255299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8923e760-8520-443c-9871-88522364012f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:57.256000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8923e760-8520-443c-9871-88522364012f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:57.256441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8923e760-8520-443c-9871-88522364012f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:57.257064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8923e760-8520-443c-9871-88522364012f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:57.605086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8923e760-8520-443c-9871-88522364012f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:57.619401 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8923e760-8520-443c-9871-88522364012f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.376503 Oct 29 03:06:57.620368 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2511/4968] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:57 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:57.822123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-529b09bf-3649-4155-a66b-d8d17ae2363b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:57.824903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-529b09bf-3649-4155-a66b-d8d17ae2363b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:57.835148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529b09bf-3649-4155-a66b-d8d17ae2363b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:57.836344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529b09bf-3649-4155-a66b-d8d17ae2363b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:57.837019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529b09bf-3649-4155-a66b-d8d17ae2363b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:57.837998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529b09bf-3649-4155-a66b-d8d17ae2363b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:57.838702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529b09bf-3649-4155-a66b-d8d17ae2363b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:57.839451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529b09bf-3649-4155-a66b-d8d17ae2363b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:57.892831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:57.893840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:57.905004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:57.905874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:57.906520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:57.907699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:57.911035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:57.911716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:58.059759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-529b09bf-3649-4155-a66b-d8d17ae2363b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:58.069902 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-529b09bf-3649-4155-a66b-d8d17ae2363b tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1543 microversion: 2.1 time: 0.260935 Oct 29 03:06:58.070590 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2458/4969] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:57 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1543 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:58.172130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-84edda70-2763-4129-b9a7-28e657224828 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:58.173044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-84edda70-2763-4129-b9a7-28e657224828 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:58.179483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84edda70-2763-4129-b9a7-28e657224828 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:58.180088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84edda70-2763-4129-b9a7-28e657224828 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:58.180441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84edda70-2763-4129-b9a7-28e657224828 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:58.181141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84edda70-2763-4129-b9a7-28e657224828 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:58.181586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84edda70-2763-4129-b9a7-28e657224828 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:58.182063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84edda70-2763-4129-b9a7-28e657224828 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:58.208623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:58.219959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:58.221379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:58.223285 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9e14d5b1-1cb6-425d-b8b6-53ae4969a840 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2868 microversion: 2.42 time: 0.334559 Oct 29 03:06:58.223862 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2512/4970] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:57 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2868 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:06:58.268520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-84edda70-2763-4129-b9a7-28e657224828 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:58.279268 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-84edda70-2763-4129-b9a7-28e657224828 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1267 microversion: 2.1 time: 0.111685 Oct 29 03:06:58.285847 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2459/4971] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:58 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:58.307836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-c27a9ffd-aab2-4f97-86dd-45ffb1d9eaae req-936f6afc-3e4b-4619-bc03-fe5eebe3f67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfab3b11-01ce-4757-ba50-5d65796f9788", "tag": "224c0a5a-9063-4270-96f9-12450fb578dc"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:58.319310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c27a9ffd-aab2-4f97-86dd-45ffb1d9eaae req-936f6afc-3e4b-4619-bc03-fe5eebe3f67f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:58.320031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c27a9ffd-aab2-4f97-86dd-45ffb1d9eaae req-936f6afc-3e4b-4619-bc03-fe5eebe3f67f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:58.320757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c27a9ffd-aab2-4f97-86dd-45ffb1d9eaae req-936f6afc-3e4b-4619-bc03-fe5eebe3f67f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:58.334560 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c27a9ffd-aab2-4f97-86dd-45ffb1d9eaae req-936f6afc-3e4b-4619-bc03-fe5eebe3f67f service nova] Creating event network-changed:224c0a5a-9063-4270-96f9-12450fb578dc for instance cfab3b11-01ce-4757-ba50-5d65796f9788 on n-h1-862964-4 Oct 29 03:06:58.342107 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-c27a9ffd-aab2-4f97-86dd-45ffb1d9eaae req-936f6afc-3e4b-4619-bc03-fe5eebe3f67f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038514 Oct 29 03:06:58.342776 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2513/4972] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:58.644669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a7e625c-e040-4b26-b37d-7e0c87443656 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:58.645149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5a7e625c-e040-4b26-b37d-7e0c87443656 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:58.652653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a7e625c-e040-4b26-b37d-7e0c87443656 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:58.653144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a7e625c-e040-4b26-b37d-7e0c87443656 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:58.653578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a7e625c-e040-4b26-b37d-7e0c87443656 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:58.654312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a7e625c-e040-4b26-b37d-7e0c87443656 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:58.654764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a7e625c-e040-4b26-b37d-7e0c87443656 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:58.655182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a7e625c-e040-4b26-b37d-7e0c87443656 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:58.865782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5a7e625c-e040-4b26-b37d-7e0c87443656 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:58.880073 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5a7e625c-e040-4b26-b37d-7e0c87443656 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.239286 Oct 29 03:06:58.881229 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2460/4973] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:58 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:59.104122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87576e33-04a7-4bac-aabe-f620ccd0b754 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:59.105172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-87576e33-04a7-4bac-aabe-f620ccd0b754 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:59.114247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87576e33-04a7-4bac-aabe-f620ccd0b754 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:59.115737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87576e33-04a7-4bac-aabe-f620ccd0b754 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:59.116328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87576e33-04a7-4bac-aabe-f620ccd0b754 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:59.118201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87576e33-04a7-4bac-aabe-f620ccd0b754 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:59.118811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87576e33-04a7-4bac-aabe-f620ccd0b754 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:59.119821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87576e33-04a7-4bac-aabe-f620ccd0b754 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:59.257690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:59.259043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:59.267594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:59.268482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:59.270814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:59.272386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:59.273120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:59.273855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:59.471664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:59.483036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:59.484480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:59.485792 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f787734e-ab8b-49b1-a599-ea6a422ef899 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2754 microversion: 2.42 time: 0.238230 Oct 29 03:06:59.486392 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2461/4974] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:59 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2754 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:06:59.503903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-99201ad2-397c-4f42-968c-d0077d2c06db tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:59.504845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-99201ad2-397c-4f42-968c-d0077d2c06db tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:59.513219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99201ad2-397c-4f42-968c-d0077d2c06db tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:59.514653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99201ad2-397c-4f42-968c-d0077d2c06db tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:59.515333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99201ad2-397c-4f42-968c-d0077d2c06db tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:59.517281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99201ad2-397c-4f42-968c-d0077d2c06db tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:59.518018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99201ad2-397c-4f42-968c-d0077d2c06db tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:59.519090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99201ad2-397c-4f42-968c-d0077d2c06db tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:59.603115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-87576e33-04a7-4bac-aabe-f620ccd0b754 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:59.605625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-99201ad2-397c-4f42-968c-d0077d2c06db tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:59.611644 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-87576e33-04a7-4bac-aabe-f620ccd0b754 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1543 microversion: 2.1 time: 0.517119 Oct 29 03:06:59.612509 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2514/4975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:59 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1543 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:59.613084 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-99201ad2-397c-4f42-968c-d0077d2c06db tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1267 microversion: 2.1 time: 0.113366 Oct 29 03:06:59.617876 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2462/4976] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:59 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1267 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:59.909075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bba68179-2081-4b12-a290-6dc5c1f6f123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:59.909598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bba68179-2081-4b12-a290-6dc5c1f6f123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:59.916062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bba68179-2081-4b12-a290-6dc5c1f6f123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:59.916555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bba68179-2081-4b12-a290-6dc5c1f6f123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:59.916983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bba68179-2081-4b12-a290-6dc5c1f6f123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:59.917756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bba68179-2081-4b12-a290-6dc5c1f6f123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:59.918224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bba68179-2081-4b12-a290-6dc5c1f6f123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:59.918646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bba68179-2081-4b12-a290-6dc5c1f6f123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:00.408154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-51ecbc20-fa41-43f1-9a4b-edc0ae2b0db8 req-53149a4f-786f-4f6b-b8d1-a44f7d05f590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfab3b11-01ce-4757-ba50-5d65796f9788", "tag": "224c0a5a-9063-4270-96f9-12450fb578dc"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:00.430976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-51ecbc20-fa41-43f1-9a4b-edc0ae2b0db8 req-53149a4f-786f-4f6b-b8d1-a44f7d05f590 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:00.431821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-51ecbc20-fa41-43f1-9a4b-edc0ae2b0db8 req-53149a4f-786f-4f6b-b8d1-a44f7d05f590 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:00.432518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-51ecbc20-fa41-43f1-9a4b-edc0ae2b0db8 req-53149a4f-786f-4f6b-b8d1-a44f7d05f590 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:00.447100 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-51ecbc20-fa41-43f1-9a4b-edc0ae2b0db8 req-53149a4f-786f-4f6b-b8d1-a44f7d05f590 service nova] Creating event network-changed:224c0a5a-9063-4270-96f9-12450fb578dc for instance cfab3b11-01ce-4757-ba50-5d65796f9788 on n-h1-862964-4 Oct 29 03:07:00.455223 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-51ecbc20-fa41-43f1-9a4b-edc0ae2b0db8 req-53149a4f-786f-4f6b-b8d1-a44f7d05f590 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049223 Oct 29 03:07:00.456660 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2463/4977] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:07:00.478058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bba68179-2081-4b12-a290-6dc5c1f6f123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:00.486420 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bba68179-2081-4b12-a290-6dc5c1f6f123 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.581316 Oct 29 03:07:00.487031 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2515/4978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:59 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:00.518302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:00.519490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:00.528650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:00.529594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:00.530183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:00.531300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:00.531969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:00.532465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:00.639835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2ea257e-bbd5-4c70-9f3e-72afea7387b9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:00.642839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2ea257e-bbd5-4c70-9f3e-72afea7387b9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:00.651865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2ea257e-bbd5-4c70-9f3e-72afea7387b9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:00.652775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2ea257e-bbd5-4c70-9f3e-72afea7387b9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:00.653516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2ea257e-bbd5-4c70-9f3e-72afea7387b9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:00.654574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2ea257e-bbd5-4c70-9f3e-72afea7387b9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:00.655408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2ea257e-bbd5-4c70-9f3e-72afea7387b9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:00.656746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2ea257e-bbd5-4c70-9f3e-72afea7387b9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:00.749592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:00.759833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:00.761951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:00.763319 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-166c6b26-4ccd-44da-b483-a436cb441018 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2708 microversion: 2.42 time: 0.251129 Oct 29 03:07:00.764289 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2464/4979] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:00 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2708 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:00.769362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-289a0033-7001-4e31-a50c-e9510fef6eb8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:00.770199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-289a0033-7001-4e31-a50c-e9510fef6eb8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:00.777122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-289a0033-7001-4e31-a50c-e9510fef6eb8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:00.777870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-289a0033-7001-4e31-a50c-e9510fef6eb8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:00.778669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-289a0033-7001-4e31-a50c-e9510fef6eb8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:00.779547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-289a0033-7001-4e31-a50c-e9510fef6eb8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:00.782238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-289a0033-7001-4e31-a50c-e9510fef6eb8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:00.783283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-289a0033-7001-4e31-a50c-e9510fef6eb8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:00.946939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-289a0033-7001-4e31-a50c-e9510fef6eb8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:00.964819 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-289a0033-7001-4e31-a50c-e9510fef6eb8 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1543 microversion: 2.1 time: 0.197643 Oct 29 03:07:00.966153 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2465/4980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:00 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1543 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:01.513126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59c0d1c7-264c-4ca6-b9ef-d2935c9f72da tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:01.515448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59c0d1c7-264c-4ca6-b9ef-d2935c9f72da tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:01.550280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c0d1c7-264c-4ca6-b9ef-d2935c9f72da tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:01.563151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c0d1c7-264c-4ca6-b9ef-d2935c9f72da tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:01.570581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c0d1c7-264c-4ca6-b9ef-d2935c9f72da tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:01.571898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c0d1c7-264c-4ca6-b9ef-d2935c9f72da tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:01.572534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c0d1c7-264c-4ca6-b9ef-d2935c9f72da tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:01.573261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c0d1c7-264c-4ca6-b9ef-d2935c9f72da tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:01.676553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2ea257e-bbd5-4c70-9f3e-72afea7387b9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:01.695943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2ea257e-bbd5-4c70-9f3e-72afea7387b9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1309 microversion: 2.1 time: 1.062775 Oct 29 03:07:01.698148 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2516/4981] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:00 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1309 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:01.792696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:01.793555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:01.803248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:01.804141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:01.804737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:01.806642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:01.808054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:01.809675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:01.846097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59c0d1c7-264c-4ca6-b9ef-d2935c9f72da tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:01.855413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:01.864865 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59c0d1c7-264c-4ca6-b9ef-d2935c9f72da tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.356063 Oct 29 03:07:01.866706 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2466/4982] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:01 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:01.993629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-67783651-cbb4-41c8-bfd5-d41e8c0116de tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:01.994516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-67783651-cbb4-41c8-bfd5-d41e8c0116de tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:02.006694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67783651-cbb4-41c8-bfd5-d41e8c0116de tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.011430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67783651-cbb4-41c8-bfd5-d41e8c0116de tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.012133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67783651-cbb4-41c8-bfd5-d41e8c0116de tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.014457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67783651-cbb4-41c8-bfd5-d41e8c0116de tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.017496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67783651-cbb4-41c8-bfd5-d41e8c0116de tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.018729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-67783651-cbb4-41c8-bfd5-d41e8c0116de tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.178494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-67783651-cbb4-41c8-bfd5-d41e8c0116de tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:02.192924 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-67783651-cbb4-41c8-bfd5-d41e8c0116de tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1501 microversion: 2.1 time: 0.206973 Oct 29 03:07:02.194118 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2467/4983] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:01 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1501 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:02.483646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:02.494109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:02.501896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:02.508249 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ec1b1a03-cdec-4bff-9a20-4bcdd66b5b04 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2708 microversion: 2.42 time: 0.720469 Oct 29 03:07:02.519907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-427f0446-ac3e-4b87-94a5-c1322aeb4cf2 req-c77b918a-f4f1-4957-a5ab-37bfe247dddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-deleted", "tag": "ad65712e-7434-443f-9bb6-d42e2e4152d0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:02.526540 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2517/4984] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:01 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2708 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:07:02.537120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-427f0446-ac3e-4b87-94a5-c1322aeb4cf2 req-c77b918a-f4f1-4957-a5ab-37bfe247dddb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.537760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-427f0446-ac3e-4b87-94a5-c1322aeb4cf2 req-c77b918a-f4f1-4957-a5ab-37bfe247dddb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.569680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-427f0446-ac3e-4b87-94a5-c1322aeb4cf2 req-c77b918a-f4f1-4957-a5ab-37bfe247dddb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.585095 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-427f0446-ac3e-4b87-94a5-c1322aeb4cf2 req-c77b918a-f4f1-4957-a5ab-37bfe247dddb service nova] Creating event network-vif-deleted:ad65712e-7434-443f-9bb6-d42e2e4152d0 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:07:02.591112 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-427f0446-ac3e-4b87-94a5-c1322aeb4cf2 req-c77b918a-f4f1-4957-a5ab-37bfe247dddb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074781 Oct 29 03:07:02.591839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2468/4985] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:07:02.721891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1b395ef3-2f50-462f-a982-a5b08f8d200e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:02.722657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b395ef3-2f50-462f-a982-a5b08f8d200e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:02.734078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b395ef3-2f50-462f-a982-a5b08f8d200e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.734558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b395ef3-2f50-462f-a982-a5b08f8d200e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.734976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b395ef3-2f50-462f-a982-a5b08f8d200e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.735669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b395ef3-2f50-462f-a982-a5b08f8d200e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.736108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b395ef3-2f50-462f-a982-a5b08f8d200e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.736516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b395ef3-2f50-462f-a982-a5b08f8d200e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.812928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8f54c616-33b0-43c4-b32b-4822b95fe08d req-bed6ca08-a57c-4394-ac11-92a501282c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbab455-c481-40ea-a59c-4ec9c15d935e", "name": "network-vif-plugged", "status": "completed", "tag": "c7aca24a-a353-4021-bdca-25ce655729ae"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:02.835973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8f54c616-33b0-43c4-b32b-4822b95fe08d req-bed6ca08-a57c-4394-ac11-92a501282c98 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.836467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8f54c616-33b0-43c4-b32b-4822b95fe08d req-bed6ca08-a57c-4394-ac11-92a501282c98 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.836904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8f54c616-33b0-43c4-b32b-4822b95fe08d req-bed6ca08-a57c-4394-ac11-92a501282c98 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.868630 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8f54c616-33b0-43c4-b32b-4822b95fe08d req-bed6ca08-a57c-4394-ac11-92a501282c98 service nova] Creating event network-vif-plugged:c7aca24a-a353-4021-bdca-25ce655729ae for instance 2bbab455-c481-40ea-a59c-4ec9c15d935e on n-h2-862964-4 Oct 29 03:07:02.877993 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8f54c616-33b0-43c4-b32b-4822b95fe08d req-bed6ca08-a57c-4394-ac11-92a501282c98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068321 Oct 29 03:07:02.881979 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2469/4986] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:02.902099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ddc1e69d-e383-4785-b6a5-64af28fd85ba tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:02.917892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ddc1e69d-e383-4785-b6a5-64af28fd85ba tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:02.937312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1e69d-e383-4785-b6a5-64af28fd85ba tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.939765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1e69d-e383-4785-b6a5-64af28fd85ba tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.941382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1e69d-e383-4785-b6a5-64af28fd85ba tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.942624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1e69d-e383-4785-b6a5-64af28fd85ba tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.943366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1e69d-e383-4785-b6a5-64af28fd85ba tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.944066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc1e69d-e383-4785-b6a5-64af28fd85ba tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:03.194355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b395ef3-2f50-462f-a982-a5b08f8d200e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:03.202821 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1b395ef3-2f50-462f-a982-a5b08f8d200e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1309 microversion: 2.1 time: 0.486732 Oct 29 03:07:03.219325 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2518/4987] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:02 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1309 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:03.225106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:03.226206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:03.232013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ddc1e69d-e383-4785-b6a5-64af28fd85ba tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:03.233180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:03.233665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:03.234129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:03.235009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:03.235604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:03.236301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:03.241920 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ddc1e69d-e383-4785-b6a5-64af28fd85ba tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.348788 Oct 29 03:07:03.243064 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2470/4988] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:02 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:03.290303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:03.291217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:03.291810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:03.292410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lazy-loading 'fault' on Instance uuid fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:07:03.394919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735d6338d29c46ee9b6065580413f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8d515c679e481b83d7001b99442d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:03.411252 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0775d6d1-6485-4826-96a2-2027b71f4f6c tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 200 len: 1322 microversion: 2.1 time: 0.189141 Oct 29 03:07:03.413358 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2519/4989] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:03 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:03.570426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:03.571625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:03.579296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:03.580021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:03.580674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:03.581573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:03.582229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:03.582831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:03.826778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:03.838389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:03.840063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:03.841755 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ddc631d4-af22-4517-ad65-0189b635be83 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2370 microversion: 2.42 time: 0.280252 Oct 29 03:07:03.842872 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2471/4990] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:03 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:04.226872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f0fa580-a226-4ccd-9abf-875dd2c0bca5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:04.228095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1f0fa580-a226-4ccd-9abf-875dd2c0bca5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:04.237767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0fa580-a226-4ccd-9abf-875dd2c0bca5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:04.239378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0fa580-a226-4ccd-9abf-875dd2c0bca5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:04.240207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0fa580-a226-4ccd-9abf-875dd2c0bca5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:04.241114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0fa580-a226-4ccd-9abf-875dd2c0bca5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:04.241564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0fa580-a226-4ccd-9abf-875dd2c0bca5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:04.242044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0fa580-a226-4ccd-9abf-875dd2c0bca5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:04.270479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7e5aa59c-d2a6-4e54-8d06-291da6e8699e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:04.271226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7e5aa59c-d2a6-4e54-8d06-291da6e8699e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:04.278020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e5aa59c-d2a6-4e54-8d06-291da6e8699e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:04.278514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e5aa59c-d2a6-4e54-8d06-291da6e8699e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:04.278949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e5aa59c-d2a6-4e54-8d06-291da6e8699e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:04.279659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e5aa59c-d2a6-4e54-8d06-291da6e8699e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:04.280110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e5aa59c-d2a6-4e54-8d06-291da6e8699e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:04.280529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e5aa59c-d2a6-4e54-8d06-291da6e8699e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:04.382531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1f0fa580-a226-4ccd-9abf-875dd2c0bca5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:04.390732 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1f0fa580-a226-4ccd-9abf-875dd2c0bca5 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1309 microversion: 2.1 time: 0.167728 Oct 29 03:07:04.391521 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2520/4991] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:04 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1309 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:04.436610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:04.437220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] [instance: fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:04.443151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:04.443635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:04.444059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:04.444749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:04.445196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:04.445692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:04.459273 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] HTTP exception thrown: Instance fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 could not be found. Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Request method failure captured: Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 HTTP/1.1 Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJiYn5SwNgRHX-3tY85od-I09wt-Q5-EMPZkNf2bzQs3_sLh5g8OMGrLTklXoP84XxdT9NdBQ2L4eRET55N22uzAg6k9_K9VqUFXvWt8RxUyCuHNcVVBWtC3QTTV3qFnzGTPElRp4nfQ3AGdqaBBba5Mpf7cVnd8RBC9e2B4g0od6-Q Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 2e8d515c679e481b83d7001b99442d35 Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e8d515c679e481b83d7001b99442d35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e8d515c679e481b83d7001b99442d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e8d515c679e481b83d7001b99442d35", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e8d515c679e481b83d7001b99442d35"}]}] Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 2e8d515c679e481b83d7001b99442d35 Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049 Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 735d6338d29c46ee9b6065580413f201 Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 could not be found. Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4'} Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 could not be found. Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 could not be found. Oct 29 03:07:04.460920 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 could not be found. Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] Returning 404 to user: Instance fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fb7d0c93-a32f-48d1-b1e3-8f6e60e39e51 tempest-FloatingIPsAssociationNegativeTestJSON-356276049 tempest-FloatingIPsAssociationNegativeTestJSON-356276049-project] 10.222.0.16 "GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4" status: 404 len: 111 microversion: 2.1 time: 0.029810 Oct 29 03:07:04.466321 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2521/4992] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:04 2022] GET /compute/v2.1/servers/fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:04.502733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7e5aa59c-d2a6-4e54-8d06-291da6e8699e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:04.514518 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7e5aa59c-d2a6-4e54-8d06-291da6e8699e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.247487 Oct 29 03:07:04.515143 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2472/4993] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:04 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:04.869198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:04.869717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:04.877703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:04.879730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:04.880370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:04.883196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:04.883886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:04.884574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:04.891586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b277867d-594a-4fe5-86ae-9cb35afbed79 req-90364538-612e-4b82-b43c-bf9640c956f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4", "name": "network-vif-deleted", "tag": "c596b5f8-cd42-45ed-b78f-8654fb1e1fbb"}, {"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-deleted", "tag": "5b15b418-d44c-4472-af06-882104b0a0b6"}, {"name": "network-changed", "server_uuid": "165e6cff-b0bf-43bc-a406-bb5b4b42d28f", "tag": "04076300-ddba-4df7-bb7e-cd90ee203828"}, {"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-deleted", "tag": "8dab038a-c463-4da0-a1b0-270182ca43e7"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:04.916629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b277867d-594a-4fe5-86ae-9cb35afbed79 req-90364538-612e-4b82-b43c-bf9640c956f6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:04.918322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b277867d-594a-4fe5-86ae-9cb35afbed79 req-90364538-612e-4b82-b43c-bf9640c956f6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:04.920155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b277867d-594a-4fe5-86ae-9cb35afbed79 req-90364538-612e-4b82-b43c-bf9640c956f6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:04.947892 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b277867d-594a-4fe5-86ae-9cb35afbed79 req-90364538-612e-4b82-b43c-bf9640c956f6 service nova] Creating event network-vif-deleted:c596b5f8-cd42-45ed-b78f-8654fb1e1fbb for instance fd8b9565-7d71-4a9d-92e7-aa5945ffa2c4 on n-h2-862964-4 Oct 29 03:07:04.962424 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b277867d-594a-4fe5-86ae-9cb35afbed79 req-90364538-612e-4b82-b43c-bf9640c956f6 service nova] Creating event network-vif-deleted:5b15b418-d44c-4472-af06-882104b0a0b6 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:07:04.963112 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b277867d-594a-4fe5-86ae-9cb35afbed79 req-90364538-612e-4b82-b43c-bf9640c956f6 service nova] Creating event network-changed:04076300-ddba-4df7-bb7e-cd90ee203828 for instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f on n-h2-862964-4 Oct 29 03:07:04.963773 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b277867d-594a-4fe5-86ae-9cb35afbed79 req-90364538-612e-4b82-b43c-bf9640c956f6 service nova] Creating event network-vif-deleted:8dab038a-c463-4da0-a1b0-270182ca43e7 for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:07:04.972897 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b277867d-594a-4fe5-86ae-9cb35afbed79 req-90364538-612e-4b82-b43c-bf9640c956f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 692 microversion: 2.1 time: 0.085298 Oct 29 03:07:04.973794 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2473/4994] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 692 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:07:05.415181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b0746c52-f799-4e87-82e5-9c28390bf925 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:05.415760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b0746c52-f799-4e87-82e5-9c28390bf925 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:05.442174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0746c52-f799-4e87-82e5-9c28390bf925 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:05.442663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0746c52-f799-4e87-82e5-9c28390bf925 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:05.443093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0746c52-f799-4e87-82e5-9c28390bf925 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:05.443804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0746c52-f799-4e87-82e5-9c28390bf925 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:05.444285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0746c52-f799-4e87-82e5-9c28390bf925 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:05.444807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0746c52-f799-4e87-82e5-9c28390bf925 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:05.737933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0746c52-f799-4e87-82e5-9c28390bf925 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:05.752230 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b0746c52-f799-4e87-82e5-9c28390bf925 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1309 microversion: 2.1 time: 0.341559 Oct 29 03:07:05.755171 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2474/4995] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:05 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1309 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:05.764593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18353924-d6ab-41ad-aa2b-0af3533a6bad tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:05.766804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18353924-d6ab-41ad-aa2b-0af3533a6bad tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:05.775974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:05.802759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:05.804768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:05.806186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18353924-d6ab-41ad-aa2b-0af3533a6bad tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:05.806843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18353924-d6ab-41ad-aa2b-0af3533a6bad tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:05.809358 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ed6de160-d745-4b71-b7a6-e1e2354620a2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2324 microversion: 2.42 time: 0.944490 Oct 29 03:07:05.809563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18353924-d6ab-41ad-aa2b-0af3533a6bad tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:05.810495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18353924-d6ab-41ad-aa2b-0af3533a6bad tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:05.827435 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2522/4996] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:04 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2324 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:05.828427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18353924-d6ab-41ad-aa2b-0af3533a6bad tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:05.829431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18353924-d6ab-41ad-aa2b-0af3533a6bad tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:06.113381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18353924-d6ab-41ad-aa2b-0af3533a6bad tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:06.128134 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18353924-d6ab-41ad-aa2b-0af3533a6bad tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1519 microversion: 2.1 time: 0.371352 Oct 29 03:07:06.140802 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2475/4997] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:05 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1519 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:06.778583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-95150379-85fe-4cdb-bebb-2fcebcca79c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:06.780613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-95150379-85fe-4cdb-bebb-2fcebcca79c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:06.790302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95150379-85fe-4cdb-bebb-2fcebcca79c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:06.791118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95150379-85fe-4cdb-bebb-2fcebcca79c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:06.791546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95150379-85fe-4cdb-bebb-2fcebcca79c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:06.792248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95150379-85fe-4cdb-bebb-2fcebcca79c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:06.793025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95150379-85fe-4cdb-bebb-2fcebcca79c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:06.793642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95150379-85fe-4cdb-bebb-2fcebcca79c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:06.839797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:06.840650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:06.851790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:06.852282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:06.852711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:06.853589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:06.854227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:06.854993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:06.964896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:06.994948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:06.996742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:07.003913 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-82d5ceca-58ad-4fe3-b196-9b3d26bd41c8 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 2143 microversion: 2.42 time: 0.162755 Oct 29 03:07:07.004967 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2476/4998] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:06 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 2143 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:07.236209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-269757062", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:07.309069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] validate_networks() for [('3406d6cf-1c47-4993-81ad-538ca7bf7fac', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:07:07.318780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-95150379-85fe-4cdb-bebb-2fcebcca79c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:07.326814 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-95150379-85fe-4cdb-bebb-2fcebcca79c2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1309 microversion: 2.1 time: 0.554412 Oct 29 03:07:07.327354 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2523/4999] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:06 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1309 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:07.343801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9c0ff4e3-1ff1-4018-88bd-c40a93946310 req-a39b034e-cb0c-4cdd-8018-4fb53f1f30c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480789f1-7931-471a-b306-64889fa76dd1", "name": "network-vif-deleted", "tag": "1a6f0f9a-363c-4cc7-bac2-3ec7fe2158ed"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:07.355084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9c0ff4e3-1ff1-4018-88bd-c40a93946310 req-a39b034e-cb0c-4cdd-8018-4fb53f1f30c8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:07.356619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9c0ff4e3-1ff1-4018-88bd-c40a93946310 req-a39b034e-cb0c-4cdd-8018-4fb53f1f30c8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:07.357408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9c0ff4e3-1ff1-4018-88bd-c40a93946310 req-a39b034e-cb0c-4cdd-8018-4fb53f1f30c8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:07.387103 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9c0ff4e3-1ff1-4018-88bd-c40a93946310 req-a39b034e-cb0c-4cdd-8018-4fb53f1f30c8 service nova] Creating event network-vif-deleted:1a6f0f9a-363c-4cc7-bac2-3ec7fe2158ed for instance 480789f1-7931-471a-b306-64889fa76dd1 on n-h2-862964-4 Oct 29 03:07:07.392744 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9c0ff4e3-1ff1-4018-88bd-c40a93946310 req-a39b034e-cb0c-4cdd-8018-4fb53f1f30c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057563 Oct 29 03:07:07.393514 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2524/5000] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:07.399585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7569b1c-5a24-45a3-a654-a0a522a4e23c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:07.400273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7569b1c-5a24-45a3-a654-a0a522a4e23c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:07.407252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7569b1c-5a24-45a3-a654-a0a522a4e23c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:07.407728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7569b1c-5a24-45a3-a654-a0a522a4e23c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:07.408322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7569b1c-5a24-45a3-a654-a0a522a4e23c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:07.409204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7569b1c-5a24-45a3-a654-a0a522a4e23c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:07.409792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7569b1c-5a24-45a3-a654-a0a522a4e23c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:07.410390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7569b1c-5a24-45a3-a654-a0a522a4e23c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:07.765095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a7569b1c-5a24-45a3-a654-a0a522a4e23c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:07.789226 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7569b1c-5a24-45a3-a654-a0a522a4e23c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.387508 Oct 29 03:07:07.795434 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2525/5001] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:07 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:07.815688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c75e7c8-7b0a-464e-a590-40c7b21092b3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:07.816298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4c75e7c8-7b0a-464e-a590-40c7b21092b3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:07.842570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c75e7c8-7b0a-464e-a590-40c7b21092b3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:07.843068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c75e7c8-7b0a-464e-a590-40c7b21092b3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:07.845035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c75e7c8-7b0a-464e-a590-40c7b21092b3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:07.846225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c75e7c8-7b0a-464e-a590-40c7b21092b3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:07.848339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c75e7c8-7b0a-464e-a590-40c7b21092b3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:07.851814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c75e7c8-7b0a-464e-a590-40c7b21092b3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:07.990598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:07:07.991071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:07:07.991610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:07:07.992105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:07:07.992829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:07:08.010684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.015323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.015800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:08.016730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.017237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.017662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:08.072353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Getting quotas for project 173e87fac5564c2db6ccff6fc14e0520. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:07:08.084816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Getting quotas for user f97cdb72a2424ca2b8487d71b7f22c0c and project 173e87fac5564c2db6ccff6fc14e0520. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:07:08.136597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:07:08.139216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:07:08.245378 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d743d780-313d-4ff3-98c0-547a0287ffb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.239006 Oct 29 03:07:08.246825 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2477/5002] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:07:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:07:08.252606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:08.253471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:08.265703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.266201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.266617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:08.269512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.270103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.270534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:08.538660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4c75e7c8-7b0a-464e-a590-40c7b21092b3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:08.542309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:08.558816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:08.560505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:08.572305 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1e2ebe71-4e9d-48a8-884e-5048fffb52e1 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1605 microversion: 2.42 time: 0.313896 Oct 29 03:07:08.573443 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4c75e7c8-7b0a-464e-a590-40c7b21092b3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.761702 Oct 29 03:07:08.575367 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2478/5003] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:08 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1605 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:08.602642 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2526/5004] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:07 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:08.634197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e582ce6f-9ff3-4a06-9c56-06cff6df642b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:08.635049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e582ce6f-9ff3-4a06-9c56-06cff6df642b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:08.643882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-109a2485-1bc9-4300-a32d-26e89b893e50 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:08.648022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-109a2485-1bc9-4300-a32d-26e89b893e50 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:08.670769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-109a2485-1bc9-4300-a32d-26e89b893e50 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.671268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-109a2485-1bc9-4300-a32d-26e89b893e50 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.682610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-109a2485-1bc9-4300-a32d-26e89b893e50 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:08.688560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-109a2485-1bc9-4300-a32d-26e89b893e50 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.690603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-109a2485-1bc9-4300-a32d-26e89b893e50 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.695110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-109a2485-1bc9-4300-a32d-26e89b893e50 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:08.851643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e582ce6f-9ff3-4a06-9c56-06cff6df642b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:08.863300 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e582ce6f-9ff3-4a06-9c56-06cff6df642b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1222 microversion: 2.1 time: 0.283044 Oct 29 03:07:08.864942 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2479/5005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:08 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1222 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:08.875801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5e694cc1-6dbf-420f-a477-e8d5a7e9957b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:08.878744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5e694cc1-6dbf-420f-a477-e8d5a7e9957b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:08.890438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:08.893895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e694cc1-6dbf-420f-a477-e8d5a7e9957b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.896996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e694cc1-6dbf-420f-a477-e8d5a7e9957b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.900174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e694cc1-6dbf-420f-a477-e8d5a7e9957b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:08.902563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e694cc1-6dbf-420f-a477-e8d5a7e9957b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.903531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e694cc1-6dbf-420f-a477-e8d5a7e9957b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.907217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e694cc1-6dbf-420f-a477-e8d5a7e9957b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.064954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-109a2485-1bc9-4300-a32d-26e89b893e50 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:09.075112 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-109a2485-1bc9-4300-a32d-26e89b893e50 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1309 microversion: 2.1 time: 0.470289 Oct 29 03:07:09.075963 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2527/5006] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:08 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1309 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:09.309499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5e694cc1-6dbf-420f-a477-e8d5a7e9957b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:09.328213 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5e694cc1-6dbf-420f-a477-e8d5a7e9957b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.458957 Oct 29 03:07:09.335132 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2480/5007] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:08 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:09.360805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef47a13d-30fe-4f55-97a8-aa0e8028bad4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:09.372057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:09.374002 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-ef47a13d-30fe-4f55-97a8-aa0e8028bad4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance c3c60d82-3116-41de-9635-b00e0e4afc7b has no mapping to a cell. Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef47a13d-30fe-4f55-97a8-aa0e8028bad4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/c3c60d82-3116-41de-9635-b00e0e4afc7b/action HTTP/1.1 Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 15 Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: {"os-stop": {}} Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance c3c60d82-3116-41de-9635-b00e0e4afc7b has no mapping to a cell. Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c3c60d82-3116-41de-9635-b00e0e4afc7b', 'body': {'os-stop': {}}} Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance c3c60d82-3116-41de-9635-b00e0e4afc7b has no mapping to a cell. Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:09.384989 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c60d82-3116-41de-9635-b00e0e4afc7b has no mapping to a cell. Oct 29 03:07:09.390039 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:09.390039 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:09.390039 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:09.390039 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:09.390039 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:09.390039 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:09.390039 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:09.390039 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:09.390039 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c60d82-3116-41de-9635-b00e0e4afc7b has no mapping to a cell. Oct 29 03:07:09.390039 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:09.391593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef47a13d-30fe-4f55-97a8-aa0e8028bad4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance c3c60d82-3116-41de-9635-b00e0e4afc7b has no mapping to a cell. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:09.393200 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ef47a13d-30fe-4f55-97a8-aa0e8028bad4 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/c3c60d82-3116-41de-9635-b00e0e4afc7b/action" status: 404 len: 117 microversion: 2.1 time: 0.036668 Oct 29 03:07:09.406171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-418762df-1739-41e7-8b5f-a6df713b1e77 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:09.407699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-418762df-1739-41e7-8b5f-a6df713b1e77 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:09.415038 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2528/5008] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:09 2022] POST /compute/v2.1/servers/c3c60d82-3116-41de-9635-b00e0e4afc7b/action => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:09.419190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-418762df-1739-41e7-8b5f-a6df713b1e77 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.419917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-418762df-1739-41e7-8b5f-a6df713b1e77 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.420526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-418762df-1739-41e7-8b5f-a6df713b1e77 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.421388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-418762df-1739-41e7-8b5f-a6df713b1e77 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.422156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-418762df-1739-41e7-8b5f-a6df713b1e77 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.423479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-418762df-1739-41e7-8b5f-a6df713b1e77 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.602885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:09.603709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:09.619669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.623007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.625165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.628097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.629690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.630603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.797978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-418762df-1739-41e7-8b5f-a6df713b1e77 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:09.810872 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-418762df-1739-41e7-8b5f-a6df713b1e77 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.411940 Oct 29 03:07:09.811457 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2481/5009] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:09 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:09.820307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:09.822571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:09.840548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3ab9c2c-d579-4215-8cfd-ea77177616ab tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:09.841461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a3ab9c2c-d579-4215-8cfd-ea77177616ab tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:09.845561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:09.847231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:09.851453 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20a1913e-5251-4dd7-9d0e-5c8d701491d3 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.253153 Oct 29 03:07:09.856151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3ab9c2c-d579-4215-8cfd-ea77177616ab tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.857427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3ab9c2c-d579-4215-8cfd-ea77177616ab tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.858053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3ab9c2c-d579-4215-8cfd-ea77177616ab tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.858937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3ab9c2c-d579-4215-8cfd-ea77177616ab tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.859318 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2529/5010] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:09 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:09.859727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3ab9c2c-d579-4215-8cfd-ea77177616ab tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.860328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3ab9c2c-d579-4215-8cfd-ea77177616ab tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.892867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-300fdc0a-4996-466a-99d5-7e298e1e8237 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:09.893483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-300fdc0a-4996-466a-99d5-7e298e1e8237 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:09.906508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-300fdc0a-4996-466a-99d5-7e298e1e8237 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.907003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-300fdc0a-4996-466a-99d5-7e298e1e8237 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.907434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-300fdc0a-4996-466a-99d5-7e298e1e8237 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.912880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-300fdc0a-4996-466a-99d5-7e298e1e8237 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.913392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-300fdc0a-4996-466a-99d5-7e298e1e8237 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.913842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-300fdc0a-4996-466a-99d5-7e298e1e8237 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.004813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-300fdc0a-4996-466a-99d5-7e298e1e8237 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:10.024504 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-300fdc0a-4996-466a-99d5-7e298e1e8237 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1274 microversion: 2.1 time: 0.136596 Oct 29 03:07:10.027051 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2530/5011] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:09 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:10.103318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-34be2d12-a524-4cd5-ac31-21e02a27a643 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:10.103913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-34be2d12-a524-4cd5-ac31-21e02a27a643 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:10.111162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34be2d12-a524-4cd5-ac31-21e02a27a643 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.111963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34be2d12-a524-4cd5-ac31-21e02a27a643 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.112596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34be2d12-a524-4cd5-ac31-21e02a27a643 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.114308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34be2d12-a524-4cd5-ac31-21e02a27a643 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.114991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34be2d12-a524-4cd5-ac31-21e02a27a643 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.115600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34be2d12-a524-4cd5-ac31-21e02a27a643 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.188283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3ab9c2c-d579-4215-8cfd-ea77177616ab tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:10.211709 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3ab9c2c-d579-4215-8cfd-ea77177616ab tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.374688 Oct 29 03:07:10.214592 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2482/5012] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:09 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:10.238468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-88845466-d071-4e2e-94b8-2d48e2a9dd29 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:10.239270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-88845466-d071-4e2e-94b8-2d48e2a9dd29 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: bb4b61dc-6fd0-4ba3-bbd1-81b5ac7c6da7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:10.248346 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-88845466-d071-4e2e-94b8-2d48e2a9dd29 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance bb4b61dc-6fd0-4ba3-bbd1-81b5ac7c6da7 could not be found. Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-88845466-d071-4e2e-94b8-2d48e2a9dd29 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/bb4b61dc-6fd0-4ba3-bbd1-81b5ac7c6da7/action HTTP/1.1 Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 15 Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: {"suspend": {}} Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance bb4b61dc-6fd0-4ba3-bbd1-81b5ac7c6da7 could not be found. Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'bb4b61dc-6fd0-4ba3-bbd1-81b5ac7c6da7', 'body': {'suspend': {}}} Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4b61dc-6fd0-4ba3-bbd1-81b5ac7c6da7 could not be found. Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4b61dc-6fd0-4ba3-bbd1-81b5ac7c6da7 could not be found. Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:10.254229 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:10.258992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:10.258992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:10.258992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4b61dc-6fd0-4ba3-bbd1-81b5ac7c6da7 could not be found. Oct 29 03:07:10.258992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:10.268442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-88845466-d071-4e2e-94b8-2d48e2a9dd29 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance bb4b61dc-6fd0-4ba3-bbd1-81b5ac7c6da7 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:10.269560 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-88845466-d071-4e2e-94b8-2d48e2a9dd29 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/bb4b61dc-6fd0-4ba3-bbd1-81b5ac7c6da7/action" status: 404 len: 111 microversion: 2.1 time: 0.035168 Oct 29 03:07:10.273687 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2483/5013] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:10 2022] POST /compute/v2.1/servers/bb4b61dc-6fd0-4ba3-bbd1-81b5ac7c6da7/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:10.278957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-41ac8595-5e42-4f6f-ad22-56a28a37738f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:10.280809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-41ac8595-5e42-4f6f-ad22-56a28a37738f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:10.295288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41ac8595-5e42-4f6f-ad22-56a28a37738f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.296697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41ac8595-5e42-4f6f-ad22-56a28a37738f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.298849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41ac8595-5e42-4f6f-ad22-56a28a37738f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.299784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41ac8595-5e42-4f6f-ad22-56a28a37738f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.300410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41ac8595-5e42-4f6f-ad22-56a28a37738f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.302308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41ac8595-5e42-4f6f-ad22-56a28a37738f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.424640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-34be2d12-a524-4cd5-ac31-21e02a27a643 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:10.446745 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-34be2d12-a524-4cd5-ac31-21e02a27a643 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1309 microversion: 2.1 time: 0.347551 Oct 29 03:07:10.451011 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2531/5014] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:10 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1309 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:10.644837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-41ac8595-5e42-4f6f-ad22-56a28a37738f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:10.659847 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-41ac8595-5e42-4f6f-ad22-56a28a37738f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.384700 Oct 29 03:07:10.662702 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2484/5015] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:10 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:10.695712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8fc544c6-1de7-4826-93db-ab2be1f49aff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:10.699403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8fc544c6-1de7-4826-93db-ab2be1f49aff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:10.708004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc544c6-1de7-4826-93db-ab2be1f49aff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.708847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc544c6-1de7-4826-93db-ab2be1f49aff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.709516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc544c6-1de7-4826-93db-ab2be1f49aff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.726929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc544c6-1de7-4826-93db-ab2be1f49aff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.728906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc544c6-1de7-4826-93db-ab2be1f49aff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.729593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc544c6-1de7-4826-93db-ab2be1f49aff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.880212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:10.880825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:10.890728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.891222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.894167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.894983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.895366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.895797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.168210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8fc544c6-1de7-4826-93db-ab2be1f49aff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:11.184996 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8fc544c6-1de7-4826-93db-ab2be1f49aff tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.493511 Oct 29 03:07:11.186471 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2532/5016] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:10 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:11.199126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b590b4cf-e631-439d-9d62-e1a9148849b8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:11.201234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b590b4cf-e631-439d-9d62-e1a9148849b8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:11.215488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b590b4cf-e631-439d-9d62-e1a9148849b8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.216002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b590b4cf-e631-439d-9d62-e1a9148849b8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.216419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b590b4cf-e631-439d-9d62-e1a9148849b8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.217158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b590b4cf-e631-439d-9d62-e1a9148849b8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.217607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b590b4cf-e631-439d-9d62-e1a9148849b8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.218102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b590b4cf-e631-439d-9d62-e1a9148849b8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.431162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b590b4cf-e631-439d-9d62-e1a9148849b8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:11.443480 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b590b4cf-e631-439d-9d62-e1a9148849b8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1280 microversion: 2.1 time: 0.255860 Oct 29 03:07:11.446164 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2533/5017] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:11 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1280 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:11.460505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fc95e4fa-2f9d-4249-baf2-503abd74227b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:11.464467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fc95e4fa-2f9d-4249-baf2-503abd74227b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:11.482468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc95e4fa-2f9d-4249-baf2-503abd74227b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.485266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc95e4fa-2f9d-4249-baf2-503abd74227b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.485907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc95e4fa-2f9d-4249-baf2-503abd74227b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.487214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc95e4fa-2f9d-4249-baf2-503abd74227b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.489856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc95e4fa-2f9d-4249-baf2-503abd74227b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.490635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc95e4fa-2f9d-4249-baf2-503abd74227b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.563547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-fc95e4fa-2f9d-4249-baf2-503abd74227b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lazy-loading 'flavor' on Instance uuid 2bbab455-c481-40ea-a59c-4ec9c15d935e {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:07:11.711720 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fc95e4fa-2f9d-4249-baf2-503abd74227b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 202 len: 0 microversion: 2.1 time: 0.261394 Oct 29 03:07:11.718606 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2534/5018] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:11 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:11.725509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5020bea9-cc7e-41b2-b0a8-012c6fe0d113 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:11.726675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5020bea9-cc7e-41b2-b0a8-012c6fe0d113 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:11.740893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5020bea9-cc7e-41b2-b0a8-012c6fe0d113 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.741823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5020bea9-cc7e-41b2-b0a8-012c6fe0d113 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.742339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5020bea9-cc7e-41b2-b0a8-012c6fe0d113 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.743443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5020bea9-cc7e-41b2-b0a8-012c6fe0d113 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.755975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5020bea9-cc7e-41b2-b0a8-012c6fe0d113 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.756797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5020bea9-cc7e-41b2-b0a8-012c6fe0d113 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.901769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:11.915353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:11.916811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:11.924955 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d426267b-38e6-4c29-971d-86ca485f4086 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 1.048581 Oct 29 03:07:11.926263 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2485/5019] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:10 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:11.934139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-dc30e2a9-e45e-41a6-98e2-7fe8cef65895 req-f523cf01-3905-4d55-8d42-2e4cff86dd38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165e6cff-b0bf-43bc-a406-bb5b4b42d28f", "name": "network-vif-plugged", "status": "completed", "tag": "04076300-ddba-4df7-bb7e-cd90ee203828"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:11.955728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-dc30e2a9-e45e-41a6-98e2-7fe8cef65895 req-f523cf01-3905-4d55-8d42-2e4cff86dd38 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.959971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-dc30e2a9-e45e-41a6-98e2-7fe8cef65895 req-f523cf01-3905-4d55-8d42-2e4cff86dd38 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.960639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-dc30e2a9-e45e-41a6-98e2-7fe8cef65895 req-f523cf01-3905-4d55-8d42-2e4cff86dd38 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.995539 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-dc30e2a9-e45e-41a6-98e2-7fe8cef65895 req-f523cf01-3905-4d55-8d42-2e4cff86dd38 service nova] Creating event network-vif-plugged:04076300-ddba-4df7-bb7e-cd90ee203828 for instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f on n-h2-862964-4 Oct 29 03:07:12.003426 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-dc30e2a9-e45e-41a6-98e2-7fe8cef65895 req-f523cf01-3905-4d55-8d42-2e4cff86dd38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075528 Oct 29 03:07:12.010690 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2486/5020] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:12.019666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8e2c4677-8214-469f-b656-3c2f27ea2612 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:12.021191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8e2c4677-8214-469f-b656-3c2f27ea2612 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:12.029377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e2c4677-8214-469f-b656-3c2f27ea2612 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.030147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e2c4677-8214-469f-b656-3c2f27ea2612 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.031299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e2c4677-8214-469f-b656-3c2f27ea2612 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:12.032137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e2c4677-8214-469f-b656-3c2f27ea2612 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.032727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e2c4677-8214-469f-b656-3c2f27ea2612 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.033254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e2c4677-8214-469f-b656-3c2f27ea2612 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:12.339645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e2c4677-8214-469f-b656-3c2f27ea2612 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:12.352819 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8e2c4677-8214-469f-b656-3c2f27ea2612 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1514 microversion: 2.1 time: 0.340489 Oct 29 03:07:12.356244 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2487/5021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:12 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1514 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:12.470845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-184e3f2e-f0b3-455a-92bd-4a35d6c4e40d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:12.471831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-184e3f2e-f0b3-455a-92bd-4a35d6c4e40d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:12.489117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184e3f2e-f0b3-455a-92bd-4a35d6c4e40d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.496633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184e3f2e-f0b3-455a-92bd-4a35d6c4e40d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.497145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184e3f2e-f0b3-455a-92bd-4a35d6c4e40d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:12.501994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184e3f2e-f0b3-455a-92bd-4a35d6c4e40d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.502680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184e3f2e-f0b3-455a-92bd-4a35d6c4e40d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.503273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184e3f2e-f0b3-455a-92bd-4a35d6c4e40d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:12.636843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5020bea9-cc7e-41b2-b0a8-012c6fe0d113 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:12.651359 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5020bea9-cc7e-41b2-b0a8-012c6fe0d113 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1309 microversion: 2.1 time: 0.928015 Oct 29 03:07:12.668356 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2535/5022] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:11 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1309 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:12.743481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-184e3f2e-f0b3-455a-92bd-4a35d6c4e40d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:12.747714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:12.753496 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-184e3f2e-f0b3-455a-92bd-4a35d6c4e40d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1322 microversion: 2.1 time: 0.287118 Oct 29 03:07:12.755205 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2488/5023] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:12 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:12.956387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:12.957082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:12.967302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.967803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.968235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:12.972318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.972894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.973339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.097654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:13.112897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:13.119095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:13.128452 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3ad8f6de-f5bd-4a35-9fd8-d506eec2448c tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.173006 Oct 29 03:07:13.148341 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2536/5024] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:12 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:13.384598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a904b025-89e5-4e76-9215-2480c01ed374 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:13.385910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a904b025-89e5-4e76-9215-2480c01ed374 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:13.410147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a904b025-89e5-4e76-9215-2480c01ed374 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.413696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a904b025-89e5-4e76-9215-2480c01ed374 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.416381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a904b025-89e5-4e76-9215-2480c01ed374 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.417417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a904b025-89e5-4e76-9215-2480c01ed374 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.421069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a904b025-89e5-4e76-9215-2480c01ed374 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.423998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a904b025-89e5-4e76-9215-2480c01ed374 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.675901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6429a7fa-7243-4a1e-aca5-77efe5d0299f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:13.677077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6429a7fa-7243-4a1e-aca5-77efe5d0299f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:13.686013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6429a7fa-7243-4a1e-aca5-77efe5d0299f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.686510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6429a7fa-7243-4a1e-aca5-77efe5d0299f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.686995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6429a7fa-7243-4a1e-aca5-77efe5d0299f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.687697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6429a7fa-7243-4a1e-aca5-77efe5d0299f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.688140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6429a7fa-7243-4a1e-aca5-77efe5d0299f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.688579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6429a7fa-7243-4a1e-aca5-77efe5d0299f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.690335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a904b025-89e5-4e76-9215-2480c01ed374 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:13.702283 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a904b025-89e5-4e76-9215-2480c01ed374 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1497 microversion: 2.1 time: 0.322025 Oct 29 03:07:13.707396 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2489/5025] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:13 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1497 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:13.737786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:13.738808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:13.749236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.750758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.751303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.752256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.753088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.753652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.790621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lazy-loading 'flavor' on Instance uuid 2bbab455-c481-40ea-a59c-4ec9c15d935e {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:07:13.810923 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Cannot 'suspend' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state suspended Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action HTTP/1.1 Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 15 Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: {"suspend": {}} Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: exception: Cannot 'suspend' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state suspended Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2bbab455-c481-40ea-a59c-4ec9c15d935e', 'body': {'suspend': {}}} Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e in vm_state suspended. Cannot suspend while the instance is in this state. Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 29 03:07:13.813941 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state suspended Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state suspended Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:13.819457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 409 to user: Cannot 'suspend' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state suspended {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:13.824929 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94061a84-8e09-4319-bd5b-b9ec6fb4cec9 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 409 len: 148 microversion: 2.1 time: 0.094194 Oct 29 03:07:13.824929 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2490/5026] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:13 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 148 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 03:07:13.828555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bcc49853-491f-4dcd-9e0e-1701a0289263 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:13.829367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bcc49853-491f-4dcd-9e0e-1701a0289263 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:13.836437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcc49853-491f-4dcd-9e0e-1701a0289263 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.836950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcc49853-491f-4dcd-9e0e-1701a0289263 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.837947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcc49853-491f-4dcd-9e0e-1701a0289263 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.838749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcc49853-491f-4dcd-9e0e-1701a0289263 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.839455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcc49853-491f-4dcd-9e0e-1701a0289263 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.839910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bcc49853-491f-4dcd-9e0e-1701a0289263 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.012616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6429a7fa-7243-4a1e-aca5-77efe5d0299f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:14.024895 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6429a7fa-7243-4a1e-aca5-77efe5d0299f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1309 microversion: 2.1 time: 0.348956 Oct 29 03:07:14.025932 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2537/5027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:13 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1309 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:14.034573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d6ede53-2c5b-41a4-93bb-58f7cad0c89c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:14.037491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9d6ede53-2c5b-41a4-93bb-58f7cad0c89c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:14.052260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d6ede53-2c5b-41a4-93bb-58f7cad0c89c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:14.053005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d6ede53-2c5b-41a4-93bb-58f7cad0c89c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:14.053624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d6ede53-2c5b-41a4-93bb-58f7cad0c89c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.053916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bcc49853-491f-4dcd-9e0e-1701a0289263 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:14.055644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d6ede53-2c5b-41a4-93bb-58f7cad0c89c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:14.057724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d6ede53-2c5b-41a4-93bb-58f7cad0c89c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:14.058461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d6ede53-2c5b-41a4-93bb-58f7cad0c89c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.065332 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bcc49853-491f-4dcd-9e0e-1701a0289263 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1322 microversion: 2.1 time: 0.243025 Oct 29 03:07:14.078924 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2491/5028] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:13 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:14.157785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:14.158409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:14.167768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:14.168204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:14.168630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.172752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:14.173207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:14.173634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.247921 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9d6ede53-2c5b-41a4-93bb-58f7cad0c89c tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 202 len: 0 microversion: 2.1 time: 0.217455 Oct 29 03:07:14.253416 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2538/5029] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:14 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:14.263270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-5e56d182-641b-41f6-be4b-5c4ea7606946 req-cb320cbd-ddc0-4339-9600-3b59858840a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6755720e-84ca-4767-ae13-d3934b13ff6b", "tag": "6e0747ef-9623-4166-aeb4-afda676eb721"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:14.302456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5e56d182-641b-41f6-be4b-5c4ea7606946 req-cb320cbd-ddc0-4339-9600-3b59858840a1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:14.303048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5e56d182-641b-41f6-be4b-5c4ea7606946 req-cb320cbd-ddc0-4339-9600-3b59858840a1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:14.303568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5e56d182-641b-41f6-be4b-5c4ea7606946 req-cb320cbd-ddc0-4339-9600-3b59858840a1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.343949 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-5e56d182-641b-41f6-be4b-5c4ea7606946 req-cb320cbd-ddc0-4339-9600-3b59858840a1 service nova] Creating event network-changed:6e0747ef-9623-4166-aeb4-afda676eb721 for instance 6755720e-84ca-4767-ae13-d3934b13ff6b on n-h2-862964-4 Oct 29 03:07:14.351805 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-5e56d182-641b-41f6-be4b-5c4ea7606946 req-cb320cbd-ddc0-4339-9600-3b59858840a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096691 Oct 29 03:07:14.353587 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2539/5030] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:14.360715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d60d9905-7fb3-4b58-99e3-2091338ef676 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:14.361797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d60d9905-7fb3-4b58-99e3-2091338ef676 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:14.370809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d60d9905-7fb3-4b58-99e3-2091338ef676 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:14.371705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d60d9905-7fb3-4b58-99e3-2091338ef676 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:14.372372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d60d9905-7fb3-4b58-99e3-2091338ef676 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.373275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d60d9905-7fb3-4b58-99e3-2091338ef676 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:14.374008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d60d9905-7fb3-4b58-99e3-2091338ef676 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:14.374715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d60d9905-7fb3-4b58-99e3-2091338ef676 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.392870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:14.407969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:14.413782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:14.418751 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-15b0a580-10bd-491a-8ed6-2f7842780582 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.265747 Oct 29 03:07:14.422500 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2492/5031] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:14 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:14.823764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d60d9905-7fb3-4b58-99e3-2091338ef676 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:14.838912 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d60d9905-7fb3-4b58-99e3-2091338ef676 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1503 microversion: 2.1 time: 0.483345 Oct 29 03:07:14.840238 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2540/5032] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:14 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1503 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:15.057745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cc9c46aa-9279-4172-8155-d9435d4751aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:15.061473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cc9c46aa-9279-4172-8155-d9435d4751aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:15.093855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3f067cd4-d569-41b7-bc9a-7bf838502ea6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:15.094764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3f067cd4-d569-41b7-bc9a-7bf838502ea6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:15.096968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc9c46aa-9279-4172-8155-d9435d4751aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.102188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc9c46aa-9279-4172-8155-d9435d4751aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.103058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc9c46aa-9279-4172-8155-d9435d4751aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.104316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc9c46aa-9279-4172-8155-d9435d4751aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.104878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc9c46aa-9279-4172-8155-d9435d4751aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.106369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc9c46aa-9279-4172-8155-d9435d4751aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.114321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f067cd4-d569-41b7-bc9a-7bf838502ea6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.115451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f067cd4-d569-41b7-bc9a-7bf838502ea6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.118526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f067cd4-d569-41b7-bc9a-7bf838502ea6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.122578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f067cd4-d569-41b7-bc9a-7bf838502ea6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.124363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f067cd4-d569-41b7-bc9a-7bf838502ea6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.124850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f067cd4-d569-41b7-bc9a-7bf838502ea6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.349971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3f067cd4-d569-41b7-bc9a-7bf838502ea6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:15.358629 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3f067cd4-d569-41b7-bc9a-7bf838502ea6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1322 microversion: 2.1 time: 0.270691 Oct 29 03:07:15.359579 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2541/5033] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:15 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:15.428595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc9c46aa-9279-4172-8155-d9435d4751aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:15.438032 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cc9c46aa-9279-4172-8155-d9435d4751aa tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1490 microversion: 2.1 time: 0.388367 Oct 29 03:07:15.438598 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2493/5034] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:15 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1490 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:15.458140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:15.459004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:15.462284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-164a83ee-188b-4a39-8c37-53fa518b6805 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-647343805"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:15.465474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-164a83ee-188b-4a39-8c37-53fa518b6805 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:15.466595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.467640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.468295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.469361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.470074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.470731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.472436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-164a83ee-188b-4a39-8c37-53fa518b6805 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.472950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-164a83ee-188b-4a39-8c37-53fa518b6805 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.473386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-164a83ee-188b-4a39-8c37-53fa518b6805 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.474179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-164a83ee-188b-4a39-8c37-53fa518b6805 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.474661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-164a83ee-188b-4a39-8c37-53fa518b6805 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.475098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-164a83ee-188b-4a39-8c37-53fa518b6805 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.557490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:15.568343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:15.570391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:15.570723 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-164a83ee-188b-4a39-8c37-53fa518b6805 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "PUT /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1074 microversion: 2.1 time: 0.111958 Oct 29 03:07:15.572101 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-52808a48-24e5-4fba-b529-c5d8ef5586c5 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.119512 Oct 29 03:07:15.573112 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2542/5035] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:15 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:15.574520 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2494/5036] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 03:07:15 2022] PUT /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1074 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:15.600283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-306989ae-8442-4cfe-840b-3019a73d9404 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:15.601480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-306989ae-8442-4cfe-840b-3019a73d9404 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:15.609405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-306989ae-8442-4cfe-840b-3019a73d9404 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.610232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-306989ae-8442-4cfe-840b-3019a73d9404 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.611041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-306989ae-8442-4cfe-840b-3019a73d9404 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.611956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-306989ae-8442-4cfe-840b-3019a73d9404 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.612663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-306989ae-8442-4cfe-840b-3019a73d9404 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.613450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-306989ae-8442-4cfe-840b-3019a73d9404 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.792603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-306989ae-8442-4cfe-840b-3019a73d9404 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:15.807879 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-306989ae-8442-4cfe-840b-3019a73d9404 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1500 microversion: 2.1 time: 0.219669 Oct 29 03:07:15.808496 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2543/5037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:15 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1500 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:15.835782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-648c1f45-3576-400d-92eb-4f77158c8b43 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:15.836800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-648c1f45-3576-400d-92eb-4f77158c8b43 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:15.843769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648c1f45-3576-400d-92eb-4f77158c8b43 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.844482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648c1f45-3576-400d-92eb-4f77158c8b43 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.845237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648c1f45-3576-400d-92eb-4f77158c8b43 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.846151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648c1f45-3576-400d-92eb-4f77158c8b43 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.846938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648c1f45-3576-400d-92eb-4f77158c8b43 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.847522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-648c1f45-3576-400d-92eb-4f77158c8b43 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.866996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79898c5e-30d7-4028-b79b-75648720abf3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:15.868720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79898c5e-30d7-4028-b79b-75648720abf3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:15.880719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79898c5e-30d7-4028-b79b-75648720abf3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.881271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79898c5e-30d7-4028-b79b-75648720abf3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.881766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79898c5e-30d7-4028-b79b-75648720abf3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.882457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79898c5e-30d7-4028-b79b-75648720abf3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.882936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79898c5e-30d7-4028-b79b-75648720abf3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.884858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79898c5e-30d7-4028-b79b-75648720abf3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.907136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:16.057675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-79898c5e-30d7-4028-b79b-75648720abf3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:16.067166 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79898c5e-30d7-4028-b79b-75648720abf3 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1503 microversion: 2.1 time: 0.204691 Oct 29 03:07:16.068764 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2544/5038] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:15 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:16.108636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-648c1f45-3576-400d-92eb-4f77158c8b43 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:16.118051 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-648c1f45-3576-400d-92eb-4f77158c8b43 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1500 microversion: 2.1 time: 0.285916 Oct 29 03:07:16.118941 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2495/5039] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:15 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1500 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:16.145327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ad3e909a-89f5-4f6e-9a70-5223b167c178 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:16.153301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad3e909a-89f5-4f6e-9a70-5223b167c178 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:16.154325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad3e909a-89f5-4f6e-9a70-5223b167c178 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:16.154942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ad3e909a-89f5-4f6e-9a70-5223b167c178 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:16.199935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ad3e909a-89f5-4f6e-9a70-5223b167c178 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Going to try to stop instance {{(pid=127042) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:07:16.265348 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ad3e909a-89f5-4f6e-9a70-5223b167c178 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "POST /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f/action" status: 202 len: 0 microversion: 2.1 time: 0.123830 Oct 29 03:07:16.267647 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2545/5040] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:16 2022] POST /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:16.276548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2d9d7343-0578-4f43-9910-5878734091ed tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:16.277693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2d9d7343-0578-4f43-9910-5878734091ed tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:16.285324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9d7343-0578-4f43-9910-5878734091ed tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:16.285841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9d7343-0578-4f43-9910-5878734091ed tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:16.286582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9d7343-0578-4f43-9910-5878734091ed tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:16.287501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9d7343-0578-4f43-9910-5878734091ed tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:16.288133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9d7343-0578-4f43-9910-5878734091ed tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:16.288733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d9d7343-0578-4f43-9910-5878734091ed tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:16.382649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4bc557b4-03f0-4ae0-9b2e-de1f46e85a95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:16.383690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4bc557b4-03f0-4ae0-9b2e-de1f46e85a95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:16.391589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bc557b4-03f0-4ae0-9b2e-de1f46e85a95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:16.392474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bc557b4-03f0-4ae0-9b2e-de1f46e85a95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:16.393215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bc557b4-03f0-4ae0-9b2e-de1f46e85a95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:16.394329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bc557b4-03f0-4ae0-9b2e-de1f46e85a95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:16.395200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bc557b4-03f0-4ae0-9b2e-de1f46e85a95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:16.395967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bc557b4-03f0-4ae0-9b2e-de1f46e85a95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:16.615591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2d9d7343-0578-4f43-9910-5878734091ed tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:16.625930 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2d9d7343-0578-4f43-9910-5878734091ed tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.353517 Oct 29 03:07:16.627180 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2496/5041] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:16 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:16.632155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:16.637272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:16.648422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:16.649215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:16.649927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:16.651187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:16.656649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:16.658536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:16.861489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:16.869030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4bc557b4-03f0-4ae0-9b2e-de1f46e85a95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:16.883401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:16.885236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:16.887249 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-90b274b3-d9a6-437e-a7ab-6cc8f948a2d2 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.258571 Oct 29 03:07:16.888205 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4bc557b4-03f0-4ae0-9b2e-de1f46e85a95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1322 microversion: 2.1 time: 0.508056 Oct 29 03:07:16.888717 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2497/5042] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:16 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:16.896154 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2546/5043] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:16 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:17.097427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ccf37a82-4759-45f3-a5fb-0e4325c1f0d8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:17.098776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ccf37a82-4759-45f3-a5fb-0e4325c1f0d8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:17.108561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccf37a82-4759-45f3-a5fb-0e4325c1f0d8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.109053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccf37a82-4759-45f3-a5fb-0e4325c1f0d8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.109491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccf37a82-4759-45f3-a5fb-0e4325c1f0d8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.110255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccf37a82-4759-45f3-a5fb-0e4325c1f0d8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.110884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccf37a82-4759-45f3-a5fb-0e4325c1f0d8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.111459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccf37a82-4759-45f3-a5fb-0e4325c1f0d8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.616357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ccf37a82-4759-45f3-a5fb-0e4325c1f0d8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:17.632422 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ccf37a82-4759-45f3-a5fb-0e4325c1f0d8 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1503 microversion: 2.1 time: 0.541107 Oct 29 03:07:17.633284 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2498/5044] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:17 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1503 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:17.657734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2ff58178-6c50-48e6-ab8d-1412b70fcf48 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:17.659394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2ff58178-6c50-48e6-ab8d-1412b70fcf48 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:17.667967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff58178-6c50-48e6-ab8d-1412b70fcf48 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.668711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff58178-6c50-48e6-ab8d-1412b70fcf48 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.669295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff58178-6c50-48e6-ab8d-1412b70fcf48 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.670215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff58178-6c50-48e6-ab8d-1412b70fcf48 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.670814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff58178-6c50-48e6-ab8d-1412b70fcf48 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.672414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ff58178-6c50-48e6-ab8d-1412b70fcf48 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.919384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:17.920403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:17.927851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.928670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.929482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.930887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.931910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.932546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.951021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2ff58178-6c50-48e6-ab8d-1412b70fcf48 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:17.960016 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2ff58178-6c50-48e6-ab8d-1412b70fcf48 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.307716 Oct 29 03:07:17.960964 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2547/5045] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:17 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:17.966061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5a64f19f-a123-4660-8ce1-f9513a3942f5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:17.966814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5a64f19f-a123-4660-8ce1-f9513a3942f5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:17.972919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a64f19f-a123-4660-8ce1-f9513a3942f5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.973546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a64f19f-a123-4660-8ce1-f9513a3942f5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.974016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a64f19f-a123-4660-8ce1-f9513a3942f5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.974726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a64f19f-a123-4660-8ce1-f9513a3942f5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.975175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a64f19f-a123-4660-8ce1-f9513a3942f5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.975591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a64f19f-a123-4660-8ce1-f9513a3942f5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:18.037912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:18.140549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:18.154063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:18.156148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:18.157617 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5347f202-7cb7-4fac-ba1a-baf05ba65651 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.243170 Oct 29 03:07:18.158781 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2499/5046] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:17 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:07:18.249416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5a64f19f-a123-4660-8ce1-f9513a3942f5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:18.259684 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5a64f19f-a123-4660-8ce1-f9513a3942f5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1322 microversion: 2.1 time: 0.297186 Oct 29 03:07:18.275223 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2548/5047] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:17 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:18.660076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8aeb18c1-0c87-4279-b29f-afef4c89d318 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:18.660855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8aeb18c1-0c87-4279-b29f-afef4c89d318 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:18.675255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aeb18c1-0c87-4279-b29f-afef4c89d318 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:18.676208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aeb18c1-0c87-4279-b29f-afef4c89d318 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:18.677946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aeb18c1-0c87-4279-b29f-afef4c89d318 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:18.678966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aeb18c1-0c87-4279-b29f-afef4c89d318 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:18.681389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aeb18c1-0c87-4279-b29f-afef4c89d318 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:18.682047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aeb18c1-0c87-4279-b29f-afef4c89d318 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:18.859940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:18.892040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8aeb18c1-0c87-4279-b29f-afef4c89d318 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:18.915188 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8aeb18c1-0c87-4279-b29f-afef4c89d318 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.260383 Oct 29 03:07:18.930586 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2500/5048] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:18 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:18.951099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8df28907-ca23-49d3-9bb5-a3a6a4178e4d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:18.951715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8df28907-ca23-49d3-9bb5-a3a6a4178e4d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:18.963767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8df28907-ca23-49d3-9bb5-a3a6a4178e4d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:18.964636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8df28907-ca23-49d3-9bb5-a3a6a4178e4d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:18.965332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8df28907-ca23-49d3-9bb5-a3a6a4178e4d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:18.966667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8df28907-ca23-49d3-9bb5-a3a6a4178e4d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:18.967610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8df28907-ca23-49d3-9bb5-a3a6a4178e4d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:18.968409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8df28907-ca23-49d3-9bb5-a3a6a4178e4d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:18.989714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59157b99-2730-4cd0-8e50-44f8e8c967d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:18.990761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59157b99-2730-4cd0-8e50-44f8e8c967d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:19.009594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157b99-2730-4cd0-8e50-44f8e8c967d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.011009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157b99-2730-4cd0-8e50-44f8e8c967d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.012095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157b99-2730-4cd0-8e50-44f8e8c967d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.015856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157b99-2730-4cd0-8e50-44f8e8c967d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.019431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157b99-2730-4cd0-8e50-44f8e8c967d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.020938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59157b99-2730-4cd0-8e50-44f8e8c967d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.218875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59157b99-2730-4cd0-8e50-44f8e8c967d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:19.232566 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59157b99-2730-4cd0-8e50-44f8e8c967d6 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.248385 Oct 29 03:07:19.241851 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2501/5049] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:18 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:19.255234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:19.258178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:19.267026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.268071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.268769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.269679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.270548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.271475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.290383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8df28907-ca23-49d3-9bb5-a3a6a4178e4d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:19.306695 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8df28907-ca23-49d3-9bb5-a3a6a4178e4d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.361137 Oct 29 03:07:19.307657 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2549/5050] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:18 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:19.322240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dec72679-e736-4e4b-919e-295ba8fddc84 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:19.322852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dec72679-e736-4e4b-919e-295ba8fddc84 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:19.334050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dec72679-e736-4e4b-919e-295ba8fddc84 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.334753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dec72679-e736-4e4b-919e-295ba8fddc84 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.335416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dec72679-e736-4e4b-919e-295ba8fddc84 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.336351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dec72679-e736-4e4b-919e-295ba8fddc84 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.340417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dec72679-e736-4e4b-919e-295ba8fddc84 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.341168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dec72679-e736-4e4b-919e-295ba8fddc84 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.407740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:19.421330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:19.424341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:19.425943 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-980fb4c3-be54-4f62-9d6a-ca0cc93906ff tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.184371 Oct 29 03:07:19.426875 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2502/5051] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:19 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:19.434517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3422e56d-cec8-43c0-bc46-5baf889750b2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:19.435246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3422e56d-cec8-43c0-bc46-5baf889750b2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: f33b6c4e-b1c1-4f8b-8088-a5640994d136] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:19.442381 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-3422e56d-cec8-43c0-bc46-5baf889750b2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance f33b6c4e-b1c1-4f8b-8088-a5640994d136 could not be found. Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3422e56d-cec8-43c0-bc46-5baf889750b2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/f33b6c4e-b1c1-4f8b-8088-a5640994d136/action HTTP/1.1 Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 15 Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: {"unpause": {}} Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance f33b6c4e-b1c1-4f8b-8088-a5640994d136 could not be found. Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'f33b6c4e-b1c1-4f8b-8088-a5640994d136', 'body': {'unpause': {}}} Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f33b6c4e-b1c1-4f8b-8088-a5640994d136 could not be found. Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f33b6c4e-b1c1-4f8b-8088-a5640994d136 could not be found. Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:19.445101 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:19.450110 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:19.450110 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:19.450110 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f33b6c4e-b1c1-4f8b-8088-a5640994d136 could not be found. Oct 29 03:07:19.450110 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:19.452444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3422e56d-cec8-43c0-bc46-5baf889750b2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance f33b6c4e-b1c1-4f8b-8088-a5640994d136 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:19.453725 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3422e56d-cec8-43c0-bc46-5baf889750b2 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/f33b6c4e-b1c1-4f8b-8088-a5640994d136/action" status: 404 len: 111 microversion: 2.1 time: 0.025619 Oct 29 03:07:19.454579 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2503/5052] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:19 2022] POST /compute/v2.1/servers/f33b6c4e-b1c1-4f8b-8088-a5640994d136/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:19.465651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51f58bea-d0b6-4d71-8faf-321e3899afae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:19.468108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-51f58bea-d0b6-4d71-8faf-321e3899afae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:19.477229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f58bea-d0b6-4d71-8faf-321e3899afae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.478187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f58bea-d0b6-4d71-8faf-321e3899afae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.478863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f58bea-d0b6-4d71-8faf-321e3899afae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.479907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f58bea-d0b6-4d71-8faf-321e3899afae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.480536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f58bea-d0b6-4d71-8faf-321e3899afae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.481108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51f58bea-d0b6-4d71-8faf-321e3899afae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.705232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-51f58bea-d0b6-4d71-8faf-321e3899afae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:19.716584 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-51f58bea-d0b6-4d71-8faf-321e3899afae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.257220 Oct 29 03:07:19.730873 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2504/5053] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:19 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:19.743771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-031fbf16-481c-4734-a080-741e879f836b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:19.744779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-031fbf16-481c-4734-a080-741e879f836b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:19.752446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-031fbf16-481c-4734-a080-741e879f836b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.753168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-031fbf16-481c-4734-a080-741e879f836b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.753881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-031fbf16-481c-4734-a080-741e879f836b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.754916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-031fbf16-481c-4734-a080-741e879f836b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.755690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-031fbf16-481c-4734-a080-741e879f836b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.756377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-031fbf16-481c-4734-a080-741e879f836b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.004061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-031fbf16-481c-4734-a080-741e879f836b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:20.015735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:20.019864 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-031fbf16-481c-4734-a080-741e879f836b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.280856 Oct 29 03:07:20.031753 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2505/5054] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:19 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:20.050307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:20.051943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:20.060421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.061270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.061972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.063471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.064133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.064760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.066991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dec72679-e736-4e4b-919e-295ba8fddc84 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:20.080337 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dec72679-e736-4e4b-919e-295ba8fddc84 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1322 microversion: 2.1 time: 0.771421 Oct 29 03:07:20.081868 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2550/5055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:19 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1322 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:20.093047 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Cannot 'unpause' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action HTTP/1.1 Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 15 Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: {"unpause": {}} Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: exception: Cannot 'unpause' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2bbab455-c481-40ea-a59c-4ec9c15d935e', 'body': {'unpause': {}}} Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e in vm_state active. Cannot unpause while the instance is in this state. Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:20.094985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:20.099475 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:20.099475 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:20.099475 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:20.099475 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:07:20.099475 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:20.100949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 409 to user: Cannot 'unpause' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:20.102128 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6d5c049c-accf-46ad-b21c-d69aa709716d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 409 len: 145 microversion: 2.1 time: 0.057787 Oct 29 03:07:20.106303 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2506/5056] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:20 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 145 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 03:07:20.113589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e1209c45-2870-41b4-aa98-5f7d9a1880f6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:20.114880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e1209c45-2870-41b4-aa98-5f7d9a1880f6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:20.122502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1209c45-2870-41b4-aa98-5f7d9a1880f6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.123442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1209c45-2870-41b4-aa98-5f7d9a1880f6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.124081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1209c45-2870-41b4-aa98-5f7d9a1880f6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.125016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1209c45-2870-41b4-aa98-5f7d9a1880f6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.125490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1209c45-2870-41b4-aa98-5f7d9a1880f6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.125956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1209c45-2870-41b4-aa98-5f7d9a1880f6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.256726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5d91cc55-996e-4234-a4db-61b0b443d049 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:20.257572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5d91cc55-996e-4234-a4db-61b0b443d049 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:20.265107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d91cc55-996e-4234-a4db-61b0b443d049 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.265973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d91cc55-996e-4234-a4db-61b0b443d049 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.266576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d91cc55-996e-4234-a4db-61b0b443d049 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.267430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d91cc55-996e-4234-a4db-61b0b443d049 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.268042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d91cc55-996e-4234-a4db-61b0b443d049 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.268439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d91cc55-996e-4234-a4db-61b0b443d049 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.375978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e1209c45-2870-41b4-aa98-5f7d9a1880f6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:20.395578 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e1209c45-2870-41b4-aa98-5f7d9a1880f6 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.287472 Oct 29 03:07:20.396574 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2551/5057] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:20 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:20.401547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-0eaf347e-60e0-4fcf-9894-997e6aa18445 req-efbd8bd4-a8f1-40e6-9893-ff36fc06feb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6755720e-84ca-4767-ae13-d3934b13ff6b", "name": "network-vif-plugged", "status": "completed", "tag": "6e0747ef-9623-4166-aeb4-afda676eb721"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:20.424374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0eaf347e-60e0-4fcf-9894-997e6aa18445 req-efbd8bd4-a8f1-40e6-9893-ff36fc06feb3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.424873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0eaf347e-60e0-4fcf-9894-997e6aa18445 req-efbd8bd4-a8f1-40e6-9893-ff36fc06feb3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.425318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0eaf347e-60e0-4fcf-9894-997e6aa18445 req-efbd8bd4-a8f1-40e6-9893-ff36fc06feb3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.431411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5d91cc55-996e-4234-a4db-61b0b443d049 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:20.443384 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5d91cc55-996e-4234-a4db-61b0b443d049 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.190535 Oct 29 03:07:20.444086 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2507/5058] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:20 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:20.450607 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-0eaf347e-60e0-4fcf-9894-997e6aa18445 req-efbd8bd4-a8f1-40e6-9893-ff36fc06feb3 service nova] Creating event network-vif-plugged:6e0747ef-9623-4166-aeb4-afda676eb721 for instance 6755720e-84ca-4767-ae13-d3934b13ff6b on n-h2-862964-4 Oct 29 03:07:20.461006 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-0eaf347e-60e0-4fcf-9894-997e6aa18445 req-efbd8bd4-a8f1-40e6-9893-ff36fc06feb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062123 Oct 29 03:07:20.462202 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2552/5059] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:20.467034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b5c57264-55da-4773-9201-b96a3f178a4e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:20.471526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b5c57264-55da-4773-9201-b96a3f178a4e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:20.475834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:20.478328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:20.494579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.496227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.496858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.499034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.500156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.500873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c57264-55da-4773-9201-b96a3f178a4e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.501353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.501569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c57264-55da-4773-9201-b96a3f178a4e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.502400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c57264-55da-4773-9201-b96a3f178a4e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.503423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c57264-55da-4773-9201-b96a3f178a4e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.517175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c57264-55da-4773-9201-b96a3f178a4e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.518097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5c57264-55da-4773-9201-b96a3f178a4e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.700873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:20.714957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:20.716555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:20.717885 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2b94114-5a7a-4a51-a261-735030aa3305 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.253346 Oct 29 03:07:20.718472 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2553/5060] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:20 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:20.764581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b5c57264-55da-4773-9201-b96a3f178a4e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:20.778155 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b5c57264-55da-4773-9201-b96a3f178a4e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.315229 Oct 29 03:07:20.779009 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2508/5061] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:20 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:20.804581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d738cd26-09c0-4106-8113-a7dae326125d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:20.805509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d738cd26-09c0-4106-8113-a7dae326125d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 41754fb3-d6e9-4c09-b635-daf6a783591c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:20.813300 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d738cd26-09c0-4106-8113-a7dae326125d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance 41754fb3-d6e9-4c09-b635-daf6a783591c could not be found. Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d738cd26-09c0-4106-8113-a7dae326125d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/41754fb3-d6e9-4c09-b635-daf6a783591c/action HTTP/1.1 Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 18 Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: {"unshelve": null} Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 41754fb3-d6e9-4c09-b635-daf6a783591c could not be found. Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '41754fb3-d6e9-4c09-b635-daf6a783591c', 'body': {'unshelve': None}} Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41754fb3-d6e9-4c09-b635-daf6a783591c could not be found. Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41754fb3-d6e9-4c09-b635-daf6a783591c could not be found. Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:20.815304 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:20.823161 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:20.823161 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:20.823161 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:20.823161 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:20.823161 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:20.823161 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:20.823161 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41754fb3-d6e9-4c09-b635-daf6a783591c could not be found. Oct 29 03:07:20.823161 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:20.823161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d738cd26-09c0-4106-8113-a7dae326125d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance 41754fb3-d6e9-4c09-b635-daf6a783591c could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:20.823161 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d738cd26-09c0-4106-8113-a7dae326125d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/41754fb3-d6e9-4c09-b635-daf6a783591c/action" status: 404 len: 111 microversion: 2.1 time: 0.016397 Oct 29 03:07:20.823161 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2554/5062] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:20 2022] POST /compute/v2.1/servers/41754fb3-d6e9-4c09-b635-daf6a783591c/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:20.831737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ea030c0-ca4e-4145-9f27-aa9039354dd5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:20.832680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ea030c0-ca4e-4145-9f27-aa9039354dd5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:20.840956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea030c0-ca4e-4145-9f27-aa9039354dd5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.841456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea030c0-ca4e-4145-9f27-aa9039354dd5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.842248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea030c0-ca4e-4145-9f27-aa9039354dd5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.843280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea030c0-ca4e-4145-9f27-aa9039354dd5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.843919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea030c0-ca4e-4145-9f27-aa9039354dd5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.844522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea030c0-ca4e-4145-9f27-aa9039354dd5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.054611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ea030c0-ca4e-4145-9f27-aa9039354dd5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:21.063118 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ea030c0-ca4e-4145-9f27-aa9039354dd5 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.236057 Oct 29 03:07:21.065417 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2509/5063] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:20 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:21.091274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-225a0cb2-8c05-44b9-a540-a1e68e71f465 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:21.092510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-225a0cb2-8c05-44b9-a540-a1e68e71f465 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:21.105576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-da7d7d6c-7594-4ba4-bb36-f8b02bb67fb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:21.106565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-da7d7d6c-7594-4ba4-bb36-f8b02bb67fb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:21.115357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7d7d6c-7594-4ba4-bb36-f8b02bb67fb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.115841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7d7d6c-7594-4ba4-bb36-f8b02bb67fb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.116264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7d7d6c-7594-4ba4-bb36-f8b02bb67fb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.116962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7d7d6c-7594-4ba4-bb36-f8b02bb67fb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.117711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7d7d6c-7594-4ba4-bb36-f8b02bb67fb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.118151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7d7d6c-7594-4ba4-bb36-f8b02bb67fb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.127639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-225a0cb2-8c05-44b9-a540-a1e68e71f465 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.127897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-225a0cb2-8c05-44b9-a540-a1e68e71f465 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.128392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-225a0cb2-8c05-44b9-a540-a1e68e71f465 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.129222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-225a0cb2-8c05-44b9-a540-a1e68e71f465 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.129673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-225a0cb2-8c05-44b9-a540-a1e68e71f465 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.130109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-225a0cb2-8c05-44b9-a540-a1e68e71f465 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.368507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-da7d7d6c-7594-4ba4-bb36-f8b02bb67fb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:21.382666 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-da7d7d6c-7594-4ba4-bb36-f8b02bb67fb8 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1322 microversion: 2.1 time: 0.280638 Oct 29 03:07:21.384292 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2510/5064] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:21 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:21.467852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8db3a97-df1c-4a6a-9bc9-30d1df55ecde tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:21.468776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8db3a97-df1c-4a6a-9bc9-30d1df55ecde tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:21.471618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-225a0cb2-8c05-44b9-a540-a1e68e71f465 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:21.476806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8db3a97-df1c-4a6a-9bc9-30d1df55ecde tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.478018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8db3a97-df1c-4a6a-9bc9-30d1df55ecde tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.478764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8db3a97-df1c-4a6a-9bc9-30d1df55ecde tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.480050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8db3a97-df1c-4a6a-9bc9-30d1df55ecde tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.480664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8db3a97-df1c-4a6a-9bc9-30d1df55ecde tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.481238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8db3a97-df1c-4a6a-9bc9-30d1df55ecde tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.489039 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-225a0cb2-8c05-44b9-a540-a1e68e71f465 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.401766 Oct 29 03:07:21.489635 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2555/5065] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:21 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:21.526471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:21.527189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:21.538173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.538931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.539761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.541175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.541911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.550086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.595777 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Cannot 'unshelve' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action HTTP/1.1 Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 18 Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: {"unshelve": null} Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: exception: Cannot 'unshelve' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2bbab455-c481-40ea-a59c-4ec9c15d935e', 'body': {'unshelve': None}} Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e in vm_state active. Cannot unshelve while the instance is in this state. Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:07:21.598041 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:07:21.602999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:07:21.602999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:21.602999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:21.602999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:21.602999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:21.602999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:21.602999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:21.602999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:21.602999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:21.602999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active Oct 29 03:07:21.602999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:21.605845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 409 to user: Cannot 'unshelve' instance 2bbab455-c481-40ea-a59c-4ec9c15d935e while it is in vm_state active {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:21.607119 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a99fe893-699b-4553-b35b-5bf1272a7c35 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action" status: 409 len: 146 microversion: 2.1 time: 0.092959 Oct 29 03:07:21.608386 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2556/5066] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:21 2022] POST /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e/action => generated 146 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:07:21.617053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a81ec130-48c3-4c44-b41d-555afcf3b357 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:21.618111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a81ec130-48c3-4c44-b41d-555afcf3b357 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:21.625173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a81ec130-48c3-4c44-b41d-555afcf3b357 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.626025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a81ec130-48c3-4c44-b41d-555afcf3b357 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.626627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a81ec130-48c3-4c44-b41d-555afcf3b357 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.627491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a81ec130-48c3-4c44-b41d-555afcf3b357 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.628225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a81ec130-48c3-4c44-b41d-555afcf3b357 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.628904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a81ec130-48c3-4c44-b41d-555afcf3b357 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.684612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8db3a97-df1c-4a6a-9bc9-30d1df55ecde tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:21.696289 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8db3a97-df1c-4a6a-9bc9-30d1df55ecde tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.232965 Oct 29 03:07:21.707767 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2511/5067] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:21 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:21.823002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a81ec130-48c3-4c44-b41d-555afcf3b357 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:21.836769 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a81ec130-48c3-4c44-b41d-555afcf3b357 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.224193 Oct 29 03:07:21.837684 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2557/5068] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:21 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:21.857912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:21.858493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:21.867340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.868119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.868544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.869249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.869697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.870194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.891514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-27b3d274-6b39-4125-b8bf-babe8ce7faf7 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] Action: 'create', calling method: .version_select at 0x7fe1a91cd790>, body: {"pool": null} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:21.951412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:21.962231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:21.964599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:21.966074 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6ce9bd8a-4bcc-42b8-8b0a-19fa407e700b tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.118701 Oct 29 03:07:21.966824 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2558/5069] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:21 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:21.972870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7045230f-7b75-488c-a5e2-eab8ce3c63eb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:21.973734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7045230f-7b75-488c-a5e2-eab8ce3c63eb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:21.980408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7045230f-7b75-488c-a5e2-eab8ce3c63eb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.981121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7045230f-7b75-488c-a5e2-eab8ce3c63eb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.981561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7045230f-7b75-488c-a5e2-eab8ce3c63eb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.982919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7045230f-7b75-488c-a5e2-eab8ce3c63eb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.983382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7045230f-7b75-488c-a5e2-eab8ce3c63eb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.984414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7045230f-7b75-488c-a5e2-eab8ce3c63eb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:22.165841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7045230f-7b75-488c-a5e2-eab8ce3c63eb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:22.175431 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7045230f-7b75-488c-a5e2-eab8ce3c63eb tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.207342 Oct 29 03:07:22.176388 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2559/5070] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:21 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:22.200902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0d675822-8583-49cf-9452-cdb60ef1fb88 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-580755931_updated"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:22.203457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0d675822-8583-49cf-9452-cdb60ef1fb88 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 58e91741-1fd1-416f-954b-32507cf8cfc5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:22.209187 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-0d675822-8583-49cf-9452-cdb60ef1fb88 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance 58e91741-1fd1-416f-954b-32507cf8cfc5 could not be found. Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0d675822-8583-49cf-9452-cdb60ef1fb88 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: request: PUT /compute/v2.1/servers/58e91741-1fd1-416f-954b-32507cf8cfc5 HTTP/1.1 Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 80 Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-580755931_updated"}} Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 58e91741-1fd1-416f-954b-32507cf8cfc5 could not be found. Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '58e91741-1fd1-416f-954b-32507cf8cfc5', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-580755931_updated'}}} Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e91741-1fd1-416f-954b-32507cf8cfc5 could not be found. Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 29 03:07:22.211068 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e91741-1fd1-416f-954b-32507cf8cfc5 could not be found. Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e91741-1fd1-416f-954b-32507cf8cfc5 could not be found. Oct 29 03:07:22.215044 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:22.217343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0d675822-8583-49cf-9452-cdb60ef1fb88 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance 58e91741-1fd1-416f-954b-32507cf8cfc5 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:22.218426 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0d675822-8583-49cf-9452-cdb60ef1fb88 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "PUT /compute/v2.1/servers/58e91741-1fd1-416f-954b-32507cf8cfc5" status: 404 len: 111 microversion: 2.1 time: 0.022419 Oct 29 03:07:22.219534 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2560/5071] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 03:07:22 2022] PUT /compute/v2.1/servers/58e91741-1fd1-416f-954b-32507cf8cfc5 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:07:22.235842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-534c48ec-9d04-4cbe-b032-a7400c00fabc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:22.236607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-534c48ec-9d04-4cbe-b032-a7400c00fabc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:22.244523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-534c48ec-9d04-4cbe-b032-a7400c00fabc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:22.245445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-534c48ec-9d04-4cbe-b032-a7400c00fabc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:22.246005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-534c48ec-9d04-4cbe-b032-a7400c00fabc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:22.247127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-534c48ec-9d04-4cbe-b032-a7400c00fabc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:22.247585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-534c48ec-9d04-4cbe-b032-a7400c00fabc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:22.248012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-534c48ec-9d04-4cbe-b032-a7400c00fabc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:22.395980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-534c48ec-9d04-4cbe-b032-a7400c00fabc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:22.408667 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-534c48ec-9d04-4cbe-b032-a7400c00fabc tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.184491 Oct 29 03:07:22.409832 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2561/5072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:22 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:22.414611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-22628767-fe32-4576-9051-c86c6338bc72 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:22.415444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-22628767-fe32-4576-9051-c86c6338bc72 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:22.421910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22628767-fe32-4576-9051-c86c6338bc72 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:22.422586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22628767-fe32-4576-9051-c86c6338bc72 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:22.424119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22628767-fe32-4576-9051-c86c6338bc72 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:22.425172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22628767-fe32-4576-9051-c86c6338bc72 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:22.426054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22628767-fe32-4576-9051-c86c6338bc72 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:22.427151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-22628767-fe32-4576-9051-c86c6338bc72 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:22.616739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-22628767-fe32-4576-9051-c86c6338bc72 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:22.640402 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-22628767-fe32-4576-9051-c86c6338bc72 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1516 microversion: 2.1 time: 0.229142 Oct 29 03:07:22.641138 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2562/5073] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:22 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:22.649387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-949cd72b-193e-47d4-b1df-4e275063efb1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:22.650573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-949cd72b-193e-47d4-b1df-4e275063efb1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:22.660673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949cd72b-193e-47d4-b1df-4e275063efb1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:22.662034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949cd72b-193e-47d4-b1df-4e275063efb1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:22.662536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949cd72b-193e-47d4-b1df-4e275063efb1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:22.663434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949cd72b-193e-47d4-b1df-4e275063efb1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:22.663980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949cd72b-193e-47d4-b1df-4e275063efb1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:22.664911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949cd72b-193e-47d4-b1df-4e275063efb1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:22.668471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:22.832894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-949cd72b-193e-47d4-b1df-4e275063efb1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:22.841660 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-949cd72b-193e-47d4-b1df-4e275063efb1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.199090 Oct 29 03:07:22.858596 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2563/5074] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:22 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:22.867714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c071fd1-8d30-4d2f-9217-c5f2de04a528 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:22.871661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9c071fd1-8d30-4d2f-9217-c5f2de04a528 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:22.878913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c071fd1-8d30-4d2f-9217-c5f2de04a528 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:22.879496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c071fd1-8d30-4d2f-9217-c5f2de04a528 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:22.879993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c071fd1-8d30-4d2f-9217-c5f2de04a528 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:22.880791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c071fd1-8d30-4d2f-9217-c5f2de04a528 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:22.881308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c071fd1-8d30-4d2f-9217-c5f2de04a528 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:22.881796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c071fd1-8d30-4d2f-9217-c5f2de04a528 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:22.910418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-9c071fd1-8d30-4d2f-9217-c5f2de04a528 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lazy-loading 'flavor' on Instance uuid 6755720e-84ca-4767-ae13-d3934b13ff6b {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:07:23.025470 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c071fd1-8d30-4d2f-9217-c5f2de04a528 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "POST /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b/action" status: 200 len: 32 microversion: 2.1 time: 0.165028 Oct 29 03:07:23.031914 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2564/5075] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:22 2022] POST /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:07:23.040036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce73aadc-c1c7-45b7-9629-2c75ca0fc78d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:23.041032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ce73aadc-c1c7-45b7-9629-2c75ca0fc78d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:23.052473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce73aadc-c1c7-45b7-9629-2c75ca0fc78d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.053216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce73aadc-c1c7-45b7-9629-2c75ca0fc78d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.054945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce73aadc-c1c7-45b7-9629-2c75ca0fc78d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.056117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce73aadc-c1c7-45b7-9629-2c75ca0fc78d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.056790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce73aadc-c1c7-45b7-9629-2c75ca0fc78d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.057379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce73aadc-c1c7-45b7-9629-2c75ca0fc78d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.358209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ce73aadc-c1c7-45b7-9629-2c75ca0fc78d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:23.368702 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ce73aadc-c1c7-45b7-9629-2c75ca0fc78d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.335103 Oct 29 03:07:23.369946 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2565/5076] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:23 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:23.376109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51cf2efa-2d47-4fde-97b8-a97e89ba3587 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51cf2efa-2d47-4fde-97b8-a97e89ba3587 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: request: PUT /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e HTTP/1.1 Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 280 Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2bbab455-c481-40ea-a59c-4ec9c15d935e', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:23.381660 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:07:23.385743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:23.392901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51cf2efa-2d47-4fde-97b8-a97e89ba3587 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:23.393696 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-51cf2efa-2d47-4fde-97b8-a97e89ba3587 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "PUT /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 400 len: 619 microversion: 2.1 time: 0.022606 Oct 29 03:07:23.397747 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2566/5077] 10.222.0.16 () {60 vars in 1257 bytes} [Sat Oct 29 03:07:23 2022] PUT /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:23.403343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:23.404155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:23.411970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.412766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.413363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.414637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.415248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.415812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.606548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:23.618114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:23.620779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:23.623291 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ef580447-a60f-48b6-b728-fde383995e2d tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.224314 Oct 29 03:07:23.624704 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2567/5078] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:23 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:23.630009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-27c401b3-5967-43b1-b591-064d579ec97d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:23.630832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-27c401b3-5967-43b1-b591-064d579ec97d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:23.639326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c401b3-5967-43b1-b591-064d579ec97d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.640114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c401b3-5967-43b1-b591-064d579ec97d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.640741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c401b3-5967-43b1-b591-064d579ec97d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.652486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c401b3-5967-43b1-b591-064d579ec97d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.653864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c401b3-5967-43b1-b591-064d579ec97d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.654492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27c401b3-5967-43b1-b591-064d579ec97d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.821489 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-27b3d274-6b39-4125-b8bf-babe8ce7faf7 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.112296 Oct 29 03:07:23.823075 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2512/5079] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Oct 29 03:07:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:23.828216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-efc54621-48d6-4002-951f-6b5c2a6d330b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:23.830034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-efc54621-48d6-4002-951f-6b5c2a6d330b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:23.839804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efc54621-48d6-4002-951f-6b5c2a6d330b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.840684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efc54621-48d6-4002-951f-6b5c2a6d330b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.841362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efc54621-48d6-4002-951f-6b5c2a6d330b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.842315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efc54621-48d6-4002-951f-6b5c2a6d330b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.843994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efc54621-48d6-4002-951f-6b5c2a6d330b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.845559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efc54621-48d6-4002-951f-6b5c2a6d330b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.969827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-27c401b3-5967-43b1-b591-064d579ec97d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:23.983945 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-27c401b3-5967-43b1-b591-064d579ec97d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.353120 Oct 29 03:07:23.984624 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2568/5080] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:23 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:24.007257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-274cedd2-bad0-4aa7-98e3-b63b6b03ade6 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] Action: 'create', calling method: .version_select at 0x7fe1a3366e50>, body: {"pool": null} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:24.030096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-efc54621-48d6-4002-951f-6b5c2a6d330b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:24.038809 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-efc54621-48d6-4002-951f-6b5c2a6d330b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.214165 Oct 29 03:07:24.040010 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2513/5081] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:23 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:24.062844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c92b119c-cf11-4660-87ff-fa10ec01737f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:24.063709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c92b119c-cf11-4660-87ff-fa10ec01737f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:24.070343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c92b119c-cf11-4660-87ff-fa10ec01737f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:24.071042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c92b119c-cf11-4660-87ff-fa10ec01737f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:24.071667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c92b119c-cf11-4660-87ff-fa10ec01737f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:24.072550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c92b119c-cf11-4660-87ff-fa10ec01737f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:24.073162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c92b119c-cf11-4660-87ff-fa10ec01737f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:24.074046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c92b119c-cf11-4660-87ff-fa10ec01737f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:24.254567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c92b119c-cf11-4660-87ff-fa10ec01737f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:24.265342 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c92b119c-cf11-4660-87ff-fa10ec01737f tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.206196 Oct 29 03:07:24.278154 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2514/5082] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:24 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:24.291214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38ffd27a-fdc9-41a3-9e99-2a0fe62e510b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38ffd27a-fdc9-41a3-9e99-2a0fe62e510b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e HTTP/1.1 Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 24 Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: {"server": {"name": ""}} Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2bbab455-c481-40ea-a59c-4ec9c15d935e', 'body': {'server': {'name': ''}}} Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi '' Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:07:24.296592 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:24.301200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38ffd27a-fdc9-41a3-9e99-2a0fe62e510b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:24.304270 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-38ffd27a-fdc9-41a3-9e99-2a0fe62e510b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "PUT /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 400 len: 108 microversion: 2.1 time: 0.011836 Oct 29 03:07:24.312255 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2515/5083] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 03:07:24 2022] PUT /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:07:24.321617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c6f3d210-bb7c-456f-a391-e640b8875d78 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:24.322496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c6f3d210-bb7c-456f-a391-e640b8875d78 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:24.331224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6f3d210-bb7c-456f-a391-e640b8875d78 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:24.332026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6f3d210-bb7c-456f-a391-e640b8875d78 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:24.332652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6f3d210-bb7c-456f-a391-e640b8875d78 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:24.333522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6f3d210-bb7c-456f-a391-e640b8875d78 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:24.334155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6f3d210-bb7c-456f-a391-e640b8875d78 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:24.335237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6f3d210-bb7c-456f-a391-e640b8875d78 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:24.507188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c6f3d210-bb7c-456f-a391-e640b8875d78 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:24.519007 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c6f3d210-bb7c-456f-a391-e640b8875d78 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1506 microversion: 2.1 time: 0.201215 Oct 29 03:07:24.519909 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2516/5084] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:24 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:24.525872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5386e00-0906-4909-b87e-a17919c3b2a8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:24.527022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d5386e00-0906-4909-b87e-a17919c3b2a8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:24.544686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5386e00-0906-4909-b87e-a17919c3b2a8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:24.545535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5386e00-0906-4909-b87e-a17919c3b2a8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:24.550855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5386e00-0906-4909-b87e-a17919c3b2a8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:24.551910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5386e00-0906-4909-b87e-a17919c3b2a8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:24.554022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5386e00-0906-4909-b87e-a17919c3b2a8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:24.556594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5386e00-0906-4909-b87e-a17919c3b2a8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:24.779778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5386e00-0906-4909-b87e-a17919c3b2a8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:24.790364 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5386e00-0906-4909-b87e-a17919c3b2a8 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.268997 Oct 29 03:07:24.791180 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2517/5085] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:24 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:24.798505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:24.799312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:24.805702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:24.806402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:24.807111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:24.808184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:24.808840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:24.809861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:24.925499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:24.943059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:24.944526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:24.945765 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-087ca167-0ba1-4c25-8949-7fb8da9e8ed4 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.153491 Oct 29 03:07:24.946378 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2518/5086] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:24 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:25.011654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-93099bad-128f-4b3c-b333-18d834dcaed0 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:25.012280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-93099bad-128f-4b3c-b333-18d834dcaed0 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:25.021546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93099bad-128f-4b3c-b333-18d834dcaed0 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.021546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93099bad-128f-4b3c-b333-18d834dcaed0 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.022048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93099bad-128f-4b3c-b333-18d834dcaed0 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.022764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93099bad-128f-4b3c-b333-18d834dcaed0 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.023328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93099bad-128f-4b3c-b333-18d834dcaed0 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.029006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93099bad-128f-4b3c-b333-18d834dcaed0 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.379646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-93099bad-128f-4b3c-b333-18d834dcaed0 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:25.390349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-93099bad-128f-4b3c-b333-18d834dcaed0 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.382839 Oct 29 03:07:25.393753 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2519/5087] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:25 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:25.470903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-805cf8f2-34d3-42a0-b4f8-1a7002df902b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:25.473561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-805cf8f2-34d3-42a0-b4f8-1a7002df902b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:25.485925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-805cf8f2-34d3-42a0-b4f8-1a7002df902b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.488209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-805cf8f2-34d3-42a0-b4f8-1a7002df902b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.488749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-805cf8f2-34d3-42a0-b4f8-1a7002df902b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.491819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-805cf8f2-34d3-42a0-b4f8-1a7002df902b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.492715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-805cf8f2-34d3-42a0-b4f8-1a7002df902b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.493265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-805cf8f2-34d3-42a0-b4f8-1a7002df902b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.550518 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-805cf8f2-34d3-42a0-b4f8-1a7002df902b tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.084740 Oct 29 03:07:25.556919 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2520/5088] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Oct 29 03:07:25 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:25.699927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7c9e4f7-d687-41ea-b753-cd7c52dccbcc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:25.700974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7c9e4f7-d687-41ea-b753-cd7c52dccbcc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:25.708559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7c9e4f7-d687-41ea-b753-cd7c52dccbcc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.709398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7c9e4f7-d687-41ea-b753-cd7c52dccbcc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.710047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7c9e4f7-d687-41ea-b753-cd7c52dccbcc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.711006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7c9e4f7-d687-41ea-b753-cd7c52dccbcc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.711644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7c9e4f7-d687-41ea-b753-cd7c52dccbcc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.712228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7c9e4f7-d687-41ea-b753-cd7c52dccbcc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.746880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7c9e4f7-d687-41ea-b753-cd7c52dccbcc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:07:25.890722 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7c9e4f7-d687-41ea-b753-cd7c52dccbcc tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 204 len: 0 microversion: 2.20 time: 0.210768 Oct 29 03:07:25.895532 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2521/5089] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:07:25 2022] DELETE /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:07:25.901534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-faddb79f-f22c-4759-a470-aae435cd2200 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:25.902406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-faddb79f-f22c-4759-a470-aae435cd2200 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:25.909222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faddb79f-f22c-4759-a470-aae435cd2200 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.909716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faddb79f-f22c-4759-a470-aae435cd2200 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.910237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faddb79f-f22c-4759-a470-aae435cd2200 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.910950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faddb79f-f22c-4759-a470-aae435cd2200 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.911461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faddb79f-f22c-4759-a470-aae435cd2200 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.911888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-faddb79f-f22c-4759-a470-aae435cd2200 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.916628 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-274cedd2-bad0-4aa7-98e3-b63b6b03ade6 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.915703 Oct 29 03:07:25.917452 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2569/5090] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Oct 29 03:07:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:25.933436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:25.934340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:25.951544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.952320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.953365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.956648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.957388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.958007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:26.141439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-faddb79f-f22c-4759-a470-aae435cd2200 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:26.151935 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-faddb79f-f22c-4759-a470-aae435cd2200 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.254838 Oct 29 03:07:26.153379 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2522/5091] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:25 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:26.159219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e413a433-4caf-4d11-a14c-026e7e75d902 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] Action: 'create', calling method: .version_select at 0x7fe1a85b3550>, body: {"pool": null} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:26.165188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:26.183569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:26.189758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:26.192688 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79f823d9-f30f-411b-a4be-ed421cc4d77a tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.266241 Oct 29 03:07:26.193633 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2570/5092] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:25 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:26.199824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:26.200759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:26.220139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:26.220738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:26.221754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:26.222715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:26.224847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:26.225401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:26.358558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:26.370780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:26.372731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:26.374469 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-683e1071-0382-4d39-84c2-bc5ca08c99bd tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1985 microversion: 2.42 time: 0.179163 Oct 29 03:07:26.377880 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2571/5093] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:26 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1985 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:26.417241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c826943-4592-4690-9ac3-31bd70cdf295 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:26.418399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9c826943-4592-4690-9ac3-31bd70cdf295 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:26.425641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c826943-4592-4690-9ac3-31bd70cdf295 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:26.426315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c826943-4592-4690-9ac3-31bd70cdf295 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:26.427882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c826943-4592-4690-9ac3-31bd70cdf295 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:26.427882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c826943-4592-4690-9ac3-31bd70cdf295 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:26.428399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c826943-4592-4690-9ac3-31bd70cdf295 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:26.429113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c826943-4592-4690-9ac3-31bd70cdf295 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:26.616677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9c826943-4592-4690-9ac3-31bd70cdf295 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:26.628107 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c826943-4592-4690-9ac3-31bd70cdf295 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.214937 Oct 29 03:07:26.630407 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2572/5094] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:26 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:27.177907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ac4a89b-d55a-4795-a0c9-0361a9b2a4ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:27.179588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1ac4a89b-d55a-4795-a0c9-0361a9b2a4ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:27.184087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:27.189543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ac4a89b-d55a-4795-a0c9-0361a9b2a4ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.194626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ac4a89b-d55a-4795-a0c9-0361a9b2a4ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.195377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ac4a89b-d55a-4795-a0c9-0361a9b2a4ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.196288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ac4a89b-d55a-4795-a0c9-0361a9b2a4ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.197193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ac4a89b-d55a-4795-a0c9-0361a9b2a4ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.197622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ac4a89b-d55a-4795-a0c9-0361a9b2a4ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.448056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ac4a89b-d55a-4795-a0c9-0361a9b2a4ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:27.456960 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ac4a89b-d55a-4795-a0c9-0361a9b2a4ae tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.283960 Oct 29 03:07:27.457636 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2573/5095] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:27 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:27.462878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:27.463585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:27.469771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.470614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.471164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.472084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.472720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.473370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.632877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:27.641997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:27.643970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:27.645405 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-738111e8-f270-44bc-b363-537cd63d172d tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.186564 Oct 29 03:07:27.646061 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2574/5096] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:27 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:27.650882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2c92e19-b9a6-49f1-bffb-29545056fb2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:27.653711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b2c92e19-b9a6-49f1-bffb-29545056fb2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:27.662328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2c92e19-b9a6-49f1-bffb-29545056fb2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.663307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2c92e19-b9a6-49f1-bffb-29545056fb2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.664374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2c92e19-b9a6-49f1-bffb-29545056fb2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.665319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2c92e19-b9a6-49f1-bffb-29545056fb2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.666605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2c92e19-b9a6-49f1-bffb-29545056fb2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.667194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2c92e19-b9a6-49f1-bffb-29545056fb2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.691395 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e413a433-4caf-4d11-a14c-026e7e75d902 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.536730 Oct 29 03:07:27.692513 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2523/5097] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Oct 29 03:07:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:27.697502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:27.698535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:27.702717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:27.708631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.720876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.721965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.723161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.724653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.725415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.734259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:27.766887 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b2c92e19-b9a6-49f1-bffb-29545056fb2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.119370 Oct 29 03:07:27.770372 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2575/5098] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:27 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:27.772828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.774363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.775055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.775758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lazy-loading 'fault' on Instance uuid 480789f1-7931-471a-b306-64889fa76dd1 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:07:27.778262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ecb5d11-b14a-4968-adba-a6aa6056fc11 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:27.780747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ecb5d11-b14a-4968-adba-a6aa6056fc11 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:27.798256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb5d11-b14a-4968-adba-a6aa6056fc11 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.798762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb5d11-b14a-4968-adba-a6aa6056fc11 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.799201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb5d11-b14a-4968-adba-a6aa6056fc11 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.800051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb5d11-b14a-4968-adba-a6aa6056fc11 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.800505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb5d11-b14a-4968-adba-a6aa6056fc11 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.800923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ecb5d11-b14a-4968-adba-a6aa6056fc11 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.851203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:27.861613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:27.863361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb215bc0435419eb2659aceb19ea58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7809d4281c4efa9330464b86c1ee27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:27.864819 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-249c1651-5f06-437e-9fc0-178b0687b5bb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 200 len: 1990 microversion: 2.42 time: 0.171140 Oct 29 03:07:27.865716 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2524/5099] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:27 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 1990 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:27.870889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f270ac12-6415-48e9-9b29-5b34878aa038 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] Action: 'create', calling method: .version_select at 0x7fe1a85c3ca0>, body: {"pool": null} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:28.167264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ecb5d11-b14a-4968-adba-a6aa6056fc11 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:28.176412 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ecb5d11-b14a-4968-adba-a6aa6056fc11 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.403723 Oct 29 03:07:28.177684 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2576/5100] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:27 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:28.182866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d8ef1d0-ec1a-43cf-b445-f510a2d88d08 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:28.183620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d8ef1d0-ec1a-43cf-b445-f510a2d88d08 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:28.190768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d8ef1d0-ec1a-43cf-b445-f510a2d88d08 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:28.191255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d8ef1d0-ec1a-43cf-b445-f510a2d88d08 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:28.191849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d8ef1d0-ec1a-43cf-b445-f510a2d88d08 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:28.192551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d8ef1d0-ec1a-43cf-b445-f510a2d88d08 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:28.193022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d8ef1d0-ec1a-43cf-b445-f510a2d88d08 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:28.193416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d8ef1d0-ec1a-43cf-b445-f510a2d88d08 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:28.571418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d8ef1d0-ec1a-43cf-b445-f510a2d88d08 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:28.585450 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d8ef1d0-ec1a-43cf-b445-f510a2d88d08 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1672 microversion: 2.1 time: 0.406358 Oct 29 03:07:28.588974 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2577/5101] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:28 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1672 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:28.600106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2668e65d-757c-430c-95f0-5db1f0d535c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:28.602166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2668e65d-757c-430c-95f0-5db1f0d535c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:28.614723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2668e65d-757c-430c-95f0-5db1f0d535c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:28.615213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2668e65d-757c-430c-95f0-5db1f0d535c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:28.615643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2668e65d-757c-430c-95f0-5db1f0d535c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:28.616394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2668e65d-757c-430c-95f0-5db1f0d535c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:28.616807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2668e65d-757c-430c-95f0-5db1f0d535c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:28.617225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2668e65d-757c-430c-95f0-5db1f0d535c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.042118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2668e65d-757c-430c-95f0-5db1f0d535c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:29.045569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:29.063712 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2668e65d-757c-430c-95f0-5db1f0d535c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.473394 Oct 29 03:07:29.064339 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2578/5102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:28 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:29.069926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:29.082850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:29.090121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.090731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.091229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.092062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.092628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.093120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.733223 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f270ac12-6415-48e9-9b29-5b34878aa038 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.866320 Oct 29 03:07:29.734458 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2525/5103] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Oct 29 03:07:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:29.740028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:29.740638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:29.748973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.749463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.749920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.750625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.751072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.751487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.774900 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] HTTP exception thrown: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Request method failure captured: Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 HTTP/1.1 Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJcj2Z1_C1r9Z3__JOloMFHMZm0PmgZ0uXz1U-XoRahkGENL6LMKSlWzTDC4bgLvWbDwCZgvalwg3H7xTmK82_i3KVZCrZHJLrO7UHrJV_nJg2Yw27MF_vqlzZ5mhS4YyStUm0gDariIm4XiOxo6jBoEJ818qMIFKWNiX-DaOPnMRIQ Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: bf7809d4281c4efa9330464b86c1ee27 Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-883463450 Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bf7809d4281c4efa9330464b86c1ee27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf7809d4281c4efa9330464b86c1ee27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bf7809d4281c4efa9330464b86c1ee27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf7809d4281c4efa9330464b86c1ee27"}]}] Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TaggedBootDevicesTest_v242-883463450 Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: bf7809d4281c4efa9330464b86c1ee27 Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-883463450 Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TaggedBootDevicesTest_v242-883463450-project Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 0bb215bc0435419eb2659aceb19ea58a Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TaggedBootDevicesTest_v242-883463450-project Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '480789f1-7931-471a-b306-64889fa76dd1'} Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:29.777752 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:29.784713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:29.784713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:29.784713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:29.784713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:29.784713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:29.784713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:29.784713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:29.784713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:29.788342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Returning 404 to user: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:29.789983 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1477b85d-87be-43b3-b909-4e01eada0755 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 404 len: 111 microversion: 2.42 time: 0.054259 Oct 29 03:07:29.791160 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2526/5104] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:29 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:29.798657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0d91dc4b-7ae8-4754-a2a5-514c49d48a8b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:29.799867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0d91dc4b-7ae8-4754-a2a5-514c49d48a8b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:29.808068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d91dc4b-7ae8-4754-a2a5-514c49d48a8b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.809219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d91dc4b-7ae8-4754-a2a5-514c49d48a8b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.809994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d91dc4b-7ae8-4754-a2a5-514c49d48a8b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.810984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d91dc4b-7ae8-4754-a2a5-514c49d48a8b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.811760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d91dc4b-7ae8-4754-a2a5-514c49d48a8b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.812521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d91dc4b-7ae8-4754-a2a5-514c49d48a8b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.966117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:29.997715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:29.999100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:30.000288 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d1a85e69-2d83-45d6-acda-3258d7c4831e tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1724 microversion: 2.20 time: 0.934837 Oct 29 03:07:30.015891 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2579/5105] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:29 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1724 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:30.016619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9f70e1b9-d9a6-48bf-ab91-43588bf3f1c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:30.027685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9f70e1b9-d9a6-48bf-ab91-43588bf3f1c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:30.036232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f70e1b9-d9a6-48bf-ab91-43588bf3f1c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:30.036724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f70e1b9-d9a6-48bf-ab91-43588bf3f1c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:30.037148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f70e1b9-d9a6-48bf-ab91-43588bf3f1c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:30.037861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f70e1b9-d9a6-48bf-ab91-43588bf3f1c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:30.038309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f70e1b9-d9a6-48bf-ab91-43588bf3f1c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:30.041642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f70e1b9-d9a6-48bf-ab91-43588bf3f1c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:30.081926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0d91dc4b-7ae8-4754-a2a5-514c49d48a8b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:30.093861 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0d91dc4b-7ae8-4754-a2a5-514c49d48a8b tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.301231 Oct 29 03:07:30.094487 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2527/5106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:29 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:30.104679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-add7d423-fade-404b-b7bd-177b7b1b280a tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] Calling method '.version_select at 0x7fe1a85b6d30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:30.342577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9f70e1b9-d9a6-48bf-ab91-43588bf3f1c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:30.355540 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9f70e1b9-d9a6-48bf-ab91-43588bf3f1c6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1672 microversion: 2.1 time: 0.353316 Oct 29 03:07:30.356869 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2580/5107] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:30 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1672 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:30.366983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e2e65666-e26c-4a65-97e2-f494e44d8e9e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '.version_select at 0x7fe1a853eb80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:30.400887 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e2e65666-e26c-4a65-97e2-f494e44d8e9e tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130320404" status: 204 len: 0 microversion: 2.42 time: 0.039845 Oct 29 03:07:30.401684 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2581/5108] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Oct 29 03:07:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130320404 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:07:30.412184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d6fd90ad-b05d-4d39-985b-655d910f742c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:30.413500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d6fd90ad-b05d-4d39-985b-655d910f742c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:30.423441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6fd90ad-b05d-4d39-985b-655d910f742c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:30.424368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6fd90ad-b05d-4d39-985b-655d910f742c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:30.424503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6fd90ad-b05d-4d39-985b-655d910f742c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:30.425169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6fd90ad-b05d-4d39-985b-655d910f742c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:30.425850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6fd90ad-b05d-4d39-985b-655d910f742c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:30.427496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6fd90ad-b05d-4d39-985b-655d910f742c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:30.574689 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-add7d423-fade-404b-b7bd-177b7b1b280a tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/b56f5885-7bcd-4983-bdb4-4f0a2496b8b6" status: 200 len: 142 microversion: 2.1 time: 0.479042 Oct 29 03:07:30.576534 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2528/5109] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:07:30 2022] GET /compute/v2.1/os-floating-ips/b56f5885-7bcd-4983-bdb4-4f0a2496b8b6 => generated 142 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:30.588417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8f5772c-d095-42de-affc-aaea3e713f7d tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] Calling method '.version_select at 0x7fe1acd4a3a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:30.904067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d6fd90ad-b05d-4d39-985b-655d910f742c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:30.914622 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d6fd90ad-b05d-4d39-985b-655d910f742c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.506834 Oct 29 03:07:30.915718 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2582/5110] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:30 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:30.921454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e9f02ab1-3d9d-43c6-b021-0731089fb56d req-678ea8e0-65e4-4949-bf99-8b2f03736de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f439b2b6-1302-414a-93d3-f162321fd6c6", "name": "network-vif-deleted", "tag": "291472dd-c560-4f62-ae19-0af367acb98e"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:30.933286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e9f02ab1-3d9d-43c6-b021-0731089fb56d req-678ea8e0-65e4-4949-bf99-8b2f03736de3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:30.933832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e9f02ab1-3d9d-43c6-b021-0731089fb56d req-678ea8e0-65e4-4949-bf99-8b2f03736de3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:30.934348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e9f02ab1-3d9d-43c6-b021-0731089fb56d req-678ea8e0-65e4-4949-bf99-8b2f03736de3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:30.948937 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e9f02ab1-3d9d-43c6-b021-0731089fb56d req-678ea8e0-65e4-4949-bf99-8b2f03736de3 service nova] Creating event network-vif-deleted:291472dd-c560-4f62-ae19-0af367acb98e for instance f439b2b6-1302-414a-93d3-f162321fd6c6 on n-h2-862964-4 Oct 29 03:07:30.956627 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e9f02ab1-3d9d-43c6-b021-0731089fb56d req-678ea8e0-65e4-4949-bf99-8b2f03736de3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038693 Oct 29 03:07:30.963604 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2583/5111] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:31.030644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:31.031337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:31.040292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.043619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.044294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.045923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.048121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.048742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.094476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.095203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.095854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.096504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lazy-loading 'fault' on Instance uuid f439b2b6-1302-414a-93d3-f162321fd6c6 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:07:31.174287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:31.198241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:31.204725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '801730a89d33490d8d6f425f20ce5b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef09834b750437e9fa350df7b4bb0f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:31.209296 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dc9b2351-88f3-4a52-a3b6-fb77b2ddd1ce tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 200 len: 1372 microversion: 2.20 time: 0.182945 Oct 29 03:07:31.212163 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2584/5112] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:31 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:07:31.235342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7cfd299c-3f81-4565-8cd8-b16f9a38cf2d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:31.237131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7cfd299c-3f81-4565-8cd8-b16f9a38cf2d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:31.248623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cfd299c-3f81-4565-8cd8-b16f9a38cf2d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.249436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cfd299c-3f81-4565-8cd8-b16f9a38cf2d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.250250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cfd299c-3f81-4565-8cd8-b16f9a38cf2d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.251312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cfd299c-3f81-4565-8cd8-b16f9a38cf2d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.251949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cfd299c-3f81-4565-8cd8-b16f9a38cf2d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.252550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cfd299c-3f81-4565-8cd8-b16f9a38cf2d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.426336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7cfd299c-3f81-4565-8cd8-b16f9a38cf2d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:31.438138 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7cfd299c-3f81-4565-8cd8-b16f9a38cf2d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.206774 Oct 29 03:07:31.439079 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2585/5113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:31 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:31.447539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-95549e08-2e88-44c2-a10c-abc6a7c789ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:31.451476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-95549e08-2e88-44c2-a10c-abc6a7c789ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:31.463340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95549e08-2e88-44c2-a10c-abc6a7c789ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.464221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95549e08-2e88-44c2-a10c-abc6a7c789ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.465001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95549e08-2e88-44c2-a10c-abc6a7c789ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.465978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95549e08-2e88-44c2-a10c-abc6a7c789ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.466687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95549e08-2e88-44c2-a10c-abc6a7c789ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.467499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95549e08-2e88-44c2-a10c-abc6a7c789ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.636760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-95549e08-2e88-44c2-a10c-abc6a7c789ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:31.657777 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-95549e08-2e88-44c2-a10c-abc6a7c789ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.217136 Oct 29 03:07:31.658426 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2586/5114] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:31 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:31.668004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:31.670084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:31.681564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.681910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.684090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.685210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.685715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.686143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.709560 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d HTTP/1.1 Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'db54eba0-267c-4806-b337-72d0ccf62f9d'} Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:31.723023 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-70841a10-f9f1-404e-a7cc-0f432de2f7ae tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 404 len: 111 microversion: 2.1 time: 0.064669 Oct 29 03:07:31.728400 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2587/5115] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:07:31 2022] DELETE /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:31.734934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:31.735859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: db54eba0-267c-4806-b337-72d0ccf62f9d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:31.747116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.747609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.748504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.748758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.749204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.749616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.765694 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d HTTP/1.1 Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'db54eba0-267c-4806-b337-72d0ccf62f9d'} Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:31.767543 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:31.772153 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:31.772153 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:31.772153 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:31.772153 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:31.772153 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:31.772153 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. Oct 29 03:07:31.772153 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:31.773429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance db54eba0-267c-4806-b337-72d0ccf62f9d could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:31.774480 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b41b5d2e-387c-49f1-bb37-75e65258055e tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d" status: 404 len: 111 microversion: 2.1 time: 0.045295 Oct 29 03:07:31.780541 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2588/5116] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:31 2022] GET /compute/v2.1/servers/db54eba0-267c-4806-b337-72d0ccf62f9d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:31.788585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2e1899af-4f6f-4b59-a252-6dda8011456b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:31.789361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2e1899af-4f6f-4b59-a252-6dda8011456b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:31.797985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1899af-4f6f-4b59-a252-6dda8011456b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.798692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1899af-4f6f-4b59-a252-6dda8011456b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.799124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1899af-4f6f-4b59-a252-6dda8011456b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.799826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1899af-4f6f-4b59-a252-6dda8011456b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.800429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1899af-4f6f-4b59-a252-6dda8011456b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.800852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e1899af-4f6f-4b59-a252-6dda8011456b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.854392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2e1899af-4f6f-4b59-a252-6dda8011456b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:07:31.982086 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2e1899af-4f6f-4b59-a252-6dda8011456b tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 204 len: 0 microversion: 2.1 time: 0.195701 Oct 29 03:07:31.987474 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2589/5117] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:07:31 2022] DELETE /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:07:31.998755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-859db8e7-39b0-49d5-9b13-f722fb6f796a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:32.000737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-859db8e7-39b0-49d5-9b13-f722fb6f796a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:32.009410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859db8e7-39b0-49d5-9b13-f722fb6f796a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.010093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859db8e7-39b0-49d5-9b13-f722fb6f796a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.010714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859db8e7-39b0-49d5-9b13-f722fb6f796a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.014079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859db8e7-39b0-49d5-9b13-f722fb6f796a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.014897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859db8e7-39b0-49d5-9b13-f722fb6f796a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.015417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-859db8e7-39b0-49d5-9b13-f722fb6f796a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.167111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-859db8e7-39b0-49d5-9b13-f722fb6f796a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:32.178776 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-859db8e7-39b0-49d5-9b13-f722fb6f796a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.189362 Oct 29 03:07:32.196713 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2590/5118] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:31 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:32.212544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-33bcee11-425b-4586-b14e-59684fc7f35a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:32.214597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-33bcee11-425b-4586-b14e-59684fc7f35a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:32.234113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33bcee11-425b-4586-b14e-59684fc7f35a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.235016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33bcee11-425b-4586-b14e-59684fc7f35a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.235677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33bcee11-425b-4586-b14e-59684fc7f35a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.236607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33bcee11-425b-4586-b14e-59684fc7f35a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.237284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33bcee11-425b-4586-b14e-59684fc7f35a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.237983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33bcee11-425b-4586-b14e-59684fc7f35a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.439678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-33bcee11-425b-4586-b14e-59684fc7f35a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:32.448558 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-33bcee11-425b-4586-b14e-59684fc7f35a tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.245913 Oct 29 03:07:32.472940 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2591/5119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:32 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:32.479842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:32.481268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:32.490266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.490766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.491200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.491911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.492822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.493893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.510870 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] HTTP exception thrown: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Request method failure captured: Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 HTTP/1.1 Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJcFBAFNOzU5bzfWkuUBjVkhOJXnzhig8t8LcAOK7ycm1RbRBHoLtshT33gQycjj5u9FKeLnTdU7rAhWEPnXnC--n33vtx4jMryneJ9QCYGXQFPhM_50vTdZF825N-Oiy5P2q8Uohu2OHC53MugGSsrWovjBGj5aAvOErRVeHhsZFP4 Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ef09834b750437e9fa350df7b4bb0f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}] Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 801730a89d33490d8d6f425f20ce5b1d Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'f439b2b6-1302-414a-93d3-f162321fd6c6'} Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:32.512568 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:32.517829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:32.517829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:32.517829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:32.517829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:32.517829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:32.517829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:32.517829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:32.517829 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:32.517829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Returning 404 to user: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:32.517829 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1888218a-3b5d-4bf1-989a-2404a2c006c7 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 404 len: 111 microversion: 2.20 time: 0.040134 Oct 29 03:07:32.518671 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2592/5120] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:32 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:32.523160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2529ddd4-1078-4bb9-ac81-8e7f8f7a5724 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:32.523659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2529ddd4-1078-4bb9-ac81-8e7f8f7a5724 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:32.532052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529ddd4-1078-4bb9-ac81-8e7f8f7a5724 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.532539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529ddd4-1078-4bb9-ac81-8e7f8f7a5724 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.533529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529ddd4-1078-4bb9-ac81-8e7f8f7a5724 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.534291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529ddd4-1078-4bb9-ac81-8e7f8f7a5724 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.534721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529ddd4-1078-4bb9-ac81-8e7f8f7a5724 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.535142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529ddd4-1078-4bb9-ac81-8e7f8f7a5724 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.568008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2529ddd4-1078-4bb9-ac81-8e7f8f7a5724 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:07:32.657934 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2529ddd4-1078-4bb9-ac81-8e7f8f7a5724 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 204 len: 0 microversion: 2.1 time: 0.138341 Oct 29 03:07:32.661864 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2593/5121] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:07:32 2022] DELETE /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:07:32.665402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-2192814a-d332-46a0-bca5-adb176bf801e req-da3f4d3a-089c-47f1-8245-bd4ea781d090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfab3b11-01ce-4757-ba50-5d65796f9788", "tag": "224c0a5a-9063-4270-96f9-12450fb578dc"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:32.676288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2192814a-d332-46a0-bca5-adb176bf801e req-da3f4d3a-089c-47f1-8245-bd4ea781d090 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.677143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2192814a-d332-46a0-bca5-adb176bf801e req-da3f4d3a-089c-47f1-8245-bd4ea781d090 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.677283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2192814a-d332-46a0-bca5-adb176bf801e req-da3f4d3a-089c-47f1-8245-bd4ea781d090 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.691218 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-2192814a-d332-46a0-bca5-adb176bf801e req-da3f4d3a-089c-47f1-8245-bd4ea781d090 service nova] Creating event network-changed:224c0a5a-9063-4270-96f9-12450fb578dc for instance cfab3b11-01ce-4757-ba50-5d65796f9788 on n-h1-862964-4 Oct 29 03:07:32.696420 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-2192814a-d332-46a0-bca5-adb176bf801e req-da3f4d3a-089c-47f1-8245-bd4ea781d090 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035999 Oct 29 03:07:32.697213 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2594/5122] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:32.702406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b471881-b1cd-4d58-ae8b-0fee8ca48b9c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:32.703098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3b471881-b1cd-4d58-ae8b-0fee8ca48b9c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:32.713316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b471881-b1cd-4d58-ae8b-0fee8ca48b9c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.714038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b471881-b1cd-4d58-ae8b-0fee8ca48b9c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.714566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b471881-b1cd-4d58-ae8b-0fee8ca48b9c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.715404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b471881-b1cd-4d58-ae8b-0fee8ca48b9c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.715963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b471881-b1cd-4d58-ae8b-0fee8ca48b9c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.717056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b471881-b1cd-4d58-ae8b-0fee8ca48b9c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.863032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b471881-b1cd-4d58-ae8b-0fee8ca48b9c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:32.873189 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3b471881-b1cd-4d58-ae8b-0fee8ca48b9c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.174798 Oct 29 03:07:32.877769 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8f5772c-d095-42de-affc-aaea3e713f7d tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/b56f5885-7bcd-4983-bdb4-4f0a2496b8b6" status: 202 len: 0 microversion: 2.1 time: 2.293805 Oct 29 03:07:32.880385 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2529/5123] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:07:30 2022] DELETE /compute/v2.1/os-floating-ips/b56f5885-7bcd-4983-bdb4-4f0a2496b8b6 => generated 0 bytes in 2297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:32.890292 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2595/5124] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:32 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:32.890794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a0e3aff2-98e2-455b-8923-edc8bf134aee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '.version_select at 0x7fe1acaf33a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:32.896839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0e313f2a-21ab-4e6c-8077-5343e20468d0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:32.897915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0e313f2a-21ab-4e6c-8077-5343e20468d0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:32.907165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e313f2a-21ab-4e6c-8077-5343e20468d0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.908185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e313f2a-21ab-4e6c-8077-5343e20468d0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.909328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e313f2a-21ab-4e6c-8077-5343e20468d0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.910354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e313f2a-21ab-4e6c-8077-5343e20468d0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.910904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e313f2a-21ab-4e6c-8077-5343e20468d0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.911455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e313f2a-21ab-4e6c-8077-5343e20468d0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.917652 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a0e3aff2-98e2-455b-8923-edc8bf134aee tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253269865" status: 204 len: 0 microversion: 2.20 time: 0.035751 Oct 29 03:07:32.931771 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2530/5125] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Oct 29 03:07:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253269865 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:07:32.934197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:32.946939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9f185590-c100-47da-bf3b-d398b40c43c5 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] Calling method '.version_select at 0x7fe1a85b69d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:33.180302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0e313f2a-21ab-4e6c-8077-5343e20468d0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:33.194703 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0e313f2a-21ab-4e6c-8077-5343e20468d0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1582 microversion: 2.1 time: 0.302295 Oct 29 03:07:33.196171 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2596/5126] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:32 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1582 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:33.206952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-faf94151-bb72-43d0-831f-f4762e4923a1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:33.207774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-faf94151-bb72-43d0-831f-f4762e4923a1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:33.215501 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9f185590-c100-47da-bf3b-d398b40c43c5 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.278968 Oct 29 03:07:33.216072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf94151-bb72-43d0-831f-f4762e4923a1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.216704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf94151-bb72-43d0-831f-f4762e4923a1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.217444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf94151-bb72-43d0-831f-f4762e4923a1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.218309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf94151-bb72-43d0-831f-f4762e4923a1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.219064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf94151-bb72-43d0-831f-f4762e4923a1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.219732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf94151-bb72-43d0-831f-f4762e4923a1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.221433 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2531/5127] 10.222.0.16 () {58 vars in 1164 bytes} [Sat Oct 29 03:07:32 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:07:33.246582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c3efe3ea-2fcb-40c8-b0bf-337f67998b0e tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] Calling method '.version_select at 0x7fe1acc43d30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:33.523356 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c3efe3ea-2fcb-40c8-b0bf-337f67998b0e tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.283871 Oct 29 03:07:33.524246 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2532/5128] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Oct 29 03:07:33 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:33.529258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59c77749-dcc9-4b38-8272-9651f95e4439 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:33.530051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59c77749-dcc9-4b38-8272-9651f95e4439 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:33.538329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c77749-dcc9-4b38-8272-9651f95e4439 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.538871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c77749-dcc9-4b38-8272-9651f95e4439 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.539302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c77749-dcc9-4b38-8272-9651f95e4439 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.539989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c77749-dcc9-4b38-8272-9651f95e4439 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.540431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c77749-dcc9-4b38-8272-9651f95e4439 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.540844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c77749-dcc9-4b38-8272-9651f95e4439 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.570779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-faf94151-bb72-43d0-831f-f4762e4923a1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:33.581738 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-faf94151-bb72-43d0-831f-f4762e4923a1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.380692 Oct 29 03:07:33.582285 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2597/5129] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:33 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:33.588103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f0ac3e0b-9df4-4956-873f-22a50a2c705c tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] Calling method '.version_select at 0x7fe1a33f20d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:33.703624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59c77749-dcc9-4b38-8272-9651f95e4439 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:33.713865 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59c77749-dcc9-4b38-8272-9651f95e4439 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.188256 Oct 29 03:07:33.731536 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2533/5130] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:33 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:33.898507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-92e8d01a-8038-450c-ad95-a5dbaa11a166 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:33.899120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-92e8d01a-8038-450c-ad95-a5dbaa11a166 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:33.906642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e8d01a-8038-450c-ad95-a5dbaa11a166 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.907087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e8d01a-8038-450c-ad95-a5dbaa11a166 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.907519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e8d01a-8038-450c-ad95-a5dbaa11a166 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.908219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e8d01a-8038-450c-ad95-a5dbaa11a166 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.908675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e8d01a-8038-450c-ad95-a5dbaa11a166 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.909568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92e8d01a-8038-450c-ad95-a5dbaa11a166 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.050249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-92e8d01a-8038-450c-ad95-a5dbaa11a166 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:34.059399 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-92e8d01a-8038-450c-ad95-a5dbaa11a166 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.164856 Oct 29 03:07:34.059988 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2534/5131] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:33 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:34.228172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b6fc4537-42b8-41f4-80ee-a639e84070d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:34.228771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b6fc4537-42b8-41f4-80ee-a639e84070d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:34.235178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc4537-42b8-41f4-80ee-a639e84070d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.235679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc4537-42b8-41f4-80ee-a639e84070d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.236106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc4537-42b8-41f4-80ee-a639e84070d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.236791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc4537-42b8-41f4-80ee-a639e84070d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.237243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc4537-42b8-41f4-80ee-a639e84070d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.237654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc4537-42b8-41f4-80ee-a639e84070d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.449794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b6fc4537-42b8-41f4-80ee-a639e84070d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:34.459031 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b6fc4537-42b8-41f4-80ee-a639e84070d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1582 microversion: 2.1 time: 0.234735 Oct 29 03:07:34.459767 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2535/5132] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:34 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1582 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:34.605103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f68ee1e9-30f8-4bbc-b13e-943fc8dd2d4f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:34.606244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f68ee1e9-30f8-4bbc-b13e-943fc8dd2d4f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:34.613655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ee1e9-30f8-4bbc-b13e-943fc8dd2d4f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.614356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ee1e9-30f8-4bbc-b13e-943fc8dd2d4f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.615260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ee1e9-30f8-4bbc-b13e-943fc8dd2d4f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.616128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ee1e9-30f8-4bbc-b13e-943fc8dd2d4f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.616723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ee1e9-30f8-4bbc-b13e-943fc8dd2d4f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.617292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ee1e9-30f8-4bbc-b13e-943fc8dd2d4f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.807265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f68ee1e9-30f8-4bbc-b13e-943fc8dd2d4f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:34.824238 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f68ee1e9-30f8-4bbc-b13e-943fc8dd2d4f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.222991 Oct 29 03:07:34.825288 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2536/5133] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:34 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:34.830730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fe96f501-ad78-45b1-96df-0bbd73dac555 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:34.831952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fe96f501-ad78-45b1-96df-0bbd73dac555 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:34.838972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe96f501-ad78-45b1-96df-0bbd73dac555 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.840027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe96f501-ad78-45b1-96df-0bbd73dac555 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.840691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe96f501-ad78-45b1-96df-0bbd73dac555 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.842983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe96f501-ad78-45b1-96df-0bbd73dac555 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.844261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe96f501-ad78-45b1-96df-0bbd73dac555 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.845080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe96f501-ad78-45b1-96df-0bbd73dac555 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:35.073631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fe96f501-ad78-45b1-96df-0bbd73dac555 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:35.095197 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fe96f501-ad78-45b1-96df-0bbd73dac555 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.268376 Oct 29 03:07:35.096740 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2537/5134] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:34 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:35.102831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-7d74ff69-4a14-4567-8f2b-cc6ce4ba37b4 req-cf6012f7-e8a0-45ff-ac07-bedd881abea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfab3b11-01ce-4757-ba50-5d65796f9788", "name": "network-vif-deleted", "tag": "224c0a5a-9063-4270-96f9-12450fb578dc"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:35.121788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7d74ff69-4a14-4567-8f2b-cc6ce4ba37b4 req-cf6012f7-e8a0-45ff-ac07-bedd881abea5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:35.123178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7d74ff69-4a14-4567-8f2b-cc6ce4ba37b4 req-cf6012f7-e8a0-45ff-ac07-bedd881abea5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:35.123619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7d74ff69-4a14-4567-8f2b-cc6ce4ba37b4 req-cf6012f7-e8a0-45ff-ac07-bedd881abea5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:35.139836 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-7d74ff69-4a14-4567-8f2b-cc6ce4ba37b4 req-cf6012f7-e8a0-45ff-ac07-bedd881abea5 service nova] Creating event network-vif-deleted:224c0a5a-9063-4270-96f9-12450fb578dc for instance cfab3b11-01ce-4757-ba50-5d65796f9788 on n-h1-862964-4 Oct 29 03:07:35.149477 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-7d74ff69-4a14-4567-8f2b-cc6ce4ba37b4 req-cf6012f7-e8a0-45ff-ac07-bedd881abea5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050858 Oct 29 03:07:35.150867 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2538/5135] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:35.157665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dc2cde1e-3c37-4cb7-a4c3-1f13d8786cd2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:35.158474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dc2cde1e-3c37-4cb7-a4c3-1f13d8786cd2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:35.166683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc2cde1e-3c37-4cb7-a4c3-1f13d8786cd2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:35.167391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc2cde1e-3c37-4cb7-a4c3-1f13d8786cd2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:35.168390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc2cde1e-3c37-4cb7-a4c3-1f13d8786cd2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:35.169144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc2cde1e-3c37-4cb7-a4c3-1f13d8786cd2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:35.169696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc2cde1e-3c37-4cb7-a4c3-1f13d8786cd2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:35.170158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc2cde1e-3c37-4cb7-a4c3-1f13d8786cd2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:35.358692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dc2cde1e-3c37-4cb7-a4c3-1f13d8786cd2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:35.374966 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dc2cde1e-3c37-4cb7-a4c3-1f13d8786cd2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.222633 Oct 29 03:07:35.376615 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2539/5136] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:35 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:35.484333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d41ce2a1-7144-4a8d-8303-6bd26021b75e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:35.484968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d41ce2a1-7144-4a8d-8303-6bd26021b75e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:35.493889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d41ce2a1-7144-4a8d-8303-6bd26021b75e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:35.494371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d41ce2a1-7144-4a8d-8303-6bd26021b75e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:35.494810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d41ce2a1-7144-4a8d-8303-6bd26021b75e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:35.495769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d41ce2a1-7144-4a8d-8303-6bd26021b75e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:35.501423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d41ce2a1-7144-4a8d-8303-6bd26021b75e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:35.507672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d41ce2a1-7144-4a8d-8303-6bd26021b75e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:35.617156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d41ce2a1-7144-4a8d-8303-6bd26021b75e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:35.632208 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d41ce2a1-7144-4a8d-8303-6bd26021b75e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1230 microversion: 2.1 time: 0.152191 Oct 29 03:07:35.633396 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2540/5137] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:35 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1230 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:35.848463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4f93a8ea-0219-411a-9f12-fac1002b81f1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:35.849093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4f93a8ea-0219-411a-9f12-fac1002b81f1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:35.856466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f93a8ea-0219-411a-9f12-fac1002b81f1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:35.857033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f93a8ea-0219-411a-9f12-fac1002b81f1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:35.857526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f93a8ea-0219-411a-9f12-fac1002b81f1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:35.858479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f93a8ea-0219-411a-9f12-fac1002b81f1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:35.859027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f93a8ea-0219-411a-9f12-fac1002b81f1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:35.859506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f93a8ea-0219-411a-9f12-fac1002b81f1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:36.046047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4f93a8ea-0219-411a-9f12-fac1002b81f1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:36.058480 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4f93a8ea-0219-411a-9f12-fac1002b81f1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.214656 Oct 29 03:07:36.060098 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2541/5138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:35 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:36.121076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9d99e5a-876d-4dae-9fa1-4f21c0d3ed8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:36.121696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9d99e5a-876d-4dae-9fa1-4f21c0d3ed8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:36.132443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d99e5a-876d-4dae-9fa1-4f21c0d3ed8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:36.134110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d99e5a-876d-4dae-9fa1-4f21c0d3ed8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:36.134798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d99e5a-876d-4dae-9fa1-4f21c0d3ed8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:36.139804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d99e5a-876d-4dae-9fa1-4f21c0d3ed8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:36.140300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d99e5a-876d-4dae-9fa1-4f21c0d3ed8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:36.140738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d99e5a-876d-4dae-9fa1-4f21c0d3ed8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:36.350590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a9d99e5a-876d-4dae-9fa1-4f21c0d3ed8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1b1de72f9d4fd3b3165588054a0a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:36.361185 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9d99e5a-876d-4dae-9fa1-4f21c0d3ed8d tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 200 len: 1512 microversion: 2.1 time: 0.244155 Oct 29 03:07:36.364382 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2542/5139] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:36 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:36.409057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9d446cff-0ba9-43bb-b52f-2eb559151156 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:36.409990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9d446cff-0ba9-43bb-b52f-2eb559151156 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:36.419653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d446cff-0ba9-43bb-b52f-2eb559151156 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:36.425466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d446cff-0ba9-43bb-b52f-2eb559151156 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:36.426212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d446cff-0ba9-43bb-b52f-2eb559151156 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:36.427261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d446cff-0ba9-43bb-b52f-2eb559151156 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:36.427877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d446cff-0ba9-43bb-b52f-2eb559151156 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:36.428463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d446cff-0ba9-43bb-b52f-2eb559151156 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:36.473504 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f0ac3e0b-9df4-4956-873f-22a50a2c705c tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/268d2e62-5000-4bc2-893b-4ccf02f4d138" status: 202 len: 0 microversion: 2.1 time: 2.889986 Oct 29 03:07:36.474964 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2598/5140] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:07:33 2022] DELETE /compute/v2.1/os-floating-ips/268d2e62-5000-4bc2-893b-4ccf02f4d138 => generated 0 bytes in 2892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:36.483771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a528c5aa-f26f-40f0-ab15-466b36c7a104 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] Calling method '.version_select at 0x7fe1a337daf0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:36.680225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9d446cff-0ba9-43bb-b52f-2eb559151156 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:36.695757 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9d446cff-0ba9-43bb-b52f-2eb559151156 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.296144 Oct 29 03:07:36.696410 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2543/5141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:36 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:36.701614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-582d2f1c-07f4-4a50-8915-e6dad1afb55e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:36.702312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-582d2f1c-07f4-4a50-8915-e6dad1afb55e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:36.731918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-582d2f1c-07f4-4a50-8915-e6dad1afb55e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:36.732827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-582d2f1c-07f4-4a50-8915-e6dad1afb55e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:36.733431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-582d2f1c-07f4-4a50-8915-e6dad1afb55e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:36.734351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-582d2f1c-07f4-4a50-8915-e6dad1afb55e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:36.734982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-582d2f1c-07f4-4a50-8915-e6dad1afb55e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:36.735560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-582d2f1c-07f4-4a50-8915-e6dad1afb55e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:36.916910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-582d2f1c-07f4-4a50-8915-e6dad1afb55e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:36.948009 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-582d2f1c-07f4-4a50-8915-e6dad1afb55e tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1397 microversion: 2.1 time: 0.250378 Oct 29 03:07:36.954281 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2544/5142] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:36 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1397 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:36.972620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-a826f020-820a-4cd7-bf06-61fb9b6c2afa req-e761d8fa-02cc-4aa8-930c-14aeac343c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbab455-c481-40ea-a59c-4ec9c15d935e", "name": "network-vif-deleted", "tag": "c7aca24a-a353-4021-bdca-25ce655729ae"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:37.000790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a826f020-820a-4cd7-bf06-61fb9b6c2afa req-e761d8fa-02cc-4aa8-930c-14aeac343c32 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:37.001941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a826f020-820a-4cd7-bf06-61fb9b6c2afa req-e761d8fa-02cc-4aa8-930c-14aeac343c32 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:37.004493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a826f020-820a-4cd7-bf06-61fb9b6c2afa req-e761d8fa-02cc-4aa8-930c-14aeac343c32 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:37.072797 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-a826f020-820a-4cd7-bf06-61fb9b6c2afa req-e761d8fa-02cc-4aa8-930c-14aeac343c32 service nova] Creating event network-vif-deleted:c7aca24a-a353-4021-bdca-25ce655729ae for instance 2bbab455-c481-40ea-a59c-4ec9c15d935e on n-h2-862964-4 Oct 29 03:07:37.095031 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-a826f020-820a-4cd7-bf06-61fb9b6c2afa req-e761d8fa-02cc-4aa8-930c-14aeac343c32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139118 Oct 29 03:07:37.095990 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2545/5143] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:37.106667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cf93d3cd-9904-40d0-b0e3-22772a03a947 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:37.107383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cf93d3cd-9904-40d0-b0e3-22772a03a947 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:37.129276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf93d3cd-9904-40d0-b0e3-22772a03a947 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:37.129974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf93d3cd-9904-40d0-b0e3-22772a03a947 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:37.140255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf93d3cd-9904-40d0-b0e3-22772a03a947 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:37.142589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf93d3cd-9904-40d0-b0e3-22772a03a947 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:37.145827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf93d3cd-9904-40d0-b0e3-22772a03a947 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:37.147262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf93d3cd-9904-40d0-b0e3-22772a03a947 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:37.462504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cf93d3cd-9904-40d0-b0e3-22772a03a947 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:37.480606 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cf93d3cd-9904-40d0-b0e3-22772a03a947 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.383242 Oct 29 03:07:37.501902 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2546/5144] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:37 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:37.507077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:37.509568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] [instance: 2bbab455-c481-40ea-a59c-4ec9c15d935e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:37.527072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:37.529302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:37.535187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:37.536367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:37.537977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:37.552826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:37.578665 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] HTTP exception thrown: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e could not be found. Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Request method failure captured: Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e HTTP/1.1 Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgZzExb0Yyrd_gXGU12wotgS3u4XNd3q1PuSt5xS3mU0we4GfDbIHMo8yJiNaG8XvLW_cTPWEbJFx5fXTMqGY-nx04AQviUFgd5yr2IvAP46yFGb949Jy7h8aZllRF61VPmpFcekA-LkrhBUjWX539LpL88OqZRkrR_7za0ptdisBA Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b925f5ecdb42e7a2f410c41f9f9cfc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b925f5ecdb42e7a2f410c41f9f9cfc"}]}] Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70b925f5ecdb42e7a2f410c41f9f9cfc Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1003225568 Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9d1b1de72f9d4fd3b3165588054a0a90 Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1003225568-project Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e could not be found. Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2bbab455-c481-40ea-a59c-4ec9c15d935e'} Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e could not be found. Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e could not be found. Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:37.582297 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:37.586944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:37.586944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:37.586944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:37.586944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:37.586944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:37.586944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e could not be found. Oct 29 03:07:37.586944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:37.586944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] Returning 404 to user: Instance 2bbab455-c481-40ea-a59c-4ec9c15d935e could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:37.586944 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ea3d919-6e13-4a33-bf1e-5ad6c9b199b1 tempest-ServersNegativeTestJSON-1003225568 tempest-ServersNegativeTestJSON-1003225568-project] 10.222.0.16 "GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e" status: 404 len: 111 microversion: 2.1 time: 0.080454 Oct 29 03:07:37.586944 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2547/5145] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:37 2022] GET /compute/v2.1/servers/2bbab455-c481-40ea-a59c-4ec9c15d935e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:37.737128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-60a131fa-bca9-49cd-bc67-d59bce2948d5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:37.737377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-60a131fa-bca9-49cd-bc67-d59bce2948d5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:37.755539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a131fa-bca9-49cd-bc67-d59bce2948d5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:37.761663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a131fa-bca9-49cd-bc67-d59bce2948d5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:37.761824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a131fa-bca9-49cd-bc67-d59bce2948d5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:37.764570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a131fa-bca9-49cd-bc67-d59bce2948d5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:37.765490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a131fa-bca9-49cd-bc67-d59bce2948d5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:37.767761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60a131fa-bca9-49cd-bc67-d59bce2948d5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.421383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-60a131fa-bca9-49cd-bc67-d59bce2948d5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:38.444297 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-60a131fa-bca9-49cd-bc67-d59bce2948d5 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.714210 Oct 29 03:07:38.448166 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2548/5146] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:37 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:38.454033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-150aa0a8-3879-4665-9999-70547959dcc2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:38.454953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-150aa0a8-3879-4665-9999-70547959dcc2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:38.461555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150aa0a8-3879-4665-9999-70547959dcc2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.462496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150aa0a8-3879-4665-9999-70547959dcc2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.463571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150aa0a8-3879-4665-9999-70547959dcc2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.464580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150aa0a8-3879-4665-9999-70547959dcc2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.465229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150aa0a8-3879-4665-9999-70547959dcc2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.465868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150aa0a8-3879-4665-9999-70547959dcc2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.470683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:38.624737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-150aa0a8-3879-4665-9999-70547959dcc2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:38.633560 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-150aa0a8-3879-4665-9999-70547959dcc2 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1397 microversion: 2.1 time: 0.183938 Oct 29 03:07:38.637453 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2549/5147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:38 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1397 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:38.652815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:38.655834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:38.668115 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a528c5aa-f26f-40f0-ab15-466b36c7a104 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/74696f42-02d5-4fde-8889-3493fdf92f65" status: 202 len: 0 microversion: 2.1 time: 2.187682 Oct 29 03:07:38.674834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.677206 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2599/5148] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:07:36 2022] DELETE /compute/v2.1/os-floating-ips/74696f42-02d5-4fde-8889-3493fdf92f65 => generated 0 bytes in 2197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:38.677460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.677958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.678705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.680406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.680406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.690289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3109ab3-64e8-49a5-943f-c0a04015088d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:38.693143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d3109ab3-64e8-49a5-943f-c0a04015088d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:38.711434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3109ab3-64e8-49a5-943f-c0a04015088d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.712004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3109ab3-64e8-49a5-943f-c0a04015088d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.712381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3109ab3-64e8-49a5-943f-c0a04015088d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.713098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3109ab3-64e8-49a5-943f-c0a04015088d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.713325 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] HTTP exception thrown: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Request method failure captured: Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 HTTP/1.1 Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJcFBAFNOzU5bzfWkuUBjVkhOJXnzhig8t8LcAOK7ycm1RbRBHoLtshT33gQycjj5u9FKeLnTdU7rAhWEPnXnC--n33vtx4jMryneJ9QCYGXQFPhM_50vTdZF825N-Oiy5P2q8Uohu2OHC53MugGSsrWovjBGj5aAvOErRVeHhsZFP4 Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ef09834b750437e9fa350df7b4bb0f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}] Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 801730a89d33490d8d6f425f20ce5b1d Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'f439b2b6-1302-414a-93d3-f162321fd6c6'} Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:38.715386 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:38.719196 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:38.719196 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:38.719196 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:38.719196 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:38.719196 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:38.719196 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:38.719196 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:38.719196 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:38.719196 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:38.719196 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:38.719196 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:38.719965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3109ab3-64e8-49a5-943f-c0a04015088d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.719965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3109ab3-64e8-49a5-943f-c0a04015088d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.722535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Returning 404 to user: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:38.723436 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-19626c72-7e3f-4be0-b26e-be4f545ee6ec tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 404 len: 111 microversion: 2.20 time: 0.084846 Oct 29 03:07:38.727625 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2550/5149] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:07:38 2022] DELETE /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:38.735350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-40958a30-e75b-4bc8-831a-e8703eef4be4 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] Calling method '.version_select at 0x7fe1acd46280>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:38.953848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d3109ab3-64e8-49a5-943f-c0a04015088d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:38.963385 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3109ab3-64e8-49a5-943f-c0a04015088d tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.283543 Oct 29 03:07:38.963946 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2600/5150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:38 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:38.987104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:38.987828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: f439b2b6-1302-414a-93d3-f162321fd6c6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:39.000070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.004042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.005282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.006296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.007528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.008223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.045951 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] HTTP exception thrown: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Request method failure captured: Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 HTTP/1.1 Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJcFBAFNOzU5bzfWkuUBjVkhOJXnzhig8t8LcAOK7ycm1RbRBHoLtshT33gQycjj5u9FKeLnTdU7rAhWEPnXnC--n33vtx4jMryneJ9QCYGXQFPhM_50vTdZF825N-Oiy5P2q8Uohu2OHC53MugGSsrWovjBGj5aAvOErRVeHhsZFP4 Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ef09834b750437e9fa350df7b4bb0f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}] Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 801730a89d33490d8d6f425f20ce5b1d Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'f439b2b6-1302-414a-93d3-f162321fd6c6'} Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.047658 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:39.051762 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.051762 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:39.051762 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:39.051762 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:39.051762 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:39.051762 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:39.051762 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. Oct 29 03:07:39.051762 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.051762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Returning 404 to user: Instance f439b2b6-1302-414a-93d3-f162321fd6c6 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:39.051762 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2f44baf-d367-4411-9cdf-d30c06942c36 tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6" status: 404 len: 111 microversion: 2.20 time: 0.069576 Oct 29 03:07:39.077772 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2601/5151] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:38 2022] GET /compute/v2.1/servers/f439b2b6-1302-414a-93d3-f162321fd6c6 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:39.472617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2da38010-df11-4c0c-8ea7-471aede319e1 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:39.474348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2da38010-df11-4c0c-8ea7-471aede319e1 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:39.482754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2da38010-df11-4c0c-8ea7-471aede319e1 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.483967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2da38010-df11-4c0c-8ea7-471aede319e1 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.485050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2da38010-df11-4c0c-8ea7-471aede319e1 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.486000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2da38010-df11-4c0c-8ea7-471aede319e1 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.486960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2da38010-df11-4c0c-8ea7-471aede319e1 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.487704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2da38010-df11-4c0c-8ea7-471aede319e1 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.651689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2da38010-df11-4c0c-8ea7-471aede319e1 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:39.662368 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2da38010-df11-4c0c-8ea7-471aede319e1 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.193643 Oct 29 03:07:39.678615 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2602/5152] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:39 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:39.685190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e6b07a86-5caf-4e9b-8130-4cf2ae28f5b9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:39.686109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e6b07a86-5caf-4e9b-8130-4cf2ae28f5b9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:39.700157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b07a86-5caf-4e9b-8130-4cf2ae28f5b9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.701162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b07a86-5caf-4e9b-8130-4cf2ae28f5b9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.704692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b07a86-5caf-4e9b-8130-4cf2ae28f5b9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.705736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b07a86-5caf-4e9b-8130-4cf2ae28f5b9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.706475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b07a86-5caf-4e9b-8130-4cf2ae28f5b9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.707409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b07a86-5caf-4e9b-8130-4cf2ae28f5b9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.791958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e6b07a86-5caf-4e9b-8130-4cf2ae28f5b9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:39.803227 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e6b07a86-5caf-4e9b-8130-4cf2ae28f5b9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1397 microversion: 2.1 time: 0.122608 Oct 29 03:07:39.804020 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2603/5153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:39 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1397 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:39.920316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:39.920817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:39.927422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.927902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.928807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.929481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.929985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.930391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.946592 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] HTTP exception thrown: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Request method failure captured: Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 HTTP/1.1 Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJcj2Z1_C1r9Z3__JOloMFHMZm0PmgZ0uXz1U-XoRahkGENL6LMKSlWzTDC4bgLvWbDwCZgvalwg3H7xTmK82_i3KVZCrZHJLrO7UHrJV_nJg2Yw27MF_vqlzZ5mhS4YyStUm0gDariIm4XiOxo6jBoEJ818qMIFKWNiX-DaOPnMRIQ Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: bf7809d4281c4efa9330464b86c1ee27 Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-883463450 Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bf7809d4281c4efa9330464b86c1ee27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf7809d4281c4efa9330464b86c1ee27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bf7809d4281c4efa9330464b86c1ee27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf7809d4281c4efa9330464b86c1ee27"}]}] Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TaggedBootDevicesTest_v242-883463450 Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: bf7809d4281c4efa9330464b86c1ee27 Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-883463450 Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TaggedBootDevicesTest_v242-883463450-project Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0bb215bc0435419eb2659aceb19ea58a Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TaggedBootDevicesTest_v242-883463450-project Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '480789f1-7931-471a-b306-64889fa76dd1'} Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:39.948345 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Returning 404 to user: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b7752fd3-8330-4fe8-9274-d24b698c8785 tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "DELETE /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 404 len: 111 microversion: 2.42 time: 0.033714 Oct 29 03:07:39.955842 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2604/5154] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:07:39 2022] DELETE /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:39.958867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:39.959473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] [instance: 480789f1-7931-471a-b306-64889fa76dd1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:39.965983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.966573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.967080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.967860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.968379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.968870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.986309 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] HTTP exception thrown: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Request method failure captured: Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 HTTP/1.1 Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJcj2Z1_C1r9Z3__JOloMFHMZm0PmgZ0uXz1U-XoRahkGENL6LMKSlWzTDC4bgLvWbDwCZgvalwg3H7xTmK82_i3KVZCrZHJLrO7UHrJV_nJg2Yw27MF_vqlzZ5mhS4YyStUm0gDariIm4XiOxo6jBoEJ818qMIFKWNiX-DaOPnMRIQ Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: bf7809d4281c4efa9330464b86c1ee27 Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-883463450 Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bf7809d4281c4efa9330464b86c1ee27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf7809d4281c4efa9330464b86c1ee27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bf7809d4281c4efa9330464b86c1ee27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf7809d4281c4efa9330464b86c1ee27"}]}] Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TaggedBootDevicesTest_v242-883463450 Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: bf7809d4281c4efa9330464b86c1ee27 Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-883463450 Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TaggedBootDevicesTest_v242-883463450-project Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0bb215bc0435419eb2659aceb19ea58a Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TaggedBootDevicesTest_v242-883463450-project Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '480789f1-7931-471a-b306-64889fa76dd1'} Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.987928 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:39.993108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.993108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:39.993108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:39.993108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:39.993108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:39.993108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:39.993108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. Oct 29 03:07:39.993108 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:39.993108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] Returning 404 to user: Instance 480789f1-7931-471a-b306-64889fa76dd1 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:39.993108 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3245c80a-88e0-4349-81f7-649730e154cb tempest-TaggedBootDevicesTest_v242-883463450 tempest-TaggedBootDevicesTest_v242-883463450-project] 10.222.0.16 "GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1" status: 404 len: 111 microversion: 2.42 time: 0.034397 Oct 29 03:07:40.005050 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2605/5155] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:39 2022] GET /compute/v2.1/servers/480789f1-7931-471a-b306-64889fa76dd1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:40.010174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bd7458b0-3df0-48ab-a817-49649f1fc078 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:40.011099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bd7458b0-3df0-48ab-a817-49649f1fc078 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:40.017874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd7458b0-3df0-48ab-a817-49649f1fc078 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.018743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd7458b0-3df0-48ab-a817-49649f1fc078 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.019371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd7458b0-3df0-48ab-a817-49649f1fc078 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.020254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd7458b0-3df0-48ab-a817-49649f1fc078 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.020880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd7458b0-3df0-48ab-a817-49649f1fc078 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.021482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd7458b0-3df0-48ab-a817-49649f1fc078 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.184587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bd7458b0-3df0-48ab-a817-49649f1fc078 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:40.194750 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bd7458b0-3df0-48ab-a817-49649f1fc078 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.187809 Oct 29 03:07:40.195548 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2606/5156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:40 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:40.493211 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-40958a30-e75b-4bc8-831a-e8703eef4be4 tempest-FloatingIPDetailsTestJSON-1934472377 tempest-FloatingIPDetailsTestJSON-1934472377-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/ca3e7885-5350-4e4e-a882-63e99d27e85a" status: 202 len: 0 microversion: 2.1 time: 1.764132 Oct 29 03:07:40.496836 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2551/5157] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:07:38 2022] DELETE /compute/v2.1/os-floating-ips/ca3e7885-5350-4e4e-a882-63e99d27e85a => generated 0 bytes in 1766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:40.690393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-afc20019-f8b9-4198-8fb0-0a28c62d6d62 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:40.691741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-afc20019-f8b9-4198-8fb0-0a28c62d6d62 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:40.701033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afc20019-f8b9-4198-8fb0-0a28c62d6d62 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.701522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afc20019-f8b9-4198-8fb0-0a28c62d6d62 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.701996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afc20019-f8b9-4198-8fb0-0a28c62d6d62 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.702703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afc20019-f8b9-4198-8fb0-0a28c62d6d62 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.703149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afc20019-f8b9-4198-8fb0-0a28c62d6d62 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.703557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-afc20019-f8b9-4198-8fb0-0a28c62d6d62 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.827836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e7e23639-87bd-4a19-afd0-6e2032d641d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:40.828827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e7e23639-87bd-4a19-afd0-6e2032d641d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:40.835794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e23639-87bd-4a19-afd0-6e2032d641d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.836533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e23639-87bd-4a19-afd0-6e2032d641d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.837145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e23639-87bd-4a19-afd0-6e2032d641d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.838297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e23639-87bd-4a19-afd0-6e2032d641d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.838976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e23639-87bd-4a19-afd0-6e2032d641d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.839553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e23639-87bd-4a19-afd0-6e2032d641d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.969617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-afc20019-f8b9-4198-8fb0-0a28c62d6d62 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:40.978880 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-afc20019-f8b9-4198-8fb0-0a28c62d6d62 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.295668 Oct 29 03:07:40.999442 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2607/5158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:40 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:41.038479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e7e23639-87bd-4a19-afd0-6e2032d641d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aff6fe639d42bcb968efc58f7e9cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876cdb4084454584965a3f11aed5e79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:41.058800 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e7e23639-87bd-4a19-afd0-6e2032d641d9 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 200 len: 1397 microversion: 2.1 time: 0.235265 Oct 29 03:07:41.059415 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2552/5159] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:40 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 1397 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:41.220713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2ea34755-641d-444e-9d06-2c68626037b4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:41.221304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2ea34755-641d-444e-9d06-2c68626037b4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:41.234255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ea34755-641d-444e-9d06-2c68626037b4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:41.234746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ea34755-641d-444e-9d06-2c68626037b4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:41.235173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ea34755-641d-444e-9d06-2c68626037b4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:41.235874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ea34755-641d-444e-9d06-2c68626037b4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:41.236341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ea34755-641d-444e-9d06-2c68626037b4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:41.236731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ea34755-641d-444e-9d06-2c68626037b4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:41.623066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2ea34755-641d-444e-9d06-2c68626037b4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:41.631598 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2ea34755-641d-444e-9d06-2c68626037b4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.414813 Oct 29 03:07:41.635070 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2608/5160] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:41 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:42.006364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cdabcca2-6500-41a0-9c26-4a0181aff7d7 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:42.007664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cdabcca2-6500-41a0-9c26-4a0181aff7d7 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:42.018413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdabcca2-6500-41a0-9c26-4a0181aff7d7 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:42.028491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdabcca2-6500-41a0-9c26-4a0181aff7d7 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:42.029443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdabcca2-6500-41a0-9c26-4a0181aff7d7 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:42.031057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdabcca2-6500-41a0-9c26-4a0181aff7d7 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:42.036632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdabcca2-6500-41a0-9c26-4a0181aff7d7 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:42.040921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cdabcca2-6500-41a0-9c26-4a0181aff7d7 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:42.088275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:42.089725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] [instance: cfab3b11-01ce-4757-ba50-5d65796f9788] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:42.110302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:42.112805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:42.114565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:42.118463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:42.119236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:42.122133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:42.159935 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] HTTP exception thrown: Instance cfab3b11-01ce-4757-ba50-5d65796f9788 could not be found. Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Request method failure captured: Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 HTTP/1.1 Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJfLOKZ0rrxMc74mFVsBdCfWEU3apEKJgpQsn8Xda4Q3UJr-PeOQxD_elPzSZIK8o3rKHKhQs3zZtKi5Cj5_wkbbk7Sc2iBhqittjePfWn8we2V6OyR2_pURH2YCVD65cFRtraTOJxYtpn3wK85mcsky72e5JPky3YsJhQq6PbYXhMo Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 876cdb4084454584965a3f11aed5e79a Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestVolumeBackupRestore-107413709 Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/876cdb4084454584965a3f11aed5e79a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/876cdb4084454584965a3f11aed5e79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_876cdb4084454584965a3f11aed5e79a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/876cdb4084454584965a3f11aed5e79a"}]}] Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestVolumeBackupRestore-107413709 Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 876cdb4084454584965a3f11aed5e79a Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestVolumeBackupRestore-107413709 Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestVolumeBackupRestore-107413709-project Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 14aff6fe639d42bcb968efc58f7e9cad Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestVolumeBackupRestore-107413709-project Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance cfab3b11-01ce-4757-ba50-5d65796f9788 could not be found. Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cfab3b11-01ce-4757-ba50-5d65796f9788'} Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfab3b11-01ce-4757-ba50-5d65796f9788 could not be found. Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfab3b11-01ce-4757-ba50-5d65796f9788 could not be found. Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:42.162124 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:42.165980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:42.165980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:42.165980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:42.165980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:42.165980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:42.165980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfab3b11-01ce-4757-ba50-5d65796f9788 could not be found. Oct 29 03:07:42.165980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:07:42.170702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Returning 404 to user: Instance cfab3b11-01ce-4757-ba50-5d65796f9788 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:42.172027 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6224a254-75c6-44ba-9ad5-b32286cfa1a0 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788" status: 404 len: 111 microversion: 2.1 time: 0.088258 Oct 29 03:07:42.178359 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2609/5161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:42 2022] GET /compute/v2.1/servers/cfab3b11-01ce-4757-ba50-5d65796f9788 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:07:42.659195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8cd08f35-47a0-4057-85ac-7d1ecb7e55a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:42.659826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8cd08f35-47a0-4057-85ac-7d1ecb7e55a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:42.669462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd08f35-47a0-4057-85ac-7d1ecb7e55a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:42.669992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd08f35-47a0-4057-85ac-7d1ecb7e55a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:42.673785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd08f35-47a0-4057-85ac-7d1ecb7e55a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:42.674902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd08f35-47a0-4057-85ac-7d1ecb7e55a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:42.675805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd08f35-47a0-4057-85ac-7d1ecb7e55a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:42.676402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd08f35-47a0-4057-85ac-7d1ecb7e55a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:42.793674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cdabcca2-6500-41a0-9c26-4a0181aff7d7 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:42.803328 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cdabcca2-6500-41a0-9c26-4a0181aff7d7 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.801122 Oct 29 03:07:42.807293 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2553/5162] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:42 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:43.715515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8cd08f35-47a0-4057-85ac-7d1ecb7e55a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:43.730736 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8cd08f35-47a0-4057-85ac-7d1ecb7e55a2 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 1.076585 Oct 29 03:07:43.731833 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2610/5163] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:42 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:43.829349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-efd63596-c73e-4f9e-8fdf-3b5cb52b07da tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:43.830540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-efd63596-c73e-4f9e-8fdf-3b5cb52b07da tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:43.842261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd63596-c73e-4f9e-8fdf-3b5cb52b07da tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:43.844104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd63596-c73e-4f9e-8fdf-3b5cb52b07da tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:43.846265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd63596-c73e-4f9e-8fdf-3b5cb52b07da tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:43.847729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd63596-c73e-4f9e-8fdf-3b5cb52b07da tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:43.849221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd63596-c73e-4f9e-8fdf-3b5cb52b07da tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:43.851604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efd63596-c73e-4f9e-8fdf-3b5cb52b07da tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:43.977782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d52512eb-2cdb-40d2-99b1-47f9210a6b60 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] Calling method '.version_select at 0x7fe1a33f23a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:44.022271 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d52512eb-2cdb-40d2-99b1-47f9210a6b60 tempest-TestVolumeBackupRestore-107413709 tempest-TestVolumeBackupRestore-107413709-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2117560397" status: 202 len: 0 microversion: 2.1 time: 0.048321 Oct 29 03:07:44.023396 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2611/5164] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 03:07:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2117560397 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:07:44.348042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-efd63596-c73e-4f9e-8fdf-3b5cb52b07da tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:44.359189 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-efd63596-c73e-4f9e-8fdf-3b5cb52b07da tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.534279 Oct 29 03:07:44.397585 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2554/5165] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:43 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:44.757623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1082593b-0306-4e10-b424-8ce5a76fdd7f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:44.758871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1082593b-0306-4e10-b424-8ce5a76fdd7f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:44.780140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1082593b-0306-4e10-b424-8ce5a76fdd7f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:44.781672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1082593b-0306-4e10-b424-8ce5a76fdd7f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:44.783223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1082593b-0306-4e10-b424-8ce5a76fdd7f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:44.785186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1082593b-0306-4e10-b424-8ce5a76fdd7f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:44.792370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1082593b-0306-4e10-b424-8ce5a76fdd7f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:44.792914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1082593b-0306-4e10-b424-8ce5a76fdd7f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:45.400635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9d11adc-7366-49f9-bd2b-19ca92ca20a6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:45.401395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9d11adc-7366-49f9-bd2b-19ca92ca20a6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:45.416617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d11adc-7366-49f9-bd2b-19ca92ca20a6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:45.420005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d11adc-7366-49f9-bd2b-19ca92ca20a6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:45.428158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d11adc-7366-49f9-bd2b-19ca92ca20a6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:45.428936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d11adc-7366-49f9-bd2b-19ca92ca20a6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:45.429404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d11adc-7366-49f9-bd2b-19ca92ca20a6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:45.432393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9d11adc-7366-49f9-bd2b-19ca92ca20a6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:45.443463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1082593b-0306-4e10-b424-8ce5a76fdd7f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:45.472572 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1082593b-0306-4e10-b424-8ce5a76fdd7f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.715529 Oct 29 03:07:45.475986 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2612/5166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:44 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:46.331871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a9d11adc-7366-49f9-bd2b-19ca92ca20a6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:46.349005 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9d11adc-7366-49f9-bd2b-19ca92ca20a6 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.953183 Oct 29 03:07:46.350311 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2555/5167] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:45 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:46.503694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2d686b7-6883-492f-ad1d-d5548889502c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:46.504251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f2d686b7-6883-492f-ad1d-d5548889502c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:46.530110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2d686b7-6883-492f-ad1d-d5548889502c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:46.532281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2d686b7-6883-492f-ad1d-d5548889502c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:46.532730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2d686b7-6883-492f-ad1d-d5548889502c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:46.533477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2d686b7-6883-492f-ad1d-d5548889502c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:46.533899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2d686b7-6883-492f-ad1d-d5548889502c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:46.534320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2d686b7-6883-492f-ad1d-d5548889502c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.040001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:47.040643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:47.055767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:47.056128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:47.056563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.057679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:47.062373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:47.063076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.126184 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] HTTP exception thrown: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Request method failure captured: Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b HTTP/1.1 Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJcFBAFNOzU5bzfWkuUBjVkhOJXnzhig8t8LcAOK7ycm1RbRBHoLtshT33gQycjj5u9FKeLnTdU7rAhWEPnXnC--n33vtx4jMryneJ9QCYGXQFPhM_50vTdZF825N-Oiy5P2q8Uohu2OHC53MugGSsrWovjBGj5aAvOErRVeHhsZFP4 Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ef09834b750437e9fa350df7b4bb0f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}] Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 801730a89d33490d8d6f425f20ce5b1d Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '31241403-2a17-4f40-818d-fc8caca85e4b'} Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:47.130917 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:47.134826 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:07:47.134826 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:47.134826 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:47.134826 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:47.134826 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:47.134826 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:47.134826 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:47.134826 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:47.134826 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:47.134826 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:07:47.134826 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:47.138436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Returning 404 to user: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:47.139529 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c62ab6e-db70-4e1f-bea2-eabb5ee7649c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "DELETE /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 404 len: 111 microversion: 2.20 time: 0.104151 Oct 29 03:07:47.140623 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2556/5168] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:07:47 2022] DELETE /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:47.151353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f2d686b7-6883-492f-ad1d-d5548889502c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:47.165521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:47.166795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] [instance: 31241403-2a17-4f40-818d-fc8caca85e4b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:47.185223 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f2d686b7-6883-492f-ad1d-d5548889502c tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.674866 Oct 29 03:07:47.186385 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2613/5169] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:46 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:47.197082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:47.197547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:47.198160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.198867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:47.199314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:47.199819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.251386 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] HTTP exception thrown: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Request method failure captured: Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b HTTP/1.1 Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJcFBAFNOzU5bzfWkuUBjVkhOJXnzhig8t8LcAOK7ycm1RbRBHoLtshT33gQycjj5u9FKeLnTdU7rAhWEPnXnC--n33vtx4jMryneJ9QCYGXQFPhM_50vTdZF825N-Oiy5P2q8Uohu2OHC53MugGSsrWovjBGj5aAvOErRVeHhsZFP4 Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ef09834b750437e9fa350df7b4bb0f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ef09834b750437e9fa350df7b4bb0f3"}]}] Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 3ef09834b750437e9fa350df7b4bb0f3 Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498686290 Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 801730a89d33490d8d6f425f20ce5b1d Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498686290-project Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '31241403-2a17-4f40-818d-fc8caca85e4b'} Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:47.253063 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:47.260914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:47.260914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:47.260914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:47.260914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:47.260914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:47.260914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:47.260914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. Oct 29 03:07:47.260914 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:07:47.260914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] Returning 404 to user: Instance 31241403-2a17-4f40-818d-fc8caca85e4b could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:47.260914 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9e7eb940-eab2-4eec-9d6c-e1513ed1ae9c tempest-AttachVolumeShelveTestJSON-498686290 tempest-AttachVolumeShelveTestJSON-498686290-project] 10.222.0.16 "GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b" status: 404 len: 111 microversion: 2.20 time: 0.106856 Oct 29 03:07:47.270277 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2557/5170] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:47 2022] GET /compute/v2.1/servers/31241403-2a17-4f40-818d-fc8caca85e4b => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:47.376563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e2b59647-34cc-4936-884e-e0e21e718ecd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:47.377662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e2b59647-34cc-4936-884e-e0e21e718ecd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:47.411113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2b59647-34cc-4936-884e-e0e21e718ecd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:47.411555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2b59647-34cc-4936-884e-e0e21e718ecd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:47.411986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2b59647-34cc-4936-884e-e0e21e718ecd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.412695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2b59647-34cc-4936-884e-e0e21e718ecd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:47.415084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2b59647-34cc-4936-884e-e0e21e718ecd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:47.417569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2b59647-34cc-4936-884e-e0e21e718ecd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:48.041020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e2b59647-34cc-4936-884e-e0e21e718ecd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:48.072737 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e2b59647-34cc-4936-884e-e0e21e718ecd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.700683 Oct 29 03:07:48.077748 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2614/5171] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:47 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:48.210141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f23d59a1-7e98-4bc7-a59d-ad424a88e2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:48.210891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f23d59a1-7e98-4bc7-a59d-ad424a88e2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:48.234558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23d59a1-7e98-4bc7-a59d-ad424a88e2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:48.235169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23d59a1-7e98-4bc7-a59d-ad424a88e2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:48.235705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23d59a1-7e98-4bc7-a59d-ad424a88e2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:48.240368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23d59a1-7e98-4bc7-a59d-ad424a88e2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:48.240958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23d59a1-7e98-4bc7-a59d-ad424a88e2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:48.241493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f23d59a1-7e98-4bc7-a59d-ad424a88e2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:48.658212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f23d59a1-7e98-4bc7-a59d-ad424a88e2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:48.669249 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f23d59a1-7e98-4bc7-a59d-ad424a88e2f3 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.461241 Oct 29 03:07:48.671453 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2558/5172] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:48 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:49.100451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-61c10c93-5f30-4279-9de2-402b6f33a57d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:49.101047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-61c10c93-5f30-4279-9de2-402b6f33a57d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:49.120875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c10c93-5f30-4279-9de2-402b6f33a57d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:49.123220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c10c93-5f30-4279-9de2-402b6f33a57d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:49.124612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c10c93-5f30-4279-9de2-402b6f33a57d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:49.126147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c10c93-5f30-4279-9de2-402b6f33a57d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:49.126942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c10c93-5f30-4279-9de2-402b6f33a57d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:49.128215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61c10c93-5f30-4279-9de2-402b6f33a57d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:49.572433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-61c10c93-5f30-4279-9de2-402b6f33a57d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:49.587823 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-61c10c93-5f30-4279-9de2-402b6f33a57d tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.491132 Oct 29 03:07:49.590527 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2615/5173] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:49 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:49.696791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d102657a-56b1-4ca6-bbcc-0bf1df700738 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:49.698407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d102657a-56b1-4ca6-bbcc-0bf1df700738 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:49.713042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d102657a-56b1-4ca6-bbcc-0bf1df700738 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:49.714453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d102657a-56b1-4ca6-bbcc-0bf1df700738 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:49.715921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d102657a-56b1-4ca6-bbcc-0bf1df700738 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:49.716849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d102657a-56b1-4ca6-bbcc-0bf1df700738 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:49.718950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d102657a-56b1-4ca6-bbcc-0bf1df700738 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:49.719536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d102657a-56b1-4ca6-bbcc-0bf1df700738 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:50.094653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d102657a-56b1-4ca6-bbcc-0bf1df700738 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:50.102663 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d102657a-56b1-4ca6-bbcc-0bf1df700738 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 0.410013 Oct 29 03:07:50.115602 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2559/5174] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:49 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:50.619034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76f0b12c-9550-415c-bf54-f183fdb0d5f2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:50.619795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-76f0b12c-9550-415c-bf54-f183fdb0d5f2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:50.623785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:50.649101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f0b12c-9550-415c-bf54-f183fdb0d5f2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:50.649604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f0b12c-9550-415c-bf54-f183fdb0d5f2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:50.650080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f0b12c-9550-415c-bf54-f183fdb0d5f2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:50.650911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f0b12c-9550-415c-bf54-f183fdb0d5f2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:50.651414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f0b12c-9550-415c-bf54-f183fdb0d5f2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:50.651847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76f0b12c-9550-415c-bf54-f183fdb0d5f2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:51.137186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-910a6477-562c-44fc-bbfc-1ab59604f969 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:51.137791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-910a6477-562c-44fc-bbfc-1ab59604f969 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:51.150259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910a6477-562c-44fc-bbfc-1ab59604f969 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:51.151326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910a6477-562c-44fc-bbfc-1ab59604f969 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:51.153550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910a6477-562c-44fc-bbfc-1ab59604f969 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:51.154483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910a6477-562c-44fc-bbfc-1ab59604f969 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:51.156780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910a6477-562c-44fc-bbfc-1ab59604f969 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:51.158624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910a6477-562c-44fc-bbfc-1ab59604f969 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:51.664592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-76f0b12c-9550-415c-bf54-f183fdb0d5f2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:51.699726 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-76f0b12c-9550-415c-bf54-f183fdb0d5f2 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 1.087268 Oct 29 03:07:51.715426 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2616/5175] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:50 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:52.576334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-910a6477-562c-44fc-bbfc-1ab59604f969 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:52.592108 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-910a6477-562c-44fc-bbfc-1ab59604f969 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1510 microversion: 2.1 time: 1.457330 Oct 29 03:07:52.601902 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2560/5176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:51 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1510 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:52.729701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3af49110-6505-4d18-a24c-c0bb9e1ab458 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:52.731156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3af49110-6505-4d18-a24c-c0bb9e1ab458 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:52.745310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3af49110-6505-4d18-a24c-c0bb9e1ab458 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:52.749010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3af49110-6505-4d18-a24c-c0bb9e1ab458 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:52.752885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3af49110-6505-4d18-a24c-c0bb9e1ab458 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:52.753993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3af49110-6505-4d18-a24c-c0bb9e1ab458 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:52.756594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3af49110-6505-4d18-a24c-c0bb9e1ab458 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:52.757279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3af49110-6505-4d18-a24c-c0bb9e1ab458 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:53.333704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3af49110-6505-4d18-a24c-c0bb9e1ab458 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:53.344860 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3af49110-6505-4d18-a24c-c0bb9e1ab458 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1522 microversion: 2.1 time: 0.620137 Oct 29 03:07:53.352697 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2617/5177] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:52 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1522 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:53.620814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-57af070f-cbf3-4127-9eb8-a55b5d5dc58f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:53.621436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-57af070f-cbf3-4127-9eb8-a55b5d5dc58f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:53.639116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57af070f-cbf3-4127-9eb8-a55b5d5dc58f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:53.639624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57af070f-cbf3-4127-9eb8-a55b5d5dc58f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:53.640057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57af070f-cbf3-4127-9eb8-a55b5d5dc58f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:53.640790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57af070f-cbf3-4127-9eb8-a55b5d5dc58f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:53.641737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57af070f-cbf3-4127-9eb8-a55b5d5dc58f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:53.641737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57af070f-cbf3-4127-9eb8-a55b5d5dc58f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:53.963418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-57af070f-cbf3-4127-9eb8-a55b5d5dc58f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:53.971940 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-57af070f-cbf3-4127-9eb8-a55b5d5dc58f tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1487 microversion: 2.1 time: 0.355730 Oct 29 03:07:53.976318 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2561/5178] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:53 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1487 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:53.999082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b518ec8-2623-454a-8e1f-d906b6798e1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-659000300"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:54.003058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b518ec8-2623-454a-8e1f-d906b6798e1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:54.039598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b518ec8-2623-454a-8e1f-d906b6798e1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:54.052440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b518ec8-2623-454a-8e1f-d906b6798e1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:54.053044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b518ec8-2623-454a-8e1f-d906b6798e1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:54.053945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b518ec8-2623-454a-8e1f-d906b6798e1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:54.062853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b518ec8-2623-454a-8e1f-d906b6798e1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:54.064482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b518ec8-2623-454a-8e1f-d906b6798e1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:54.102686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:54.202372 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b518ec8-2623-454a-8e1f-d906b6798e1b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "PUT /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1060 microversion: 2.1 time: 0.207875 Oct 29 03:07:54.214863 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2618/5179] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 03:07:53 2022] PUT /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1060 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:54.242102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1d68bcb6-ff7c-4a08-a7ae-45614e20bc89 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:54.243220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1d68bcb6-ff7c-4a08-a7ae-45614e20bc89 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:54.255676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d68bcb6-ff7c-4a08-a7ae-45614e20bc89 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:54.256328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d68bcb6-ff7c-4a08-a7ae-45614e20bc89 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:54.257004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d68bcb6-ff7c-4a08-a7ae-45614e20bc89 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:54.258009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d68bcb6-ff7c-4a08-a7ae-45614e20bc89 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:54.258702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d68bcb6-ff7c-4a08-a7ae-45614e20bc89 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:54.259345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d68bcb6-ff7c-4a08-a7ae-45614e20bc89 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:54.376338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f866f5a8-7aa6-4d13-a235-c7411ab4b024 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:54.377017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f866f5a8-7aa6-4d13-a235-c7411ab4b024 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:54.389734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f866f5a8-7aa6-4d13-a235-c7411ab4b024 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:54.398615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f866f5a8-7aa6-4d13-a235-c7411ab4b024 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:54.399046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f866f5a8-7aa6-4d13-a235-c7411ab4b024 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:54.399791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f866f5a8-7aa6-4d13-a235-c7411ab4b024 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:54.400244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f866f5a8-7aa6-4d13-a235-c7411ab4b024 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:54.400722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f866f5a8-7aa6-4d13-a235-c7411ab4b024 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:54.829090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1d68bcb6-ff7c-4a08-a7ae-45614e20bc89 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:54.837639 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1d68bcb6-ff7c-4a08-a7ae-45614e20bc89 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1487 microversion: 2.1 time: 0.599421 Oct 29 03:07:54.855689 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2562/5180] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:54 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1487 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:54.867858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-28036582-91de-4003-a448-d3192d02cc36 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:54.868759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-28036582-91de-4003-a448-d3192d02cc36 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:54.877466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28036582-91de-4003-a448-d3192d02cc36 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:54.878371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28036582-91de-4003-a448-d3192d02cc36 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:54.878998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28036582-91de-4003-a448-d3192d02cc36 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:54.879997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28036582-91de-4003-a448-d3192d02cc36 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:54.880610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28036582-91de-4003-a448-d3192d02cc36 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:54.881478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28036582-91de-4003-a448-d3192d02cc36 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:55.276674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-28036582-91de-4003-a448-d3192d02cc36 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:55.286880 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-28036582-91de-4003-a448-d3192d02cc36 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1487 microversion: 2.1 time: 0.424401 Oct 29 03:07:55.291269 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2563/5181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:54 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1487 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:55.325887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e742349-896e-47f3-b77f-786df55b8025 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Calling method '.version_select at 0x7fe1acd46430>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:55.406402 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e742349-896e-47f3-b77f-786df55b8025 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc" status: 200 len: 636 microversion: 2.1 time: 0.100831 Oct 29 03:07:55.414841 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2564/5182] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:07:55 2022] GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc => generated 636 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:55.434899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-30509805-d135-4086-a46b-ff0942d66a46 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:55.439595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-30509805-d135-4086-a46b-ff0942d66a46 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:55.450620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30509805-d135-4086-a46b-ff0942d66a46 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:55.451422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30509805-d135-4086-a46b-ff0942d66a46 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:55.452085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30509805-d135-4086-a46b-ff0942d66a46 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:55.453041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30509805-d135-4086-a46b-ff0942d66a46 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:55.454046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30509805-d135-4086-a46b-ff0942d66a46 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:55.454725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30509805-d135-4086-a46b-ff0942d66a46 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:55.506879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-30509805-d135-4086-a46b-ff0942d66a46 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:07:55.623731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f866f5a8-7aa6-4d13-a235-c7411ab4b024 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:55.642512 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f866f5a8-7aa6-4d13-a235-c7411ab4b024 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1502 microversion: 2.1 time: 1.267986 Oct 29 03:07:55.644597 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2619/5183] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:54 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1502 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:55.656056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d8be3541-f69d-41f2-ba1e-7023039efbea tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Action: 'update_all', calling method: .version_select at 0x7fe1a33f2280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:55.735528 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-30509805-d135-4086-a46b-ff0942d66a46 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 204 len: 0 microversion: 2.1 time: 0.306800 Oct 29 03:07:55.736123 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2565/5184] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:07:55 2022] DELETE /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:07:55.756586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-32c50843-0bd5-4e24-b558-f594b18f236c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Action: 'create', calling method: .version_select at 0x7fe1acd05160>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1211153096", "description": "tempest-description-140182155"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:55.785006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d8be3541-f69d-41f2-ba1e-7023039efbea tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:07:55.797063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d8be3541-f69d-41f2-ba1e-7023039efbea tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for user 7aa28bf5c15d4a79b61bb9cae94481fb and project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:07:56.243389 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d8be3541-f69d-41f2-ba1e-7023039efbea tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.595723 Oct 29 03:07:56.249057 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2620/5185] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:07:55 2022] PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 61 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:07:56.250814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2130d0ed-6331-4445-ace1-58e552631506 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:56.251421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2130d0ed-6331-4445-ace1-58e552631506 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:56.261372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2130d0ed-6331-4445-ace1-58e552631506 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:56.261885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2130d0ed-6331-4445-ace1-58e552631506 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:56.262357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2130d0ed-6331-4445-ace1-58e552631506 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:56.284924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2130d0ed-6331-4445-ace1-58e552631506 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:56.285579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2130d0ed-6331-4445-ace1-58e552631506 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:56.286064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2130d0ed-6331-4445-ace1-58e552631506 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:56.451347 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-32c50843-0bd5-4e24-b558-f594b18f236c tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.713279 Oct 29 03:07:56.452350 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2566/5186] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Oct 29 03:07:55 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:56.457952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-99f8fc68-858e-43e7-b6a9-df45ca5cb96d tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Calling method '.version_select at 0x7fe1a85b6820>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:56.949118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2130d0ed-6331-4445-ace1-58e552631506 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:56.960868 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2130d0ed-6331-4445-ace1-58e552631506 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1493 microversion: 2.1 time: 0.715137 Oct 29 03:07:56.961754 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2621/5187] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:56 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1493 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:56.964887 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-99f8fc68-858e-43e7-b6a9-df45ca5cb96d tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "DELETE /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.509913 Oct 29 03:07:56.965605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2567/5188] 10.222.0.16 () {58 vars in 1296 bytes} [Sat Oct 29 03:07:56 2022] DELETE /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata/os_version => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:07:56.973769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0d2bf98e-9d60-47aa-8832-ee0e551bb4cf tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1211153096"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:56.975746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0d2bf98e-9d60-47aa-8832-ee0e551bb4cf tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:56.984882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-73f427cc-6c01-40f8-9b51-a3e0e11e1593 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Calling method '.version_select at 0x7fe1acc43940>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:56.988399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d2bf98e-9d60-47aa-8832-ee0e551bb4cf tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:56.991898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d2bf98e-9d60-47aa-8832-ee0e551bb4cf tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:56.992653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d2bf98e-9d60-47aa-8832-ee0e551bb4cf tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:56.995152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d2bf98e-9d60-47aa-8832-ee0e551bb4cf tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:56.997399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d2bf98e-9d60-47aa-8832-ee0e551bb4cf tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:56.998098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0d2bf98e-9d60-47aa-8832-ee0e551bb4cf tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:57.042064 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-73f427cc-6c01-40f8-9b51-a3e0e11e1593 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 37 microversion: 2.1 time: 0.061877 Oct 29 03:07:57.043009 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2568/5189] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:07:56 2022] GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 37 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:07:57.053431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9f43526c-614b-484c-88eb-59cc66d595ff tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Action: 'update_all', calling method: .version_select at 0x7fe1a3f84670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:57.168248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9f43526c-614b-484c-88eb-59cc66d595ff tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:07:57.182858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9f43526c-614b-484c-88eb-59cc66d595ff tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for user 7aa28bf5c15d4a79b61bb9cae94481fb and project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:07:57.721442 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9f43526c-614b-484c-88eb-59cc66d595ff tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.672006 Oct 29 03:07:57.726326 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2569/5190] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:07:57 2022] PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 61 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:07:57.732666 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.network.security_group_api [None req-0d2bf98e-9d60-47aa-8832-ee0e551bb4cf tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Adding security group 7f2e6dbc-41b3-45fe-b29d-bf096b04c70e to port 6e0747ef-9623-4166-aeb4-afda676eb721 Oct 29 03:07:57.732816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e1d3f34-dfda-4231-864f-589b99fd6bf2 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Calling method '.version_select at 0x7fe1acc435e0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:57.800565 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1e1d3f34-dfda-4231-864f-589b99fd6bf2 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.072818 Oct 29 03:07:57.801151 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2570/5191] 10.222.0.16 () {58 vars in 1290 bytes} [Sat Oct 29 03:07:57 2022] GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata/os_distro => generated 33 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 03:07:57.812546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0d898c6a-02ba-4139-a4f9-d19b82b8d0f2 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Action: 'update_all', calling method: .version_select at 0x7fe1a8cd30d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:57.874418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:57.895381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-0d898c6a-02ba-4139-a4f9-d19b82b8d0f2 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:07:57.904519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-0d898c6a-02ba-4139-a4f9-d19b82b8d0f2 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for user 7aa28bf5c15d4a79b61bb9cae94481fb and project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:07:58.135193 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0d898c6a-02ba-4139-a4f9-d19b82b8d0f2 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.326931 Oct 29 03:07:58.136868 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2571/5192] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:07:57 2022] PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 61 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:07:58.141841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac50e92b-9647-456c-a997-b9537063007b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:58.142866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac50e92b-9647-456c-a997-b9537063007b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:58.150952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac50e92b-9647-456c-a997-b9537063007b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:58.151703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac50e92b-9647-456c-a997-b9537063007b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:58.152292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac50e92b-9647-456c-a997-b9537063007b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:58.153153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac50e92b-9647-456c-a997-b9537063007b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:58.153756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac50e92b-9647-456c-a997-b9537063007b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:58.154722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac50e92b-9647-456c-a997-b9537063007b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:58.452583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac50e92b-9647-456c-a997-b9537063007b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:58.467426 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac50e92b-9647-456c-a997-b9537063007b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1493 microversion: 2.1 time: 0.326280 Oct 29 03:07:58.470996 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2572/5193] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:58 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1493 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:58.491919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bda57e74-136c-4d49-8d19-14fb35548f16 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Calling method '.version_select at 0x7fe1acb19430>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:58.568433 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bda57e74-136c-4d49-8d19-14fb35548f16 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.091260 Oct 29 03:07:58.575072 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2573/5194] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:07:58 2022] GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 61 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:07:58.580891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e348e4b-b1f9-4c72-a0d0-fc9c6b6ebb02 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Action: 'update_all', calling method: .version_select at 0x7fe1a3f9c0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:58.698744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-0e348e4b-b1f9-4c72-a0d0-fc9c6b6ebb02 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:07:58.724831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-0e348e4b-b1f9-4c72-a0d0-fc9c6b6ebb02 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for user 7aa28bf5c15d4a79b61bb9cae94481fb and project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:07:58.967349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e348e4b-b1f9-4c72-a0d0-fc9c6b6ebb02 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.391320 Oct 29 03:07:58.967951 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2574/5195] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:07:58 2022] PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 61 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 03:07:58.982189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9fb8164f-a882-4a04-8c8a-af879916e569 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Action: 'update_all', calling method: .version_select at 0x7fe1acb19f70>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:59.153924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9fb8164f-a882-4a04-8c8a-af879916e569 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:07:59.192321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9fb8164f-a882-4a04-8c8a-af879916e569 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for user 7aa28bf5c15d4a79b61bb9cae94481fb and project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:07:59.826179 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9fb8164f-a882-4a04-8c8a-af879916e569 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 64 microversion: 2.1 time: 0.850783 Oct 29 03:07:59.828480 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2575/5196] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:07:58 2022] PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 64 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:07:59.836081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dc41a0a1-540d-4450-a374-742209e3ebad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:59.836688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dc41a0a1-540d-4450-a374-742209e3ebad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:59.857122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc41a0a1-540d-4450-a374-742209e3ebad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:59.857608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc41a0a1-540d-4450-a374-742209e3ebad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:59.858066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc41a0a1-540d-4450-a374-742209e3ebad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:59.858779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc41a0a1-540d-4450-a374-742209e3ebad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:59.859221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc41a0a1-540d-4450-a374-742209e3ebad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:59.859637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc41a0a1-540d-4450-a374-742209e3ebad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:00.078113 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0d2bf98e-9d60-47aa-8832-ee0e551bb4cf tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "POST /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b/action" status: 202 len: 0 microversion: 2.1 time: 3.113342 Oct 29 03:08:00.078728 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2622/5197] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:56 2022] POST /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b/action => generated 0 bytes in 3115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:08:00.083714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-23be6e3d-fb2b-47bc-9f38-75d55e979428 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Calling method '.version_select at 0x7fe1a333d160>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:00.100249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dc41a0a1-540d-4450-a374-742209e3ebad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:00.115669 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dc41a0a1-540d-4450-a374-742209e3ebad tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1493 microversion: 2.1 time: 0.284610 Oct 29 03:08:00.116492 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2576/5198] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:59 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1493 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:00.124000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e0808f55-94be-41a9-b24f-caf9db6bc147 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1211153096"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:00.124812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e0808f55-94be-41a9-b24f-caf9db6bc147 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:00.134193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0808f55-94be-41a9-b24f-caf9db6bc147 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:00.134987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0808f55-94be-41a9-b24f-caf9db6bc147 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:00.136128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0808f55-94be-41a9-b24f-caf9db6bc147 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:00.137461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0808f55-94be-41a9-b24f-caf9db6bc147 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:00.138209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0808f55-94be-41a9-b24f-caf9db6bc147 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:00.139241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0808f55-94be-41a9-b24f-caf9db6bc147 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:00.145586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:00.150527 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-23be6e3d-fb2b-47bc-9f38-75d55e979428 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 64 microversion: 2.1 time: 0.063210 Oct 29 03:08:00.153792 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2623/5199] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:08:00 2022] GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 64 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:00.165074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-1c565821-a998-4f3a-87a4-216454993674 req-63b3c827-968b-4d9e-aa3a-561662181e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6755720e-84ca-4767-ae13-d3934b13ff6b", "tag": "6e0747ef-9623-4166-aeb4-afda676eb721"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:00.192055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1c565821-a998-4f3a-87a4-216454993674 req-63b3c827-968b-4d9e-aa3a-561662181e5c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:00.192546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1c565821-a998-4f3a-87a4-216454993674 req-63b3c827-968b-4d9e-aa3a-561662181e5c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:00.192970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1c565821-a998-4f3a-87a4-216454993674 req-63b3c827-968b-4d9e-aa3a-561662181e5c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:00.216813 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1c565821-a998-4f3a-87a4-216454993674 req-63b3c827-968b-4d9e-aa3a-561662181e5c service nova] Creating event network-changed:6e0747ef-9623-4166-aeb4-afda676eb721 for instance 6755720e-84ca-4767-ae13-d3934b13ff6b on n-h2-862964-4 Oct 29 03:08:00.239965 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-1c565821-a998-4f3a-87a4-216454993674 req-63b3c827-968b-4d9e-aa3a-561662181e5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084545 Oct 29 03:08:00.245262 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2624/5200] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:00.260279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f9bb7c9-9c02-475d-b3db-fe6eb2ca52e4 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Action: 'update_all', calling method: .version_select at 0x7fe1a336ea60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:00.364549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5f9bb7c9-9c02-475d-b3db-fe6eb2ca52e4 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:00.379974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5f9bb7c9-9c02-475d-b3db-fe6eb2ca52e4 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for user 7aa28bf5c15d4a79b61bb9cae94481fb and project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:00.482413 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.network.security_group_api [None req-e0808f55-94be-41a9-b24f-caf9db6bc147 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Removing security group 7f2e6dbc-41b3-45fe-b29d-bf096b04c70e from port 6e0747ef-9623-4166-aeb4-afda676eb721 Oct 29 03:08:01.178745 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f9bb7c9-9c02-475d-b3db-fe6eb2ca52e4 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.931828 Oct 29 03:08:01.179494 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2625/5201] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:08:00 2022] PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 61 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:01.225305 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e0808f55-94be-41a9-b24f-caf9db6bc147 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "POST /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b/action" status: 202 len: 0 microversion: 2.1 time: 1.106749 Oct 29 03:08:01.226104 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2577/5202] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:08:00 2022] POST /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b/action => generated 0 bytes in 1108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:08:01.231429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-114c010f-b10f-4c57-9ffe-ea4c27aaf0c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:01.232031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-114c010f-b10f-4c57-9ffe-ea4c27aaf0c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:01.245569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-114c010f-b10f-4c57-9ffe-ea4c27aaf0c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:01.246587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-114c010f-b10f-4c57-9ffe-ea4c27aaf0c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:01.255408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-114c010f-b10f-4c57-9ffe-ea4c27aaf0c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:01.256909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-114c010f-b10f-4c57-9ffe-ea4c27aaf0c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:01.257590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-114c010f-b10f-4c57-9ffe-ea4c27aaf0c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:01.258549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-114c010f-b10f-4c57-9ffe-ea4c27aaf0c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:01.377107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-114c010f-b10f-4c57-9ffe-ea4c27aaf0c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:01.386925 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-114c010f-b10f-4c57-9ffe-ea4c27aaf0c1 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 200 len: 1451 microversion: 2.1 time: 0.159677 Oct 29 03:08:01.388594 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2578/5203] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:01 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:01.394396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5ab8a90-7905-4b40-8bbe-d677affc7680 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Action: 'update', calling method: .version_select at 0x7fe1a85b6670>, body: {"meta": {"os_version": "alt"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:01.474106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f8d5761c-40e7-4ef9-a2ad-e18663109114 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Action: 'create', calling method: .version_select at 0x7fe1a3358ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-298811870", "metadata": {"Type": "work"}}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f8d5761c-40e7-4ef9-a2ad-e18663109114 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Request method failure captured: Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 121 Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJkQ_uScYSeG5wT38aOylZMWR_z414jJ_oYSeMr4LphpfqknPTeyKVqnCVXIF0xw6Z4fsmJZ-ZexXspY9hP5gfkPrBhw8n1aM7YLVqfpGPTYJC555FWxl5nOzQxEzMrL_MKdhuGddWloKEzaeUrXNWKuxtDML0W5CkXC1UzLpnvZu9E Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_501eac100a614a719b6ccdaffee756ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}] Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: ffebad20b25a4c49b625e9198eb6530f Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-298811870", "metadata": {"Type": "work"}}} Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-298811870', 'metadata': {'Type': 'work'}}}} Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi '#$%' Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:08:01.490980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.496605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f8d5761c-40e7-4ef9-a2ad-e18663109114 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:01.497592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f5ab8a90-7905-4b40-8bbe-d677affc7680 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:01.497698 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f8d5761c-40e7-4ef9-a2ad-e18663109114 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.315589 Oct 29 03:08:01.497698 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2626/5204] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:08:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 317 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:08:01.510874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f5ab8a90-7905-4b40-8bbe-d677affc7680 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for user 7aa28bf5c15d4a79b61bb9cae94481fb and project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:01.514477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c5e56908-5f0c-4f41-8bf1-852062624b90 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Action: 'create', calling method: .version_select at 0x7fe1a3366c10>, body: {"pool": null} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:01.929459 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5ab8a90-7905-4b40-8bbe-d677affc7680 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.538787 Oct 29 03:08:01.930015 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2579/5205] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Oct 29 03:08:01 2022] PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata/os_version => generated 31 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:01.935330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-830cf5f3-d907-4c12-9041-8ac66dc018b0 req-041cc043-5e5f-4b4e-b74d-02b5d73298f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6755720e-84ca-4767-ae13-d3934b13ff6b", "tag": "6e0747ef-9623-4166-aeb4-afda676eb721"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:01.948598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-830cf5f3-d907-4c12-9041-8ac66dc018b0 req-041cc043-5e5f-4b4e-b74d-02b5d73298f8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:01.949896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-830cf5f3-d907-4c12-9041-8ac66dc018b0 req-041cc043-5e5f-4b4e-b74d-02b5d73298f8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:01.950496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-830cf5f3-d907-4c12-9041-8ac66dc018b0 req-041cc043-5e5f-4b4e-b74d-02b5d73298f8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:01.964771 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-830cf5f3-d907-4c12-9041-8ac66dc018b0 req-041cc043-5e5f-4b4e-b74d-02b5d73298f8 service nova] Creating event network-changed:6e0747ef-9623-4166-aeb4-afda676eb721 for instance 6755720e-84ca-4767-ae13-d3934b13ff6b on n-h2-862964-4 Oct 29 03:08:01.971349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-830cf5f3-d907-4c12-9041-8ac66dc018b0 req-041cc043-5e5f-4b4e-b74d-02b5d73298f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039851 Oct 29 03:08:01.972516 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2580/5206] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:01.979016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-96dec7f0-6a18-48bc-81a8-1d794da7c951 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Action: 'create', calling method: .version_select at 0x7fe1accceca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-669456671", "metadata": {"Type": "work"}}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-96dec7f0-6a18-48bc-81a8-1d794da7c951 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Request method failure captured: Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 119 Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJkQ_uScYSeG5wT38aOylZMWR_z414jJ_oYSeMr4LphpfqknPTeyKVqnCVXIF0xw6Z4fsmJZ-ZexXspY9hP5gfkPrBhw8n1aM7YLVqfpGPTYJC555FWxl5nOzQxEzMrL_MKdhuGddWloKEzaeUrXNWKuxtDML0W5CkXC1UzLpnvZu9E Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_501eac100a614a719b6ccdaffee756ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}] Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: ffebad20b25a4c49b625e9198eb6530f Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-669456671", "metadata": {"Type": "work"}}} Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-669456671', 'metadata': {'Type': 'work'}}}} Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi '0' Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:08:01.984025 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-96dec7f0-6a18-48bc-81a8-1d794da7c951 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-96dec7f0-6a18-48bc-81a8-1d794da7c951 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011442 Oct 29 03:08:01.990753 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2581/5207] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:08:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:08:01.998550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d3be00a8-8787-4667-bc59-c20824cd9adf tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Calling method '.version_select at 0x7fe1a80528b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:02.060880 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d3be00a8-8787-4667-bc59-c20824cd9adf tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 58 microversion: 2.1 time: 0.073850 Oct 29 03:08:02.061731 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2582/5208] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:08:01 2022] GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 58 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:02.068607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9c8c5de-ae59-4fe3-bb96-08e9ec00b51b tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Action: 'create', calling method: .version_select at 0x7fe1accce9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1992268156", "metadata": {"Type": "work"}}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9c8c5de-ae59-4fe3-bb96-08e9ec00b51b tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Request method failure captured: Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 119 Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJkQ_uScYSeG5wT38aOylZMWR_z414jJ_oYSeMr4LphpfqknPTeyKVqnCVXIF0xw6Z4fsmJZ-ZexXspY9hP5gfkPrBhw8n1aM7YLVqfpGPTYJC555FWxl5nOzQxEzMrL_MKdhuGddWloKEzaeUrXNWKuxtDML0W5CkXC1UzLpnvZu9E Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_501eac100a614a719b6ccdaffee756ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}] Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: ffebad20b25a4c49b625e9198eb6530f Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1992268156", "metadata": {"Type": "work"}}} Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1992268156', 'metadata': {'Type': 'work'}}}} Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi '' Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:08:02.072834 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:08:02.077686 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 03:08:02.077686 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.077686 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:02.077686 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.077686 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:02.077686 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:02.077686 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:02.077686 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:08:02.077686 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:08:02.077686 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 03:08:02.077686 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.079342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9c8c5de-ae59-4fe3-bb96-08e9ec00b51b tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:02.080511 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9c8c5de-ae59-4fe3-bb96-08e9ec00b51b tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017537 Oct 29 03:08:02.081512 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2583/5209] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:08:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:08:02.088447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-45e79c7b-dd7a-46fd-a7e4-9c0d97991d80 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Action: 'update_all', calling method: .version_select at 0x7fe1a3f73dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:02.155245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-45e79c7b-dd7a-46fd-a7e4-9c0d97991d80 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:02.161792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-45e79c7b-dd7a-46fd-a7e4-9c0d97991d80 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for user 7aa28bf5c15d4a79b61bb9cae94481fb and project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:02.524659 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-45e79c7b-dd7a-46fd-a7e4-9c0d97991d80 tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.441427 Oct 29 03:08:02.525335 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2584/5210] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:08:02 2022] PUT /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 61 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:02.532592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-82b055c1-62d2-4762-80da-3cf9ce34b1ea tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Calling method '.version_select at 0x7fe1accceca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:02.574119 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-82b055c1-62d2-4762-80da-3cf9ce34b1ea tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] HTTP exception thrown: Volume tempest-invalid-708642504 could not be found. Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-82b055c1-62d2-4762-80da-3cf9ce34b1ea tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Request method failure captured: Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-708642504 HTTP/1.1 Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJkQ_uScYSeG5wT38aOylZMWR_z414jJ_oYSeMr4LphpfqknPTeyKVqnCVXIF0xw6Z4fsmJZ-ZexXspY9hP5gfkPrBhw8n1aM7YLVqfpGPTYJC555FWxl5nOzQxEzMrL_MKdhuGddWloKEzaeUrXNWKuxtDML0W5CkXC1UzLpnvZu9E Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_501eac100a614a719b6ccdaffee756ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}] Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: ffebad20b25a4c49b625e9198eb6530f Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: exception: Volume tempest-invalid-708642504 could not be found. Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'tempest-invalid-708642504'} Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-708642504 could not be found. (HTTP 404) (Request-ID: req-784aec0f-b72e-4e28-b886-c8b9e5c0e704) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:08:02.590312 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-708642504 could not be found. Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-708642504 could not be found. Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-708642504 could not be found. Oct 29 03:08:02.595429 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.600352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-82b055c1-62d2-4762-80da-3cf9ce34b1ea tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Returning 404 to user: Volume tempest-invalid-708642504 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:02.601167 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-82b055c1-62d2-4762-80da-3cf9ce34b1ea tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-708642504" status: 404 len: 98 microversion: 2.1 time: 0.074708 Oct 29 03:08:02.602015 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2585/5211] 10.222.0.16 () {58 vars in 1215 bytes} [Sat Oct 29 03:08:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-708642504 => generated 98 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:08:02.608225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:02.614194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:02.633789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:02.636959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:02.639537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:02.640494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:02.642167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:02.643777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:02.673100 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f HTTP/1.1 Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '165e6cff-b0bf-43bc-a406-bb5b4b42d28f'} Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.684734 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:02.690684 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:02.690684 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:02.690684 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:02.690684 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:02.690684 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:02.690684 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:02.691932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:02.694231 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-87d9829e-2c28-438c-b5c8-63c7b96d3856 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 404 len: 111 microversion: 2.1 time: 0.090852 Oct 29 03:08:02.699336 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2586/5212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:02 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:02.718883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e3cc03e7-9423-43c2-a40c-949c7a48d6ad tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Action: 'create', calling method: .version_select at 0x7fe1acc080d0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:02.810614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-e3cc03e7-9423-43c2-a40c-949c7a48d6ad tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:02.825792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-e3cc03e7-9423-43c2-a40c-949c7a48d6ad tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Getting quotas for user 7aa28bf5c15d4a79b61bb9cae94481fb and project ac55b5631b734e7283ed3ddd685b061e. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:03.320909 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e3cc03e7-9423-43c2-a40c-949c7a48d6ad tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "POST /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 85 microversion: 2.1 time: 0.619510 Oct 29 03:08:03.321521 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2587/5213] 10.222.0.16 () {60 vars in 1281 bytes} [Sat Oct 29 03:08:02 2022] POST /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 85 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:03.330818 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ebc4162-4873-4bac-b77b-975b0c122ade tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005531 Oct 29 03:08:03.335534 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2588/5214] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Oct 29 03:08:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 03:08:03.352576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4950d85b-c556-47e8-b066-299b39ea0b24 req-cff6182f-0baf-4e10-8837-0fd432ed290b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165e6cff-b0bf-43bc-a406-bb5b4b42d28f", "name": "network-vif-deleted", "tag": "04076300-ddba-4df7-bb7e-cd90ee203828"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:03.373796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4950d85b-c556-47e8-b066-299b39ea0b24 req-cff6182f-0baf-4e10-8837-0fd432ed290b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:03.381247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4950d85b-c556-47e8-b066-299b39ea0b24 req-cff6182f-0baf-4e10-8837-0fd432ed290b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:03.381922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4950d85b-c556-47e8-b066-299b39ea0b24 req-cff6182f-0baf-4e10-8837-0fd432ed290b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:03.409576 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4950d85b-c556-47e8-b066-299b39ea0b24 req-cff6182f-0baf-4e10-8837-0fd432ed290b service nova] Creating event network-vif-deleted:04076300-ddba-4df7-bb7e-cd90ee203828 for instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f on n-h2-862964-4 Oct 29 03:08:03.415565 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4950d85b-c556-47e8-b066-299b39ea0b24 req-cff6182f-0baf-4e10-8837-0fd432ed290b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078345 Oct 29 03:08:03.417555 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2589/5215] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:03.424685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:03.425646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:03.435949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:03.438060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:03.438963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:03.440700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:03.442379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:03.443089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:03.461607 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f HTTP/1.1 Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '165e6cff-b0bf-43bc-a406-bb5b4b42d28f'} Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:03.464560 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:03.468558 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:03.468558 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:03.468558 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:03.468558 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:03.468558 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:03.468558 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:03.468558 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:03.468558 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:03.468558 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:03.468558 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:03.473079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:03.475155 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54b118eb-929c-4071-ae3a-68e094241193 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 404 len: 111 microversion: 2.1 time: 0.055453 Oct 29 03:08:03.476318 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2590/5216] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:03 2022] DELETE /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:03.484821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8470b17e-89c8-4714-b14f-39333a76306a tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] Calling method '.version_select at 0x7fe1acc081f0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:03.546627 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8470b17e-89c8-4714-b14f-39333a76306a tempest-ImagesMetadataTestJSON-533766026 tempest-ImagesMetadataTestJSON-533766026-project] 10.222.0.16 "GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata" status: 200 len: 85 microversion: 2.1 time: 0.068960 Oct 29 03:08:03.553683 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2591/5217] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:08:03 2022] GET /compute/v2.1/images/0fee7b12-8a2e-4f32-bc90-920f6060b7cc/metadata => generated 85 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:03.560490 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bd5bc8ad-4061-41ca-b9ab-b11bb1a3dcbd tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005243 Oct 29 03:08:03.561390 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2592/5218] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 03:08:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 03:08:03.582992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:03.583956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 165e6cff-b0bf-43bc-a406-bb5b4b42d28f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:03.593641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:03.594594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:03.595282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:03.596220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:03.596994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:03.597644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:03.628913 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f HTTP/1.1 Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '165e6cff-b0bf-43bc-a406-bb5b4b42d28f'} Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:03.632102 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:03.636394 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:03.636394 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:03.636394 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:03.636394 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:03.636394 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. Oct 29 03:08:03.636394 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:03.637638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 165e6cff-b0bf-43bc-a406-bb5b4b42d28f could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:03.638657 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-44ad5be0-d94e-4c70-88b1-d0cfb4ded62e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f" status: 404 len: 111 microversion: 2.1 time: 0.072266 Oct 29 03:08:03.640334 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2593/5219] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:03 2022] GET /compute/v2.1/servers/165e6cff-b0bf-43bc-a406-bb5b4b42d28f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:03.646580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7a435aa6-8109-472e-85ab-a7aa580362d1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:03.648223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7a435aa6-8109-472e-85ab-a7aa580362d1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:03.658088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a435aa6-8109-472e-85ab-a7aa580362d1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:03.658967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a435aa6-8109-472e-85ab-a7aa580362d1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:03.659654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a435aa6-8109-472e-85ab-a7aa580362d1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:03.661694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a435aa6-8109-472e-85ab-a7aa580362d1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:03.662445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a435aa6-8109-472e-85ab-a7aa580362d1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:03.663262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a435aa6-8109-472e-85ab-a7aa580362d1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:04.709106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7a435aa6-8109-472e-85ab-a7aa580362d1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:04.729853 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7a435aa6-8109-472e-85ab-a7aa580362d1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 1.087924 Oct 29 03:08:04.742678 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2594/5220] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:03 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:04.757685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fe390e38-c0cd-4508-8651-ec203639c260 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Calling method '.version_select at 0x7fe1a85b6310>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:04.814111 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-fe390e38-c0cd-4508-8651-ec203639c260 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] HTTP exception thrown: Volume c9c2b5a1-bcad-49a2-9684-d1fe82214d59 could not be found. Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fe390e38-c0cd-4508-8651-ec203639c260 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Request method failure captured: Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-volumes/c9c2b5a1-bcad-49a2-9684-d1fe82214d59 HTTP/1.1 Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJkQ_uScYSeG5wT38aOylZMWR_z414jJ_oYSeMr4LphpfqknPTeyKVqnCVXIF0xw6Z4fsmJZ-ZexXspY9hP5gfkPrBhw8n1aM7YLVqfpGPTYJC555FWxl5nOzQxEzMrL_MKdhuGddWloKEzaeUrXNWKuxtDML0W5CkXC1UzLpnvZu9E Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_501eac100a614a719b6ccdaffee756ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}] Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: ffebad20b25a4c49b625e9198eb6530f Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: exception: Volume c9c2b5a1-bcad-49a2-9684-d1fe82214d59 could not be found. Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'c9c2b5a1-bcad-49a2-9684-d1fe82214d59'} Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9c2b5a1-bcad-49a2-9684-d1fe82214d59 could not be found. (HTTP 404) (Request-ID: req-e3316e66-5ee5-4b29-9cac-b518182ef950) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:08:04.816477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9c2b5a1-bcad-49a2-9684-d1fe82214d59 could not be found. Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9c2b5a1-bcad-49a2-9684-d1fe82214d59 could not be found. Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9c2b5a1-bcad-49a2-9684-d1fe82214d59 could not be found. Oct 29 03:08:04.820324 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.827781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fe390e38-c0cd-4508-8651-ec203639c260 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Returning 404 to user: Volume c9c2b5a1-bcad-49a2-9684-d1fe82214d59 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:04.829862 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fe390e38-c0cd-4508-8651-ec203639c260 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/c9c2b5a1-bcad-49a2-9684-d1fe82214d59" status: 404 len: 109 microversion: 2.1 time: 0.084636 Oct 29 03:08:04.830983 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2595/5221] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:08:04 2022] DELETE /compute/v2.1/os-volumes/c9c2b5a1-bcad-49a2-9684-d1fe82214d59 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:04.839292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:04.846747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:04.866819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:04.868162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:04.868832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:04.871517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:04.872376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:04.876930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:04.909790 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b HTTP/1.1 Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b'} Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:04.913436 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:08:04.917985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.917985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:04.917985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.917985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:04.917985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:04.917985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:04.917985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:04.917985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:04.917985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:08:04.917985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:04.920482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:04.921603 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f93b1279-0ab0-4dd1-974d-fc9bf7762192 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 404 len: 111 microversion: 2.1 time: 0.089448 Oct 29 03:08:04.922693 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2596/5222] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:04 2022] DELETE /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:04.928416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-99330d94-570d-4154-ac54-22dcff8c0375 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:04.929599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-99330d94-570d-4154-ac54-22dcff8c0375 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:04.942970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99330d94-570d-4154-ac54-22dcff8c0375 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:04.943722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99330d94-570d-4154-ac54-22dcff8c0375 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:04.944392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99330d94-570d-4154-ac54-22dcff8c0375 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:04.945747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99330d94-570d-4154-ac54-22dcff8c0375 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:04.946464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99330d94-570d-4154-ac54-22dcff8c0375 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:04.947106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-99330d94-570d-4154-ac54-22dcff8c0375 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:05.467147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-99330d94-570d-4154-ac54-22dcff8c0375 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:05.478351 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-99330d94-570d-4154-ac54-22dcff8c0375 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.554325 Oct 29 03:08:05.479748 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2597/5223] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:04 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:05.491656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-511115cf-5744-4d0f-99e0-3e38954dda51 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Calling method '.version_select at 0x7fe1accced30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:05.533997 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c5e56908-5f0c-4f41-8bf1-852062624b90 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.028885 Oct 29 03:08:05.535268 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2627/5224] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Oct 29 03:08:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:05.540642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:05.542192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:05.558093 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-511115cf-5744-4d0f-99e0-3e38954dda51 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] HTTP exception thrown: Volume 1718ec0b-462f-40cc-ac59-e25abd7780a3 could not be found. Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-511115cf-5744-4d0f-99e0-3e38954dda51 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Request method failure captured: Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-volumes/1718ec0b-462f-40cc-ac59-e25abd7780a3 HTTP/1.1 Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJkQ_uScYSeG5wT38aOylZMWR_z414jJ_oYSeMr4LphpfqknPTeyKVqnCVXIF0xw6Z4fsmJZ-ZexXspY9hP5gfkPrBhw8n1aM7YLVqfpGPTYJC555FWxl5nOzQxEzMrL_MKdhuGddWloKEzaeUrXNWKuxtDML0W5CkXC1UzLpnvZu9E Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_501eac100a614a719b6ccdaffee756ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/501eac100a614a719b6ccdaffee756ff"}]}] Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 501eac100a614a719b6ccdaffee756ff Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesNegativeTest-1072765188 Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: ffebad20b25a4c49b625e9198eb6530f Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesNegativeTest-1072765188-project Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: exception: Volume 1718ec0b-462f-40cc-ac59-e25abd7780a3 could not be found. Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1718ec0b-462f-40cc-ac59-e25abd7780a3'} Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1718ec0b-462f-40cc-ac59-e25abd7780a3 could not be found. (HTTP 404) (Request-ID: req-00b8deba-1e41-44d4-9b67-9a7cf1fd14bc) Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:08:05.560920 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1718ec0b-462f-40cc-ac59-e25abd7780a3 could not be found. Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1718ec0b-462f-40cc-ac59-e25abd7780a3 could not be found. Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1718ec0b-462f-40cc-ac59-e25abd7780a3 could not be found. Oct 29 03:08:05.566076 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.572611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-511115cf-5744-4d0f-99e0-3e38954dda51 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] Returning 404 to user: Volume 1718ec0b-462f-40cc-ac59-e25abd7780a3 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:05.573063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:05.574056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:05.574473 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-511115cf-5744-4d0f-99e0-3e38954dda51 tempest-VolumesNegativeTest-1072765188 tempest-VolumesNegativeTest-1072765188-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1718ec0b-462f-40cc-ac59-e25abd7780a3" status: 404 len: 109 microversion: 2.1 time: 0.092852 Oct 29 03:08:05.574740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:05.575566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:05.575714 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2598/5225] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:05 2022] GET /compute/v2.1/os-volumes/1718ec0b-462f-40cc-ac59-e25abd7780a3 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:05.576458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:05.577265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:05.583894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6182485c-b762-4caf-baa3-68d75dcb5c55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:05.584498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6182485c-b762-4caf-baa3-68d75dcb5c55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:05.593396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6182485c-b762-4caf-baa3-68d75dcb5c55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:05.594355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6182485c-b762-4caf-baa3-68d75dcb5c55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:05.597319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6182485c-b762-4caf-baa3-68d75dcb5c55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:05.598942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6182485c-b762-4caf-baa3-68d75dcb5c55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:05.599581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6182485c-b762-4caf-baa3-68d75dcb5c55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:05.601332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6182485c-b762-4caf-baa3-68d75dcb5c55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:05.639974 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b HTTP/1.1 Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b'} Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.654599 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:05.658800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:05.658800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:05.658800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:05.658800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:05.658800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. Oct 29 03:08:05.658800 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:05.658800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:05.658800 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79ae73a7-7e32-4bba-ada7-31d54760d949 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b" status: 404 len: 111 microversion: 2.1 time: 0.119610 Oct 29 03:08:05.658800 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2628/5226] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:05 2022] GET /compute/v2.1/servers/c8ab415d-d065-44c6-b3d9-5fb89ffe9c1b => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:05.665029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.228"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:05.668738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:05.718354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:05.718913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:05.719358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:05.723861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:05.724586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:05.725244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:05.801896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "refresh_cache-6755720e-84ca-4767-ae13-d3934b13ff6b" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 03:08:05.802699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquired lock "refresh_cache-6755720e-84ca-4767-ae13-d3934b13ff6b" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 03:08:06.493756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6182485c-b762-4caf-baa3-68d75dcb5c55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:06.510670 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6182485c-b762-4caf-baa3-68d75dcb5c55 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.933780 Oct 29 03:08:06.511569 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2599/5227] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:05 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:06.525159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:06.526225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:06.532793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:06.549041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:06.549041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:06.549041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:06.549041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:06.549041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:06.572500 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da HTTP/1.1 Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'd7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da'} Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:06.574323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:08:06.579411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:06.579411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:06.579411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:06.579411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:06.579411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:06.579411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:06.579411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:06.579411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:06.579411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:08:06.579411 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:06.580220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:06.581303 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b531d008-48b8-4d88-b5db-eb7ac61ad7d9 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 404 len: 111 microversion: 2.1 time: 0.068652 Oct 29 03:08:06.587776 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2600/5228] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:06 2022] DELETE /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:06.606893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-106104f2-bb28-4858-823d-cefbb1e37d7e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:06.607582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-106104f2-bb28-4858-823d-cefbb1e37d7e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:06.619944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-106104f2-bb28-4858-823d-cefbb1e37d7e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:06.620437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-106104f2-bb28-4858-823d-cefbb1e37d7e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:06.620871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-106104f2-bb28-4858-823d-cefbb1e37d7e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:06.621581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-106104f2-bb28-4858-823d-cefbb1e37d7e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:06.622069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-106104f2-bb28-4858-823d-cefbb1e37d7e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:06.622484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-106104f2-bb28-4858-823d-cefbb1e37d7e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.135202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-106104f2-bb28-4858-823d-cefbb1e37d7e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:07.143904 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-106104f2-bb28-4858-823d-cefbb1e37d7e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.554353 Oct 29 03:08:07.144541 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2601/5229] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:06 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:07.150080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:07.150978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:07.157526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:07.158224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:07.158913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.159912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:07.160517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:07.161142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.203231 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da HTTP/1.1 Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'd7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da'} Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.207325 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:07.212248 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:07.212248 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:07.212248 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:07.212248 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:07.212248 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. Oct 29 03:08:07.212248 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.212248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:07.212248 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f49d2fd1-ebf4-4fec-9419-9698678b144b tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da" status: 404 len: 111 microversion: 2.1 time: 0.065241 Oct 29 03:08:07.215065 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2602/5230] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:07 2022] GET /compute/v2.1/servers/d7cc9a0d-cf9f-49b4-9757-0ce24f9dd6da => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:07.229089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:07.229601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:07.242050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:07.242991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:07.245642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.247482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:07.248952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:07.250472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.274312 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 HTTP/1.1 Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '54089ec6-4554-46bf-a61c-4a3423ae07f4'} Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:07.276989 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:08:07.283428 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.283428 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:07.283428 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.283428 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:07.283428 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:07.283428 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:07.283428 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:07.283428 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:07.283428 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:08:07.283428 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.289310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:07.304911 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7dba4aae-7b52-4a51-857a-590efe249d8a tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 404 len: 111 microversion: 2.1 time: 0.075385 Oct 29 03:08:07.307332 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2603/5231] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:07 2022] DELETE /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:07.316826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:07.318311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 54089ec6-4554-46bf-a61c-4a3423ae07f4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:07.327431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:07.328650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:07.329466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.330551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:07.331246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:07.332322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.370856 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 HTTP/1.1 Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '54089ec6-4554-46bf-a61c-4a3423ae07f4'} Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.378721 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:07.388029 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:07.388029 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:07.388029 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:07.388029 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:07.388029 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. Oct 29 03:08:07.388029 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:07.388029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 54089ec6-4554-46bf-a61c-4a3423ae07f4 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:07.388029 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-84892f78-122d-4e85-bc6e-e46862f17e0e tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4" status: 404 len: 111 microversion: 2.1 time: 0.069601 Oct 29 03:08:07.388029 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2604/5232] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:07 2022] GET /compute/v2.1/servers/54089ec6-4554-46bf-a61c-4a3423ae07f4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:07.406838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1352762983", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "c699032f-5e15-4569-a5f2-71386fa3ff27"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:07.514754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] validate_networks() for [('c699032f-5e15-4569-a5f2-71386fa3ff27', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:08:08.070295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Building network info cache for instance {{(pid=127042) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 03:08:09.384406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Updating instance_info_cache with network_info: [{"id": "6e0747ef-9623-4166-aeb4-afda676eb721", "address": "fa:16:3e:9a:d4:f4", "network": {"id": "3406d6cf-1c47-4993-81ad-538ca7bf7fac", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-182684075-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "173e87fac5564c2db6ccff6fc14e0520", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6e0747ef-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127042) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 03:08:09.404939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:08:09.405499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:08:09.405837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:08:09.406345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:08:09.406763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:08:09.426628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Releasing lock "refresh_cache-6755720e-84ca-4767-ae13-d3934b13ff6b" {{(pid=127042) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 03:08:09.427505 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2053ec8e-1c7b-4500-b441-2975bdb6e55f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "POST /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b/action" status: 202 len: 0 microversion: 2.1 time: 3.768782 Oct 29 03:08:09.428120 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2629/5233] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:08:05 2022] POST /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b/action => generated 0 bytes in 3770 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 03:08:09.433650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:09.434548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:09.437916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:09.438571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:09.441040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:09.442797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:09.444318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:09.450594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:09.471203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:09.473504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:09.474001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:09.474787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:09.477641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:09.478391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:09.496382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for project d4193e4464b7488b9b3bb4064afb0288. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:09.519606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for user dc4e17d222e0426698d1ef9a17921d64 and project d4193e4464b7488b9b3bb4064afb0288. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:09.522916 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 HTTP/1.1 Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '95d304e2-1429-4040-abb7-142f54881823'} Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:09.529672 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:08:09.534497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:09.534497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:09.534497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:09.534497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:09.534497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:09.534497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:09.534497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:09.534497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:09.534497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:08:09.534497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:09.540073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:09.542378 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bd05b39e-7e99-417e-a76a-047924a39939 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 404 len: 111 microversion: 2.1 time: 0.113104 Oct 29 03:08:09.543576 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2630/5234] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:09 2022] DELETE /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:09.558892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-664e3a91-0d6d-4110-bd64-c6b308815cbe req-ce189e11-961f-4a11-9fc5-1d5473ee1899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6755720e-84ca-4767-ae13-d3934b13ff6b", "tag": "6e0747ef-9623-4166-aeb4-afda676eb721"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:09.566717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:08:09.571787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:09.599929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-664e3a91-0d6d-4110-bd64-c6b308815cbe req-ce189e11-961f-4a11-9fc5-1d5473ee1899 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:09.600560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-664e3a91-0d6d-4110-bd64-c6b308815cbe req-ce189e11-961f-4a11-9fc5-1d5473ee1899 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:09.600999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-664e3a91-0d6d-4110-bd64-c6b308815cbe req-ce189e11-961f-4a11-9fc5-1d5473ee1899 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:09.637750 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-664e3a91-0d6d-4110-bd64-c6b308815cbe req-ce189e11-961f-4a11-9fc5-1d5473ee1899 service nova] Creating event network-changed:6e0747ef-9623-4166-aeb4-afda676eb721 for instance 6755720e-84ca-4767-ae13-d3934b13ff6b on n-h2-862964-4 Oct 29 03:08:09.652307 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-664e3a91-0d6d-4110-bd64-c6b308815cbe req-ce189e11-961f-4a11-9fc5-1d5473ee1899 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105348 Oct 29 03:08:09.652935 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2631/5235] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:09.662651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-11612e4b-3e88-48bb-8ba5-ec3dbe9b739e tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a336eaf0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:09.710105 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.327292 Oct 29 03:08:09.720679 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2605/5236] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:08:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:08:09.723610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:09.725244 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-01b33b79-5370-4344-bd99-3229e3767bd4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002888 Oct 29 03:08:09.726638 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2606/5237] 10.222.0.16 () {56 vars in 886 bytes} [Sat Oct 29 03:08:09 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 03:08:09.734150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.228"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:09.752307 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-11612e4b-3e88-48bb-8ba5-ec3dbe9b739e tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/e05761a2-07fa-41b1-846e-3c9d6ce0904f" status: 200 len: 662 microversion: 2.1 time: 0.097317 Oct 29 03:08:09.752896 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2632/5238] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:09 2022] GET /compute/v2.1/images/e05761a2-07fa-41b1-846e-3c9d6ce0904f => generated 662 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:09.769180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:09.769949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 95d304e2-1429-4040-abb7-142f54881823] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:09.793556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:09.794518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:09.795284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:09.799289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:09.799976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:09.800572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:09.835452 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 HTTP/1.1 Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '95d304e2-1429-4040-abb7-142f54881823'} Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:09.848758 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:09.853580 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:09.853580 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:09.853580 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:09.853580 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:09.853580 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. Oct 29 03:08:09.853580 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:09.853580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 95d304e2-1429-4040-abb7-142f54881823 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:09.853580 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d196870c-70b3-4690-9d9c-4e429a650139 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823" status: 404 len: 111 microversion: 2.1 time: 0.094868 Oct 29 03:08:09.853580 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2633/5239] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:09 2022] GET /compute/v2.1/servers/95d304e2-1429-4040-abb7-142f54881823 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:09.875844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ffc837a7-092e-4990-a47e-e2b69886715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:09.880978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ffc837a7-092e-4990-a47e-e2b69886715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:09.985957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ffc837a7-092e-4990-a47e-e2b69886715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:09.993753 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ffc837a7-092e-4990-a47e-e2b69886715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1215 microversion: 2.1 time: 0.141965 Oct 29 03:08:09.994423 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2634/5240] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:09 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:10.007348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0f05621-bfab-40c4-b364-2dce142fabb5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a333c0d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:10.094461 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b0f05621-bfab-40c4-b364-2dce142fabb5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/e05761a2-07fa-41b1-846e-3c9d6ce0904f" status: 200 len: 662 microversion: 2.1 time: 0.098981 Oct 29 03:08:10.095718 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2635/5241] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:09 2022] GET /compute/v2.1/images/e05761a2-07fa-41b1-846e-3c9d6ce0904f => generated 662 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:10.108918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:10.109834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:10.121638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.127651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.128357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.129309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.130240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.131303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.190808 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb HTTP/1.1 Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '796202dc-3a57-414c-bb69-53b9dbeb8fcb'} Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:10.192653 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:08:10.196840 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.196840 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:10.196840 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.196840 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.196840 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:10.196840 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:10.196840 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:10.196840 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:10.196840 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:08:10.196840 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.198416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:10.199458 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c20ec52b-22b5-4449-b5f5-c3e3ed15f649 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 404 len: 111 microversion: 2.1 time: 0.102555 Oct 29 03:08:10.202603 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2636/5242] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:10 2022] DELETE /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:10.211723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:10.219081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 796202dc-3a57-414c-bb69-53b9dbeb8fcb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:10.238466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.245449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.247015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.250819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.252456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.253734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.288470 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb HTTP/1.1 Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '796202dc-3a57-414c-bb69-53b9dbeb8fcb'} Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.290058 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.297770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:10.297770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:10.297770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:10.297770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:10.297770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. Oct 29 03:08:10.297770 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.297770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 796202dc-3a57-414c-bb69-53b9dbeb8fcb could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:10.297770 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-17b2b7d4-e829-4e3e-8d9a-61a2ffbf7900 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb" status: 404 len: 111 microversion: 2.1 time: 0.083590 Oct 29 03:08:10.303836 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2637/5243] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:10 2022] GET /compute/v2.1/servers/796202dc-3a57-414c-bb69-53b9dbeb8fcb => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:10.308743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2de6a422-2204-4cca-9273-bf5d4e12ea24 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:10.315434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2de6a422-2204-4cca-9273-bf5d4e12ea24 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:10.329521 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-2de6a422-2204-4cca-9273-bf5d4e12ea24 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2de6a422-2204-4cca-9273-bf5d4e12ea24 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 HTTP/1.1 Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3b74d997-be16-4f01-aba0-2b1bb0f0b5d0'} Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:10.334258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.340623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.340623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:10.340623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:10.340623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:10.340623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:10.340623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:08:10.340623 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.346300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2de6a422-2204-4cca-9273-bf5d4e12ea24 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:10.347428 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2de6a422-2204-4cca-9273-bf5d4e12ea24 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3b74d997-be16-4f01-aba0-2b1bb0f0b5d0" status: 404 len: 111 microversion: 2.1 time: 0.042586 Oct 29 03:08:10.348499 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2638/5244] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:10 2022] DELETE /compute/v2.1/servers/3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:10.358647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a240104f-3083-4a21-a111-521a155289d4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:10.362488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a240104f-3083-4a21-a111-521a155289d4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:10.373481 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a240104f-3083-4a21-a111-521a155289d4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a240104f-3083-4a21-a111-521a155289d4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 HTTP/1.1 Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3b74d997-be16-4f01-aba0-2b1bb0f0b5d0'} Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:10.384177 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:10.388828 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:10.388828 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:10.388828 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. Oct 29 03:08:10.388828 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:10.390847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a240104f-3083-4a21-a111-521a155289d4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:10.392191 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a240104f-3083-4a21-a111-521a155289d4 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3b74d997-be16-4f01-aba0-2b1bb0f0b5d0" status: 404 len: 111 microversion: 2.1 time: 0.039761 Oct 29 03:08:10.393445 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2639/5245] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:10 2022] GET /compute/v2.1/servers/3b74d997-be16-4f01-aba0-2b1bb0f0b5d0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:10.402935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f883c95-6815-480a-b881-096b53f7f5bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:10.406461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f883c95-6815-480a-b881-096b53f7f5bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:10.428654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f883c95-6815-480a-b881-096b53f7f5bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.429154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f883c95-6815-480a-b881-096b53f7f5bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.429786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f883c95-6815-480a-b881-096b53f7f5bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.430723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f883c95-6815-480a-b881-096b53f7f5bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.431336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f883c95-6815-480a-b881-096b53f7f5bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.432161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f883c95-6815-480a-b881-096b53f7f5bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.504384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f883c95-6815-480a-b881-096b53f7f5bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:08:10.634756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:10.644097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:10.649414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.650606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.655128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.656883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.667916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.668878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.772740 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f883c95-6815-480a-b881-096b53f7f5bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 204 len: 0 microversion: 2.1 time: 0.373534 Oct 29 03:08:10.775705 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2640/5246] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:10 2022] DELETE /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:08:10.787407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ceb72ebe-3d6a-4e3a-ba83-9f74410b6028 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:10.793795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ceb72ebe-3d6a-4e3a-ba83-9f74410b6028 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:10.814142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceb72ebe-3d6a-4e3a-ba83-9f74410b6028 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.814742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceb72ebe-3d6a-4e3a-ba83-9f74410b6028 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.815278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceb72ebe-3d6a-4e3a-ba83-9f74410b6028 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.816362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceb72ebe-3d6a-4e3a-ba83-9f74410b6028 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.817058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceb72ebe-3d6a-4e3a-ba83-9f74410b6028 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.817748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceb72ebe-3d6a-4e3a-ba83-9f74410b6028 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:11.139275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ceb72ebe-3d6a-4e3a-ba83-9f74410b6028 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:11.153335 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ceb72ebe-3d6a-4e3a-ba83-9f74410b6028 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1481 microversion: 2.1 time: 0.373052 Oct 29 03:08:11.177110 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2641/5247] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:10 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1481 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:11.183469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-031fa465-beef-47db-980c-f294f2dc715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:11.184498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-031fa465-beef-47db-980c-f294f2dc715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:11.190748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-031fa465-beef-47db-980c-f294f2dc715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:11.191443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-031fa465-beef-47db-980c-f294f2dc715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:11.192056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-031fa465-beef-47db-980c-f294f2dc715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:11.192920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-031fa465-beef-47db-980c-f294f2dc715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:11.193518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-031fa465-beef-47db-980c-f294f2dc715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:11.194166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-031fa465-beef-47db-980c-f294f2dc715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:11.356815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-031fa465-beef-47db-980c-f294f2dc715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:11.369397 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-031fa465-beef-47db-980c-f294f2dc715b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1219 microversion: 2.1 time: 0.190851 Oct 29 03:08:11.371290 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2642/5248] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:11 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1219 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:12.190753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3826d19f-308b-4dbd-a178-38354fb0e180 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:12.206236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3826d19f-308b-4dbd-a178-38354fb0e180 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:12.224386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3826d19f-308b-4dbd-a178-38354fb0e180 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:12.226593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3826d19f-308b-4dbd-a178-38354fb0e180 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:12.227516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3826d19f-308b-4dbd-a178-38354fb0e180 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:12.230147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3826d19f-308b-4dbd-a178-38354fb0e180 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:12.232096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3826d19f-308b-4dbd-a178-38354fb0e180 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:12.235851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3826d19f-308b-4dbd-a178-38354fb0e180 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:12.265281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "refresh_cache-6755720e-84ca-4767-ae13-d3934b13ff6b" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 03:08:12.266685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquired lock "refresh_cache-6755720e-84ca-4767-ae13-d3934b13ff6b" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 03:08:12.971327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3826d19f-308b-4dbd-a178-38354fb0e180 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:12.988466 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3826d19f-308b-4dbd-a178-38354fb0e180 tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1481 microversion: 2.1 time: 0.803351 Oct 29 03:08:13.003905 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2643/5249] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:12 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1481 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:13.031152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3fba8559-5cf8-4edf-9646-63577b54a6a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a86ddf70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:13.111933 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3fba8559-5cf8-4edf-9646-63577b54a6a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/d5fc0698-4832-48bd-a41d-39fe00fd1111" status: 200 len: 662 microversion: 2.1 time: 0.096930 Oct 29 03:08:13.115156 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2644/5250] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:13 2022] GET /compute/v2.1/images/d5fc0698-4832-48bd-a41d-39fe00fd1111 => generated 662 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:13.129890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-242d5394-3e06-4faf-8411-428d79e459d9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:13.130732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-242d5394-3e06-4faf-8411-428d79e459d9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:13.143057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-242d5394-3e06-4faf-8411-428d79e459d9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:13.143767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-242d5394-3e06-4faf-8411-428d79e459d9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:13.145311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-242d5394-3e06-4faf-8411-428d79e459d9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:13.146424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-242d5394-3e06-4faf-8411-428d79e459d9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:13.146885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-242d5394-3e06-4faf-8411-428d79e459d9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:13.152050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-242d5394-3e06-4faf-8411-428d79e459d9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:13.366866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-242d5394-3e06-4faf-8411-428d79e459d9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:13.383080 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-242d5394-3e06-4faf-8411-428d79e459d9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1275 microversion: 2.1 time: 0.266469 Oct 29 03:08:13.385595 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2645/5251] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:13 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:13.401018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7d671e3-8c1d-4738-b97e-8c7adae5d727 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a336e9d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:13.484487 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b7d671e3-8c1d-4738-b97e-8c7adae5d727 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/d5fc0698-4832-48bd-a41d-39fe00fd1111" status: 200 len: 662 microversion: 2.1 time: 0.096402 Oct 29 03:08:13.489065 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2646/5252] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:13 2022] GET /compute/v2.1/images/d5fc0698-4832-48bd-a41d-39fe00fd1111 => generated 662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:14.025243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-100cf4ec-68cb-4ab2-81d7-e27344958dec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:14.026222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-100cf4ec-68cb-4ab2-81d7-e27344958dec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:14.038375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100cf4ec-68cb-4ab2-81d7-e27344958dec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:14.044215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100cf4ec-68cb-4ab2-81d7-e27344958dec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:14.045051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100cf4ec-68cb-4ab2-81d7-e27344958dec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:14.047462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100cf4ec-68cb-4ab2-81d7-e27344958dec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:14.048512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100cf4ec-68cb-4ab2-81d7-e27344958dec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:14.051010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100cf4ec-68cb-4ab2-81d7-e27344958dec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:14.731997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-100cf4ec-68cb-4ab2-81d7-e27344958dec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cecadca739554f858c269b85690b5cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1b05d7018447eebe74cc47de363ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:14.742997 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-100cf4ec-68cb-4ab2-81d7-e27344958dec tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 200 len: 1481 microversion: 2.1 time: 0.725784 Oct 29 03:08:14.743605 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2647/5253] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:14 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 1481 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:14.781787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-723c192d-797b-47ac-8590-c4f835bbca37 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:14.782330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-723c192d-797b-47ac-8590-c4f835bbca37 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:14.798090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-723c192d-797b-47ac-8590-c4f835bbca37 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:14.799234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-723c192d-797b-47ac-8590-c4f835bbca37 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:14.800154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-723c192d-797b-47ac-8590-c4f835bbca37 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:14.802324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-723c192d-797b-47ac-8590-c4f835bbca37 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:14.804220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-723c192d-797b-47ac-8590-c4f835bbca37 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:14.804869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-723c192d-797b-47ac-8590-c4f835bbca37 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:15.133041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Building network info cache for instance {{(pid=127041) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 03:08:15.668444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-723c192d-797b-47ac-8590-c4f835bbca37 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:15.678188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:15.690468 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-723c192d-797b-47ac-8590-c4f835bbca37 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1273 microversion: 2.1 time: 0.925042 Oct 29 03:08:15.692705 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2648/5254] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:14 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1273 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:15.717173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a386ce2c-dbf3-4186-bfd1-e8eceb369899 req-fbe5ed84-7262-4d8e-8a77-8c608959eefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aef61b2-712e-4f92-a0f4-161ebe964609", "name": "network-vif-deleted", "tag": "fda11e41-7f15-4760-9834-d65bf8eed0f5"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:15.733834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a386ce2c-dbf3-4186-bfd1-e8eceb369899 req-fbe5ed84-7262-4d8e-8a77-8c608959eefa service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:15.747106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a386ce2c-dbf3-4186-bfd1-e8eceb369899 req-fbe5ed84-7262-4d8e-8a77-8c608959eefa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:15.747106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a386ce2c-dbf3-4186-bfd1-e8eceb369899 req-fbe5ed84-7262-4d8e-8a77-8c608959eefa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:15.782781 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a386ce2c-dbf3-4186-bfd1-e8eceb369899 req-fbe5ed84-7262-4d8e-8a77-8c608959eefa service nova] Creating event network-vif-deleted:fda11e41-7f15-4760-9834-d65bf8eed0f5 for instance 3aef61b2-712e-4f92-a0f4-161ebe964609 on n-h1-862964-4 Oct 29 03:08:15.795833 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a386ce2c-dbf3-4186-bfd1-e8eceb369899 req-fbe5ed84-7262-4d8e-8a77-8c608959eefa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098202 Oct 29 03:08:15.796740 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2649/5255] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:15.810344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-42de0a63-581a-418a-ac88-35ac69f5d1af req-2d99e59e-0177-4a3e-9f38-1b9750db01e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6755720e-84ca-4767-ae13-d3934b13ff6b", "tag": "6e0747ef-9623-4166-aeb4-afda676eb721"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:15.830535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-42de0a63-581a-418a-ac88-35ac69f5d1af req-2d99e59e-0177-4a3e-9f38-1b9750db01e4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:15.842768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-42de0a63-581a-418a-ac88-35ac69f5d1af req-2d99e59e-0177-4a3e-9f38-1b9750db01e4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:15.843371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-42de0a63-581a-418a-ac88-35ac69f5d1af req-2d99e59e-0177-4a3e-9f38-1b9750db01e4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:15.870182 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-42de0a63-581a-418a-ac88-35ac69f5d1af req-2d99e59e-0177-4a3e-9f38-1b9750db01e4 service nova] Creating event network-changed:6e0747ef-9623-4166-aeb4-afda676eb721 for instance 6755720e-84ca-4767-ae13-d3934b13ff6b on n-h2-862964-4 Oct 29 03:08:15.904362 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-42de0a63-581a-418a-ac88-35ac69f5d1af req-2d99e59e-0177-4a3e-9f38-1b9750db01e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105737 Oct 29 03:08:15.905071 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2650/5256] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:15.930636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bec44929-c874-49a0-a863-4eb2536f17c8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3333430>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:16.007839 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bec44929-c874-49a0-a863-4eb2536f17c8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/8c6dc413-f071-4d30-a81f-69766c9c78c3" status: 200 len: 661 microversion: 2.1 time: 0.101375 Oct 29 03:08:16.008787 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2651/5257] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:15 2022] GET /compute/v2.1/images/8c6dc413-f071-4d30-a81f-69766c9c78c3 => generated 661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:16.028741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:16.029484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] [instance: 3aef61b2-712e-4f92-a0f4-161ebe964609] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:16.060722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:16.061228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:16.061640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:16.062373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:16.062819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:16.063231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:16.090557 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] HTTP exception thrown: Instance 3aef61b2-712e-4f92-a0f4-161ebe964609 could not be found. Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Request method failure captured: Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 HTTP/1.1 Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJgN6qEpG_yo5CO46_leG_qxjfnH1XztUWamSdQosKNRyNulbO2ycfAt-CjTRRQYlrqhELg8i5XViVV3WPrOUXQ56-KQmyMTM3jv9w-DXtz-3KHKIggZR02tlIC1pr5yFQ8A_eqQ_eQnOPx6NmcE21IrbcDVPBsb6anZTWOzpYlI4UU Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9e1b05d7018447eebe74cc47de363ead", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9e1b05d7018447eebe74cc47de363ead"}]}] Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersTestJSON-309934721 Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 9e1b05d7018447eebe74cc47de363ead Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersTestJSON-309934721 Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersTestJSON-309934721-project Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: cecadca739554f858c269b85690b5cec Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersTestJSON-309934721-project Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3aef61b2-712e-4f92-a0f4-161ebe964609 could not be found. Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3aef61b2-712e-4f92-a0f4-161ebe964609'} Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aef61b2-712e-4f92-a0f4-161ebe964609 could not be found. Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aef61b2-712e-4f92-a0f4-161ebe964609 could not be found. Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:16.092980 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:16.097977 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:16.097977 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:16.097977 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:16.097977 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:16.097977 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aef61b2-712e-4f92-a0f4-161ebe964609 could not be found. Oct 29 03:08:16.097977 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:16.097977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] Returning 404 to user: Instance 3aef61b2-712e-4f92-a0f4-161ebe964609 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:16.097977 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3bd9283e-60dc-4857-878a-85c5fb4ac1bf tempest-ServersTestJSON-309934721 tempest-ServersTestJSON-309934721-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609" status: 404 len: 111 microversion: 2.1 time: 0.084177 Oct 29 03:08:16.100494 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2652/5258] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:16 2022] GET /compute/v2.1/servers/3aef61b2-712e-4f92-a0f4-161ebe964609 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:16.109232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-551ff525-9b88-417a-a137-11fc6d901754 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a333d280>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:16.191573 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-551ff525-9b88-417a-a137-11fc6d901754 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/8c6dc413-f071-4d30-a81f-69766c9c78c3" status: 200 len: 661 microversion: 2.1 time: 0.089910 Oct 29 03:08:16.195234 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2653/5259] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:16 2022] GET /compute/v2.1/images/8c6dc413-f071-4d30-a81f-69766c9c78c3 => generated 661 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:16.361348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1910259894", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:16.434995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:08:17.175893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:08:17.176576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:08:17.176926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:08:17.177628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:08:17.181771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:08:17.202290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:17.203100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:17.204942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:17.207296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:17.207904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:17.210031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:17.247555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Getting quotas for project 431409236f15444e85495d233664fff8. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:17.262128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Getting quotas for user d1dc27c611114996857a8c1ee7a573a6 and project 431409236f15444e85495d233664fff8. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:17.309458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:08:17.312077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:17.409737 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c2691e8-5e75-4754-a742-9c885657c131 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054087 Oct 29 03:08:17.427103 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2654/5260] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:08:17.437988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-30fc226e-e42e-4bd9-9c94-cadb7333ac51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:17.439527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-30fc226e-e42e-4bd9-9c94-cadb7333ac51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:17.452256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30fc226e-e42e-4bd9-9c94-cadb7333ac51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:17.453687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30fc226e-e42e-4bd9-9c94-cadb7333ac51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:17.454202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30fc226e-e42e-4bd9-9c94-cadb7333ac51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:17.459123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30fc226e-e42e-4bd9-9c94-cadb7333ac51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:17.459775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30fc226e-e42e-4bd9-9c94-cadb7333ac51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:17.460708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-30fc226e-e42e-4bd9-9c94-cadb7333ac51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:17.894124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-30fc226e-e42e-4bd9-9c94-cadb7333ac51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:17.906797 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-30fc226e-e42e-4bd9-9c94-cadb7333ac51 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1315 microversion: 2.1 time: 0.478422 Oct 29 03:08:17.907745 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2655/5261] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:17 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:17.922196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-709387663", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:18.045054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:08:18.469711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:08:18.470395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:08:18.479945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:08:18.480666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:08:18.481092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:08:18.494903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=17 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:18.502830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:18.506508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:18.507144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:18.508087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:18.508730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:18.509330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:18.537951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:18.556941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Getting quotas for project 431409236f15444e85495d233664fff8. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:18.567501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Getting quotas for user d1dc27c611114996857a8c1ee7a573a6 and project 431409236f15444e85495d233664fff8. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:18.590992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:08:18.596189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:18.654807 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-99b31bac-3c58-4cdd-9ddb-633269ffb8a5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745945 Oct 29 03:08:18.655466 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2656/5262] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:08:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:08:18.667195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7e6e0dfd-0142-4433-a5d7-17389cffbbbb tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:18.668114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7e6e0dfd-0142-4433-a5d7-17389cffbbbb tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:19.235086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Updating instance_info_cache with network_info: [{"id": "6e0747ef-9623-4166-aeb4-afda676eb721", "address": "fa:16:3e:9a:d4:f4", "network": {"id": "3406d6cf-1c47-4993-81ad-538ca7bf7fac", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-182684075-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "173e87fac5564c2db6ccff6fc14e0520", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6e0747ef-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127041) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 03:08:19.249861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Releasing lock "refresh_cache-6755720e-84ca-4767-ae13-d3934b13ff6b" {{(pid=127041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 03:08:19.252088 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aae046f7-cbba-472b-a381-e494400d2f95 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "POST /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b/action" status: 202 len: 0 microversion: 2.1 time: 9.522600 Oct 29 03:08:19.253849 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2607/5263] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:08:09 2022] POST /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b/action => generated 0 bytes in 9526 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 03:08:19.265150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-46fed4c4-3506-4ce4-b5fe-a426b17dfa83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:19.265821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-46fed4c4-3506-4ce4-b5fe-a426b17dfa83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:19.306291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46fed4c4-3506-4ce4-b5fe-a426b17dfa83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:19.309041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46fed4c4-3506-4ce4-b5fe-a426b17dfa83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:19.311562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46fed4c4-3506-4ce4-b5fe-a426b17dfa83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:19.313470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46fed4c4-3506-4ce4-b5fe-a426b17dfa83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:19.314320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46fed4c4-3506-4ce4-b5fe-a426b17dfa83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:19.317340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46fed4c4-3506-4ce4-b5fe-a426b17dfa83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:19.478511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:19.507281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7e6e0dfd-0142-4433-a5d7-17389cffbbbb tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:19.524832 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7e6e0dfd-0142-4433-a5d7-17389cffbbbb tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1217 microversion: 2.1 time: 0.861401 Oct 29 03:08:19.526216 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2657/5264] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:18 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1217 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:19.538540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=34 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:19.542537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2d5386ba-10ec-4f86-b5e0-f42b7edc0aec tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '.version_select at 0x7fe1a33a0280>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:20.386665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-46fed4c4-3506-4ce4-b5fe-a426b17dfa83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:20.395956 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-46fed4c4-3506-4ce4-b5fe-a426b17dfa83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1315 microversion: 2.1 time: 1.138339 Oct 29 03:08:20.402499 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2608/5265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:19 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1315 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:20.552062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a684a08-4b8e-4555-b35c-0038c107b290 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:20.552678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a684a08-4b8e-4555-b35c-0038c107b290 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:20.567201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a684a08-4b8e-4555-b35c-0038c107b290 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:20.572337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a684a08-4b8e-4555-b35c-0038c107b290 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:20.573174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a684a08-4b8e-4555-b35c-0038c107b290 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:20.574057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a684a08-4b8e-4555-b35c-0038c107b290 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:20.574539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a684a08-4b8e-4555-b35c-0038c107b290 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:20.574977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a684a08-4b8e-4555-b35c-0038c107b290 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:20.880058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2a684a08-4b8e-4555-b35c-0038c107b290 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:20.890426 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a684a08-4b8e-4555-b35c-0038c107b290 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1277 microversion: 2.1 time: 0.342199 Oct 29 03:08:20.891017 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2609/5266] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:20 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1277 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:21.432023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9302a64-6482-4d68-915c-5dafb187b3a7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:21.432736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f9302a64-6482-4d68-915c-5dafb187b3a7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:21.447713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9302a64-6482-4d68-915c-5dafb187b3a7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:21.448285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9302a64-6482-4d68-915c-5dafb187b3a7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:21.448731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9302a64-6482-4d68-915c-5dafb187b3a7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:21.449484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9302a64-6482-4d68-915c-5dafb187b3a7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:21.450003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9302a64-6482-4d68-915c-5dafb187b3a7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:21.450421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9302a64-6482-4d68-915c-5dafb187b3a7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:22.501959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f9302a64-6482-4d68-915c-5dafb187b3a7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:22.512744 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f9302a64-6482-4d68-915c-5dafb187b3a7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1315 microversion: 2.1 time: 1.086157 Oct 29 03:08:22.518355 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2610/5267] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:21 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:22.523417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-14fae141-c728-4e3f-b21a-67bfbfc8a4c6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:22.524028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-14fae141-c728-4e3f-b21a-67bfbfc8a4c6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:22.542801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14fae141-c728-4e3f-b21a-67bfbfc8a4c6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:22.543539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14fae141-c728-4e3f-b21a-67bfbfc8a4c6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:22.544176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14fae141-c728-4e3f-b21a-67bfbfc8a4c6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:22.545073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14fae141-c728-4e3f-b21a-67bfbfc8a4c6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:22.545685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14fae141-c728-4e3f-b21a-67bfbfc8a4c6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:22.548090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-14fae141-c728-4e3f-b21a-67bfbfc8a4c6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:22.789998 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2d5386ba-10ec-4f86-b5e0-f42b7edc0aec tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/47b8cb2c-308c-485d-adef-741f9aabf6bd" status: 202 len: 0 microversion: 2.1 time: 3.262434 Oct 29 03:08:22.791366 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2658/5268] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:08:19 2022] DELETE /compute/v2.1/os-floating-ips/47b8cb2c-308c-485d-adef-741f9aabf6bd => generated 0 bytes in 3264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:08:22.797893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-3f2842cd-d28a-471e-9de6-ded395005b6e req-471ccf83-7464-4f1e-a1b4-91341ae98930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7064a1-f665-453b-8f44-91cedddf96bc", "tag": "eaa05058-291a-420d-8b9f-0f339119b6cb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:22.818106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3f2842cd-d28a-471e-9de6-ded395005b6e req-471ccf83-7464-4f1e-a1b4-91341ae98930 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:22.818592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3f2842cd-d28a-471e-9de6-ded395005b6e req-471ccf83-7464-4f1e-a1b4-91341ae98930 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:22.819027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3f2842cd-d28a-471e-9de6-ded395005b6e req-471ccf83-7464-4f1e-a1b4-91341ae98930 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:22.854864 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-3f2842cd-d28a-471e-9de6-ded395005b6e req-471ccf83-7464-4f1e-a1b4-91341ae98930 service nova] Creating event network-changed:eaa05058-291a-420d-8b9f-0f339119b6cb for instance 2c7064a1-f665-453b-8f44-91cedddf96bc on n-h1-862964-4 Oct 29 03:08:22.862917 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-3f2842cd-d28a-471e-9de6-ded395005b6e req-471ccf83-7464-4f1e-a1b4-91341ae98930 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070168 Oct 29 03:08:22.867721 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2659/5269] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:22.883438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d207ee7d-30d7-4203-bc50-d9c36a5adb55 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '.version_select at 0x7fe1a32f9dc0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:22.884591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-14fae141-c728-4e3f-b21a-67bfbfc8a4c6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:22.894729 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-14fae141-c728-4e3f-b21a-67bfbfc8a4c6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1275 microversion: 2.1 time: 0.374979 Oct 29 03:08:22.897716 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2611/5270] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:22 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1275 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:23.542229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3afb503b-070c-4a74-9eea-948adbaa416d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:23.544830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3afb503b-070c-4a74-9eea-948adbaa416d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:23.565370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3afb503b-070c-4a74-9eea-948adbaa416d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:23.566615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3afb503b-070c-4a74-9eea-948adbaa416d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:23.567549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3afb503b-070c-4a74-9eea-948adbaa416d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:23.568455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3afb503b-070c-4a74-9eea-948adbaa416d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:23.569249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3afb503b-070c-4a74-9eea-948adbaa416d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:23.570859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3afb503b-070c-4a74-9eea-948adbaa416d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:23.586041 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d207ee7d-30d7-4203-bc50-d9c36a5adb55 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7f2e6dbc-41b3-45fe-b29d-bf096b04c70e" status: 202 len: 0 microversion: 2.1 time: 0.715451 Oct 29 03:08:23.587499 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2660/5271] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 03:08:22 2022] DELETE /compute/v2.1/os-security-groups/7f2e6dbc-41b3-45fe-b29d-bf096b04c70e => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:08:23.596461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fc3f36f2-b45c-4e4f-9724-dc738a2a33ab tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:23.597198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fc3f36f2-b45c-4e4f-9724-dc738a2a33ab tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:23.613105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc3f36f2-b45c-4e4f-9724-dc738a2a33ab tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:23.614609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc3f36f2-b45c-4e4f-9724-dc738a2a33ab tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:23.615538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc3f36f2-b45c-4e4f-9724-dc738a2a33ab tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:23.619526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc3f36f2-b45c-4e4f-9724-dc738a2a33ab tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:23.627582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc3f36f2-b45c-4e4f-9724-dc738a2a33ab tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:23.629271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc3f36f2-b45c-4e4f-9724-dc738a2a33ab tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:23.671222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fc3f36f2-b45c-4e4f-9724-dc738a2a33ab tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:08:23.802835 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fc3f36f2-b45c-4e4f-9724-dc738a2a33ab tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 204 len: 0 microversion: 2.1 time: 0.210660 Oct 29 03:08:23.807664 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2661/5272] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:23 2022] DELETE /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:08:23.814972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-84c8d7c5-411b-4e4e-9e07-674c29fdd5bd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:23.815968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-84c8d7c5-411b-4e4e-9e07-674c29fdd5bd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:23.852217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c8d7c5-411b-4e4e-9e07-674c29fdd5bd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:23.853078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c8d7c5-411b-4e4e-9e07-674c29fdd5bd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:23.853856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c8d7c5-411b-4e4e-9e07-674c29fdd5bd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:23.854939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c8d7c5-411b-4e4e-9e07-674c29fdd5bd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:23.855553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c8d7c5-411b-4e4e-9e07-674c29fdd5bd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:23.856150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-84c8d7c5-411b-4e4e-9e07-674c29fdd5bd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:24.224909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-84c8d7c5-411b-4e4e-9e07-674c29fdd5bd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:24.233959 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-84c8d7c5-411b-4e4e-9e07-674c29fdd5bd tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1508 microversion: 2.1 time: 0.424515 Oct 29 03:08:24.250520 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2662/5273] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:23 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1508 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:24.256342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9529cbef-ffbe-4091-8e70-eb4df12f6f79 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:24.257184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9529cbef-ffbe-4091-8e70-eb4df12f6f79 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:24.264353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9529cbef-ffbe-4091-8e70-eb4df12f6f79 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:24.265034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9529cbef-ffbe-4091-8e70-eb4df12f6f79 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:24.265631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9529cbef-ffbe-4091-8e70-eb4df12f6f79 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:24.266779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9529cbef-ffbe-4091-8e70-eb4df12f6f79 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:24.267413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9529cbef-ffbe-4091-8e70-eb4df12f6f79 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:24.268032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9529cbef-ffbe-4091-8e70-eb4df12f6f79 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:24.886401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3afb503b-070c-4a74-9eea-948adbaa416d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:24.900006 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3afb503b-070c-4a74-9eea-948adbaa416d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1315 microversion: 2.1 time: 1.362792 Oct 29 03:08:24.902457 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2612/5274] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:23 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1315 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:24.974848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9529cbef-ffbe-4091-8e70-eb4df12f6f79 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:25.002384 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9529cbef-ffbe-4091-8e70-eb4df12f6f79 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1317 microversion: 2.1 time: 0.749990 Oct 29 03:08:25.003631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2663/5275] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:24 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1317 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:25.261093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-714e99c0-7fdf-4449-bb97-3c5ec3eb1f4f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:25.262173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-714e99c0-7fdf-4449-bb97-3c5ec3eb1f4f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:25.271623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-714e99c0-7fdf-4449-bb97-3c5ec3eb1f4f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:25.272334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-714e99c0-7fdf-4449-bb97-3c5ec3eb1f4f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:25.272932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-714e99c0-7fdf-4449-bb97-3c5ec3eb1f4f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:25.273907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-714e99c0-7fdf-4449-bb97-3c5ec3eb1f4f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:25.274514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-714e99c0-7fdf-4449-bb97-3c5ec3eb1f4f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:25.275428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-714e99c0-7fdf-4449-bb97-3c5ec3eb1f4f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:25.926911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-366553bc-903c-424a-b3c5-890b08259b36 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:25.933769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-714e99c0-7fdf-4449-bb97-3c5ec3eb1f4f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:25.941060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-366553bc-903c-424a-b3c5-890b08259b36 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:25.946207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:25.971282 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-714e99c0-7fdf-4449-bb97-3c5ec3eb1f4f tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1508 microversion: 2.1 time: 0.715996 Oct 29 03:08:25.972712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366553bc-903c-424a-b3c5-890b08259b36 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:25.974542 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2613/5276] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:25 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1508 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:25.983250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366553bc-903c-424a-b3c5-890b08259b36 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:25.985650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366553bc-903c-424a-b3c5-890b08259b36 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:25.987826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366553bc-903c-424a-b3c5-890b08259b36 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:25.991098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366553bc-903c-424a-b3c5-890b08259b36 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:25.991832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366553bc-903c-424a-b3c5-890b08259b36 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:26.046025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e9e0b955-cca8-421e-8478-110ba428491c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:26.049882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e9e0b955-cca8-421e-8478-110ba428491c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:26.069666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9e0b955-cca8-421e-8478-110ba428491c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:26.070341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9e0b955-cca8-421e-8478-110ba428491c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:26.071343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9e0b955-cca8-421e-8478-110ba428491c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:26.078401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9e0b955-cca8-421e-8478-110ba428491c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:26.084376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9e0b955-cca8-421e-8478-110ba428491c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:26.085053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9e0b955-cca8-421e-8478-110ba428491c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:26.637743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e9e0b955-cca8-421e-8478-110ba428491c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:26.650380 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e9e0b955-cca8-421e-8478-110ba428491c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1317 microversion: 2.1 time: 0.625246 Oct 29 03:08:26.651579 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2614/5277] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:26 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:26.660327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ea7eb4d4-0a4d-43ad-9bd3-17434543bdd3 req-f3f78aae-6b31-4e48-8730-9556423d163f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87ccf8a-8236-4a31-ad90-4805b875a1c1", "tag": "e064d394-4cc8-46e7-ab41-6664c7bdbce0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:26.691925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ea7eb4d4-0a4d-43ad-9bd3-17434543bdd3 req-f3f78aae-6b31-4e48-8730-9556423d163f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:26.692511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ea7eb4d4-0a4d-43ad-9bd3-17434543bdd3 req-f3f78aae-6b31-4e48-8730-9556423d163f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:26.692935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ea7eb4d4-0a4d-43ad-9bd3-17434543bdd3 req-f3f78aae-6b31-4e48-8730-9556423d163f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:26.719071 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ea7eb4d4-0a4d-43ad-9bd3-17434543bdd3 req-f3f78aae-6b31-4e48-8730-9556423d163f service nova] Creating event network-changed:e064d394-4cc8-46e7-ab41-6664c7bdbce0 for instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 on n-h2-862964-4 Oct 29 03:08:26.737899 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ea7eb4d4-0a4d-43ad-9bd3-17434543bdd3 req-f3f78aae-6b31-4e48-8730-9556423d163f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083152 Oct 29 03:08:26.739053 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2615/5278] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:26.840062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-366553bc-903c-424a-b3c5-890b08259b36 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:26.853037 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-366553bc-903c-424a-b3c5-890b08259b36 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1315 microversion: 2.1 time: 0.931867 Oct 29 03:08:26.854452 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2664/5279] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:25 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:27.002329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e2433ff7-0eae-41a1-aae3-f0c7a3394b64 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:27.007072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e2433ff7-0eae-41a1-aae3-f0c7a3394b64 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:27.023147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2433ff7-0eae-41a1-aae3-f0c7a3394b64 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:27.023958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2433ff7-0eae-41a1-aae3-f0c7a3394b64 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:27.024797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2433ff7-0eae-41a1-aae3-f0c7a3394b64 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:27.026865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2433ff7-0eae-41a1-aae3-f0c7a3394b64 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:27.028601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2433ff7-0eae-41a1-aae3-f0c7a3394b64 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:27.029332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e2433ff7-0eae-41a1-aae3-f0c7a3394b64 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:27.546190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e2433ff7-0eae-41a1-aae3-f0c7a3394b64 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:27.561013 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e2433ff7-0eae-41a1-aae3-f0c7a3394b64 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1508 microversion: 2.1 time: 0.564310 Oct 29 03:08:27.576305 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2616/5280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:26 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1508 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:27.687708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0e35591e-22f4-4f83-bc83-0ede6b356a12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:27.688971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0e35591e-22f4-4f83-bc83-0ede6b356a12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:27.719627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e35591e-22f4-4f83-bc83-0ede6b356a12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:27.720553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e35591e-22f4-4f83-bc83-0ede6b356a12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:27.721320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e35591e-22f4-4f83-bc83-0ede6b356a12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:27.725972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e35591e-22f4-4f83-bc83-0ede6b356a12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:27.727102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e35591e-22f4-4f83-bc83-0ede6b356a12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:27.728286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e35591e-22f4-4f83-bc83-0ede6b356a12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:27.877187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-58f600bd-22f5-4089-b20f-c9c668d4d23a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:27.877735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-58f600bd-22f5-4089-b20f-c9c668d4d23a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:27.889154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f600bd-22f5-4089-b20f-c9c668d4d23a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:27.891501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f600bd-22f5-4089-b20f-c9c668d4d23a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:27.892519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f600bd-22f5-4089-b20f-c9c668d4d23a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:27.896454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f600bd-22f5-4089-b20f-c9c668d4d23a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:27.897186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f600bd-22f5-4089-b20f-c9c668d4d23a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:27.897763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f600bd-22f5-4089-b20f-c9c668d4d23a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:28.546351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:28.659001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-58f600bd-22f5-4089-b20f-c9c668d4d23a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:28.670558 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-58f600bd-22f5-4089-b20f-c9c668d4d23a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1315 microversion: 2.1 time: 0.797680 Oct 29 03:08:28.671548 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2617/5281] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:27 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1315 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:28.680530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d328b997-927b-4ee6-bf89-d62035130d86 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:28.683657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d328b997-927b-4ee6-bf89-d62035130d86 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:28.692340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d328b997-927b-4ee6-bf89-d62035130d86 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:28.693344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d328b997-927b-4ee6-bf89-d62035130d86 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:28.693991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d328b997-927b-4ee6-bf89-d62035130d86 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:28.695499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d328b997-927b-4ee6-bf89-d62035130d86 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:28.697242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d328b997-927b-4ee6-bf89-d62035130d86 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:28.698198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d328b997-927b-4ee6-bf89-d62035130d86 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:29.021526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0e35591e-22f4-4f83-bc83-0ede6b356a12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:29.036675 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0e35591e-22f4-4f83-bc83-0ede6b356a12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1317 microversion: 2.1 time: 1.367101 Oct 29 03:08:29.038550 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2665/5282] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:27 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1317 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:29.051331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d7afeb75-257c-4c8e-bf60-b8c007ee8b7c req-c8de819b-c114-4fed-b62c-02ce043d3fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e128c38-7acd-43a8-b9a3-cc26676e702e", "tag": "b1e0bf4b-9dd4-47dd-923b-eaaab9d2e6fa"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:29.076132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7afeb75-257c-4c8e-bf60-b8c007ee8b7c req-c8de819b-c114-4fed-b62c-02ce043d3fe1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:29.076625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7afeb75-257c-4c8e-bf60-b8c007ee8b7c req-c8de819b-c114-4fed-b62c-02ce043d3fe1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:29.077085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7afeb75-257c-4c8e-bf60-b8c007ee8b7c req-c8de819b-c114-4fed-b62c-02ce043d3fe1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:29.100283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d328b997-927b-4ee6-bf89-d62035130d86 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:29.114704 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d328b997-927b-4ee6-bf89-d62035130d86 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1508 microversion: 2.1 time: 0.442046 Oct 29 03:08:29.115305 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2618/5283] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:28 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1508 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:29.116794 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d7afeb75-257c-4c8e-bf60-b8c007ee8b7c req-c8de819b-c114-4fed-b62c-02ce043d3fe1 service nova] Creating event network-changed:b1e0bf4b-9dd4-47dd-923b-eaaab9d2e6fa for instance 1e128c38-7acd-43a8-b9a3-cc26676e702e on n-h1-862964-4 Oct 29 03:08:29.130695 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d7afeb75-257c-4c8e-bf60-b8c007ee8b7c req-c8de819b-c114-4fed-b62c-02ce043d3fe1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090717 Oct 29 03:08:29.132340 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2666/5284] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:29.699169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6188fc30-d62e-4a31-b747-dab74cd45108 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:29.701159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6188fc30-d62e-4a31-b747-dab74cd45108 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:29.709728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6188fc30-d62e-4a31-b747-dab74cd45108 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:29.709728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6188fc30-d62e-4a31-b747-dab74cd45108 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:29.718770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6188fc30-d62e-4a31-b747-dab74cd45108 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:29.719811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6188fc30-d62e-4a31-b747-dab74cd45108 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:29.720603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6188fc30-d62e-4a31-b747-dab74cd45108 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:29.721203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6188fc30-d62e-4a31-b747-dab74cd45108 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:30.057237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=7 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:30.063178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85feb54e-a12d-4e2a-b409-8af7a881fa59 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:30.064394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-85feb54e-a12d-4e2a-b409-8af7a881fa59 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:30.079790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85feb54e-a12d-4e2a-b409-8af7a881fa59 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:30.080798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85feb54e-a12d-4e2a-b409-8af7a881fa59 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:30.081578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85feb54e-a12d-4e2a-b409-8af7a881fa59 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:30.082591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85feb54e-a12d-4e2a-b409-8af7a881fa59 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:30.083352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85feb54e-a12d-4e2a-b409-8af7a881fa59 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:30.084449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85feb54e-a12d-4e2a-b409-8af7a881fa59 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:30.243749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6188fc30-d62e-4a31-b747-dab74cd45108 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:30.252694 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6188fc30-d62e-4a31-b747-dab74cd45108 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1315 microversion: 2.1 time: 0.559782 Oct 29 03:08:30.270484 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2619/5285] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:29 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:30.282519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:30.283140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:30.290495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:30.291075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:30.291516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:30.292229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:30.292682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:30.293105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:30.335793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:30.336534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:30.337502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:30.338483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lazy-loading 'fault' on Instance uuid 6755720e-84ca-4767-ae13-d3934b13ff6b {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:08:30.427703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97cdb72a2424ca2b8487d71b7f22c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173e87fac5564c2db6ccff6fc14e0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:30.440605 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a8f9bbf-8f44-405e-910c-a446b345079e tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 200 len: 1312 microversion: 2.1 time: 0.167553 Oct 29 03:08:30.444435 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2620/5286] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:30 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:30.453698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-047fc330-29f2-493e-b2b0-4b8d11cadc12 req-e20003c8-2037-4c59-975b-13dc23fe9ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7064a1-f665-453b-8f44-91cedddf96bc", "name": "network-vif-plugged", "status": "completed", "tag": "eaa05058-291a-420d-8b9f-0f339119b6cb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:30.476546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-047fc330-29f2-493e-b2b0-4b8d11cadc12 req-e20003c8-2037-4c59-975b-13dc23fe9ef3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:30.477782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-047fc330-29f2-493e-b2b0-4b8d11cadc12 req-e20003c8-2037-4c59-975b-13dc23fe9ef3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:30.481597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-047fc330-29f2-493e-b2b0-4b8d11cadc12 req-e20003c8-2037-4c59-975b-13dc23fe9ef3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:30.512057 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-047fc330-29f2-493e-b2b0-4b8d11cadc12 req-e20003c8-2037-4c59-975b-13dc23fe9ef3 service nova] Creating event network-vif-plugged:eaa05058-291a-420d-8b9f-0f339119b6cb for instance 2c7064a1-f665-453b-8f44-91cedddf96bc on n-h1-862964-4 Oct 29 03:08:30.523958 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-047fc330-29f2-493e-b2b0-4b8d11cadc12 req-e20003c8-2037-4c59-975b-13dc23fe9ef3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078239 Oct 29 03:08:30.527567 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2621/5287] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:30.784080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-85feb54e-a12d-4e2a-b409-8af7a881fa59 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:30.792467 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-85feb54e-a12d-4e2a-b409-8af7a881fa59 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1317 microversion: 2.1 time: 0.736141 Oct 29 03:08:30.796958 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2667/5288] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:30 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1317 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:31.166036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-48c1e452-b07b-4df3-b179-5aaf7fc39d17 req-d63aed58-2773-437b-ab13-9961f0e139db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6755720e-84ca-4767-ae13-d3934b13ff6b", "name": "network-vif-deleted", "tag": "6e0747ef-9623-4166-aeb4-afda676eb721"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:31.200963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-48c1e452-b07b-4df3-b179-5aaf7fc39d17 req-d63aed58-2773-437b-ab13-9961f0e139db service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.204046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-48c1e452-b07b-4df3-b179-5aaf7fc39d17 req-d63aed58-2773-437b-ab13-9961f0e139db service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.204694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-48c1e452-b07b-4df3-b179-5aaf7fc39d17 req-d63aed58-2773-437b-ab13-9961f0e139db service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.241396 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-48c1e452-b07b-4df3-b179-5aaf7fc39d17 req-d63aed58-2773-437b-ab13-9961f0e139db service nova] Creating event network-vif-deleted:6e0747ef-9623-4166-aeb4-afda676eb721 for instance 6755720e-84ca-4767-ae13-d3934b13ff6b on n-h2-862964-4 Oct 29 03:08:31.251775 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-48c1e452-b07b-4df3-b179-5aaf7fc39d17 req-d63aed58-2773-437b-ab13-9961f0e139db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092590 Oct 29 03:08:31.253967 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2622/5289] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:31.282810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6ddc215a-558b-41d1-9280-cad347d1b23d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:31.284019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6ddc215a-558b-41d1-9280-cad347d1b23d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:31.304443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ddc215a-558b-41d1-9280-cad347d1b23d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.305137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ddc215a-558b-41d1-9280-cad347d1b23d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.305792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ddc215a-558b-41d1-9280-cad347d1b23d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.306917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ddc215a-558b-41d1-9280-cad347d1b23d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.307680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ddc215a-558b-41d1-9280-cad347d1b23d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.308259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ddc215a-558b-41d1-9280-cad347d1b23d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.480440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:31.481146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] [instance: 6755720e-84ca-4767-ae13-d3934b13ff6b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:31.499889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.500389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.500826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.501549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.502032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.502434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.551094 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] HTTP exception thrown: Instance 6755720e-84ca-4767-ae13-d3934b13ff6b could not be found. Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Request method failure captured: Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b HTTP/1.1 Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJjaDuMgOFfsJV_xpFCbxrD9RzGN8v4cfBimOiq-KFTd63bLft0XnB3E5IZKgS0vV_olJyOyyzyNZDFTF-j94CKLm_PF8PT-8-1FU6AfkouPAfn4I6TYWI1qTxKiBAQ0qfw8_OXEG0-Q6EpUr0y9FRxAnwaLQRUAAGz79YECXTymtzs Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 173e87fac5564c2db6ccff6fc14e0520 Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2131327502 Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/173e87fac5564c2db6ccff6fc14e0520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/173e87fac5564c2db6ccff6fc14e0520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_173e87fac5564c2db6ccff6fc14e0520", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/173e87fac5564c2db6ccff6fc14e0520"}]}] Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2131327502 Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 173e87fac5564c2db6ccff6fc14e0520 Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2131327502 Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerRescueTestJSONUnderV235-2131327502-project Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: f97cdb72a2424ca2b8487d71b7f22c0c Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2131327502-project Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 6755720e-84ca-4767-ae13-d3934b13ff6b could not be found. Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '6755720e-84ca-4767-ae13-d3934b13ff6b'} Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6755720e-84ca-4767-ae13-d3934b13ff6b could not be found. Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6755720e-84ca-4767-ae13-d3934b13ff6b could not be found. Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:31.567458 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:31.572748 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:31.572748 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:31.572748 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:31.572748 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:31.572748 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:31.572748 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:31.572748 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6755720e-84ca-4767-ae13-d3934b13ff6b could not be found. Oct 29 03:08:31.572748 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:08:31.574668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] Returning 404 to user: Instance 6755720e-84ca-4767-ae13-d3934b13ff6b could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:31.575818 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e418233d-aadc-4a34-ad8e-b1429a8e8c32 tempest-ServerRescueTestJSONUnderV235-2131327502 tempest-ServerRescueTestJSONUnderV235-2131327502-project] 10.222.0.16 "GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b" status: 404 len: 111 microversion: 2.1 time: 0.110818 Oct 29 03:08:31.577174 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2623/5290] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:31 2022] GET /compute/v2.1/servers/6755720e-84ca-4767-ae13-d3934b13ff6b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:08:31.816991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d872e358-7add-4583-ae81-a15924691ccf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:31.824457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d872e358-7add-4583-ae81-a15924691ccf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:31.839388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d872e358-7add-4583-ae81-a15924691ccf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.841788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d872e358-7add-4583-ae81-a15924691ccf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.843145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d872e358-7add-4583-ae81-a15924691ccf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.848368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d872e358-7add-4583-ae81-a15924691ccf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.849057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d872e358-7add-4583-ae81-a15924691ccf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.849593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d872e358-7add-4583-ae81-a15924691ccf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.939163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6ddc215a-558b-41d1-9280-cad347d1b23d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:31.949650 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6ddc215a-558b-41d1-9280-cad347d1b23d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1315 microversion: 2.1 time: 0.670599 Oct 29 03:08:31.953503 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2668/5291] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:31 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:32.475288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d872e358-7add-4583-ae81-a15924691ccf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:32.494319 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d872e358-7add-4583-ae81-a15924691ccf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1317 microversion: 2.1 time: 0.681527 Oct 29 03:08:32.497410 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2624/5292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:31 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1317 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:32.978599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7c708c9c-a0e6-4553-b43e-a7c7395d84d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:32.979163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7c708c9c-a0e6-4553-b43e-a7c7395d84d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:32.987386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c708c9c-a0e6-4553-b43e-a7c7395d84d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:32.987964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c708c9c-a0e6-4553-b43e-a7c7395d84d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:32.988811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c708c9c-a0e6-4553-b43e-a7c7395d84d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:32.989730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c708c9c-a0e6-4553-b43e-a7c7395d84d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:32.990425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c708c9c-a0e6-4553-b43e-a7c7395d84d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:32.991187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c708c9c-a0e6-4553-b43e-a7c7395d84d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:33.251495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7c708c9c-a0e6-4553-b43e-a7c7395d84d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:33.260514 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7c708c9c-a0e6-4553-b43e-a7c7395d84d0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1503 microversion: 2.1 time: 0.286348 Oct 29 03:08:33.269491 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2669/5293] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:32 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:33.290194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a7d265a7-515f-4140-a520-0871cdc0fd26 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:33.291760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a7d265a7-515f-4140-a520-0871cdc0fd26 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:33.299825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d265a7-515f-4140-a520-0871cdc0fd26 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:33.300608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d265a7-515f-4140-a520-0871cdc0fd26 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:33.301386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d265a7-515f-4140-a520-0871cdc0fd26 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:33.303198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d265a7-515f-4140-a520-0871cdc0fd26 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:33.304388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d265a7-515f-4140-a520-0871cdc0fd26 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:33.305135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7d265a7-515f-4140-a520-0871cdc0fd26 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:33.521435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de82a8dd-ce20-4429-8820-1d618d34607d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:33.522182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-de82a8dd-ce20-4429-8820-1d618d34607d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:33.534451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de82a8dd-ce20-4429-8820-1d618d34607d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:33.534957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de82a8dd-ce20-4429-8820-1d618d34607d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:33.535386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de82a8dd-ce20-4429-8820-1d618d34607d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:33.538001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de82a8dd-ce20-4429-8820-1d618d34607d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:33.538467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de82a8dd-ce20-4429-8820-1d618d34607d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:33.538885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de82a8dd-ce20-4429-8820-1d618d34607d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:33.603419 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.network.security_group_api [None req-a7d265a7-515f-4140-a520-0871cdc0fd26 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Removing security group 51991c83-a81f-4fef-9c64-9d2e931cd6f2 from port eaa05058-291a-420d-8b9f-0f339119b6cb Oct 29 03:08:33.899158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de82a8dd-ce20-4429-8820-1d618d34607d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:33.917958 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de82a8dd-ce20-4429-8820-1d618d34607d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1317 microversion: 2.1 time: 0.400113 Oct 29 03:08:33.920680 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2670/5294] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:33 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:34.113145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a0a84639-7af5-45bb-a283-778e1c24729d req-55e8393a-168c-4700-807f-d572ff579f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87ccf8a-8236-4a31-ad90-4805b875a1c1", "name": "network-vif-plugged", "status": "completed", "tag": "e064d394-4cc8-46e7-ab41-6664c7bdbce0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:34.135401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a0a84639-7af5-45bb-a283-778e1c24729d req-55e8393a-168c-4700-807f-d572ff579f81 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.135935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a0a84639-7af5-45bb-a283-778e1c24729d req-55e8393a-168c-4700-807f-d572ff579f81 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.139360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a0a84639-7af5-45bb-a283-778e1c24729d req-55e8393a-168c-4700-807f-d572ff579f81 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.166764 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a0a84639-7af5-45bb-a283-778e1c24729d req-55e8393a-168c-4700-807f-d572ff579f81 service nova] Creating event network-vif-plugged:e064d394-4cc8-46e7-ab41-6664c7bdbce0 for instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 on n-h2-862964-4 Oct 29 03:08:34.173696 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a0a84639-7af5-45bb-a283-778e1c24729d req-55e8393a-168c-4700-807f-d572ff579f81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065491 Oct 29 03:08:34.174925 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2671/5295] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:08:34.176745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a0a84639-7af5-45bb-a283-778e1c24729d req-55e8393a-168c-4700-807f-d572ff579f81 service nova] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:34.178574 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a0a84639-7af5-45bb-a283-778e1c24729d req-55e8393a-168c-4700-807f-d572ff579f81 service nova] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002165 Oct 29 03:08:34.179952 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2672/5296] 10.222.0.16 () {56 vars in 886 bytes} [Sat Oct 29 03:08:34 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 03:08:34.399066 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a7d265a7-515f-4140-a520-0871cdc0fd26 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc/action" status: 202 len: 0 microversion: 2.1 time: 1.112717 Oct 29 03:08:34.404084 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2625/5297] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:08:33 2022] POST /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc/action => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:08:34.410396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-77a40ee8-4111-40bc-87e4-e4fef9eb6e78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:34.411432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-77a40ee8-4111-40bc-87e4-e4fef9eb6e78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:34.429618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77a40ee8-4111-40bc-87e4-e4fef9eb6e78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.430149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77a40ee8-4111-40bc-87e4-e4fef9eb6e78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.433613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77a40ee8-4111-40bc-87e4-e4fef9eb6e78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.434412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77a40ee8-4111-40bc-87e4-e4fef9eb6e78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.434887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77a40ee8-4111-40bc-87e4-e4fef9eb6e78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.437864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77a40ee8-4111-40bc-87e4-e4fef9eb6e78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.880519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77a40ee8-4111-40bc-87e4-e4fef9eb6e78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:34.889876 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-77a40ee8-4111-40bc-87e4-e4fef9eb6e78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1461 microversion: 2.1 time: 0.485119 Oct 29 03:08:34.893893 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2673/5298] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:34 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1461 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:34.919438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9dddb77d-cf39-4fe5-b639-8681cf9bd59a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:34.920221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9dddb77d-cf39-4fe5-b639-8681cf9bd59a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:34.931875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dddb77d-cf39-4fe5-b639-8681cf9bd59a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.933017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dddb77d-cf39-4fe5-b639-8681cf9bd59a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.935968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dddb77d-cf39-4fe5-b639-8681cf9bd59a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.937032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dddb77d-cf39-4fe5-b639-8681cf9bd59a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.937922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dddb77d-cf39-4fe5-b639-8681cf9bd59a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.939424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dddb77d-cf39-4fe5-b639-8681cf9bd59a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.944709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5dfa1c9d-c242-4eea-b54c-11e5977e70c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:34.945343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5dfa1c9d-c242-4eea-b54c-11e5977e70c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:34.964683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dfa1c9d-c242-4eea-b54c-11e5977e70c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.965174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dfa1c9d-c242-4eea-b54c-11e5977e70c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.965654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dfa1c9d-c242-4eea-b54c-11e5977e70c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.966511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dfa1c9d-c242-4eea-b54c-11e5977e70c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.966962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dfa1c9d-c242-4eea-b54c-11e5977e70c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.967383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dfa1c9d-c242-4eea-b54c-11e5977e70c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.222038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9dddb77d-cf39-4fe5-b639-8681cf9bd59a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:35.240704 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9dddb77d-cf39-4fe5-b639-8681cf9bd59a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.325971 Oct 29 03:08:35.256134 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2626/5299] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:34 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:35.272729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-cf02443c-9154-44ad-b9aa-9abfc39481fd req-fd55d099-b656-4587-b371-d943c6723066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7064a1-f665-453b-8f44-91cedddf96bc", "tag": "eaa05058-291a-420d-8b9f-0f339119b6cb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:35.300597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cf02443c-9154-44ad-b9aa-9abfc39481fd req-fd55d099-b656-4587-b371-d943c6723066 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.300972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cf02443c-9154-44ad-b9aa-9abfc39481fd req-fd55d099-b656-4587-b371-d943c6723066 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.301407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cf02443c-9154-44ad-b9aa-9abfc39481fd req-fd55d099-b656-4587-b371-d943c6723066 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.327323 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-cf02443c-9154-44ad-b9aa-9abfc39481fd req-fd55d099-b656-4587-b371-d943c6723066 service nova] Creating event network-changed:eaa05058-291a-420d-8b9f-0f339119b6cb for instance 2c7064a1-f665-453b-8f44-91cedddf96bc on n-h1-862964-4 Oct 29 03:08:35.341987 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-cf02443c-9154-44ad-b9aa-9abfc39481fd req-fd55d099-b656-4587-b371-d943c6723066 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084267 Oct 29 03:08:35.342878 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2627/5300] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:35.350897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2441ef7b-5909-4e34-8071-a8593f1e20cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:35.351612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2441ef7b-5909-4e34-8071-a8593f1e20cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:35.351739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5dfa1c9d-c242-4eea-b54c-11e5977e70c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:35.366553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2441ef7b-5909-4e34-8071-a8593f1e20cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.367052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2441ef7b-5909-4e34-8071-a8593f1e20cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.367800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2441ef7b-5909-4e34-8071-a8593f1e20cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.368559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2441ef7b-5909-4e34-8071-a8593f1e20cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.369266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2441ef7b-5909-4e34-8071-a8593f1e20cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.369783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2441ef7b-5909-4e34-8071-a8593f1e20cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.385376 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5dfa1c9d-c242-4eea-b54c-11e5977e70c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1317 microversion: 2.1 time: 0.441396 Oct 29 03:08:35.388687 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2674/5301] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:34 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:35.801409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2441ef7b-5909-4e34-8071-a8593f1e20cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:35.813716 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2441ef7b-5909-4e34-8071-a8593f1e20cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.469603 Oct 29 03:08:35.820898 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2628/5302] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:35 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:35.853693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ead879ea-aac0-4c46-b961-0e7fde9916cf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:35.855941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ead879ea-aac0-4c46-b961-0e7fde9916cf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:35.872371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ead879ea-aac0-4c46-b961-0e7fde9916cf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.874488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ead879ea-aac0-4c46-b961-0e7fde9916cf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.875221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ead879ea-aac0-4c46-b961-0e7fde9916cf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.877667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ead879ea-aac0-4c46-b961-0e7fde9916cf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.878401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ead879ea-aac0-4c46-b961-0e7fde9916cf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.879290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ead879ea-aac0-4c46-b961-0e7fde9916cf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.937260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:36.213149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c57de658-c41c-4ab6-b87c-b2d741c96715 req-7b6be68d-d0c8-45d2-bf21-5f4d57e52607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e128c38-7acd-43a8-b9a3-cc26676e702e", "name": "network-vif-plugged", "status": "completed", "tag": "b1e0bf4b-9dd4-47dd-923b-eaaab9d2e6fa"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:36.230075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c57de658-c41c-4ab6-b87c-b2d741c96715 req-7b6be68d-d0c8-45d2-bf21-5f4d57e52607 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.232958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c57de658-c41c-4ab6-b87c-b2d741c96715 req-7b6be68d-d0c8-45d2-bf21-5f4d57e52607 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.233581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c57de658-c41c-4ab6-b87c-b2d741c96715 req-7b6be68d-d0c8-45d2-bf21-5f4d57e52607 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.254284 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c57de658-c41c-4ab6-b87c-b2d741c96715 req-7b6be68d-d0c8-45d2-bf21-5f4d57e52607 service nova] Creating event network-vif-plugged:b1e0bf4b-9dd4-47dd-923b-eaaab9d2e6fa for instance 1e128c38-7acd-43a8-b9a3-cc26676e702e on n-h1-862964-4 Oct 29 03:08:36.260157 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c57de658-c41c-4ab6-b87c-b2d741c96715 req-7b6be68d-d0c8-45d2-bf21-5f4d57e52607 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050597 Oct 29 03:08:36.261227 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2629/5303] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:08:36.419687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6cd773d1-02aa-4854-8819-5bc9fcfb34ef tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:36.421142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6cd773d1-02aa-4854-8819-5bc9fcfb34ef tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:36.433304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd773d1-02aa-4854-8819-5bc9fcfb34ef tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.434573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd773d1-02aa-4854-8819-5bc9fcfb34ef tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.435957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd773d1-02aa-4854-8819-5bc9fcfb34ef tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.437396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd773d1-02aa-4854-8819-5bc9fcfb34ef tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.438360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd773d1-02aa-4854-8819-5bc9fcfb34ef tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.439049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cd773d1-02aa-4854-8819-5bc9fcfb34ef tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.654879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ead879ea-aac0-4c46-b961-0e7fde9916cf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:36.666602 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ead879ea-aac0-4c46-b961-0e7fde9916cf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.820727 Oct 29 03:08:36.667232 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2675/5304] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:35 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:36.690752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b70022e-75ca-4ea3-a55e-72613f1e97cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:36.691757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b70022e-75ca-4ea3-a55e-72613f1e97cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:36.700040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b70022e-75ca-4ea3-a55e-72613f1e97cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.701410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b70022e-75ca-4ea3-a55e-72613f1e97cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.702155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b70022e-75ca-4ea3-a55e-72613f1e97cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.703111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b70022e-75ca-4ea3-a55e-72613f1e97cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.703792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b70022e-75ca-4ea3-a55e-72613f1e97cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.704455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b70022e-75ca-4ea3-a55e-72613f1e97cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.810394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6cd773d1-02aa-4854-8819-5bc9fcfb34ef tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:36.827729 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6cd773d1-02aa-4854-8819-5bc9fcfb34ef tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1317 microversion: 2.1 time: 0.414607 Oct 29 03:08:36.843508 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2630/5305] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:36 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:37.461344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9b70022e-75ca-4ea3-a55e-72613f1e97cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:37.476745 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b70022e-75ca-4ea3-a55e-72613f1e97cc tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.790180 Oct 29 03:08:37.479081 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2676/5306] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:36 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:37.694044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-260647908", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "c699032f-5e15-4569-a5f2-71386fa3ff27"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:37.839262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] validate_networks() for [('c699032f-5e15-4569-a5f2-71386fa3ff27', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:08:37.854548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5723b017-2f4b-4c70-9318-5e83f0c811e3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:37.855844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5723b017-2f4b-4c70-9318-5e83f0c811e3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:37.863838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5723b017-2f4b-4c70-9318-5e83f0c811e3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:37.865404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5723b017-2f4b-4c70-9318-5e83f0c811e3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:37.866681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5723b017-2f4b-4c70-9318-5e83f0c811e3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:37.867983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5723b017-2f4b-4c70-9318-5e83f0c811e3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:37.868828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5723b017-2f4b-4c70-9318-5e83f0c811e3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:37.869978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5723b017-2f4b-4c70-9318-5e83f0c811e3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.647016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5723b017-2f4b-4c70-9318-5e83f0c811e3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:38.675350 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5723b017-2f4b-4c70-9318-5e83f0c811e3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1466 microversion: 2.1 time: 0.823963 Oct 29 03:08:38.679063 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2677/5307] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:37 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1466 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:38.704200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4211e806-0926-4595-8def-4e477d38f2f1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:38.707493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4211e806-0926-4595-8def-4e477d38f2f1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:38.717960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4211e806-0926-4595-8def-4e477d38f2f1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.721491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4211e806-0926-4595-8def-4e477d38f2f1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.726007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4211e806-0926-4595-8def-4e477d38f2f1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.727208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4211e806-0926-4595-8def-4e477d38f2f1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.728056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4211e806-0926-4595-8def-4e477d38f2f1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.728701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4211e806-0926-4595-8def-4e477d38f2f1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.818031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:08:38.818873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:08:38.819447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:08:38.820916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:08:38.821465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:08:38.850967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.852391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.854510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.857308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.858743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.859930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.922463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for project d4193e4464b7488b9b3bb4064afb0288. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:38.944966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Getting quotas for user dc4e17d222e0426698d1ef9a17921d64 and project d4193e4464b7488b9b3bb4064afb0288. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:38.980709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:08:38.985694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:39.108060 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-55a0fcf8-9c41-45da-a985-20941babae3e tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417988 Oct 29 03:08:39.109361 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2631/5308] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:08:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:08:39.123272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c37d76ae-a8e9-4577-8a55-3750c5365e53 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:39.124019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c37d76ae-a8e9-4577-8a55-3750c5365e53 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:39.251961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4211e806-0926-4595-8def-4e477d38f2f1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:39.288664 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4211e806-0926-4595-8def-4e477d38f2f1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 200 len: 1468 microversion: 2.1 time: 0.589133 Oct 29 03:08:39.295315 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2678/5309] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:38 2022] GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 1468 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:39.326221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c37d76ae-a8e9-4577-8a55-3750c5365e53 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:39.341498 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c37d76ae-a8e9-4577-8a55-3750c5365e53 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1214 microversion: 2.1 time: 0.217757 Oct 29 03:08:39.343011 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2632/5310] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:39 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1214 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:39.377511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-48b07258-c2c5-478f-a008-1f4a20450042 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-19518206"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:39.380412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-48b07258-c2c5-478f-a008-1f4a20450042 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:39.407019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48b07258-c2c5-478f-a008-1f4a20450042 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:39.407979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48b07258-c2c5-478f-a008-1f4a20450042 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:39.408641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48b07258-c2c5-478f-a008-1f4a20450042 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:39.409677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48b07258-c2c5-478f-a008-1f4a20450042 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:39.410440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48b07258-c2c5-478f-a008-1f4a20450042 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:39.411767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48b07258-c2c5-478f-a008-1f4a20450042 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:39.749875 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-48b07258-c2c5-478f-a008-1f4a20450042 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "POST /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1/action" status: 202 len: 0 microversion: 2.1 time: 0.383979 Oct 29 03:08:39.756278 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2633/5311] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:08:39 2022] POST /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 03:08:39.769157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bb71020f-feb5-425e-9760-503e1e1abd6f tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1acc434c0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:39.874483 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bb71020f-feb5-425e-9760-503e1e1abd6f tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.116034 Oct 29 03:08:39.879161 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2634/5312] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:39 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:40.209568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-726520cf-48c6-4df7-8dbe-a1552260fd57 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Calling method '.version_select at 0x7fe1a32f95e0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:40.390329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2568fffa-2e48-4b1c-8442-760d84344515 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:40.391641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2568fffa-2e48-4b1c-8442-760d84344515 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:40.411904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2568fffa-2e48-4b1c-8442-760d84344515 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:40.412678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2568fffa-2e48-4b1c-8442-760d84344515 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:40.413122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2568fffa-2e48-4b1c-8442-760d84344515 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:40.415621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2568fffa-2e48-4b1c-8442-760d84344515 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:40.416394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2568fffa-2e48-4b1c-8442-760d84344515 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:40.416832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2568fffa-2e48-4b1c-8442-760d84344515 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:40.722224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2568fffa-2e48-4b1c-8442-760d84344515 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:40.726604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:40.735830 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2568fffa-2e48-4b1c-8442-760d84344515 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1210 microversion: 2.1 time: 0.372607 Oct 29 03:08:40.749837 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2635/5313] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:40 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1210 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:40.855325 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-726520cf-48c6-4df7-8dbe-a1552260fd57 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/24916df98a104710b7939e018de25ca1/defaults" status: 200 len: 371 microversion: 2.1 time: 1.557527 Oct 29 03:08:40.856595 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2679/5314] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 03:08:39 2022] GET /compute/v2.1/os-quota-sets/24916df98a104710b7939e018de25ca1/defaults => generated 371 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:40.869933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0a4f3d5e-4d2e-4a29-b4db-4a6ad3194f99 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Calling method '.version_select at 0x7fe1a3f738b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:40.892748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ae60daa5-f3c3-45be-8f39-bc9e5cf06728 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a32f80d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:40.979102 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ae60daa5-f3c3-45be-8f39-bc9e5cf06728 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.090720 Oct 29 03:08:40.979651 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2680/5315] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:40 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:41.460087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:41.487476 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0a4f3d5e-4d2e-4a29-b4db-4a6ad3194f99 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/24916df98a104710b7939e018de25ca1" status: 200 len: 371 microversion: 2.1 time: 0.622414 Oct 29 03:08:41.488335 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2636/5316] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 03:08:40 2022] GET /compute/v2.1/os-quota-sets/24916df98a104710b7939e018de25ca1 => generated 371 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:41.504177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4aadf84b-341d-4941-96b1-3749d9dd64df tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Calling method '.version_select at 0x7fe1a336ea60>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:41.767316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-01da8977-dc67-4277-a0e5-d1e553d01cce tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:41.768012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-01da8977-dc67-4277-a0e5-d1e553d01cce tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:41.791808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01da8977-dc67-4277-a0e5-d1e553d01cce tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:41.792615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01da8977-dc67-4277-a0e5-d1e553d01cce tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:41.793275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01da8977-dc67-4277-a0e5-d1e553d01cce tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:41.794385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01da8977-dc67-4277-a0e5-d1e553d01cce tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:41.795123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01da8977-dc67-4277-a0e5-d1e553d01cce tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:41.797021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-01da8977-dc67-4277-a0e5-d1e553d01cce tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:41.913471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-01da8977-dc67-4277-a0e5-d1e553d01cce tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:41.928914 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-01da8977-dc67-4277-a0e5-d1e553d01cce tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1284 microversion: 2.1 time: 0.166559 Oct 29 03:08:41.935234 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2637/5317] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:41 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:41.996450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-961a7ce8-9123-4142-9ed6-1c8e9a45a259 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1acb19d30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:42.069549 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-961a7ce8-9123-4142-9ed6-1c8e9a45a259 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.078784 Oct 29 03:08:42.071391 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2638/5318] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:41 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:42.272376 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4aadf84b-341d-4941-96b1-3749d9dd64df tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/24916df98a104710b7939e018de25ca1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.773131 Oct 29 03:08:42.273767 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2681/5319] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 03:08:41 2022] GET /compute/v2.1/os-quota-sets/24916df98a104710b7939e018de25ca1/defaults => generated 371 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:08:42.289278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3e9d8cec-6339-4654-8fab-15bcfe9e2022 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Calling method '.version_select at 0x7fe1a8cd3670>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:42.953303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-69a1563e-8344-4fe0-9262-ea7088452f60 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:42.954302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-69a1563e-8344-4fe0-9262-ea7088452f60 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:42.961114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69a1563e-8344-4fe0-9262-ea7088452f60 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:42.962035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69a1563e-8344-4fe0-9262-ea7088452f60 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:42.962724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69a1563e-8344-4fe0-9262-ea7088452f60 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:42.963740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69a1563e-8344-4fe0-9262-ea7088452f60 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:42.964416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69a1563e-8344-4fe0-9262-ea7088452f60 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:42.965055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69a1563e-8344-4fe0-9262-ea7088452f60 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:43.026899 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3e9d8cec-6339-4654-8fab-15bcfe9e2022 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/24916df98a104710b7939e018de25ca1" status: 200 len: 371 microversion: 2.1 time: 0.741661 Oct 29 03:08:43.027485 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2639/5320] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 03:08:42 2022] GET /compute/v2.1/os-quota-sets/24916df98a104710b7939e018de25ca1 => generated 371 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:43.040188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-02f8436e-32bc-483d-962c-e43b53c52b09 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Calling method '.version_select at 0x7fe1a3f73af0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:43.125602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69a1563e-8344-4fe0-9262-ea7088452f60 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:43.139650 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-69a1563e-8344-4fe0-9262-ea7088452f60 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1272 microversion: 2.1 time: 0.190302 Oct 29 03:08:43.141374 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2682/5321] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:42 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:43.147650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ff520f9b-975c-4e52-9ca1-255f6b7c1cda tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3286700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:43.231015 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ff520f9b-975c-4e52-9ca1-255f6b7c1cda tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.087260 Oct 29 03:08:43.232498 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2683/5322] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:43 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:43.702357 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-02f8436e-32bc-483d-962c-e43b53c52b09 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/24916df98a104710b7939e018de25ca1?user_id=904447cf3fd642f5ae2d618e3444fba3" status: 200 len: 371 microversion: 2.1 time: 0.665995 Oct 29 03:08:43.702921 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2640/5323] 10.222.0.16 () {58 vars in 1323 bytes} [Sat Oct 29 03:08:43 2022] GET /compute/v2.1/os-quota-sets/24916df98a104710b7939e018de25ca1?user_id=904447cf3fd642f5ae2d618e3444fba3 => generated 371 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:08:44.165763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be14d255-566e-4780-9957-90fbbb8399de tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:44.166425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-be14d255-566e-4780-9957-90fbbb8399de tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:44.178350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be14d255-566e-4780-9957-90fbbb8399de tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.179892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be14d255-566e-4780-9957-90fbbb8399de tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.181096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be14d255-566e-4780-9957-90fbbb8399de tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.184657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be14d255-566e-4780-9957-90fbbb8399de tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.187806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be14d255-566e-4780-9957-90fbbb8399de tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.188525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be14d255-566e-4780-9957-90fbbb8399de tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.247542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f4333267-c924-4681-a529-b6f4ca24a4e8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1acb19f70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:44.314082 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f4333267-c924-4681-a529-b6f4ca24a4e8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.070672 Oct 29 03:08:44.315031 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2641/5324] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:44 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:44.489193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-7fe484fe-9050-4ed3-aa09-f49b4580a923 req-2406274b-49f4-4d69-81d6-4e6e41f5c160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87ccf8a-8236-4a31-ad90-4805b875a1c1", "name": "network-vif-plugged", "status": "completed", "tag": "e064d394-4cc8-46e7-ab41-6664c7bdbce0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:44.500551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7fe484fe-9050-4ed3-aa09-f49b4580a923 req-2406274b-49f4-4d69-81d6-4e6e41f5c160 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.501578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7fe484fe-9050-4ed3-aa09-f49b4580a923 req-2406274b-49f4-4d69-81d6-4e6e41f5c160 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.502836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7fe484fe-9050-4ed3-aa09-f49b4580a923 req-2406274b-49f4-4d69-81d6-4e6e41f5c160 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.516096 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-7fe484fe-9050-4ed3-aa09-f49b4580a923 req-2406274b-49f4-4d69-81d6-4e6e41f5c160 service nova] Creating event network-vif-plugged:e064d394-4cc8-46e7-ab41-6664c7bdbce0 for instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 on n-h2-862964-4 Oct 29 03:08:44.522008 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-7fe484fe-9050-4ed3-aa09-f49b4580a923 req-2406274b-49f4-4d69-81d6-4e6e41f5c160 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036374 Oct 29 03:08:44.523403 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2642/5325] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:08:44.539966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-be14d255-566e-4780-9957-90fbbb8399de tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:44.560848 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be14d255-566e-4780-9957-90fbbb8399de tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1272 microversion: 2.1 time: 0.399953 Oct 29 03:08:44.565368 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2684/5326] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:44 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1272 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:45.336386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b0d839b9-f424-4227-928c-34eedb00e57c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a8789940>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:45.424906 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b0d839b9-f424-4227-928c-34eedb00e57c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.095417 Oct 29 03:08:45.438050 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2643/5327] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:45 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:45.592141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b3f59203-fd5c-44c2-bb22-6c5350dade98 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:45.593513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b3f59203-fd5c-44c2-bb22-6c5350dade98 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:45.622066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f59203-fd5c-44c2-bb22-6c5350dade98 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:45.623096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f59203-fd5c-44c2-bb22-6c5350dade98 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:45.625379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f59203-fd5c-44c2-bb22-6c5350dade98 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:45.627498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f59203-fd5c-44c2-bb22-6c5350dade98 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:45.639527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f59203-fd5c-44c2-bb22-6c5350dade98 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:45.640111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f59203-fd5c-44c2-bb22-6c5350dade98 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:46.092578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3f59203-fd5c-44c2-bb22-6c5350dade98 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:46.113876 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b3f59203-fd5c-44c2-bb22-6c5350dade98 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1314 microversion: 2.1 time: 0.531582 Oct 29 03:08:46.122206 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2685/5328] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:45 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:46.453646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b8c171d-f4bb-478a-a731-63651e6cc870 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3e5df70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:46.552641 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b8c171d-f4bb-478a-a731-63651e6cc870 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.099989 Oct 29 03:08:46.570948 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2644/5329] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:46 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:47.141296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-58eb4995-0190-454b-82e7-e82b8e6f1edf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:47.142612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-58eb4995-0190-454b-82e7-e82b8e6f1edf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:47.154917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58eb4995-0190-454b-82e7-e82b8e6f1edf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:47.156935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58eb4995-0190-454b-82e7-e82b8e6f1edf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:47.158978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58eb4995-0190-454b-82e7-e82b8e6f1edf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:47.160070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58eb4995-0190-454b-82e7-e82b8e6f1edf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:47.161542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58eb4995-0190-454b-82e7-e82b8e6f1edf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:47.162473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58eb4995-0190-454b-82e7-e82b8e6f1edf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:47.572808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8c9ad178-52b4-4d79-84d8-4d115371ae17 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1acc22550>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:47.673633 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8c9ad178-52b4-4d79-84d8-4d115371ae17 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.106640 Oct 29 03:08:47.674660 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2645/5330] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:47 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:48.693080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bb311241-b1ee-4ab2-b5bb-c0ccf5ebd20c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3fda4c0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:48.749583 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bb311241-b1ee-4ab2-b5bb-c0ccf5ebd20c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.062298 Oct 29 03:08:48.766191 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2646/5331] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:48 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:49.230825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-58eb4995-0190-454b-82e7-e82b8e6f1edf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:49.248157 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-58eb4995-0190-454b-82e7-e82b8e6f1edf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1314 microversion: 2.1 time: 2.109831 Oct 29 03:08:49.263802 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2686/5332] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:47 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1314 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:49.774045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:49.780265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8c0bd228-7ba0-4d97-b650-4fefb9c08578 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a80940d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:49.889456 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8c0bd228-7ba0-4d97-b650-4fefb9c08578 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.116658 Oct 29 03:08:49.890093 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2647/5333] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:49 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:50.272813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7ea74cbf-f4bf-41ca-b3e6-566f99d5b9f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:50.273789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7ea74cbf-f4bf-41ca-b3e6-566f99d5b9f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:50.279327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:50.308830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ea74cbf-f4bf-41ca-b3e6-566f99d5b9f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.309325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ea74cbf-f4bf-41ca-b3e6-566f99d5b9f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.309752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ea74cbf-f4bf-41ca-b3e6-566f99d5b9f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:50.310477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ea74cbf-f4bf-41ca-b3e6-566f99d5b9f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.310920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ea74cbf-f4bf-41ca-b3e6-566f99d5b9f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.311536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ea74cbf-f4bf-41ca-b3e6-566f99d5b9f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:50.553381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4f08e356-714f-410b-9901-5c1712286975 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Action: 'create', calling method: .version_select at 0x7fe1a3fda9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-132370202", "metadata": {"Type": "work"}}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:50.814524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7ea74cbf-f4bf-41ca-b3e6-566f99d5b9f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:50.828145 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7ea74cbf-f4bf-41ca-b3e6-566f99d5b9f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1314 microversion: 2.1 time: 0.559646 Oct 29 03:08:50.851013 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2687/5334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:50 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:50.902131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4c5fdb3f-b071-4232-a9a1-1b12f281854d req-ebdaa051-690a-4133-83b4-9438a425a9da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572315db-719f-4e84-890d-9968c46ff335", "tag": "a6107dbe-78ce-4e28-a7e1-0e8894eaa341"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:50.922633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4c5fdb3f-b071-4232-a9a1-1b12f281854d req-ebdaa051-690a-4133-83b4-9438a425a9da service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.923962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4c5fdb3f-b071-4232-a9a1-1b12f281854d req-ebdaa051-690a-4133-83b4-9438a425a9da service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.927162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4c5fdb3f-b071-4232-a9a1-1b12f281854d req-ebdaa051-690a-4133-83b4-9438a425a9da service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:50.974188 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4c5fdb3f-b071-4232-a9a1-1b12f281854d req-ebdaa051-690a-4133-83b4-9438a425a9da service nova] Creating event network-changed:a6107dbe-78ce-4e28-a7e1-0e8894eaa341 for instance 572315db-719f-4e84-890d-9968c46ff335 on n-h2-862964-4 Oct 29 03:08:50.996028 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4c5fdb3f-b071-4232-a9a1-1b12f281854d req-ebdaa051-690a-4133-83b4-9438a425a9da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104897 Oct 29 03:08:51.001095 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2688/5335] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 29 03:08:51.025589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3d8cbd5-3a8a-4f8d-9378-490212dee365 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a329b940>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:51.130673 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a3d8cbd5-3a8a-4f8d-9378-490212dee365 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.125458 Oct 29 03:08:51.133593 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2689/5336] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:51 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:51.508297 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4f08e356-714f-410b-9901-5c1712286975 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.219285 Oct 29 03:08:51.518469 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2648/5337] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:08:50 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1221 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 29 03:08:51.525674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9c42c386-d5a3-4216-bb53-7a2dfd0f6da3 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Calling method '.version_select at 0x7fe1a3fdac10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:51.606371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ff1aac07-64f8-4e3f-9a1c-3078ad51e3cb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Action: 'create', calling method: .version_select at 0x7fe1a336eee0>, body: {"keypair": {"name": "tempest-keypair-690712398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET+0NpyVTZLyuwMwZ9yLh97bhWl6/TSt5d1DIqkhbnhJ8uxu+8qUcGJniprmxYLXwJMTEht7O5AZAMpZP9xiAd6zAO0e+ooNALclQBK//K5ruKsaw8vGSselVnD9gziyA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:51.694057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-ff1aac07-64f8-4e3f-9a1c-3078ad51e3cb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Getting quotas for project 70185f31a11248d79b722001900d890a. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:51.718082 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9c42c386-d5a3-4216-bb53-7a2dfd0f6da3 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45" status: 200 len: 352 microversion: 2.1 time: 0.198773 Oct 29 03:08:51.718873 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2649/5338] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:51 2022] GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45 => generated 352 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:51.725646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-ff1aac07-64f8-4e3f-9a1c-3078ad51e3cb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Getting quotas for user 4aab5eb9a3764e75863bf930c2bbd8bd and project 70185f31a11248d79b722001900d890a. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:51.808258 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ff1aac07-64f8-4e3f-9a1c-3078ad51e3cb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.672315 Oct 29 03:08:51.822929 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2690/5339] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:08:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:51.859598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bff6e04c-907b-4a6b-b10c-989d7e972c0f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:51.860565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bff6e04c-907b-4a6b-b10c-989d7e972c0f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:51.894172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bff6e04c-907b-4a6b-b10c-989d7e972c0f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:51.895782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bff6e04c-907b-4a6b-b10c-989d7e972c0f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:51.897277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bff6e04c-907b-4a6b-b10c-989d7e972c0f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:51.898424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bff6e04c-907b-4a6b-b10c-989d7e972c0f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:51.907833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bff6e04c-907b-4a6b-b10c-989d7e972c0f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:51.908581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bff6e04c-907b-4a6b-b10c-989d7e972c0f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:52.148396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bdfdeacb-bd62-45ed-a365-a26ca6ec11e7 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a333d700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:52.249247 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bdfdeacb-bd62-45ed-a365-a26ca6ec11e7 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.104556 Oct 29 03:08:52.249890 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2691/5340] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:52 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:52.582389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bff6e04c-907b-4a6b-b10c-989d7e972c0f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:52.594721 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bff6e04c-907b-4a6b-b10c-989d7e972c0f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1314 microversion: 2.1 time: 0.739131 Oct 29 03:08:52.597503 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2650/5341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:51 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:52.732634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-59929812-49e0-4df9-ba32-885f435fc780 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Calling method '.version_select at 0x7fe1a3286ee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:52.854734 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-59929812-49e0-4df9-ba32-885f435fc780 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45" status: 200 len: 352 microversion: 2.1 time: 0.125711 Oct 29 03:08:52.856206 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2692/5342] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:52 2022] GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:53.266064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7281e3f1-f628-45fe-a269-61a0fe290eb4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3fdaee0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.391065 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7281e3f1-f628-45fe-a269-61a0fe290eb4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.129640 Oct 29 03:08:53.401865 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2651/5343] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:53.627796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b1c47c42-bcc8-4551-bc60-d35a629a91ea tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.628808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b1c47c42-bcc8-4551-bc60-d35a629a91ea tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:53.666729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c47c42-bcc8-4551-bc60-d35a629a91ea tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.670292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c47c42-bcc8-4551-bc60-d35a629a91ea tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.670742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c47c42-bcc8-4551-bc60-d35a629a91ea tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.671670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c47c42-bcc8-4551-bc60-d35a629a91ea tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.672031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c47c42-bcc8-4551-bc60-d35a629a91ea tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.672459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1c47c42-bcc8-4551-bc60-d35a629a91ea tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.871428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1a1f11bf-f8a4-494f-a99d-7b80c1283bd8 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Calling method '.version_select at 0x7fe1a3ec6430>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.911315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=16 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:54.029938 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1a1f11bf-f8a4-494f-a99d-7b80c1283bd8 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45" status: 200 len: 353 microversion: 2.1 time: 0.163948 Oct 29 03:08:54.038781 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2652/5344] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:54.044404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e2f0ae90-277e-425e-b8b8-0250c22da90b tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Calling method '.version_select at 0x7fe1acc221f0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:54.281725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b1c47c42-bcc8-4551-bc60-d35a629a91ea tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:54.314237 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e2f0ae90-277e-425e-b8b8-0250c22da90b tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45" status: 200 len: 353 microversion: 2.1 time: 0.248692 Oct 29 03:08:54.314237 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2653/5345] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:54 2022] GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45 => generated 353 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:08:54.315028 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b1c47c42-bcc8-4551-bc60-d35a629a91ea tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1314 microversion: 2.1 time: 0.670126 Oct 29 03:08:54.315028 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2693/5346] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:54.326234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a0330d2d-ca3c-4da0-8945-caecb5073d75 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Calling method '.version_select at 0x7fe1a3ec63a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:54.410914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9e5a4fcc-adfc-448e-8d77-7dfb915aa1e5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a336e8b0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:54.458218 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a0330d2d-ca3c-4da0-8945-caecb5073d75 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45" status: 202 len: 0 microversion: 2.1 time: 0.136600 Oct 29 03:08:54.462405 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2654/5347] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:08:54 2022] DELETE /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:08:54.467584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cede3107-d6e2-4b41-9aca-328e86ea4da0 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Calling method '.version_select at 0x7fe1acb198b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:54.528201 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9e5a4fcc-adfc-448e-8d77-7dfb915aa1e5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.123019 Oct 29 03:08:54.537399 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2694/5348] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:54 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:54.650927 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cede3107-d6e2-4b41-9aca-328e86ea4da0 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45" status: 200 len: 352 microversion: 2.1 time: 0.186902 Oct 29 03:08:54.651658 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2655/5349] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:54 2022] GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45 => generated 352 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:55.338742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d76c506f-1b7d-4c27-8d05-507140b7e070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:55.339767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d76c506f-1b7d-4c27-8d05-507140b7e070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:55.357982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d76c506f-1b7d-4c27-8d05-507140b7e070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.359966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d76c506f-1b7d-4c27-8d05-507140b7e070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.360790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d76c506f-1b7d-4c27-8d05-507140b7e070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.363918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d76c506f-1b7d-4c27-8d05-507140b7e070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.364999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d76c506f-1b7d-4c27-8d05-507140b7e070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.377075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d76c506f-1b7d-4c27-8d05-507140b7e070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.562494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a593b59b-1ed8-4c9b-b0f1-08b69e671485 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3e5daf0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:55.685569 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a593b59b-1ed8-4c9b-b0f1-08b69e671485 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.134781 Oct 29 03:08:55.686543 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2656/5350] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:55 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:55.695686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c77ee11-552a-4044-b616-4cba53b67b71 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Calling method '.version_select at 0x7fe1acd05160>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:55.801723 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6c77ee11-552a-4044-b616-4cba53b67b71 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45" status: 200 len: 352 microversion: 2.1 time: 0.112976 Oct 29 03:08:55.802420 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2657/5351] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:55 2022] GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:56.703887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b839f2b9-1e49-4f20-a706-17de136c119c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a8052c10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:56.762437 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b839f2b9-1e49-4f20-a706-17de136c119c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.063808 Oct 29 03:08:56.779646 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2658/5352] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:56 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:56.817837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0680faed-e4b5-4790-8844-7a191e6d51d5 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Calling method '.version_select at 0x7fe1acd05280>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:57.009675 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0680faed-e4b5-4790-8844-7a191e6d51d5 tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45" status: 200 len: 352 microversion: 2.1 time: 0.196084 Oct 29 03:08:57.010992 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2659/5353] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:56 2022] GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45 => generated 352 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:57.130175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d76c506f-1b7d-4c27-8d05-507140b7e070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:57.141136 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d76c506f-1b7d-4c27-8d05-507140b7e070 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1314 microversion: 2.1 time: 1.809098 Oct 29 03:08:57.149524 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2695/5354] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:55 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1314 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:57.183389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1796828655", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ee6d8c3-9928-4013-889f-bc9a08b57f9f"}], "security_groups": [{"name": "tempest-securitygroup--311971809"}], "key_name": "tempest-keypair-690712398", "user_data": "}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:57.443324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] validate_networks() for [('7ee6d8c3-9928-4013-889f-bc9a08b57f9f', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:08:57.787717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-682c9630-5555-4f57-be3a-c3c5c6da8030 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a33335e0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:57.870099 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-682c9630-5555-4f57-be3a-c3c5c6da8030 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.087604 Oct 29 03:08:57.875504 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2696/5355] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:57 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:58.027788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-53aad5bb-bd7d-4ae0-82a3-3683c560501d tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Calling method '.version_select at 0x7fe1a32f95e0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:58.152837 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-53aad5bb-bd7d-4ae0-82a3-3683c560501d tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45" status: 200 len: 352 microversion: 2.1 time: 0.131176 Oct 29 03:08:58.153408 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2697/5356] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:58 2022] GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45 => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:58.177484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9818dcdc-d869-4900-b0eb-c2079d73e82b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:58.178120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9818dcdc-d869-4900-b0eb-c2079d73e82b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:58.193061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9818dcdc-d869-4900-b0eb-c2079d73e82b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:58.193609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9818dcdc-d869-4900-b0eb-c2079d73e82b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:58.194070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9818dcdc-d869-4900-b0eb-c2079d73e82b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:58.194828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9818dcdc-d869-4900-b0eb-c2079d73e82b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:58.195247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9818dcdc-d869-4900-b0eb-c2079d73e82b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:58.198832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9818dcdc-d869-4900-b0eb-c2079d73e82b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:58.634342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9818dcdc-d869-4900-b0eb-c2079d73e82b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:58.647931 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9818dcdc-d869-4900-b0eb-c2079d73e82b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1314 microversion: 2.1 time: 0.474212 Oct 29 03:08:58.656410 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2698/5357] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:58 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:58.893164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d6529a53-b843-4862-be62-08785489f646 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3296ee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:58.973393 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d6529a53-b843-4862-be62-08785489f646 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.084280 Oct 29 03:08:58.974758 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2699/5358] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:58 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:59.167730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fe512a8a-a840-4ffa-95ee-29609f7aa59a tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Calling method '.version_select at 0x7fe1a32f90d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:59.231090 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-fe512a8a-a840-4ffa-95ee-29609f7aa59a tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] HTTP exception thrown: Volume 22338515-0088-4b35-8d9d-8fa7a01ece45 could not be found. Oct 29 03:08:59.254306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:08:59.254807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:08:59.255986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:08:59.256419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:08:59.256839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fe512a8a-a840-4ffa-95ee-29609f7aa59a tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Request method failure captured: Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45 HTTP/1.1 Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJlC5M563_FWcWBYs_vVMJRixbJmFj3zvKgH2XeHt_18IJN5aZXxzzrQpen0IOS-gvqtrDU15fYvprDyf7QpAN37FTK5SaoHz8yd0jV1XtQY55g9i7y13GhavWP3U_lvp346nPad4ZYSoaIWfztrp33LGq9ZPodqF613NM3xANRgzNA Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: c639ff72d2fe4a879f8ef8aa060ff134 Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-VolumesGetTestJSON-1324579552 Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c639ff72d2fe4a879f8ef8aa060ff134"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c639ff72d2fe4a879f8ef8aa060ff134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c639ff72d2fe4a879f8ef8aa060ff134", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c639ff72d2fe4a879f8ef8aa060ff134"}]}] Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-VolumesGetTestJSON-1324579552 Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: c639ff72d2fe4a879f8ef8aa060ff134 Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-VolumesGetTestJSON-1324579552 Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-VolumesGetTestJSON-1324579552-project Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 46106f84fe6c4f4ab0d291148780806b Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-VolumesGetTestJSON-1324579552-project Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: exception: Volume 22338515-0088-4b35-8d9d-8fa7a01ece45 could not be found. Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '22338515-0088-4b35-8d9d-8fa7a01ece45'} Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22338515-0088-4b35-8d9d-8fa7a01ece45 could not be found. (HTTP 404) (Request-ID: req-85b08a7b-df58-4ba1-b8af-44f197169026) Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:08:59.273610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22338515-0088-4b35-8d9d-8fa7a01ece45 could not be found. Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22338515-0088-4b35-8d9d-8fa7a01ece45 could not be found. Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22338515-0088-4b35-8d9d-8fa7a01ece45 could not be found. Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fe512a8a-a840-4ffa-95ee-29609f7aa59a tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] Returning 404 to user: Volume 22338515-0088-4b35-8d9d-8fa7a01ece45 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fe512a8a-a840-4ffa-95ee-29609f7aa59a tempest-VolumesGetTestJSON-1324579552 tempest-VolumesGetTestJSON-1324579552-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45" status: 404 len: 109 microversion: 2.1 time: 0.111894 Oct 29 03:08:59.278462 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2700/5359] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:59 2022] GET /compute/v2.1/os-volumes/22338515-0088-4b35-8d9d-8fa7a01ece45 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:08:59.293971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.298333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.299392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:59.308667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.309419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.310145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:59.348327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Getting quotas for project 70185f31a11248d79b722001900d890a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:59.386302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Getting quotas for user 4aab5eb9a3764e75863bf930c2bbd8bd and project 70185f31a11248d79b722001900d890a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:59.427092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:08:59.430344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:59.547619 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-be69f996-0cc7-4df6-9bd3-483110ac73ba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.374831 Oct 29 03:08:59.562068 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2660/5360] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:08:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:08:59.572528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1499056e-3061-48b9-8a65-71b66fc647bf tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:59.573132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1499056e-3061-48b9-8a65-71b66fc647bf tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:59.683770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a80ba94b-737f-494a-9eb2-e8d7bcc3b3e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:59.684775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a80ba94b-737f-494a-9eb2-e8d7bcc3b3e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:59.698505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a80ba94b-737f-494a-9eb2-e8d7bcc3b3e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.700778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a80ba94b-737f-494a-9eb2-e8d7bcc3b3e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.703726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a80ba94b-737f-494a-9eb2-e8d7bcc3b3e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:59.719723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a80ba94b-737f-494a-9eb2-e8d7bcc3b3e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.722328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a80ba94b-737f-494a-9eb2-e8d7bcc3b3e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.722612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a80ba94b-737f-494a-9eb2-e8d7bcc3b3e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:59.830859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1499056e-3061-48b9-8a65-71b66fc647bf tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:59.838641 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1499056e-3061-48b9-8a65-71b66fc647bf tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1237 microversion: 2.1 time: 0.271081 Oct 29 03:08:59.839211 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2701/5361] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:59 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1237 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:00.005262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7fb14c56-933b-4f95-a208-76b05b1e9e49 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a333c040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:00.163129 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7fb14c56-933b-4f95-a208-76b05b1e9e49 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.176247 Oct 29 03:09:00.166496 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2702/5362] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:59 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:00.201952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a80ba94b-737f-494a-9eb2-e8d7bcc3b3e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:00.219018 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a80ba94b-737f-494a-9eb2-e8d7bcc3b3e1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1314 microversion: 2.1 time: 0.539605 Oct 29 03:09:00.219701 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2661/5363] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:59 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:00.595962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b28eb76f-dcc3-4b41-b217-66aec5b12f27 req-07a8a939-ca68-45af-897c-203bcf207c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572315db-719f-4e84-890d-9968c46ff335", "name": "network-vif-plugged", "status": "completed", "tag": "a6107dbe-78ce-4e28-a7e1-0e8894eaa341"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:00.622495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b28eb76f-dcc3-4b41-b217-66aec5b12f27 req-07a8a939-ca68-45af-897c-203bcf207c49 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:00.624796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b28eb76f-dcc3-4b41-b217-66aec5b12f27 req-07a8a939-ca68-45af-897c-203bcf207c49 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:00.626046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b28eb76f-dcc3-4b41-b217-66aec5b12f27 req-07a8a939-ca68-45af-897c-203bcf207c49 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:00.648044 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b28eb76f-dcc3-4b41-b217-66aec5b12f27 req-07a8a939-ca68-45af-897c-203bcf207c49 service nova] Creating event network-vif-plugged:a6107dbe-78ce-4e28-a7e1-0e8894eaa341 for instance 572315db-719f-4e84-890d-9968c46ff335 on n-h2-862964-4 Oct 29 03:09:00.661296 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b28eb76f-dcc3-4b41-b217-66aec5b12f27 req-07a8a939-ca68-45af-897c-203bcf207c49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071817 Oct 29 03:09:00.664921 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2703/5364] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:00.862029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-971133d0-0e8f-43f5-bc69-142f75f5e1c2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:00.863201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-971133d0-0e8f-43f5-bc69-142f75f5e1c2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:00.875559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971133d0-0e8f-43f5-bc69-142f75f5e1c2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:00.878035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971133d0-0e8f-43f5-bc69-142f75f5e1c2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:00.878842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971133d0-0e8f-43f5-bc69-142f75f5e1c2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:00.884480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971133d0-0e8f-43f5-bc69-142f75f5e1c2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:00.885603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971133d0-0e8f-43f5-bc69-142f75f5e1c2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:00.886494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971133d0-0e8f-43f5-bc69-142f75f5e1c2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.109343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-971133d0-0e8f-43f5-bc69-142f75f5e1c2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:01.124122 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-971133d0-0e8f-43f5-bc69-142f75f5e1c2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1241 microversion: 2.1 time: 0.266703 Oct 29 03:09:01.146668 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2662/5365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:00 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1241 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:01.185399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1fe92d0b-2fce-4895-9e9b-ecd57eada6bf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a32f9670>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:01.245782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b16d804-c1ab-438f-841c-665872dadc7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:01.246781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6b16d804-c1ab-438f-841c-665872dadc7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:01.269401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16d804-c1ab-438f-841c-665872dadc7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:01.273980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16d804-c1ab-438f-841c-665872dadc7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:01.277761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16d804-c1ab-438f-841c-665872dadc7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.288050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16d804-c1ab-438f-841c-665872dadc7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:01.288557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16d804-c1ab-438f-841c-665872dadc7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:01.292042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16d804-c1ab-438f-841c-665872dadc7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.314216 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1fe92d0b-2fce-4895-9e9b-ecd57eada6bf tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.135870 Oct 29 03:09:01.316362 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2704/5366] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:01 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:01.980782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b16d804-c1ab-438f-841c-665872dadc7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:01.989167 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b16d804-c1ab-438f-841c-665872dadc7b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1314 microversion: 2.1 time: 0.749469 Oct 29 03:09:02.007662 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2663/5367] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:01 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:02.153944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e44518d6-7de9-4d2b-968e-6de65f6e2561 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:02.154710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e44518d6-7de9-4d2b-968e-6de65f6e2561 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:02.185648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44518d6-7de9-4d2b-968e-6de65f6e2561 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:02.186206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44518d6-7de9-4d2b-968e-6de65f6e2561 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:02.193580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44518d6-7de9-4d2b-968e-6de65f6e2561 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:02.194505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44518d6-7de9-4d2b-968e-6de65f6e2561 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:02.194989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44518d6-7de9-4d2b-968e-6de65f6e2561 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:02.195418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e44518d6-7de9-4d2b-968e-6de65f6e2561 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:02.331028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f6ae23bb-d9b5-4f85-92e7-69aaf9271ea4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3e5d0d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:02.434936 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f6ae23bb-d9b5-4f85-92e7-69aaf9271ea4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.108444 Oct 29 03:09:02.435646 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2664/5368] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:02 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:02.494876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e44518d6-7de9-4d2b-968e-6de65f6e2561 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:02.521440 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e44518d6-7de9-4d2b-968e-6de65f6e2561 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1289 microversion: 2.1 time: 0.371772 Oct 29 03:09:02.540628 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2705/5369] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:02 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1289 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:03.021270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fcf45b8d-1c1c-414c-9941-4761a74e02f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:03.022568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fcf45b8d-1c1c-414c-9941-4761a74e02f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:03.041164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcf45b8d-1c1c-414c-9941-4761a74e02f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.048069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcf45b8d-1c1c-414c-9941-4761a74e02f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.050574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcf45b8d-1c1c-414c-9941-4761a74e02f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.056455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcf45b8d-1c1c-414c-9941-4761a74e02f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.058029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcf45b8d-1c1c-414c-9941-4761a74e02f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.059655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcf45b8d-1c1c-414c-9941-4761a74e02f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.426268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fcf45b8d-1c1c-414c-9941-4761a74e02f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:03.458135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d3c2cd2-be59-459b-b359-353cce287b9c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a86ddaf0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:03.468734 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fcf45b8d-1c1c-414c-9941-4761a74e02f9 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1502 microversion: 2.1 time: 0.452094 Oct 29 03:09:03.485371 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2665/5370] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:03 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1502 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:03.504199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a59c8da2-0095-4ba8-abd4-f42de8dbf5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:03.504199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a59c8da2-0095-4ba8-abd4-f42de8dbf5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:03.510579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a59c8da2-0095-4ba8-abd4-f42de8dbf5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.511383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a59c8da2-0095-4ba8-abd4-f42de8dbf5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.511976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a59c8da2-0095-4ba8-abd4-f42de8dbf5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.512836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a59c8da2-0095-4ba8-abd4-f42de8dbf5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.513387 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7d3c2cd2-be59-459b-b359-353cce287b9c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.058852 Oct 29 03:09:03.513614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a59c8da2-0095-4ba8-abd4-f42de8dbf5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.514222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a59c8da2-0095-4ba8-abd4-f42de8dbf5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.520076 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2706/5371] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:03 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:03.552628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e50f2603-f000-4b7c-bb6b-5f2ae6fffbdb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:03.553234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e50f2603-f000-4b7c-bb6b-5f2ae6fffbdb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:03.570062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e50f2603-f000-4b7c-bb6b-5f2ae6fffbdb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.572203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e50f2603-f000-4b7c-bb6b-5f2ae6fffbdb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.573143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e50f2603-f000-4b7c-bb6b-5f2ae6fffbdb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.577705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e50f2603-f000-4b7c-bb6b-5f2ae6fffbdb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.580008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e50f2603-f000-4b7c-bb6b-5f2ae6fffbdb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.580640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e50f2603-f000-4b7c-bb6b-5f2ae6fffbdb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.662408 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a59c8da2-0095-4ba8-abd4-f42de8dbf5a5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335/action" status: 202 len: 0 microversion: 2.1 time: 0.171309 Oct 29 03:09:03.665334 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2666/5372] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:03 2022] POST /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:09:03.697528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3f75fc4b-2356-4aaa-8bb4-961223e7550f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:03.699786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3f75fc4b-2356-4aaa-8bb4-961223e7550f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:03.717663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f75fc4b-2356-4aaa-8bb4-961223e7550f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.719737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f75fc4b-2356-4aaa-8bb4-961223e7550f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.720340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f75fc4b-2356-4aaa-8bb4-961223e7550f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.722428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f75fc4b-2356-4aaa-8bb4-961223e7550f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.724289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f75fc4b-2356-4aaa-8bb4-961223e7550f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.725866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f75fc4b-2356-4aaa-8bb4-961223e7550f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:04.103645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3f75fc4b-2356-4aaa-8bb4-961223e7550f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:04.116251 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3f75fc4b-2356-4aaa-8bb4-961223e7550f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1507 microversion: 2.1 time: 0.438923 Oct 29 03:09:04.121052 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2667/5373] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:03 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:04.187307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e50f2603-f000-4b7c-bb6b-5f2ae6fffbdb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:04.201306 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e50f2603-f000-4b7c-bb6b-5f2ae6fffbdb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1295 microversion: 2.1 time: 0.656552 Oct 29 03:09:04.203549 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2707/5374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:03 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1295 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:04.532842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e639716a-e68b-4acf-829d-6c0792a88298 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a399eaf0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:04.616952 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e639716a-e68b-4acf-829d-6c0792a88298 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.091807 Oct 29 03:09:04.618347 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2668/5375] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:04 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:05.158956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-12f60404-8f7b-4558-bd45-bb519edeaa86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:05.164292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-12f60404-8f7b-4558-bd45-bb519edeaa86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:05.208201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12f60404-8f7b-4558-bd45-bb519edeaa86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:05.231833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b405318b-cfc9-41cb-af35-6eefb76b7eec tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:05.232387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b405318b-cfc9-41cb-af35-6eefb76b7eec tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:05.234610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12f60404-8f7b-4558-bd45-bb519edeaa86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:05.237476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12f60404-8f7b-4558-bd45-bb519edeaa86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:05.238342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12f60404-8f7b-4558-bd45-bb519edeaa86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:05.241069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12f60404-8f7b-4558-bd45-bb519edeaa86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:05.245871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12f60404-8f7b-4558-bd45-bb519edeaa86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:05.251173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b405318b-cfc9-41cb-af35-6eefb76b7eec tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:05.251874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b405318b-cfc9-41cb-af35-6eefb76b7eec tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:05.252317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b405318b-cfc9-41cb-af35-6eefb76b7eec tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:05.254380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b405318b-cfc9-41cb-af35-6eefb76b7eec tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:05.255197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b405318b-cfc9-41cb-af35-6eefb76b7eec tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:05.255628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b405318b-cfc9-41cb-af35-6eefb76b7eec tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:05.571185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b405318b-cfc9-41cb-af35-6eefb76b7eec tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:05.581741 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b405318b-cfc9-41cb-af35-6eefb76b7eec tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1362 microversion: 2.1 time: 0.357821 Oct 29 03:09:05.584988 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2669/5376] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:05 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:05.632961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d08fcb9c-da31-44c1-8671-7a76c3206778 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a399e160>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:05.651736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-12f60404-8f7b-4558-bd45-bb519edeaa86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:05.665351 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-12f60404-8f7b-4558-bd45-bb519edeaa86 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1487 microversion: 2.1 time: 0.521251 Oct 29 03:09:05.666026 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2708/5377] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:05 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1487 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:05.706152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f9cd641c-ca7b-4a58-b7c2-c0286a2d70c4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:05.707123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f9cd641c-ca7b-4a58-b7c2-c0286a2d70c4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:05.716240 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d08fcb9c-da31-44c1-8671-7a76c3206778 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.087459 Oct 29 03:09:05.718423 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2670/5378] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:05 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:05.724435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9cd641c-ca7b-4a58-b7c2-c0286a2d70c4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:05.724933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9cd641c-ca7b-4a58-b7c2-c0286a2d70c4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:05.725365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9cd641c-ca7b-4a58-b7c2-c0286a2d70c4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:05.728352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9cd641c-ca7b-4a58-b7c2-c0286a2d70c4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:05.728822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9cd641c-ca7b-4a58-b7c2-c0286a2d70c4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:05.729720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f9cd641c-ca7b-4a58-b7c2-c0286a2d70c4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:05.838394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-f9cd641c-ca7b-4a58-b7c2-c0286a2d70c4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lazy-loading 'flavor' on Instance uuid 572315db-719f-4e84-890d-9968c46ff335 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:09:05.908135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:06.320414 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f9cd641c-ca7b-4a58-b7c2-c0286a2d70c4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335/action" status: 202 len: 0 microversion: 2.1 time: 0.626457 Oct 29 03:09:06.323444 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2709/5379] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:05 2022] POST /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:09:06.332398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50d05d0a-2c71-4d2d-b561-1e5b8857d51f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:06.333610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-50d05d0a-2c71-4d2d-b561-1e5b8857d51f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:06.354260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d05d0a-2c71-4d2d-b561-1e5b8857d51f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:06.354941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d05d0a-2c71-4d2d-b561-1e5b8857d51f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:06.355561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d05d0a-2c71-4d2d-b561-1e5b8857d51f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:06.356454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d05d0a-2c71-4d2d-b561-1e5b8857d51f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:06.356914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d05d0a-2c71-4d2d-b561-1e5b8857d51f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:06.357339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50d05d0a-2c71-4d2d-b561-1e5b8857d51f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:06.611194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d45e779e-57ed-45b1-8a98-bb89b68659e5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:06.611895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d45e779e-57ed-45b1-8a98-bb89b68659e5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:06.628646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d45e779e-57ed-45b1-8a98-bb89b68659e5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:06.628872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d45e779e-57ed-45b1-8a98-bb89b68659e5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:06.629283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d45e779e-57ed-45b1-8a98-bb89b68659e5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:06.658216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d45e779e-57ed-45b1-8a98-bb89b68659e5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:06.658813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d45e779e-57ed-45b1-8a98-bb89b68659e5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:06.659258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d45e779e-57ed-45b1-8a98-bb89b68659e5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:06.791115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-50d05d0a-2c71-4d2d-b561-1e5b8857d51f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:06.804389 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50d05d0a-2c71-4d2d-b561-1e5b8857d51f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1493 microversion: 2.1 time: 0.476755 Oct 29 03:09:06.826361 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2671/5380] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:06 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1493 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:06.857529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ba7a1dc-39ab-4c2a-9592-2433d9626660 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a399e160>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:06.950259 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ba7a1dc-39ab-4c2a-9592-2433d9626660 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.120703 Oct 29 03:09:06.950853 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2672/5381] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:06 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:06.965648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-84b292e2-ae41-4f12-a0eb-7da3c89cbdf0 req-ac40d016-b96b-4781-9d87-4a57dbcf5f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15eb84a-805e-4a1f-abfb-f0c495c463b6", "tag": "741e7b99-4744-4575-82a2-e9205a08d484"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:07.007121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-84b292e2-ae41-4f12-a0eb-7da3c89cbdf0 req-ac40d016-b96b-4781-9d87-4a57dbcf5f80 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:07.007951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-84b292e2-ae41-4f12-a0eb-7da3c89cbdf0 req-ac40d016-b96b-4781-9d87-4a57dbcf5f80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:07.008753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-84b292e2-ae41-4f12-a0eb-7da3c89cbdf0 req-ac40d016-b96b-4781-9d87-4a57dbcf5f80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:07.029009 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-84b292e2-ae41-4f12-a0eb-7da3c89cbdf0 req-ac40d016-b96b-4781-9d87-4a57dbcf5f80 service nova] Creating event network-changed:741e7b99-4744-4575-82a2-e9205a08d484 for instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 on n-h1-862964-4 Oct 29 03:09:07.037243 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-84b292e2-ae41-4f12-a0eb-7da3c89cbdf0 req-ac40d016-b96b-4781-9d87-4a57dbcf5f80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082854 Oct 29 03:09:07.038751 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2673/5382] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:07.323360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d45e779e-57ed-45b1-8a98-bb89b68659e5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:07.337283 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d45e779e-57ed-45b1-8a98-bb89b68659e5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1362 microversion: 2.1 time: 0.730229 Oct 29 03:09:07.346087 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2710/5383] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:06 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1362 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:07.840554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e9320553-8232-4680-82ec-9b5a8513f6ee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:07.841349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e9320553-8232-4680-82ec-9b5a8513f6ee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:07.867705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9320553-8232-4680-82ec-9b5a8513f6ee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:07.868163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9320553-8232-4680-82ec-9b5a8513f6ee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:07.868598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9320553-8232-4680-82ec-9b5a8513f6ee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:07.869300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9320553-8232-4680-82ec-9b5a8513f6ee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:07.876295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9320553-8232-4680-82ec-9b5a8513f6ee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:07.879356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9320553-8232-4680-82ec-9b5a8513f6ee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:07.972703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8fcd0c76-7e02-4cc8-bb9d-13425d1f87ed tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a333dd30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:08.056499 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8fcd0c76-7e02-4cc8-bb9d-13425d1f87ed tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.093061 Oct 29 03:09:08.057392 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2711/5384] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:07 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:08.374535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef85f2e1-9948-4118-be99-bf7f57c862d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:08.375221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ef85f2e1-9948-4118-be99-bf7f57c862d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:08.393940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef85f2e1-9948-4118-be99-bf7f57c862d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:08.394739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef85f2e1-9948-4118-be99-bf7f57c862d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:08.395348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef85f2e1-9948-4118-be99-bf7f57c862d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:08.400249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef85f2e1-9948-4118-be99-bf7f57c862d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:08.402047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef85f2e1-9948-4118-be99-bf7f57c862d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:08.402655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef85f2e1-9948-4118-be99-bf7f57c862d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:08.440013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e9320553-8232-4680-82ec-9b5a8513f6ee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:08.463535 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e9320553-8232-4680-82ec-9b5a8513f6ee tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1514 microversion: 2.1 time: 0.627742 Oct 29 03:09:08.488252 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2674/5385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:07 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1514 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:09.072837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59c022d5-9261-4202-8a3b-8194c2ffbfdd tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a87894c0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:09.172563 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59c022d5-9261-4202-8a3b-8194c2ffbfdd tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1451 microversion: 2.1 time: 0.104658 Oct 29 03:09:09.173959 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2675/5386] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:09 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:09.498124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-88aded02-92d3-4a6e-97d4-aa98cd93782c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:09.498895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-88aded02-92d3-4a6e-97d4-aa98cd93782c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:09.502586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:09.506168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:09.550579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88aded02-92d3-4a6e-97d4-aa98cd93782c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:09.561397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88aded02-92d3-4a6e-97d4-aa98cd93782c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:09.562488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88aded02-92d3-4a6e-97d4-aa98cd93782c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:09.564074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88aded02-92d3-4a6e-97d4-aa98cd93782c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:09.565460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88aded02-92d3-4a6e-97d4-aa98cd93782c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:09.570368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88aded02-92d3-4a6e-97d4-aa98cd93782c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:09.801252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ef85f2e1-9948-4118-be99-bf7f57c862d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:09.821875 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ef85f2e1-9948-4118-be99-bf7f57c862d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1362 microversion: 2.1 time: 1.448598 Oct 29 03:09:09.824388 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2712/5387] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:08 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1362 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:09.869151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-88aded02-92d3-4a6e-97d4-aa98cd93782c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:09.879898 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-88aded02-92d3-4a6e-97d4-aa98cd93782c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.387164 Oct 29 03:09:09.884455 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2676/5388] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:09 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:10.188513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c9a9eb58-3107-4cdb-99cc-ae684a8f5584 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a32f9820>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:10.194304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:10.846860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2cab3127-33b9-431a-b300-851f250fa48c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:10.847634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2cab3127-33b9-431a-b300-851f250fa48c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:10.857459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cab3127-33b9-431a-b300-851f250fa48c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:10.859286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cab3127-33b9-431a-b300-851f250fa48c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:10.860472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cab3127-33b9-431a-b300-851f250fa48c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:10.861515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cab3127-33b9-431a-b300-851f250fa48c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:10.862235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cab3127-33b9-431a-b300-851f250fa48c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:10.862904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cab3127-33b9-431a-b300-851f250fa48c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:10.931332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:11.201257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2cab3127-33b9-431a-b300-851f250fa48c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:11.224009 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2cab3127-33b9-431a-b300-851f250fa48c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1362 microversion: 2.1 time: 0.380867 Oct 29 03:09:11.226793 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2677/5389] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:10 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:11.248901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25654a24-254e-47e4-8bfc-eb480bbf1912 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:11.252083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25654a24-254e-47e4-8bfc-eb480bbf1912 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:11.271392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25654a24-254e-47e4-8bfc-eb480bbf1912 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:11.278247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25654a24-254e-47e4-8bfc-eb480bbf1912 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:11.279828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25654a24-254e-47e4-8bfc-eb480bbf1912 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:11.281056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25654a24-254e-47e4-8bfc-eb480bbf1912 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:11.284213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25654a24-254e-47e4-8bfc-eb480bbf1912 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:11.292274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25654a24-254e-47e4-8bfc-eb480bbf1912 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:11.637055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25654a24-254e-47e4-8bfc-eb480bbf1912 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:11.648868 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25654a24-254e-47e4-8bfc-eb480bbf1912 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.417678 Oct 29 03:09:11.669899 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2678/5390] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:11 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:12.251189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b36c0eec-7f27-450d-a40d-c1336b4f133e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:12.252457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b36c0eec-7f27-450d-a40d-c1336b4f133e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:12.261241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:12.264479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b36c0eec-7f27-450d-a40d-c1336b4f133e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:12.267175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b36c0eec-7f27-450d-a40d-c1336b4f133e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:12.267637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b36c0eec-7f27-450d-a40d-c1336b4f133e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:12.268377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b36c0eec-7f27-450d-a40d-c1336b4f133e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:12.268833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b36c0eec-7f27-450d-a40d-c1336b4f133e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:12.270295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b36c0eec-7f27-450d-a40d-c1336b4f133e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:12.577409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b36c0eec-7f27-450d-a40d-c1336b4f133e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:12.587627 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b36c0eec-7f27-450d-a40d-c1336b4f133e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1362 microversion: 2.1 time: 0.338778 Oct 29 03:09:12.588825 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2679/5391] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:12 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:12.682666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89b4c430-d794-4d08-847c-f06e22c0325f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:12.683486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89b4c430-d794-4d08-847c-f06e22c0325f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:12.694868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4c430-d794-4d08-847c-f06e22c0325f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:12.695377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4c430-d794-4d08-847c-f06e22c0325f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:12.697071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4c430-d794-4d08-847c-f06e22c0325f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:12.698780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4c430-d794-4d08-847c-f06e22c0325f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:12.700159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4c430-d794-4d08-847c-f06e22c0325f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:12.700614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89b4c430-d794-4d08-847c-f06e22c0325f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:13.032596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-89b4c430-d794-4d08-847c-f06e22c0325f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:13.041686 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89b4c430-d794-4d08-847c-f06e22c0325f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.366742 Oct 29 03:09:13.063172 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2680/5392] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:12 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:13.068347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-510bce3b-6a20-4f23-8d41-191e0c6a228a req-6c7f315e-1f89-49e1-aa64-00071e86d4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572315db-719f-4e84-890d-9968c46ff335", "name": "network-vif-plugged", "status": "completed", "tag": "a6107dbe-78ce-4e28-a7e1-0e8894eaa341"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:13.079708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-510bce3b-6a20-4f23-8d41-191e0c6a228a req-6c7f315e-1f89-49e1-aa64-00071e86d4b3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:13.080460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-510bce3b-6a20-4f23-8d41-191e0c6a228a req-6c7f315e-1f89-49e1-aa64-00071e86d4b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:13.081048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-510bce3b-6a20-4f23-8d41-191e0c6a228a req-6c7f315e-1f89-49e1-aa64-00071e86d4b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:13.104919 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-510bce3b-6a20-4f23-8d41-191e0c6a228a req-6c7f315e-1f89-49e1-aa64-00071e86d4b3 service nova] Creating event network-vif-plugged:a6107dbe-78ce-4e28-a7e1-0e8894eaa341 for instance 572315db-719f-4e84-890d-9968c46ff335 on n-h2-862964-4 Oct 29 03:09:13.117763 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-510bce3b-6a20-4f23-8d41-191e0c6a228a req-6c7f315e-1f89-49e1-aa64-00071e86d4b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052720 Oct 29 03:09:13.121082 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2681/5393] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:13.620384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b6f46e7e-5556-4331-8c16-0247013bcce0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:13.623534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b6f46e7e-5556-4331-8c16-0247013bcce0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:13.661789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f46e7e-5556-4331-8c16-0247013bcce0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:13.663786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f46e7e-5556-4331-8c16-0247013bcce0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:13.668651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f46e7e-5556-4331-8c16-0247013bcce0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:13.670910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f46e7e-5556-4331-8c16-0247013bcce0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:13.671406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f46e7e-5556-4331-8c16-0247013bcce0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:13.671848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6f46e7e-5556-4331-8c16-0247013bcce0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:13.692297 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c9a9eb58-3107-4cdb-99cc-ae684a8f5584 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1460 microversion: 2.1 time: 3.507572 Oct 29 03:09:13.693792 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2713/5394] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:10 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1460 bytes in 3510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:13.714654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e957c6d8-d130-4eff-86c9-cb9136ccaf63 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a32a00d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:13.820037 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e957c6d8-d130-4eff-86c9-cb9136ccaf63 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 200 len: 1460 microversion: 2.1 time: 0.116044 Oct 29 03:09:13.820665 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2714/5395] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:13 2022] GET /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 1460 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:13.853131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-92624da2-0beb-403a-aebf-ff2492cc6357 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:13.856771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-92624da2-0beb-403a-aebf-ff2492cc6357 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:13.884902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92624da2-0beb-403a-aebf-ff2492cc6357 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:13.886041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92624da2-0beb-403a-aebf-ff2492cc6357 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:13.886651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92624da2-0beb-403a-aebf-ff2492cc6357 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:13.889544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92624da2-0beb-403a-aebf-ff2492cc6357 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:13.892779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92624da2-0beb-403a-aebf-ff2492cc6357 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:13.894660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92624da2-0beb-403a-aebf-ff2492cc6357 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:14.340093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-92624da2-0beb-403a-aebf-ff2492cc6357 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:14.352611 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-92624da2-0beb-403a-aebf-ff2492cc6357 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 200 len: 1481 microversion: 2.1 time: 0.518050 Oct 29 03:09:14.355506 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2715/5396] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:13 2022] GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 1481 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:14.373299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b6f46e7e-5556-4331-8c16-0247013bcce0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:14.388147 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b6f46e7e-5556-4331-8c16-0247013bcce0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1362 microversion: 2.1 time: 0.775999 Oct 29 03:09:14.393072 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2682/5397] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:13 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1362 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:14.412970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76906b05-27ee-4f8c-95b6-e86ae353a31d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:14.418313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-76906b05-27ee-4f8c-95b6-e86ae353a31d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:14.436486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76906b05-27ee-4f8c-95b6-e86ae353a31d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:14.439275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76906b05-27ee-4f8c-95b6-e86ae353a31d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:14.441466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76906b05-27ee-4f8c-95b6-e86ae353a31d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:14.442598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76906b05-27ee-4f8c-95b6-e86ae353a31d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:14.443530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76906b05-27ee-4f8c-95b6-e86ae353a31d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:14.445457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-76906b05-27ee-4f8c-95b6-e86ae353a31d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:14.949873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-76906b05-27ee-4f8c-95b6-e86ae353a31d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:14.967484 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-76906b05-27ee-4f8c-95b6-e86ae353a31d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.593388 Oct 29 03:09:14.970179 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2716/5398] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:14 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:15.194440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c29bcec7-cbb1-43ee-a385-05c44ef0f233 req-1333009a-65aa-4b01-ae9e-ce6d1da13e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15eb84a-805e-4a1f-abfb-f0c495c463b6", "name": "network-vif-plugged", "status": "completed", "tag": "741e7b99-4744-4575-82a2-e9205a08d484"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:15.215124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c29bcec7-cbb1-43ee-a385-05c44ef0f233 req-1333009a-65aa-4b01-ae9e-ce6d1da13e45 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:15.217275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c29bcec7-cbb1-43ee-a385-05c44ef0f233 req-1333009a-65aa-4b01-ae9e-ce6d1da13e45 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:15.218344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c29bcec7-cbb1-43ee-a385-05c44ef0f233 req-1333009a-65aa-4b01-ae9e-ce6d1da13e45 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:15.253091 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c29bcec7-cbb1-43ee-a385-05c44ef0f233 req-1333009a-65aa-4b01-ae9e-ce6d1da13e45 service nova] Creating event network-vif-plugged:741e7b99-4744-4575-82a2-e9205a08d484 for instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 on n-h1-862964-4 Oct 29 03:09:15.276177 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c29bcec7-cbb1-43ee-a385-05c44ef0f233 req-1333009a-65aa-4b01-ae9e-ce6d1da13e45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077819 Oct 29 03:09:15.279776 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2683/5399] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:15.380996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5fabccdd-71a8-4a61-97ae-5185b41ec2d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:15.382100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5fabccdd-71a8-4a61-97ae-5185b41ec2d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:15.395729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fabccdd-71a8-4a61-97ae-5185b41ec2d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:15.400897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fabccdd-71a8-4a61-97ae-5185b41ec2d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:15.401524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fabccdd-71a8-4a61-97ae-5185b41ec2d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:15.414522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fabccdd-71a8-4a61-97ae-5185b41ec2d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:15.415134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ea4e58e-9eed-492a-bbd6-732e78b68fcc tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:15.415732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fabccdd-71a8-4a61-97ae-5185b41ec2d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:15.416215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2ea4e58e-9eed-492a-bbd6-732e78b68fcc tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:15.417474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fabccdd-71a8-4a61-97ae-5185b41ec2d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:15.441252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ea4e58e-9eed-492a-bbd6-732e78b68fcc tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:15.444408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ea4e58e-9eed-492a-bbd6-732e78b68fcc tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:15.445073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ea4e58e-9eed-492a-bbd6-732e78b68fcc tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:15.446688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ea4e58e-9eed-492a-bbd6-732e78b68fcc tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:15.448699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ea4e58e-9eed-492a-bbd6-732e78b68fcc tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:15.450600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ea4e58e-9eed-492a-bbd6-732e78b68fcc tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:15.858495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2ea4e58e-9eed-492a-bbd6-732e78b68fcc tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:15.873273 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ea4e58e-9eed-492a-bbd6-732e78b68fcc tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1362 microversion: 2.1 time: 0.462070 Oct 29 03:09:15.874907 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2684/5400] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:15 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:16.011225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be2e618b-8739-4e41-811f-1bcccf86991c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:16.012357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be2e618b-8739-4e41-811f-1bcccf86991c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:16.037723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be2e618b-8739-4e41-811f-1bcccf86991c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:16.042229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be2e618b-8739-4e41-811f-1bcccf86991c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:16.045668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be2e618b-8739-4e41-811f-1bcccf86991c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:16.046650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be2e618b-8739-4e41-811f-1bcccf86991c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:16.048354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be2e618b-8739-4e41-811f-1bcccf86991c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:16.048956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be2e618b-8739-4e41-811f-1bcccf86991c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:16.419957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-be2e618b-8739-4e41-811f-1bcccf86991c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:16.432382 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-be2e618b-8739-4e41-811f-1bcccf86991c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.438123 Oct 29 03:09:16.434206 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2685/5401] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:15 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:16.508569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5fabccdd-71a8-4a61-97ae-5185b41ec2d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:16.522250 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5fabccdd-71a8-4a61-97ae-5185b41ec2d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 200 len: 1468 microversion: 2.1 time: 1.145098 Oct 29 03:09:16.524198 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2717/5402] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:15 2022] GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 1468 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:16.547965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-932ef106-e496-4212-a15c-4ef130a47896 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1443924361"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:16.565229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-932ef106-e496-4212-a15c-4ef130a47896 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:16.597505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932ef106-e496-4212-a15c-4ef130a47896 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:16.601444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932ef106-e496-4212-a15c-4ef130a47896 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:16.605207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932ef106-e496-4212-a15c-4ef130a47896 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:16.607477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932ef106-e496-4212-a15c-4ef130a47896 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:16.609431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932ef106-e496-4212-a15c-4ef130a47896 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:16.614283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-932ef106-e496-4212-a15c-4ef130a47896 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:16.903317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aa3cdad1-2e8a-4dd8-80c6-50964ae24d12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:16.904972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aa3cdad1-2e8a-4dd8-80c6-50964ae24d12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:16.926321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa3cdad1-2e8a-4dd8-80c6-50964ae24d12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:16.929580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa3cdad1-2e8a-4dd8-80c6-50964ae24d12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:16.930209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa3cdad1-2e8a-4dd8-80c6-50964ae24d12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:16.946062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa3cdad1-2e8a-4dd8-80c6-50964ae24d12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:16.946703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa3cdad1-2e8a-4dd8-80c6-50964ae24d12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:16.947150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aa3cdad1-2e8a-4dd8-80c6-50964ae24d12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:17.288648 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-932ef106-e496-4212-a15c-4ef130a47896 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "POST /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e/action" status: 202 len: 0 microversion: 2.1 time: 0.744694 Oct 29 03:09:17.294823 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2686/5403] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:16 2022] POST /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 03:09:17.319115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-686c9bb9-3c21-49b9-b5c5-59f21f5355e8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1acc080d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:17.392406 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-686c9bb9-3c21-49b9-b5c5-59f21f5355e8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1453 microversion: 2.1 time: 0.086090 Oct 29 03:09:17.397150 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2687/5404] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:17 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:17.463114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0eb4c0c7-693f-442f-9b1c-cad53d0f8a2b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:17.465362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0eb4c0c7-693f-442f-9b1c-cad53d0f8a2b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:17.479423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0eb4c0c7-693f-442f-9b1c-cad53d0f8a2b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:17.484791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0eb4c0c7-693f-442f-9b1c-cad53d0f8a2b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:17.486134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0eb4c0c7-693f-442f-9b1c-cad53d0f8a2b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:17.488421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0eb4c0c7-693f-442f-9b1c-cad53d0f8a2b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:17.489906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0eb4c0c7-693f-442f-9b1c-cad53d0f8a2b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:17.491713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0eb4c0c7-693f-442f-9b1c-cad53d0f8a2b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:17.659724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aa3cdad1-2e8a-4dd8-80c6-50964ae24d12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:17.672768 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aa3cdad1-2e8a-4dd8-80c6-50964ae24d12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1362 microversion: 2.1 time: 0.774467 Oct 29 03:09:17.682737 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2718/5405] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:16 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1362 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:17.893710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0eb4c0c7-693f-442f-9b1c-cad53d0f8a2b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:17.905390 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0eb4c0c7-693f-442f-9b1c-cad53d0f8a2b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.449598 Oct 29 03:09:17.906015 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2688/5406] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:17 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:18.378635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-c1efa905-03fc-484c-a068-95a355e47ae6 req-39367fb7-dddf-4d12-a9e7-64c866ebb552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87ccf8a-8236-4a31-ad90-4805b875a1c1", "name": "network-vif-unplugged", "status": "completed", "tag": "e064d394-4cc8-46e7-ab41-6664c7bdbce0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:18.412564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-abe69c34-03c2-4970-afca-0f1817a7ba88 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3fda430>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:18.445760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c1efa905-03fc-484c-a068-95a355e47ae6 req-39367fb7-dddf-4d12-a9e7-64c866ebb552 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:18.454142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c1efa905-03fc-484c-a068-95a355e47ae6 req-39367fb7-dddf-4d12-a9e7-64c866ebb552 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:18.455815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c1efa905-03fc-484c-a068-95a355e47ae6 req-39367fb7-dddf-4d12-a9e7-64c866ebb552 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:18.509710 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c1efa905-03fc-484c-a068-95a355e47ae6 req-39367fb7-dddf-4d12-a9e7-64c866ebb552 service nova] Creating event network-vif-unplugged:e064d394-4cc8-46e7-ab41-6664c7bdbce0 for instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 on n-h2-862964-4 Oct 29 03:09:18.512813 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-abe69c34-03c2-4970-afca-0f1817a7ba88 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1453 microversion: 2.1 time: 0.108141 Oct 29 03:09:18.515678 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2689/5407] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:18 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:18.532153 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-c1efa905-03fc-484c-a068-95a355e47ae6 req-39367fb7-dddf-4d12-a9e7-64c866ebb552 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156955 Oct 29 03:09:18.533206 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2719/5408] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:18.700174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3af1c3e6-f21a-4916-8283-c5acc962517f tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:18.701388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3af1c3e6-f21a-4916-8283-c5acc962517f tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:18.728605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3af1c3e6-f21a-4916-8283-c5acc962517f tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:18.729647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3af1c3e6-f21a-4916-8283-c5acc962517f tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:18.730120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3af1c3e6-f21a-4916-8283-c5acc962517f tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:18.731077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3af1c3e6-f21a-4916-8283-c5acc962517f tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:18.733210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3af1c3e6-f21a-4916-8283-c5acc962517f tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:18.733969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3af1c3e6-f21a-4916-8283-c5acc962517f tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:18.935167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e8427f86-7bf2-4077-a3e8-1c8337494b4d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:18.940465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e8427f86-7bf2-4077-a3e8-1c8337494b4d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:18.970844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8427f86-7bf2-4077-a3e8-1c8337494b4d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:18.978006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8427f86-7bf2-4077-a3e8-1c8337494b4d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:18.982054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8427f86-7bf2-4077-a3e8-1c8337494b4d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:18.985441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8427f86-7bf2-4077-a3e8-1c8337494b4d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:18.986667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8427f86-7bf2-4077-a3e8-1c8337494b4d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:18.991262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8427f86-7bf2-4077-a3e8-1c8337494b4d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:19.133277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3af1c3e6-f21a-4916-8283-c5acc962517f tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:19.141883 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3af1c3e6-f21a-4916-8283-c5acc962517f tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1548 microversion: 2.1 time: 0.446757 Oct 29 03:09:19.147992 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2690/5409] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:18 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1548 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:19.186145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37ba0ea6-c664-4a89-88a9-176d0525befe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:19.186145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37ba0ea6-c664-4a89-88a9-176d0525befe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:19.186145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ba0ea6-c664-4a89-88a9-176d0525befe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:19.186145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ba0ea6-c664-4a89-88a9-176d0525befe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:19.186145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ba0ea6-c664-4a89-88a9-176d0525befe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:19.186145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ba0ea6-c664-4a89-88a9-176d0525befe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:19.186653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ba0ea6-c664-4a89-88a9-176d0525befe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:19.203877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ba0ea6-c664-4a89-88a9-176d0525befe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:19.348705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e8427f86-7bf2-4077-a3e8-1c8337494b4d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:19.366808 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e8427f86-7bf2-4077-a3e8-1c8337494b4d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.440654 Oct 29 03:09:19.368351 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2720/5410] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:18 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:19.434201 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37ba0ea6-c664-4a89-88a9-176d0525befe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.263143 Oct 29 03:09:19.435951 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2691/5411] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:09:19 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/os-interface => generated 284 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:19.528549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8a72f599-ae7d-44da-bbf6-9db4a812228c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a33a0430>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:19.606737 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8a72f599-ae7d-44da-bbf6-9db4a812228c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1453 microversion: 2.1 time: 0.078647 Oct 29 03:09:19.607391 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2721/5412] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:19 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:20.396891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ca666c1-eb98-44a8-a1e6-1b97eaaf4669 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:20.398432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ca666c1-eb98-44a8-a1e6-1b97eaaf4669 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:20.414763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:20.419968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ca666c1-eb98-44a8-a1e6-1b97eaaf4669 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:20.422311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ca666c1-eb98-44a8-a1e6-1b97eaaf4669 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:20.423217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ca666c1-eb98-44a8-a1e6-1b97eaaf4669 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:20.426562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ca666c1-eb98-44a8-a1e6-1b97eaaf4669 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:20.427566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ca666c1-eb98-44a8-a1e6-1b97eaaf4669 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:20.428205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ca666c1-eb98-44a8-a1e6-1b97eaaf4669 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:20.555680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1108222212", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "98e7e5cc-1edb-4357-a851-5dd67b91d1bf"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:20.703613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] validate_networks() for [('98e7e5cc-1edb-4357-a851-5dd67b91d1bf', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:09:20.760637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ca666c1-eb98-44a8-a1e6-1b97eaaf4669 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:20.773256 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ca666c1-eb98-44a8-a1e6-1b97eaaf4669 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.384986 Oct 29 03:09:20.781554 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2722/5413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:20 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:20.809596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e9626316-c477-4cf2-8c1e-919e0290241b tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3205670>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:20.987699 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e9626316-c477-4cf2-8c1e-919e0290241b tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1453 microversion: 2.1 time: 0.205956 Oct 29 03:09:20.989732 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2723/5414] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:20 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1453 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:21.802280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-39c03273-0142-450a-a6e0-136d59906831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:21.803600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-39c03273-0142-450a-a6e0-136d59906831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:21.815811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39c03273-0142-450a-a6e0-136d59906831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:21.824587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39c03273-0142-450a-a6e0-136d59906831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:21.825030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39c03273-0142-450a-a6e0-136d59906831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:21.825770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39c03273-0142-450a-a6e0-136d59906831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:21.826246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39c03273-0142-450a-a6e0-136d59906831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:21.826666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39c03273-0142-450a-a6e0-136d59906831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:22.108879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:09:22.110283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:09:22.110999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:09:22.111642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:09:22.112271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:09:22.130632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:22.131680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:22.132349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:22.133361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:22.134782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:22.138763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:22.183367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Getting quotas for project 6f3b3b4572cb4ca0a03dee7dc0da988b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:09:22.195594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Getting quotas for user 575da00069cc4e7bbeeeb78925b9beba and project 6f3b3b4572cb4ca0a03dee7dc0da988b. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:09:22.217783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:09:22.220676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:09:22.230359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-39c03273-0142-450a-a6e0-136d59906831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:22.254127 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-39c03273-0142-450a-a6e0-136d59906831 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.453804 Oct 29 03:09:22.258835 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2724/5415] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:21 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:22.268903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0dfd0915-5c3d-41f7-8fdc-5dbfca01770c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a33528b0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:22.298490 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8a22a2ce-4fe9-460b-aa2a-1534fa6cbb35 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.288508 Oct 29 03:09:22.301648 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2692/5416] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:09:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:09:22.315269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-357c09a6-fe25-4aa5-87ee-fab2c4d05015 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:22.319960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-357c09a6-fe25-4aa5-87ee-fab2c4d05015 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:22.447515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-357c09a6-fe25-4aa5-87ee-fab2c4d05015 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:22.463113 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-357c09a6-fe25-4aa5-87ee-fab2c4d05015 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1228 microversion: 2.1 time: 0.154551 Oct 29 03:09:22.466617 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2693/5417] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:22 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1228 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:22.483333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-5b4517f9-6072-4497-966f-ce0833a929f3 req-b5493b5b-e75e-4687-bb01-1848fcdeaa45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15eb84a-805e-4a1f-abfb-f0c495c463b6", "tag": "741e7b99-4744-4575-82a2-e9205a08d484"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:22.497520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5b4517f9-6072-4497-966f-ce0833a929f3 req-b5493b5b-e75e-4687-bb01-1848fcdeaa45 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:22.502400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5b4517f9-6072-4497-966f-ce0833a929f3 req-b5493b5b-e75e-4687-bb01-1848fcdeaa45 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:22.503141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5b4517f9-6072-4497-966f-ce0833a929f3 req-b5493b5b-e75e-4687-bb01-1848fcdeaa45 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:22.533045 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-5b4517f9-6072-4497-966f-ce0833a929f3 req-b5493b5b-e75e-4687-bb01-1848fcdeaa45 service nova] Creating event network-changed:741e7b99-4744-4575-82a2-e9205a08d484 for instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 on n-h1-862964-4 Oct 29 03:09:22.566272 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-5b4517f9-6072-4497-966f-ce0833a929f3 req-b5493b5b-e75e-4687-bb01-1848fcdeaa45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086928 Oct 29 03:09:22.567413 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2694/5418] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:23.238753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-19cb17c9-5a8e-4eca-9162-e64beadaaaaf req-0ac502ca-b8a1-4f05-9160-94f7e172eef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e128c38-7acd-43a8-b9a3-cc26676e702e", "name": "network-vif-plugged", "status": "completed", "tag": "b1e0bf4b-9dd4-47dd-923b-eaaab9d2e6fa"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:23.293062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-19cb17c9-5a8e-4eca-9162-e64beadaaaaf req-0ac502ca-b8a1-4f05-9160-94f7e172eef6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.303753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-19cb17c9-5a8e-4eca-9162-e64beadaaaaf req-0ac502ca-b8a1-4f05-9160-94f7e172eef6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.305103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-19cb17c9-5a8e-4eca-9162-e64beadaaaaf req-0ac502ca-b8a1-4f05-9160-94f7e172eef6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:23.339716 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-19cb17c9-5a8e-4eca-9162-e64beadaaaaf req-0ac502ca-b8a1-4f05-9160-94f7e172eef6 service nova] Creating event network-vif-plugged:b1e0bf4b-9dd4-47dd-923b-eaaab9d2e6fa for instance 1e128c38-7acd-43a8-b9a3-cc26676e702e on n-h1-862964-4 Oct 29 03:09:23.359491 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-19cb17c9-5a8e-4eca-9162-e64beadaaaaf req-0ac502ca-b8a1-4f05-9160-94f7e172eef6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129171 Oct 29 03:09:23.362828 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2695/5419] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:23.376992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2c331fe7-1562-4899-bd0a-47b334ab1d00 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:23.379617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2c331fe7-1562-4899-bd0a-47b334ab1d00 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:23.403374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c331fe7-1562-4899-bd0a-47b334ab1d00 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.406816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c331fe7-1562-4899-bd0a-47b334ab1d00 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.408208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c331fe7-1562-4899-bd0a-47b334ab1d00 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:23.409944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c331fe7-1562-4899-bd0a-47b334ab1d00 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.412554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c331fe7-1562-4899-bd0a-47b334ab1d00 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.413355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c331fe7-1562-4899-bd0a-47b334ab1d00 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:23.867028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c331fe7-1562-4899-bd0a-47b334ab1d00 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:23.898146 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2c331fe7-1562-4899-bd0a-47b334ab1d00 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.522397 Oct 29 03:09:23.902344 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2696/5420] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:23 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:23.949451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aca35d08-d9c8-4758-9fd4-57bb09ed8cb0 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:23.950281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aca35d08-d9c8-4758-9fd4-57bb09ed8cb0 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:23.966162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aca35d08-d9c8-4758-9fd4-57bb09ed8cb0 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.968523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aca35d08-d9c8-4758-9fd4-57bb09ed8cb0 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.968977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aca35d08-d9c8-4758-9fd4-57bb09ed8cb0 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:23.970017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aca35d08-d9c8-4758-9fd4-57bb09ed8cb0 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.970517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aca35d08-d9c8-4758-9fd4-57bb09ed8cb0 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.973424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aca35d08-d9c8-4758-9fd4-57bb09ed8cb0 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:24.129408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aca35d08-d9c8-4758-9fd4-57bb09ed8cb0 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:24.145678 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aca35d08-d9c8-4758-9fd4-57bb09ed8cb0 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1224 microversion: 2.1 time: 0.241998 Oct 29 03:09:24.147178 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2697/5421] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:23 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1224 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:24.926986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac7d36d1-9cf0-4050-9c34-36b0ad31cb1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:24.927785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac7d36d1-9cf0-4050-9c34-36b0ad31cb1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:24.956895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac7d36d1-9cf0-4050-9c34-36b0ad31cb1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:24.957403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac7d36d1-9cf0-4050-9c34-36b0ad31cb1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:24.963212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac7d36d1-9cf0-4050-9c34-36b0ad31cb1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:24.964362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac7d36d1-9cf0-4050-9c34-36b0ad31cb1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:24.964881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac7d36d1-9cf0-4050-9c34-36b0ad31cb1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:24.965429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac7d36d1-9cf0-4050-9c34-36b0ad31cb1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:25.408770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac7d36d1-9cf0-4050-9c34-36b0ad31cb1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:25.420693 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac7d36d1-9cf0-4050-9c34-36b0ad31cb1b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.498177 Oct 29 03:09:25.422835 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2698/5422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:24 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:25.440479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e34f2ca-3869-4f5a-9b7e-8fc47a3f1f7b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:25.446384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e34f2ca-3869-4f5a-9b7e-8fc47a3f1f7b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:25.466709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e34f2ca-3869-4f5a-9b7e-8fc47a3f1f7b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:25.469894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e34f2ca-3869-4f5a-9b7e-8fc47a3f1f7b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:25.470578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e34f2ca-3869-4f5a-9b7e-8fc47a3f1f7b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:25.472493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e34f2ca-3869-4f5a-9b7e-8fc47a3f1f7b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:25.474042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e34f2ca-3869-4f5a-9b7e-8fc47a3f1f7b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:25.475161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e34f2ca-3869-4f5a-9b7e-8fc47a3f1f7b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:25.560181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:25.761845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2e34f2ca-3869-4f5a-9b7e-8fc47a3f1f7b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:25.777613 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e34f2ca-3869-4f5a-9b7e-8fc47a3f1f7b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1298 microversion: 2.1 time: 0.353452 Oct 29 03:09:25.793449 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2699/5423] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:25 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1298 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:26.448168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-93fbaef6-921f-4624-831f-c3b7c4c543b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:26.448837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-93fbaef6-921f-4624-831f-c3b7c4c543b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:26.486227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fbaef6-921f-4624-831f-c3b7c4c543b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:26.486721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fbaef6-921f-4624-831f-c3b7c4c543b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:26.487153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fbaef6-921f-4624-831f-c3b7c4c543b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:26.487868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fbaef6-921f-4624-831f-c3b7c4c543b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:26.488313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fbaef6-921f-4624-831f-c3b7c4c543b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:26.488729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fbaef6-921f-4624-831f-c3b7c4c543b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:26.818739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-93fbaef6-921f-4624-831f-c3b7c4c543b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:26.827471 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-93fbaef6-921f-4624-831f-c3b7c4c543b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.383416 Oct 29 03:09:26.850235 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2700/5424] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:26 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:26.867120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5bbf6d59-0130-4bf2-8d03-36a93b793104 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:26.870419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5bbf6d59-0130-4bf2-8d03-36a93b793104 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:26.890966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbf6d59-0130-4bf2-8d03-36a93b793104 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:26.892043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbf6d59-0130-4bf2-8d03-36a93b793104 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:26.894628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbf6d59-0130-4bf2-8d03-36a93b793104 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:26.896405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbf6d59-0130-4bf2-8d03-36a93b793104 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:26.897454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbf6d59-0130-4bf2-8d03-36a93b793104 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:26.899471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbf6d59-0130-4bf2-8d03-36a93b793104 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:27.116144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5bbf6d59-0130-4bf2-8d03-36a93b793104 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:27.160485 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5bbf6d59-0130-4bf2-8d03-36a93b793104 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1286 microversion: 2.1 time: 0.310141 Oct 29 03:09:27.161112 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2701/5425] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:26 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1286 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:27.861039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f7190ae7-1897-4a1b-9587-95522173382d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:27.861610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f7190ae7-1897-4a1b-9587-95522173382d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:27.886862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7190ae7-1897-4a1b-9587-95522173382d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:27.890994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7190ae7-1897-4a1b-9587-95522173382d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:27.891484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7190ae7-1897-4a1b-9587-95522173382d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:27.900057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7190ae7-1897-4a1b-9587-95522173382d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:27.901259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7190ae7-1897-4a1b-9587-95522173382d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:27.904465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7190ae7-1897-4a1b-9587-95522173382d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:28.435931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7190ae7-1897-4a1b-9587-95522173382d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:28.449292 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f7190ae7-1897-4a1b-9587-95522173382d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.592191 Oct 29 03:09:28.450770 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2702/5426] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:27 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:28.464037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-13952990-b2bd-4b35-ac52-1a9ace0d8d37 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:28.464956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-13952990-b2bd-4b35-ac52-1a9ace0d8d37 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:28.476286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13952990-b2bd-4b35-ac52-1a9ace0d8d37 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:28.478255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13952990-b2bd-4b35-ac52-1a9ace0d8d37 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:28.479692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13952990-b2bd-4b35-ac52-1a9ace0d8d37 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:28.483526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13952990-b2bd-4b35-ac52-1a9ace0d8d37 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:28.484189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13952990-b2bd-4b35-ac52-1a9ace0d8d37 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:28.484880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13952990-b2bd-4b35-ac52-1a9ace0d8d37 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:28.785932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-13952990-b2bd-4b35-ac52-1a9ace0d8d37 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:28.803798 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-13952990-b2bd-4b35-ac52-1a9ace0d8d37 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1328 microversion: 2.1 time: 0.351822 Oct 29 03:09:28.805069 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2703/5427] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:28 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1328 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:29.476780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a508df19-8c34-48f4-af5a-c97cf7504ddb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:29.478601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a508df19-8c34-48f4-af5a-c97cf7504ddb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:29.492022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a508df19-8c34-48f4-af5a-c97cf7504ddb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:29.493025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a508df19-8c34-48f4-af5a-c97cf7504ddb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:29.495504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a508df19-8c34-48f4-af5a-c97cf7504ddb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:29.496492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a508df19-8c34-48f4-af5a-c97cf7504ddb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:29.499047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a508df19-8c34-48f4-af5a-c97cf7504ddb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:29.499676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a508df19-8c34-48f4-af5a-c97cf7504ddb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:29.891523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a508df19-8c34-48f4-af5a-c97cf7504ddb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:29.914915 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a508df19-8c34-48f4-af5a-c97cf7504ddb tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.438144 Oct 29 03:09:29.919653 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2704/5428] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:29 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:29.930795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b0acafb0-c5e1-4c5d-a8aa-abc5d4df4b9e req-5cd13832-6381-4f16-bd65-5a4c8ff0712f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef5cba7a-fdd8-4243-b637-ec1f186e1561", "tag": "d88658fa-48a5-41e1-879c-5bb69c3b7fe9"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:29.955181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0acafb0-c5e1-4c5d-a8aa-abc5d4df4b9e req-5cd13832-6381-4f16-bd65-5a4c8ff0712f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:29.955665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0acafb0-c5e1-4c5d-a8aa-abc5d4df4b9e req-5cd13832-6381-4f16-bd65-5a4c8ff0712f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:29.956132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0acafb0-c5e1-4c5d-a8aa-abc5d4df4b9e req-5cd13832-6381-4f16-bd65-5a4c8ff0712f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:29.983500 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b0acafb0-c5e1-4c5d-a8aa-abc5d4df4b9e req-5cd13832-6381-4f16-bd65-5a4c8ff0712f service nova] Creating event network-changed:d88658fa-48a5-41e1-879c-5bb69c3b7fe9 for instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 on n-h2-862964-4 Oct 29 03:09:29.998092 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b0acafb0-c5e1-4c5d-a8aa-abc5d4df4b9e req-5cd13832-6381-4f16-bd65-5a4c8ff0712f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076727 Oct 29 03:09:29.999053 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2705/5429] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:30.006764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3b6ca141-64de-4047-923e-1192086d8bbb tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:30.012081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b6ca141-64de-4047-923e-1192086d8bbb tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:30.024591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b6ca141-64de-4047-923e-1192086d8bbb tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:30.029830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b6ca141-64de-4047-923e-1192086d8bbb tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:30.030517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b6ca141-64de-4047-923e-1192086d8bbb tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:30.033239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b6ca141-64de-4047-923e-1192086d8bbb tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:30.033933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b6ca141-64de-4047-923e-1192086d8bbb tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:30.034533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b6ca141-64de-4047-923e-1192086d8bbb tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:30.316754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b6ca141-64de-4047-923e-1192086d8bbb tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:30.330918 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3b6ca141-64de-4047-923e-1192086d8bbb tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1328 microversion: 2.1 time: 0.330632 Oct 29 03:09:30.341848 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2706/5430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:29 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1328 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:30.942677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b9ed98ca-be55-4821-ad29-e6dd25a688c5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:30.943396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b9ed98ca-be55-4821-ad29-e6dd25a688c5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:30.960492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9ed98ca-be55-4821-ad29-e6dd25a688c5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:30.961038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9ed98ca-be55-4821-ad29-e6dd25a688c5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:30.963929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9ed98ca-be55-4821-ad29-e6dd25a688c5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:30.965626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9ed98ca-be55-4821-ad29-e6dd25a688c5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:30.966695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9ed98ca-be55-4821-ad29-e6dd25a688c5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:30.970535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b9ed98ca-be55-4821-ad29-e6dd25a688c5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:31.298797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b9ed98ca-be55-4821-ad29-e6dd25a688c5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:31.308566 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b9ed98ca-be55-4821-ad29-e6dd25a688c5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.371175 Oct 29 03:09:31.329941 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2707/5431] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:30 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:31.354349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-298c4496-44b2-4dfe-b6a5-f9a46613d757 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:31.355062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-298c4496-44b2-4dfe-b6a5-f9a46613d757 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:31.364673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-298c4496-44b2-4dfe-b6a5-f9a46613d757 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:31.365593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-298c4496-44b2-4dfe-b6a5-f9a46613d757 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:31.368061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-298c4496-44b2-4dfe-b6a5-f9a46613d757 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:31.371518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-298c4496-44b2-4dfe-b6a5-f9a46613d757 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:31.372151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-298c4496-44b2-4dfe-b6a5-f9a46613d757 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:31.372665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-298c4496-44b2-4dfe-b6a5-f9a46613d757 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:31.631355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-298c4496-44b2-4dfe-b6a5-f9a46613d757 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:31.643499 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-298c4496-44b2-4dfe-b6a5-f9a46613d757 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1328 microversion: 2.1 time: 0.292016 Oct 29 03:09:31.659861 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2708/5432] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:31 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1328 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:31.807664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:32.238697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:32.339115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7cf710a4-3c6e-4c25-87fd-3536c1cc35ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:32.344167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7cf710a4-3c6e-4c25-87fd-3536c1cc35ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:32.358028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:32.371299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cf710a4-3c6e-4c25-87fd-3536c1cc35ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:32.372072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cf710a4-3c6e-4c25-87fd-3536c1cc35ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:32.375357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cf710a4-3c6e-4c25-87fd-3536c1cc35ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:32.376319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cf710a4-3c6e-4c25-87fd-3536c1cc35ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:32.379880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cf710a4-3c6e-4c25-87fd-3536c1cc35ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:32.383448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cf710a4-3c6e-4c25-87fd-3536c1cc35ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:32.498035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:32.820734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7cf710a4-3c6e-4c25-87fd-3536c1cc35ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:32.835227 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7cf710a4-3c6e-4c25-87fd-3536c1cc35ab tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.499234 Oct 29 03:09:32.837688 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2709/5433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:32 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:32.861791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-97313bcd-f941-4295-841b-fe0bbac0e3db tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:32.870321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-97313bcd-f941-4295-841b-fe0bbac0e3db tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:32.890346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97313bcd-f941-4295-841b-fe0bbac0e3db tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:32.892691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97313bcd-f941-4295-841b-fe0bbac0e3db tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:32.897303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97313bcd-f941-4295-841b-fe0bbac0e3db tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:32.898781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97313bcd-f941-4295-841b-fe0bbac0e3db tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:32.903833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97313bcd-f941-4295-841b-fe0bbac0e3db tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:32.904898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97313bcd-f941-4295-841b-fe0bbac0e3db tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:33.123018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-97313bcd-f941-4295-841b-fe0bbac0e3db tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:33.132545 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-97313bcd-f941-4295-841b-fe0bbac0e3db tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1328 microversion: 2.1 time: 0.288664 Oct 29 03:09:33.133382 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2710/5434] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:32 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1328 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:33.862332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eaae9812-9c6c-467e-b1d0-0ac8f2ff57f5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:33.863987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eaae9812-9c6c-467e-b1d0-0ac8f2ff57f5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:33.886262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaae9812-9c6c-467e-b1d0-0ac8f2ff57f5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:33.886951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaae9812-9c6c-467e-b1d0-0ac8f2ff57f5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:33.887540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaae9812-9c6c-467e-b1d0-0ac8f2ff57f5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:33.888510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaae9812-9c6c-467e-b1d0-0ac8f2ff57f5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:33.891561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaae9812-9c6c-467e-b1d0-0ac8f2ff57f5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:33.892180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eaae9812-9c6c-467e-b1d0-0ac8f2ff57f5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:34.123832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eaae9812-9c6c-467e-b1d0-0ac8f2ff57f5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:34.135244 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eaae9812-9c6c-467e-b1d0-0ac8f2ff57f5 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.277792 Oct 29 03:09:34.151091 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2711/5435] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:33 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:34.168235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0a378a6a-3a99-46ea-bcdf-b3112b929971 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:34.168850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0a378a6a-3a99-46ea-bcdf-b3112b929971 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:34.181543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a378a6a-3a99-46ea-bcdf-b3112b929971 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:34.182071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a378a6a-3a99-46ea-bcdf-b3112b929971 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:34.182507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a378a6a-3a99-46ea-bcdf-b3112b929971 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:34.183208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a378a6a-3a99-46ea-bcdf-b3112b929971 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:34.183658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a378a6a-3a99-46ea-bcdf-b3112b929971 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:34.190957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a378a6a-3a99-46ea-bcdf-b3112b929971 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:34.460599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0a378a6a-3a99-46ea-bcdf-b3112b929971 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:34.469864 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0a378a6a-3a99-46ea-bcdf-b3112b929971 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1328 microversion: 2.1 time: 0.306764 Oct 29 03:09:34.470962 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2712/5436] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:34 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1328 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:34.615554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6a9a0eaf-ddca-49fb-82a2-81fb4b123185 req-45287d11-4fc6-421d-b033-3a3483ef6f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5cba7a-fdd8-4243-b637-ec1f186e1561", "name": "network-vif-plugged", "status": "completed", "tag": "d88658fa-48a5-41e1-879c-5bb69c3b7fe9"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:34.648718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6a9a0eaf-ddca-49fb-82a2-81fb4b123185 req-45287d11-4fc6-421d-b033-3a3483ef6f97 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:34.652595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6a9a0eaf-ddca-49fb-82a2-81fb4b123185 req-45287d11-4fc6-421d-b033-3a3483ef6f97 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:34.653227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6a9a0eaf-ddca-49fb-82a2-81fb4b123185 req-45287d11-4fc6-421d-b033-3a3483ef6f97 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:34.687413 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6a9a0eaf-ddca-49fb-82a2-81fb4b123185 req-45287d11-4fc6-421d-b033-3a3483ef6f97 service nova] Creating event network-vif-plugged:d88658fa-48a5-41e1-879c-5bb69c3b7fe9 for instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 on n-h2-862964-4 Oct 29 03:09:34.693708 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6a9a0eaf-ddca-49fb-82a2-81fb4b123185 req-45287d11-4fc6-421d-b033-3a3483ef6f97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082238 Oct 29 03:09:34.694890 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2713/5437] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:09:35.178210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b74472fb-5108-41fa-922d-0dd46ed51514 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:35.180516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b74472fb-5108-41fa-922d-0dd46ed51514 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:35.181596 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0dfd0915-5c3d-41f7-8fdc-5dbfca01770c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1453 microversion: 2.1 time: 12.921535 Oct 29 03:09:35.202703 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2725/5438] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:22 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1453 bytes in 12943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:35.207261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b74472fb-5108-41fa-922d-0dd46ed51514 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:35.207751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b74472fb-5108-41fa-922d-0dd46ed51514 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:35.208185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b74472fb-5108-41fa-922d-0dd46ed51514 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:35.213457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b74472fb-5108-41fa-922d-0dd46ed51514 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:35.215971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b74472fb-5108-41fa-922d-0dd46ed51514 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:35.217366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b74472fb-5108-41fa-922d-0dd46ed51514 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:35.470249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b74472fb-5108-41fa-922d-0dd46ed51514 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:35.480268 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b74472fb-5108-41fa-922d-0dd46ed51514 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.321454 Oct 29 03:09:35.492032 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2714/5439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:35 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:35.504120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-08a44cc3-8bfa-4fa3-b70f-e8e4b0da5d4b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:35.505082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-08a44cc3-8bfa-4fa3-b70f-e8e4b0da5d4b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:35.515606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08a44cc3-8bfa-4fa3-b70f-e8e4b0da5d4b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:35.516193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08a44cc3-8bfa-4fa3-b70f-e8e4b0da5d4b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:35.516687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08a44cc3-8bfa-4fa3-b70f-e8e4b0da5d4b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:35.517471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08a44cc3-8bfa-4fa3-b70f-e8e4b0da5d4b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:35.518170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08a44cc3-8bfa-4fa3-b70f-e8e4b0da5d4b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:35.518662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08a44cc3-8bfa-4fa3-b70f-e8e4b0da5d4b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:35.747983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-08a44cc3-8bfa-4fa3-b70f-e8e4b0da5d4b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:35.756872 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-08a44cc3-8bfa-4fa3-b70f-e8e4b0da5d4b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1328 microversion: 2.1 time: 0.261621 Oct 29 03:09:35.757969 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2726/5440] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:35 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1328 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:36.201293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4a84823c-9e33-49e0-93e5-c0e4b4465cc9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1acc229d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:36.271241 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4a84823c-9e33-49e0-93e5-c0e4b4465cc9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1453 microversion: 2.1 time: 0.073173 Oct 29 03:09:36.272255 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2715/5441] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:36 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:36.507116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e7b6ff5b-a4d0-4a6a-b5a3-05542784b627 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:36.507793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e7b6ff5b-a4d0-4a6a-b5a3-05542784b627 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:36.518815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7b6ff5b-a4d0-4a6a-b5a3-05542784b627 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:36.519570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7b6ff5b-a4d0-4a6a-b5a3-05542784b627 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:36.520198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7b6ff5b-a4d0-4a6a-b5a3-05542784b627 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:36.521068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7b6ff5b-a4d0-4a6a-b5a3-05542784b627 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:36.521680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7b6ff5b-a4d0-4a6a-b5a3-05542784b627 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:36.522296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7b6ff5b-a4d0-4a6a-b5a3-05542784b627 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:36.783337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1a665ed3-b675-40cd-abc1-39450e453c4c tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:36.784237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1a665ed3-b675-40cd-abc1-39450e453c4c tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:36.794491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a665ed3-b675-40cd-abc1-39450e453c4c tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:36.798750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a665ed3-b675-40cd-abc1-39450e453c4c tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:36.799957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a665ed3-b675-40cd-abc1-39450e453c4c tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:36.800906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a665ed3-b675-40cd-abc1-39450e453c4c tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:36.802077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a665ed3-b675-40cd-abc1-39450e453c4c tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:36.802667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a665ed3-b675-40cd-abc1-39450e453c4c tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:37.003839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e7b6ff5b-a4d0-4a6a-b5a3-05542784b627 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:37.013775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e7b6ff5b-a4d0-4a6a-b5a3-05542784b627 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1506 microversion: 2.1 time: 0.510835 Oct 29 03:09:37.016607 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2727/5442] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:36 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:37.059279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1a665ed3-b675-40cd-abc1-39450e453c4c tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:37.067812 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1a665ed3-b675-40cd-abc1-39450e453c4c tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1528 microversion: 2.1 time: 0.290194 Oct 29 03:09:37.071063 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2716/5443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:36 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1528 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:37.096054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2fc5c261-a371-488a-8c0f-887461f360c2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:37.097244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2fc5c261-a371-488a-8c0f-887461f360c2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:37.104852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2fc5c261-a371-488a-8c0f-887461f360c2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:37.105439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2fc5c261-a371-488a-8c0f-887461f360c2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:37.106157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2fc5c261-a371-488a-8c0f-887461f360c2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:37.107180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2fc5c261-a371-488a-8c0f-887461f360c2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:37.107972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2fc5c261-a371-488a-8c0f-887461f360c2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:37.108613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2fc5c261-a371-488a-8c0f-887461f360c2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:37.287758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-49cc6ead-17ff-4cf9-a905-1950ce1a7865 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a8cd3280>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:37.351559 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-49cc6ead-17ff-4cf9-a905-1950ce1a7865 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1453 microversion: 2.1 time: 0.067627 Oct 29 03:09:37.352217 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2717/5444] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:37 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:37.523908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2fc5c261-a371-488a-8c0f-887461f360c2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:37.533068 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2fc5c261-a371-488a-8c0f-887461f360c2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1528 microversion: 2.1 time: 0.441261 Oct 29 03:09:37.539140 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2728/5445] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:37 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1528 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:38.047041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c6bd27f-b530-4807-aca2-b227332c742a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:38.048295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c6bd27f-b530-4807-aca2-b227332c742a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:38.058367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6bd27f-b530-4807-aca2-b227332c742a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.059404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6bd27f-b530-4807-aca2-b227332c742a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.060874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6bd27f-b530-4807-aca2-b227332c742a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.062123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6bd27f-b530-4807-aca2-b227332c742a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.062796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6bd27f-b530-4807-aca2-b227332c742a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.063429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6bd27f-b530-4807-aca2-b227332c742a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.167264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:38.168776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:38.179583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.180411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.182553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.183575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.184263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.185533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.211210 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] HTTP exception thrown: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Request method failure captured: Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 HTTP/1.1 Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJlfiUoTftOUoMm9eUVfGCg-YPcvDBxrBOfnF63q03qmdzw0BcqnYpUgckNJXv7xioTEMSk2E7Mc63hitKXhGXw4ouaH8I0iRwOrfoBZcsPgBl1gjAKTjo96nZXAcw8CRKhvUhKmCkHrVfDWjmHuZ0_W6iAmsrmzxKvE2bgpotoYku8 Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 5a73f6a2f07c484eafb35e4d55bf493e Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-104883333 Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a73f6a2f07c484eafb35e4d55bf493e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a73f6a2f07c484eafb35e4d55bf493e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a73f6a2f07c484eafb35e4d55bf493e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a73f6a2f07c484eafb35e4d55bf493e"}]}] Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-104883333 Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 5a73f6a2f07c484eafb35e4d55bf493e Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-104883333 Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestMultiTenantJSON-104883333-project Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: c0b9cd5c1cd349f3b1e6af834f5cc35a Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-104883333-project Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'ef5cba7a-fdd8-4243-b637-ec1f186e1561'} Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:09:38.213203 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:09:38.217690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:38.217690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:38.217690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:38.217690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:38.217690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:38.217690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:38.217690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:38.217690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:09:38.217690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:09:38.217690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:38.217690 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:38.219943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Returning 404 to user: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:09:38.221779 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-33daf490-f811-4b2a-b112-bf0984495ed9 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 404 len: 111 microversion: 2.1 time: 0.657701 Oct 29 03:09:38.222851 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2718/5446] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:09:37 2022] DELETE /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 111 bytes in 659 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:38.233416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f96ffea0-4169-4a73-8162-be05e957e93f tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:38.234444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f96ffea0-4169-4a73-8162-be05e957e93f tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:38.240703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f96ffea0-4169-4a73-8162-be05e957e93f tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.241681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f96ffea0-4169-4a73-8162-be05e957e93f tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.242788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f96ffea0-4169-4a73-8162-be05e957e93f tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.243943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f96ffea0-4169-4a73-8162-be05e957e93f tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.244621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f96ffea0-4169-4a73-8162-be05e957e93f tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.245271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f96ffea0-4169-4a73-8162-be05e957e93f tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.296785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c6bd27f-b530-4807-aca2-b227332c742a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:38.310551 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c6bd27f-b530-4807-aca2-b227332c742a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1506 microversion: 2.1 time: 0.266320 Oct 29 03:09:38.315361 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2729/5447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:38 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:38.369814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45ebb874-d2d2-43f5-b053-f3724fc4e469 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a333d430>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:38.461107 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-45ebb874-d2d2-43f5-b053-f3724fc4e469 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1453 microversion: 2.1 time: 0.096343 Oct 29 03:09:38.461902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f96ffea0-4169-4a73-8162-be05e957e93f tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:38.463305 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2730/5448] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:38 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:38.464780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:38.473842 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f96ffea0-4169-4a73-8162-be05e957e93f tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1528 microversion: 2.1 time: 0.244308 Oct 29 03:09:38.496481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9cb687f8-4049-4911-ac79-72a09277fbef req-4d04e19e-3ce2-4644-8482-53376d7d5790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572315db-719f-4e84-890d-9968c46ff335", "name": "network-vif-unplugged", "status": "completed", "tag": "a6107dbe-78ce-4e28-a7e1-0e8894eaa341"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:38.502446 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2719/5449] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:38 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1528 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:38.508477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Action: 'update', calling method: >, body: {"server": {"name": "ef5cba7a-fdd8-4243-b637-ec1f186e1561_new"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:38.511069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:38.520930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9cb687f8-4049-4911-ac79-72a09277fbef req-4d04e19e-3ce2-4644-8482-53376d7d5790 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.523808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9cb687f8-4049-4911-ac79-72a09277fbef req-4d04e19e-3ce2-4644-8482-53376d7d5790 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.524383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.525065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9cb687f8-4049-4911-ac79-72a09277fbef req-4d04e19e-3ce2-4644-8482-53376d7d5790 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.525838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.526472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.528020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.529589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.530394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.552626 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] HTTP exception thrown: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Request method failure captured: Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: request: PUT /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 HTTP/1.1 Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 64 Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJlfiUoTftOUoMm9eUVfGCg-YPcvDBxrBOfnF63q03qmdzw0BcqnYpUgckNJXv7xioTEMSk2E7Mc63hitKXhGXw4ouaH8I0iRwOrfoBZcsPgBl1gjAKTjo96nZXAcw8CRKhvUhKmCkHrVfDWjmHuZ0_W6iAmsrmzxKvE2bgpotoYku8 Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 5a73f6a2f07c484eafb35e4d55bf493e Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-104883333 Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a73f6a2f07c484eafb35e4d55bf493e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a73f6a2f07c484eafb35e4d55bf493e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a73f6a2f07c484eafb35e4d55bf493e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a73f6a2f07c484eafb35e4d55bf493e"}]}] Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-104883333 Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 5a73f6a2f07c484eafb35e4d55bf493e Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-104883333 Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestMultiTenantJSON-104883333-project Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: c0b9cd5c1cd349f3b1e6af834f5cc35a Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-104883333-project Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: {"server": {"name": "ef5cba7a-fdd8-4243-b637-ec1f186e1561_new"}} Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'ef5cba7a-fdd8-4243-b637-ec1f186e1561', 'body': {'server': {'name': 'ef5cba7a-fdd8-4243-b637-ec1f186e1561_new'}}} Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:09:38.556971 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:38.563231 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:38.571314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] Returning 404 to user: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:09:38.574242 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-78879b14-b481-431a-b301-51a606db41c0 tempest-ServersNegativeTestMultiTenantJSON-104883333 tempest-ServersNegativeTestMultiTenantJSON-104883333-project] 10.222.0.16 "PUT /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 404 len: 111 microversion: 2.1 time: 0.066785 Oct 29 03:09:38.575711 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2720/5450] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 03:09:38 2022] PUT /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:38.579354 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9cb687f8-4049-4911-ac79-72a09277fbef req-4d04e19e-3ce2-4644-8482-53376d7d5790 service nova] Creating event network-vif-unplugged:a6107dbe-78ce-4e28-a7e1-0e8894eaa341 for instance 572315db-719f-4e84-890d-9968c46ff335 on n-h2-862964-4 Oct 29 03:09:38.591290 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9cb687f8-4049-4911-ac79-72a09277fbef req-4d04e19e-3ce2-4644-8482-53376d7d5790 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107896 Oct 29 03:09:38.597238 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2731/5451] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:38.602560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-deefc416-1a5a-428b-aaa4-b372d4c71545 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:38.604481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-deefc416-1a5a-428b-aaa4-b372d4c71545 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:38.625407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-deefc416-1a5a-428b-aaa4-b372d4c71545 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.625965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-deefc416-1a5a-428b-aaa4-b372d4c71545 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.627351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-deefc416-1a5a-428b-aaa4-b372d4c71545 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.629497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-deefc416-1a5a-428b-aaa4-b372d4c71545 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.630390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-deefc416-1a5a-428b-aaa4-b372d4c71545 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.630856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-deefc416-1a5a-428b-aaa4-b372d4c71545 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.697669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-deefc416-1a5a-428b-aaa4-b372d4c71545 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:09:38.866133 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-deefc416-1a5a-428b-aaa4-b372d4c71545 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 204 len: 0 microversion: 2.1 time: 0.281439 Oct 29 03:09:38.866838 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2721/5452] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:09:38 2022] DELETE /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:09:38.876870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-814a2f1d-c330-4323-876a-355716725ae6 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:38.877576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-814a2f1d-c330-4323-876a-355716725ae6 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:38.894476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814a2f1d-c330-4323-876a-355716725ae6 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.894964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814a2f1d-c330-4323-876a-355716725ae6 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.895705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814a2f1d-c330-4323-876a-355716725ae6 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.896386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814a2f1d-c330-4323-876a-355716725ae6 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.897075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814a2f1d-c330-4323-876a-355716725ae6 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.897537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-814a2f1d-c330-4323-876a-355716725ae6 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:39.147909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-814a2f1d-c330-4323-876a-355716725ae6 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:39.160097 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-814a2f1d-c330-4323-876a-355716725ae6 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1534 microversion: 2.1 time: 0.285252 Oct 29 03:09:39.163155 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2732/5453] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:38 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1534 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:39.338541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2b1fa370-7721-4d91-836c-f95ea79b4b59 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:39.339633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2b1fa370-7721-4d91-836c-f95ea79b4b59 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:39.342689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:39.356775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b1fa370-7721-4d91-836c-f95ea79b4b59 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:39.359140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b1fa370-7721-4d91-836c-f95ea79b4b59 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:39.362887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b1fa370-7721-4d91-836c-f95ea79b4b59 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:39.364022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b1fa370-7721-4d91-836c-f95ea79b4b59 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:39.365015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b1fa370-7721-4d91-836c-f95ea79b4b59 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:39.366769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b1fa370-7721-4d91-836c-f95ea79b4b59 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:39.481444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e07b87db-2830-4979-a916-8393f8aff5c4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3219940>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:39.628943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e07b87db-2830-4979-a916-8393f8aff5c4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1453 microversion: 2.1 time: 0.152931 Oct 29 03:09:39.630860 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2733/5454] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:39 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:39.636017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2b1fa370-7721-4d91-836c-f95ea79b4b59 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:39.646869 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2b1fa370-7721-4d91-836c-f95ea79b4b59 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1506 microversion: 2.1 time: 0.313927 Oct 29 03:09:39.650697 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2722/5455] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:39 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:40.185724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4be37d63-2952-4f44-a4b8-534b22ac9b5e tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:40.186393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4be37d63-2952-4f44-a4b8-534b22ac9b5e tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:40.195280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4be37d63-2952-4f44-a4b8-534b22ac9b5e tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:40.196373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4be37d63-2952-4f44-a4b8-534b22ac9b5e tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:40.197181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4be37d63-2952-4f44-a4b8-534b22ac9b5e tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:40.198539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4be37d63-2952-4f44-a4b8-534b22ac9b5e tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:40.199162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4be37d63-2952-4f44-a4b8-534b22ac9b5e tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:40.199756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4be37d63-2952-4f44-a4b8-534b22ac9b5e tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:40.408566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4be37d63-2952-4f44-a4b8-534b22ac9b5e tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:40.425196 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4be37d63-2952-4f44-a4b8-534b22ac9b5e tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1534 microversion: 2.1 time: 0.243728 Oct 29 03:09:40.427463 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2734/5456] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:40 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1534 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:40.646401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-91f840a3-bb90-4199-82c5-815d48d27187 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a8976790>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:40.680797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f27c74f-c0ea-4fb2-a33a-4f85d89d992f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:40.682735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f27c74f-c0ea-4fb2-a33a-4f85d89d992f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:40.699382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f27c74f-c0ea-4fb2-a33a-4f85d89d992f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:40.703440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f27c74f-c0ea-4fb2-a33a-4f85d89d992f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:40.706131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f27c74f-c0ea-4fb2-a33a-4f85d89d992f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:40.708369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f27c74f-c0ea-4fb2-a33a-4f85d89d992f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:40.712846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f27c74f-c0ea-4fb2-a33a-4f85d89d992f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:40.714517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f27c74f-c0ea-4fb2-a33a-4f85d89d992f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:40.738279 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-91f840a3-bb90-4199-82c5-815d48d27187 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1453 microversion: 2.1 time: 0.096519 Oct 29 03:09:40.747993 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2723/5457] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:40 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:40.944850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8f27c74f-c0ea-4fb2-a33a-4f85d89d992f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:40.951775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f27c74f-c0ea-4fb2-a33a-4f85d89d992f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1506 microversion: 2.1 time: 0.275202 Oct 29 03:09:40.952827 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2735/5458] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:40 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:41.455108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9a1d4c8f-f9a2-45c2-90f7-df9d1ea81ea5 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:41.456052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9a1d4c8f-f9a2-45c2-90f7-df9d1ea81ea5 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:41.467518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a1d4c8f-f9a2-45c2-90f7-df9d1ea81ea5 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:41.469066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a1d4c8f-f9a2-45c2-90f7-df9d1ea81ea5 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:41.471731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a1d4c8f-f9a2-45c2-90f7-df9d1ea81ea5 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:41.473408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a1d4c8f-f9a2-45c2-90f7-df9d1ea81ea5 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:41.474752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a1d4c8f-f9a2-45c2-90f7-df9d1ea81ea5 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:41.475573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a1d4c8f-f9a2-45c2-90f7-df9d1ea81ea5 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:41.720555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9a1d4c8f-f9a2-45c2-90f7-df9d1ea81ea5 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:41.733863 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9a1d4c8f-f9a2-45c2-90f7-df9d1ea81ea5 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1534 microversion: 2.1 time: 0.283859 Oct 29 03:09:41.734973 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2724/5459] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:41 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1534 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:41.755677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fc5224a6-5a06-4301-83a9-01126ab0319e tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3276040>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:41.980563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac1c5503-1964-4718-b486-f043d20bf523 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:41.981177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac1c5503-1964-4718-b486-f043d20bf523 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:41.994917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac1c5503-1964-4718-b486-f043d20bf523 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:41.998922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac1c5503-1964-4718-b486-f043d20bf523 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.000966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac1c5503-1964-4718-b486-f043d20bf523 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:42.001774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac1c5503-1964-4718-b486-f043d20bf523 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:42.002273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac1c5503-1964-4718-b486-f043d20bf523 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.002697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac1c5503-1964-4718-b486-f043d20bf523 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:42.349443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac1c5503-1964-4718-b486-f043d20bf523 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:42.363227 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac1c5503-1964-4718-b486-f043d20bf523 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 200 len: 1509 microversion: 2.1 time: 0.386304 Oct 29 03:09:42.373873 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2725/5460] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:41 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 1509 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:42.392795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-579d4663-156c-44cc-8d0b-39c38891984b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:42.393283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-579d4663-156c-44cc-8d0b-39c38891984b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:42.407429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-579d4663-156c-44cc-8d0b-39c38891984b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:42.408232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-579d4663-156c-44cc-8d0b-39c38891984b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.408668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-579d4663-156c-44cc-8d0b-39c38891984b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:42.411084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-579d4663-156c-44cc-8d0b-39c38891984b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:42.414463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-579d4663-156c-44cc-8d0b-39c38891984b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.419761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-579d4663-156c-44cc-8d0b-39c38891984b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:42.613981 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fc5224a6-5a06-4301-83a9-01126ab0319e tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1453 microversion: 2.1 time: 0.862898 Oct 29 03:09:42.614828 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2736/5461] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:41 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1453 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:42.631655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-c60e9e76-6639-49b3-921d-c9ed53765ee4 req-58afe13f-8e95-4d41-9099-f548ba5fd470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5cba7a-fdd8-4243-b637-ec1f186e1561", "name": "network-vif-unplugged", "status": "completed", "tag": "d88658fa-48a5-41e1-879c-5bb69c3b7fe9"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:42.655219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c60e9e76-6639-49b3-921d-c9ed53765ee4 req-58afe13f-8e95-4d41-9099-f548ba5fd470 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:42.658125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c60e9e76-6639-49b3-921d-c9ed53765ee4 req-58afe13f-8e95-4d41-9099-f548ba5fd470 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.658842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c60e9e76-6639-49b3-921d-c9ed53765ee4 req-58afe13f-8e95-4d41-9099-f548ba5fd470 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:42.682107 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c60e9e76-6639-49b3-921d-c9ed53765ee4 req-58afe13f-8e95-4d41-9099-f548ba5fd470 service nova] Creating event network-vif-unplugged:d88658fa-48a5-41e1-879c-5bb69c3b7fe9 for instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 on n-h2-862964-4 Oct 29 03:09:42.689864 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-c60e9e76-6639-49b3-921d-c9ed53765ee4 req-58afe13f-8e95-4d41-9099-f548ba5fd470 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062863 Oct 29 03:09:42.692447 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2737/5462] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:09:42.747142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-579d4663-156c-44cc-8d0b-39c38891984b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:42.762117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-92fb0ee3-f6a3-4273-83f5-9fdfb98cb713 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:42.763628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-92fb0ee3-f6a3-4273-83f5-9fdfb98cb713 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:42.767345 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-579d4663-156c-44cc-8d0b-39c38891984b tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.378396 Oct 29 03:09:42.767969 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2726/5463] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:42 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:42.774668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92fb0ee3-f6a3-4273-83f5-9fdfb98cb713 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:42.778755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92fb0ee3-f6a3-4273-83f5-9fdfb98cb713 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.781368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92fb0ee3-f6a3-4273-83f5-9fdfb98cb713 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:42.782473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92fb0ee3-f6a3-4273-83f5-9fdfb98cb713 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:42.784132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92fb0ee3-f6a3-4273-83f5-9fdfb98cb713 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.795663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-04aa00e1-8e6e-44b3-a4ea-728e14e4c3b7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:42.796087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-04aa00e1-8e6e-44b3-a4ea-728e14e4c3b7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:42.796898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92fb0ee3-f6a3-4273-83f5-9fdfb98cb713 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:42.814705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04aa00e1-8e6e-44b3-a4ea-728e14e4c3b7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:42.815215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04aa00e1-8e6e-44b3-a4ea-728e14e4c3b7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.815663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04aa00e1-8e6e-44b3-a4ea-728e14e4c3b7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:42.816382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04aa00e1-8e6e-44b3-a4ea-728e14e4c3b7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:42.816836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04aa00e1-8e6e-44b3-a4ea-728e14e4c3b7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.817255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04aa00e1-8e6e-44b3-a4ea-728e14e4c3b7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:43.076520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-04aa00e1-8e6e-44b3-a4ea-728e14e4c3b7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:43.084522 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-04aa00e1-8e6e-44b3-a4ea-728e14e4c3b7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.292853 Oct 29 03:09:43.086588 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2727/5464] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:42 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:43.109557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a4fb6d2b-5aff-4362-b6ce-c1c5c3a5258d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:43.110466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a4fb6d2b-5aff-4362-b6ce-c1c5c3a5258d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:43.118362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4fb6d2b-5aff-4362-b6ce-c1c5c3a5258d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:43.119147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4fb6d2b-5aff-4362-b6ce-c1c5c3a5258d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:43.119757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4fb6d2b-5aff-4362-b6ce-c1c5c3a5258d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:43.121072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4fb6d2b-5aff-4362-b6ce-c1c5c3a5258d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:43.121739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4fb6d2b-5aff-4362-b6ce-c1c5c3a5258d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:43.122515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4fb6d2b-5aff-4362-b6ce-c1c5c3a5258d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:43.619504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a4fb6d2b-5aff-4362-b6ce-c1c5c3a5258d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:43.632212 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a4fb6d2b-5aff-4362-b6ce-c1c5c3a5258d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.527217 Oct 29 03:09:43.633353 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2728/5465] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:43 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:43.647656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5f41bd58-0bac-48e5-b2da-83914cdfe18a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3f73f70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:43.663051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-92fb0ee3-f6a3-4273-83f5-9fdfb98cb713 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:43.673088 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-92fb0ee3-f6a3-4273-83f5-9fdfb98cb713 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1534 microversion: 2.1 time: 0.916400 Oct 29 03:09:43.674961 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2738/5466] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:42 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1534 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:43.682447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9378feda-fc6c-4d95-9854-8d11b0a811a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:43.683295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9378feda-fc6c-4d95-9854-8d11b0a811a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:43.696113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9378feda-fc6c-4d95-9854-8d11b0a811a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:43.696594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9378feda-fc6c-4d95-9854-8d11b0a811a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:43.697425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9378feda-fc6c-4d95-9854-8d11b0a811a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:43.706167 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5f41bd58-0bac-48e5-b2da-83914cdfe18a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1462 microversion: 2.1 time: 0.071475 Oct 29 03:09:43.706761 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2729/5467] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:43 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1462 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:43.707938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9378feda-fc6c-4d95-9854-8d11b0a811a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:43.708896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9378feda-fc6c-4d95-9854-8d11b0a811a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:43.709350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9378feda-fc6c-4d95-9854-8d11b0a811a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:43.721964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-579355ea-b90c-4064-ac57-cffc67485f39 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3ec6c10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:43.781712 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-579355ea-b90c-4064-ac57-cffc67485f39 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 200 len: 1462 microversion: 2.1 time: 0.063937 Oct 29 03:09:43.790349 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2730/5468] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:43 2022] GET /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 1462 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:43.797422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a5e7b53d-91d6-4838-837e-eed7a68f4d71 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:43.798425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a5e7b53d-91d6-4838-837e-eed7a68f4d71 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:43.806668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5e7b53d-91d6-4838-837e-eed7a68f4d71 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:43.807851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5e7b53d-91d6-4838-837e-eed7a68f4d71 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:43.808539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5e7b53d-91d6-4838-837e-eed7a68f4d71 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:43.809469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5e7b53d-91d6-4838-837e-eed7a68f4d71 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:43.810451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5e7b53d-91d6-4838-837e-eed7a68f4d71 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:43.811308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5e7b53d-91d6-4838-837e-eed7a68f4d71 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.002457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9378feda-fc6c-4d95-9854-8d11b0a811a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:44.005403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a5e7b53d-91d6-4838-837e-eed7a68f4d71 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:44.013761 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9378feda-fc6c-4d95-9854-8d11b0a811a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.336518 Oct 29 03:09:44.017001 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a5e7b53d-91d6-4838-837e-eed7a68f4d71 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1466 microversion: 2.1 time: 0.224408 Oct 29 03:09:44.017465 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2739/5469] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:43 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:44.030879 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2731/5470] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:43 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1466 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:44.039084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4bcd341e-71c3-4f30-a59d-56b358d48792 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-383146801"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:44.039691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cff0db7a-9296-4961-b0dc-16e50ee9573c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:44.041548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4bcd341e-71c3-4f30-a59d-56b358d48792 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:44.047767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bcd341e-71c3-4f30-a59d-56b358d48792 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.048256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bcd341e-71c3-4f30-a59d-56b358d48792 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.048691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bcd341e-71c3-4f30-a59d-56b358d48792 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.049455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bcd341e-71c3-4f30-a59d-56b358d48792 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.049946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bcd341e-71c3-4f30-a59d-56b358d48792 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.050346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4bcd341e-71c3-4f30-a59d-56b358d48792 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.050743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cff0db7a-9296-4961-b0dc-16e50ee9573c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.051653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cff0db7a-9296-4961-b0dc-16e50ee9573c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.052811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cff0db7a-9296-4961-b0dc-16e50ee9573c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.083292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cff0db7a-9296-4961-b0dc-16e50ee9573c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Going to try to stop instance {{(pid=127041) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:09:44.183367 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cff0db7a-9296-4961-b0dc-16e50ee9573c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.133165 Oct 29 03:09:44.186598 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2732/5471] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:44 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:09:44.205188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-49a24b55-8921-4e85-977d-75a6e426e53f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:44.209182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-49a24b55-8921-4e85-977d-75a6e426e53f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:44.225772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49a24b55-8921-4e85-977d-75a6e426e53f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.229712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49a24b55-8921-4e85-977d-75a6e426e53f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.231247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49a24b55-8921-4e85-977d-75a6e426e53f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.232520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49a24b55-8921-4e85-977d-75a6e426e53f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.233278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49a24b55-8921-4e85-977d-75a6e426e53f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.234063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-49a24b55-8921-4e85-977d-75a6e426e53f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.360932 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4bcd341e-71c3-4f30-a59d-56b358d48792 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "POST /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1/action" status: 202 len: 0 microversion: 2.1 time: 0.325862 Oct 29 03:09:44.362526 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2740/5472] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:44 2022] POST /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 03:09:44.369864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-62975264-f0b1-4730-98b6-3cdcf6ba92bc req-cb321b9c-4509-433c-a987-e03214ab491b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5cba7a-fdd8-4243-b637-ec1f186e1561", "name": "network-vif-deleted", "tag": "d88658fa-48a5-41e1-879c-5bb69c3b7fe9"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:44.380595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-62975264-f0b1-4730-98b6-3cdcf6ba92bc req-cb321b9c-4509-433c-a987-e03214ab491b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.381410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-62975264-f0b1-4730-98b6-3cdcf6ba92bc req-cb321b9c-4509-433c-a987-e03214ab491b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.383110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-62975264-f0b1-4730-98b6-3cdcf6ba92bc req-cb321b9c-4509-433c-a987-e03214ab491b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.397155 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-62975264-f0b1-4730-98b6-3cdcf6ba92bc req-cb321b9c-4509-433c-a987-e03214ab491b service nova] Creating event network-vif-deleted:d88658fa-48a5-41e1-879c-5bb69c3b7fe9 for instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 on n-h2-862964-4 Oct 29 03:09:44.402954 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-62975264-f0b1-4730-98b6-3cdcf6ba92bc req-cb321b9c-4509-433c-a987-e03214ab491b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038966 Oct 29 03:09:44.403842 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2741/5473] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:44.412278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1cf454c2-a5e9-4a16-8514-03a63bdf4b9d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3276ca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:44.477526 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1cf454c2-a5e9-4a16-8514-03a63bdf4b9d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.070844 Oct 29 03:09:44.478838 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2742/5474] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:44 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:44.626182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-49a24b55-8921-4e85-977d-75a6e426e53f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:44.635633 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-49a24b55-8921-4e85-977d-75a6e426e53f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.443183 Oct 29 03:09:44.637673 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2733/5475] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:44 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:44.700661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dfe0bc1b-ce6e-419d-b416-1be80f0ff3f2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:44.701311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dfe0bc1b-ce6e-419d-b416-1be80f0ff3f2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:44.714950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfe0bc1b-ce6e-419d-b416-1be80f0ff3f2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.715475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfe0bc1b-ce6e-419d-b416-1be80f0ff3f2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.715909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfe0bc1b-ce6e-419d-b416-1be80f0ff3f2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.716619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfe0bc1b-ce6e-419d-b416-1be80f0ff3f2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.717069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfe0bc1b-ce6e-419d-b416-1be80f0ff3f2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.717489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfe0bc1b-ce6e-419d-b416-1be80f0ff3f2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.824810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dfe0bc1b-ce6e-419d-b416-1be80f0ff3f2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:44.834867 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dfe0bc1b-ce6e-419d-b416-1be80f0ff3f2 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1313 microversion: 2.1 time: 0.139675 Oct 29 03:09:44.838550 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2743/5476] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:44 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:45.493884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-21216e3b-fe3e-41f0-a82b-0d4d176b2708 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3f73f70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:45.550876 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-21216e3b-fe3e-41f0-a82b-0d4d176b2708 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.061098 Oct 29 03:09:45.551969 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2734/5477] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:45 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:45.665088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-88942486-5fcc-4f2c-867f-095d5b7b630a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:45.665701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-88942486-5fcc-4f2c-867f-095d5b7b630a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:45.673188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88942486-5fcc-4f2c-867f-095d5b7b630a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:45.674010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88942486-5fcc-4f2c-867f-095d5b7b630a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:45.674599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88942486-5fcc-4f2c-867f-095d5b7b630a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:45.675475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88942486-5fcc-4f2c-867f-095d5b7b630a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:45.676092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88942486-5fcc-4f2c-867f-095d5b7b630a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:45.677043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88942486-5fcc-4f2c-867f-095d5b7b630a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:45.828864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-88942486-5fcc-4f2c-867f-095d5b7b630a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:45.842029 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-88942486-5fcc-4f2c-867f-095d5b7b630a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.181074 Oct 29 03:09:45.844533 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2744/5478] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:45 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:45.864358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:45.864963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:45.894380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:45.894834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:45.895261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:45.895962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:45.896646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:45.896932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:45.936687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:45.937375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:45.938027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:45.938629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lazy-loading 'fault' on Instance uuid ef5cba7a-fdd8-4243-b637-ec1f186e1561 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:09:45.986912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '575da00069cc4e7bbeeeb78925b9beba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:45.996876 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-146d5a68-f967-4b5a-a4b0-d41383aa880b tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 200 len: 1318 microversion: 2.1 time: 0.137026 Oct 29 03:09:45.997674 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2735/5479] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:45 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:46.567063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f765930-4092-447a-ab32-18a91322b7c7 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a329fd30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:46.623495 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f765930-4092-447a-ab32-18a91322b7c7 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.060034 Oct 29 03:09:46.624067 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2745/5480] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:46 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:46.809757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-04f0433e-0068-4e77-b78d-a8cd767447b1 req-9c3ff07f-9239-4dd7-8d82-a858c8d01642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e128c38-7acd-43a8-b9a3-cc26676e702e", "name": "network-vif-unplugged", "status": "completed", "tag": "b1e0bf4b-9dd4-47dd-923b-eaaab9d2e6fa"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:46.823463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-04f0433e-0068-4e77-b78d-a8cd767447b1 req-9c3ff07f-9239-4dd7-8d82-a858c8d01642 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:46.823898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-04f0433e-0068-4e77-b78d-a8cd767447b1 req-9c3ff07f-9239-4dd7-8d82-a858c8d01642 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:46.824571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-04f0433e-0068-4e77-b78d-a8cd767447b1 req-9c3ff07f-9239-4dd7-8d82-a858c8d01642 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:46.843605 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-04f0433e-0068-4e77-b78d-a8cd767447b1 req-9c3ff07f-9239-4dd7-8d82-a858c8d01642 service nova] Creating event network-vif-unplugged:b1e0bf4b-9dd4-47dd-923b-eaaab9d2e6fa for instance 1e128c38-7acd-43a8-b9a3-cc26676e702e on n-h1-862964-4 Oct 29 03:09:46.849216 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-04f0433e-0068-4e77-b78d-a8cd767447b1 req-9c3ff07f-9239-4dd7-8d82-a858c8d01642 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043124 Oct 29 03:09:46.850103 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2736/5481] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:46.869339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5ba87b86-9cae-44be-9472-d697170dd0aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:46.870557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5ba87b86-9cae-44be-9472-d697170dd0aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:46.884303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ba87b86-9cae-44be-9472-d697170dd0aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:46.884808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ba87b86-9cae-44be-9472-d697170dd0aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:46.885233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ba87b86-9cae-44be-9472-d697170dd0aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:46.885962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ba87b86-9cae-44be-9472-d697170dd0aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:46.886584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ba87b86-9cae-44be-9472-d697170dd0aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:46.887001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ba87b86-9cae-44be-9472-d697170dd0aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:47.022591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:47.024716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] [instance: ef5cba7a-fdd8-4243-b637-ec1f186e1561] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:47.035792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:47.036541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:47.037019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:47.037696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:47.038191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:47.038644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:47.053124 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] HTTP exception thrown: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Request method failure captured: Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 HTTP/1.1 Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJlPol-L1ZPExKEhLZPu2gIanBTQlzNH3w6PS4WxfEQyVvYErPWYDqaPyXnOlMj0NXbrn8gXvAVBktWEOrHKOXv5qqfEnumCfdMNbx5syqGkoWIkbgFCPShO5vSsVSEO6pPD3hA7K7NA7tM11AkjpoNbUNElzqM_38jLFdkOOLDymZQ Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6f3b3b4572cb4ca0a03dee7dc0da988b Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-300361560 Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f3b3b4572cb4ca0a03dee7dc0da988b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f3b3b4572cb4ca0a03dee7dc0da988b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f3b3b4572cb4ca0a03dee7dc0da988b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f3b3b4572cb4ca0a03dee7dc0da988b"}]}] Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-300361560 Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6f3b3b4572cb4ca0a03dee7dc0da988b Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-300361560 Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestMultiTenantJSON-300361560-project Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 575da00069cc4e7bbeeeb78925b9beba Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-300361560-project Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'ef5cba7a-fdd8-4243-b637-ec1f186e1561'} Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:47.055031 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] Returning 404 to user: Instance ef5cba7a-fdd8-4243-b637-ec1f186e1561 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d080e0e2-06f7-4ac3-be8a-ba0bae1cbc85 tempest-ServersNegativeTestMultiTenantJSON-300361560 tempest-ServersNegativeTestMultiTenantJSON-300361560-project] 10.222.0.16 "GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561" status: 404 len: 111 microversion: 2.1 time: 0.039420 Oct 29 03:09:47.060220 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2737/5482] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:47 2022] GET /compute/v2.1/servers/ef5cba7a-fdd8-4243-b637-ec1f186e1561 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:09:47.071733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5ba87b86-9cae-44be-9472-d697170dd0aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:47.081558 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5ba87b86-9cae-44be-9472-d697170dd0aa tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.216712 Oct 29 03:09:47.082861 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2746/5483] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:46 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:47.645606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-204f4f3b-02b5-4113-ab27-99ba6f881038 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3915040>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:47.700367 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-204f4f3b-02b5-4113-ab27-99ba6f881038 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.058414 Oct 29 03:09:47.700969 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2738/5484] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:47 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:48.106839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79ab1ea8-b36d-4dc9-b0f4-cc258cbf4fe0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:48.108167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79ab1ea8-b36d-4dc9-b0f4-cc258cbf4fe0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:48.117961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ab1ea8-b36d-4dc9-b0f4-cc258cbf4fe0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:48.118449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ab1ea8-b36d-4dc9-b0f4-cc258cbf4fe0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:48.118877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ab1ea8-b36d-4dc9-b0f4-cc258cbf4fe0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:48.119680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ab1ea8-b36d-4dc9-b0f4-cc258cbf4fe0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:48.120153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ab1ea8-b36d-4dc9-b0f4-cc258cbf4fe0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:48.120565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79ab1ea8-b36d-4dc9-b0f4-cc258cbf4fe0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:48.371446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-79ab1ea8-b36d-4dc9-b0f4-cc258cbf4fe0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:48.382993 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79ab1ea8-b36d-4dc9-b0f4-cc258cbf4fe0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.279950 Oct 29 03:09:48.383617 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2747/5485] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:48 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:48.722806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-727c90fd-f819-4b5a-ac0f-bd171a304bb2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a399e5e0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:48.808566 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-727c90fd-f819-4b5a-ac0f-bd171a304bb2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.095044 Oct 29 03:09:48.811793 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2739/5486] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:48 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:49.412482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e0c94735-a8ce-4b27-8b7e-358975b9b7f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:49.413037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e0c94735-a8ce-4b27-8b7e-358975b9b7f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:49.425342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0c94735-a8ce-4b27-8b7e-358975b9b7f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:49.425889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0c94735-a8ce-4b27-8b7e-358975b9b7f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:49.426328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0c94735-a8ce-4b27-8b7e-358975b9b7f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:49.427057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0c94735-a8ce-4b27-8b7e-358975b9b7f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:49.427507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0c94735-a8ce-4b27-8b7e-358975b9b7f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:49.433499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0c94735-a8ce-4b27-8b7e-358975b9b7f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:49.442612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:49.826833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c2799943-ef4c-42f5-b9a6-49e23bc12385 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a8789e50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:49.902522 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c2799943-ef4c-42f5-b9a6-49e23bc12385 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.080430 Oct 29 03:09:49.903331 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2740/5487] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:49 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:50.161423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e0c94735-a8ce-4b27-8b7e-358975b9b7f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:50.170433 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e0c94735-a8ce-4b27-8b7e-358975b9b7f4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.761958 Oct 29 03:09:50.171023 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2748/5488] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:49 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:50.820788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b0ae65e4-8376-45a4-81a0-bd2228aa0757 req-ca07ae71-9ae5-4888-be52-72b3045eab2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87ccf8a-8236-4a31-ad90-4805b875a1c1", "name": "network-vif-plugged", "status": "completed", "tag": "e064d394-4cc8-46e7-ab41-6664c7bdbce0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:50.845758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0ae65e4-8376-45a4-81a0-bd2228aa0757 req-ca07ae71-9ae5-4888-be52-72b3045eab2a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:50.846506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0ae65e4-8376-45a4-81a0-bd2228aa0757 req-ca07ae71-9ae5-4888-be52-72b3045eab2a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:50.846699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0ae65e4-8376-45a4-81a0-bd2228aa0757 req-ca07ae71-9ae5-4888-be52-72b3045eab2a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:50.878253 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b0ae65e4-8376-45a4-81a0-bd2228aa0757 req-ca07ae71-9ae5-4888-be52-72b3045eab2a service nova] Creating event network-vif-plugged:e064d394-4cc8-46e7-ab41-6664c7bdbce0 for instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 on n-h2-862964-4 Oct 29 03:09:50.883662 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b0ae65e4-8376-45a4-81a0-bd2228aa0757 req-ca07ae71-9ae5-4888-be52-72b3045eab2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067683 Oct 29 03:09:50.884407 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2741/5489] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:50.918826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-68eb5601-d079-4d9f-9815-059f25d84b14 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3296310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:50.998637 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-68eb5601-d079-4d9f-9815-059f25d84b14 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.083347 Oct 29 03:09:51.000906 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2749/5490] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:50 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:51.199124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d6f0f04f-586d-4bcc-a610-0deb6b25ea23 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:51.200659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d6f0f04f-586d-4bcc-a610-0deb6b25ea23 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:51.223919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6f0f04f-586d-4bcc-a610-0deb6b25ea23 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:51.225864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6f0f04f-586d-4bcc-a610-0deb6b25ea23 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:51.226432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6f0f04f-586d-4bcc-a610-0deb6b25ea23 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:51.233397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6f0f04f-586d-4bcc-a610-0deb6b25ea23 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:51.234036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6f0f04f-586d-4bcc-a610-0deb6b25ea23 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:51.237452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6f0f04f-586d-4bcc-a610-0deb6b25ea23 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:51.772812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d6f0f04f-586d-4bcc-a610-0deb6b25ea23 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:51.790778 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d6f0f04f-586d-4bcc-a610-0deb6b25ea23 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 0.597509 Oct 29 03:09:51.791691 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2742/5491] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:51 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:52.014652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f4783ee-3a87-46e0-bdf6-83bc360c76fd tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a32d00d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:52.118958 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f4783ee-3a87-46e0-bdf6-83bc360c76fd tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.109033 Oct 29 03:09:52.119848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2750/5492] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:52 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:52.815972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b538cb7-2e6d-4ba0-ae15-078fa181de25 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:52.817912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6b538cb7-2e6d-4ba0-ae15-078fa181de25 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:52.826382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b538cb7-2e6d-4ba0-ae15-078fa181de25 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:52.827298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b538cb7-2e6d-4ba0-ae15-078fa181de25 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:52.828256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b538cb7-2e6d-4ba0-ae15-078fa181de25 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:52.829265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b538cb7-2e6d-4ba0-ae15-078fa181de25 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:52.829931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b538cb7-2e6d-4ba0-ae15-078fa181de25 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:52.830513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b538cb7-2e6d-4ba0-ae15-078fa181de25 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:52.836457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:53.136982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6978c05-14e3-4b55-8ca2-8efc29623faa tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a32191f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:53.198593 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c6978c05-14e3-4b55-8ca2-8efc29623faa tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.067589 Oct 29 03:09:53.199183 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2751/5493] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:53 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:53.820600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b538cb7-2e6d-4ba0-ae15-078fa181de25 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:53.829686 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b538cb7-2e6d-4ba0-ae15-078fa181de25 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1680 microversion: 2.1 time: 1.018375 Oct 29 03:09:53.835605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2743/5494] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:52 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1680 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:54.216765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-747120bc-24a2-40d3-a44d-2213ce3b1b37 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a32d01f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:54.332183 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-747120bc-24a2-40d3-a44d-2213ce3b1b37 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.120917 Oct 29 03:09:54.333373 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2752/5495] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:54 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:54.859438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-30d184c2-c424-40e6-a3c4-a17d5aa38d71 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:54.860102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-30d184c2-c424-40e6-a3c4-a17d5aa38d71 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:54.873204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30d184c2-c424-40e6-a3c4-a17d5aa38d71 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:54.874170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30d184c2-c424-40e6-a3c4-a17d5aa38d71 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:54.874783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30d184c2-c424-40e6-a3c4-a17d5aa38d71 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:54.875679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30d184c2-c424-40e6-a3c4-a17d5aa38d71 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:54.878360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30d184c2-c424-40e6-a3c4-a17d5aa38d71 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:54.879793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30d184c2-c424-40e6-a3c4-a17d5aa38d71 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:55.125277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eaaf662f-7d3f-4be0-b7c1-eabb5bcac4ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:55.126340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eaaf662f-7d3f-4be0-b7c1-eabb5bcac4ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:55.159933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaaf662f-7d3f-4be0-b7c1-eabb5bcac4ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:55.160868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaaf662f-7d3f-4be0-b7c1-eabb5bcac4ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:55.161612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaaf662f-7d3f-4be0-b7c1-eabb5bcac4ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:55.169696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaaf662f-7d3f-4be0-b7c1-eabb5bcac4ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:55.170223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaaf662f-7d3f-4be0-b7c1-eabb5bcac4ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:55.170657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eaaf662f-7d3f-4be0-b7c1-eabb5bcac4ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:55.251666 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eaaf662f-7d3f-4be0-b7c1-eabb5bcac4ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/ips" status: 200 len: 146 microversion: 2.1 time: 0.131260 Oct 29 03:09:55.260025 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2753/5496] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:09:55 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/ips => generated 146 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:55.351485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-27c1637c-6b9e-411a-a27b-d97aca165a88 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3333670>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:55.497936 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-27c1637c-6b9e-411a-a27b-d97aca165a88 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.151983 Oct 29 03:09:55.507554 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2754/5497] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:55 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:55.556966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-30d184c2-c424-40e6-a3c4-a17d5aa38d71 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:55.576473 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-30d184c2-c424-40e6-a3c4-a17d5aa38d71 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1657 microversion: 2.1 time: 0.720888 Oct 29 03:09:55.582576 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2744/5498] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:54 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1657 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:55.622352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-026c4826-78e3-4277-a10b-72fa5285a0b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:55.643919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-026c4826-78e3-4277-a10b-72fa5285a0b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:55.649683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-026c4826-78e3-4277-a10b-72fa5285a0b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:55.650511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-026c4826-78e3-4277-a10b-72fa5285a0b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:55.740335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-026c4826-78e3-4277-a10b-72fa5285a0b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Going to try to start instance {{(pid=127042) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:09:55.847157 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-026c4826-78e3-4277-a10b-72fa5285a0b4 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.238282 Oct 29 03:09:55.848690 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2755/5499] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:55 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:09:55.856540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9f642172-d833-44ea-82d6-cd23f2cd8995 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:55.857139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9f642172-d833-44ea-82d6-cd23f2cd8995 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:55.873300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f642172-d833-44ea-82d6-cd23f2cd8995 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:55.874733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f642172-d833-44ea-82d6-cd23f2cd8995 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:55.875431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f642172-d833-44ea-82d6-cd23f2cd8995 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:55.877207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f642172-d833-44ea-82d6-cd23f2cd8995 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:55.886019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f642172-d833-44ea-82d6-cd23f2cd8995 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:55.886774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f642172-d833-44ea-82d6-cd23f2cd8995 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:56.257524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9f642172-d833-44ea-82d6-cd23f2cd8995 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:56.276154 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9f642172-d833-44ea-82d6-cd23f2cd8995 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1666 microversion: 2.1 time: 0.422124 Oct 29 03:09:56.280025 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2745/5500] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:55 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1666 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:56.515919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d538171-a810-49fe-8132-1306190a0e12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3219310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:56.617730 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d538171-a810-49fe-8132-1306190a0e12 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.105993 Oct 29 03:09:56.620966 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2756/5501] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:56 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:57.307988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d46d3624-12f0-4086-b48a-d52a2acd5118 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:57.308612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d46d3624-12f0-4086-b48a-d52a2acd5118 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:57.328892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d46d3624-12f0-4086-b48a-d52a2acd5118 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:57.329447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d46d3624-12f0-4086-b48a-d52a2acd5118 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:57.331403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d46d3624-12f0-4086-b48a-d52a2acd5118 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:57.332714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d46d3624-12f0-4086-b48a-d52a2acd5118 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:57.334411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d46d3624-12f0-4086-b48a-d52a2acd5118 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:57.336615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d46d3624-12f0-4086-b48a-d52a2acd5118 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:57.644365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7dc8c87-5b8d-442f-a3f8-8a358766f453 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3312310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:57.722703 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b7dc8c87-5b8d-442f-a3f8-8a358766f453 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.092440 Oct 29 03:09:57.723372 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2757/5502] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:57 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:57.915800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d46d3624-12f0-4086-b48a-d52a2acd5118 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:57.924724 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d46d3624-12f0-4086-b48a-d52a2acd5118 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1666 microversion: 2.1 time: 0.622312 Oct 29 03:09:57.935605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2746/5503] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:57 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1666 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:58.740241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-77e4c858-4ccc-4031-a97b-5c5c980264d4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a33649d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:58.846847 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-77e4c858-4ccc-4031-a97b-5c5c980264d4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.111455 Oct 29 03:09:58.856870 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2758/5504] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:58 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:58.966769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a958ed3-b4ac-4c52-b933-c98eed886c48 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:58.968182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6a958ed3-b4ac-4c52-b933-c98eed886c48 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:58.980753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a958ed3-b4ac-4c52-b933-c98eed886c48 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:58.982885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a958ed3-b4ac-4c52-b933-c98eed886c48 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:58.983880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a958ed3-b4ac-4c52-b933-c98eed886c48 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:58.985275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a958ed3-b4ac-4c52-b933-c98eed886c48 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:58.987070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a958ed3-b4ac-4c52-b933-c98eed886c48 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:58.988397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a958ed3-b4ac-4c52-b933-c98eed886c48 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:59.267980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b7d9b96-cca4-40e4-be49-812be39a5f11 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3040e8da-0895-432e-8597-d93faf113fa5"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:59.270968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0b7d9b96-cca4-40e4-be49-812be39a5f11 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:59.285782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d9b96-cca4-40e4-be49-812be39a5f11 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:59.286687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d9b96-cca4-40e4-be49-812be39a5f11 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:59.287363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d9b96-cca4-40e4-be49-812be39a5f11 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:59.288256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d9b96-cca4-40e4-be49-812be39a5f11 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:59.290988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d9b96-cca4-40e4-be49-812be39a5f11 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:59.291419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d9b96-cca4-40e4-be49-812be39a5f11 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:59.469981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a958ed3-b4ac-4c52-b933-c98eed886c48 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:59.497522 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a958ed3-b4ac-4c52-b933-c98eed886c48 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.539011 Oct 29 03:09:59.498174 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2747/5505] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:58 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:59.525254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3dca22fa-c66c-4247-9d13-77325fbee19f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:59.525887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3dca22fa-c66c-4247-9d13-77325fbee19f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:59.551807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3dca22fa-c66c-4247-9d13-77325fbee19f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:59.552594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3dca22fa-c66c-4247-9d13-77325fbee19f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:59.553263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3dca22fa-c66c-4247-9d13-77325fbee19f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:59.554315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3dca22fa-c66c-4247-9d13-77325fbee19f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:59.564169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3dca22fa-c66c-4247-9d13-77325fbee19f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:59.564913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3dca22fa-c66c-4247-9d13-77325fbee19f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:59.837565 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b7d9b96-cca4-40e4-be49-812be39a5f11 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "POST /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.574348 Oct 29 03:09:59.841969 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2759/5506] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:09:59 2022] POST /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/os-volume_attachments => generated 194 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:59.880411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b65ea14a-62d6-4b89-ba63-e21e541f2275 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3312d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:00.008517 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b65ea14a-62d6-4b89-ba63-e21e541f2275 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.148471 Oct 29 03:10:00.016815 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2760/5507] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:59 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:00.042243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3dca22fa-c66c-4247-9d13-77325fbee19f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:00.050917 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3dca22fa-c66c-4247-9d13-77325fbee19f tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.529413 Oct 29 03:10:00.053035 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2748/5508] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:59 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:00.088451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8502f90e-c535-4400-9b63-456333e70cac tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:00.089260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8502f90e-c535-4400-9b63-456333e70cac tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:00.096589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8502f90e-c535-4400-9b63-456333e70cac tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:00.101732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8502f90e-c535-4400-9b63-456333e70cac tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:00.108595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8502f90e-c535-4400-9b63-456333e70cac tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:00.109696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8502f90e-c535-4400-9b63-456333e70cac tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:00.115824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8502f90e-c535-4400-9b63-456333e70cac tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:00.116571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8502f90e-c535-4400-9b63-456333e70cac tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:00.771123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8502f90e-c535-4400-9b63-456333e70cac tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:00.781963 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8502f90e-c535-4400-9b63-456333e70cac tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.697679 Oct 29 03:10:00.782566 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2761/5509] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:00 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:00.810092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8df0cd84-0e1d-4e8b-821b-60d155a49727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:00.810987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8df0cd84-0e1d-4e8b-821b-60d155a49727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:00.820082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8df0cd84-0e1d-4e8b-821b-60d155a49727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:00.820811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8df0cd84-0e1d-4e8b-821b-60d155a49727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:00.821433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8df0cd84-0e1d-4e8b-821b-60d155a49727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:00.822355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8df0cd84-0e1d-4e8b-821b-60d155a49727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:00.823578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8df0cd84-0e1d-4e8b-821b-60d155a49727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:00.826896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8df0cd84-0e1d-4e8b-821b-60d155a49727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:01.024358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f95b336-7f12-4680-9f5e-1eb185b9589a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a333c550>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:01.136614 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f95b336-7f12-4680-9f5e-1eb185b9589a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.116300 Oct 29 03:10:01.144832 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2762/5510] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:01 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:01.999470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8df0cd84-0e1d-4e8b-821b-60d155a49727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:02.014616 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8df0cd84-0e1d-4e8b-821b-60d155a49727 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 1.203069 Oct 29 03:10:02.017588 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2749/5511] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:00 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:02.037245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87bf2f19-1174-4076-be21-e3b267f9e94a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:02.038066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-87bf2f19-1174-4076-be21-e3b267f9e94a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:02.056345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=45 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:02.062177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87bf2f19-1174-4076-be21-e3b267f9e94a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:02.065280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87bf2f19-1174-4076-be21-e3b267f9e94a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:02.072208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87bf2f19-1174-4076-be21-e3b267f9e94a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:02.074156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87bf2f19-1174-4076-be21-e3b267f9e94a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:02.074814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87bf2f19-1174-4076-be21-e3b267f9e94a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:02.075574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87bf2f19-1174-4076-be21-e3b267f9e94a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:02.152884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7e4974e-35b1-4757-90cf-ae781729bf30 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a8976670>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:02.242502 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7e4974e-35b1-4757-90cf-ae781729bf30 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.093088 Oct 29 03:10:02.257894 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2750/5512] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:02 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:02.955796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-87bf2f19-1174-4076-be21-e3b267f9e94a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:02.998497 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-87bf2f19-1174-4076-be21-e3b267f9e94a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.964885 Oct 29 03:10:03.019617 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2763/5513] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:02 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:03.025305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-17af545d-ee3b-42fe-8c76-c4bdac1b44a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:03.027745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-17af545d-ee3b-42fe-8c76-c4bdac1b44a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:03.049071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17af545d-ee3b-42fe-8c76-c4bdac1b44a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:03.049886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17af545d-ee3b-42fe-8c76-c4bdac1b44a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:03.050517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17af545d-ee3b-42fe-8c76-c4bdac1b44a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:03.051403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17af545d-ee3b-42fe-8c76-c4bdac1b44a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:03.052017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17af545d-ee3b-42fe-8c76-c4bdac1b44a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:03.052598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17af545d-ee3b-42fe-8c76-c4bdac1b44a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:03.101157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-17af545d-ee3b-42fe-8c76-c4bdac1b44a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lazy-loading 'flavor' on Instance uuid 72e7e466-df5f-45f5-9e45-dc3c16e888b7 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:10:03.221250 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-17af545d-ee3b-42fe-8c76-c4bdac1b44a1 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.201697 Oct 29 03:10:03.224671 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2751/5514] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:10:03 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:10:03.241183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6aec1408-f997-4958-9986-0b68a758302c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:03.243148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6aec1408-f997-4958-9986-0b68a758302c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:03.260682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ef088d66-11e1-4604-95a7-8bf42356ee5b tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3911550>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:03.263034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6aec1408-f997-4958-9986-0b68a758302c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:03.265774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6aec1408-f997-4958-9986-0b68a758302c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:03.266602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6aec1408-f997-4958-9986-0b68a758302c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:03.267922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6aec1408-f997-4958-9986-0b68a758302c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:03.268683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6aec1408-f997-4958-9986-0b68a758302c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:03.269337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6aec1408-f997-4958-9986-0b68a758302c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:03.376274 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ef088d66-11e1-4604-95a7-8bf42356ee5b tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.119881 Oct 29 03:10:03.377091 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2752/5515] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:03 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:03.852366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6aec1408-f997-4958-9986-0b68a758302c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:03.862781 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6aec1408-f997-4958-9986-0b68a758302c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1678 microversion: 2.1 time: 0.633413 Oct 29 03:10:03.865142 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2764/5516] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:03 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1678 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:04.393045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a51088c-afd2-4d79-8e43-8ed93c3aa9fc tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a8976940>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:04.464651 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5a51088c-afd2-4d79-8e43-8ed93c3aa9fc tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.076105 Oct 29 03:10:04.465853 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2753/5517] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:04 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:04.894630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f677292-ac50-40c1-a834-5deb6ef4bfc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:04.896083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f677292-ac50-40c1-a834-5deb6ef4bfc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:04.915060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f677292-ac50-40c1-a834-5deb6ef4bfc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:04.916939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f677292-ac50-40c1-a834-5deb6ef4bfc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:04.917849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f677292-ac50-40c1-a834-5deb6ef4bfc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:04.918968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f677292-ac50-40c1-a834-5deb6ef4bfc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:04.919654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f677292-ac50-40c1-a834-5deb6ef4bfc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:04.920320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f677292-ac50-40c1-a834-5deb6ef4bfc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:05.444936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f677292-ac50-40c1-a834-5deb6ef4bfc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:05.456152 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f677292-ac50-40c1-a834-5deb6ef4bfc8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1661 microversion: 2.1 time: 0.565984 Oct 29 03:10:05.462262 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2765/5518] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:04 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1661 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:05.483038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e34b36e4-ac61-4f24-97a2-3f8b2de8555c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3eeb4c0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:05.492767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f75ad55a-2d39-497f-95bb-6271795670a6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:05.496931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f75ad55a-2d39-497f-95bb-6271795670a6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:05.524276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75ad55a-2d39-497f-95bb-6271795670a6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:05.527594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75ad55a-2d39-497f-95bb-6271795670a6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:05.530452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75ad55a-2d39-497f-95bb-6271795670a6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:05.552106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75ad55a-2d39-497f-95bb-6271795670a6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:05.553721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75ad55a-2d39-497f-95bb-6271795670a6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:05.558833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f75ad55a-2d39-497f-95bb-6271795670a6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:05.606178 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e34b36e4-ac61-4f24-97a2-3f8b2de8555c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.129071 Oct 29 03:10:05.614046 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2754/5519] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:05 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:05.790460 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f75ad55a-2d39-497f-95bb-6271795670a6 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action" status: 202 len: 0 microversion: 2.1 time: 0.304556 Oct 29 03:10:05.792747 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2766/5520] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:10:05 2022] POST /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:10:05.801463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0726ae3b-97da-4b71-b73a-3b35ec4f68a2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:05.802525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0726ae3b-97da-4b71-b73a-3b35ec4f68a2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:05.814141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0726ae3b-97da-4b71-b73a-3b35ec4f68a2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:05.816381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0726ae3b-97da-4b71-b73a-3b35ec4f68a2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:05.817638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0726ae3b-97da-4b71-b73a-3b35ec4f68a2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:05.818667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0726ae3b-97da-4b71-b73a-3b35ec4f68a2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:05.819346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0726ae3b-97da-4b71-b73a-3b35ec4f68a2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:05.820231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0726ae3b-97da-4b71-b73a-3b35ec4f68a2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:06.148342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0726ae3b-97da-4b71-b73a-3b35ec4f68a2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:06.157205 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0726ae3b-97da-4b71-b73a-3b35ec4f68a2 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1667 microversion: 2.1 time: 0.360506 Oct 29 03:10:06.157717 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2755/5521] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:05 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1667 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:06.622944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2f8ddc66-0ab1-4d92-8034-1be9514abf6f tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3364e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:06.744229 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2f8ddc66-0ab1-4d92-8034-1be9514abf6f tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.126776 Oct 29 03:10:06.745001 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2767/5522] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:06 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:07.184021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5e3d101c-a1b3-4644-8379-45b603e4f774 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:07.185250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5e3d101c-a1b3-4644-8379-45b603e4f774 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:07.202401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3d101c-a1b3-4644-8379-45b603e4f774 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:07.205429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3d101c-a1b3-4644-8379-45b603e4f774 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:07.207443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3d101c-a1b3-4644-8379-45b603e4f774 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:07.209526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3d101c-a1b3-4644-8379-45b603e4f774 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:07.219537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3d101c-a1b3-4644-8379-45b603e4f774 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:07.220600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e3d101c-a1b3-4644-8379-45b603e4f774 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:07.761461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e1950760-011c-4a48-9825-bad602879336 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a33baa60>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:07.835159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5e3d101c-a1b3-4644-8379-45b603e4f774 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:07.841875 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e1950760-011c-4a48-9825-bad602879336 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.085688 Oct 29 03:10:07.842480 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2768/5523] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:07 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:07.853509 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5e3d101c-a1b3-4644-8379-45b603e4f774 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1667 microversion: 2.1 time: 0.673353 Oct 29 03:10:07.859906 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2756/5524] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:07 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1667 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:08.237366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3ec89fa4-b6a7-466c-8484-2ff25e56be1d tempest-ExtensionsTest-1087411064 tempest-ExtensionsTest-1087411064-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:08.239581 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3ec89fa4-b6a7-466c-8484-2ff25e56be1d tempest-ExtensionsTest-1087411064 tempest-ExtensionsTest-1087411064-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.384715 Oct 29 03:10:08.240849 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2769/5525] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Oct 29 03:10:07 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:08.250919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7f90d781-65b1-4173-b33e-c0168b0dde5d tempest-ExtensionsTest-1087411064 tempest-ExtensionsTest-1087411064-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:08.254056 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7f90d781-65b1-4173-b33e-c0168b0dde5d tempest-ExtensionsTest-1087411064 tempest-ExtensionsTest-1087411064-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007506 Oct 29 03:10:08.255349 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2757/5526] 10.222.0.16 () {58 vars in 1134 bytes} [Sat Oct 29 03:10:08 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:10:08.858811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8e073c52-898b-468c-b13f-b96e237fdda4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a32f9430>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:08.886843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0f7a2b8b-57bf-410f-8107-7abb7a18ad0c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:08.887809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0f7a2b8b-57bf-410f-8107-7abb7a18ad0c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:08.896836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f7a2b8b-57bf-410f-8107-7abb7a18ad0c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.904999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f7a2b8b-57bf-410f-8107-7abb7a18ad0c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.905711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f7a2b8b-57bf-410f-8107-7abb7a18ad0c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:08.906645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f7a2b8b-57bf-410f-8107-7abb7a18ad0c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.907270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f7a2b8b-57bf-410f-8107-7abb7a18ad0c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.907858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0f7a2b8b-57bf-410f-8107-7abb7a18ad0c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:08.943381 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8e073c52-898b-468c-b13f-b96e237fdda4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1452 microversion: 2.1 time: 0.089304 Oct 29 03:10:08.951187 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2770/5527] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:08 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:09.289562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0f7a2b8b-57bf-410f-8107-7abb7a18ad0c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:09.308896 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0f7a2b8b-57bf-410f-8107-7abb7a18ad0c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.424123 Oct 29 03:10:09.309622 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2758/5528] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:08 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:09.341627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4dfea9cf-1afe-4335-8c82-a05d4037a17a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:09.342566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4dfea9cf-1afe-4335-8c82-a05d4037a17a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:09.371071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dfea9cf-1afe-4335-8c82-a05d4037a17a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:09.371567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dfea9cf-1afe-4335-8c82-a05d4037a17a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:09.372008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dfea9cf-1afe-4335-8c82-a05d4037a17a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:09.372718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dfea9cf-1afe-4335-8c82-a05d4037a17a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:09.373171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dfea9cf-1afe-4335-8c82-a05d4037a17a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:09.373591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4dfea9cf-1afe-4335-8c82-a05d4037a17a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:09.636690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4dfea9cf-1afe-4335-8c82-a05d4037a17a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:09.652948 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4dfea9cf-1afe-4335-8c82-a05d4037a17a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1670 microversion: 2.1 time: 0.316815 Oct 29 03:10:09.657867 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2771/5529] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:09 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1670 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:09.685105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:09.685865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:09.688355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=52 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:09.697843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:09.701863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:09.702280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:09.703223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:09.703669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:09.706372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:09.751311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:10:09.771399 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.compute.api [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Working on deleting snapshot 18602747-a435-4a52-8961-f1b389963255 from shelved instance... Oct 29 03:10:09.958556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8fa8190f-4b84-43f2-bc51-b771cd7ecfbd tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3219310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:10.891760 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8fa8190f-4b84-43f2-bc51-b771cd7ecfbd tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1461 microversion: 2.1 time: 0.936224 Oct 29 03:10:10.897852 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2772/5530] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:09 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1461 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:10.912913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-125ee363-287e-4b7a-a3d0-2f127a5df125 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3333dc0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:10.993292 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-125ee363-287e-4b7a-a3d0-2f127a5df125 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 200 len: 1461 microversion: 2.1 time: 0.088476 Oct 29 03:10:10.997133 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2773/5531] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:10 2022] GET /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 1461 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:11.012166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0a7d4589-594b-4260-92a5-cf797498da7d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:11.012768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0a7d4589-594b-4260-92a5-cf797498da7d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:11.021339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a7d4589-594b-4260-92a5-cf797498da7d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:11.021866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a7d4589-594b-4260-92a5-cf797498da7d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:11.022836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a7d4589-594b-4260-92a5-cf797498da7d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:11.024120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a7d4589-594b-4260-92a5-cf797498da7d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:11.024931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a7d4589-594b-4260-92a5-cf797498da7d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:11.025466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a7d4589-594b-4260-92a5-cf797498da7d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:11.062832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Doing local delete in cell 6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) {{(pid=127041) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 29 03:10:11.063727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:11.064218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:11.065095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:11.065095 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.compute.api [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 29 03:10:11.077379 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [08b8d584-c957-4b33-8f55-ae4be8e99d11] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 03:10:11.240293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0a7d4589-594b-4260-92a5-cf797498da7d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:11.258530 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0a7d4589-594b-4260-92a5-cf797498da7d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 200 len: 1481 microversion: 2.1 time: 0.251309 Oct 29 03:10:11.263207 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2774/5532] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:11 2022] GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 1481 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:12.091236 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [08b8d584-c957-4b33-8f55-ae4be8e99d11] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40684. Oct 29 03:10:12.100650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] deallocate_for_instance() {{(pid=127041) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 29 03:10:12.288714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-679de408-4ba0-4014-8c19-519ae1f345ac tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:12.290308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-679de408-4ba0-4014-8c19-519ae1f345ac tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:12.303941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679de408-4ba0-4014-8c19-519ae1f345ac tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:12.309558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679de408-4ba0-4014-8c19-519ae1f345ac tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:12.310954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679de408-4ba0-4014-8c19-519ae1f345ac tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:12.311868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679de408-4ba0-4014-8c19-519ae1f345ac tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:12.315075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679de408-4ba0-4014-8c19-519ae1f345ac tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:12.315838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-679de408-4ba0-4014-8c19-519ae1f345ac tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:12.654822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-679de408-4ba0-4014-8c19-519ae1f345ac tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:12.668589 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-679de408-4ba0-4014-8c19-519ae1f345ac tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 200 len: 1468 microversion: 2.1 time: 0.384800 Oct 29 03:10:12.681833 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2775/5533] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:12 2022] GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 1468 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:12.696155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a4a23301-1c2f-43ce-826b-b0b66c1448e4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3333160>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:12.916988 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a4a23301-1c2f-43ce-826b-b0b66c1448e4 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-10-29T03%3A08%3A14Z" status: 200 len: 1900 microversion: 2.1 time: 0.224693 Oct 29 03:10:12.931673 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2776/5534] 10.222.0.16 () {58 vars in 1199 bytes} [Sat Oct 29 03:10:12 2022] GET /compute/v2.1/images?changes-since=2022-10-29T03%3A08%3A14Z => generated 1900 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:12.939183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eb249009-4189-4b4c-b9bf-dddb1a43e08a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a33371f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:13.101926 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eb249009-4189-4b4c-b9bf-dddb1a43e08a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1517251441" status: 200 len: 485 microversion: 2.1 time: 0.168757 Oct 29 03:10:13.102919 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2777/5535] 10.222.0.16 () {58 vars in 1231 bytes} [Sat Oct 29 03:10:12 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1517251441 => generated 485 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:13.121147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f95f62ab-19ed-4ecd-a735-eb7ab552ba21 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a32f9e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:13.126802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Updating instance_info_cache with network_info: [] {{(pid=127041) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 03:10:13.321563 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f95f62ab-19ed-4ecd-a735-eb7ab552ba21 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images?server=a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 200 len: 955 microversion: 2.1 time: 0.207883 Oct 29 03:10:13.330359 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2778/5536] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Oct 29 03:10:13 2022] GET /compute/v2.1/images?server=a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 955 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:13.345217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d6e3f96e-cbd3-475d-a764-655008bd7cbe req-2f566748-3e13-41be-9f6c-3e8f8afa80a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572315db-719f-4e84-890d-9968c46ff335", "name": "network-vif-deleted", "tag": "a6107dbe-78ce-4e28-a7e1-0e8894eaa341"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:13.373942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d6e3f96e-cbd3-475d-a764-655008bd7cbe req-2f566748-3e13-41be-9f6c-3e8f8afa80a6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:13.374682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d6e3f96e-cbd3-475d-a764-655008bd7cbe req-2f566748-3e13-41be-9f6c-3e8f8afa80a6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:13.377190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d6e3f96e-cbd3-475d-a764-655008bd7cbe req-2f566748-3e13-41be-9f6c-3e8f8afa80a6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:13.409302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.compute.server_external_events [req-d6e3f96e-cbd3-475d-a764-655008bd7cbe req-2f566748-3e13-41be-9f6c-3e8f8afa80a6 service nova] Unable to find a host for instance 572315db-719f-4e84-890d-9968c46ff335. Dropping event network-vif-deleted {{(pid=127042) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 03:10:13.410335 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d6e3f96e-cbd3-475d-a764-655008bd7cbe req-2f566748-3e13-41be-9f6c-3e8f8afa80a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.078254 Oct 29 03:10:13.410968 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2779/5537] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 79 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 03:10:13.418475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e609d425-4d04-4a48-ace1-c71125a2c1b5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3364c10>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:13.636134 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e609d425-4d04-4a48-ace1-c71125a2c1b5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 485 microversion: 2.1 time: 0.223614 Oct 29 03:10:13.639938 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2780/5538] 10.222.0.16 () {58 vars in 1317 bytes} [Sat Oct 29 03:10:13 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 485 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:13.660473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-813d698d-aca7-4938-b998-2a42c854d19c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3312280>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:13.739995 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-813d698d-aca7-4938-b998-2a42c854d19c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 485 microversion: 2.1 time: 0.091039 Oct 29 03:10:13.740775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:13.742607 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2781/5539] 10.222.0.16 () {58 vars in 1303 bytes} [Sat Oct 29 03:10:13 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 485 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:13.759103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cc7bc178-af07-4051-aaab-000c10e65a73 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3364f70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:13.937290 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ae346ce7-2f7d-4a83-b65e-a2d07a934254 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "DELETE /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 204 len: 0 microversion: 2.1 time: 4.257144 Oct 29 03:10:13.938338 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2759/5540] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:10:09 2022] DELETE /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 0 bytes in 4259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:13.942337 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cc7bc178-af07-4051-aaab-000c10e65a73 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.190523 Oct 29 03:10:13.943140 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2782/5541] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Oct 29 03:10:13 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:13.965861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:13.966837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 572315db-719f-4e84-890d-9968c46ff335] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:13.971767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5edb8525-325f-4d7e-b7cf-a409cf5a6cfe tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3337b80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:13.986539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:13.987032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:13.988755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:13.989695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:13.992465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:13.993131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:14.025432 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] HTTP exception thrown: Instance 572315db-719f-4e84-890d-9968c46ff335 could not be found. Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Request method failure captured: Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 HTTP/1.1 Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJeSr1oL0rONYcv9CfxIanIPbUeGw-s2Wl4VNA9GEpVCgEE4OiCenlJFf66TiN_-nkeJklfReLoMTtrJ83D7xezyaNkFbwK0U16CX_E0dK0DTvVDkg1lOik0BLuL1_K7VtLlWIKuOhFwA62qqiC9Oq-KCZnYhWwKlrztnOyVOmkou8Q Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d4193e4464b7488b9b3bb4064afb0288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}] Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: dc4e17d222e0426698d1ef9a17921d64 Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 572315db-719f-4e84-890d-9968c46ff335 could not be found. Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '572315db-719f-4e84-890d-9968c46ff335'} Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 572315db-719f-4e84-890d-9968c46ff335 could not be found. Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 572315db-719f-4e84-890d-9968c46ff335 could not be found. Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:14.033698 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:14.040277 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:14.040277 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:14.040277 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:14.040277 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:10:14.040277 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:10:14.040277 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 572315db-719f-4e84-890d-9968c46ff335 could not be found. Oct 29 03:10:14.040277 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:14.040277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Returning 404 to user: Instance 572315db-719f-4e84-890d-9968c46ff335 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:10:14.040277 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d0d613a-0801-4203-8db4-c372ce3e62da tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335" status: 404 len: 111 microversion: 2.1 time: 0.095122 Oct 29 03:10:14.040277 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2760/5542] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:13 2022] GET /compute/v2.1/servers/572315db-719f-4e84-890d-9968c46ff335 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:14.046652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9f567968-69a6-4ca1-85bf-8a1e8cea5e75 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:14.050092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9f567968-69a6-4ca1-85bf-8a1e8cea5e75 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:14.059611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f567968-69a6-4ca1-85bf-8a1e8cea5e75 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:14.060099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f567968-69a6-4ca1-85bf-8a1e8cea5e75 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:14.060521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f567968-69a6-4ca1-85bf-8a1e8cea5e75 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:14.061399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f567968-69a6-4ca1-85bf-8a1e8cea5e75 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:14.062238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f567968-69a6-4ca1-85bf-8a1e8cea5e75 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:14.062820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f567968-69a6-4ca1-85bf-8a1e8cea5e75 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:14.082548 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5edb8525-325f-4d7e-b7cf-a409cf5a6cfe tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.120179 Oct 29 03:10:14.086699 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2783/5543] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Oct 29 03:10:13 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:14.110514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9f567968-69a6-4ca1-85bf-8a1e8cea5e75 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:10:14.111902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd85ad8d-0cee-40af-85f9-f60982c2cea6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3364790>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:14.217000 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd85ad8d-0cee-40af-85f9-f60982c2cea6 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.117436 Oct 29 03:10:14.218357 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2784/5544] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 03:10:14 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:14.249246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-11d84e72-1712-4fc6-950b-5f23407a9ed1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3312f70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:14.261443 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9f567968-69a6-4ca1-85bf-8a1e8cea5e75 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 204 len: 0 microversion: 2.1 time: 0.218513 Oct 29 03:10:14.269452 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2761/5545] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:10:14 2022] DELETE /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:14.276293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8c52aa6d-adac-4c7c-bb06-5e979b76a3c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:14.276992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8c52aa6d-adac-4c7c-bb06-5e979b76a3c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:14.288589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c52aa6d-adac-4c7c-bb06-5e979b76a3c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:14.289477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c52aa6d-adac-4c7c-bb06-5e979b76a3c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:14.290512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c52aa6d-adac-4c7c-bb06-5e979b76a3c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:14.292758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c52aa6d-adac-4c7c-bb06-5e979b76a3c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:14.293769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c52aa6d-adac-4c7c-bb06-5e979b76a3c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:14.294714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c52aa6d-adac-4c7c-bb06-5e979b76a3c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:14.547103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c52aa6d-adac-4c7c-bb06-5e979b76a3c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:14.559656 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8c52aa6d-adac-4c7c-bb06-5e979b76a3c0 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1467 microversion: 2.1 time: 0.288531 Oct 29 03:10:14.560257 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2762/5546] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:14 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1467 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:14.837280 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-11d84e72-1712-4fc6-950b-5f23407a9ed1 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-10-29T03%3A08%3A07Z" status: 200 len: 6326 microversion: 2.1 time: 0.594816 Oct 29 03:10:14.855002 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2785/5547] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Oct 29 03:10:14 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-29T03%3A08%3A07Z => generated 6326 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:14.858329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dcaeeb49-9597-415b-ba83-4654e148e1c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1acb19dc0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:14.937097 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dcaeeb49-9597-415b-ba83-4654e148e1c2 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1517251441" status: 200 len: 665 microversion: 2.1 time: 0.081484 Oct 29 03:10:14.949763 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2763/5548] 10.222.0.16 () {58 vars in 1252 bytes} [Sat Oct 29 03:10:14 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1517251441 => generated 665 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:10:14.956075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-085fd0e8-e026-410b-99ed-a41347810a0c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3364f70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:15.052745 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-085fd0e8-e026-410b-99ed-a41347810a0c tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1465 microversion: 2.1 time: 0.101474 Oct 29 03:10:15.054480 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2786/5549] 10.222.0.16 () {58 vars in 1338 bytes} [Sat Oct 29 03:10:14 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1465 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:15.070587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bd1f6547-fc47-41ee-b4bd-8b27d3f6d3c0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3919af0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:15.141892 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bd1f6547-fc47-41ee-b4bd-8b27d3f6d3c0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1465 microversion: 2.1 time: 0.075189 Oct 29 03:10:15.143389 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2764/5550] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Oct 29 03:10:15 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1465 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:15.161025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-69bfe295-9ccb-4647-8639-32f732483088 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a32f98b0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:15.352180 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-69bfe295-9ccb-4647-8639-32f732483088 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.196180 Oct 29 03:10:15.356540 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2787/5551] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Oct 29 03:10:15 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:15.376423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8d1f2a3-b774-427c-a175-0734650a06c9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3f634c0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:15.473030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-89cd6e62-7a9a-402a-8b53-880dc2197945 req-e3b996ee-fb83-46be-9a80-fa802fa4ede0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87ccf8a-8236-4a31-ad90-4805b875a1c1", "name": "network-vif-unplugged", "status": "completed", "tag": "e064d394-4cc8-46e7-ab41-6664c7bdbce0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:15.513138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-89cd6e62-7a9a-402a-8b53-880dc2197945 req-e3b996ee-fb83-46be-9a80-fa802fa4ede0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:15.515061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-89cd6e62-7a9a-402a-8b53-880dc2197945 req-e3b996ee-fb83-46be-9a80-fa802fa4ede0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:15.517602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-89cd6e62-7a9a-402a-8b53-880dc2197945 req-e3b996ee-fb83-46be-9a80-fa802fa4ede0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:15.549397 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8d1f2a3-b774-427c-a175-0734650a06c9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.177017 Oct 29 03:10:15.575063 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-89cd6e62-7a9a-402a-8b53-880dc2197945 req-e3b996ee-fb83-46be-9a80-fa802fa4ede0 service nova] Creating event network-vif-unplugged:e064d394-4cc8-46e7-ab41-6664c7bdbce0 for instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 on n-h2-862964-4 Oct 29 03:10:15.579459 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2765/5552] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Oct 29 03:10:15 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:15.580240 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-89cd6e62-7a9a-402a-8b53-880dc2197945 req-e3b996ee-fb83-46be-9a80-fa802fa4ede0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112743 Oct 29 03:10:15.585296 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2788/5553] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:15.586746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ccd61255-4e7b-4d7c-9d6d-f3c639ee4acd tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3919430>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:15.614749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4553589d-ec4e-4ba1-b359-996914bc6859 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:15.617905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4553589d-ec4e-4ba1-b359-996914bc6859 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:15.654337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4553589d-ec4e-4ba1-b359-996914bc6859 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:15.660337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4553589d-ec4e-4ba1-b359-996914bc6859 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:15.663119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4553589d-ec4e-4ba1-b359-996914bc6859 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:15.664423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4553589d-ec4e-4ba1-b359-996914bc6859 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:15.667924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4553589d-ec4e-4ba1-b359-996914bc6859 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:15.668928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4553589d-ec4e-4ba1-b359-996914bc6859 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:15.681485 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ccd61255-4e7b-4d7c-9d6d-f3c639ee4acd tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/c6777954-04bd-4ae1-b363-bbcd09a3f6ab" status: 200 len: 784 microversion: 2.1 time: 0.100125 Oct 29 03:10:15.694790 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2766/5554] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:15 2022] GET /compute/v2.1/images/c6777954-04bd-4ae1-b363-bbcd09a3f6ab => generated 784 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:15.704150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51eb4e9a-92a5-4f24-8266-1486c73fa167 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a87895e0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:15.826977 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-51eb4e9a-92a5-4f24-8266-1486c73fa167 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.130413 Oct 29 03:10:15.838797 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2767/5555] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 03:10:15 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:15.845045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cbf01bd6-44ab-4ef5-a112-c368ffdd9cb0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3e5d790>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:15.946306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4553589d-ec4e-4ba1-b359-996914bc6859 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:15.957428 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4553589d-ec4e-4ba1-b359-996914bc6859 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1467 microversion: 2.1 time: 0.370553 Oct 29 03:10:15.964599 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2789/5556] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:15 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1467 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:16.987042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f03554a-6793-424d-8f32-a9b257624320 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:16.988597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5f03554a-6793-424d-8f32-a9b257624320 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:17.003629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f03554a-6793-424d-8f32-a9b257624320 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:17.006342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f03554a-6793-424d-8f32-a9b257624320 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:17.010812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f03554a-6793-424d-8f32-a9b257624320 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:17.011816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f03554a-6793-424d-8f32-a9b257624320 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:17.013093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f03554a-6793-424d-8f32-a9b257624320 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:17.013775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5f03554a-6793-424d-8f32-a9b257624320 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:17.047157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:17.291681 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cbf01bd6-44ab-4ef5-a112-c368ffdd9cb0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "DELETE /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d" status: 204 len: 0 microversion: 2.1 time: 1.451458 Oct 29 03:10:17.292323 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2768/5557] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:15 2022] DELETE /compute/v2.1/images/f0480c07-741e-427d-b639-aba23e38ce3d => generated 0 bytes in 1453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:17.302752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1007ca71-d5ce-4a70-9016-aa29b4b19eed tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:17.326852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1007ca71-d5ce-4a70-9016-aa29b4b19eed tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:17.327711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1007ca71-d5ce-4a70-9016-aa29b4b19eed tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:17.328310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1007ca71-d5ce-4a70-9016-aa29b4b19eed tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:17.397175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1007ca71-d5ce-4a70-9016-aa29b4b19eed tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Going to try to stop instance {{(pid=127041) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:10:17.398396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5f03554a-6793-424d-8f32-a9b257624320 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:17.408364 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f03554a-6793-424d-8f32-a9b257624320 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1467 microversion: 2.1 time: 0.427731 Oct 29 03:10:17.411595 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2790/5558] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:16 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1467 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:17.426294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-43875956-0247-4a64-9086-782d836656d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a33a7ca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:17.510456 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1007ca71-d5ce-4a70-9016-aa29b4b19eed tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "POST /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/action" status: 202 len: 0 microversion: 2.1 time: 0.211824 Oct 29 03:10:17.512508 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2769/5559] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:10:17 2022] POST /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:10:17.525288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54ca10cd-d40e-4505-ac10-2ae429ecb460 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:17.528319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54ca10cd-d40e-4505-ac10-2ae429ecb460 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:17.540521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ca10cd-d40e-4505-ac10-2ae429ecb460 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:17.541474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ca10cd-d40e-4505-ac10-2ae429ecb460 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:17.541941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ca10cd-d40e-4505-ac10-2ae429ecb460 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:17.543035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ca10cd-d40e-4505-ac10-2ae429ecb460 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:17.548609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ca10cd-d40e-4505-ac10-2ae429ecb460 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:17.552590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54ca10cd-d40e-4505-ac10-2ae429ecb460 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:18.012081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-54ca10cd-d40e-4505-ac10-2ae429ecb460 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:18.021162 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54ca10cd-d40e-4505-ac10-2ae429ecb460 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.503289 Oct 29 03:10:18.021760 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2770/5560] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:17 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:18.440423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-053ae3ee-220a-4871-b1c7-afdf12b67b97 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:18.441457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-053ae3ee-220a-4871-b1c7-afdf12b67b97 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:18.452050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-053ae3ee-220a-4871-b1c7-afdf12b67b97 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:18.452811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-053ae3ee-220a-4871-b1c7-afdf12b67b97 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:18.453940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-053ae3ee-220a-4871-b1c7-afdf12b67b97 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:18.455748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-053ae3ee-220a-4871-b1c7-afdf12b67b97 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:18.456493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-053ae3ee-220a-4871-b1c7-afdf12b67b97 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:18.457132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-053ae3ee-220a-4871-b1c7-afdf12b67b97 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:18.627529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-053ae3ee-220a-4871-b1c7-afdf12b67b97 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:18.644241 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-053ae3ee-220a-4871-b1c7-afdf12b67b97 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 200 len: 1467 microversion: 2.1 time: 0.208073 Oct 29 03:10:18.662406 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2771/5561] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:18 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 1467 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:18.715174 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-43875956-0247-4a64-9086-782d836656d0 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "DELETE /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a" status: 204 len: 0 microversion: 2.1 time: 1.299566 Oct 29 03:10:18.719092 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2791/5562] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:17 2022] DELETE /compute/v2.1/images/3889aec1-54d7-4096-96bd-2be8b017753a => generated 0 bytes in 1301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:18.737038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-34a1cde3-eacd-49b9-80f9-2612ea04766d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a8789dc0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:18.976289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-651f81cd-6f9c-4569-8617-a00dd9eb0107 req-f1b4522b-bfa1-483a-8d09-2ae4f7aac2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7064a1-f665-453b-8f44-91cedddf96bc", "name": "network-vif-deleted", "tag": "eaa05058-291a-420d-8b9f-0f339119b6cb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:18.997235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-651f81cd-6f9c-4569-8617-a00dd9eb0107 req-f1b4522b-bfa1-483a-8d09-2ae4f7aac2e2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:18.997620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-651f81cd-6f9c-4569-8617-a00dd9eb0107 req-f1b4522b-bfa1-483a-8d09-2ae4f7aac2e2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:18.999352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-651f81cd-6f9c-4569-8617-a00dd9eb0107 req-f1b4522b-bfa1-483a-8d09-2ae4f7aac2e2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:19.032094 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-651f81cd-6f9c-4569-8617-a00dd9eb0107 req-f1b4522b-bfa1-483a-8d09-2ae4f7aac2e2 service nova] Creating event network-vif-deleted:eaa05058-291a-420d-8b9f-0f339119b6cb for instance 2c7064a1-f665-453b-8f44-91cedddf96bc on n-h1-862964-4 Oct 29 03:10:19.049856 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-651f81cd-6f9c-4569-8617-a00dd9eb0107 req-f1b4522b-bfa1-483a-8d09-2ae4f7aac2e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076502 Oct 29 03:10:19.051195 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2792/5563] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:10:19.059361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3425b6ff-2379-4488-9315-ac9cc1ee166e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:19.060602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3425b6ff-2379-4488-9315-ac9cc1ee166e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:19.086946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3425b6ff-2379-4488-9315-ac9cc1ee166e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:19.089895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3425b6ff-2379-4488-9315-ac9cc1ee166e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:19.090764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3425b6ff-2379-4488-9315-ac9cc1ee166e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:19.092066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3425b6ff-2379-4488-9315-ac9cc1ee166e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:19.092795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3425b6ff-2379-4488-9315-ac9cc1ee166e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:19.093500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3425b6ff-2379-4488-9315-ac9cc1ee166e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:20.103501 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-34a1cde3-eacd-49b9-80f9-2612ea04766d tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "DELETE /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d" status: 204 len: 0 microversion: 2.1 time: 1.382849 Oct 29 03:10:20.104359 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2772/5564] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:18 2022] DELETE /compute/v2.1/images/801b2930-4e47-4fb4-aff2-f5d8521a152d => generated 0 bytes in 1385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:10:20.110064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:20.110952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 2c7064a1-f665-453b-8f44-91cedddf96bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:20.121403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3425b6ff-2379-4488-9315-ac9cc1ee166e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:20.128607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:20.131474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:20.132371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:20.135449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:20.136166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:20.137286 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3425b6ff-2379-4488-9315-ac9cc1ee166e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 1.084518 Oct 29 03:10:20.138096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:20.138764 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2793/5565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:19 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:20.145251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c689b34-7732-4c64-ac51-14e6796b6c95 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:20.146302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0c689b34-7732-4c64-ac51-14e6796b6c95 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:20.154593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c689b34-7732-4c64-ac51-14e6796b6c95 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:20.155447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c689b34-7732-4c64-ac51-14e6796b6c95 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:20.156336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c689b34-7732-4c64-ac51-14e6796b6c95 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:20.157205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c689b34-7732-4c64-ac51-14e6796b6c95 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:20.157835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c689b34-7732-4c64-ac51-14e6796b6c95 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:20.158545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c689b34-7732-4c64-ac51-14e6796b6c95 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:20.197654 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] HTTP exception thrown: Instance 2c7064a1-f665-453b-8f44-91cedddf96bc could not be found. Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Request method failure captured: Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc HTTP/1.1 Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJeSr1oL0rONYcv9CfxIanIPbUeGw-s2Wl4VNA9GEpVCgEE4OiCenlJFf66TiN_-nkeJklfReLoMTtrJ83D7xezyaNkFbwK0U16CX_E0dK0DTvVDkg1lOik0BLuL1_K7VtLlWIKuOhFwA62qqiC9Oq-KCZnYhWwKlrztnOyVOmkou8Q Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d4193e4464b7488b9b3bb4064afb0288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}] Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: dc4e17d222e0426698d1ef9a17921d64 Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 2c7064a1-f665-453b-8f44-91cedddf96bc could not be found. Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2c7064a1-f665-453b-8f44-91cedddf96bc'} Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7064a1-f665-453b-8f44-91cedddf96bc could not be found. Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7064a1-f665-453b-8f44-91cedddf96bc could not be found. Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:20.201179 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:20.206323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:20.206323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:20.206323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:20.206323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:10:20.206323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:10:20.206323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7064a1-f665-453b-8f44-91cedddf96bc could not be found. Oct 29 03:10:20.206323 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:20.208569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Returning 404 to user: Instance 2c7064a1-f665-453b-8f44-91cedddf96bc could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:10:20.210811 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-190ebbb6-8e8d-410a-8c81-8a28f4ce8497 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc" status: 404 len: 111 microversion: 2.1 time: 0.105031 Oct 29 03:10:20.212752 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2773/5566] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:20 2022] GET /compute/v2.1/servers/2c7064a1-f665-453b-8f44-91cedddf96bc => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:20.217258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0c689b34-7732-4c64-ac51-14e6796b6c95 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:10:20.226322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e7f4e538-fa4a-4a8e-a84a-ac1c232399f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:20.229471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e7f4e538-fa4a-4a8e-a84a-ac1c232399f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:20.241851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7f4e538-fa4a-4a8e-a84a-ac1c232399f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:20.243126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7f4e538-fa4a-4a8e-a84a-ac1c232399f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:20.245040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7f4e538-fa4a-4a8e-a84a-ac1c232399f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:20.246326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7f4e538-fa4a-4a8e-a84a-ac1c232399f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:20.247308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7f4e538-fa4a-4a8e-a84a-ac1c232399f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:20.247996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7f4e538-fa4a-4a8e-a84a-ac1c232399f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:20.285781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e7f4e538-fa4a-4a8e-a84a-ac1c232399f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:10:20.391046 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0c689b34-7732-4c64-ac51-14e6796b6c95 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 204 len: 0 microversion: 2.1 time: 0.249779 Oct 29 03:10:20.392646 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2794/5567] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:10:20 2022] DELETE /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:20.416000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ff89f302-a62b-45d7-9dae-394033295454 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:20.419967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ff89f302-a62b-45d7-9dae-394033295454 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:20.437241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff89f302-a62b-45d7-9dae-394033295454 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:20.437241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff89f302-a62b-45d7-9dae-394033295454 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:20.440112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff89f302-a62b-45d7-9dae-394033295454 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:20.442681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff89f302-a62b-45d7-9dae-394033295454 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:20.445558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff89f302-a62b-45d7-9dae-394033295454 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:20.446132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff89f302-a62b-45d7-9dae-394033295454 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:20.453030 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e7f4e538-fa4a-4a8e-a84a-ac1c232399f8 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 204 len: 0 microversion: 2.1 time: 0.235718 Oct 29 03:10:20.453840 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2774/5568] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:10:20 2022] DELETE /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:20.463039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ee913d29-0ad9-4a92-aeae-8780847dba83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:20.463735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ee913d29-0ad9-4a92-aeae-8780847dba83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:20.481385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee913d29-0ad9-4a92-aeae-8780847dba83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:20.481644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee913d29-0ad9-4a92-aeae-8780847dba83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:20.485177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee913d29-0ad9-4a92-aeae-8780847dba83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:20.486900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee913d29-0ad9-4a92-aeae-8780847dba83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:20.492968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee913d29-0ad9-4a92-aeae-8780847dba83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:20.493581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee913d29-0ad9-4a92-aeae-8780847dba83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:20.843477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ff89f302-a62b-45d7-9dae-394033295454 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:20.852209 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ff89f302-a62b-45d7-9dae-394033295454 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1472 microversion: 2.1 time: 0.454923 Oct 29 03:10:20.853118 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2795/5569] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:20 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1472 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:20.998550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ee913d29-0ad9-4a92-aeae-8780847dba83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:21.007025 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ee913d29-0ad9-4a92-aeae-8780847dba83 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1508 microversion: 2.1 time: 0.547457 Oct 29 03:10:21.008187 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2775/5570] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:20 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1508 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:21.166413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f67b03ac-0e02-4249-8790-b96874aee195 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:21.167022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f67b03ac-0e02-4249-8790-b96874aee195 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:21.174943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f67b03ac-0e02-4249-8790-b96874aee195 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:21.175661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f67b03ac-0e02-4249-8790-b96874aee195 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:21.176293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f67b03ac-0e02-4249-8790-b96874aee195 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:21.177302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f67b03ac-0e02-4249-8790-b96874aee195 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:21.178145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f67b03ac-0e02-4249-8790-b96874aee195 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:21.179359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f67b03ac-0e02-4249-8790-b96874aee195 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:21.413492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f67b03ac-0e02-4249-8790-b96874aee195 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:21.422511 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f67b03ac-0e02-4249-8790-b96874aee195 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.260803 Oct 29 03:10:21.423518 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2796/5571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:21 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:21.876209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-121dce2a-70fd-4ec3-a187-52de53f8e8d9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:21.876816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-121dce2a-70fd-4ec3-a187-52de53f8e8d9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:21.887230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-121dce2a-70fd-4ec3-a187-52de53f8e8d9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:21.889060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-121dce2a-70fd-4ec3-a187-52de53f8e8d9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:21.889957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-121dce2a-70fd-4ec3-a187-52de53f8e8d9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:21.893002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-121dce2a-70fd-4ec3-a187-52de53f8e8d9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:21.893721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-121dce2a-70fd-4ec3-a187-52de53f8e8d9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:21.894443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-121dce2a-70fd-4ec3-a187-52de53f8e8d9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:22.032429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d518df7c-2474-4645-940e-55fadbbf9721 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:22.033357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d518df7c-2474-4645-940e-55fadbbf9721 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:22.044707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d518df7c-2474-4645-940e-55fadbbf9721 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:22.046313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d518df7c-2474-4645-940e-55fadbbf9721 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:22.047008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d518df7c-2474-4645-940e-55fadbbf9721 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:22.048589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d518df7c-2474-4645-940e-55fadbbf9721 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:22.050354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d518df7c-2474-4645-940e-55fadbbf9721 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:22.053242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d518df7c-2474-4645-940e-55fadbbf9721 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:22.380113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-121dce2a-70fd-4ec3-a187-52de53f8e8d9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:22.397219 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-121dce2a-70fd-4ec3-a187-52de53f8e8d9 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1472 microversion: 2.1 time: 0.524863 Oct 29 03:10:22.398767 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2776/5572] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:21 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1472 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:22.459188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-70d43956-f74d-4de4-b4b5-d841629c9135 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:22.462066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-70d43956-f74d-4de4-b4b5-d841629c9135 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:22.479551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70d43956-f74d-4de4-b4b5-d841629c9135 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:22.482415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70d43956-f74d-4de4-b4b5-d841629c9135 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:22.490646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d518df7c-2474-4645-940e-55fadbbf9721 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:22.496137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70d43956-f74d-4de4-b4b5-d841629c9135 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:22.508258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70d43956-f74d-4de4-b4b5-d841629c9135 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:22.510858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70d43956-f74d-4de4-b4b5-d841629c9135 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:22.517692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70d43956-f74d-4de4-b4b5-d841629c9135 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:22.520576 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d518df7c-2474-4645-940e-55fadbbf9721 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1508 microversion: 2.1 time: 0.488306 Oct 29 03:10:22.522988 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2797/5573] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:22 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1508 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:22.583847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:UPDATE=15,nova_cell1:SELECT=80,nova_cell1:DELETE=2,nova_cell1:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:22.876465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-70d43956-f74d-4de4-b4b5-d841629c9135 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:22.885936 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-70d43956-f74d-4de4-b4b5-d841629c9135 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.438098 Oct 29 03:10:22.886532 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2777/5574] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:22 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:23.430891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3fca8a60-4e06-4a6b-9a7e-a68a7d8e108a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:23.431464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3fca8a60-4e06-4a6b-9a7e-a68a7d8e108a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:23.455551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fca8a60-4e06-4a6b-9a7e-a68a7d8e108a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:23.456322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fca8a60-4e06-4a6b-9a7e-a68a7d8e108a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:23.459745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fca8a60-4e06-4a6b-9a7e-a68a7d8e108a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:23.462140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fca8a60-4e06-4a6b-9a7e-a68a7d8e108a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:23.464386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fca8a60-4e06-4a6b-9a7e-a68a7d8e108a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:23.468563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fca8a60-4e06-4a6b-9a7e-a68a7d8e108a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:23.546730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-58f3b5a8-18e1-4e44-90d7-81bb014afdba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:23.547595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-58f3b5a8-18e1-4e44-90d7-81bb014afdba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:23.567178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f3b5a8-18e1-4e44-90d7-81bb014afdba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:23.568409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f3b5a8-18e1-4e44-90d7-81bb014afdba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:23.570599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f3b5a8-18e1-4e44-90d7-81bb014afdba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:23.571626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f3b5a8-18e1-4e44-90d7-81bb014afdba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:23.572988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f3b5a8-18e1-4e44-90d7-81bb014afdba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:23.575135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-58f3b5a8-18e1-4e44-90d7-81bb014afdba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:24.259122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-58f3b5a8-18e1-4e44-90d7-81bb014afdba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:24.279134 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-58f3b5a8-18e1-4e44-90d7-81bb014afdba tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1508 microversion: 2.1 time: 0.727189 Oct 29 03:10:24.279134 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2778/5575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:23 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1508 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:24.308836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7c06408b-1567-4ee2-9499-9629ad7a064d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:24.309223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7c06408b-1567-4ee2-9499-9629ad7a064d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:24.323216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c06408b-1567-4ee2-9499-9629ad7a064d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:24.323704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c06408b-1567-4ee2-9499-9629ad7a064d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:24.324133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c06408b-1567-4ee2-9499-9629ad7a064d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:24.324847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c06408b-1567-4ee2-9499-9629ad7a064d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:24.339429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c06408b-1567-4ee2-9499-9629ad7a064d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:24.339836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c06408b-1567-4ee2-9499-9629ad7a064d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:24.371798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3fca8a60-4e06-4a6b-9a7e-a68a7d8e108a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:24.381384 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3fca8a60-4e06-4a6b-9a7e-a68a7d8e108a tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1472 microversion: 2.1 time: 0.955299 Oct 29 03:10:24.384234 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2798/5576] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:23 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1472 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:24.834109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7c06408b-1567-4ee2-9499-9629ad7a064d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:24.843408 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7c06408b-1567-4ee2-9499-9629ad7a064d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.545431 Oct 29 03:10:24.870331 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2779/5577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:24 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:25.091756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a1aec135-4305-415b-ad62-3bf2fefcec1b req-632521ee-1039-4e98-8caa-eaba636e6fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e128c38-7acd-43a8-b9a3-cc26676e702e", "name": "network-vif-deleted", "tag": "b1e0bf4b-9dd4-47dd-923b-eaaab9d2e6fa"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:25.111117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a1aec135-4305-415b-ad62-3bf2fefcec1b req-632521ee-1039-4e98-8caa-eaba636e6fcc service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:25.113829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a1aec135-4305-415b-ad62-3bf2fefcec1b req-632521ee-1039-4e98-8caa-eaba636e6fcc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:25.114321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a1aec135-4305-415b-ad62-3bf2fefcec1b req-632521ee-1039-4e98-8caa-eaba636e6fcc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:25.143111 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a1aec135-4305-415b-ad62-3bf2fefcec1b req-632521ee-1039-4e98-8caa-eaba636e6fcc service nova] Creating event network-vif-deleted:b1e0bf4b-9dd4-47dd-923b-eaaab9d2e6fa for instance 1e128c38-7acd-43a8-b9a3-cc26676e702e on n-h1-862964-4 Oct 29 03:10:25.153482 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a1aec135-4305-415b-ad62-3bf2fefcec1b req-632521ee-1039-4e98-8caa-eaba636e6fcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065467 Oct 29 03:10:25.156441 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2799/5578] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:25.305267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1642fd88-d836-498c-92c9-423fc27c4451 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:25.306041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1642fd88-d836-498c-92c9-423fc27c4451 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:25.320380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1642fd88-d836-498c-92c9-423fc27c4451 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:25.321199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1642fd88-d836-498c-92c9-423fc27c4451 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:25.321605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1642fd88-d836-498c-92c9-423fc27c4451 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:25.322387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1642fd88-d836-498c-92c9-423fc27c4451 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:25.323005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1642fd88-d836-498c-92c9-423fc27c4451 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:25.323593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1642fd88-d836-498c-92c9-423fc27c4451 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:25.413264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:25.414285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:25.423451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:25.423995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:25.424439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:25.425164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:25.425615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:25.426068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:25.513554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:25.514146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:25.514592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:25.515054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lazy-loading 'fault' on Instance uuid 1e128c38-7acd-43a8-b9a3-cc26676e702e {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:10:25.673733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1642fd88-d836-498c-92c9-423fc27c4451 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:25.697490 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1642fd88-d836-498c-92c9-423fc27c4451 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1466 microversion: 2.1 time: 0.397215 Oct 29 03:10:25.698355 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2780/5579] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:25 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1466 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:25.768648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6016d548-a692-4ea1-904d-df870eaceec5 req-4aa451d0-0d13-4828-8965-39d869af8e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fdf9998-e29c-42b9-9f11-0ee63dd05901", "name": "network-vif-deleted", "tag": "a9efba69-8d4a-400d-b346-7a0ea12c04fe"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:25.790818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6016d548-a692-4ea1-904d-df870eaceec5 req-4aa451d0-0d13-4828-8965-39d869af8e55 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:25.791619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6016d548-a692-4ea1-904d-df870eaceec5 req-4aa451d0-0d13-4828-8965-39d869af8e55 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:25.813465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6016d548-a692-4ea1-904d-df870eaceec5 req-4aa451d0-0d13-4828-8965-39d869af8e55 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:25.843224 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6016d548-a692-4ea1-904d-df870eaceec5 req-4aa451d0-0d13-4828-8965-39d869af8e55 service nova] Creating event network-vif-deleted:a9efba69-8d4a-400d-b346-7a0ea12c04fe for instance 6fdf9998-e29c-42b9-9f11-0ee63dd05901 on n-h1-862964-4 Oct 29 03:10:25.855286 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6016d548-a692-4ea1-904d-df870eaceec5 req-4aa451d0-0d13-4828-8965-39d869af8e55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092881 Oct 29 03:10:25.856976 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2781/5580] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:10:25.874104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4c882d6a-e8e3-4a38-a169-5285b7fefca9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:25.875195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4c882d6a-e8e3-4a38-a169-5285b7fefca9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:25.895483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c882d6a-e8e3-4a38-a169-5285b7fefca9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:25.897243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c882d6a-e8e3-4a38-a169-5285b7fefca9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:25.898326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c882d6a-e8e3-4a38-a169-5285b7fefca9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:25.900362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c882d6a-e8e3-4a38-a169-5285b7fefca9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:25.902884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c882d6a-e8e3-4a38-a169-5285b7fefca9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:25.905157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c882d6a-e8e3-4a38-a169-5285b7fefca9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:25.995652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:26.008264 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6022dc64-377b-435d-9fb1-52a9f8993b85 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 200 len: 1307 microversion: 2.1 time: 0.597032 Oct 29 03:10:26.011809 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2800/5581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:25 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 1307 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:26.442393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4c882d6a-e8e3-4a38-a169-5285b7fefca9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:26.450684 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4c882d6a-e8e3-4a38-a169-5285b7fefca9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.583659 Oct 29 03:10:26.470373 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2782/5582] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:25 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:26.721089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:26.722233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:26.743740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:26.744254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:26.745973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:26.748575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:26.749149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:26.749597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:26.804188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:26.805589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:26.806233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:26.806907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lazy-loading 'fault' on Instance uuid 6fdf9998-e29c-42b9-9f11-0ee63dd05901 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:10:26.908434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:26.922190 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3212ad5f-910c-482c-a612-35c8e4856b2c tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 200 len: 1305 microversion: 2.1 time: 0.205354 Oct 29 03:10:26.922795 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2801/5583] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:26 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 1305 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:27.035806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:27.037215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: 1e128c38-7acd-43a8-b9a3-cc26676e702e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:27.044204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.045184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.046898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:27.049636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.050808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.051887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:27.077384 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] HTTP exception thrown: Instance 1e128c38-7acd-43a8-b9a3-cc26676e702e could not be found. Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Request method failure captured: Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e HTTP/1.1 Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJkW_ncnKScJtxUpAzUJOO3lfmZUfVMk8u3M4rVCjF647d1iYtd7wlobF06IuJvkEmAPZV7p0vKfpKW9zsXfmIEwIEn0LXNO-YFXzggwhe1RX6ijLFCd04dgbtrP1Qfpqq5S7XA_FsjIVj7JtulU0y1bNRIm0iHZyslnLib2Q4vbErU Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 431409236f15444e85495d233664fff8 Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ListImageFiltersTestJSON-754380435 Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/431409236f15444e85495d233664fff8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/431409236f15444e85495d233664fff8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_431409236f15444e85495d233664fff8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/431409236f15444e85495d233664fff8"}]}] Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ListImageFiltersTestJSON-754380435 Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 431409236f15444e85495d233664fff8 Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-754380435 Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ListImageFiltersTestJSON-754380435-project Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d1dc27c611114996857a8c1ee7a573a6 Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ListImageFiltersTestJSON-754380435-project Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 1e128c38-7acd-43a8-b9a3-cc26676e702e could not be found. Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1e128c38-7acd-43a8-b9a3-cc26676e702e'} Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e128c38-7acd-43a8-b9a3-cc26676e702e could not be found. Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e128c38-7acd-43a8-b9a3-cc26676e702e could not be found. Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:27.080870 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:27.086202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:27.086202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:27.086202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:27.086202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:10:27.086202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:10:27.086202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e128c38-7acd-43a8-b9a3-cc26676e702e could not be found. Oct 29 03:10:27.086202 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:27.089860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Returning 404 to user: Instance 1e128c38-7acd-43a8-b9a3-cc26676e702e could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:10:27.091657 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8dabd300-ac58-455a-932e-06b956645b25 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e" status: 404 len: 111 microversion: 2.1 time: 0.060779 Oct 29 03:10:27.097156 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2783/5584] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:27 2022] GET /compute/v2.1/servers/1e128c38-7acd-43a8-b9a3-cc26676e702e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:27.100692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1e98d896-15db-4982-b159-d9a1236cfd76 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:27.101359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1e98d896-15db-4982-b159-d9a1236cfd76 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:27.116773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e98d896-15db-4982-b159-d9a1236cfd76 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.117594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e98d896-15db-4982-b159-d9a1236cfd76 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.119435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e98d896-15db-4982-b159-d9a1236cfd76 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:27.120173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e98d896-15db-4982-b159-d9a1236cfd76 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.122207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e98d896-15db-4982-b159-d9a1236cfd76 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.122666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e98d896-15db-4982-b159-d9a1236cfd76 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:27.182248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1e98d896-15db-4982-b159-d9a1236cfd76 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:10:27.388798 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1e98d896-15db-4982-b159-d9a1236cfd76 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 204 len: 0 microversion: 2.1 time: 0.289266 Oct 29 03:10:27.392505 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2802/5585] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:10:27 2022] DELETE /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:10:27.406287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ebf24010-0d3f-4144-96d8-a63d25983e89 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:27.407949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ebf24010-0d3f-4144-96d8-a63d25983e89 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:27.423259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf24010-0d3f-4144-96d8-a63d25983e89 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.434312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf24010-0d3f-4144-96d8-a63d25983e89 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.434784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf24010-0d3f-4144-96d8-a63d25983e89 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:27.435716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf24010-0d3f-4144-96d8-a63d25983e89 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.436187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf24010-0d3f-4144-96d8-a63d25983e89 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.437014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ebf24010-0d3f-4144-96d8-a63d25983e89 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:27.484893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a759a1d3-defb-40b8-82fe-39c9b5aa3648 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:27.485696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a759a1d3-defb-40b8-82fe-39c9b5aa3648 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:27.497915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a759a1d3-defb-40b8-82fe-39c9b5aa3648 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.499201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a759a1d3-defb-40b8-82fe-39c9b5aa3648 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.499732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a759a1d3-defb-40b8-82fe-39c9b5aa3648 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:27.500809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a759a1d3-defb-40b8-82fe-39c9b5aa3648 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.502512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a759a1d3-defb-40b8-82fe-39c9b5aa3648 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.503009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a759a1d3-defb-40b8-82fe-39c9b5aa3648 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:27.674728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ebf24010-0d3f-4144-96d8-a63d25983e89 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:27.688626 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ebf24010-0d3f-4144-96d8-a63d25983e89 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 200 len: 1474 microversion: 2.1 time: 0.291127 Oct 29 03:10:27.692876 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2784/5586] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:27 2022] GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 1474 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:27.945042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:27.945734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 6fdf9998-e29c-42b9-9f11-0ee63dd05901] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:27.956430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.958103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.958554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:27.966516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.967030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.967471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:28.000920 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] HTTP exception thrown: Instance 6fdf9998-e29c-42b9-9f11-0ee63dd05901 could not be found. Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Request method failure captured: Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 HTTP/1.1 Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJeSr1oL0rONYcv9CfxIanIPbUeGw-s2Wl4VNA9GEpVCgEE4OiCenlJFf66TiN_-nkeJklfReLoMTtrJ83D7xezyaNkFbwK0U16CX_E0dK0DTvVDkg1lOik0BLuL1_K7VtLlWIKuOhFwA62qqiC9Oq-KCZnYhWwKlrztnOyVOmkou8Q Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d4193e4464b7488b9b3bb4064afb0288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}] Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: dc4e17d222e0426698d1ef9a17921d64 Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 6fdf9998-e29c-42b9-9f11-0ee63dd05901 could not be found. Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '6fdf9998-e29c-42b9-9f11-0ee63dd05901'} Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fdf9998-e29c-42b9-9f11-0ee63dd05901 could not be found. Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fdf9998-e29c-42b9-9f11-0ee63dd05901 could not be found. Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:28.002519 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:28.008485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:28.008485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:28.008485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:28.008485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:10:28.008485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:10:28.008485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fdf9998-e29c-42b9-9f11-0ee63dd05901 could not be found. Oct 29 03:10:28.008485 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:28.008485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Returning 404 to user: Instance 6fdf9998-e29c-42b9-9f11-0ee63dd05901 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:10:28.008485 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1bb034ee-6f0c-4554-a6f2-38d88af8c944 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901" status: 404 len: 111 microversion: 2.1 time: 0.063390 Oct 29 03:10:28.008485 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2785/5587] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:27 2022] GET /compute/v2.1/servers/6fdf9998-e29c-42b9-9f11-0ee63dd05901 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:10:28.013780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-40ef7b1f-70e8-4829-9b6f-9d4bbbd789e3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:28.014304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-40ef7b1f-70e8-4829-9b6f-9d4bbbd789e3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:28.025108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40ef7b1f-70e8-4829-9b6f-9d4bbbd789e3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:28.025605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40ef7b1f-70e8-4829-9b6f-9d4bbbd789e3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:28.026061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40ef7b1f-70e8-4829-9b6f-9d4bbbd789e3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:28.026967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40ef7b1f-70e8-4829-9b6f-9d4bbbd789e3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:28.036180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40ef7b1f-70e8-4829-9b6f-9d4bbbd789e3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:28.036955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40ef7b1f-70e8-4829-9b6f-9d4bbbd789e3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:28.096357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-40ef7b1f-70e8-4829-9b6f-9d4bbbd789e3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:10:28.209610 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-40ef7b1f-70e8-4829-9b6f-9d4bbbd789e3 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 204 len: 0 microversion: 2.1 time: 0.200052 Oct 29 03:10:28.214000 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2786/5588] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:10:28 2022] DELETE /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:28.219887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bbc99365-f9a4-4c20-9f1b-842851781fa7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:28.220592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bbc99365-f9a4-4c20-9f1b-842851781fa7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:28.227683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc99365-f9a4-4c20-9f1b-842851781fa7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:28.228411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc99365-f9a4-4c20-9f1b-842851781fa7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:28.229470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc99365-f9a4-4c20-9f1b-842851781fa7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:28.230593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc99365-f9a4-4c20-9f1b-842851781fa7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:28.231345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc99365-f9a4-4c20-9f1b-842851781fa7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:28.231934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bbc99365-f9a4-4c20-9f1b-842851781fa7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:28.463784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a759a1d3-defb-40b8-82fe-39c9b5aa3648 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:28.465544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bbc99365-f9a4-4c20-9f1b-842851781fa7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:28.475868 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a759a1d3-defb-40b8-82fe-39c9b5aa3648 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.996034 Oct 29 03:10:28.479863 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2803/5589] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:27 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:28.482670 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bbc99365-f9a4-4c20-9f1b-842851781fa7 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1495 microversion: 2.1 time: 0.267282 Oct 29 03:10:28.485307 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2787/5590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:28 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1495 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:28.716688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40e2bffd-39a8-4559-a81a-0c90010559f3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:28.717185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40e2bffd-39a8-4559-a81a-0c90010559f3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:28.736567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e2bffd-39a8-4559-a81a-0c90010559f3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:28.737036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e2bffd-39a8-4559-a81a-0c90010559f3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:28.737531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e2bffd-39a8-4559-a81a-0c90010559f3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:28.738204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e2bffd-39a8-4559-a81a-0c90010559f3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:28.739086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e2bffd-39a8-4559-a81a-0c90010559f3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:28.739673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e2bffd-39a8-4559-a81a-0c90010559f3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.152465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40e2bffd-39a8-4559-a81a-0c90010559f3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:29.164207 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40e2bffd-39a8-4559-a81a-0c90010559f3 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 200 len: 1474 microversion: 2.1 time: 0.451278 Oct 29 03:10:29.165591 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2804/5591] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:28 2022] GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 1474 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:29.497522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-bdb7d2bf-9004-42ee-9680-42067debb8de req-dc131f50-46e1-4f63-b538-6ecf3e9a2dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd82f16-b3c9-4acb-bfec-cae607467d9f", "name": "network-vif-deleted", "tag": "3f06b1c1-7ce1-4a4c-92b7-f3356b842207"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:29.511402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5adc17eb-e555-43b8-974e-0cbfafc8d058 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:29.512799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5adc17eb-e555-43b8-974e-0cbfafc8d058 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:29.545491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bdb7d2bf-9004-42ee-9680-42067debb8de req-dc131f50-46e1-4f63-b538-6ecf3e9a2dc0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.547985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adc17eb-e555-43b8-974e-0cbfafc8d058 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.549204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adc17eb-e555-43b8-974e-0cbfafc8d058 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.558604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adc17eb-e555-43b8-974e-0cbfafc8d058 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.561693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adc17eb-e555-43b8-974e-0cbfafc8d058 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.562954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adc17eb-e555-43b8-974e-0cbfafc8d058 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.563636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5adc17eb-e555-43b8-974e-0cbfafc8d058 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.564795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bdb7d2bf-9004-42ee-9680-42067debb8de req-dc131f50-46e1-4f63-b538-6ecf3e9a2dc0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.565276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bdb7d2bf-9004-42ee-9680-42067debb8de req-dc131f50-46e1-4f63-b538-6ecf3e9a2dc0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.576900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:29.604160 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-bdb7d2bf-9004-42ee-9680-42067debb8de req-dc131f50-46e1-4f63-b538-6ecf3e9a2dc0 service nova] Creating event network-vif-deleted:3f06b1c1-7ce1-4a4c-92b7-f3356b842207 for instance 1cd82f16-b3c9-4acb-bfec-cae607467d9f on n-h1-862964-4 Oct 29 03:10:29.610567 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-bdb7d2bf-9004-42ee-9680-42067debb8de req-dc131f50-46e1-4f63-b538-6ecf3e9a2dc0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118293 Oct 29 03:10:29.612618 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2788/5592] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:29.632984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:29.634301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:29.647420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.648214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.648663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.649376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.649885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.650317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.709034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.709918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.710800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.711453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lazy-loading 'fault' on Instance uuid 1cd82f16-b3c9-4acb-bfec-cae607467d9f {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:10:29.780443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:29.794165 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8873fa3f-d475-44fa-b178-bd88c91a09bf tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 200 len: 1304 microversion: 2.1 time: 0.178309 Oct 29 03:10:29.795163 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2789/5593] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:29 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 1304 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:30.144199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5adc17eb-e555-43b8-974e-0cbfafc8d058 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:30.156142 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5adc17eb-e555-43b8-974e-0cbfafc8d058 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.649157 Oct 29 03:10:30.157693 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2805/5594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:29 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:30.190758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0a9172d8-f6cc-4583-9c15-d4e5863e3c05 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:30.191933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0a9172d8-f6cc-4583-9c15-d4e5863e3c05 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:30.201083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a9172d8-f6cc-4583-9c15-d4e5863e3c05 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:30.202885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a9172d8-f6cc-4583-9c15-d4e5863e3c05 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:30.204520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a9172d8-f6cc-4583-9c15-d4e5863e3c05 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:30.207515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a9172d8-f6cc-4583-9c15-d4e5863e3c05 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:30.208486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a9172d8-f6cc-4583-9c15-d4e5863e3c05 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:30.209233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a9172d8-f6cc-4583-9c15-d4e5863e3c05 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:30.410753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0a9172d8-f6cc-4583-9c15-d4e5863e3c05 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:30.421940 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0a9172d8-f6cc-4583-9c15-d4e5863e3c05 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 200 len: 1474 microversion: 2.1 time: 0.236204 Oct 29 03:10:30.422971 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2790/5595] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:30 2022] GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 1474 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:30.822342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:30.822961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 1cd82f16-b3c9-4acb-bfec-cae607467d9f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:30.832155 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:10:30.833650 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:10:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f (ip 10.222.0.16) !!! Oct 29 03:10:30.838508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:30.840059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:30.841769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:30.846126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:30.846889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:30.848671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:30.878953 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] HTTP exception thrown: Instance 1cd82f16-b3c9-4acb-bfec-cae607467d9f could not be found. Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Request method failure captured: Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f HTTP/1.1 Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJeSr1oL0rONYcv9CfxIanIPbUeGw-s2Wl4VNA9GEpVCgEE4OiCenlJFf66TiN_-nkeJklfReLoMTtrJ83D7xezyaNkFbwK0U16CX_E0dK0DTvVDkg1lOik0BLuL1_K7VtLlWIKuOhFwA62qqiC9Oq-KCZnYhWwKlrztnOyVOmkou8Q Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d4193e4464b7488b9b3bb4064afb0288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}] Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: dc4e17d222e0426698d1ef9a17921d64 Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1cd82f16-b3c9-4acb-bfec-cae607467d9f could not be found. Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1cd82f16-b3c9-4acb-bfec-cae607467d9f'} Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd82f16-b3c9-4acb-bfec-cae607467d9f could not be found. Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd82f16-b3c9-4acb-bfec-cae607467d9f could not be found. Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:30.888250 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:30.892969 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:30.892969 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:30.892969 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:30.892969 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:10:30.892969 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:10:30.892969 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd82f16-b3c9-4acb-bfec-cae607467d9f could not be found. Oct 29 03:10:30.892969 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:30.897430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Returning 404 to user: Instance 1cd82f16-b3c9-4acb-bfec-cae607467d9f could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:10:30.899946 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e30c5394-46ff-4fab-9506-213541c5fd73 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f" status: 404 len: 111 microversion: 2.1 time: 0.082354 Oct 29 03:10:30.904885 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2806/5596] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:30 2022] GET /compute/v2.1/servers/1cd82f16-b3c9-4acb-bfec-cae607467d9f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:30.909781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c4ae962b-c888-4f2b-9fb9-64f21a6c4668 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:30.910486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c4ae962b-c888-4f2b-9fb9-64f21a6c4668 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:30.921129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4ae962b-c888-4f2b-9fb9-64f21a6c4668 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:30.921623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4ae962b-c888-4f2b-9fb9-64f21a6c4668 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:30.922081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4ae962b-c888-4f2b-9fb9-64f21a6c4668 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:30.922792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4ae962b-c888-4f2b-9fb9-64f21a6c4668 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:30.923243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4ae962b-c888-4f2b-9fb9-64f21a6c4668 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:30.923661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c4ae962b-c888-4f2b-9fb9-64f21a6c4668 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:30.957301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c4ae962b-c888-4f2b-9fb9-64f21a6c4668 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:10:31.097098 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c4ae962b-c888-4f2b-9fb9-64f21a6c4668 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "DELETE /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 204 len: 0 microversion: 2.1 time: 0.190512 Oct 29 03:10:31.098251 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2791/5597] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:10:30 2022] DELETE /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:10:31.107010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f59f12e-cea5-4a25-aa51-9ab7c244579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:31.107625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1f59f12e-cea5-4a25-aa51-9ab7c244579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:31.117606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f59f12e-cea5-4a25-aa51-9ab7c244579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:31.123619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f59f12e-cea5-4a25-aa51-9ab7c244579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:31.124070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f59f12e-cea5-4a25-aa51-9ab7c244579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:31.124824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f59f12e-cea5-4a25-aa51-9ab7c244579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:31.125279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f59f12e-cea5-4a25-aa51-9ab7c244579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:31.125705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f59f12e-cea5-4a25-aa51-9ab7c244579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:31.186708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb3bdd72-796f-4904-a46c-c5cb30144a12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:31.188028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eb3bdd72-796f-4904-a46c-c5cb30144a12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:31.198028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb3bdd72-796f-4904-a46c-c5cb30144a12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:31.199048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb3bdd72-796f-4904-a46c-c5cb30144a12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:31.199945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb3bdd72-796f-4904-a46c-c5cb30144a12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:31.202056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb3bdd72-796f-4904-a46c-c5cb30144a12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:31.203019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb3bdd72-796f-4904-a46c-c5cb30144a12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:31.203607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb3bdd72-796f-4904-a46c-c5cb30144a12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:31.409227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eb3bdd72-796f-4904-a46c-c5cb30144a12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:31.420502 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eb3bdd72-796f-4904-a46c-c5cb30144a12 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.243509 Oct 29 03:10:31.435156 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2792/5598] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:31 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:31.457870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1cdaf62e-5275-484e-a6ea-3d1c172368a8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:31.458908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1cdaf62e-5275-484e-a6ea-3d1c172368a8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:31.469604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cdaf62e-5275-484e-a6ea-3d1c172368a8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:31.470552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cdaf62e-5275-484e-a6ea-3d1c172368a8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:31.471455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cdaf62e-5275-484e-a6ea-3d1c172368a8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:31.472502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cdaf62e-5275-484e-a6ea-3d1c172368a8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:31.473181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cdaf62e-5275-484e-a6ea-3d1c172368a8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:31.473881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1cdaf62e-5275-484e-a6ea-3d1c172368a8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:31.479578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:31.736890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1cdaf62e-5275-484e-a6ea-3d1c172368a8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1dc27c611114996857a8c1ee7a573a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431409236f15444e85495d233664fff8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:31.750128 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1cdaf62e-5275-484e-a6ea-3d1c172368a8 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 200 len: 1474 microversion: 2.1 time: 0.303371 Oct 29 03:10:31.750779 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2793/5599] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:31 2022] GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 1474 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:32.021229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1f59f12e-cea5-4a25-aa51-9ab7c244579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:32.033302 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1f59f12e-cea5-4a25-aa51-9ab7c244579d tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1676 microversion: 2.1 time: 0.929117 Oct 29 03:10:32.047778 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2807/5600] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:31 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1676 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:32.055093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-faef4efe-635b-461c-8a12-614619d62696 req-b5a6766e-25f3-4708-9a57-14ba2c046375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87ccf8a-8236-4a31-ad90-4805b875a1c1", "name": "network-vif-deleted", "tag": "e064d394-4cc8-46e7-ab41-6664c7bdbce0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:32.088435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-faef4efe-635b-461c-8a12-614619d62696 req-b5a6766e-25f3-4708-9a57-14ba2c046375 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:32.088915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-faef4efe-635b-461c-8a12-614619d62696 req-b5a6766e-25f3-4708-9a57-14ba2c046375 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:32.089770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-faef4efe-635b-461c-8a12-614619d62696 req-b5a6766e-25f3-4708-9a57-14ba2c046375 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:32.110391 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-faef4efe-635b-461c-8a12-614619d62696 req-b5a6766e-25f3-4708-9a57-14ba2c046375 service nova] Creating event network-vif-deleted:e064d394-4cc8-46e7-ab41-6664c7bdbce0 for instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 on n-h2-862964-4 Oct 29 03:10:32.117091 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-faef4efe-635b-461c-8a12-614619d62696 req-b5a6766e-25f3-4708-9a57-14ba2c046375 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067922 Oct 29 03:10:32.118786 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2794/5601] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:10:32.450565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-faa8533e-bb1d-404b-beb5-4acdab1c5a64 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:32.451275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-faa8533e-bb1d-404b-beb5-4acdab1c5a64 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:32.458336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:32.464420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faa8533e-bb1d-404b-beb5-4acdab1c5a64 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:32.465508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faa8533e-bb1d-404b-beb5-4acdab1c5a64 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:32.466227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faa8533e-bb1d-404b-beb5-4acdab1c5a64 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:32.467566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faa8533e-bb1d-404b-beb5-4acdab1c5a64 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:32.468579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faa8533e-bb1d-404b-beb5-4acdab1c5a64 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:32.469295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faa8533e-bb1d-404b-beb5-4acdab1c5a64 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:32.781931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:32.782680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] [instance: a87ccf8a-8236-4a31-ad90-4805b875a1c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:32.800420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:32.801202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:32.801823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:32.802754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:32.803638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:32.804316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:32.840774 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] HTTP exception thrown: Instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 could not be found. Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Request method failure captured: Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 HTTP/1.1 Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJkW_ncnKScJtxUpAzUJOO3lfmZUfVMk8u3M4rVCjF647d1iYtd7wlobF06IuJvkEmAPZV7p0vKfpKW9zsXfmIEwIEn0LXNO-YFXzggwhe1RX6ijLFCd04dgbtrP1Qfpqq5S7XA_FsjIVj7JtulU0y1bNRIm0iHZyslnLib2Q4vbErU Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 431409236f15444e85495d233664fff8 Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ListImageFiltersTestJSON-754380435 Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/431409236f15444e85495d233664fff8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/431409236f15444e85495d233664fff8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_431409236f15444e85495d233664fff8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/431409236f15444e85495d233664fff8"}]}] Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ListImageFiltersTestJSON-754380435 Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 431409236f15444e85495d233664fff8 Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-754380435 Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ListImageFiltersTestJSON-754380435-project Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d1dc27c611114996857a8c1ee7a573a6 Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ListImageFiltersTestJSON-754380435-project Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 could not be found. Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'a87ccf8a-8236-4a31-ad90-4805b875a1c1'} Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 could not be found. Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 could not be found. Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:32.843013 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:32.847775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:32.847775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:32.847775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:32.847775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:10:32.847775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:10:32.847775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 could not be found. Oct 29 03:10:32.847775 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:10:32.847775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Returning 404 to user: Instance a87ccf8a-8236-4a31-ad90-4805b875a1c1 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:10:32.847775 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a572c927-6433-4dd2-88d2-e623ed9509af tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1" status: 404 len: 111 microversion: 2.1 time: 0.074743 Oct 29 03:10:32.847775 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2795/5602] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:32 2022] GET /compute/v2.1/servers/a87ccf8a-8236-4a31-ad90-4805b875a1c1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:32.862432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e953aefd-c2a1-4bc7-a7cd-f4d76762349f tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3919040>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:32.876693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-faa8533e-bb1d-404b-beb5-4acdab1c5a64 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:32.898526 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-faa8533e-bb1d-404b-beb5-4acdab1c5a64 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.455106 Oct 29 03:10:32.899550 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2808/5603] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:32 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:33.064837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6659fcb2-99f3-4833-b197-251aeb707784 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:33.067691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6659fcb2-99f3-4833-b197-251aeb707784 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:33.079299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6659fcb2-99f3-4833-b197-251aeb707784 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:33.081286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6659fcb2-99f3-4833-b197-251aeb707784 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:33.082234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6659fcb2-99f3-4833-b197-251aeb707784 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:33.083524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6659fcb2-99f3-4833-b197-251aeb707784 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:33.085021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6659fcb2-99f3-4833-b197-251aeb707784 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:33.086028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6659fcb2-99f3-4833-b197-251aeb707784 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:33.458907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6659fcb2-99f3-4833-b197-251aeb707784 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:33.487124 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6659fcb2-99f3-4833-b197-251aeb707784 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1676 microversion: 2.1 time: 0.428948 Oct 29 03:10:33.493892 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2809/5604] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:33 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1676 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:33.578331 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e953aefd-c2a1-4bc7-a7cd-f4d76762349f tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "DELETE /compute/v2.1/images/8c6dc413-f071-4d30-a81f-69766c9c78c3" status: 204 len: 0 microversion: 2.1 time: 0.722399 Oct 29 03:10:33.582516 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2796/5605] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:32 2022] DELETE /compute/v2.1/images/8c6dc413-f071-4d30-a81f-69766c9c78c3 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:33.589611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6754b01-e346-4b03-8d3e-55832728e29e tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a32d0b80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:33.933337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-182e598f-cdf6-40bf-982b-95b381ec4993 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:33.934179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-182e598f-cdf6-40bf-982b-95b381ec4993 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:33.973645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182e598f-cdf6-40bf-982b-95b381ec4993 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:33.974210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182e598f-cdf6-40bf-982b-95b381ec4993 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:33.974608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182e598f-cdf6-40bf-982b-95b381ec4993 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:33.977196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182e598f-cdf6-40bf-982b-95b381ec4993 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:33.977937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182e598f-cdf6-40bf-982b-95b381ec4993 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:33.978948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-182e598f-cdf6-40bf-982b-95b381ec4993 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:34.081512 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c6754b01-e346-4b03-8d3e-55832728e29e tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "DELETE /compute/v2.1/images/d5fc0698-4832-48bd-a41d-39fe00fd1111" status: 204 len: 0 microversion: 2.1 time: 0.496756 Oct 29 03:10:34.082456 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2810/5606] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:33 2022] DELETE /compute/v2.1/images/d5fc0698-4832-48bd-a41d-39fe00fd1111 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:34.091047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-50e4e109-ddb8-45ca-9978-953c5a10ada5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] Calling method '.version_select at 0x7fe1a3312d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:34.429034 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-50e4e109-ddb8-45ca-9978-953c5a10ada5 tempest-ListImageFiltersTestJSON-754380435 tempest-ListImageFiltersTestJSON-754380435-project] 10.222.0.16 "DELETE /compute/v2.1/images/e05761a2-07fa-41b1-846e-3c9d6ce0904f" status: 204 len: 0 microversion: 2.1 time: 0.341629 Oct 29 03:10:34.429633 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2811/5607] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:34 2022] DELETE /compute/v2.1/images/e05761a2-07fa-41b1-846e-3c9d6ce0904f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:34.512075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a0d6c799-47e3-4099-8f2c-52ef96d43c78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:34.512978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a0d6c799-47e3-4099-8f2c-52ef96d43c78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:34.519330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0d6c799-47e3-4099-8f2c-52ef96d43c78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:34.520078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0d6c799-47e3-4099-8f2c-52ef96d43c78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:34.520681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0d6c799-47e3-4099-8f2c-52ef96d43c78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:34.521556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0d6c799-47e3-4099-8f2c-52ef96d43c78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:34.522315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0d6c799-47e3-4099-8f2c-52ef96d43c78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:34.523172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0d6c799-47e3-4099-8f2c-52ef96d43c78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:34.716767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a0d6c799-47e3-4099-8f2c-52ef96d43c78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:34.730995 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a0d6c799-47e3-4099-8f2c-52ef96d43c78 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1676 microversion: 2.1 time: 0.222734 Oct 29 03:10:34.733465 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2812/5608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:34 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:34.828632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-182e598f-cdf6-40bf-982b-95b381ec4993 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:34.839879 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-182e598f-cdf6-40bf-982b-95b381ec4993 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.916656 Oct 29 03:10:34.840465 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2797/5609] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:33 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:35.758306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90c691af-51ec-4032-95cc-8eaf12389716 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:35.758908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-90c691af-51ec-4032-95cc-8eaf12389716 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:35.781841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c691af-51ec-4032-95cc-8eaf12389716 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:35.782400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c691af-51ec-4032-95cc-8eaf12389716 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:35.782776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c691af-51ec-4032-95cc-8eaf12389716 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:35.783476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c691af-51ec-4032-95cc-8eaf12389716 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:35.792636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c9559c16-873b-4789-8a18-84b93c46f1cc req-18698c20-4052-46c2-9d47-d9dcea6f5ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e7e466-df5f-45f5-9e45-dc3c16e888b7", "name": "network-vif-deleted", "tag": "4f85a0f7-faab-45b5-be06-7a79452c31af"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:35.805398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c691af-51ec-4032-95cc-8eaf12389716 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:35.809194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90c691af-51ec-4032-95cc-8eaf12389716 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:35.827817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c9559c16-873b-4789-8a18-84b93c46f1cc req-18698c20-4052-46c2-9d47-d9dcea6f5ab8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:35.839276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c9559c16-873b-4789-8a18-84b93c46f1cc req-18698c20-4052-46c2-9d47-d9dcea6f5ab8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:35.840906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c9559c16-873b-4789-8a18-84b93c46f1cc req-18698c20-4052-46c2-9d47-d9dcea6f5ab8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:35.882979 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c9559c16-873b-4789-8a18-84b93c46f1cc req-18698c20-4052-46c2-9d47-d9dcea6f5ab8 service nova] Creating event network-vif-deleted:4f85a0f7-faab-45b5-be06-7a79452c31af for instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 on n-h1-862964-4 Oct 29 03:10:35.895923 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c9559c16-873b-4789-8a18-84b93c46f1cc req-18698c20-4052-46c2-9d47-d9dcea6f5ab8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106270 Oct 29 03:10:35.898140 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2798/5610] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:10:35.909715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b8dba96a-00f9-453e-8003-fa93d0f62eba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:35.911500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b8dba96a-00f9-453e-8003-fa93d0f62eba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:35.923355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8dba96a-00f9-453e-8003-fa93d0f62eba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:35.924114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8dba96a-00f9-453e-8003-fa93d0f62eba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:35.924553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8dba96a-00f9-453e-8003-fa93d0f62eba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:35.925477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8dba96a-00f9-453e-8003-fa93d0f62eba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:35.926085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8dba96a-00f9-453e-8003-fa93d0f62eba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:35.926555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b8dba96a-00f9-453e-8003-fa93d0f62eba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:36.241869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b8dba96a-00f9-453e-8003-fa93d0f62eba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:36.254737 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b8dba96a-00f9-453e-8003-fa93d0f62eba tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.354952 Oct 29 03:10:36.255811 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2799/5611] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:35 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:36.644415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-90c691af-51ec-4032-95cc-8eaf12389716 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e17d222e0426698d1ef9a17921d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4193e4464b7488b9b3bb4064afb0288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:36.659760 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90c691af-51ec-4032-95cc-8eaf12389716 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 200 len: 1608 microversion: 2.1 time: 0.903084 Oct 29 03:10:36.661557 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2813/5612] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:35 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 1608 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:37.280676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e7db476b-d2cc-446a-a623-db4e24788530 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:37.281289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e7db476b-d2cc-446a-a623-db4e24788530 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:37.284246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:37.295041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7db476b-d2cc-446a-a623-db4e24788530 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:37.296772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7db476b-d2cc-446a-a623-db4e24788530 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:37.300026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7db476b-d2cc-446a-a623-db4e24788530 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:37.301001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7db476b-d2cc-446a-a623-db4e24788530 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:37.301621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7db476b-d2cc-446a-a623-db4e24788530 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:37.302290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7db476b-d2cc-446a-a623-db4e24788530 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:37.866429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6883f5e3-4131-4fbd-a2fe-c80182918593 tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Calling method '.version_select at 0x7fe1a3333ca0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:37.885308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6883f5e3-4131-4fbd-a2fe-c80182918593 tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:37.887425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6883f5e3-4131-4fbd-a2fe-c80182918593 tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:37.888057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6883f5e3-4131-4fbd-a2fe-c80182918593 tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:37.889000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6883f5e3-4131-4fbd-a2fe-c80182918593 tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:37.889636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6883f5e3-4131-4fbd-a2fe-c80182918593 tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:37.890445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6883f5e3-4131-4fbd-a2fe-c80182918593 tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:37.928668 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6883f5e3-4131-4fbd-a2fe-c80182918593 tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.289507 Oct 29 03:10:37.934182 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2814/5613] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:37 2022] GET /compute/v2.1/limits => generated 511 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:37.941169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:37.941961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] [instance: 72e7e466-df5f-45f5-9e45-dc3c16e888b7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:37.948725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:37.949548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:37.950222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:37.951158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:37.951775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:37.952361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:37.972312 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] HTTP exception thrown: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 could not be found. Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Request method failure captured: Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 HTTP/1.1 Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJeSr1oL0rONYcv9CfxIanIPbUeGw-s2Wl4VNA9GEpVCgEE4OiCenlJFf66TiN_-nkeJklfReLoMTtrJ83D7xezyaNkFbwK0U16CX_E0dK0DTvVDkg1lOik0BLuL1_K7VtLlWIKuOhFwA62qqiC9Oq-KCZnYhWwKlrztnOyVOmkou8Q Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d4193e4464b7488b9b3bb4064afb0288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4193e4464b7488b9b3bb4064afb0288"}]}] Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: d4193e4464b7488b9b3bb4064afb0288 Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerActionsTestJSON-1516121526 Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: dc4e17d222e0426698d1ef9a17921d64 Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerActionsTestJSON-1516121526-project Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 could not be found. Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '72e7e466-df5f-45f5-9e45-dc3c16e888b7'} Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 could not be found. Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 could not be found. Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:37.974030 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:37.979975 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:37.979975 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:37.979975 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:37.979975 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:10:37.979975 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:10:37.979975 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 could not be found. Oct 29 03:10:37.979975 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:37.979975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Returning 404 to user: Instance 72e7e466-df5f-45f5-9e45-dc3c16e888b7 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:10:37.979975 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-009de79a-ad1c-4598-a208-7b915b079056 tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7" status: 404 len: 111 microversion: 2.1 time: 0.039328 Oct 29 03:10:37.982427 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2815/5614] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:37 2022] GET /compute/v2.1/servers/72e7e466-df5f-45f5-9e45-dc3c16e888b7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:37.984901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fc64d93b-9d4e-4644-9426-d77e38f67f6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] Calling method '.version_select at 0x7fe1aa92ff70>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:38.066951 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fc64d93b-9d4e-4644-9426-d77e38f67f6a tempest-ServerActionsTestJSON-1516121526 tempest-ServerActionsTestJSON-1516121526-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-745139463" status: 202 len: 0 microversion: 2.1 time: 0.085728 Oct 29 03:10:38.069308 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2816/5615] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 03:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-745139463 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:10:38.083367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be251b82-2e71-4284-a725-58985d0196cd tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-742633575", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:38.186107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-be251b82-2e71-4284-a725-58985d0196cd tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:10:38.347040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e7db476b-d2cc-446a-a623-db4e24788530 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:38.367900 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e7db476b-d2cc-446a-a623-db4e24788530 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 1.088396 Oct 29 03:10:38.369477 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2800/5616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:37 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:38.729249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-be251b82-2e71-4284-a725-58985d0196cd tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Getting quotas for project 3e8451f602c24cf5bea6f42dab290345. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:10:38.748418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-be251b82-2e71-4284-a725-58985d0196cd tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Getting quotas for user 0abfed1818be4d8fb042d536456c8e91 and project 3e8451f602c24cf5bea6f42dab290345. Resources: dict_keys(['metadata_items']) {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:10:38.778413 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-be251b82-2e71-4284-a725-58985d0196cd tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be251b82-2e71-4284-a725-58985d0196cd tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Request method failure captured: Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 1751 Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJmt73K9IUOVY3gurN5RpoZrAdD_d7YH1VRCwLVTZmXd1kOrkohKwCAbOjU5BVTguR6XW3ei6KiVWpf6qWuiT8wYXzpNTFs-EOmW-UF8vPzyi3LSfaz3XglxaxZn_oxYYFwwSyvL8mIHCrjCsijSJoPf6VxNuor5KqurMCdBaEAPH4k Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 3e8451f602c24cf5bea6f42dab290345 Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-614024556 Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e8451f602c24cf5bea6f42dab290345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e8451f602c24cf5bea6f42dab290345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e8451f602c24cf5bea6f42dab290345", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e8451f602c24cf5bea6f42dab290345"}]}] Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-614024556 Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 3e8451f602c24cf5bea6f42dab290345 Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-614024556 Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-614024556-project Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 0abfed1818be4d8fb042d536456c8e91 Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-614024556-project Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-742633575", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:10:38.781350 n-d-862964-4 devstack@n-api.service[127042]: exception: Maximum number of metadata items exceeds 128 Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-742633575', 'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:10:38.784188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 29 03:10:38.788659 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:10:38.792722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be251b82-2e71-4284-a725-58985d0196cd tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:10:38.792722 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be251b82-2e71-4284-a725-58985d0196cd tempest-AbsoluteLimitsNegativeTestJSON-614024556 tempest-AbsoluteLimitsNegativeTestJSON-614024556-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.721792 Oct 29 03:10:38.798408 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2817/5617] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Oct 29 03:10:38 2022] POST /compute/v2.1/servers => generated 87 bytes in 728 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:10:39.396033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1db2b5c5-57fd-4269-999d-3146fe054210 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:39.397312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1db2b5c5-57fd-4269-999d-3146fe054210 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:39.417667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1db2b5c5-57fd-4269-999d-3146fe054210 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:39.418177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1db2b5c5-57fd-4269-999d-3146fe054210 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:39.418634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1db2b5c5-57fd-4269-999d-3146fe054210 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:39.419331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1db2b5c5-57fd-4269-999d-3146fe054210 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:39.419804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1db2b5c5-57fd-4269-999d-3146fe054210 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:39.420217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1db2b5c5-57fd-4269-999d-3146fe054210 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:40.807549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1db2b5c5-57fd-4269-999d-3146fe054210 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:40.845933 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1db2b5c5-57fd-4269-999d-3146fe054210 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 1.454614 Oct 29 03:10:40.846541 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2801/5618] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:39 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:41.872205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6058dac1-b805-4714-aa76-2483d3686785 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:41.872820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6058dac1-b805-4714-aa76-2483d3686785 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:41.891488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6058dac1-b805-4714-aa76-2483d3686785 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:41.891982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6058dac1-b805-4714-aa76-2483d3686785 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:41.892416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6058dac1-b805-4714-aa76-2483d3686785 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:41.893130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6058dac1-b805-4714-aa76-2483d3686785 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:41.893586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6058dac1-b805-4714-aa76-2483d3686785 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:41.894069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6058dac1-b805-4714-aa76-2483d3686785 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:42.792886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6058dac1-b805-4714-aa76-2483d3686785 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:42.801884 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6058dac1-b805-4714-aa76-2483d3686785 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1723 microversion: 2.1 time: 0.933730 Oct 29 03:10:42.806912 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2818/5619] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:41 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1723 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:43.834627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6230c20b-6567-41e9-9715-9ffab0f170a2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:43.836050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6230c20b-6567-41e9-9715-9ffab0f170a2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:43.855027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6230c20b-6567-41e9-9715-9ffab0f170a2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:43.855974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6230c20b-6567-41e9-9715-9ffab0f170a2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:43.856510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6230c20b-6567-41e9-9715-9ffab0f170a2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:43.858342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6230c20b-6567-41e9-9715-9ffab0f170a2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:43.861483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6230c20b-6567-41e9-9715-9ffab0f170a2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:43.862847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6230c20b-6567-41e9-9715-9ffab0f170a2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:44.705595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6230c20b-6567-41e9-9715-9ffab0f170a2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:44.718241 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6230c20b-6567-41e9-9715-9ffab0f170a2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1700 microversion: 2.1 time: 0.888683 Oct 29 03:10:44.731749 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2802/5620] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:43 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1700 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:44.743799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7544e3a1-1268-477e-8af0-8cc473724760 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:44.761029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7544e3a1-1268-477e-8af0-8cc473724760 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:44.761529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7544e3a1-1268-477e-8af0-8cc473724760 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:44.761985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7544e3a1-1268-477e-8af0-8cc473724760 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:44.876639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7544e3a1-1268-477e-8af0-8cc473724760 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Going to try to start instance {{(pid=127042) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:10:44.985096 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7544e3a1-1268-477e-8af0-8cc473724760 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "POST /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/action" status: 202 len: 0 microversion: 2.1 time: 0.244199 Oct 29 03:10:44.987422 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2819/5621] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:10:44 2022] POST /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:10:44.998965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4872d7e9-9da5-4e68-bdfb-025a01cd8674 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:45.002345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4872d7e9-9da5-4e68-bdfb-025a01cd8674 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:45.013948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4872d7e9-9da5-4e68-bdfb-025a01cd8674 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:45.017408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4872d7e9-9da5-4e68-bdfb-025a01cd8674 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:45.017877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4872d7e9-9da5-4e68-bdfb-025a01cd8674 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:45.018875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4872d7e9-9da5-4e68-bdfb-025a01cd8674 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:45.019573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4872d7e9-9da5-4e68-bdfb-025a01cd8674 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:45.020196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4872d7e9-9da5-4e68-bdfb-025a01cd8674 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:46.404787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4872d7e9-9da5-4e68-bdfb-025a01cd8674 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:46.443521 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4872d7e9-9da5-4e68-bdfb-025a01cd8674 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1709 microversion: 2.1 time: 1.452523 Oct 29 03:10:46.444163 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2803/5622] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:44 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1709 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:47.472191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-03b4fdd5-d868-48d0-9450-ae9b1a3098d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:47.473057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-03b4fdd5-d868-48d0-9450-ae9b1a3098d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:47.485409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b4fdd5-d868-48d0-9450-ae9b1a3098d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:47.491279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b4fdd5-d868-48d0-9450-ae9b1a3098d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:47.491744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b4fdd5-d868-48d0-9450-ae9b1a3098d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:47.492821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b4fdd5-d868-48d0-9450-ae9b1a3098d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:47.493246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b4fdd5-d868-48d0-9450-ae9b1a3098d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:47.493681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03b4fdd5-d868-48d0-9450-ae9b1a3098d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:47.817101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-03b4fdd5-d868-48d0-9450-ae9b1a3098d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:47.831460 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-03b4fdd5-d868-48d0-9450-ae9b1a3098d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1709 microversion: 2.1 time: 0.362724 Oct 29 03:10:47.832971 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2820/5623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:47 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1709 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:48.859848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6f5e2d7a-2328-4624-baab-7a160b662043 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:48.860581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6f5e2d7a-2328-4624-baab-7a160b662043 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:48.874794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f5e2d7a-2328-4624-baab-7a160b662043 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:48.875615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f5e2d7a-2328-4624-baab-7a160b662043 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:48.876298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f5e2d7a-2328-4624-baab-7a160b662043 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:48.878674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f5e2d7a-2328-4624-baab-7a160b662043 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:48.880565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f5e2d7a-2328-4624-baab-7a160b662043 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:48.881467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f5e2d7a-2328-4624-baab-7a160b662043 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:50.301195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6f5e2d7a-2328-4624-baab-7a160b662043 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:50.318558 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6f5e2d7a-2328-4624-baab-7a160b662043 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1709 microversion: 2.1 time: 1.465554 Oct 29 03:10:50.338075 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2804/5624] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:48 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1709 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:51.348652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-128ae176-70e9-4f8e-9dbb-eb197b817860 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:51.349230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-128ae176-70e9-4f8e-9dbb-eb197b817860 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:51.351324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:51.355008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:51.383152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-128ae176-70e9-4f8e-9dbb-eb197b817860 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:51.383646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-128ae176-70e9-4f8e-9dbb-eb197b817860 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:51.384078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-128ae176-70e9-4f8e-9dbb-eb197b817860 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:51.384787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-128ae176-70e9-4f8e-9dbb-eb197b817860 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:51.385235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-128ae176-70e9-4f8e-9dbb-eb197b817860 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:51.385653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-128ae176-70e9-4f8e-9dbb-eb197b817860 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:51.998762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-128ae176-70e9-4f8e-9dbb-eb197b817860 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:52.015299 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-128ae176-70e9-4f8e-9dbb-eb197b817860 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1713 microversion: 2.1 time: 0.670787 Oct 29 03:10:52.018323 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2821/5625] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:51 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1713 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:02.025193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=9 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:02.026088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=53 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:02.307541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c1d2ab6-b160-4cef-aa73-43b2b076905e tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Calling method '.version_select at 0x7fe1a38d7c10>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:02.375011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-1c1d2ab6-b160-4cef-aa73-43b2b076905e tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a31ad37b-7f51-4439-ac19-63051efa1b4a does not exist", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 03:11:02.375608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.security_group_api [None req-1c1d2ab6-b160-4cef-aa73-43b2b076905e tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Neutron security group a31ad37b-7f51-4439-ac19-63051efa1b4a not found {{(pid=127041) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 03:11:02.376235 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-1c1d2ab6-b160-4cef-aa73-43b2b076905e tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] HTTP exception thrown: Security group a31ad37b-7f51-4439-ac19-63051efa1b4a does not exist Oct 29 03:11:02.376235 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-c071d1fa-57f1-46ae-88c3-6fc0e58d046c'] Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c1d2ab6-b160-4cef-aa73-43b2b076905e tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Request method failure captured: Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-security-groups/a31ad37b-7f51-4439-ac19-63051efa1b4a HTTP/1.1 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJnFMzj-uBvye4k4T_biwAK6DePGT4xn2_nhHZ1OqcNw6ZaFNX2G4ePiwhlwG73Gngk5s8bqzu4XzdgvDnmqpw8d8P62RkNZdWjItkQnvMEVlhniswTVQCv52L_VCoCE67dtEkLUwMW0DJj8fq6NYP_yB_5GNsKhyue00-uQfRU9kA0 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 50ec8b68206e47ff894b19726e829260 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50ec8b68206e47ff894b19726e829260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50ec8b68206e47ff894b19726e829260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50ec8b68206e47ff894b19726e829260", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50ec8b68206e47ff894b19726e829260"}]}] Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 50ec8b68206e47ff894b19726e829260 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupsNegativeTestJSON-1790904443-project Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 57ad9751505044e7a5e3a17d2da06fb7 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443-project Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: exception: Security group a31ad37b-7f51-4439-ac19-63051efa1b4a does not exist Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-c071d1fa-57f1-46ae-88c3-6fc0e58d046c'] Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'a31ad37b-7f51-4439-ac19-63051efa1b4a'} Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 03:11:02.378669 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a31ad37b-7f51-4439-ac19-63051efa1b4a does not exist Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c071d1fa-57f1-46ae-88c3-6fc0e58d046c'] Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a31ad37b-7f51-4439-ac19-63051efa1b4a does not exist Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c071d1fa-57f1-46ae-88c3-6fc0e58d046c'] Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a31ad37b-7f51-4439-ac19-63051efa1b4a does not exist Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c071d1fa-57f1-46ae-88c3-6fc0e58d046c'] Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a31ad37b-7f51-4439-ac19-63051efa1b4a does not exist Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c071d1fa-57f1-46ae-88c3-6fc0e58d046c'] Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c1d2ab6-b160-4cef-aa73-43b2b076905e tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Returning 404 to user: Security group a31ad37b-7f51-4439-ac19-63051efa1b4a does not exist Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-c071d1fa-57f1-46ae-88c3-6fc0e58d046c'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1c1d2ab6-b160-4cef-aa73-43b2b076905e tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a31ad37b-7f51-4439-ac19-63051efa1b4a" status: 404 len: 194 microversion: 2.1 time: 0.356575 Oct 29 03:11:02.383390 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2805/5626] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 03:11:02 2022] DELETE /compute/v2.1/os-security-groups/a31ad37b-7f51-4439-ac19-63051efa1b4a => generated 194 bytes in 359 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:11:02.392553 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3f7cea37-f61b-41ae-b17b-ecb5d49c5605 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004077 Oct 29 03:11:02.393343 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2822/5627] 10.222.0.16 () {58 vars in 1164 bytes} [Sat Oct 29 03:11:02 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 03:11:02.402900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-86426943-65c6-4099-8b14-b0a359420a12 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Calling method '.version_select at 0x7fe1acb19dc0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:02.870577 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-86426943-65c6-4099-8b14-b0a359420a12 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.472043 Oct 29 03:11:02.871355 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2806/5628] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 03:11:02 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:02.883828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:02.884884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:02.890281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6642b773-2667-4b7b-a64e-6f620e82853d tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Calling method '.version_select at 0x7fe1a346a310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:03.310891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG neutronclient.v2_0.client [None req-6642b773-2667-4b7b-a64e-6f620e82853d tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127042) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 03:11:03.311608 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-6642b773-2667-4b7b-a64e-6f620e82853d tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 29 03:11:03.311608 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-bf8bdabd-d098-4dbf-aeaa-28808ffdccd8'] Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6642b773-2667-4b7b-a64e-6f620e82853d tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Request method failure captured: Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-security-groups/cd63a7d7-03c3-4522-8a53-e7aa787725ed HTTP/1.1 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJnFMzj-uBvye4k4T_biwAK6DePGT4xn2_nhHZ1OqcNw6ZaFNX2G4ePiwhlwG73Gngk5s8bqzu4XzdgvDnmqpw8d8P62RkNZdWjItkQnvMEVlhniswTVQCv52L_VCoCE67dtEkLUwMW0DJj8fq6NYP_yB_5GNsKhyue00-uQfRU9kA0 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 50ec8b68206e47ff894b19726e829260 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50ec8b68206e47ff894b19726e829260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50ec8b68206e47ff894b19726e829260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50ec8b68206e47ff894b19726e829260", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50ec8b68206e47ff894b19726e829260"}]}] Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 50ec8b68206e47ff894b19726e829260 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsNegativeTestJSON-1790904443-project Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 57ad9751505044e7a5e3a17d2da06fb7 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443-project Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: exception: Insufficient rights for removing default security group. Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-bf8bdabd-d098-4dbf-aeaa-28808ffdccd8'] Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cd63a7d7-03c3-4522-8a53-e7aa787725ed'} Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 03:11:03.314711 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf8bdabd-d098-4dbf-aeaa-28808ffdccd8'] Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf8bdabd-d098-4dbf-aeaa-28808ffdccd8'] Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf8bdabd-d098-4dbf-aeaa-28808ffdccd8'] Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf8bdabd-d098-4dbf-aeaa-28808ffdccd8'] Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6642b773-2667-4b7b-a64e-6f620e82853d tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-bf8bdabd-d098-4dbf-aeaa-28808ffdccd8'] {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6642b773-2667-4b7b-a64e-6f620e82853d tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/cd63a7d7-03c3-4522-8a53-e7aa787725ed" status: 400 len: 182 microversion: 2.1 time: 0.435444 Oct 29 03:11:03.324302 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2823/5629] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 03:11:02 2022] DELETE /compute/v2.1/os-security-groups/cd63a7d7-03c3-4522-8a53-e7aa787725ed => generated 182 bytes in 437 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:11:03.332290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8280ed0c-9262-4391-b4ab-1a91bee35f38 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Calling method '.version_select at 0x7fe1a3937a60>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:03.412196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG neutronclient.v2_0.client [None req-8280ed0c-9262-4391-b4ab-1a91bee35f38 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d729d426-be61-49e8-ab67-c92307ff77f2 does not exist", "detail": ""}} {{(pid=127041) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 03:11:03.412878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.security_group_api [None req-8280ed0c-9262-4391-b4ab-1a91bee35f38 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Neutron security group d729d426-be61-49e8-ab67-c92307ff77f2 not found {{(pid=127041) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 03:11:03.413677 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-8280ed0c-9262-4391-b4ab-1a91bee35f38 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] HTTP exception thrown: Security group d729d426-be61-49e8-ab67-c92307ff77f2 does not exist Oct 29 03:11:03.413677 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-3d68ee01-cb36-4627-b19e-0f54f8364433'] Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8280ed0c-9262-4391-b4ab-1a91bee35f38 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Request method failure captured: Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-security-groups/d729d426-be61-49e8-ab67-c92307ff77f2 HTTP/1.1 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJnFMzj-uBvye4k4T_biwAK6DePGT4xn2_nhHZ1OqcNw6ZaFNX2G4ePiwhlwG73Gngk5s8bqzu4XzdgvDnmqpw8d8P62RkNZdWjItkQnvMEVlhniswTVQCv52L_VCoCE67dtEkLUwMW0DJj8fq6NYP_yB_5GNsKhyue00-uQfRU9kA0 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 50ec8b68206e47ff894b19726e829260 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50ec8b68206e47ff894b19726e829260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50ec8b68206e47ff894b19726e829260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50ec8b68206e47ff894b19726e829260", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50ec8b68206e47ff894b19726e829260"}]}] Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 50ec8b68206e47ff894b19726e829260 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-SecurityGroupsNegativeTestJSON-1790904443-project Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 57ad9751505044e7a5e3a17d2da06fb7 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443-project Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: exception: Security group d729d426-be61-49e8-ab67-c92307ff77f2 does not exist Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-3d68ee01-cb36-4627-b19e-0f54f8364433'] Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'd729d426-be61-49e8-ab67-c92307ff77f2'} Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 03:11:03.416539 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d729d426-be61-49e8-ab67-c92307ff77f2 does not exist Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d68ee01-cb36-4627-b19e-0f54f8364433'] Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d729d426-be61-49e8-ab67-c92307ff77f2 does not exist Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d68ee01-cb36-4627-b19e-0f54f8364433'] Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d729d426-be61-49e8-ab67-c92307ff77f2 does not exist Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d68ee01-cb36-4627-b19e-0f54f8364433'] Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d729d426-be61-49e8-ab67-c92307ff77f2 does not exist Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d68ee01-cb36-4627-b19e-0f54f8364433'] Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8280ed0c-9262-4391-b4ab-1a91bee35f38 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Returning 404 to user: Security group d729d426-be61-49e8-ab67-c92307ff77f2 does not exist Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: Neutron server returns request_ids: ['req-3d68ee01-cb36-4627-b19e-0f54f8364433'] {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:11:03.421659 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8280ed0c-9262-4391-b4ab-1a91bee35f38 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/d729d426-be61-49e8-ab67-c92307ff77f2" status: 404 len: 194 microversion: 2.1 time: 0.093187 Oct 29 03:11:03.430861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-29706b6e-2e29-4aa0-8b54-9725dd21fc76 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Action: 'update', calling method: .version_select at 0x7fe1a33f2670>, body: {"security_group": {"name": "tempest-sg-1497796255", "description": "tempest-description-1181293820"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:03.432479 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2807/5630] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 03:11:03 2022] GET /compute/v2.1/os-security-groups/d729d426-be61-49e8-ab67-c92307ff77f2 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:11:03.587826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG neutronclient.v2_0.client [None req-29706b6e-2e29-4aa0-8b54-9725dd21fc76 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be437239-6c56-4812-8556-a58d39493afd does not exist", "detail": ""}} {{(pid=127042) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 03:11:03.588524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.security_group_api [None req-29706b6e-2e29-4aa0-8b54-9725dd21fc76 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Neutron security group be437239-6c56-4812-8556-a58d39493afd not found {{(pid=127042) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 03:11:03.589330 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-29706b6e-2e29-4aa0-8b54-9725dd21fc76 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] HTTP exception thrown: Security group be437239-6c56-4812-8556-a58d39493afd does not exist Oct 29 03:11:03.589330 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-f981b745-4e96-4fd3-a483-7b26dfcd5e50'] Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-29706b6e-2e29-4aa0-8b54-9725dd21fc76 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Request method failure captured: Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: request: PUT /compute/v2.1/os-security-groups/be437239-6c56-4812-8556-a58d39493afd HTTP/1.1 Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 102 Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJnFMzj-uBvye4k4T_biwAK6DePGT4xn2_nhHZ1OqcNw6ZaFNX2G4ePiwhlwG73Gngk5s8bqzu4XzdgvDnmqpw8d8P62RkNZdWjItkQnvMEVlhniswTVQCv52L_VCoCE67dtEkLUwMW0DJj8fq6NYP_yB_5GNsKhyue00-uQfRU9kA0 Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 50ec8b68206e47ff894b19726e829260 Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50ec8b68206e47ff894b19726e829260"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50ec8b68206e47ff894b19726e829260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50ec8b68206e47ff894b19726e829260", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50ec8b68206e47ff894b19726e829260"}]}] Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 50ec8b68206e47ff894b19726e829260 Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443 Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-SecurityGroupsNegativeTestJSON-1790904443-project Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 57ad9751505044e7a5e3a17d2da06fb7 Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1790904443-project Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: {"security_group": {"name": "tempest-sg-1497796255", "description": "tempest-description-1181293820"}} Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: exception: Security group be437239-6c56-4812-8556-a58d39493afd does not exist Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-f981b745-4e96-4fd3-a483-7b26dfcd5e50'] Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'be437239-6c56-4812-8556-a58d39493afd', 'body': {'security_group': {'name': 'tempest-sg-1497796255', 'description': 'tempest-description-1181293820'}}} Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 03:11:03.591796 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be437239-6c56-4812-8556-a58d39493afd does not exist Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f981b745-4e96-4fd3-a483-7b26dfcd5e50'] Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be437239-6c56-4812-8556-a58d39493afd does not exist Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f981b745-4e96-4fd3-a483-7b26dfcd5e50'] Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be437239-6c56-4812-8556-a58d39493afd does not exist Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f981b745-4e96-4fd3-a483-7b26dfcd5e50'] Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be437239-6c56-4812-8556-a58d39493afd does not exist Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f981b745-4e96-4fd3-a483-7b26dfcd5e50'] Oct 29 03:11:03.596434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:11:03.604814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-29706b6e-2e29-4aa0-8b54-9725dd21fc76 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] Returning 404 to user: Security group be437239-6c56-4812-8556-a58d39493afd does not exist Oct 29 03:11:03.604814 n-d-862964-4 devstack@n-api.service[127042]: Neutron server returns request_ids: ['req-f981b745-4e96-4fd3-a483-7b26dfcd5e50'] {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:11:03.606033 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-29706b6e-2e29-4aa0-8b54-9725dd21fc76 tempest-SecurityGroupsNegativeTestJSON-1790904443 tempest-SecurityGroupsNegativeTestJSON-1790904443-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/be437239-6c56-4812-8556-a58d39493afd" status: 404 len: 194 microversion: 2.1 time: 0.180652 Oct 29 03:11:03.606913 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2824/5631] 10.222.0.16 () {60 vars in 1290 bytes} [Sat Oct 29 03:11:03 2022] PUT /compute/v2.1/os-security-groups/be437239-6c56-4812-8556-a58d39493afd => generated 194 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:11:18.484119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5e1904b2-06df-489c-bdbe-5e01a5ea6108 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] Action: 'create', calling method: .version_select at 0x7fe1a3937ee0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:18.504116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5e1904b2-06df-489c-bdbe-5e01a5ea6108 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] Getting quotas for project 38f9e1e21653406ebb6203c714551a02. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:18.511251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5e1904b2-06df-489c-bdbe-5e01a5ea6108 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] Getting quotas for user ec6f5c41ab1d4c2d90041c01efe8bc54 and project 38f9e1e21653406ebb6203c714551a02. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:18.570973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5e1904b2-06df-489c-bdbe-5e01a5ea6108 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] Getting quotas for project 38f9e1e21653406ebb6203c714551a02. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:18.580011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5e1904b2-06df-489c-bdbe-5e01a5ea6108 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] Getting quotas for user ec6f5c41ab1d4c2d90041c01efe8bc54 and project 38f9e1e21653406ebb6203c714551a02. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:18.595176 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5e1904b2-06df-489c-bdbe-5e01a5ea6108 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.375933 Oct 29 03:11:18.602539 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2808/5632] 10.222.0.16 () {62 vars in 1214 bytes} [Sat Oct 29 03:11:18 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:11:18.608005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2794511e-f81a-47e0-b3ed-43dda5fda909 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:18.626340 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2794511e-f81a-47e0-b3ed-43dda5fda909 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.021928 Oct 29 03:11:18.633918 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2825/5633] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Oct 29 03:11:18 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:11:18.639479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8aed548c-6981-40f6-9f61-19bb1b3d1f33 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:18.660764 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8aed548c-6981-40f6-9f61-19bb1b3d1f33 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/850de39f-9eb3-48c1-9f1a-9e6522c954c8" status: 200 len: 235 microversion: 2.64 time: 0.023524 Oct 29 03:11:18.664429 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2809/5634] 10.222.0.16 () {60 vars in 1304 bytes} [Sat Oct 29 03:11:18 2022] GET /compute/v2.1/os-server-groups/850de39f-9eb3-48c1-9f1a-9e6522c954c8 => generated 235 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:11:18.677374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-733a8fdf-2e19-4277-a3ec-498ce31ea1f2 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:18.713301 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-733a8fdf-2e19-4277-a3ec-498ce31ea1f2 tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/850de39f-9eb3-48c1-9f1a-9e6522c954c8" status: 204 len: 0 microversion: 2.64 time: 0.039753 Oct 29 03:11:18.718761 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2826/5635] 10.222.0.16 () {60 vars in 1307 bytes} [Sat Oct 29 03:11:18 2022] DELETE /compute/v2.1/os-server-groups/850de39f-9eb3-48c1-9f1a-9e6522c954c8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:11:18.724996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-944f9706-87b0-40b6-a123-93b5e5d9d7ed tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:18.732116 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-944f9706-87b0-40b6-a123-93b5e5d9d7ed tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] HTTP exception thrown: Instance group 850de39f-9eb3-48c1-9f1a-9e6522c954c8 could not be found. Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-944f9706-87b0-40b6-a123-93b5e5d9d7ed tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] Request method failure captured: Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-server-groups/850de39f-9eb3-48c1-9f1a-9e6522c954c8 HTTP/1.1 Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJnWFLdSP-nqiVIOXUrZAvSL5dDiPIozJ0q57SfTJwtvD2B0MU0mPVHqrVh_FOQm4Uebr5ovC_XHQsdgHPEtywDWTLD9OiXPsmg32THMG6BwjFdOIO9dTgYKEx3ov2GYYycoC9Ddzkd6tkLHDdH8VTeilA5IbX_HhAPrsRGB8vyR14w Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.64 Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 38f9e1e21653406ebb6203c714551a02 Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerGroup264TestJSON-1975354395 Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/38f9e1e21653406ebb6203c714551a02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f9e1e21653406ebb6203c714551a02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_38f9e1e21653406ebb6203c714551a02", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f9e1e21653406ebb6203c714551a02"}]}] Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerGroup264TestJSON-1975354395 Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 38f9e1e21653406ebb6203c714551a02 Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1975354395 Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerGroup264TestJSON-1975354395-project Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: ec6f5c41ab1d4c2d90041c01efe8bc54 Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerGroup264TestJSON-1975354395-project Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance group 850de39f-9eb3-48c1-9f1a-9e6522c954c8 could not be found. Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '850de39f-9eb3-48c1-9f1a-9e6522c954c8'} Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 850de39f-9eb3-48c1-9f1a-9e6522c954c8 could not be found. Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 850de39f-9eb3-48c1-9f1a-9e6522c954c8 could not be found. Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:18.758777 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:18.765901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:18.765901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:18.765901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:11:18.765901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:11:18.765901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 850de39f-9eb3-48c1-9f1a-9e6522c954c8 could not be found. Oct 29 03:11:18.765901 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:11:18.765901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-944f9706-87b0-40b6-a123-93b5e5d9d7ed tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] Returning 404 to user: Instance group 850de39f-9eb3-48c1-9f1a-9e6522c954c8 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:11:18.765901 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-944f9706-87b0-40b6-a123-93b5e5d9d7ed tempest-ServerGroup264TestJSON-1975354395 tempest-ServerGroup264TestJSON-1975354395-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/850de39f-9eb3-48c1-9f1a-9e6522c954c8" status: 404 len: 117 microversion: 2.64 time: 0.046113 Oct 29 03:11:18.766646 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2810/5636] 10.222.0.16 () {60 vars in 1307 bytes} [Sat Oct 29 03:11:18 2022] DELETE /compute/v2.1/os-server-groups/850de39f-9eb3-48c1-9f1a-9e6522c954c8 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:11:22.784362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2f24f6f-2ee2-4a56-9f67-adf48c27a594 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:22.785457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f2f24f6f-2ee2-4a56-9f67-adf48c27a594 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:22.798597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f24f6f-2ee2-4a56-9f67-adf48c27a594 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:22.809737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f24f6f-2ee2-4a56-9f67-adf48c27a594 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:22.810504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f24f6f-2ee2-4a56-9f67-adf48c27a594 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:22.811418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f24f6f-2ee2-4a56-9f67-adf48c27a594 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:22.812025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f24f6f-2ee2-4a56-9f67-adf48c27a594 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:22.812632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2f24f6f-2ee2-4a56-9f67-adf48c27a594 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:22.973897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-f2f24f6f-2ee2-4a56-9f67-adf48c27a594 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lazy-loading 'services' on Instance uuid a15eb84a-805e-4a1f-abfb-f0c495c463b6 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:11:23.103865 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f2f24f6f-2ee2-4a56-9f67-adf48c27a594 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/os-volume_attachments/3040e8da-0895-432e-8597-d93faf113fa5" status: 202 len: 0 microversion: 2.1 time: 0.322990 Oct 29 03:11:23.105267 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2827/5637] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:11:22 2022] DELETE /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/os-volume_attachments/3040e8da-0895-432e-8597-d93faf113fa5 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:11:32.185181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-08e22e3c-a392-4cab-8756-a2023a5df6b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:32.202404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:32.203434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:32.212270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08e22e3c-a392-4cab-8756-a2023a5df6b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:32.213020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08e22e3c-a392-4cab-8756-a2023a5df6b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:32.213575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08e22e3c-a392-4cab-8756-a2023a5df6b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:32.249838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-08e22e3c-a392-4cab-8756-a2023a5df6b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Going to try to stop instance {{(pid=127041) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:11:32.353606 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-08e22e3c-a392-4cab-8756-a2023a5df6b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "POST /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/action" status: 202 len: 0 microversion: 2.1 time: 0.178393 Oct 29 03:11:32.354329 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2811/5638] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:11:32 2022] POST /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:11:32.373087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-60054e67-86a8-487e-bf4e-0a4d96bd8141 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:32.375891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-60054e67-86a8-487e-bf4e-0a4d96bd8141 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:32.388622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60054e67-86a8-487e-bf4e-0a4d96bd8141 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:32.389509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60054e67-86a8-487e-bf4e-0a4d96bd8141 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:32.390220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60054e67-86a8-487e-bf4e-0a4d96bd8141 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:32.391160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60054e67-86a8-487e-bf4e-0a4d96bd8141 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:32.391844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60054e67-86a8-487e-bf4e-0a4d96bd8141 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:32.392476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60054e67-86a8-487e-bf4e-0a4d96bd8141 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:33.128529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-60054e67-86a8-487e-bf4e-0a4d96bd8141 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:33.140374 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-60054e67-86a8-487e-bf4e-0a4d96bd8141 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1677 microversion: 2.1 time: 0.781241 Oct 29 03:11:33.142937 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2828/5639] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:32 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1677 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:34.172623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25c49666-5114-4153-a98c-afe962f5a1e8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:34.174047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25c49666-5114-4153-a98c-afe962f5a1e8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:34.194280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25c49666-5114-4153-a98c-afe962f5a1e8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:34.195617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25c49666-5114-4153-a98c-afe962f5a1e8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:34.196204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25c49666-5114-4153-a98c-afe962f5a1e8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:34.197510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25c49666-5114-4153-a98c-afe962f5a1e8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:34.198458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25c49666-5114-4153-a98c-afe962f5a1e8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:34.199085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25c49666-5114-4153-a98c-afe962f5a1e8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:34.554651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25c49666-5114-4153-a98c-afe962f5a1e8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:34.563385 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25c49666-5114-4153-a98c-afe962f5a1e8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1677 microversion: 2.1 time: 0.397228 Oct 29 03:11:34.583228 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2812/5640] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:34 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1677 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:35.588330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-259ef7d1-35ce-4df7-8a52-220ff3614d8e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:35.589016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-259ef7d1-35ce-4df7-8a52-220ff3614d8e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:35.597908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-259ef7d1-35ce-4df7-8a52-220ff3614d8e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:35.600135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-259ef7d1-35ce-4df7-8a52-220ff3614d8e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:35.602656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-259ef7d1-35ce-4df7-8a52-220ff3614d8e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:35.603417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-259ef7d1-35ce-4df7-8a52-220ff3614d8e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:35.605518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-259ef7d1-35ce-4df7-8a52-220ff3614d8e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:35.606199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-259ef7d1-35ce-4df7-8a52-220ff3614d8e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:35.853867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-259ef7d1-35ce-4df7-8a52-220ff3614d8e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:35.866928 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-259ef7d1-35ce-4df7-8a52-220ff3614d8e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1677 microversion: 2.1 time: 0.283543 Oct 29 03:11:35.885512 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2813/5641] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:35 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1677 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:11:36.071003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1939622066", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "8786a7c7-feef-4473-96b5-2123af12cf70"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:36.193419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] validate_networks() for [('8786a7c7-feef-4473-96b5-2123af12cf70', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:11:36.894887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fe904c22-96e6-48e0-8c40-cba23a041ac1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:36.896245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fe904c22-96e6-48e0-8c40-cba23a041ac1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:36.910423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe904c22-96e6-48e0-8c40-cba23a041ac1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:36.913789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe904c22-96e6-48e0-8c40-cba23a041ac1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:36.915254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe904c22-96e6-48e0-8c40-cba23a041ac1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:36.918621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe904c22-96e6-48e0-8c40-cba23a041ac1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:36.919383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe904c22-96e6-48e0-8c40-cba23a041ac1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:36.920197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fe904c22-96e6-48e0-8c40-cba23a041ac1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:37.513021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:11:37.514058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:11:37.514704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:11:37.515119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:11:37.515560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:11:37.555680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:37.556498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:37.557507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:37.558790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:37.561235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:37.561899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:37.586808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Getting quotas for project a92eaae8be3f450eb401dceb09341400. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:37.594251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Getting quotas for user f4e793d75b944fc7a139abfa22789a94 and project a92eaae8be3f450eb401dceb09341400. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:37.612908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:11:37.616623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:11:37.675498 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c04ad477-d537-407b-9e5a-648644f3f2db tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.201854 Oct 29 03:11:37.676506 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2829/5642] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 03:11:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:11:37.691398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5101105b-93a0-47fc-bc5d-3c8f1bfb2919 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:37.692982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5101105b-93a0-47fc-bc5d-3c8f1bfb2919 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:37.937607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5101105b-93a0-47fc-bc5d-3c8f1bfb2919 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:37.956919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5101105b-93a0-47fc-bc5d-3c8f1bfb2919 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:37.962328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5101105b-93a0-47fc-bc5d-3c8f1bfb2919 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:37.966663 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5101105b-93a0-47fc-bc5d-3c8f1bfb2919 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1259 microversion: 2.21 time: 0.281214 Oct 29 03:11:37.967227 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2830/5643] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:37 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1259 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:11:37.979779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fe904c22-96e6-48e0-8c40-cba23a041ac1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:38.007280 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fe904c22-96e6-48e0-8c40-cba23a041ac1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1677 microversion: 2.1 time: 1.118174 Oct 29 03:11:38.007897 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2814/5644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:36 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1677 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:39.000888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:39.001448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:39.011262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:39.011913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:39.012492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:39.013440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:39.014049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:39.014610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:39.034782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ef5b7708-1f33-4418-a94d-ccf390961ec3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:39.036868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ef5b7708-1f33-4418-a94d-ccf390961ec3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:39.061282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef5b7708-1f33-4418-a94d-ccf390961ec3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:39.062919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef5b7708-1f33-4418-a94d-ccf390961ec3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:39.064493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef5b7708-1f33-4418-a94d-ccf390961ec3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:39.065822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef5b7708-1f33-4418-a94d-ccf390961ec3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:39.069027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef5b7708-1f33-4418-a94d-ccf390961ec3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:39.069781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef5b7708-1f33-4418-a94d-ccf390961ec3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:39.256068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:39.280462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:39.282540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:39.288514 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c6b899c-2811-4364-aaef-5856a2d7af23 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1255 microversion: 2.21 time: 0.293206 Oct 29 03:11:39.290780 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2831/5645] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:38 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1255 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:11:39.504811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ef5b7708-1f33-4418-a94d-ccf390961ec3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:39.515606 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ef5b7708-1f33-4418-a94d-ccf390961ec3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1677 microversion: 2.1 time: 0.485240 Oct 29 03:11:39.538406 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2815/5646] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:39 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1677 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:11:40.319370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:40.320605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:40.330552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:40.331670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:40.332514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:40.333572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:40.334257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:40.334856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:40.516164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:40.528953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:40.534778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:40.540995 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3cb6052b-aff7-484b-84aa-4098b61980ed tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1317 microversion: 2.21 time: 0.226466 Oct 29 03:11:40.541604 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2832/5647] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:40 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:11:40.547593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-813d949a-9dee-4fe1-a033-f7d168af8053 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:40.547593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-813d949a-9dee-4fe1-a033-f7d168af8053 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:40.557974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-813d949a-9dee-4fe1-a033-f7d168af8053 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:40.561367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-813d949a-9dee-4fe1-a033-f7d168af8053 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:40.564664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-813d949a-9dee-4fe1-a033-f7d168af8053 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:40.566981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-813d949a-9dee-4fe1-a033-f7d168af8053 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:40.569396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-813d949a-9dee-4fe1-a033-f7d168af8053 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:40.572959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-813d949a-9dee-4fe1-a033-f7d168af8053 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:41.260503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-813d949a-9dee-4fe1-a033-f7d168af8053 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:41.275341 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-813d949a-9dee-4fe1-a033-f7d168af8053 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1677 microversion: 2.1 time: 0.734884 Oct 29 03:11:41.276299 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2816/5648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:40 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1677 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:11:41.576029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:41.577615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:41.589262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:41.593490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:41.594768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:41.597304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:41.599440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:41.602957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:41.783748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:41.795823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:41.803089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:41.808732 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3757d57b-2dde-4c33-95b1-95a7be64e092 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1317 microversion: 2.21 time: 0.238275 Oct 29 03:11:41.814174 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2833/5649] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:41 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:11:42.300501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-52577c35-d3fc-47e1-aef6-80afed2729b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:42.301114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-52577c35-d3fc-47e1-aef6-80afed2729b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:42.318267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52577c35-d3fc-47e1-aef6-80afed2729b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:42.319175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52577c35-d3fc-47e1-aef6-80afed2729b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:42.319773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52577c35-d3fc-47e1-aef6-80afed2729b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:42.321161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52577c35-d3fc-47e1-aef6-80afed2729b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:42.321788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52577c35-d3fc-47e1-aef6-80afed2729b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:42.322407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52577c35-d3fc-47e1-aef6-80afed2729b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:42.850336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:42.850957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:42.866347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:42.867034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:42.867926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:42.869571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:42.878682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:42.879470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:43.189304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:43.198761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:43.210858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:43.212057 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-57260ae6-c0ce-44f0-baa0-e1993fb230f5 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1359 microversion: 2.21 time: 0.369161 Oct 29 03:11:43.212629 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2834/5650] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:42 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1359 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:11:43.487954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-52577c35-d3fc-47e1-aef6-80afed2729b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:43.503838 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-52577c35-d3fc-47e1-aef6-80afed2729b3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1677 microversion: 2.1 time: 1.205254 Oct 29 03:11:43.507250 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2817/5651] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:42 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1677 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:44.240555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:44.241763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:44.248978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:44.251434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:44.253937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:44.255028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:44.256217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:44.256838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:44.529296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e9fd3d23-beb3-4067-912a-1cd9ebbe5dcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:44.538628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e9fd3d23-beb3-4067-912a-1cd9ebbe5dcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:44.550148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9fd3d23-beb3-4067-912a-1cd9ebbe5dcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:44.550928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9fd3d23-beb3-4067-912a-1cd9ebbe5dcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:44.551438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9fd3d23-beb3-4067-912a-1cd9ebbe5dcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:44.552221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9fd3d23-beb3-4067-912a-1cd9ebbe5dcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:44.552669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9fd3d23-beb3-4067-912a-1cd9ebbe5dcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:44.553123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9fd3d23-beb3-4067-912a-1cd9ebbe5dcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:44.762740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:44.771241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:44.773071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:44.774458 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8af0dfa3-51af-44d6-9ae5-88d51a93e755 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1359 microversion: 2.21 time: 0.538615 Oct 29 03:11:44.786938 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2835/5652] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:44 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1359 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:11:45.076222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e9fd3d23-beb3-4067-912a-1cd9ebbe5dcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:45.098099 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e9fd3d23-beb3-4067-912a-1cd9ebbe5dcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1654 microversion: 2.1 time: 0.571466 Oct 29 03:11:45.113959 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2818/5653] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:44 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1654 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:11:45.131617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fb98610d-6148-4094-a4e3-137c692f0f73 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:45.150442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb98610d-6148-4094-a4e3-137c692f0f73 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:45.150851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb98610d-6148-4094-a4e3-137c692f0f73 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:45.151294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb98610d-6148-4094-a4e3-137c692f0f73 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:45.229045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fb98610d-6148-4094-a4e3-137c692f0f73 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Going to try to start instance {{(pid=127041) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:11:45.345058 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fb98610d-6148-4094-a4e3-137c692f0f73 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "POST /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/action" status: 202 len: 0 microversion: 2.1 time: 0.218558 Oct 29 03:11:45.346070 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2819/5654] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:11:45 2022] POST /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:11:45.367035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-43d340d4-2f32-44cf-883d-d01dc51dc5b0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:45.369735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-43d340d4-2f32-44cf-883d-d01dc51dc5b0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:45.387749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43d340d4-2f32-44cf-883d-d01dc51dc5b0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:45.391534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43d340d4-2f32-44cf-883d-d01dc51dc5b0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:45.392164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43d340d4-2f32-44cf-883d-d01dc51dc5b0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:45.393718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43d340d4-2f32-44cf-883d-d01dc51dc5b0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:45.394487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43d340d4-2f32-44cf-883d-d01dc51dc5b0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:45.394907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43d340d4-2f32-44cf-883d-d01dc51dc5b0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:45.459911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-adc515b7-bd11-460f-8d1b-48de251ff279 req-4ac633f4-eb31-4a60-8f8d-9052ba11fe89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad0c9f73-672d-4abc-a6dc-7537d3b39c67", "tag": "aea4bedc-a1e5-4c11-ad99-6962f371519c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:45.483652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-adc515b7-bd11-460f-8d1b-48de251ff279 req-4ac633f4-eb31-4a60-8f8d-9052ba11fe89 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:45.484287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-adc515b7-bd11-460f-8d1b-48de251ff279 req-4ac633f4-eb31-4a60-8f8d-9052ba11fe89 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:45.484730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-adc515b7-bd11-460f-8d1b-48de251ff279 req-4ac633f4-eb31-4a60-8f8d-9052ba11fe89 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:45.506873 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-adc515b7-bd11-460f-8d1b-48de251ff279 req-4ac633f4-eb31-4a60-8f8d-9052ba11fe89 service nova] Creating event network-changed:aea4bedc-a1e5-4c11-ad99-6962f371519c for instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 on n-h2-862964-4 Oct 29 03:11:45.530408 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-adc515b7-bd11-460f-8d1b-48de251ff279 req-4ac633f4-eb31-4a60-8f8d-9052ba11fe89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.544301 Oct 29 03:11:45.531465 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2836/5655] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:45.803477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:45.804445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:45.818098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:45.820777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:45.822169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:45.825714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:45.826857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:45.827592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:46.172296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-43d340d4-2f32-44cf-883d-d01dc51dc5b0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:46.193819 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-43d340d4-2f32-44cf-883d-d01dc51dc5b0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1663 microversion: 2.1 time: 0.839303 Oct 29 03:11:46.194950 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2820/5656] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:45 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1663 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:46.554117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:46.571712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:46.573915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:46.575804 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d66728f-9001-42c6-8daf-36d8fad4d880 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1359 microversion: 2.21 time: 0.778596 Oct 29 03:11:46.576574 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2837/5657] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:45 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1359 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:11:47.220010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-62184929-cd9e-4331-80c7-eb83b4b7f3aa tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:47.220833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-62184929-cd9e-4331-80c7-eb83b4b7f3aa tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:47.237845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62184929-cd9e-4331-80c7-eb83b4b7f3aa tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:47.241703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62184929-cd9e-4331-80c7-eb83b4b7f3aa tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:47.242829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62184929-cd9e-4331-80c7-eb83b4b7f3aa tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:47.243893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62184929-cd9e-4331-80c7-eb83b4b7f3aa tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:47.245471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62184929-cd9e-4331-80c7-eb83b4b7f3aa tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:47.247247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62184929-cd9e-4331-80c7-eb83b4b7f3aa tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:47.623291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:47.623906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:47.640885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:47.646859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:47.655191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:47.658717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:47.659730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:47.662637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:47.665099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:47.760751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-62184929-cd9e-4331-80c7-eb83b4b7f3aa tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:47.779690 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-62184929-cd9e-4331-80c7-eb83b4b7f3aa tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1663 microversion: 2.1 time: 0.562456 Oct 29 03:11:47.785352 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2821/5658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:47 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1663 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:47.947487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:48.752816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:48.756145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:48.772670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:48.774507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:48.778796 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-796da247-89db-414c-9eaa-b848fe458b40 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1359 microversion: 2.21 time: 1.166337 Oct 29 03:11:48.789856 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2838/5659] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:47 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1359 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:11:48.807906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b620fec-58b1-4530-8be4-c3fedb4e1b5c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:48.814459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4b620fec-58b1-4530-8be4-c3fedb4e1b5c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:48.829218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b620fec-58b1-4530-8be4-c3fedb4e1b5c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:48.830124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b620fec-58b1-4530-8be4-c3fedb4e1b5c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:48.830884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b620fec-58b1-4530-8be4-c3fedb4e1b5c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:48.837370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b620fec-58b1-4530-8be4-c3fedb4e1b5c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:48.839189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b620fec-58b1-4530-8be4-c3fedb4e1b5c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:48.840009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b620fec-58b1-4530-8be4-c3fedb4e1b5c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:49.480462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b620fec-58b1-4530-8be4-c3fedb4e1b5c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:49.493416 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4b620fec-58b1-4530-8be4-c3fedb4e1b5c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1667 microversion: 2.1 time: 0.689656 Oct 29 03:11:49.507768 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2822/5660] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:48 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1667 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:49.808812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:49.810178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:49.825697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:49.828232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:49.833223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:49.834310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:49.840580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:49.841828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:49.849174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:50.262386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:50.282708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:50.289628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:50.298095 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-69b2c6f2-9946-4e34-bf6a-7d6bfb3603b6 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1359 microversion: 2.21 time: 0.492297 Oct 29 03:11:50.300275 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2839/5661] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:49 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1359 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:11:51.328052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:51.328662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:51.350206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:51.351699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:51.353306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:51.354229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:51.356875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:51.357312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:51.871138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:51.909356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:51.914627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:51.924674 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59d2a2e2-71bc-409e-aab0-18c62cb83e5b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1359 microversion: 2.21 time: 0.598807 Oct 29 03:11:51.928299 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2823/5662] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:51 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1359 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:11:52.510951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-fbd30d44-5d36-4ebb-9591-d570ac5cd2fa req-9f21e626-430e-41d1-9119-007bb9e9b9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0c9f73-672d-4abc-a6dc-7537d3b39c67", "name": "network-vif-plugged", "status": "completed", "tag": "aea4bedc-a1e5-4c11-ad99-6962f371519c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:52.534275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fbd30d44-5d36-4ebb-9591-d570ac5cd2fa req-9f21e626-430e-41d1-9119-007bb9e9b9cb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:52.535075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fbd30d44-5d36-4ebb-9591-d570ac5cd2fa req-9f21e626-430e-41d1-9119-007bb9e9b9cb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:52.538625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fbd30d44-5d36-4ebb-9591-d570ac5cd2fa req-9f21e626-430e-41d1-9119-007bb9e9b9cb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:52.580984 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-fbd30d44-5d36-4ebb-9591-d570ac5cd2fa req-9f21e626-430e-41d1-9119-007bb9e9b9cb service nova] Creating event network-vif-plugged:aea4bedc-a1e5-4c11-ad99-6962f371519c for instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 on n-h2-862964-4 Oct 29 03:11:52.604747 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-fbd30d44-5d36-4ebb-9591-d570ac5cd2fa req-9f21e626-430e-41d1-9119-007bb9e9b9cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.486600 Oct 29 03:11:52.605788 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2840/5663] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:52.631462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-99f35738-60e0-4a79-97b1-58548bc32369 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Action: 'create', calling method: .version_select at 0x7fe1a38ff5e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1052921220", "policies": ["affinity"]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:52.658946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-99f35738-60e0-4a79-97b1-58548bc32369 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:52.667040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-99f35738-60e0-4a79-97b1-58548bc32369 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:52.752141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-99f35738-60e0-4a79-97b1-58548bc32369 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:52.768080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-99f35738-60e0-4a79-97b1-58548bc32369 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:52.798093 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-99f35738-60e0-4a79-97b1-58548bc32369 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.602699 Oct 29 03:11:52.799275 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2824/5664] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Oct 29 03:11:52 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:52.811889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e2913457-1711-4486-8b07-8eac4c2017e0 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Action: 'create', calling method: .version_select at 0x7fe1a3364940>, body: {"server_group": {"name": "tempest-server-group-198926945", "policies": ["affinity"]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:52.852824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e2913457-1711-4486-8b07-8eac4c2017e0 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:52.871171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e2913457-1711-4486-8b07-8eac4c2017e0 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:52.952580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:52.953353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:52.965427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:52.972595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:52.975770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:52.976807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e2913457-1711-4486-8b07-8eac4c2017e0 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:52.979124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:52.979846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:52.988656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:52.994643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e2913457-1711-4486-8b07-8eac4c2017e0 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:53.025742 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e2913457-1711-4486-8b07-8eac4c2017e0 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.213396 Oct 29 03:11:53.029577 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2841/5665] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Oct 29 03:11:52 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:53.040511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-71c02b72-37ba-4e71-8042-6b6fb57d1d5c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Action: 'create', calling method: .version_select at 0x7fe1a33ba280>, body: {"server_group": {"name": "tempest-server-group-198926945", "policies": ["affinity"]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:53.061281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-71c02b72-37ba-4e71-8042-6b6fb57d1d5c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:53.067659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-71c02b72-37ba-4e71-8042-6b6fb57d1d5c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:53.139100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-71c02b72-37ba-4e71-8042-6b6fb57d1d5c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:53.151946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-71c02b72-37ba-4e71-8042-6b6fb57d1d5c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:53.174560 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-71c02b72-37ba-4e71-8042-6b6fb57d1d5c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.137964 Oct 29 03:11:53.182016 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2842/5666] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Oct 29 03:11:53 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:11:53.188418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6caa3be4-8177-4cbf-9505-d79b7537cae1 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:53.230094 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6caa3be4-8177-4cbf-9505-d79b7537cae1 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/1b14988c-7e14-49a7-9182-a1ee4c8f657f" status: 204 len: 0 microversion: 2.1 time: 0.046036 Oct 29 03:11:53.231104 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2843/5667] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:11:53 2022] DELETE /compute/v2.1/os-server-groups/1b14988c-7e14-49a7-9182-a1ee4c8f657f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:11:53.272180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e259f014-4899-47fb-a66c-db09f58b30eb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:53.320100 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e259f014-4899-47fb-a66c-db09f58b30eb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.081249 Oct 29 03:11:53.328426 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2844/5668] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 03:11:53 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:53.351492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-22ec2a92-b472-4f18-8b40-fe12def76285 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:53.386106 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-22ec2a92-b472-4f18-8b40-fe12def76285 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/7d11259d-2d86-41b9-9536-bf0cc1b7fdcd" status: 204 len: 0 microversion: 2.1 time: 0.055901 Oct 29 03:11:53.387023 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2845/5669] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:11:53 2022] DELETE /compute/v2.1/os-server-groups/7d11259d-2d86-41b9-9536-bf0cc1b7fdcd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:11:53.398624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7472e3ba-a328-43fb-9d53-bdf7fed02861 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:53.419652 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7472e3ba-a328-43fb-9d53-bdf7fed02861 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.025830 Oct 29 03:11:53.420901 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2846/5670] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 03:11:53 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:53.436259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3fc9fbac-426a-4e2e-b47b-5e90c2c4d430 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Action: 'create', calling method: .version_select at 0x7fe1a84223a0>, body: {"server_group": {"name": "tempest-server-group-477015896", "policies": ["affinity"]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:53.484718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-3fc9fbac-426a-4e2e-b47b-5e90c2c4d430 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:53.500127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-3fc9fbac-426a-4e2e-b47b-5e90c2c4d430 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:53.608653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-3fc9fbac-426a-4e2e-b47b-5e90c2c4d430 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:53.613008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:53.616789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-3fc9fbac-426a-4e2e-b47b-5e90c2c4d430 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:53.659008 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3fc9fbac-426a-4e2e-b47b-5e90c2c4d430 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.227666 Oct 29 03:11:53.659808 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2847/5671] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Oct 29 03:11:53 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:53.676565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a42b717-e802-45ec-9a31-c7685897f866 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:53.743675 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1a42b717-e802-45ec-9a31-c7685897f866 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/9b853abe-3d19-43da-a7eb-cf8443360112" status: 204 len: 0 microversion: 2.1 time: 0.075063 Oct 29 03:11:53.747718 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2848/5672] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:11:53 2022] DELETE /compute/v2.1/os-server-groups/9b853abe-3d19-43da-a7eb-cf8443360112 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:11:53.752658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-76a7a1a6-310e-419c-becf-0e7df2320faf tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:53.765041 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-76a7a1a6-310e-419c-becf-0e7df2320faf tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016054 Oct 29 03:11:53.773087 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2849/5673] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 03:11:53 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:53.777404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:53.787359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-58059b67-ef9c-446f-9a67-a22601d36048 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Action: 'create', calling method: .version_select at 0x7fe1a3312820>, body: {"server_group": {"name": "tempest-server-group-1162193520", "policies": ["anti-affinity"]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:53.792534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:53.794205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:53.800678 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-63e3c526-28b8-48b3-9255-ed413b7d93ff tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1359 microversion: 2.21 time: 0.850791 Oct 29 03:11:53.802889 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2825/5674] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:52 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1359 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:11:53.855282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-58059b67-ef9c-446f-9a67-a22601d36048 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:53.876531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-58059b67-ef9c-446f-9a67-a22601d36048 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:53.968264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-58059b67-ef9c-446f-9a67-a22601d36048 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:53.975911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-58059b67-ef9c-446f-9a67-a22601d36048 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_groups'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:54.032255 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-58059b67-ef9c-446f-9a67-a22601d36048 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.256918 Oct 29 03:11:54.044607 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2850/5675] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Oct 29 03:11:53 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:54.047972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ffe040a3-133c-4a4f-a1a3-c7ba47d709a5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:54.145214 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ffe040a3-133c-4a4f-a1a3-c7ba47d709a5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/37f2ee1b-592f-4292-a441-575a74abb543" status: 204 len: 0 microversion: 2.1 time: 0.102924 Oct 29 03:11:54.147062 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2826/5676] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:11:54 2022] DELETE /compute/v2.1/os-server-groups/37f2ee1b-592f-4292-a441-575a74abb543 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:11:54.155142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8be8ab3b-3e30-433d-9719-154256b8fed6 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:54.191443 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8be8ab3b-3e30-433d-9719-154256b8fed6 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035384 Oct 29 03:11:54.194247 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2851/5677] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 03:11:54 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:54.466027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2121662675", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "e9f097b8-496a-4253-891a-d73330b7a441"}]}, "os:scheduler_hints": {"group": "33ede29d-55e5-41d4-98da-8ba68045d9a2"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:54.629060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] validate_networks() for [('e9f097b8-496a-4253-891a-d73330b7a441', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:11:54.833450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:54.835153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:54.843798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:54.844432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:54.845250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:54.846371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:54.847125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:54.849224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:55.448018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:55.484654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:55.505750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:55.527675 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3fc11b8-c377-47b7-86fb-4268616bfa12 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1552 microversion: 2.21 time: 0.695035 Oct 29 03:11:55.528507 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2852/5678] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:54 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1552 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:11:55.591718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e7f4a08b-263d-4cea-9b20-d5b3f09c7bbd tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:55.592275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e7f4a08b-263d-4cea-9b20-d5b3f09c7bbd tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:55.647180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7f4a08b-263d-4cea-9b20-d5b3f09c7bbd tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:55.651548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7f4a08b-263d-4cea-9b20-d5b3f09c7bbd tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:55.653967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7f4a08b-263d-4cea-9b20-d5b3f09c7bbd tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:55.657591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7f4a08b-263d-4cea-9b20-d5b3f09c7bbd tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:55.658519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7f4a08b-263d-4cea-9b20-d5b3f09c7bbd tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:55.662540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7f4a08b-263d-4cea-9b20-d5b3f09c7bbd tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:55.719652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e7f4a08b-263d-4cea-9b20-d5b3f09c7bbd tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:11:55.912639 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e7f4a08b-263d-4cea-9b20-d5b3f09c7bbd tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 204 len: 0 microversion: 2.21 time: 0.354447 Oct 29 03:11:55.913320 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2853/5679] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:11:55 2022] DELETE /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:11:55.953591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:55.954637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:55.969760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:55.970509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:55.972893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:55.978158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:55.978953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:55.979559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:56.250816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:56.262979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:56.265945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:56.267683 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-701f4bb9-4610-4676-be7d-d714c8d54a61 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1558 microversion: 2.21 time: 0.332426 Oct 29 03:11:56.268832 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2854/5680] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:55 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1558 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:11:57.293587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:57.294296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:57.311938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:57.312183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:57.312611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:57.313505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:57.314156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:57.314730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:57.664440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:11:57.665552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:11:57.666177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:11:57.667185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:11:57.668013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:11:57.715005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:57.719967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:57.721329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:57.723629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:57.724749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:57.726533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:57.727501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:57.749963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:57.755692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:57.759114 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-68aefb19-badd-44dc-8051-0af02107cb2b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1558 microversion: 2.21 time: 0.468030 Oct 29 03:11:57.759858 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2855/5681] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:57 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1558 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:11:57.782376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:57.798762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:57.832382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:11:57.835221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:11:57.950575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:57.957220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:58.015910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:58.023474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:58.024707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Getting quotas for user cc26b3ebcdfe4bea81cab484f092b401 and project 393e2b2202cb46e8b1603038f079b9aa. Resources: {'server_group_members'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:58.064450 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [38acbc69-4d86-4244-a450-cb24e00484a9] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 03:11:58.705843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-236ea9ee-59e7-426e-8cba-7c6c8f3678aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902-project-admin] Calling method '.version_select at 0x7fe1a3333d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:58.708816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-236ea9ee-59e7-426e-8cba-7c6c8f3678aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:58.711272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-236ea9ee-59e7-426e-8cba-7c6c8f3678aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:58.711671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-236ea9ee-59e7-426e-8cba-7c6c8f3678aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:58.758612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-236ea9ee-59e7-426e-8cba-7c6c8f3678aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:58.761017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-236ea9ee-59e7-426e-8cba-7c6c8f3678aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:58.762478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-236ea9ee-59e7-426e-8cba-7c6c8f3678aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:58.792530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-236ea9ee-59e7-426e-8cba-7c6c8f3678aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:58.793016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-236ea9ee-59e7-426e-8cba-7c6c8f3678aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:58.793443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-236ea9ee-59e7-426e-8cba-7c6c8f3678aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:58.813260 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-236ea9ee-59e7-426e-8cba-7c6c8f3678aa tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1962673902-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.473927 Oct 29 03:11:58.816278 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2856/5682] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 03:11:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:11:58.823005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-cde87373-e2d1-4840-9934-da5a3cc6e464 req-329363c3-5b9f-40f0-8a92-37d1c14afe54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0c9f73-672d-4abc-a6dc-7537d3b39c67", "name": "network-vif-deleted", "tag": "aea4bedc-a1e5-4c11-ad99-6962f371519c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:58.854328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cde87373-e2d1-4840-9934-da5a3cc6e464 req-329363c3-5b9f-40f0-8a92-37d1c14afe54 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:58.855455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cde87373-e2d1-4840-9934-da5a3cc6e464 req-329363c3-5b9f-40f0-8a92-37d1c14afe54 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:58.858322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cde87373-e2d1-4840-9934-da5a3cc6e464 req-329363c3-5b9f-40f0-8a92-37d1c14afe54 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:58.887101 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-cde87373-e2d1-4840-9934-da5a3cc6e464 req-329363c3-5b9f-40f0-8a92-37d1c14afe54 service nova] Creating event network-vif-deleted:aea4bedc-a1e5-4c11-ad99-6962f371519c for instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 on n-h2-862964-4 Oct 29 03:11:58.899306 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-cde87373-e2d1-4840-9934-da5a3cc6e464 req-329363c3-5b9f-40f0-8a92-37d1c14afe54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080020 Oct 29 03:11:58.902321 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2857/5683] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:58.913585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:58.914459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:58.938515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:58.941336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:58.943284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:58.944158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:58.946827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:58.947340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:58.987999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:58.988657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:58.989342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:58.989927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lazy-loading 'fault' on Instance uuid ad0c9f73-672d-4abc-a6dc-7537d3b39c67 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:11:59.063812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:59.072095 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [38acbc69-4d86-4244-a450-cb24e00484a9] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43794. Oct 29 03:11:59.076198 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1e24fc86-f4c2-44ce-a719-662d0c1d725f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.617339 Oct 29 03:11:59.083074 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2827/5684] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:11:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:11:59.088334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:59.089295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-87c8b910-cc4c-4115-af47-3323a6568ee0 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:59.089941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-87c8b910-cc4c-4115-af47-3323a6568ee0 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:59.090370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4e793d75b944fc7a139abfa22789a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92eaae8be3f450eb401dceb09341400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:59.092671 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c182c96b-419e-46ae-af75-3ba00ef9dc8c tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 200 len: 1349 microversion: 2.21 time: 0.188604 Oct 29 03:11:59.112731 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2858/5685] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:11:58 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 1349 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:11:59.347131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-87c8b910-cc4c-4115-af47-3323a6568ee0 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:59.356751 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-87c8b910-cc4c-4115-af47-3323a6568ee0 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1213 microversion: 2.1 time: 0.271228 Oct 29 03:11:59.359670 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2828/5686] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:59 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1213 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:00.118868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:00.120060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:00.127462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:00.128400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:00.128977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:00.129913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:00.130674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:00.131239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:00.170419 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] HTTP exception thrown: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Request method failure captured: Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 HTTP/1.1 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJnn5o80XwycQMokuy3MdH2gRzAwFjMN5kwSANWSU_LZgT4bArTH9jD62S4r0wRmpJEVz21oj0PCZ2Oc84Vm67g9naVw1QINqtnNHlsr9kDk37OZnm8Ael3WbLMMYb1fUDa1nJpdlWUAmhlXwo0ZXrGzJqUj7MWvhYakJe2TVF8EVR4 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: a92eaae8be3f450eb401dceb09341400 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1166464695 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a92eaae8be3f450eb401dceb09341400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a92eaae8be3f450eb401dceb09341400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a92eaae8be3f450eb401dceb09341400", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a92eaae8be3f450eb401dceb09341400"}]}] Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-InstanceActionsV221TestJSON-1166464695 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: a92eaae8be3f450eb401dceb09341400 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1166464695 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-InstanceActionsV221TestJSON-1166464695-project Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f4e793d75b944fc7a139abfa22789a94 Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-InstanceActionsV221TestJSON-1166464695-project Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'ad0c9f73-672d-4abc-a6dc-7537d3b39c67'} Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.174188 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:00.177924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.177924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:00.177924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:00.177924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:00.177924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:00.177924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:00.177924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.177924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.179224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Returning 404 to user: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:00.180670 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-12ac77cd-d28c-4900-9d40-7d854ae24008 tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 404 len: 111 microversion: 2.21 time: 0.066031 Oct 29 03:12:00.182412 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2859/5687] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:00 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:12:00.189785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cb334a5f-ea03-45eb-8cc2-19fe8a60223d tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '.version_select at 0x7fe1a385e8b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:00.190432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cb334a5f-ea03-45eb-8cc2-19fe8a60223d tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:00.198313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb334a5f-ea03-45eb-8cc2-19fe8a60223d tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:00.198789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb334a5f-ea03-45eb-8cc2-19fe8a60223d tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:00.199212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb334a5f-ea03-45eb-8cc2-19fe8a60223d tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:00.199903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb334a5f-ea03-45eb-8cc2-19fe8a60223d tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:00.200345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb334a5f-ea03-45eb-8cc2-19fe8a60223d tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:00.200758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb334a5f-ea03-45eb-8cc2-19fe8a60223d tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:00.227402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:00.275133 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cb334a5f-ea03-45eb-8cc2-19fe8a60223d tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.089188 Oct 29 03:12:00.276096 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2829/5688] 10.222.0.16 () {60 vars in 1337 bytes} [Sat Oct 29 03:12:00 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67/os-instance-actions => generated 611 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:12:00.296047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:00.297554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:00.304748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:00.305378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:00.306582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:00.307406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:00.307956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:00.308471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:00.325510 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] HTTP exception thrown: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Request method failure captured: Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 HTTP/1.1 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJnn5o80XwycQMokuy3MdH2gRzAwFjMN5kwSANWSU_LZgT4bArTH9jD62S4r0wRmpJEVz21oj0PCZ2Oc84Vm67g9naVw1QINqtnNHlsr9kDk37OZnm8Ael3WbLMMYb1fUDa1nJpdlWUAmhlXwo0ZXrGzJqUj7MWvhYakJe2TVF8EVR4 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: a92eaae8be3f450eb401dceb09341400 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1166464695 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a92eaae8be3f450eb401dceb09341400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a92eaae8be3f450eb401dceb09341400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a92eaae8be3f450eb401dceb09341400", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a92eaae8be3f450eb401dceb09341400"}]}] Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-InstanceActionsV221TestJSON-1166464695 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: a92eaae8be3f450eb401dceb09341400 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1166464695 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-InstanceActionsV221TestJSON-1166464695-project Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: f4e793d75b944fc7a139abfa22789a94 Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-InstanceActionsV221TestJSON-1166464695-project Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'ad0c9f73-672d-4abc-a6dc-7537d3b39c67'} Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:12:00.327446 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Returning 404 to user: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:00.330743 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e6f0eab9-de3e-4a03-8484-0b280bd9703a tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 404 len: 111 microversion: 2.21 time: 0.039977 Oct 29 03:12:00.332738 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2860/5689] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:12:00 2022] DELETE /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:12:00.341844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:00.342956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] [instance: ad0c9f73-672d-4abc-a6dc-7537d3b39c67] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:00.350561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:00.351303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:00.352017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:00.353211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:00.354677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:00.355200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:00.387063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-06a03970-ba2a-4951-a53b-ae00d2813f54 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:00.387940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-06a03970-ba2a-4951-a53b-ae00d2813f54 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:00.389224 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] HTTP exception thrown: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Request method failure captured: Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 HTTP/1.1 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJnn5o80XwycQMokuy3MdH2gRzAwFjMN5kwSANWSU_LZgT4bArTH9jD62S4r0wRmpJEVz21oj0PCZ2Oc84Vm67g9naVw1QINqtnNHlsr9kDk37OZnm8Ael3WbLMMYb1fUDa1nJpdlWUAmhlXwo0ZXrGzJqUj7MWvhYakJe2TVF8EVR4 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: a92eaae8be3f450eb401dceb09341400 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1166464695 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a92eaae8be3f450eb401dceb09341400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a92eaae8be3f450eb401dceb09341400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a92eaae8be3f450eb401dceb09341400", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a92eaae8be3f450eb401dceb09341400"}]}] Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-InstanceActionsV221TestJSON-1166464695 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: a92eaae8be3f450eb401dceb09341400 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1166464695 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-InstanceActionsV221TestJSON-1166464695-project Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: f4e793d75b944fc7a139abfa22789a94 Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-InstanceActionsV221TestJSON-1166464695-project Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'ad0c9f73-672d-4abc-a6dc-7537d3b39c67'} Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.393097 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:00.397107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.397107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:00.397107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:00.397107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:00.397107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:00.397107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:00.397107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. Oct 29 03:12:00.397107 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:00.400789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] Returning 404 to user: Instance ad0c9f73-672d-4abc-a6dc-7537d3b39c67 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:00.404480 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-85cde2d5-31bd-411f-9ae8-140af5e0301b tempest-InstanceActionsV221TestJSON-1166464695 tempest-InstanceActionsV221TestJSON-1166464695-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67" status: 404 len: 111 microversion: 2.21 time: 0.065345 Oct 29 03:12:00.405471 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2830/5690] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:00 2022] GET /compute/v2.1/servers/ad0c9f73-672d-4abc-a6dc-7537d3b39c67 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:12:00.505127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-06a03970-ba2a-4951-a53b-ae00d2813f54 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:00.514557 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-06a03970-ba2a-4951-a53b-ae00d2813f54 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1213 microversion: 2.1 time: 0.132004 Oct 29 03:12:00.515530 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2861/5691] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:00 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:01.564671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-09bebce7-0aff-4cf2-a69c-4196b435bceb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:01.565029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-09bebce7-0aff-4cf2-a69c-4196b435bceb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:01.952668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-09bebce7-0aff-4cf2-a69c-4196b435bceb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:01.971756 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-09bebce7-0aff-4cf2-a69c-4196b435bceb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1213 microversion: 2.1 time: 0.433080 Oct 29 03:12:01.972627 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2831/5692] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:01 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1213 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:03.009086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5527173c-0fb7-4647-829a-a035cea79147 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:03.010403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5527173c-0fb7-4647-829a-a035cea79147 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:03.679160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5527173c-0fb7-4647-829a-a035cea79147 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:03.692194 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5527173c-0fb7-4647-829a-a035cea79147 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1213 microversion: 2.1 time: 0.696173 Oct 29 03:12:03.694857 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2862/5693] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:02 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1213 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:04.719389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-042fe4a5-1c40-4b8e-8c97-50d0538c4de3 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:04.724967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-042fe4a5-1c40-4b8e-8c97-50d0538c4de3 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:04.746940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-042fe4a5-1c40-4b8e-8c97-50d0538c4de3 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:04.748784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-042fe4a5-1c40-4b8e-8c97-50d0538c4de3 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:04.750083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-042fe4a5-1c40-4b8e-8c97-50d0538c4de3 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:04.760234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-042fe4a5-1c40-4b8e-8c97-50d0538c4de3 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:04.761954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-042fe4a5-1c40-4b8e-8c97-50d0538c4de3 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:04.764437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-042fe4a5-1c40-4b8e-8c97-50d0538c4de3 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:05.007948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-042fe4a5-1c40-4b8e-8c97-50d0538c4de3 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:05.022673 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-042fe4a5-1c40-4b8e-8c97-50d0538c4de3 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1265 microversion: 2.1 time: 0.309971 Oct 29 03:12:05.025982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2832/5694] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:04 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:06.052344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-59c816e2-f3b2-42b6-a9dc-cc0f49e8f241 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:06.052945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-59c816e2-f3b2-42b6-a9dc-cc0f49e8f241 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:06.060619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59c816e2-f3b2-42b6-a9dc-cc0f49e8f241 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:06.061312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59c816e2-f3b2-42b6-a9dc-cc0f49e8f241 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:06.061965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59c816e2-f3b2-42b6-a9dc-cc0f49e8f241 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:06.062815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59c816e2-f3b2-42b6-a9dc-cc0f49e8f241 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:06.063397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59c816e2-f3b2-42b6-a9dc-cc0f49e8f241 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:06.063959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59c816e2-f3b2-42b6-a9dc-cc0f49e8f241 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:06.171371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-59c816e2-f3b2-42b6-a9dc-cc0f49e8f241 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:06.183696 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-59c816e2-f3b2-42b6-a9dc-cc0f49e8f241 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1271 microversion: 2.1 time: 0.135240 Oct 29 03:12:06.185129 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2863/5695] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:06 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:07.208822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94e26a05-6014-4d99-a35f-ad1db6653e37 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:07.209435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-94e26a05-6014-4d99-a35f-ad1db6653e37 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:07.230124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e26a05-6014-4d99-a35f-ad1db6653e37 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:07.230605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e26a05-6014-4d99-a35f-ad1db6653e37 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:07.231202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e26a05-6014-4d99-a35f-ad1db6653e37 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:07.232338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e26a05-6014-4d99-a35f-ad1db6653e37 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:07.232933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e26a05-6014-4d99-a35f-ad1db6653e37 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:07.233567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94e26a05-6014-4d99-a35f-ad1db6653e37 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:07.754784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:07.840992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-94e26a05-6014-4d99-a35f-ad1db6653e37 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:07.859687 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94e26a05-6014-4d99-a35f-ad1db6653e37 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1271 microversion: 2.1 time: 0.655348 Oct 29 03:12:07.863001 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2833/5696] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:07 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1271 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:08.890385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2673b9c3-c982-4356-82a7-43e9a5366c41 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:08.891069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2673b9c3-c982-4356-82a7-43e9a5366c41 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:08.912511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2673b9c3-c982-4356-82a7-43e9a5366c41 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:08.913076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2673b9c3-c982-4356-82a7-43e9a5366c41 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:08.916812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2673b9c3-c982-4356-82a7-43e9a5366c41 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:08.920086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2673b9c3-c982-4356-82a7-43e9a5366c41 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:08.921144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2673b9c3-c982-4356-82a7-43e9a5366c41 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:08.921898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2673b9c3-c982-4356-82a7-43e9a5366c41 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:09.646647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2673b9c3-c982-4356-82a7-43e9a5366c41 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:09.664178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2673b9c3-c982-4356-82a7-43e9a5366c41 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1313 microversion: 2.1 time: 0.780698 Oct 29 03:12:09.665396 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2864/5697] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:08 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:10.694259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-207d8da3-f694-4172-98ae-a5f53a7c1b1a tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:10.695152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-207d8da3-f694-4172-98ae-a5f53a7c1b1a tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:10.715029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-207d8da3-f694-4172-98ae-a5f53a7c1b1a tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:10.717235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-207d8da3-f694-4172-98ae-a5f53a7c1b1a tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:10.718220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-207d8da3-f694-4172-98ae-a5f53a7c1b1a tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:10.731762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-207d8da3-f694-4172-98ae-a5f53a7c1b1a tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:10.732369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-207d8da3-f694-4172-98ae-a5f53a7c1b1a tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:10.735205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-207d8da3-f694-4172-98ae-a5f53a7c1b1a tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:11.085420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b00cea6d-0b5b-4029-bf2d-72b1818cb255 req-c4ba9cf1-a1bb-438b-9926-077b06ed5e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e455ad-f8cf-484d-9e70-4ed6f3e5be5c", "tag": "0a18bdb1-b19a-4262-b7f3-6102febee682"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:11.101241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b00cea6d-0b5b-4029-bf2d-72b1818cb255 req-c4ba9cf1-a1bb-438b-9926-077b06ed5e3d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:11.101762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b00cea6d-0b5b-4029-bf2d-72b1818cb255 req-c4ba9cf1-a1bb-438b-9926-077b06ed5e3d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:11.102221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b00cea6d-0b5b-4029-bf2d-72b1818cb255 req-c4ba9cf1-a1bb-438b-9926-077b06ed5e3d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:11.128855 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b00cea6d-0b5b-4029-bf2d-72b1818cb255 req-c4ba9cf1-a1bb-438b-9926-077b06ed5e3d service nova] Creating event network-changed:0a18bdb1-b19a-4262-b7f3-6102febee682 for instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c on n-h2-862964-4 Oct 29 03:12:11.147931 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b00cea6d-0b5b-4029-bf2d-72b1818cb255 req-c4ba9cf1-a1bb-438b-9926-077b06ed5e3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066343 Oct 29 03:12:11.149165 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2865/5698] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:11.364248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-207d8da3-f694-4172-98ae-a5f53a7c1b1a tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:11.377964 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-207d8da3-f694-4172-98ae-a5f53a7c1b1a tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1313 microversion: 2.1 time: 0.689888 Oct 29 03:12:11.388965 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2834/5699] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:10 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1313 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:12.413349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aac3533d-b60d-483a-9cce-c49a4015fd5d tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:12.414198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aac3533d-b60d-483a-9cce-c49a4015fd5d tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:12.425424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aac3533d-b60d-483a-9cce-c49a4015fd5d tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:12.426032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aac3533d-b60d-483a-9cce-c49a4015fd5d tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:12.426515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aac3533d-b60d-483a-9cce-c49a4015fd5d tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:12.427251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aac3533d-b60d-483a-9cce-c49a4015fd5d tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:12.427707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aac3533d-b60d-483a-9cce-c49a4015fd5d tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:12.444924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aac3533d-b60d-483a-9cce-c49a4015fd5d tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:12.769892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aac3533d-b60d-483a-9cce-c49a4015fd5d tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:12.778713 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aac3533d-b60d-483a-9cce-c49a4015fd5d tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1313 microversion: 2.1 time: 0.371021 Oct 29 03:12:12.779846 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2866/5700] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:12 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:13.804394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c967981c-2078-4f6e-bc52-ccfec15717d5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:13.805652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c967981c-2078-4f6e-bc52-ccfec15717d5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:13.809513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=26 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:13.817316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c967981c-2078-4f6e-bc52-ccfec15717d5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:13.817842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c967981c-2078-4f6e-bc52-ccfec15717d5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:13.818289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c967981c-2078-4f6e-bc52-ccfec15717d5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:13.819014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c967981c-2078-4f6e-bc52-ccfec15717d5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:13.819678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c967981c-2078-4f6e-bc52-ccfec15717d5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:13.819902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c967981c-2078-4f6e-bc52-ccfec15717d5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:14.501602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c967981c-2078-4f6e-bc52-ccfec15717d5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:14.513228 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c967981c-2078-4f6e-bc52-ccfec15717d5 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1313 microversion: 2.1 time: 0.713465 Oct 29 03:12:14.513832 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2835/5701] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:13 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:15.540224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b088d88-21ec-4297-8fb1-5dda7be38d34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:15.544369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b088d88-21ec-4297-8fb1-5dda7be38d34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:15.557550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=36 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:15.561053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b088d88-21ec-4297-8fb1-5dda7be38d34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:15.567007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b088d88-21ec-4297-8fb1-5dda7be38d34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:15.569125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b088d88-21ec-4297-8fb1-5dda7be38d34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:15.578525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b088d88-21ec-4297-8fb1-5dda7be38d34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:15.579636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b088d88-21ec-4297-8fb1-5dda7be38d34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:15.580262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b088d88-21ec-4297-8fb1-5dda7be38d34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:15.971211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2b088d88-21ec-4297-8fb1-5dda7be38d34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:15.983338 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b088d88-21ec-4297-8fb1-5dda7be38d34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1313 microversion: 2.1 time: 0.446915 Oct 29 03:12:15.987559 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2867/5702] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:15 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:17.017977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4d0440fa-b679-441a-affd-88e11fecb568 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:17.018662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4d0440fa-b679-441a-affd-88e11fecb568 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:17.031752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d0440fa-b679-441a-affd-88e11fecb568 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:17.033317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d0440fa-b679-441a-affd-88e11fecb568 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:17.034559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d0440fa-b679-441a-affd-88e11fecb568 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:17.042656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d0440fa-b679-441a-affd-88e11fecb568 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:17.043432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d0440fa-b679-441a-affd-88e11fecb568 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:17.044063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d0440fa-b679-441a-affd-88e11fecb568 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:17.595408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-01e2d110-d14f-498e-93c5-04799255425b req-5dc898f7-7d6b-46ed-b47d-5d1ba092ab84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e455ad-f8cf-484d-9e70-4ed6f3e5be5c", "name": "network-vif-plugged", "status": "completed", "tag": "0a18bdb1-b19a-4262-b7f3-6102febee682"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:17.607596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-01e2d110-d14f-498e-93c5-04799255425b req-5dc898f7-7d6b-46ed-b47d-5d1ba092ab84 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:17.608530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-01e2d110-d14f-498e-93c5-04799255425b req-5dc898f7-7d6b-46ed-b47d-5d1ba092ab84 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:17.609097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-01e2d110-d14f-498e-93c5-04799255425b req-5dc898f7-7d6b-46ed-b47d-5d1ba092ab84 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:17.627794 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-01e2d110-d14f-498e-93c5-04799255425b req-5dc898f7-7d6b-46ed-b47d-5d1ba092ab84 service nova] Creating event network-vif-plugged:0a18bdb1-b19a-4262-b7f3-6102febee682 for instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c on n-h2-862964-4 Oct 29 03:12:17.634888 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-01e2d110-d14f-498e-93c5-04799255425b req-5dc898f7-7d6b-46ed-b47d-5d1ba092ab84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043488 Oct 29 03:12:17.636274 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2868/5703] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:12:17.688107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4d0440fa-b679-441a-affd-88e11fecb568 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:17.712498 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4d0440fa-b679-441a-affd-88e11fecb568 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1313 microversion: 2.1 time: 0.701698 Oct 29 03:12:17.713112 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2836/5704] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:17 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1313 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:18.737360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-98e0ee4e-9ccd-4525-85c1-9166a2786bc7 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:18.737969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-98e0ee4e-9ccd-4525-85c1-9166a2786bc7 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:18.739165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c363437e-a479-466f-977e-cf1ef5ecb194 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:18.745283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c363437e-a479-466f-977e-cf1ef5ecb194 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:18.756192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e0ee4e-9ccd-4525-85c1-9166a2786bc7 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:18.762881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e0ee4e-9ccd-4525-85c1-9166a2786bc7 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:18.763719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e0ee4e-9ccd-4525-85c1-9166a2786bc7 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:18.764639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e0ee4e-9ccd-4525-85c1-9166a2786bc7 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:18.766826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e0ee4e-9ccd-4525-85c1-9166a2786bc7 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:18.770466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98e0ee4e-9ccd-4525-85c1-9166a2786bc7 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:18.772062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c363437e-a479-466f-977e-cf1ef5ecb194 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:18.773878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c363437e-a479-466f-977e-cf1ef5ecb194 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:18.775771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c363437e-a479-466f-977e-cf1ef5ecb194 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:18.777279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c363437e-a479-466f-977e-cf1ef5ecb194 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:18.779454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c363437e-a479-466f-977e-cf1ef5ecb194 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:18.780075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c363437e-a479-466f-977e-cf1ef5ecb194 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:18.850198 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c363437e-a479-466f-977e-cf1ef5ecb194 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123852 Oct 29 03:12:18.851453 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2869/5705] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:18 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:12:18.982714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51119968-dc52-466c-b820-59bbfc322a4d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:18.983196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-51119968-dc52-466c-b820-59bbfc322a4d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:18.992708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51119968-dc52-466c-b820-59bbfc322a4d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:18.994152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51119968-dc52-466c-b820-59bbfc322a4d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:18.994761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51119968-dc52-466c-b820-59bbfc322a4d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:18.997538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51119968-dc52-466c-b820-59bbfc322a4d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:18.998523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51119968-dc52-466c-b820-59bbfc322a4d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:19.000125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51119968-dc52-466c-b820-59bbfc322a4d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:19.072102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:19.096304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-51119968-dc52-466c-b820-59bbfc322a4d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:12:19.301430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:19.306637 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-51119968-dc52-466c-b820-59bbfc322a4d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 204 len: 0 microversion: 2.1 time: 0.327328 Oct 29 03:12:19.307786 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2870/5706] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:12:18 2022] DELETE /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:12:19.319172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aab70e9f-e198-41a7-9d66-33960ddddcf9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:19.319947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aab70e9f-e198-41a7-9d66-33960ddddcf9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:19.328568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aab70e9f-e198-41a7-9d66-33960ddddcf9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:19.329289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aab70e9f-e198-41a7-9d66-33960ddddcf9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:19.330012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aab70e9f-e198-41a7-9d66-33960ddddcf9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:19.330909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aab70e9f-e198-41a7-9d66-33960ddddcf9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:19.331675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aab70e9f-e198-41a7-9d66-33960ddddcf9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:19.333318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aab70e9f-e198-41a7-9d66-33960ddddcf9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:19.351898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-98e0ee4e-9ccd-4525-85c1-9166a2786bc7 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:19.361372 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-98e0ee4e-9ccd-4525-85c1-9166a2786bc7 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1313 microversion: 2.1 time: 0.628599 Oct 29 03:12:19.376709 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2837/5707] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:18 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:20.301061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aab70e9f-e198-41a7-9d66-33960ddddcf9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:20.310219 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aab70e9f-e198-41a7-9d66-33960ddddcf9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1673 microversion: 2.1 time: 0.997799 Oct 29 03:12:20.316186 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2871/5708] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:19 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1673 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:20.388822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-417a7e91-8d6e-46a5-b30c-73c8ef78a83c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:20.389447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-417a7e91-8d6e-46a5-b30c-73c8ef78a83c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:20.397672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-417a7e91-8d6e-46a5-b30c-73c8ef78a83c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:20.398334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-417a7e91-8d6e-46a5-b30c-73c8ef78a83c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:20.398915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-417a7e91-8d6e-46a5-b30c-73c8ef78a83c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:20.399805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-417a7e91-8d6e-46a5-b30c-73c8ef78a83c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:20.400368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-417a7e91-8d6e-46a5-b30c-73c8ef78a83c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:20.400893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-417a7e91-8d6e-46a5-b30c-73c8ef78a83c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:20.687329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-417a7e91-8d6e-46a5-b30c-73c8ef78a83c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:20.695902 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-417a7e91-8d6e-46a5-b30c-73c8ef78a83c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1497 microversion: 2.1 time: 0.310979 Oct 29 03:12:20.696496 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2838/5709] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:20 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1497 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:20.724002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be76016c-00e7-4ee6-b08a-94d12e442c47 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:20.764930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.compute.server_groups [None req-be76016c-00e7-4ee6-b08a-94d12e442c47 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Querying cell 6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) for 1 instances {{(pid=127042) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 03:12:20.765661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be76016c-00e7-4ee6-b08a-94d12e442c47 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:20.770313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be76016c-00e7-4ee6-b08a-94d12e442c47 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:20.770781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be76016c-00e7-4ee6-b08a-94d12e442c47 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:20.832967 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be76016c-00e7-4ee6-b08a-94d12e442c47 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/33ede29d-55e5-41d4-98da-8ba68045d9a2" status: 200 len: 222 microversion: 2.1 time: 0.116388 Oct 29 03:12:20.834155 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2872/5710] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:12:20 2022] GET /compute/v2.1/os-server-groups/33ede29d-55e5-41d4-98da-8ba68045d9a2 => generated 222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:20.845012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4429d94c-c3da-4d29-ade5-fbb7a87e8d93 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:20.845508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4429d94c-c3da-4d29-ade5-fbb7a87e8d93 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:20.856407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4429d94c-c3da-4d29-ade5-fbb7a87e8d93 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:20.857498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4429d94c-c3da-4d29-ade5-fbb7a87e8d93 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:20.857976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4429d94c-c3da-4d29-ade5-fbb7a87e8d93 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:20.858677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4429d94c-c3da-4d29-ade5-fbb7a87e8d93 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:20.862748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4429d94c-c3da-4d29-ade5-fbb7a87e8d93 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:20.864425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4429d94c-c3da-4d29-ade5-fbb7a87e8d93 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:20.941061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4429d94c-c3da-4d29-ade5-fbb7a87e8d93 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:12:21.092916 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4429d94c-c3da-4d29-ade5-fbb7a87e8d93 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "DELETE /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 204 len: 0 microversion: 2.1 time: 0.251603 Oct 29 03:12:21.093609 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2839/5711] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:12:20 2022] DELETE /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:12:21.103003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4db696ac-c9ad-4129-ade4-491c5d1a1e0e tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:21.103498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4db696ac-c9ad-4129-ade4-491c5d1a1e0e tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:21.110006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4db696ac-c9ad-4129-ade4-491c5d1a1e0e tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:21.111040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4db696ac-c9ad-4129-ade4-491c5d1a1e0e tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:21.112674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4db696ac-c9ad-4129-ade4-491c5d1a1e0e tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:21.113692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4db696ac-c9ad-4129-ade4-491c5d1a1e0e tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:21.114767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4db696ac-c9ad-4129-ade4-491c5d1a1e0e tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:21.120070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4db696ac-c9ad-4129-ade4-491c5d1a1e0e tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:21.337991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fcb999f9-de1a-42c0-aa4f-870bbbf0571c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:21.340151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fcb999f9-de1a-42c0-aa4f-870bbbf0571c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:21.347608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcb999f9-de1a-42c0-aa4f-870bbbf0571c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:21.348733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcb999f9-de1a-42c0-aa4f-870bbbf0571c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:21.349291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcb999f9-de1a-42c0-aa4f-870bbbf0571c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:21.350153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcb999f9-de1a-42c0-aa4f-870bbbf0571c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:21.350835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcb999f9-de1a-42c0-aa4f-870bbbf0571c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:21.351445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fcb999f9-de1a-42c0-aa4f-870bbbf0571c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:21.629582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4db696ac-c9ad-4129-ade4-491c5d1a1e0e tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:21.639373 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4db696ac-c9ad-4129-ade4-491c5d1a1e0e tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1503 microversion: 2.1 time: 0.541136 Oct 29 03:12:21.660665 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2873/5712] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:21 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1503 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:22.127996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fcb999f9-de1a-42c0-aa4f-870bbbf0571c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:22.137474 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fcb999f9-de1a-42c0-aa4f-870bbbf0571c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1673 microversion: 2.1 time: 0.804309 Oct 29 03:12:22.142683 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2840/5713] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:21 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1673 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:22.664708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f5b87115-bd8f-4026-b0fa-64e3224e865f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:22.665319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f5b87115-bd8f-4026-b0fa-64e3224e865f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:22.682885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5b87115-bd8f-4026-b0fa-64e3224e865f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:22.684886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5b87115-bd8f-4026-b0fa-64e3224e865f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:22.685678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5b87115-bd8f-4026-b0fa-64e3224e865f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:22.686662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5b87115-bd8f-4026-b0fa-64e3224e865f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:22.687974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5b87115-bd8f-4026-b0fa-64e3224e865f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:22.689472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5b87115-bd8f-4026-b0fa-64e3224e865f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:23.167076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-798845db-abe3-4f14-9cad-65af807b8c6c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:23.167687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-798845db-abe3-4f14-9cad-65af807b8c6c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:23.182354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-798845db-abe3-4f14-9cad-65af807b8c6c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:23.184889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-798845db-abe3-4f14-9cad-65af807b8c6c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:23.185343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-798845db-abe3-4f14-9cad-65af807b8c6c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:23.188998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-798845db-abe3-4f14-9cad-65af807b8c6c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:23.189509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-798845db-abe3-4f14-9cad-65af807b8c6c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:23.191833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-798845db-abe3-4f14-9cad-65af807b8c6c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:23.463986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-798845db-abe3-4f14-9cad-65af807b8c6c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:23.477700 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-798845db-abe3-4f14-9cad-65af807b8c6c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1606 microversion: 2.1 time: 0.314886 Oct 29 03:12:23.481865 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2841/5714] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:23 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1606 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:23.570012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f5b87115-bd8f-4026-b0fa-64e3224e865f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:23.583392 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f5b87115-bd8f-4026-b0fa-64e3224e865f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1503 microversion: 2.1 time: 0.920707 Oct 29 03:12:23.586855 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2874/5715] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:22 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1503 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:24.508976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b53de1a-b477-48ef-9bf9-fd4922217a8b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:24.509835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4b53de1a-b477-48ef-9bf9-fd4922217a8b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:24.521010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b53de1a-b477-48ef-9bf9-fd4922217a8b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:24.526207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b53de1a-b477-48ef-9bf9-fd4922217a8b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:24.526857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b53de1a-b477-48ef-9bf9-fd4922217a8b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:24.527931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b53de1a-b477-48ef-9bf9-fd4922217a8b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:24.535974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b53de1a-b477-48ef-9bf9-fd4922217a8b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:24.536425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b53de1a-b477-48ef-9bf9-fd4922217a8b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:24.609880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45fbfd07-aa24-4d74-826e-ed89536defae tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:24.610510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-45fbfd07-aa24-4d74-826e-ed89536defae tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:24.618231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fbfd07-aa24-4d74-826e-ed89536defae tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:24.618908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fbfd07-aa24-4d74-826e-ed89536defae tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:24.619488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fbfd07-aa24-4d74-826e-ed89536defae tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:24.620361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fbfd07-aa24-4d74-826e-ed89536defae tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:24.620961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fbfd07-aa24-4d74-826e-ed89536defae tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:24.621524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45fbfd07-aa24-4d74-826e-ed89536defae tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:24.794798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-45fbfd07-aa24-4d74-826e-ed89536defae tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:24.804223 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-45fbfd07-aa24-4d74-826e-ed89536defae tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1461 microversion: 2.1 time: 0.199499 Oct 29 03:12:24.804828 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2875/5716] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:24 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1461 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:24.944152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-78772a39-7cab-45d7-8d97-a177a1de983a req-f2abd2e6-5291-48bd-9e6f-caf6e985d75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e455ad-f8cf-484d-9e70-4ed6f3e5be5c", "name": "network-vif-deleted", "tag": "0a18bdb1-b19a-4262-b7f3-6102febee682"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:24.959972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-78772a39-7cab-45d7-8d97-a177a1de983a req-f2abd2e6-5291-48bd-9e6f-caf6e985d75c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:24.960718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-78772a39-7cab-45d7-8d97-a177a1de983a req-f2abd2e6-5291-48bd-9e6f-caf6e985d75c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:24.961303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-78772a39-7cab-45d7-8d97-a177a1de983a req-f2abd2e6-5291-48bd-9e6f-caf6e985d75c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:25.013886 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-78772a39-7cab-45d7-8d97-a177a1de983a req-f2abd2e6-5291-48bd-9e6f-caf6e985d75c service nova] Creating event network-vif-deleted:0a18bdb1-b19a-4262-b7f3-6102febee682 for instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c on n-h2-862964-4 Oct 29 03:12:25.034790 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-78772a39-7cab-45d7-8d97-a177a1de983a req-f2abd2e6-5291-48bd-9e6f-caf6e985d75c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095778 Oct 29 03:12:25.053310 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2876/5717] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:25.745518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b53de1a-b477-48ef-9bf9-fd4922217a8b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:25.761538 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4b53de1a-b477-48ef-9bf9-fd4922217a8b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1606 microversion: 2.1 time: 1.256276 Oct 29 03:12:25.773934 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2842/5718] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:24 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1606 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:25.832351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:25.833050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:25.848495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:25.848982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:25.849414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:25.850178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:25.850615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:25.854332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:25.932459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:25.933385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:25.933999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:25.934667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lazy-loading 'fault' on Instance uuid 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:12:26.061134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc26b3ebcdfe4bea81cab484f092b401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '393e2b2202cb46e8b1603038f079b9aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:26.073114 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-32dd1cc4-5390-4360-b818-b9ab00f92536 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 200 len: 1303 microversion: 2.1 time: 0.245196 Oct 29 03:12:26.082090 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2877/5719] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:25 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 1303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:26.460141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-18b52e9d-1c94-46e2-86b5-66c13a0c8b04 req-5a5e8e36-dbbd-4417-8391-e610670d2efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15eb84a-805e-4a1f-abfb-f0c495c463b6", "name": "network-vif-deleted", "tag": "741e7b99-4744-4575-82a2-e9205a08d484"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:26.497253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-18b52e9d-1c94-46e2-86b5-66c13a0c8b04 req-5a5e8e36-dbbd-4417-8391-e610670d2efa service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:26.498653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-18b52e9d-1c94-46e2-86b5-66c13a0c8b04 req-5a5e8e36-dbbd-4417-8391-e610670d2efa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:26.499761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-18b52e9d-1c94-46e2-86b5-66c13a0c8b04 req-5a5e8e36-dbbd-4417-8391-e610670d2efa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:26.533901 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-18b52e9d-1c94-46e2-86b5-66c13a0c8b04 req-5a5e8e36-dbbd-4417-8391-e610670d2efa service nova] Creating event network-vif-deleted:741e7b99-4744-4575-82a2-e9205a08d484 for instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 on n-h1-862964-4 Oct 29 03:12:26.552517 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-18b52e9d-1c94-46e2-86b5-66c13a0c8b04 req-5a5e8e36-dbbd-4417-8391-e610670d2efa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375259 Oct 29 03:12:26.556121 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2843/5720] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:26.786743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:26.787378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:26.799483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:26.803758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:26.804358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:26.805240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:26.805907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:26.806473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:26.911179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:26.912778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:26.913438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:26.914122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lazy-loading 'fault' on Instance uuid a15eb84a-805e-4a1f-abfb-f0c495c463b6 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:12:27.109429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:27.110154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:27.129233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:27.129986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:27.130430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:27.131150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:27.132267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:27.134805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:27.176082 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] HTTP exception thrown: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Request method failure captured: Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c HTTP/1.1 Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJn4kHUa3PvCZFPJ-rB32Fkt0_017DCmmU4d7iJEAN3-5FI8dwo12QFlzbliQi-at7YUw59rX8diaXxDqnetRGUvfWz3qYFODrloJSgRiFy6mHEfw7YmruzAn4Js5ccjJsvkDgELFMkvyenKJuhG4bn7_1p85Q7dVpHjZRyXJZz5Azg Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_393e2b2202cb46e8b1603038f079b9aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}] Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cc26b3ebcdfe4bea81cab484f092b401 Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '06e455ad-f8cf-484d-9e70-4ed6f3e5be5c'} Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.179999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.185586 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.185586 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.185586 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.185586 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:27.185586 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:27.185586 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.185586 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.187766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Returning 404 to user: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:27.189231 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4b0f3577-59f4-403e-af92-5d909d579618 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 404 len: 111 microversion: 2.1 time: 0.084126 Oct 29 03:12:27.196951 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2844/5721] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:27 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:12:27.214984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8baae9b6-8c33-41f3-a61a-0e8f4e91b9cb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:27.240487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.compute.server_groups [None req-8baae9b6-8c33-41f3-a61a-0e8f4e91b9cb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Querying cell 6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) for 1 instances {{(pid=127041) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 03:12:27.244128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8baae9b6-8c33-41f3-a61a-0e8f4e91b9cb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:27.244610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8baae9b6-8c33-41f3-a61a-0e8f4e91b9cb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:27.245045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8baae9b6-8c33-41f3-a61a-0e8f4e91b9cb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:27.261638 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8baae9b6-8c33-41f3-a61a-0e8f4e91b9cb tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.063193 Oct 29 03:12:27.262351 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2845/5722] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 03:12:27 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:27.280878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ad3bd6af-2d80-46d6-8630-7f3a7ec0e405 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:27.314672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.compute.server_groups [None req-ad3bd6af-2d80-46d6-8630-7f3a7ec0e405 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Querying cell 6e360a35-3f1b-44d0-a54d-47a31b18ebee(cell1) for 1 instances {{(pid=127041) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 03:12:27.314672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad3bd6af-2d80-46d6-8630-7f3a7ec0e405 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:27.314836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad3bd6af-2d80-46d6-8630-7f3a7ec0e405 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:27.315190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ad3bd6af-2d80-46d6-8630-7f3a7ec0e405 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:27.342081 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ad3bd6af-2d80-46d6-8630-7f3a7ec0e405 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/33ede29d-55e5-41d4-98da-8ba68045d9a2" status: 200 len: 184 microversion: 2.1 time: 0.071429 Oct 29 03:12:27.346495 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2846/5723] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:12:27 2022] GET /compute/v2.1/os-server-groups/33ede29d-55e5-41d4-98da-8ba68045d9a2 => generated 184 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:12:27.356713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:27.357858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:27.369206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:27.370026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:27.370620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:27.371627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:27.372220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:27.372782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:27.397587 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] HTTP exception thrown: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Request method failure captured: Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c HTTP/1.1 Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJn4kHUa3PvCZFPJ-rB32Fkt0_017DCmmU4d7iJEAN3-5FI8dwo12QFlzbliQi-at7YUw59rX8diaXxDqnetRGUvfWz3qYFODrloJSgRiFy6mHEfw7YmruzAn4Js5ccjJsvkDgELFMkvyenKJuhG4bn7_1p85Q7dVpHjZRyXJZz5Azg Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_393e2b2202cb46e8b1603038f079b9aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}] Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cc26b3ebcdfe4bea81cab484f092b401 Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '06e455ad-f8cf-484d-9e70-4ed6f3e5be5c'} Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:12:27.399881 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:27.403915 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.403915 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.403915 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.403915 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.403915 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.403915 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.403915 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.403915 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:27.403915 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:27.403915 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.403915 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.405580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Returning 404 to user: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:27.406799 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-863d1264-0d5e-41a3-a166-57724b642275 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "DELETE /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 404 len: 111 microversion: 2.1 time: 0.054412 Oct 29 03:12:27.407968 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2847/5724] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:12:27 2022] DELETE /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:12:27.421139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:27.422506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] [instance: 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:27.441727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:27.442803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:27.445295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:27.446465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:27.447295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:27.450223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:27.480575 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] HTTP exception thrown: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Request method failure captured: Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c HTTP/1.1 Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJn4kHUa3PvCZFPJ-rB32Fkt0_017DCmmU4d7iJEAN3-5FI8dwo12QFlzbliQi-at7YUw59rX8diaXxDqnetRGUvfWz3qYFODrloJSgRiFy6mHEfw7YmruzAn4Js5ccjJsvkDgELFMkvyenKJuhG4bn7_1p85Q7dVpHjZRyXJZz5Azg Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_393e2b2202cb46e8b1603038f079b9aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}] Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cc26b3ebcdfe4bea81cab484f092b401 Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '06e455ad-f8cf-484d-9e70-4ed6f3e5be5c'} Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.482162 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.486256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.486256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.486256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.486256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:27.486256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:27.486256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. Oct 29 03:12:27.486256 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.496926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Returning 404 to user: Instance 06e455ad-f8cf-484d-9e70-4ed6f3e5be5c could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:27.498098 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3837935b-5374-4ea6-ad52-397dfbff270f tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c" status: 404 len: 111 microversion: 2.1 time: 0.086229 Oct 29 03:12:27.500920 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2848/5725] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:27 2022] GET /compute/v2.1/servers/06e455ad-f8cf-484d-9e70-4ed6f3e5be5c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:12:27.515996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be85a303-be99-48b8-9db6-bc042633426c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:27.531852 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-be85a303-be99-48b8-9db6-bc042633426c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] HTTP exception thrown: Instance group 37f2ee1b-592f-4292-a441-575a74abb543 could not be found. Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be85a303-be99-48b8-9db6-bc042633426c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Request method failure captured: Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-server-groups/37f2ee1b-592f-4292-a441-575a74abb543 HTTP/1.1 Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJn4kHUa3PvCZFPJ-rB32Fkt0_017DCmmU4d7iJEAN3-5FI8dwo12QFlzbliQi-at7YUw59rX8diaXxDqnetRGUvfWz3qYFODrloJSgRiFy6mHEfw7YmruzAn4Js5ccjJsvkDgELFMkvyenKJuhG4bn7_1p85Q7dVpHjZRyXJZz5Azg Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_393e2b2202cb46e8b1603038f079b9aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}] Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cc26b3ebcdfe4bea81cab484f092b401 Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance group 37f2ee1b-592f-4292-a441-575a74abb543 could not be found. Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '37f2ee1b-592f-4292-a441-575a74abb543'} Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 37f2ee1b-592f-4292-a441-575a74abb543 could not be found. Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 37f2ee1b-592f-4292-a441-575a74abb543 could not be found. Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.536275 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.540465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.540465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.540465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:27.540465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:27.540465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 37f2ee1b-592f-4292-a441-575a74abb543 could not be found. Oct 29 03:12:27.540465 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.548880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be85a303-be99-48b8-9db6-bc042633426c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Returning 404 to user: Instance group 37f2ee1b-592f-4292-a441-575a74abb543 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:27.548880 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-be85a303-be99-48b8-9db6-bc042633426c tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/37f2ee1b-592f-4292-a441-575a74abb543" status: 404 len: 117 microversion: 2.1 time: 0.034971 Oct 29 03:12:27.548880 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2849/5726] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:12:27 2022] DELETE /compute/v2.1/os-server-groups/37f2ee1b-592f-4292-a441-575a74abb543 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:12:27.565628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-42ad5527-e410-4fa9-8431-dc8bfe184a79 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:27.578160 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-42ad5527-e410-4fa9-8431-dc8bfe184a79 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] HTTP exception thrown: Instance group 9b853abe-3d19-43da-a7eb-cf8443360112 could not be found. Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-42ad5527-e410-4fa9-8431-dc8bfe184a79 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Request method failure captured: Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-server-groups/9b853abe-3d19-43da-a7eb-cf8443360112 HTTP/1.1 Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJn4kHUa3PvCZFPJ-rB32Fkt0_017DCmmU4d7iJEAN3-5FI8dwo12QFlzbliQi-at7YUw59rX8diaXxDqnetRGUvfWz3qYFODrloJSgRiFy6mHEfw7YmruzAn4Js5ccjJsvkDgELFMkvyenKJuhG4bn7_1p85Q7dVpHjZRyXJZz5Azg Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_393e2b2202cb46e8b1603038f079b9aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}] Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cc26b3ebcdfe4bea81cab484f092b401 Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance group 9b853abe-3d19-43da-a7eb-cf8443360112 could not be found. Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '9b853abe-3d19-43da-a7eb-cf8443360112'} Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9b853abe-3d19-43da-a7eb-cf8443360112 could not be found. Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9b853abe-3d19-43da-a7eb-cf8443360112 could not be found. Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.579704 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.583783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.583783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.583783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:27.583783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:27.583783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9b853abe-3d19-43da-a7eb-cf8443360112 could not be found. Oct 29 03:12:27.583783 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.583783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-42ad5527-e410-4fa9-8431-dc8bfe184a79 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Returning 404 to user: Instance group 9b853abe-3d19-43da-a7eb-cf8443360112 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:27.583783 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-42ad5527-e410-4fa9-8431-dc8bfe184a79 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/9b853abe-3d19-43da-a7eb-cf8443360112" status: 404 len: 117 microversion: 2.1 time: 0.027788 Oct 29 03:12:27.583783 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2850/5727] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:12:27 2022] DELETE /compute/v2.1/os-server-groups/9b853abe-3d19-43da-a7eb-cf8443360112 => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:12:27.590601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-917bf8ff-2a0e-4a19-bb1a-a94e97d19c75 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:27.594737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:27.597121 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-917bf8ff-2a0e-4a19-bb1a-a94e97d19c75 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] HTTP exception thrown: Instance group 7d11259d-2d86-41b9-9536-bf0cc1b7fdcd could not be found. Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-917bf8ff-2a0e-4a19-bb1a-a94e97d19c75 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Request method failure captured: Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-server-groups/7d11259d-2d86-41b9-9536-bf0cc1b7fdcd HTTP/1.1 Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJn4kHUa3PvCZFPJ-rB32Fkt0_017DCmmU4d7iJEAN3-5FI8dwo12QFlzbliQi-at7YUw59rX8diaXxDqnetRGUvfWz3qYFODrloJSgRiFy6mHEfw7YmruzAn4Js5ccjJsvkDgELFMkvyenKJuhG4bn7_1p85Q7dVpHjZRyXJZz5Azg Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_393e2b2202cb46e8b1603038f079b9aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}] Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cc26b3ebcdfe4bea81cab484f092b401 Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance group 7d11259d-2d86-41b9-9536-bf0cc1b7fdcd could not be found. Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '7d11259d-2d86-41b9-9536-bf0cc1b7fdcd'} Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7d11259d-2d86-41b9-9536-bf0cc1b7fdcd could not be found. Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7d11259d-2d86-41b9-9536-bf0cc1b7fdcd could not be found. Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.598887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.605607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.605607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.605607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:27.605607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:27.605607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7d11259d-2d86-41b9-9536-bf0cc1b7fdcd could not be found. Oct 29 03:12:27.605607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.605607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-917bf8ff-2a0e-4a19-bb1a-a94e97d19c75 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Returning 404 to user: Instance group 7d11259d-2d86-41b9-9536-bf0cc1b7fdcd could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:27.605607 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-917bf8ff-2a0e-4a19-bb1a-a94e97d19c75 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/7d11259d-2d86-41b9-9536-bf0cc1b7fdcd" status: 404 len: 117 microversion: 2.1 time: 0.014026 Oct 29 03:12:27.605607 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2851/5728] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:12:27 2022] DELETE /compute/v2.1/os-server-groups/7d11259d-2d86-41b9-9536-bf0cc1b7fdcd => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:12:27.608791 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3a0e1de8-3435-40aa-87fe-c5f481430c87 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 200 len: 1327 microversion: 2.1 time: 0.827613 Oct 29 03:12:27.609569 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2878/5729] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:26 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 1327 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:27.612056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-694b80db-4186-432a-89d6-862c4cfbef34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:27.632723 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-694b80db-4186-432a-89d6-862c4cfbef34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] HTTP exception thrown: Instance group 1b14988c-7e14-49a7-9182-a1ee4c8f657f could not be found. Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-694b80db-4186-432a-89d6-862c4cfbef34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Request method failure captured: Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/os-server-groups/1b14988c-7e14-49a7-9182-a1ee4c8f657f HTTP/1.1 Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJn4kHUa3PvCZFPJ-rB32Fkt0_017DCmmU4d7iJEAN3-5FI8dwo12QFlzbliQi-at7YUw59rX8diaXxDqnetRGUvfWz3qYFODrloJSgRiFy6mHEfw7YmruzAn4Js5ccjJsvkDgELFMkvyenKJuhG4bn7_1p85Q7dVpHjZRyXJZz5Azg Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_393e2b2202cb46e8b1603038f079b9aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/393e2b2202cb46e8b1603038f079b9aa"}]}] Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 393e2b2202cb46e8b1603038f079b9aa Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerGroupTestJSON-1107779121 Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: cc26b3ebcdfe4bea81cab484f092b401 Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerGroupTestJSON-1107779121-project Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance group 1b14988c-7e14-49a7-9182-a1ee4c8f657f could not be found. Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1b14988c-7e14-49a7-9182-a1ee4c8f657f'} Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1b14988c-7e14-49a7-9182-a1ee4c8f657f could not be found. Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1b14988c-7e14-49a7-9182-a1ee4c8f657f could not be found. Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.637259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:27.644059 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:27.644059 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:27.644059 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:27.644059 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:27.644059 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1b14988c-7e14-49a7-9182-a1ee4c8f657f could not be found. Oct 29 03:12:27.644059 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:27.644059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-694b80db-4186-432a-89d6-862c4cfbef34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Returning 404 to user: Instance group 1b14988c-7e14-49a7-9182-a1ee4c8f657f could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:27.644059 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-694b80db-4186-432a-89d6-862c4cfbef34 tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/1b14988c-7e14-49a7-9182-a1ee4c8f657f" status: 404 len: 117 microversion: 2.1 time: 0.033029 Oct 29 03:12:27.644059 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2852/5730] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:12:27 2022] DELETE /compute/v2.1/os-server-groups/1b14988c-7e14-49a7-9182-a1ee4c8f657f => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:12:27.649645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-288b56d6-359b-4f91-963c-be57b9681fde tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:27.699922 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-288b56d6-359b-4f91-963c-be57b9681fde tempest-ServerGroupTestJSON-1107779121 tempest-ServerGroupTestJSON-1107779121-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/33ede29d-55e5-41d4-98da-8ba68045d9a2" status: 204 len: 0 microversion: 2.1 time: 0.054054 Oct 29 03:12:27.700856 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2879/5731] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:12:27 2022] DELETE /compute/v2.1/os-server-groups/33ede29d-55e5-41d4-98da-8ba68045d9a2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:12:28.638606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:28.639977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:28.653339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:28.656251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:28.657279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:28.659227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:28.660338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:28.662090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:28.662919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:28.703765 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] HTTP exception thrown: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Request method failure captured: Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 HTTP/1.1 Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJlCIGQhVW_9VpbQRjyKddjGr1_Frj1Tg9-G58COkKQiRZ2cCRdmWbOJI48UOlXkoa70xuji6ps-cI-nKgpLRhq62ueIANiYRGqj3PZjVExgX0BM3ox1KWKRuUbmyYkwu9NUHZZQ4jahYN1wOtYCjAi5RwjGGjpciCjnc3WrfUtI_0Y Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70185f31a11248d79b722001900d890a Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70185f31a11248d79b722001900d890a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70185f31a11248d79b722001900d890a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}] Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70185f31a11248d79b722001900d890a Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 4aab5eb9a3764e75863bf930c2bbd8bd Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'a15eb84a-805e-4a1f-abfb-f0c495c463b6'} Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:28.709055 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:28.712457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:28.712457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:28.712457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:28.712457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:28.712457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:28.712457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:12:28.712457 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:28.714500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Returning 404 to user: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:28.715828 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ef144b82-7601-4520-809b-b501bc07bacd tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 404 len: 111 microversion: 2.1 time: 0.084151 Oct 29 03:12:28.716932 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2853/5732] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:28 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:12:28.726659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a269f11d-69dd-4286-b453-a0b1e6d0dac3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '.version_select at 0x7fe1a32f9ee0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:28.753637 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a269f11d-69dd-4286-b453-a0b1e6d0dac3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-690712398" status: 202 len: 0 microversion: 2.1 time: 0.031863 Oct 29 03:12:28.755294 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2880/5733] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 03:12:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-690712398 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:12:31.116418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-96f8a0be-ffaa-475d-b466-5b4de4a9bfe7 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Action: 'create', calling method: .version_select at 0x7fe1a38584c0>, body: {"keypair": {"name": "tempest-keypair-2056067123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoLT95fZIfBXbfRYPZb3CRbBVkZ18184UdW2tDkUuHIf16ZKDUMI+GN+JDCR7/KHS1r5RXCcCroZOQUFcyfTka72ckwlDo8PdILNPPgY4Wo9oJLRdBRx8u3ZtA/RvkZcQ=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:31.136848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-96f8a0be-ffaa-475d-b466-5b4de4a9bfe7 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Getting quotas for project 70185f31a11248d79b722001900d890a. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:12:31.146743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-96f8a0be-ffaa-475d-b466-5b4de4a9bfe7 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Getting quotas for user 4aab5eb9a3764e75863bf930c2bbd8bd and project 70185f31a11248d79b722001900d890a. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:12:31.210053 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-96f8a0be-ffaa-475d-b466-5b4de4a9bfe7 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097365 Oct 29 03:12:31.218613 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2854/5734] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:12:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:31.486726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-702007618", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "80eecc89-4c1b-45a3-bb46-061b101f676e"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:31.603912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] validate_networks() for [('80eecc89-4c1b-45a3-bb46-061b101f676e', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:12:33.264089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:12:33.264655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:12:33.264982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:12:33.265430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:12:33.266246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:12:33.307270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:33.311591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:33.313889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:33.314877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:33.316871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:33.319376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:33.372451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Getting quotas for project 015cadf2cdfb4250b719b96a082024ce. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:12:33.393903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Getting quotas for user bb414159a80d48f9bbce14d6f89b5334 and project 015cadf2cdfb4250b719b96a082024ce. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:12:33.428059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:12:33.433503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:12:33.548321 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-427c7e0c-2f39-4369-a13b-d765e21e83c1 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.189767 Oct 29 03:12:33.550105 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2881/5735] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:12:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:12:33.561900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-622110c4-41a4-48e6-827a-8e8e190bcd84 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:33.563594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-622110c4-41a4-48e6-827a-8e8e190bcd84 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:33.730912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-622110c4-41a4-48e6-827a-8e8e190bcd84 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:33.753859 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-622110c4-41a4-48e6-827a-8e8e190bcd84 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1224 microversion: 2.1 time: 0.197129 Oct 29 03:12:33.757929 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2855/5736] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:33 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1224 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:34.780854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b80bdcd5-8c3d-4552-9b32-566c76a3a26d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:34.783369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b80bdcd5-8c3d-4552-9b32-566c76a3a26d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:34.809100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b80bdcd5-8c3d-4552-9b32-566c76a3a26d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:34.827342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b80bdcd5-8c3d-4552-9b32-566c76a3a26d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:34.828799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b80bdcd5-8c3d-4552-9b32-566c76a3a26d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:34.847817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b80bdcd5-8c3d-4552-9b32-566c76a3a26d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:34.851361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b80bdcd5-8c3d-4552-9b32-566c76a3a26d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:34.852124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b80bdcd5-8c3d-4552-9b32-566c76a3a26d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:35.030116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b80bdcd5-8c3d-4552-9b32-566c76a3a26d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:35.042647 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b80bdcd5-8c3d-4552-9b32-566c76a3a26d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1220 microversion: 2.1 time: 0.266960 Oct 29 03:12:35.053147 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2882/5737] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:34 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1220 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:36.080491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b4de1513-b1c8-49db-b96d-8579dbd7deec tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:36.081844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b4de1513-b1c8-49db-b96d-8579dbd7deec tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:36.090328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4de1513-b1c8-49db-b96d-8579dbd7deec tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:36.091073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4de1513-b1c8-49db-b96d-8579dbd7deec tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:36.091681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4de1513-b1c8-49db-b96d-8579dbd7deec tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:36.092660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4de1513-b1c8-49db-b96d-8579dbd7deec tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:36.098741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4de1513-b1c8-49db-b96d-8579dbd7deec tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:36.099463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4de1513-b1c8-49db-b96d-8579dbd7deec tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:36.124881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:36.651774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b4de1513-b1c8-49db-b96d-8579dbd7deec tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:36.679894 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b4de1513-b1c8-49db-b96d-8579dbd7deec tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1282 microversion: 2.1 time: 0.603483 Oct 29 03:12:36.695389 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2856/5738] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:36 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1282 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:37.705293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-408635fd-1e72-4be1-b457-cdd275566617 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:37.706814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-408635fd-1e72-4be1-b457-cdd275566617 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:37.722026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408635fd-1e72-4be1-b457-cdd275566617 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:37.722923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408635fd-1e72-4be1-b457-cdd275566617 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:37.723567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408635fd-1e72-4be1-b457-cdd275566617 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:37.724492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408635fd-1e72-4be1-b457-cdd275566617 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:37.726068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408635fd-1e72-4be1-b457-cdd275566617 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:37.727630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-408635fd-1e72-4be1-b457-cdd275566617 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:37.876480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-408635fd-1e72-4be1-b457-cdd275566617 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:37.894329 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-408635fd-1e72-4be1-b457-cdd275566617 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1282 microversion: 2.1 time: 0.192613 Oct 29 03:12:37.909758 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2883/5739] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:37 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:38.657746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1893151744", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ee6d8c3-9928-4013-889f-bc9a08b57f9f"}], "security_groups": [{"name": "tempest-securitygroup--1482489797"}], "key_name": "tempest-keypair-2056067123", "user_data": "}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:38.926626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-703fe65b-7e20-4e3d-84aa-0bc6af1a1c2a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:38.927238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-703fe65b-7e20-4e3d-84aa-0bc6af1a1c2a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:38.942252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-703fe65b-7e20-4e3d-84aa-0bc6af1a1c2a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:38.943006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-703fe65b-7e20-4e3d-84aa-0bc6af1a1c2a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:38.947053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-703fe65b-7e20-4e3d-84aa-0bc6af1a1c2a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:38.948088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-703fe65b-7e20-4e3d-84aa-0bc6af1a1c2a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:38.948720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-703fe65b-7e20-4e3d-84aa-0bc6af1a1c2a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:38.949637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-703fe65b-7e20-4e3d-84aa-0bc6af1a1c2a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:39.004180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] validate_networks() for [('7ee6d8c3-9928-4013-889f-bc9a08b57f9f', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:12:40.192752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-703fe65b-7e20-4e3d-84aa-0bc6af1a1c2a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:40.210945 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-703fe65b-7e20-4e3d-84aa-0bc6af1a1c2a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1324 microversion: 2.1 time: 1.297393 Oct 29 03:12:40.212266 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2884/5740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:38 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1324 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:40.621321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:12:40.621925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:12:40.622231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:12:40.622773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:12:40.623035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:12:40.642019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:40.642752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:40.643443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:40.644430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:40.645210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:40.645793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:40.697646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Getting quotas for project 70185f31a11248d79b722001900d890a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:12:40.706200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Getting quotas for user 4aab5eb9a3764e75863bf930c2bbd8bd and project 70185f31a11248d79b722001900d890a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:12:40.740098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:12:40.742863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:12:40.836039 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c3f7969e-d2e3-4044-bc14-7837a3acc670 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.183375 Oct 29 03:12:40.843160 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2857/5741] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:12:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 2191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:12:40.849900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac1fd5a1-53b4-4361-8f22-ed1ce2031bcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:40.851034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ac1fd5a1-53b4-4361-8f22-ed1ce2031bcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:41.223611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ac1fd5a1-53b4-4361-8f22-ed1ce2031bcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:41.235973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0dd1ec3a-dd9c-4695-9290-2fb6d9b7e993 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:41.235973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0dd1ec3a-dd9c-4695-9290-2fb6d9b7e993 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:41.246118 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ac1fd5a1-53b4-4361-8f22-ed1ce2031bcb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1238 microversion: 2.1 time: 0.401634 Oct 29 03:12:41.251466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd1ec3a-dd9c-4695-9290-2fb6d9b7e993 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:41.251633 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2885/5742] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:40 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1238 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:41.254468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd1ec3a-dd9c-4695-9290-2fb6d9b7e993 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:41.255948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd1ec3a-dd9c-4695-9290-2fb6d9b7e993 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:41.258238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd1ec3a-dd9c-4695-9290-2fb6d9b7e993 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:41.264145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd1ec3a-dd9c-4695-9290-2fb6d9b7e993 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:41.264804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0dd1ec3a-dd9c-4695-9290-2fb6d9b7e993 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:42.283462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dbdfd62d-aa63-43d1-8706-a3d2f9f37262 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:42.285819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dbdfd62d-aa63-43d1-8706-a3d2f9f37262 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:42.295491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbdfd62d-aa63-43d1-8706-a3d2f9f37262 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:42.296261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbdfd62d-aa63-43d1-8706-a3d2f9f37262 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:42.297404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbdfd62d-aa63-43d1-8706-a3d2f9f37262 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:42.298833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbdfd62d-aa63-43d1-8706-a3d2f9f37262 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:42.298961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0dd1ec3a-dd9c-4695-9290-2fb6d9b7e993 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:42.300263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbdfd62d-aa63-43d1-8706-a3d2f9f37262 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:42.301192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbdfd62d-aa63-43d1-8706-a3d2f9f37262 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:42.307919 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0dd1ec3a-dd9c-4695-9290-2fb6d9b7e993 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1324 microversion: 2.1 time: 1.076618 Oct 29 03:12:42.308593 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2858/5743] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:41 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1324 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:42.629375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dbdfd62d-aa63-43d1-8706-a3d2f9f37262 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:42.640848 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dbdfd62d-aa63-43d1-8706-a3d2f9f37262 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1234 microversion: 2.1 time: 0.368120 Oct 29 03:12:42.641686 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2886/5744] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:42 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1234 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:43.338092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a7abec6-b374-45e7-90b0-5269afc7d273 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:43.340833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6a7abec6-b374-45e7-90b0-5269afc7d273 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:43.358311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7abec6-b374-45e7-90b0-5269afc7d273 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:43.358823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7abec6-b374-45e7-90b0-5269afc7d273 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:43.359268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7abec6-b374-45e7-90b0-5269afc7d273 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:43.360090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7abec6-b374-45e7-90b0-5269afc7d273 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:43.360553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7abec6-b374-45e7-90b0-5269afc7d273 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:43.360977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7abec6-b374-45e7-90b0-5269afc7d273 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:43.596681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4d17a281-f018-4451-91b8-bfd07b6f3694 req-07c6a8d8-b09e-4525-9e1d-169ebdfa7849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13326ccb-1056-453f-b9ac-65f29e0883a6", "tag": "b589f504-1893-45db-bbe7-89ade08b3a38"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:43.627740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:43.635969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4d17a281-f018-4451-91b8-bfd07b6f3694 req-07c6a8d8-b09e-4525-9e1d-169ebdfa7849 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:43.644221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4d17a281-f018-4451-91b8-bfd07b6f3694 req-07c6a8d8-b09e-4525-9e1d-169ebdfa7849 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:43.644929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4d17a281-f018-4451-91b8-bfd07b6f3694 req-07c6a8d8-b09e-4525-9e1d-169ebdfa7849 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:43.663820 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4d17a281-f018-4451-91b8-bfd07b6f3694 req-07c6a8d8-b09e-4525-9e1d-169ebdfa7849 service nova] Creating event network-changed:b589f504-1893-45db-bbe7-89ade08b3a38 for instance 13326ccb-1056-453f-b9ac-65f29e0883a6 on n-h1-862964-4 Oct 29 03:12:43.679462 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4d17a281-f018-4451-91b8-bfd07b6f3694 req-07c6a8d8-b09e-4525-9e1d-169ebdfa7849 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089764 Oct 29 03:12:43.681553 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2887/5745] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:43.694229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5c297cb-90d4-41cd-bb06-2e119f49d032 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:43.696103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b5c297cb-90d4-41cd-bb06-2e119f49d032 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:43.704247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c297cb-90d4-41cd-bb06-2e119f49d032 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:43.704646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c297cb-90d4-41cd-bb06-2e119f49d032 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:43.705410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c297cb-90d4-41cd-bb06-2e119f49d032 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:43.706215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c297cb-90d4-41cd-bb06-2e119f49d032 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:43.707326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c297cb-90d4-41cd-bb06-2e119f49d032 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:43.707869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c297cb-90d4-41cd-bb06-2e119f49d032 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:43.963998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b5c297cb-90d4-41cd-bb06-2e119f49d032 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:43.973094 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b5c297cb-90d4-41cd-bb06-2e119f49d032 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1296 microversion: 2.1 time: 0.289854 Oct 29 03:12:43.974301 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2888/5746] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:43 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1296 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:44.367018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a7abec6-b374-45e7-90b0-5269afc7d273 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:44.383630 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a7abec6-b374-45e7-90b0-5269afc7d273 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1324 microversion: 2.1 time: 1.054053 Oct 29 03:12:44.385464 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2859/5747] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:43 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1324 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:45.001438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cc66c8b4-e5df-43b3-a480-882262fcf4c8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:45.002189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cc66c8b4-e5df-43b3-a480-882262fcf4c8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:45.010134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc66c8b4-e5df-43b3-a480-882262fcf4c8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:45.010722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc66c8b4-e5df-43b3-a480-882262fcf4c8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:45.011225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc66c8b4-e5df-43b3-a480-882262fcf4c8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:45.012041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc66c8b4-e5df-43b3-a480-882262fcf4c8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:45.012547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc66c8b4-e5df-43b3-a480-882262fcf4c8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:45.013183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cc66c8b4-e5df-43b3-a480-882262fcf4c8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:45.167974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cc66c8b4-e5df-43b3-a480-882262fcf4c8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:45.176490 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cc66c8b4-e5df-43b3-a480-882262fcf4c8 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1296 microversion: 2.1 time: 0.179698 Oct 29 03:12:45.177060 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2889/5748] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:44 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1296 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:45.411517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e22a36c0-570b-4779-a49c-c562b44e82f7 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:45.412198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e22a36c0-570b-4779-a49c-c562b44e82f7 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:45.421627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e22a36c0-570b-4779-a49c-c562b44e82f7 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:45.422695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e22a36c0-570b-4779-a49c-c562b44e82f7 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:45.423334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e22a36c0-570b-4779-a49c-c562b44e82f7 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:45.424476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e22a36c0-570b-4779-a49c-c562b44e82f7 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:45.425305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e22a36c0-570b-4779-a49c-c562b44e82f7 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:45.426143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e22a36c0-570b-4779-a49c-c562b44e82f7 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:45.953219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e22a36c0-570b-4779-a49c-c562b44e82f7 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:45.964397 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e22a36c0-570b-4779-a49c-c562b44e82f7 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1324 microversion: 2.1 time: 0.557009 Oct 29 03:12:45.966552 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2860/5749] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:45 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1324 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:46.199714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e1d125d5-d8d2-4d64-b0b6-5630a3151417 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:46.200835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e1d125d5-d8d2-4d64-b0b6-5630a3151417 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:46.222370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1d125d5-d8d2-4d64-b0b6-5630a3151417 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:46.222786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1d125d5-d8d2-4d64-b0b6-5630a3151417 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:46.223206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1d125d5-d8d2-4d64-b0b6-5630a3151417 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:46.224373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1d125d5-d8d2-4d64-b0b6-5630a3151417 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:46.226347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1d125d5-d8d2-4d64-b0b6-5630a3151417 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:46.227106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e1d125d5-d8d2-4d64-b0b6-5630a3151417 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:46.233014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:46.704248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e1d125d5-d8d2-4d64-b0b6-5630a3151417 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:46.724545 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e1d125d5-d8d2-4d64-b0b6-5630a3151417 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1364 microversion: 2.1 time: 0.527657 Oct 29 03:12:46.740582 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2890/5750] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:46 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1364 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:46.998104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a2f8fc7f-d1af-4077-88bd-c739bd96a193 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:46.998966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a2f8fc7f-d1af-4077-88bd-c739bd96a193 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:47.006980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2f8fc7f-d1af-4077-88bd-c739bd96a193 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:47.007627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2f8fc7f-d1af-4077-88bd-c739bd96a193 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:47.008210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2f8fc7f-d1af-4077-88bd-c739bd96a193 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:47.009124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2f8fc7f-d1af-4077-88bd-c739bd96a193 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:47.009832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2f8fc7f-d1af-4077-88bd-c739bd96a193 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:47.010493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2f8fc7f-d1af-4077-88bd-c739bd96a193 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:47.157548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2134755794", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": "none"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:47.234998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:12:47.235617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:12:47.235974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:12:47.236385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:12:47.236825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:12:47.251388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:47.252102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:47.252688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:47.253688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:47.254587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:47.255198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:47.276811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Getting quotas for project aa0cc560e4e64377bfa3239d8e6d1570. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:12:47.284104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Getting quotas for user b44e66d6ec5548789906a0f9e2f9f097 and project aa0cc560e4e64377bfa3239d8e6d1570. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:12:47.298926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:12:47.301901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:12:47.354681 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4cea2b58-7df0-449d-a097-0de79effb678 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.340322 Oct 29 03:12:47.355662 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2891/5751] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Oct 29 03:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:12:47.370343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0ba2ba8a-f06f-4583-9847-b09754e32162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:47.371298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0ba2ba8a-f06f-4583-9847-b09754e32162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:47.498305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a2f8fc7f-d1af-4077-88bd-c739bd96a193 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:47.512515 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a2f8fc7f-d1af-4077-88bd-c739bd96a193 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1324 microversion: 2.1 time: 0.522169 Oct 29 03:12:47.512960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0ba2ba8a-f06f-4583-9847-b09754e32162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:47.514189 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2861/5752] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:46 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1324 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:47.545094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0ba2ba8a-f06f-4583-9847-b09754e32162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:47.551389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0ba2ba8a-f06f-4583-9847-b09754e32162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:47.554484 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0ba2ba8a-f06f-4583-9847-b09754e32162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1278 microversion: 2.54 time: 0.191502 Oct 29 03:12:47.565203 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2892/5753] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:47 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:12:47.758065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-20e6db93-cc41-4e9c-bb6c-c039419a6a7a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:47.759622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-20e6db93-cc41-4e9c-bb6c-c039419a6a7a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:47.771221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20e6db93-cc41-4e9c-bb6c-c039419a6a7a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:47.772886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20e6db93-cc41-4e9c-bb6c-c039419a6a7a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:47.773544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20e6db93-cc41-4e9c-bb6c-c039419a6a7a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:47.775003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20e6db93-cc41-4e9c-bb6c-c039419a6a7a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:47.776170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20e6db93-cc41-4e9c-bb6c-c039419a6a7a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:47.777054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20e6db93-cc41-4e9c-bb6c-c039419a6a7a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:48.412176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-20e6db93-cc41-4e9c-bb6c-c039419a6a7a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:48.428007 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-20e6db93-cc41-4e9c-bb6c-c039419a6a7a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1364 microversion: 2.1 time: 0.675783 Oct 29 03:12:48.428601 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2862/5754] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:47 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1364 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:48.610743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:48.612144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:48.638849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:48.639891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:48.640969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:48.641744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:48.644450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:48.644989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:48.647726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-65cada5a-b0ec-40f6-bc0d-4c311fa9cfc6 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:48.648335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-65cada5a-b0ec-40f6-bc0d-4c311fa9cfc6 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:48.663117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65cada5a-b0ec-40f6-bc0d-4c311fa9cfc6 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:48.663613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65cada5a-b0ec-40f6-bc0d-4c311fa9cfc6 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:48.664044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65cada5a-b0ec-40f6-bc0d-4c311fa9cfc6 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:48.664763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65cada5a-b0ec-40f6-bc0d-4c311fa9cfc6 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:48.665211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65cada5a-b0ec-40f6-bc0d-4c311fa9cfc6 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:48.665631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65cada5a-b0ec-40f6-bc0d-4c311fa9cfc6 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:48.802615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:48.814951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:48.818919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:48.820828 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-82242be8-4423-45b3-bf8d-21105b05a0cb tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1330 microversion: 2.54 time: 0.225352 Oct 29 03:12:48.823248 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2893/5755] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:48 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1330 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:12:48.959816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e67fd98f-7e6e-47be-9725-0c555397fcc7 req-0aab5384-c3a3-4a15-8528-2c1d1bab6165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00cb236a-db5a-4b3b-a464-0b7914d1a15c", "tag": "73c14a2a-e037-42e6-8e22-9fd7b95de128"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:48.981424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e67fd98f-7e6e-47be-9725-0c555397fcc7 req-0aab5384-c3a3-4a15-8528-2c1d1bab6165 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:48.983061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e67fd98f-7e6e-47be-9725-0c555397fcc7 req-0aab5384-c3a3-4a15-8528-2c1d1bab6165 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:48.986015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e67fd98f-7e6e-47be-9725-0c555397fcc7 req-0aab5384-c3a3-4a15-8528-2c1d1bab6165 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.022851 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e67fd98f-7e6e-47be-9725-0c555397fcc7 req-0aab5384-c3a3-4a15-8528-2c1d1bab6165 service nova] Creating event network-changed:73c14a2a-e037-42e6-8e22-9fd7b95de128 for instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c on n-h2-862964-4 Oct 29 03:12:49.030230 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e67fd98f-7e6e-47be-9725-0c555397fcc7 req-0aab5384-c3a3-4a15-8528-2c1d1bab6165 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080319 Oct 29 03:12:49.031734 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2894/5756] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:49.061323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-65cada5a-b0ec-40f6-bc0d-4c311fa9cfc6 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:49.070553 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-65cada5a-b0ec-40f6-bc0d-4c311fa9cfc6 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1324 microversion: 2.1 time: 0.426620 Oct 29 03:12:49.073894 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2863/5757] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:48 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1324 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:49.453890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a1613ffe-ee24-42da-b672-47a1c3bd901a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:49.454696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a1613ffe-ee24-42da-b672-47a1c3bd901a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:49.457080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=4,nova_api:INSERT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:49.465006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1613ffe-ee24-42da-b672-47a1c3bd901a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.469795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1613ffe-ee24-42da-b672-47a1c3bd901a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.472199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1613ffe-ee24-42da-b672-47a1c3bd901a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.475568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1613ffe-ee24-42da-b672-47a1c3bd901a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.477557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1613ffe-ee24-42da-b672-47a1c3bd901a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.483116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1613ffe-ee24-42da-b672-47a1c3bd901a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.700712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-74a20cb1-de43-4992-a749-00fb4665d61d req-50ca6137-0ceb-454d-9e2c-aa46fe490575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13326ccb-1056-453f-b9ac-65f29e0883a6", "name": "network-vif-plugged", "status": "completed", "tag": "b589f504-1893-45db-bbe7-89ade08b3a38"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:49.714277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-74a20cb1-de43-4992-a749-00fb4665d61d req-50ca6137-0ceb-454d-9e2c-aa46fe490575 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.714982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-74a20cb1-de43-4992-a749-00fb4665d61d req-50ca6137-0ceb-454d-9e2c-aa46fe490575 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.715467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-74a20cb1-de43-4992-a749-00fb4665d61d req-50ca6137-0ceb-454d-9e2c-aa46fe490575 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.730219 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-74a20cb1-de43-4992-a749-00fb4665d61d req-50ca6137-0ceb-454d-9e2c-aa46fe490575 service nova] Creating event network-vif-plugged:b589f504-1893-45db-bbe7-89ade08b3a38 for instance 13326ccb-1056-453f-b9ac-65f29e0883a6 on n-h1-862964-4 Oct 29 03:12:49.744720 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-74a20cb1-de43-4992-a749-00fb4665d61d req-50ca6137-0ceb-454d-9e2c-aa46fe490575 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051775 Oct 29 03:12:49.746225 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2864/5758] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:49.857450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:49.860791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:49.873532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.874251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.874826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.875680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.876291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.877439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:50.040188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a1613ffe-ee24-42da-b672-47a1c3bd901a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:50.048200 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a1613ffe-ee24-42da-b672-47a1c3bd901a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1364 microversion: 2.1 time: 0.599002 Oct 29 03:12:50.063686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:50.068834 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2895/5759] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:49 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1364 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:50.069790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:50.071325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:50.072511 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-09a0b2ab-eb69-427c-bdb1-6f654dde2e71 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1336 microversion: 2.54 time: 0.223444 Oct 29 03:12:50.073111 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2865/5760] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:49 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1336 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:12:50.101001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b177b83f-5190-4f12-9049-60e71fbed095 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:50.103891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b177b83f-5190-4f12-9049-60e71fbed095 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:50.111435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b177b83f-5190-4f12-9049-60e71fbed095 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:50.112152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b177b83f-5190-4f12-9049-60e71fbed095 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:50.113947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b177b83f-5190-4f12-9049-60e71fbed095 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:50.116152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b177b83f-5190-4f12-9049-60e71fbed095 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:50.119206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b177b83f-5190-4f12-9049-60e71fbed095 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:50.119829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b177b83f-5190-4f12-9049-60e71fbed095 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:50.783102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b177b83f-5190-4f12-9049-60e71fbed095 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:50.792525 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b177b83f-5190-4f12-9049-60e71fbed095 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1324 microversion: 2.1 time: 0.699594 Oct 29 03:12:50.793207 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2896/5761] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:50 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1324 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:51.071912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b844820c-0f0a-4e1e-b1da-cb77dbf06a20 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:51.073374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b844820c-0f0a-4e1e-b1da-cb77dbf06a20 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:51.078097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:51.078763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=12 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:51.085889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b844820c-0f0a-4e1e-b1da-cb77dbf06a20 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:51.086613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b844820c-0f0a-4e1e-b1da-cb77dbf06a20 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:51.087034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b844820c-0f0a-4e1e-b1da-cb77dbf06a20 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:51.087749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b844820c-0f0a-4e1e-b1da-cb77dbf06a20 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:51.088193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b844820c-0f0a-4e1e-b1da-cb77dbf06a20 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:51.088605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b844820c-0f0a-4e1e-b1da-cb77dbf06a20 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:51.103709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:51.104296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:51.111020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:51.111530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:51.111961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:51.112699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:51.113150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:51.113569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:51.219652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:51.230670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:51.232391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:51.233572 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de9deb71-913f-45e7-b2aa-3e3169102c47 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1336 microversion: 2.54 time: 0.133868 Oct 29 03:12:51.234444 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2897/5762] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:51 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1336 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:12:51.677762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b844820c-0f0a-4e1e-b1da-cb77dbf06a20 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:51.685840 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b844820c-0f0a-4e1e-b1da-cb77dbf06a20 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1364 microversion: 2.1 time: 0.618140 Oct 29 03:12:51.686464 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2866/5763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:51 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1364 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:51.816072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-704f5633-0fc1-45d4-9fd2-056012f0b3ff tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:51.816697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-704f5633-0fc1-45d4-9fd2-056012f0b3ff tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:51.823692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704f5633-0fc1-45d4-9fd2-056012f0b3ff tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:51.824189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704f5633-0fc1-45d4-9fd2-056012f0b3ff tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:51.824619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704f5633-0fc1-45d4-9fd2-056012f0b3ff tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:51.825318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704f5633-0fc1-45d4-9fd2-056012f0b3ff tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:51.825765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704f5633-0fc1-45d4-9fd2-056012f0b3ff tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:51.826213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704f5633-0fc1-45d4-9fd2-056012f0b3ff tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:52.054077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-704f5633-0fc1-45d4-9fd2-056012f0b3ff tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:52.062345 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-704f5633-0fc1-45d4-9fd2-056012f0b3ff tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1324 microversion: 2.1 time: 0.250170 Oct 29 03:12:52.068898 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2898/5764] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:51 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:52.262841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:52.264163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:52.289148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:52.290272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:52.291165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:52.293673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:52.295939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:52.297014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:52.709603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cca9bb6e-2aa7-4dd1-9cc2-7266a03eb91b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:52.710252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cca9bb6e-2aa7-4dd1-9cc2-7266a03eb91b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:52.722205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:52.729341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca9bb6e-2aa7-4dd1-9cc2-7266a03eb91b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:52.730060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca9bb6e-2aa7-4dd1-9cc2-7266a03eb91b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:52.730800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca9bb6e-2aa7-4dd1-9cc2-7266a03eb91b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:52.731676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca9bb6e-2aa7-4dd1-9cc2-7266a03eb91b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:52.732266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca9bb6e-2aa7-4dd1-9cc2-7266a03eb91b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:52.732866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cca9bb6e-2aa7-4dd1-9cc2-7266a03eb91b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:52.738487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:52.744094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:52.747562 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9014c583-9ef9-4100-aeac-f16a1f63f03c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1357 microversion: 2.54 time: 0.487931 Oct 29 03:12:52.749343 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2867/5765] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:52 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1357 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:12:52.784444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-afd24356-5527-42f6-9418-4a92903784b9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Action: 'create', calling method: .version_select at 0x7fe1a38ff310>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1072917626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML8yqXcBsgSk5tecv7dgIuN1M1YCEyevkIcvl1i9RBqyNFKG4G9R/nF8DJF+bmu0E7lSg4901AIjBxjp0qWpc6Wfl9UPF7QHur5YijImKc3mFZn8WOjYBH6Y4Mhzj3zyA=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:52.802592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-afd24356-5527-42f6-9418-4a92903784b9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Getting quotas for project aa0cc560e4e64377bfa3239d8e6d1570. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:12:52.808835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-afd24356-5527-42f6-9418-4a92903784b9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Getting quotas for user b44e66d6ec5548789906a0f9e2f9f097 and project aa0cc560e4e64377bfa3239d8e6d1570. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:12:52.836837 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-afd24356-5527-42f6-9418-4a92903784b9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.056251 Oct 29 03:12:52.844705 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2868/5766] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Oct 29 03:12:52 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 29 03:12:52.853476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1072917626", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:52.856878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:52.864922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:52.865674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:52.866582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:52.868018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:52.868692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:52.869310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:52.979311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:12:52.979917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:12:52.981174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:12:52.982394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:12:52.983299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:12:53.111810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:53.119498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:53.120127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:53.120967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:53.121886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:53.122481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:53.123114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:53.160852 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fc47823e-82fa-41f4-9288-c8b3a89ab358 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "POST /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da/action" status: 202 len: 1140 microversion: 2.54 time: 0.312383 Oct 29 03:12:53.175750 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2869/5767] 10.222.0.16 () {62 vars in 1320 bytes} [Sat Oct 29 03:12:52 2022] POST /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da/action => generated 1140 bytes in 328 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 03:12:53.181446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f2083834-b0cb-4f5c-8f3c-95feae2ce626 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:53.182847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f2083834-b0cb-4f5c-8f3c-95feae2ce626 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:53.192853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cca9bb6e-2aa7-4dd1-9cc2-7266a03eb91b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:53.221110 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cca9bb6e-2aa7-4dd1-9cc2-7266a03eb91b tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1364 microversion: 2.1 time: 0.516267 Oct 29 03:12:53.223328 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2899/5768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:52 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1364 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:53.225350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2083834-b0cb-4f5c-8f3c-95feae2ce626 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:53.228700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2083834-b0cb-4f5c-8f3c-95feae2ce626 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:53.229255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2083834-b0cb-4f5c-8f3c-95feae2ce626 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:53.230406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2083834-b0cb-4f5c-8f3c-95feae2ce626 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:53.231006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2083834-b0cb-4f5c-8f3c-95feae2ce626 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:53.231727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2083834-b0cb-4f5c-8f3c-95feae2ce626 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:53.242671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:53.244341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:53.257218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:53.258568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:53.260174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:53.261741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:53.262444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:53.263076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:53.426465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:53.434985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:53.436411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:53.449842 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0968c7b9-f4dc-4df5-a088-a1a941abd147 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.211081 Oct 29 03:12:53.449842 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2900/5769] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:53 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:12:53.905434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f2083834-b0cb-4f5c-8f3c-95feae2ce626 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:53.919736 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f2083834-b0cb-4f5c-8f3c-95feae2ce626 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1520 microversion: 2.1 time: 0.742126 Oct 29 03:12:53.921321 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2870/5770] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:53 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1520 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:53.948134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:53.949484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:53.959795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:53.960778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:53.963105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:53.964063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:53.967090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:53.969347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:54.047111 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] HTTP exception thrown: Instance is not a member of specified network Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Request method failure captured: Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6/ips/invalid HTTP/1.1 Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJofJLoHP4xZruIjmbbGuWT9FlpIjfGbfMac1A12K5r-4ttYDq8vrtgk2oUM1a7bq8Hu6sWU3CWag4Jup73crF4vjGJ2hXSg3zRd0FsiYuWYBGQE0yXG02PZoDtuPWMEdNYvUQKWNqdwhmrzjmcKGMsvi9ESbGfhOs4DX6dXSlq0bDU Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 015cadf2cdfb4250b719b96a082024ce Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-879750955 Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/015cadf2cdfb4250b719b96a082024ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/015cadf2cdfb4250b719b96a082024ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_015cadf2cdfb4250b719b96a082024ce", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/015cadf2cdfb4250b719b96a082024ce"}]}] Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-879750955 Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 015cadf2cdfb4250b719b96a082024ce Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-879750955 Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerAddressesNegativeTestJSON-879750955-project Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: bb414159a80d48f9bbce14d6f89b5334 Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-879750955-project Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance is not a member of specified network Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': '13326ccb-1056-453f-b9ac-65f29e0883a6', 'id': 'invalid'} Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 29 03:12:54.054950 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:54.062800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:54.065016 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-92d5f918-9202-4b4f-9c41-a29ddaf69a20 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.123117 Oct 29 03:12:54.067459 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2901/5771] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 03:12:53 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6/ips/invalid => generated 91 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:12:54.081386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-359c7337-8e42-4160-b184-845f00879671 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:54.081895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-359c7337-8e42-4160-b184-845f00879671 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Failed to fetch instance by id 999 {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 03:12:54.082420 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-359c7337-8e42-4160-b184-845f00879671 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] HTTP exception thrown: Instance 999 could not be found. Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-359c7337-8e42-4160-b184-845f00879671 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Request method failure captured: Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJofJLoHP4xZruIjmbbGuWT9FlpIjfGbfMac1A12K5r-4ttYDq8vrtgk2oUM1a7bq8Hu6sWU3CWag4Jup73crF4vjGJ2hXSg3zRd0FsiYuWYBGQE0yXG02PZoDtuPWMEdNYvUQKWNqdwhmrzjmcKGMsvi9ESbGfhOs4DX6dXSlq0bDU Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 015cadf2cdfb4250b719b96a082024ce Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-879750955 Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/015cadf2cdfb4250b719b96a082024ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/015cadf2cdfb4250b719b96a082024ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_015cadf2cdfb4250b719b96a082024ce", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/015cadf2cdfb4250b719b96a082024ce"}]}] Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-879750955 Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 015cadf2cdfb4250b719b96a082024ce Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-879750955 Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerAddressesNegativeTestJSON-879750955-project Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: bb414159a80d48f9bbce14d6f89b5334 Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-879750955-project Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 999 could not be found. Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'server_id': '999'} Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 29 03:12:54.089609 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:12:54.095933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-359c7337-8e42-4160-b184-845f00879671 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:54.095933 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-359c7337-8e42-4160-b184-845f00879671 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.017715 Oct 29 03:12:54.095933 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2871/5772] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Oct 29 03:12:54 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:12:54.105191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6130a37a-cc01-4897-a103-b13dbca8459f tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:54.106460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6130a37a-cc01-4897-a103-b13dbca8459f tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:54.116967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6130a37a-cc01-4897-a103-b13dbca8459f tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:54.117988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6130a37a-cc01-4897-a103-b13dbca8459f tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:54.118520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6130a37a-cc01-4897-a103-b13dbca8459f tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:54.119741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6130a37a-cc01-4897-a103-b13dbca8459f tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:54.120454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6130a37a-cc01-4897-a103-b13dbca8459f tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:54.120976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6130a37a-cc01-4897-a103-b13dbca8459f tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:54.157907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6130a37a-cc01-4897-a103-b13dbca8459f tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:12:54.250262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e31349d1-9dba-481e-b8dc-10986f0b13ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:54.251138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e31349d1-9dba-481e-b8dc-10986f0b13ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:54.270134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e31349d1-9dba-481e-b8dc-10986f0b13ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:54.272314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e31349d1-9dba-481e-b8dc-10986f0b13ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:54.272881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e31349d1-9dba-481e-b8dc-10986f0b13ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:54.273702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e31349d1-9dba-481e-b8dc-10986f0b13ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:54.275429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e31349d1-9dba-481e-b8dc-10986f0b13ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:54.276557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e31349d1-9dba-481e-b8dc-10986f0b13ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:54.277794 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6130a37a-cc01-4897-a103-b13dbca8459f tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 204 len: 0 microversion: 2.1 time: 0.179646 Oct 29 03:12:54.279036 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2902/5773] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:12:54 2022] DELETE /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:12:54.288434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-53508c62-4fae-40ae-93d7-cc4091e9a481 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:54.289616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-53508c62-4fae-40ae-93d7-cc4091e9a481 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:54.296884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53508c62-4fae-40ae-93d7-cc4091e9a481 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:54.297734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53508c62-4fae-40ae-93d7-cc4091e9a481 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:54.298595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53508c62-4fae-40ae-93d7-cc4091e9a481 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:54.299561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53508c62-4fae-40ae-93d7-cc4091e9a481 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:54.301000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53508c62-4fae-40ae-93d7-cc4091e9a481 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:54.301648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-53508c62-4fae-40ae-93d7-cc4091e9a481 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:54.769053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e31349d1-9dba-481e-b8dc-10986f0b13ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:54.778992 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e31349d1-9dba-481e-b8dc-10986f0b13ac tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1364 microversion: 2.1 time: 0.533477 Oct 29 03:12:54.782083 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2872/5774] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:54 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1364 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:54.791999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:54.792938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:54.812692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:54.813196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:54.813629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:54.814539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:54.815143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:54.815782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:54.976263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-53508c62-4fae-40ae-93d7-cc4091e9a481 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:54.988969 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-53508c62-4fae-40ae-93d7-cc4091e9a481 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1526 microversion: 2.1 time: 0.705363 Oct 29 03:12:54.990562 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2903/5775] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:54 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1526 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:55.005148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:55.007686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:55.020978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:55.022745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:55.024114 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c8a223db-3ce9-49f8-852a-5ff0a927cb2e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.240910 Oct 29 03:12:55.025150 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2873/5776] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:54 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:12:55.805396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ad7ca42-5c27-48e6-9fe7-0a52c684756d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:55.806173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8ad7ca42-5c27-48e6-9fe7-0a52c684756d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:55.817659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad7ca42-5c27-48e6-9fe7-0a52c684756d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:55.818407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad7ca42-5c27-48e6-9fe7-0a52c684756d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:55.820503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad7ca42-5c27-48e6-9fe7-0a52c684756d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:55.821979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad7ca42-5c27-48e6-9fe7-0a52c684756d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:55.823404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad7ca42-5c27-48e6-9fe7-0a52c684756d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:55.824851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad7ca42-5c27-48e6-9fe7-0a52c684756d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:56.019829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-26c7cfde-6a85-47b0-be9d-2d1bcb245a05 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:56.021447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-26c7cfde-6a85-47b0-be9d-2d1bcb245a05 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:56.039304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26c7cfde-6a85-47b0-be9d-2d1bcb245a05 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:56.043533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26c7cfde-6a85-47b0-be9d-2d1bcb245a05 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:56.046441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26c7cfde-6a85-47b0-be9d-2d1bcb245a05 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:56.048286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26c7cfde-6a85-47b0-be9d-2d1bcb245a05 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:56.050887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26c7cfde-6a85-47b0-be9d-2d1bcb245a05 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:56.052222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26c7cfde-6a85-47b0-be9d-2d1bcb245a05 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:56.221460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8ad7ca42-5c27-48e6-9fe7-0a52c684756d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:56.231114 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8ad7ca42-5c27-48e6-9fe7-0a52c684756d tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1364 microversion: 2.1 time: 0.430498 Oct 29 03:12:56.255483 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2904/5777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:55 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1364 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:56.278447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:56.281977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:56.298073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:56.306289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:56.308572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:56.311932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:56.315127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:56.316001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:56.478576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:56.493400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:56.495272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:56.497598 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-47ea4557-2b4c-4bc5-bb75-1a41852ad850 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.240063 Oct 29 03:12:56.511348 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2905/5778] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:56 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:12:56.820977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-26c7cfde-6a85-47b0-be9d-2d1bcb245a05 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:56.834408 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-26c7cfde-6a85-47b0-be9d-2d1bcb245a05 tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1526 microversion: 2.1 time: 0.822500 Oct 29 03:12:56.836550 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2874/5779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:56 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1526 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:57.226713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-34f99b5b-d13d-434c-8313-8cd3570be770 req-68288da3-12b4-4bf1-a5a8-cc6ae2e3c3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13326ccb-1056-453f-b9ac-65f29e0883a6", "name": "network-vif-deleted", "tag": "b589f504-1893-45db-bbe7-89ade08b3a38"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:57.253297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-34f99b5b-d13d-434c-8313-8cd3570be770 req-68288da3-12b4-4bf1-a5a8-cc6ae2e3c3a5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:57.253900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-34f99b5b-d13d-434c-8313-8cd3570be770 req-68288da3-12b4-4bf1-a5a8-cc6ae2e3c3a5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:57.254846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-34f99b5b-d13d-434c-8313-8cd3570be770 req-68288da3-12b4-4bf1-a5a8-cc6ae2e3c3a5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:57.265384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ab3aa518-e781-4c47-b357-930b02c0c385 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:57.266046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ab3aa518-e781-4c47-b357-930b02c0c385 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:57.278473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:57.281606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab3aa518-e781-4c47-b357-930b02c0c385 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:57.282506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab3aa518-e781-4c47-b357-930b02c0c385 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:57.283908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab3aa518-e781-4c47-b357-930b02c0c385 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:57.285182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab3aa518-e781-4c47-b357-930b02c0c385 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:57.288326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab3aa518-e781-4c47-b357-930b02c0c385 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:57.288967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab3aa518-e781-4c47-b357-930b02c0c385 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:57.304348 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-34f99b5b-d13d-434c-8313-8cd3570be770 req-68288da3-12b4-4bf1-a5a8-cc6ae2e3c3a5 service nova] Creating event network-vif-deleted:b589f504-1893-45db-bbe7-89ade08b3a38 for instance 13326ccb-1056-453f-b9ac-65f29e0883a6 on n-h1-862964-4 Oct 29 03:12:57.323347 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-34f99b5b-d13d-434c-8313-8cd3570be770 req-68288da3-12b4-4bf1-a5a8-cc6ae2e3c3a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102241 Oct 29 03:12:57.328113 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2906/5780] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:57.529483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:57.530311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:57.568216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=16 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:57.570975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:57.571805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:57.572406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:57.573267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:57.574129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:57.577449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:57.722032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:57.731675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:57.743636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:57.745013 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e7850240-0b91-42b7-98b4-05d35ddd319d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.220084 Oct 29 03:12:57.745464 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2907/5781] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:57 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:12:57.750033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-76effa3c-d1bc-4ece-8452-e02e76501f16 req-014d8ac1-70fe-432d-8918-8d7b96fa4582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cb236a-db5a-4b3b-a464-0b7914d1a15c", "name": "network-vif-plugged", "status": "completed", "tag": "73c14a2a-e037-42e6-8e22-9fd7b95de128"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:57.760075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-76effa3c-d1bc-4ece-8452-e02e76501f16 req-014d8ac1-70fe-432d-8918-8d7b96fa4582 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:57.760806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-76effa3c-d1bc-4ece-8452-e02e76501f16 req-014d8ac1-70fe-432d-8918-8d7b96fa4582 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:57.761394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-76effa3c-d1bc-4ece-8452-e02e76501f16 req-014d8ac1-70fe-432d-8918-8d7b96fa4582 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:57.778889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ab3aa518-e781-4c47-b357-930b02c0c385 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:57.784478 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-76effa3c-d1bc-4ece-8452-e02e76501f16 req-014d8ac1-70fe-432d-8918-8d7b96fa4582 service nova] Creating event network-vif-plugged:73c14a2a-e037-42e6-8e22-9fd7b95de128 for instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c on n-h2-862964-4 Oct 29 03:12:57.791102 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-76effa3c-d1bc-4ece-8452-e02e76501f16 req-014d8ac1-70fe-432d-8918-8d7b96fa4582 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044386 Oct 29 03:12:57.791716 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2908/5782] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:57.792324 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ab3aa518-e781-4c47-b357-930b02c0c385 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1364 microversion: 2.1 time: 0.533415 Oct 29 03:12:57.793189 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2875/5783] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:57 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1364 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:57.864716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:57.866572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:57.891638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:57.892136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:57.892600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:57.893305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:57.894616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:57.895052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:57.941862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:57.942352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:57.942961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:57.943986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lazy-loading 'fault' on Instance uuid 13326ccb-1056-453f-b9ac-65f29e0883a6 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:12:58.022603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb414159a80d48f9bbce14d6f89b5334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015cadf2cdfb4250b719b96a082024ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:58.035693 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f6613b57-2173-4ce9-9ad7-55a95729b11a tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 200 len: 1314 microversion: 2.1 time: 0.180681 Oct 29 03:12:58.037081 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2876/5784] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:57 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:58.773864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:58.775507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:58.791848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:58.793064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:58.795188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:58.795977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:58.797143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:58.797579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:58.811954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:58.817978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-306dfde2-5487-41b7-8344-5972c0506547 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:58.819418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-306dfde2-5487-41b7-8344-5972c0506547 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:58.825780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:58.834647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306dfde2-5487-41b7-8344-5972c0506547 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:58.835141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306dfde2-5487-41b7-8344-5972c0506547 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:58.835574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306dfde2-5487-41b7-8344-5972c0506547 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:58.836280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306dfde2-5487-41b7-8344-5972c0506547 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:58.836726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306dfde2-5487-41b7-8344-5972c0506547 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:58.837143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-306dfde2-5487-41b7-8344-5972c0506547 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:58.934249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:58.948620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:58.950692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:58.952203 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-45b3c09c-1cbd-4fae-bc4a-2b6687463da4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.183419 Oct 29 03:12:58.955712 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2909/5785] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:58 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:12:59.061075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:59.061777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] [instance: 13326ccb-1056-453f-b9ac-65f29e0883a6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:59.069598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:59.071006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:59.071441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:59.072248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:59.072698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:59.073116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:59.095488 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] HTTP exception thrown: Instance 13326ccb-1056-453f-b9ac-65f29e0883a6 could not be found. Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Request method failure captured: Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 HTTP/1.1 Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJofJLoHP4xZruIjmbbGuWT9FlpIjfGbfMac1A12K5r-4ttYDq8vrtgk2oUM1a7bq8Hu6sWU3CWag4Jup73crF4vjGJ2hXSg3zRd0FsiYuWYBGQE0yXG02PZoDtuPWMEdNYvUQKWNqdwhmrzjmcKGMsvi9ESbGfhOs4DX6dXSlq0bDU Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 015cadf2cdfb4250b719b96a082024ce Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-879750955 Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/015cadf2cdfb4250b719b96a082024ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/015cadf2cdfb4250b719b96a082024ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_015cadf2cdfb4250b719b96a082024ce", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/015cadf2cdfb4250b719b96a082024ce"}]}] Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-879750955 Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 015cadf2cdfb4250b719b96a082024ce Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-879750955 Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerAddressesNegativeTestJSON-879750955-project Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: bb414159a80d48f9bbce14d6f89b5334 Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-879750955-project Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 13326ccb-1056-453f-b9ac-65f29e0883a6 could not be found. Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '13326ccb-1056-453f-b9ac-65f29e0883a6'} Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13326ccb-1056-453f-b9ac-65f29e0883a6 could not be found. Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13326ccb-1056-453f-b9ac-65f29e0883a6 could not be found. Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:59.097663 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:59.101836 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:59.101836 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:59.101836 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:59.101836 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:59.101836 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:59.101836 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:59.101836 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13326ccb-1056-453f-b9ac-65f29e0883a6 could not be found. Oct 29 03:12:59.101836 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:12:59.103405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] Returning 404 to user: Instance 13326ccb-1056-453f-b9ac-65f29e0883a6 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:59.104541 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-babc304c-bd04-4d55-967b-f2610b191b3d tempest-ServerAddressesNegativeTestJSON-879750955 tempest-ServerAddressesNegativeTestJSON-879750955-project] 10.222.0.16 "GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6" status: 404 len: 111 microversion: 2.1 time: 0.048815 Oct 29 03:12:59.105273 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2910/5786] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:59 2022] GET /compute/v2.1/servers/13326ccb-1056-453f-b9ac-65f29e0883a6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:12:59.256639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-306dfde2-5487-41b7-8344-5972c0506547 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:59.267816 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-306dfde2-5487-41b7-8344-5972c0506547 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1364 microversion: 2.1 time: 0.454179 Oct 29 03:12:59.268558 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2877/5787] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:58 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1364 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:59.984027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:59.985516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:00.000976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:00.001907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:00.004255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:00.006514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:00.007991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:00.008583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:00.184673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:00.198882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:00.205121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:00.207682 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ca1d389d-fa13-4e61-9ae0-ccd73da06f75 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.229588 Oct 29 03:13:00.210034 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2911/5788] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:12:59 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:00.291621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ef95e57-1b9a-4de2-9c64-bc5680331e89 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:00.292240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ef95e57-1b9a-4de2-9c64-bc5680331e89 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:00.305460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef95e57-1b9a-4de2-9c64-bc5680331e89 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:00.306721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef95e57-1b9a-4de2-9c64-bc5680331e89 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:00.306721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef95e57-1b9a-4de2-9c64-bc5680331e89 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:00.307114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef95e57-1b9a-4de2-9c64-bc5680331e89 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:00.312588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef95e57-1b9a-4de2-9c64-bc5680331e89 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:00.313080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef95e57-1b9a-4de2-9c64-bc5680331e89 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:00.714056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ef95e57-1b9a-4de2-9c64-bc5680331e89 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:00.726583 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ef95e57-1b9a-4de2-9c64-bc5680331e89 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1550 microversion: 2.1 time: 0.438747 Oct 29 03:13:00.769058 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2878/5789] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:00 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1550 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:00.794552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a839337f-da0a-4316-95a9-21e09cee5281 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:00.795312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a839337f-da0a-4316-95a9-21e09cee5281 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:00.804321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a839337f-da0a-4316-95a9-21e09cee5281 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:00.804813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a839337f-da0a-4316-95a9-21e09cee5281 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:00.805247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a839337f-da0a-4316-95a9-21e09cee5281 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:00.806012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a839337f-da0a-4316-95a9-21e09cee5281 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:00.806539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a839337f-da0a-4316-95a9-21e09cee5281 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:00.806862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a839337f-da0a-4316-95a9-21e09cee5281 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:01.012177 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a839337f-da0a-4316-95a9-21e09cee5281 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.222264 Oct 29 03:13:01.013139 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2912/5790] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:13:00 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:01.238486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:01.239102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:01.253256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:01.255627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:01.256219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:01.261119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:01.261763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:01.263580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:01.635183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:01.660135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:01.661868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:01.663232 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ce081bc-08ee-4444-9200-0df765c8a971 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.431591 Oct 29 03:13:01.674210 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2879/5791] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:01 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:02.690122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:02.691596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:02.698403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:02.699187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:02.699817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:02.700720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:02.701368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:02.702035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:02.827681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:02.843398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:02.847962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:02.849585 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d1c5d37f-adfe-4d90-906b-8ad342e2aab1 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.164753 Oct 29 03:13:02.850904 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2913/5792] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:02 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:03.877018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:03.877633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:03.881018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:03.892235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:03.892934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:03.893599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:03.894651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:03.895241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:03.895807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:04.054442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-37eb335d-d4b3-4a14-9389-0fac6de12136 req-0910e549-fa99-4a35-9954-6697cc2ce2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00cb236a-db5a-4b3b-a464-0b7914d1a15c", "tag": "73c14a2a-e037-42e6-8e22-9fd7b95de128"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:04.058595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:04.070645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-37eb335d-d4b3-4a14-9389-0fac6de12136 req-0910e549-fa99-4a35-9954-6697cc2ce2f5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:04.077268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-37eb335d-d4b3-4a14-9389-0fac6de12136 req-0910e549-fa99-4a35-9954-6697cc2ce2f5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:04.078201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-37eb335d-d4b3-4a14-9389-0fac6de12136 req-0910e549-fa99-4a35-9954-6697cc2ce2f5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:04.109599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:04.118028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:04.119970 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-945dd326-4f24-49ce-a8ca-06f7a5774162 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.246668 Oct 29 03:13:04.120642 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-37eb335d-d4b3-4a14-9389-0fac6de12136 req-0910e549-fa99-4a35-9954-6697cc2ce2f5 service nova] Creating event network-changed:73c14a2a-e037-42e6-8e22-9fd7b95de128 for instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c on n-h2-862964-4 Oct 29 03:13:04.121219 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2880/5793] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:03 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:04.126763 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-37eb335d-d4b3-4a14-9389-0fac6de12136 req-0910e549-fa99-4a35-9954-6697cc2ce2f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076964 Oct 29 03:13:04.127824 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2914/5794] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:13:05.150167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:05.151421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:05.158526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:05.160086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:05.160682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:05.161651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:05.162271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:05.162837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:05.255568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:05.272606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:05.276711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:05.279682 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ddc76379-d955-4276-9166-0ff00164eea9 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.133434 Oct 29 03:13:05.281469 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2881/5795] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:05 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:06.318834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:06.320691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:06.333272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:06.334276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:06.334883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:06.335972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:06.336582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:06.337388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:06.482633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:06.505891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:06.507447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:06.508967 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d9b4d2d-c48b-45ec-93f9-a32504cd9bef tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.203611 Oct 29 03:13:06.510146 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2915/5796] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:06 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:07.540970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:07.541696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:07.550399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:07.551147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:07.551793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:07.552734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:07.553820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:07.554720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:07.664353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:07.674135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:07.675681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:07.677255 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-acca16c2-5085-435e-abd5-ceb15816cb21 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.141934 Oct 29 03:13:07.690804 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2882/5797] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:07 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:08.704614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:08.705268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:08.724924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:08.725918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:08.726525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:08.727440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:08.728063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:08.728491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:08.853837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:08.863903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:08.865001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:08.868246 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e94fac6e-4153-4d2a-b898-0f630fa59e0c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.167663 Oct 29 03:13:08.869768 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2916/5798] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:08 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:09.902087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:09.902807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:09.914600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:09.915310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:09.915950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:09.916849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:09.917485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:09.918150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:10.040697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:10.059019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:10.062303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:10.063775 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4a2a42a4-d1f6-4a22-9365-35dcb32575a3 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.167452 Oct 29 03:13:10.081591 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2883/5799] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:09 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:11.094347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:11.094950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:11.109489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:11.110001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:11.110431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:11.111519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:11.111658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:11.112131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:11.237848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:11.258281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:11.262641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:11.266414 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fa93c4cb-54b5-452a-8183-77142ef1c05e tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.175396 Oct 29 03:13:11.278015 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2917/5800] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:11 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:12.302334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:12.303047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:12.315306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:12.316048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:12.316910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:12.317822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:12.318429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:12.319065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:12.475632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:12.486735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:12.489003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:12.490598 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9e3d1b61-6d41-45b1-9168-f16747553529 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.201115 Oct 29 03:13:12.493727 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2884/5801] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:12 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:13.521687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:13.522523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:13.542125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:13.542720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:13.543068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:13.543782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:13.544232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:13.544651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:13.733835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:13.751755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:13.754375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:13.755885 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-19733472-1ac5-42f4-861e-24fb77e25e3d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.239131 Oct 29 03:13:13.757100 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2918/5802] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:13 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:14.783230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:14.783909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:14.791179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:14.791941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:14.792585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:14.793475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:14.794135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:14.794734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:14.927865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:14.943841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:14.946398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:14.947891 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e371b20d-25ff-4bf7-b1c3-8a2831f4f71f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.168600 Oct 29 03:13:14.948584 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2885/5803] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:14 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:15.976721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:15.978161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:15.985524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:15.986145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:15.986655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:15.987550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:15.988067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:15.989497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:16.125310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:16.146386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:16.148579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:16.150004 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-26ff7924-7889-4fc4-9121-bc105604a3fe tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.177244 Oct 29 03:13:16.151114 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2919/5804] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:15 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:13:17.175984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:17.177918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:17.194512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:17.195287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:17.196047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:17.197662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:17.198294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:17.198861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:17.324113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:17.342788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:17.344956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:17.346440 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7a226f73-e2a1-4e61-ab0d-9f2666c72b86 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.175124 Oct 29 03:13:17.366794 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2886/5805] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:17 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:18.374934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:18.377073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:18.399429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:18.402885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:18.403404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:18.404189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:18.404789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:18.405866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:18.565010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:18.573769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:18.575796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:18.577212 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3b361f72-058f-4914-82e0-5fdd4985045f tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.208175 Oct 29 03:13:18.577759 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2920/5806] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:18 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:19.612198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:19.622241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:19.646915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:19.647643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:19.648198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:19.650697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:19.651601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:19.652829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:19.821519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:19.831008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:19.833117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:19.834456 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-903afa3d-08db-47f4-bb1f-49dfdbf6385c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1409 microversion: 2.54 time: 0.232349 Oct 29 03:13:19.835103 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2887/5807] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:19 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1409 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:20.861625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:20.863652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:20.873516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:20.882557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:20.883207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:20.883775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:20.884477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:20.885154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:20.885780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:21.052240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:21.063491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:21.065696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:21.067450 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c1dda7e8-743a-441f-80b2-8c747c3e4925 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1415 microversion: 2.54 time: 0.210288 Oct 29 03:13:21.068633 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2921/5808] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:20 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1415 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:22.098006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:22.102380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:22.124290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:22.125286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:22.126845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:22.127922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:22.131399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:22.132158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:22.249968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-358921830", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:22.295547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:22.325420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] validate_networks() for [('b3fcf96d-de3d-4345-8a6f-b72b4af06776', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:13:22.328245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:22.331092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:22.352108 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bf92acd9-a2e8-4884-a04b-cdac357d64f4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1415 microversion: 2.54 time: 0.250935 Oct 29 03:13:22.352875 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2922/5809] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:22 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1415 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:23.381592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:23.382394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:23.394957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:23.399184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:23.399817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:23.404862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:23.405541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:23.406217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:23.539493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:23.552417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:23.558109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:23.562589 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f8c7eaf3-872c-44d0-92e8-e1473b84272c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1400 microversion: 2.54 time: 0.185508 Oct 29 03:13:23.563240 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2923/5810] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:23 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1400 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:23.595419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-567ebfd8-3086-4c2d-9812-c37eb2dcf69d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '.version_select at 0x7fe1acb0f3a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:23.632271 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-567ebfd8-3086-4c2d-9812-c37eb2dcf69d tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1072917626" status: 204 len: 0 microversion: 2.54 time: 0.043271 Oct 29 03:13:23.633250 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2924/5811] 10.222.0.16 () {60 vars in 1319 bytes} [Sat Oct 29 03:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1072917626 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:13:23.644816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e1debf0-1367-41a7-a970-337bc62042d4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:23.645626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e1debf0-1367-41a7-a970-337bc62042d4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:23.652327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1debf0-1367-41a7-a970-337bc62042d4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:23.652977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1debf0-1367-41a7-a970-337bc62042d4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:23.653587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1debf0-1367-41a7-a970-337bc62042d4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:23.654502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1debf0-1367-41a7-a970-337bc62042d4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:23.655106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1debf0-1367-41a7-a970-337bc62042d4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:23.655678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1debf0-1367-41a7-a970-337bc62042d4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:23.700944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e1debf0-1367-41a7-a970-337bc62042d4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:13:23.836300 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3e1debf0-1367-41a7-a970-337bc62042d4 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 204 len: 0 microversion: 2.54 time: 0.195091 Oct 29 03:13:23.838255 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2925/5812] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Oct 29 03:13:23 2022] DELETE /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:13:23.851644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:23.852809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:23.861635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:23.862386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:23.862943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:23.864017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:23.864627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:23.865354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:24.072031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:13:24.072529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:13:24.073084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:13:24.073698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:13:24.074315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:13:24.075292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:24.093236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:24.095528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:24.096467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:24.096815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:24.097544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:24.098526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:24.105106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:24.105782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:24.119629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:24.121205 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-64ad54b5-ecd2-4b45-a5d0-00d9b8e8c368 tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1406 microversion: 2.54 time: 0.278542 Oct 29 03:13:24.122397 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2926/5813] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:23 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:13:24.155271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Getting quotas for project 552af5aaae3f49fdb5cc8ea8ec4ccdec. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:13:24.169931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Getting quotas for user 89a693133ded46eba2b9b70e899f38f9 and project 552af5aaae3f49fdb5cc8ea8ec4ccdec. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:13:24.197009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:13:24.201481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:13:24.276624 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-38826f34-9e86-47ce-8a5b-06c0f548e367 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.188328 Oct 29 03:13:24.278326 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2888/5814] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:13:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:13:24.290196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7ad50102-2d36-4ade-8776-bd77115334a3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:24.290811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7ad50102-2d36-4ade-8776-bd77115334a3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:24.457299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7ad50102-2d36-4ade-8776-bd77115334a3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:24.479619 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7ad50102-2d36-4ade-8776-bd77115334a3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1221 microversion: 2.1 time: 0.192875 Oct 29 03:13:24.495858 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2927/5815] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:24 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1221 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:24.588640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-993792518", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:24.715769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] validate_networks() for [('b3fcf96d-de3d-4345-8a6f-b72b4af06776', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:13:25.151625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:25.152308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:25.167359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:25.167864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:25.173820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:25.175066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:25.175720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:25.176162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:25.404958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:25.423347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:25.424892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:25.426160 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de6ad9b2-7c2c-49a1-9b01-bb73c2ee831a tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1406 microversion: 2.54 time: 0.279469 Oct 29 03:13:25.426741 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2928/5816] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:25 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:13:25.732966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:13:25.734006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:13:25.734086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:13:25.735269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:13:25.735716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:13:25.760394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:25.765256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:25.767501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:25.776410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:25.784401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:25.791271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:25.846756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Getting quotas for project 552af5aaae3f49fdb5cc8ea8ec4ccdec. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:13:25.853893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Getting quotas for user 89a693133ded46eba2b9b70e899f38f9 and project 552af5aaae3f49fdb5cc8ea8ec4ccdec. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:13:25.883643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:13:25.914617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:13:26.038372 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5ccb63de-4b96-4d1c-983d-72b96b21b10e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.454694 Oct 29 03:13:26.046449 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2889/5817] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:13:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:13:26.053688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f3e46c87-24d0-43ca-b712-44f73727a031 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:26.054330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f3e46c87-24d0-43ca-b712-44f73727a031 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:26.316881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f3e46c87-24d0-43ca-b712-44f73727a031 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:26.326404 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f3e46c87-24d0-43ca-b712-44f73727a031 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1221 microversion: 2.1 time: 0.277943 Oct 29 03:13:26.328063 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2929/5818] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:26 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1221 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:26.461296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:26.462028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:26.480400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:26.483839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:26.484548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:26.486948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:26.501484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:26.502014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:26.505536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=92 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:26.907385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:26.932215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:26.939091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b44e66d6ec5548789906a0f9e2f9f097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0cc560e4e64377bfa3239d8e6d1570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:26.961865 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b91c4f3c-c5ac-40c6-bfad-6fccdaf0e95b tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 200 len: 1406 microversion: 2.54 time: 0.506465 Oct 29 03:13:26.968818 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2890/5819] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:26 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 1406 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:13:27.350970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-29c987fa-ecf8-4af7-a535-f8d82723235c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:27.351531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-29c987fa-ecf8-4af7-a535-f8d82723235c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:27.367485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29c987fa-ecf8-4af7-a535-f8d82723235c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:27.368208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29c987fa-ecf8-4af7-a535-f8d82723235c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:27.370011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29c987fa-ecf8-4af7-a535-f8d82723235c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:27.370931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29c987fa-ecf8-4af7-a535-f8d82723235c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:27.372918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29c987fa-ecf8-4af7-a535-f8d82723235c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:27.374708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29c987fa-ecf8-4af7-a535-f8d82723235c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:27.802218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-29c987fa-ecf8-4af7-a535-f8d82723235c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:27.832802 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-29c987fa-ecf8-4af7-a535-f8d82723235c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1273 microversion: 2.1 time: 0.483339 Oct 29 03:13:27.834554 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2930/5820] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:27 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1273 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:27.996819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:27.998200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] [instance: e0f7a698-a95c-4115-aefa-ba47d8dc35da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:28.006680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:28.007561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:28.008470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:28.009425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:28.010123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:28.011306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:28.033628 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] HTTP exception thrown: Instance e0f7a698-a95c-4115-aefa-ba47d8dc35da could not be found. Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Request method failure captured: Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da HTTP/1.1 Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJou4cF9GuspcVU7iAnNRXc1KxUpq3e0LeOXdO43bTWzTbCTotDLoK9pfQk1Mwm1DK4n_UGxqXEmHwNwpmG6lDM61phb7tbrBitH2D1dGPKo30Z6ygv-sdp_8HjjD9U8FlK2wq3OIHOwRTVEbtOyBQfZPpchhA8SJFWpGXvoVKAAMJQ Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Openstack-Nova-Api-Version: 2.54 Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: aa0cc560e4e64377bfa3239d8e6d1570 Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerShowV254Test-177673731 Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aa0cc560e4e64377bfa3239d8e6d1570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa0cc560e4e64377bfa3239d8e6d1570"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aa0cc560e4e64377bfa3239d8e6d1570", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa0cc560e4e64377bfa3239d8e6d1570"}]}] Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerShowV254Test-177673731 Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: aa0cc560e4e64377bfa3239d8e6d1570 Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerShowV254Test-177673731 Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerShowV254Test-177673731-project Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: b44e66d6ec5548789906a0f9e2f9f097 Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerShowV254Test-177673731-project Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance e0f7a698-a95c-4115-aefa-ba47d8dc35da could not be found. Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'e0f7a698-a95c-4115-aefa-ba47d8dc35da'} Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f7a698-a95c-4115-aefa-ba47d8dc35da could not be found. Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f7a698-a95c-4115-aefa-ba47d8dc35da could not be found. Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:28.035994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:28.039711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:28.039711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:28.039711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:28.039711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:28.039711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:28.039711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f7a698-a95c-4115-aefa-ba47d8dc35da could not be found. Oct 29 03:13:28.039711 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:28.043878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] Returning 404 to user: Instance e0f7a698-a95c-4115-aefa-ba47d8dc35da could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:28.045464 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-83f23f0f-4646-4700-bc99-724ccde53c2c tempest-ServerShowV254Test-177673731 tempest-ServerShowV254Test-177673731-project] 10.222.0.16 "GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da" status: 404 len: 111 microversion: 2.54 time: 0.052547 Oct 29 03:13:28.046712 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2891/5821] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Oct 29 03:13:27 2022] GET /compute/v2.1/servers/e0f7a698-a95c-4115-aefa-ba47d8dc35da => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:13:28.868880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5743ee90-efa0-430f-af96-bb9028ec495d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:28.871368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5743ee90-efa0-430f-af96-bb9028ec495d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:28.903553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5743ee90-efa0-430f-af96-bb9028ec495d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:28.904235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5743ee90-efa0-430f-af96-bb9028ec495d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:28.904826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5743ee90-efa0-430f-af96-bb9028ec495d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:28.906662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5743ee90-efa0-430f-af96-bb9028ec495d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:28.911585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5743ee90-efa0-430f-af96-bb9028ec495d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:28.912218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5743ee90-efa0-430f-af96-bb9028ec495d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:29.073128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5743ee90-efa0-430f-af96-bb9028ec495d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:29.083612 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5743ee90-efa0-430f-af96-bb9028ec495d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1279 microversion: 2.1 time: 0.225158 Oct 29 03:13:29.084907 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2931/5822] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:28 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:30.109285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81623238-db21-4bf8-99ff-252dfc586e61 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:30.110742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81623238-db21-4bf8-99ff-252dfc586e61 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:30.123408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:30.125332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81623238-db21-4bf8-99ff-252dfc586e61 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:30.126062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81623238-db21-4bf8-99ff-252dfc586e61 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:30.126711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81623238-db21-4bf8-99ff-252dfc586e61 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:30.128292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81623238-db21-4bf8-99ff-252dfc586e61 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:30.129098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81623238-db21-4bf8-99ff-252dfc586e61 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:30.130890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81623238-db21-4bf8-99ff-252dfc586e61 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:30.249362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-81623238-db21-4bf8-99ff-252dfc586e61 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:30.260129 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81623238-db21-4bf8-99ff-252dfc586e61 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1279 microversion: 2.1 time: 0.155478 Oct 29 03:13:30.262093 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2892/5823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:30 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:31.285620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c64cd8a0-5bb2-4b10-92ac-8e289d252285 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:31.286464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c64cd8a0-5bb2-4b10-92ac-8e289d252285 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:31.295048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c64cd8a0-5bb2-4b10-92ac-8e289d252285 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:31.295413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c64cd8a0-5bb2-4b10-92ac-8e289d252285 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:31.295852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c64cd8a0-5bb2-4b10-92ac-8e289d252285 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:31.305113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c64cd8a0-5bb2-4b10-92ac-8e289d252285 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:31.305824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c64cd8a0-5bb2-4b10-92ac-8e289d252285 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:31.310239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c64cd8a0-5bb2-4b10-92ac-8e289d252285 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:31.751763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c64cd8a0-5bb2-4b10-92ac-8e289d252285 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:31.761249 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c64cd8a0-5bb2-4b10-92ac-8e289d252285 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1321 microversion: 2.1 time: 0.481085 Oct 29 03:13:31.762627 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2932/5824] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:31 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1321 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:32.420172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b369871b-4b36-4425-97a7-8bbe934a7342 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Action: 'create', calling method: .version_select at 0x7fe1a38a71f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-435138308"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:32.785360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-95e9bc8c-78be-4404-a34c-f8b14b30e8ef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:32.786819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-95e9bc8c-78be-4404-a34c-f8b14b30e8ef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:32.807128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95e9bc8c-78be-4404-a34c-f8b14b30e8ef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:32.808787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95e9bc8c-78be-4404-a34c-f8b14b30e8ef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:32.809427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95e9bc8c-78be-4404-a34c-f8b14b30e8ef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:32.811051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95e9bc8c-78be-4404-a34c-f8b14b30e8ef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:32.813259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95e9bc8c-78be-4404-a34c-f8b14b30e8ef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:32.814289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-95e9bc8c-78be-4404-a34c-f8b14b30e8ef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:32.988748 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b369871b-4b36-4425-97a7-8bbe934a7342 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.022905 Oct 29 03:13:32.997537 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2893/5825] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Oct 29 03:13:31 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1025 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 29 03:13:33.004940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4cd47d70-bf94-4e83-9ad2-5f682834c187 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a384ca60>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:33.080686 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4cd47d70-bf94-4e83-9ad2-5f682834c187 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5" status: 200 len: 344 microversion: 2.1 time: 0.080887 Oct 29 03:13:33.081478 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2894/5826] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:13:32 2022] GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:13:33.092901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-91fee602-6c6a-41a3-a589-d50246e06a7b req-efb45693-2ff8-4e6f-a9c0-d0314661a5aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37fd6874-8c38-4df7-aa0b-a77fc38850bc", "tag": "c7e8fc92-fda8-403c-bb0f-155bfdcc3152"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:33.103597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-91fee602-6c6a-41a3-a589-d50246e06a7b req-efb45693-2ff8-4e6f-a9c0-d0314661a5aa service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:33.104337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-91fee602-6c6a-41a3-a589-d50246e06a7b req-efb45693-2ff8-4e6f-a9c0-d0314661a5aa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:33.105042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-91fee602-6c6a-41a3-a589-d50246e06a7b req-efb45693-2ff8-4e6f-a9c0-d0314661a5aa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:33.120596 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-91fee602-6c6a-41a3-a589-d50246e06a7b req-efb45693-2ff8-4e6f-a9c0-d0314661a5aa service nova] Creating event network-changed:c7e8fc92-fda8-403c-bb0f-155bfdcc3152 for instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc on n-h1-862964-4 Oct 29 03:13:33.132829 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-91fee602-6c6a-41a3-a589-d50246e06a7b req-efb45693-2ff8-4e6f-a9c0-d0314661a5aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049219 Oct 29 03:13:33.134036 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2895/5827] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:33.604740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-95e9bc8c-78be-4404-a34c-f8b14b30e8ef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:33.623088 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-95e9bc8c-78be-4404-a34c-f8b14b30e8ef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1321 microversion: 2.1 time: 0.842129 Oct 29 03:13:33.625392 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2933/5828] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:32 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1321 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:34.100283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5dfdec5b-f313-4965-b7d2-31615cd869a1 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1acc22d30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:34.354407 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5dfdec5b-f313-4965-b7d2-31615cd869a1 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5" status: 200 len: 345 microversion: 2.1 time: 0.261239 Oct 29 03:13:34.355000 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2896/5829] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:13:34 2022] GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 => generated 345 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:34.369145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-28c6cf3e-c1ce-4e86-98c8-d110b8bd371d tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Action: 'create', calling method: .version_select at 0x7fe1a84751f0>, body: {"snapshot": {"volume_id": "48c634e3-2ee2-491b-90e7-424cb81489d5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1970964297"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:34.619661 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-28c6cf3e-c1ce-4e86-98c8-d110b8bd371d tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.254928 Oct 29 03:13:34.620346 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2934/5830] 10.222.0.16 () {60 vars in 1162 bytes} [Sat Oct 29 03:13:34 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:34.632190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bc722412-53ae-4c34-9cc0-7c49c0264d59 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1acc223a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:34.649070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17f57e2e-359f-49d7-af5c-0f97f5b8d3f5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:34.650131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-17f57e2e-359f-49d7-af5c-0f97f5b8d3f5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:34.682779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17f57e2e-359f-49d7-af5c-0f97f5b8d3f5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:34.683366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17f57e2e-359f-49d7-af5c-0f97f5b8d3f5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:34.683872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17f57e2e-359f-49d7-af5c-0f97f5b8d3f5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:34.690295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17f57e2e-359f-49d7-af5c-0f97f5b8d3f5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:34.690985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17f57e2e-359f-49d7-af5c-0f97f5b8d3f5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:34.693409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17f57e2e-359f-49d7-af5c-0f97f5b8d3f5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:34.703596 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bc722412-53ae-4c34-9cc0-7c49c0264d59 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f" status: 200 len: 287 microversion: 2.1 time: 0.075659 Oct 29 03:13:34.704613 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2897/5831] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:13:34 2022] GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:34.716980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8e2808ec-2058-448f-b58c-426d11a5af19 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a385eca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:34.780511 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8e2808ec-2058-448f-b58c-426d11a5af19 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.068638 Oct 29 03:13:34.781093 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2898/5832] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Oct 29 03:13:34 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:13:34.796085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e75624e-42a7-4173-9249-b2b502848b0a tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1acc22ca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:34.843801 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e75624e-42a7-4173-9249-b2b502848b0a tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f" status: 200 len: 287 microversion: 2.1 time: 0.055064 Oct 29 03:13:34.844828 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2899/5833] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:13:34 2022] GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:13:35.051728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-17f57e2e-359f-49d7-af5c-0f97f5b8d3f5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:35.074736 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-17f57e2e-359f-49d7-af5c-0f97f5b8d3f5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1321 microversion: 2.1 time: 0.430998 Oct 29 03:13:35.098187 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2935/5834] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:34 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:13:35.199623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8fe8f042-ee80-42f3-a172-cdd2ffafecc4 req-f294b3c2-7260-4e0a-a9e8-20c2fb5621a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "432b0c44-ded6-4344-8c88-27d842cfb635", "tag": "cf125b0e-e530-4df4-8a3d-a952bc6a5281"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:35.224350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8fe8f042-ee80-42f3-a172-cdd2ffafecc4 req-f294b3c2-7260-4e0a-a9e8-20c2fb5621a4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:35.224851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8fe8f042-ee80-42f3-a172-cdd2ffafecc4 req-f294b3c2-7260-4e0a-a9e8-20c2fb5621a4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:35.226552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8fe8f042-ee80-42f3-a172-cdd2ffafecc4 req-f294b3c2-7260-4e0a-a9e8-20c2fb5621a4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:35.252998 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8fe8f042-ee80-42f3-a172-cdd2ffafecc4 req-f294b3c2-7260-4e0a-a9e8-20c2fb5621a4 service nova] Creating event network-changed:cf125b0e-e530-4df4-8a3d-a952bc6a5281 for instance 432b0c44-ded6-4344-8c88-27d842cfb635 on n-h2-862964-4 Oct 29 03:13:35.260689 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8fe8f042-ee80-42f3-a172-cdd2ffafecc4 req-f294b3c2-7260-4e0a-a9e8-20c2fb5621a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065953 Oct 29 03:13:35.270695 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2900/5835] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:35.857519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3465171d-5729-4f02-90a3-044749da0a1f tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a84750d0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:35.923956 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3465171d-5729-4f02-90a3-044749da0a1f tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f" status: 200 len: 287 microversion: 2.1 time: 0.070589 Oct 29 03:13:35.925215 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2936/5836] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:13:35 2022] GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:36.098368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4aaae521-06ce-4054-a2bf-2bbe641cc6e0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:36.099092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4aaae521-06ce-4054-a2bf-2bbe641cc6e0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:36.108275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:36.109646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=12 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:36.116575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aaae521-06ce-4054-a2bf-2bbe641cc6e0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:36.117395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aaae521-06ce-4054-a2bf-2bbe641cc6e0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:36.117856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aaae521-06ce-4054-a2bf-2bbe641cc6e0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:36.118590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aaae521-06ce-4054-a2bf-2bbe641cc6e0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:36.119039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aaae521-06ce-4054-a2bf-2bbe641cc6e0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:36.119467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aaae521-06ce-4054-a2bf-2bbe641cc6e0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:36.925741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4aaae521-06ce-4054-a2bf-2bbe641cc6e0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:36.937660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5f8da4e2-1dd7-46ea-b020-d15bd8930815 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a854b940>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:36.952762 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4aaae521-06ce-4054-a2bf-2bbe641cc6e0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1321 microversion: 2.1 time: 0.859594 Oct 29 03:13:36.954877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:36.958341 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2901/5837] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:36 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1321 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:37.016416 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5f8da4e2-1dd7-46ea-b020-d15bd8930815 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f" status: 200 len: 287 microversion: 2.1 time: 0.083041 Oct 29 03:13:37.017252 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2937/5838] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:13:36 2022] GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:37.983789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aed17552-de21-4fed-ab3c-47dc09a030bd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:37.984961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aed17552-de21-4fed-ab3c-47dc09a030bd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:37.995066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aed17552-de21-4fed-ab3c-47dc09a030bd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:37.995841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aed17552-de21-4fed-ab3c-47dc09a030bd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:37.996443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aed17552-de21-4fed-ab3c-47dc09a030bd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:37.997320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aed17552-de21-4fed-ab3c-47dc09a030bd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:37.998058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aed17552-de21-4fed-ab3c-47dc09a030bd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:37.998643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aed17552-de21-4fed-ab3c-47dc09a030bd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:38.031209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9a89ef33-cd35-4059-a801-50d2628c1f9c tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1acbb5670>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:38.081879 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9a89ef33-cd35-4059-a801-50d2628c1f9c tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f" status: 200 len: 288 microversion: 2.1 time: 0.055592 Oct 29 03:13:38.090620 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2938/5839] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:13:38 2022] GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f => generated 288 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:38.096324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d445f70c-e02b-4006-ad0f-3a9f3f3ee9e5 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a33ba430>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:38.184780 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d445f70c-e02b-4006-ad0f-3a9f3f3ee9e5 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f" status: 202 len: 0 microversion: 2.1 time: 0.092228 Oct 29 03:13:38.188395 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2939/5840] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 03:13:38 2022] DELETE /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:13:38.194778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-431e7f2a-cbbc-4ab6-b9e4-073a105257ff tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a3352700>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:38.249519 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-431e7f2a-cbbc-4ab6-b9e4-073a105257ff tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f" status: 200 len: 287 microversion: 2.1 time: 0.059978 Oct 29 03:13:38.250459 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2940/5841] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:13:38 2022] GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:38.700268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aed17552-de21-4fed-ab3c-47dc09a030bd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:38.713025 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aed17552-de21-4fed-ab3c-47dc09a030bd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1321 microversion: 2.1 time: 0.735668 Oct 29 03:13:38.732651 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2902/5842] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:37 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1321 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:39.265891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-792a8d28-2c89-42fd-b5ca-bd69e365d579 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a85943a0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:39.312333 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-792a8d28-2c89-42fd-b5ca-bd69e365d579 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f" status: 200 len: 287 microversion: 2.1 time: 0.051995 Oct 29 03:13:39.312932 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2941/5843] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:13:39 2022] GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:13:39.745957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-413f8dbc-0519-4289-af30-5ca2b1425689 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:39.747221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-413f8dbc-0519-4289-af30-5ca2b1425689 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:39.760750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-413f8dbc-0519-4289-af30-5ca2b1425689 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:39.762394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-413f8dbc-0519-4289-af30-5ca2b1425689 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:39.764084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-413f8dbc-0519-4289-af30-5ca2b1425689 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:39.765584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-413f8dbc-0519-4289-af30-5ca2b1425689 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:39.770631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-413f8dbc-0519-4289-af30-5ca2b1425689 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:39.771341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-413f8dbc-0519-4289-af30-5ca2b1425689 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:40.329840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-88fdd95b-f5dd-48ac-b02f-ce5c752131bb tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a854b1f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:40.407539 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-88fdd95b-f5dd-48ac-b02f-ce5c752131bb tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f" status: 200 len: 287 microversion: 2.1 time: 0.083907 Oct 29 03:13:40.409011 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2942/5844] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:13:40 2022] GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:40.478912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-413f8dbc-0519-4289-af30-5ca2b1425689 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:40.489352 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-413f8dbc-0519-4289-af30-5ca2b1425689 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1321 microversion: 2.1 time: 0.747585 Oct 29 03:13:40.489994 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2903/5845] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:39 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1321 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:40.899134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4f69b981-5433-4be8-b6de-20fa47e8eed5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:40.900344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4f69b981-5433-4be8-b6de-20fa47e8eed5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:40.910287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f69b981-5433-4be8-b6de-20fa47e8eed5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:40.910839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f69b981-5433-4be8-b6de-20fa47e8eed5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:40.911219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f69b981-5433-4be8-b6de-20fa47e8eed5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:40.916234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f69b981-5433-4be8-b6de-20fa47e8eed5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:40.916890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f69b981-5433-4be8-b6de-20fa47e8eed5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:40.917360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f69b981-5433-4be8-b6de-20fa47e8eed5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:40.973439 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4f69b981-5433-4be8-b6de-20fa47e8eed5 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/ips" status: 200 len: 145 microversion: 2.1 time: 0.078165 Oct 29 03:13:40.974748 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2943/5846] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:13:40 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/ips => generated 145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:41.420761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8db86180-a6bd-4929-a023-88571baf44ee tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a38d78b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:41.487616 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-8db86180-a6bd-4929-a023-88571baf44ee tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] HTTP exception thrown: Snapshot 6e324467-bbe7-48d3-a741-dd597001233f could not be found. Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8db86180-a6bd-4929-a023-88571baf44ee tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Request method failure captured: Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f HTTP/1.1 Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJpb5CRYDdUzJMBsnrIyCQBe92SXQ0ZfGgpFiNVzTfLQ1u9dfdm48ij254OUQrdX30sKzkuKBYngrh_KAGKKcLAmhj-QiiF66UvuCPyP0zeXwKxwq8u1dDHtKiZ23vzIeLNwAJk5QnbT-tKU4DO6GYXedNVX4WWunGmKLVxZycRpP2k Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: bec6f8b74a4d44b2be4eee296a42a953 Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bec6f8b74a4d44b2be4eee296a42a953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bec6f8b74a4d44b2be4eee296a42a953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bec6f8b74a4d44b2be4eee296a42a953", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bec6f8b74a4d44b2be4eee296a42a953"}]}] Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: bec6f8b74a4d44b2be4eee296a42a953 Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesSnapshotsTestJSON-1768830913-project Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: ded3fc6d1e7a42ecae088c96856add61 Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1768830913-project Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: exception: Snapshot 6e324467-bbe7-48d3-a741-dd597001233f could not be found. Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '6e324467-bbe7-48d3-a741-dd597001233f'} Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6e324467-bbe7-48d3-a741-dd597001233f could not be found. (HTTP 404) (Request-ID: req-02cb06c9-659c-4a42-ac53-1ca59b658b53) Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:13:41.494265 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6e324467-bbe7-48d3-a741-dd597001233f could not be found. Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6e324467-bbe7-48d3-a741-dd597001233f could not be found. Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6e324467-bbe7-48d3-a741-dd597001233f could not be found. Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8db86180-a6bd-4929-a023-88571baf44ee tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Returning 404 to user: Snapshot 6e324467-bbe7-48d3-a741-dd597001233f could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8db86180-a6bd-4929-a023-88571baf44ee tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f" status: 404 len: 111 microversion: 2.1 time: 0.079366 Oct 29 03:13:41.498916 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2904/5847] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:13:41 2022] GET /compute/v2.1/os-snapshots/6e324467-bbe7-48d3-a741-dd597001233f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:13:41.505084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c825c8d4-92df-44ca-9942-6d5b950203a7 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a33bae50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:41.517506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ad5ed26-3868-4a1f-9592-e567b85caa70 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:41.518294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9ad5ed26-3868-4a1f-9592-e567b85caa70 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:41.572490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad5ed26-3868-4a1f-9592-e567b85caa70 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:41.573003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad5ed26-3868-4a1f-9592-e567b85caa70 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:41.573449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad5ed26-3868-4a1f-9592-e567b85caa70 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:41.586371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad5ed26-3868-4a1f-9592-e567b85caa70 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:41.587027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad5ed26-3868-4a1f-9592-e567b85caa70 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:41.587486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ad5ed26-3868-4a1f-9592-e567b85caa70 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:41.626030 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c825c8d4-92df-44ca-9942-6d5b950203a7 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5" status: 202 len: 0 microversion: 2.1 time: 0.124866 Oct 29 03:13:41.627470 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2944/5848] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:13:41 2022] DELETE /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:13:41.636437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-685d2de2-e4b1-4ef4-a1c0-e29fc90fece9 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a8bc3d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:41.756537 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-685d2de2-e4b1-4ef4-a1c0-e29fc90fece9 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5" status: 200 len: 344 microversion: 2.1 time: 0.124318 Oct 29 03:13:41.757127 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2945/5849] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:13:41 2022] GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 => generated 344 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:13:41.938394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-636239f0-70f2-4cfd-ad28-8c5b1839d903 req-1e2f01ec-0c14-4ae5-baea-2ae8735e5096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fd6874-8c38-4df7-aa0b-a77fc38850bc", "name": "network-vif-plugged", "status": "completed", "tag": "c7e8fc92-fda8-403c-bb0f-155bfdcc3152"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:41.960383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-636239f0-70f2-4cfd-ad28-8c5b1839d903 req-1e2f01ec-0c14-4ae5-baea-2ae8735e5096 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:41.962635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-636239f0-70f2-4cfd-ad28-8c5b1839d903 req-1e2f01ec-0c14-4ae5-baea-2ae8735e5096 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:41.964503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-636239f0-70f2-4cfd-ad28-8c5b1839d903 req-1e2f01ec-0c14-4ae5-baea-2ae8735e5096 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:41.990871 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-636239f0-70f2-4cfd-ad28-8c5b1839d903 req-1e2f01ec-0c14-4ae5-baea-2ae8735e5096 service nova] Creating event network-vif-plugged:c7e8fc92-fda8-403c-bb0f-155bfdcc3152 for instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc on n-h1-862964-4 Oct 29 03:13:42.003540 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-636239f0-70f2-4cfd-ad28-8c5b1839d903 req-1e2f01ec-0c14-4ae5-baea-2ae8735e5096 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068954 Oct 29 03:13:42.006499 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2946/5850] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:13:42.210986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ad5ed26-3868-4a1f-9592-e567b85caa70 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:42.225517 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ad5ed26-3868-4a1f-9592-e567b85caa70 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1321 microversion: 2.1 time: 0.712231 Oct 29 03:13:42.228462 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2905/5851] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:41 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1321 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:13:42.771445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b73c4d28-4ad6-4722-87bd-dcae9b9b3fd6 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1acbb51f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:42.879496 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b73c4d28-4ad6-4722-87bd-dcae9b9b3fd6 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5" status: 200 len: 344 microversion: 2.1 time: 0.112280 Oct 29 03:13:42.880360 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2947/5852] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:13:42 2022] GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 => generated 344 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:43.254916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ab20f90-763b-40ce-9e68-00014d79e5b6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:43.255532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ab20f90-763b-40ce-9e68-00014d79e5b6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:43.273492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ab20f90-763b-40ce-9e68-00014d79e5b6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:43.274473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ab20f90-763b-40ce-9e68-00014d79e5b6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:43.275158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ab20f90-763b-40ce-9e68-00014d79e5b6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:43.276103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ab20f90-763b-40ce-9e68-00014d79e5b6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:43.276837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ab20f90-763b-40ce-9e68-00014d79e5b6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:43.277463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ab20f90-763b-40ce-9e68-00014d79e5b6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:43.669793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ab20f90-763b-40ce-9e68-00014d79e5b6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:43.686693 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ab20f90-763b-40ce-9e68-00014d79e5b6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1321 microversion: 2.1 time: 0.436015 Oct 29 03:13:43.688482 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2906/5853] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:43 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1321 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:43.854494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-64c60393-8c66-415d-bebd-4ed5eb3135e1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0729f5f3-6c4a-4057-8c99-b254c112bb47"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:43.857895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-64c60393-8c66-415d-bebd-4ed5eb3135e1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:43.880601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64c60393-8c66-415d-bebd-4ed5eb3135e1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:43.881236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64c60393-8c66-415d-bebd-4ed5eb3135e1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:43.881785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64c60393-8c66-415d-bebd-4ed5eb3135e1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:43.882550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64c60393-8c66-415d-bebd-4ed5eb3135e1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:43.884168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64c60393-8c66-415d-bebd-4ed5eb3135e1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:43.886090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-64c60393-8c66-415d-bebd-4ed5eb3135e1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:43.894932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94f53a98-5095-483f-867c-e561b920a693 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a38d7280>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:44.005386 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94f53a98-5095-483f-867c-e561b920a693 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5" status: 200 len: 344 microversion: 2.1 time: 0.115529 Oct 29 03:13:44.006560 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2907/5854] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:13:43 2022] GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 => generated 344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:13:44.339746 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-64c60393-8c66-415d-bebd-4ed5eb3135e1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "POST /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486648 Oct 29 03:13:44.342303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2948/5855] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:13:43 2022] POST /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:44.713531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d248f2f3-d575-447c-ad81-ed931be22056 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:44.714987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d248f2f3-d575-447c-ad81-ed931be22056 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:44.733540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d248f2f3-d575-447c-ad81-ed931be22056 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:44.735066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d248f2f3-d575-447c-ad81-ed931be22056 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:44.735471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d248f2f3-d575-447c-ad81-ed931be22056 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:44.736328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d248f2f3-d575-447c-ad81-ed931be22056 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:44.736802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d248f2f3-d575-447c-ad81-ed931be22056 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:44.737229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d248f2f3-d575-447c-ad81-ed931be22056 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:45.021683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-67052231-f12f-43de-a59f-3805fd48fedb tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a8bc3c10>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:45.140901 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-67052231-f12f-43de-a59f-3805fd48fedb tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5" status: 200 len: 344 microversion: 2.1 time: 0.123834 Oct 29 03:13:45.141764 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2949/5856] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:13:45 2022] GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 => generated 344 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:45.282535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d248f2f3-d575-447c-ad81-ed931be22056 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:45.301711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ca9c9972-3639-436a-b341-503346b49070 req-cdb4d2b7-bcef-466b-b1fd-17c34821ed82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432b0c44-ded6-4344-8c88-27d842cfb635", "name": "network-vif-plugged", "status": "completed", "tag": "cf125b0e-e530-4df4-8a3d-a952bc6a5281"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:45.307662 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d248f2f3-d575-447c-ad81-ed931be22056 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1321 microversion: 2.1 time: 0.599993 Oct 29 03:13:45.308215 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2908/5857] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:44 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1321 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:45.334776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ca9c9972-3639-436a-b341-503346b49070 req-cdb4d2b7-bcef-466b-b1fd-17c34821ed82 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:45.335650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ca9c9972-3639-436a-b341-503346b49070 req-cdb4d2b7-bcef-466b-b1fd-17c34821ed82 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:45.337496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ca9c9972-3639-436a-b341-503346b49070 req-cdb4d2b7-bcef-466b-b1fd-17c34821ed82 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:45.362932 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ca9c9972-3639-436a-b341-503346b49070 req-cdb4d2b7-bcef-466b-b1fd-17c34821ed82 service nova] Creating event network-vif-plugged:cf125b0e-e530-4df4-8a3d-a952bc6a5281 for instance 432b0c44-ded6-4344-8c88-27d842cfb635 on n-h2-862964-4 Oct 29 03:13:45.371048 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ca9c9972-3639-436a-b341-503346b49070 req-cdb4d2b7-bcef-466b-b1fd-17c34821ed82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071812 Oct 29 03:13:45.388707 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2950/5858] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:46.156337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7b4e347-b0f6-4eeb-be08-0cd4d2b91796 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a38d7af0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:46.206726 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-c7b4e347-b0f6-4eeb-be08-0cd4d2b91796 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] HTTP exception thrown: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7b4e347-b0f6-4eeb-be08-0cd4d2b91796 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Request method failure captured: Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 HTTP/1.1 Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJpb5CRYDdUzJMBsnrIyCQBe92SXQ0ZfGgpFiNVzTfLQ1u9dfdm48ij254OUQrdX30sKzkuKBYngrh_KAGKKcLAmhj-QiiF66UvuCPyP0zeXwKxwq8u1dDHtKiZ23vzIeLNwAJk5QnbT-tKU4DO6GYXedNVX4WWunGmKLVxZycRpP2k Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: bec6f8b74a4d44b2be4eee296a42a953 Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bec6f8b74a4d44b2be4eee296a42a953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bec6f8b74a4d44b2be4eee296a42a953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bec6f8b74a4d44b2be4eee296a42a953", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bec6f8b74a4d44b2be4eee296a42a953"}]}] Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: bec6f8b74a4d44b2be4eee296a42a953 Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesSnapshotsTestJSON-1768830913-project Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: ded3fc6d1e7a42ecae088c96856add61 Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1768830913-project Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: exception: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '48c634e3-2ee2-491b-90e7-424cb81489d5'} Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. (HTTP 404) (Request-ID: req-431d8ebd-3613-4a5f-b317-147dc4e78c1d) Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:13:46.209434 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.213432 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.218451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7b4e347-b0f6-4eeb-be08-0cd4d2b91796 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Returning 404 to user: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:46.219514 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7b4e347-b0f6-4eeb-be08-0cd4d2b91796 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5" status: 404 len: 109 microversion: 2.1 time: 0.067851 Oct 29 03:13:46.220921 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2909/5859] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:13:46 2022] GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:13:46.237629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-860fae6e-0009-4f74-8554-4e10ca9d0027 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a33ba280>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:46.282425 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-860fae6e-0009-4f74-8554-4e10ca9d0027 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] HTTP exception thrown: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-860fae6e-0009-4f74-8554-4e10ca9d0027 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Request method failure captured: Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 HTTP/1.1 Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJpb5CRYDdUzJMBsnrIyCQBe92SXQ0ZfGgpFiNVzTfLQ1u9dfdm48ij254OUQrdX30sKzkuKBYngrh_KAGKKcLAmhj-QiiF66UvuCPyP0zeXwKxwq8u1dDHtKiZ23vzIeLNwAJk5QnbT-tKU4DO6GYXedNVX4WWunGmKLVxZycRpP2k Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: bec6f8b74a4d44b2be4eee296a42a953 Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bec6f8b74a4d44b2be4eee296a42a953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bec6f8b74a4d44b2be4eee296a42a953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bec6f8b74a4d44b2be4eee296a42a953", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bec6f8b74a4d44b2be4eee296a42a953"}]}] Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: bec6f8b74a4d44b2be4eee296a42a953 Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-VolumesSnapshotsTestJSON-1768830913-project Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: ded3fc6d1e7a42ecae088c96856add61 Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1768830913-project Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: method: Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: exception: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '48c634e3-2ee2-491b-90e7-424cb81489d5'} Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. (HTTP 404) (Request-ID: req-a0dece84-6e4d-4b9f-91be-44c8c6c15361) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:13:46.284676 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.290092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.296559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-860fae6e-0009-4f74-8554-4e10ca9d0027 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Returning 404 to user: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:46.296559 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-860fae6e-0009-4f74-8554-4e10ca9d0027 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5" status: 404 len: 109 microversion: 2.1 time: 0.066271 Oct 29 03:13:46.296559 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2951/5860] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:13:46 2022] DELETE /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:13:46.309011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9878b746-1666-4034-a17a-42342819de33 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Calling method '.version_select at 0x7fe1a384ce50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:46.332213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-706212a5-424b-45f7-b512-37558c3088e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:46.333326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-706212a5-424b-45f7-b512-37558c3088e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:46.345094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706212a5-424b-45f7-b512-37558c3088e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:46.351376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706212a5-424b-45f7-b512-37558c3088e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:46.352180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706212a5-424b-45f7-b512-37558c3088e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:46.353036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706212a5-424b-45f7-b512-37558c3088e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:46.357382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706212a5-424b-45f7-b512-37558c3088e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:46.362425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-706212a5-424b-45f7-b512-37558c3088e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:46.373363 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-9878b746-1666-4034-a17a-42342819de33 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] HTTP exception thrown: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9878b746-1666-4034-a17a-42342819de33 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Request method failure captured: Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 HTTP/1.1 Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJpb5CRYDdUzJMBsnrIyCQBe92SXQ0ZfGgpFiNVzTfLQ1u9dfdm48ij254OUQrdX30sKzkuKBYngrh_KAGKKcLAmhj-QiiF66UvuCPyP0zeXwKxwq8u1dDHtKiZ23vzIeLNwAJk5QnbT-tKU4DO6GYXedNVX4WWunGmKLVxZycRpP2k Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: bec6f8b74a4d44b2be4eee296a42a953 Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bec6f8b74a4d44b2be4eee296a42a953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bec6f8b74a4d44b2be4eee296a42a953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bec6f8b74a4d44b2be4eee296a42a953", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bec6f8b74a4d44b2be4eee296a42a953"}]}] Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: bec6f8b74a4d44b2be4eee296a42a953 Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1768830913 Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesSnapshotsTestJSON-1768830913-project Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: ded3fc6d1e7a42ecae088c96856add61 Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1768830913-project Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: method: Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: exception: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '48c634e3-2ee2-491b-90e7-424cb81489d5'} Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. (HTTP 404) (Request-ID: req-a59753bf-927e-4127-9163-39ab022c2007) Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:13:46.377739 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9878b746-1666-4034-a17a-42342819de33 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] Returning 404 to user: Volume 48c634e3-2ee2-491b-90e7-424cb81489d5 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:46.381381 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9878b746-1666-4034-a17a-42342819de33 tempest-VolumesSnapshotsTestJSON-1768830913 tempest-VolumesSnapshotsTestJSON-1768830913-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5" status: 404 len: 109 microversion: 2.1 time: 0.078420 Oct 29 03:13:46.383775 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2910/5861] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:13:46 2022] GET /compute/v2.1/os-volumes/48c634e3-2ee2-491b-90e7-424cb81489d5 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:13:47.203330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-706212a5-424b-45f7-b512-37558c3088e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:47.212877 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-706212a5-424b-45f7-b512-37558c3088e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1321 microversion: 2.1 time: 0.885936 Oct 29 03:13:47.234816 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2952/5862] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:46 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1321 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:13:48.262441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9fae7077-6a32-46c2-9c7f-5103c6540fef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:48.263179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9fae7077-6a32-46c2-9c7f-5103c6540fef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:48.281375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fae7077-6a32-46c2-9c7f-5103c6540fef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:48.297557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fae7077-6a32-46c2-9c7f-5103c6540fef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:48.297976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fae7077-6a32-46c2-9c7f-5103c6540fef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:48.298646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fae7077-6a32-46c2-9c7f-5103c6540fef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:48.299152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fae7077-6a32-46c2-9c7f-5103c6540fef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:48.299582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fae7077-6a32-46c2-9c7f-5103c6540fef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:48.735285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9fae7077-6a32-46c2-9c7f-5103c6540fef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:48.749621 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9fae7077-6a32-46c2-9c7f-5103c6540fef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1514 microversion: 2.1 time: 0.494542 Oct 29 03:13:48.751867 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2911/5863] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:48 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1514 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:48.780509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-38796a6a-424d-4d0f-94e3-fc5ddbd2b3c1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:48.783879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-38796a6a-424d-4d0f-94e3-fc5ddbd2b3c1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:48.819102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38796a6a-424d-4d0f-94e3-fc5ddbd2b3c1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:48.819610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38796a6a-424d-4d0f-94e3-fc5ddbd2b3c1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:48.820047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38796a6a-424d-4d0f-94e3-fc5ddbd2b3c1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:48.823258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38796a6a-424d-4d0f-94e3-fc5ddbd2b3c1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:48.823746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38796a6a-424d-4d0f-94e3-fc5ddbd2b3c1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:48.824175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38796a6a-424d-4d0f-94e3-fc5ddbd2b3c1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:48.884126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-38796a6a-424d-4d0f-94e3-fc5ddbd2b3c1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lazy-loading 'flavor' on Instance uuid 432b0c44-ded6-4344-8c88-27d842cfb635 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:13:49.297007 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-38796a6a-424d-4d0f-94e3-fc5ddbd2b3c1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635/action" status: 200 len: 32 microversion: 2.1 time: 0.522662 Oct 29 03:13:49.306239 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2953/5864] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:13:48 2022] POST /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635/action => generated 32 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:13:49.318306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-846d4d0f-04a6-46f8-a55a-44a4707d9457 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:49.320007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-846d4d0f-04a6-46f8-a55a-44a4707d9457 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:49.355509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-846d4d0f-04a6-46f8-a55a-44a4707d9457 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:49.358042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-846d4d0f-04a6-46f8-a55a-44a4707d9457 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:49.358824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-846d4d0f-04a6-46f8-a55a-44a4707d9457 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:49.364356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-846d4d0f-04a6-46f8-a55a-44a4707d9457 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:49.367804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-846d4d0f-04a6-46f8-a55a-44a4707d9457 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:49.368780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-846d4d0f-04a6-46f8-a55a-44a4707d9457 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:50.081578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-846d4d0f-04a6-46f8-a55a-44a4707d9457 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:50.095455 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-846d4d0f-04a6-46f8-a55a-44a4707d9457 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.783077 Oct 29 03:13:50.109994 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2912/5865] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:49 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:51.137269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45933ec4-6ce8-4228-8bcc-65a6aa28c904 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:51.138024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-45933ec4-6ce8-4228-8bcc-65a6aa28c904 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:51.144613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:51.163748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45933ec4-6ce8-4228-8bcc-65a6aa28c904 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:51.164264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45933ec4-6ce8-4228-8bcc-65a6aa28c904 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:51.164705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45933ec4-6ce8-4228-8bcc-65a6aa28c904 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:51.169771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45933ec4-6ce8-4228-8bcc-65a6aa28c904 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:51.170488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45933ec4-6ce8-4228-8bcc-65a6aa28c904 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:51.170928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45933ec4-6ce8-4228-8bcc-65a6aa28c904 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:52.229609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-45933ec4-6ce8-4228-8bcc-65a6aa28c904 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:52.250215 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-45933ec4-6ce8-4228-8bcc-65a6aa28c904 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 1.131402 Oct 29 03:13:52.254861 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2954/5866] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:51 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:53.281651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ed8086a-ac34-48b1-a475-3ae687273082 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:53.282293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2ed8086a-ac34-48b1-a475-3ae687273082 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:53.298111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed8086a-ac34-48b1-a475-3ae687273082 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:53.298666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed8086a-ac34-48b1-a475-3ae687273082 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:53.301344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed8086a-ac34-48b1-a475-3ae687273082 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:53.302157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed8086a-ac34-48b1-a475-3ae687273082 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:53.302630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed8086a-ac34-48b1-a475-3ae687273082 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:53.305214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ed8086a-ac34-48b1-a475-3ae687273082 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:54.356284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2ed8086a-ac34-48b1-a475-3ae687273082 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:54.371900 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ed8086a-ac34-48b1-a475-3ae687273082 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 1.097604 Oct 29 03:13:54.375866 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2913/5867] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:53 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:55.400853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5e014f78-7977-464a-94c9-a9d43a1267a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:55.401452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5e014f78-7977-464a-94c9-a9d43a1267a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:55.413747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e014f78-7977-464a-94c9-a9d43a1267a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:55.414274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e014f78-7977-464a-94c9-a9d43a1267a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:55.414700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e014f78-7977-464a-94c9-a9d43a1267a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:55.417894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e014f78-7977-464a-94c9-a9d43a1267a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:55.420376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e014f78-7977-464a-94c9-a9d43a1267a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:55.421000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e014f78-7977-464a-94c9-a9d43a1267a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:55.453563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:55.781125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5e014f78-7977-464a-94c9-a9d43a1267a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:55.809702 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5e014f78-7977-464a-94c9-a9d43a1267a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.412274 Oct 29 03:13:55.837013 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2955/5868] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:55 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:56.852334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5b52aa6-28cf-4497-85ed-052e2eadbeb2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:56.855117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5b52aa6-28cf-4497-85ed-052e2eadbeb2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:56.876945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5b52aa6-28cf-4497-85ed-052e2eadbeb2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:56.878135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5b52aa6-28cf-4497-85ed-052e2eadbeb2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:56.878699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5b52aa6-28cf-4497-85ed-052e2eadbeb2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:56.880100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5b52aa6-28cf-4497-85ed-052e2eadbeb2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:56.880820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5b52aa6-28cf-4497-85ed-052e2eadbeb2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:56.881269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5b52aa6-28cf-4497-85ed-052e2eadbeb2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:56.887175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=72 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:57.147030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e5b52aa6-28cf-4497-85ed-052e2eadbeb2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:57.165862 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e5b52aa6-28cf-4497-85ed-052e2eadbeb2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.328040 Oct 29 03:13:57.174145 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2914/5869] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:56 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:58.202188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c11a8a2e-35c8-468e-adef-b191a1963ecc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:58.203619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c11a8a2e-35c8-468e-adef-b191a1963ecc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:58.214465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11a8a2e-35c8-468e-adef-b191a1963ecc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:58.219166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11a8a2e-35c8-468e-adef-b191a1963ecc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:58.219783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11a8a2e-35c8-468e-adef-b191a1963ecc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:58.221831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11a8a2e-35c8-468e-adef-b191a1963ecc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:58.223469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11a8a2e-35c8-468e-adef-b191a1963ecc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:58.224155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c11a8a2e-35c8-468e-adef-b191a1963ecc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:58.800136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c11a8a2e-35c8-468e-adef-b191a1963ecc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:58.815404 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c11a8a2e-35c8-468e-adef-b191a1963ecc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.618367 Oct 29 03:13:58.816819 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2956/5870] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:58 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:59.847239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-85d34eb6-d373-4613-974b-1f5769f65b12 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:59.848729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-85d34eb6-d373-4613-974b-1f5769f65b12 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:59.879152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85d34eb6-d373-4613-974b-1f5769f65b12 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:59.884780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85d34eb6-d373-4613-974b-1f5769f65b12 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:59.886043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85d34eb6-d373-4613-974b-1f5769f65b12 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:59.890344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85d34eb6-d373-4613-974b-1f5769f65b12 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:59.891905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85d34eb6-d373-4613-974b-1f5769f65b12 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:59.896339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-85d34eb6-d373-4613-974b-1f5769f65b12 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:59.995249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-429a5175-74d6-4466-a46f-f2c51b2c2bae tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:00.001829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-429a5175-74d6-4466-a46f-f2c51b2c2bae tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:00.034458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-429a5175-74d6-4466-a46f-f2c51b2c2bae tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:00.046756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-429a5175-74d6-4466-a46f-f2c51b2c2bae tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:00.059761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-429a5175-74d6-4466-a46f-f2c51b2c2bae tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:00.061930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-429a5175-74d6-4466-a46f-f2c51b2c2bae tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:00.065102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-429a5175-74d6-4466-a46f-f2c51b2c2bae tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:00.069205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-429a5175-74d6-4466-a46f-f2c51b2c2bae tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:00.146013 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-429a5175-74d6-4466-a46f-f2c51b2c2bae tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162924 Oct 29 03:14:00.153729 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2957/5871] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:13:59 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:14:00.164883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-889e039f-be30-4242-8923-c14cea54a231 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:00.168398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-889e039f-be30-4242-8923-c14cea54a231 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:00.184290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-889e039f-be30-4242-8923-c14cea54a231 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:00.185017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-889e039f-be30-4242-8923-c14cea54a231 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:00.185908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-889e039f-be30-4242-8923-c14cea54a231 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:00.186788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-889e039f-be30-4242-8923-c14cea54a231 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:00.187396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-889e039f-be30-4242-8923-c14cea54a231 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:00.187975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-889e039f-be30-4242-8923-c14cea54a231 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:00.239142 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-889e039f-be30-4242-8923-c14cea54a231 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments/0729f5f3-6c4a-4057-8c99-b254c112bb47" status: 200 len: 194 microversion: 2.1 time: 0.083460 Oct 29 03:14:00.246746 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2958/5872] 10.222.0.16 () {58 vars in 1413 bytes} [Sat Oct 29 03:14:00 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments/0729f5f3-6c4a-4057-8c99-b254c112bb47 => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:00.585473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-85d34eb6-d373-4613-974b-1f5769f65b12 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:00.612681 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-85d34eb6-d373-4613-974b-1f5769f65b12 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.773516 Oct 29 03:14:00.627233 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2915/5873] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:59 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:01.640390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-971a0ed1-8969-4a03-932f-ff41fde4e1bc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:01.642257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-971a0ed1-8969-4a03-932f-ff41fde4e1bc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:01.657247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-971a0ed1-8969-4a03-932f-ff41fde4e1bc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:01.658022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-971a0ed1-8969-4a03-932f-ff41fde4e1bc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:01.658494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-971a0ed1-8969-4a03-932f-ff41fde4e1bc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:01.670843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-971a0ed1-8969-4a03-932f-ff41fde4e1bc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:01.675126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-971a0ed1-8969-4a03-932f-ff41fde4e1bc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:01.676833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-971a0ed1-8969-4a03-932f-ff41fde4e1bc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:02.177571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-971a0ed1-8969-4a03-932f-ff41fde4e1bc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:02.187800 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-971a0ed1-8969-4a03-932f-ff41fde4e1bc tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.552410 Oct 29 03:14:02.200201 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2959/5874] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:01 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:03.091153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e34e80b1-acf7-467e-9f3c-6bbff19febfe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5be5140-52d7-4f47-8b92-9d3f3e8df059"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:03.093663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e34e80b1-acf7-467e-9f3c-6bbff19febfe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:03.098001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=28 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:03.115446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34e80b1-acf7-467e-9f3c-6bbff19febfe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:03.115934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34e80b1-acf7-467e-9f3c-6bbff19febfe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:03.116366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34e80b1-acf7-467e-9f3c-6bbff19febfe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:03.117381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34e80b1-acf7-467e-9f3c-6bbff19febfe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:03.125467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34e80b1-acf7-467e-9f3c-6bbff19febfe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:03.130762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34e80b1-acf7-467e-9f3c-6bbff19febfe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:03.213882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3638d859-de89-4d31-8f8b-d01b5cefcdcf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:03.214606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3638d859-de89-4d31-8f8b-d01b5cefcdcf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:03.231643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3638d859-de89-4d31-8f8b-d01b5cefcdcf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:03.232138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3638d859-de89-4d31-8f8b-d01b5cefcdcf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:03.232567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3638d859-de89-4d31-8f8b-d01b5cefcdcf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:03.233276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3638d859-de89-4d31-8f8b-d01b5cefcdcf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:03.233722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3638d859-de89-4d31-8f8b-d01b5cefcdcf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:03.240873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3638d859-de89-4d31-8f8b-d01b5cefcdcf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:03.675474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3638d859-de89-4d31-8f8b-d01b5cefcdcf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:03.685722 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e34e80b1-acf7-467e-9f3c-6bbff19febfe tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "POST /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.598464 Oct 29 03:14:03.687839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2916/5875] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:14:03 2022] POST /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:03.695041 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3638d859-de89-4d31-8f8b-d01b5cefcdcf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.485845 Oct 29 03:14:03.712854 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2960/5876] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:03 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:14:04.728839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1808e270-0270-4619-96a1-f1aa38ccebf3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:04.729565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1808e270-0270-4619-96a1-f1aa38ccebf3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:04.749547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1808e270-0270-4619-96a1-f1aa38ccebf3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:04.753949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1808e270-0270-4619-96a1-f1aa38ccebf3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:04.754558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1808e270-0270-4619-96a1-f1aa38ccebf3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:04.762076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1808e270-0270-4619-96a1-f1aa38ccebf3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:04.762809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1808e270-0270-4619-96a1-f1aa38ccebf3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:04.765751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1808e270-0270-4619-96a1-f1aa38ccebf3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:05.489411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1808e270-0270-4619-96a1-f1aa38ccebf3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:05.505187 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1808e270-0270-4619-96a1-f1aa38ccebf3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.782326 Oct 29 03:14:05.506203 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2917/5877] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:04 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:06.536494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c670495-8c9c-4a0d-8d1e-1a7a311cb37b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:06.537162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9c670495-8c9c-4a0d-8d1e-1a7a311cb37b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:06.591476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c670495-8c9c-4a0d-8d1e-1a7a311cb37b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:06.592482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c670495-8c9c-4a0d-8d1e-1a7a311cb37b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:06.594944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c670495-8c9c-4a0d-8d1e-1a7a311cb37b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:06.599953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c670495-8c9c-4a0d-8d1e-1a7a311cb37b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:06.602426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c670495-8c9c-4a0d-8d1e-1a7a311cb37b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:06.602894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c670495-8c9c-4a0d-8d1e-1a7a311cb37b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:06.952071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9c670495-8c9c-4a0d-8d1e-1a7a311cb37b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:06.975221 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c670495-8c9c-4a0d-8d1e-1a7a311cb37b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.443542 Oct 29 03:14:06.980739 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2961/5878] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:06 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:08.005115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9fd6653f-ebce-49d7-8038-909dfdc7f0e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:08.005648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9fd6653f-ebce-49d7-8038-909dfdc7f0e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:08.031048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fd6653f-ebce-49d7-8038-909dfdc7f0e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:08.035263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fd6653f-ebce-49d7-8038-909dfdc7f0e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:08.035979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fd6653f-ebce-49d7-8038-909dfdc7f0e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:08.036921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fd6653f-ebce-49d7-8038-909dfdc7f0e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:08.040289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fd6653f-ebce-49d7-8038-909dfdc7f0e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:08.040932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fd6653f-ebce-49d7-8038-909dfdc7f0e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:09.832885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9fd6653f-ebce-49d7-8038-909dfdc7f0e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:09.848469 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9fd6653f-ebce-49d7-8038-909dfdc7f0e9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 1.847845 Oct 29 03:14:09.852064 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2918/5879] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:07 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:10.879046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-72ebbef8-a7ee-4a10-b32d-7afdcf6466be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:10.880028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-72ebbef8-a7ee-4a10-b32d-7afdcf6466be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:10.889268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72ebbef8-a7ee-4a10-b32d-7afdcf6466be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:10.892099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72ebbef8-a7ee-4a10-b32d-7afdcf6466be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:10.892740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72ebbef8-a7ee-4a10-b32d-7afdcf6466be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:10.896598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72ebbef8-a7ee-4a10-b32d-7afdcf6466be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:10.897972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72ebbef8-a7ee-4a10-b32d-7afdcf6466be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:10.898722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-72ebbef8-a7ee-4a10-b32d-7afdcf6466be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:11.267219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-72ebbef8-a7ee-4a10-b32d-7afdcf6466be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:11.276692 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-72ebbef8-a7ee-4a10-b32d-7afdcf6466be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.404847 Oct 29 03:14:11.277989 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2962/5880] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:10 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:12.304435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e1659ca-a7c3-4fa1-8822-4fb608abcdb4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:12.304966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0e1659ca-a7c3-4fa1-8822-4fb608abcdb4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:12.326180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1659ca-a7c3-4fa1-8822-4fb608abcdb4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:12.326526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1659ca-a7c3-4fa1-8822-4fb608abcdb4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:12.326960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1659ca-a7c3-4fa1-8822-4fb608abcdb4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:12.327673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1659ca-a7c3-4fa1-8822-4fb608abcdb4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:12.328121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1659ca-a7c3-4fa1-8822-4fb608abcdb4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:12.328537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1659ca-a7c3-4fa1-8822-4fb608abcdb4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:12.948122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0e1659ca-a7c3-4fa1-8822-4fb608abcdb4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:12.973055 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e1659ca-a7c3-4fa1-8822-4fb608abcdb4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.673398 Oct 29 03:14:12.988172 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2919/5881] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:12 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:14.007787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d2ccfce-8b01-42e4-b628-b6ed4b0a3daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:14.016996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9d2ccfce-8b01-42e4-b628-b6ed4b0a3daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:14.041609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d2ccfce-8b01-42e4-b628-b6ed4b0a3daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:14.043679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d2ccfce-8b01-42e4-b628-b6ed4b0a3daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:14.045010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d2ccfce-8b01-42e4-b628-b6ed4b0a3daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:14.048489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d2ccfce-8b01-42e4-b628-b6ed4b0a3daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:14.049250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d2ccfce-8b01-42e4-b628-b6ed4b0a3daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:14.050136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d2ccfce-8b01-42e4-b628-b6ed4b0a3daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:14.278671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9d2ccfce-8b01-42e4-b628-b6ed4b0a3daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:14.286884 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9d2ccfce-8b01-42e4-b628-b6ed4b0a3daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.294725 Oct 29 03:14:14.289984 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2963/5882] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:13 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:15.312162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a1cc4d5b-aeae-480c-b378-f997bc37d3a1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:15.313706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a1cc4d5b-aeae-480c-b378-f997bc37d3a1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:15.328407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1cc4d5b-aeae-480c-b378-f997bc37d3a1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:15.330661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1cc4d5b-aeae-480c-b378-f997bc37d3a1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:15.333913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1cc4d5b-aeae-480c-b378-f997bc37d3a1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:15.334851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1cc4d5b-aeae-480c-b378-f997bc37d3a1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:15.335481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1cc4d5b-aeae-480c-b378-f997bc37d3a1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:15.337067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1cc4d5b-aeae-480c-b378-f997bc37d3a1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:15.831204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a1cc4d5b-aeae-480c-b378-f997bc37d3a1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:15.845040 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a1cc4d5b-aeae-480c-b378-f997bc37d3a1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.532634 Oct 29 03:14:15.848914 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2920/5883] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:15 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:16.878081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3c0d3c39-d54a-4dcc-98aa-3bc343c67949 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:16.878838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3c0d3c39-d54a-4dcc-98aa-3bc343c67949 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:16.890188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0d3c39-d54a-4dcc-98aa-3bc343c67949 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:16.897041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0d3c39-d54a-4dcc-98aa-3bc343c67949 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:16.897982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0d3c39-d54a-4dcc-98aa-3bc343c67949 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:16.899080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0d3c39-d54a-4dcc-98aa-3bc343c67949 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:16.899698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0d3c39-d54a-4dcc-98aa-3bc343c67949 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:16.900391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0d3c39-d54a-4dcc-98aa-3bc343c67949 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:17.734024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3c0d3c39-d54a-4dcc-98aa-3bc343c67949 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:17.761920 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3c0d3c39-d54a-4dcc-98aa-3bc343c67949 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.889522 Oct 29 03:14:17.765602 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2964/5884] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:16 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:18.792476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-66e282f9-265a-4072-ac56-fadce7de3882 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:18.795510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-66e282f9-265a-4072-ac56-fadce7de3882 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:18.810717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66e282f9-265a-4072-ac56-fadce7de3882 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:18.811199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66e282f9-265a-4072-ac56-fadce7de3882 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:18.815543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66e282f9-265a-4072-ac56-fadce7de3882 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:18.819195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66e282f9-265a-4072-ac56-fadce7de3882 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:18.819882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66e282f9-265a-4072-ac56-fadce7de3882 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:18.823124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66e282f9-265a-4072-ac56-fadce7de3882 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:19.304752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-66e282f9-265a-4072-ac56-fadce7de3882 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:19.332989 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-66e282f9-265a-4072-ac56-fadce7de3882 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.547070 Oct 29 03:14:19.334413 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2921/5885] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:18 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:19.944045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aecbff67-8b22-4907-9be4-128e8b018ba1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:19.948406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aecbff67-8b22-4907-9be4-128e8b018ba1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:19.963741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecbff67-8b22-4907-9be4-128e8b018ba1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:19.966973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecbff67-8b22-4907-9be4-128e8b018ba1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:19.967446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecbff67-8b22-4907-9be4-128e8b018ba1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:19.968206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecbff67-8b22-4907-9be4-128e8b018ba1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:19.969959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecbff67-8b22-4907-9be4-128e8b018ba1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:19.971039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aecbff67-8b22-4907-9be4-128e8b018ba1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:20.069485 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aecbff67-8b22-4907-9be4-128e8b018ba1 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.132332 Oct 29 03:14:20.070151 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2965/5886] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:14:19 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:20.220181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-675b4e35-b687-4ae3-8656-cd88f1cdca37 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:20.220963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-675b4e35-b687-4ae3-8656-cd88f1cdca37 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:20.239908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-675b4e35-b687-4ae3-8656-cd88f1cdca37 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:20.240408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-675b4e35-b687-4ae3-8656-cd88f1cdca37 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:20.240932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-675b4e35-b687-4ae3-8656-cd88f1cdca37 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:20.241584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-675b4e35-b687-4ae3-8656-cd88f1cdca37 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:20.242379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-675b4e35-b687-4ae3-8656-cd88f1cdca37 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:20.242804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-675b4e35-b687-4ae3-8656-cd88f1cdca37 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:20.314084 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-675b4e35-b687-4ae3-8656-cd88f1cdca37 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments/0729f5f3-6c4a-4057-8c99-b254c112bb47" status: 200 len: 194 microversion: 2.1 time: 0.098249 Oct 29 03:14:20.315351 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2922/5887] 10.222.0.16 () {58 vars in 1413 bytes} [Sat Oct 29 03:14:20 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments/0729f5f3-6c4a-4057-8c99-b254c112bb47 => generated 194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:20.327308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce3e335a-b3d2-4a39-99ae-01291562ebd3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:20.327965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ce3e335a-b3d2-4a39-99ae-01291562ebd3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:20.336742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce3e335a-b3d2-4a39-99ae-01291562ebd3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:20.339259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce3e335a-b3d2-4a39-99ae-01291562ebd3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:20.340875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce3e335a-b3d2-4a39-99ae-01291562ebd3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:20.342771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce3e335a-b3d2-4a39-99ae-01291562ebd3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:20.353024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce3e335a-b3d2-4a39-99ae-01291562ebd3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:20.353641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce3e335a-b3d2-4a39-99ae-01291562ebd3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:20.363348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e54caf73-8e0b-4d45-967f-9bc1e0c848e8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:20.364507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e54caf73-8e0b-4d45-967f-9bc1e0c848e8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:20.372621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e54caf73-8e0b-4d45-967f-9bc1e0c848e8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:20.373110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e54caf73-8e0b-4d45-967f-9bc1e0c848e8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:20.373534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e54caf73-8e0b-4d45-967f-9bc1e0c848e8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:20.374269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e54caf73-8e0b-4d45-967f-9bc1e0c848e8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:20.374711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e54caf73-8e0b-4d45-967f-9bc1e0c848e8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:20.375127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e54caf73-8e0b-4d45-967f-9bc1e0c848e8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:20.570883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-ce3e335a-b3d2-4a39-99ae-01291562ebd3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lazy-loading 'services' on Instance uuid 00cb236a-db5a-4b3b-a464-0b7914d1a15c {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:20.729285 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ce3e335a-b3d2-4a39-99ae-01291562ebd3 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "DELETE /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments/0729f5f3-6c4a-4057-8c99-b254c112bb47" status: 202 len: 0 microversion: 2.1 time: 0.407106 Oct 29 03:14:20.730103 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2966/5888] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:14:20 2022] DELETE /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments/0729f5f3-6c4a-4057-8c99-b254c112bb47 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:14:20.861445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e54caf73-8e0b-4d45-967f-9bc1e0c848e8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:20.873454 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e54caf73-8e0b-4d45-967f-9bc1e0c848e8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1520 microversion: 2.1 time: 0.515350 Oct 29 03:14:20.874510 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2923/5889] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:20 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1520 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:14:21.899250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-254f2a2f-7971-4867-9a06-e6033546c8ad tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:21.901139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-254f2a2f-7971-4867-9a06-e6033546c8ad tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:21.903379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=26 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:21.940409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-254f2a2f-7971-4867-9a06-e6033546c8ad tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:21.940934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-254f2a2f-7971-4867-9a06-e6033546c8ad tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:21.941374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-254f2a2f-7971-4867-9a06-e6033546c8ad tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:21.942124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-254f2a2f-7971-4867-9a06-e6033546c8ad tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:21.942579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-254f2a2f-7971-4867-9a06-e6033546c8ad tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:21.943000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-254f2a2f-7971-4867-9a06-e6033546c8ad tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:22.610027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-254f2a2f-7971-4867-9a06-e6033546c8ad tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:22.631877 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-254f2a2f-7971-4867-9a06-e6033546c8ad tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1500 microversion: 2.1 time: 0.737821 Oct 29 03:14:22.632029 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2967/5890] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:21 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1500 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:22.658136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f44d9d4c-498c-4d58-bb64-3563f73e9ff1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:22.660253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f44d9d4c-498c-4d58-bb64-3563f73e9ff1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:22.669845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f44d9d4c-498c-4d58-bb64-3563f73e9ff1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:22.670547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f44d9d4c-498c-4d58-bb64-3563f73e9ff1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:22.671209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f44d9d4c-498c-4d58-bb64-3563f73e9ff1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:22.672741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f44d9d4c-498c-4d58-bb64-3563f73e9ff1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:22.674919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f44d9d4c-498c-4d58-bb64-3563f73e9ff1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:22.675609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f44d9d4c-498c-4d58-bb64-3563f73e9ff1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:23.167835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f44d9d4c-498c-4d58-bb64-3563f73e9ff1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:23.181822 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f44d9d4c-498c-4d58-bb64-3563f73e9ff1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1514 microversion: 2.1 time: 0.524776 Oct 29 03:14:23.182906 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2924/5891] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:22 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1514 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:23.208841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac9a694b-ee1d-47b5-b820-912920966035 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:23.212014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ac9a694b-ee1d-47b5-b820-912920966035 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 2d3e0434-3023-4a35-af2d-2854d10df9a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:23.244823 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-ac9a694b-ee1d-47b5-b820-912920966035 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] HTTP exception thrown: Instance 2d3e0434-3023-4a35-af2d-2854d10df9a4 could not be found. Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac9a694b-ee1d-47b5-b820-912920966035 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Request method failure captured: Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/2d3e0434-3023-4a35-af2d-2854d10df9a4/action HTTP/1.1 Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 14 Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJpRn_7hoOfvObzqA-ZLLdT0Ldg_y6elYIAF6FaT28sdj-TKjsGF45L6GmeVGfwMnSs4H8JoHZrc7By31zLGvou-MnR3pglqzR_y5cbEOWkNw533fNI-OxPHdxTNrRl2C5LEagXcPpESr9s5MAeq27S7NZgAah_V7oaKcjpRtmQEpM8 Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_552af5aaae3f49fdb5cc8ea8ec4ccdec", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}] Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 89a693133ded46eba2b9b70e899f38f9 Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: {"rescue": {}} Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 2d3e0434-3023-4a35-af2d-2854d10df9a4 could not be found. Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2d3e0434-3023-4a35-af2d-2854d10df9a4', 'body': {'rescue': {}}} Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3e0434-3023-4a35-af2d-2854d10df9a4 could not be found. Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3e0434-3023-4a35-af2d-2854d10df9a4 could not be found. Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:23.250505 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:23.255480 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:23.255480 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:23.255480 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:14:23.255480 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:14:23.255480 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3e0434-3023-4a35-af2d-2854d10df9a4 could not be found. Oct 29 03:14:23.255480 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:23.260429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac9a694b-ee1d-47b5-b820-912920966035 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Returning 404 to user: Instance 2d3e0434-3023-4a35-af2d-2854d10df9a4 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:23.262891 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ac9a694b-ee1d-47b5-b820-912920966035 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/2d3e0434-3023-4a35-af2d-2854d10df9a4/action" status: 404 len: 111 microversion: 2.1 time: 0.059124 Oct 29 03:14:23.272871 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2968/5892] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:14:23 2022] POST /compute/v2.1/servers/2d3e0434-3023-4a35-af2d-2854d10df9a4/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:14:23.276132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-40a9d0d6-d474-4c35-9ab3-994da7f69c68 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:23.276964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-40a9d0d6-d474-4c35-9ab3-994da7f69c68 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:23.292772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40a9d0d6-d474-4c35-9ab3-994da7f69c68 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:23.293397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40a9d0d6-d474-4c35-9ab3-994da7f69c68 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:23.293866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40a9d0d6-d474-4c35-9ab3-994da7f69c68 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:23.294688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40a9d0d6-d474-4c35-9ab3-994da7f69c68 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:23.302665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40a9d0d6-d474-4c35-9ab3-994da7f69c68 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:23.302665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40a9d0d6-d474-4c35-9ab3-994da7f69c68 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:23.521213 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-40a9d0d6-d474-4c35-9ab3-994da7f69c68 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/action" status: 202 len: 0 microversion: 2.1 time: 0.245693 Oct 29 03:14:23.525222 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2925/5893] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:14:23 2022] POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:14:23.538363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c3ec29d-ddeb-4bfd-810f-ccbf2698f11b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:23.540277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c3ec29d-ddeb-4bfd-810f-ccbf2698f11b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:23.561325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3ec29d-ddeb-4bfd-810f-ccbf2698f11b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:23.562992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3ec29d-ddeb-4bfd-810f-ccbf2698f11b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:23.565391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3ec29d-ddeb-4bfd-810f-ccbf2698f11b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:23.568575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3ec29d-ddeb-4bfd-810f-ccbf2698f11b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:23.571617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3ec29d-ddeb-4bfd-810f-ccbf2698f11b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:23.573680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3ec29d-ddeb-4bfd-810f-ccbf2698f11b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:24.259536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c3ec29d-ddeb-4bfd-810f-ccbf2698f11b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:24.275279 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c3ec29d-ddeb-4bfd-810f-ccbf2698f11b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1519 microversion: 2.1 time: 0.747210 Oct 29 03:14:24.295334 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2969/5894] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:23 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1519 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:25.306658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b49bf443-5d9a-42e7-8b47-3e8230642d95 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:25.308079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b49bf443-5d9a-42e7-8b47-3e8230642d95 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:25.333411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49bf443-5d9a-42e7-8b47-3e8230642d95 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:25.333933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49bf443-5d9a-42e7-8b47-3e8230642d95 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:25.334381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49bf443-5d9a-42e7-8b47-3e8230642d95 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:25.335100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49bf443-5d9a-42e7-8b47-3e8230642d95 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:25.350978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49bf443-5d9a-42e7-8b47-3e8230642d95 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:25.350978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49bf443-5d9a-42e7-8b47-3e8230642d95 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:26.138508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b49bf443-5d9a-42e7-8b47-3e8230642d95 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:26.147143 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b49bf443-5d9a-42e7-8b47-3e8230642d95 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1499 microversion: 2.1 time: 0.847615 Oct 29 03:14:26.154568 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2926/5895] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:25 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1499 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:26.175361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:26.179884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:26.209220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:26.215011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:26.217304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:26.218701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:26.223123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:26.225009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:26.238617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:26.288042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lazy-loading 'flavor' on Instance uuid 37fd6874-8c38-4df7-aa0b-a77fc38850bc {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:26.312544 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] HTTP exception thrown: Cannot 'rescue' instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc while it is in vm_state paused Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Request method failure captured: Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/action HTTP/1.1 Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 14 Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJpRn_7hoOfvObzqA-ZLLdT0Ldg_y6elYIAF6FaT28sdj-TKjsGF45L6GmeVGfwMnSs4H8JoHZrc7By31zLGvou-MnR3pglqzR_y5cbEOWkNw533fNI-OxPHdxTNrRl2C5LEagXcPpESr9s5MAeq27S7NZgAah_V7oaKcjpRtmQEpM8 Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_552af5aaae3f49fdb5cc8ea8ec4ccdec", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}] Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 89a693133ded46eba2b9b70e899f38f9 Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: {"rescue": {}} Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: exception: Cannot 'rescue' instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc while it is in vm_state paused Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '37fd6874-8c38-4df7-aa0b-a77fc38850bc', 'body': {'rescue': {}}} Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc in vm_state paused. Cannot rescue while the instance is in this state. Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc while it is in vm_state paused Oct 29 03:14:26.314918 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc while it is in vm_state paused Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Returning 409 to user: Cannot 'rescue' instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc while it is in vm_state paused {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1215c691-7a81-4ef5-8ca5-988dc62022e1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/action" status: 409 len: 144 microversion: 2.1 time: 0.145989 Oct 29 03:14:26.323449 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2970/5896] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:14:26 2022] POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/action => generated 144 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:14:26.327829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9b37bc5b-4c0c-485b-9c8d-4b91ced2b7ea tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:26.328571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9b37bc5b-4c0c-485b-9c8d-4b91ced2b7ea tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:26.337759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b37bc5b-4c0c-485b-9c8d-4b91ced2b7ea tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:26.338286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b37bc5b-4c0c-485b-9c8d-4b91ced2b7ea tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:26.352074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b37bc5b-4c0c-485b-9c8d-4b91ced2b7ea tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:26.353473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b37bc5b-4c0c-485b-9c8d-4b91ced2b7ea tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:26.353997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b37bc5b-4c0c-485b-9c8d-4b91ced2b7ea tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:26.354905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b37bc5b-4c0c-485b-9c8d-4b91ced2b7ea tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:26.486431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:26.521758 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9b37bc5b-4c0c-485b-9c8d-4b91ced2b7ea tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/action" status: 202 len: 0 microversion: 2.1 time: 0.197739 Oct 29 03:14:26.526347 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2927/5897] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:14:26 2022] POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:14:26.537824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-34cabf5e-944c-4b17-960f-bb34dea8ea89 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:26.538485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-34cabf5e-944c-4b17-960f-bb34dea8ea89 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:26.559471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34cabf5e-944c-4b17-960f-bb34dea8ea89 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:26.559975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34cabf5e-944c-4b17-960f-bb34dea8ea89 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:26.560421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34cabf5e-944c-4b17-960f-bb34dea8ea89 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:26.561161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34cabf5e-944c-4b17-960f-bb34dea8ea89 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:26.561621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34cabf5e-944c-4b17-960f-bb34dea8ea89 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:26.566079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34cabf5e-944c-4b17-960f-bb34dea8ea89 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:27.834333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-34cabf5e-944c-4b17-960f-bb34dea8ea89 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:27.863482 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-34cabf5e-944c-4b17-960f-bb34dea8ea89 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1506 microversion: 2.1 time: 1.329907 Oct 29 03:14:27.864395 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2971/5898] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:26 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1506 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:14:28.892877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7e19955-f921-487c-b09e-7bb641eccf8c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:28.896156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7e19955-f921-487c-b09e-7bb641eccf8c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:28.912360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e19955-f921-487c-b09e-7bb641eccf8c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:28.925750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e19955-f921-487c-b09e-7bb641eccf8c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:28.926483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e19955-f921-487c-b09e-7bb641eccf8c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:28.927392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e19955-f921-487c-b09e-7bb641eccf8c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:28.930451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e19955-f921-487c-b09e-7bb641eccf8c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:28.931142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7e19955-f921-487c-b09e-7bb641eccf8c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:29.858544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c7e19955-f921-487c-b09e-7bb641eccf8c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:29.869468 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7e19955-f921-487c-b09e-7bb641eccf8c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1514 microversion: 2.1 time: 0.982685 Oct 29 03:14:29.870094 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2928/5899] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:28 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1514 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:14:31.082370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dbf9b02f-518f-4bfc-90d1-bc7e178774e0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:31.083541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dbf9b02f-518f-4bfc-90d1-bc7e178774e0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:31.091517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbf9b02f-518f-4bfc-90d1-bc7e178774e0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.092255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbf9b02f-518f-4bfc-90d1-bc7e178774e0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.092906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbf9b02f-518f-4bfc-90d1-bc7e178774e0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.093857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbf9b02f-518f-4bfc-90d1-bc7e178774e0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.094990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbf9b02f-518f-4bfc-90d1-bc7e178774e0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.097003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dbf9b02f-518f-4bfc-90d1-bc7e178774e0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.163986 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dbf9b02f-518f-4bfc-90d1-bc7e178774e0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments/b5be5140-52d7-4f47-8b92-9d3f3e8df059" status: 200 len: 194 microversion: 2.1 time: 0.086050 Oct 29 03:14:31.170255 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2972/5900] 10.222.0.16 () {58 vars in 1413 bytes} [Sat Oct 29 03:14:31 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments/b5be5140-52d7-4f47-8b92-9d3f3e8df059 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:31.176349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3fbcbe11-1144-46f1-a5d8-17dcb75b9525 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:31.177264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3fbcbe11-1144-46f1-a5d8-17dcb75b9525 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:31.190502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fbcbe11-1144-46f1-a5d8-17dcb75b9525 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.191201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fbcbe11-1144-46f1-a5d8-17dcb75b9525 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.191783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fbcbe11-1144-46f1-a5d8-17dcb75b9525 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.192676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fbcbe11-1144-46f1-a5d8-17dcb75b9525 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.195325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fbcbe11-1144-46f1-a5d8-17dcb75b9525 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.195955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3fbcbe11-1144-46f1-a5d8-17dcb75b9525 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.464633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-3fbcbe11-1144-46f1-a5d8-17dcb75b9525 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lazy-loading 'services' on Instance uuid 00cb236a-db5a-4b3b-a464-0b7914d1a15c {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:31.626961 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3fbcbe11-1144-46f1-a5d8-17dcb75b9525 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "DELETE /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments/b5be5140-52d7-4f47-8b92-9d3f3e8df059" status: 202 len: 0 microversion: 2.1 time: 0.452531 Oct 29 03:14:31.632260 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2929/5901] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:14:31 2022] DELETE /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments/b5be5140-52d7-4f47-8b92-9d3f3e8df059 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:14:32.974879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6545993-98cb-4344-a4b6-7f9b10e5225c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:32.979545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b6545993-98cb-4344-a4b6-7f9b10e5225c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:32.997648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6545993-98cb-4344-a4b6-7f9b10e5225c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.999958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6545993-98cb-4344-a4b6-7f9b10e5225c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:33.003755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6545993-98cb-4344-a4b6-7f9b10e5225c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:33.005892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6545993-98cb-4344-a4b6-7f9b10e5225c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:33.006880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6545993-98cb-4344-a4b6-7f9b10e5225c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:33.008004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6545993-98cb-4344-a4b6-7f9b10e5225c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:33.094762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-b6545993-98cb-4344-a4b6-7f9b10e5225c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lazy-loading 'flavor' on Instance uuid 37fd6874-8c38-4df7-aa0b-a77fc38850bc {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:33.324943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6545993-98cb-4344-a4b6-7f9b10e5225c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/action" status: 200 len: 32 microversion: 2.1 time: 0.366207 Oct 29 03:14:33.326248 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2973/5902] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:14:32 2022] POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/action => generated 32 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:33.337789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b68180d-2313-4e28-b27a-cdba9c89ecfb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:33.338550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8b68180d-2313-4e28-b27a-cdba9c89ecfb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:33.340954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=28 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:33.360158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b68180d-2313-4e28-b27a-cdba9c89ecfb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:33.363396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b68180d-2313-4e28-b27a-cdba9c89ecfb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:33.363896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b68180d-2313-4e28-b27a-cdba9c89ecfb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:33.365457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b68180d-2313-4e28-b27a-cdba9c89ecfb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:33.367634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b68180d-2313-4e28-b27a-cdba9c89ecfb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:33.370063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b68180d-2313-4e28-b27a-cdba9c89ecfb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:33.884098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8b68180d-2313-4e28-b27a-cdba9c89ecfb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:33.893516 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b68180d-2313-4e28-b27a-cdba9c89ecfb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.561335 Oct 29 03:14:33.894131 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2930/5903] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:33 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:34.922262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-26adcf20-db84-4737-b53a-0561522c2feb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:34.923991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-26adcf20-db84-4737-b53a-0561522c2feb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:34.938768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26adcf20-db84-4737-b53a-0561522c2feb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:34.940225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26adcf20-db84-4737-b53a-0561522c2feb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:34.942276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26adcf20-db84-4737-b53a-0561522c2feb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:34.943254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26adcf20-db84-4737-b53a-0561522c2feb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:34.947093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26adcf20-db84-4737-b53a-0561522c2feb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:34.947864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26adcf20-db84-4737-b53a-0561522c2feb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:35.297377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-26adcf20-db84-4737-b53a-0561522c2feb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:35.310702 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-26adcf20-db84-4737-b53a-0561522c2feb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.394154 Oct 29 03:14:35.311332 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2974/5904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:34 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:36.334576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f078f7a0-eaac-42f1-b4f2-d324efb39005 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:36.335197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f078f7a0-eaac-42f1-b4f2-d324efb39005 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:36.351245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f078f7a0-eaac-42f1-b4f2-d324efb39005 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:36.353148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f078f7a0-eaac-42f1-b4f2-d324efb39005 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:36.353655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f078f7a0-eaac-42f1-b4f2-d324efb39005 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:36.356502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f078f7a0-eaac-42f1-b4f2-d324efb39005 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:36.358860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f078f7a0-eaac-42f1-b4f2-d324efb39005 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:36.359943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f078f7a0-eaac-42f1-b4f2-d324efb39005 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:36.747543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f078f7a0-eaac-42f1-b4f2-d324efb39005 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:36.767097 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f078f7a0-eaac-42f1-b4f2-d324efb39005 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.436579 Oct 29 03:14:36.768250 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2931/5905] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:36 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:37.792604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0fb281b1-ba39-4aff-a9a8-a1cc709ddf88 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:37.793203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0fb281b1-ba39-4aff-a9a8-a1cc709ddf88 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:37.803657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fb281b1-ba39-4aff-a9a8-a1cc709ddf88 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:37.813531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fb281b1-ba39-4aff-a9a8-a1cc709ddf88 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:37.814325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fb281b1-ba39-4aff-a9a8-a1cc709ddf88 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:37.815340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fb281b1-ba39-4aff-a9a8-a1cc709ddf88 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:37.815954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fb281b1-ba39-4aff-a9a8-a1cc709ddf88 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:37.816543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fb281b1-ba39-4aff-a9a8-a1cc709ddf88 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:38.508379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0fb281b1-ba39-4aff-a9a8-a1cc709ddf88 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:38.540245 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0fb281b1-ba39-4aff-a9a8-a1cc709ddf88 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.751538 Oct 29 03:14:38.542007 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2975/5906] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:37 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:39.568716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d36ff20a-58c5-4dd8-aa8b-856a33c7f18a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:39.569318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d36ff20a-58c5-4dd8-aa8b-856a33c7f18a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:39.589432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d36ff20a-58c5-4dd8-aa8b-856a33c7f18a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:39.589951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d36ff20a-58c5-4dd8-aa8b-856a33c7f18a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:39.590387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d36ff20a-58c5-4dd8-aa8b-856a33c7f18a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:39.591114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d36ff20a-58c5-4dd8-aa8b-856a33c7f18a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:39.591540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d36ff20a-58c5-4dd8-aa8b-856a33c7f18a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:39.591957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d36ff20a-58c5-4dd8-aa8b-856a33c7f18a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:40.115903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d36ff20a-58c5-4dd8-aa8b-856a33c7f18a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:40.132156 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d36ff20a-58c5-4dd8-aa8b-856a33c7f18a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.566857 Oct 29 03:14:40.146096 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2932/5907] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:39 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:41.011354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-050444d1-a8ed-4a06-a21b-1717b901312c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:41.013929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-050444d1-a8ed-4a06-a21b-1717b901312c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:41.033200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-050444d1-a8ed-4a06-a21b-1717b901312c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:41.037892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-050444d1-a8ed-4a06-a21b-1717b901312c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:41.038350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-050444d1-a8ed-4a06-a21b-1717b901312c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:41.039098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-050444d1-a8ed-4a06-a21b-1717b901312c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:41.039560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-050444d1-a8ed-4a06-a21b-1717b901312c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:41.043732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-050444d1-a8ed-4a06-a21b-1717b901312c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:41.142222 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-050444d1-a8ed-4a06-a21b-1717b901312c tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.136342 Oct 29 03:14:41.159248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a75d18be-1f37-4fb5-bf2c-e13802ed84a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:41.159881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a75d18be-1f37-4fb5-bf2c-e13802ed84a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:41.163861 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2976/5908] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:14:41 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments => generated 25 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:41.178510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75d18be-1f37-4fb5-bf2c-e13802ed84a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:41.181210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75d18be-1f37-4fb5-bf2c-e13802ed84a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:41.181932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75d18be-1f37-4fb5-bf2c-e13802ed84a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:41.182850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75d18be-1f37-4fb5-bf2c-e13802ed84a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:41.185784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75d18be-1f37-4fb5-bf2c-e13802ed84a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:41.186465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75d18be-1f37-4fb5-bf2c-e13802ed84a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:41.426988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-39eb26d7-4729-45ce-82f9-d00514cd7935 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:41.430097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-39eb26d7-4729-45ce-82f9-d00514cd7935 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:41.437348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39eb26d7-4729-45ce-82f9-d00514cd7935 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:41.438187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39eb26d7-4729-45ce-82f9-d00514cd7935 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:41.439910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39eb26d7-4729-45ce-82f9-d00514cd7935 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:41.440883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39eb26d7-4729-45ce-82f9-d00514cd7935 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:41.441709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39eb26d7-4729-45ce-82f9-d00514cd7935 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:41.442494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39eb26d7-4729-45ce-82f9-d00514cd7935 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:41.514077 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-39eb26d7-4729-45ce-82f9-d00514cd7935 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092800 Oct 29 03:14:41.521829 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2977/5909] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:14:41 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:41.643257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a75d18be-1f37-4fb5-bf2c-e13802ed84a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:41.671588 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a75d18be-1f37-4fb5-bf2c-e13802ed84a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.511245 Oct 29 03:14:41.676300 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2933/5910] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:41 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:41.713592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dc6e0d3c-8d01-4b96-aca4-50fed4e22089 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:41.714415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dc6e0d3c-8d01-4b96-aca4-50fed4e22089 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:41.726974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc6e0d3c-8d01-4b96-aca4-50fed4e22089 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:41.730249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc6e0d3c-8d01-4b96-aca4-50fed4e22089 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:41.732501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc6e0d3c-8d01-4b96-aca4-50fed4e22089 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:41.735320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc6e0d3c-8d01-4b96-aca4-50fed4e22089 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:41.737817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc6e0d3c-8d01-4b96-aca4-50fed4e22089 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:41.742825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc6e0d3c-8d01-4b96-aca4-50fed4e22089 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:41.813543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dc6e0d3c-8d01-4b96-aca4-50fed4e22089 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:14:42.052682 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dc6e0d3c-8d01-4b96-aca4-50fed4e22089 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "DELETE /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 204 len: 0 microversion: 2.1 time: 0.343631 Oct 29 03:14:42.057773 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2978/5911] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:14:41 2022] DELETE /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:14:42.067951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d3c2f91a-5f95-4a79-b132-443ac801d1eb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:42.068699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d3c2f91a-5f95-4a79-b132-443ac801d1eb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:42.081712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3c2f91a-5f95-4a79-b132-443ac801d1eb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:42.082377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3c2f91a-5f95-4a79-b132-443ac801d1eb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:42.084077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3c2f91a-5f95-4a79-b132-443ac801d1eb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:42.088462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3c2f91a-5f95-4a79-b132-443ac801d1eb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:42.089253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3c2f91a-5f95-4a79-b132-443ac801d1eb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:42.089923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3c2f91a-5f95-4a79-b132-443ac801d1eb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:42.646465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d3c2f91a-5f95-4a79-b132-443ac801d1eb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:42.664196 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d3c2f91a-5f95-4a79-b132-443ac801d1eb tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1674 microversion: 2.1 time: 0.601339 Oct 29 03:14:42.678548 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2934/5912] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:42 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1674 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:42.701023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e46f5826-69e9-448c-9962-53bdcb26915b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:42.701721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e46f5826-69e9-448c-9962-53bdcb26915b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:42.709079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e46f5826-69e9-448c-9962-53bdcb26915b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:42.716475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e46f5826-69e9-448c-9962-53bdcb26915b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:42.722070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e46f5826-69e9-448c-9962-53bdcb26915b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:42.723113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e46f5826-69e9-448c-9962-53bdcb26915b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:42.724749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e46f5826-69e9-448c-9962-53bdcb26915b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:42.726114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e46f5826-69e9-448c-9962-53bdcb26915b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:43.148177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e46f5826-69e9-448c-9962-53bdcb26915b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:43.162251 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e46f5826-69e9-448c-9962-53bdcb26915b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.463259 Oct 29 03:14:43.163921 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2979/5913] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:42 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:43.697691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8aa9e04f-4a0c-4149-9c7d-7e684af392de tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:43.698438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8aa9e04f-4a0c-4149-9c7d-7e684af392de tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:43.713496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa9e04f-4a0c-4149-9c7d-7e684af392de tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:43.714021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa9e04f-4a0c-4149-9c7d-7e684af392de tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:43.723332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa9e04f-4a0c-4149-9c7d-7e684af392de tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:43.725640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa9e04f-4a0c-4149-9c7d-7e684af392de tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:43.726317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa9e04f-4a0c-4149-9c7d-7e684af392de tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:43.731354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8aa9e04f-4a0c-4149-9c7d-7e684af392de tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:44.194505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bf5ad33e-bb2e-4271-8356-3e4915ade3be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:44.195709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bf5ad33e-bb2e-4271-8356-3e4915ade3be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:44.224699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8aa9e04f-4a0c-4149-9c7d-7e684af392de tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:44.227632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf5ad33e-bb2e-4271-8356-3e4915ade3be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:44.231956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf5ad33e-bb2e-4271-8356-3e4915ade3be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:44.232696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf5ad33e-bb2e-4271-8356-3e4915ade3be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:44.233674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf5ad33e-bb2e-4271-8356-3e4915ade3be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:44.234597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf5ad33e-bb2e-4271-8356-3e4915ade3be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:44.235439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf5ad33e-bb2e-4271-8356-3e4915ade3be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:44.245553 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8aa9e04f-4a0c-4149-9c7d-7e684af392de tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1674 microversion: 2.1 time: 0.549232 Oct 29 03:14:44.246248 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2935/5914] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:43 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1674 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:44.974597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bf5ad33e-bb2e-4271-8356-3e4915ade3be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:44.984720 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bf5ad33e-bb2e-4271-8356-3e4915ade3be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.794245 Oct 29 03:14:45.006240 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2980/5915] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:44 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:45.286201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ba576139-a3c5-499c-ae33-6127c74d282e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:45.286826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ba576139-a3c5-499c-ae33-6127c74d282e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:45.299258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba576139-a3c5-499c-ae33-6127c74d282e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:45.299749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba576139-a3c5-499c-ae33-6127c74d282e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:45.303498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba576139-a3c5-499c-ae33-6127c74d282e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:45.306741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba576139-a3c5-499c-ae33-6127c74d282e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:45.307402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba576139-a3c5-499c-ae33-6127c74d282e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:45.310153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba576139-a3c5-499c-ae33-6127c74d282e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:45.672076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ba576139-a3c5-499c-ae33-6127c74d282e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:45.683037 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ba576139-a3c5-499c-ae33-6127c74d282e tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1674 microversion: 2.1 time: 0.402061 Oct 29 03:14:45.683714 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2936/5916] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:45 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1674 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:46.026169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c9c2475-d641-4f27-ad3b-0424396b21c8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:46.031212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c9c2475-d641-4f27-ad3b-0424396b21c8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:46.052927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c9c2475-d641-4f27-ad3b-0424396b21c8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:46.053677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c9c2475-d641-4f27-ad3b-0424396b21c8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:46.054479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c9c2475-d641-4f27-ad3b-0424396b21c8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:46.055987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c9c2475-d641-4f27-ad3b-0424396b21c8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:46.056677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c9c2475-d641-4f27-ad3b-0424396b21c8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:46.057301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c9c2475-d641-4f27-ad3b-0424396b21c8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:46.708352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4d45e8f5-7b28-489e-aa96-b543e82df1d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:46.708973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4d45e8f5-7b28-489e-aa96-b543e82df1d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:46.721611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d45e8f5-7b28-489e-aa96-b543e82df1d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:46.722149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d45e8f5-7b28-489e-aa96-b543e82df1d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:46.722591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d45e8f5-7b28-489e-aa96-b543e82df1d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:46.723308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d45e8f5-7b28-489e-aa96-b543e82df1d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:46.726598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d45e8f5-7b28-489e-aa96-b543e82df1d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:46.728055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d45e8f5-7b28-489e-aa96-b543e82df1d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:46.968097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c9c2475-d641-4f27-ad3b-0424396b21c8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:46.982663 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c9c2475-d641-4f27-ad3b-0424396b21c8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.971808 Oct 29 03:14:46.984588 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2981/5917] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:46 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:47.269355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4d45e8f5-7b28-489e-aa96-b543e82df1d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:47.281946 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4d45e8f5-7b28-489e-aa96-b543e82df1d0 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1674 microversion: 2.1 time: 0.576763 Oct 29 03:14:47.282555 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2937/5918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:46 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1674 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:14:48.015321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dd820277-831c-43d8-817a-7fbc7fba5a4c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:48.015931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd820277-831c-43d8-817a-7fbc7fba5a4c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:48.030848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd820277-831c-43d8-817a-7fbc7fba5a4c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:48.035456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd820277-831c-43d8-817a-7fbc7fba5a4c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:48.036134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd820277-831c-43d8-817a-7fbc7fba5a4c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:48.039709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd820277-831c-43d8-817a-7fbc7fba5a4c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:48.040211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd820277-831c-43d8-817a-7fbc7fba5a4c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:48.040781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd820277-831c-43d8-817a-7fbc7fba5a4c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:48.305828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7818ccb0-40d3-4cc7-85d4-231afd8e1973 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:48.306972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7818ccb0-40d3-4cc7-85d4-231afd8e1973 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:48.331229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7818ccb0-40d3-4cc7-85d4-231afd8e1973 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:48.332525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7818ccb0-40d3-4cc7-85d4-231afd8e1973 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:48.334282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7818ccb0-40d3-4cc7-85d4-231afd8e1973 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:48.336479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7818ccb0-40d3-4cc7-85d4-231afd8e1973 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:48.343662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7818ccb0-40d3-4cc7-85d4-231afd8e1973 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:48.346380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7818ccb0-40d3-4cc7-85d4-231afd8e1973 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:48.593476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7818ccb0-40d3-4cc7-85d4-231afd8e1973 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aab5eb9a3764e75863bf930c2bbd8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70185f31a11248d79b722001900d890a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:48.650645 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7818ccb0-40d3-4cc7-85d4-231afd8e1973 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 200 len: 1606 microversion: 2.1 time: 0.313952 Oct 29 03:14:48.654596 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2938/5919] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:48 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 1606 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:48.771665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd820277-831c-43d8-817a-7fbc7fba5a4c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:48.784621 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dd820277-831c-43d8-817a-7fbc7fba5a4c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.772696 Oct 29 03:14:48.795043 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2982/5920] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:48 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:48.820367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-bbf44612-80b1-492a-82c3-a0d47a06e4fd req-c9aa6a4c-f04d-4366-af5d-6a61a7956713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cb236a-db5a-4b3b-a464-0b7914d1a15c", "name": "network-vif-deleted", "tag": "73c14a2a-e037-42e6-8e22-9fd7b95de128"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:48.835657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bbf44612-80b1-492a-82c3-a0d47a06e4fd req-c9aa6a4c-f04d-4366-af5d-6a61a7956713 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:48.836820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bbf44612-80b1-492a-82c3-a0d47a06e4fd req-c9aa6a4c-f04d-4366-af5d-6a61a7956713 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:48.837375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bbf44612-80b1-492a-82c3-a0d47a06e4fd req-c9aa6a4c-f04d-4366-af5d-6a61a7956713 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:48.887493 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-bbf44612-80b1-492a-82c3-a0d47a06e4fd req-c9aa6a4c-f04d-4366-af5d-6a61a7956713 service nova] Creating event network-vif-deleted:73c14a2a-e037-42e6-8e22-9fd7b95de128 for instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c on n-h2-862964-4 Oct 29 03:14:48.906708 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-bbf44612-80b1-492a-82c3-a0d47a06e4fd req-c9aa6a4c-f04d-4366-af5d-6a61a7956713 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091429 Oct 29 03:14:48.907465 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2939/5921] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:49.683026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:49.683637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:49.709740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:49.710746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:49.715257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:49.717426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:49.718112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:49.734573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:49.762074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:49.784827 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] HTTP exception thrown: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Request method failure captured: Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c HTTP/1.1 Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJlCIGQhVW_9VpbQRjyKddjGr1_Frj1Tg9-G58COkKQiRZ2cCRdmWbOJI48UOlXkoa70xuji6ps-cI-nKgpLRhq62ueIANiYRGqj3PZjVExgX0BM3ox1KWKRuUbmyYkwu9NUHZZQ4jahYN1wOtYCjAi5RwjGGjpciCjnc3WrfUtI_0Y Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70185f31a11248d79b722001900d890a Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70185f31a11248d79b722001900d890a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70185f31a11248d79b722001900d890a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}] Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70185f31a11248d79b722001900d890a Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 4aab5eb9a3764e75863bf930c2bbd8bd Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '00cb236a-db5a-4b3b-a464-0b7914d1a15c'} Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:49.810518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:49.815588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:49.815588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:49.815588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:49.815588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:14:49.815588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:14:49.815588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:14:49.815588 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:49.816176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3c0f7821-4049-4a3a-ac20-9cbff3d6978a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:49.816176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3c0f7821-4049-4a3a-ac20-9cbff3d6978a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:49.827087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f7821-4049-4a3a-ac20-9cbff3d6978a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:49.827393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Returning 404 to user: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:49.827621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f7821-4049-4a3a-ac20-9cbff3d6978a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:49.828059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f7821-4049-4a3a-ac20-9cbff3d6978a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:49.828823 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6e44edb5-5048-4234-a170-dfa502fe2a45 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 404 len: 111 microversion: 2.1 time: 0.152012 Oct 29 03:14:49.829207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f7821-4049-4a3a-ac20-9cbff3d6978a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:49.830178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f7821-4049-4a3a-ac20-9cbff3d6978a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:49.830320 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2983/5922] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:49 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:14:49.831733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c0f7821-4049-4a3a-ac20-9cbff3d6978a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:49.848541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-55b98b25-3303-4850-a0e4-2482197d48b9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '.version_select at 0x7fe1acbc9940>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:49.919974 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-55b98b25-3303-4850-a0e4-2482197d48b9 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056067123" status: 202 len: 0 microversion: 2.1 time: 0.080026 Oct 29 03:14:49.921137 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2984/5923] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:14:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056067123 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:14:50.215266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c0f7821-4049-4a3a-ac20-9cbff3d6978a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:50.237698 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3c0f7821-4049-4a3a-ac20-9cbff3d6978a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.429702 Oct 29 03:14:50.246959 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2940/5924] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:49 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:51.264911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1b8e2116-d8f6-493a-8fe4-ddd9ecb253c7 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:51.266259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b8e2116-d8f6-493a-8fe4-ddd9ecb253c7 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:51.285687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b8e2116-d8f6-493a-8fe4-ddd9ecb253c7 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:51.288909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b8e2116-d8f6-493a-8fe4-ddd9ecb253c7 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:51.289631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b8e2116-d8f6-493a-8fe4-ddd9ecb253c7 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:51.290652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b8e2116-d8f6-493a-8fe4-ddd9ecb253c7 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:51.291367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b8e2116-d8f6-493a-8fe4-ddd9ecb253c7 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:51.292007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b8e2116-d8f6-493a-8fe4-ddd9ecb253c7 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:51.641138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b8e2116-d8f6-493a-8fe4-ddd9ecb253c7 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:51.650696 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1b8e2116-d8f6-493a-8fe4-ddd9ecb253c7 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.390166 Oct 29 03:14:51.667055 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2985/5925] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:51 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:14:52.676742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5ff66945-1b30-480d-9ec6-82e703030e40 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:52.677356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5ff66945-1b30-480d-9ec6-82e703030e40 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:52.686543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ff66945-1b30-480d-9ec6-82e703030e40 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:52.687035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ff66945-1b30-480d-9ec6-82e703030e40 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:52.687472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ff66945-1b30-480d-9ec6-82e703030e40 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:52.688234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ff66945-1b30-480d-9ec6-82e703030e40 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:52.688682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ff66945-1b30-480d-9ec6-82e703030e40 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:52.689104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ff66945-1b30-480d-9ec6-82e703030e40 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:53.141287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5ff66945-1b30-480d-9ec6-82e703030e40 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:53.149917 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5ff66945-1b30-480d-9ec6-82e703030e40 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1500 microversion: 2.1 time: 0.477285 Oct 29 03:14:53.150509 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2941/5926] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:52 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1500 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:53.173346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a25bcef0-95ae-49ef-892c-9acf62450b59"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:53.176600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:53.179664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:53.194454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:53.195455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:53.196922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:53.201050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:53.201852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:53.202451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:53.273934 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] HTTP exception thrown: Cannot 'attach_volume' instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc while it is in vm_state rescued Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Request method failure captured: Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/os-volume_attachments HTTP/1.1 Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 74 Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJpRn_7hoOfvObzqA-ZLLdT0Ldg_y6elYIAF6FaT28sdj-TKjsGF45L6GmeVGfwMnSs4H8JoHZrc7By31zLGvou-MnR3pglqzR_y5cbEOWkNw533fNI-OxPHdxTNrRl2C5LEagXcPpESr9s5MAeq27S7NZgAah_V7oaKcjpRtmQEpM8 Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_552af5aaae3f49fdb5cc8ea8ec4ccdec", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}] Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 89a693133ded46eba2b9b70e899f38f9 Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: {"volumeAttachment": {"volumeId": "a25bcef0-95ae-49ef-892c-9acf62450b59"}} Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: exception: Cannot 'attach_volume' instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc while it is in vm_state rescued Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': '37fd6874-8c38-4df7-aa0b-a77fc38850bc', 'body': {'volumeAttachment': {'volumeId': 'a25bcef0-95ae-49ef-892c-9acf62450b59'}}} Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 29 03:14:53.285630 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc while it is in vm_state rescued Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc while it is in vm_state rescued Oct 29 03:14:53.290297 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:14:53.292549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Returning 409 to user: Cannot 'attach_volume' instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc while it is in vm_state rescued {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:53.293592 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f7266769-9ea1-41ed-9403-177e21383948 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.124460 Oct 29 03:14:53.295715 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2986/5927] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:14:53 2022] POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/os-volume_attachments => generated 152 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:14:53.309180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d1a97ff2-5e76-4402-a189-07b1c5bd951a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:53.309747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d1a97ff2-5e76-4402-a189-07b1c5bd951a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:53.327195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1a97ff2-5e76-4402-a189-07b1c5bd951a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:53.327700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1a97ff2-5e76-4402-a189-07b1c5bd951a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:53.328138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1a97ff2-5e76-4402-a189-07b1c5bd951a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:53.330346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1a97ff2-5e76-4402-a189-07b1c5bd951a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:53.330814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1a97ff2-5e76-4402-a189-07b1c5bd951a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:53.332640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d1a97ff2-5e76-4402-a189-07b1c5bd951a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:53.451104 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d1a97ff2-5e76-4402-a189-07b1c5bd951a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/action" status: 202 len: 0 microversion: 2.1 time: 0.151416 Oct 29 03:14:53.452284 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2942/5928] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:14:53 2022] POST /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:14:53.462317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-100367a1-a3a5-498d-9ec5-6c707ce5c75f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:53.463083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-100367a1-a3a5-498d-9ec5-6c707ce5c75f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:53.477116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100367a1-a3a5-498d-9ec5-6c707ce5c75f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:53.478421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100367a1-a3a5-498d-9ec5-6c707ce5c75f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:53.480094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100367a1-a3a5-498d-9ec5-6c707ce5c75f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:53.483421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100367a1-a3a5-498d-9ec5-6c707ce5c75f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:53.484320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100367a1-a3a5-498d-9ec5-6c707ce5c75f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:53.486060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-100367a1-a3a5-498d-9ec5-6c707ce5c75f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:54.268794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-100367a1-a3a5-498d-9ec5-6c707ce5c75f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:54.285298 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-100367a1-a3a5-498d-9ec5-6c707ce5c75f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1508 microversion: 2.1 time: 0.828671 Oct 29 03:14:54.287983 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2987/5929] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:53 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1508 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:55.314373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-32016b6e-196f-4c39-8d6e-6c28ce8a91eb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:55.315087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-32016b6e-196f-4c39-8d6e-6c28ce8a91eb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:55.325629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32016b6e-196f-4c39-8d6e-6c28ce8a91eb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:55.326212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32016b6e-196f-4c39-8d6e-6c28ce8a91eb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:55.326649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32016b6e-196f-4c39-8d6e-6c28ce8a91eb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:55.327319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32016b6e-196f-4c39-8d6e-6c28ce8a91eb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:55.327768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32016b6e-196f-4c39-8d6e-6c28ce8a91eb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:55.328181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32016b6e-196f-4c39-8d6e-6c28ce8a91eb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:55.388688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:55.847344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-32016b6e-196f-4c39-8d6e-6c28ce8a91eb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:55.863506 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-32016b6e-196f-4c39-8d6e-6c28ce8a91eb tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1508 microversion: 2.1 time: 0.554206 Oct 29 03:14:55.864338 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2943/5930] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:55 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1508 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:56.889062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d7e9d403-5c87-4dc3-8d35-c67015a2c248 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:56.891476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d7e9d403-5c87-4dc3-8d35-c67015a2c248 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:56.904932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7e9d403-5c87-4dc3-8d35-c67015a2c248 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:56.905420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7e9d403-5c87-4dc3-8d35-c67015a2c248 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:56.905880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7e9d403-5c87-4dc3-8d35-c67015a2c248 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:56.906739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7e9d403-5c87-4dc3-8d35-c67015a2c248 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:56.907188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7e9d403-5c87-4dc3-8d35-c67015a2c248 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:56.910168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7e9d403-5c87-4dc3-8d35-c67015a2c248 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:57.576695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d7e9d403-5c87-4dc3-8d35-c67015a2c248 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:57.592398 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d7e9d403-5c87-4dc3-8d35-c67015a2c248 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1508 microversion: 2.1 time: 0.706426 Oct 29 03:14:57.595170 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2988/5931] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:56 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1508 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:58.623338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-05c503f5-1200-46bf-8a43-fd6bad61e604 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:58.638006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-05c503f5-1200-46bf-8a43-fd6bad61e604 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:58.645638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05c503f5-1200-46bf-8a43-fd6bad61e604 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:58.646404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05c503f5-1200-46bf-8a43-fd6bad61e604 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:58.647018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05c503f5-1200-46bf-8a43-fd6bad61e604 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:58.647904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05c503f5-1200-46bf-8a43-fd6bad61e604 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:58.648506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05c503f5-1200-46bf-8a43-fd6bad61e604 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:58.649081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05c503f5-1200-46bf-8a43-fd6bad61e604 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:59.868378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-05c503f5-1200-46bf-8a43-fd6bad61e604 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:59.879224 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-05c503f5-1200-46bf-8a43-fd6bad61e604 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1514 microversion: 2.1 time: 1.259956 Oct 29 03:14:59.886176 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2944/5932] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:58 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1514 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:04.260718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5e3d0253-d43b-4d58-998c-c6bce75e4484 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'create', calling method: .version_select at 0x7fe1a853e160>, body: {"keypair": {"name": "tempest-keypair-105955857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtV2G/24G2gVNFSgqgc1BuihnekziJAGASUSBwhgG7cS5mFVyQWm8K8W65hQdtzJt0Z6QCvRPjly7zlTr8CXd0pTxNlamDVnOOiVArD/kw2WTXtgv4jxYnBJp5awl1SCw=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:04.336585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5e3d0253-d43b-4d58-998c-c6bce75e4484 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Getting quotas for project 552af5aaae3f49fdb5cc8ea8ec4ccdec. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:15:04.366020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5e3d0253-d43b-4d58-998c-c6bce75e4484 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Getting quotas for user 89a693133ded46eba2b9b70e899f38f9 and project 552af5aaae3f49fdb5cc8ea8ec4ccdec. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:15:04.455073 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5e3d0253-d43b-4d58-998c-c6bce75e4484 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.196444 Oct 29 03:15:04.459227 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2989/5933] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:15:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:06.607900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:06.608557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:06.616779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=30 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:06.618901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:06.619570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:06.620176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:06.621048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:06.621657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:06.622266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:06.666975 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] HTTP exception thrown: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Request method failure captured: Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c HTTP/1.1 Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJlCIGQhVW_9VpbQRjyKddjGr1_Frj1Tg9-G58COkKQiRZ2cCRdmWbOJI48UOlXkoa70xuji6ps-cI-nKgpLRhq62ueIANiYRGqj3PZjVExgX0BM3ox1KWKRuUbmyYkwu9NUHZZQ4jahYN1wOtYCjAi5RwjGGjpciCjnc3WrfUtI_0Y Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70185f31a11248d79b722001900d890a Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70185f31a11248d79b722001900d890a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70185f31a11248d79b722001900d890a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}] Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70185f31a11248d79b722001900d890a Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 4aab5eb9a3764e75863bf930c2bbd8bd Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '00cb236a-db5a-4b3b-a464-0b7914d1a15c'} Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:15:06.668794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Returning 404 to user: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-98f17c36-b884-46d2-b78f-de74b155a002 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "DELETE /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 404 len: 111 microversion: 2.1 time: 0.066497 Oct 29 03:15:06.674225 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2945/5934] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:15:06 2022] DELETE /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:15:06.680501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:06.681104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: 00cb236a-db5a-4b3b-a464-0b7914d1a15c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:06.694403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:06.701121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:06.702077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:06.703227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:06.706523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:06.707175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:06.739077 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] HTTP exception thrown: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Request method failure captured: Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c HTTP/1.1 Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJlCIGQhVW_9VpbQRjyKddjGr1_Frj1Tg9-G58COkKQiRZ2cCRdmWbOJI48UOlXkoa70xuji6ps-cI-nKgpLRhq62ueIANiYRGqj3PZjVExgX0BM3ox1KWKRuUbmyYkwu9NUHZZQ4jahYN1wOtYCjAi5RwjGGjpciCjnc3WrfUtI_0Y Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70185f31a11248d79b722001900d890a Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70185f31a11248d79b722001900d890a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70185f31a11248d79b722001900d890a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}] Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70185f31a11248d79b722001900d890a Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 4aab5eb9a3764e75863bf930c2bbd8bd Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '00cb236a-db5a-4b3b-a464-0b7914d1a15c'} Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:15:06.745361 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:15:06.749832 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:06.749832 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:15:06.749832 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:15:06.749832 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:15:06.749832 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:15:06.749832 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. Oct 29 03:15:06.749832 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:15:06.751449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Returning 404 to user: Instance 00cb236a-db5a-4b3b-a464-0b7914d1a15c could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:15:06.752508 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c515c205-a9c0-4ac1-9949-24bafbb5e379 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c" status: 404 len: 111 microversion: 2.1 time: 0.076882 Oct 29 03:15:06.753576 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2990/5935] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:06 2022] GET /compute/v2.1/servers/00cb236a-db5a-4b3b-a464-0b7914d1a15c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:15:08.420346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-992267312", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3fcf96d-de3d-4345-8a6f-b72b4af06776"}], "security_groups": [{"name": "tempest-securitygroup--377158596"}], "key_name": "tempest-keypair-105955857", "user_data": "}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:08.561628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] validate_networks() for [('b3fcf96d-de3d-4345-8a6f-b72b4af06776', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:15:09.342866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:15:09.343282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:15:09.343818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:15:09.344421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:15:09.345119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:15:09.357098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:09.360768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:09.370282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:09.373040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:09.373520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:09.373986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:09.417971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Getting quotas for project 552af5aaae3f49fdb5cc8ea8ec4ccdec. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:15:09.446742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Getting quotas for user 89a693133ded46eba2b9b70e899f38f9 and project 552af5aaae3f49fdb5cc8ea8ec4ccdec. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:15:09.496498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:15:09.500216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:15:09.655982 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-70261aa5-8084-4f51-bd94-1c1441f1e231 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.240527 Oct 29 03:15:09.657400 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2946/5936] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:15:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:15:09.667984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6a4255de-f35f-481f-bc9f-c632cf369d3f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:09.668595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6a4255de-f35f-481f-bc9f-c632cf369d3f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:09.974575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6a4255de-f35f-481f-bc9f-c632cf369d3f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:09.980879 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6a4255de-f35f-481f-bc9f-c632cf369d3f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1244 microversion: 2.1 time: 0.316710 Oct 29 03:15:10.002895 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2991/5937] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:09 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1244 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:11.014071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54f139b8-8d2f-40b5-881a-64d267f2b48e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:11.015110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54f139b8-8d2f-40b5-881a-64d267f2b48e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:11.051592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f139b8-8d2f-40b5-881a-64d267f2b48e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:11.052501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f139b8-8d2f-40b5-881a-64d267f2b48e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:11.053595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f139b8-8d2f-40b5-881a-64d267f2b48e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:11.054684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f139b8-8d2f-40b5-881a-64d267f2b48e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:11.056850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f139b8-8d2f-40b5-881a-64d267f2b48e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:11.058081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54f139b8-8d2f-40b5-881a-64d267f2b48e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:11.155671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-54f139b8-8d2f-40b5-881a-64d267f2b48e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:11.166847 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54f139b8-8d2f-40b5-881a-64d267f2b48e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1296 microversion: 2.1 time: 0.156733 Oct 29 03:15:11.168122 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2947/5938] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:11 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1296 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:12.192690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-38b19bd9-a7f6-4618-9ad3-eea825c9db0e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:12.193434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-38b19bd9-a7f6-4618-9ad3-eea825c9db0e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:12.221789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b19bd9-a7f6-4618-9ad3-eea825c9db0e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:12.222326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b19bd9-a7f6-4618-9ad3-eea825c9db0e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:12.222848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b19bd9-a7f6-4618-9ad3-eea825c9db0e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:12.223500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b19bd9-a7f6-4618-9ad3-eea825c9db0e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:12.223948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b19bd9-a7f6-4618-9ad3-eea825c9db0e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:12.224364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38b19bd9-a7f6-4618-9ad3-eea825c9db0e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:12.481869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:12.483105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:12.495570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:12.496183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:12.496822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:12.498595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:12.499228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:12.499763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:12.504049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-38b19bd9-a7f6-4618-9ad3-eea825c9db0e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:12.518114 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-38b19bd9-a7f6-4618-9ad3-eea825c9db0e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1302 microversion: 2.1 time: 0.323522 Oct 29 03:15:12.519111 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2992/5939] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:12 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1302 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:12.539530 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] HTTP exception thrown: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Request method failure captured: Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 HTTP/1.1 Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJlCIGQhVW_9VpbQRjyKddjGr1_Frj1Tg9-G58COkKQiRZ2cCRdmWbOJI48UOlXkoa70xuji6ps-cI-nKgpLRhq62ueIANiYRGqj3PZjVExgX0BM3ox1KWKRuUbmyYkwu9NUHZZQ4jahYN1wOtYCjAi5RwjGGjpciCjnc3WrfUtI_0Y Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 70185f31a11248d79b722001900d890a Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70185f31a11248d79b722001900d890a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70185f31a11248d79b722001900d890a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}] Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 70185f31a11248d79b722001900d890a Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 4aab5eb9a3764e75863bf930c2bbd8bd Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'a15eb84a-805e-4a1f-abfb-f0c495c463b6'} Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:15:12.542066 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:15:12.545927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:15:12.545927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:15:12.545927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:15:12.545927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:15:12.545927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:12.545927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:15:12.545927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:15:12.545927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:15:12.545927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:15:12.545927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:15:12.545927 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:15:12.549494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Returning 404 to user: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:15:12.550949 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-378c9666-59bf-4777-9da5-0f0b175146e2 tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 404 len: 111 microversion: 2.1 time: 0.073925 Oct 29 03:15:12.555831 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2948/5940] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:15:12 2022] DELETE /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:15:12.560422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:12.561009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] [instance: a15eb84a-805e-4a1f-abfb-f0c495c463b6] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:12.579759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:12.580259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:12.580693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:12.581416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:12.581875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:12.582296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:12.629527 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] HTTP exception thrown: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Request method failure captured: Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 HTTP/1.1 Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJlCIGQhVW_9VpbQRjyKddjGr1_Frj1Tg9-G58COkKQiRZ2cCRdmWbOJI48UOlXkoa70xuji6ps-cI-nKgpLRhq62ueIANiYRGqj3PZjVExgX0BM3ox1KWKRuUbmyYkwu9NUHZZQ4jahYN1wOtYCjAi5RwjGGjpciCjnc3WrfUtI_0Y Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 70185f31a11248d79b722001900d890a Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70185f31a11248d79b722001900d890a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70185f31a11248d79b722001900d890a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70185f31a11248d79b722001900d890a"}]}] Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 70185f31a11248d79b722001900d890a Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1983603956 Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 4aab5eb9a3764e75863bf930c2bbd8bd Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeTestJSON-1983603956-project Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'a15eb84a-805e-4a1f-abfb-f0c495c463b6'} Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:15:12.638699 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:15:12.648166 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:12.648166 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:15:12.648166 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:15:12.648166 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:15:12.648166 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:15:12.648166 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. Oct 29 03:15:12.648166 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:15:12.648166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] Returning 404 to user: Instance a15eb84a-805e-4a1f-abfb-f0c495c463b6 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:15:12.648166 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6225f58b-b27f-4426-9887-cb76fbea291a tempest-AttachVolumeTestJSON-1983603956 tempest-AttachVolumeTestJSON-1983603956-project] 10.222.0.16 "GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6" status: 404 len: 111 microversion: 2.1 time: 0.084225 Oct 29 03:15:12.648166 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2993/5941] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:12 2022] GET /compute/v2.1/servers/a15eb84a-805e-4a1f-abfb-f0c495c463b6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:15:13.551114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b569ebd8-5feb-47fb-a096-d1237ec86566 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:13.552768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b569ebd8-5feb-47fb-a096-d1237ec86566 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:13.578597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b569ebd8-5feb-47fb-a096-d1237ec86566 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:13.579247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b569ebd8-5feb-47fb-a096-d1237ec86566 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:13.581495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b569ebd8-5feb-47fb-a096-d1237ec86566 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:13.583248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b569ebd8-5feb-47fb-a096-d1237ec86566 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:13.595114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b569ebd8-5feb-47fb-a096-d1237ec86566 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:13.603724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b569ebd8-5feb-47fb-a096-d1237ec86566 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:13.778772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b569ebd8-5feb-47fb-a096-d1237ec86566 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:13.787613 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b569ebd8-5feb-47fb-a096-d1237ec86566 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1302 microversion: 2.1 time: 0.243922 Oct 29 03:15:13.790802 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2949/5942] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:13 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1302 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:14.816134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d8111e77-789e-4efb-be8b-65b367ac4eaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:14.817465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d8111e77-789e-4efb-be8b-65b367ac4eaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:14.832393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8111e77-789e-4efb-be8b-65b367ac4eaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:14.833162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8111e77-789e-4efb-be8b-65b367ac4eaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:14.838615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8111e77-789e-4efb-be8b-65b367ac4eaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:14.839731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8111e77-789e-4efb-be8b-65b367ac4eaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:14.840490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8111e77-789e-4efb-be8b-65b367ac4eaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:14.841072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8111e77-789e-4efb-be8b-65b367ac4eaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:15.690603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d8111e77-789e-4efb-be8b-65b367ac4eaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:15.705371 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d8111e77-789e-4efb-be8b-65b367ac4eaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1369 microversion: 2.1 time: 0.893655 Oct 29 03:15:15.706769 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2994/5943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:14 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1369 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:16.733314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a32ac2a-ccd9-4c30-951d-2165aa06480a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:16.733958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a32ac2a-ccd9-4c30-951d-2165aa06480a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:16.747786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-459c8eef-c3f0-42c6-90f2-485592cac266 req-b8047540-260e-4cc7-b984-5ada84b0e2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2c36c2-406c-4847-ae8d-3fbd334c9039", "tag": "54901416-0c67-44c6-a0aa-ed5d4e84ca7e"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:16.760373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a32ac2a-ccd9-4c30-951d-2165aa06480a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:16.761060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a32ac2a-ccd9-4c30-951d-2165aa06480a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:16.762474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a32ac2a-ccd9-4c30-951d-2165aa06480a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:16.763900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a32ac2a-ccd9-4c30-951d-2165aa06480a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:16.765219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a32ac2a-ccd9-4c30-951d-2165aa06480a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:16.768486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a32ac2a-ccd9-4c30-951d-2165aa06480a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:16.771727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-459c8eef-c3f0-42c6-90f2-485592cac266 req-b8047540-260e-4cc7-b984-5ada84b0e2af service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:16.772465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-459c8eef-c3f0-42c6-90f2-485592cac266 req-b8047540-260e-4cc7-b984-5ada84b0e2af service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:16.773089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-459c8eef-c3f0-42c6-90f2-485592cac266 req-b8047540-260e-4cc7-b984-5ada84b0e2af service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:16.797889 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-459c8eef-c3f0-42c6-90f2-485592cac266 req-b8047540-260e-4cc7-b984-5ada84b0e2af service nova] Creating event network-changed:54901416-0c67-44c6-a0aa-ed5d4e84ca7e for instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 on n-h1-862964-4 Oct 29 03:15:16.808207 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-459c8eef-c3f0-42c6-90f2-485592cac266 req-b8047540-260e-4cc7-b984-5ada84b0e2af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063982 Oct 29 03:15:16.809183 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2995/5944] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:15:17.255567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2a32ac2a-ccd9-4c30-951d-2165aa06480a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:17.271165 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a32ac2a-ccd9-4c30-951d-2165aa06480a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1369 microversion: 2.1 time: 0.541807 Oct 29 03:15:17.272436 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2950/5945] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:16 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1369 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:18.301790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-949404d9-629a-48e6-9c4d-4d1d53aec418 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:18.303408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-949404d9-629a-48e6-9c4d-4d1d53aec418 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:18.323184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949404d9-629a-48e6-9c4d-4d1d53aec418 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:18.324511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949404d9-629a-48e6-9c4d-4d1d53aec418 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:18.325033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949404d9-629a-48e6-9c4d-4d1d53aec418 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:18.326413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949404d9-629a-48e6-9c4d-4d1d53aec418 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:18.327062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949404d9-629a-48e6-9c4d-4d1d53aec418 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:18.327623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-949404d9-629a-48e6-9c4d-4d1d53aec418 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:18.939516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-949404d9-629a-48e6-9c4d-4d1d53aec418 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:18.951084 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-949404d9-629a-48e6-9c4d-4d1d53aec418 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1369 microversion: 2.1 time: 0.657998 Oct 29 03:15:18.953575 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2996/5946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:18 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1369 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:19.973149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:19.974713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:19.980701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7e70e9a2-7738-4472-8870-1c20a1900365 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:19.981434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7e70e9a2-7738-4472-8870-1c20a1900365 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:19.996970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e70e9a2-7738-4472-8870-1c20a1900365 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:19.997540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e70e9a2-7738-4472-8870-1c20a1900365 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:20.000808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e70e9a2-7738-4472-8870-1c20a1900365 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:20.001460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e70e9a2-7738-4472-8870-1c20a1900365 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:20.001970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e70e9a2-7738-4472-8870-1c20a1900365 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:20.002401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e70e9a2-7738-4472-8870-1c20a1900365 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:20.504727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7e70e9a2-7738-4472-8870-1c20a1900365 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:20.526305 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7e70e9a2-7738-4472-8870-1c20a1900365 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1369 microversion: 2.1 time: 0.554755 Oct 29 03:15:20.529185 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2951/5947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:19 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1369 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:21.557989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e10ba6a8-6efc-425e-aa49-735653e80b45 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:21.559404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e10ba6a8-6efc-425e-aa49-735653e80b45 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:21.572454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:21.576773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e10ba6a8-6efc-425e-aa49-735653e80b45 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:21.578683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e10ba6a8-6efc-425e-aa49-735653e80b45 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:21.580504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e10ba6a8-6efc-425e-aa49-735653e80b45 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:21.581546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e10ba6a8-6efc-425e-aa49-735653e80b45 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:21.582487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e10ba6a8-6efc-425e-aa49-735653e80b45 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:21.585169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e10ba6a8-6efc-425e-aa49-735653e80b45 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:21.612120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=48 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:22.294430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e10ba6a8-6efc-425e-aa49-735653e80b45 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:22.308739 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e10ba6a8-6efc-425e-aa49-735653e80b45 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1369 microversion: 2.1 time: 0.756214 Oct 29 03:15:22.311494 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2997/5948] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:21 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1369 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:22.617725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d9249fd2-2f2c-4943-b847-54c06aeb75da req-4be4657d-72a2-4048-9c27-4e9b02fb30b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc2c36c2-406c-4847-ae8d-3fbd334c9039", "name": "network-vif-plugged", "status": "completed", "tag": "54901416-0c67-44c6-a0aa-ed5d4e84ca7e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:22.645756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d9249fd2-2f2c-4943-b847-54c06aeb75da req-4be4657d-72a2-4048-9c27-4e9b02fb30b1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:22.645756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d9249fd2-2f2c-4943-b847-54c06aeb75da req-4be4657d-72a2-4048-9c27-4e9b02fb30b1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:22.646215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d9249fd2-2f2c-4943-b847-54c06aeb75da req-4be4657d-72a2-4048-9c27-4e9b02fb30b1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:22.690175 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d9249fd2-2f2c-4943-b847-54c06aeb75da req-4be4657d-72a2-4048-9c27-4e9b02fb30b1 service nova] Creating event network-vif-plugged:54901416-0c67-44c6-a0aa-ed5d4e84ca7e for instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 on n-h1-862964-4 Oct 29 03:15:22.710200 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d9249fd2-2f2c-4943-b847-54c06aeb75da req-4be4657d-72a2-4048-9c27-4e9b02fb30b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099016 Oct 29 03:15:22.713076 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2952/5949] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:23.335414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98e76d59-c844-4a47-801c-b2b677a76313 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:23.336121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-98e76d59-c844-4a47-801c-b2b677a76313 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:23.339594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:23.360795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98e76d59-c844-4a47-801c-b2b677a76313 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:23.361683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98e76d59-c844-4a47-801c-b2b677a76313 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:23.362322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98e76d59-c844-4a47-801c-b2b677a76313 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:23.364346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98e76d59-c844-4a47-801c-b2b677a76313 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:23.366152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98e76d59-c844-4a47-801c-b2b677a76313 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:23.368256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98e76d59-c844-4a47-801c-b2b677a76313 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:23.979700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-98e76d59-c844-4a47-801c-b2b677a76313 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:23.999159 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-98e76d59-c844-4a47-801c-b2b677a76313 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1369 microversion: 2.1 time: 0.667863 Oct 29 03:15:24.000518 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2998/5950] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:23 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1369 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:25.025458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-75531aab-1b0e-40fc-8ea1-03eb5058c3ca tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:25.034558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-75531aab-1b0e-40fc-8ea1-03eb5058c3ca tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:25.049197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75531aab-1b0e-40fc-8ea1-03eb5058c3ca tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:25.050997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75531aab-1b0e-40fc-8ea1-03eb5058c3ca tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:25.053436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75531aab-1b0e-40fc-8ea1-03eb5058c3ca tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:25.054440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75531aab-1b0e-40fc-8ea1-03eb5058c3ca tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:25.056689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75531aab-1b0e-40fc-8ea1-03eb5058c3ca tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:25.057412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75531aab-1b0e-40fc-8ea1-03eb5058c3ca tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:25.703409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-75531aab-1b0e-40fc-8ea1-03eb5058c3ca tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:25.705887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=48 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:25.720881 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-75531aab-1b0e-40fc-8ea1-03eb5058c3ca tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1563 microversion: 2.1 time: 0.699791 Oct 29 03:15:25.733941 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2953/5951] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:25 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1563 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:25.747406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d2da4385-51d7-4dc7-94ad-fd131d477207 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:25.747975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d2da4385-51d7-4dc7-94ad-fd131d477207 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:25.760462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2da4385-51d7-4dc7-94ad-fd131d477207 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:25.760959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2da4385-51d7-4dc7-94ad-fd131d477207 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:25.761396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2da4385-51d7-4dc7-94ad-fd131d477207 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:25.762133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2da4385-51d7-4dc7-94ad-fd131d477207 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:25.762582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2da4385-51d7-4dc7-94ad-fd131d477207 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:25.763025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2da4385-51d7-4dc7-94ad-fd131d477207 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:26.204859 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d2da4385-51d7-4dc7-94ad-fd131d477207 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.461386 Oct 29 03:15:26.205906 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 2999/5952] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:15:25 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-interface => generated 285 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:30.846941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-5563de86-ce15-45c6-9f40-c06dfcce25ae req-1808d029-a207-4c6c-92b8-2652ae13c656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2c36c2-406c-4847-ae8d-3fbd334c9039", "tag": "54901416-0c67-44c6-a0aa-ed5d4e84ca7e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:30.870097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5563de86-ce15-45c6-9f40-c06dfcce25ae req-1808d029-a207-4c6c-92b8-2652ae13c656 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:30.870580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5563de86-ce15-45c6-9f40-c06dfcce25ae req-1808d029-a207-4c6c-92b8-2652ae13c656 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:30.871002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5563de86-ce15-45c6-9f40-c06dfcce25ae req-1808d029-a207-4c6c-92b8-2652ae13c656 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:30.903148 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-5563de86-ce15-45c6-9f40-c06dfcce25ae req-1808d029-a207-4c6c-92b8-2652ae13c656 service nova] Creating event network-changed:54901416-0c67-44c6-a0aa-ed5d4e84ca7e for instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 on n-h1-862964-4 Oct 29 03:15:30.919528 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-5563de86-ce15-45c6-9f40-c06dfcce25ae req-1808d029-a207-4c6c-92b8-2652ae13c656 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074322 Oct 29 03:15:30.921896 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2954/5953] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:42.056020 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:15:42.056541 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:15:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Oct 29 03:15:42.057443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:42.058423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=15 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:42.493213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d017ac9-62f4-4da7-be4c-52c0e457cfef tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: .version_select at 0x7fe1a8475d30>, body: {"keypair": {"name": "tempest-keypair-2076600207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLV8BrtIoRptS2UwIYmzKRvRjO690jmlhLvMKl78oLi+iAR9wSS40+QhaT/EmCmgMjvoDg7UrmnoM8D9iPilRG7v5hzTzN/NdKVMhgZFLKeEdGrmWwM+K+IjEIDMLAP3Q=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:42.566806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-8d017ac9-62f4-4da7-be4c-52c0e457cfef tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for project b9abafce931f45438286305af9b7a64a. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:15:42.593394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-8d017ac9-62f4-4da7-be4c-52c0e457cfef tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for user d2867c5be8974c028f933d1c8fe2c2fa and project b9abafce931f45438286305af9b7a64a. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:15:42.674596 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d017ac9-62f4-4da7-be4c-52c0e457cfef tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.611784 Oct 29 03:15:42.687212 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3000/5954] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:15:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:47.091225 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:15:47.091936 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:15:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 29 03:15:47.097169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:47.099326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:47.112183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1147181770", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd1396d1-98cd-4d89-ada5-9f148b567381"}], "security_groups": [{"name": "tempest-securitygroup--406582417"}], "key_name": "tempest-keypair-2076600207", "user_data": "}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:47.877348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] validate_networks() for [('cd1396d1-98cd-4d89-ada5-9f148b567381', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:15:49.002418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:15:49.004580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:15:49.005568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:15:49.006228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:15:49.006839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:15:49.020042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:49.021150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:49.022569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:49.023828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:49.024533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:49.025390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:49.047242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for project b9abafce931f45438286305af9b7a64a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:15:49.053271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for user d2867c5be8974c028f933d1c8fe2c2fa and project b9abafce931f45438286305af9b7a64a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:15:49.068811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:15:49.071696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:15:49.148413 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59440e2c-a0b1-4aa5-95e3-6df39c6b8cd3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.057014 Oct 29 03:15:49.151047 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2955/5955] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:15:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:15:49.163346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c9657020-0f87-410c-9105-1aefa61ec55f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:49.163904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c9657020-0f87-410c-9105-1aefa61ec55f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:49.788472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c9657020-0f87-410c-9105-1aefa61ec55f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:49.800752 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c9657020-0f87-410c-9105-1aefa61ec55f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1242 microversion: 2.1 time: 0.638599 Oct 29 03:15:49.801411 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3001/5956] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:49 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1242 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:50.824059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-09aa38c2-12bb-4ddc-ba3d-705e5000c2b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:50.831167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-09aa38c2-12bb-4ddc-ba3d-705e5000c2b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:50.852767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09aa38c2-12bb-4ddc-ba3d-705e5000c2b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:50.853296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09aa38c2-12bb-4ddc-ba3d-705e5000c2b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:50.860402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09aa38c2-12bb-4ddc-ba3d-705e5000c2b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:50.861989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09aa38c2-12bb-4ddc-ba3d-705e5000c2b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:50.862349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09aa38c2-12bb-4ddc-ba3d-705e5000c2b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:50.862837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09aa38c2-12bb-4ddc-ba3d-705e5000c2b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:51.035477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-09aa38c2-12bb-4ddc-ba3d-705e5000c2b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:51.047328 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-09aa38c2-12bb-4ddc-ba3d-705e5000c2b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1294 microversion: 2.1 time: 0.225334 Oct 29 03:15:51.047957 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2956/5957] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:50 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1294 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:52.076167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-50386677-436a-4d8f-8254-defa29271194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:52.077535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-50386677-436a-4d8f-8254-defa29271194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:52.099768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50386677-436a-4d8f-8254-defa29271194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:52.100261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50386677-436a-4d8f-8254-defa29271194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:52.100690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50386677-436a-4d8f-8254-defa29271194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:52.113210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50386677-436a-4d8f-8254-defa29271194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:52.113698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50386677-436a-4d8f-8254-defa29271194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:52.114157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50386677-436a-4d8f-8254-defa29271194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:52.308179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-50386677-436a-4d8f-8254-defa29271194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:52.318574 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-50386677-436a-4d8f-8254-defa29271194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1300 microversion: 2.1 time: 0.246602 Oct 29 03:15:52.319169 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3002/5958] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:52 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1300 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:53.347055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0bf387c4-84d4-403e-bcfd-dcff4d946b31 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:53.347830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0bf387c4-84d4-403e-bcfd-dcff4d946b31 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:53.378620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bf387c4-84d4-403e-bcfd-dcff4d946b31 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:53.379526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bf387c4-84d4-403e-bcfd-dcff4d946b31 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:53.380741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bf387c4-84d4-403e-bcfd-dcff4d946b31 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:53.384303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bf387c4-84d4-403e-bcfd-dcff4d946b31 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:53.391385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bf387c4-84d4-403e-bcfd-dcff4d946b31 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:53.395189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0bf387c4-84d4-403e-bcfd-dcff4d946b31 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:53.950281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0bf387c4-84d4-403e-bcfd-dcff4d946b31 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:53.998499 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0bf387c4-84d4-403e-bcfd-dcff4d946b31 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1367 microversion: 2.1 time: 0.656725 Oct 29 03:15:54.002503 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2957/5959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:53 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1367 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:54.720900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-0a2fc68c-a0ad-47a3-b0c9-d21228eb7ab9 req-41b0ee1d-4b94-4194-8cad-82b60fbf0772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89aba2d7-1168-4034-be52-6377499ca509", "tag": "6e488bd1-dc25-4e8a-9645-b99435427051"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:54.747537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0a2fc68c-a0ad-47a3-b0c9-d21228eb7ab9 req-41b0ee1d-4b94-4194-8cad-82b60fbf0772 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:54.748013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0a2fc68c-a0ad-47a3-b0c9-d21228eb7ab9 req-41b0ee1d-4b94-4194-8cad-82b60fbf0772 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:54.748433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-0a2fc68c-a0ad-47a3-b0c9-d21228eb7ab9 req-41b0ee1d-4b94-4194-8cad-82b60fbf0772 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:54.830093 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-0a2fc68c-a0ad-47a3-b0c9-d21228eb7ab9 req-41b0ee1d-4b94-4194-8cad-82b60fbf0772 service nova] Creating event network-changed:6e488bd1-dc25-4e8a-9645-b99435427051 for instance 89aba2d7-1168-4034-be52-6377499ca509 on n-h2-862964-4 Oct 29 03:15:54.863106 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-0a2fc68c-a0ad-47a3-b0c9-d21228eb7ab9 req-41b0ee1d-4b94-4194-8cad-82b60fbf0772 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150447 Oct 29 03:15:54.863740 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3003/5960] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:55.029861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5dd00b8e-5c15-48a4-87b5-789e19eea3ae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:55.031718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5dd00b8e-5c15-48a4-87b5-789e19eea3ae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:55.067030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd00b8e-5c15-48a4-87b5-789e19eea3ae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:55.067352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd00b8e-5c15-48a4-87b5-789e19eea3ae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:55.067795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd00b8e-5c15-48a4-87b5-789e19eea3ae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:55.069653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd00b8e-5c15-48a4-87b5-789e19eea3ae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:55.073525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd00b8e-5c15-48a4-87b5-789e19eea3ae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:55.074023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5dd00b8e-5c15-48a4-87b5-789e19eea3ae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:55.681177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5dd00b8e-5c15-48a4-87b5-789e19eea3ae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:55.692891 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5dd00b8e-5c15-48a4-87b5-789e19eea3ae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1367 microversion: 2.1 time: 0.668102 Oct 29 03:15:55.698546 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2958/5961] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:55 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1367 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:56.728117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-765e0b6c-c72b-4fa6-8ec7-5e0e5adaaad9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:56.729475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-765e0b6c-c72b-4fa6-8ec7-5e0e5adaaad9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:56.770576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-765e0b6c-c72b-4fa6-8ec7-5e0e5adaaad9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:56.771125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-765e0b6c-c72b-4fa6-8ec7-5e0e5adaaad9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:56.771566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-765e0b6c-c72b-4fa6-8ec7-5e0e5adaaad9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:56.772682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-765e0b6c-c72b-4fa6-8ec7-5e0e5adaaad9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:56.773213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-765e0b6c-c72b-4fa6-8ec7-5e0e5adaaad9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:56.775130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-765e0b6c-c72b-4fa6-8ec7-5e0e5adaaad9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:57.361702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-765e0b6c-c72b-4fa6-8ec7-5e0e5adaaad9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:57.375635 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-765e0b6c-c72b-4fa6-8ec7-5e0e5adaaad9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1367 microversion: 2.1 time: 0.649425 Oct 29 03:15:57.379877 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3004/5962] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:56 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1367 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:58.092125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-743e4ee5-26c3-402b-b0ca-1fa58a1070fa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d88063cb-1ab2-49f3-8afc-f0a34e6df32b"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:58.099495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-743e4ee5-26c3-402b-b0ca-1fa58a1070fa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:58.121897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-743e4ee5-26c3-402b-b0ca-1fa58a1070fa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:58.122935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-743e4ee5-26c3-402b-b0ca-1fa58a1070fa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:58.123685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-743e4ee5-26c3-402b-b0ca-1fa58a1070fa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:58.125063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-743e4ee5-26c3-402b-b0ca-1fa58a1070fa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:58.125758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-743e4ee5-26c3-402b-b0ca-1fa58a1070fa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:58.126513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-743e4ee5-26c3-402b-b0ca-1fa58a1070fa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:58.406336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7c6975e-3b82-4e7c-9f90-0e968da556e1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:58.406967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7c6975e-3b82-4e7c-9f90-0e968da556e1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:58.449510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c6975e-3b82-4e7c-9f90-0e968da556e1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:58.459269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c6975e-3b82-4e7c-9f90-0e968da556e1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:58.461240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c6975e-3b82-4e7c-9f90-0e968da556e1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:58.462092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c6975e-3b82-4e7c-9f90-0e968da556e1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:58.462674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c6975e-3b82-4e7c-9f90-0e968da556e1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:58.462967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7c6975e-3b82-4e7c-9f90-0e968da556e1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:58.815841 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-743e4ee5-26c3-402b-b0ca-1fa58a1070fa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733040 Oct 29 03:15:58.816489 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2959/5963] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:15:58 2022] POST /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:15:59.090531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a7c6975e-3b82-4e7c-9f90-0e968da556e1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:59.102195 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7c6975e-3b82-4e7c-9f90-0e968da556e1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1367 microversion: 2.1 time: 0.705464 Oct 29 03:15:59.128420 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3005/5964] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:58 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1367 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:16:00.126163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-049b1399-c11c-4141-b0bc-06c646b616fd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:00.126974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-049b1399-c11c-4141-b0bc-06c646b616fd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:00.130169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:00.132926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:00.174469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049b1399-c11c-4141-b0bc-06c646b616fd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:00.181975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049b1399-c11c-4141-b0bc-06c646b616fd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:00.182916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049b1399-c11c-4141-b0bc-06c646b616fd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:00.187136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049b1399-c11c-4141-b0bc-06c646b616fd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:00.189796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049b1399-c11c-4141-b0bc-06c646b616fd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:00.190765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049b1399-c11c-4141-b0bc-06c646b616fd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:00.797996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-049b1399-c11c-4141-b0bc-06c646b616fd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:00.811336 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-049b1399-c11c-4141-b0bc-06c646b616fd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1367 microversion: 2.1 time: 0.686764 Oct 29 03:16:00.814696 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2960/5965] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:00 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1367 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:01.846735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7e940da9-898c-4069-a7c3-2fec3ea9196a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:01.850713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7e940da9-898c-4069-a7c3-2fec3ea9196a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:01.862829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:01.887529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e940da9-898c-4069-a7c3-2fec3ea9196a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:01.897625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e940da9-898c-4069-a7c3-2fec3ea9196a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:01.902759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e940da9-898c-4069-a7c3-2fec3ea9196a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:01.904265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e940da9-898c-4069-a7c3-2fec3ea9196a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:01.905413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e940da9-898c-4069-a7c3-2fec3ea9196a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:01.907468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e940da9-898c-4069-a7c3-2fec3ea9196a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:02.531482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7e940da9-898c-4069-a7c3-2fec3ea9196a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:02.546727 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7e940da9-898c-4069-a7c3-2fec3ea9196a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1367 microversion: 2.1 time: 0.711738 Oct 29 03:16:02.563779 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3006/5966] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:01 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1367 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:03.574821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2c9be4a1-c7be-4439-b21e-bebddc7ad79b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:03.575435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2c9be4a1-c7be-4439-b21e-bebddc7ad79b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:03.592960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9be4a1-c7be-4439-b21e-bebddc7ad79b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:03.593472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9be4a1-c7be-4439-b21e-bebddc7ad79b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:03.598556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9be4a1-c7be-4439-b21e-bebddc7ad79b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:03.599333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9be4a1-c7be-4439-b21e-bebddc7ad79b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:03.599810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9be4a1-c7be-4439-b21e-bebddc7ad79b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:03.600242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9be4a1-c7be-4439-b21e-bebddc7ad79b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:04.354611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d336a588-417f-4a45-83b4-4f2a656bfd14 req-73883dcc-d1bc-499a-9530-0a0cf9b319a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89aba2d7-1168-4034-be52-6377499ca509", "name": "network-vif-plugged", "status": "completed", "tag": "6e488bd1-dc25-4e8a-9645-b99435427051"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:04.390132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d336a588-417f-4a45-83b4-4f2a656bfd14 req-73883dcc-d1bc-499a-9530-0a0cf9b319a6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:04.397067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d336a588-417f-4a45-83b4-4f2a656bfd14 req-73883dcc-d1bc-499a-9530-0a0cf9b319a6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:04.397700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d336a588-417f-4a45-83b4-4f2a656bfd14 req-73883dcc-d1bc-499a-9530-0a0cf9b319a6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:04.480177 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d336a588-417f-4a45-83b4-4f2a656bfd14 req-73883dcc-d1bc-499a-9530-0a0cf9b319a6 service nova] Creating event network-vif-plugged:6e488bd1-dc25-4e8a-9645-b99435427051 for instance 89aba2d7-1168-4034-be52-6377499ca509 on n-h2-862964-4 Oct 29 03:16:04.492682 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d336a588-417f-4a45-83b4-4f2a656bfd14 req-73883dcc-d1bc-499a-9530-0a0cf9b319a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141211 Oct 29 03:16:04.493312 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3007/5967] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:16:05.004302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c9be4a1-c7be-4439-b21e-bebddc7ad79b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:05.018131 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2c9be4a1-c7be-4439-b21e-bebddc7ad79b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1367 microversion: 2.1 time: 1.444278 Oct 29 03:16:05.021010 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2961/5968] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:03 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1367 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:16:05.890736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0cd42d97-4ca5-4c50-9210-f5bd0117abea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Action: 'create', calling method: .version_select at 0x7fe1a8beeca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-746602752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/byGlLIfF9wexqgb5hVf3Ir5DcddhihOUsBl+pd2/vFAbpzRddCrXWPMx4uMz/bhBQgGSvdZfAzvYsHDF36QShDf3y0qqzC0RHBv3DmGbAJeVA4TJf/TBkUj7AwJsUTA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:05.942726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0cd42d97-4ca5-4c50-9210-f5bd0117abea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:16:05.959511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-0cd42d97-4ca5-4c50-9210-f5bd0117abea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for user 29f3383c209340adb16a7074c291b191 and project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:16:06.019283 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0cd42d97-4ca5-4c50-9210-f5bd0117abea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.134585 Oct 29 03:16:06.027015 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3008/5969] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:16:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:06.045748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-40d86414-9010-414e-bf65-4099142a3bbd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:06.046409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-40d86414-9010-414e-bf65-4099142a3bbd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:06.112271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40d86414-9010-414e-bf65-4099142a3bbd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:06.122395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40d86414-9010-414e-bf65-4099142a3bbd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:06.124053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40d86414-9010-414e-bf65-4099142a3bbd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:06.127176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40d86414-9010-414e-bf65-4099142a3bbd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:06.131068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40d86414-9010-414e-bf65-4099142a3bbd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:06.132981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-40d86414-9010-414e-bf65-4099142a3bbd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:06.689960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-40d86414-9010-414e-bf65-4099142a3bbd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:06.718459 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-40d86414-9010-414e-bf65-4099142a3bbd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1367 microversion: 2.1 time: 0.676358 Oct 29 03:16:06.722422 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2962/5970] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:06 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1367 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:07.768090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a886e535-125c-4a5c-8fb0-6025677b7cc2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:07.773748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a886e535-125c-4a5c-8fb0-6025677b7cc2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:07.819370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a886e535-125c-4a5c-8fb0-6025677b7cc2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:07.821576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a886e535-125c-4a5c-8fb0-6025677b7cc2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:07.823269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a886e535-125c-4a5c-8fb0-6025677b7cc2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:07.825056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a886e535-125c-4a5c-8fb0-6025677b7cc2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:07.831819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a886e535-125c-4a5c-8fb0-6025677b7cc2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:07.832483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a886e535-125c-4a5c-8fb0-6025677b7cc2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:08.894512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a886e535-125c-4a5c-8fb0-6025677b7cc2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:08.907013 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a886e535-125c-4a5c-8fb0-6025677b7cc2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1557 microversion: 2.1 time: 1.151947 Oct 29 03:16:08.907631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3009/5971] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:07 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1557 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:08.935490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4d913120-3a9d-493d-80bd-fd0395aefde5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:08.937099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4d913120-3a9d-493d-80bd-fd0395aefde5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:08.965117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d913120-3a9d-493d-80bd-fd0395aefde5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:08.969006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d913120-3a9d-493d-80bd-fd0395aefde5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:08.971554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d913120-3a9d-493d-80bd-fd0395aefde5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:08.978390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d913120-3a9d-493d-80bd-fd0395aefde5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:08.981001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d913120-3a9d-493d-80bd-fd0395aefde5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:08.983149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d913120-3a9d-493d-80bd-fd0395aefde5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:09.113264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-782991340", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "72119a3f-cf27-4ce1-a7a3-e49f22c563ca"}], "key_name": "tempest-TestNetworkBasicOps-746602752", "security_groups": [{"name": "tempest-secgroup-smoke-893307795"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:09.291160 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4d913120-3a9d-493d-80bd-fd0395aefde5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.361213 Oct 29 03:16:09.292802 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2963/5972] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:16:08 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-interface => generated 285 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:10.320470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] validate_networks() for [('72119a3f-cf27-4ce1-a7a3-e49f22c563ca', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:16:12.150941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c1b584b4-56f5-43ef-99e7-9a2ba13febb7 req-8aee3eb0-74e2-4272-850b-92c425b46948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89aba2d7-1168-4034-be52-6377499ca509", "tag": "6e488bd1-dc25-4e8a-9645-b99435427051"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:12.190485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c1b584b4-56f5-43ef-99e7-9a2ba13febb7 req-8aee3eb0-74e2-4272-850b-92c425b46948 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:12.195644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c1b584b4-56f5-43ef-99e7-9a2ba13febb7 req-8aee3eb0-74e2-4272-850b-92c425b46948 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:12.196273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c1b584b4-56f5-43ef-99e7-9a2ba13febb7 req-8aee3eb0-74e2-4272-850b-92c425b46948 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:12.232108 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c1b584b4-56f5-43ef-99e7-9a2ba13febb7 req-8aee3eb0-74e2-4272-850b-92c425b46948 service nova] Creating event network-changed:6e488bd1-dc25-4e8a-9645-b99435427051 for instance 89aba2d7-1168-4034-be52-6377499ca509 on n-h2-862964-4 Oct 29 03:16:12.247758 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c1b584b4-56f5-43ef-99e7-9a2ba13febb7 req-8aee3eb0-74e2-4272-850b-92c425b46948 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101854 Oct 29 03:16:12.254821 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2964/5973] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:16:12.387214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:16:12.387857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:16:12.388366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:16:12.388993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:16:12.389675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:16:12.392100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:12.424695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:12.425272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:12.425741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:12.426528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:12.426994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:12.427611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:12.452201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:16:12.468872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for user 29f3383c209340adb16a7074c291b191 and project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:16:12.503623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:16:12.515041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:16:12.615285 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2bde3b7f-9ebc-4f07-82de-0bcdb51b72ea tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.509454 Oct 29 03:16:12.625098 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3010/5974] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:16:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 3519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:16:12.632669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15210218-5adb-4945-86ea-1451311b6c2e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:12.633820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-15210218-5adb-4945-86ea-1451311b6c2e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:12.802617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15210218-5adb-4945-86ea-1451311b6c2e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:12.813445 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-15210218-5adb-4945-86ea-1451311b6c2e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1247 microversion: 2.1 time: 0.186301 Oct 29 03:16:12.818819 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2965/5975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:12 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1247 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:16:13.847491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2e16f36f-2d62-4fb5-9618-b6b809c61120 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:13.849027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2e16f36f-2d62-4fb5-9618-b6b809c61120 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:13.903414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e16f36f-2d62-4fb5-9618-b6b809c61120 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:13.903965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e16f36f-2d62-4fb5-9618-b6b809c61120 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:13.919335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e16f36f-2d62-4fb5-9618-b6b809c61120 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:13.920096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e16f36f-2d62-4fb5-9618-b6b809c61120 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:13.921297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e16f36f-2d62-4fb5-9618-b6b809c61120 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:13.935102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e16f36f-2d62-4fb5-9618-b6b809c61120 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:14.112390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2e16f36f-2d62-4fb5-9618-b6b809c61120 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:14.126509 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2e16f36f-2d62-4fb5-9618-b6b809c61120 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1243 microversion: 2.1 time: 0.281015 Oct 29 03:16:14.127274 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3011/5976] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:13 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1243 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:15.150661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a37cad13-a9c7-4a2c-91f5-7cf78451cc47 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:15.151251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a37cad13-a9c7-4a2c-91f5-7cf78451cc47 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:15.159658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a37cad13-a9c7-4a2c-91f5-7cf78451cc47 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:15.160137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a37cad13-a9c7-4a2c-91f5-7cf78451cc47 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:15.160781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a37cad13-a9c7-4a2c-91f5-7cf78451cc47 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:15.161666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a37cad13-a9c7-4a2c-91f5-7cf78451cc47 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:15.162294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a37cad13-a9c7-4a2c-91f5-7cf78451cc47 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:15.163005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a37cad13-a9c7-4a2c-91f5-7cf78451cc47 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:15.234532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a37cad13-a9c7-4a2c-91f5-7cf78451cc47 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:15.244271 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a37cad13-a9c7-4a2c-91f5-7cf78451cc47 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1305 microversion: 2.1 time: 0.097348 Oct 29 03:16:15.258687 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2966/5977] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:15 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:16.269901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-081d0388-be84-43eb-8f81-b0bc97c06542 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:16.271114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-081d0388-be84-43eb-8f81-b0bc97c06542 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:16.286139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-081d0388-be84-43eb-8f81-b0bc97c06542 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:16.286643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-081d0388-be84-43eb-8f81-b0bc97c06542 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:16.287102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-081d0388-be84-43eb-8f81-b0bc97c06542 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:16.287782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-081d0388-be84-43eb-8f81-b0bc97c06542 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:16.288240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-081d0388-be84-43eb-8f81-b0bc97c06542 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:16.288659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-081d0388-be84-43eb-8f81-b0bc97c06542 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:16.428213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-081d0388-be84-43eb-8f81-b0bc97c06542 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:16.444317 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-081d0388-be84-43eb-8f81-b0bc97c06542 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1305 microversion: 2.1 time: 0.175814 Oct 29 03:16:16.445124 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3012/5978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:16 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1305 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:17.470811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6eb4c41b-173f-406b-95ab-afa1fd8570f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:17.471444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6eb4c41b-173f-406b-95ab-afa1fd8570f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:17.474598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:17.481512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6eb4c41b-173f-406b-95ab-afa1fd8570f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:17.485059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6eb4c41b-173f-406b-95ab-afa1fd8570f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:17.486097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6eb4c41b-173f-406b-95ab-afa1fd8570f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:17.489370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6eb4c41b-173f-406b-95ab-afa1fd8570f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:17.492570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6eb4c41b-173f-406b-95ab-afa1fd8570f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:17.494272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6eb4c41b-173f-406b-95ab-afa1fd8570f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:17.519034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:17.800116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6eb4c41b-173f-406b-95ab-afa1fd8570f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:17.808080 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6eb4c41b-173f-406b-95ab-afa1fd8570f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1372 microversion: 2.1 time: 0.342656 Oct 29 03:16:17.822753 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2967/5979] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:17 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1372 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:18.326320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-60ff2c77-a6c4-4a38-90ab-69bd1ea4ef05 req-8c4215c3-a4dc-49c0-b2e7-bf5dec014479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20910431-5b8e-4048-9c7f-e1371ccc60bc", "tag": "07f9ee21-a2db-4276-bb07-41cd48d0ca2c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:18.342978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-60ff2c77-a6c4-4a38-90ab-69bd1ea4ef05 req-8c4215c3-a4dc-49c0-b2e7-bf5dec014479 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:18.344013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-60ff2c77-a6c4-4a38-90ab-69bd1ea4ef05 req-8c4215c3-a4dc-49c0-b2e7-bf5dec014479 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:18.345505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-60ff2c77-a6c4-4a38-90ab-69bd1ea4ef05 req-8c4215c3-a4dc-49c0-b2e7-bf5dec014479 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:18.365668 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-60ff2c77-a6c4-4a38-90ab-69bd1ea4ef05 req-8c4215c3-a4dc-49c0-b2e7-bf5dec014479 service nova] Creating event network-changed:07f9ee21-a2db-4276-bb07-41cd48d0ca2c for instance 20910431-5b8e-4048-9c7f-e1371ccc60bc on n-h1-862964-4 Oct 29 03:16:18.373671 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-60ff2c77-a6c4-4a38-90ab-69bd1ea4ef05 req-8c4215c3-a4dc-49c0-b2e7-bf5dec014479 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051129 Oct 29 03:16:18.375322 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3013/5980] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:18.834053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-24393d8e-0d82-4403-8302-f398fe2e1abb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:18.834725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-24393d8e-0d82-4403-8302-f398fe2e1abb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:18.850551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24393d8e-0d82-4403-8302-f398fe2e1abb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:18.853844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24393d8e-0d82-4403-8302-f398fe2e1abb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:18.854560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24393d8e-0d82-4403-8302-f398fe2e1abb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:18.856083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24393d8e-0d82-4403-8302-f398fe2e1abb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:18.856607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24393d8e-0d82-4403-8302-f398fe2e1abb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:18.856966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24393d8e-0d82-4403-8302-f398fe2e1abb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:19.246646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f749e6ba-b911-4e43-966b-1e73b9a0e02d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:19.252115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f749e6ba-b911-4e43-966b-1e73b9a0e02d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:19.268634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f749e6ba-b911-4e43-966b-1e73b9a0e02d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:19.269136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f749e6ba-b911-4e43-966b-1e73b9a0e02d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:19.269939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f749e6ba-b911-4e43-966b-1e73b9a0e02d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:19.271076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f749e6ba-b911-4e43-966b-1e73b9a0e02d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:19.271173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f749e6ba-b911-4e43-966b-1e73b9a0e02d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:19.271540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f749e6ba-b911-4e43-966b-1e73b9a0e02d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:19.311390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-f749e6ba-b911-4e43-966b-1e73b9a0e02d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lazy-loading 'flavor' on Instance uuid cc2c36c2-406c-4847-ae8d-3fbd334c9039 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:16:19.524300 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f749e6ba-b911-4e43-966b-1e73b9a0e02d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/action" status: 200 len: 32 microversion: 2.1 time: 0.283842 Oct 29 03:16:19.525355 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3014/5981] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:16:19 2022] POST /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/action => generated 32 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:16:19.540629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-400f7fee-97de-48fb-a057-19d1ec9b0d0f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:19.541999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-400f7fee-97de-48fb-a057-19d1ec9b0d0f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:19.551508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-400f7fee-97de-48fb-a057-19d1ec9b0d0f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:19.552259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-400f7fee-97de-48fb-a057-19d1ec9b0d0f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:19.553086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-400f7fee-97de-48fb-a057-19d1ec9b0d0f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:19.554069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-400f7fee-97de-48fb-a057-19d1ec9b0d0f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:19.554726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-400f7fee-97de-48fb-a057-19d1ec9b0d0f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:19.555367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-400f7fee-97de-48fb-a057-19d1ec9b0d0f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:19.796584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-24393d8e-0d82-4403-8302-f398fe2e1abb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:19.811876 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-24393d8e-0d82-4403-8302-f398fe2e1abb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1372 microversion: 2.1 time: 0.982464 Oct 29 03:16:19.812808 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2968/5982] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:18 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1372 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:20.450065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-400f7fee-97de-48fb-a057-19d1ec9b0d0f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:20.480112 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-400f7fee-97de-48fb-a057-19d1ec9b0d0f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.947299 Oct 29 03:16:20.481057 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3015/5983] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:19 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:20.839088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eeb2bf28-e982-4cc4-a264-edf84d25ad05 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:20.840479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eeb2bf28-e982-4cc4-a264-edf84d25ad05 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:20.849037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf28-e982-4cc4-a264-edf84d25ad05 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:20.849731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf28-e982-4cc4-a264-edf84d25ad05 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:20.850392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf28-e982-4cc4-a264-edf84d25ad05 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:20.851382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf28-e982-4cc4-a264-edf84d25ad05 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:20.852089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf28-e982-4cc4-a264-edf84d25ad05 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:20.852655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf28-e982-4cc4-a264-edf84d25ad05 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:21.005082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eeb2bf28-e982-4cc4-a264-edf84d25ad05 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:21.012864 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eeb2bf28-e982-4cc4-a264-edf84d25ad05 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1372 microversion: 2.1 time: 0.178111 Oct 29 03:16:21.013454 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2969/5984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:20 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:21.505959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ffb87d1d-a629-415d-8f1d-feefb2c7d833 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:21.508268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ffb87d1d-a629-415d-8f1d-feefb2c7d833 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:21.517581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffb87d1d-a629-415d-8f1d-feefb2c7d833 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:21.518089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffb87d1d-a629-415d-8f1d-feefb2c7d833 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:21.518846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffb87d1d-a629-415d-8f1d-feefb2c7d833 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:21.519711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffb87d1d-a629-415d-8f1d-feefb2c7d833 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:21.520421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffb87d1d-a629-415d-8f1d-feefb2c7d833 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:21.521006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ffb87d1d-a629-415d-8f1d-feefb2c7d833 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:21.858271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ffb87d1d-a629-415d-8f1d-feefb2c7d833 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:21.866830 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ffb87d1d-a629-415d-8f1d-feefb2c7d833 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.365446 Oct 29 03:16:21.867743 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3016/5985] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:21 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:22.038363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d12c3ca6-d5b7-4dba-9482-9f9d6fad9a72 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:22.039677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d12c3ca6-d5b7-4dba-9482-9f9d6fad9a72 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:22.054146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d12c3ca6-d5b7-4dba-9482-9f9d6fad9a72 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:22.055230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d12c3ca6-d5b7-4dba-9482-9f9d6fad9a72 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:22.055856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d12c3ca6-d5b7-4dba-9482-9f9d6fad9a72 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:22.056739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d12c3ca6-d5b7-4dba-9482-9f9d6fad9a72 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:22.058484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d12c3ca6-d5b7-4dba-9482-9f9d6fad9a72 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:22.059091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d12c3ca6-d5b7-4dba-9482-9f9d6fad9a72 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:22.414550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d12c3ca6-d5b7-4dba-9482-9f9d6fad9a72 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:22.439216 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d12c3ca6-d5b7-4dba-9482-9f9d6fad9a72 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1372 microversion: 2.1 time: 0.407655 Oct 29 03:16:22.442346 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2970/5986] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:22 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1372 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:22.893115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3f05f797-0406-424e-8ad3-c44843c9207f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:22.893720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3f05f797-0406-424e-8ad3-c44843c9207f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:22.896277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:22.897132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=10 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:22.916861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f05f797-0406-424e-8ad3-c44843c9207f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:22.917357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f05f797-0406-424e-8ad3-c44843c9207f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:22.917816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f05f797-0406-424e-8ad3-c44843c9207f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:22.918520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f05f797-0406-424e-8ad3-c44843c9207f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:22.918965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f05f797-0406-424e-8ad3-c44843c9207f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:22.919384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3f05f797-0406-424e-8ad3-c44843c9207f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:22.971484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:23.242878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3f05f797-0406-424e-8ad3-c44843c9207f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:23.260230 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3f05f797-0406-424e-8ad3-c44843c9207f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.371195 Oct 29 03:16:23.262411 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3017/5987] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:22 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:23.471679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-93bc7fe7-08eb-452a-bcbd-952c8db9c980 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:23.473532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-93bc7fe7-08eb-452a-bcbd-952c8db9c980 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:23.476102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:23.491114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93bc7fe7-08eb-452a-bcbd-952c8db9c980 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:23.491901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93bc7fe7-08eb-452a-bcbd-952c8db9c980 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:23.495073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93bc7fe7-08eb-452a-bcbd-952c8db9c980 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:23.496146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93bc7fe7-08eb-452a-bcbd-952c8db9c980 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:23.497184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93bc7fe7-08eb-452a-bcbd-952c8db9c980 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:23.497791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93bc7fe7-08eb-452a-bcbd-952c8db9c980 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:23.842887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-93bc7fe7-08eb-452a-bcbd-952c8db9c980 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:23.853063 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-93bc7fe7-08eb-452a-bcbd-952c8db9c980 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1372 microversion: 2.1 time: 0.386085 Oct 29 03:16:23.853692 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2971/5988] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:23 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1372 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:24.287408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a916c8db-1473-4e4e-95f8-68bd8e44c3b8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:24.288121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a916c8db-1473-4e4e-95f8-68bd8e44c3b8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:24.310593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a916c8db-1473-4e4e-95f8-68bd8e44c3b8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:24.313883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a916c8db-1473-4e4e-95f8-68bd8e44c3b8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:24.314830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a916c8db-1473-4e4e-95f8-68bd8e44c3b8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:24.315830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a916c8db-1473-4e4e-95f8-68bd8e44c3b8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:24.318844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a916c8db-1473-4e4e-95f8-68bd8e44c3b8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:24.319633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a916c8db-1473-4e4e-95f8-68bd8e44c3b8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:24.632034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a916c8db-1473-4e4e-95f8-68bd8e44c3b8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:24.649849 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a916c8db-1473-4e4e-95f8-68bd8e44c3b8 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.366356 Oct 29 03:16:24.650611 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3018/5989] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:24 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:24.881408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16b3cdde-6e55-4bd0-a042-7a3d47c18a3c tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:24.884369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-16b3cdde-6e55-4bd0-a042-7a3d47c18a3c tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:24.895459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b3cdde-6e55-4bd0-a042-7a3d47c18a3c tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:24.896244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b3cdde-6e55-4bd0-a042-7a3d47c18a3c tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:24.896930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b3cdde-6e55-4bd0-a042-7a3d47c18a3c tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:24.897934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b3cdde-6e55-4bd0-a042-7a3d47c18a3c tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:24.898609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b3cdde-6e55-4bd0-a042-7a3d47c18a3c tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:24.899250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16b3cdde-6e55-4bd0-a042-7a3d47c18a3c tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:25.180220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-16b3cdde-6e55-4bd0-a042-7a3d47c18a3c tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:25.206109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-2d8e02eb-fa48-4f53-a75e-7cb4d8a8ce64 req-59c42b2f-34e5-4800-a573-03e1b9779f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20910431-5b8e-4048-9c7f-e1371ccc60bc", "name": "network-vif-plugged", "status": "completed", "tag": "07f9ee21-a2db-4276-bb07-41cd48d0ca2c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:25.219697 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-16b3cdde-6e55-4bd0-a042-7a3d47c18a3c tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1372 microversion: 2.1 time: 0.344743 Oct 29 03:16:25.221538 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2972/5990] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:24 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1372 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:25.239172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2d8e02eb-fa48-4f53-a75e-7cb4d8a8ce64 req-59c42b2f-34e5-4800-a573-03e1b9779f9c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:25.239658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2d8e02eb-fa48-4f53-a75e-7cb4d8a8ce64 req-59c42b2f-34e5-4800-a573-03e1b9779f9c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:25.240093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2d8e02eb-fa48-4f53-a75e-7cb4d8a8ce64 req-59c42b2f-34e5-4800-a573-03e1b9779f9c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:25.288396 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-2d8e02eb-fa48-4f53-a75e-7cb4d8a8ce64 req-59c42b2f-34e5-4800-a573-03e1b9779f9c service nova] Creating event network-vif-plugged:07f9ee21-a2db-4276-bb07-41cd48d0ca2c for instance 20910431-5b8e-4048-9c7f-e1371ccc60bc on n-h1-862964-4 Oct 29 03:16:25.311646 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-2d8e02eb-fa48-4f53-a75e-7cb4d8a8ce64 req-59c42b2f-34e5-4800-a573-03e1b9779f9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109172 Oct 29 03:16:25.312848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3019/5991] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:16:25.678423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bf442b8f-2b09-4088-928a-ee66a08711dd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:25.679032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bf442b8f-2b09-4088-928a-ee66a08711dd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:25.691904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf442b8f-2b09-4088-928a-ee66a08711dd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:25.692401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf442b8f-2b09-4088-928a-ee66a08711dd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:25.695511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf442b8f-2b09-4088-928a-ee66a08711dd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:25.702811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf442b8f-2b09-4088-928a-ee66a08711dd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:25.703300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf442b8f-2b09-4088-928a-ee66a08711dd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:25.703741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf442b8f-2b09-4088-928a-ee66a08711dd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:26.076696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bf442b8f-2b09-4088-928a-ee66a08711dd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:26.086585 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bf442b8f-2b09-4088-928a-ee66a08711dd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.416083 Oct 29 03:16:26.089311 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2973/5992] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:25 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:26.249255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fd48e382-1714-4699-83a9-1945c92852f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:26.250451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fd48e382-1714-4699-83a9-1945c92852f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:26.261314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd48e382-1714-4699-83a9-1945c92852f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:26.269256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd48e382-1714-4699-83a9-1945c92852f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:26.270023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd48e382-1714-4699-83a9-1945c92852f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:26.270936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd48e382-1714-4699-83a9-1945c92852f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:26.271589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd48e382-1714-4699-83a9-1945c92852f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:26.272205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fd48e382-1714-4699-83a9-1945c92852f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:27.029257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fd48e382-1714-4699-83a9-1945c92852f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:27.039009 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fd48e382-1714-4699-83a9-1945c92852f3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1372 microversion: 2.1 time: 0.794673 Oct 29 03:16:27.040054 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3020/5993] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:26 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1372 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:27.112105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25221caa-8f27-4bd2-b244-558bbb817e9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:27.112721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25221caa-8f27-4bd2-b244-558bbb817e9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:27.124288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25221caa-8f27-4bd2-b244-558bbb817e9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:27.131644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25221caa-8f27-4bd2-b244-558bbb817e9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:27.132586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25221caa-8f27-4bd2-b244-558bbb817e9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:27.142929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25221caa-8f27-4bd2-b244-558bbb817e9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:27.145530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25221caa-8f27-4bd2-b244-558bbb817e9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:27.146226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25221caa-8f27-4bd2-b244-558bbb817e9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:27.437638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25221caa-8f27-4bd2-b244-558bbb817e9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:27.446963 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25221caa-8f27-4bd2-b244-558bbb817e9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.338688 Oct 29 03:16:27.470530 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2974/5994] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:27 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:28.065162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5062e1ce-68b0-42d0-a9d5-d0eccc46c077 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:28.066525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5062e1ce-68b0-42d0-a9d5-d0eccc46c077 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:28.074659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5062e1ce-68b0-42d0-a9d5-d0eccc46c077 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:28.075286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5062e1ce-68b0-42d0-a9d5-d0eccc46c077 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:28.076403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5062e1ce-68b0-42d0-a9d5-d0eccc46c077 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:28.078043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5062e1ce-68b0-42d0-a9d5-d0eccc46c077 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:28.078645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5062e1ce-68b0-42d0-a9d5-d0eccc46c077 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:28.079243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5062e1ce-68b0-42d0-a9d5-d0eccc46c077 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:28.375716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5062e1ce-68b0-42d0-a9d5-d0eccc46c077 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:28.385564 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5062e1ce-68b0-42d0-a9d5-d0eccc46c077 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1545 microversion: 2.1 time: 0.324999 Oct 29 03:16:28.386212 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3021/5995] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:28 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1545 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:28.409580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-679d3cf7-8db6-4661-85dc-bbd41c6e3387 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:28.410223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-679d3cf7-8db6-4661-85dc-bbd41c6e3387 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:28.418388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-679d3cf7-8db6-4661-85dc-bbd41c6e3387 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:28.419119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-679d3cf7-8db6-4661-85dc-bbd41c6e3387 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:28.419713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-679d3cf7-8db6-4661-85dc-bbd41c6e3387 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:28.420610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-679d3cf7-8db6-4661-85dc-bbd41c6e3387 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:28.421226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-679d3cf7-8db6-4661-85dc-bbd41c6e3387 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:28.421818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-679d3cf7-8db6-4661-85dc-bbd41c6e3387 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:28.500647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-528d3f39-66a0-4ce9-b08b-fd53d2474d97 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:28.501266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-528d3f39-66a0-4ce9-b08b-fd53d2474d97 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:28.510288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-528d3f39-66a0-4ce9-b08b-fd53d2474d97 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:28.514274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-528d3f39-66a0-4ce9-b08b-fd53d2474d97 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:28.514958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-528d3f39-66a0-4ce9-b08b-fd53d2474d97 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:28.515872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-528d3f39-66a0-4ce9-b08b-fd53d2474d97 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:28.516488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-528d3f39-66a0-4ce9-b08b-fd53d2474d97 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:28.517282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-528d3f39-66a0-4ce9-b08b-fd53d2474d97 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:28.614322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-679d3cf7-8db6-4661-85dc-bbd41c6e3387 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:28.637430 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-679d3cf7-8db6-4661-85dc-bbd41c6e3387 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1545 microversion: 2.1 time: 0.217964 Oct 29 03:16:28.638251 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2975/5996] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:28 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1545 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:28.853153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-528d3f39-66a0-4ce9-b08b-fd53d2474d97 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:28.869115 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-528d3f39-66a0-4ce9-b08b-fd53d2474d97 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.372600 Oct 29 03:16:28.870853 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3022/5997] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:28 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:16:29.902289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4e3cdbd5-7ef5-4734-b494-69657a4be88e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:29.903977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4e3cdbd5-7ef5-4734-b494-69657a4be88e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:29.923823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e3cdbd5-7ef5-4734-b494-69657a4be88e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:29.924841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e3cdbd5-7ef5-4734-b494-69657a4be88e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:29.927935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e3cdbd5-7ef5-4734-b494-69657a4be88e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:29.929439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e3cdbd5-7ef5-4734-b494-69657a4be88e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:29.930193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e3cdbd5-7ef5-4734-b494-69657a4be88e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:29.931820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e3cdbd5-7ef5-4734-b494-69657a4be88e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:30.580378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4e3cdbd5-7ef5-4734-b494-69657a4be88e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:30.593783 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4e3cdbd5-7ef5-4734-b494-69657a4be88e tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.695944 Oct 29 03:16:30.616707 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2976/5998] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:29 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:31.625036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-33c1b394-82e5-4a47-8c63-063ad13f0c27 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:31.628753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-33c1b394-82e5-4a47-8c63-063ad13f0c27 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:31.640785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33c1b394-82e5-4a47-8c63-063ad13f0c27 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:31.650821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33c1b394-82e5-4a47-8c63-063ad13f0c27 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:31.660399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33c1b394-82e5-4a47-8c63-063ad13f0c27 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:31.664491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33c1b394-82e5-4a47-8c63-063ad13f0c27 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:31.665411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33c1b394-82e5-4a47-8c63-063ad13f0c27 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:31.666238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33c1b394-82e5-4a47-8c63-063ad13f0c27 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:32.174167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-33c1b394-82e5-4a47-8c63-063ad13f0c27 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:32.197141 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-33c1b394-82e5-4a47-8c63-063ad13f0c27 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.576248 Oct 29 03:16:32.197737 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3023/5999] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:31 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:32.257755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9152f5ca-cae0-45b3-ae79-81f9f05c98fd req-7e942aed-e909-4add-8eaf-0f369722ef9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20910431-5b8e-4048-9c7f-e1371ccc60bc", "tag": "07f9ee21-a2db-4276-bb07-41cd48d0ca2c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:32.276349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9152f5ca-cae0-45b3-ae79-81f9f05c98fd req-7e942aed-e909-4add-8eaf-0f369722ef9a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:32.283398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9152f5ca-cae0-45b3-ae79-81f9f05c98fd req-7e942aed-e909-4add-8eaf-0f369722ef9a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:32.290099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9152f5ca-cae0-45b3-ae79-81f9f05c98fd req-7e942aed-e909-4add-8eaf-0f369722ef9a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:32.329021 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9152f5ca-cae0-45b3-ae79-81f9f05c98fd req-7e942aed-e909-4add-8eaf-0f369722ef9a service nova] Creating event network-changed:07f9ee21-a2db-4276-bb07-41cd48d0ca2c for instance 20910431-5b8e-4048-9c7f-e1371ccc60bc on n-h1-862964-4 Oct 29 03:16:32.344168 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9152f5ca-cae0-45b3-ae79-81f9f05c98fd req-7e942aed-e909-4add-8eaf-0f369722ef9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090122 Oct 29 03:16:32.345179 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2977/6000] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:33.222550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20ac0233-4430-4b70-a0f1-86e972066d7b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:33.224907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-20ac0233-4430-4b70-a0f1-86e972066d7b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:33.248375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20ac0233-4430-4b70-a0f1-86e972066d7b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:33.249656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20ac0233-4430-4b70-a0f1-86e972066d7b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:33.250332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20ac0233-4430-4b70-a0f1-86e972066d7b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:33.251764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20ac0233-4430-4b70-a0f1-86e972066d7b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:33.252431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20ac0233-4430-4b70-a0f1-86e972066d7b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:33.253055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20ac0233-4430-4b70-a0f1-86e972066d7b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:34.164409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20ac0233-4430-4b70-a0f1-86e972066d7b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:34.174398 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20ac0233-4430-4b70-a0f1-86e972066d7b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.956953 Oct 29 03:16:34.194609 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3024/6001] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:33 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:35.224474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2993670a-28f6-4c05-8ee4-bc4edcf513a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:35.225853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2993670a-28f6-4c05-8ee4-bc4edcf513a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:35.244025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2993670a-28f6-4c05-8ee4-bc4edcf513a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:35.244637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2993670a-28f6-4c05-8ee4-bc4edcf513a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:35.245284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2993670a-28f6-4c05-8ee4-bc4edcf513a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:35.247710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2993670a-28f6-4c05-8ee4-bc4edcf513a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:35.248511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2993670a-28f6-4c05-8ee4-bc4edcf513a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:35.249214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2993670a-28f6-4c05-8ee4-bc4edcf513a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:35.552503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2993670a-28f6-4c05-8ee4-bc4edcf513a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:35.583708 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2993670a-28f6-4c05-8ee4-bc4edcf513a5 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.366661 Oct 29 03:16:35.584839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2978/6002] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:35 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:16:36.613627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b95b277a-391f-4726-b8fc-286ddee1281c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:36.614402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b95b277a-391f-4726-b8fc-286ddee1281c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:36.627487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95b277a-391f-4726-b8fc-286ddee1281c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:36.629171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95b277a-391f-4726-b8fc-286ddee1281c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:36.629791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95b277a-391f-4726-b8fc-286ddee1281c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:36.632824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95b277a-391f-4726-b8fc-286ddee1281c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:36.633531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95b277a-391f-4726-b8fc-286ddee1281c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:36.634182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b95b277a-391f-4726-b8fc-286ddee1281c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:37.004205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b95b277a-391f-4726-b8fc-286ddee1281c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:37.015547 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b95b277a-391f-4726-b8fc-286ddee1281c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.406472 Oct 29 03:16:37.016515 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3025/6003] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:36 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:38.044277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8e68c92c-891e-495b-8435-3f00da4e9d43 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:38.045031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8e68c92c-891e-495b-8435-3f00da4e9d43 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:38.071141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68c92c-891e-495b-8435-3f00da4e9d43 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:38.071659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68c92c-891e-495b-8435-3f00da4e9d43 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:38.072099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68c92c-891e-495b-8435-3f00da4e9d43 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:38.072824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68c92c-891e-495b-8435-3f00da4e9d43 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:38.073279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68c92c-891e-495b-8435-3f00da4e9d43 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:38.073704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68c92c-891e-495b-8435-3f00da4e9d43 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:38.421254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e68c92c-891e-495b-8435-3f00da4e9d43 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:38.431300 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8e68c92c-891e-495b-8435-3f00da4e9d43 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.391040 Oct 29 03:16:38.432509 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2979/6004] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:38 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:39.462083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-31a1cc23-cedb-4ead-909b-a9bd9b36b0c2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:39.463425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-31a1cc23-cedb-4ead-909b-a9bd9b36b0c2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:39.474219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31a1cc23-cedb-4ead-909b-a9bd9b36b0c2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:39.475070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31a1cc23-cedb-4ead-909b-a9bd9b36b0c2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:39.475754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31a1cc23-cedb-4ead-909b-a9bd9b36b0c2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:39.476743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31a1cc23-cedb-4ead-909b-a9bd9b36b0c2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:39.477431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31a1cc23-cedb-4ead-909b-a9bd9b36b0c2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:39.480492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31a1cc23-cedb-4ead-909b-a9bd9b36b0c2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:39.698800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-31a1cc23-cedb-4ead-909b-a9bd9b36b0c2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:39.712197 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-31a1cc23-cedb-4ead-909b-a9bd9b36b0c2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.258335 Oct 29 03:16:39.729728 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3026/6005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:39 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:40.735628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f3e994f1-3b89-41f9-95c8-a825619e9540 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:40.736152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f3e994f1-3b89-41f9-95c8-a825619e9540 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:40.743449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3e994f1-3b89-41f9-95c8-a825619e9540 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:40.744300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3e994f1-3b89-41f9-95c8-a825619e9540 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:40.745025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3e994f1-3b89-41f9-95c8-a825619e9540 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:40.746216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3e994f1-3b89-41f9-95c8-a825619e9540 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:40.746833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3e994f1-3b89-41f9-95c8-a825619e9540 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:40.747417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3e994f1-3b89-41f9-95c8-a825619e9540 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:41.037148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f3e994f1-3b89-41f9-95c8-a825619e9540 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:41.056481 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f3e994f1-3b89-41f9-95c8-a825619e9540 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.315038 Oct 29 03:16:41.057265 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2980/6006] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:40 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:42.085878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fea8dbcb-ddab-4918-8850-3efaa69e40f1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:42.087077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fea8dbcb-ddab-4918-8850-3efaa69e40f1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:42.099908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea8dbcb-ddab-4918-8850-3efaa69e40f1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:42.101939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea8dbcb-ddab-4918-8850-3efaa69e40f1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:42.103795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea8dbcb-ddab-4918-8850-3efaa69e40f1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:42.106798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea8dbcb-ddab-4918-8850-3efaa69e40f1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:42.107482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea8dbcb-ddab-4918-8850-3efaa69e40f1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:42.110170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea8dbcb-ddab-4918-8850-3efaa69e40f1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:42.404383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fea8dbcb-ddab-4918-8850-3efaa69e40f1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:42.414075 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fea8dbcb-ddab-4918-8850-3efaa69e40f1 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.333213 Oct 29 03:16:42.415321 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3027/6007] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:42 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:43.440336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89758ca5-4208-4f07-a517-1ef525cace42 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:43.440975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89758ca5-4208-4f07-a517-1ef525cace42 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:43.460202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89758ca5-4208-4f07-a517-1ef525cace42 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:43.463697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89758ca5-4208-4f07-a517-1ef525cace42 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:43.464308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89758ca5-4208-4f07-a517-1ef525cace42 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:43.465494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89758ca5-4208-4f07-a517-1ef525cace42 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:43.470084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89758ca5-4208-4f07-a517-1ef525cace42 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:43.470595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89758ca5-4208-4f07-a517-1ef525cace42 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:43.687263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-89758ca5-4208-4f07-a517-1ef525cace42 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:43.697122 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89758ca5-4208-4f07-a517-1ef525cace42 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.262392 Oct 29 03:16:43.702210 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2981/6008] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:43 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:44.721112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d5975c7a-c318-439b-9170-d1da85851a21 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:44.721738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d5975c7a-c318-439b-9170-d1da85851a21 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:44.724457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:44.743841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5975c7a-c318-439b-9170-d1da85851a21 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:44.744614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5975c7a-c318-439b-9170-d1da85851a21 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:44.745314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5975c7a-c318-439b-9170-d1da85851a21 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:44.746443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5975c7a-c318-439b-9170-d1da85851a21 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:44.747171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5975c7a-c318-439b-9170-d1da85851a21 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:44.748230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5975c7a-c318-439b-9170-d1da85851a21 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:44.977579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d5975c7a-c318-439b-9170-d1da85851a21 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:44.989188 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d5975c7a-c318-439b-9170-d1da85851a21 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.272588 Oct 29 03:16:44.990325 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3028/6009] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:44 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:46.017457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-48d22574-211b-4b6b-93fd-a715cfac2bae tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:46.018221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-48d22574-211b-4b6b-93fd-a715cfac2bae tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:46.035947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48d22574-211b-4b6b-93fd-a715cfac2bae tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:46.036457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48d22574-211b-4b6b-93fd-a715cfac2bae tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:46.042661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48d22574-211b-4b6b-93fd-a715cfac2bae tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:46.044163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48d22574-211b-4b6b-93fd-a715cfac2bae tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:46.044972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48d22574-211b-4b6b-93fd-a715cfac2bae tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:46.046775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-48d22574-211b-4b6b-93fd-a715cfac2bae tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:46.390906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-48d22574-211b-4b6b-93fd-a715cfac2bae tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:46.407147 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-48d22574-211b-4b6b-93fd-a715cfac2bae tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.397177 Oct 29 03:16:46.408562 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2982/6010] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:46 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:47.048903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-88d5a5c4-8d00-499b-9525-10e27a8b00fe tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:47.049271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-88d5a5c4-8d00-499b-9525-10e27a8b00fe tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:47.063924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d5a5c4-8d00-499b-9525-10e27a8b00fe tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:47.064434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d5a5c4-8d00-499b-9525-10e27a8b00fe tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:47.064877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d5a5c4-8d00-499b-9525-10e27a8b00fe tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:47.065607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d5a5c4-8d00-499b-9525-10e27a8b00fe tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:47.066090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d5a5c4-8d00-499b-9525-10e27a8b00fe tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:47.071160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d5a5c4-8d00-499b-9525-10e27a8b00fe tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:47.135215 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-88d5a5c4-8d00-499b-9525-10e27a8b00fe tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/ips" status: 200 len: 149 microversion: 2.1 time: 0.092580 Oct 29 03:16:47.139340 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3029/6011] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:16:47 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:47.436196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-72396818-b7d6-4d15-a58e-c655d527994a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:47.439592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-72396818-b7d6-4d15-a58e-c655d527994a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:47.454836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72396818-b7d6-4d15-a58e-c655d527994a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:47.455373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72396818-b7d6-4d15-a58e-c655d527994a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:47.456043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72396818-b7d6-4d15-a58e-c655d527994a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:47.457033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72396818-b7d6-4d15-a58e-c655d527994a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:47.457760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72396818-b7d6-4d15-a58e-c655d527994a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:47.458467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72396818-b7d6-4d15-a58e-c655d527994a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:47.952402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-72396818-b7d6-4d15-a58e-c655d527994a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:47.955395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:47.969400 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-72396818-b7d6-4d15-a58e-c655d527994a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1734 microversion: 2.1 time: 0.541754 Oct 29 03:16:47.970324 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2983/6012] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:47 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1734 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:49.027685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9280c5af-38fc-4465-956b-b3fee07346f0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:49.027685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9280c5af-38fc-4465-956b-b3fee07346f0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:49.027685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9280c5af-38fc-4465-956b-b3fee07346f0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:49.027685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9280c5af-38fc-4465-956b-b3fee07346f0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:49.027685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9280c5af-38fc-4465-956b-b3fee07346f0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:49.027685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9280c5af-38fc-4465-956b-b3fee07346f0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:49.027685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9280c5af-38fc-4465-956b-b3fee07346f0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:49.027685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9280c5af-38fc-4465-956b-b3fee07346f0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:49.449024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9280c5af-38fc-4465-956b-b3fee07346f0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:49.490647 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9280c5af-38fc-4465-956b-b3fee07346f0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1714 microversion: 2.1 time: 0.493721 Oct 29 03:16:49.491276 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3030/6013] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:48 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1714 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:49.716735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:49.717520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:49.731257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=34 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:49.755688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:49.769181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:49.772429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:49.786265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:49.786880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:49.787323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:50.055449 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] HTTP exception thrown: Cannot 'detach_volume' instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 while it is in vm_state rescued Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Request method failure captured: Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments/d88063cb-1ab2-49f3-8afc-f0a34e6df32b HTTP/1.1 Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJpRn_7hoOfvObzqA-ZLLdT0Ldg_y6elYIAF6FaT28sdj-TKjsGF45L6GmeVGfwMnSs4H8JoHZrc7By31zLGvou-MnR3pglqzR_y5cbEOWkNw533fNI-OxPHdxTNrRl2C5LEagXcPpESr9s5MAeq27S7NZgAah_V7oaKcjpRtmQEpM8 Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_552af5aaae3f49fdb5cc8ea8ec4ccdec", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}] Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 89a693133ded46eba2b9b70e899f38f9 Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: exception: Cannot 'detach_volume' instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 while it is in vm_state rescued Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'server_id': 'cc2c36c2-406c-4847-ae8d-3fbd334c9039', 'id': 'd88063cb-1ab2-49f3-8afc-f0a34e6df32b'} Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 while it is in vm_state rescued Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:16:50.057476 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:16:50.062362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:16:50.062362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:16:50.062362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:16:50.062362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:16:50.062362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 while it is in vm_state rescued Oct 29 03:16:50.062362 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:16:50.062362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Returning 409 to user: Cannot 'detach_volume' instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 while it is in vm_state rescued {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:16:50.065102 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18f1b295-569b-41bd-b767-891dd31b2823 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments/d88063cb-1ab2-49f3-8afc-f0a34e6df32b" status: 409 len: 152 microversion: 2.1 time: 0.346502 Oct 29 03:16:50.067692 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2984/6014] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:16:49 2022] DELETE /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments/d88063cb-1ab2-49f3-8afc-f0a34e6df32b => generated 152 bytes in 356 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:16:50.078201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-550a5aff-ad3d-48af-a734-f4cf4513379f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:50.083914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-550a5aff-ad3d-48af-a734-f4cf4513379f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:50.097868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-550a5aff-ad3d-48af-a734-f4cf4513379f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:50.098369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-550a5aff-ad3d-48af-a734-f4cf4513379f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:50.098806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-550a5aff-ad3d-48af-a734-f4cf4513379f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:50.104382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-550a5aff-ad3d-48af-a734-f4cf4513379f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:50.123832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-550a5aff-ad3d-48af-a734-f4cf4513379f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:50.129601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-550a5aff-ad3d-48af-a734-f4cf4513379f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:50.229158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5e832f9f-74bf-485f-a114-b932723d7d26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e35728a0-3bb8-4c99-a907-2082d7a1a689"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:50.232113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5e832f9f-74bf-485f-a114-b932723d7d26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:50.247054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e832f9f-74bf-485f-a114-b932723d7d26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:50.247979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e832f9f-74bf-485f-a114-b932723d7d26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:50.250189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e832f9f-74bf-485f-a114-b932723d7d26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:50.251815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e832f9f-74bf-485f-a114-b932723d7d26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:50.252361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e832f9f-74bf-485f-a114-b932723d7d26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:50.254371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e832f9f-74bf-485f-a114-b932723d7d26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:50.380324 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-550a5aff-ad3d-48af-a734-f4cf4513379f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/action" status: 202 len: 0 microversion: 2.1 time: 0.309401 Oct 29 03:16:50.381029 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3031/6015] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:16:50 2022] POST /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:16:50.391991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d936370b-26a1-47a6-8372-3460ada7ef60 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:50.393050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d936370b-26a1-47a6-8372-3460ada7ef60 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:50.405359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d936370b-26a1-47a6-8372-3460ada7ef60 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:50.407705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d936370b-26a1-47a6-8372-3460ada7ef60 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:50.408513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d936370b-26a1-47a6-8372-3460ada7ef60 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:50.412895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d936370b-26a1-47a6-8372-3460ada7ef60 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:50.413795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d936370b-26a1-47a6-8372-3460ada7ef60 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:50.414523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d936370b-26a1-47a6-8372-3460ada7ef60 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:51.004107 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5e832f9f-74bf-485f-a114-b932723d7d26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780537 Oct 29 03:16:51.027543 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2985/6016] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:16:50 2022] POST /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:16:51.178060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d936370b-26a1-47a6-8372-3460ada7ef60 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:51.198447 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d936370b-26a1-47a6-8372-3460ada7ef60 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1722 microversion: 2.1 time: 0.811071 Oct 29 03:16:51.215911 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3032/6017] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:50 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1722 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:52.237119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cd8c1ba6-3bc1-4eee-9ac4-acb97be27a22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:52.239680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cd8c1ba6-3bc1-4eee-9ac4-acb97be27a22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:52.279746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd8c1ba6-3bc1-4eee-9ac4-acb97be27a22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:52.283067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd8c1ba6-3bc1-4eee-9ac4-acb97be27a22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:52.285154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd8c1ba6-3bc1-4eee-9ac4-acb97be27a22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:52.285874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd8c1ba6-3bc1-4eee-9ac4-acb97be27a22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:52.291163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd8c1ba6-3bc1-4eee-9ac4-acb97be27a22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:52.291914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd8c1ba6-3bc1-4eee-9ac4-acb97be27a22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:52.779864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cd8c1ba6-3bc1-4eee-9ac4-acb97be27a22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:52.805456 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cd8c1ba6-3bc1-4eee-9ac4-acb97be27a22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1722 microversion: 2.1 time: 0.574669 Oct 29 03:16:52.806653 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2986/6018] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:52 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1722 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:16:53.135440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ed253122-01e3-4048-b53a-2e31c2378163 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:53.137793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ed253122-01e3-4048-b53a-2e31c2378163 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:53.153142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed253122-01e3-4048-b53a-2e31c2378163 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:53.153559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed253122-01e3-4048-b53a-2e31c2378163 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:53.154223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed253122-01e3-4048-b53a-2e31c2378163 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:53.155141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed253122-01e3-4048-b53a-2e31c2378163 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:53.155599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed253122-01e3-4048-b53a-2e31c2378163 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:53.156024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed253122-01e3-4048-b53a-2e31c2378163 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:53.193482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:53.832029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bdf233dd-c844-4757-8db9-42657239afef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:53.832947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bdf233dd-c844-4757-8db9-42657239afef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:53.848809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf233dd-c844-4757-8db9-42657239afef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:53.849313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf233dd-c844-4757-8db9-42657239afef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:53.849755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf233dd-c844-4757-8db9-42657239afef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:53.850505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf233dd-c844-4757-8db9-42657239afef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:53.850958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf233dd-c844-4757-8db9-42657239afef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:53.851378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bdf233dd-c844-4757-8db9-42657239afef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:54.036720 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ed253122-01e3-4048-b53a-2e31c2378163 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "POST /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc/action" status: 200 len: 24562 microversion: 2.1 time: 0.905086 Oct 29 03:16:54.037592 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3033/6019] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:16:53 2022] POST /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc/action => generated 24562 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:16:54.597504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bdf233dd-c844-4757-8db9-42657239afef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:54.623781 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bdf233dd-c844-4757-8db9-42657239afef tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1722 microversion: 2.1 time: 0.795596 Oct 29 03:16:54.633947 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2987/6020] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:53 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1722 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:16:55.657008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b44a9d90-d0d1-4325-b80b-7792c80fb43b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:55.657988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b44a9d90-d0d1-4325-b80b-7792c80fb43b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:55.666534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b44a9d90-d0d1-4325-b80b-7792c80fb43b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:55.667271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b44a9d90-d0d1-4325-b80b-7792c80fb43b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:55.667920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b44a9d90-d0d1-4325-b80b-7792c80fb43b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:55.669573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b44a9d90-d0d1-4325-b80b-7792c80fb43b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:55.670353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b44a9d90-d0d1-4325-b80b-7792c80fb43b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:55.670964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b44a9d90-d0d1-4325-b80b-7792c80fb43b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:55.885992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b44a9d90-d0d1-4325-b80b-7792c80fb43b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:55.898873 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b44a9d90-d0d1-4325-b80b-7792c80fb43b tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1728 microversion: 2.1 time: 0.246366 Oct 29 03:16:55.899997 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3034/6021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:55 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1728 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:55.927840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b891939-1ca7-42cc-b257-5477d067e51d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:55.928339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6b891939-1ca7-42cc-b257-5477d067e51d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:55.937160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b891939-1ca7-42cc-b257-5477d067e51d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:55.938349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b891939-1ca7-42cc-b257-5477d067e51d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:55.938854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b891939-1ca7-42cc-b257-5477d067e51d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:55.939815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b891939-1ca7-42cc-b257-5477d067e51d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:55.940349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b891939-1ca7-42cc-b257-5477d067e51d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:55.940900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b891939-1ca7-42cc-b257-5477d067e51d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:56.176155 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b891939-1ca7-42cc-b257-5477d067e51d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.254496 Oct 29 03:16:56.177616 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2988/6022] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:16:55 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-interface => generated 285 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:59.481653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e6ed8f0e-9c5a-4054-8011-31ffcc89c00b req-ebca2e27-56aa-4312-bb90-344c84c4132b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2c36c2-406c-4847-ae8d-3fbd334c9039", "tag": "54901416-0c67-44c6-a0aa-ed5d4e84ca7e"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:59.523929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e6ed8f0e-9c5a-4054-8011-31ffcc89c00b req-ebca2e27-56aa-4312-bb90-344c84c4132b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:59.527958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e6ed8f0e-9c5a-4054-8011-31ffcc89c00b req-ebca2e27-56aa-4312-bb90-344c84c4132b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:59.541367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e6ed8f0e-9c5a-4054-8011-31ffcc89c00b req-ebca2e27-56aa-4312-bb90-344c84c4132b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:59.576294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e6ed8f0e-9c5a-4054-8011-31ffcc89c00b req-ebca2e27-56aa-4312-bb90-344c84c4132b service nova] Creating event network-changed:54901416-0c67-44c6-a0aa-ed5d4e84ca7e for instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 on n-h1-862964-4 Oct 29 03:16:59.591945 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e6ed8f0e-9c5a-4054-8011-31ffcc89c00b req-ebca2e27-56aa-4312-bb90-344c84c4132b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411007 Oct 29 03:16:59.596928 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3035/6023] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:01.617682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-41c19e87-dc44-4e13-b6c1-01083ed388a7 req-7f9e8da2-506a-493b-bd3e-a01111e4b55f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2c36c2-406c-4847-ae8d-3fbd334c9039", "tag": "54901416-0c67-44c6-a0aa-ed5d4e84ca7e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:01.638147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-41c19e87-dc44-4e13-b6c1-01083ed388a7 req-7f9e8da2-506a-493b-bd3e-a01111e4b55f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:01.638725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-41c19e87-dc44-4e13-b6c1-01083ed388a7 req-7f9e8da2-506a-493b-bd3e-a01111e4b55f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:01.639223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-41c19e87-dc44-4e13-b6c1-01083ed388a7 req-7f9e8da2-506a-493b-bd3e-a01111e4b55f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:01.696398 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-41c19e87-dc44-4e13-b6c1-01083ed388a7 req-7f9e8da2-506a-493b-bd3e-a01111e4b55f service nova] Creating event network-changed:54901416-0c67-44c6-a0aa-ed5d4e84ca7e for instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 on n-h1-862964-4 Oct 29 03:17:01.702798 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-41c19e87-dc44-4e13-b6c1-01083ed388a7 req-7f9e8da2-506a-493b-bd3e-a01111e4b55f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091217 Oct 29 03:17:01.704000 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2989/6024] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:04.390331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1254123953", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:04.459222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:17:04.929164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:17:04.930059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:17:04.931174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:17:04.932213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:17:04.934003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:17:04.954428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:04.955163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:04.955758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:04.956721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:04.957352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:04.958656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:04.983644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Getting quotas for project 738337cc190644dcb6ac88db4d0994aa. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:17:04.991393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Getting quotas for user 42be58e511bc4f27aba89c886e479d5f and project 738337cc190644dcb6ac88db4d0994aa. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:17:05.010342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:17:05.014119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:17:05.105505 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a4939d2a-ccc2-4293-9eb5-43b30d2b1f9d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721457 Oct 29 03:17:05.116992 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3036/6025] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:17:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:17:05.125789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bcfbf81d-6480-4cc8-960e-e55e3c5c0574 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:05.127296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bcfbf81d-6480-4cc8-960e-e55e3c5c0574 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:05.358404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bcfbf81d-6480-4cc8-960e-e55e3c5c0574 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:05.371269 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bcfbf81d-6480-4cc8-960e-e55e3c5c0574 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1215 microversion: 2.1 time: 0.251498 Oct 29 03:17:05.387517 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2990/6026] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:05 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:06.409012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-01e8a490-89bd-4680-b5fd-4cc673d597f2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:06.410458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-01e8a490-89bd-4680-b5fd-4cc673d597f2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:06.796626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7f516285-5188-4b95-bc9e-d9633b6aa63d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Action: 'create', calling method: .version_select at 0x7fe1a3fda3a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1734719945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLP2eVlQcbcq9QXF09U0t6a5/iKpEOCt8g0eti+MQOW4Fz/TsCbgvQoEBwuYmja8NRcEEbHlaI+lW6PUVM96WkG1dCaXXLZrFp1OgZjyOC2hbNwP4YwMBe7d17qZs2FBg=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:06.838855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-7f516285-5188-4b95-bc9e-d9633b6aa63d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:17:06.859438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-7f516285-5188-4b95-bc9e-d9633b6aa63d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for user 29f3383c209340adb16a7074c291b191 and project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:17:06.877960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-01e8a490-89bd-4680-b5fd-4cc673d597f2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:06.886953 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-01e8a490-89bd-4680-b5fd-4cc673d597f2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1215 microversion: 2.1 time: 0.487761 Oct 29 03:17:06.899498 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3037/6027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:06 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1215 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:06.910146 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7f516285-5188-4b95-bc9e-d9633b6aa63d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.117604 Oct 29 03:17:06.910765 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2991/6028] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:17:06 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:17:07.916679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-568f455d-74be-4f57-b805-af42d54797cc tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:07.921403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-568f455d-74be-4f57-b805-af42d54797cc tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:07.948413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-568f455d-74be-4f57-b805-af42d54797cc tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:07.951809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-568f455d-74be-4f57-b805-af42d54797cc tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:07.952905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-568f455d-74be-4f57-b805-af42d54797cc tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:07.955152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-568f455d-74be-4f57-b805-af42d54797cc tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:07.955889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-568f455d-74be-4f57-b805-af42d54797cc tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:07.958961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-568f455d-74be-4f57-b805-af42d54797cc tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:08.158184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a8c4a0e-44a6-4bf1-b23b-d859a7b1aa53 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: .version_select at 0x7fe1a85c3d30>, body: {"keypair": {"name": "tempest-keypair-2006241641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUwqyRVRP52w54O3C92OWVv7+9c3aEemQNPnDj9W2aJDMTxwHDMF/uPDtAq4UYfd7rLW2h+afw4y7m9iXs07gdodtaG5DqC12cLQrh+9IpsG1Ym1pejjqf+eb7qzeAHYA=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:08.178443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6a8c4a0e-44a6-4bf1-b23b-d859a7b1aa53 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for project b9abafce931f45438286305af9b7a64a. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:17:08.184799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6a8c4a0e-44a6-4bf1-b23b-d859a7b1aa53 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for user d2867c5be8974c028f933d1c8fe2c2fa and project b9abafce931f45438286305af9b7a64a. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:17:08.226633 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a8c4a0e-44a6-4bf1-b23b-d859a7b1aa53 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075166 Oct 29 03:17:08.228145 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2992/6029] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:17:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:08.253473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-568f455d-74be-4f57-b805-af42d54797cc tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:08.266695 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-568f455d-74be-4f57-b805-af42d54797cc tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1275 microversion: 2.1 time: 0.359905 Oct 29 03:17:08.270903 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3038/6030] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:07 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1275 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:09.297510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18422856-6b0a-4d56-9080-e1270444d79c tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:09.298864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18422856-6b0a-4d56-9080-e1270444d79c tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:09.315049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18422856-6b0a-4d56-9080-e1270444d79c tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:09.317155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18422856-6b0a-4d56-9080-e1270444d79c tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:09.318612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18422856-6b0a-4d56-9080-e1270444d79c tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:09.321315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18422856-6b0a-4d56-9080-e1270444d79c tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:09.322327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18422856-6b0a-4d56-9080-e1270444d79c tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:09.324656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18422856-6b0a-4d56-9080-e1270444d79c tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:09.506251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18422856-6b0a-4d56-9080-e1270444d79c tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:09.523569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1646140954", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "45dbb054-ab9f-44e7-aed9-260588843129"}], "key_name": "tempest-TestNetworkBasicOps-1734719945", "security_groups": [{"name": "tempest-secgroup-smoke-1164101872"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:09.529836 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18422856-6b0a-4d56-9080-e1270444d79c tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1273 microversion: 2.1 time: 0.235897 Oct 29 03:17:09.554618 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2993/6031] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:09 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:09.834202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] validate_networks() for [('45dbb054-ab9f-44e7-aed9-260588843129', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:17:10.564172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f1148d96-64b4-417e-a38d-c31b29ebb4a8 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:10.564695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f1148d96-64b4-417e-a38d-c31b29ebb4a8 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:10.580164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1148d96-64b4-417e-a38d-c31b29ebb4a8 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:10.583485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1148d96-64b4-417e-a38d-c31b29ebb4a8 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:10.585082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1148d96-64b4-417e-a38d-c31b29ebb4a8 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:10.587439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1148d96-64b4-417e-a38d-c31b29ebb4a8 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:10.588155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1148d96-64b4-417e-a38d-c31b29ebb4a8 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:10.589360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f1148d96-64b4-417e-a38d-c31b29ebb4a8 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:10.817210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f1148d96-64b4-417e-a38d-c31b29ebb4a8 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:10.830058 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f1148d96-64b4-417e-a38d-c31b29ebb4a8 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1273 microversion: 2.1 time: 0.270970 Oct 29 03:17:10.839775 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2994/6032] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:10 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1273 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:11.269590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1217863838", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd1396d1-98cd-4d89-ada5-9f148b567381"}], "security_groups": [{"name": "tempest-securitygroup--314581603"}], "key_name": "tempest-keypair-2006241641", "user_data": "}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:11.566444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] validate_networks() for [('cd1396d1-98cd-4d89-ada5-9f148b567381', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:17:11.713355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:17:11.714377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:17:11.715055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:17:11.715624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:17:11.716424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:17:11.736194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:11.737013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:11.737606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:11.738568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:11.739219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:11.739835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:11.801374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:17:11.815322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for user 29f3383c209340adb16a7074c291b191 and project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:17:11.833296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:17:11.836513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:17:11.962741 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-32633432-fa90-48eb-a015-d0887ee552b6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.440710 Oct 29 03:17:11.970871 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3039/6033] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:17:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 2453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:17:11.976325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d9dd6c28-07a6-4ca9-a094-4af34fddaaeb tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:11.977258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d9dd6c28-07a6-4ca9-a094-4af34fddaaeb tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:11.985896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9dd6c28-07a6-4ca9-a094-4af34fddaaeb tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:11.986577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9dd6c28-07a6-4ca9-a094-4af34fddaaeb tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:11.987364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9dd6c28-07a6-4ca9-a094-4af34fddaaeb tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:11.988248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9dd6c28-07a6-4ca9-a094-4af34fddaaeb tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:11.989437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9dd6c28-07a6-4ca9-a094-4af34fddaaeb tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:11.990057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d9dd6c28-07a6-4ca9-a094-4af34fddaaeb tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:12.289412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d9dd6c28-07a6-4ca9-a094-4af34fddaaeb tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:12.302812 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d9dd6c28-07a6-4ca9-a094-4af34fddaaeb tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1315 microversion: 2.1 time: 0.328948 Oct 29 03:17:12.305143 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3040/6034] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:11 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:12.331584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c11684cd-2668-4937-962a-d83c9be5dcfa tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:12.337287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c11684cd-2668-4937-962a-d83c9be5dcfa tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:12.464404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c11684cd-2668-4937-962a-d83c9be5dcfa tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:12.473246 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c11684cd-2668-4937-962a-d83c9be5dcfa tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1249 microversion: 2.1 time: 0.165940 Oct 29 03:17:12.473624 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3041/6035] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:12 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1249 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:12.989726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:17:12.990244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:17:12.990817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:17:12.991299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:17:12.991779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:17:13.010520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:13.011126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:13.011636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:13.012900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:13.015835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:13.016545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:13.052885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for project b9abafce931f45438286305af9b7a64a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:17:13.059541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for user d2867c5be8974c028f933d1c8fe2c2fa and project b9abafce931f45438286305af9b7a64a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:17:13.077842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:17:13.081682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:17:13.138247 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8bfecccb-35bd-4550-93ab-e0eb7fe7c5b7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.874542 Oct 29 03:17:13.139784 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2995/6036] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:17:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:17:13.151583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-28c7f7f3-9934-464d-a38a-262ffbdca0f1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:13.152927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-28c7f7f3-9934-464d-a38a-262ffbdca0f1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:13.296336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-28c7f7f3-9934-464d-a38a-262ffbdca0f1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:13.323415 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-28c7f7f3-9934-464d-a38a-262ffbdca0f1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1242 microversion: 2.1 time: 0.175763 Oct 29 03:17:13.328487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9645a8a2-4ff4-4b8c-8482-6e9c3acd621f tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:13.329493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9645a8a2-4ff4-4b8c-8482-6e9c3acd621f tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:13.340167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9645a8a2-4ff4-4b8c-8482-6e9c3acd621f tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:13.340669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9645a8a2-4ff4-4b8c-8482-6e9c3acd621f tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:13.341157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9645a8a2-4ff4-4b8c-8482-6e9c3acd621f tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:13.342905 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3042/6037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:13 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1242 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:13.343644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9645a8a2-4ff4-4b8c-8482-6e9c3acd621f tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:13.344173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9645a8a2-4ff4-4b8c-8482-6e9c3acd621f tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:13.346057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9645a8a2-4ff4-4b8c-8482-6e9c3acd621f tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:13.401078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-2f47d366-70be-473e-b4b9-5bf2b6a6851f req-f0228f04-7b94-4af5-a731-0eae47729bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d903395-bfec-4058-ad40-0d4816da0f23", "tag": "3945a8a5-d936-4950-b5da-a5caf20af3b0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:13.446574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2f47d366-70be-473e-b4b9-5bf2b6a6851f req-f0228f04-7b94-4af5-a731-0eae47729bfa service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:13.451399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2f47d366-70be-473e-b4b9-5bf2b6a6851f req-f0228f04-7b94-4af5-a731-0eae47729bfa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:13.452130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2f47d366-70be-473e-b4b9-5bf2b6a6851f req-f0228f04-7b94-4af5-a731-0eae47729bfa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:13.465795 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-2f47d366-70be-473e-b4b9-5bf2b6a6851f req-f0228f04-7b94-4af5-a731-0eae47729bfa service nova] Creating event network-changed:3945a8a5-d936-4950-b5da-a5caf20af3b0 for instance 3d903395-bfec-4058-ad40-0d4816da0f23 on n-h2-862964-4 Oct 29 03:17:13.475542 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-2f47d366-70be-473e-b4b9-5bf2b6a6851f req-f0228f04-7b94-4af5-a731-0eae47729bfa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113246 Oct 29 03:17:13.478199 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3043/6038] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:13.497586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5543640f-47af-4910-8880-c040852d093d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:13.498411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5543640f-47af-4910-8880-c040852d093d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:13.519254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5543640f-47af-4910-8880-c040852d093d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:13.519856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5543640f-47af-4910-8880-c040852d093d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:13.520306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5543640f-47af-4910-8880-c040852d093d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:13.521057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5543640f-47af-4910-8880-c040852d093d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:13.521505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5543640f-47af-4910-8880-c040852d093d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:13.526805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5543640f-47af-4910-8880-c040852d093d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:13.627175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5543640f-47af-4910-8880-c040852d093d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:13.639585 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5543640f-47af-4910-8880-c040852d093d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1301 microversion: 2.1 time: 0.146248 Oct 29 03:17:13.672362 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3044/6039] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:13 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1301 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:13.914085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9645a8a2-4ff4-4b8c-8482-6e9c3acd621f tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:13.940180 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9645a8a2-4ff4-4b8c-8482-6e9c3acd621f tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1315 microversion: 2.1 time: 0.616140 Oct 29 03:17:13.940911 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2996/6040] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:13 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:14.353007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b577773-d4ea-47da-ad53-3113382558f4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:14.353792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b577773-d4ea-47da-ad53-3113382558f4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:14.362594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b577773-d4ea-47da-ad53-3113382558f4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:14.363948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b577773-d4ea-47da-ad53-3113382558f4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:14.365106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b577773-d4ea-47da-ad53-3113382558f4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:14.369678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b577773-d4ea-47da-ad53-3113382558f4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:14.370467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b577773-d4ea-47da-ad53-3113382558f4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:14.372285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b577773-d4ea-47da-ad53-3113382558f4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:14.486652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9b577773-d4ea-47da-ad53-3113382558f4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:14.496889 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b577773-d4ea-47da-ad53-3113382558f4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1294 microversion: 2.1 time: 0.147460 Oct 29 03:17:14.498185 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3045/6041] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:14 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1294 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:14.700410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3f2b6fd9-ae00-4b6f-b331-e95b6c1d6c35 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:14.702099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3f2b6fd9-ae00-4b6f-b331-e95b6c1d6c35 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:14.713661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fd9-ae00-4b6f-b331-e95b6c1d6c35 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:14.714988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fd9-ae00-4b6f-b331-e95b6c1d6c35 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:14.717064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fd9-ae00-4b6f-b331-e95b6c1d6c35 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:14.718785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fd9-ae00-4b6f-b331-e95b6c1d6c35 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:14.719756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fd9-ae00-4b6f-b331-e95b6c1d6c35 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:14.720698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f2b6fd9-ae00-4b6f-b331-e95b6c1d6c35 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:14.844335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3f2b6fd9-ae00-4b6f-b331-e95b6c1d6c35 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:14.853099 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3f2b6fd9-ae00-4b6f-b331-e95b6c1d6c35 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1307 microversion: 2.1 time: 0.160471 Oct 29 03:17:14.854029 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2997/6042] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:14 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:14.965042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da7ac167-c88b-4395-986a-9642aa2b0bb2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:14.966035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-da7ac167-c88b-4395-986a-9642aa2b0bb2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:14.975569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:14.978550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da7ac167-c88b-4395-986a-9642aa2b0bb2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:14.982344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da7ac167-c88b-4395-986a-9642aa2b0bb2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:14.984514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da7ac167-c88b-4395-986a-9642aa2b0bb2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:14.986545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da7ac167-c88b-4395-986a-9642aa2b0bb2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:14.987375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da7ac167-c88b-4395-986a-9642aa2b0bb2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:14.989587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da7ac167-c88b-4395-986a-9642aa2b0bb2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:15.347927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-da7ac167-c88b-4395-986a-9642aa2b0bb2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:15.365751 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-da7ac167-c88b-4395-986a-9642aa2b0bb2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1315 microversion: 2.1 time: 0.405042 Oct 29 03:17:15.368202 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3046/6043] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:14 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:15.520772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-35f46d3a-5a9c-462a-a437-749c1092e52b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:15.522498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-35f46d3a-5a9c-462a-a437-749c1092e52b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:15.539031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35f46d3a-5a9c-462a-a437-749c1092e52b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:15.539751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35f46d3a-5a9c-462a-a437-749c1092e52b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:15.540462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35f46d3a-5a9c-462a-a437-749c1092e52b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:15.541327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35f46d3a-5a9c-462a-a437-749c1092e52b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:15.542483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35f46d3a-5a9c-462a-a437-749c1092e52b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:15.543078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35f46d3a-5a9c-462a-a437-749c1092e52b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:15.656853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-35f46d3a-5a9c-462a-a437-749c1092e52b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:15.675365 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-35f46d3a-5a9c-462a-a437-749c1092e52b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1300 microversion: 2.1 time: 0.154898 Oct 29 03:17:15.676239 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2998/6044] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:15 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1300 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:15.877739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8135fdfa-7ec7-4b7c-b036-c9fbc228dc46 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:15.878586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8135fdfa-7ec7-4b7c-b036-c9fbc228dc46 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:15.889941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8135fdfa-7ec7-4b7c-b036-c9fbc228dc46 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:15.892685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8135fdfa-7ec7-4b7c-b036-c9fbc228dc46 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:15.893340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8135fdfa-7ec7-4b7c-b036-c9fbc228dc46 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:15.895995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8135fdfa-7ec7-4b7c-b036-c9fbc228dc46 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:15.896492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8135fdfa-7ec7-4b7c-b036-c9fbc228dc46 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:15.896923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8135fdfa-7ec7-4b7c-b036-c9fbc228dc46 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:16.045760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8135fdfa-7ec7-4b7c-b036-c9fbc228dc46 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:16.057647 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8135fdfa-7ec7-4b7c-b036-c9fbc228dc46 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1307 microversion: 2.1 time: 0.184062 Oct 29 03:17:16.058952 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3047/6045] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:15 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:16.402194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e01cfda-9c9f-4b03-8580-e877eed7d4d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:16.405284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e01cfda-9c9f-4b03-8580-e877eed7d4d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:16.428927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e01cfda-9c9f-4b03-8580-e877eed7d4d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:16.430158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e01cfda-9c9f-4b03-8580-e877eed7d4d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:16.430881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e01cfda-9c9f-4b03-8580-e877eed7d4d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:16.432325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e01cfda-9c9f-4b03-8580-e877eed7d4d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:16.432927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e01cfda-9c9f-4b03-8580-e877eed7d4d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:16.433532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e01cfda-9c9f-4b03-8580-e877eed7d4d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:16.704842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7026d647-642b-4d62-88bd-7f86c59d0aa6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:16.705470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7026d647-642b-4d62-88bd-7f86c59d0aa6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:16.719988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7026d647-642b-4d62-88bd-7f86c59d0aa6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:16.723396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7026d647-642b-4d62-88bd-7f86c59d0aa6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:16.723396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7026d647-642b-4d62-88bd-7f86c59d0aa6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:16.735030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7026d647-642b-4d62-88bd-7f86c59d0aa6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:16.735988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7026d647-642b-4d62-88bd-7f86c59d0aa6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:16.736845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7026d647-642b-4d62-88bd-7f86c59d0aa6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:16.785044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2e01cfda-9c9f-4b03-8580-e877eed7d4d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:16.793469 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e01cfda-9c9f-4b03-8580-e877eed7d4d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1315 microversion: 2.1 time: 0.397885 Oct 29 03:17:16.819887 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 2999/6046] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:16 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:17.087375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0642aeb6-98a7-474e-bb86-e64edb601657 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:17.088205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0642aeb6-98a7-474e-bb86-e64edb601657 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:17.099259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0642aeb6-98a7-474e-bb86-e64edb601657 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:17.099853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0642aeb6-98a7-474e-bb86-e64edb601657 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:17.100628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0642aeb6-98a7-474e-bb86-e64edb601657 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:17.102211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0642aeb6-98a7-474e-bb86-e64edb601657 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:17.104603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0642aeb6-98a7-474e-bb86-e64edb601657 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:17.105284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0642aeb6-98a7-474e-bb86-e64edb601657 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:17.703407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7026d647-642b-4d62-88bd-7f86c59d0aa6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:17.712670 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7026d647-642b-4d62-88bd-7f86c59d0aa6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1367 microversion: 2.1 time: 1.013333 Oct 29 03:17:17.724968 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3048/6047] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:16 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1367 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:17.819325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0642aeb6-98a7-474e-bb86-e64edb601657 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:17.823446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e63b528d-92cb-4e31-9524-26292cbf059e tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:17.824066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e63b528d-92cb-4e31-9524-26292cbf059e tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:17.833469 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0642aeb6-98a7-474e-bb86-e64edb601657 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1375 microversion: 2.1 time: 0.750435 Oct 29 03:17:17.839958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63b528d-92cb-4e31-9524-26292cbf059e tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:17.840423 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3000/6048] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:17 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1375 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:17.841196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63b528d-92cb-4e31-9524-26292cbf059e tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:17.844832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63b528d-92cb-4e31-9524-26292cbf059e tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:17.845916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63b528d-92cb-4e31-9524-26292cbf059e tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:17.846607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63b528d-92cb-4e31-9524-26292cbf059e tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:17.847252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e63b528d-92cb-4e31-9524-26292cbf059e tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:18.335902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-0ec66529-7b54-4fa2-b85d-e2a1b268cf52 req-7f1f7330-8eba-4103-b96b-6cb0f173ed47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a940222-301e-49c9-a1ed-4c8bcce9eb0c", "tag": "9e2c3995-42d3-4817-825b-8fb0a1d7d939"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:18.361961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0ec66529-7b54-4fa2-b85d-e2a1b268cf52 req-7f1f7330-8eba-4103-b96b-6cb0f173ed47 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:18.362565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0ec66529-7b54-4fa2-b85d-e2a1b268cf52 req-7f1f7330-8eba-4103-b96b-6cb0f173ed47 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:18.363076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0ec66529-7b54-4fa2-b85d-e2a1b268cf52 req-7f1f7330-8eba-4103-b96b-6cb0f173ed47 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:18.366141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:18.403623 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-0ec66529-7b54-4fa2-b85d-e2a1b268cf52 req-7f1f7330-8eba-4103-b96b-6cb0f173ed47 service nova] Creating event network-changed:9e2c3995-42d3-4817-825b-8fb0a1d7d939 for instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c on n-h1-862964-4 Oct 29 03:17:18.415297 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-0ec66529-7b54-4fa2-b85d-e2a1b268cf52 req-7f1f7330-8eba-4103-b96b-6cb0f173ed47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090292 Oct 29 03:17:18.419551 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3001/6049] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:18.575904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e63b528d-92cb-4e31-9524-26292cbf059e tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:18.584553 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e63b528d-92cb-4e31-9524-26292cbf059e tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1315 microversion: 2.1 time: 0.771084 Oct 29 03:17:18.592218 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3049/6050] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:17 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:18.745892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-363a538e-a4b5-476b-98b2-993b34781c85 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:18.747157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-363a538e-a4b5-476b-98b2-993b34781c85 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:18.787200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-363a538e-a4b5-476b-98b2-993b34781c85 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:18.787719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-363a538e-a4b5-476b-98b2-993b34781c85 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:18.788148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-363a538e-a4b5-476b-98b2-993b34781c85 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:18.794405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-363a538e-a4b5-476b-98b2-993b34781c85 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:18.794898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-363a538e-a4b5-476b-98b2-993b34781c85 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:18.795350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-363a538e-a4b5-476b-98b2-993b34781c85 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:18.857563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ae96084b-4723-43a4-9eae-bb3ca95e3b02 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:18.858281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ae96084b-4723-43a4-9eae-bb3ca95e3b02 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:18.874504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae96084b-4723-43a4-9eae-bb3ca95e3b02 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:18.879302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae96084b-4723-43a4-9eae-bb3ca95e3b02 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:18.881432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae96084b-4723-43a4-9eae-bb3ca95e3b02 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:18.883603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae96084b-4723-43a4-9eae-bb3ca95e3b02 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:18.888572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae96084b-4723-43a4-9eae-bb3ca95e3b02 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:18.889082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ae96084b-4723-43a4-9eae-bb3ca95e3b02 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:19.149899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-363a538e-a4b5-476b-98b2-993b34781c85 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:19.160895 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-363a538e-a4b5-476b-98b2-993b34781c85 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1367 microversion: 2.1 time: 0.423506 Oct 29 03:17:19.165097 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3002/6051] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:18 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:19.623843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cef5dff6-623c-4d1c-8eda-0d47bf428f7d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:19.624460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cef5dff6-623c-4d1c-8eda-0d47bf428f7d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:19.645490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cef5dff6-623c-4d1c-8eda-0d47bf428f7d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:19.646309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cef5dff6-623c-4d1c-8eda-0d47bf428f7d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:19.646900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cef5dff6-623c-4d1c-8eda-0d47bf428f7d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:19.647912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cef5dff6-623c-4d1c-8eda-0d47bf428f7d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:19.648517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cef5dff6-623c-4d1c-8eda-0d47bf428f7d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:19.649382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cef5dff6-623c-4d1c-8eda-0d47bf428f7d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:19.960267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cef5dff6-623c-4d1c-8eda-0d47bf428f7d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:19.970357 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cef5dff6-623c-4d1c-8eda-0d47bf428f7d tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1315 microversion: 2.1 time: 0.359182 Oct 29 03:17:19.971765 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3003/6052] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:19 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:20.206189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ae96084b-4723-43a4-9eae-bb3ca95e3b02 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:20.229161 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ae96084b-4723-43a4-9eae-bb3ca95e3b02 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1375 microversion: 2.1 time: 1.375417 Oct 29 03:17:20.231878 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3050/6053] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:18 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1375 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:20.252596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bcd3510-2239-47e3-9d49-658bb621cc2a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:20.253575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bcd3510-2239-47e3-9d49-658bb621cc2a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:20.262145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcd3510-2239-47e3-9d49-658bb621cc2a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:20.262730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcd3510-2239-47e3-9d49-658bb621cc2a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:20.263277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcd3510-2239-47e3-9d49-658bb621cc2a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:20.268542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcd3510-2239-47e3-9d49-658bb621cc2a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:20.270820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcd3510-2239-47e3-9d49-658bb621cc2a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:20.271429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bcd3510-2239-47e3-9d49-658bb621cc2a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:20.316455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4738a178-8ffe-4926-ab1a-4b87f52f3762 req-d1f99b69-4db6-41b5-ba29-cd296f396aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d903395-bfec-4058-ad40-0d4816da0f23", "name": "network-vif-plugged", "status": "completed", "tag": "3945a8a5-d936-4950-b5da-a5caf20af3b0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:20.322060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=5 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:20.332287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4738a178-8ffe-4926-ab1a-4b87f52f3762 req-d1f99b69-4db6-41b5-ba29-cd296f396aea service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:20.332910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4738a178-8ffe-4926-ab1a-4b87f52f3762 req-d1f99b69-4db6-41b5-ba29-cd296f396aea service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:20.334367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4738a178-8ffe-4926-ab1a-4b87f52f3762 req-d1f99b69-4db6-41b5-ba29-cd296f396aea service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:20.351401 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4738a178-8ffe-4926-ab1a-4b87f52f3762 req-d1f99b69-4db6-41b5-ba29-cd296f396aea service nova] Creating event network-vif-plugged:3945a8a5-d936-4950-b5da-a5caf20af3b0 for instance 3d903395-bfec-4058-ad40-0d4816da0f23 on n-h2-862964-4 Oct 29 03:17:20.361115 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4738a178-8ffe-4926-ab1a-4b87f52f3762 req-d1f99b69-4db6-41b5-ba29-cd296f396aea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.386472 Oct 29 03:17:20.362028 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3004/6054] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:20.852381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9bcd3510-2239-47e3-9d49-658bb621cc2a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:20.878348 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9bcd3510-2239-47e3-9d49-658bb621cc2a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1367 microversion: 2.1 time: 0.644953 Oct 29 03:17:20.884921 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3051/6055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:20 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1367 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:21.003661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-71142b49-0997-4442-95c1-59aae9d2c7a6 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:21.004895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-71142b49-0997-4442-95c1-59aae9d2c7a6 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:21.020763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71142b49-0997-4442-95c1-59aae9d2c7a6 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:21.023217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71142b49-0997-4442-95c1-59aae9d2c7a6 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:21.023840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71142b49-0997-4442-95c1-59aae9d2c7a6 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:21.026766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71142b49-0997-4442-95c1-59aae9d2c7a6 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:21.027397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71142b49-0997-4442-95c1-59aae9d2c7a6 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:21.028995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71142b49-0997-4442-95c1-59aae9d2c7a6 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:21.252853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4f371827-eb8c-4160-a8d9-c6b80b7a31cf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:21.253658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4f371827-eb8c-4160-a8d9-c6b80b7a31cf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:21.264365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f371827-eb8c-4160-a8d9-c6b80b7a31cf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:21.271843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f371827-eb8c-4160-a8d9-c6b80b7a31cf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:21.275319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f371827-eb8c-4160-a8d9-c6b80b7a31cf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:21.276546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f371827-eb8c-4160-a8d9-c6b80b7a31cf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:21.282631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f371827-eb8c-4160-a8d9-c6b80b7a31cf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:21.283452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f371827-eb8c-4160-a8d9-c6b80b7a31cf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:21.628579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-71142b49-0997-4442-95c1-59aae9d2c7a6 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:21.637132 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-71142b49-0997-4442-95c1-59aae9d2c7a6 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1315 microversion: 2.1 time: 0.639791 Oct 29 03:17:21.651491 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3005/6056] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:20 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:21.660380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4eea7164-1aa9-453b-80ed-4a01e5004ef0 req-d9aa2084-a2ce-4215-9330-7e3433edd06b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083f03bb-76fb-455c-838c-ec3e6a9be2b1", "tag": "02254f06-dac7-4e8d-9729-e2ab40b6402d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:21.673492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4eea7164-1aa9-453b-80ed-4a01e5004ef0 req-d9aa2084-a2ce-4215-9330-7e3433edd06b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:21.674228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4eea7164-1aa9-453b-80ed-4a01e5004ef0 req-d9aa2084-a2ce-4215-9330-7e3433edd06b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:21.674879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4eea7164-1aa9-453b-80ed-4a01e5004ef0 req-d9aa2084-a2ce-4215-9330-7e3433edd06b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:21.697026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4f371827-eb8c-4160-a8d9-c6b80b7a31cf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:21.697568 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4eea7164-1aa9-453b-80ed-4a01e5004ef0 req-d9aa2084-a2ce-4215-9330-7e3433edd06b service nova] Creating event network-changed:02254f06-dac7-4e8d-9729-e2ab40b6402d for instance 083f03bb-76fb-455c-838c-ec3e6a9be2b1 on n-h1-862964-4 Oct 29 03:17:21.703749 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4eea7164-1aa9-453b-80ed-4a01e5004ef0 req-d9aa2084-a2ce-4215-9330-7e3433edd06b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050553 Oct 29 03:17:21.704808 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3006/6057] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:21.705492 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4f371827-eb8c-4160-a8d9-c6b80b7a31cf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1375 microversion: 2.1 time: 0.456619 Oct 29 03:17:21.708459 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3052/6058] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:21 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1375 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:21.927455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-316d5745-1634-43e7-a42d-63e1af53f39e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:21.928331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-316d5745-1634-43e7-a42d-63e1af53f39e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:21.947488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316d5745-1634-43e7-a42d-63e1af53f39e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:21.948329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316d5745-1634-43e7-a42d-63e1af53f39e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:21.949016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316d5745-1634-43e7-a42d-63e1af53f39e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:21.950956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316d5745-1634-43e7-a42d-63e1af53f39e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:21.951590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316d5745-1634-43e7-a42d-63e1af53f39e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:21.952191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316d5745-1634-43e7-a42d-63e1af53f39e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:22.641119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-316d5745-1634-43e7-a42d-63e1af53f39e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:22.650848 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-316d5745-1634-43e7-a42d-63e1af53f39e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1367 microversion: 2.1 time: 0.728010 Oct 29 03:17:22.651438 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3007/6059] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:21 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1367 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:22.662094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:22.671625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3fa35408-f000-4eab-a676-6bf4e3c5f0d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:22.672634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3fa35408-f000-4eab-a676-6bf4e3c5f0d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:22.692438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fa35408-f000-4eab-a676-6bf4e3c5f0d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:22.693630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fa35408-f000-4eab-a676-6bf4e3c5f0d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:22.694492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fa35408-f000-4eab-a676-6bf4e3c5f0d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:22.696288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fa35408-f000-4eab-a676-6bf4e3c5f0d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:22.697950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fa35408-f000-4eab-a676-6bf4e3c5f0d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:22.698609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fa35408-f000-4eab-a676-6bf4e3c5f0d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:22.737412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e1da381e-2e49-46fb-9d3b-686bc17ee83f tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:22.739849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e1da381e-2e49-46fb-9d3b-686bc17ee83f tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:22.753842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1da381e-2e49-46fb-9d3b-686bc17ee83f tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:22.761825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1da381e-2e49-46fb-9d3b-686bc17ee83f tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:22.764293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1da381e-2e49-46fb-9d3b-686bc17ee83f tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:22.765748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1da381e-2e49-46fb-9d3b-686bc17ee83f tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:22.767004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1da381e-2e49-46fb-9d3b-686bc17ee83f tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:22.779264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1da381e-2e49-46fb-9d3b-686bc17ee83f tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:22.913761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3fa35408-f000-4eab-a676-6bf4e3c5f0d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:22.928607 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3fa35408-f000-4eab-a676-6bf4e3c5f0d4 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1465 microversion: 2.1 time: 0.267599 Oct 29 03:17:22.941848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3053/6060] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:22 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1465 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:22.982761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f6b1a396-5bfe-4be6-bfb6-ae7694a45c4a tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:22.983603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f6b1a396-5bfe-4be6-bfb6-ae7694a45c4a tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:22.990866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6b1a396-5bfe-4be6-bfb6-ae7694a45c4a tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:22.991653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6b1a396-5bfe-4be6-bfb6-ae7694a45c4a tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:22.992882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6b1a396-5bfe-4be6-bfb6-ae7694a45c4a tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:22.993831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6b1a396-5bfe-4be6-bfb6-ae7694a45c4a tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:22.994725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6b1a396-5bfe-4be6-bfb6-ae7694a45c4a tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:22.995362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6b1a396-5bfe-4be6-bfb6-ae7694a45c4a tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:23.019993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e1da381e-2e49-46fb-9d3b-686bc17ee83f tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:23.029422 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e1da381e-2e49-46fb-9d3b-686bc17ee83f tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1375 microversion: 2.1 time: 0.300371 Oct 29 03:17:23.043396 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3008/6061] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:22 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1375 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:23.056584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f6b1a396-5bfe-4be6-bfb6-ae7694a45c4a tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:17:23.110118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:23.217631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f6b1a396-5bfe-4be6-bfb6-ae7694a45c4a tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 204 len: 0 microversion: 2.1 time: 0.239024 Oct 29 03:17:23.222182 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3054/6062] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:17:22 2022] DELETE /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:17:23.231584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-91c2f5a4-a619-4458-9a1b-864f9916a0a3 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:23.232369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-91c2f5a4-a619-4458-9a1b-864f9916a0a3 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:23.235613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:23.236370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=16 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:23.256547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91c2f5a4-a619-4458-9a1b-864f9916a0a3 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:23.257393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91c2f5a4-a619-4458-9a1b-864f9916a0a3 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:23.259031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91c2f5a4-a619-4458-9a1b-864f9916a0a3 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:23.261465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91c2f5a4-a619-4458-9a1b-864f9916a0a3 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:23.265922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91c2f5a4-a619-4458-9a1b-864f9916a0a3 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:23.269242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91c2f5a4-a619-4458-9a1b-864f9916a0a3 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:23.664315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-91c2f5a4-a619-4458-9a1b-864f9916a0a3 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:23.674765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4cdad9e4-6716-4f9e-b468-7611b0653468 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:23.676407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4cdad9e4-6716-4f9e-b468-7611b0653468 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:23.690248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=18 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:23.692181 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-91c2f5a4-a619-4458-9a1b-864f9916a0a3 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1471 microversion: 2.1 time: 0.464871 Oct 29 03:17:23.696356 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3009/6063] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:23 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1471 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:23.697559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdad9e4-6716-4f9e-b468-7611b0653468 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:23.698959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdad9e4-6716-4f9e-b468-7611b0653468 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:23.699468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdad9e4-6716-4f9e-b468-7611b0653468 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:23.700306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdad9e4-6716-4f9e-b468-7611b0653468 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:23.700836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdad9e4-6716-4f9e-b468-7611b0653468 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:23.701321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cdad9e4-6716-4f9e-b468-7611b0653468 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:24.060268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cdad9e4-6716-4f9e-b468-7611b0653468 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:24.064095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15d55994-6d1e-4cc8-9088-d31d236a30ba tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:24.064915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-15d55994-6d1e-4cc8-9088-d31d236a30ba tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:24.072878 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4cdad9e4-6716-4f9e-b468-7611b0653468 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1367 microversion: 2.1 time: 0.402302 Oct 29 03:17:24.073475 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3055/6064] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:23 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:24.075224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d55994-6d1e-4cc8-9088-d31d236a30ba tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:24.075991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d55994-6d1e-4cc8-9088-d31d236a30ba tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:24.076597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d55994-6d1e-4cc8-9088-d31d236a30ba tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:24.077474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d55994-6d1e-4cc8-9088-d31d236a30ba tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:24.078191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d55994-6d1e-4cc8-9088-d31d236a30ba tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:24.078796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15d55994-6d1e-4cc8-9088-d31d236a30ba tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:24.224603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15d55994-6d1e-4cc8-9088-d31d236a30ba tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:24.232936 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-15d55994-6d1e-4cc8-9088-d31d236a30ba tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1375 microversion: 2.1 time: 0.173147 Oct 29 03:17:24.233532 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3010/6065] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:24 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:24.720534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c4ac979-441e-4892-ba91-8882dd754a55 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:24.721246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c4ac979-441e-4892-ba91-8882dd754a55 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:24.730441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c4ac979-441e-4892-ba91-8882dd754a55 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:24.731116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c4ac979-441e-4892-ba91-8882dd754a55 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:24.732034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c4ac979-441e-4892-ba91-8882dd754a55 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:24.733047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c4ac979-441e-4892-ba91-8882dd754a55 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:24.733888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c4ac979-441e-4892-ba91-8882dd754a55 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:24.734704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c4ac979-441e-4892-ba91-8882dd754a55 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:24.959191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c4ac979-441e-4892-ba91-8882dd754a55 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:24.973440 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c4ac979-441e-4892-ba91-8882dd754a55 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1471 microversion: 2.1 time: 0.257808 Oct 29 03:17:24.991362 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3056/6066] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:24 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1471 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:25.097069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e78bf1d1-2cdd-47cb-b4f4-e55bb4817724 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:25.097848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e78bf1d1-2cdd-47cb-b4f4-e55bb4817724 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:25.110607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e78bf1d1-2cdd-47cb-b4f4-e55bb4817724 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:25.111175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e78bf1d1-2cdd-47cb-b4f4-e55bb4817724 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:25.111615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e78bf1d1-2cdd-47cb-b4f4-e55bb4817724 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:25.112346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e78bf1d1-2cdd-47cb-b4f4-e55bb4817724 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:25.112856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e78bf1d1-2cdd-47cb-b4f4-e55bb4817724 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:25.113327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e78bf1d1-2cdd-47cb-b4f4-e55bb4817724 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:25.259511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9d284a04-378a-4ddc-9321-fa5a13cfc8d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:25.260605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9d284a04-378a-4ddc-9321-fa5a13cfc8d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:25.281504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d284a04-378a-4ddc-9321-fa5a13cfc8d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:25.282117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d284a04-378a-4ddc-9321-fa5a13cfc8d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:25.290259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d284a04-378a-4ddc-9321-fa5a13cfc8d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:25.291467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d284a04-378a-4ddc-9321-fa5a13cfc8d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:25.291973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d284a04-378a-4ddc-9321-fa5a13cfc8d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:25.292434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9d284a04-378a-4ddc-9321-fa5a13cfc8d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:25.597109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e78bf1d1-2cdd-47cb-b4f4-e55bb4817724 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:25.608703 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e78bf1d1-2cdd-47cb-b4f4-e55bb4817724 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1367 microversion: 2.1 time: 0.516046 Oct 29 03:17:25.610540 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3011/6067] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:25 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1367 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:25.852463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9d284a04-378a-4ddc-9321-fa5a13cfc8d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:25.871239 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9d284a04-378a-4ddc-9321-fa5a13cfc8d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1375 microversion: 2.1 time: 0.617262 Oct 29 03:17:25.893596 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3057/6068] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:25 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1375 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:25.915297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c072ba04-e32d-4dcc-b125-82e089344c32 req-98e4034a-dc26-464e-a7d9-f2dcde3cc59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d903395-bfec-4058-ad40-0d4816da0f23", "name": "network-vif-deleted", "tag": "3945a8a5-d936-4950-b5da-a5caf20af3b0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:25.930333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c072ba04-e32d-4dcc-b125-82e089344c32 req-98e4034a-dc26-464e-a7d9-f2dcde3cc59e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:25.934679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c072ba04-e32d-4dcc-b125-82e089344c32 req-98e4034a-dc26-464e-a7d9-f2dcde3cc59e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:25.935642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c072ba04-e32d-4dcc-b125-82e089344c32 req-98e4034a-dc26-464e-a7d9-f2dcde3cc59e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:25.954483 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c072ba04-e32d-4dcc-b125-82e089344c32 req-98e4034a-dc26-464e-a7d9-f2dcde3cc59e service nova] Creating event network-vif-deleted:3945a8a5-d936-4950-b5da-a5caf20af3b0 for instance 3d903395-bfec-4058-ad40-0d4816da0f23 on n-h2-862964-4 Oct 29 03:17:25.961249 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c072ba04-e32d-4dcc-b125-82e089344c32 req-98e4034a-dc26-464e-a7d9-f2dcde3cc59e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049479 Oct 29 03:17:25.971976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-fdace2ef-027c-45ea-b602-ac0ae58b63a3 req-d2226e48-2034-4440-b2bb-2a81e7f015f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a940222-301e-49c9-a1ed-4c8bcce9eb0c", "name": "network-vif-plugged", "status": "completed", "tag": "9e2c3995-42d3-4817-825b-8fb0a1d7d939"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:25.978752 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3012/6069] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:25.985678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fdace2ef-027c-45ea-b602-ac0ae58b63a3 req-d2226e48-2034-4440-b2bb-2a81e7f015f8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:25.986699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fdace2ef-027c-45ea-b602-ac0ae58b63a3 req-d2226e48-2034-4440-b2bb-2a81e7f015f8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:25.987628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fdace2ef-027c-45ea-b602-ac0ae58b63a3 req-d2226e48-2034-4440-b2bb-2a81e7f015f8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:26.002237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e9a4d9a2-2667-46c1-b71b-63953ff385b2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:26.003193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e9a4d9a2-2667-46c1-b71b-63953ff385b2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:26.028767 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-fdace2ef-027c-45ea-b602-ac0ae58b63a3 req-d2226e48-2034-4440-b2bb-2a81e7f015f8 service nova] Creating event network-vif-plugged:9e2c3995-42d3-4817-825b-8fb0a1d7d939 for instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c on n-h1-862964-4 Oct 29 03:17:26.030585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9a4d9a2-2667-46c1-b71b-63953ff385b2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:26.031230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9a4d9a2-2667-46c1-b71b-63953ff385b2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:26.031728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9a4d9a2-2667-46c1-b71b-63953ff385b2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:26.033148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9a4d9a2-2667-46c1-b71b-63953ff385b2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:26.036109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9a4d9a2-2667-46c1-b71b-63953ff385b2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:26.036808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e9a4d9a2-2667-46c1-b71b-63953ff385b2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:26.042405 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-fdace2ef-027c-45ea-b602-ac0ae58b63a3 req-d2226e48-2034-4440-b2bb-2a81e7f015f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075001 Oct 29 03:17:26.045317 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3058/6070] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:17:26.167084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e9a4d9a2-2667-46c1-b71b-63953ff385b2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42be58e511bc4f27aba89c886e479d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '738337cc190644dcb6ac88db4d0994aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:26.188440 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e9a4d9a2-2667-46c1-b71b-63953ff385b2 tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 200 len: 1300 microversion: 2.1 time: 0.191530 Oct 29 03:17:26.192542 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3013/6071] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:25 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 1300 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:26.647890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8320d955-9a0e-4a41-8d38-e12fa98eaca4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:26.648754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8320d955-9a0e-4a41-8d38-e12fa98eaca4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:26.665643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8320d955-9a0e-4a41-8d38-e12fa98eaca4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:26.666189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8320d955-9a0e-4a41-8d38-e12fa98eaca4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:26.666760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8320d955-9a0e-4a41-8d38-e12fa98eaca4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:26.667514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8320d955-9a0e-4a41-8d38-e12fa98eaca4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:26.668150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8320d955-9a0e-4a41-8d38-e12fa98eaca4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:26.668607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8320d955-9a0e-4a41-8d38-e12fa98eaca4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:26.877502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8320d955-9a0e-4a41-8d38-e12fa98eaca4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:26.886453 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8320d955-9a0e-4a41-8d38-e12fa98eaca4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1367 microversion: 2.1 time: 0.242670 Oct 29 03:17:26.887115 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3059/6072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:26 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:26.901322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1d362b05-f45c-428b-a4e1-3e49115958bc tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:26.901958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1d362b05-f45c-428b-a4e1-3e49115958bc tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:26.909381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d362b05-f45c-428b-a4e1-3e49115958bc tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:26.910013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d362b05-f45c-428b-a4e1-3e49115958bc tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:26.910544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d362b05-f45c-428b-a4e1-3e49115958bc tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:26.911347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d362b05-f45c-428b-a4e1-3e49115958bc tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:26.912138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d362b05-f45c-428b-a4e1-3e49115958bc tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:26.912745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d362b05-f45c-428b-a4e1-3e49115958bc tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:27.085983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1d362b05-f45c-428b-a4e1-3e49115958bc tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:27.096342 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1d362b05-f45c-428b-a4e1-3e49115958bc tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1375 microversion: 2.1 time: 0.198877 Oct 29 03:17:27.098330 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3014/6073] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:26 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1375 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:27.213197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:27.213817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] [instance: 3d903395-bfec-4058-ad40-0d4816da0f23] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:27.221610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:27.223095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:27.223786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:27.225212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:27.225916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:27.226872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:27.248129 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] HTTP exception thrown: Instance 3d903395-bfec-4058-ad40-0d4816da0f23 could not be found. Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Request method failure captured: Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 HTTP/1.1 Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJstw7-5WjoX1rrFk6l9cHVY11sX_G9qUDJB6obPk7YAxV58CBtLrW7RdD-UQjSYZ6-sdJi_RqxudyNTWoYKVitALkw0au_wIwZTcvN0BHXq4Zg0JsrvW1alw_G6eOZpyzj8nQIblPJpXYJrYOpMykj5OsDmkjoXU4YXGiMpZZ0MRUU Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 738337cc190644dcb6ac88db4d0994aa Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-VolumesNegativeTest-915600624 Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/738337cc190644dcb6ac88db4d0994aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/738337cc190644dcb6ac88db4d0994aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_738337cc190644dcb6ac88db4d0994aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/738337cc190644dcb6ac88db4d0994aa"}]}] Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-VolumesNegativeTest-915600624 Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 738337cc190644dcb6ac88db4d0994aa Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-VolumesNegativeTest-915600624 Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-VolumesNegativeTest-915600624-project Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 42be58e511bc4f27aba89c886e479d5f Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-VolumesNegativeTest-915600624-project Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3d903395-bfec-4058-ad40-0d4816da0f23 could not be found. Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3d903395-bfec-4058-ad40-0d4816da0f23'} Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d903395-bfec-4058-ad40-0d4816da0f23 could not be found. Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d903395-bfec-4058-ad40-0d4816da0f23 could not be found. Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:17:27.253129 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:27.258515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:27.258515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:17:27.258515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:17:27.258515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:17:27.258515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:17:27.258515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d903395-bfec-4058-ad40-0d4816da0f23 could not be found. Oct 29 03:17:27.258515 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:27.259412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] Returning 404 to user: Instance 3d903395-bfec-4058-ad40-0d4816da0f23 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:17:27.260381 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a88c1b9a-0733-43ed-a806-bae0e55b20da tempest-VolumesNegativeTest-915600624 tempest-VolumesNegativeTest-915600624-project] 10.222.0.16 "GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23" status: 404 len: 111 microversion: 2.1 time: 0.051299 Oct 29 03:17:27.262862 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3060/6074] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:27 2022] GET /compute/v2.1/servers/3d903395-bfec-4058-ad40-0d4816da0f23 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:17:27.910900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3d1f037b-c138-4842-91d8-2f3f6e20f999 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:27.911512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3d1f037b-c138-4842-91d8-2f3f6e20f999 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:27.927125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d1f037b-c138-4842-91d8-2f3f6e20f999 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:27.927611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d1f037b-c138-4842-91d8-2f3f6e20f999 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:27.928596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d1f037b-c138-4842-91d8-2f3f6e20f999 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:27.930786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d1f037b-c138-4842-91d8-2f3f6e20f999 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:27.931944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d1f037b-c138-4842-91d8-2f3f6e20f999 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:27.933968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d1f037b-c138-4842-91d8-2f3f6e20f999 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:28.109521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-975b2891-4851-40c9-98c1-01f8f0559813 req-b260f9f2-73be-48c6-9126-127d0306732a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083f03bb-76fb-455c-838c-ec3e6a9be2b1", "name": "network-vif-plugged", "status": "completed", "tag": "02254f06-dac7-4e8d-9729-e2ab40b6402d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:28.140532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-975b2891-4851-40c9-98c1-01f8f0559813 req-b260f9f2-73be-48c6-9126-127d0306732a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:28.141407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-975b2891-4851-40c9-98c1-01f8f0559813 req-b260f9f2-73be-48c6-9126-127d0306732a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:28.142085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-975b2891-4851-40c9-98c1-01f8f0559813 req-b260f9f2-73be-48c6-9126-127d0306732a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:28.181562 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-975b2891-4851-40c9-98c1-01f8f0559813 req-b260f9f2-73be-48c6-9126-127d0306732a service nova] Creating event network-vif-plugged:02254f06-dac7-4e8d-9729-e2ab40b6402d for instance 083f03bb-76fb-455c-838c-ec3e6a9be2b1 on n-h1-862964-4 Oct 29 03:17:28.204106 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-975b2891-4851-40c9-98c1-01f8f0559813 req-b260f9f2-73be-48c6-9126-127d0306732a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098924 Oct 29 03:17:28.205356 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3061/6075] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:17:28.213441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2d0d239-b861-4a37-bb40-0bd006f1fa64 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:28.220303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b2d0d239-b861-4a37-bb40-0bd006f1fa64 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:28.224293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3d1f037b-c138-4842-91d8-2f3f6e20f999 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:28.233989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2d0d239-b861-4a37-bb40-0bd006f1fa64 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:28.234376 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3d1f037b-c138-4842-91d8-2f3f6e20f999 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1556 microversion: 2.1 time: 0.328243 Oct 29 03:17:28.234970 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3015/6076] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:27 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1556 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:28.235877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2d0d239-b861-4a37-bb40-0bd006f1fa64 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:28.236563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2d0d239-b861-4a37-bb40-0bd006f1fa64 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:28.237525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2d0d239-b861-4a37-bb40-0bd006f1fa64 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:28.238242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2d0d239-b861-4a37-bb40-0bd006f1fa64 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:28.238893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2d0d239-b861-4a37-bb40-0bd006f1fa64 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:28.275618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bc67fd33-e3ad-45e4-afef-1cb1a91493d5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:28.279483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bc67fd33-e3ad-45e4-afef-1cb1a91493d5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:28.304208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc67fd33-e3ad-45e4-afef-1cb1a91493d5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:28.305524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc67fd33-e3ad-45e4-afef-1cb1a91493d5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:28.309181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc67fd33-e3ad-45e4-afef-1cb1a91493d5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:28.314532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc67fd33-e3ad-45e4-afef-1cb1a91493d5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:28.315497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc67fd33-e3ad-45e4-afef-1cb1a91493d5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:28.316188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc67fd33-e3ad-45e4-afef-1cb1a91493d5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:28.495157 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bc67fd33-e3ad-45e4-afef-1cb1a91493d5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227158 Oct 29 03:17:28.500061 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3016/6077] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:17:28 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:28.510815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cf6f4960-ff34-4979-a9de-40389cf3fad0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:28.513849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cf6f4960-ff34-4979-a9de-40389cf3fad0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:28.534347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6f4960-ff34-4979-a9de-40389cf3fad0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:28.534869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6f4960-ff34-4979-a9de-40389cf3fad0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:28.535551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6f4960-ff34-4979-a9de-40389cf3fad0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:28.537746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6f4960-ff34-4979-a9de-40389cf3fad0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:28.542253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6f4960-ff34-4979-a9de-40389cf3fad0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:28.543858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6f4960-ff34-4979-a9de-40389cf3fad0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:28.677348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-cf6f4960-ff34-4979-a9de-40389cf3fad0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lazy-loading 'services' on Instance uuid cc2c36c2-406c-4847-ae8d-3fbd334c9039 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:17:28.781212 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cf6f4960-ff34-4979-a9de-40389cf3fad0 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments/d88063cb-1ab2-49f3-8afc-f0a34e6df32b" status: 202 len: 0 microversion: 2.1 time: 0.279193 Oct 29 03:17:28.781848 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3017/6078] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:17:28 2022] DELETE /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments/d88063cb-1ab2-49f3-8afc-f0a34e6df32b => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:17:28.794543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-79cc409f-18ec-4641-819a-f989117e2a0d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:28.797331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-79cc409f-18ec-4641-819a-f989117e2a0d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:28.804636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79cc409f-18ec-4641-819a-f989117e2a0d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:28.805442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79cc409f-18ec-4641-819a-f989117e2a0d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:28.806145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79cc409f-18ec-4641-819a-f989117e2a0d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:28.807180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79cc409f-18ec-4641-819a-f989117e2a0d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:28.807922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79cc409f-18ec-4641-819a-f989117e2a0d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:28.808604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-79cc409f-18ec-4641-819a-f989117e2a0d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:28.870412 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-79cc409f-18ec-4641-819a-f989117e2a0d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081321 Oct 29 03:17:28.871011 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3018/6079] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:28 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:17:29.229545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2d0d239-b861-4a37-bb40-0bd006f1fa64 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:29.240906 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b2d0d239-b861-4a37-bb40-0bd006f1fa64 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1375 microversion: 2.1 time: 1.033952 Oct 29 03:17:29.246749 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3062/6080] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:28 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1375 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:29.883913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0c69109a-308a-44bc-9b1c-15621578108f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:29.886929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0c69109a-308a-44bc-9b1c-15621578108f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:29.905153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c69109a-308a-44bc-9b1c-15621578108f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:29.905866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c69109a-308a-44bc-9b1c-15621578108f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:29.909519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c69109a-308a-44bc-9b1c-15621578108f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:29.912546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c69109a-308a-44bc-9b1c-15621578108f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:29.913068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c69109a-308a-44bc-9b1c-15621578108f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:29.913513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c69109a-308a-44bc-9b1c-15621578108f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:30.033850 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0c69109a-308a-44bc-9b1c-15621578108f tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151397 Oct 29 03:17:30.036996 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3019/6081] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:29 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:30.277582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7e792d17-03ef-4123-8234-8d169ae8d38e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:30.279291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7e792d17-03ef-4123-8234-8d169ae8d38e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:30.290027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e792d17-03ef-4123-8234-8d169ae8d38e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:30.291835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e792d17-03ef-4123-8234-8d169ae8d38e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:30.292639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e792d17-03ef-4123-8234-8d169ae8d38e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:30.293646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e792d17-03ef-4123-8234-8d169ae8d38e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:30.294656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e792d17-03ef-4123-8234-8d169ae8d38e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:30.295237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e792d17-03ef-4123-8234-8d169ae8d38e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:30.770450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7e792d17-03ef-4123-8234-8d169ae8d38e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:30.790631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7e792d17-03ef-4123-8234-8d169ae8d38e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1375 microversion: 2.1 time: 0.517661 Oct 29 03:17:30.798492 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3063/6082] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:30 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1375 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:31.051968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6cffdd29-f3ba-4c9e-98f4-9cc692cfc503 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:31.054219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6cffdd29-f3ba-4c9e-98f4-9cc692cfc503 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:31.070777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cffdd29-f3ba-4c9e-98f4-9cc692cfc503 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:31.083119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cffdd29-f3ba-4c9e-98f4-9cc692cfc503 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:31.083828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cffdd29-f3ba-4c9e-98f4-9cc692cfc503 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:31.086902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cffdd29-f3ba-4c9e-98f4-9cc692cfc503 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:31.087396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cffdd29-f3ba-4c9e-98f4-9cc692cfc503 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:31.087829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cffdd29-f3ba-4c9e-98f4-9cc692cfc503 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:31.094086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:31.151047 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6cffdd29-f3ba-4c9e-98f4-9cc692cfc503 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105972 Oct 29 03:17:31.151986 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3020/6083] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:31 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:31.747709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f2aca580-4255-45e9-81e3-67f307586ef3 req-2c17bada-1027-42f5-8bf3-3e5ce1014ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a940222-301e-49c9-a1ed-4c8bcce9eb0c", "tag": "9e2c3995-42d3-4817-825b-8fb0a1d7d939"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:31.778161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f2aca580-4255-45e9-81e3-67f307586ef3 req-2c17bada-1027-42f5-8bf3-3e5ce1014ee9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:31.778897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f2aca580-4255-45e9-81e3-67f307586ef3 req-2c17bada-1027-42f5-8bf3-3e5ce1014ee9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:31.779516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f2aca580-4255-45e9-81e3-67f307586ef3 req-2c17bada-1027-42f5-8bf3-3e5ce1014ee9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:31.807831 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f2aca580-4255-45e9-81e3-67f307586ef3 req-2c17bada-1027-42f5-8bf3-3e5ce1014ee9 service nova] Creating event network-changed:9e2c3995-42d3-4817-825b-8fb0a1d7d939 for instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c on n-h1-862964-4 Oct 29 03:17:31.819631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f2aca580-4255-45e9-81e3-67f307586ef3 req-2c17bada-1027-42f5-8bf3-3e5ce1014ee9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.383825 Oct 29 03:17:31.819910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fad75e2c-dc42-480c-a2b5-a73e89a595da tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:31.820502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fad75e2c-dc42-480c-a2b5-a73e89a595da tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:31.820661 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3064/6084] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:31.836367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fad75e2c-dc42-480c-a2b5-a73e89a595da tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:31.839882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fad75e2c-dc42-480c-a2b5-a73e89a595da tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:31.841362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fad75e2c-dc42-480c-a2b5-a73e89a595da tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:31.843831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fad75e2c-dc42-480c-a2b5-a73e89a595da tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:31.846309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fad75e2c-dc42-480c-a2b5-a73e89a595da tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:31.862473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fad75e2c-dc42-480c-a2b5-a73e89a595da tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:32.168255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8b574552-bc02-4a87-bc9a-c9d68491d380 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:32.172730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8b574552-bc02-4a87-bc9a-c9d68491d380 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:32.210131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b574552-bc02-4a87-bc9a-c9d68491d380 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:32.210677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b574552-bc02-4a87-bc9a-c9d68491d380 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:32.218413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b574552-bc02-4a87-bc9a-c9d68491d380 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:32.219452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b574552-bc02-4a87-bc9a-c9d68491d380 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:32.220034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b574552-bc02-4a87-bc9a-c9d68491d380 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:32.220613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b574552-bc02-4a87-bc9a-c9d68491d380 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:32.273042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fad75e2c-dc42-480c-a2b5-a73e89a595da tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:32.287210 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fad75e2c-dc42-480c-a2b5-a73e89a595da tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1547 microversion: 2.1 time: 0.471890 Oct 29 03:17:32.312885 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3021/6085] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:31 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1547 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:32.315727 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8b574552-bc02-4a87-bc9a-c9d68491d380 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155823 Oct 29 03:17:32.316448 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3065/6086] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:32 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:17:32.322893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8c279583-f3ff-4055-a679-696b26235f62 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:32.325328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8c279583-f3ff-4055-a679-696b26235f62 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:32.342152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c279583-f3ff-4055-a679-696b26235f62 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:32.343827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c279583-f3ff-4055-a679-696b26235f62 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:32.344446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c279583-f3ff-4055-a679-696b26235f62 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:32.347176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c279583-f3ff-4055-a679-696b26235f62 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:32.347860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c279583-f3ff-4055-a679-696b26235f62 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:32.349324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8c279583-f3ff-4055-a679-696b26235f62 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:32.933478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8c279583-f3ff-4055-a679-696b26235f62 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:32.953043 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8c279583-f3ff-4055-a679-696b26235f62 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1547 microversion: 2.1 time: 0.634202 Oct 29 03:17:32.953043 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3022/6087] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:32 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1547 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:33.332478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d04b048-c0d4-4cdc-ad79-933847930d09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:33.341537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d04b048-c0d4-4cdc-ad79-933847930d09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:33.381666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d04b048-c0d4-4cdc-ad79-933847930d09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:33.382221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d04b048-c0d4-4cdc-ad79-933847930d09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:33.382671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d04b048-c0d4-4cdc-ad79-933847930d09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:33.383411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d04b048-c0d4-4cdc-ad79-933847930d09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:33.383864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d04b048-c0d4-4cdc-ad79-933847930d09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:33.384286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d04b048-c0d4-4cdc-ad79-933847930d09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:33.480451 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d04b048-c0d4-4cdc-ad79-933847930d09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152450 Oct 29 03:17:33.483851 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3066/6088] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:33 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:34.500606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e7a2b1e-f786-4c06-a13d-6aa52646491c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:34.503347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0e7a2b1e-f786-4c06-a13d-6aa52646491c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:34.541502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e7a2b1e-f786-4c06-a13d-6aa52646491c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:34.543724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e7a2b1e-f786-4c06-a13d-6aa52646491c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:34.544280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e7a2b1e-f786-4c06-a13d-6aa52646491c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:34.547435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e7a2b1e-f786-4c06-a13d-6aa52646491c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:34.547947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e7a2b1e-f786-4c06-a13d-6aa52646491c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:34.548394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e7a2b1e-f786-4c06-a13d-6aa52646491c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:34.639061 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e7a2b1e-f786-4c06-a13d-6aa52646491c tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150091 Oct 29 03:17:34.654224 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3023/6089] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:34 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:35.667585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ed2d2be2-02a5-4061-a1b9-eb0eeeb87bd2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:35.673046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ed2d2be2-02a5-4061-a1b9-eb0eeeb87bd2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:35.683035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed2d2be2-02a5-4061-a1b9-eb0eeeb87bd2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:35.683959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed2d2be2-02a5-4061-a1b9-eb0eeeb87bd2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:35.684857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed2d2be2-02a5-4061-a1b9-eb0eeeb87bd2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:35.685927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed2d2be2-02a5-4061-a1b9-eb0eeeb87bd2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:35.686860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed2d2be2-02a5-4061-a1b9-eb0eeeb87bd2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:35.687513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed2d2be2-02a5-4061-a1b9-eb0eeeb87bd2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:35.739461 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ed2d2be2-02a5-4061-a1b9-eb0eeeb87bd2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076437 Oct 29 03:17:35.740531 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3067/6090] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:35 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:36.760576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-266b0d81-72da-47c4-8576-4f11a4b2ff9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:36.765215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-266b0d81-72da-47c4-8576-4f11a4b2ff9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:36.798961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-266b0d81-72da-47c4-8576-4f11a4b2ff9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:36.799718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-266b0d81-72da-47c4-8576-4f11a4b2ff9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:36.801312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-266b0d81-72da-47c4-8576-4f11a4b2ff9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:36.802487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-266b0d81-72da-47c4-8576-4f11a4b2ff9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:36.804525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-266b0d81-72da-47c4-8576-4f11a4b2ff9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:36.807455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-266b0d81-72da-47c4-8576-4f11a4b2ff9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:36.896376 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-266b0d81-72da-47c4-8576-4f11a4b2ff9d tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146807 Oct 29 03:17:36.901989 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3024/6091] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:36 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:37.909227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c28d057-03a3-4230-9e48-6b324c15aeaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:37.912783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0c28d057-03a3-4230-9e48-6b324c15aeaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:37.935107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c28d057-03a3-4230-9e48-6b324c15aeaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:37.936507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c28d057-03a3-4230-9e48-6b324c15aeaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:37.937280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c28d057-03a3-4230-9e48-6b324c15aeaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:37.938294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c28d057-03a3-4230-9e48-6b324c15aeaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:37.938986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c28d057-03a3-4230-9e48-6b324c15aeaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:37.939846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c28d057-03a3-4230-9e48-6b324c15aeaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.030606 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0c28d057-03a3-4230-9e48-6b324c15aeaf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125493 Oct 29 03:17:38.038151 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3068/6092] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:37 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:17:38.169615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:38.173306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:38.185719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.188573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.189535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.192567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.193202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.194051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.252201 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] HTTP exception thrown: Cannot 'reboot' instance 432b0c44-ded6-4344-8c88-27d842cfb635 while it is in vm_state rescued Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Request method failure captured: Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635/action HTTP/1.1 Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 28 Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJpRn_7hoOfvObzqA-ZLLdT0Ldg_y6elYIAF6FaT28sdj-TKjsGF45L6GmeVGfwMnSs4H8JoHZrc7By31zLGvou-MnR3pglqzR_y5cbEOWkNw533fNI-OxPHdxTNrRl2C5LEagXcPpESr9s5MAeq27S7NZgAah_V7oaKcjpRtmQEpM8 Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_552af5aaae3f49fdb5cc8ea8ec4ccdec", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}] Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 89a693133ded46eba2b9b70e899f38f9 Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: {"reboot": {"type": "HARD"}} Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: exception: Cannot 'reboot' instance 432b0c44-ded6-4344-8c88-27d842cfb635 while it is in vm_state rescued Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '432b0c44-ded6-4344-8c88-27d842cfb635', 'body': {'reboot': {'type': 'HARD'}}} Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 432b0c44-ded6-4344-8c88-27d842cfb635 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:17:38.262509 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:17:38.268764 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 432b0c44-ded6-4344-8c88-27d842cfb635 while it is in vm_state rescued Oct 29 03:17:38.268764 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:17:38.268764 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:17:38.268764 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:17:38.268764 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:38.268764 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:17:38.268764 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:17:38.268764 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:17:38.268764 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:17:38.268764 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 432b0c44-ded6-4344-8c88-27d842cfb635 while it is in vm_state rescued Oct 29 03:17:38.268764 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:17:38.271017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Returning 409 to user: Cannot 'reboot' instance 432b0c44-ded6-4344-8c88-27d842cfb635 while it is in vm_state rescued {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:17:38.272297 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7cdb2021-7286-404f-b0ff-e4a72ba0b0c9 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635/action" status: 409 len: 145 microversion: 2.1 time: 0.111325 Oct 29 03:17:38.273134 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3025/6093] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:17:38 2022] POST /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635/action => generated 145 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 03:17:38.285401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:38.289281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:38.298934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.299650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.300297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.301461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.302634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.303214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.398122 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] HTTP exception thrown: Cannot 'rebuild' instance 432b0c44-ded6-4344-8c88-27d842cfb635 while it is in vm_state rescued Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Request method failure captured: Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635/action HTTP/1.1 Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 65 Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJpRn_7hoOfvObzqA-ZLLdT0Ldg_y6elYIAF6FaT28sdj-TKjsGF45L6GmeVGfwMnSs4H8JoHZrc7By31zLGvou-MnR3pglqzR_y5cbEOWkNw533fNI-OxPHdxTNrRl2C5LEagXcPpESr9s5MAeq27S7NZgAah_V7oaKcjpRtmQEpM8 Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_552af5aaae3f49fdb5cc8ea8ec4ccdec", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}] Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 89a693133ded46eba2b9b70e899f38f9 Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: exception: Cannot 'rebuild' instance 432b0c44-ded6-4344-8c88-27d842cfb635 while it is in vm_state rescued Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '432b0c44-ded6-4344-8c88-27d842cfb635', 'body': {'rebuild': {'imageRef': 'c6777954-04bd-4ae1-b363-bbcd09a3f6ab'}}} Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 432b0c44-ded6-4344-8c88-27d842cfb635 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:17:38.406654 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 432b0c44-ded6-4344-8c88-27d842cfb635 while it is in vm_state rescued Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 432b0c44-ded6-4344-8c88-27d842cfb635 while it is in vm_state rescued Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Returning 409 to user: Cannot 'rebuild' instance 432b0c44-ded6-4344-8c88-27d842cfb635 while it is in vm_state rescued {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:17:38.411107 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2466c5b4-74fb-4175-bd00-45067f5d7386 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "POST /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635/action" status: 409 len: 146 microversion: 2.1 time: 0.129139 Oct 29 03:17:38.421353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2baf2a25-9b92-48ea-8409-7553e5b850fd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:38.421882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2baf2a25-9b92-48ea-8409-7553e5b850fd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:38.427180 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3069/6094] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:17:38 2022] POST /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635/action => generated 146 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:17:38.433605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baf2a25-9b92-48ea-8409-7553e5b850fd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.434031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baf2a25-9b92-48ea-8409-7553e5b850fd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.434505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baf2a25-9b92-48ea-8409-7553e5b850fd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.436206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baf2a25-9b92-48ea-8409-7553e5b850fd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.436682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baf2a25-9b92-48ea-8409-7553e5b850fd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.437117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2baf2a25-9b92-48ea-8409-7553e5b850fd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.496981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2baf2a25-9b92-48ea-8409-7553e5b850fd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:17:38.698770 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2baf2a25-9b92-48ea-8409-7553e5b850fd tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 204 len: 0 microversion: 2.1 time: 0.282228 Oct 29 03:17:38.699383 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3026/6095] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:17:38 2022] DELETE /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:17:38.708621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7b39dae-27c9-4b42-9132-516794ea4daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:38.709512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7b39dae-27c9-4b42-9132-516794ea4daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:38.720545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b39dae-27c9-4b42-9132-516794ea4daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.721054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b39dae-27c9-4b42-9132-516794ea4daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.721493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b39dae-27c9-4b42-9132-516794ea4daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.722241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b39dae-27c9-4b42-9132-516794ea4daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.722967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b39dae-27c9-4b42-9132-516794ea4daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.730391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b39dae-27c9-4b42-9132-516794ea4daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:39.081123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a7b39dae-27c9-4b42-9132-516794ea4daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:39.103478 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7b39dae-27c9-4b42-9132-516794ea4daa tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1688 microversion: 2.1 time: 0.399353 Oct 29 03:17:39.111520 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3070/6096] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:38 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1688 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:40.131539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cd48d675-0f96-4a6c-a2ca-7ebbac70b07a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:40.132247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cd48d675-0f96-4a6c-a2ca-7ebbac70b07a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:40.144279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd48d675-0f96-4a6c-a2ca-7ebbac70b07a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:40.146579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd48d675-0f96-4a6c-a2ca-7ebbac70b07a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:40.148071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd48d675-0f96-4a6c-a2ca-7ebbac70b07a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:40.151724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd48d675-0f96-4a6c-a2ca-7ebbac70b07a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:40.152207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd48d675-0f96-4a6c-a2ca-7ebbac70b07a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:40.153919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd48d675-0f96-4a6c-a2ca-7ebbac70b07a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:40.485736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cd48d675-0f96-4a6c-a2ca-7ebbac70b07a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:40.495558 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cd48d675-0f96-4a6c-a2ca-7ebbac70b07a tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1688 microversion: 2.1 time: 0.368558 Oct 29 03:17:40.496303 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3027/6097] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:40 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1688 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:40.704257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1273646871", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:40.792785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] validate_networks() for None {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:17:41.303792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:17:41.304551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:17:41.307418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:17:41.320982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:17:41.321414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:17:41.346632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:41.351562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:41.368499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:41.379977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:41.380790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:41.382261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:41.433348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Getting quotas for project a3d76d510f90412b8f2f2b8f8bec7b83. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:17:41.448379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Getting quotas for user c80163670b554c0398b7d752a9fc05fb and project a3d76d510f90412b8f2f2b8f8bec7b83. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:17:41.482335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:17:41.484748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:17:41.523644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-920d7435-94b7-461c-97f7-ae139e8b2ce6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:41.524420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-920d7435-94b7-461c-97f7-ae139e8b2ce6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:41.531861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-920d7435-94b7-461c-97f7-ae139e8b2ce6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:41.550587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-920d7435-94b7-461c-97f7-ae139e8b2ce6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:41.551022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-920d7435-94b7-461c-97f7-ae139e8b2ce6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:41.551789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-920d7435-94b7-461c-97f7-ae139e8b2ce6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:41.552444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-920d7435-94b7-461c-97f7-ae139e8b2ce6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:41.552918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-920d7435-94b7-461c-97f7-ae139e8b2ce6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:41.666564 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e81c5c00-9a2a-4f0b-8207-950abcf8bfa4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966552 Oct 29 03:17:41.674448 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3071/6098] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:17:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:17:41.680426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5baf1ae9-2c97-49e8-8d38-d340c2baf814 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:41.681383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5baf1ae9-2c97-49e8-8d38-d340c2baf814 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:42.054642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5baf1ae9-2c97-49e8-8d38-d340c2baf814 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:42.062893 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5baf1ae9-2c97-49e8-8d38-d340c2baf814 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1214 microversion: 2.1 time: 0.387211 Oct 29 03:17:42.063550 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3072/6099] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:41 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1214 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:42.305220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-920d7435-94b7-461c-97f7-ae139e8b2ce6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:42.321986 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-920d7435-94b7-461c-97f7-ae139e8b2ce6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1688 microversion: 2.1 time: 0.795557 Oct 29 03:17:42.325230 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3028/6100] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:41 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1688 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:43.088851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-77795a91-c18d-4361-83c3-18d599b22606 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:43.089588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-77795a91-c18d-4361-83c3-18d599b22606 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:43.097490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77795a91-c18d-4361-83c3-18d599b22606 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:43.097997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77795a91-c18d-4361-83c3-18d599b22606 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:43.099890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77795a91-c18d-4361-83c3-18d599b22606 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:43.100683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77795a91-c18d-4361-83c3-18d599b22606 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:43.101321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77795a91-c18d-4361-83c3-18d599b22606 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:43.101934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77795a91-c18d-4361-83c3-18d599b22606 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:43.312673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77795a91-c18d-4361-83c3-18d599b22606 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:43.322597 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-77795a91-c18d-4361-83c3-18d599b22606 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1266 microversion: 2.1 time: 0.237767 Oct 29 03:17:43.339023 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3073/6101] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:43 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:43.353232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-247cc67c-1c34-4eb9-802d-c995aff9c322 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:43.357398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-247cc67c-1c34-4eb9-802d-c995aff9c322 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:43.369157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-247cc67c-1c34-4eb9-802d-c995aff9c322 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:43.369962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-247cc67c-1c34-4eb9-802d-c995aff9c322 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:43.370602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-247cc67c-1c34-4eb9-802d-c995aff9c322 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:43.372082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-247cc67c-1c34-4eb9-802d-c995aff9c322 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:43.372715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-247cc67c-1c34-4eb9-802d-c995aff9c322 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:43.373312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-247cc67c-1c34-4eb9-802d-c995aff9c322 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:44.044184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-247cc67c-1c34-4eb9-802d-c995aff9c322 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:44.054967 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-247cc67c-1c34-4eb9-802d-c995aff9c322 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1688 microversion: 2.1 time: 0.707169 Oct 29 03:17:44.056040 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3029/6102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:43 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1688 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:44.350692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-804650fd-4d58-40ba-b68d-8adb776878e4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:44.351315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-804650fd-4d58-40ba-b68d-8adb776878e4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:44.362967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-804650fd-4d58-40ba-b68d-8adb776878e4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:44.364944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-804650fd-4d58-40ba-b68d-8adb776878e4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:44.367746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-804650fd-4d58-40ba-b68d-8adb776878e4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:44.369572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-804650fd-4d58-40ba-b68d-8adb776878e4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:44.374643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-804650fd-4d58-40ba-b68d-8adb776878e4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:44.375408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-804650fd-4d58-40ba-b68d-8adb776878e4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:45.030854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-804650fd-4d58-40ba-b68d-8adb776878e4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:45.044458 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-804650fd-4d58-40ba-b68d-8adb776878e4 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1272 microversion: 2.1 time: 0.697965 Oct 29 03:17:45.044707 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3074/6103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:44 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1272 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:45.084727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be0692d3-be6e-4186-8e94-dc1e04798504 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:45.085345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be0692d3-be6e-4186-8e94-dc1e04798504 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:45.100100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be0692d3-be6e-4186-8e94-dc1e04798504 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:45.101896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be0692d3-be6e-4186-8e94-dc1e04798504 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:45.102520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be0692d3-be6e-4186-8e94-dc1e04798504 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:45.104644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be0692d3-be6e-4186-8e94-dc1e04798504 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:45.105312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be0692d3-be6e-4186-8e94-dc1e04798504 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:45.107408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be0692d3-be6e-4186-8e94-dc1e04798504 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:45.274226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-be0692d3-be6e-4186-8e94-dc1e04798504 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:45.290578 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-be0692d3-be6e-4186-8e94-dc1e04798504 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1621 microversion: 2.1 time: 0.210417 Oct 29 03:17:45.293021 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3030/6104] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:45 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1621 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:45.768262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-62602be1-da0b-440b-ad14-8d8c7d4acd33 req-170e700a-b4a3-4437-a30a-b2e10289da6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc2c36c2-406c-4847-ae8d-3fbd334c9039", "name": "network-vif-deleted", "tag": "54901416-0c67-44c6-a0aa-ed5d4e84ca7e"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:45.785363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:45.825836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-62602be1-da0b-440b-ad14-8d8c7d4acd33 req-170e700a-b4a3-4437-a30a-b2e10289da6e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:45.826840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-62602be1-da0b-440b-ad14-8d8c7d4acd33 req-170e700a-b4a3-4437-a30a-b2e10289da6e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:45.827282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-62602be1-da0b-440b-ad14-8d8c7d4acd33 req-170e700a-b4a3-4437-a30a-b2e10289da6e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:45.894328 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-62602be1-da0b-440b-ad14-8d8c7d4acd33 req-170e700a-b4a3-4437-a30a-b2e10289da6e service nova] Creating event network-vif-deleted:54901416-0c67-44c6-a0aa-ed5d4e84ca7e for instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 on n-h1-862964-4 Oct 29 03:17:45.917031 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-62602be1-da0b-440b-ad14-8d8c7d4acd33 req-170e700a-b4a3-4437-a30a-b2e10289da6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152587 Oct 29 03:17:45.917672 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3075/6105] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:46.068190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a11ef410-a0a4-460a-903e-7b6800339093 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:46.068956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a11ef410-a0a4-460a-903e-7b6800339093 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:46.085270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a11ef410-a0a4-460a-903e-7b6800339093 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:46.085884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a11ef410-a0a4-460a-903e-7b6800339093 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:46.086267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a11ef410-a0a4-460a-903e-7b6800339093 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:46.090452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a11ef410-a0a4-460a-903e-7b6800339093 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:46.091385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a11ef410-a0a4-460a-903e-7b6800339093 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:46.091827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a11ef410-a0a4-460a-903e-7b6800339093 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:46.322536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:46.323332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:46.338423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:46.343865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:46.345235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:46.363531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:46.364136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:46.364474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:46.386492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:46.396358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a11ef410-a0a4-460a-903e-7b6800339093 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:46.427240 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a11ef410-a0a4-460a-903e-7b6800339093 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1272 microversion: 2.1 time: 0.357641 Oct 29 03:17:46.428339 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3031/6106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:46 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1272 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:46.487133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:46.487638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:46.488081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:46.488541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lazy-loading 'fault' on Instance uuid cc2c36c2-406c-4847-ae8d-3fbd334c9039 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:17:46.808041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:46.828789 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d9ec3d2-7ad8-45d6-9c70-288ea7ce1795 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 200 len: 1334 microversion: 2.1 time: 0.507757 Oct 29 03:17:46.829826 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3076/6107] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:46 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 1334 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:47.456027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-454200a1-9820-47b6-9f41-a80658fada46 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:47.458846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-454200a1-9820-47b6-9f41-a80658fada46 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:47.480356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454200a1-9820-47b6-9f41-a80658fada46 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:47.480859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454200a1-9820-47b6-9f41-a80658fada46 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:47.483605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454200a1-9820-47b6-9f41-a80658fada46 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:47.484877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454200a1-9820-47b6-9f41-a80658fada46 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:47.485617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454200a1-9820-47b6-9f41-a80658fada46 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:47.486336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454200a1-9820-47b6-9f41-a80658fada46 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:47.623981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-454200a1-9820-47b6-9f41-a80658fada46 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:47.634497 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-454200a1-9820-47b6-9f41-a80658fada46 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1272 microversion: 2.1 time: 0.184324 Oct 29 03:17:47.635103 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3032/6108] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:47 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:47.862115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:47.863797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: cc2c36c2-406c-4847-ae8d-3fbd334c9039] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:47.885697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:47.893396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:47.901592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:47.902845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:47.903640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:47.904327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:47.935675 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] HTTP exception thrown: Instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 could not be found. Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Request method failure captured: Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 HTTP/1.1 Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJpRn_7hoOfvObzqA-ZLLdT0Ldg_y6elYIAF6FaT28sdj-TKjsGF45L6GmeVGfwMnSs4H8JoHZrc7By31zLGvou-MnR3pglqzR_y5cbEOWkNw533fNI-OxPHdxTNrRl2C5LEagXcPpESr9s5MAeq27S7NZgAah_V7oaKcjpRtmQEpM8 Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_552af5aaae3f49fdb5cc8ea8ec4ccdec", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}] Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 89a693133ded46eba2b9b70e899f38f9 Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 could not be found. Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cc2c36c2-406c-4847-ae8d-3fbd334c9039'} Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 could not be found. Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 could not be found. Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:47.937375 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:17:47.941706 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:47.941706 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:47.941706 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:17:47.941706 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:17:47.941706 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:17:47.941706 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:17:47.941706 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 could not be found. Oct 29 03:17:47.941706 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:17:47.941706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Returning 404 to user: Instance cc2c36c2-406c-4847-ae8d-3fbd334c9039 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:17:47.941706 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-418e18a4-58d0-4978-b689-1c16e76ed8be tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039" status: 404 len: 111 microversion: 2.1 time: 0.080787 Oct 29 03:17:47.941706 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3077/6109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:47 2022] GET /compute/v2.1/servers/cc2c36c2-406c-4847-ae8d-3fbd334c9039 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:17:47.948148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f37bf582-dd35-459e-a62b-1d65cd314207 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '.version_select at 0x7fe1a85b3ca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:48.005014 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f37bf582-dd35-459e-a62b-1d65cd314207 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-105955857" status: 202 len: 0 microversion: 2.1 time: 0.060909 Oct 29 03:17:48.005963 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3033/6110] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 03:17:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-105955857 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:17:48.658304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dc43860f-57ad-48a7-b057-4602efc0232a tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:48.662329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dc43860f-57ad-48a7-b057-4602efc0232a tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:48.669397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc43860f-57ad-48a7-b057-4602efc0232a tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:48.671362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc43860f-57ad-48a7-b057-4602efc0232a tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:48.672771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc43860f-57ad-48a7-b057-4602efc0232a tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:48.680044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc43860f-57ad-48a7-b057-4602efc0232a tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:48.681424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc43860f-57ad-48a7-b057-4602efc0232a tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:48.683457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc43860f-57ad-48a7-b057-4602efc0232a tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:50.059321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dc43860f-57ad-48a7-b057-4602efc0232a tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:50.071840 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dc43860f-57ad-48a7-b057-4602efc0232a tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1314 microversion: 2.1 time: 1.416517 Oct 29 03:17:50.075262 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3078/6111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:48 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1314 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:51.112895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4038ad9a-c10d-410b-95ba-2d66225074b0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:51.116054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4038ad9a-c10d-410b-95ba-2d66225074b0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:51.149158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:51.156638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4038ad9a-c10d-410b-95ba-2d66225074b0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:51.157423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4038ad9a-c10d-410b-95ba-2d66225074b0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:51.158685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4038ad9a-c10d-410b-95ba-2d66225074b0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:51.160969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4038ad9a-c10d-410b-95ba-2d66225074b0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:51.163703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4038ad9a-c10d-410b-95ba-2d66225074b0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:51.166468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4038ad9a-c10d-410b-95ba-2d66225074b0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:52.018694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4038ad9a-c10d-410b-95ba-2d66225074b0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:52.036778 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4038ad9a-c10d-410b-95ba-2d66225074b0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1314 microversion: 2.1 time: 0.934614 Oct 29 03:17:52.038648 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3034/6112] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:51 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:52.159912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-2cd791a2-aad0-471d-bde0-8d0e90306b85 req-3151a80b-72a8-4921-95b4-613d129458de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b72a9fc-fd46-443d-a9a6-97ee498c9864", "tag": "4a7cd189-1b05-4340-8452-504e740a1789"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:52.171609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:52.173285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:52.180084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2cd791a2-aad0-471d-bde0-8d0e90306b85 req-3151a80b-72a8-4921-95b4-613d129458de service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:52.181012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2cd791a2-aad0-471d-bde0-8d0e90306b85 req-3151a80b-72a8-4921-95b4-613d129458de service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:52.181661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2cd791a2-aad0-471d-bde0-8d0e90306b85 req-3151a80b-72a8-4921-95b4-613d129458de service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:52.196189 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-2cd791a2-aad0-471d-bde0-8d0e90306b85 req-3151a80b-72a8-4921-95b4-613d129458de service nova] Creating event network-changed:4a7cd189-1b05-4340-8452-504e740a1789 for instance 9b72a9fc-fd46-443d-a9a6-97ee498c9864 on n-h2-862964-4 Oct 29 03:17:52.204445 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-2cd791a2-aad0-471d-bde0-8d0e90306b85 req-3151a80b-72a8-4921-95b4-613d129458de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050653 Oct 29 03:17:52.205991 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3079/6113] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:53.063447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9789145-6cd9-4eef-a2c3-d4e184cbb278 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:53.064184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c9789145-6cd9-4eef-a2c3-d4e184cbb278 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:53.085553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9789145-6cd9-4eef-a2c3-d4e184cbb278 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:53.103203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9789145-6cd9-4eef-a2c3-d4e184cbb278 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:53.103793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9789145-6cd9-4eef-a2c3-d4e184cbb278 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:53.104846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9789145-6cd9-4eef-a2c3-d4e184cbb278 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:53.108559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9789145-6cd9-4eef-a2c3-d4e184cbb278 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:53.108559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9789145-6cd9-4eef-a2c3-d4e184cbb278 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:53.511589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c9789145-6cd9-4eef-a2c3-d4e184cbb278 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:53.524217 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c9789145-6cd9-4eef-a2c3-d4e184cbb278 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1314 microversion: 2.1 time: 0.464958 Oct 29 03:17:53.540590 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3035/6114] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:53 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:54.550470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e84f8a86-8aa2-4b5b-913e-c06b142f5682 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:54.552098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e84f8a86-8aa2-4b5b-913e-c06b142f5682 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:54.562646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e84f8a86-8aa2-4b5b-913e-c06b142f5682 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:54.563130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e84f8a86-8aa2-4b5b-913e-c06b142f5682 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:54.563559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e84f8a86-8aa2-4b5b-913e-c06b142f5682 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:54.564262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e84f8a86-8aa2-4b5b-913e-c06b142f5682 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:54.564715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e84f8a86-8aa2-4b5b-913e-c06b142f5682 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:54.565135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e84f8a86-8aa2-4b5b-913e-c06b142f5682 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:55.128701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e84f8a86-8aa2-4b5b-913e-c06b142f5682 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:55.140511 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e84f8a86-8aa2-4b5b-913e-c06b142f5682 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1314 microversion: 2.1 time: 0.592097 Oct 29 03:17:55.142818 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3080/6115] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:54 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:56.168813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-87e26a94-8503-43b5-aa49-7daf308339c1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:56.170403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-87e26a94-8503-43b5-aa49-7daf308339c1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:56.188643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87e26a94-8503-43b5-aa49-7daf308339c1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:56.192602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87e26a94-8503-43b5-aa49-7daf308339c1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:56.194323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87e26a94-8503-43b5-aa49-7daf308339c1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:56.195314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87e26a94-8503-43b5-aa49-7daf308339c1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:56.197641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87e26a94-8503-43b5-aa49-7daf308339c1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:56.200574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87e26a94-8503-43b5-aa49-7daf308339c1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:56.247213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:56.859803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-87e26a94-8503-43b5-aa49-7daf308339c1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:56.880206 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-87e26a94-8503-43b5-aa49-7daf308339c1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1314 microversion: 2.1 time: 0.716876 Oct 29 03:17:56.893239 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3036/6116] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:56 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:57.962094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-195d33cf-6f61-44c0-b344-89042a89c363 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:57.963398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-195d33cf-6f61-44c0-b344-89042a89c363 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:57.985117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-195d33cf-6f61-44c0-b344-89042a89c363 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:57.985695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-195d33cf-6f61-44c0-b344-89042a89c363 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:58.000814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-195d33cf-6f61-44c0-b344-89042a89c363 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:58.024984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-195d33cf-6f61-44c0-b344-89042a89c363 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:58.025820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-195d33cf-6f61-44c0-b344-89042a89c363 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:58.029531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-195d33cf-6f61-44c0-b344-89042a89c363 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:58.789497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-195d33cf-6f61-44c0-b344-89042a89c363 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:58.805074 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-195d33cf-6f61-44c0-b344-89042a89c363 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1314 microversion: 2.1 time: 0.877975 Oct 29 03:17:58.805974 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3081/6117] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:57 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1314 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:59.836723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c974f64f-d00b-4c11-9c93-2d868a2eb8d3 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:59.838083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c974f64f-d00b-4c11-9c93-2d868a2eb8d3 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:59.857029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c974f64f-d00b-4c11-9c93-2d868a2eb8d3 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:59.863030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c974f64f-d00b-4c11-9c93-2d868a2eb8d3 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:59.863612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c974f64f-d00b-4c11-9c93-2d868a2eb8d3 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:59.864473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c974f64f-d00b-4c11-9c93-2d868a2eb8d3 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:59.865044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c974f64f-d00b-4c11-9c93-2d868a2eb8d3 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:59.865580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c974f64f-d00b-4c11-9c93-2d868a2eb8d3 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:00.284282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-29265c9d-37c2-49f5-b563-11718ac3aedf req-e777a30e-4178-4a97-aa77-bd4416edbd8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b72a9fc-fd46-443d-a9a6-97ee498c9864", "name": "network-vif-plugged", "status": "completed", "tag": "4a7cd189-1b05-4340-8452-504e740a1789"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:00.301751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-29265c9d-37c2-49f5-b563-11718ac3aedf req-e777a30e-4178-4a97-aa77-bd4416edbd8c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:00.303016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-29265c9d-37c2-49f5-b563-11718ac3aedf req-e777a30e-4178-4a97-aa77-bd4416edbd8c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:00.303695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-29265c9d-37c2-49f5-b563-11718ac3aedf req-e777a30e-4178-4a97-aa77-bd4416edbd8c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:00.338263 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-29265c9d-37c2-49f5-b563-11718ac3aedf req-e777a30e-4178-4a97-aa77-bd4416edbd8c service nova] Creating event network-vif-plugged:4a7cd189-1b05-4340-8452-504e740a1789 for instance 9b72a9fc-fd46-443d-a9a6-97ee498c9864 on n-h2-862964-4 Oct 29 03:18:00.351470 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-29265c9d-37c2-49f5-b563-11718ac3aedf req-e777a30e-4178-4a97-aa77-bd4416edbd8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072538 Oct 29 03:18:00.354111 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3082/6118] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:00.359344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c974f64f-d00b-4c11-9c93-2d868a2eb8d3 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:00.368073 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c974f64f-d00b-4c11-9c93-2d868a2eb8d3 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1314 microversion: 2.1 time: 0.535278 Oct 29 03:18:00.373548 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3037/6119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:59 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:01.403252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-366e071b-819a-4e97-ba36-7de9b1909cf1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:01.404732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-366e071b-819a-4e97-ba36-7de9b1909cf1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:01.417765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366e071b-819a-4e97-ba36-7de9b1909cf1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:01.418683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366e071b-819a-4e97-ba36-7de9b1909cf1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:01.422034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366e071b-819a-4e97-ba36-7de9b1909cf1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:01.423884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366e071b-819a-4e97-ba36-7de9b1909cf1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:01.428220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366e071b-819a-4e97-ba36-7de9b1909cf1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:01.428723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-366e071b-819a-4e97-ba36-7de9b1909cf1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:01.711855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-366e071b-819a-4e97-ba36-7de9b1909cf1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:01.724827 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-366e071b-819a-4e97-ba36-7de9b1909cf1 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1314 microversion: 2.1 time: 0.330894 Oct 29 03:18:01.726638 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3083/6120] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:01 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:18:02.326525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3a95bdbf-c8fb-4e34-bb3e-97b3ecf9ece3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:02.327110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3a95bdbf-c8fb-4e34-bb3e-97b3ecf9ece3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:02.336398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a95bdbf-c8fb-4e34-bb3e-97b3ecf9ece3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:02.337821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a95bdbf-c8fb-4e34-bb3e-97b3ecf9ece3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:02.338667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a95bdbf-c8fb-4e34-bb3e-97b3ecf9ece3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:02.339646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a95bdbf-c8fb-4e34-bb3e-97b3ecf9ece3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:02.341483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a95bdbf-c8fb-4e34-bb3e-97b3ecf9ece3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:02.342668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3a95bdbf-c8fb-4e34-bb3e-97b3ecf9ece3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:02.388168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3a95bdbf-c8fb-4e34-bb3e-97b3ecf9ece3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:18:02.561608 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3a95bdbf-c8fb-4e34-bb3e-97b3ecf9ece3 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 204 len: 0 microversion: 2.1 time: 0.239736 Oct 29 03:18:02.567695 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3038/6121] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:18:02 2022] DELETE /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:18:02.583400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce6ae949-8a15-4ea2-a6db-023e4c8f3213 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:02.584011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ce6ae949-8a15-4ea2-a6db-023e4c8f3213 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:02.606909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce6ae949-8a15-4ea2-a6db-023e4c8f3213 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:02.609832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce6ae949-8a15-4ea2-a6db-023e4c8f3213 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:02.611298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce6ae949-8a15-4ea2-a6db-023e4c8f3213 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:02.615127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce6ae949-8a15-4ea2-a6db-023e4c8f3213 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:02.616884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce6ae949-8a15-4ea2-a6db-023e4c8f3213 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:02.619803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce6ae949-8a15-4ea2-a6db-023e4c8f3213 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:02.735980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-669ebe6e-3a0c-46bf-bce1-4fc9ca437802 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:02.737267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-669ebe6e-3a0c-46bf-bce1-4fc9ca437802 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:02.745868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-669ebe6e-3a0c-46bf-bce1-4fc9ca437802 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:02.746059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-669ebe6e-3a0c-46bf-bce1-4fc9ca437802 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:02.746740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-669ebe6e-3a0c-46bf-bce1-4fc9ca437802 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:02.748273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-669ebe6e-3a0c-46bf-bce1-4fc9ca437802 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:02.749679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-669ebe6e-3a0c-46bf-bce1-4fc9ca437802 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:02.750497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-669ebe6e-3a0c-46bf-bce1-4fc9ca437802 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:02.784712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-669ebe6e-3a0c-46bf-bce1-4fc9ca437802 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:18:03.000629 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-669ebe6e-3a0c-46bf-bce1-4fc9ca437802 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "DELETE /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 204 len: 0 microversion: 2.1 time: 0.271841 Oct 29 03:18:03.001839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3039/6122] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:18:02 2022] DELETE /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:18:03.022391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3027020b-9c6d-4f7f-aac2-98fde8a4d79d tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:03.023254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3027020b-9c6d-4f7f-aac2-98fde8a4d79d tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:03.030379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3027020b-9c6d-4f7f-aac2-98fde8a4d79d tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:03.030880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3027020b-9c6d-4f7f-aac2-98fde8a4d79d tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:03.031322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3027020b-9c6d-4f7f-aac2-98fde8a4d79d tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:03.032142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3027020b-9c6d-4f7f-aac2-98fde8a4d79d tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:03.032605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3027020b-9c6d-4f7f-aac2-98fde8a4d79d tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:03.033034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3027020b-9c6d-4f7f-aac2-98fde8a4d79d tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:03.054283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ce6ae949-8a15-4ea2-a6db-023e4c8f3213 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:03.064161 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ce6ae949-8a15-4ea2-a6db-023e4c8f3213 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1506 microversion: 2.1 time: 0.496598 Oct 29 03:18:03.068159 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3084/6123] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:02 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:03.073200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f0dfd4c-ebc1-4dbf-b6d7-49c611e6eb4e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:03.082639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1f0dfd4c-ebc1-4dbf-b6d7-49c611e6eb4e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:03.098772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0dfd4c-ebc1-4dbf-b6d7-49c611e6eb4e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:03.099591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0dfd4c-ebc1-4dbf-b6d7-49c611e6eb4e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:03.100324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0dfd4c-ebc1-4dbf-b6d7-49c611e6eb4e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:03.101245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0dfd4c-ebc1-4dbf-b6d7-49c611e6eb4e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:03.101942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0dfd4c-ebc1-4dbf-b6d7-49c611e6eb4e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:03.102571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f0dfd4c-ebc1-4dbf-b6d7-49c611e6eb4e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:03.346496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3027020b-9c6d-4f7f-aac2-98fde8a4d79d tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:03.357661 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3027020b-9c6d-4f7f-aac2-98fde8a4d79d tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1462 microversion: 2.1 time: 0.354336 Oct 29 03:18:03.370949 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3040/6124] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:03 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1462 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:03.383689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5ae19ce8-2de8-4fb1-9c24-c9e793829c61 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03ed7c25-afe6-437d-b495-cbf57e1a084d", "device": "/dev/sdb"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:03.388620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5ae19ce8-2de8-4fb1-9c24-c9e793829c61 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:03.408037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ae19ce8-2de8-4fb1-9c24-c9e793829c61 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:03.408538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ae19ce8-2de8-4fb1-9c24-c9e793829c61 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:03.408977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ae19ce8-2de8-4fb1-9c24-c9e793829c61 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:03.409691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ae19ce8-2de8-4fb1-9c24-c9e793829c61 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:03.410184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ae19ce8-2de8-4fb1-9c24-c9e793829c61 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:03.415161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ae19ce8-2de8-4fb1-9c24-c9e793829c61 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:03.747562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1f0dfd4c-ebc1-4dbf-b6d7-49c611e6eb4e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:03.770147 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1f0dfd4c-ebc1-4dbf-b6d7-49c611e6eb4e tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1553 microversion: 2.1 time: 0.698143 Oct 29 03:18:03.771238 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3085/6125] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:03 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1553 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:04.090212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dcff81fd-a4a2-4fef-a8d8-62a02ef02374 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:04.091489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dcff81fd-a4a2-4fef-a8d8-62a02ef02374 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:04.114272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcff81fd-a4a2-4fef-a8d8-62a02ef02374 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:04.115462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcff81fd-a4a2-4fef-a8d8-62a02ef02374 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:04.116233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcff81fd-a4a2-4fef-a8d8-62a02ef02374 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:04.118674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcff81fd-a4a2-4fef-a8d8-62a02ef02374 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:04.119364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcff81fd-a4a2-4fef-a8d8-62a02ef02374 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:04.120237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dcff81fd-a4a2-4fef-a8d8-62a02ef02374 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:04.820015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dcff81fd-a4a2-4fef-a8d8-62a02ef02374 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:04.829212 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dcff81fd-a4a2-4fef-a8d8-62a02ef02374 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1506 microversion: 2.1 time: 0.743114 Oct 29 03:18:04.842709 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3086/6126] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:04 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1506 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:04.854019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c36d6da3-ca17-4a95-8ebf-f259cd597c6d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:04.854985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c36d6da3-ca17-4a95-8ebf-f259cd597c6d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:04.864319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c36d6da3-ca17-4a95-8ebf-f259cd597c6d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:04.864857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c36d6da3-ca17-4a95-8ebf-f259cd597c6d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:04.865375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c36d6da3-ca17-4a95-8ebf-f259cd597c6d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:04.866210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c36d6da3-ca17-4a95-8ebf-f259cd597c6d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:04.867740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c36d6da3-ca17-4a95-8ebf-f259cd597c6d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:04.868343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c36d6da3-ca17-4a95-8ebf-f259cd597c6d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:05.048577 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5ae19ce8-2de8-4fb1-9c24-c9e793829c61 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "POST /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.668638 Oct 29 03:18:05.076732 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3041/6127] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:18:03 2022] POST /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864/os-volume_attachments => generated 194 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:05.335143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c36d6da3-ca17-4a95-8ebf-f259cd597c6d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:05.346971 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c36d6da3-ca17-4a95-8ebf-f259cd597c6d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1553 microversion: 2.1 time: 0.502516 Oct 29 03:18:05.363807 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3087/6128] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:04 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1553 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:05.878118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1b9a2c94-d0f3-4d0e-8a4e-53cb6cc7e1b4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:05.879414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1b9a2c94-d0f3-4d0e-8a4e-53cb6cc7e1b4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:05.899011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b9a2c94-d0f3-4d0e-8a4e-53cb6cc7e1b4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:05.899532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b9a2c94-d0f3-4d0e-8a4e-53cb6cc7e1b4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:05.899983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b9a2c94-d0f3-4d0e-8a4e-53cb6cc7e1b4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:05.900715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b9a2c94-d0f3-4d0e-8a4e-53cb6cc7e1b4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:05.901176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b9a2c94-d0f3-4d0e-8a4e-53cb6cc7e1b4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:05.901608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b9a2c94-d0f3-4d0e-8a4e-53cb6cc7e1b4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:06.171897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-27c1d248-f08d-458e-95f0-49a896ed9657 req-f3824bc8-9367-4bb1-a1c8-016d4a9c6f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083f03bb-76fb-455c-838c-ec3e6a9be2b1", "name": "network-vif-deleted", "tag": "02254f06-dac7-4e8d-9729-e2ab40b6402d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:06.198904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-27c1d248-f08d-458e-95f0-49a896ed9657 req-f3824bc8-9367-4bb1-a1c8-016d4a9c6f62 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:06.206111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-27c1d248-f08d-458e-95f0-49a896ed9657 req-f3824bc8-9367-4bb1-a1c8-016d4a9c6f62 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:06.210157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-27c1d248-f08d-458e-95f0-49a896ed9657 req-f3824bc8-9367-4bb1-a1c8-016d4a9c6f62 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:06.250421 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-27c1d248-f08d-458e-95f0-49a896ed9657 req-f3824bc8-9367-4bb1-a1c8-016d4a9c6f62 service nova] Creating event network-vif-deleted:02254f06-dac7-4e8d-9729-e2ab40b6402d for instance 083f03bb-76fb-455c-838c-ec3e6a9be2b1 on n-h1-862964-4 Oct 29 03:18:06.263903 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-27c1d248-f08d-458e-95f0-49a896ed9657 req-f3824bc8-9367-4bb1-a1c8-016d4a9c6f62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096255 Oct 29 03:18:06.266535 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3088/6129] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:18:06.376976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:06.377587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:06.416018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:06.418245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:06.418976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:06.421984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:06.423980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:06.425254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:06.462464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b9a2c94-d0f3-4d0e-8a4e-53cb6cc7e1b4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:06.486590 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1b9a2c94-d0f3-4d0e-8a4e-53cb6cc7e1b4 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1506 microversion: 2.1 time: 0.625665 Oct 29 03:18:06.498973 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3042/6130] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:05 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:18:06.587348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:06.597839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:06.598894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:06.599835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lazy-loading 'fault' on Instance uuid 083f03bb-76fb-455c-838c-ec3e6a9be2b1 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:18:06.688673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:06.709388 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-00e0d3ab-748c-4399-85dd-9b3aaaf6bd33 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 200 len: 1339 microversion: 2.1 time: 0.336940 Oct 29 03:18:06.718533 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3089/6131] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:06 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 1339 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:06.896348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8114a97f-6c23-4041-bf49-3df0d82ce279 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:06.901072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8114a97f-6c23-4041-bf49-3df0d82ce279 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:06.921120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8114a97f-6c23-4041-bf49-3df0d82ce279 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:06.922125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8114a97f-6c23-4041-bf49-3df0d82ce279 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:06.927117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8114a97f-6c23-4041-bf49-3df0d82ce279 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:06.928143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8114a97f-6c23-4041-bf49-3df0d82ce279 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:06.929009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8114a97f-6c23-4041-bf49-3df0d82ce279 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:06.930906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8114a97f-6c23-4041-bf49-3df0d82ce279 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:06.982421 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8114a97f-6c23-4041-bf49-3df0d82ce279 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c/ips" status: 200 len: 149 microversion: 2.1 time: 0.090189 Oct 29 03:18:06.991026 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3043/6132] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:18:06 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c/ips => generated 149 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:18:06.998368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e35728a0-3bb8-4c99-a907-2082d7a1a689"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:07.002024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:07.021055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.022162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.024278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.028316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.032269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.033166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.190074 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Invalid volume: volume e35728a0-3bb8-4c99-a907-2082d7a1a689 is already attached to instances: 89aba2d7-1168-4034-be52-6377499ca509 Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c/os-volume_attachments HTTP/1.1 Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 74 Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: {"volumeAttachment": {"volumeId": "e35728a0-3bb8-4c99-a907-2082d7a1a689"}} Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid volume: volume e35728a0-3bb8-4c99-a907-2082d7a1a689 is already attached to instances: 89aba2d7-1168-4034-be52-6377499ca509 Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': '4a940222-301e-49c9-a1ed-4c8bcce9eb0c', 'body': {'volumeAttachment': {'volumeId': 'e35728a0-3bb8-4c99-a907-2082d7a1a689'}}} Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e35728a0-3bb8-4c99-a907-2082d7a1a689 is already attached to instances: 89aba2d7-1168-4034-be52-6377499ca509 Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:18:07.192648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e35728a0-3bb8-4c99-a907-2082d7a1a689 is already attached to instances: 89aba2d7-1168-4034-be52-6377499ca509 Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e35728a0-3bb8-4c99-a907-2082d7a1a689 is already attached to instances: 89aba2d7-1168-4034-be52-6377499ca509 Oct 29 03:18:07.197116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:07.202480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 400 to user: Invalid volume: volume e35728a0-3bb8-4c99-a907-2082d7a1a689 is already attached to instances: 89aba2d7-1168-4034-be52-6377499ca509 {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:18:07.203794 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-85c5eb79-4310-4660-ba56-ba5d09508835 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.212307 Oct 29 03:18:07.207547 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3090/6133] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:18:06 2022] POST /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c/os-volume_attachments => generated 174 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:18:07.216953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e344d41a-9e04-4f68-b45b-3f2cdcc73ff4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:07.217463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e344d41a-9e04-4f68-b45b-3f2cdcc73ff4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:07.228291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e344d41a-9e04-4f68-b45b-3f2cdcc73ff4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.228821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e344d41a-9e04-4f68-b45b-3f2cdcc73ff4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.230706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e344d41a-9e04-4f68-b45b-3f2cdcc73ff4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.231508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e344d41a-9e04-4f68-b45b-3f2cdcc73ff4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.231968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e344d41a-9e04-4f68-b45b-3f2cdcc73ff4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.232392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e344d41a-9e04-4f68-b45b-3f2cdcc73ff4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.297084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e344d41a-9e04-4f68-b45b-3f2cdcc73ff4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:18:07.474252 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e344d41a-9e04-4f68-b45b-3f2cdcc73ff4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 204 len: 0 microversion: 2.1 time: 0.261791 Oct 29 03:18:07.480542 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3044/6134] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:18:07 2022] DELETE /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:18:07.484712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0a155d3e-94ca-4930-81fe-481140a68cd2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:07.485567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0a155d3e-94ca-4930-81fe-481140a68cd2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:07.500595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a155d3e-94ca-4930-81fe-481140a68cd2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.504227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a155d3e-94ca-4930-81fe-481140a68cd2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.504871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a155d3e-94ca-4930-81fe-481140a68cd2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.505819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a155d3e-94ca-4930-81fe-481140a68cd2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.513505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a155d3e-94ca-4930-81fe-481140a68cd2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.519747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a155d3e-94ca-4930-81fe-481140a68cd2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.525575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:07.526256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:07.536877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.537626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.538388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.539288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.545301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.546037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.665838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.666579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.667188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.668230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lazy-loading 'fault' on Instance uuid 432b0c44-ded6-4344-8c88-27d842cfb635 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:18:07.743281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:07.769344 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-78499c8e-7bba-4735-8935-24f7ee0a9072 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 200 len: 1311 microversion: 2.1 time: 0.248134 Oct 29 03:18:07.772243 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3045/6135] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:07 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 1311 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:07.777308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:07.784988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 083f03bb-76fb-455c-838c-ec3e6a9be2b1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:07.796222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.796725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.797163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.797921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.798375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.810092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.827870 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] HTTP exception thrown: Instance 083f03bb-76fb-455c-838c-ec3e6a9be2b1 could not be found. Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Request method failure captured: Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 HTTP/1.1 Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJrkVSZkDwcR-xbx2aNwTvJT8pdDmKb2Glq9K7pRpScIFtZBFaLYs9iBtkG5F9qTWmmPYwCYMk1x5hl8O85NidzVq45b_r_iFpZ1nUJEfguSfT4xShcObPyBS9H1v-dBHAfa27QvSNY3YYYOTkRQO4OvNwNVqKQ-MhHoWhLux76dTBI Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b67b758e83034d5f903c6ca9dfa5c883 Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestNetworkBasicOps-369482432 Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b67b758e83034d5f903c6ca9dfa5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b67b758e83034d5f903c6ca9dfa5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b67b758e83034d5f903c6ca9dfa5c883", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b67b758e83034d5f903c6ca9dfa5c883"}]}] Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestNetworkBasicOps-369482432 Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b67b758e83034d5f903c6ca9dfa5c883 Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestNetworkBasicOps-369482432 Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestNetworkBasicOps-369482432-project Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 29f3383c209340adb16a7074c291b191 Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestNetworkBasicOps-369482432-project Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 083f03bb-76fb-455c-838c-ec3e6a9be2b1 could not be found. Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '083f03bb-76fb-455c-838c-ec3e6a9be2b1'} Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083f03bb-76fb-455c-838c-ec3e6a9be2b1 could not be found. Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083f03bb-76fb-455c-838c-ec3e6a9be2b1 could not be found. Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:07.844742 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:07.849912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:07.849912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:07.849912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:07.849912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:18:07.849912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:18:07.849912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083f03bb-76fb-455c-838c-ec3e6a9be2b1 could not be found. Oct 29 03:18:07.849912 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:07.849912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Returning 404 to user: Instance 083f03bb-76fb-455c-838c-ec3e6a9be2b1 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:18:07.849912 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f9912ad-2a9d-4fae-bcf3-d500190e176d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1" status: 404 len: 111 microversion: 2.1 time: 0.075222 Oct 29 03:18:07.853787 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3046/6136] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:07 2022] GET /compute/v2.1/servers/083f03bb-76fb-455c-838c-ec3e6a9be2b1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:18:07.872726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0a155d3e-94ca-4930-81fe-481140a68cd2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:07.883731 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0a155d3e-94ca-4930-81fe-481140a68cd2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1681 microversion: 2.1 time: 0.402860 Oct 29 03:18:07.887694 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3091/6137] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:07 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1681 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:08.168043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-941649ae-6386-4c03-9cef-7434ff1b2b77 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '.version_select at 0x7fe1a3f73160>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:08.213740 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-941649ae-6386-4c03-9cef-7434ff1b2b77 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1734719945" status: 202 len: 0 microversion: 2.1 time: 0.049937 Oct 29 03:18:08.214372 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3047/6138] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Oct 29 03:18:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1734719945 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:18:08.300241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f90678f9-a700-434d-adf4-a0a56e0ef964 req-971cc6bb-7e0f-43ec-a335-2402a9f12b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432b0c44-ded6-4344-8c88-27d842cfb635", "name": "network-vif-deleted", "tag": "cf125b0e-e530-4df4-8a3d-a952bc6a5281"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:08.321263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f90678f9-a700-434d-adf4-a0a56e0ef964 req-971cc6bb-7e0f-43ec-a335-2402a9f12b2b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:08.322693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f90678f9-a700-434d-adf4-a0a56e0ef964 req-971cc6bb-7e0f-43ec-a335-2402a9f12b2b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:08.323552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f90678f9-a700-434d-adf4-a0a56e0ef964 req-971cc6bb-7e0f-43ec-a335-2402a9f12b2b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:08.342228 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f90678f9-a700-434d-adf4-a0a56e0ef964 req-971cc6bb-7e0f-43ec-a335-2402a9f12b2b service nova] Creating event network-vif-deleted:cf125b0e-e530-4df4-8a3d-a952bc6a5281 for instance 432b0c44-ded6-4344-8c88-27d842cfb635 on n-h2-862964-4 Oct 29 03:18:08.348792 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f90678f9-a700-434d-adf4-a0a56e0ef964 req-971cc6bb-7e0f-43ec-a335-2402a9f12b2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057373 Oct 29 03:18:08.351014 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3092/6139] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:08.800072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:08.800861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 432b0c44-ded6-4344-8c88-27d842cfb635] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:08.816370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:08.817103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:08.818853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:08.819737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:08.822105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:08.822618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:08.880303 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] HTTP exception thrown: Instance 432b0c44-ded6-4344-8c88-27d842cfb635 could not be found. Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Request method failure captured: Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 HTTP/1.1 Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJpRn_7hoOfvObzqA-ZLLdT0Ldg_y6elYIAF6FaT28sdj-TKjsGF45L6GmeVGfwMnSs4H8JoHZrc7By31zLGvou-MnR3pglqzR_y5cbEOWkNw533fNI-OxPHdxTNrRl2C5LEagXcPpESr9s5MAeq27S7NZgAah_V7oaKcjpRtmQEpM8 Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_552af5aaae3f49fdb5cc8ea8ec4ccdec", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}] Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 89a693133ded46eba2b9b70e899f38f9 Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 432b0c44-ded6-4344-8c88-27d842cfb635 could not be found. Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '432b0c44-ded6-4344-8c88-27d842cfb635'} Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 432b0c44-ded6-4344-8c88-27d842cfb635 could not be found. Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 432b0c44-ded6-4344-8c88-27d842cfb635 could not be found. Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:08.882387 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:08.887767 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:08.887767 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:08.887767 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:08.887767 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:08.887767 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:18:08.887767 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:18:08.887767 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 432b0c44-ded6-4344-8c88-27d842cfb635 could not be found. Oct 29 03:18:08.887767 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:08.888920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Returning 404 to user: Instance 432b0c44-ded6-4344-8c88-27d842cfb635 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:18:08.897586 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1e65bc62-bf84-454c-9d91-661f7387f3c6 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635" status: 404 len: 111 microversion: 2.1 time: 0.102453 Oct 29 03:18:08.898413 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3048/6140] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:08 2022] GET /compute/v2.1/servers/432b0c44-ded6-4344-8c88-27d842cfb635 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:18:08.909229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5b6371de-7e0d-4388-a61e-4534e7c80277 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:08.910093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5b6371de-7e0d-4388-a61e-4534e7c80277 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:08.913384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2c82d74a-3500-4ce8-b3ae-355f964d0c10 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:08.914133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2c82d74a-3500-4ce8-b3ae-355f964d0c10 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:08.925431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b6371de-7e0d-4388-a61e-4534e7c80277 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:08.934032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c82d74a-3500-4ce8-b3ae-355f964d0c10 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:08.934848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c82d74a-3500-4ce8-b3ae-355f964d0c10 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:08.935582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c82d74a-3500-4ce8-b3ae-355f964d0c10 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:08.935717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b6371de-7e0d-4388-a61e-4534e7c80277 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:08.936111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b6371de-7e0d-4388-a61e-4534e7c80277 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:08.936859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b6371de-7e0d-4388-a61e-4534e7c80277 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:08.940783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b6371de-7e0d-4388-a61e-4534e7c80277 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:08.941247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b6371de-7e0d-4388-a61e-4534e7c80277 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:08.943437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c82d74a-3500-4ce8-b3ae-355f964d0c10 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:08.944375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c82d74a-3500-4ce8-b3ae-355f964d0c10 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:08.945049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c82d74a-3500-4ce8-b3ae-355f964d0c10 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:08.954962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:09.021556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5b6371de-7e0d-4388-a61e-4534e7c80277 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:18:09.121708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:09.169211 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5b6371de-7e0d-4388-a61e-4534e7c80277 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 204 len: 0 microversion: 2.1 time: 0.265592 Oct 29 03:18:09.171437 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3093/6141] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:18:08 2022] DELETE /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:18:09.184147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-394ef826-68f9-4177-8a5c-211ac577a3e2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:09.186355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-394ef826-68f9-4177-8a5c-211ac577a3e2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:09.194143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-394ef826-68f9-4177-8a5c-211ac577a3e2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:09.195104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-394ef826-68f9-4177-8a5c-211ac577a3e2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:09.195785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-394ef826-68f9-4177-8a5c-211ac577a3e2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:09.196815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-394ef826-68f9-4177-8a5c-211ac577a3e2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:09.197478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-394ef826-68f9-4177-8a5c-211ac577a3e2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:09.198237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-394ef826-68f9-4177-8a5c-211ac577a3e2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:09.890125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c82d74a-3500-4ce8-b3ae-355f964d0c10 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:09.912184 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2c82d74a-3500-4ce8-b3ae-355f964d0c10 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1681 microversion: 2.1 time: 1.002196 Oct 29 03:18:09.926931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-394ef826-68f9-4177-8a5c-211ac577a3e2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:09.942746 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-394ef826-68f9-4177-8a5c-211ac577a3e2 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.763193 Oct 29 03:18:09.944273 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3094/6143] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:09 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:09.961929 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3049/6143] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:08 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1681 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:18:10.949056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a03c5409-87d4-48b2-bd3f-10ce67838b63 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:10.955135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a03c5409-87d4-48b2-bd3f-10ce67838b63 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:10.967950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0d6808fd-6d9c-4f01-a9a1-fd90688e5f09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:10.969169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0d6808fd-6d9c-4f01-a9a1-fd90688e5f09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:10.989782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a03c5409-87d4-48b2-bd3f-10ce67838b63 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:10.990310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a03c5409-87d4-48b2-bd3f-10ce67838b63 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:10.990751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a03c5409-87d4-48b2-bd3f-10ce67838b63 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:10.991465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a03c5409-87d4-48b2-bd3f-10ce67838b63 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:10.991918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a03c5409-87d4-48b2-bd3f-10ce67838b63 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:10.992652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a03c5409-87d4-48b2-bd3f-10ce67838b63 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:10.998486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d6808fd-6d9c-4f01-a9a1-fd90688e5f09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:10.998994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d6808fd-6d9c-4f01-a9a1-fd90688e5f09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:10.999436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d6808fd-6d9c-4f01-a9a1-fd90688e5f09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:11.000174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d6808fd-6d9c-4f01-a9a1-fd90688e5f09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:11.000630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d6808fd-6d9c-4f01-a9a1-fd90688e5f09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:11.001056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0d6808fd-6d9c-4f01-a9a1-fd90688e5f09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:11.361022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0d6808fd-6d9c-4f01-a9a1-fd90688e5f09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:11.371901 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0d6808fd-6d9c-4f01-a9a1-fd90688e5f09 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 0.408612 Oct 29 03:18:11.380051 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3050/6144] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:10 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:11.502541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a03c5409-87d4-48b2-bd3f-10ce67838b63 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:11.514543 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a03c5409-87d4-48b2-bd3f-10ce67838b63 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1614 microversion: 2.1 time: 0.569440 Oct 29 03:18:11.515138 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3095/6145] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:10 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1614 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:11.603827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-7b9c69e2-988b-489b-a487-6d2cde24cb4c req-f9a1a2d9-9be7-4e5b-a891-bb9672df2232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a940222-301e-49c9-a1ed-4c8bcce9eb0c", "name": "network-vif-deleted", "tag": "9e2c3995-42d3-4817-825b-8fb0a1d7d939"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:11.620857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7b9c69e2-988b-489b-a487-6d2cde24cb4c req-f9a1a2d9-9be7-4e5b-a891-bb9672df2232 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:11.632190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7b9c69e2-988b-489b-a487-6d2cde24cb4c req-f9a1a2d9-9be7-4e5b-a891-bb9672df2232 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:11.632899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7b9c69e2-988b-489b-a487-6d2cde24cb4c req-f9a1a2d9-9be7-4e5b-a891-bb9672df2232 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:11.658349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-7b9c69e2-988b-489b-a487-6d2cde24cb4c req-f9a1a2d9-9be7-4e5b-a891-bb9672df2232 service nova] Creating event network-vif-deleted:9e2c3995-42d3-4817-825b-8fb0a1d7d939 for instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c on n-h1-862964-4 Oct 29 03:18:11.674245 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-7b9c69e2-988b-489b-a487-6d2cde24cb4c req-f9a1a2d9-9be7-4e5b-a891-bb9672df2232 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074476 Oct 29 03:18:11.675605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3051/6146] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:12.406383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dc94b3f3-f622-43b3-97af-bb821b7ad525 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:12.407650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dc94b3f3-f622-43b3-97af-bb821b7ad525 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:12.417314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc94b3f3-f622-43b3-97af-bb821b7ad525 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:12.418283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc94b3f3-f622-43b3-97af-bb821b7ad525 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:12.418902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc94b3f3-f622-43b3-97af-bb821b7ad525 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:12.422929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc94b3f3-f622-43b3-97af-bb821b7ad525 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:12.423776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc94b3f3-f622-43b3-97af-bb821b7ad525 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:12.424382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc94b3f3-f622-43b3-97af-bb821b7ad525 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:12.544533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:12.545376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:12.573198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:12.573825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:12.580962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:12.581744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:12.586455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:12.586913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:12.665389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:12.666336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:12.666932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:12.667543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lazy-loading 'fault' on Instance uuid 4a940222-301e-49c9-a1ed-4c8bcce9eb0c {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:18:12.747713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:12.756622 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f020ea24-b038-44fe-af3d-b06073149095 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 200 len: 1332 microversion: 2.1 time: 0.217123 Oct 29 03:18:12.757894 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3052/6147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:12 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 1332 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:13.417685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dc94b3f3-f622-43b3-97af-bb821b7ad525 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:13.431142 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dc94b3f3-f622-43b3-97af-bb821b7ad525 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1520 microversion: 2.1 time: 1.029808 Oct 29 03:18:13.452497 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3096/6148] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:12 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1520 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:13.781078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:13.782633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:13.795437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0bf9127-eacc-4b31-9217-aaa43ac4f3d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:13.795954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0bf9127-eacc-4b31-9217-aaa43ac4f3d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:13.814899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0bf9127-eacc-4b31-9217-aaa43ac4f3d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:13.815600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:13.816420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:13.817138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0bf9127-eacc-4b31-9217-aaa43ac4f3d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:13.817837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:13.818533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0bf9127-eacc-4b31-9217-aaa43ac4f3d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:13.819552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:13.823372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0bf9127-eacc-4b31-9217-aaa43ac4f3d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:13.824168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:13.825153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:13.825844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0bf9127-eacc-4b31-9217-aaa43ac4f3d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:13.826689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0bf9127-eacc-4b31-9217-aaa43ac4f3d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:13.894499 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c HTTP/1.1 Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '4a940222-301e-49c9-a1ed-4c8bcce9eb0c'} Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:13.900713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:13.905770 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:13.905770 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:13.905770 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:13.905770 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:18:13.905770 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:18:13.905770 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:18:13.905770 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:18:13.910503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:18:13.916514 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9d240b62-0169-4e92-933f-0fbc86daad9b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 404 len: 111 microversion: 2.1 time: 0.136613 Oct 29 03:18:13.917490 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3053/6149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:13 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:18:13.928641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-fa3e1f44-233c-47af-8869-1568a4b6a709 req-df639db2-5b9b-441c-8297-9faf467011d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20910431-5b8e-4048-9c7f-e1371ccc60bc", "tag": "07f9ee21-a2db-4276-bb07-41cd48d0ca2c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:13.943699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0bf9127-eacc-4b31-9217-aaa43ac4f3d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:18:13.956464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fa3e1f44-233c-47af-8869-1568a4b6a709 req-df639db2-5b9b-441c-8297-9faf467011d2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:13.957964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fa3e1f44-233c-47af-8869-1568a4b6a709 req-df639db2-5b9b-441c-8297-9faf467011d2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:13.960949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fa3e1f44-233c-47af-8869-1568a4b6a709 req-df639db2-5b9b-441c-8297-9faf467011d2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:13.997932 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-fa3e1f44-233c-47af-8869-1568a4b6a709 req-df639db2-5b9b-441c-8297-9faf467011d2 service nova] Creating event network-changed:07f9ee21-a2db-4276-bb07-41cd48d0ca2c for instance 20910431-5b8e-4048-9c7f-e1371ccc60bc on n-h1-862964-4 Oct 29 03:18:14.009133 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-fa3e1f44-233c-47af-8869-1568a4b6a709 req-df639db2-5b9b-441c-8297-9faf467011d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084455 Oct 29 03:18:14.010452 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3054/6150] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:14.017682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e0612fb-ac91-4778-85b0-0316abc3654e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '.version_select at 0x7fe1a85b6f70>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:14.079282 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e0612fb-ac91-4778-85b0-0316abc3654e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006241641" status: 202 len: 0 microversion: 2.1 time: 0.066869 Oct 29 03:18:14.082381 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3055/6151] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:18:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006241641 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:18:14.211577 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d0bf9127-eacc-4b31-9217-aaa43ac4f3d9 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "DELETE /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 204 len: 0 microversion: 2.1 time: 0.416990 Oct 29 03:18:14.218205 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3097/6152] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:18:13 2022] DELETE /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:18:14.228218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c161d5e5-66a6-4bbc-b02c-92739c8718f0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:14.228962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c161d5e5-66a6-4bbc-b02c-92739c8718f0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:14.246034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c161d5e5-66a6-4bbc-b02c-92739c8718f0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:14.246668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c161d5e5-66a6-4bbc-b02c-92739c8718f0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:14.247162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c161d5e5-66a6-4bbc-b02c-92739c8718f0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:14.247887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c161d5e5-66a6-4bbc-b02c-92739c8718f0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:14.248348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c161d5e5-66a6-4bbc-b02c-92739c8718f0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:14.248777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c161d5e5-66a6-4bbc-b02c-92739c8718f0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:14.460973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2d60f42-6af7-47b8-9ed5-b3e30073dc75 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:14.461757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2d60f42-6af7-47b8-9ed5-b3e30073dc75 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:14.478035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2d60f42-6af7-47b8-9ed5-b3e30073dc75 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:14.478674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2d60f42-6af7-47b8-9ed5-b3e30073dc75 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:14.479134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2d60f42-6af7-47b8-9ed5-b3e30073dc75 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:14.479882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2d60f42-6af7-47b8-9ed5-b3e30073dc75 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:14.480412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2d60f42-6af7-47b8-9ed5-b3e30073dc75 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:14.480840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2d60f42-6af7-47b8-9ed5-b3e30073dc75 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:14.571676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c161d5e5-66a6-4bbc-b02c-92739c8718f0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:14.586465 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c161d5e5-66a6-4bbc-b02c-92739c8718f0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1670 microversion: 2.1 time: 0.362523 Oct 29 03:18:14.587364 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3056/6153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:14 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1670 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:14.704307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2d60f42-6af7-47b8-9ed5-b3e30073dc75 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:14.717792 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2d60f42-6af7-47b8-9ed5-b3e30073dc75 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1478 microversion: 2.1 time: 0.262420 Oct 29 03:18:14.720593 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3098/6154] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:14 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1478 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:15.615422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fbe4ac8b-7db0-4f92-815a-3e5a61ce3851 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:15.616039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fbe4ac8b-7db0-4f92-815a-3e5a61ce3851 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:15.628364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac8b-7db0-4f92-815a-3e5a61ce3851 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:15.629155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac8b-7db0-4f92-815a-3e5a61ce3851 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:15.629750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac8b-7db0-4f92-815a-3e5a61ce3851 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:15.630649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac8b-7db0-4f92-815a-3e5a61ce3851 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:15.631258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac8b-7db0-4f92-815a-3e5a61ce3851 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:15.631991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac8b-7db0-4f92-815a-3e5a61ce3851 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:15.743659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:15.744538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:15.759402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:15.760207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:15.760822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:15.762003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:15.762635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:15.763596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:15.808670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:15.809386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:15.810496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:15.811135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lazy-loading 'fault' on Instance uuid 37fd6874-8c38-4df7-aa0b-a77fc38850bc {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:18:15.904857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a693133ded46eba2b9b70e899f38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:15.920363 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4baa35c3-fcc0-4fa4-b8ce-d9392f060ecf tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 200 len: 1311 microversion: 2.1 time: 0.180775 Oct 29 03:18:15.921321 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3099/6155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:15 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 1311 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:18:16.036039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-66e4e662-b5b7-4443-a18c-dd108a805f6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:16.036484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-66e4e662-b5b7-4443-a18c-dd108a805f6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:16.038666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:16.055261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e4e662-b5b7-4443-a18c-dd108a805f6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:16.055988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e4e662-b5b7-4443-a18c-dd108a805f6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:16.056596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e4e662-b5b7-4443-a18c-dd108a805f6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:16.058567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e4e662-b5b7-4443-a18c-dd108a805f6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:16.068785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e4e662-b5b7-4443-a18c-dd108a805f6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:16.069562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66e4e662-b5b7-4443-a18c-dd108a805f6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:16.078814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fbe4ac8b-7db0-4f92-815a-3e5a61ce3851 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:16.087499 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fbe4ac8b-7db0-4f92-815a-3e5a61ce3851 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1670 microversion: 2.1 time: 0.476486 Oct 29 03:18:16.096014 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3057/6156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:15 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1670 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:16.100880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-e20d44f6-36f6-4644-84ca-64bcaefccc9d req-f384d93c-0993-4898-b506-31fac52e3720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fd6874-8c38-4df7-aa0b-a77fc38850bc", "name": "network-vif-deleted", "tag": "c7e8fc92-fda8-403c-bb0f-155bfdcc3152"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:16.126481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e20d44f6-36f6-4644-84ca-64bcaefccc9d req-f384d93c-0993-4898-b506-31fac52e3720 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:16.126959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e20d44f6-36f6-4644-84ca-64bcaefccc9d req-f384d93c-0993-4898-b506-31fac52e3720 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:16.127385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e20d44f6-36f6-4644-84ca-64bcaefccc9d req-f384d93c-0993-4898-b506-31fac52e3720 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:16.150392 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-e20d44f6-36f6-4644-84ca-64bcaefccc9d req-f384d93c-0993-4898-b506-31fac52e3720 service nova] Creating event network-vif-deleted:c7e8fc92-fda8-403c-bb0f-155bfdcc3152 for instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc on n-h1-862964-4 Oct 29 03:18:16.167753 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-e20d44f6-36f6-4644-84ca-64bcaefccc9d req-f384d93c-0993-4898-b506-31fac52e3720 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070285 Oct 29 03:18:16.168956 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3058/6157] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:16.203853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-66e4e662-b5b7-4443-a18c-dd108a805f6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lazy-loading 'services' on Instance uuid 89aba2d7-1168-4034-be52-6377499ca509 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:18:16.337183 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-66e4e662-b5b7-4443-a18c-dd108a805f6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments/e35728a0-3bb8-4c99-a907-2082d7a1a689" status: 202 len: 0 microversion: 2.1 time: 0.298584 Oct 29 03:18:16.342388 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3100/6158] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:18:16 2022] DELETE /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments/e35728a0-3bb8-4c99-a907-2082d7a1a689 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:18:16.353306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-35bb816e-fc74-401f-9c0d-183b95071107 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:16.357635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-35bb816e-fc74-401f-9c0d-183b95071107 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:16.378408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35bb816e-fc74-401f-9c0d-183b95071107 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:16.379194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35bb816e-fc74-401f-9c0d-183b95071107 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:16.380241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35bb816e-fc74-401f-9c0d-183b95071107 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:16.383127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35bb816e-fc74-401f-9c0d-183b95071107 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:16.383750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35bb816e-fc74-401f-9c0d-183b95071107 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:16.385668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35bb816e-fc74-401f-9c0d-183b95071107 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:16.478079 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-35bb816e-fc74-401f-9c0d-183b95071107 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129342 Oct 29 03:18:16.482809 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3059/6159] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:16 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:16.946815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:16.948748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] [instance: 37fd6874-8c38-4df7-aa0b-a77fc38850bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:16.957567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:16.958318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:16.958958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:16.959900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:16.960521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:16.961117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:16.976447 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] HTTP exception thrown: Instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc could not be found. Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Request method failure captured: Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc HTTP/1.1 Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJpRn_7hoOfvObzqA-ZLLdT0Ldg_y6elYIAF6FaT28sdj-TKjsGF45L6GmeVGfwMnSs4H8JoHZrc7By31zLGvou-MnR3pglqzR_y5cbEOWkNw533fNI-OxPHdxTNrRl2C5LEagXcPpESr9s5MAeq27S7NZgAah_V7oaKcjpRtmQEpM8 Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_552af5aaae3f49fdb5cc8ea8ec4ccdec", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/552af5aaae3f49fdb5cc8ea8ec4ccdec"}]}] Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 552af5aaae3f49fdb5cc8ea8ec4ccdec Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1350410865 Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 89a693133ded46eba2b9b70e899f38f9 Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1350410865-project Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc could not be found. Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '37fd6874-8c38-4df7-aa0b-a77fc38850bc'} Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc could not be found. Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc could not be found. Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:16.978156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:16.983308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:16.983308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:16.983308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:16.983308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:16.983308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:18:16.983308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:18:16.983308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc could not be found. Oct 29 03:18:16.983308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:16.985205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] Returning 404 to user: Instance 37fd6874-8c38-4df7-aa0b-a77fc38850bc could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:18:16.986114 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ea0ce3c2-7580-4bb4-bc9d-20f82e813d22 tempest-ServerRescueNegativeTestJSON-1350410865 tempest-ServerRescueNegativeTestJSON-1350410865-project] 10.222.0.16 "GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc" status: 404 len: 111 microversion: 2.1 time: 0.045998 Oct 29 03:18:16.987315 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3101/6160] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:16 2022] GET /compute/v2.1/servers/37fd6874-8c38-4df7-aa0b-a77fc38850bc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:18:17.119442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:17.121591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:17.139186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:17.139751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:17.140317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:17.141412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:17.142510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:17.142510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:17.194825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:17.195793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:17.196712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:17.198986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lazy-loading 'fault' on Instance uuid 20910431-5b8e-4048-9c7f-e1371ccc60bc {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:18:17.295836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:17.308634 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29614927-88c5-4d10-9b15-afd47baf7a07 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 200 len: 1337 microversion: 2.1 time: 0.193570 Oct 29 03:18:17.324218 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3060/6161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:17 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 1337 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:17.494306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8b1c58d0-f6a9-4640-9eba-484f7d0a1aea tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:17.497533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8b1c58d0-f6a9-4640-9eba-484f7d0a1aea tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:17.516964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b1c58d0-f6a9-4640-9eba-484f7d0a1aea tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:17.517723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b1c58d0-f6a9-4640-9eba-484f7d0a1aea tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:17.518530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b1c58d0-f6a9-4640-9eba-484f7d0a1aea tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:17.520782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b1c58d0-f6a9-4640-9eba-484f7d0a1aea tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:17.522084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b1c58d0-f6a9-4640-9eba-484f7d0a1aea tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:17.522679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b1c58d0-f6a9-4640-9eba-484f7d0a1aea tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:17.571064 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8b1c58d0-f6a9-4640-9eba-484f7d0a1aea tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079380 Oct 29 03:18:17.572446 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3102/6162] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:17 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:18.236927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-47d967c8-6f7e-4ffe-9d2f-2b66a9f56585 req-2616ab7c-2cd8-4152-a303-ef1ea399b053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20910431-5b8e-4048-9c7f-e1371ccc60bc", "name": "network-vif-deleted", "tag": "07f9ee21-a2db-4276-bb07-41cd48d0ca2c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:18.256831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-47d967c8-6f7e-4ffe-9d2f-2b66a9f56585 req-2616ab7c-2cd8-4152-a303-ef1ea399b053 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:18.257159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-47d967c8-6f7e-4ffe-9d2f-2b66a9f56585 req-2616ab7c-2cd8-4152-a303-ef1ea399b053 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:18.257920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-47d967c8-6f7e-4ffe-9d2f-2b66a9f56585 req-2616ab7c-2cd8-4152-a303-ef1ea399b053 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:18.307018 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-47d967c8-6f7e-4ffe-9d2f-2b66a9f56585 req-2616ab7c-2cd8-4152-a303-ef1ea399b053 service nova] Creating event network-vif-deleted:07f9ee21-a2db-4276-bb07-41cd48d0ca2c for instance 20910431-5b8e-4048-9c7f-e1371ccc60bc on n-h1-862964-4 Oct 29 03:18:18.318447 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-47d967c8-6f7e-4ffe-9d2f-2b66a9f56585 req-2616ab7c-2cd8-4152-a303-ef1ea399b053 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085754 Oct 29 03:18:18.319736 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3061/6163] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:18.337943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:18.339066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 20910431-5b8e-4048-9c7f-e1371ccc60bc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:18.352277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:18.355084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:18.355501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:18.358551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:18.359155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:18.360078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:18.395680 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] HTTP exception thrown: Instance 20910431-5b8e-4048-9c7f-e1371ccc60bc could not be found. Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Request method failure captured: Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc HTTP/1.1 Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJrkVSZkDwcR-xbx2aNwTvJT8pdDmKb2Glq9K7pRpScIFtZBFaLYs9iBtkG5F9qTWmmPYwCYMk1x5hl8O85NidzVq45b_r_iFpZ1nUJEfguSfT4xShcObPyBS9H1v-dBHAfa27QvSNY3YYYOTkRQO4OvNwNVqKQ-MhHoWhLux76dTBI Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b67b758e83034d5f903c6ca9dfa5c883 Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestNetworkBasicOps-369482432 Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b67b758e83034d5f903c6ca9dfa5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b67b758e83034d5f903c6ca9dfa5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b67b758e83034d5f903c6ca9dfa5c883", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b67b758e83034d5f903c6ca9dfa5c883"}]}] Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestNetworkBasicOps-369482432 Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b67b758e83034d5f903c6ca9dfa5c883 Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestNetworkBasicOps-369482432 Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestNetworkBasicOps-369482432-project Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 29f3383c209340adb16a7074c291b191 Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestNetworkBasicOps-369482432-project Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 20910431-5b8e-4048-9c7f-e1371ccc60bc could not be found. Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '20910431-5b8e-4048-9c7f-e1371ccc60bc'} Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20910431-5b8e-4048-9c7f-e1371ccc60bc could not be found. Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20910431-5b8e-4048-9c7f-e1371ccc60bc could not be found. Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:18.398507 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:18.404308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:18.404308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:18.404308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:18.404308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:18:18.404308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:18:18.404308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20910431-5b8e-4048-9c7f-e1371ccc60bc could not be found. Oct 29 03:18:18.404308 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:18.404308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Returning 404 to user: Instance 20910431-5b8e-4048-9c7f-e1371ccc60bc could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:18:18.404308 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f7a3185d-f635-4275-a7d1-9a0f521a9675 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc" status: 404 len: 111 microversion: 2.1 time: 0.068826 Oct 29 03:18:18.405877 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3103/6164] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:18 2022] GET /compute/v2.1/servers/20910431-5b8e-4048-9c7f-e1371ccc60bc => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:18:18.591869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-21d4857a-6146-47e5-84cc-b73b8665e96a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:18.594297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-21d4857a-6146-47e5-84cc-b73b8665e96a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:18.608552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21d4857a-6146-47e5-84cc-b73b8665e96a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:18.609048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21d4857a-6146-47e5-84cc-b73b8665e96a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:18.609484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21d4857a-6146-47e5-84cc-b73b8665e96a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:18.610232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21d4857a-6146-47e5-84cc-b73b8665e96a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:18.610683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21d4857a-6146-47e5-84cc-b73b8665e96a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:18.611107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21d4857a-6146-47e5-84cc-b73b8665e96a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:18.715299 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-21d4857a-6146-47e5-84cc-b73b8665e96a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128846 Oct 29 03:18:18.724256 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3062/6165] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:18 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:18.981557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f0584bed-a099-42d6-9aa0-8a85793c45db tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '.version_select at 0x7fe1acd00e50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:19.012766 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f0584bed-a099-42d6-9aa0-8a85793c45db tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-746602752" status: 202 len: 0 microversion: 2.1 time: 0.033968 Oct 29 03:18:19.018437 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3104/6166] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 03:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-746602752 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:18:19.734618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-972f8437-d8ea-4eb6-8828-104ead304823 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:19.738544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-972f8437-d8ea-4eb6-8828-104ead304823 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:19.757623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-972f8437-d8ea-4eb6-8828-104ead304823 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:19.760487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-972f8437-d8ea-4eb6-8828-104ead304823 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:19.761173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-972f8437-d8ea-4eb6-8828-104ead304823 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:19.764694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-972f8437-d8ea-4eb6-8828-104ead304823 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:19.768537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-972f8437-d8ea-4eb6-8828-104ead304823 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:19.769264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-972f8437-d8ea-4eb6-8828-104ead304823 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:19.854847 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-972f8437-d8ea-4eb6-8828-104ead304823 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125825 Oct 29 03:18:19.858801 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3063/6167] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:19 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:20.873335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0b355d0-021c-40fa-8233-8cbaeddbb412 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:20.875022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b0b355d0-021c-40fa-8233-8cbaeddbb412 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:20.888564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0b355d0-021c-40fa-8233-8cbaeddbb412 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:20.889388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0b355d0-021c-40fa-8233-8cbaeddbb412 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:20.890051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0b355d0-021c-40fa-8233-8cbaeddbb412 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:20.892018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0b355d0-021c-40fa-8233-8cbaeddbb412 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:20.892688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0b355d0-021c-40fa-8233-8cbaeddbb412 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:20.893960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0b355d0-021c-40fa-8233-8cbaeddbb412 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:20.955757 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b0b355d0-021c-40fa-8233-8cbaeddbb412 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088882 Oct 29 03:18:20.957192 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3105/6168] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:20 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:21.968878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-307d4fbc-b1e2-433e-8e53-d69ff2c0507d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:21.976371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-307d4fbc-b1e2-433e-8e53-d69ff2c0507d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:22.006322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:22.007915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307d4fbc-b1e2-433e-8e53-d69ff2c0507d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:22.008446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307d4fbc-b1e2-433e-8e53-d69ff2c0507d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:22.008884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307d4fbc-b1e2-433e-8e53-d69ff2c0507d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:22.009718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307d4fbc-b1e2-433e-8e53-d69ff2c0507d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:22.010320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307d4fbc-b1e2-433e-8e53-d69ff2c0507d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:22.010837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-307d4fbc-b1e2-433e-8e53-d69ff2c0507d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:22.135309 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-307d4fbc-b1e2-433e-8e53-d69ff2c0507d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170253 Oct 29 03:18:22.135816 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3064/6169] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:21 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:23.148286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4618f11d-272a-4be7-905b-f150b782aa5c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:23.152128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4618f11d-272a-4be7-905b-f150b782aa5c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:23.171000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4618f11d-272a-4be7-905b-f150b782aa5c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:23.174428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4618f11d-272a-4be7-905b-f150b782aa5c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:23.177143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4618f11d-272a-4be7-905b-f150b782aa5c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:23.178216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4618f11d-272a-4be7-905b-f150b782aa5c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:23.186180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4618f11d-272a-4be7-905b-f150b782aa5c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:23.189493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4618f11d-272a-4be7-905b-f150b782aa5c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:23.315002 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4618f11d-272a-4be7-905b-f150b782aa5c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170925 Oct 29 03:18:23.325276 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3106/6170] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:23 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:24.331335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4c8a0bfe-4dce-46b1-8bc7-3ba57628b058 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:24.335127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4c8a0bfe-4dce-46b1-8bc7-3ba57628b058 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:24.364788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8a0bfe-4dce-46b1-8bc7-3ba57628b058 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:24.382655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8a0bfe-4dce-46b1-8bc7-3ba57628b058 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:24.384880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8a0bfe-4dce-46b1-8bc7-3ba57628b058 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:24.388230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8a0bfe-4dce-46b1-8bc7-3ba57628b058 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:24.391577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8a0bfe-4dce-46b1-8bc7-3ba57628b058 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:24.393107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4c8a0bfe-4dce-46b1-8bc7-3ba57628b058 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:24.573321 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4c8a0bfe-4dce-46b1-8bc7-3ba57628b058 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.246519 Oct 29 03:18:24.582317 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3065/6171] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:24 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments => generated 197 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:25.588633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-becdd4e9-7482-4bea-a608-f5ba1cffb194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:25.604462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-becdd4e9-7482-4bea-a608-f5ba1cffb194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:25.613141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-becdd4e9-7482-4bea-a608-f5ba1cffb194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:25.614053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-becdd4e9-7482-4bea-a608-f5ba1cffb194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:25.614669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-becdd4e9-7482-4bea-a608-f5ba1cffb194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:25.615558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-becdd4e9-7482-4bea-a608-f5ba1cffb194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:25.616168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-becdd4e9-7482-4bea-a608-f5ba1cffb194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:25.616752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-becdd4e9-7482-4bea-a608-f5ba1cffb194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:25.726198 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-becdd4e9-7482-4bea-a608-f5ba1cffb194 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.141461 Oct 29 03:18:25.727916 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3107/6172] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:25 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:18:25.947427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9f25a743-7a4a-4d54-82ab-045e442325ee tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:25.950453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9f25a743-7a4a-4d54-82ab-045e442325ee tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:25.971546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f25a743-7a4a-4d54-82ab-045e442325ee tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:25.972606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f25a743-7a4a-4d54-82ab-045e442325ee tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:25.975491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f25a743-7a4a-4d54-82ab-045e442325ee tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:25.976265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f25a743-7a4a-4d54-82ab-045e442325ee tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:25.981311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f25a743-7a4a-4d54-82ab-045e442325ee tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:25.981777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9f25a743-7a4a-4d54-82ab-045e442325ee tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:26.115878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9f25a743-7a4a-4d54-82ab-045e442325ee tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:18:26.323036 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9f25a743-7a4a-4d54-82ab-045e442325ee tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 204 len: 0 microversion: 2.1 time: 0.381653 Oct 29 03:18:26.333286 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3066/6173] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:18:25 2022] DELETE /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:18:26.338699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-024cd9e4-3e43-413d-bd57-5f453be915b3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:26.339460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-024cd9e4-3e43-413d-bd57-5f453be915b3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:26.359414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024cd9e4-3e43-413d-bd57-5f453be915b3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:26.359979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024cd9e4-3e43-413d-bd57-5f453be915b3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:26.360424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024cd9e4-3e43-413d-bd57-5f453be915b3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:26.361198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024cd9e4-3e43-413d-bd57-5f453be915b3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:26.361651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024cd9e4-3e43-413d-bd57-5f453be915b3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:26.362098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-024cd9e4-3e43-413d-bd57-5f453be915b3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:27.322865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-024cd9e4-3e43-413d-bd57-5f453be915b3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:27.338626 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-024cd9e4-3e43-413d-bd57-5f453be915b3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1681 microversion: 2.1 time: 1.000639 Oct 29 03:18:27.345301 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3108/6174] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:26 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1681 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:28.369348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2d5d440e-6fe6-4eb2-9ade-c27d7b7f93d3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:28.370123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2d5d440e-6fe6-4eb2-9ade-c27d7b7f93d3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:28.382767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d5d440e-6fe6-4eb2-9ade-c27d7b7f93d3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:28.383474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d5d440e-6fe6-4eb2-9ade-c27d7b7f93d3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:28.386640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d5d440e-6fe6-4eb2-9ade-c27d7b7f93d3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:28.387554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d5d440e-6fe6-4eb2-9ade-c27d7b7f93d3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:28.388161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d5d440e-6fe6-4eb2-9ade-c27d7b7f93d3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:28.390315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d5d440e-6fe6-4eb2-9ade-c27d7b7f93d3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:28.775978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2d5d440e-6fe6-4eb2-9ade-c27d7b7f93d3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:28.778546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:28.795442 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2d5d440e-6fe6-4eb2-9ade-c27d7b7f93d3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1681 microversion: 2.1 time: 0.430560 Oct 29 03:18:28.803054 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3067/6175] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:28 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1681 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:29.829838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eceb52ed-bb2e-422a-8211-0d1117063541 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:29.830509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eceb52ed-bb2e-422a-8211-0d1117063541 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:29.854016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceb52ed-bb2e-422a-8211-0d1117063541 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:29.855617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceb52ed-bb2e-422a-8211-0d1117063541 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:29.856598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceb52ed-bb2e-422a-8211-0d1117063541 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:29.859682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceb52ed-bb2e-422a-8211-0d1117063541 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:29.861342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceb52ed-bb2e-422a-8211-0d1117063541 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:29.865706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eceb52ed-bb2e-422a-8211-0d1117063541 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:30.585369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eceb52ed-bb2e-422a-8211-0d1117063541 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:30.599892 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eceb52ed-bb2e-422a-8211-0d1117063541 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1681 microversion: 2.1 time: 0.773561 Oct 29 03:18:30.602001 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3109/6176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:29 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1681 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:18:31.635657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a7ddc614-b373-4c15-96e1-80001505703d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:31.636336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a7ddc614-b373-4c15-96e1-80001505703d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:31.649265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7ddc614-b373-4c15-96e1-80001505703d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:31.667791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7ddc614-b373-4c15-96e1-80001505703d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:31.670839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7ddc614-b373-4c15-96e1-80001505703d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:31.675633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7ddc614-b373-4c15-96e1-80001505703d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:31.678745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7ddc614-b373-4c15-96e1-80001505703d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:31.679447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7ddc614-b373-4c15-96e1-80001505703d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:31.740436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-aab52d61-06ca-4974-8571-071c76a1586d req-3153c004-76bc-4657-9e61-f47946295380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89aba2d7-1168-4034-be52-6377499ca509", "name": "network-vif-deleted", "tag": "6e488bd1-dc25-4e8a-9645-b99435427051"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:31.761453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-aab52d61-06ca-4974-8571-071c76a1586d req-3153c004-76bc-4657-9e61-f47946295380 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:31.762881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-aab52d61-06ca-4974-8571-071c76a1586d req-3153c004-76bc-4657-9e61-f47946295380 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:31.764144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-aab52d61-06ca-4974-8571-071c76a1586d req-3153c004-76bc-4657-9e61-f47946295380 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:31.776239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:31.778927 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-aab52d61-06ca-4974-8571-071c76a1586d req-3153c004-76bc-4657-9e61-f47946295380 service nova] Creating event network-vif-deleted:6e488bd1-dc25-4e8a-9645-b99435427051 for instance 89aba2d7-1168-4034-be52-6377499ca509 on n-h2-862964-4 Oct 29 03:18:31.786664 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-aab52d61-06ca-4974-8571-071c76a1586d req-3153c004-76bc-4657-9e61-f47946295380 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049818 Oct 29 03:18:31.788185 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3110/6177] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:31.930800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a7ddc614-b373-4c15-96e1-80001505703d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:31.941779 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a7ddc614-b373-4c15-96e1-80001505703d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 200 len: 1614 microversion: 2.1 time: 0.313587 Oct 29 03:18:31.942986 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3068/6178] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:31 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 1614 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:32.966300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:32.966991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:32.985504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:32.998188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:32.999114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:33.000146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:33.000882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:33.001596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:33.051545 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 HTTP/1.1 Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '89aba2d7-1168-4034-be52-6377499ca509'} Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:33.055949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:33.061752 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:33.061752 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:33.061752 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:33.061752 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:18:33.061752 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:18:33.061752 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:18:33.061752 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:18:33.061752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:18:33.061752 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f5c48985-5bc4-4509-ba58-55f78ca8590f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 404 len: 111 microversion: 2.1 time: 0.096592 Oct 29 03:18:33.070764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-db1ca595-ecaf-4031-9d13-d7e0b0a38063 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '.version_select at 0x7fe1a80523a0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:33.081927 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3111/6179] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:32 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:18:33.120817 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-db1ca595-ecaf-4031-9d13-d7e0b0a38063 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076600207" status: 202 len: 0 microversion: 2.1 time: 0.057579 Oct 29 03:18:33.121701 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3069/6180] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076600207 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:18:34.501212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-257b8f27-5d33-4c19-8899-dfd5621c6376 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: .version_select at 0x7fe1a88d7820>, body: {"keypair": {"name": "tempest-keypair-2110113614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNngzj8683m49FvI58MFsVTFrP0lkk8N/XL6ZRiOzudj6EBZFRvtWS3YGtGNT6EZJtr/SdY94VNSS4sHnx0bXorwM5OiqLRMP3DSyMnWqTdWLwgX6G0nViN7/iPd3Rc0xA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:34.520306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-257b8f27-5d33-4c19-8899-dfd5621c6376 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for project b9abafce931f45438286305af9b7a64a. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:18:34.532424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-257b8f27-5d33-4c19-8899-dfd5621c6376 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for user d2867c5be8974c028f933d1c8fe2c2fa and project b9abafce931f45438286305af9b7a64a. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:18:34.571307 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-257b8f27-5d33-4c19-8899-dfd5621c6376 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077546 Oct 29 03:18:34.583409 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3112/6181] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:18:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:39.724866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1711632778", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd1396d1-98cd-4d89-ada5-9f148b567381"}], "security_groups": [{"name": "tempest-securitygroup--1724292691"}], "key_name": "tempest-keypair-2110113614", "user_data": "}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:39.990522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] validate_networks() for [('cd1396d1-98cd-4d89-ada5-9f148b567381', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:18:41.054369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:18:41.054938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:18:41.055267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:18:41.055875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:18:41.056714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:18:41.089004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:41.089519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:41.091677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:41.095754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:41.097020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:41.105383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:41.163288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for project b9abafce931f45438286305af9b7a64a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:18:41.181769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for user d2867c5be8974c028f933d1c8fe2c2fa and project b9abafce931f45438286305af9b7a64a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:18:41.206629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:18:41.220405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:18:41.341084 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-16d8261d-924a-4d48-b8b3-bf9ff903ffc6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.621577 Oct 29 03:18:41.342038 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3070/6182] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:18:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:18:41.354786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-343bc2da-ff93-4467-8bca-0f740459c936 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:41.356025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-343bc2da-ff93-4467-8bca-0f740459c936 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:41.717014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-343bc2da-ff93-4467-8bca-0f740459c936 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:41.731793 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-343bc2da-ff93-4467-8bca-0f740459c936 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1242 microversion: 2.1 time: 0.374184 Oct 29 03:18:41.747531 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3113/6183] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:41 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1242 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:42.760213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-33562913-65ea-4b1e-8e6b-a1bafbe103e4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:42.761155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-33562913-65ea-4b1e-8e6b-a1bafbe103e4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:42.877517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33562913-65ea-4b1e-8e6b-a1bafbe103e4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:42.883454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33562913-65ea-4b1e-8e6b-a1bafbe103e4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:42.884393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33562913-65ea-4b1e-8e6b-a1bafbe103e4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:42.893737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33562913-65ea-4b1e-8e6b-a1bafbe103e4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:42.896460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33562913-65ea-4b1e-8e6b-a1bafbe103e4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:42.896916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-33562913-65ea-4b1e-8e6b-a1bafbe103e4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:43.164928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-33562913-65ea-4b1e-8e6b-a1bafbe103e4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:43.195520 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-33562913-65ea-4b1e-8e6b-a1bafbe103e4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1238 microversion: 2.1 time: 0.438927 Oct 29 03:18:43.201000 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3071/6184] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:42 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1238 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:44.222730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1301f263-af59-4482-89c1-bb5b56a7b1b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:44.223351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1301f263-af59-4482-89c1-bb5b56a7b1b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:44.240532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1301f263-af59-4482-89c1-bb5b56a7b1b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:44.241020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1301f263-af59-4482-89c1-bb5b56a7b1b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:44.241456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1301f263-af59-4482-89c1-bb5b56a7b1b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:44.247958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1301f263-af59-4482-89c1-bb5b56a7b1b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:44.248545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1301f263-af59-4482-89c1-bb5b56a7b1b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:44.255043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1301f263-af59-4482-89c1-bb5b56a7b1b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:44.731169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1301f263-af59-4482-89c1-bb5b56a7b1b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:44.746303 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1301f263-af59-4482-89c1-bb5b56a7b1b1 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1300 microversion: 2.1 time: 0.523484 Oct 29 03:18:44.747375 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3114/6185] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:44 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1300 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:45.770831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fd2cb5a1-0594-4c1d-b20d-c986c1563f26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:45.772000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fd2cb5a1-0594-4c1d-b20d-c986c1563f26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:45.783507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd2cb5a1-0594-4c1d-b20d-c986c1563f26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:45.784084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd2cb5a1-0594-4c1d-b20d-c986c1563f26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:45.784414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd2cb5a1-0594-4c1d-b20d-c986c1563f26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:45.788545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd2cb5a1-0594-4c1d-b20d-c986c1563f26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:45.791024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd2cb5a1-0594-4c1d-b20d-c986c1563f26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:45.791654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd2cb5a1-0594-4c1d-b20d-c986c1563f26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:46.354912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fd2cb5a1-0594-4c1d-b20d-c986c1563f26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:46.363097 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fd2cb5a1-0594-4c1d-b20d-c986c1563f26 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1300 microversion: 2.1 time: 0.596229 Oct 29 03:18:46.368110 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3072/6186] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:45 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1300 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:47.387876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ba04fe94-daed-481f-90a7-862191a4576f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:47.388511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ba04fe94-daed-481f-90a7-862191a4576f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:47.391827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:47.410487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba04fe94-daed-481f-90a7-862191a4576f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:47.411073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba04fe94-daed-481f-90a7-862191a4576f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:47.411665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba04fe94-daed-481f-90a7-862191a4576f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:47.412574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba04fe94-daed-481f-90a7-862191a4576f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:47.413118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba04fe94-daed-481f-90a7-862191a4576f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:47.413635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba04fe94-daed-481f-90a7-862191a4576f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:47.942210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ba04fe94-daed-481f-90a7-862191a4576f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:47.955180 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ba04fe94-daed-481f-90a7-862191a4576f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1300 microversion: 2.1 time: 0.572140 Oct 29 03:18:47.955756 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3115/6187] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:47 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1300 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:48.764354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-28c4d041-a379-4b4b-a131-4bc3a03a7412 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Action: 'create', calling method: .version_select at 0x7fe1a8a24430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-965229880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWY5snHChyyor1xEcAxz6VZOjCTwhQ81ZqGCfy77txg8tU48EJIgK53RGN+mo6B90gRHjodevwVsLvW+I8EKWIQlwaV7Nfkr/DN4Pq9D9jN6B3PBkIu9DBmhiLz0Vz39Q=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:48.798763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-28c4d041-a379-4b4b-a131-4bc3a03a7412 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:18:48.816432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-28c4d041-a379-4b4b-a131-4bc3a03a7412 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for user 29f3383c209340adb16a7074c291b191 and project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:18:48.873117 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-28c4d041-a379-4b4b-a131-4bc3a03a7412 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.115067 Oct 29 03:18:48.874442 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3073/6188] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:18:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:48.986093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-341ce3e0-f5a5-4c2a-bb3d-b004baa7e16d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:48.989011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-341ce3e0-f5a5-4c2a-bb3d-b004baa7e16d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:49.007119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-341ce3e0-f5a5-4c2a-bb3d-b004baa7e16d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:49.011742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-341ce3e0-f5a5-4c2a-bb3d-b004baa7e16d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:49.012408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-341ce3e0-f5a5-4c2a-bb3d-b004baa7e16d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:49.013339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-341ce3e0-f5a5-4c2a-bb3d-b004baa7e16d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:49.013896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-341ce3e0-f5a5-4c2a-bb3d-b004baa7e16d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:49.015001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-341ce3e0-f5a5-4c2a-bb3d-b004baa7e16d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:49.471326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-341ce3e0-f5a5-4c2a-bb3d-b004baa7e16d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:49.483755 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-341ce3e0-f5a5-4c2a-bb3d-b004baa7e16d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1368 microversion: 2.1 time: 0.509431 Oct 29 03:18:49.486115 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3116/6189] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:48 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1368 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:50.459196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ff6f59eb-6af9-4969-a799-fe16a232b2f2 req-df7c55b8-926e-440a-b835-f8d668c7212a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa97d54-2dd3-4579-af28-273efbde95da", "tag": "8f500c61-7437-43d3-a116-29d01e0fa0dd"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:50.482285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ff6f59eb-6af9-4969-a799-fe16a232b2f2 req-df7c55b8-926e-440a-b835-f8d668c7212a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:50.483185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ff6f59eb-6af9-4969-a799-fe16a232b2f2 req-df7c55b8-926e-440a-b835-f8d668c7212a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:50.486097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ff6f59eb-6af9-4969-a799-fe16a232b2f2 req-df7c55b8-926e-440a-b835-f8d668c7212a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:50.512784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-573e35a6-8127-418a-a51f-7a04e9918546 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:50.513532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-573e35a6-8127-418a-a51f-7a04e9918546 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:50.520486 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ff6f59eb-6af9-4969-a799-fe16a232b2f2 req-df7c55b8-926e-440a-b835-f8d668c7212a service nova] Creating event network-changed:8f500c61-7437-43d3-a116-29d01e0fa0dd for instance dfa97d54-2dd3-4579-af28-273efbde95da on n-h1-862964-4 Oct 29 03:18:50.528332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-573e35a6-8127-418a-a51f-7a04e9918546 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:50.528827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-573e35a6-8127-418a-a51f-7a04e9918546 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:50.530896 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ff6f59eb-6af9-4969-a799-fe16a232b2f2 req-df7c55b8-926e-440a-b835-f8d668c7212a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076085 Oct 29 03:18:50.532101 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3074/6190] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:50.536886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-573e35a6-8127-418a-a51f-7a04e9918546 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:50.539144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-573e35a6-8127-418a-a51f-7a04e9918546 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:50.541694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-573e35a6-8127-418a-a51f-7a04e9918546 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:50.550916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-573e35a6-8127-418a-a51f-7a04e9918546 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:51.154415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-573e35a6-8127-418a-a51f-7a04e9918546 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:51.168472 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-573e35a6-8127-418a-a51f-7a04e9918546 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1368 microversion: 2.1 time: 0.659593 Oct 29 03:18:51.184046 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3117/6191] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:50 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1368 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:52.194599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0ba87dad-3111-4574-a420-5082ff2cc7ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:52.199413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1881991985", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "10adc8a4-e784-449f-8552-ad8809c3fc57"}], "key_name": "tempest-TestNetworkBasicOps-965229880", "security_groups": [{"name": "tempest-secgroup-smoke-42416913"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:52.200835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0ba87dad-3111-4574-a420-5082ff2cc7ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:52.217869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:52.219892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba87dad-3111-4574-a420-5082ff2cc7ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:52.220421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba87dad-3111-4574-a420-5082ff2cc7ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:52.220882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba87dad-3111-4574-a420-5082ff2cc7ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:52.221605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba87dad-3111-4574-a420-5082ff2cc7ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:52.222074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba87dad-3111-4574-a420-5082ff2cc7ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:52.235006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba87dad-3111-4574-a420-5082ff2cc7ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:52.264200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:52.489760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] validate_networks() for [('10adc8a4-e784-449f-8552-ad8809c3fc57', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:18:52.604713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0ba87dad-3111-4574-a420-5082ff2cc7ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:52.614120 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0ba87dad-3111-4574-a420-5082ff2cc7ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1368 microversion: 2.1 time: 0.424628 Oct 29 03:18:52.617932 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3118/6192] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:52 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1368 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:53.349938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:18:53.350456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:18:53.350992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:18:53.351761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:18:53.352254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:18:53.366141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:53.366968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:53.368299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:53.369466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:53.370274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:53.370909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:53.399143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:18:53.407457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Getting quotas for user 29f3383c209340adb16a7074c291b191 and project b67b758e83034d5f903c6ca9dfa5c883. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:18:53.465622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:18:53.475308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:18:53.587249 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18019d19-d82c-4c8a-adae-f52f29f24249 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.397517 Oct 29 03:18:53.597450 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3075/6193] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:18:52 2022] POST /compute/v2.1/servers => generated 404 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:18:53.600172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6ce89f4b-4fa2-4900-a0cb-4bb46eeb525d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:53.601184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6ce89f4b-4fa2-4900-a0cb-4bb46eeb525d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:53.647050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4f47c884-8844-4af8-b91b-7eb98bdadcae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:53.647672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4f47c884-8844-4af8-b91b-7eb98bdadcae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:53.657053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f47c884-8844-4af8-b91b-7eb98bdadcae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:53.658275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f47c884-8844-4af8-b91b-7eb98bdadcae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:53.662946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f47c884-8844-4af8-b91b-7eb98bdadcae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:53.663701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f47c884-8844-4af8-b91b-7eb98bdadcae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:53.664165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f47c884-8844-4af8-b91b-7eb98bdadcae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:53.664608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f47c884-8844-4af8-b91b-7eb98bdadcae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:53.736899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6ce89f4b-4fa2-4900-a0cb-4bb46eeb525d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:53.750750 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6ce89f4b-4fa2-4900-a0cb-4bb46eeb525d tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1248 microversion: 2.1 time: 0.153911 Oct 29 03:18:53.751368 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3119/6194] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:53 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1248 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:18:54.052873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4f47c884-8844-4af8-b91b-7eb98bdadcae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:54.061414 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4f47c884-8844-4af8-b91b-7eb98bdadcae tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1368 microversion: 2.1 time: 0.420634 Oct 29 03:18:54.069680 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3076/6195] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:53 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1368 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:54.776348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb72ba77-4a59-484e-9b26-f32f88d0de83 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:54.777739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fb72ba77-4a59-484e-9b26-f32f88d0de83 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:54.790150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb72ba77-4a59-484e-9b26-f32f88d0de83 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:54.795733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb72ba77-4a59-484e-9b26-f32f88d0de83 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:54.796532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb72ba77-4a59-484e-9b26-f32f88d0de83 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:54.797637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb72ba77-4a59-484e-9b26-f32f88d0de83 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:54.798620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb72ba77-4a59-484e-9b26-f32f88d0de83 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:54.801039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb72ba77-4a59-484e-9b26-f32f88d0de83 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:54.951119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fb72ba77-4a59-484e-9b26-f32f88d0de83 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:54.960251 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fb72ba77-4a59-484e-9b26-f32f88d0de83 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1244 microversion: 2.1 time: 0.188631 Oct 29 03:18:54.962403 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3120/6196] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:54 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1244 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:55.091727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b578eaaa-c4ed-4270-9825-3d545c2aa49f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:55.092496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b578eaaa-c4ed-4270-9825-3d545c2aa49f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:55.097560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:55.111278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b578eaaa-c4ed-4270-9825-3d545c2aa49f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:55.112188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b578eaaa-c4ed-4270-9825-3d545c2aa49f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:55.112888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b578eaaa-c4ed-4270-9825-3d545c2aa49f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:55.114190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b578eaaa-c4ed-4270-9825-3d545c2aa49f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:55.117349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b578eaaa-c4ed-4270-9825-3d545c2aa49f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:55.118361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b578eaaa-c4ed-4270-9825-3d545c2aa49f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:55.394327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b578eaaa-c4ed-4270-9825-3d545c2aa49f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:55.404361 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b578eaaa-c4ed-4270-9825-3d545c2aa49f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1368 microversion: 2.1 time: 0.316696 Oct 29 03:18:55.415750 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3077/6197] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:55 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:55.912480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d41eea82-20dc-4841-b229-277ef3feae23 req-e1e475d7-66fd-4d22-a9a7-a2fdf8e3bff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa97d54-2dd3-4579-af28-273efbde95da", "name": "network-vif-plugged", "status": "completed", "tag": "8f500c61-7437-43d3-a116-29d01e0fa0dd"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:55.946533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d41eea82-20dc-4841-b229-277ef3feae23 req-e1e475d7-66fd-4d22-a9a7-a2fdf8e3bff3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:55.947005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d41eea82-20dc-4841-b229-277ef3feae23 req-e1e475d7-66fd-4d22-a9a7-a2fdf8e3bff3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:55.947418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d41eea82-20dc-4841-b229-277ef3feae23 req-e1e475d7-66fd-4d22-a9a7-a2fdf8e3bff3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:55.985328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-83df412a-f78c-420f-b764-af5d174021a3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:55.986582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-83df412a-f78c-420f-b764-af5d174021a3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:55.996799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83df412a-f78c-420f-b764-af5d174021a3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:55.999742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83df412a-f78c-420f-b764-af5d174021a3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:56.001759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83df412a-f78c-420f-b764-af5d174021a3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:56.004336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83df412a-f78c-420f-b764-af5d174021a3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:56.004902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83df412a-f78c-420f-b764-af5d174021a3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:56.005035 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d41eea82-20dc-4841-b229-277ef3feae23 req-e1e475d7-66fd-4d22-a9a7-a2fdf8e3bff3 service nova] Creating event network-vif-plugged:8f500c61-7437-43d3-a116-29d01e0fa0dd for instance dfa97d54-2dd3-4579-af28-273efbde95da on n-h1-862964-4 Oct 29 03:18:56.009102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83df412a-f78c-420f-b764-af5d174021a3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:56.036052 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d41eea82-20dc-4841-b229-277ef3feae23 req-e1e475d7-66fd-4d22-a9a7-a2fdf8e3bff3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127981 Oct 29 03:18:56.036669 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3121/6198] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:18:56.251521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-83df412a-f78c-420f-b764-af5d174021a3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:56.280740 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-83df412a-f78c-420f-b764-af5d174021a3 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1306 microversion: 2.1 time: 0.293036 Oct 29 03:18:56.293834 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3078/6199] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:55 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1306 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:56.433321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c0006435-ab75-4842-8712-496a37d5bee7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:56.434232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c0006435-ab75-4842-8712-496a37d5bee7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:56.441312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0006435-ab75-4842-8712-496a37d5bee7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:56.444408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0006435-ab75-4842-8712-496a37d5bee7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:56.447577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0006435-ab75-4842-8712-496a37d5bee7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:56.448472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0006435-ab75-4842-8712-496a37d5bee7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:56.450540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0006435-ab75-4842-8712-496a37d5bee7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:56.451078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0006435-ab75-4842-8712-496a37d5bee7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:56.834696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c0006435-ab75-4842-8712-496a37d5bee7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:56.843149 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c0006435-ab75-4842-8712-496a37d5bee7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1368 microversion: 2.1 time: 0.415724 Oct 29 03:18:56.845428 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3122/6200] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:56 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1368 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:57.308509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4f782d37-0a07-4151-87da-cb50c8b5f1c0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:57.309160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4f782d37-0a07-4151-87da-cb50c8b5f1c0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:57.329364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f782d37-0a07-4151-87da-cb50c8b5f1c0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:57.330311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f782d37-0a07-4151-87da-cb50c8b5f1c0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:57.335962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f782d37-0a07-4151-87da-cb50c8b5f1c0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:57.336983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f782d37-0a07-4151-87da-cb50c8b5f1c0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:57.338419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f782d37-0a07-4151-87da-cb50c8b5f1c0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:57.340421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f782d37-0a07-4151-87da-cb50c8b5f1c0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:57.757394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4f782d37-0a07-4151-87da-cb50c8b5f1c0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:57.767616 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4f782d37-0a07-4151-87da-cb50c8b5f1c0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1372 microversion: 2.1 time: 0.463270 Oct 29 03:18:57.768215 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3079/6201] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:57 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1372 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:57.871940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-02ceeacd-4138-4c65-9a21-f0b08805f8cc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:57.873126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-02ceeacd-4138-4c65-9a21-f0b08805f8cc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:57.886240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02ceeacd-4138-4c65-9a21-f0b08805f8cc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:57.886883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02ceeacd-4138-4c65-9a21-f0b08805f8cc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:57.887327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02ceeacd-4138-4c65-9a21-f0b08805f8cc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:57.888049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02ceeacd-4138-4c65-9a21-f0b08805f8cc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:57.891469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02ceeacd-4138-4c65-9a21-f0b08805f8cc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:57.894776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-02ceeacd-4138-4c65-9a21-f0b08805f8cc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:58.379090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-02ceeacd-4138-4c65-9a21-f0b08805f8cc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:58.399512 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-02ceeacd-4138-4c65-9a21-f0b08805f8cc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1557 microversion: 2.1 time: 0.532840 Oct 29 03:18:58.413302 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3123/6202] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:57 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1557 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:58.436129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-28fb3cf2-3f3b-4fd3-8e05-0859f58dadb0 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:58.437334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-28fb3cf2-3f3b-4fd3-8e05-0859f58dadb0 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:58.457276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28fb3cf2-3f3b-4fd3-8e05-0859f58dadb0 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:58.475349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28fb3cf2-3f3b-4fd3-8e05-0859f58dadb0 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:58.481307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28fb3cf2-3f3b-4fd3-8e05-0859f58dadb0 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:58.484578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28fb3cf2-3f3b-4fd3-8e05-0859f58dadb0 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:58.485318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28fb3cf2-3f3b-4fd3-8e05-0859f58dadb0 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:58.486019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28fb3cf2-3f3b-4fd3-8e05-0859f58dadb0 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:58.768181 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-28fb3cf2-3f3b-4fd3-8e05-0859f58dadb0 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.336842 Oct 29 03:18:58.770248 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3080/6203] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:18:58 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-interface => generated 284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:58.797709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98a42948-b4d9-43da-80a3-6cf635845003 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:58.802581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-98a42948-b4d9-43da-80a3-6cf635845003 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:58.832488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a42948-b4d9-43da-80a3-6cf635845003 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:58.836002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a42948-b4d9-43da-80a3-6cf635845003 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:58.836748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a42948-b4d9-43da-80a3-6cf635845003 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:58.837714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a42948-b4d9-43da-80a3-6cf635845003 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:58.840262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a42948-b4d9-43da-80a3-6cf635845003 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:58.840999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a42948-b4d9-43da-80a3-6cf635845003 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:00.112526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-98a42948-b4d9-43da-80a3-6cf635845003 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:00.123699 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-98a42948-b4d9-43da-80a3-6cf635845003 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1372 microversion: 2.1 time: 1.332367 Oct 29 03:19:00.126392 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3124/6204] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:58 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1372 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:00.301454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-5fa3da15-3b5f-434e-b5ab-98182f91a77f req-38775569-e6cc-4ddb-a002-fb0be1754936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6095e30b-742a-44e0-871c-e2e96a7a07cc", "tag": "242980be-4410-4a86-9136-256682906b32"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:00.332739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5fa3da15-3b5f-434e-b5ab-98182f91a77f req-38775569-e6cc-4ddb-a002-fb0be1754936 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:00.344319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5fa3da15-3b5f-434e-b5ab-98182f91a77f req-38775569-e6cc-4ddb-a002-fb0be1754936 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:00.345381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5fa3da15-3b5f-434e-b5ab-98182f91a77f req-38775569-e6cc-4ddb-a002-fb0be1754936 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:00.373667 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-5fa3da15-3b5f-434e-b5ab-98182f91a77f req-38775569-e6cc-4ddb-a002-fb0be1754936 service nova] Creating event network-changed:242980be-4410-4a86-9136-256682906b32 for instance 6095e30b-742a-44e0-871c-e2e96a7a07cc on n-h2-862964-4 Oct 29 03:19:00.387999 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-5fa3da15-3b5f-434e-b5ab-98182f91a77f req-38775569-e6cc-4ddb-a002-fb0be1754936 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099101 Oct 29 03:19:00.406288 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3081/6205] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:01.163064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5e0a521f-4135-4712-9a75-24d87b4a4b79 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:01.163892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5e0a521f-4135-4712-9a75-24d87b4a4b79 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:01.172500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e0a521f-4135-4712-9a75-24d87b4a4b79 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:01.173110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e0a521f-4135-4712-9a75-24d87b4a4b79 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:01.173794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e0a521f-4135-4712-9a75-24d87b4a4b79 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:01.175154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e0a521f-4135-4712-9a75-24d87b4a4b79 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:01.175827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e0a521f-4135-4712-9a75-24d87b4a4b79 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:01.176444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e0a521f-4135-4712-9a75-24d87b4a4b79 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:01.977413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5e0a521f-4135-4712-9a75-24d87b4a4b79 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:01.987129 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5e0a521f-4135-4712-9a75-24d87b4a4b79 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1372 microversion: 2.1 time: 0.841018 Oct 29 03:19:01.988523 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3125/6206] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:01 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1372 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:02.476097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f9e5f862-036f-4fa7-86d2-577864fc2714 req-03a4a0d7-23b4-4ab2-a17e-3b7d91a8a453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa97d54-2dd3-4579-af28-273efbde95da", "tag": "8f500c61-7437-43d3-a116-29d01e0fa0dd"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:02.498272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f9e5f862-036f-4fa7-86d2-577864fc2714 req-03a4a0d7-23b4-4ab2-a17e-3b7d91a8a453 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:02.500663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f9e5f862-036f-4fa7-86d2-577864fc2714 req-03a4a0d7-23b4-4ab2-a17e-3b7d91a8a453 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:02.501399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f9e5f862-036f-4fa7-86d2-577864fc2714 req-03a4a0d7-23b4-4ab2-a17e-3b7d91a8a453 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:02.521001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=56 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:02.524417 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f9e5f862-036f-4fa7-86d2-577864fc2714 req-03a4a0d7-23b4-4ab2-a17e-3b7d91a8a453 service nova] Creating event network-changed:8f500c61-7437-43d3-a116-29d01e0fa0dd for instance dfa97d54-2dd3-4579-af28-273efbde95da on n-h1-862964-4 Oct 29 03:19:02.536200 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f9e5f862-036f-4fa7-86d2-577864fc2714 req-03a4a0d7-23b4-4ab2-a17e-3b7d91a8a453 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067575 Oct 29 03:19:02.537576 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3082/6207] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:03.021722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd15a3cd-6f0a-4ac8-b8cb-cb78dc4ac734 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:03.022360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cd15a3cd-6f0a-4ac8-b8cb-cb78dc4ac734 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:03.061351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd15a3cd-6f0a-4ac8-b8cb-cb78dc4ac734 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:03.061870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd15a3cd-6f0a-4ac8-b8cb-cb78dc4ac734 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:03.062305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd15a3cd-6f0a-4ac8-b8cb-cb78dc4ac734 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:03.066394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd15a3cd-6f0a-4ac8-b8cb-cb78dc4ac734 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:03.067433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd15a3cd-6f0a-4ac8-b8cb-cb78dc4ac734 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:03.068805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd15a3cd-6f0a-4ac8-b8cb-cb78dc4ac734 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:03.649426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd15a3cd-6f0a-4ac8-b8cb-cb78dc4ac734 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:03.665212 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd15a3cd-6f0a-4ac8-b8cb-cb78dc4ac734 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1372 microversion: 2.1 time: 0.650147 Oct 29 03:19:03.668006 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3126/6208] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:03 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1372 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:04.695763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ea68c78a-e454-45d8-85ca-7ef557ff8571 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:04.697077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ea68c78a-e454-45d8-85ca-7ef557ff8571 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:04.713196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:04.716348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=16 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:04.725611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea68c78a-e454-45d8-85ca-7ef557ff8571 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:04.727769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea68c78a-e454-45d8-85ca-7ef557ff8571 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:04.728333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea68c78a-e454-45d8-85ca-7ef557ff8571 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:04.730894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea68c78a-e454-45d8-85ca-7ef557ff8571 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:04.732130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea68c78a-e454-45d8-85ca-7ef557ff8571 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:04.736883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea68c78a-e454-45d8-85ca-7ef557ff8571 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:05.111290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ea68c78a-e454-45d8-85ca-7ef557ff8571 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:05.121778 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ea68c78a-e454-45d8-85ca-7ef557ff8571 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1372 microversion: 2.1 time: 0.432711 Oct 29 03:19:05.126913 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3083/6209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:04 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1372 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:06.149518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5cbd650d-15df-4247-a808-50514a7059d6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:06.150157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5cbd650d-15df-4247-a808-50514a7059d6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:06.153636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:06.170680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cbd650d-15df-4247-a808-50514a7059d6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:06.173070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cbd650d-15df-4247-a808-50514a7059d6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:06.174278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cbd650d-15df-4247-a808-50514a7059d6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:06.175628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cbd650d-15df-4247-a808-50514a7059d6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:06.189399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cbd650d-15df-4247-a808-50514a7059d6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:06.189909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cbd650d-15df-4247-a808-50514a7059d6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:06.244212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=72 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:06.574284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5cbd650d-15df-4247-a808-50514a7059d6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:06.588486 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5cbd650d-15df-4247-a808-50514a7059d6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1372 microversion: 2.1 time: 0.442991 Oct 29 03:19:06.591428 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3127/6210] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:06 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1372 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:07.613843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6daeeb29-4e04-480a-ba75-edd072c3379a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:07.614559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6daeeb29-4e04-480a-ba75-edd072c3379a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:07.624476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6daeeb29-4e04-480a-ba75-edd072c3379a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:07.627567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6daeeb29-4e04-480a-ba75-edd072c3379a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:07.631499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6daeeb29-4e04-480a-ba75-edd072c3379a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:07.632526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6daeeb29-4e04-480a-ba75-edd072c3379a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:07.633164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6daeeb29-4e04-480a-ba75-edd072c3379a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:07.633774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6daeeb29-4e04-480a-ba75-edd072c3379a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:07.875899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6daeeb29-4e04-480a-ba75-edd072c3379a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:07.886393 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6daeeb29-4e04-480a-ba75-edd072c3379a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1372 microversion: 2.1 time: 0.276510 Oct 29 03:19:07.886993 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3084/6211] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:07 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1372 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:08.757283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9eba2204-0096-4f8b-8036-2430601baa68 req-eef59096-6ec7-4987-a73d-c378a64efe0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6095e30b-742a-44e0-871c-e2e96a7a07cc", "name": "network-vif-plugged", "status": "completed", "tag": "242980be-4410-4a86-9136-256682906b32"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:08.800755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9eba2204-0096-4f8b-8036-2430601baa68 req-eef59096-6ec7-4987-a73d-c378a64efe0f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:08.801767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9eba2204-0096-4f8b-8036-2430601baa68 req-eef59096-6ec7-4987-a73d-c378a64efe0f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:08.801767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9eba2204-0096-4f8b-8036-2430601baa68 req-eef59096-6ec7-4987-a73d-c378a64efe0f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:08.832947 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9eba2204-0096-4f8b-8036-2430601baa68 req-eef59096-6ec7-4987-a73d-c378a64efe0f service nova] Creating event network-vif-plugged:242980be-4410-4a86-9136-256682906b32 for instance 6095e30b-742a-44e0-871c-e2e96a7a07cc on n-h2-862964-4 Oct 29 03:19:08.842639 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9eba2204-0096-4f8b-8036-2430601baa68 req-eef59096-6ec7-4987-a73d-c378a64efe0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088520 Oct 29 03:19:08.844650 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3128/6212] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:08.911759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ff0fe0a-b994-416d-bb0c-60973a1f283a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:08.912409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ff0fe0a-b994-416d-bb0c-60973a1f283a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:08.950385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff0fe0a-b994-416d-bb0c-60973a1f283a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:08.950894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff0fe0a-b994-416d-bb0c-60973a1f283a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:08.951338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff0fe0a-b994-416d-bb0c-60973a1f283a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:08.952069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff0fe0a-b994-416d-bb0c-60973a1f283a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:08.953369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff0fe0a-b994-416d-bb0c-60973a1f283a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:08.963816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ff0fe0a-b994-416d-bb0c-60973a1f283a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:09.290827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ff0fe0a-b994-416d-bb0c-60973a1f283a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:09.301778 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ff0fe0a-b994-416d-bb0c-60973a1f283a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1372 microversion: 2.1 time: 0.393444 Oct 29 03:19:09.302980 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3085/6213] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:08 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1372 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:10.327165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-502977ec-3cb2-48a7-a5e0-d4372ced69fb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:10.327963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-502977ec-3cb2-48a7-a5e0-d4372ced69fb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:10.338589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-502977ec-3cb2-48a7-a5e0-d4372ced69fb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:10.339510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-502977ec-3cb2-48a7-a5e0-d4372ced69fb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:10.340032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-502977ec-3cb2-48a7-a5e0-d4372ced69fb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:10.340826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-502977ec-3cb2-48a7-a5e0-d4372ced69fb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:10.341528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-502977ec-3cb2-48a7-a5e0-d4372ced69fb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:10.342192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-502977ec-3cb2-48a7-a5e0-d4372ced69fb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:10.673392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-502977ec-3cb2-48a7-a5e0-d4372ced69fb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:10.687292 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-502977ec-3cb2-48a7-a5e0-d4372ced69fb tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1372 microversion: 2.1 time: 0.365659 Oct 29 03:19:10.693616 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3129/6214] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:10 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1372 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:11.714806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d6c985d1-d12a-44df-8abe-cae06a86ec96 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:11.715418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d6c985d1-d12a-44df-8abe-cae06a86ec96 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:11.731266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6c985d1-d12a-44df-8abe-cae06a86ec96 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:11.737931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6c985d1-d12a-44df-8abe-cae06a86ec96 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:11.741006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6c985d1-d12a-44df-8abe-cae06a86ec96 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:11.743051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6c985d1-d12a-44df-8abe-cae06a86ec96 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:11.750692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6c985d1-d12a-44df-8abe-cae06a86ec96 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:11.751130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d6c985d1-d12a-44df-8abe-cae06a86ec96 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:11.964797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d6c985d1-d12a-44df-8abe-cae06a86ec96 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:11.979296 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d6c985d1-d12a-44df-8abe-cae06a86ec96 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1544 microversion: 2.1 time: 0.266179 Oct 29 03:19:11.979296 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3086/6215] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:11 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1544 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:11.999959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-797ea019-1871-4c50-b7e6-648b22902743 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:12.000483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-797ea019-1871-4c50-b7e6-648b22902743 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:12.008655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797ea019-1871-4c50-b7e6-648b22902743 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:12.009621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797ea019-1871-4c50-b7e6-648b22902743 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:12.010684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797ea019-1871-4c50-b7e6-648b22902743 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:12.013038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797ea019-1871-4c50-b7e6-648b22902743 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:12.014044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797ea019-1871-4c50-b7e6-648b22902743 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:12.014692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-797ea019-1871-4c50-b7e6-648b22902743 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:12.324949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-797ea019-1871-4c50-b7e6-648b22902743 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:12.336545 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-797ea019-1871-4c50-b7e6-648b22902743 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1544 microversion: 2.1 time: 0.339534 Oct 29 03:19:12.337145 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3130/6216] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:11 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1544 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:15.020892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-13650027-4484-4733-921e-4bbf48412f85 req-5a2f5b05-a2fb-465b-bfc2-bb0a7856a881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6095e30b-742a-44e0-871c-e2e96a7a07cc", "tag": "242980be-4410-4a86-9136-256682906b32"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:15.045495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-13650027-4484-4733-921e-4bbf48412f85 req-5a2f5b05-a2fb-465b-bfc2-bb0a7856a881 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:15.047527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-13650027-4484-4733-921e-4bbf48412f85 req-5a2f5b05-a2fb-465b-bfc2-bb0a7856a881 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:15.049175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-13650027-4484-4733-921e-4bbf48412f85 req-5a2f5b05-a2fb-465b-bfc2-bb0a7856a881 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:15.080746 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-13650027-4484-4733-921e-4bbf48412f85 req-5a2f5b05-a2fb-465b-bfc2-bb0a7856a881 service nova] Creating event network-changed:242980be-4410-4a86-9136-256682906b32 for instance 6095e30b-742a-44e0-871c-e2e96a7a07cc on n-h2-862964-4 Oct 29 03:19:15.091914 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-13650027-4484-4733-921e-4bbf48412f85 req-5a2f5b05-a2fb-465b-bfc2-bb0a7856a881 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074769 Oct 29 03:19:15.098477 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3087/6217] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:33.055721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-048bd87f-e124-47f3-8021-4d9125f698e5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:33.056211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-048bd87f-e124-47f3-8021-4d9125f698e5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:33.071774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=33 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:33.076095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=19 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:33.085383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-048bd87f-e124-47f3-8021-4d9125f698e5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:33.086291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-048bd87f-e124-47f3-8021-4d9125f698e5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:33.086911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-048bd87f-e124-47f3-8021-4d9125f698e5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:33.090541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-048bd87f-e124-47f3-8021-4d9125f698e5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:33.091237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-048bd87f-e124-47f3-8021-4d9125f698e5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:33.091827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-048bd87f-e124-47f3-8021-4d9125f698e5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:33.143948 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-048bd87f-e124-47f3-8021-4d9125f698e5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/ips" status: 200 len: 149 microversion: 2.1 time: 0.096393 Oct 29 03:19:33.145164 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3131/6218] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:19:33 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:35.933835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=21 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:35.934996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=27 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:35.940910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2590a247-5bad-42e3-9bd9-9377777a790f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6aa2bd8-4380-4fb2-8ac2-d6849284e68d"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:35.945568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2590a247-5bad-42e3-9bd9-9377777a790f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:35.964818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2590a247-5bad-42e3-9bd9-9377777a790f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:35.968156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2590a247-5bad-42e3-9bd9-9377777a790f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:35.968752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2590a247-5bad-42e3-9bd9-9377777a790f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:35.969708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2590a247-5bad-42e3-9bd9-9377777a790f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:35.971935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2590a247-5bad-42e3-9bd9-9377777a790f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:35.977722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2590a247-5bad-42e3-9bd9-9377777a790f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:36.516552 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2590a247-5bad-42e3-9bd9-9377777a790f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584638 Oct 29 03:19:36.517378 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3088/6219] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:19:35 2022] POST /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments => generated 194 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:38.829628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-405c31a5-3231-4b25-9eb6-ef24de4c304b tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:38.832918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-405c31a5-3231-4b25-9eb6-ef24de4c304b tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:38.840805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-405c31a5-3231-4b25-9eb6-ef24de4c304b tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:38.841524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-405c31a5-3231-4b25-9eb6-ef24de4c304b tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:38.842169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-405c31a5-3231-4b25-9eb6-ef24de4c304b tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:38.843009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-405c31a5-3231-4b25-9eb6-ef24de4c304b tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:38.843783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-405c31a5-3231-4b25-9eb6-ef24de4c304b tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:38.844495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-405c31a5-3231-4b25-9eb6-ef24de4c304b tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:38.995911 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-405c31a5-3231-4b25-9eb6-ef24de4c304b tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "POST /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc/action" status: 200 len: 24578 microversion: 2.1 time: 0.170156 Oct 29 03:19:38.997202 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3132/6220] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:38 2022] POST /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc/action => generated 24578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:19:50.377040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-11c7b1c7-8cb9-4b54-99cf-0fd927d6b0d5 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:50.382274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-11c7b1c7-8cb9-4b54-99cf-0fd927d6b0d5 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:50.403707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:50.412456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:50.416685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11c7b1c7-8cb9-4b54-99cf-0fd927d6b0d5 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:50.420568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11c7b1c7-8cb9-4b54-99cf-0fd927d6b0d5 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:50.421224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11c7b1c7-8cb9-4b54-99cf-0fd927d6b0d5 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:50.422149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11c7b1c7-8cb9-4b54-99cf-0fd927d6b0d5 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:50.426511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11c7b1c7-8cb9-4b54-99cf-0fd927d6b0d5 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:50.427507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-11c7b1c7-8cb9-4b54-99cf-0fd927d6b0d5 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:50.505768 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-11c7b1c7-8cb9-4b54-99cf-0fd927d6b0d5 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "POST /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc/action" status: 200 len: 32633 microversion: 2.1 time: 0.135548 Oct 29 03:19:50.514337 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3089/6221] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:50 2022] POST /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc/action => generated 32633 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:19:53.203764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bcc03a30-131a-433c-8fd7-83a4f3e738a1 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:53.205216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bcc03a30-131a-433c-8fd7-83a4f3e738a1 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:53.220265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-190cc9c7-521d-49c1-b975-d90c8f248db9 req-4489ff8b-fad4-498b-90d9-de53a2f8acc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6095e30b-742a-44e0-871c-e2e96a7a07cc", "tag": "242980be-4410-4a86-9136-256682906b32"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:53.256036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:53.259925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:53.265676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bcc03a30-131a-433c-8fd7-83a4f3e738a1 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:53.266881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bcc03a30-131a-433c-8fd7-83a4f3e738a1 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:53.267349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-190cc9c7-521d-49c1-b975-d90c8f248db9 req-4489ff8b-fad4-498b-90d9-de53a2f8acc3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:53.268268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bcc03a30-131a-433c-8fd7-83a4f3e738a1 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:53.268785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-190cc9c7-521d-49c1-b975-d90c8f248db9 req-4489ff8b-fad4-498b-90d9-de53a2f8acc3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:53.269660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bcc03a30-131a-433c-8fd7-83a4f3e738a1 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:53.270326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-190cc9c7-521d-49c1-b975-d90c8f248db9 req-4489ff8b-fad4-498b-90d9-de53a2f8acc3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:53.271789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bcc03a30-131a-433c-8fd7-83a4f3e738a1 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:53.273278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bcc03a30-131a-433c-8fd7-83a4f3e738a1 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:53.328469 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-190cc9c7-521d-49c1-b975-d90c8f248db9 req-4489ff8b-fad4-498b-90d9-de53a2f8acc3 service nova] Creating event network-changed:242980be-4410-4a86-9136-256682906b32 for instance 6095e30b-742a-44e0-871c-e2e96a7a07cc on n-h2-862964-4 Oct 29 03:19:53.348343 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-190cc9c7-521d-49c1-b975-d90c8f248db9 req-4489ff8b-fad4-498b-90d9-de53a2f8acc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136990 Oct 29 03:19:53.351012 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3090/6222] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:19:53.376368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bcc03a30-131a-433c-8fd7-83a4f3e738a1 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:19:53.642263 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bcc03a30-131a-433c-8fd7-83a4f3e738a1 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 204 len: 0 microversion: 2.1 time: 0.442242 Oct 29 03:19:53.643747 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3133/6223] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:19:53 2022] DELETE /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:19:53.661740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b5fd8525-3323-4fdf-8d82-1e406a660ae0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:53.664120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b5fd8525-3323-4fdf-8d82-1e406a660ae0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:53.676863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fd8525-3323-4fdf-8d82-1e406a660ae0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:53.678256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fd8525-3323-4fdf-8d82-1e406a660ae0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:53.679114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fd8525-3323-4fdf-8d82-1e406a660ae0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:53.680207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fd8525-3323-4fdf-8d82-1e406a660ae0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:53.680918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fd8525-3323-4fdf-8d82-1e406a660ae0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:53.681712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5fd8525-3323-4fdf-8d82-1e406a660ae0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:54.870450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b5fd8525-3323-4fdf-8d82-1e406a660ae0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:54.884281 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b5fd8525-3323-4fdf-8d82-1e406a660ae0 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1668 microversion: 2.1 time: 1.235270 Oct 29 03:19:54.893418 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3091/6224] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:53 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1668 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:54.977842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6aa2bd8-4380-4fb2-8ac2-d6849284e68d"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:54.982411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:55.012467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:55.012953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:55.013401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:55.021141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:55.022159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:55.022612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:55.241433 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Invalid volume: volume f6aa2bd8-4380-4fb2-8ac2-d6849284e68d is already attached to instances: dfa97d54-2dd3-4579-af28-273efbde95da Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments HTTP/1.1 Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 74 Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: {"volumeAttachment": {"volumeId": "f6aa2bd8-4380-4fb2-8ac2-d6849284e68d"}} Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: exception: Invalid volume: volume f6aa2bd8-4380-4fb2-8ac2-d6849284e68d is already attached to instances: dfa97d54-2dd3-4579-af28-273efbde95da Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': 'dfa97d54-2dd3-4579-af28-273efbde95da', 'body': {'volumeAttachment': {'volumeId': 'f6aa2bd8-4380-4fb2-8ac2-d6849284e68d'}}} Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f6aa2bd8-4380-4fb2-8ac2-d6849284e68d is already attached to instances: dfa97d54-2dd3-4579-af28-273efbde95da Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:19:55.244994 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f6aa2bd8-4380-4fb2-8ac2-d6849284e68d is already attached to instances: dfa97d54-2dd3-4579-af28-273efbde95da Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f6aa2bd8-4380-4fb2-8ac2-d6849284e68d is already attached to instances: dfa97d54-2dd3-4579-af28-273efbde95da Oct 29 03:19:55.248904 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:19:55.252032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 400 to user: Invalid volume: volume f6aa2bd8-4380-4fb2-8ac2-d6849284e68d is already attached to instances: dfa97d54-2dd3-4579-af28-273efbde95da {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:19:55.255068 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-13656f06-54a4-4a4a-bd78-e76711c7b34a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.282514 Oct 29 03:19:55.259240 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3134/6225] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:19:54 2022] POST /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments => generated 174 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:19:55.384214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-03fc41a0-69c2-489f-bf96-4e4c4824efce tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:55.384977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-03fc41a0-69c2-489f-bf96-4e4c4824efce tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:55.403142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03fc41a0-69c2-489f-bf96-4e4c4824efce tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:55.403751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03fc41a0-69c2-489f-bf96-4e4c4824efce tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:55.406678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03fc41a0-69c2-489f-bf96-4e4c4824efce tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:55.407532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03fc41a0-69c2-489f-bf96-4e4c4824efce tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:55.408065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03fc41a0-69c2-489f-bf96-4e4c4824efce tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:55.408647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03fc41a0-69c2-489f-bf96-4e4c4824efce tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:55.662052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-03fc41a0-69c2-489f-bf96-4e4c4824efce tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lazy-loading 'services' on Instance uuid dfa97d54-2dd3-4579-af28-273efbde95da {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:19:55.848711 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-03fc41a0-69c2-489f-bf96-4e4c4824efce tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments/f6aa2bd8-4380-4fb2-8ac2-d6849284e68d" status: 202 len: 0 microversion: 2.1 time: 0.469001 Oct 29 03:19:55.863145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d89401a6-6f40-4772-b7aa-2c51af7a3a6c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:55.865425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d89401a6-6f40-4772-b7aa-2c51af7a3a6c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:55.869725 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3092/6226] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:19:55 2022] DELETE /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments/f6aa2bd8-4380-4fb2-8ac2-d6849284e68d => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:19:55.885547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89401a6-6f40-4772-b7aa-2c51af7a3a6c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:55.886171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89401a6-6f40-4772-b7aa-2c51af7a3a6c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:55.886494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89401a6-6f40-4772-b7aa-2c51af7a3a6c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:55.887217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89401a6-6f40-4772-b7aa-2c51af7a3a6c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:55.887666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89401a6-6f40-4772-b7aa-2c51af7a3a6c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:55.888088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d89401a6-6f40-4772-b7aa-2c51af7a3a6c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:55.929764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e27b1a06-ef05-43f0-a148-2137ef0f39f6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:55.932770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e27b1a06-ef05-43f0-a148-2137ef0f39f6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:55.959690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e27b1a06-ef05-43f0-a148-2137ef0f39f6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:55.961632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e27b1a06-ef05-43f0-a148-2137ef0f39f6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:55.965078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e27b1a06-ef05-43f0-a148-2137ef0f39f6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:55.968984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e27b1a06-ef05-43f0-a148-2137ef0f39f6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:55.970005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e27b1a06-ef05-43f0-a148-2137ef0f39f6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:55.970926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e27b1a06-ef05-43f0-a148-2137ef0f39f6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:56.010534 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d89401a6-6f40-4772-b7aa-2c51af7a3a6c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151305 Oct 29 03:19:56.013890 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3135/6227] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:55 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:19:56.787062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e27b1a06-ef05-43f0-a148-2137ef0f39f6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:56.800694 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e27b1a06-ef05-43f0-a148-2137ef0f39f6 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1668 microversion: 2.1 time: 0.880589 Oct 29 03:19:56.801125 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3093/6228] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:55 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1668 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:57.033938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-955ab8d1-37fa-4d30-9ddf-5a58517c96e2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:57.036274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-955ab8d1-37fa-4d30-9ddf-5a58517c96e2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:57.058778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-955ab8d1-37fa-4d30-9ddf-5a58517c96e2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:57.062018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-955ab8d1-37fa-4d30-9ddf-5a58517c96e2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:57.062472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-955ab8d1-37fa-4d30-9ddf-5a58517c96e2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:57.063250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-955ab8d1-37fa-4d30-9ddf-5a58517c96e2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:57.064819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-955ab8d1-37fa-4d30-9ddf-5a58517c96e2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:57.065255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-955ab8d1-37fa-4d30-9ddf-5a58517c96e2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:57.230008 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-955ab8d1-37fa-4d30-9ddf-5a58517c96e2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192213 Oct 29 03:19:57.232842 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3136/6229] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:57 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:57.825832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-347e5d74-71f7-40f2-b172-480cd0fbfb3a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:57.827506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-347e5d74-71f7-40f2-b172-480cd0fbfb3a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:57.859756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-347e5d74-71f7-40f2-b172-480cd0fbfb3a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:57.862763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-347e5d74-71f7-40f2-b172-480cd0fbfb3a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:57.863258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-347e5d74-71f7-40f2-b172-480cd0fbfb3a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:57.864027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-347e5d74-71f7-40f2-b172-480cd0fbfb3a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:57.864500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-347e5d74-71f7-40f2-b172-480cd0fbfb3a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:57.871595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-347e5d74-71f7-40f2-b172-480cd0fbfb3a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:58.196377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-347e5d74-71f7-40f2-b172-480cd0fbfb3a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f3383c209340adb16a7074c291b191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67b758e83034d5f903c6ca9dfa5c883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:58.215488 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-347e5d74-71f7-40f2-b172-480cd0fbfb3a tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 200 len: 1602 microversion: 2.1 time: 0.394639 Oct 29 03:19:58.221333 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3094/6230] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:57 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 1602 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:58.237251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-2a358c1f-2800-4213-9601-8b4a0273c667 req-f43868e5-a5d2-4c36-990b-568ac428c2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6095e30b-742a-44e0-871c-e2e96a7a07cc", "name": "network-vif-deleted", "tag": "242980be-4410-4a86-9136-256682906b32"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:58.246833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8152a5b-8c5a-45bc-99fa-94c276125590 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:58.264992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8152a5b-8c5a-45bc-99fa-94c276125590 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:58.269119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2a358c1f-2800-4213-9601-8b4a0273c667 req-f43868e5-a5d2-4c36-990b-568ac428c2d9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:58.274117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8152a5b-8c5a-45bc-99fa-94c276125590 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:58.278335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8152a5b-8c5a-45bc-99fa-94c276125590 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:58.281758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8152a5b-8c5a-45bc-99fa-94c276125590 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:58.287082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2a358c1f-2800-4213-9601-8b4a0273c667 req-f43868e5-a5d2-4c36-990b-568ac428c2d9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:58.288012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8152a5b-8c5a-45bc-99fa-94c276125590 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:58.289337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2a358c1f-2800-4213-9601-8b4a0273c667 req-f43868e5-a5d2-4c36-990b-568ac428c2d9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:58.298585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8152a5b-8c5a-45bc-99fa-94c276125590 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:58.299025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8152a5b-8c5a-45bc-99fa-94c276125590 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:58.332672 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-2a358c1f-2800-4213-9601-8b4a0273c667 req-f43868e5-a5d2-4c36-990b-568ac428c2d9 service nova] Creating event network-vif-deleted:242980be-4410-4a86-9136-256682906b32 for instance 6095e30b-742a-44e0-871c-e2e96a7a07cc on n-h2-862964-4 Oct 29 03:19:58.347081 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-2a358c1f-2800-4213-9601-8b4a0273c667 req-f43868e5-a5d2-4c36-990b-568ac428c2d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117476 Oct 29 03:19:58.349362 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3137/6231] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:19:58.392404 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8152a5b-8c5a-45bc-99fa-94c276125590 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150289 Oct 29 03:19:58.397398 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3095/6232] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:58 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:19:59.171852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fae0bcdd-9afb-4332-8399-72824d9da472 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:59.172446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fae0bcdd-9afb-4332-8399-72824d9da472 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:59.185184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fae0bcdd-9afb-4332-8399-72824d9da472 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:59.186568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fae0bcdd-9afb-4332-8399-72824d9da472 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:59.189001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fae0bcdd-9afb-4332-8399-72824d9da472 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:59.191289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fae0bcdd-9afb-4332-8399-72824d9da472 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:59.193335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fae0bcdd-9afb-4332-8399-72824d9da472 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:59.194162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fae0bcdd-9afb-4332-8399-72824d9da472 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:59.247884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:59.248551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] [instance: 6095e30b-742a-44e0-871c-e2e96a7a07cc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:59.282948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:59.284898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:59.287694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:59.291061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:59.294560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:59.304531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:59.382651 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] HTTP exception thrown: Instance 6095e30b-742a-44e0-871c-e2e96a7a07cc could not be found. Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Request method failure captured: Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc HTTP/1.1 Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJrkVSZkDwcR-xbx2aNwTvJT8pdDmKb2Glq9K7pRpScIFtZBFaLYs9iBtkG5F9qTWmmPYwCYMk1x5hl8O85NidzVq45b_r_iFpZ1nUJEfguSfT4xShcObPyBS9H1v-dBHAfa27QvSNY3YYYOTkRQO4OvNwNVqKQ-MhHoWhLux76dTBI Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b67b758e83034d5f903c6ca9dfa5c883 Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestNetworkBasicOps-369482432 Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b67b758e83034d5f903c6ca9dfa5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b67b758e83034d5f903c6ca9dfa5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b67b758e83034d5f903c6ca9dfa5c883", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b67b758e83034d5f903c6ca9dfa5c883"}]}] Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestNetworkBasicOps-369482432 Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b67b758e83034d5f903c6ca9dfa5c883 Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestNetworkBasicOps-369482432 Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestNetworkBasicOps-369482432-project Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 29f3383c209340adb16a7074c291b191 Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestNetworkBasicOps-369482432-project Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 6095e30b-742a-44e0-871c-e2e96a7a07cc could not be found. Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '6095e30b-742a-44e0-871c-e2e96a7a07cc'} Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6095e30b-742a-44e0-871c-e2e96a7a07cc could not be found. Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6095e30b-742a-44e0-871c-e2e96a7a07cc could not be found. Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:19:59.388664 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:19:59.392092 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:59.392092 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:19:59.392092 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:19:59.392092 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:19:59.392092 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:19:59.392092 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6095e30b-742a-44e0-871c-e2e96a7a07cc could not be found. Oct 29 03:19:59.392092 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:19:59.415144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Returning 404 to user: Instance 6095e30b-742a-44e0-871c-e2e96a7a07cc could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:19:59.416662 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-04bdebfe-0b98-4d7b-85d8-efc498587caf tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc" status: 404 len: 111 microversion: 2.1 time: 0.175030 Oct 29 03:19:59.418011 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3096/6233] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:59 2022] GET /compute/v2.1/servers/6095e30b-742a-44e0-871c-e2e96a7a07cc => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:19:59.434459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7a8628a4-1976-4bac-9ec7-b10c501c2410 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:59.440532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7a8628a4-1976-4bac-9ec7-b10c501c2410 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:59.454346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8628a4-1976-4bac-9ec7-b10c501c2410 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:59.457963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8628a4-1976-4bac-9ec7-b10c501c2410 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:59.458640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8628a4-1976-4bac-9ec7-b10c501c2410 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:59.459592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8628a4-1976-4bac-9ec7-b10c501c2410 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:59.463977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8628a4-1976-4bac-9ec7-b10c501c2410 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:59.464703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8628a4-1976-4bac-9ec7-b10c501c2410 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:59.533693 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7a8628a4-1976-4bac-9ec7-b10c501c2410 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114372 Oct 29 03:19:59.543183 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3097/6234] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:59 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:59.566281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-fae0bcdd-9afb-4332-8399-72824d9da472 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lazy-loading 'services' on Instance uuid 9b72a9fc-fd46-443d-a9a6-97ee498c9864 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:19:59.758849 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fae0bcdd-9afb-4332-8399-72824d9da472 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864/os-volume_attachments/03ed7c25-afe6-437d-b495-cbf57e1a084d" status: 202 len: 0 microversion: 2.1 time: 0.586377 Oct 29 03:19:59.760235 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3138/6235] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:19:59 2022] DELETE /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864/os-volume_attachments/03ed7c25-afe6-437d-b495-cbf57e1a084d => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:19:59.784569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3629f375-aab4-4ac0-ba9b-90d1f32c8ac5 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] Calling method '.version_select at 0x7fe1a3f9ce50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:59.872567 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3629f375-aab4-4ac0-ba9b-90d1f32c8ac5 tempest-TestNetworkBasicOps-369482432 tempest-TestNetworkBasicOps-369482432-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-965229880" status: 202 len: 0 microversion: 2.1 time: 0.092745 Oct 29 03:19:59.873216 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3098/6236] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 03:19:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-965229880 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:20:00.553738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d8234734-c7f3-4563-a76e-c9512bdacabc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:00.556798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d8234734-c7f3-4563-a76e-c9512bdacabc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:00.570397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8234734-c7f3-4563-a76e-c9512bdacabc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:00.571708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8234734-c7f3-4563-a76e-c9512bdacabc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:00.576626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8234734-c7f3-4563-a76e-c9512bdacabc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:00.577546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8234734-c7f3-4563-a76e-c9512bdacabc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:00.578184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8234734-c7f3-4563-a76e-c9512bdacabc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:00.578807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8234734-c7f3-4563-a76e-c9512bdacabc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:00.645015 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d8234734-c7f3-4563-a76e-c9512bdacabc tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099998 Oct 29 03:20:00.659268 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3139/6237] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:00 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:01.667784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3cdd6757-babe-4cae-867b-90eb40937475 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:01.670227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3cdd6757-babe-4cae-867b-90eb40937475 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:01.706741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cdd6757-babe-4cae-867b-90eb40937475 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:01.707324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cdd6757-babe-4cae-867b-90eb40937475 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:01.707917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cdd6757-babe-4cae-867b-90eb40937475 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:01.716687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cdd6757-babe-4cae-867b-90eb40937475 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:01.717472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cdd6757-babe-4cae-867b-90eb40937475 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:01.718098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3cdd6757-babe-4cae-867b-90eb40937475 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:01.788242 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3cdd6757-babe-4cae-867b-90eb40937475 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125237 Oct 29 03:20:01.795192 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3099/6238] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:01 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:02.801763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-96536f03-374b-493d-8949-a846a00936c2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:02.804338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-96536f03-374b-493d-8949-a846a00936c2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:02.831931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96536f03-374b-493d-8949-a846a00936c2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:02.833985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96536f03-374b-493d-8949-a846a00936c2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:02.838203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96536f03-374b-493d-8949-a846a00936c2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:02.839204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96536f03-374b-493d-8949-a846a00936c2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:02.839749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96536f03-374b-493d-8949-a846a00936c2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:02.840351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96536f03-374b-493d-8949-a846a00936c2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:02.904441 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-96536f03-374b-493d-8949-a846a00936c2 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106478 Oct 29 03:20:02.907437 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3140/6239] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:02 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:03.925578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fa429448-0982-4ddc-b1a1-bca9a9b4b49b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:03.928232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fa429448-0982-4ddc-b1a1-bca9a9b4b49b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:03.945080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa429448-0982-4ddc-b1a1-bca9a9b4b49b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:03.945624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa429448-0982-4ddc-b1a1-bca9a9b4b49b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:03.946520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa429448-0982-4ddc-b1a1-bca9a9b4b49b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:03.947249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa429448-0982-4ddc-b1a1-bca9a9b4b49b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:03.951211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa429448-0982-4ddc-b1a1-bca9a9b4b49b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:03.951866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa429448-0982-4ddc-b1a1-bca9a9b4b49b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:04.016635 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fa429448-0982-4ddc-b1a1-bca9a9b4b49b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098997 Oct 29 03:20:04.025983 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3100/6240] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:03 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:05.029652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-758c03a0-86b7-4454-be6c-d103a8b1fadf tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:05.032387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-758c03a0-86b7-4454-be6c-d103a8b1fadf tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:05.063647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758c03a0-86b7-4454-be6c-d103a8b1fadf tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:05.064342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758c03a0-86b7-4454-be6c-d103a8b1fadf tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:05.064924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758c03a0-86b7-4454-be6c-d103a8b1fadf tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:05.065989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758c03a0-86b7-4454-be6c-d103a8b1fadf tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:05.066632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758c03a0-86b7-4454-be6c-d103a8b1fadf tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:05.067888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-758c03a0-86b7-4454-be6c-d103a8b1fadf tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:05.116529 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-758c03a0-86b7-4454-be6c-d103a8b1fadf tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091655 Oct 29 03:20:05.120183 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3141/6241] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:05 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:20:05.439633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e4ed531-adef-464e-a1d0-c07612ac6937 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:05.440163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e4ed531-adef-464e-a1d0-c07612ac6937 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:05.455017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e4ed531-adef-464e-a1d0-c07612ac6937 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:05.456546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e4ed531-adef-464e-a1d0-c07612ac6937 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:05.458095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e4ed531-adef-464e-a1d0-c07612ac6937 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:05.459038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e4ed531-adef-464e-a1d0-c07612ac6937 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:05.462562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e4ed531-adef-464e-a1d0-c07612ac6937 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:05.463348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e4ed531-adef-464e-a1d0-c07612ac6937 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:05.559258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e4ed531-adef-464e-a1d0-c07612ac6937 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:20:05.798277 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1e4ed531-adef-464e-a1d0-c07612ac6937 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 204 len: 0 microversion: 2.1 time: 0.360171 Oct 29 03:20:05.803600 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3101/6242] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:20:05 2022] DELETE /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:20:05.807572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bdad1085-7a8e-4280-b3bf-5c2bae58d2ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:05.808379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bdad1085-7a8e-4280-b3bf-5c2bae58d2ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:05.818485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdad1085-7a8e-4280-b3bf-5c2bae58d2ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:05.818981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdad1085-7a8e-4280-b3bf-5c2bae58d2ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:05.819410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdad1085-7a8e-4280-b3bf-5c2bae58d2ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:05.820111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdad1085-7a8e-4280-b3bf-5c2bae58d2ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:05.820554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdad1085-7a8e-4280-b3bf-5c2bae58d2ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:05.820969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bdad1085-7a8e-4280-b3bf-5c2bae58d2ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:06.405000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bdad1085-7a8e-4280-b3bf-5c2bae58d2ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:06.442031 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bdad1085-7a8e-4280-b3bf-5c2bae58d2ca tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1682 microversion: 2.1 time: 0.638089 Oct 29 03:20:06.443992 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3142/6243] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:05 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1682 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:07.473826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b49c688c-d794-406b-97ba-066ed772213d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:07.475287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b49c688c-d794-406b-97ba-066ed772213d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:07.536734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49c688c-d794-406b-97ba-066ed772213d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:07.539322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49c688c-d794-406b-97ba-066ed772213d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:07.551715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49c688c-d794-406b-97ba-066ed772213d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:07.554132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49c688c-d794-406b-97ba-066ed772213d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:07.555084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49c688c-d794-406b-97ba-066ed772213d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:07.557076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b49c688c-d794-406b-97ba-066ed772213d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:07.836880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b49c688c-d794-406b-97ba-066ed772213d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:07.848270 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b49c688c-d794-406b-97ba-066ed772213d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1682 microversion: 2.1 time: 0.380889 Oct 29 03:20:07.850180 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3102/6244] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:07 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1682 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:08.843485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-46f21890-1f95-4206-aa35-3dc2493a4c16 req-efe781da-5eb6-439c-8b77-e4ae9117e67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa97d54-2dd3-4579-af28-273efbde95da", "name": "network-vif-deleted", "tag": "8f500c61-7437-43d3-a116-29d01e0fa0dd"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:08.859188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-46f21890-1f95-4206-aa35-3dc2493a4c16 req-efe781da-5eb6-439c-8b77-e4ae9117e67c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:08.859655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-46f21890-1f95-4206-aa35-3dc2493a4c16 req-efe781da-5eb6-439c-8b77-e4ae9117e67c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:08.873060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-46f21890-1f95-4206-aa35-3dc2493a4c16 req-efe781da-5eb6-439c-8b77-e4ae9117e67c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:08.885881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e3ad7b6f-6f0d-4426-a359-31d0f2bc433e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:08.886592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e3ad7b6f-6f0d-4426-a359-31d0f2bc433e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:08.892480 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-46f21890-1f95-4206-aa35-3dc2493a4c16 req-efe781da-5eb6-439c-8b77-e4ae9117e67c service nova] Creating event network-vif-deleted:8f500c61-7437-43d3-a116-29d01e0fa0dd for instance dfa97d54-2dd3-4579-af28-273efbde95da on n-h1-862964-4 Oct 29 03:20:08.900002 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-46f21890-1f95-4206-aa35-3dc2493a4c16 req-efe781da-5eb6-439c-8b77-e4ae9117e67c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060019 Oct 29 03:20:08.906990 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3143/6245] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:08.908170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3ad7b6f-6f0d-4426-a359-31d0f2bc433e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:08.908966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3ad7b6f-6f0d-4426-a359-31d0f2bc433e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:08.909303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3ad7b6f-6f0d-4426-a359-31d0f2bc433e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:08.910315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3ad7b6f-6f0d-4426-a359-31d0f2bc433e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:08.918503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3ad7b6f-6f0d-4426-a359-31d0f2bc433e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:08.918962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3ad7b6f-6f0d-4426-a359-31d0f2bc433e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:09.181889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e3ad7b6f-6f0d-4426-a359-31d0f2bc433e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:09.214234 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e3ad7b6f-6f0d-4426-a359-31d0f2bc433e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 200 len: 1327 microversion: 2.1 time: 0.340191 Oct 29 03:20:09.217256 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3103/6246] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:08 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 1327 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:10.246519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:10.247480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:10.262110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:10.266568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:10.267377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:10.269102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:10.271355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:10.273017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:10.323480 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da HTTP/1.1 Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'dfa97d54-2dd3-4579-af28-273efbde95da'} Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:20:10.325191 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:20:10.330003 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:10.330003 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:20:10.330003 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:20:10.330003 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:20:10.330003 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:20:10.330003 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:20:10.330003 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:20:10.330003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:20:10.330003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-41b7a40c-b3cf-4703-bc97-6dd9bb29c0da tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 404 len: 111 microversion: 2.1 time: 0.090754 Oct 29 03:20:10.337785 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3144/6247] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:10 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:20:10.342816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a4f8969-5125-4a5b-9e65-ca6ad329bffa tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '.version_select at 0x7fe1a85b6280>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:10.394761 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5a4f8969-5125-4a5b-9e65-ca6ad329bffa tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110113614" status: 202 len: 0 microversion: 2.1 time: 0.055757 Oct 29 03:20:10.395991 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3104/6248] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:20:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110113614 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:20:12.141654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5a2299c8-cba1-4c39-a746-1847716109f9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: .version_select at 0x7fe1a848c670>, body: {"keypair": {"name": "tempest-keypair-1897396573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtzRLxuvYz6YN+9auL3TPDPN3dvCKlPuTCdEsPfS3iwG/ASBhZnQkX+iaf7hJdcTTMzAIP+V228NAci85V7B7YCSKNIm9PKiovr7RO/7uFqQUOidT6MxQ2R9Gqd4zcUAw=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:12.230634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5a2299c8-cba1-4c39-a746-1847716109f9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for project b9abafce931f45438286305af9b7a64a. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:20:12.259736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-5a2299c8-cba1-4c39-a746-1847716109f9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for user d2867c5be8974c028f933d1c8fe2c2fa and project b9abafce931f45438286305af9b7a64a. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:20:12.336828 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5a2299c8-cba1-4c39-a746-1847716109f9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.204244 Oct 29 03:20:12.340114 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3145/6249] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:20:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:12.940968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e587d07-c932-4d4a-8713-ac6edc33f083 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:12.940968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0e587d07-c932-4d4a-8713-ac6edc33f083 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:12.955819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e587d07-c932-4d4a-8713-ac6edc33f083 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:12.956321 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e587d07-c932-4d4a-8713-ac6edc33f083 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:12.956741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e587d07-c932-4d4a-8713-ac6edc33f083 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:12.963774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e587d07-c932-4d4a-8713-ac6edc33f083 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:12.964382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e587d07-c932-4d4a-8713-ac6edc33f083 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:12.964837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e587d07-c932-4d4a-8713-ac6edc33f083 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:13.032314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0e587d07-c932-4d4a-8713-ac6edc33f083 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:20:13.112414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:13.201078 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e587d07-c932-4d4a-8713-ac6edc33f083 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 204 len: 0 microversion: 2.1 time: 0.265791 Oct 29 03:20:13.202072 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3105/6250] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:20:12 2022] DELETE /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:20:13.211207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ed262e8c-1873-4319-b1ee-849c2beb5ea0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:13.212497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ed262e8c-1873-4319-b1ee-849c2beb5ea0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:13.227629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed262e8c-1873-4319-b1ee-849c2beb5ea0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:13.238299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed262e8c-1873-4319-b1ee-849c2beb5ea0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:13.238803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed262e8c-1873-4319-b1ee-849c2beb5ea0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:13.244709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed262e8c-1873-4319-b1ee-849c2beb5ea0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:13.245399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed262e8c-1873-4319-b1ee-849c2beb5ea0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:13.246052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed262e8c-1873-4319-b1ee-849c2beb5ea0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:13.657313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ed262e8c-1873-4319-b1ee-849c2beb5ea0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:13.667363 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ed262e8c-1873-4319-b1ee-849c2beb5ea0 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1468 microversion: 2.1 time: 0.461039 Oct 29 03:20:13.672334 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3146/6251] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:13 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1468 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:14.696822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7670f2a6-d124-4750-a6aa-7041b77a6bec tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:14.698308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7670f2a6-d124-4750-a6aa-7041b77a6bec tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:14.718099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7670f2a6-d124-4750-a6aa-7041b77a6bec tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:14.719845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7670f2a6-d124-4750-a6aa-7041b77a6bec tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:14.728270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7670f2a6-d124-4750-a6aa-7041b77a6bec tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:14.729374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7670f2a6-d124-4750-a6aa-7041b77a6bec tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:14.730048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7670f2a6-d124-4750-a6aa-7041b77a6bec tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:14.730645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7670f2a6-d124-4750-a6aa-7041b77a6bec tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:15.212851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7670f2a6-d124-4750-a6aa-7041b77a6bec tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:15.227066 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7670f2a6-d124-4750-a6aa-7041b77a6bec tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1468 microversion: 2.1 time: 0.535606 Oct 29 03:20:15.228459 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3106/6252] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:14 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1468 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:15.364966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-179eeb2f-2f00-416f-8496-facf616c0cfd tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Action: 'create', calling method: .version_select at 0x7fe1a8374550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2077221411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESZoxhoLVQK2OoxUlaDUOHtpVyR0ZhaWPTsHvAibcwNUlQG7ozvXJl8fM2oPIlpDOZCbXsP8NVJ9hSRcTP63cQ1ibSAqGG2rRd+loaFnAEyf+ay1MFdQrMiyb8sHS6OMA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:15.406742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-179eeb2f-2f00-416f-8496-facf616c0cfd tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Getting quotas for project 277ad94ea2a64ebf892a59f204307814. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:20:15.425122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-179eeb2f-2f00-416f-8496-facf616c0cfd tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Getting quotas for user b612ecc5516f4f6ead6ca28d74911292 and project 277ad94ea2a64ebf892a59f204307814. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:20:15.478884 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-179eeb2f-2f00-416f-8496-facf616c0cfd tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.769508 Oct 29 03:20:15.480729 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3147/6253] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:20:14 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:20:15.823485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-661865754", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd1396d1-98cd-4d89-ada5-9f148b567381"}], "security_groups": [{"name": "tempest-securitygroup--1937225791"}], "key_name": "tempest-keypair-1897396573", "user_data": "}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:16.070166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] validate_networks() for [('cd1396d1-98cd-4d89-ada5-9f148b567381', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:20:16.255968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79f2d25d-2563-49a5-9fab-a72e24a8ee37 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:16.257056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79f2d25d-2563-49a5-9fab-a72e24a8ee37 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:16.268592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f2d25d-2563-49a5-9fab-a72e24a8ee37 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:16.269272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f2d25d-2563-49a5-9fab-a72e24a8ee37 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:16.271709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f2d25d-2563-49a5-9fab-a72e24a8ee37 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:16.277706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f2d25d-2563-49a5-9fab-a72e24a8ee37 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:16.278368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f2d25d-2563-49a5-9fab-a72e24a8ee37 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:16.279666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79f2d25d-2563-49a5-9fab-a72e24a8ee37 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:16.823572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:20:16.824253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:20:16.825056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:20:16.825719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:20:16.826932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:20:16.864544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:16.865038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:16.865652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:16.867695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:16.868213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:16.868637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:16.890802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for project b9abafce931f45438286305af9b7a64a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:20:16.897132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Getting quotas for user d2867c5be8974c028f933d1c8fe2c2fa and project b9abafce931f45438286305af9b7a64a. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:20:16.910825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:20:16.913243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:20:16.988456 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-efad7cdc-3059-4847-905d-d51a380693ba tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.170084 Oct 29 03:20:16.989851 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3107/6254] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:20:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:20:17.002004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1fcd1579-f8b1-4294-8706-235477d85b8a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:17.002626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1fcd1579-f8b1-4294-8706-235477d85b8a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:17.101668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1fcd1579-f8b1-4294-8706-235477d85b8a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:17.123898 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1fcd1579-f8b1-4294-8706-235477d85b8a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1241 microversion: 2.1 time: 0.124182 Oct 29 03:20:17.124949 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3108/6255] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:16 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1241 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:17.387659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-79f2d25d-2563-49a5-9fab-a72e24a8ee37 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80163670b554c0398b7d752a9fc05fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:17.401717 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79f2d25d-2563-49a5-9fab-a72e24a8ee37 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 200 len: 1468 microversion: 2.1 time: 1.149451 Oct 29 03:20:17.402502 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3148/6256] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:16 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 1468 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:17.475964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-2a231e43-d5c2-466a-9ec1-7e44ae9ecba5 req-c90c2a0c-4e53-43bb-a321-24c7f262d0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b72a9fc-fd46-443d-a9a6-97ee498c9864", "name": "network-vif-deleted", "tag": "4a7cd189-1b05-4340-8452-504e740a1789"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:17.535845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2a231e43-d5c2-466a-9ec1-7e44ae9ecba5 req-c90c2a0c-4e53-43bb-a321-24c7f262d0c5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:17.538805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2a231e43-d5c2-466a-9ec1-7e44ae9ecba5 req-c90c2a0c-4e53-43bb-a321-24c7f262d0c5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:17.539314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2a231e43-d5c2-466a-9ec1-7e44ae9ecba5 req-c90c2a0c-4e53-43bb-a321-24c7f262d0c5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:17.571738 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-2a231e43-d5c2-466a-9ec1-7e44ae9ecba5 req-c90c2a0c-4e53-43bb-a321-24c7f262d0c5 service nova] Creating event network-vif-deleted:4a7cd189-1b05-4340-8452-504e740a1789 for instance 9b72a9fc-fd46-443d-a9a6-97ee498c9864 on n-h2-862964-4 Oct 29 03:20:17.588246 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-2a231e43-d5c2-466a-9ec1-7e44ae9ecba5 req-c90c2a0c-4e53-43bb-a321-24c7f262d0c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115798 Oct 29 03:20:17.589239 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3109/6257] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:18.148566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-164f48a3-e64d-4372-b972-d0e0a55ff63e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:18.149482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-164f48a3-e64d-4372-b972-d0e0a55ff63e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:18.156739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-164f48a3-e64d-4372-b972-d0e0a55ff63e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:18.157478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-164f48a3-e64d-4372-b972-d0e0a55ff63e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:18.158072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-164f48a3-e64d-4372-b972-d0e0a55ff63e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:18.159113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-164f48a3-e64d-4372-b972-d0e0a55ff63e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:18.159564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-164f48a3-e64d-4372-b972-d0e0a55ff63e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:18.159983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-164f48a3-e64d-4372-b972-d0e0a55ff63e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:18.310438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-164f48a3-e64d-4372-b972-d0e0a55ff63e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:18.324649 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-164f48a3-e64d-4372-b972-d0e0a55ff63e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1237 microversion: 2.1 time: 0.180093 Oct 29 03:20:18.325556 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3149/6258] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:18 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1237 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:18.428015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:18.429723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] [instance: 9b72a9fc-fd46-443d-a9a6-97ee498c9864] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:18.450104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:18.451812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:18.452364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:18.457144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:18.458694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:18.459669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:18.496029 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] HTTP exception thrown: Instance 9b72a9fc-fd46-443d-a9a6-97ee498c9864 could not be found. Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Request method failure captured: Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 HTTP/1.1 Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJtRRJU2ukZoI81QGmxTLoQcZ8Kv023VjdmW11QAH8IUoEvdqsSMHQnKEWVdFcge4GmGllN7-LA7kzrrsG-1xN0aV78nzFVzwK_DcJBZmWCEkhQimbrQqv72A2YWBE8D9Jm1T-vlSHii30FE56LrShpdc7ARtzwvq4T53Z6FBLoYZFU Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: a3d76d510f90412b8f2f2b8f8bec7b83 Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesBackupsTest-199943804 Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a3d76d510f90412b8f2f2b8f8bec7b83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3d76d510f90412b8f2f2b8f8bec7b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a3d76d510f90412b8f2f2b8f8bec7b83", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3d76d510f90412b8f2f2b8f8bec7b83"}]}] Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesBackupsTest-199943804 Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: a3d76d510f90412b8f2f2b8f8bec7b83 Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesBackupsTest-199943804 Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesBackupsTest-199943804-project Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: c80163670b554c0398b7d752a9fc05fb Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesBackupsTest-199943804-project Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 9b72a9fc-fd46-443d-a9a6-97ee498c9864 could not be found. Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '9b72a9fc-fd46-443d-a9a6-97ee498c9864'} Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b72a9fc-fd46-443d-a9a6-97ee498c9864 could not be found. Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b72a9fc-fd46-443d-a9a6-97ee498c9864 could not be found. Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:20:18.506233 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:20:18.510502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:18.510502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:20:18.510502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:20:18.510502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:20:18.510502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:20:18.510502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b72a9fc-fd46-443d-a9a6-97ee498c9864 could not be found. Oct 29 03:20:18.510502 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:20:18.510502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] Returning 404 to user: Instance 9b72a9fc-fd46-443d-a9a6-97ee498c9864 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:20:18.510502 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ec03d66-834e-4382-9b5e-c67a6cb6c819 tempest-VolumesBackupsTest-199943804 tempest-VolumesBackupsTest-199943804-project] 10.222.0.16 "GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864" status: 404 len: 111 microversion: 2.1 time: 0.086101 Oct 29 03:20:18.510502 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3110/6259] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:18 2022] GET /compute/v2.1/servers/9b72a9fc-fd46-443d-a9a6-97ee498c9864 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:20:19.354301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5335b2e-e1fe-45e6-8065-35d61db69308 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:19.356298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b5335b2e-e1fe-45e6-8065-35d61db69308 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:19.388913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5335b2e-e1fe-45e6-8065-35d61db69308 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:19.392149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5335b2e-e1fe-45e6-8065-35d61db69308 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:19.394123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5335b2e-e1fe-45e6-8065-35d61db69308 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:19.399733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5335b2e-e1fe-45e6-8065-35d61db69308 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:19.401771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5335b2e-e1fe-45e6-8065-35d61db69308 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:19.402446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5335b2e-e1fe-45e6-8065-35d61db69308 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:19.586045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b5335b2e-e1fe-45e6-8065-35d61db69308 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:19.602531 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b5335b2e-e1fe-45e6-8065-35d61db69308 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1299 microversion: 2.1 time: 0.250465 Oct 29 03:20:19.604583 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3150/6260] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:19 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:20.633432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-08381efe-53da-468d-8889-f48557ec8aa4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:20.634755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-08381efe-53da-468d-8889-f48557ec8aa4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:20.637909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:20.654144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08381efe-53da-468d-8889-f48557ec8aa4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:20.655244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08381efe-53da-468d-8889-f48557ec8aa4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:20.655880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08381efe-53da-468d-8889-f48557ec8aa4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:20.656797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08381efe-53da-468d-8889-f48557ec8aa4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:20.657441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08381efe-53da-468d-8889-f48557ec8aa4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:20.658507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08381efe-53da-468d-8889-f48557ec8aa4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:21.477724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-08381efe-53da-468d-8889-f48557ec8aa4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:21.487966 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-08381efe-53da-468d-8889-f48557ec8aa4 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1367 microversion: 2.1 time: 0.859409 Oct 29 03:20:21.492434 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3111/6261] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:20 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1367 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:22.515214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51ec7119-95e4-478f-8695-41d325948235 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:22.515825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-51ec7119-95e4-478f-8695-41d325948235 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:22.538488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ec7119-95e4-478f-8695-41d325948235 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:22.538975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ec7119-95e4-478f-8695-41d325948235 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:22.539401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ec7119-95e4-478f-8695-41d325948235 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:22.540132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ec7119-95e4-478f-8695-41d325948235 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:22.542345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ec7119-95e4-478f-8695-41d325948235 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:22.542865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51ec7119-95e4-478f-8695-41d325948235 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:22.552996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:23.046577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-51ec7119-95e4-478f-8695-41d325948235 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:23.058466 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-51ec7119-95e4-478f-8695-41d325948235 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1367 microversion: 2.1 time: 0.545555 Oct 29 03:20:23.060666 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3151/6262] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:22 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1367 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:23.962473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-06fae4b5-fdbb-4b0b-8cb2-1a1c20f1ed75 req-5fa4a83f-bf62-4dac-b07a-09e3ad7dd28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122f9e06-2fe2-4986-a388-48af68a21002", "tag": "5ddfdf8c-5c1f-45dc-a77b-caf52f004f7e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:23.984837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-06fae4b5-fdbb-4b0b-8cb2-1a1c20f1ed75 req-5fa4a83f-bf62-4dac-b07a-09e3ad7dd28d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:23.992431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-06fae4b5-fdbb-4b0b-8cb2-1a1c20f1ed75 req-5fa4a83f-bf62-4dac-b07a-09e3ad7dd28d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:23.994346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-06fae4b5-fdbb-4b0b-8cb2-1a1c20f1ed75 req-5fa4a83f-bf62-4dac-b07a-09e3ad7dd28d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:24.030982 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-06fae4b5-fdbb-4b0b-8cb2-1a1c20f1ed75 req-5fa4a83f-bf62-4dac-b07a-09e3ad7dd28d service nova] Creating event network-changed:5ddfdf8c-5c1f-45dc-a77b-caf52f004f7e for instance 122f9e06-2fe2-4986-a388-48af68a21002 on n-h1-862964-4 Oct 29 03:20:24.058114 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-06fae4b5-fdbb-4b0b-8cb2-1a1c20f1ed75 req-5fa4a83f-bf62-4dac-b07a-09e3ad7dd28d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103954 Oct 29 03:20:24.064455 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3112/6263] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:24.086439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f4ab589f-7025-4328-a96e-8afa3b2a75cb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:24.087234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f4ab589f-7025-4328-a96e-8afa3b2a75cb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:24.089865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:24.109739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4ab589f-7025-4328-a96e-8afa3b2a75cb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:24.114347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4ab589f-7025-4328-a96e-8afa3b2a75cb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:24.114795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4ab589f-7025-4328-a96e-8afa3b2a75cb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:24.115528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4ab589f-7025-4328-a96e-8afa3b2a75cb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:24.119040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4ab589f-7025-4328-a96e-8afa3b2a75cb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:24.119510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f4ab589f-7025-4328-a96e-8afa3b2a75cb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:25.445141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:25.656127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f4ab589f-7025-4328-a96e-8afa3b2a75cb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:25.671341 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f4ab589f-7025-4328-a96e-8afa3b2a75cb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1367 microversion: 2.1 time: 1.589017 Oct 29 03:20:25.689240 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3152/6264] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:24 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1367 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:26.698855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-da7e0130-02e0-4fc2-a3f2-7c104797a577 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:26.699587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-da7e0130-02e0-4fc2-a3f2-7c104797a577 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:26.718037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7e0130-02e0-4fc2-a3f2-7c104797a577 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:26.718630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7e0130-02e0-4fc2-a3f2-7c104797a577 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:26.719077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7e0130-02e0-4fc2-a3f2-7c104797a577 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:26.719818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7e0130-02e0-4fc2-a3f2-7c104797a577 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:26.720324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7e0130-02e0-4fc2-a3f2-7c104797a577 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:26.720752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da7e0130-02e0-4fc2-a3f2-7c104797a577 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:26.879465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:27.076963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-da7e0130-02e0-4fc2-a3f2-7c104797a577 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:27.085380 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-da7e0130-02e0-4fc2-a3f2-7c104797a577 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1367 microversion: 2.1 time: 0.392073 Oct 29 03:20:27.094648 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3113/6265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:26 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:28.132272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d07485a-2d92-461c-a4a7-618472adf9f7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:28.132898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d07485a-2d92-461c-a4a7-618472adf9f7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:28.149729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d07485a-2d92-461c-a4a7-618472adf9f7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:28.153223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d07485a-2d92-461c-a4a7-618472adf9f7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:28.157543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d07485a-2d92-461c-a4a7-618472adf9f7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:28.161763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d07485a-2d92-461c-a4a7-618472adf9f7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:28.163323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d07485a-2d92-461c-a4a7-618472adf9f7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:28.166421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d07485a-2d92-461c-a4a7-618472adf9f7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:28.790078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d07485a-2d92-461c-a4a7-618472adf9f7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:28.802399 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d07485a-2d92-461c-a4a7-618472adf9f7 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1367 microversion: 2.1 time: 0.683564 Oct 29 03:20:28.803425 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3153/6266] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:28 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1367 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:29.830882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5359254e-46ed-4f4e-8ffe-5943d7262ddd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:29.831519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5359254e-46ed-4f4e-8ffe-5943d7262ddd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:29.834505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:29.855454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5359254e-46ed-4f4e-8ffe-5943d7262ddd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:29.856945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5359254e-46ed-4f4e-8ffe-5943d7262ddd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:29.857569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5359254e-46ed-4f4e-8ffe-5943d7262ddd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:29.859338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5359254e-46ed-4f4e-8ffe-5943d7262ddd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:29.860853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5359254e-46ed-4f4e-8ffe-5943d7262ddd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:29.867570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5359254e-46ed-4f4e-8ffe-5943d7262ddd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:30.299436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5359254e-46ed-4f4e-8ffe-5943d7262ddd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:30.316082 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5359254e-46ed-4f4e-8ffe-5943d7262ddd tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1367 microversion: 2.1 time: 0.491231 Oct 29 03:20:30.316690 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3114/6267] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:29 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:31.342539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6b748a5e-713e-47d0-aeb2-93476faa785b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:31.344015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6b748a5e-713e-47d0-aeb2-93476faa785b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:31.366352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b748a5e-713e-47d0-aeb2-93476faa785b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:31.369270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b748a5e-713e-47d0-aeb2-93476faa785b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:31.371595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b748a5e-713e-47d0-aeb2-93476faa785b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:31.375532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b748a5e-713e-47d0-aeb2-93476faa785b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:31.377111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b748a5e-713e-47d0-aeb2-93476faa785b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:31.378180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b748a5e-713e-47d0-aeb2-93476faa785b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:31.832318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6b748a5e-713e-47d0-aeb2-93476faa785b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:31.847840 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6b748a5e-713e-47d0-aeb2-93476faa785b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1367 microversion: 2.1 time: 0.506735 Oct 29 03:20:31.861442 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3154/6268] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:31 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1367 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:32.435375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-627314738-access_point-251979903", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "3e9e3d4f-4175-41da-875c-6755fe4eb1c1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2077221411", "security_groups": [{"name": "tempest-secgroup_access--219318272"}, {"name": "tempest-secgroup_general--1636277768"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:32.737457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] validate_networks() for [('3e9e3d4f-4175-41da-875c-6755fe4eb1c1', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:20:32.872375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f32539c4-5e25-4b25-b4af-fe7b10c2147d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:32.872935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f32539c4-5e25-4b25-b4af-fe7b10c2147d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:32.890872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32539c4-5e25-4b25-b4af-fe7b10c2147d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:32.891384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32539c4-5e25-4b25-b4af-fe7b10c2147d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:32.891825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32539c4-5e25-4b25-b4af-fe7b10c2147d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:32.894430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32539c4-5e25-4b25-b4af-fe7b10c2147d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:32.894914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32539c4-5e25-4b25-b4af-fe7b10c2147d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:32.897583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f32539c4-5e25-4b25-b4af-fe7b10c2147d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:33.445203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f32539c4-5e25-4b25-b4af-fe7b10c2147d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:33.448540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:20:33.448994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:20:33.449460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:20:33.449873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:20:33.450530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:20:33.468524 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f32539c4-5e25-4b25-b4af-fe7b10c2147d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1367 microversion: 2.1 time: 0.600548 Oct 29 03:20:33.470059 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3155/6269] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:32 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1367 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:33.489188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:33.489713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:33.490180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:33.490961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:33.491489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:33.491900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:33.544872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Getting quotas for project 277ad94ea2a64ebf892a59f204307814. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:20:33.551798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Getting quotas for user b612ecc5516f4f6ead6ca28d74911292 and project 277ad94ea2a64ebf892a59f204307814. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:20:33.576957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:20:33.579687 n-d-862964-4 devstack@n-api.service[127041]: WARNING nova.utils [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-627314738-access_point-251979903 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-627314738-acc Oct 29 03:20:33.580693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:20:33.679445 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81b2254f-d855-45ed-ba42-33b45234ee2c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.248151 Oct 29 03:20:33.687954 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3115/6270] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:20:32 2022] POST /compute/v2.1/servers => generated 457 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:20:33.692343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6f3457d1-4802-45bb-9482-1b41f55d554a tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:33.693174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6f3457d1-4802-45bb-9482-1b41f55d554a tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:33.784596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6f3457d1-4802-45bb-9482-1b41f55d554a tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:33.794077 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6f3457d1-4802-45bb-9482-1b41f55d554a tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1293 microversion: 2.1 time: 0.106273 Oct 29 03:20:33.808680 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3156/6271] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:33 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:34.500348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7595a24e-76f9-4bd4-a8f3-6ddb2695fbf3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:34.501922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7595a24e-76f9-4bd4-a8f3-6ddb2695fbf3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:34.524363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7595a24e-76f9-4bd4-a8f3-6ddb2695fbf3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:34.525121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7595a24e-76f9-4bd4-a8f3-6ddb2695fbf3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:34.530025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7595a24e-76f9-4bd4-a8f3-6ddb2695fbf3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:34.538785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7595a24e-76f9-4bd4-a8f3-6ddb2695fbf3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:34.542694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7595a24e-76f9-4bd4-a8f3-6ddb2695fbf3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:34.544197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7595a24e-76f9-4bd4-a8f3-6ddb2695fbf3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:34.804309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7595a24e-76f9-4bd4-a8f3-6ddb2695fbf3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:34.821279 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7595a24e-76f9-4bd4-a8f3-6ddb2695fbf3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1367 microversion: 2.1 time: 0.329072 Oct 29 03:20:34.823970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a09754a4-aafe-499c-bb88-ea6f1abeafd9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:34.824656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a09754a4-aafe-499c-bb88-ea6f1abeafd9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:34.828288 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3116/6272] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:34 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:34.854952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a09754a4-aafe-499c-bb88-ea6f1abeafd9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:34.855545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a09754a4-aafe-499c-bb88-ea6f1abeafd9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:34.858682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a09754a4-aafe-499c-bb88-ea6f1abeafd9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:34.860477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a09754a4-aafe-499c-bb88-ea6f1abeafd9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:34.860948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a09754a4-aafe-499c-bb88-ea6f1abeafd9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:34.864536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a09754a4-aafe-499c-bb88-ea6f1abeafd9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:34.974979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a09754a4-aafe-499c-bb88-ea6f1abeafd9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:34.990860 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a09754a4-aafe-499c-bb88-ea6f1abeafd9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1289 microversion: 2.1 time: 0.170727 Oct 29 03:20:34.992485 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3157/6273] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:34 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1289 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:35.290825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-134b9160-587e-4deb-b2db-472e1ec4c24b req-847f6cc2-004b-4b7f-b60b-4f32d370a1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122f9e06-2fe2-4986-a388-48af68a21002", "name": "network-vif-plugged", "status": "completed", "tag": "5ddfdf8c-5c1f-45dc-a77b-caf52f004f7e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:35.330369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-134b9160-587e-4deb-b2db-472e1ec4c24b req-847f6cc2-004b-4b7f-b60b-4f32d370a1f8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:35.333339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-134b9160-587e-4deb-b2db-472e1ec4c24b req-847f6cc2-004b-4b7f-b60b-4f32d370a1f8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:35.334447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-134b9160-587e-4deb-b2db-472e1ec4c24b req-847f6cc2-004b-4b7f-b60b-4f32d370a1f8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:35.389093 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-134b9160-587e-4deb-b2db-472e1ec4c24b req-847f6cc2-004b-4b7f-b60b-4f32d370a1f8 service nova] Creating event network-vif-plugged:5ddfdf8c-5c1f-45dc-a77b-caf52f004f7e for instance 122f9e06-2fe2-4986-a388-48af68a21002 on n-h1-862964-4 Oct 29 03:20:35.431561 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-134b9160-587e-4deb-b2db-472e1ec4c24b req-847f6cc2-004b-4b7f-b60b-4f32d370a1f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155304 Oct 29 03:20:35.443642 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3117/6274] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:20:35.856086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b27dec91-30de-4c44-b563-83e786ff811d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:35.856770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b27dec91-30de-4c44-b563-83e786ff811d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:35.880438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b27dec91-30de-4c44-b563-83e786ff811d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:35.881461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b27dec91-30de-4c44-b563-83e786ff811d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:35.882603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b27dec91-30de-4c44-b563-83e786ff811d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:35.884026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b27dec91-30de-4c44-b563-83e786ff811d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:35.887402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b27dec91-30de-4c44-b563-83e786ff811d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:35.888282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b27dec91-30de-4c44-b563-83e786ff811d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:36.018590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16c791a7-b2f2-4f69-8873-3b3dffa26c58 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:36.019294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-16c791a7-b2f2-4f69-8873-3b3dffa26c58 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:36.034692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c791a7-b2f2-4f69-8873-3b3dffa26c58 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:36.035122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c791a7-b2f2-4f69-8873-3b3dffa26c58 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:36.035556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c791a7-b2f2-4f69-8873-3b3dffa26c58 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:36.046764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c791a7-b2f2-4f69-8873-3b3dffa26c58 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:36.047628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c791a7-b2f2-4f69-8873-3b3dffa26c58 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:36.052168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16c791a7-b2f2-4f69-8873-3b3dffa26c58 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:36.146116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-16c791a7-b2f2-4f69-8873-3b3dffa26c58 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:36.160574 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-16c791a7-b2f2-4f69-8873-3b3dffa26c58 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1351 microversion: 2.1 time: 0.145796 Oct 29 03:20:36.162156 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3118/6275] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:36 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:36.411972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b27dec91-30de-4c44-b563-83e786ff811d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:36.425056 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b27dec91-30de-4c44-b563-83e786ff811d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1367 microversion: 2.1 time: 0.573716 Oct 29 03:20:36.428920 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3158/6276] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:35 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1367 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:37.183697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-80ad3a8f-d4ad-4ab3-9110-95ab11925bc3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:37.184779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-80ad3a8f-d4ad-4ab3-9110-95ab11925bc3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:37.198618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80ad3a8f-d4ad-4ab3-9110-95ab11925bc3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:37.199668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80ad3a8f-d4ad-4ab3-9110-95ab11925bc3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:37.200314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80ad3a8f-d4ad-4ab3-9110-95ab11925bc3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:37.201934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80ad3a8f-d4ad-4ab3-9110-95ab11925bc3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:37.204906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80ad3a8f-d4ad-4ab3-9110-95ab11925bc3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:37.205597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-80ad3a8f-d4ad-4ab3-9110-95ab11925bc3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:37.440771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-80ad3a8f-d4ad-4ab3-9110-95ab11925bc3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:37.453126 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-80ad3a8f-d4ad-4ab3-9110-95ab11925bc3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1470 microversion: 2.1 time: 0.271934 Oct 29 03:20:37.454030 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3119/6277] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:37 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:37.457205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-03aa721b-db6a-4463-8de0-45c7e45e7ce9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:37.457854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-03aa721b-db6a-4463-8de0-45c7e45e7ce9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:37.473859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03aa721b-db6a-4463-8de0-45c7e45e7ce9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:37.474599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03aa721b-db6a-4463-8de0-45c7e45e7ce9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:37.475045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03aa721b-db6a-4463-8de0-45c7e45e7ce9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:37.475771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03aa721b-db6a-4463-8de0-45c7e45e7ce9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:37.476285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03aa721b-db6a-4463-8de0-45c7e45e7ce9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:37.476767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03aa721b-db6a-4463-8de0-45c7e45e7ce9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:38.399738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-03aa721b-db6a-4463-8de0-45c7e45e7ce9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:38.413527 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-03aa721b-db6a-4463-8de0-45c7e45e7ce9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1557 microversion: 2.1 time: 0.960694 Oct 29 03:20:38.416831 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3159/6278] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:37 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1557 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:38.442103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f875d2d5-1c66-4605-81e8-4f5abbf6c86a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:38.443362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f875d2d5-1c66-4605-81e8-4f5abbf6c86a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:38.469458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f875d2d5-1c66-4605-81e8-4f5abbf6c86a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:38.469458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f875d2d5-1c66-4605-81e8-4f5abbf6c86a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:38.469458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f875d2d5-1c66-4605-81e8-4f5abbf6c86a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:38.471988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f875d2d5-1c66-4605-81e8-4f5abbf6c86a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:38.472970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f875d2d5-1c66-4605-81e8-4f5abbf6c86a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:38.474236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f875d2d5-1c66-4605-81e8-4f5abbf6c86a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:38.481495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5b5004c9-580c-4f7c-9fde-7c8f356a4c93 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:38.486340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5b5004c9-580c-4f7c-9fde-7c8f356a4c93 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:38.505122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5004c9-580c-4f7c-9fde-7c8f356a4c93 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:38.505122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5004c9-580c-4f7c-9fde-7c8f356a4c93 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:38.505533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5004c9-580c-4f7c-9fde-7c8f356a4c93 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:38.506341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5004c9-580c-4f7c-9fde-7c8f356a4c93 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:38.508897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5004c9-580c-4f7c-9fde-7c8f356a4c93 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:38.512422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5004c9-580c-4f7c-9fde-7c8f356a4c93 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:38.694552 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f875d2d5-1c66-4605-81e8-4f5abbf6c86a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.257661 Oct 29 03:20:38.695658 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3120/6279] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:20:38 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-interface => generated 285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:39.012554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5b5004c9-580c-4f7c-9fde-7c8f356a4c93 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:39.023452 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5b5004c9-580c-4f7c-9fde-7c8f356a4c93 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1470 microversion: 2.1 time: 0.549586 Oct 29 03:20:39.024475 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3160/6280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:38 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1470 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:39.466142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-98200728-d523-443e-899d-fab2d83715a1 req-794366fe-930a-471f-80f1-5d2df8236a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bed59ff-7027-4341-bef3-f482a37b515e", "tag": "949456c0-ba71-449a-ba3b-2ffafdd1496b"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:39.512434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-98200728-d523-443e-899d-fab2d83715a1 req-794366fe-930a-471f-80f1-5d2df8236a9e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:39.519021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-98200728-d523-443e-899d-fab2d83715a1 req-794366fe-930a-471f-80f1-5d2df8236a9e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:39.519474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-98200728-d523-443e-899d-fab2d83715a1 req-794366fe-930a-471f-80f1-5d2df8236a9e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:39.568179 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-98200728-d523-443e-899d-fab2d83715a1 req-794366fe-930a-471f-80f1-5d2df8236a9e service nova] Creating event network-changed:949456c0-ba71-449a-ba3b-2ffafdd1496b for instance 0bed59ff-7027-4341-bef3-f482a37b515e on n-h2-862964-4 Oct 29 03:20:39.575206 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-98200728-d523-443e-899d-fab2d83715a1 req-794366fe-930a-471f-80f1-5d2df8236a9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115093 Oct 29 03:20:39.576370 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3121/6281] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:40.049684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-86005736-7a48-49a4-bd20-04e18c0920a4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:40.050632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86005736-7a48-49a4-bd20-04e18c0920a4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:40.067488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86005736-7a48-49a4-bd20-04e18c0920a4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:40.071624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86005736-7a48-49a4-bd20-04e18c0920a4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:40.072199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86005736-7a48-49a4-bd20-04e18c0920a4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:40.072970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86005736-7a48-49a4-bd20-04e18c0920a4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:40.073435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86005736-7a48-49a4-bd20-04e18c0920a4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:40.081741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86005736-7a48-49a4-bd20-04e18c0920a4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:40.482803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-86005736-7a48-49a4-bd20-04e18c0920a4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:40.495917 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-86005736-7a48-49a4-bd20-04e18c0920a4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1470 microversion: 2.1 time: 0.453153 Oct 29 03:20:40.496534 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3161/6282] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:40 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1470 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:40.986521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1bc8e87d-d854-4b99-8415-be46a79f6705 req-75a15063-a67c-41af-9931-3a391be29250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122f9e06-2fe2-4986-a388-48af68a21002", "tag": "5ddfdf8c-5c1f-45dc-a77b-caf52f004f7e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:41.003430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1bc8e87d-d854-4b99-8415-be46a79f6705 req-75a15063-a67c-41af-9931-3a391be29250 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:41.004130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1bc8e87d-d854-4b99-8415-be46a79f6705 req-75a15063-a67c-41af-9931-3a391be29250 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:41.004765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1bc8e87d-d854-4b99-8415-be46a79f6705 req-75a15063-a67c-41af-9931-3a391be29250 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:41.017930 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1bc8e87d-d854-4b99-8415-be46a79f6705 req-75a15063-a67c-41af-9931-3a391be29250 service nova] Creating event network-changed:5ddfdf8c-5c1f-45dc-a77b-caf52f004f7e for instance 122f9e06-2fe2-4986-a388-48af68a21002 on n-h1-862964-4 Oct 29 03:20:41.025492 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1bc8e87d-d854-4b99-8415-be46a79f6705 req-75a15063-a67c-41af-9931-3a391be29250 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049556 Oct 29 03:20:41.026858 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3122/6283] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:41.525275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5605e79a-d197-4c6a-85ea-ae9b1d7e5a17 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:41.526650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5605e79a-d197-4c6a-85ea-ae9b1d7e5a17 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:41.537737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5605e79a-d197-4c6a-85ea-ae9b1d7e5a17 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:41.539460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5605e79a-d197-4c6a-85ea-ae9b1d7e5a17 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:41.543164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5605e79a-d197-4c6a-85ea-ae9b1d7e5a17 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:41.544439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5605e79a-d197-4c6a-85ea-ae9b1d7e5a17 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:41.547948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5605e79a-d197-4c6a-85ea-ae9b1d7e5a17 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:41.559198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5605e79a-d197-4c6a-85ea-ae9b1d7e5a17 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:42.339412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5605e79a-d197-4c6a-85ea-ae9b1d7e5a17 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:42.383344 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5605e79a-d197-4c6a-85ea-ae9b1d7e5a17 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1470 microversion: 2.1 time: 0.862075 Oct 29 03:20:42.388917 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3162/6284] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:41 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1470 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:43.408377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fdf43bba-bf65-464c-8492-fbc4204a320b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:43.409641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fdf43bba-bf65-464c-8492-fbc4204a320b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:43.426182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdf43bba-bf65-464c-8492-fbc4204a320b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:43.426690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdf43bba-bf65-464c-8492-fbc4204a320b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:43.427123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdf43bba-bf65-464c-8492-fbc4204a320b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:43.427850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdf43bba-bf65-464c-8492-fbc4204a320b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:43.428594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdf43bba-bf65-464c-8492-fbc4204a320b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:43.429016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fdf43bba-bf65-464c-8492-fbc4204a320b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:43.432629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:43.507000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:43.569193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:43.712541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fdf43bba-bf65-464c-8492-fbc4204a320b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:43.722596 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fdf43bba-bf65-464c-8492-fbc4204a320b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1470 microversion: 2.1 time: 0.317626 Oct 29 03:20:43.723717 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3123/6285] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:43 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1470 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:44.747050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3aa516a9-86db-4087-b5c7-716cbf1e99df tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:44.748635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3aa516a9-86db-4087-b5c7-716cbf1e99df tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:44.762641 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:20:44.763470 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:20:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e (ip 10.222.0.16) !!! Oct 29 03:20:44.768387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:44.774444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3aa516a9-86db-4087-b5c7-716cbf1e99df tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:44.775226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3aa516a9-86db-4087-b5c7-716cbf1e99df tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:44.777777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3aa516a9-86db-4087-b5c7-716cbf1e99df tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:44.788339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3aa516a9-86db-4087-b5c7-716cbf1e99df tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:44.789253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3aa516a9-86db-4087-b5c7-716cbf1e99df tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:44.791227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3aa516a9-86db-4087-b5c7-716cbf1e99df tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:45.113167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3aa516a9-86db-4087-b5c7-716cbf1e99df tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:45.127473 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3aa516a9-86db-4087-b5c7-716cbf1e99df tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1470 microversion: 2.1 time: 0.384932 Oct 29 03:20:45.146668 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3163/6286] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:44 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1470 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:46.151585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9c752bfe-e2f4-426a-9df6-66f50ecaa5c3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:46.152122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9c752bfe-e2f4-426a-9df6-66f50ecaa5c3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:46.159368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c752bfe-e2f4-426a-9df6-66f50ecaa5c3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:46.159855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c752bfe-e2f4-426a-9df6-66f50ecaa5c3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:46.160287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c752bfe-e2f4-426a-9df6-66f50ecaa5c3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:46.160995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c752bfe-e2f4-426a-9df6-66f50ecaa5c3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:46.161442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c752bfe-e2f4-426a-9df6-66f50ecaa5c3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:46.161890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9c752bfe-e2f4-426a-9df6-66f50ecaa5c3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:46.363743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9c752bfe-e2f4-426a-9df6-66f50ecaa5c3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:46.372398 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9c752bfe-e2f4-426a-9df6-66f50ecaa5c3 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1470 microversion: 2.1 time: 0.225019 Oct 29 03:20:46.373280 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3124/6287] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:46 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:47.098777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d9588ecb-e804-425c-b908-f2060c531736 req-2e6d79b0-9aa5-4298-9811-fd8a5d36c52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bed59ff-7027-4341-bef3-f482a37b515e", "name": "network-vif-plugged", "status": "completed", "tag": "949456c0-ba71-449a-ba3b-2ffafdd1496b"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:47.121832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d9588ecb-e804-425c-b908-f2060c531736 req-2e6d79b0-9aa5-4298-9811-fd8a5d36c52d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:47.123158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d9588ecb-e804-425c-b908-f2060c531736 req-2e6d79b0-9aa5-4298-9811-fd8a5d36c52d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:47.123651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d9588ecb-e804-425c-b908-f2060c531736 req-2e6d79b0-9aa5-4298-9811-fd8a5d36c52d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:47.138886 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d9588ecb-e804-425c-b908-f2060c531736 req-2e6d79b0-9aa5-4298-9811-fd8a5d36c52d service nova] Creating event network-vif-plugged:949456c0-ba71-449a-ba3b-2ffafdd1496b for instance 0bed59ff-7027-4341-bef3-f482a37b515e on n-h2-862964-4 Oct 29 03:20:47.149524 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d9588ecb-e804-425c-b908-f2060c531736 req-2e6d79b0-9aa5-4298-9811-fd8a5d36c52d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053167 Oct 29 03:20:47.152754 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3164/6288] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:20:47.395798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ca7e3721-29da-4ebf-b03c-bccfe0e0c21f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:47.396668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ca7e3721-29da-4ebf-b03c-bccfe0e0c21f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:47.407354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7e3721-29da-4ebf-b03c-bccfe0e0c21f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:47.407843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7e3721-29da-4ebf-b03c-bccfe0e0c21f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:47.411346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7e3721-29da-4ebf-b03c-bccfe0e0c21f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:47.412284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7e3721-29da-4ebf-b03c-bccfe0e0c21f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:47.413823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7e3721-29da-4ebf-b03c-bccfe0e0c21f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:47.417991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7e3721-29da-4ebf-b03c-bccfe0e0c21f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:47.937594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ca7e3721-29da-4ebf-b03c-bccfe0e0c21f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:47.939574 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ca7e3721-29da-4ebf-b03c-bccfe0e0c21f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1470 microversion: 2.1 time: 0.547725 Oct 29 03:20:47.961038 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3125/6289] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:47 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1470 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:48.971513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ee14392-02c9-4fca-91ae-aa512971ffbe tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:48.972970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ee14392-02c9-4fca-91ae-aa512971ffbe tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:48.993593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee14392-02c9-4fca-91ae-aa512971ffbe tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:48.994037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee14392-02c9-4fca-91ae-aa512971ffbe tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:48.994483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee14392-02c9-4fca-91ae-aa512971ffbe tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:48.995174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee14392-02c9-4fca-91ae-aa512971ffbe tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:48.995625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee14392-02c9-4fca-91ae-aa512971ffbe tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:48.996047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ee14392-02c9-4fca-91ae-aa512971ffbe tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:49.346566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ee14392-02c9-4fca-91ae-aa512971ffbe tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:49.357585 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ee14392-02c9-4fca-91ae-aa512971ffbe tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1642 microversion: 2.1 time: 0.392501 Oct 29 03:20:49.358997 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3165/6290] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:48 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1642 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:49.384727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-64e310e1-8f01-4afe-af0c-f1bc9a7c4b4f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:49.386241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-64e310e1-8f01-4afe-af0c-f1bc9a7c4b4f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:49.394291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64e310e1-8f01-4afe-af0c-f1bc9a7c4b4f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:49.395267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64e310e1-8f01-4afe-af0c-f1bc9a7c4b4f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:49.396014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64e310e1-8f01-4afe-af0c-f1bc9a7c4b4f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:49.398071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64e310e1-8f01-4afe-af0c-f1bc9a7c4b4f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:49.399492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64e310e1-8f01-4afe-af0c-f1bc9a7c4b4f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:49.400372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64e310e1-8f01-4afe-af0c-f1bc9a7c4b4f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:49.818065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-64e310e1-8f01-4afe-af0c-f1bc9a7c4b4f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:49.831686 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-64e310e1-8f01-4afe-af0c-f1bc9a7c4b4f tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1642 microversion: 2.1 time: 0.450974 Oct 29 03:20:49.847380 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3126/6291] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:49 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1642 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:49.879005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2074f1f-ad67-4854-a5f4-9969c3ec4f28 tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:49.881613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f2074f1f-ad67-4854-a5f4-9969c3ec4f28 tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:49.929400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2074f1f-ad67-4854-a5f4-9969c3ec4f28 tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:49.935958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2074f1f-ad67-4854-a5f4-9969c3ec4f28 tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:49.939714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2074f1f-ad67-4854-a5f4-9969c3ec4f28 tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:49.942403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2074f1f-ad67-4854-a5f4-9969c3ec4f28 tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:49.944364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2074f1f-ad67-4854-a5f4-9969c3ec4f28 tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:49.945141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2074f1f-ad67-4854-a5f4-9969c3ec4f28 tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:50.731816 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f2074f1f-ad67-4854-a5f4-9969c3ec4f28 tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1793 microversion: 2.1 time: 0.871717 Oct 29 03:20:50.732578 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3166/6292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:49 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1793 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:55.315363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-21cf7f7e-a3cc-4969-a94f-eef9e0b53abf req-6f4b7b0e-d9c8-42ba-a505-c93b671c4f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bed59ff-7027-4341-bef3-f482a37b515e", "tag": "949456c0-ba71-449a-ba3b-2ffafdd1496b"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:55.331301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:55.338287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-21cf7f7e-a3cc-4969-a94f-eef9e0b53abf req-6f4b7b0e-d9c8-42ba-a505-c93b671c4f8e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:55.339161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-21cf7f7e-a3cc-4969-a94f-eef9e0b53abf req-6f4b7b0e-d9c8-42ba-a505-c93b671c4f8e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:55.342012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-21cf7f7e-a3cc-4969-a94f-eef9e0b53abf req-6f4b7b0e-d9c8-42ba-a505-c93b671c4f8e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:55.372397 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-21cf7f7e-a3cc-4969-a94f-eef9e0b53abf req-6f4b7b0e-d9c8-42ba-a505-c93b671c4f8e service nova] Creating event network-changed:949456c0-ba71-449a-ba3b-2ffafdd1496b for instance 0bed59ff-7027-4341-bef3-f482a37b515e on n-h2-862964-4 Oct 29 03:20:55.385235 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-21cf7f7e-a3cc-4969-a94f-eef9e0b53abf req-6f4b7b0e-d9c8-42ba-a505-c93b671c4f8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073406 Oct 29 03:20:55.386598 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3127/6293] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:12.570482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=31 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:12.571357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=84 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:12.741508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e76350a6-29a7-4083-bc96-8b3831625af3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:12.742836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e76350a6-29a7-4083-bc96-8b3831625af3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:12.749993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e76350a6-29a7-4083-bc96-8b3831625af3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:12.750669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e76350a6-29a7-4083-bc96-8b3831625af3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:12.751242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e76350a6-29a7-4083-bc96-8b3831625af3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:12.752229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e76350a6-29a7-4083-bc96-8b3831625af3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:12.752995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e76350a6-29a7-4083-bc96-8b3831625af3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:12.753584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e76350a6-29a7-4083-bc96-8b3831625af3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:12.791108 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e76350a6-29a7-4083-bc96-8b3831625af3 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/ips" status: 200 len: 150 microversion: 2.1 time: 0.226121 Oct 29 03:21:12.799516 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3167/6294] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:21:12 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/ips => generated 150 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:14.214203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=25 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:14.216161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:14.221962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c32d1cf3-e484-40d0-9dbb-3de5e4409a42 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0a4a1a5-99c9-46c4-8244-b45edb7d97e8"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:14.225574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c32d1cf3-e484-40d0-9dbb-3de5e4409a42 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:14.235121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c32d1cf3-e484-40d0-9dbb-3de5e4409a42 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:14.236253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c32d1cf3-e484-40d0-9dbb-3de5e4409a42 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:14.237184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c32d1cf3-e484-40d0-9dbb-3de5e4409a42 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:14.238318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c32d1cf3-e484-40d0-9dbb-3de5e4409a42 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:14.239214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c32d1cf3-e484-40d0-9dbb-3de5e4409a42 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:14.239754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c32d1cf3-e484-40d0-9dbb-3de5e4409a42 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:14.582839 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c32d1cf3-e484-40d0-9dbb-3de5e4409a42 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "POST /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369761 Oct 29 03:21:14.583663 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3128/6295] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:21:14 2022] POST /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:24.054847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:24.055577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:24.189085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2040702546", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "6046273d-5664-4c6d-8574-198e772d46db"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:24.270478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] validate_networks() for [('6046273d-5664-4c6d-8574-198e772d46db', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:21:24.777106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:21:24.777529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:21:24.778057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:21:24.778463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:21:24.778874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:21:24.789095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:24.789570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:24.790005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:24.790928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:24.791542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:24.792147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:24.810830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Getting quotas for project 2b1b4358363c4472b054ba19c0bda83a. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:21:24.817102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Getting quotas for user dc93f2087f8546c4808f6d8c79bc048c and project 2b1b4358363c4472b054ba19c0bda83a. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:21:24.833908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:21:24.836516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:21:24.889207 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-514b803a-ac2e-4a64-9dad-431fcfcd64b5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840332 Oct 29 03:21:24.890282 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3168/6296] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:21:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:21:24.899592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:24.900469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:24.905437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d2312279-7b05-40f0-91a7-08c6a4524b0f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:24.906421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d2312279-7b05-40f0-91a7-08c6a4524b0f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:24.968361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d2312279-7b05-40f0-91a7-08c6a4524b0f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:24.976916 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d2312279-7b05-40f0-91a7-08c6a4524b0f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1214 microversion: 2.1 time: 0.079245 Oct 29 03:21:24.978487 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3129/6297] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:24 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:26.000859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2e67c1d1-001e-45aa-baa7-eb08c42877b1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:26.001499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2e67c1d1-001e-45aa-baa7-eb08c42877b1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:26.008081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e67c1d1-001e-45aa-baa7-eb08c42877b1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:26.008669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e67c1d1-001e-45aa-baa7-eb08c42877b1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:26.010005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e67c1d1-001e-45aa-baa7-eb08c42877b1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:26.011575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e67c1d1-001e-45aa-baa7-eb08c42877b1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:26.012100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e67c1d1-001e-45aa-baa7-eb08c42877b1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:26.012589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2e67c1d1-001e-45aa-baa7-eb08c42877b1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:26.087657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2e67c1d1-001e-45aa-baa7-eb08c42877b1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:26.096321 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2e67c1d1-001e-45aa-baa7-eb08c42877b1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1266 microversion: 2.1 time: 0.100118 Oct 29 03:21:26.097120 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3169/6298] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:25 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:26.920938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b21c62a5-dbcc-4d58-9f5b-583b9884a28c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:26.921463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b21c62a5-dbcc-4d58-9f5b-583b9884a28c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:26.934726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b21c62a5-dbcc-4d58-9f5b-583b9884a28c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:26.935216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b21c62a5-dbcc-4d58-9f5b-583b9884a28c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:26.935647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b21c62a5-dbcc-4d58-9f5b-583b9884a28c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:26.936355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b21c62a5-dbcc-4d58-9f5b-583b9884a28c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:26.936803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b21c62a5-dbcc-4d58-9f5b-583b9884a28c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:26.937218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b21c62a5-dbcc-4d58-9f5b-583b9884a28c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:27.060547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-b21c62a5-dbcc-4d58-9f5b-583b9884a28c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lazy-loading 'services' on Instance uuid 122f9e06-2fe2-4986-a388-48af68a21002 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:21:27.121366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f5f6d4a-cfef-4ad2-be8a-8d1812e80208 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:27.121951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f5f6d4a-cfef-4ad2-be8a-8d1812e80208 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:27.136258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f5f6d4a-cfef-4ad2-be8a-8d1812e80208 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:27.136741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f5f6d4a-cfef-4ad2-be8a-8d1812e80208 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:27.137190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f5f6d4a-cfef-4ad2-be8a-8d1812e80208 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:27.137909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f5f6d4a-cfef-4ad2-be8a-8d1812e80208 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:27.138362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f5f6d4a-cfef-4ad2-be8a-8d1812e80208 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:27.138785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f5f6d4a-cfef-4ad2-be8a-8d1812e80208 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:27.164980 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b21c62a5-dbcc-4d58-9f5b-583b9884a28c tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments/b0a4a1a5-99c9-46c4-8244-b45edb7d97e8" status: 202 len: 0 microversion: 2.1 time: 0.248467 Oct 29 03:21:27.167152 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3130/6299] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:21:26 2022] DELETE /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments/b0a4a1a5-99c9-46c4-8244-b45edb7d97e8 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:21:27.175618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5dc4c6b-0e17-46f8-a1b0-15c250fbaac9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:27.179261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5dc4c6b-0e17-46f8-a1b0-15c250fbaac9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:27.186743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5dc4c6b-0e17-46f8-a1b0-15c250fbaac9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:27.188619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5dc4c6b-0e17-46f8-a1b0-15c250fbaac9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:27.189292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5dc4c6b-0e17-46f8-a1b0-15c250fbaac9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:27.190281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5dc4c6b-0e17-46f8-a1b0-15c250fbaac9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:27.190913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5dc4c6b-0e17-46f8-a1b0-15c250fbaac9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:27.191549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5dc4c6b-0e17-46f8-a1b0-15c250fbaac9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:27.231859 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e5dc4c6b-0e17-46f8-a1b0-15c250fbaac9 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061087 Oct 29 03:21:27.233278 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3131/6300] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:21:27 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:27.273182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f5f6d4a-cfef-4ad2-be8a-8d1812e80208 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:27.285283 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f5f6d4a-cfef-4ad2-be8a-8d1812e80208 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1272 microversion: 2.1 time: 0.168186 Oct 29 03:21:27.287960 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3170/6301] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:27 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:28.245270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b7b80067-20fd-46ae-9d69-5dda352e8455 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:28.247564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b7b80067-20fd-46ae-9d69-5dda352e8455 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:28.266045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7b80067-20fd-46ae-9d69-5dda352e8455 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:28.266943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7b80067-20fd-46ae-9d69-5dda352e8455 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:28.267536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7b80067-20fd-46ae-9d69-5dda352e8455 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:28.268465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7b80067-20fd-46ae-9d69-5dda352e8455 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:28.268949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7b80067-20fd-46ae-9d69-5dda352e8455 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:28.269365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7b80067-20fd-46ae-9d69-5dda352e8455 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:28.313179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-39e1d562-f03e-42db-b9e4-904676a6152c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:28.315250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-39e1d562-f03e-42db-b9e4-904676a6152c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:28.324860 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b7b80067-20fd-46ae-9d69-5dda352e8455 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083401 Oct 29 03:21:28.326401 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3132/6302] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:21:28 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:28.329759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39e1d562-f03e-42db-b9e4-904676a6152c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:28.330331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39e1d562-f03e-42db-b9e4-904676a6152c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:28.330776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39e1d562-f03e-42db-b9e4-904676a6152c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:28.334721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39e1d562-f03e-42db-b9e4-904676a6152c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:28.335671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39e1d562-f03e-42db-b9e4-904676a6152c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:28.336281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39e1d562-f03e-42db-b9e4-904676a6152c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:28.480165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8cce9b47-57e0-40b0-b132-8069f80b4533 req-0aa6243b-d475-4f53-916a-a8e9d0245fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd5b2e9d-ec2f-4b39-8198-27da8b63ac31", "tag": "b8d138f4-7e78-450e-87dd-4121be9ddb72"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:28.513319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8cce9b47-57e0-40b0-b132-8069f80b4533 req-0aa6243b-d475-4f53-916a-a8e9d0245fd0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:28.527720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8cce9b47-57e0-40b0-b132-8069f80b4533 req-0aa6243b-d475-4f53-916a-a8e9d0245fd0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:28.531589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8cce9b47-57e0-40b0-b132-8069f80b4533 req-0aa6243b-d475-4f53-916a-a8e9d0245fd0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:28.573696 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8cce9b47-57e0-40b0-b132-8069f80b4533 req-0aa6243b-d475-4f53-916a-a8e9d0245fd0 service nova] Creating event network-changed:b8d138f4-7e78-450e-87dd-4121be9ddb72 for instance cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 on n-h1-862964-4 Oct 29 03:21:28.587829 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8cce9b47-57e0-40b0-b132-8069f80b4533 req-0aa6243b-d475-4f53-916a-a8e9d0245fd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111965 Oct 29 03:21:28.588804 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3133/6303] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:21:28.787995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-39e1d562-f03e-42db-b9e4-904676a6152c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:28.801613 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-39e1d562-f03e-42db-b9e4-904676a6152c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1314 microversion: 2.1 time: 0.492791 Oct 29 03:21:28.812815 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3171/6304] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:28 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:29.339503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6196a927-3bdb-4bb9-9a3b-03777070527f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:29.341821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6196a927-3bdb-4bb9-9a3b-03777070527f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:29.359598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6196a927-3bdb-4bb9-9a3b-03777070527f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:29.360224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6196a927-3bdb-4bb9-9a3b-03777070527f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:29.360709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6196a927-3bdb-4bb9-9a3b-03777070527f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:29.361478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6196a927-3bdb-4bb9-9a3b-03777070527f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:29.362053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6196a927-3bdb-4bb9-9a3b-03777070527f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:29.362545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6196a927-3bdb-4bb9-9a3b-03777070527f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:29.400721 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6196a927-3bdb-4bb9-9a3b-03777070527f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066602 Oct 29 03:21:29.401661 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3134/6305] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:21:29 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:29.826690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-896d22da-3360-4a2a-9c1b-33da4bdc35f4 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:29.827850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-896d22da-3360-4a2a-9c1b-33da4bdc35f4 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:29.835098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-896d22da-3360-4a2a-9c1b-33da4bdc35f4 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:29.835782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-896d22da-3360-4a2a-9c1b-33da4bdc35f4 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:29.836387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-896d22da-3360-4a2a-9c1b-33da4bdc35f4 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:29.837249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-896d22da-3360-4a2a-9c1b-33da4bdc35f4 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:29.837871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-896d22da-3360-4a2a-9c1b-33da4bdc35f4 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:29.838447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-896d22da-3360-4a2a-9c1b-33da4bdc35f4 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:29.982654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-896d22da-3360-4a2a-9c1b-33da4bdc35f4 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:29.990765 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-896d22da-3360-4a2a-9c1b-33da4bdc35f4 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1314 microversion: 2.1 time: 0.168075 Oct 29 03:21:29.991392 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3172/6306] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:29 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:30.413936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7fb184c8-1dea-49c5-811d-324758ae4b6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:30.417741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7fb184c8-1dea-49c5-811d-324758ae4b6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:30.432500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fb184c8-1dea-49c5-811d-324758ae4b6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:30.432985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fb184c8-1dea-49c5-811d-324758ae4b6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:30.435573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fb184c8-1dea-49c5-811d-324758ae4b6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:30.436306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fb184c8-1dea-49c5-811d-324758ae4b6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:30.438112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fb184c8-1dea-49c5-811d-324758ae4b6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:30.438560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fb184c8-1dea-49c5-811d-324758ae4b6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:30.517858 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7fb184c8-1dea-49c5-811d-324758ae4b6b tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109009 Oct 29 03:21:30.530419 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3135/6307] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:21:30 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:31.016879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-86cbb264-a482-4e8d-bc42-8a6038aeb840 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:31.017491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86cbb264-a482-4e8d-bc42-8a6038aeb840 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:31.032938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86cbb264-a482-4e8d-bc42-8a6038aeb840 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:31.033709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86cbb264-a482-4e8d-bc42-8a6038aeb840 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:31.034316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86cbb264-a482-4e8d-bc42-8a6038aeb840 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:31.037636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86cbb264-a482-4e8d-bc42-8a6038aeb840 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:31.038378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86cbb264-a482-4e8d-bc42-8a6038aeb840 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:31.038976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86cbb264-a482-4e8d-bc42-8a6038aeb840 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:31.371429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-86cbb264-a482-4e8d-bc42-8a6038aeb840 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:31.382234 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-86cbb264-a482-4e8d-bc42-8a6038aeb840 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1314 microversion: 2.1 time: 0.369935 Oct 29 03:21:31.387113 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3173/6308] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:31 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:31.550874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3f0b461a-f66b-467c-9b15-66c75ff98cb5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:31.557340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3f0b461a-f66b-467c-9b15-66c75ff98cb5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:31.578242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0b461a-f66b-467c-9b15-66c75ff98cb5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:31.579049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0b461a-f66b-467c-9b15-66c75ff98cb5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:31.579702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0b461a-f66b-467c-9b15-66c75ff98cb5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:31.581186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0b461a-f66b-467c-9b15-66c75ff98cb5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:31.581892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0b461a-f66b-467c-9b15-66c75ff98cb5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:31.582530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f0b461a-f66b-467c-9b15-66c75ff98cb5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:31.643202 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3f0b461a-f66b-467c-9b15-66c75ff98cb5 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103137 Oct 29 03:21:31.644531 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3136/6309] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:21:31 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:32.422447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aed7a948-43a9-4cdf-ab6e-bd40228c045a tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:32.423782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aed7a948-43a9-4cdf-ab6e-bd40228c045a tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:32.443998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed7a948-43a9-4cdf-ab6e-bd40228c045a tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:32.445992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed7a948-43a9-4cdf-ab6e-bd40228c045a tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:32.447947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed7a948-43a9-4cdf-ab6e-bd40228c045a tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:32.448935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed7a948-43a9-4cdf-ab6e-bd40228c045a tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:32.451404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed7a948-43a9-4cdf-ab6e-bd40228c045a tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:32.452079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aed7a948-43a9-4cdf-ab6e-bd40228c045a tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:32.657676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a6b1d9a-ca9d-4861-87d0-b398415326a6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:32.682834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a6b1d9a-ca9d-4861-87d0-b398415326a6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:32.690551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a6b1d9a-ca9d-4861-87d0-b398415326a6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:32.691041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a6b1d9a-ca9d-4861-87d0-b398415326a6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:32.691486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a6b1d9a-ca9d-4861-87d0-b398415326a6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:32.692210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a6b1d9a-ca9d-4861-87d0-b398415326a6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:32.692664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a6b1d9a-ca9d-4861-87d0-b398415326a6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:32.693090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a6b1d9a-ca9d-4861-87d0-b398415326a6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:32.806217 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a6b1d9a-ca9d-4861-87d0-b398415326a6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153466 Oct 29 03:21:32.810017 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3137/6310] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:21:32 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:32.830932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aed7a948-43a9-4cdf-ab6e-bd40228c045a tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:32.839437 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aed7a948-43a9-4cdf-ab6e-bd40228c045a tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1314 microversion: 2.1 time: 0.430445 Oct 29 03:21:32.842606 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3174/6311] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:32 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:33.817930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ea44bfb1-681d-4a38-bad7-15bfd4242a8f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:33.821049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ea44bfb1-681d-4a38-bad7-15bfd4242a8f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:33.840901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea44bfb1-681d-4a38-bad7-15bfd4242a8f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:33.841392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea44bfb1-681d-4a38-bad7-15bfd4242a8f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:33.841833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea44bfb1-681d-4a38-bad7-15bfd4242a8f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:33.842559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea44bfb1-681d-4a38-bad7-15bfd4242a8f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:33.843006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea44bfb1-681d-4a38-bad7-15bfd4242a8f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:33.843424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea44bfb1-681d-4a38-bad7-15bfd4242a8f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:33.874930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-58d73454-2e84-421f-bd33-1c998de822e1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:33.875594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-58d73454-2e84-421f-bd33-1c998de822e1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:33.894391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58d73454-2e84-421f-bd33-1c998de822e1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:33.896893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58d73454-2e84-421f-bd33-1c998de822e1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:33.897678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58d73454-2e84-421f-bd33-1c998de822e1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:33.899259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58d73454-2e84-421f-bd33-1c998de822e1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:33.901050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58d73454-2e84-421f-bd33-1c998de822e1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:33.903027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58d73454-2e84-421f-bd33-1c998de822e1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:33.907710 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ea44bfb1-681d-4a38-bad7-15bfd4242a8f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093762 Oct 29 03:21:33.913552 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3138/6312] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:21:33 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:21:34.043052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cf9b8f9b-ebce-490e-a8a6-d0c331553371 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:34.043795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cf9b8f9b-ebce-490e-a8a6-d0c331553371 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:34.054544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf9b8f9b-ebce-490e-a8a6-d0c331553371 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:34.055116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf9b8f9b-ebce-490e-a8a6-d0c331553371 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:34.055553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf9b8f9b-ebce-490e-a8a6-d0c331553371 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:34.056261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf9b8f9b-ebce-490e-a8a6-d0c331553371 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:34.056716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf9b8f9b-ebce-490e-a8a6-d0c331553371 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:34.057141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf9b8f9b-ebce-490e-a8a6-d0c331553371 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:34.118097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cf9b8f9b-ebce-490e-a8a6-d0c331553371 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:21:34.189083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-58d73454-2e84-421f-bd33-1c998de822e1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:34.228422 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-58d73454-2e84-421f-bd33-1c998de822e1 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1314 microversion: 2.1 time: 0.364268 Oct 29 03:21:34.231205 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3175/6313] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:33 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:34.302694 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cf9b8f9b-ebce-490e-a8a6-d0c331553371 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 204 len: 0 microversion: 2.1 time: 0.263642 Oct 29 03:21:34.303904 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3139/6314] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:34 2022] DELETE /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:21:34.314170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b99b28b8-d1ac-4122-9bff-b049722441f6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:34.314872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b99b28b8-d1ac-4122-9bff-b049722441f6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:34.325510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b99b28b8-d1ac-4122-9bff-b049722441f6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:34.328273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b99b28b8-d1ac-4122-9bff-b049722441f6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:34.330909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b99b28b8-d1ac-4122-9bff-b049722441f6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:34.331728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b99b28b8-d1ac-4122-9bff-b049722441f6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:34.332662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b99b28b8-d1ac-4122-9bff-b049722441f6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:34.334554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b99b28b8-d1ac-4122-9bff-b049722441f6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:34.631727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b99b28b8-d1ac-4122-9bff-b049722441f6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:34.640523 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b99b28b8-d1ac-4122-9bff-b049722441f6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1682 microversion: 2.1 time: 0.331678 Oct 29 03:21:34.644393 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3176/6315] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:34 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1682 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:34.778001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b43a68ee-6f72-4dde-b021-e04d399528bf req-44e785ef-5936-4f36-a1fc-20f731d0af6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5b2e9d-ec2f-4b39-8198-27da8b63ac31", "name": "network-vif-plugged", "status": "completed", "tag": "b8d138f4-7e78-450e-87dd-4121be9ddb72"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:34.813981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b43a68ee-6f72-4dde-b021-e04d399528bf req-44e785ef-5936-4f36-a1fc-20f731d0af6c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:34.814730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b43a68ee-6f72-4dde-b021-e04d399528bf req-44e785ef-5936-4f36-a1fc-20f731d0af6c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:34.816250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b43a68ee-6f72-4dde-b021-e04d399528bf req-44e785ef-5936-4f36-a1fc-20f731d0af6c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:34.860952 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b43a68ee-6f72-4dde-b021-e04d399528bf req-44e785ef-5936-4f36-a1fc-20f731d0af6c service nova] Creating event network-vif-plugged:b8d138f4-7e78-450e-87dd-4121be9ddb72 for instance cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 on n-h1-862964-4 Oct 29 03:21:34.889469 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b43a68ee-6f72-4dde-b021-e04d399528bf req-44e785ef-5936-4f36-a1fc-20f731d0af6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116822 Oct 29 03:21:34.904292 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3140/6316] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:35.258993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3c3ebd32-a216-4ce6-a3a5-90e3a647c9b9 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:35.261449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3c3ebd32-a216-4ce6-a3a5-90e3a647c9b9 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:35.292150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:35.297743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:35.303088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c3ebd32-a216-4ce6-a3a5-90e3a647c9b9 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:35.303584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c3ebd32-a216-4ce6-a3a5-90e3a647c9b9 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:35.318786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c3ebd32-a216-4ce6-a3a5-90e3a647c9b9 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:35.320112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c3ebd32-a216-4ce6-a3a5-90e3a647c9b9 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:35.320845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c3ebd32-a216-4ce6-a3a5-90e3a647c9b9 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:35.321466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c3ebd32-a216-4ce6-a3a5-90e3a647c9b9 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:35.671106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6f80d40b-2838-49bc-a316-0e35acfd35c6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:35.674712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6f80d40b-2838-49bc-a316-0e35acfd35c6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:35.686086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3c3ebd32-a216-4ce6-a3a5-90e3a647c9b9 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:35.695309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:35.699037 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3c3ebd32-a216-4ce6-a3a5-90e3a647c9b9 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1314 microversion: 2.1 time: 0.446736 Oct 29 03:21:35.700225 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3177/6317] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:35 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:35.723224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f80d40b-2838-49bc-a316-0e35acfd35c6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:35.725606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f80d40b-2838-49bc-a316-0e35acfd35c6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:35.726399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f80d40b-2838-49bc-a316-0e35acfd35c6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:35.727314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f80d40b-2838-49bc-a316-0e35acfd35c6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:35.729262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f80d40b-2838-49bc-a316-0e35acfd35c6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:35.730470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f80d40b-2838-49bc-a316-0e35acfd35c6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:36.421112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6f80d40b-2838-49bc-a316-0e35acfd35c6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:36.433016 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6f80d40b-2838-49bc-a316-0e35acfd35c6 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1682 microversion: 2.1 time: 0.771663 Oct 29 03:21:36.444251 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3141/6318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:35 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1682 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:36.729418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-99341188-2e6b-46fd-8072-7fe2d289983f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:36.729842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-99341188-2e6b-46fd-8072-7fe2d289983f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:36.747267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99341188-2e6b-46fd-8072-7fe2d289983f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:36.747764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99341188-2e6b-46fd-8072-7fe2d289983f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:36.748193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99341188-2e6b-46fd-8072-7fe2d289983f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:36.748910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99341188-2e6b-46fd-8072-7fe2d289983f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:36.749356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99341188-2e6b-46fd-8072-7fe2d289983f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:36.749776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99341188-2e6b-46fd-8072-7fe2d289983f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:37.179651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-99341188-2e6b-46fd-8072-7fe2d289983f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:37.193323 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-99341188-2e6b-46fd-8072-7fe2d289983f tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1314 microversion: 2.1 time: 0.468424 Oct 29 03:21:37.206080 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3178/6319] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:36 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:37.469378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-694fb402-80be-4da9-be67-3116e9a1267d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:37.470583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-694fb402-80be-4da9-be67-3116e9a1267d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:37.492001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-694fb402-80be-4da9-be67-3116e9a1267d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:37.493103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-694fb402-80be-4da9-be67-3116e9a1267d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:37.493559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-694fb402-80be-4da9-be67-3116e9a1267d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:37.494337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-694fb402-80be-4da9-be67-3116e9a1267d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:37.494783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-694fb402-80be-4da9-be67-3116e9a1267d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:37.495203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-694fb402-80be-4da9-be67-3116e9a1267d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:37.840597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-694fb402-80be-4da9-be67-3116e9a1267d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:37.854051 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-694fb402-80be-4da9-be67-3116e9a1267d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1682 microversion: 2.1 time: 0.385790 Oct 29 03:21:37.858853 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3142/6320] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:37 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1682 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:38.217634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b82b2ee0-6253-4561-a625-050f9620a231 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:38.219182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b82b2ee0-6253-4561-a625-050f9620a231 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:38.236767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82b2ee0-6253-4561-a625-050f9620a231 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:38.243370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82b2ee0-6253-4561-a625-050f9620a231 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:38.245652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82b2ee0-6253-4561-a625-050f9620a231 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:38.251318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82b2ee0-6253-4561-a625-050f9620a231 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:38.254189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82b2ee0-6253-4561-a625-050f9620a231 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:38.254726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b82b2ee0-6253-4561-a625-050f9620a231 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:38.669228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b82b2ee0-6253-4561-a625-050f9620a231 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:38.677509 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b82b2ee0-6253-4561-a625-050f9620a231 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1498 microversion: 2.1 time: 0.465281 Oct 29 03:21:38.700396 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3179/6321] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:38 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1498 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:38.763029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-50fd9908-70da-4039-b966-7d4653321534 req-51e1789c-e7be-459f-82d8-6fc78ba8761c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122f9e06-2fe2-4986-a388-48af68a21002", "name": "network-vif-deleted", "tag": "5ddfdf8c-5c1f-45dc-a77b-caf52f004f7e"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:38.786429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-50fd9908-70da-4039-b966-7d4653321534 req-51e1789c-e7be-459f-82d8-6fc78ba8761c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:38.787210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-50fd9908-70da-4039-b966-7d4653321534 req-51e1789c-e7be-459f-82d8-6fc78ba8761c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:38.787886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-50fd9908-70da-4039-b966-7d4653321534 req-51e1789c-e7be-459f-82d8-6fc78ba8761c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:38.807170 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-50fd9908-70da-4039-b966-7d4653321534 req-51e1789c-e7be-459f-82d8-6fc78ba8761c service nova] Creating event network-vif-deleted:5ddfdf8c-5c1f-45dc-a77b-caf52f004f7e for instance 122f9e06-2fe2-4986-a388-48af68a21002 on n-h1-862964-4 Oct 29 03:21:38.815279 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-50fd9908-70da-4039-b966-7d4653321534 req-51e1789c-e7be-459f-82d8-6fc78ba8761c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056365 Oct 29 03:21:38.816429 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3143/6322] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:38.887818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:38.888612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:38.902904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:38.903858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:38.905079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:38.906026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:38.906628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:38.907196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:38.968134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:38.973393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:38.974164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:38.974802 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lazy-loading 'fault' on Instance uuid 122f9e06-2fe2-4986-a388-48af68a21002 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:21:39.052314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2867c5be8974c028f933d1c8fe2c2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9abafce931f45438286305af9b7a64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:39.075663 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8b6638cf-cf15-49c5-8a32-66728d07031d tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 200 len: 1331 microversion: 2.1 time: 0.196627 Oct 29 03:21:39.079303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3180/6323] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:38 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 1331 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:39.507551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1726130494", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "f01ee5df-896c-454a-ba4f-bc97ee2311a9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2077221411", "security_groups": []}, "os:scheduler_hints": {"different_host": ["0bed59ff-7027-4341-bef3-f482a37b515e"]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:39.691930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] validate_networks() for [('f01ee5df-896c-454a-ba4f-bc97ee2311a9', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:21:40.103606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:40.104844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:40.125363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:40.128381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:40.129099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:40.130051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:40.136798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:40.137468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:40.203424 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 HTTP/1.1 Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '122f9e06-2fe2-4986-a388-48af68a21002'} Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:40.205388 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:40.210116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:40.210116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:40.210116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:40.210116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:40.210116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:40.210116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:40.210116 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:40.210116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:40.214302 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-09de68bb-36e9-4cd0-bb6b-19916418673a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 404 len: 111 microversion: 2.1 time: 0.107489 Oct 29 03:21:40.214946 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3181/6324] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:40 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:21:40.225326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8a8064d5-2dd2-416f-ac3b-6efc55ace67a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '.version_select at 0x7fe1a854be50>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:40.282943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8a8064d5-2dd2-416f-ac3b-6efc55ace67a tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897396573" status: 202 len: 0 microversion: 2.1 time: 0.063232 Oct 29 03:21:40.292450 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3182/6325] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:21:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897396573 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:21:40.697286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:21:40.697963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:21:40.698192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:21:40.698601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:21:40.699015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:21:40.717400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:40.717924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:40.718368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:40.719103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:40.719558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:40.721307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:40.772183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Getting quotas for project 277ad94ea2a64ebf892a59f204307814. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:21:40.785676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Getting quotas for user b612ecc5516f4f6ead6ca28d74911292 and project 277ad94ea2a64ebf892a59f204307814. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:21:40.819183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:21:40.821911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:21:40.932209 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-875eb852-a6e5-47d0-8c17-1d229ef2f69c tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.434501 Oct 29 03:21:40.935134 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3144/6326] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:21:39 2022] POST /compute/v2.1/servers => generated 361 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:21:40.947334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bb72f8c-6802-423d-8121-9e0b5e6c69e9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:40.947943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bb72f8c-6802-423d-8121-9e0b5e6c69e9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:41.138678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9bb72f8c-6802-423d-8121-9e0b5e6c69e9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:41.147910 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9bb72f8c-6802-423d-8121-9e0b5e6c69e9 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1242 microversion: 2.1 time: 0.205086 Oct 29 03:21:41.161072 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3183/6327] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:40 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1242 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:42.187214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0424722c-5ee5-409c-9a5e-ea19da90384e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:42.188029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0424722c-5ee5-409c-9a5e-ea19da90384e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:42.206983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0424722c-5ee5-409c-9a5e-ea19da90384e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:42.215520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0424722c-5ee5-409c-9a5e-ea19da90384e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:42.217502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0424722c-5ee5-409c-9a5e-ea19da90384e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:42.220910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0424722c-5ee5-409c-9a5e-ea19da90384e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:42.226206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0424722c-5ee5-409c-9a5e-ea19da90384e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:42.226904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0424722c-5ee5-409c-9a5e-ea19da90384e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:42.470296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0424722c-5ee5-409c-9a5e-ea19da90384e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:42.479061 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0424722c-5ee5-409c-9a5e-ea19da90384e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1238 microversion: 2.1 time: 0.296120 Oct 29 03:21:42.490118 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3145/6328] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:42 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1238 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:43.514987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-80ee1acd-f1a1-4975-8b00-b642366f735d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:43.516292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-80ee1acd-f1a1-4975-8b00-b642366f735d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:43.542865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80ee1acd-f1a1-4975-8b00-b642366f735d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:43.546589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80ee1acd-f1a1-4975-8b00-b642366f735d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:43.549252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80ee1acd-f1a1-4975-8b00-b642366f735d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:43.551916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80ee1acd-f1a1-4975-8b00-b642366f735d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:43.554094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80ee1acd-f1a1-4975-8b00-b642366f735d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:43.554793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-80ee1acd-f1a1-4975-8b00-b642366f735d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:43.701638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-80ee1acd-f1a1-4975-8b00-b642366f735d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:43.713332 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-80ee1acd-f1a1-4975-8b00-b642366f735d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1300 microversion: 2.1 time: 0.202170 Oct 29 03:21:43.738192 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3184/6329] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:43 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1300 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:43.947497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6d71f32d-eb1e-4cb4-ba22-65a520f43fb5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:43.948554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6d71f32d-eb1e-4cb4-ba22-65a520f43fb5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:43.959411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d71f32d-eb1e-4cb4-ba22-65a520f43fb5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:43.964250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d71f32d-eb1e-4cb4-ba22-65a520f43fb5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:43.965578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d71f32d-eb1e-4cb4-ba22-65a520f43fb5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:43.968535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d71f32d-eb1e-4cb4-ba22-65a520f43fb5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:43.969251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d71f32d-eb1e-4cb4-ba22-65a520f43fb5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:43.969938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6d71f32d-eb1e-4cb4-ba22-65a520f43fb5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:44.033173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6d71f32d-eb1e-4cb4-ba22-65a520f43fb5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:21:44.041641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:44.166767 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6d71f32d-eb1e-4cb4-ba22-65a520f43fb5 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 204 len: 0 microversion: 2.1 time: 0.224060 Oct 29 03:21:44.168480 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3146/6330] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:43 2022] DELETE /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:21:44.176924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c573d09-d45a-49c4-b9ca-a4f98ee9af04 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:44.177450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c573d09-d45a-49c4-b9ca-a4f98ee9af04 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:44.193853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c573d09-d45a-49c4-b9ca-a4f98ee9af04 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:44.197829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c573d09-d45a-49c4-b9ca-a4f98ee9af04 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:44.198383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c573d09-d45a-49c4-b9ca-a4f98ee9af04 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:44.199149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c573d09-d45a-49c4-b9ca-a4f98ee9af04 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:44.202237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c573d09-d45a-49c4-b9ca-a4f98ee9af04 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:44.202860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c573d09-d45a-49c4-b9ca-a4f98ee9af04 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:44.503539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c573d09-d45a-49c4-b9ca-a4f98ee9af04 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:44.518786 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c573d09-d45a-49c4-b9ca-a4f98ee9af04 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1504 microversion: 2.1 time: 0.344037 Oct 29 03:21:44.523061 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3185/6331] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:44 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:44.739444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-910245c3-1fbc-4e49-b43b-f8958516d3a2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:44.740590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-910245c3-1fbc-4e49-b43b-f8958516d3a2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:44.750089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910245c3-1fbc-4e49-b43b-f8958516d3a2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:44.753663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910245c3-1fbc-4e49-b43b-f8958516d3a2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:44.754308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910245c3-1fbc-4e49-b43b-f8958516d3a2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:44.756629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910245c3-1fbc-4e49-b43b-f8958516d3a2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:44.759688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910245c3-1fbc-4e49-b43b-f8958516d3a2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:44.760442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910245c3-1fbc-4e49-b43b-f8958516d3a2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:44.876847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-910245c3-1fbc-4e49-b43b-f8958516d3a2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:44.886555 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-910245c3-1fbc-4e49-b43b-f8958516d3a2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1300 microversion: 2.1 time: 0.151785 Oct 29 03:21:44.887151 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3147/6332] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:44 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1300 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:45.561795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-88467163-adc4-4b24-aaa9-b00bfe581e71 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:45.563112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-88467163-adc4-4b24-aaa9-b00bfe581e71 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:45.570971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88467163-adc4-4b24-aaa9-b00bfe581e71 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:45.571785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88467163-adc4-4b24-aaa9-b00bfe581e71 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:45.572410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88467163-adc4-4b24-aaa9-b00bfe581e71 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:45.573355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88467163-adc4-4b24-aaa9-b00bfe581e71 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:45.574056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88467163-adc4-4b24-aaa9-b00bfe581e71 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:45.574710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88467163-adc4-4b24-aaa9-b00bfe581e71 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:45.913691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e7e88995-415c-4a06-ae16-24e7105f6af0 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:45.915678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e7e88995-415c-4a06-ae16-24e7105f6af0 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:45.931363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e88995-415c-4a06-ae16-24e7105f6af0 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:45.933734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e88995-415c-4a06-ae16-24e7105f6af0 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:45.934433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e88995-415c-4a06-ae16-24e7105f6af0 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:45.935727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e88995-415c-4a06-ae16-24e7105f6af0 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:45.936581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e88995-415c-4a06-ae16-24e7105f6af0 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:45.937443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7e88995-415c-4a06-ae16-24e7105f6af0 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:45.978906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-88467163-adc4-4b24-aaa9-b00bfe581e71 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:45.995070 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-88467163-adc4-4b24-aaa9-b00bfe581e71 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1504 microversion: 2.1 time: 0.454765 Oct 29 03:21:45.998230 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3186/6333] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:45 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:46.141463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e7e88995-415c-4a06-ae16-24e7105f6af0 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:46.167440 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e7e88995-415c-4a06-ae16-24e7105f6af0 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1300 microversion: 2.1 time: 0.242375 Oct 29 03:21:46.189538 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3148/6334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:45 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1300 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:46.646818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ba5606a3-92fa-4dd4-a00c-d33849b8afef req-283f8962-72e6-4f21-aa70-36e23f56452e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5b2e9d-ec2f-4b39-8198-27da8b63ac31", "name": "network-vif-deleted", "tag": "b8d138f4-7e78-450e-87dd-4121be9ddb72"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:46.660677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ba5606a3-92fa-4dd4-a00c-d33849b8afef req-283f8962-72e6-4f21-aa70-36e23f56452e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:46.661207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ba5606a3-92fa-4dd4-a00c-d33849b8afef req-283f8962-72e6-4f21-aa70-36e23f56452e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:46.661640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ba5606a3-92fa-4dd4-a00c-d33849b8afef req-283f8962-72e6-4f21-aa70-36e23f56452e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:46.674928 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ba5606a3-92fa-4dd4-a00c-d33849b8afef req-283f8962-72e6-4f21-aa70-36e23f56452e service nova] Creating event network-vif-deleted:b8d138f4-7e78-450e-87dd-4121be9ddb72 for instance cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 on n-h1-862964-4 Oct 29 03:21:46.703051 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ba5606a3-92fa-4dd4-a00c-d33849b8afef req-283f8962-72e6-4f21-aa70-36e23f56452e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061747 Oct 29 03:21:46.703888 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3187/6335] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:46.806441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-55bcba69-2186-4457-8bf4-105fea444b5a req-b661d694-297d-4b47-a4b7-39f199031bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e71641-e5db-46a7-b682-65e36218d4a2", "tag": "4188efe2-396c-4b57-a23b-713911dd648d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:46.825138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55bcba69-2186-4457-8bf4-105fea444b5a req-b661d694-297d-4b47-a4b7-39f199031bd7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:46.826036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55bcba69-2186-4457-8bf4-105fea444b5a req-b661d694-297d-4b47-a4b7-39f199031bd7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:46.827005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55bcba69-2186-4457-8bf4-105fea444b5a req-b661d694-297d-4b47-a4b7-39f199031bd7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:46.853088 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-55bcba69-2186-4457-8bf4-105fea444b5a req-b661d694-297d-4b47-a4b7-39f199031bd7 service nova] Creating event network-changed:4188efe2-396c-4b57-a23b-713911dd648d for instance 17e71641-e5db-46a7-b682-65e36218d4a2 on n-h1-862964-4 Oct 29 03:21:46.860280 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-55bcba69-2186-4457-8bf4-105fea444b5a req-b661d694-297d-4b47-a4b7-39f199031bd7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057991 Oct 29 03:21:46.861408 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3149/6336] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:47.028416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:47.030379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:47.037571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.038554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.039266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.040231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.045036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.045954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.051035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:47.083969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.085578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.086815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.087652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lazy-loading 'fault' on Instance uuid cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:21:47.145680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc93f2087f8546c4808f6d8c79bc048c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b4358363c4472b054ba19c0bda83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:47.156600 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5535b891-f09a-47e4-a7a1-39e1067f5d5c tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 200 len: 1304 microversion: 2.1 time: 0.133965 Oct 29 03:21:47.157592 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3188/6337] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:47 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:47.197630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6be1ec99-bf89-4049-81d4-76600c27f1d4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:47.198797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6be1ec99-bf89-4049-81d4-76600c27f1d4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:47.209649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6be1ec99-bf89-4049-81d4-76600c27f1d4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.210943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6be1ec99-bf89-4049-81d4-76600c27f1d4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.211552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6be1ec99-bf89-4049-81d4-76600c27f1d4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.212636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6be1ec99-bf89-4049-81d4-76600c27f1d4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.213245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6be1ec99-bf89-4049-81d4-76600c27f1d4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.213858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6be1ec99-bf89-4049-81d4-76600c27f1d4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.452665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6be1ec99-bf89-4049-81d4-76600c27f1d4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:47.462132 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6be1ec99-bf89-4049-81d4-76600c27f1d4 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1300 microversion: 2.1 time: 0.269336 Oct 29 03:21:47.476552 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3150/6338] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:47 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1300 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:47.661225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:47.661785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:47.669108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.669764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.670408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.671310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.671746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.672125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.688330 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 HTTP/1.1 Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '122f9e06-2fe2-4986-a388-48af68a21002'} Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:47.696051 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:47.699987 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-446401e4-5dd3-49bf-80ed-ee9112852092 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 404 len: 111 microversion: 2.1 time: 0.041585 Oct 29 03:21:47.701309 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3189/6339] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:47 2022] DELETE /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:47.706534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:47.707150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 122f9e06-2fe2-4986-a388-48af68a21002] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:47.713757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.714278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.714836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.715399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.715869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.716291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.742936 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 HTTP/1.1 Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '122f9e06-2fe2-4986-a388-48af68a21002'} Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:47.745332 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:47.749723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:47.749723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:47.749723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:47.749723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:47.749723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:47.749723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. Oct 29 03:21:47.749723 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:47.757534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance 122f9e06-2fe2-4986-a388-48af68a21002 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:47.761792 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d443f3c6-7f2c-4135-9184-939b0b0fc026 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002" status: 404 len: 111 microversion: 2.1 time: 0.059211 Oct 29 03:21:47.764166 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3151/6340] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:47 2022] GET /compute/v2.1/servers/122f9e06-2fe2-4986-a388-48af68a21002 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:48.187765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:48.188613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] [instance: cd5b2e9d-ec2f-4b39-8198-27da8b63ac31] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:48.197545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:48.198060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:48.198498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:48.199182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:48.207754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:48.208259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:48.237751 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] HTTP exception thrown: Instance cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 could not be found. Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Request method failure captured: Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 HTTP/1.1 Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJwyCEveX5vJ1GVW4oLnhgwHp6g9PqtA9k3o17KrSqB5kW06xsLGXPNF6wqRsCGHSitfDD-fYQOfrQx-_DJM4yKS-zYacb0wFikKOk-53054CbXEZkIulUTkkJlPsf2WYhNK58E1xGMyWzmOHazEWTlqrierQO2uuXDC1NFEO6fCN7w Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 2b1b4358363c4472b054ba19c0bda83a Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-VolumesActionsTest-1828119028 Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2b1b4358363c4472b054ba19c0bda83a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b1b4358363c4472b054ba19c0bda83a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2b1b4358363c4472b054ba19c0bda83a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b1b4358363c4472b054ba19c0bda83a"}]}] Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-VolumesActionsTest-1828119028 Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 2b1b4358363c4472b054ba19c0bda83a Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-VolumesActionsTest-1828119028 Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-VolumesActionsTest-1828119028-project Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: dc93f2087f8546c4808f6d8c79bc048c Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-VolumesActionsTest-1828119028-project Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 could not be found. Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cd5b2e9d-ec2f-4b39-8198-27da8b63ac31'} Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 could not be found. Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 could not be found. Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:48.241497 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:48.248985 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:48.248985 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:48.248985 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:48.248985 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:48.248985 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:48.248985 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 could not be found. Oct 29 03:21:48.248985 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:48.252911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] Returning 404 to user: Instance cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:48.254100 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d4027ed1-acd6-4305-848e-f238c8bf3629 tempest-VolumesActionsTest-1828119028 tempest-VolumesActionsTest-1828119028-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31" status: 404 len: 111 microversion: 2.1 time: 0.071219 Oct 29 03:21:48.255302 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3190/6341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:48 2022] GET /compute/v2.1/servers/cd5b2e9d-ec2f-4b39-8198-27da8b63ac31 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:48.489585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-09a8d776-a2b6-4ecb-b5ab-21e63f4776d2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:48.490392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-09a8d776-a2b6-4ecb-b5ab-21e63f4776d2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:48.503099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a8d776-a2b6-4ecb-b5ab-21e63f4776d2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:48.505324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a8d776-a2b6-4ecb-b5ab-21e63f4776d2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:48.505909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a8d776-a2b6-4ecb-b5ab-21e63f4776d2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:48.508461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a8d776-a2b6-4ecb-b5ab-21e63f4776d2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:48.510542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a8d776-a2b6-4ecb-b5ab-21e63f4776d2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:48.511104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09a8d776-a2b6-4ecb-b5ab-21e63f4776d2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:49.085561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-09a8d776-a2b6-4ecb-b5ab-21e63f4776d2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:49.095935 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-09a8d776-a2b6-4ecb-b5ab-21e63f4776d2 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1300 microversion: 2.1 time: 0.611094 Oct 29 03:21:49.096529 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3152/6342] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:48 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1300 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:50.120935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f0eadcae-069f-47a5-b7cb-0413607126eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:50.122248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f0eadcae-069f-47a5-b7cb-0413607126eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:50.134244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eadcae-069f-47a5-b7cb-0413607126eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:50.134945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eadcae-069f-47a5-b7cb-0413607126eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:50.136425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eadcae-069f-47a5-b7cb-0413607126eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:50.138282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eadcae-069f-47a5-b7cb-0413607126eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:50.139446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eadcae-069f-47a5-b7cb-0413607126eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:50.141763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0eadcae-069f-47a5-b7cb-0413607126eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:50.758776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f0eadcae-069f-47a5-b7cb-0413607126eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:50.770847 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f0eadcae-069f-47a5-b7cb-0413607126eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1300 microversion: 2.1 time: 0.654289 Oct 29 03:21:50.773412 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3191/6343] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:50 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1300 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:51.795027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a2c4397a-1470-460d-af3c-330ba51298eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:51.795671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a2c4397a-1470-460d-af3c-330ba51298eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:51.806404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:51.807176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:51.808869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2c4397a-1470-460d-af3c-330ba51298eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:51.809259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2c4397a-1470-460d-af3c-330ba51298eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:51.809691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2c4397a-1470-460d-af3c-330ba51298eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:51.815153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2c4397a-1470-460d-af3c-330ba51298eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:51.815153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2c4397a-1470-460d-af3c-330ba51298eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:51.815153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2c4397a-1470-460d-af3c-330ba51298eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:51.982329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a2c4397a-1470-460d-af3c-330ba51298eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:51.994683 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a2c4397a-1470-460d-af3c-330ba51298eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1300 microversion: 2.1 time: 0.203164 Oct 29 03:21:51.995656 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3153/6344] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:51 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1300 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:52.480166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:52.489777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:52.490422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:52.511105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:52.512044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:52.512685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:52.513608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:52.514293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:52.514923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:52.534665 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da HTTP/1.1 Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'dfa97d54-2dd3-4579-af28-273efbde95da'} Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:52.537582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:52.542022 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:21:52.542022 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.542022 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:52.542022 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.542022 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.542022 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:52.542022 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:52.542022 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:52.542022 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:52.542022 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:21:52.542022 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.543910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:52.544962 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1030d0c7-d5ea-407e-9478-63848ff616bb tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 404 len: 111 microversion: 2.1 time: 0.068369 Oct 29 03:21:52.546448 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3192/6345] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:52 2022] DELETE /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:52.559020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:52.559928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: dfa97d54-2dd3-4579-af28-273efbde95da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:52.566920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:52.568420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:52.569666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:52.570587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:52.571197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:52.571776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:52.591054 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da HTTP/1.1 Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'dfa97d54-2dd3-4579-af28-273efbde95da'} Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:52.592887 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.596976 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.596976 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:52.596976 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:52.596976 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:52.596976 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:52.596976 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. Oct 29 03:21:52.596976 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.599855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance dfa97d54-2dd3-4579-af28-273efbde95da could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:52.601174 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-465d68f6-4a28-4088-892e-ece1dd09662f tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da" status: 404 len: 111 microversion: 2.1 time: 0.050968 Oct 29 03:21:52.602439 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3154/6346] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:52 2022] GET /compute/v2.1/servers/dfa97d54-2dd3-4579-af28-273efbde95da => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:21:52.611637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:52.612403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:52.623057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:52.623550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:52.623981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:52.627955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:52.628641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:52.629518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:52.660178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c HTTP/1.1 Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '4a940222-301e-49c9-a1ed-4c8bcce9eb0c'} Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:52.664086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:52.667888 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:21:52.667888 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.667888 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:52.667888 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.667888 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.667888 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:52.667888 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:52.667888 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:52.667888 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:52.667888 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:21:52.667888 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.670296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:52.672503 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0ba6a738-776b-4c03-a944-905bed80fc54 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 404 len: 111 microversion: 2.1 time: 0.065528 Oct 29 03:21:52.673622 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3193/6347] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:52 2022] DELETE /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:52.683387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:52.684306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 4a940222-301e-49c9-a1ed-4c8bcce9eb0c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:52.692448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:52.693408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:52.694170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:52.695368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:52.696205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:52.696853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:52.714687 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c HTTP/1.1 Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '4a940222-301e-49c9-a1ed-4c8bcce9eb0c'} Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:52.716607 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.720398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:52.720398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:52.720398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:52.720398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:52.720398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:52.720398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. Oct 29 03:21:52.720398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:52.724117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance 4a940222-301e-49c9-a1ed-4c8bcce9eb0c could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:52.725379 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2f53b3fe-ee1e-44a0-ad9c-f96b951d3c11 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c" status: 404 len: 111 microversion: 2.1 time: 0.047880 Oct 29 03:21:52.726813 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3155/6348] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:52 2022] GET /compute/v2.1/servers/4a940222-301e-49c9-a1ed-4c8bcce9eb0c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:53.019987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2052730b-dbc4-4148-b63e-8b2bf5c841ed tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:53.020728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2052730b-dbc4-4148-b63e-8b2bf5c841ed tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:53.043938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-10558be4-7c5d-420c-a120-0f1692e13824 req-92e3a008-fd77-48c0-be35-8ff5c869a4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e71641-e5db-46a7-b682-65e36218d4a2", "name": "network-vif-plugged", "status": "completed", "tag": "4188efe2-396c-4b57-a23b-713911dd648d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:53.060903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2052730b-dbc4-4148-b63e-8b2bf5c841ed tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:53.063432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2052730b-dbc4-4148-b63e-8b2bf5c841ed tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:53.066510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2052730b-dbc4-4148-b63e-8b2bf5c841ed tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:53.077053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2052730b-dbc4-4148-b63e-8b2bf5c841ed tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:53.078221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2052730b-dbc4-4148-b63e-8b2bf5c841ed tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:53.080057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2052730b-dbc4-4148-b63e-8b2bf5c841ed tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:53.091959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-10558be4-7c5d-420c-a120-0f1692e13824 req-92e3a008-fd77-48c0-be35-8ff5c869a4f9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:53.096723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-10558be4-7c5d-420c-a120-0f1692e13824 req-92e3a008-fd77-48c0-be35-8ff5c869a4f9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:53.099495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-10558be4-7c5d-420c-a120-0f1692e13824 req-92e3a008-fd77-48c0-be35-8ff5c869a4f9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:53.156741 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-10558be4-7c5d-420c-a120-0f1692e13824 req-92e3a008-fd77-48c0-be35-8ff5c869a4f9 service nova] Creating event network-vif-plugged:4188efe2-396c-4b57-a23b-713911dd648d for instance 17e71641-e5db-46a7-b682-65e36218d4a2 on n-h1-862964-4 Oct 29 03:21:53.164078 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-10558be4-7c5d-420c-a120-0f1692e13824 req-92e3a008-fd77-48c0-be35-8ff5c869a4f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126725 Oct 29 03:21:53.175892 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3156/6349] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:53.314557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2052730b-dbc4-4148-b63e-8b2bf5c841ed tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:53.323892 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2052730b-dbc4-4148-b63e-8b2bf5c841ed tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1300 microversion: 2.1 time: 0.309332 Oct 29 03:21:53.329631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3194/6350] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:53 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1300 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:54.355424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-90d4cc6f-f940-45eb-9537-180519316008 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:54.356417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-90d4cc6f-f940-45eb-9537-180519316008 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:54.365624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90d4cc6f-f940-45eb-9537-180519316008 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:54.366633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90d4cc6f-f940-45eb-9537-180519316008 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:54.367946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90d4cc6f-f940-45eb-9537-180519316008 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:54.368833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90d4cc6f-f940-45eb-9537-180519316008 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:54.369473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90d4cc6f-f940-45eb-9537-180519316008 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:54.370689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-90d4cc6f-f940-45eb-9537-180519316008 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:54.549634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-90d4cc6f-f940-45eb-9537-180519316008 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:54.581978 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-90d4cc6f-f940-45eb-9537-180519316008 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1300 microversion: 2.1 time: 0.232693 Oct 29 03:21:54.583034 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3157/6351] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:54 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1300 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:55.605526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-23938ab1-c0e0-4d64-8d24-451e449dc0ad tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:55.606810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-23938ab1-c0e0-4d64-8d24-451e449dc0ad tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:55.611548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:55.624651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23938ab1-c0e0-4d64-8d24-451e449dc0ad tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:55.625413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23938ab1-c0e0-4d64-8d24-451e449dc0ad tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:55.626851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23938ab1-c0e0-4d64-8d24-451e449dc0ad tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:55.629924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23938ab1-c0e0-4d64-8d24-451e449dc0ad tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:55.631437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23938ab1-c0e0-4d64-8d24-451e449dc0ad tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:55.633818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23938ab1-c0e0-4d64-8d24-451e449dc0ad tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:55.841958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-23938ab1-c0e0-4d64-8d24-451e449dc0ad tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:55.855732 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-23938ab1-c0e0-4d64-8d24-451e449dc0ad tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1473 microversion: 2.1 time: 0.254673 Oct 29 03:21:55.858027 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3195/6352] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:55 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1473 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:55.880175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce4c0336-e651-4c0c-ac58-4d2b0be30b1e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:55.881481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce4c0336-e651-4c0c-ac58-4d2b0be30b1e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:55.884639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:55.889941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4c0336-e651-4c0c-ac58-4d2b0be30b1e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:55.890696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4c0336-e651-4c0c-ac58-4d2b0be30b1e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:55.891297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4c0336-e651-4c0c-ac58-4d2b0be30b1e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:55.892209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4c0336-e651-4c0c-ac58-4d2b0be30b1e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:55.892873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4c0336-e651-4c0c-ac58-4d2b0be30b1e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:55.893447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce4c0336-e651-4c0c-ac58-4d2b0be30b1e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:56.016866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce4c0336-e651-4c0c-ac58-4d2b0be30b1e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:56.027678 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce4c0336-e651-4c0c-ac58-4d2b0be30b1e tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1473 microversion: 2.1 time: 0.151094 Oct 29 03:21:56.028995 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3158/6353] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:55 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1473 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:56.054713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-704774f9-8e5e-42b3-a4a1-c3c5610556ad tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:56.055323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-704774f9-8e5e-42b3-a4a1-c3c5610556ad tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:56.065492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704774f9-8e5e-42b3-a4a1-c3c5610556ad tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:56.066420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704774f9-8e5e-42b3-a4a1-c3c5610556ad tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:56.067783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704774f9-8e5e-42b3-a4a1-c3c5610556ad tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:56.068503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704774f9-8e5e-42b3-a4a1-c3c5610556ad tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:56.072286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704774f9-8e5e-42b3-a4a1-c3c5610556ad tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:56.073304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-704774f9-8e5e-42b3-a4a1-c3c5610556ad tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:56.361308 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-704774f9-8e5e-42b3-a4a1-c3c5610556ad tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1624 microversion: 2.1 time: 0.311058 Oct 29 03:21:56.362134 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3196/6354] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:56 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1624 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:56.385202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-521e99bf-7262-4709-88ee-e733a63c08cc tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:56.386515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-521e99bf-7262-4709-88ee-e733a63c08cc tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:56.399190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521e99bf-7262-4709-88ee-e733a63c08cc tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:56.410454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521e99bf-7262-4709-88ee-e733a63c08cc tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:56.411203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521e99bf-7262-4709-88ee-e733a63c08cc tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:56.412005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521e99bf-7262-4709-88ee-e733a63c08cc tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:56.412521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521e99bf-7262-4709-88ee-e733a63c08cc tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:56.413092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521e99bf-7262-4709-88ee-e733a63c08cc tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:56.700067 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-521e99bf-7262-4709-88ee-e733a63c08cc tempest-TestSecurityGroupsBasicOps-475858907 tempest-TestSecurityGroupsBasicOps-475858907-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1912 microversion: 2.1 time: 0.318637 Oct 29 03:21:56.705131 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3159/6355] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:56 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1912 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:56.785339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ce067603-b0b1-4b5e-a3fc-f366995fb39d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:56.785879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ce067603-b0b1-4b5e-a3fc-f366995fb39d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:56.801656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce067603-b0b1-4b5e-a3fc-f366995fb39d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:56.802175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce067603-b0b1-4b5e-a3fc-f366995fb39d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:56.803334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce067603-b0b1-4b5e-a3fc-f366995fb39d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:56.804079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce067603-b0b1-4b5e-a3fc-f366995fb39d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:56.805216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce067603-b0b1-4b5e-a3fc-f366995fb39d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:56.805645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ce067603-b0b1-4b5e-a3fc-f366995fb39d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:56.856372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ce067603-b0b1-4b5e-a3fc-f366995fb39d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:21:56.982132 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ce067603-b0b1-4b5e-a3fc-f366995fb39d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 204 len: 0 microversion: 2.1 time: 0.200168 Oct 29 03:21:56.987441 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3197/6356] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:56 2022] DELETE /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:21:56.996403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8ab9c18-a748-424e-b410-924ca9c8ef54 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:56.997168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8ab9c18-a748-424e-b410-924ca9c8ef54 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:57.008539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8ab9c18-a748-424e-b410-924ca9c8ef54 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:57.012237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8ab9c18-a748-424e-b410-924ca9c8ef54 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:57.012914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8ab9c18-a748-424e-b410-924ca9c8ef54 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:57.014990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8ab9c18-a748-424e-b410-924ca9c8ef54 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:57.015645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8ab9c18-a748-424e-b410-924ca9c8ef54 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:57.016171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8ab9c18-a748-424e-b410-924ca9c8ef54 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:57.164805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8ab9c18-a748-424e-b410-924ca9c8ef54 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:57.173008 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8ab9c18-a748-424e-b410-924ca9c8ef54 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1479 microversion: 2.1 time: 0.181207 Oct 29 03:21:57.173923 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3160/6357] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:56 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1479 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:58.211995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2a35fbf-d75b-40d7-b4c6-39c0e851e4ba tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:58.216530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b2a35fbf-d75b-40d7-b4c6-39c0e851e4ba tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:58.253889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a35fbf-d75b-40d7-b4c6-39c0e851e4ba tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:58.257886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a35fbf-d75b-40d7-b4c6-39c0e851e4ba tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:58.258298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a35fbf-d75b-40d7-b4c6-39c0e851e4ba tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:58.259101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a35fbf-d75b-40d7-b4c6-39c0e851e4ba tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:58.260583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a35fbf-d75b-40d7-b4c6-39c0e851e4ba tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:58.262252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a35fbf-d75b-40d7-b4c6-39c0e851e4ba tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:58.375392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:58.375879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:58.394730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:58.395255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:58.395636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:58.399667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:58.400138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:58.400567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:58.436559 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 HTTP/1.1 Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '89aba2d7-1168-4034-be52-6377499ca509'} Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:58.441501 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:58.446137 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4023cbcf-1a2d-461a-8e8c-1201d63efd70 tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 404 len: 111 microversion: 2.1 time: 0.071443 Oct 29 03:21:58.450732 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3161/6358] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:58 2022] DELETE /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:21:58.454847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2a35fbf-d75b-40d7-b4c6-39c0e851e4ba tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:58.460386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:58.464624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] [instance: 89aba2d7-1168-4034-be52-6377499ca509] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:58.474385 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b2a35fbf-d75b-40d7-b4c6-39c0e851e4ba tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1479 microversion: 2.1 time: 0.280684 Oct 29 03:21:58.475712 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3198/6359] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:58 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1479 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:58.498319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:58.498824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:58.499272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:58.500509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:58.500960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:58.501418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:58.519549 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] HTTP exception thrown: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Request method failure captured: Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 HTTP/1.1 Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJrd7fLvQszKT6d9pCg7lN2MzWC-ibuO7F0S0J1U-GDDtFPoHy0mqcUiG0Jfb6LNjO_bu-aVgU68p_t2-4PnjDSmv-4PvjadmLeYYmshnWcOSkNo30DXN3DEZhJMorokeUSUoq2fosKM97oB72tKprK8ZAG_sQcLexPE3r0b1_hupmw Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9abafce931f45438286305af9b7a64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9abafce931f45438286305af9b7a64a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9abafce931f45438286305af9b7a64a"}]}] Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b9abafce931f45438286305af9b7a64a Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-143873284 Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d2867c5be8974c028f933d1c8fe2c2fa Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-AttachVolumeNegativeTest-143873284-project Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '89aba2d7-1168-4034-be52-6377499ca509'} Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:58.521369 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.525929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:58.525929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:58.525929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:58.525929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:58.525929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:58.525929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. Oct 29 03:21:58.525929 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.527274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] Returning 404 to user: Instance 89aba2d7-1168-4034-be52-6377499ca509 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:58.528461 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-46987f65-1a2f-40d6-aa7b-54c3247e888e tempest-AttachVolumeNegativeTest-143873284 tempest-AttachVolumeNegativeTest-143873284-project] 10.222.0.16 "GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509" status: 404 len: 111 microversion: 2.1 time: 0.073428 Oct 29 03:21:58.529488 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3162/6360] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:58 2022] GET /compute/v2.1/servers/89aba2d7-1168-4034-be52-6377499ca509 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:59.276590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d62d0860-7880-4f14-8cbd-85e44940d830 req-84c7c80c-7023-4b46-84bd-c0979d3c2aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e71641-e5db-46a7-b682-65e36218d4a2", "name": "network-vif-deleted", "tag": "4188efe2-396c-4b57-a23b-713911dd648d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:59.302293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d62d0860-7880-4f14-8cbd-85e44940d830 req-84c7c80c-7023-4b46-84bd-c0979d3c2aee service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:59.302974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d62d0860-7880-4f14-8cbd-85e44940d830 req-84c7c80c-7023-4b46-84bd-c0979d3c2aee service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:59.303861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d62d0860-7880-4f14-8cbd-85e44940d830 req-84c7c80c-7023-4b46-84bd-c0979d3c2aee service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:59.340609 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d62d0860-7880-4f14-8cbd-85e44940d830 req-84c7c80c-7023-4b46-84bd-c0979d3c2aee service nova] Creating event network-vif-deleted:4188efe2-396c-4b57-a23b-713911dd648d for instance 17e71641-e5db-46a7-b682-65e36218d4a2 on n-h1-862964-4 Oct 29 03:21:59.353026 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d62d0860-7880-4f14-8cbd-85e44940d830 req-84c7c80c-7023-4b46-84bd-c0979d3c2aee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080740 Oct 29 03:21:59.356718 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3199/6361] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:59.499331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:59.500359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:59.509759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:59.522308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:59.523085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:59.524245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:59.525009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:59.525587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:59.622500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:59.622946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:59.623382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:59.631084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lazy-loading 'fault' on Instance uuid 17e71641-e5db-46a7-b682-65e36218d4a2 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:21:59.706576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:59.716349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6272744b-84d6-4e3f-a9e5-fd5b4b181209 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 200 len: 1332 microversion: 2.1 time: 0.221247 Oct 29 03:21:59.732620 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3163/6362] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:59 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 1332 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:00.743869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:00.745359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 17e71641-e5db-46a7-b682-65e36218d4a2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:00.754245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:00.755066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:00.755700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:00.756714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:00.771203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:00.772230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:00.825995 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] HTTP exception thrown: Instance 17e71641-e5db-46a7-b682-65e36218d4a2 could not be found. Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Request method failure captured: Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 HTTP/1.1 Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJvsTT0yzYwjnxilbotOrm4rk5sne-vcL_XlbPl7K9x7bRuf1U5Nv95H4JmDcrBGaLwGfKCmshght522xdxoIa7d4T4MVX9TE3WhU0wGNb_kkCxaxWt4U5gUYTgtEX9sgypzq2G1Fy0c__f9qEDkxKq92qDNm5dFcXNoN52orcVJ-m8 Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 277ad94ea2a64ebf892a59f204307814 Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-627314738 Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/277ad94ea2a64ebf892a59f204307814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/277ad94ea2a64ebf892a59f204307814"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_277ad94ea2a64ebf892a59f204307814", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/277ad94ea2a64ebf892a59f204307814"}]}] Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestSecurityGroupsBasicOps-627314738 Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 277ad94ea2a64ebf892a59f204307814 Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-627314738 Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestSecurityGroupsBasicOps-627314738-project Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: b612ecc5516f4f6ead6ca28d74911292 Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestSecurityGroupsBasicOps-627314738-project Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 17e71641-e5db-46a7-b682-65e36218d4a2 could not be found. Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '17e71641-e5db-46a7-b682-65e36218d4a2'} Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e71641-e5db-46a7-b682-65e36218d4a2 could not be found. Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e71641-e5db-46a7-b682-65e36218d4a2 could not be found. Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:22:00.828391 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:22:00.832122 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:00.832122 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:22:00.832122 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:22:00.832122 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:22:00.832122 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:22:00.832122 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e71641-e5db-46a7-b682-65e36218d4a2 could not be found. Oct 29 03:22:00.832122 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:22:00.834474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Returning 404 to user: Instance 17e71641-e5db-46a7-b682-65e36218d4a2 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:22:00.835751 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f197995d-2df2-47bc-9d8a-4bfb867a6c7d tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2" status: 404 len: 111 microversion: 2.1 time: 0.097385 Oct 29 03:22:00.836534 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3200/6363] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:00 2022] GET /compute/v2.1/servers/17e71641-e5db-46a7-b682-65e36218d4a2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:22:09.834708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e3b37c20-fe40-4c6c-93ef-fb9eeeb3fff6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:09.838491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e3b37c20-fe40-4c6c-93ef-fb9eeeb3fff6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:09.851511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=13 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:09.852594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:09.854677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b37c20-fe40-4c6c-93ef-fb9eeeb3fff6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:09.855525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b37c20-fe40-4c6c-93ef-fb9eeeb3fff6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:09.856238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b37c20-fe40-4c6c-93ef-fb9eeeb3fff6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:09.857688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b37c20-fe40-4c6c-93ef-fb9eeeb3fff6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:09.859136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b37c20-fe40-4c6c-93ef-fb9eeeb3fff6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:09.859822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3b37c20-fe40-4c6c-93ef-fb9eeeb3fff6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:09.958691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e3b37c20-fe40-4c6c-93ef-fb9eeeb3fff6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:22:10.138100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-5c1acc98-50b8-4eb7-8765-9faa3f77f8ce req-85dde789-d86b-405d-ad78-bd91ae32c76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bed59ff-7027-4341-bef3-f482a37b515e", "tag": "949456c0-ba71-449a-ba3b-2ffafdd1496b"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:10.159215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5c1acc98-50b8-4eb7-8765-9faa3f77f8ce req-85dde789-d86b-405d-ad78-bd91ae32c76f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:10.165774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5c1acc98-50b8-4eb7-8765-9faa3f77f8ce req-85dde789-d86b-405d-ad78-bd91ae32c76f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:10.166322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5c1acc98-50b8-4eb7-8765-9faa3f77f8ce req-85dde789-d86b-405d-ad78-bd91ae32c76f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:10.208589 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e3b37c20-fe40-4c6c-93ef-fb9eeeb3fff6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 204 len: 0 microversion: 2.1 time: 0.383895 Oct 29 03:22:10.209130 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3164/6364] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:22:09 2022] DELETE /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:22:10.210841 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-5c1acc98-50b8-4eb7-8765-9faa3f77f8ce req-85dde789-d86b-405d-ad78-bd91ae32c76f service nova] Creating event network-changed:949456c0-ba71-449a-ba3b-2ffafdd1496b for instance 0bed59ff-7027-4341-bef3-f482a37b515e on n-h2-862964-4 Oct 29 03:22:10.224007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e423aa3-d649-46c3-a66d-c50de69bfd67 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:10.225090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9e423aa3-d649-46c3-a66d-c50de69bfd67 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:10.233333 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-5c1acc98-50b8-4eb7-8765-9faa3f77f8ce req-85dde789-d86b-405d-ad78-bd91ae32c76f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.406018 Oct 29 03:22:10.235402 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3201/6365] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:10.240239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e423aa3-d649-46c3-a66d-c50de69bfd67 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:10.243159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e423aa3-d649-46c3-a66d-c50de69bfd67 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:10.244047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e423aa3-d649-46c3-a66d-c50de69bfd67 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:10.245615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e423aa3-d649-46c3-a66d-c50de69bfd67 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:10.250763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e423aa3-d649-46c3-a66d-c50de69bfd67 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:10.254315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e423aa3-d649-46c3-a66d-c50de69bfd67 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:10.576269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9e423aa3-d649-46c3-a66d-c50de69bfd67 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:10.586777 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9e423aa3-d649-46c3-a66d-c50de69bfd67 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1767 microversion: 2.1 time: 0.373130 Oct 29 03:22:10.588723 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3165/6366] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:10 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1767 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:11.615385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ee031b86-b3c1-4a82-9b6e-2f65a5e612c6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:11.616974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ee031b86-b3c1-4a82-9b6e-2f65a5e612c6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:11.628794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee031b86-b3c1-4a82-9b6e-2f65a5e612c6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:11.628794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee031b86-b3c1-4a82-9b6e-2f65a5e612c6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:11.628794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee031b86-b3c1-4a82-9b6e-2f65a5e612c6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:11.628794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee031b86-b3c1-4a82-9b6e-2f65a5e612c6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:11.628794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee031b86-b3c1-4a82-9b6e-2f65a5e612c6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:11.629158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee031b86-b3c1-4a82-9b6e-2f65a5e612c6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:12.095914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ee031b86-b3c1-4a82-9b6e-2f65a5e612c6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:12.104663 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ee031b86-b3c1-4a82-9b6e-2f65a5e612c6 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1767 microversion: 2.1 time: 0.493940 Oct 29 03:22:12.124165 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3202/6367] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:11 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1767 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:13.133517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a81275f7-f466-4b0f-87d0-9e8cd86da7eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:13.134289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a81275f7-f466-4b0f-87d0-9e8cd86da7eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:13.149573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81275f7-f466-4b0f-87d0-9e8cd86da7eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:13.151001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81275f7-f466-4b0f-87d0-9e8cd86da7eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:13.156017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-86342567-1a22-4e60-a128-6f7a889074f0 req-a51bd343-2892-4104-ab63-01558e87f936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bed59ff-7027-4341-bef3-f482a37b515e", "name": "network-vif-deleted", "tag": "949456c0-ba71-449a-ba3b-2ffafdd1496b"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:13.156840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81275f7-f466-4b0f-87d0-9e8cd86da7eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:13.167372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86342567-1a22-4e60-a128-6f7a889074f0 req-a51bd343-2892-4104-ab63-01558e87f936 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:13.168101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86342567-1a22-4e60-a128-6f7a889074f0 req-a51bd343-2892-4104-ab63-01558e87f936 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:13.168372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-86342567-1a22-4e60-a128-6f7a889074f0 req-a51bd343-2892-4104-ab63-01558e87f936 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:13.171984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81275f7-f466-4b0f-87d0-9e8cd86da7eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:13.173776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81275f7-f466-4b0f-87d0-9e8cd86da7eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:13.174895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a81275f7-f466-4b0f-87d0-9e8cd86da7eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:13.198912 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-86342567-1a22-4e60-a128-6f7a889074f0 req-a51bd343-2892-4104-ab63-01558e87f936 service nova] Creating event network-vif-deleted:949456c0-ba71-449a-ba3b-2ffafdd1496b for instance 0bed59ff-7027-4341-bef3-f482a37b515e on n-h2-862964-4 Oct 29 03:22:13.212392 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-86342567-1a22-4e60-a128-6f7a889074f0 req-a51bd343-2892-4104-ab63-01558e87f936 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059861 Oct 29 03:22:13.230696 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3203/6368] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:22:13.365955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a81275f7-f466-4b0f-87d0-9e8cd86da7eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b612ecc5516f4f6ead6ca28d74911292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277ad94ea2a64ebf892a59f204307814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:13.386319 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a81275f7-f466-4b0f-87d0-9e8cd86da7eb tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 200 len: 1378 microversion: 2.1 time: 0.258464 Oct 29 03:22:13.387878 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3166/6369] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:13 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 1378 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:14.418028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:14.418696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] [instance: 0bed59ff-7027-4341-bef3-f482a37b515e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:14.426941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:14.433945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:14.434150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:14.434907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:14.435375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:14.436045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:14.465641 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] HTTP exception thrown: Instance 0bed59ff-7027-4341-bef3-f482a37b515e could not be found. Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Request method failure captured: Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e HTTP/1.1 Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJvsTT0yzYwjnxilbotOrm4rk5sne-vcL_XlbPl7K9x7bRuf1U5Nv95H4JmDcrBGaLwGfKCmshght522xdxoIa7d4T4MVX9TE3WhU0wGNb_kkCxaxWt4U5gUYTgtEX9sgypzq2G1Fy0c__f9qEDkxKq92qDNm5dFcXNoN52orcVJ-m8 Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 277ad94ea2a64ebf892a59f204307814 Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-627314738 Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/277ad94ea2a64ebf892a59f204307814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/277ad94ea2a64ebf892a59f204307814"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_277ad94ea2a64ebf892a59f204307814", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/277ad94ea2a64ebf892a59f204307814"}]}] Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestSecurityGroupsBasicOps-627314738 Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 277ad94ea2a64ebf892a59f204307814 Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-627314738 Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestSecurityGroupsBasicOps-627314738-project Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: b612ecc5516f4f6ead6ca28d74911292 Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestSecurityGroupsBasicOps-627314738-project Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 0bed59ff-7027-4341-bef3-f482a37b515e could not be found. Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '0bed59ff-7027-4341-bef3-f482a37b515e'} Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bed59ff-7027-4341-bef3-f482a37b515e could not be found. Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bed59ff-7027-4341-bef3-f482a37b515e could not be found. Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:22:14.467862 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:22:14.473196 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:14.473196 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:22:14.473196 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:22:14.473196 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:22:14.473196 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:22:14.473196 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bed59ff-7027-4341-bef3-f482a37b515e could not be found. Oct 29 03:22:14.473196 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:22:14.474840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Returning 404 to user: Instance 0bed59ff-7027-4341-bef3-f482a37b515e could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:22:14.475969 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9bccd28e-9aaa-4ee6-aa86-8679a3f7df79 tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e" status: 404 len: 111 microversion: 2.1 time: 0.063242 Oct 29 03:22:14.476731 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3204/6370] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:14 2022] GET /compute/v2.1/servers/0bed59ff-7027-4341-bef3-f482a37b515e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:22:21.263944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f933dfc9-f150-4626-9147-5319eb7fbc5b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] Calling method '.version_select at 0x7fe1a8a8eca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:21.305738 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f933dfc9-f150-4626-9147-5319eb7fbc5b tempest-TestSecurityGroupsBasicOps-627314738 tempest-TestSecurityGroupsBasicOps-627314738-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2077221411" status: 202 len: 0 microversion: 2.1 time: 0.047809 Oct 29 03:22:21.306964 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3167/6371] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Oct 29 03:22:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2077221411 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:22:56.474769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1301711554", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "63a5bc93-8443-4e79-97c6-2580d9e59b4a"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:56.486756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:56.488308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:56.546522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] validate_networks() for [('63a5bc93-8443-4e79-97c6-2580d9e59b4a', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:22:57.040411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:22:57.040834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:22:57.041298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:22:57.041697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:22:57.042128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:22:57.070811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:57.071305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:57.071728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:57.077008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:57.077776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:57.078436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:57.101208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Getting quotas for project 3854eeed984341d4a87c49eedf243a53. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:22:57.107437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Getting quotas for user 099e1f7107484087bca33a38ce40ed69 and project 3854eeed984341d4a87c49eedf243a53. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:22:57.128264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:22:57.133514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:22:57.188829 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-83b5fe97-2a0f-4265-a1c9-c100344a23df tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719530 Oct 29 03:22:57.189837 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3205/6372] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:22:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:22:57.199372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:57.206915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:57.211878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3a32d97f-89cb-4801-916e-3864f211aaf0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:57.212484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3a32d97f-89cb-4801-916e-3864f211aaf0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:57.309083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3a32d97f-89cb-4801-916e-3864f211aaf0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:57.318118 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3a32d97f-89cb-4801-916e-3864f211aaf0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1214 microversion: 2.1 time: 0.120725 Oct 29 03:22:57.320628 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3168/6373] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:57 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:58.344388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2bc7a4b7-ab90-44d7-8942-c70252d7ce88 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:58.345004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2bc7a4b7-ab90-44d7-8942-c70252d7ce88 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:58.358876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bc7a4b7-ab90-44d7-8942-c70252d7ce88 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:58.360138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bc7a4b7-ab90-44d7-8942-c70252d7ce88 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:58.360798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bc7a4b7-ab90-44d7-8942-c70252d7ce88 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:58.361727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bc7a4b7-ab90-44d7-8942-c70252d7ce88 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:58.362653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bc7a4b7-ab90-44d7-8942-c70252d7ce88 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:58.363325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bc7a4b7-ab90-44d7-8942-c70252d7ce88 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:58.442372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2bc7a4b7-ab90-44d7-8942-c70252d7ce88 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:58.454307 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2bc7a4b7-ab90-44d7-8942-c70252d7ce88 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1210 microversion: 2.1 time: 0.114935 Oct 29 03:22:58.455849 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3206/6374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:58 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:58.811613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9dd991f3-841c-4e47-a543-2365d2e98669 tempest-PortsAdminExtendedAttrsTestJSON-1351241676 tempest-PortsAdminExtendedAttrsTestJSON-1351241676-project-admin] Calling method '.version_select at 0x7fe1acca2e50>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:58.813429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dd991f3-841c-4e47-a543-2365d2e98669 tempest-PortsAdminExtendedAttrsTestJSON-1351241676 tempest-PortsAdminExtendedAttrsTestJSON-1351241676-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:58.813951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dd991f3-841c-4e47-a543-2365d2e98669 tempest-PortsAdminExtendedAttrsTestJSON-1351241676 tempest-PortsAdminExtendedAttrsTestJSON-1351241676-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:58.814390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dd991f3-841c-4e47-a543-2365d2e98669 tempest-PortsAdminExtendedAttrsTestJSON-1351241676 tempest-PortsAdminExtendedAttrsTestJSON-1351241676-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:58.850488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dd991f3-841c-4e47-a543-2365d2e98669 tempest-PortsAdminExtendedAttrsTestJSON-1351241676 tempest-PortsAdminExtendedAttrsTestJSON-1351241676-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:58.850986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dd991f3-841c-4e47-a543-2365d2e98669 tempest-PortsAdminExtendedAttrsTestJSON-1351241676 tempest-PortsAdminExtendedAttrsTestJSON-1351241676-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:58.851544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dd991f3-841c-4e47-a543-2365d2e98669 tempest-PortsAdminExtendedAttrsTestJSON-1351241676 tempest-PortsAdminExtendedAttrsTestJSON-1351241676-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:58.869989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dd991f3-841c-4e47-a543-2365d2e98669 tempest-PortsAdminExtendedAttrsTestJSON-1351241676 tempest-PortsAdminExtendedAttrsTestJSON-1351241676-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:58.870977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dd991f3-841c-4e47-a543-2365d2e98669 tempest-PortsAdminExtendedAttrsTestJSON-1351241676 tempest-PortsAdminExtendedAttrsTestJSON-1351241676-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:58.871618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9dd991f3-841c-4e47-a543-2365d2e98669 tempest-PortsAdminExtendedAttrsTestJSON-1351241676 tempest-PortsAdminExtendedAttrsTestJSON-1351241676-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:58.879128 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9dd991f3-841c-4e47-a543-2365d2e98669 tempest-PortsAdminExtendedAttrsTestJSON-1351241676 tempest-PortsAdminExtendedAttrsTestJSON-1351241676-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.281652 Oct 29 03:22:58.881337 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3169/6375] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 03:22:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:59.478178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9ba74661-cfb7-4321-9598-51aa9771585b tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:59.479422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9ba74661-cfb7-4321-9598-51aa9771585b tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:59.493982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ba74661-cfb7-4321-9598-51aa9771585b tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:59.494640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ba74661-cfb7-4321-9598-51aa9771585b tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:59.495074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ba74661-cfb7-4321-9598-51aa9771585b tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:59.495884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ba74661-cfb7-4321-9598-51aa9771585b tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:59.496495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ba74661-cfb7-4321-9598-51aa9771585b tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:59.497587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ba74661-cfb7-4321-9598-51aa9771585b tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:59.579843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9ba74661-cfb7-4321-9598-51aa9771585b tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:59.604081 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9ba74661-cfb7-4321-9598-51aa9771585b tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1272 microversion: 2.1 time: 0.115041 Oct 29 03:22:59.605407 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3207/6376] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:59 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:00.628950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50042853-d72d-4e75-baa2-81e7c2f8c26f tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:00.629618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-50042853-d72d-4e75-baa2-81e7c2f8c26f tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:00.637789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50042853-d72d-4e75-baa2-81e7c2f8c26f tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:00.638879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50042853-d72d-4e75-baa2-81e7c2f8c26f tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:00.639516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50042853-d72d-4e75-baa2-81e7c2f8c26f tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:00.640500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50042853-d72d-4e75-baa2-81e7c2f8c26f tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:00.641173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50042853-d72d-4e75-baa2-81e7c2f8c26f tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:00.641873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50042853-d72d-4e75-baa2-81e7c2f8c26f tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:00.934483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-50042853-d72d-4e75-baa2-81e7c2f8c26f tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:00.948167 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50042853-d72d-4e75-baa2-81e7c2f8c26f tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1314 microversion: 2.1 time: 0.323195 Oct 29 03:23:00.965757 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3170/6377] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:00 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:01.630499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-23e32cab-cd47-491d-8b9c-ea6f502b9dd7 req-52c5e21b-abe6-41f3-8ede-967843af22b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b786d4-a50a-4918-8b22-f3e3d73c3d7a", "tag": "8d89904f-89f9-4cba-aac6-7a79ef03b357"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:01.643777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-23e32cab-cd47-491d-8b9c-ea6f502b9dd7 req-52c5e21b-abe6-41f3-8ede-967843af22b3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:01.644810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-23e32cab-cd47-491d-8b9c-ea6f502b9dd7 req-52c5e21b-abe6-41f3-8ede-967843af22b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:01.645433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-23e32cab-cd47-491d-8b9c-ea6f502b9dd7 req-52c5e21b-abe6-41f3-8ede-967843af22b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:01.659504 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-23e32cab-cd47-491d-8b9c-ea6f502b9dd7 req-52c5e21b-abe6-41f3-8ede-967843af22b3 service nova] Creating event network-changed:8d89904f-89f9-4cba-aac6-7a79ef03b357 for instance 06b786d4-a50a-4918-8b22-f3e3d73c3d7a on n-h1-862964-4 Oct 29 03:23:01.667252 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-23e32cab-cd47-491d-8b9c-ea6f502b9dd7 req-52c5e21b-abe6-41f3-8ede-967843af22b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147575 Oct 29 03:23:01.668727 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3208/6378] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:01.974416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bf3f1948-3b02-459b-b059-140822e832a4 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:01.975966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bf3f1948-3b02-459b-b059-140822e832a4 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:01.988301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf3f1948-3b02-459b-b059-140822e832a4 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:01.989074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf3f1948-3b02-459b-b059-140822e832a4 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:01.989695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf3f1948-3b02-459b-b059-140822e832a4 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:01.996663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf3f1948-3b02-459b-b059-140822e832a4 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:01.997418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf3f1948-3b02-459b-b059-140822e832a4 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:01.998119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf3f1948-3b02-459b-b059-140822e832a4 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:02.777471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bf3f1948-3b02-459b-b059-140822e832a4 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:02.788064 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bf3f1948-3b02-459b-b059-140822e832a4 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1314 microversion: 2.1 time: 0.817491 Oct 29 03:23:02.788829 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3171/6379] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:01 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:03.813487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b3f58d20-c0a9-4b32-b1bc-e0f359d4cf84 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:03.814173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b3f58d20-c0a9-4b32-b1bc-e0f359d4cf84 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:03.825075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f58d20-c0a9-4b32-b1bc-e0f359d4cf84 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:03.825715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f58d20-c0a9-4b32-b1bc-e0f359d4cf84 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:03.826193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f58d20-c0a9-4b32-b1bc-e0f359d4cf84 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:03.826898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f58d20-c0a9-4b32-b1bc-e0f359d4cf84 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:03.827357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f58d20-c0a9-4b32-b1bc-e0f359d4cf84 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:03.827775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3f58d20-c0a9-4b32-b1bc-e0f359d4cf84 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:03.975509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3f58d20-c0a9-4b32-b1bc-e0f359d4cf84 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:03.983919 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b3f58d20-c0a9-4b32-b1bc-e0f359d4cf84 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1314 microversion: 2.1 time: 0.174786 Oct 29 03:23:03.985152 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3209/6380] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:03 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:05.008188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9a9e215c-2b64-4cb6-8359-32c079e99637 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:05.008838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9a9e215c-2b64-4cb6-8359-32c079e99637 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:05.024033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a9e215c-2b64-4cb6-8359-32c079e99637 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:05.024538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a9e215c-2b64-4cb6-8359-32c079e99637 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:05.025116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a9e215c-2b64-4cb6-8359-32c079e99637 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:05.026136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a9e215c-2b64-4cb6-8359-32c079e99637 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:05.026445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a9e215c-2b64-4cb6-8359-32c079e99637 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:05.026883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a9e215c-2b64-4cb6-8359-32c079e99637 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:05.283212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9a9e215c-2b64-4cb6-8359-32c079e99637 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:05.291834 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9a9e215c-2b64-4cb6-8359-32c079e99637 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1314 microversion: 2.1 time: 0.288088 Oct 29 03:23:05.294052 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3172/6381] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:05 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:06.317779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0a9c754e-3c61-4021-8833-5440b47f5439 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:06.318725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0a9c754e-3c61-4021-8833-5440b47f5439 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:06.324973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9c754e-3c61-4021-8833-5440b47f5439 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:06.326302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9c754e-3c61-4021-8833-5440b47f5439 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:06.327039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9c754e-3c61-4021-8833-5440b47f5439 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:06.328933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9c754e-3c61-4021-8833-5440b47f5439 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:06.330948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9c754e-3c61-4021-8833-5440b47f5439 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:06.332164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a9c754e-3c61-4021-8833-5440b47f5439 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:06.528738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0a9c754e-3c61-4021-8833-5440b47f5439 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:06.538277 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0a9c754e-3c61-4021-8833-5440b47f5439 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1314 microversion: 2.1 time: 0.225455 Oct 29 03:23:06.538879 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3210/6382] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:06 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:07.316826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:07.323569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-06110ed0-f881-4fa9-b350-dfb29f0e970a req-6a744bd0-a4d1-4bfa-8fe2-4b1727684580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b786d4-a50a-4918-8b22-f3e3d73c3d7a", "name": "network-vif-plugged", "status": "completed", "tag": "8d89904f-89f9-4cba-aac6-7a79ef03b357"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:07.335674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-06110ed0-f881-4fa9-b350-dfb29f0e970a req-6a744bd0-a4d1-4bfa-8fe2-4b1727684580 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:07.336158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-06110ed0-f881-4fa9-b350-dfb29f0e970a req-6a744bd0-a4d1-4bfa-8fe2-4b1727684580 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:07.336772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-06110ed0-f881-4fa9-b350-dfb29f0e970a req-6a744bd0-a4d1-4bfa-8fe2-4b1727684580 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:07.349761 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-06110ed0-f881-4fa9-b350-dfb29f0e970a req-6a744bd0-a4d1-4bfa-8fe2-4b1727684580 service nova] Creating event network-vif-plugged:8d89904f-89f9-4cba-aac6-7a79ef03b357 for instance 06b786d4-a50a-4918-8b22-f3e3d73c3d7a on n-h1-862964-4 Oct 29 03:23:07.355798 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-06110ed0-f881-4fa9-b350-dfb29f0e970a req-6a744bd0-a4d1-4bfa-8fe2-4b1727684580 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228835 Oct 29 03:23:07.356594 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3173/6383] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:23:07.564918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-34c28eae-ea5b-4daf-818e-62e15622b117 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:07.565658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-34c28eae-ea5b-4daf-818e-62e15622b117 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:07.568141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:07.569016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:07.582458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34c28eae-ea5b-4daf-818e-62e15622b117 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:07.583741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34c28eae-ea5b-4daf-818e-62e15622b117 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:07.584951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34c28eae-ea5b-4daf-818e-62e15622b117 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:07.585930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34c28eae-ea5b-4daf-818e-62e15622b117 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:07.587121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34c28eae-ea5b-4daf-818e-62e15622b117 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:07.588007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-34c28eae-ea5b-4daf-818e-62e15622b117 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:07.806102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-34c28eae-ea5b-4daf-818e-62e15622b117 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:07.815378 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-34c28eae-ea5b-4daf-818e-62e15622b117 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1314 microversion: 2.1 time: 0.256212 Oct 29 03:23:07.816593 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3211/6384] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:07 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:08.840538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bd997dce-998b-4da3-9791-e01820c93f5d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:08.841384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bd997dce-998b-4da3-9791-e01820c93f5d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:08.848715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd997dce-998b-4da3-9791-e01820c93f5d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:08.849272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd997dce-998b-4da3-9791-e01820c93f5d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:08.849829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd997dce-998b-4da3-9791-e01820c93f5d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:08.850549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd997dce-998b-4da3-9791-e01820c93f5d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:08.851138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd997dce-998b-4da3-9791-e01820c93f5d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:08.851662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd997dce-998b-4da3-9791-e01820c93f5d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:09.050632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bd997dce-998b-4da3-9791-e01820c93f5d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:09.059048 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bd997dce-998b-4da3-9791-e01820c93f5d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1498 microversion: 2.1 time: 0.224226 Oct 29 03:23:09.060558 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3174/6385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:08 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:09.665950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-86a50efc-7313-4132-85fa-09579e5cd3a9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:09.666411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86a50efc-7313-4132-85fa-09579e5cd3a9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:09.674006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a50efc-7313-4132-85fa-09579e5cd3a9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:09.677837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a50efc-7313-4132-85fa-09579e5cd3a9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:09.678297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a50efc-7313-4132-85fa-09579e5cd3a9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:09.679038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a50efc-7313-4132-85fa-09579e5cd3a9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:09.682061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a50efc-7313-4132-85fa-09579e5cd3a9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:09.682458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a50efc-7313-4132-85fa-09579e5cd3a9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:09.715903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86a50efc-7313-4132-85fa-09579e5cd3a9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:23:09.837281 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-86a50efc-7313-4132-85fa-09579e5cd3a9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "DELETE /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 204 len: 0 microversion: 2.1 time: 0.171677 Oct 29 03:23:09.841164 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3212/6386] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:23:09 2022] DELETE /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:23:09.848054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-000466ba-3702-4613-92ef-a9953154836d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:09.849107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-000466ba-3702-4613-92ef-a9953154836d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:09.856713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000466ba-3702-4613-92ef-a9953154836d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:09.865178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000466ba-3702-4613-92ef-a9953154836d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:09.866752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000466ba-3702-4613-92ef-a9953154836d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:09.868506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000466ba-3702-4613-92ef-a9953154836d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:09.869176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000466ba-3702-4613-92ef-a9953154836d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:09.874419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-000466ba-3702-4613-92ef-a9953154836d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:10.110045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-000466ba-3702-4613-92ef-a9953154836d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:10.121135 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-000466ba-3702-4613-92ef-a9953154836d tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1504 microversion: 2.1 time: 0.276917 Oct 29 03:23:10.131871 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3175/6387] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:09 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:11.158795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-feecf878-88ff-471a-b3f9-3443ef69c9e3 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:11.159681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-feecf878-88ff-471a-b3f9-3443ef69c9e3 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:11.220975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feecf878-88ff-471a-b3f9-3443ef69c9e3 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:11.222112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feecf878-88ff-471a-b3f9-3443ef69c9e3 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:11.227968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feecf878-88ff-471a-b3f9-3443ef69c9e3 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:11.233871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feecf878-88ff-471a-b3f9-3443ef69c9e3 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:11.233871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feecf878-88ff-471a-b3f9-3443ef69c9e3 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:11.233871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feecf878-88ff-471a-b3f9-3443ef69c9e3 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:11.488750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-feecf878-88ff-471a-b3f9-3443ef69c9e3 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:11.501840 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-feecf878-88ff-471a-b3f9-3443ef69c9e3 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1504 microversion: 2.1 time: 0.348500 Oct 29 03:23:11.505036 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3213/6388] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:11 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:12.240117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-0570f4e6-36f1-4252-9ae9-587ee4f3c198 req-bab03f74-2f56-4be2-981d-43f3b4e8b596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b786d4-a50a-4918-8b22-f3e3d73c3d7a", "name": "network-vif-deleted", "tag": "8d89904f-89f9-4cba-aac6-7a79ef03b357"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:12.257166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0570f4e6-36f1-4252-9ae9-587ee4f3c198 req-bab03f74-2f56-4be2-981d-43f3b4e8b596 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:12.257674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0570f4e6-36f1-4252-9ae9-587ee4f3c198 req-bab03f74-2f56-4be2-981d-43f3b4e8b596 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:12.258256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0570f4e6-36f1-4252-9ae9-587ee4f3c198 req-bab03f74-2f56-4be2-981d-43f3b4e8b596 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:12.276061 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-0570f4e6-36f1-4252-9ae9-587ee4f3c198 req-bab03f74-2f56-4be2-981d-43f3b4e8b596 service nova] Creating event network-vif-deleted:8d89904f-89f9-4cba-aac6-7a79ef03b357 for instance 06b786d4-a50a-4918-8b22-f3e3d73c3d7a on n-h1-862964-4 Oct 29 03:23:12.284150 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-0570f4e6-36f1-4252-9ae9-587ee4f3c198 req-bab03f74-2f56-4be2-981d-43f3b4e8b596 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050680 Oct 29 03:23:12.290375 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3176/6389] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:12.529268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:12.530128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:12.558915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:12.560806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:12.561372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:12.564511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:12.565145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:12.566922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:12.611687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:12.612175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:12.612719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:12.613036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lazy-loading 'fault' on Instance uuid 06b786d4-a50a-4918-8b22-f3e3d73c3d7a {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:23:12.685471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:12.699448 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ac27c017-b01b-4670-9ef0-19f2da739efa tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 200 len: 1304 microversion: 2.1 time: 0.174750 Oct 29 03:23:12.700688 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3214/6390] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:12 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 1304 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:13.728977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:13.729561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: 06b786d4-a50a-4918-8b22-f3e3d73c3d7a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:13.738506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:13.739028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:13.739631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:13.740953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:13.741626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:13.746303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:13.762022 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] HTTP exception thrown: Instance 06b786d4-a50a-4918-8b22-f3e3d73c3d7a could not be found. Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Request method failure captured: Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a HTTP/1.1 Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJyNeOKJCUy2wQ74_-eXOY-wOR89WoCakGdPiZp7_KmCk51Z-R6QIZ-xJ8mHdu80eE9x3Ih3MFI_NpgP7Z3W4UnL1F29uqunI07TopgBQydBb6IR63zG6fyWQwRCVfAsw2OBJSG-v6pC81FTxiYBMwCJKKepilBIGHkDz77KWXyFsXk Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 3854eeed984341d4a87c49eedf243a53 Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesActionsTest-1216749851 Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3854eeed984341d4a87c49eedf243a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3854eeed984341d4a87c49eedf243a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3854eeed984341d4a87c49eedf243a53", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3854eeed984341d4a87c49eedf243a53"}]}] Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesActionsTest-1216749851 Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 3854eeed984341d4a87c49eedf243a53 Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesActionsTest-1216749851 Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesActionsTest-1216749851-project Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 099e1f7107484087bca33a38ce40ed69 Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesActionsTest-1216749851-project Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 06b786d4-a50a-4918-8b22-f3e3d73c3d7a could not be found. Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '06b786d4-a50a-4918-8b22-f3e3d73c3d7a'} Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b786d4-a50a-4918-8b22-f3e3d73c3d7a could not be found. Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b786d4-a50a-4918-8b22-f3e3d73c3d7a could not be found. Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:13.763749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:23:13.768227 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:13.768227 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:13.768227 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:13.768227 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:23:13.768227 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:23:13.768227 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b786d4-a50a-4918-8b22-f3e3d73c3d7a could not be found. Oct 29 03:23:13.768227 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:23:13.769592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Returning 404 to user: Instance 06b786d4-a50a-4918-8b22-f3e3d73c3d7a could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:23:13.770647 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-226ad2f9-398a-4197-8540-2cf8fb14f40a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a" status: 404 len: 111 microversion: 2.1 time: 0.046949 Oct 29 03:23:13.772155 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3177/6391] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:13 2022] GET /compute/v2.1/servers/06b786d4-a50a-4918-8b22-f3e3d73c3d7a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:23:13.911710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-203662657", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "63a5bc93-8443-4e79-97c6-2580d9e59b4a"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:14.001740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] validate_networks() for [('63a5bc93-8443-4e79-97c6-2580d9e59b4a', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:23:14.824834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:23:14.825266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:23:14.825732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:23:14.826148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:23:14.828123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:23:14.842193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:14.844121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:14.844843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:14.845642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:14.846139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:14.846563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:14.870808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Getting quotas for project 3854eeed984341d4a87c49eedf243a53. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:23:14.878769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Getting quotas for user 099e1f7107484087bca33a38ce40ed69 and project 3854eeed984341d4a87c49eedf243a53. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:23:14.895607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:23:14.898036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:23:14.962284 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a89f15fc-475d-4347-9257-22033e6097ac tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054968 Oct 29 03:23:14.964056 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3215/6392] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:23:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:23:14.976850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9b82ee74-27ba-4436-9d8a-429b47ec8fae tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:14.978112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9b82ee74-27ba-4436-9d8a-429b47ec8fae tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:15.109967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9b82ee74-27ba-4436-9d8a-429b47ec8fae tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:15.123759 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9b82ee74-27ba-4436-9d8a-429b47ec8fae tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1213 microversion: 2.1 time: 0.152486 Oct 29 03:23:15.139328 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3178/6393] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:14 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:16.152141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b641024c-be21-419b-babe-74fe28ff0d6a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:16.152753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b641024c-be21-419b-babe-74fe28ff0d6a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:16.160751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b641024c-be21-419b-babe-74fe28ff0d6a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:16.161506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b641024c-be21-419b-babe-74fe28ff0d6a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:16.165055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b641024c-be21-419b-babe-74fe28ff0d6a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:16.167945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b641024c-be21-419b-babe-74fe28ff0d6a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:16.173633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b641024c-be21-419b-babe-74fe28ff0d6a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:16.174254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b641024c-be21-419b-babe-74fe28ff0d6a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:16.253740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b641024c-be21-419b-babe-74fe28ff0d6a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:16.264542 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b641024c-be21-419b-babe-74fe28ff0d6a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1265 microversion: 2.1 time: 0.116321 Oct 29 03:23:16.265453 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3216/6394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:16 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:17.289658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-263e34d4-c49f-4092-a85f-6f1b25a494e9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:17.290454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-263e34d4-c49f-4092-a85f-6f1b25a494e9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:17.306219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-263e34d4-c49f-4092-a85f-6f1b25a494e9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:17.308036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-263e34d4-c49f-4092-a85f-6f1b25a494e9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:17.308577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-263e34d4-c49f-4092-a85f-6f1b25a494e9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:17.310795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-263e34d4-c49f-4092-a85f-6f1b25a494e9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:17.311350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-263e34d4-c49f-4092-a85f-6f1b25a494e9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:17.314503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-263e34d4-c49f-4092-a85f-6f1b25a494e9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:17.475050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-263e34d4-c49f-4092-a85f-6f1b25a494e9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:17.484841 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-263e34d4-c49f-4092-a85f-6f1b25a494e9 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1271 microversion: 2.1 time: 0.199659 Oct 29 03:23:17.485450 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3179/6395] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:17 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:18.520214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f390bf0-7232-4de2-b0e2-b5466556229a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:18.520827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f390bf0-7232-4de2-b0e2-b5466556229a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:18.543208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f390bf0-7232-4de2-b0e2-b5466556229a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:18.543723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f390bf0-7232-4de2-b0e2-b5466556229a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:18.544164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f390bf0-7232-4de2-b0e2-b5466556229a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:18.544882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f390bf0-7232-4de2-b0e2-b5466556229a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:18.546420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f390bf0-7232-4de2-b0e2-b5466556229a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:18.547088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f390bf0-7232-4de2-b0e2-b5466556229a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:18.928912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f390bf0-7232-4de2-b0e2-b5466556229a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:18.940604 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f390bf0-7232-4de2-b0e2-b5466556229a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1313 microversion: 2.1 time: 0.430509 Oct 29 03:23:18.942170 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3217/6396] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:18 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:19.590847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d71ed498-3c6b-4736-9c79-eb9930be3153 req-0faa097c-0cb7-4743-aa9f-88f8089c347a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1c67b4-2c8f-4f98-9620-ae7d010956ef", "tag": "602c2543-4852-452a-b25e-8a901d19ae39"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:19.621956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d71ed498-3c6b-4736-9c79-eb9930be3153 req-0faa097c-0cb7-4743-aa9f-88f8089c347a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:19.625045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d71ed498-3c6b-4736-9c79-eb9930be3153 req-0faa097c-0cb7-4743-aa9f-88f8089c347a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:19.627567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d71ed498-3c6b-4736-9c79-eb9930be3153 req-0faa097c-0cb7-4743-aa9f-88f8089c347a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:19.657824 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d71ed498-3c6b-4736-9c79-eb9930be3153 req-0faa097c-0cb7-4743-aa9f-88f8089c347a service nova] Creating event network-changed:602c2543-4852-452a-b25e-8a901d19ae39 for instance cc1c67b4-2c8f-4f98-9620-ae7d010956ef on n-h1-862964-4 Oct 29 03:23:19.676195 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d71ed498-3c6b-4736-9c79-eb9930be3153 req-0faa097c-0cb7-4743-aa9f-88f8089c347a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086359 Oct 29 03:23:19.680958 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3180/6397] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:19.971830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c1719299-0aa0-4166-8fe1-10915654e831 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:19.974883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c1719299-0aa0-4166-8fe1-10915654e831 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:19.994145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1719299-0aa0-4166-8fe1-10915654e831 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:19.998218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1719299-0aa0-4166-8fe1-10915654e831 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:20.000317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1719299-0aa0-4166-8fe1-10915654e831 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:20.001313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1719299-0aa0-4166-8fe1-10915654e831 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:20.001961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1719299-0aa0-4166-8fe1-10915654e831 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:20.003719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c1719299-0aa0-4166-8fe1-10915654e831 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:20.303474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c1719299-0aa0-4166-8fe1-10915654e831 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:20.317677 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c1719299-0aa0-4166-8fe1-10915654e831 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1313 microversion: 2.1 time: 0.356542 Oct 29 03:23:20.335329 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3218/6398] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:19 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:21.345100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d80fc873-3a23-48b3-bba4-d2bf0b1cd48e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:21.346004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d80fc873-3a23-48b3-bba4-d2bf0b1cd48e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:21.377930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d80fc873-3a23-48b3-bba4-d2bf0b1cd48e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:21.381356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d80fc873-3a23-48b3-bba4-d2bf0b1cd48e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:21.382010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d80fc873-3a23-48b3-bba4-d2bf0b1cd48e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:21.382927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d80fc873-3a23-48b3-bba4-d2bf0b1cd48e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:21.383530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d80fc873-3a23-48b3-bba4-d2bf0b1cd48e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:21.385231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d80fc873-3a23-48b3-bba4-d2bf0b1cd48e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:21.672969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d80fc873-3a23-48b3-bba4-d2bf0b1cd48e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:21.686383 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d80fc873-3a23-48b3-bba4-d2bf0b1cd48e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1313 microversion: 2.1 time: 0.343761 Oct 29 03:23:21.688003 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3181/6399] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:21 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:22.717641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7c293dd7-623b-4540-80df-a2b2c8a1b2b0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:22.721008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7c293dd7-623b-4540-80df-a2b2c8a1b2b0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:22.747938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c293dd7-623b-4540-80df-a2b2c8a1b2b0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:22.748872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c293dd7-623b-4540-80df-a2b2c8a1b2b0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:22.750573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c293dd7-623b-4540-80df-a2b2c8a1b2b0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:22.754399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c293dd7-623b-4540-80df-a2b2c8a1b2b0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:22.766225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c293dd7-623b-4540-80df-a2b2c8a1b2b0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:22.766915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c293dd7-623b-4540-80df-a2b2c8a1b2b0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:23.136483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7c293dd7-623b-4540-80df-a2b2c8a1b2b0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:23.151752 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7c293dd7-623b-4540-80df-a2b2c8a1b2b0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1313 microversion: 2.1 time: 0.439249 Oct 29 03:23:23.153614 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3219/6400] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:22 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:24.177929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4735d57c-384e-4747-b8ea-6c8d13a7e95e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:24.178715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4735d57c-384e-4747-b8ea-6c8d13a7e95e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:24.188001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4735d57c-384e-4747-b8ea-6c8d13a7e95e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:24.188991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4735d57c-384e-4747-b8ea-6c8d13a7e95e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:24.189500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4735d57c-384e-4747-b8ea-6c8d13a7e95e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:24.191100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4735d57c-384e-4747-b8ea-6c8d13a7e95e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:24.191843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4735d57c-384e-4747-b8ea-6c8d13a7e95e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:24.192398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4735d57c-384e-4747-b8ea-6c8d13a7e95e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:24.381962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4735d57c-384e-4747-b8ea-6c8d13a7e95e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:24.390459 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4735d57c-384e-4747-b8ea-6c8d13a7e95e tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1313 microversion: 2.1 time: 0.217345 Oct 29 03:23:24.406651 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3182/6401] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:24 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:25.163315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-13ccccef-8837-4445-8583-85c26dca3d5f req-92e9a317-13f3-4843-958a-5aa77f7aaa8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1c67b4-2c8f-4f98-9620-ae7d010956ef", "name": "network-vif-plugged", "status": "completed", "tag": "602c2543-4852-452a-b25e-8a901d19ae39"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:25.174269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:25.175681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:25.178636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-13ccccef-8837-4445-8583-85c26dca3d5f req-92e9a317-13f3-4843-958a-5aa77f7aaa8b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:25.179551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-13ccccef-8837-4445-8583-85c26dca3d5f req-92e9a317-13f3-4843-958a-5aa77f7aaa8b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:25.180170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-13ccccef-8837-4445-8583-85c26dca3d5f req-92e9a317-13f3-4843-958a-5aa77f7aaa8b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:25.198285 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-13ccccef-8837-4445-8583-85c26dca3d5f req-92e9a317-13f3-4843-958a-5aa77f7aaa8b service nova] Creating event network-vif-plugged:602c2543-4852-452a-b25e-8a901d19ae39 for instance cc1c67b4-2c8f-4f98-9620-ae7d010956ef on n-h1-862964-4 Oct 29 03:23:25.203975 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-13ccccef-8837-4445-8583-85c26dca3d5f req-92e9a317-13f3-4843-958a-5aa77f7aaa8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044720 Oct 29 03:23:25.204963 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3220/6402] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:25.415199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ab36c36a-f7ba-4b88-97b0-91fb791fa223 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:25.416735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ab36c36a-f7ba-4b88-97b0-91fb791fa223 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:25.424462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:25.433121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab36c36a-f7ba-4b88-97b0-91fb791fa223 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:25.434877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab36c36a-f7ba-4b88-97b0-91fb791fa223 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:25.436367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab36c36a-f7ba-4b88-97b0-91fb791fa223 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:25.437925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab36c36a-f7ba-4b88-97b0-91fb791fa223 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:25.438873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab36c36a-f7ba-4b88-97b0-91fb791fa223 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:25.439452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ab36c36a-f7ba-4b88-97b0-91fb791fa223 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:25.631644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ab36c36a-f7ba-4b88-97b0-91fb791fa223 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:25.642518 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ab36c36a-f7ba-4b88-97b0-91fb791fa223 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1313 microversion: 2.1 time: 0.232241 Oct 29 03:23:25.643636 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3183/6403] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:25 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:26.685506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e4649f5-4267-48cd-a486-65f402a0b4e0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:26.687513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4e4649f5-4267-48cd-a486-65f402a0b4e0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:26.698816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:26.713993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e4649f5-4267-48cd-a486-65f402a0b4e0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:26.714859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e4649f5-4267-48cd-a486-65f402a0b4e0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:26.715992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e4649f5-4267-48cd-a486-65f402a0b4e0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:26.717219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e4649f5-4267-48cd-a486-65f402a0b4e0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:26.717930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e4649f5-4267-48cd-a486-65f402a0b4e0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:26.718863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e4649f5-4267-48cd-a486-65f402a0b4e0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:26.743512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:26.917732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4e4649f5-4267-48cd-a486-65f402a0b4e0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:26.928550 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4e4649f5-4267-48cd-a486-65f402a0b4e0 tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1498 microversion: 2.1 time: 0.263325 Oct 29 03:23:26.929147 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3221/6404] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:26 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1498 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:27.518328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-00e5112e-b0c4-4a5a-ad6f-472e88512dea tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:27.518906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-00e5112e-b0c4-4a5a-ad6f-472e88512dea tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:27.533066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=39 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:27.537476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e5112e-b0c4-4a5a-ad6f-472e88512dea tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:27.541442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e5112e-b0c4-4a5a-ad6f-472e88512dea tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:27.541938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e5112e-b0c4-4a5a-ad6f-472e88512dea tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:27.542840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e5112e-b0c4-4a5a-ad6f-472e88512dea tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:27.543447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e5112e-b0c4-4a5a-ad6f-472e88512dea tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:27.544006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00e5112e-b0c4-4a5a-ad6f-472e88512dea tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:27.547786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=69 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:27.575527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-00e5112e-b0c4-4a5a-ad6f-472e88512dea tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:23:27.653768 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-00e5112e-b0c4-4a5a-ad6f-472e88512dea tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 204 len: 0 microversion: 2.1 time: 0.141625 Oct 29 03:23:27.655044 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3184/6405] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:23:27 2022] DELETE /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:23:27.663758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da2c4aed-21fb-4e64-96bc-d6db12572cff tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:27.664463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-da2c4aed-21fb-4e64-96bc-d6db12572cff tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:27.670729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2c4aed-21fb-4e64-96bc-d6db12572cff tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:27.671324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2c4aed-21fb-4e64-96bc-d6db12572cff tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:27.671816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2c4aed-21fb-4e64-96bc-d6db12572cff tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:27.672768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2c4aed-21fb-4e64-96bc-d6db12572cff tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:27.673220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2c4aed-21fb-4e64-96bc-d6db12572cff tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:27.673636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da2c4aed-21fb-4e64-96bc-d6db12572cff tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:27.847038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-da2c4aed-21fb-4e64-96bc-d6db12572cff tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:27.857617 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-da2c4aed-21fb-4e64-96bc-d6db12572cff tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1504 microversion: 2.1 time: 0.197984 Oct 29 03:23:27.858243 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3222/6406] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:27 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:28.882340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c244292a-b20c-4006-bbd4-80a6e84f341a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:28.883816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c244292a-b20c-4006-bbd4-80a6e84f341a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:28.898205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c244292a-b20c-4006-bbd4-80a6e84f341a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:28.898702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c244292a-b20c-4006-bbd4-80a6e84f341a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:28.900463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c244292a-b20c-4006-bbd4-80a6e84f341a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:28.901192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c244292a-b20c-4006-bbd4-80a6e84f341a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:28.901643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c244292a-b20c-4006-bbd4-80a6e84f341a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:28.902079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c244292a-b20c-4006-bbd4-80a6e84f341a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:29.121455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c244292a-b20c-4006-bbd4-80a6e84f341a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:29.132475 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c244292a-b20c-4006-bbd4-80a6e84f341a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1504 microversion: 2.1 time: 0.255209 Oct 29 03:23:29.134147 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3185/6407] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:28 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:30.156600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4fe7f606-6e3b-4e97-b72e-c86ffbc3b44a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:30.157975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4fe7f606-6e3b-4e97-b72e-c86ffbc3b44a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:30.158658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-244f50ec-a7b4-4ab1-9cf2-211ec83c44bd req-844505f7-ac0f-4358-9470-cf4f9df44537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1c67b4-2c8f-4f98-9620-ae7d010956ef", "name": "network-vif-deleted", "tag": "602c2543-4852-452a-b25e-8a901d19ae39"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:30.168241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe7f606-6e3b-4e97-b72e-c86ffbc3b44a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:30.170485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-244f50ec-a7b4-4ab1-9cf2-211ec83c44bd req-844505f7-ac0f-4358-9470-cf4f9df44537 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:30.171167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-244f50ec-a7b4-4ab1-9cf2-211ec83c44bd req-844505f7-ac0f-4358-9470-cf4f9df44537 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:30.171308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe7f606-6e3b-4e97-b72e-c86ffbc3b44a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:30.171762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-244f50ec-a7b4-4ab1-9cf2-211ec83c44bd req-844505f7-ac0f-4358-9470-cf4f9df44537 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:30.173368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe7f606-6e3b-4e97-b72e-c86ffbc3b44a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:30.175801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe7f606-6e3b-4e97-b72e-c86ffbc3b44a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:30.176499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe7f606-6e3b-4e97-b72e-c86ffbc3b44a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:30.177257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4fe7f606-6e3b-4e97-b72e-c86ffbc3b44a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:30.187950 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-244f50ec-a7b4-4ab1-9cf2-211ec83c44bd req-844505f7-ac0f-4358-9470-cf4f9df44537 service nova] Creating event network-vif-deleted:602c2543-4852-452a-b25e-8a901d19ae39 for instance cc1c67b4-2c8f-4f98-9620-ae7d010956ef on n-h1-862964-4 Oct 29 03:23:30.194032 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-244f50ec-a7b4-4ab1-9cf2-211ec83c44bd req-844505f7-ac0f-4358-9470-cf4f9df44537 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043124 Oct 29 03:23:30.195463 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3223/6408] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:30.264478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4fe7f606-6e3b-4e97-b72e-c86ffbc3b44a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '099e1f7107484087bca33a38ce40ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3854eeed984341d4a87c49eedf243a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:30.277032 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4fe7f606-6e3b-4e97-b72e-c86ffbc3b44a tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 200 len: 1462 microversion: 2.1 time: 0.124137 Oct 29 03:23:30.282296 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3186/6409] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:30 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 1462 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:31.307034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:31.307718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] [instance: cc1c67b4-2c8f-4f98-9620-ae7d010956ef] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:31.324826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:31.325315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:31.325737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:31.326924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:31.327374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:31.327791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:31.349411 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] HTTP exception thrown: Instance cc1c67b4-2c8f-4f98-9620-ae7d010956ef could not be found. Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Request method failure captured: Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef HTTP/1.1 Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJyNeOKJCUy2wQ74_-eXOY-wOR89WoCakGdPiZp7_KmCk51Z-R6QIZ-xJ8mHdu80eE9x3Ih3MFI_NpgP7Z3W4UnL1F29uqunI07TopgBQydBb6IR63zG6fyWQwRCVfAsw2OBJSG-v6pC81FTxiYBMwCJKKepilBIGHkDz77KWXyFsXk Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 3854eeed984341d4a87c49eedf243a53 Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-VolumesActionsTest-1216749851 Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3854eeed984341d4a87c49eedf243a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3854eeed984341d4a87c49eedf243a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3854eeed984341d4a87c49eedf243a53", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3854eeed984341d4a87c49eedf243a53"}]}] Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-VolumesActionsTest-1216749851 Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 3854eeed984341d4a87c49eedf243a53 Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-VolumesActionsTest-1216749851 Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-VolumesActionsTest-1216749851-project Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 099e1f7107484087bca33a38ce40ed69 Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-VolumesActionsTest-1216749851-project Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance cc1c67b4-2c8f-4f98-9620-ae7d010956ef could not be found. Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cc1c67b4-2c8f-4f98-9620-ae7d010956ef'} Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1c67b4-2c8f-4f98-9620-ae7d010956ef could not be found. Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1c67b4-2c8f-4f98-9620-ae7d010956ef could not be found. Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:31.351457 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:23:31.356439 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:31.356439 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:31.356439 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:31.356439 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:23:31.356439 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:23:31.356439 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1c67b4-2c8f-4f98-9620-ae7d010956ef could not be found. Oct 29 03:23:31.356439 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:23:31.359194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] Returning 404 to user: Instance cc1c67b4-2c8f-4f98-9620-ae7d010956ef could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:23:31.361122 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d0c47a0e-163f-40ba-a190-2d792042a57c tempest-VolumesActionsTest-1216749851 tempest-VolumesActionsTest-1216749851-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef" status: 404 len: 111 microversion: 2.1 time: 0.059254 Oct 29 03:23:31.361963 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3224/6410] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:31 2022] GET /compute/v2.1/servers/cc1c67b4-2c8f-4f98-9620-ae7d010956ef => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:44.961747 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3640b49c-df75-45b0-9f42-eeffda4d3fa1] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:26:44.962791 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:26:44.963524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:44.964467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:44.965479 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:26:44.965622 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:26:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Oct 29 03:26:44.966682 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:26:44.966955 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:26:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Oct 29 03:26:44.968555 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 03:26:44.968907 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:26:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Oct 29 03:26:45.183728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d8ba17ed-9ae4-4058-aebd-f046e4ea971e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'create', calling method: .version_select at 0x7fe1a87b5790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-974757103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa4fRSNj3zAWhgmQJVWkqtzSKwPjry4qPMPgUDqNURFX51T2iJao4DXa7nX6is7NFWvQaj2Lbmh5SRYvcogguXK94PEPJej9zXjoebF3qS4A4RopjmvBG+j31c0k789IA=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:45.201441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d8ba17ed-9ae4-4058-aebd-f046e4ea971e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:26:45.207410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d8ba17ed-9ae4-4058-aebd-f046e4ea971e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for user 6988b3809252496ca2f97a1f6eff5825 and project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:26:45.238256 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d8ba17ed-9ae4-4058-aebd-f046e4ea971e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.282288 Oct 29 03:26:45.239463 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3187/6411] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:26:44 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:26:51.256802 n-d-862964-4 devstack@n-api.service[127042]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57dcae21-10f9-47d2-a254-51c1dd17cc94] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:26:51.258217 n-d-862964-4 devstack@n-api.service[127042]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c94bedb-2bbe-465a-b30f-0cf9af7fe730] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:26:51.259119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=7 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:51.259940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=15 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:51.261659 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 03:26:51.261876 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:26:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 29 03:26:51.264234 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:26:51.264620 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:26:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 29 03:26:51.267366 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 03:26:51.267511 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:26:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 29 03:26:51.280395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1493024012", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "9c22fe82-1171-4771-9d7e-ad5bc19d43b5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-974757103", "security_groups": [{"name": "tempest-secgroup-smoke-1636457141"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:51.558194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] validate_networks() for [('9c22fe82-1171-4771-9d7e-ad5bc19d43b5', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:26:52.110961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:26:52.111523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:26:52.112088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:26:52.112730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:26:52.113234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:26:52.124061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:52.124607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:52.127208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:52.128604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:52.129286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:52.130041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:52.155962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:26:52.162647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for user 6988b3809252496ca2f97a1f6eff5825 and project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:26:52.180804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:26:52.190133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:26:52.251247 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f772e69-cc1c-4de6-a5e2-16da88b3a49e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.001971 Oct 29 03:26:52.252232 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3225/6412] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:26:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:26:52.265754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d052fcbe-14ed-4ec4-b654-b3bce86a006c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:52.271251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d052fcbe-14ed-4ec4-b654-b3bce86a006c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:52.307801 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38476. Oct 29 03:26:52.309583 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [3640b49c-df75-45b0-9f42-eeffda4d3fa1] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38474. Oct 29 03:26:52.456333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d052fcbe-14ed-4ec4-b654-b3bce86a006c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:52.465354 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d052fcbe-14ed-4ec4-b654-b3bce86a006c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1266 microversion: 2.1 time: 0.203932 Oct 29 03:26:52.466051 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3188/6413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:52 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:53.491157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f545e450-c765-4c8d-bbbc-fbbed4034f95 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:53.491860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f545e450-c765-4c8d-bbbc-fbbed4034f95 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:53.511757 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] [57dcae21-10f9-47d2-a254-51c1dd17cc94] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38496. Oct 29 03:26:53.515706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f545e450-c765-4c8d-bbbc-fbbed4034f95 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:53.516526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f545e450-c765-4c8d-bbbc-fbbed4034f95 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:53.517132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f545e450-c765-4c8d-bbbc-fbbed4034f95 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:53.518375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f545e450-c765-4c8d-bbbc-fbbed4034f95 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:53.519055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f545e450-c765-4c8d-bbbc-fbbed4034f95 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:53.519633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f545e450-c765-4c8d-bbbc-fbbed4034f95 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:53.560085 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c94bedb-2bbe-465a-b30f-0cf9af7fe730] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38498. Oct 29 03:26:53.628033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f545e450-c765-4c8d-bbbc-fbbed4034f95 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:53.641336 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f545e450-c765-4c8d-bbbc-fbbed4034f95 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1318 microversion: 2.1 time: 0.156718 Oct 29 03:26:53.643721 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3226/6414] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:53 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:54.667579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4aa62e52-b9e3-4922-8da2-42999ade1407 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:54.668208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4aa62e52-b9e3-4922-8da2-42999ade1407 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:54.688617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aa62e52-b9e3-4922-8da2-42999ade1407 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.689436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aa62e52-b9e3-4922-8da2-42999ade1407 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.689931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aa62e52-b9e3-4922-8da2-42999ade1407 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.694052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aa62e52-b9e3-4922-8da2-42999ade1407 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.694871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aa62e52-b9e3-4922-8da2-42999ade1407 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.695541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4aa62e52-b9e3-4922-8da2-42999ade1407 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.904040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4aa62e52-b9e3-4922-8da2-42999ade1407 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:54.922916 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4aa62e52-b9e3-4922-8da2-42999ade1407 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1392 microversion: 2.1 time: 0.259656 Oct 29 03:26:54.924249 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3189/6415] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:54 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1392 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:55.925777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-32cdc820-97c9-489d-ae4b-76f7600f67d9 req-cbdd3c5e-2ec7-4070-8f51-53fd080e4869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459bdce4-aa58-4e36-b19a-947b23e71197", "tag": "c8a7d21b-b130-4514-ac1a-d43c7cca8ca3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:55.936442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-32cdc820-97c9-489d-ae4b-76f7600f67d9 req-cbdd3c5e-2ec7-4070-8f51-53fd080e4869 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:55.937213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-32cdc820-97c9-489d-ae4b-76f7600f67d9 req-cbdd3c5e-2ec7-4070-8f51-53fd080e4869 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:55.937943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-32cdc820-97c9-489d-ae4b-76f7600f67d9 req-cbdd3c5e-2ec7-4070-8f51-53fd080e4869 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:55.948244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-30e7fbd1-e175-41b8-bd5b-4bf3618f756d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:55.948860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-30e7fbd1-e175-41b8-bd5b-4bf3618f756d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:55.954665 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-32cdc820-97c9-489d-ae4b-76f7600f67d9 req-cbdd3c5e-2ec7-4070-8f51-53fd080e4869 service nova] Creating event network-changed:c8a7d21b-b130-4514-ac1a-d43c7cca8ca3 for instance 459bdce4-aa58-4e36-b19a-947b23e71197 on n-h1-862964-4 Oct 29 03:26:55.958434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e7fbd1-e175-41b8-bd5b-4bf3618f756d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:55.958935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e7fbd1-e175-41b8-bd5b-4bf3618f756d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:55.959435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e7fbd1-e175-41b8-bd5b-4bf3618f756d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:55.960234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e7fbd1-e175-41b8-bd5b-4bf3618f756d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:55.960696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e7fbd1-e175-41b8-bd5b-4bf3618f756d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:55.961122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-30e7fbd1-e175-41b8-bd5b-4bf3618f756d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:55.962553 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-32cdc820-97c9-489d-ae4b-76f7600f67d9 req-cbdd3c5e-2ec7-4070-8f51-53fd080e4869 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040269 Oct 29 03:26:55.963963 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3227/6416] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:56.204815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-30e7fbd1-e175-41b8-bd5b-4bf3618f756d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:56.213392 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-30e7fbd1-e175-41b8-bd5b-4bf3618f756d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1392 microversion: 2.1 time: 0.269143 Oct 29 03:26:56.214182 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3190/6417] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:55 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:57.238433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f45924f0-59ec-46d1-922f-048f72cf2677 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:57.239116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f45924f0-59ec-46d1-922f-048f72cf2677 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:57.246286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f45924f0-59ec-46d1-922f-048f72cf2677 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:57.246761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f45924f0-59ec-46d1-922f-048f72cf2677 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:57.247236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f45924f0-59ec-46d1-922f-048f72cf2677 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:57.248169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f45924f0-59ec-46d1-922f-048f72cf2677 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:57.248617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f45924f0-59ec-46d1-922f-048f72cf2677 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:57.249032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f45924f0-59ec-46d1-922f-048f72cf2677 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:57.385416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f45924f0-59ec-46d1-922f-048f72cf2677 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:57.397626 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f45924f0-59ec-46d1-922f-048f72cf2677 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1392 microversion: 2.1 time: 0.164302 Oct 29 03:26:57.399184 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3228/6418] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:57 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:58.422741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e367a19c-3872-4e2d-804b-77bd4e1982d4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:58.423376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e367a19c-3872-4e2d-804b-77bd4e1982d4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:58.430296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e367a19c-3872-4e2d-804b-77bd4e1982d4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:58.430773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e367a19c-3872-4e2d-804b-77bd4e1982d4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:58.431201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e367a19c-3872-4e2d-804b-77bd4e1982d4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:58.431891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e367a19c-3872-4e2d-804b-77bd4e1982d4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:58.432331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e367a19c-3872-4e2d-804b-77bd4e1982d4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:58.432742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e367a19c-3872-4e2d-804b-77bd4e1982d4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:58.578536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e367a19c-3872-4e2d-804b-77bd4e1982d4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:58.586701 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e367a19c-3872-4e2d-804b-77bd4e1982d4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1392 microversion: 2.1 time: 0.168046 Oct 29 03:26:58.587259 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3191/6419] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:58 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:59.609267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ea0e43c7-f90c-4b12-a34d-487ed5b99124 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:59.609889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ea0e43c7-f90c-4b12-a34d-487ed5b99124 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:59.617940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0e43c7-f90c-4b12-a34d-487ed5b99124 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:59.618465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0e43c7-f90c-4b12-a34d-487ed5b99124 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:59.618941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0e43c7-f90c-4b12-a34d-487ed5b99124 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:59.619653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0e43c7-f90c-4b12-a34d-487ed5b99124 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:59.620147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0e43c7-f90c-4b12-a34d-487ed5b99124 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:59.620627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0e43c7-f90c-4b12-a34d-487ed5b99124 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:59.772270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ea0e43c7-f90c-4b12-a34d-487ed5b99124 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:59.784169 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ea0e43c7-f90c-4b12-a34d-487ed5b99124 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1392 microversion: 2.1 time: 0.179110 Oct 29 03:26:59.801053 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3229/6420] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:59 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:59.894184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3b6f79fb-e252-406b-b79a-0c1a00bb56a2 req-1b4762a6-c76e-45ad-ba13-f6947aa01d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459bdce4-aa58-4e36-b19a-947b23e71197", "name": "network-vif-plugged", "status": "completed", "tag": "c8a7d21b-b130-4514-ac1a-d43c7cca8ca3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:59.906698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3b6f79fb-e252-406b-b79a-0c1a00bb56a2 req-1b4762a6-c76e-45ad-ba13-f6947aa01d9a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:59.907318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3b6f79fb-e252-406b-b79a-0c1a00bb56a2 req-1b4762a6-c76e-45ad-ba13-f6947aa01d9a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:59.907922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3b6f79fb-e252-406b-b79a-0c1a00bb56a2 req-1b4762a6-c76e-45ad-ba13-f6947aa01d9a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:59.921165 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3b6f79fb-e252-406b-b79a-0c1a00bb56a2 req-1b4762a6-c76e-45ad-ba13-f6947aa01d9a service nova] Creating event network-vif-plugged:c8a7d21b-b130-4514-ac1a-d43c7cca8ca3 for instance 459bdce4-aa58-4e36-b19a-947b23e71197 on n-h1-862964-4 Oct 29 03:26:59.928028 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3b6f79fb-e252-406b-b79a-0c1a00bb56a2 req-1b4762a6-c76e-45ad-ba13-f6947aa01d9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037879 Oct 29 03:26:59.928789 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3192/6421] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:27:00.809456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-03f61e29-762a-4585-a519-71c435c76364 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:00.810206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-03f61e29-762a-4585-a519-71c435c76364 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:00.817886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03f61e29-762a-4585-a519-71c435c76364 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:00.818373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03f61e29-762a-4585-a519-71c435c76364 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:00.818786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03f61e29-762a-4585-a519-71c435c76364 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:00.819552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03f61e29-762a-4585-a519-71c435c76364 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:00.819997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03f61e29-762a-4585-a519-71c435c76364 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:00.820410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03f61e29-762a-4585-a519-71c435c76364 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:00.963942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-03f61e29-762a-4585-a519-71c435c76364 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:00.974234 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-03f61e29-762a-4585-a519-71c435c76364 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1392 microversion: 2.1 time: 0.169647 Oct 29 03:27:00.974887 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3230/6422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:00 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:01.998548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fce0a14d-3452-491b-bb09-94f7096cca5d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:01.999265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fce0a14d-3452-491b-bb09-94f7096cca5d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:02.008035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fce0a14d-3452-491b-bb09-94f7096cca5d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:02.008035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fce0a14d-3452-491b-bb09-94f7096cca5d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:02.008035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fce0a14d-3452-491b-bb09-94f7096cca5d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:02.008542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fce0a14d-3452-491b-bb09-94f7096cca5d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:02.009617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fce0a14d-3452-491b-bb09-94f7096cca5d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:02.010078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fce0a14d-3452-491b-bb09-94f7096cca5d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:02.160375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fce0a14d-3452-491b-bb09-94f7096cca5d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:02.168571 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fce0a14d-3452-491b-bb09-94f7096cca5d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1564 microversion: 2.1 time: 0.174187 Oct 29 03:27:02.169149 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3193/6423] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:01 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:02.191055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-499d0908-09c6-45ea-8dc0-7bf773535144 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:02.191559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-499d0908-09c6-45ea-8dc0-7bf773535144 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:02.194390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:02.195817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:02.201831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499d0908-09c6-45ea-8dc0-7bf773535144 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:02.202316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499d0908-09c6-45ea-8dc0-7bf773535144 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:02.202886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499d0908-09c6-45ea-8dc0-7bf773535144 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:02.203697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499d0908-09c6-45ea-8dc0-7bf773535144 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:02.204151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499d0908-09c6-45ea-8dc0-7bf773535144 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:02.204567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-499d0908-09c6-45ea-8dc0-7bf773535144 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:02.349748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-499d0908-09c6-45ea-8dc0-7bf773535144 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:02.359908 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-499d0908-09c6-45ea-8dc0-7bf773535144 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1564 microversion: 2.1 time: 0.172566 Oct 29 03:27:02.360848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3231/6424] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:02 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:04.481339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec3dc4ce-19b1-4c68-955f-a0ce3f92e5df tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:04.482427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ec3dc4ce-19b1-4c68-955f-a0ce3f92e5df tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:04.488824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:04.491232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a9b95389-8b46-4deb-a63c-a73a60e26c47 req-fd842e80-5186-4207-813c-ccc650c11b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459bdce4-aa58-4e36-b19a-947b23e71197", "tag": "c8a7d21b-b130-4514-ac1a-d43c7cca8ca3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:04.491711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3dc4ce-19b1-4c68-955f-a0ce3f92e5df tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:04.492463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3dc4ce-19b1-4c68-955f-a0ce3f92e5df tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:04.493138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3dc4ce-19b1-4c68-955f-a0ce3f92e5df tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:04.494046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3dc4ce-19b1-4c68-955f-a0ce3f92e5df tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:04.494665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3dc4ce-19b1-4c68-955f-a0ce3f92e5df tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:04.495243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec3dc4ce-19b1-4c68-955f-a0ce3f92e5df tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:04.507840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a9b95389-8b46-4deb-a63c-a73a60e26c47 req-fd842e80-5186-4207-813c-ccc650c11b24 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:04.508782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a9b95389-8b46-4deb-a63c-a73a60e26c47 req-fd842e80-5186-4207-813c-ccc650c11b24 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:04.509377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a9b95389-8b46-4deb-a63c-a73a60e26c47 req-fd842e80-5186-4207-813c-ccc650c11b24 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:04.522958 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a9b95389-8b46-4deb-a63c-a73a60e26c47 req-fd842e80-5186-4207-813c-ccc650c11b24 service nova] Creating event network-changed:c8a7d21b-b130-4514-ac1a-d43c7cca8ca3 for instance 459bdce4-aa58-4e36-b19a-947b23e71197 on n-h1-862964-4 Oct 29 03:27:04.529856 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a9b95389-8b46-4deb-a63c-a73a60e26c47 req-fd842e80-5186-4207-813c-ccc650c11b24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045353 Oct 29 03:27:04.531031 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3232/6425] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:27:04.803929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ec3dc4ce-19b1-4c68-955f-a0ce3f92e5df tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:04.817447 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ec3dc4ce-19b1-4c68-955f-a0ce3f92e5df tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1564 microversion: 2.1 time: 0.339921 Oct 29 03:27:04.818262 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3194/6426] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:04 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1564 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:26.106591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:26.107549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=36 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:26.111778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-368bba25-00cd-4e97-8b22-3f71be3ff1b9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:26.114045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-368bba25-00cd-4e97-8b22-3f71be3ff1b9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:26.121572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368bba25-00cd-4e97-8b22-3f71be3ff1b9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:26.122154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368bba25-00cd-4e97-8b22-3f71be3ff1b9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:26.122582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368bba25-00cd-4e97-8b22-3f71be3ff1b9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:26.123268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368bba25-00cd-4e97-8b22-3f71be3ff1b9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:26.123695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368bba25-00cd-4e97-8b22-3f71be3ff1b9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:26.124207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368bba25-00cd-4e97-8b22-3f71be3ff1b9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:26.196258 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-368bba25-00cd-4e97-8b22-3f71be3ff1b9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197/action" status: 200 len: 24570 microversion: 2.1 time: 0.091464 Oct 29 03:27:26.197146 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3233/6427] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:27:26 2022] POST /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197/action => generated 24570 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:27:32.564302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-76983309-4488-4afc-9b7c-61d807e4dd59 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:32.564937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-76983309-4488-4afc-9b7c-61d807e4dd59 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:32.567385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:32.568251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=32 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:32.574705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-76983309-4488-4afc-9b7c-61d807e4dd59 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:32.575408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-76983309-4488-4afc-9b7c-61d807e4dd59 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:32.575839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-76983309-4488-4afc-9b7c-61d807e4dd59 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:32.576532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-76983309-4488-4afc-9b7c-61d807e4dd59 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:32.576979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-76983309-4488-4afc-9b7c-61d807e4dd59 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:32.577640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-76983309-4488-4afc-9b7c-61d807e4dd59 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:32.817632 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-76983309-4488-4afc-9b7c-61d807e4dd59 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1833 microversion: 2.1 time: 0.257756 Oct 29 03:27:32.818122 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3195/6428] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:32 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1833 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:32.843941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82bd716d-3214-4b26-a355-16ab1d34a63f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:32.844636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-82bd716d-3214-4b26-a355-16ab1d34a63f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:32.852351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82bd716d-3214-4b26-a355-16ab1d34a63f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:32.852824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82bd716d-3214-4b26-a355-16ab1d34a63f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:32.853250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82bd716d-3214-4b26-a355-16ab1d34a63f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:32.853977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82bd716d-3214-4b26-a355-16ab1d34a63f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:32.854424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82bd716d-3214-4b26-a355-16ab1d34a63f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:32.854837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82bd716d-3214-4b26-a355-16ab1d34a63f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.000795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-82bd716d-3214-4b26-a355-16ab1d34a63f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:33.012519 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-82bd716d-3214-4b26-a355-16ab1d34a63f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1682 microversion: 2.1 time: 0.173409 Oct 29 03:27:33.013350 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3234/6429] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:32 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:33.112797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-510da17f-29f5-4b3b-a9cc-e787c7a986ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:33.115069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-510da17f-29f5-4b3b-a9cc-e787c7a986ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:33.121563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-510da17f-29f5-4b3b-a9cc-e787c7a986ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.122121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-510da17f-29f5-4b3b-a9cc-e787c7a986ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.122541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-510da17f-29f5-4b3b-a9cc-e787c7a986ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.123242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-510da17f-29f5-4b3b-a9cc-e787c7a986ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.123700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-510da17f-29f5-4b3b-a9cc-e787c7a986ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.124166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-510da17f-29f5-4b3b-a9cc-e787c7a986ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.193026 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-510da17f-29f5-4b3b-a9cc-e787c7a986ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197/action" status: 200 len: 32641 microversion: 2.1 time: 0.084282 Oct 29 03:27:33.193698 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3196/6430] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:27:33 2022] POST /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197/action => generated 32641 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:27:33.360951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:33.361535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:33.368811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.369086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.369512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.370231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.370673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.371086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.411846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '242fc17348054226a14c87a3080b0e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732e7d1faa543c8abe82f355fcdf7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:33.412286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] flavor_id is None. Assuming migration. {{(pid=127042) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 03:27:33.412747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127042) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:27:33.711679 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40abde78-a8c7-4850-9353-b1739b07f249 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197/action" status: 202 len: 0 microversion: 2.1 time: 0.355767 Oct 29 03:27:33.712373 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3235/6431] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:27:33 2022] POST /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:27:33.721644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3c6128ab-38f1-4996-930f-930e8b099c18 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:33.722378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3c6128ab-38f1-4996-930f-930e8b099c18 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:33.729635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c6128ab-38f1-4996-930f-930e8b099c18 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.730149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c6128ab-38f1-4996-930f-930e8b099c18 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.730574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c6128ab-38f1-4996-930f-930e8b099c18 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.731266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c6128ab-38f1-4996-930f-930e8b099c18 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.731711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c6128ab-38f1-4996-930f-930e8b099c18 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.732127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c6128ab-38f1-4996-930f-930e8b099c18 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.883058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c6128ab-38f1-4996-930f-930e8b099c18 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:33.891662 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3c6128ab-38f1-4996-930f-930e8b099c18 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1691 microversion: 2.1 time: 0.174571 Oct 29 03:27:33.892286 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3197/6432] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:33 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:34.918333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6395239-292d-4487-929c-7e58e2c67720 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:34.918925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b6395239-292d-4487-929c-7e58e2c67720 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:34.926010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6395239-292d-4487-929c-7e58e2c67720 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:34.926495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6395239-292d-4487-929c-7e58e2c67720 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:34.926925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6395239-292d-4487-929c-7e58e2c67720 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:34.927615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6395239-292d-4487-929c-7e58e2c67720 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:34.928064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6395239-292d-4487-929c-7e58e2c67720 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:34.928482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b6395239-292d-4487-929c-7e58e2c67720 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:35.072507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b6395239-292d-4487-929c-7e58e2c67720 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:35.081039 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6395239-292d-4487-929c-7e58e2c67720 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1691 microversion: 2.1 time: 0.168443 Oct 29 03:27:35.081619 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3236/6433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:34 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:36.104924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7eb37de2-b0bd-4b38-b9f1-eaec7f8afe5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:36.105638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7eb37de2-b0bd-4b38-b9f1-eaec7f8afe5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:36.113285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7eb37de2-b0bd-4b38-b9f1-eaec7f8afe5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:36.113774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7eb37de2-b0bd-4b38-b9f1-eaec7f8afe5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:36.114239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7eb37de2-b0bd-4b38-b9f1-eaec7f8afe5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:36.114937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7eb37de2-b0bd-4b38-b9f1-eaec7f8afe5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:36.115388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7eb37de2-b0bd-4b38-b9f1-eaec7f8afe5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:36.115844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7eb37de2-b0bd-4b38-b9f1-eaec7f8afe5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:36.253739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7eb37de2-b0bd-4b38-b9f1-eaec7f8afe5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:36.262276 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7eb37de2-b0bd-4b38-b9f1-eaec7f8afe5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1696 microversion: 2.1 time: 0.161319 Oct 29 03:27:36.262890 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3198/6434] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:36 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:37.287260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f1b3b817-51c2-47c1-b834-ff10ee5383b7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:37.287812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f1b3b817-51c2-47c1-b834-ff10ee5383b7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:37.295020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1b3b817-51c2-47c1-b834-ff10ee5383b7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:37.295509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1b3b817-51c2-47c1-b834-ff10ee5383b7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:37.296105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1b3b817-51c2-47c1-b834-ff10ee5383b7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:37.296917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1b3b817-51c2-47c1-b834-ff10ee5383b7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:37.297374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1b3b817-51c2-47c1-b834-ff10ee5383b7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:37.298141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1b3b817-51c2-47c1-b834-ff10ee5383b7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:37.441275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f1b3b817-51c2-47c1-b834-ff10ee5383b7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:37.449165 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f1b3b817-51c2-47c1-b834-ff10ee5383b7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1696 microversion: 2.1 time: 0.165939 Oct 29 03:27:37.449743 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3237/6435] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:37 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:38.473257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aa51d66a-04e1-4a0f-b6d7-1ee88733d02a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:38.474026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aa51d66a-04e1-4a0f-b6d7-1ee88733d02a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:38.481280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa51d66a-04e1-4a0f-b6d7-1ee88733d02a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:38.481762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa51d66a-04e1-4a0f-b6d7-1ee88733d02a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:38.482223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa51d66a-04e1-4a0f-b6d7-1ee88733d02a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:38.482934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa51d66a-04e1-4a0f-b6d7-1ee88733d02a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:38.483437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa51d66a-04e1-4a0f-b6d7-1ee88733d02a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:38.483864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa51d66a-04e1-4a0f-b6d7-1ee88733d02a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:38.627166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aa51d66a-04e1-4a0f-b6d7-1ee88733d02a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:38.635080 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aa51d66a-04e1-4a0f-b6d7-1ee88733d02a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1696 microversion: 2.1 time: 0.165915 Oct 29 03:27:38.635646 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3199/6436] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:38 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:39.658516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db710c16-e8b1-402d-900f-2913f05ec4ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:39.659136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-db710c16-e8b1-402d-900f-2913f05ec4ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:39.666542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db710c16-e8b1-402d-900f-2913f05ec4ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:39.667360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db710c16-e8b1-402d-900f-2913f05ec4ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:39.668024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db710c16-e8b1-402d-900f-2913f05ec4ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:39.668672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db710c16-e8b1-402d-900f-2913f05ec4ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:39.669113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db710c16-e8b1-402d-900f-2913f05ec4ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:39.669658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db710c16-e8b1-402d-900f-2913f05ec4ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:39.815891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-db710c16-e8b1-402d-900f-2913f05ec4ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:39.823963 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-db710c16-e8b1-402d-900f-2913f05ec4ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1696 microversion: 2.1 time: 0.169355 Oct 29 03:27:39.824745 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3238/6437] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:39 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:40.847553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cfe3418e-5894-4df6-9692-d4e7ebf0b5d3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:40.848147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cfe3418e-5894-4df6-9692-d4e7ebf0b5d3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:40.858565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe3418e-5894-4df6-9692-d4e7ebf0b5d3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:40.859055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe3418e-5894-4df6-9692-d4e7ebf0b5d3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:40.859486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe3418e-5894-4df6-9692-d4e7ebf0b5d3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:40.860188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe3418e-5894-4df6-9692-d4e7ebf0b5d3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:40.860635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe3418e-5894-4df6-9692-d4e7ebf0b5d3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:40.861053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfe3418e-5894-4df6-9692-d4e7ebf0b5d3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:40.999887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cfe3418e-5894-4df6-9692-d4e7ebf0b5d3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:41.007906 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cfe3418e-5894-4df6-9692-d4e7ebf0b5d3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1696 microversion: 2.1 time: 0.164268 Oct 29 03:27:41.008481 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3200/6438] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:40 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:42.032336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d89251c-a49b-4d72-ad6d-119360e1b221 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:42.033031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d89251c-a49b-4d72-ad6d-119360e1b221 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:42.040223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d89251c-a49b-4d72-ad6d-119360e1b221 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:42.040788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d89251c-a49b-4d72-ad6d-119360e1b221 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:42.041309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d89251c-a49b-4d72-ad6d-119360e1b221 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:42.042196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d89251c-a49b-4d72-ad6d-119360e1b221 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:42.042708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d89251c-a49b-4d72-ad6d-119360e1b221 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:42.043186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d89251c-a49b-4d72-ad6d-119360e1b221 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:42.195628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d89251c-a49b-4d72-ad6d-119360e1b221 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:42.211440 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d89251c-a49b-4d72-ad6d-119360e1b221 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1696 microversion: 2.1 time: 0.183342 Oct 29 03:27:42.227643 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3239/6439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:42 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1696 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:43.238945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f4493d6f-e24f-41e1-a848-db02fe8b13ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:43.239564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f4493d6f-e24f-41e1-a848-db02fe8b13ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:43.247346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4493d6f-e24f-41e1-a848-db02fe8b13ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:43.247839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4493d6f-e24f-41e1-a848-db02fe8b13ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:43.248279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4493d6f-e24f-41e1-a848-db02fe8b13ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:43.249112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4493d6f-e24f-41e1-a848-db02fe8b13ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:43.249790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4493d6f-e24f-41e1-a848-db02fe8b13ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:43.250248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4493d6f-e24f-41e1-a848-db02fe8b13ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:43.386590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f4493d6f-e24f-41e1-a848-db02fe8b13ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:43.395064 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f4493d6f-e24f-41e1-a848-db02fe8b13ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1696 microversion: 2.1 time: 0.160697 Oct 29 03:27:43.395649 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3201/6440] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:43 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:44.419008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eef2d325-ec19-4da4-b917-71d26ab14810 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:44.419577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eef2d325-ec19-4da4-b917-71d26ab14810 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:44.427102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eef2d325-ec19-4da4-b917-71d26ab14810 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:44.427594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eef2d325-ec19-4da4-b917-71d26ab14810 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:44.428027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eef2d325-ec19-4da4-b917-71d26ab14810 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:44.428762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eef2d325-ec19-4da4-b917-71d26ab14810 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:44.429228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eef2d325-ec19-4da4-b917-71d26ab14810 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:44.429648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eef2d325-ec19-4da4-b917-71d26ab14810 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:44.564525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eef2d325-ec19-4da4-b917-71d26ab14810 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:44.573186 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eef2d325-ec19-4da4-b917-71d26ab14810 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1696 microversion: 2.1 time: 0.158061 Oct 29 03:27:44.576771 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3240/6441] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:44 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:45.596828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18247690-7562-4da0-9027-32d172441d7a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:45.597433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18247690-7562-4da0-9027-32d172441d7a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:45.604465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18247690-7562-4da0-9027-32d172441d7a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:45.604942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18247690-7562-4da0-9027-32d172441d7a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:45.605389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18247690-7562-4da0-9027-32d172441d7a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:45.606116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18247690-7562-4da0-9027-32d172441d7a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:45.606558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18247690-7562-4da0-9027-32d172441d7a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:45.606958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18247690-7562-4da0-9027-32d172441d7a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:45.747716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18247690-7562-4da0-9027-32d172441d7a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:45.756258 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18247690-7562-4da0-9027-32d172441d7a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1696 microversion: 2.1 time: 0.163628 Oct 29 03:27:45.756875 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3202/6442] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:45 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:46.780612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-08d8456f-0f91-4743-9eab-7d224c52d98c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:46.781303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-08d8456f-0f91-4743-9eab-7d224c52d98c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:46.789103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08d8456f-0f91-4743-9eab-7d224c52d98c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:46.790082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08d8456f-0f91-4743-9eab-7d224c52d98c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:46.790082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08d8456f-0f91-4743-9eab-7d224c52d98c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:46.790760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08d8456f-0f91-4743-9eab-7d224c52d98c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:46.791203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08d8456f-0f91-4743-9eab-7d224c52d98c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:46.791637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08d8456f-0f91-4743-9eab-7d224c52d98c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:46.935927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-08d8456f-0f91-4743-9eab-7d224c52d98c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:46.943977 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-08d8456f-0f91-4743-9eab-7d224c52d98c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1696 microversion: 2.1 time: 0.167817 Oct 29 03:27:46.944553 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3241/6443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:46 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:47.968541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e382cdf-7ad8-45dc-963c-fa21d2368186 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:47.969210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9e382cdf-7ad8-45dc-963c-fa21d2368186 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:47.976754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e382cdf-7ad8-45dc-963c-fa21d2368186 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:47.977240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e382cdf-7ad8-45dc-963c-fa21d2368186 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:47.977670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e382cdf-7ad8-45dc-963c-fa21d2368186 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:47.978406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e382cdf-7ad8-45dc-963c-fa21d2368186 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:47.979054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e382cdf-7ad8-45dc-963c-fa21d2368186 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:47.979474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e382cdf-7ad8-45dc-963c-fa21d2368186 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:48.133164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9e382cdf-7ad8-45dc-963c-fa21d2368186 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:48.141755 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9e382cdf-7ad8-45dc-963c-fa21d2368186 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1695 microversion: 2.1 time: 0.177187 Oct 29 03:27:48.142670 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3203/6444] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:47 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:48.637390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f08bc6dc-5561-4cd3-9ec7-ca795378f4de req-9ba99be2-0d69-4a12-a32e-8186a3ccefb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459bdce4-aa58-4e36-b19a-947b23e71197", "name": "network-vif-unplugged", "status": "completed", "tag": "c8a7d21b-b130-4514-ac1a-d43c7cca8ca3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:48.647662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f08bc6dc-5561-4cd3-9ec7-ca795378f4de req-9ba99be2-0d69-4a12-a32e-8186a3ccefb0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:48.648150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f08bc6dc-5561-4cd3-9ec7-ca795378f4de req-9ba99be2-0d69-4a12-a32e-8186a3ccefb0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:48.648572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f08bc6dc-5561-4cd3-9ec7-ca795378f4de req-9ba99be2-0d69-4a12-a32e-8186a3ccefb0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:48.661242 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f08bc6dc-5561-4cd3-9ec7-ca795378f4de req-9ba99be2-0d69-4a12-a32e-8186a3ccefb0 service nova] Creating event network-vif-unplugged:c8a7d21b-b130-4514-ac1a-d43c7cca8ca3 for instance 459bdce4-aa58-4e36-b19a-947b23e71197 on n-h2-862964-4 Oct 29 03:27:48.666762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-f08bc6dc-5561-4cd3-9ec7-ca795378f4de req-9ba99be2-0d69-4a12-a32e-8186a3ccefb0 service nova] Instance 459bdce4-aa58-4e36-b19a-947b23e71197 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:27:48.679227 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f08bc6dc-5561-4cd3-9ec7-ca795378f4de req-9ba99be2-0d69-4a12-a32e-8186a3ccefb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119486 Oct 29 03:27:48.680109 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3242/6445] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:49.164573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-92239cc0-7c68-4fdf-8033-e114fc0bfbf4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:49.165189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-92239cc0-7c68-4fdf-8033-e114fc0bfbf4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:49.172611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92239cc0-7c68-4fdf-8033-e114fc0bfbf4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:49.173101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92239cc0-7c68-4fdf-8033-e114fc0bfbf4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:49.173539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92239cc0-7c68-4fdf-8033-e114fc0bfbf4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:49.174268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92239cc0-7c68-4fdf-8033-e114fc0bfbf4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:49.174914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92239cc0-7c68-4fdf-8033-e114fc0bfbf4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:49.175339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-92239cc0-7c68-4fdf-8033-e114fc0bfbf4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:49.316780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-92239cc0-7c68-4fdf-8033-e114fc0bfbf4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:49.332388 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-92239cc0-7c68-4fdf-8033-e114fc0bfbf4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1695 microversion: 2.1 time: 0.171507 Oct 29 03:27:49.333503 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3204/6446] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:49 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:50.358739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d5cb9a07-a40c-40ad-91bd-1d6c17df3ff5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:50.359657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d5cb9a07-a40c-40ad-91bd-1d6c17df3ff5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:50.368877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5cb9a07-a40c-40ad-91bd-1d6c17df3ff5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:50.369354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5cb9a07-a40c-40ad-91bd-1d6c17df3ff5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:50.369774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5cb9a07-a40c-40ad-91bd-1d6c17df3ff5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:50.370507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5cb9a07-a40c-40ad-91bd-1d6c17df3ff5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:50.370946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5cb9a07-a40c-40ad-91bd-1d6c17df3ff5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:50.371381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5cb9a07-a40c-40ad-91bd-1d6c17df3ff5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:50.511985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d5cb9a07-a40c-40ad-91bd-1d6c17df3ff5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:50.520410 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d5cb9a07-a40c-40ad-91bd-1d6c17df3ff5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1693 microversion: 2.1 time: 0.167153 Oct 29 03:27:50.520976 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3243/6447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:50 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:50.699131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f309181b-ec8d-438e-9764-6ecbeb749188 req-533ccc87-d997-45b4-95ea-204af114315b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459bdce4-aa58-4e36-b19a-947b23e71197", "tag": "c8a7d21b-b130-4514-ac1a-d43c7cca8ca3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:50.709906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f309181b-ec8d-438e-9764-6ecbeb749188 req-533ccc87-d997-45b4-95ea-204af114315b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:50.710380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f309181b-ec8d-438e-9764-6ecbeb749188 req-533ccc87-d997-45b4-95ea-204af114315b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:50.710807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f309181b-ec8d-438e-9764-6ecbeb749188 req-533ccc87-d997-45b4-95ea-204af114315b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:50.723279 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f309181b-ec8d-438e-9764-6ecbeb749188 req-533ccc87-d997-45b4-95ea-204af114315b service nova] Creating event network-changed:c8a7d21b-b130-4514-ac1a-d43c7cca8ca3 for instance 459bdce4-aa58-4e36-b19a-947b23e71197 on n-h2-862964-4 Oct 29 03:27:50.729010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-f309181b-ec8d-438e-9764-6ecbeb749188 req-533ccc87-d997-45b4-95ea-204af114315b service nova] Instance 459bdce4-aa58-4e36-b19a-947b23e71197 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:27:50.740320 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f309181b-ec8d-438e-9764-6ecbeb749188 req-533ccc87-d997-45b4-95ea-204af114315b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044943 Oct 29 03:27:50.741144 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3205/6448] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:51.545201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1bab1566-38bc-4649-a6de-2b54931834b3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:51.546563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1bab1566-38bc-4649-a6de-2b54931834b3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:51.556399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bab1566-38bc-4649-a6de-2b54931834b3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:51.557468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bab1566-38bc-4649-a6de-2b54931834b3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:51.558112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bab1566-38bc-4649-a6de-2b54931834b3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:51.559087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bab1566-38bc-4649-a6de-2b54931834b3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:51.559799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bab1566-38bc-4649-a6de-2b54931834b3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:51.560591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1bab1566-38bc-4649-a6de-2b54931834b3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:51.719714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1bab1566-38bc-4649-a6de-2b54931834b3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:51.728032 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1bab1566-38bc-4649-a6de-2b54931834b3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1690 microversion: 2.1 time: 0.187312 Oct 29 03:27:51.728646 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3244/6449] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:51 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:51.752832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-78c06660-385f-4fa9-8336-33b7a60e6288 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:51.753491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-78c06660-385f-4fa9-8336-33b7a60e6288 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:51.760183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c06660-385f-4fa9-8336-33b7a60e6288 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:51.760672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c06660-385f-4fa9-8336-33b7a60e6288 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:51.761109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c06660-385f-4fa9-8336-33b7a60e6288 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:51.761795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c06660-385f-4fa9-8336-33b7a60e6288 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:51.762294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c06660-385f-4fa9-8336-33b7a60e6288 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:51.762722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-78c06660-385f-4fa9-8336-33b7a60e6288 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:51.828798 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-78c06660-385f-4fa9-8336-33b7a60e6288 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197/action" status: 204 len: 0 microversion: 2.1 time: 0.080984 Oct 29 03:27:51.829870 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3206/6450] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:27:51 2022] POST /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:27:51.838195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6fc9f5ab-e3bc-4c7c-a847-004333c04ce2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:51.838806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6fc9f5ab-e3bc-4c7c-a847-004333c04ce2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:51.846197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fc9f5ab-e3bc-4c7c-a847-004333c04ce2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:51.846857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fc9f5ab-e3bc-4c7c-a847-004333c04ce2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:51.847364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fc9f5ab-e3bc-4c7c-a847-004333c04ce2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:51.847945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fc9f5ab-e3bc-4c7c-a847-004333c04ce2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:51.848575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fc9f5ab-e3bc-4c7c-a847-004333c04ce2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:51.849059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fc9f5ab-e3bc-4c7c-a847-004333c04ce2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:51.997413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6fc9f5ab-e3bc-4c7c-a847-004333c04ce2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:52.006245 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6fc9f5ab-e3bc-4c7c-a847-004333c04ce2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1690 microversion: 2.1 time: 0.172022 Oct 29 03:27:52.007462 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3245/6451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:51 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:53.030798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-91bc7da2-9bc3-4c7c-8334-09783f3b8b5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:53.031755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-91bc7da2-9bc3-4c7c-8334-09783f3b8b5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:53.038925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91bc7da2-9bc3-4c7c-8334-09783f3b8b5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:53.039680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91bc7da2-9bc3-4c7c-8334-09783f3b8b5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:53.040405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91bc7da2-9bc3-4c7c-8334-09783f3b8b5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:53.041188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91bc7da2-9bc3-4c7c-8334-09783f3b8b5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:53.041706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91bc7da2-9bc3-4c7c-8334-09783f3b8b5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:53.042384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91bc7da2-9bc3-4c7c-8334-09783f3b8b5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:53.197132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-91bc7da2-9bc3-4c7c-8334-09783f3b8b5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:53.208306 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-91bc7da2-9bc3-4c7c-8334-09783f3b8b5e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1690 microversion: 2.1 time: 0.181763 Oct 29 03:27:53.221832 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3207/6452] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:53 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:54.233268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e3a82499-d09a-40eb-b28f-e95afd5f1bde tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:54.233945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e3a82499-d09a-40eb-b28f-e95afd5f1bde tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:54.241060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3a82499-d09a-40eb-b28f-e95afd5f1bde tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:54.241548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3a82499-d09a-40eb-b28f-e95afd5f1bde tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:54.242020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3a82499-d09a-40eb-b28f-e95afd5f1bde tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:54.243038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3a82499-d09a-40eb-b28f-e95afd5f1bde tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:54.243493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3a82499-d09a-40eb-b28f-e95afd5f1bde tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:54.243915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3a82499-d09a-40eb-b28f-e95afd5f1bde tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:54.380210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e3a82499-d09a-40eb-b28f-e95afd5f1bde tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:54.388452 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e3a82499-d09a-40eb-b28f-e95afd5f1bde tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1682 microversion: 2.1 time: 0.159159 Oct 29 03:27:54.389023 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3246/6453] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:54 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:54.952662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-a056759f-8dc9-462e-af90-7b539cc4284f req-52de221b-145d-4623-b582-1eabaeedd5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459bdce4-aa58-4e36-b19a-947b23e71197", "name": "network-vif-plugged", "status": "completed", "tag": "c8a7d21b-b130-4514-ac1a-d43c7cca8ca3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:54.964713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a056759f-8dc9-462e-af90-7b539cc4284f req-52de221b-145d-4623-b582-1eabaeedd5b4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:54.965463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a056759f-8dc9-462e-af90-7b539cc4284f req-52de221b-145d-4623-b582-1eabaeedd5b4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:54.965907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a056759f-8dc9-462e-af90-7b539cc4284f req-52de221b-145d-4623-b582-1eabaeedd5b4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:54.978117 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-a056759f-8dc9-462e-af90-7b539cc4284f req-52de221b-145d-4623-b582-1eabaeedd5b4 service nova] Creating event network-vif-plugged:c8a7d21b-b130-4514-ac1a-d43c7cca8ca3 for instance 459bdce4-aa58-4e36-b19a-947b23e71197 on n-h2-862964-4 Oct 29 03:27:54.983300 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-a056759f-8dc9-462e-af90-7b539cc4284f req-52de221b-145d-4623-b582-1eabaeedd5b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035024 Oct 29 03:27:54.984218 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3208/6454] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:27:59.366921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-574376087", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "d0119cee-d2ee-44c6-8fb1-337fa8c254bc"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:59.378197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=31 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:59.427865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] validate_networks() for [('d0119cee-d2ee-44c6-8fb1-337fa8c254bc', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:27:59.803518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:27:59.803932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:27:59.804395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:27:59.804793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:27:59.805194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:27:59.815112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:59.815586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:59.816011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:59.816729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:59.817173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:59.817587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:59.824271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:59.836592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Getting quotas for project 2aae79e92fe04118abc223a15b0125c7. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:27:59.842509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Getting quotas for user 6164bf5a872d4a61affdfdc17ade47b0 and project 2aae79e92fe04118abc223a15b0125c7. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:27:59.855280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:27:59.857527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:27:59.912529 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a9c761b4-8b58-4f88-bb84-d2aa40acf00c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550533 Oct 29 03:27:59.919215 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3247/6455] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:27:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:27:59.926124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d7d3c1c5-2740-4436-a3e3-36e2c3b7dd48 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:59.926789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d7d3c1c5-2740-4436-a3e3-36e2c3b7dd48 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:59.988023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d7d3c1c5-2740-4436-a3e3-36e2c3b7dd48 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:59.995344 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d7d3c1c5-2740-4436-a3e3-36e2c3b7dd48 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 200 len: 1218 microversion: 2.1 time: 0.074653 Oct 29 03:27:59.995930 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3209/6456] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:59 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:01.019285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0fab781b-b70f-46fb-bb5f-aa1308ea4907 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:01.019905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0fab781b-b70f-46fb-bb5f-aa1308ea4907 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:01.027066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fab781b-b70f-46fb-bb5f-aa1308ea4907 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:01.027427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fab781b-b70f-46fb-bb5f-aa1308ea4907 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:01.027874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fab781b-b70f-46fb-bb5f-aa1308ea4907 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:01.028574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fab781b-b70f-46fb-bb5f-aa1308ea4907 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:01.029001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fab781b-b70f-46fb-bb5f-aa1308ea4907 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:01.029418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fab781b-b70f-46fb-bb5f-aa1308ea4907 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:01.092847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0fab781b-b70f-46fb-bb5f-aa1308ea4907 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:01.102001 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0fab781b-b70f-46fb-bb5f-aa1308ea4907 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 200 len: 1278 microversion: 2.1 time: 0.087641 Oct 29 03:28:01.102575 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3248/6457] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:01 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:02.125713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-086aca89-b4d2-491a-a83f-665ddff86232 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:02.126360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-086aca89-b4d2-491a-a83f-665ddff86232 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:02.134901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-086aca89-b4d2-491a-a83f-665ddff86232 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:02.135631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-086aca89-b4d2-491a-a83f-665ddff86232 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:02.136060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-086aca89-b4d2-491a-a83f-665ddff86232 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:02.136767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-086aca89-b4d2-491a-a83f-665ddff86232 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:02.137196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-086aca89-b4d2-491a-a83f-665ddff86232 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:02.137612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-086aca89-b4d2-491a-a83f-665ddff86232 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:02.364900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-086aca89-b4d2-491a-a83f-665ddff86232 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:02.373927 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-086aca89-b4d2-491a-a83f-665ddff86232 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 200 len: 1318 microversion: 2.1 time: 0.252214 Oct 29 03:28:02.374518 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3210/6458] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:02 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:02.578147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-197d4c31-e91a-4cf3-babc-6fafe6724b55 req-11e30a8f-482f-45ff-85e0-3f7549295e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0417d30f-0f4e-4bc2-91ad-733bd25d36d2", "tag": "1844a75a-d3d0-4582-accf-173c9acf96ee"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:02.588486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-197d4c31-e91a-4cf3-babc-6fafe6724b55 req-11e30a8f-482f-45ff-85e0-3f7549295e77 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:02.588942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-197d4c31-e91a-4cf3-babc-6fafe6724b55 req-11e30a8f-482f-45ff-85e0-3f7549295e77 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:02.589360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-197d4c31-e91a-4cf3-babc-6fafe6724b55 req-11e30a8f-482f-45ff-85e0-3f7549295e77 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:02.601166 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-197d4c31-e91a-4cf3-babc-6fafe6724b55 req-11e30a8f-482f-45ff-85e0-3f7549295e77 service nova] Creating event network-changed:1844a75a-d3d0-4582-accf-173c9acf96ee for instance 0417d30f-0f4e-4bc2-91ad-733bd25d36d2 on n-h1-862964-4 Oct 29 03:28:02.606210 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-197d4c31-e91a-4cf3-babc-6fafe6724b55 req-11e30a8f-482f-45ff-85e0-3f7549295e77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099939 Oct 29 03:28:02.606822 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3249/6459] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:03.397255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d8f0100f-4ec6-424c-b4a1-124dd374589e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:03.397870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d8f0100f-4ec6-424c-b4a1-124dd374589e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:03.400759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=35 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:03.406672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8f0100f-4ec6-424c-b4a1-124dd374589e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:03.407152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8f0100f-4ec6-424c-b4a1-124dd374589e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:03.407582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8f0100f-4ec6-424c-b4a1-124dd374589e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:03.408273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8f0100f-4ec6-424c-b4a1-124dd374589e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:03.408722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8f0100f-4ec6-424c-b4a1-124dd374589e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:03.409149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d8f0100f-4ec6-424c-b4a1-124dd374589e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:03.411966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:03.562243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d8f0100f-4ec6-424c-b4a1-124dd374589e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:03.570603 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d8f0100f-4ec6-424c-b4a1-124dd374589e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 200 len: 1318 microversion: 2.1 time: 0.177321 Oct 29 03:28:03.571172 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3211/6460] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:03 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:04.594211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-81113547-521f-4e69-bd5e-47a958ed4e54 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:04.594909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-81113547-521f-4e69-bd5e-47a958ed4e54 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:04.601627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81113547-521f-4e69-bd5e-47a958ed4e54 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:04.602592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81113547-521f-4e69-bd5e-47a958ed4e54 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:04.603008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81113547-521f-4e69-bd5e-47a958ed4e54 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:04.603705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81113547-521f-4e69-bd5e-47a958ed4e54 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:04.604153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81113547-521f-4e69-bd5e-47a958ed4e54 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:04.604571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-81113547-521f-4e69-bd5e-47a958ed4e54 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:04.744665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-81113547-521f-4e69-bd5e-47a958ed4e54 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:04.753036 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-81113547-521f-4e69-bd5e-47a958ed4e54 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 200 len: 1318 microversion: 2.1 time: 0.164110 Oct 29 03:28:04.753631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3250/6461] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:04 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:05.780893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5e15201c-3499-4e5c-8e56-8314853cbf09 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:05.781593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5e15201c-3499-4e5c-8e56-8314853cbf09 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:05.789004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e15201c-3499-4e5c-8e56-8314853cbf09 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:05.789485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e15201c-3499-4e5c-8e56-8314853cbf09 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:05.789944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e15201c-3499-4e5c-8e56-8314853cbf09 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:05.790664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e15201c-3499-4e5c-8e56-8314853cbf09 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:05.791110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e15201c-3499-4e5c-8e56-8314853cbf09 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:05.791529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5e15201c-3499-4e5c-8e56-8314853cbf09 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:05.936859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5e15201c-3499-4e5c-8e56-8314853cbf09 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:05.944986 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5e15201c-3499-4e5c-8e56-8314853cbf09 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 200 len: 1318 microversion: 2.1 time: 0.171278 Oct 29 03:28:05.945559 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3212/6462] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:05 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:06.361025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-7645eac5-a216-404e-8e56-c00b6be27bc9 req-b870e5a5-53c8-4bec-91b3-719a74bfe9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0417d30f-0f4e-4bc2-91ad-733bd25d36d2", "name": "network-vif-plugged", "status": "completed", "tag": "1844a75a-d3d0-4582-accf-173c9acf96ee"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:06.371748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7645eac5-a216-404e-8e56-c00b6be27bc9 req-b870e5a5-53c8-4bec-91b3-719a74bfe9b6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:06.372234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7645eac5-a216-404e-8e56-c00b6be27bc9 req-b870e5a5-53c8-4bec-91b3-719a74bfe9b6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:06.372656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7645eac5-a216-404e-8e56-c00b6be27bc9 req-b870e5a5-53c8-4bec-91b3-719a74bfe9b6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:06.383903 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-7645eac5-a216-404e-8e56-c00b6be27bc9 req-b870e5a5-53c8-4bec-91b3-719a74bfe9b6 service nova] Creating event network-vif-plugged:1844a75a-d3d0-4582-accf-173c9acf96ee for instance 0417d30f-0f4e-4bc2-91ad-733bd25d36d2 on n-h1-862964-4 Oct 29 03:28:06.388751 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-7645eac5-a216-404e-8e56-c00b6be27bc9 req-b870e5a5-53c8-4bec-91b3-719a74bfe9b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095904 Oct 29 03:28:06.389324 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3251/6463] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:06.971296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bd37f8f4-7bd5-4503-8e87-1cafe0344e22 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:06.972099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bd37f8f4-7bd5-4503-8e87-1cafe0344e22 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:06.979483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd37f8f4-7bd5-4503-8e87-1cafe0344e22 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:06.979961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd37f8f4-7bd5-4503-8e87-1cafe0344e22 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:06.980619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd37f8f4-7bd5-4503-8e87-1cafe0344e22 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:06.981367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd37f8f4-7bd5-4503-8e87-1cafe0344e22 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:06.981830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd37f8f4-7bd5-4503-8e87-1cafe0344e22 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:06.982263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bd37f8f4-7bd5-4503-8e87-1cafe0344e22 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:07.115494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bd37f8f4-7bd5-4503-8e87-1cafe0344e22 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:07.123758 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bd37f8f4-7bd5-4503-8e87-1cafe0344e22 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 200 len: 1318 microversion: 2.1 time: 0.157977 Oct 29 03:28:07.124381 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3213/6464] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:06 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:08.153099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3b7d70d6-a5f7-4544-9ac1-5c7da57172ba tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:08.154288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3b7d70d6-a5f7-4544-9ac1-5c7da57172ba tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:08.165091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b7d70d6-a5f7-4544-9ac1-5c7da57172ba tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:08.165903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b7d70d6-a5f7-4544-9ac1-5c7da57172ba tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:08.166650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b7d70d6-a5f7-4544-9ac1-5c7da57172ba tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:08.167783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b7d70d6-a5f7-4544-9ac1-5c7da57172ba tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:08.168526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b7d70d6-a5f7-4544-9ac1-5c7da57172ba tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:08.169232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3b7d70d6-a5f7-4544-9ac1-5c7da57172ba tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:08.306296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3b7d70d6-a5f7-4544-9ac1-5c7da57172ba tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:08.314318 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3b7d70d6-a5f7-4544-9ac1-5c7da57172ba tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 200 len: 1507 microversion: 2.1 time: 0.169754 Oct 29 03:28:08.314905 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3252/6465] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:08 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:18.587822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-35e4d5e0-a371-4aa5-b380-b2672baa9932 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:18.590051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-35e4d5e0-a371-4aa5-b380-b2672baa9932 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:18.594428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:18.595455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=5 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:18.596080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=17 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:18.604937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e4d5e0-a371-4aa5-b380-b2672baa9932 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:18.605454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e4d5e0-a371-4aa5-b380-b2672baa9932 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:18.605897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e4d5e0-a371-4aa5-b380-b2672baa9932 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:18.606625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e4d5e0-a371-4aa5-b380-b2672baa9932 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:18.607069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e4d5e0-a371-4aa5-b380-b2672baa9932 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:18.607487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e4d5e0-a371-4aa5-b380-b2672baa9932 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:18.665249 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-35e4d5e0-a371-4aa5-b380-b2672baa9932 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197/action" status: 200 len: 24573 microversion: 2.1 time: 0.081223 Oct 29 03:28:18.667110 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3214/6466] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:28:18 2022] POST /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197/action => generated 24573 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:28:23.548339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fdab191a-fe75-4752-9195-3c91097bce52 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7332c801-53c1-4b41-b751-b9833a4218f0", "device": "/dev/sdb"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:23.551446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fdab191a-fe75-4752-9195-3c91097bce52 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:23.553818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:23.554652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:23.555440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:23.556174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=23 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:23.563493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdab191a-fe75-4752-9195-3c91097bce52 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:23.563977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdab191a-fe75-4752-9195-3c91097bce52 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:23.564407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdab191a-fe75-4752-9195-3c91097bce52 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:23.565131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdab191a-fe75-4752-9195-3c91097bce52 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:23.565576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdab191a-fe75-4752-9195-3c91097bce52 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:23.566022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdab191a-fe75-4752-9195-3c91097bce52 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:23.847573 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fdab191a-fe75-4752-9195-3c91097bce52 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "POST /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303105 Oct 29 03:28:23.848225 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3253/6467] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:28:23 2022] POST /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:24.899363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e98bc6d5-dfb1-4877-a5a9-d5833daa2ce5 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:24.899963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e98bc6d5-dfb1-4877-a5a9-d5833daa2ce5 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:24.907555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e98bc6d5-dfb1-4877-a5a9-d5833daa2ce5 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:24.908034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e98bc6d5-dfb1-4877-a5a9-d5833daa2ce5 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:24.908473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e98bc6d5-dfb1-4877-a5a9-d5833daa2ce5 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:24.909153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e98bc6d5-dfb1-4877-a5a9-d5833daa2ce5 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:24.909600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e98bc6d5-dfb1-4877-a5a9-d5833daa2ce5 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:24.910055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e98bc6d5-dfb1-4877-a5a9-d5833daa2ce5 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:25.044048 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e98bc6d5-dfb1-4877-a5a9-d5833daa2ce5 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1833 microversion: 2.1 time: 0.149159 Oct 29 03:28:25.044624 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3215/6468] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:24 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1833 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:26.233442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-93397929-ce26-47b3-831d-9e9d29276294 req-7b4bd4f2-d72a-458e-a73e-7c80f7d3e67b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459bdce4-aa58-4e36-b19a-947b23e71197", "tag": "c8a7d21b-b130-4514-ac1a-d43c7cca8ca3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:26.235997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bf7810a2-57f3-4146-80c1-073f9ce79075 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:26.236589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bf7810a2-57f3-4146-80c1-073f9ce79075 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:26.244669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf7810a2-57f3-4146-80c1-073f9ce79075 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:26.245162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf7810a2-57f3-4146-80c1-073f9ce79075 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:26.245607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf7810a2-57f3-4146-80c1-073f9ce79075 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:26.246626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf7810a2-57f3-4146-80c1-073f9ce79075 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:26.247089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf7810a2-57f3-4146-80c1-073f9ce79075 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:26.247514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf7810a2-57f3-4146-80c1-073f9ce79075 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:26.249378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-93397929-ce26-47b3-831d-9e9d29276294 req-7b4bd4f2-d72a-458e-a73e-7c80f7d3e67b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:26.251231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-93397929-ce26-47b3-831d-9e9d29276294 req-7b4bd4f2-d72a-458e-a73e-7c80f7d3e67b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:26.252253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-93397929-ce26-47b3-831d-9e9d29276294 req-7b4bd4f2-d72a-458e-a73e-7c80f7d3e67b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:26.269857 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-93397929-ce26-47b3-831d-9e9d29276294 req-7b4bd4f2-d72a-458e-a73e-7c80f7d3e67b service nova] Creating event network-changed:c8a7d21b-b130-4514-ac1a-d43c7cca8ca3 for instance 459bdce4-aa58-4e36-b19a-947b23e71197 on n-h2-862964-4 Oct 29 03:28:26.275889 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-93397929-ce26-47b3-831d-9e9d29276294 req-7b4bd4f2-d72a-458e-a73e-7c80f7d3e67b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046859 Oct 29 03:28:26.277065 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3216/6469] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:26.279224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bf7810a2-57f3-4146-80c1-073f9ce79075 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:28:26.398619 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bf7810a2-57f3-4146-80c1-073f9ce79075 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "DELETE /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 204 len: 0 microversion: 2.1 time: 0.170951 Oct 29 03:28:26.399434 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3254/6470] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:28:26 2022] DELETE /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:28:26.408325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9d531b68-40a4-4957-9247-ae5b676c8c72 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:26.409382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9d531b68-40a4-4957-9247-ae5b676c8c72 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:26.416073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d531b68-40a4-4957-9247-ae5b676c8c72 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:26.416887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d531b68-40a4-4957-9247-ae5b676c8c72 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:26.417582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d531b68-40a4-4957-9247-ae5b676c8c72 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:26.418555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d531b68-40a4-4957-9247-ae5b676c8c72 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:26.419220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d531b68-40a4-4957-9247-ae5b676c8c72 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:26.419857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9d531b68-40a4-4957-9247-ae5b676c8c72 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:26.573664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9d531b68-40a4-4957-9247-ae5b676c8c72 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:26.582193 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9d531b68-40a4-4957-9247-ae5b676c8c72 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1688 microversion: 2.1 time: 0.178135 Oct 29 03:28:26.582883 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3217/6471] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:26 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:27.606853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0349e56-d71b-4931-b104-79c2e97a1020 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:27.608379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b0349e56-d71b-4931-b104-79c2e97a1020 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:27.618629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0349e56-d71b-4931-b104-79c2e97a1020 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:27.619198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0349e56-d71b-4931-b104-79c2e97a1020 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:27.619689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0349e56-d71b-4931-b104-79c2e97a1020 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:27.620476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0349e56-d71b-4931-b104-79c2e97a1020 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:27.621342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0349e56-d71b-4931-b104-79c2e97a1020 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:27.622184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0349e56-d71b-4931-b104-79c2e97a1020 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:27.790506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b0349e56-d71b-4931-b104-79c2e97a1020 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:27.799397 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b0349e56-d71b-4931-b104-79c2e97a1020 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1688 microversion: 2.1 time: 0.196804 Oct 29 03:28:27.800009 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3255/6472] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:27 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:28.489256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8cf6175a-c928-4454-9f33-6f6124bf7dcc req-9b3d085c-523a-4a72-81aa-80908e1c9fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459bdce4-aa58-4e36-b19a-947b23e71197", "name": "network-vif-deleted", "tag": "c8a7d21b-b130-4514-ac1a-d43c7cca8ca3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:28.500980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8cf6175a-c928-4454-9f33-6f6124bf7dcc req-9b3d085c-523a-4a72-81aa-80908e1c9fa0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:28.502326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8cf6175a-c928-4454-9f33-6f6124bf7dcc req-9b3d085c-523a-4a72-81aa-80908e1c9fa0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:28.502773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8cf6175a-c928-4454-9f33-6f6124bf7dcc req-9b3d085c-523a-4a72-81aa-80908e1c9fa0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:28.515865 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8cf6175a-c928-4454-9f33-6f6124bf7dcc req-9b3d085c-523a-4a72-81aa-80908e1c9fa0 service nova] Creating event network-vif-deleted:c8a7d21b-b130-4514-ac1a-d43c7cca8ca3 for instance 459bdce4-aa58-4e36-b19a-947b23e71197 on n-h2-862964-4 Oct 29 03:28:28.521058 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8cf6175a-c928-4454-9f33-6f6124bf7dcc req-9b3d085c-523a-4a72-81aa-80908e1c9fa0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035498 Oct 29 03:28:28.521668 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3218/6473] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:28.824037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:28.824731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:28.832988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:28.833486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:28.834006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:28.834991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:28.835256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:28.835697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:28.874992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:28.875485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:28.875889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:28.876538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lazy-loading 'fault' on Instance uuid 459bdce4-aa58-4e36-b19a-947b23e71197 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:28:28.922543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:28.930527 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ea65aaa5-050a-48d6-a0dd-148d88603017 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 200 len: 1356 microversion: 2.1 time: 0.111211 Oct 29 03:28:28.931109 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3256/6474] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:28 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:29.958271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:29.959190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 459bdce4-aa58-4e36-b19a-947b23e71197] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:29.969230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:29.969848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:29.970467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:29.971382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:29.971981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:29.972576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:29.989122 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] HTTP exception thrown: Instance 459bdce4-aa58-4e36-b19a-947b23e71197 could not be found. Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Request method failure captured: Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 HTTP/1.1 Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ10LZQSVueycmVKmxTnPj3nUimr4sccneo7HLm8KXoelgnMvGdJN1ul4_Noy4qlMD9jBc7keg-hfhkO8RJdfVJEtLkxYJxm5hLDbYb4Zkhq0cAALSLv_Q2FcEk-lgwgLiCvqwRZD85031-7BUx5-jlERqTw0IWvFo1WnuKpY-yQSgQ Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 1d8e5b0759e64bc5a2118d6ab364bec3 Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d8e5b0759e64bc5a2118d6ab364bec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d8e5b0759e64bc5a2118d6ab364bec3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d8e5b0759e64bc5a2118d6ab364bec3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d8e5b0759e64bc5a2118d6ab364bec3"}]}] Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 1d8e5b0759e64bc5a2118d6ab364bec3 Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestNetworkAdvancedServerOps-841069215-project Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 6988b3809252496ca2f97a1f6eff5825 Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestNetworkAdvancedServerOps-841069215-project Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 459bdce4-aa58-4e36-b19a-947b23e71197 could not be found. Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '459bdce4-aa58-4e36-b19a-947b23e71197'} Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459bdce4-aa58-4e36-b19a-947b23e71197 could not be found. Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459bdce4-aa58-4e36-b19a-947b23e71197 could not be found. Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:28:29.990802 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:29.996150 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:28:29.996150 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:29.996150 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:29.996150 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:29.996150 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:28:29.996150 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:28:29.996150 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459bdce4-aa58-4e36-b19a-947b23e71197 could not be found. Oct 29 03:28:29.996150 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:28:29.996150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Returning 404 to user: Instance 459bdce4-aa58-4e36-b19a-947b23e71197 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:28:29.996150 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0addc1bb-8697-4df4-9a34-4d16c6c0a399 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197" status: 404 len: 111 microversion: 2.1 time: 0.039850 Oct 29 03:28:29.996150 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3219/6475] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:29 2022] GET /compute/v2.1/servers/459bdce4-aa58-4e36-b19a-947b23e71197 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:28:33.368372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-222cb3f2-0516-47fb-a73f-dd8031ec9fd4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '.version_select at 0x7fe1a31d11f0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:33.402241 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-222cb3f2-0516-47fb-a73f-dd8031ec9fd4 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-974757103" status: 202 len: 0 microversion: 2.1 time: 0.038216 Oct 29 03:28:33.402827 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3257/6476] 10.222.0.16 () {58 vars in 1281 bytes} [Sat Oct 29 03:28:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-974757103 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:28:33.432463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d1568070-e953-497a-8310-5d0fd2a3c8e6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'create', calling method: .version_select at 0x7fe1acca24c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1671381355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNkEbQzZUXToDuR5c2PszMp4Q1TZagfEyouQxkgiamOirAgtRXUIf668KKqpsynK+QqOoG7qFUJ4bBKpRqjSH2vOvyYYj1sCKeP/Yka4C2pjUQFluM/F7PA9fm+MSE7Gg=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:33.450345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d1568070-e953-497a-8310-5d0fd2a3c8e6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:28:33.457962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d1568070-e953-497a-8310-5d0fd2a3c8e6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for user 6988b3809252496ca2f97a1f6eff5825 and project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:28:33.482585 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d1568070-e953-497a-8310-5d0fd2a3c8e6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054159 Oct 29 03:28:33.483413 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3220/6477] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:28:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:39.262326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:39.268366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-181112961", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "07d322a3-0875-4f1c-8255-5b25e8b35f69"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1671381355", "security_groups": [{"name": "tempest-secgroup-smoke-212287887"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:39.439839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] validate_networks() for [('07d322a3-0875-4f1c-8255-5b25e8b35f69', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:28:39.920514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:28:39.920993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:28:39.921575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:28:39.922107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:28:39.922620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:28:39.935394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:39.936004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:39.936508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:39.937327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:39.937871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:39.938457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:39.959878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:28:39.966538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for user 6988b3809252496ca2f97a1f6eff5825 and project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:28:39.981401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:28:39.984300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:28:40.039262 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-00ef1cba-ef11-44d2-a72a-870f8516c936 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.778672 Oct 29 03:28:40.040241 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3258/6478] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:28:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:28:40.051397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d910a68e-beda-4af0-ada6-595c70fb362c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:40.052563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d910a68e-beda-4af0-ada6-595c70fb362c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:40.055722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=22 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:40.129350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d910a68e-beda-4af0-ada6-595c70fb362c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:40.136831 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d910a68e-beda-4af0-ada6-595c70fb362c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1266 microversion: 2.1 time: 0.089170 Oct 29 03:28:40.138032 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3221/6479] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:40 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:41.164306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1b919eec-f8b2-431b-814f-f62a5fefe985 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:41.166652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b919eec-f8b2-431b-814f-f62a5fefe985 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:41.222917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b919eec-f8b2-431b-814f-f62a5fefe985 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:41.223501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b919eec-f8b2-431b-814f-f62a5fefe985 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:41.224181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b919eec-f8b2-431b-814f-f62a5fefe985 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:41.224967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b919eec-f8b2-431b-814f-f62a5fefe985 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:41.225509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b919eec-f8b2-431b-814f-f62a5fefe985 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:41.226031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b919eec-f8b2-431b-814f-f62a5fefe985 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:41.308000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b919eec-f8b2-431b-814f-f62a5fefe985 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:41.323332 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1b919eec-f8b2-431b-814f-f62a5fefe985 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1318 microversion: 2.1 time: 0.159337 Oct 29 03:28:41.324006 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3259/6480] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:41 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:42.351651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8101500-a6ea-4186-8966-e4b011cb24a3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:42.352389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8101500-a6ea-4186-8966-e4b011cb24a3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:42.370981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8101500-a6ea-4186-8966-e4b011cb24a3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:42.371736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8101500-a6ea-4186-8966-e4b011cb24a3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:42.372295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8101500-a6ea-4186-8966-e4b011cb24a3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:42.373642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8101500-a6ea-4186-8966-e4b011cb24a3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:42.376184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8101500-a6ea-4186-8966-e4b011cb24a3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:42.376979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8101500-a6ea-4186-8966-e4b011cb24a3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:42.604767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8101500-a6ea-4186-8966-e4b011cb24a3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:42.634936 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8101500-a6ea-4186-8966-e4b011cb24a3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1391 microversion: 2.1 time: 0.287501 Oct 29 03:28:42.638317 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3222/6481] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:42 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1391 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:43.270863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e020e9f3-1a7c-4702-afde-5df5d0ec8802 req-196a736f-2ec7-4023-9578-e062a628fd56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd", "tag": "608c9b52-0f19-4678-95e0-4c0f52aa04f0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:43.289495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e020e9f3-1a7c-4702-afde-5df5d0ec8802 req-196a736f-2ec7-4023-9578-e062a628fd56 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:43.290416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e020e9f3-1a7c-4702-afde-5df5d0ec8802 req-196a736f-2ec7-4023-9578-e062a628fd56 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:43.291059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e020e9f3-1a7c-4702-afde-5df5d0ec8802 req-196a736f-2ec7-4023-9578-e062a628fd56 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:43.305441 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e020e9f3-1a7c-4702-afde-5df5d0ec8802 req-196a736f-2ec7-4023-9578-e062a628fd56 service nova] Creating event network-changed:608c9b52-0f19-4678-95e0-4c0f52aa04f0 for instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd on n-h2-862964-4 Oct 29 03:28:43.314083 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e020e9f3-1a7c-4702-afde-5df5d0ec8802 req-196a736f-2ec7-4023-9578-e062a628fd56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046617 Oct 29 03:28:43.315479 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3260/6482] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:43.661457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4e44e97b-4a01-43a4-99e1-6d5a8e98470c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:43.662060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4e44e97b-4a01-43a4-99e1-6d5a8e98470c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:43.669528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e44e97b-4a01-43a4-99e1-6d5a8e98470c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:43.670063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e44e97b-4a01-43a4-99e1-6d5a8e98470c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:43.670619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e44e97b-4a01-43a4-99e1-6d5a8e98470c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:43.671294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e44e97b-4a01-43a4-99e1-6d5a8e98470c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:43.671743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e44e97b-4a01-43a4-99e1-6d5a8e98470c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:43.672162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e44e97b-4a01-43a4-99e1-6d5a8e98470c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:43.824001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4e44e97b-4a01-43a4-99e1-6d5a8e98470c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:43.835310 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4e44e97b-4a01-43a4-99e1-6d5a8e98470c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1391 microversion: 2.1 time: 0.177908 Oct 29 03:28:43.836523 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3223/6483] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:43 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:44.860887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9a441d7a-2e88-408c-8fe0-e1c62e32a261 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:44.861551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a441d7a-2e88-408c-8fe0-e1c62e32a261 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:44.872915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a441d7a-2e88-408c-8fe0-e1c62e32a261 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:44.873409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a441d7a-2e88-408c-8fe0-e1c62e32a261 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:44.873907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a441d7a-2e88-408c-8fe0-e1c62e32a261 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:44.874676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a441d7a-2e88-408c-8fe0-e1c62e32a261 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:44.875118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a441d7a-2e88-408c-8fe0-e1c62e32a261 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:44.875531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a441d7a-2e88-408c-8fe0-e1c62e32a261 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:45.087761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9a441d7a-2e88-408c-8fe0-e1c62e32a261 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:45.095749 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9a441d7a-2e88-408c-8fe0-e1c62e32a261 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1391 microversion: 2.1 time: 0.240329 Oct 29 03:28:45.096360 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3261/6484] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:44 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:46.122929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4298ced7-092d-4ed2-a3f6-aee4797c41c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:46.123660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4298ced7-092d-4ed2-a3f6-aee4797c41c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:46.130907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4298ced7-092d-4ed2-a3f6-aee4797c41c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:46.131370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4298ced7-092d-4ed2-a3f6-aee4797c41c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:46.131828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4298ced7-092d-4ed2-a3f6-aee4797c41c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:46.132515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4298ced7-092d-4ed2-a3f6-aee4797c41c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:46.132995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4298ced7-092d-4ed2-a3f6-aee4797c41c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:46.133410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4298ced7-092d-4ed2-a3f6-aee4797c41c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:46.268795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4298ced7-092d-4ed2-a3f6-aee4797c41c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:46.277546 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4298ced7-092d-4ed2-a3f6-aee4797c41c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1391 microversion: 2.1 time: 0.158699 Oct 29 03:28:46.278174 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3224/6485] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:46 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:47.303319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f1417ec9-f51e-4d95-8872-96bf9f7f9f4c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:47.304735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f1417ec9-f51e-4d95-8872-96bf9f7f9f4c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:47.314000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1417ec9-f51e-4d95-8872-96bf9f7f9f4c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:47.314907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1417ec9-f51e-4d95-8872-96bf9f7f9f4c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:47.315757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1417ec9-f51e-4d95-8872-96bf9f7f9f4c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:47.316592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1417ec9-f51e-4d95-8872-96bf9f7f9f4c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:47.317128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1417ec9-f51e-4d95-8872-96bf9f7f9f4c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:47.317629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1417ec9-f51e-4d95-8872-96bf9f7f9f4c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:47.462985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f1417ec9-f51e-4d95-8872-96bf9f7f9f4c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:47.472175 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f1417ec9-f51e-4d95-8872-96bf9f7f9f4c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1391 microversion: 2.1 time: 0.175029 Oct 29 03:28:47.472740 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3262/6486] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:47 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:48.064142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1ae5a4a6-91bb-47b0-b28f-442823034f01 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:48.065265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1ae5a4a6-91bb-47b0-b28f-442823034f01 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:48.072729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae5a4a6-91bb-47b0-b28f-442823034f01 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:48.073213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae5a4a6-91bb-47b0-b28f-442823034f01 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:48.073644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae5a4a6-91bb-47b0-b28f-442823034f01 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:48.074379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae5a4a6-91bb-47b0-b28f-442823034f01 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:48.074822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae5a4a6-91bb-47b0-b28f-442823034f01 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:48.075239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae5a4a6-91bb-47b0-b28f-442823034f01 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:48.160471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-1ae5a4a6-91bb-47b0-b28f-442823034f01 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lazy-loading 'services' on Instance uuid 0417d30f-0f4e-4bc2-91ad-733bd25d36d2 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:28:48.259082 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1ae5a4a6-91bb-47b0-b28f-442823034f01 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2/os-volume_attachments/7332c801-53c1-4b41-b751-b9833a4218f0" status: 202 len: 0 microversion: 2.1 time: 0.198852 Oct 29 03:28:48.259697 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3225/6487] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:28:48 2022] DELETE /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2/os-volume_attachments/7332c801-53c1-4b41-b751-b9833a4218f0 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:28:48.498016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef2a6494-3a24-49cd-97d4-4d118bfa88ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:48.498776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ef2a6494-3a24-49cd-97d4-4d118bfa88ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:48.506074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef2a6494-3a24-49cd-97d4-4d118bfa88ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:48.506566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef2a6494-3a24-49cd-97d4-4d118bfa88ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:48.506974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef2a6494-3a24-49cd-97d4-4d118bfa88ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:48.507700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef2a6494-3a24-49cd-97d4-4d118bfa88ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:48.508151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef2a6494-3a24-49cd-97d4-4d118bfa88ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:48.508585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef2a6494-3a24-49cd-97d4-4d118bfa88ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:48.650507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ef2a6494-3a24-49cd-97d4-4d118bfa88ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:48.658659 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ef2a6494-3a24-49cd-97d4-4d118bfa88ab tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1391 microversion: 2.1 time: 0.166306 Oct 29 03:28:48.659242 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3263/6488] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:48 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:49.224655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-70f2130d-b519-4440-825a-6e1ad6795f92 req-229fd728-7193-43bd-83fe-91cb4402883f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd", "name": "network-vif-plugged", "status": "completed", "tag": "608c9b52-0f19-4678-95e0-4c0f52aa04f0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:49.232676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:49.240735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-70f2130d-b519-4440-825a-6e1ad6795f92 req-229fd728-7193-43bd-83fe-91cb4402883f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:49.241200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-70f2130d-b519-4440-825a-6e1ad6795f92 req-229fd728-7193-43bd-83fe-91cb4402883f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:49.241851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-70f2130d-b519-4440-825a-6e1ad6795f92 req-229fd728-7193-43bd-83fe-91cb4402883f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:49.256496 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-70f2130d-b519-4440-825a-6e1ad6795f92 req-229fd728-7193-43bd-83fe-91cb4402883f service nova] Creating event network-vif-plugged:608c9b52-0f19-4678-95e0-4c0f52aa04f0 for instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd on n-h2-862964-4 Oct 29 03:28:49.261980 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-70f2130d-b519-4440-825a-6e1ad6795f92 req-229fd728-7193-43bd-83fe-91cb4402883f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042705 Oct 29 03:28:49.263428 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3226/6489] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:49.683140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6bee200a-87cf-4f69-8c87-8341441b610c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:49.683707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6bee200a-87cf-4f69-8c87-8341441b610c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:49.691289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6bee200a-87cf-4f69-8c87-8341441b610c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:49.691849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6bee200a-87cf-4f69-8c87-8341441b610c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:49.692359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6bee200a-87cf-4f69-8c87-8341441b610c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:49.693119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6bee200a-87cf-4f69-8c87-8341441b610c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:49.693636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6bee200a-87cf-4f69-8c87-8341441b610c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:49.694186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6bee200a-87cf-4f69-8c87-8341441b610c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:49.832499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6bee200a-87cf-4f69-8c87-8341441b610c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:49.840633 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6bee200a-87cf-4f69-8c87-8341441b610c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1391 microversion: 2.1 time: 0.161517 Oct 29 03:28:49.841214 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3264/6490] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:49 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:50.861714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:50.866974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b31913c7-8d44-45cc-be32-5921e33612bd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:50.868075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b31913c7-8d44-45cc-be32-5921e33612bd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:50.874921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31913c7-8d44-45cc-be32-5921e33612bd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:50.875425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31913c7-8d44-45cc-be32-5921e33612bd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:50.875835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31913c7-8d44-45cc-be32-5921e33612bd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:50.876602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31913c7-8d44-45cc-be32-5921e33612bd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:50.876991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31913c7-8d44-45cc-be32-5921e33612bd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:50.877500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31913c7-8d44-45cc-be32-5921e33612bd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:51.014602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b31913c7-8d44-45cc-be32-5921e33612bd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:51.022658 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b31913c7-8d44-45cc-be32-5921e33612bd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1562 microversion: 2.1 time: 0.162014 Oct 29 03:28:51.023213 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3227/6491] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:50 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:51.045452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8255a837-6d93-41e8-8252-d58796c02440 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:51.046065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8255a837-6d93-41e8-8252-d58796c02440 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:51.048022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:51.048683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:51.055923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8255a837-6d93-41e8-8252-d58796c02440 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:51.056405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8255a837-6d93-41e8-8252-d58796c02440 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:51.056832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8255a837-6d93-41e8-8252-d58796c02440 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:51.057527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8255a837-6d93-41e8-8252-d58796c02440 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:51.058001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8255a837-6d93-41e8-8252-d58796c02440 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:51.058436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8255a837-6d93-41e8-8252-d58796c02440 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:51.208524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8255a837-6d93-41e8-8252-d58796c02440 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:51.218088 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8255a837-6d93-41e8-8252-d58796c02440 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1562 microversion: 2.1 time: 0.176346 Oct 29 03:28:51.219006 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3265/6492] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:51 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1562 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:52.866958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2d130f44-ab88-46b2-bcb3-de064d08a1ce tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:52.868430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2d130f44-ab88-46b2-bcb3-de064d08a1ce tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:52.875281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d130f44-ab88-46b2-bcb3-de064d08a1ce tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:52.875516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-c904e463-0611-4702-bb18-4cc5c67afa2d req-3d6d1a79-3a94-4737-af3b-7dbb06ef94ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd", "tag": "608c9b52-0f19-4678-95e0-4c0f52aa04f0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:52.877537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d130f44-ab88-46b2-bcb3-de064d08a1ce tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:52.878192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d130f44-ab88-46b2-bcb3-de064d08a1ce tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:52.879081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d130f44-ab88-46b2-bcb3-de064d08a1ce tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:52.879701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d130f44-ab88-46b2-bcb3-de064d08a1ce tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:52.880114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d130f44-ab88-46b2-bcb3-de064d08a1ce tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:52.897178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c904e463-0611-4702-bb18-4cc5c67afa2d req-3d6d1a79-3a94-4737-af3b-7dbb06ef94ad service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:52.897661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c904e463-0611-4702-bb18-4cc5c67afa2d req-3d6d1a79-3a94-4737-af3b-7dbb06ef94ad service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:52.898136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c904e463-0611-4702-bb18-4cc5c67afa2d req-3d6d1a79-3a94-4737-af3b-7dbb06ef94ad service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:52.911349 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c904e463-0611-4702-bb18-4cc5c67afa2d req-3d6d1a79-3a94-4737-af3b-7dbb06ef94ad service nova] Creating event network-changed:608c9b52-0f19-4678-95e0-4c0f52aa04f0 for instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd on n-h2-862964-4 Oct 29 03:28:52.919388 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-c904e463-0611-4702-bb18-4cc5c67afa2d req-3d6d1a79-3a94-4737-af3b-7dbb06ef94ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048374 Oct 29 03:28:52.920723 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3266/6493] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:53.025166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2d130f44-ab88-46b2-bcb3-de064d08a1ce tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:53.034053 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2d130f44-ab88-46b2-bcb3-de064d08a1ce tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1562 microversion: 2.1 time: 0.170745 Oct 29 03:28:53.034941 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3228/6494] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:52 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:53.651613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e60bdca-10f4-4b3d-a7a9-7a9848865634 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:53.652205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e60bdca-10f4-4b3d-a7a9-7a9848865634 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:53.654247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:53.660061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e60bdca-10f4-4b3d-a7a9-7a9848865634 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:53.660578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e60bdca-10f4-4b3d-a7a9-7a9848865634 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:53.660999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e60bdca-10f4-4b3d-a7a9-7a9848865634 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:53.661696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e60bdca-10f4-4b3d-a7a9-7a9848865634 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:53.662207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e60bdca-10f4-4b3d-a7a9-7a9848865634 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:53.662626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e60bdca-10f4-4b3d-a7a9-7a9848865634 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:53.692006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e60bdca-10f4-4b3d-a7a9-7a9848865634 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:28:53.775672 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3e60bdca-10f4-4b3d-a7a9-7a9848865634 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 204 len: 0 microversion: 2.1 time: 0.128188 Oct 29 03:28:53.776280 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3267/6495] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:28:53 2022] DELETE /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:28:53.785170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fa80875b-e596-414b-9fc8-e8056ef68d1e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:53.785827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fa80875b-e596-414b-9fc8-e8056ef68d1e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:53.792496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa80875b-e596-414b-9fc8-e8056ef68d1e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:53.792990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa80875b-e596-414b-9fc8-e8056ef68d1e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:53.793423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa80875b-e596-414b-9fc8-e8056ef68d1e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:53.794242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa80875b-e596-414b-9fc8-e8056ef68d1e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:53.794937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa80875b-e596-414b-9fc8-e8056ef68d1e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:53.795370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa80875b-e596-414b-9fc8-e8056ef68d1e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:53.938331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fa80875b-e596-414b-9fc8-e8056ef68d1e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:53.946554 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fa80875b-e596-414b-9fc8-e8056ef68d1e tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 200 len: 1513 microversion: 2.1 time: 0.165717 Oct 29 03:28:53.947117 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3229/6496] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:53 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:28:54.972775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d29223b5-9183-4a8d-ac4d-cd6c3d234240 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:54.973570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d29223b5-9183-4a8d-ac4d-cd6c3d234240 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:54.981505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d29223b5-9183-4a8d-ac4d-cd6c3d234240 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:54.982079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d29223b5-9183-4a8d-ac4d-cd6c3d234240 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:54.982558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d29223b5-9183-4a8d-ac4d-cd6c3d234240 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:54.983347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d29223b5-9183-4a8d-ac4d-cd6c3d234240 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:54.983839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d29223b5-9183-4a8d-ac4d-cd6c3d234240 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:54.984300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d29223b5-9183-4a8d-ac4d-cd6c3d234240 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:55.124004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d29223b5-9183-4a8d-ac4d-cd6c3d234240 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:55.132090 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d29223b5-9183-4a8d-ac4d-cd6c3d234240 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 200 len: 1513 microversion: 2.1 time: 0.164262 Oct 29 03:28:55.132669 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3268/6497] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:54 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:55.889787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-73accf45-f192-4b4b-8d51-12329c0cec6d req-2e8a4969-1869-497a-a788-2245fd81968c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0417d30f-0f4e-4bc2-91ad-733bd25d36d2", "name": "network-vif-deleted", "tag": "1844a75a-d3d0-4582-accf-173c9acf96ee"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:55.901673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-73accf45-f192-4b4b-8d51-12329c0cec6d req-2e8a4969-1869-497a-a788-2245fd81968c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:55.902200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-73accf45-f192-4b4b-8d51-12329c0cec6d req-2e8a4969-1869-497a-a788-2245fd81968c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:55.902628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-73accf45-f192-4b4b-8d51-12329c0cec6d req-2e8a4969-1869-497a-a788-2245fd81968c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:55.913436 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-73accf45-f192-4b4b-8d51-12329c0cec6d req-2e8a4969-1869-497a-a788-2245fd81968c service nova] Creating event network-vif-deleted:1844a75a-d3d0-4582-accf-173c9acf96ee for instance 0417d30f-0f4e-4bc2-91ad-733bd25d36d2 on n-h1-862964-4 Oct 29 03:28:55.919869 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-73accf45-f192-4b4b-8d51-12329c0cec6d req-2e8a4969-1869-497a-a788-2245fd81968c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033910 Oct 29 03:28:55.920992 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3230/6498] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:56.156933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:56.157491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:56.164708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:56.165185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:56.165608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:56.166327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:56.166770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:56.167184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:56.199188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:56.199665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:56.200085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:56.200520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lazy-loading 'fault' on Instance uuid 0417d30f-0f4e-4bc2-91ad-733bd25d36d2 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:28:56.241468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:56.250199 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b0313687-a022-4082-a860-29b3f1f32f28 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 200 len: 1308 microversion: 2.1 time: 0.097161 Oct 29 03:28:56.250768 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3269/6499] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:56 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:57.276566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:57.277422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 0417d30f-0f4e-4bc2-91ad-733bd25d36d2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:57.284670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:57.285147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:57.285574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:57.286298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:57.286743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:57.287158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:57.302919 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] HTTP exception thrown: Instance 0417d30f-0f4e-4bc2-91ad-733bd25d36d2 could not be found. Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Request method failure captured: Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 HTTP/1.1 Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ2I8XEycdhnQRwwx2RauraDMSCpVlKbCYrfDJFcvfsgGMxV3hvL4Fpj54HMwpr4SXc-4oziflaAdPMGxjb65qOpQ8cKOEzQdwgkbD4eDo6MYBJUvPXgxg2TFOfckk7gs2N_WTHlCurRuaGRaQsYWfwR40I-S_ITNETjIihDjc1bN_U Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2aae79e92fe04118abc223a15b0125c7 Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesSnapshotTestJSON-846137126 Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2aae79e92fe04118abc223a15b0125c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2aae79e92fe04118abc223a15b0125c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2aae79e92fe04118abc223a15b0125c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2aae79e92fe04118abc223a15b0125c7"}]}] Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesSnapshotTestJSON-846137126 Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2aae79e92fe04118abc223a15b0125c7 Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-846137126 Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesSnapshotTestJSON-846137126-project Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 6164bf5a872d4a61affdfdc17ade47b0 Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesSnapshotTestJSON-846137126-project Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 0417d30f-0f4e-4bc2-91ad-733bd25d36d2 could not be found. Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '0417d30f-0f4e-4bc2-91ad-733bd25d36d2'} Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0417d30f-0f4e-4bc2-91ad-733bd25d36d2 could not be found. Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0417d30f-0f4e-4bc2-91ad-733bd25d36d2 could not be found. Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:57.304542 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:28:57.310551 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:57.310551 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:57.310551 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:57.310551 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:28:57.310551 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:28:57.310551 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0417d30f-0f4e-4bc2-91ad-733bd25d36d2 could not be found. Oct 29 03:28:57.310551 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:28:57.310551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Returning 404 to user: Instance 0417d30f-0f4e-4bc2-91ad-733bd25d36d2 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:28:57.310551 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a49c79d5-a6dc-4d24-bdbf-62ada9348c03 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2" status: 404 len: 111 microversion: 2.1 time: 0.035748 Oct 29 03:28:57.310551 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3231/6500] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:57 2022] GET /compute/v2.1/servers/0417d30f-0f4e-4bc2-91ad-733bd25d36d2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:29:04.118948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-589685612", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "d0119cee-d2ee-44c6-8fb1-337fa8c254bc"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:04.179588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] validate_networks() for [('d0119cee-d2ee-44c6-8fb1-337fa8c254bc', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:29:04.542567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:29:04.543090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:29:04.543733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:29:04.544241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:29:04.544989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:29:04.555519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:04.555923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:04.556350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:04.557068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:04.557517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:04.557953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:04.575555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Getting quotas for project 2aae79e92fe04118abc223a15b0125c7. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:29:04.581023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Getting quotas for user 6164bf5a872d4a61affdfdc17ade47b0 and project 2aae79e92fe04118abc223a15b0125c7. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:29:04.593640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:29:04.596017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:29:04.643370 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2bcf18b-6cd7-4901-b866-678db77cd52b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528561 Oct 29 03:29:04.644136 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3270/6501] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:29:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:29:04.655375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4609367e-ca01-46e3-af19-21b51a0ce3f6 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:04.655985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4609367e-ca01-46e3-af19-21b51a0ce3f6 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:04.710743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4609367e-ca01-46e3-af19-21b51a0ce3f6 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:04.718052 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4609367e-ca01-46e3-af19-21b51a0ce3f6 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1218 microversion: 2.1 time: 0.066729 Oct 29 03:29:04.718611 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3232/6502] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:04 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:05.741678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-182b18ac-9cc5-4f63-86aa-8d59da96c794 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:05.742847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-182b18ac-9cc5-4f63-86aa-8d59da96c794 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:05.750089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-182b18ac-9cc5-4f63-86aa-8d59da96c794 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:05.750656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-182b18ac-9cc5-4f63-86aa-8d59da96c794 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:05.751370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-182b18ac-9cc5-4f63-86aa-8d59da96c794 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:05.752150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-182b18ac-9cc5-4f63-86aa-8d59da96c794 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:05.752692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-182b18ac-9cc5-4f63-86aa-8d59da96c794 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:05.753177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-182b18ac-9cc5-4f63-86aa-8d59da96c794 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:05.820492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-182b18ac-9cc5-4f63-86aa-8d59da96c794 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:05.830419 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-182b18ac-9cc5-4f63-86aa-8d59da96c794 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1278 microversion: 2.1 time: 0.093532 Oct 29 03:29:05.831140 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3271/6503] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:05 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:06.854140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-acccd4f1-3a20-48a8-800c-2f1662ccdbb4 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:06.854746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-acccd4f1-3a20-48a8-800c-2f1662ccdbb4 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:06.863538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acccd4f1-3a20-48a8-800c-2f1662ccdbb4 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:06.864022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acccd4f1-3a20-48a8-800c-2f1662ccdbb4 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:06.864447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acccd4f1-3a20-48a8-800c-2f1662ccdbb4 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:06.865145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acccd4f1-3a20-48a8-800c-2f1662ccdbb4 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:06.865593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acccd4f1-3a20-48a8-800c-2f1662ccdbb4 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:06.866029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acccd4f1-3a20-48a8-800c-2f1662ccdbb4 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:07.075846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-acccd4f1-3a20-48a8-800c-2f1662ccdbb4 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:07.084128 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-acccd4f1-3a20-48a8-800c-2f1662ccdbb4 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1318 microversion: 2.1 time: 0.233982 Oct 29 03:29:07.084814 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3233/6504] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:06 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:07.620599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-beecdc8d-1418-4192-922c-e3b10bc4587d req-48e89109-bab9-438e-abff-f51c201be772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4493d14e-9576-4e96-833f-c378de6fb252", "tag": "14adb051-715d-4755-ade1-332312c0d91b"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:07.633670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-beecdc8d-1418-4192-922c-e3b10bc4587d req-48e89109-bab9-438e-abff-f51c201be772 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:07.634256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-beecdc8d-1418-4192-922c-e3b10bc4587d req-48e89109-bab9-438e-abff-f51c201be772 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:07.634772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-beecdc8d-1418-4192-922c-e3b10bc4587d req-48e89109-bab9-438e-abff-f51c201be772 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:07.649466 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-beecdc8d-1418-4192-922c-e3b10bc4587d req-48e89109-bab9-438e-abff-f51c201be772 service nova] Creating event network-changed:14adb051-715d-4755-ade1-332312c0d91b for instance 4493d14e-9576-4e96-833f-c378de6fb252 on n-h1-862964-4 Oct 29 03:29:07.660738 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-beecdc8d-1418-4192-922c-e3b10bc4587d req-48e89109-bab9-438e-abff-f51c201be772 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044233 Oct 29 03:29:07.661569 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3272/6505] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:29:08.108211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9666234a-03d3-4f0e-ba37-73d4262a3218 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:08.108859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9666234a-03d3-4f0e-ba37-73d4262a3218 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:08.115785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9666234a-03d3-4f0e-ba37-73d4262a3218 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:08.116273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9666234a-03d3-4f0e-ba37-73d4262a3218 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:08.116704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9666234a-03d3-4f0e-ba37-73d4262a3218 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:08.117720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9666234a-03d3-4f0e-ba37-73d4262a3218 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:08.118206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9666234a-03d3-4f0e-ba37-73d4262a3218 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:08.118659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9666234a-03d3-4f0e-ba37-73d4262a3218 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:08.259045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9666234a-03d3-4f0e-ba37-73d4262a3218 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:08.267220 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9666234a-03d3-4f0e-ba37-73d4262a3218 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1318 microversion: 2.1 time: 0.163187 Oct 29 03:29:08.267791 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3234/6506] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:08 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:29:09.291061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d9440ce-250b-440d-90fe-940560c7d8ce tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:09.291755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7d9440ce-250b-440d-90fe-940560c7d8ce tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:09.298746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d9440ce-250b-440d-90fe-940560c7d8ce tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:09.299214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d9440ce-250b-440d-90fe-940560c7d8ce tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:09.299694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d9440ce-250b-440d-90fe-940560c7d8ce tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:09.300373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d9440ce-250b-440d-90fe-940560c7d8ce tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:09.300813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d9440ce-250b-440d-90fe-940560c7d8ce tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:09.301228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d9440ce-250b-440d-90fe-940560c7d8ce tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:09.316687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:09.440218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7d9440ce-250b-440d-90fe-940560c7d8ce tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:09.452374 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7d9440ce-250b-440d-90fe-940560c7d8ce tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1318 microversion: 2.1 time: 0.166203 Oct 29 03:29:09.453133 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3273/6507] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:09 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:10.475947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8e69eff2-4cd6-4e31-b5be-935b23a49e5b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:10.476547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8e69eff2-4cd6-4e31-b5be-935b23a49e5b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:10.483864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e69eff2-4cd6-4e31-b5be-935b23a49e5b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:10.484354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e69eff2-4cd6-4e31-b5be-935b23a49e5b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:10.484788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e69eff2-4cd6-4e31-b5be-935b23a49e5b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:10.485481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e69eff2-4cd6-4e31-b5be-935b23a49e5b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:10.485934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e69eff2-4cd6-4e31-b5be-935b23a49e5b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:10.486386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e69eff2-4cd6-4e31-b5be-935b23a49e5b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:10.489109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:10.632310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e69eff2-4cd6-4e31-b5be-935b23a49e5b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:10.640627 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8e69eff2-4cd6-4e31-b5be-935b23a49e5b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1318 microversion: 2.1 time: 0.168681 Oct 29 03:29:10.641202 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3235/6508] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:10 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:11.667477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0e4464e9-87d7-45bc-b3da-2a921f43ba2a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:11.668464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0e4464e9-87d7-45bc-b3da-2a921f43ba2a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:11.680267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e4464e9-87d7-45bc-b3da-2a921f43ba2a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:11.681049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e4464e9-87d7-45bc-b3da-2a921f43ba2a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:11.681791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e4464e9-87d7-45bc-b3da-2a921f43ba2a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:11.682977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e4464e9-87d7-45bc-b3da-2a921f43ba2a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:11.683726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e4464e9-87d7-45bc-b3da-2a921f43ba2a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:11.684423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e4464e9-87d7-45bc-b3da-2a921f43ba2a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:11.818928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0e4464e9-87d7-45bc-b3da-2a921f43ba2a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:11.826998 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0e4464e9-87d7-45bc-b3da-2a921f43ba2a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1318 microversion: 2.1 time: 0.166050 Oct 29 03:29:11.827574 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3274/6509] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:11 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:12.854610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5bbd53d9-720a-4762-8263-2f10e03fd87b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:12.855174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5bbd53d9-720a-4762-8263-2f10e03fd87b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:12.862547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbd53d9-720a-4762-8263-2f10e03fd87b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:12.863028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbd53d9-720a-4762-8263-2f10e03fd87b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:12.863459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbd53d9-720a-4762-8263-2f10e03fd87b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:12.864458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbd53d9-720a-4762-8263-2f10e03fd87b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:12.864914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbd53d9-720a-4762-8263-2f10e03fd87b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:12.865359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbd53d9-720a-4762-8263-2f10e03fd87b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:13.005645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5bbd53d9-720a-4762-8263-2f10e03fd87b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:13.014008 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5bbd53d9-720a-4762-8263-2f10e03fd87b tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1318 microversion: 2.1 time: 0.163329 Oct 29 03:29:13.025982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3236/6510] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:12 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:14.038226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4d6505f4-4280-48a1-aa60-bede128a18a9 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:14.038956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4d6505f4-4280-48a1-aa60-bede128a18a9 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:14.047297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d6505f4-4280-48a1-aa60-bede128a18a9 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:14.047863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d6505f4-4280-48a1-aa60-bede128a18a9 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:14.048368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d6505f4-4280-48a1-aa60-bede128a18a9 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:14.049183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d6505f4-4280-48a1-aa60-bede128a18a9 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:14.049711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d6505f4-4280-48a1-aa60-bede128a18a9 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:14.050232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4d6505f4-4280-48a1-aa60-bede128a18a9 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:14.188603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4d6505f4-4280-48a1-aa60-bede128a18a9 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:14.196830 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4d6505f4-4280-48a1-aa60-bede128a18a9 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1318 microversion: 2.1 time: 0.163287 Oct 29 03:29:14.197419 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3275/6511] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:14 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:14.602803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9f1ac918-ff2b-4180-bba5-24a5ecb35c82 req-30bbc52e-bab9-4014-a7f1-1d9c668f58d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4493d14e-9576-4e96-833f-c378de6fb252", "name": "network-vif-plugged", "status": "completed", "tag": "14adb051-715d-4755-ade1-332312c0d91b"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:14.614088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9f1ac918-ff2b-4180-bba5-24a5ecb35c82 req-30bbc52e-bab9-4014-a7f1-1d9c668f58d9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:14.614479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9f1ac918-ff2b-4180-bba5-24a5ecb35c82 req-30bbc52e-bab9-4014-a7f1-1d9c668f58d9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:14.614900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9f1ac918-ff2b-4180-bba5-24a5ecb35c82 req-30bbc52e-bab9-4014-a7f1-1d9c668f58d9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:14.627147 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9f1ac918-ff2b-4180-bba5-24a5ecb35c82 req-30bbc52e-bab9-4014-a7f1-1d9c668f58d9 service nova] Creating event network-vif-plugged:14adb051-715d-4755-ade1-332312c0d91b for instance 4493d14e-9576-4e96-833f-c378de6fb252 on n-h1-862964-4 Oct 29 03:29:14.632285 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9f1ac918-ff2b-4180-bba5-24a5ecb35c82 req-30bbc52e-bab9-4014-a7f1-1d9c668f58d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Oct 29 03:29:14.633251 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3237/6512] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:29:15.222548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7ada3864-e756-459f-b3e3-1693dfa4be2d tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:15.223290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7ada3864-e756-459f-b3e3-1693dfa4be2d tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:15.225555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:15.226397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:15.234935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ada3864-e756-459f-b3e3-1693dfa4be2d tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:15.235561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ada3864-e756-459f-b3e3-1693dfa4be2d tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:15.236091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ada3864-e756-459f-b3e3-1693dfa4be2d tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:15.236934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ada3864-e756-459f-b3e3-1693dfa4be2d tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:15.237525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ada3864-e756-459f-b3e3-1693dfa4be2d tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:15.238088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7ada3864-e756-459f-b3e3-1693dfa4be2d tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:15.376400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7ada3864-e756-459f-b3e3-1693dfa4be2d tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:15.388684 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7ada3864-e756-459f-b3e3-1693dfa4be2d tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1318 microversion: 2.1 time: 0.170601 Oct 29 03:29:15.389346 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3276/6513] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:15 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:16.411621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:16.420419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b9af451-abd7-4719-8227-45aaabcdf698 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:16.421129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4b9af451-abd7-4719-8227-45aaabcdf698 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:16.427880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9af451-abd7-4719-8227-45aaabcdf698 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:16.428359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9af451-abd7-4719-8227-45aaabcdf698 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:16.428789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9af451-abd7-4719-8227-45aaabcdf698 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:16.429474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9af451-abd7-4719-8227-45aaabcdf698 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:16.429962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9af451-abd7-4719-8227-45aaabcdf698 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:16.430382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b9af451-abd7-4719-8227-45aaabcdf698 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:16.581734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b9af451-abd7-4719-8227-45aaabcdf698 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:16.594162 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4b9af451-abd7-4719-8227-45aaabcdf698 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1507 microversion: 2.1 time: 0.184175 Oct 29 03:29:16.594982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3238/6514] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:16 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:16.617897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-35063ea4-07e5-44fd-9d01-4b29d030da2c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "267173af-c7be-4540-81e5-7f7ca0363ad4", "device": "/dev/sdb"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:16.620361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-35063ea4-07e5-44fd-9d01-4b29d030da2c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:16.627141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35063ea4-07e5-44fd-9d01-4b29d030da2c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:16.627622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35063ea4-07e5-44fd-9d01-4b29d030da2c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:16.628046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35063ea4-07e5-44fd-9d01-4b29d030da2c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:16.628768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35063ea4-07e5-44fd-9d01-4b29d030da2c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:16.629238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35063ea4-07e5-44fd-9d01-4b29d030da2c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:16.629579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35063ea4-07e5-44fd-9d01-4b29d030da2c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:16.888620 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-35063ea4-07e5-44fd-9d01-4b29d030da2c tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "POST /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275065 Oct 29 03:29:16.889247 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3277/6515] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:29:16 2022] POST /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:29:18.322826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ee2284d1-9990-472d-97dd-7ff9ad03370a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:18.325047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ee2284d1-9990-472d-97dd-7ff9ad03370a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:18.332243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee2284d1-9990-472d-97dd-7ff9ad03370a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:18.332734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee2284d1-9990-472d-97dd-7ff9ad03370a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:18.333169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee2284d1-9990-472d-97dd-7ff9ad03370a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:18.333898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee2284d1-9990-472d-97dd-7ff9ad03370a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:18.334353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee2284d1-9990-472d-97dd-7ff9ad03370a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:18.334773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ee2284d1-9990-472d-97dd-7ff9ad03370a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:18.409109 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ee2284d1-9990-472d-97dd-7ff9ad03370a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd/action" status: 200 len: 24549 microversion: 2.1 time: 0.090307 Oct 29 03:29:18.409794 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3239/6516] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:29:18 2022] POST /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd/action => generated 24549 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:29:29.391456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:29.392702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:29.397911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b69f37dc-b6f3-41d7-b2a9-fe2c3642e77e tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:29.398835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b69f37dc-b6f3-41d7-b2a9-fe2c3642e77e tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:29.408721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b69f37dc-b6f3-41d7-b2a9-fe2c3642e77e tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:29.409349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b69f37dc-b6f3-41d7-b2a9-fe2c3642e77e tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:29.409964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b69f37dc-b6f3-41d7-b2a9-fe2c3642e77e tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:29.410859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b69f37dc-b6f3-41d7-b2a9-fe2c3642e77e tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:29.411452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b69f37dc-b6f3-41d7-b2a9-fe2c3642e77e tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:29.412000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b69f37dc-b6f3-41d7-b2a9-fe2c3642e77e tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:29.553108 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b69f37dc-b6f3-41d7-b2a9-fe2c3642e77e tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1832 microversion: 2.1 time: 0.164444 Oct 29 03:29:29.553746 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3278/6517] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:29 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1832 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:29.577069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ba8868a3-49c9-490f-a6b0-3a3237f22ff7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:29.577774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ba8868a3-49c9-490f-a6b0-3a3237f22ff7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:29.580540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=29 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:29.581169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=23 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:29.587426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba8868a3-49c9-490f-a6b0-3a3237f22ff7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:29.587913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba8868a3-49c9-490f-a6b0-3a3237f22ff7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:29.588347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba8868a3-49c9-490f-a6b0-3a3237f22ff7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:29.589044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba8868a3-49c9-490f-a6b0-3a3237f22ff7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:29.589496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba8868a3-49c9-490f-a6b0-3a3237f22ff7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:29.589950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba8868a3-49c9-490f-a6b0-3a3237f22ff7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:29.741397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ba8868a3-49c9-490f-a6b0-3a3237f22ff7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:29.749996 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ba8868a3-49c9-490f-a6b0-3a3237f22ff7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1681 microversion: 2.1 time: 0.177195 Oct 29 03:29:29.750510 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3240/6518] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:29 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:29.858862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e4dc421f-b08d-467c-8738-95791848ab63 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:29.861108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e4dc421f-b08d-467c-8738-95791848ab63 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:29.867957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4dc421f-b08d-467c-8738-95791848ab63 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:29.868460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4dc421f-b08d-467c-8738-95791848ab63 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:29.868876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4dc421f-b08d-467c-8738-95791848ab63 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:29.869622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4dc421f-b08d-467c-8738-95791848ab63 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:29.870108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4dc421f-b08d-467c-8738-95791848ab63 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:29.870516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4dc421f-b08d-467c-8738-95791848ab63 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:29.922657 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e4dc421f-b08d-467c-8738-95791848ab63 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd/action" status: 200 len: 32612 microversion: 2.1 time: 0.067679 Oct 29 03:29:29.930020 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3279/6519] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:29:29 2022] POST /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd/action => generated 32612 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:29:30.100218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:30.100818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:30.107888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:30.108375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:30.108828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:30.109527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:30.110000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:30.110452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:30.206411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '242fc17348054226a14c87a3080b0e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732e7d1faa543c8abe82f355fcdf7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:30.207024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] flavor_id is None. Assuming migration. {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 03:29:30.207457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:29:30.382503 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6890a7de-20ef-44d7-9dc0-8312ea8e7cb2 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd/action" status: 202 len: 0 microversion: 2.1 time: 0.286176 Oct 29 03:29:30.385998 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3241/6520] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:29:30 2022] POST /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:29:30.392563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49349d00-c982-4e03-8ae6-b769c1ba50ea tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:30.393255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49349d00-c982-4e03-8ae6-b769c1ba50ea tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:30.401302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49349d00-c982-4e03-8ae6-b769c1ba50ea tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:30.402038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49349d00-c982-4e03-8ae6-b769c1ba50ea tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:30.402638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49349d00-c982-4e03-8ae6-b769c1ba50ea tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:30.403457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49349d00-c982-4e03-8ae6-b769c1ba50ea tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:30.404180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49349d00-c982-4e03-8ae6-b769c1ba50ea tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:30.404661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49349d00-c982-4e03-8ae6-b769c1ba50ea tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:30.586700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-49349d00-c982-4e03-8ae6-b769c1ba50ea tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:30.596500 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-49349d00-c982-4e03-8ae6-b769c1ba50ea tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1690 microversion: 2.1 time: 0.208658 Oct 29 03:29:30.597087 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3280/6521] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:30 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:31.627134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8055bd7f-415e-42f6-981f-a685146b9457 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:31.628129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8055bd7f-415e-42f6-981f-a685146b9457 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:31.639584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8055bd7f-415e-42f6-981f-a685146b9457 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:31.640074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8055bd7f-415e-42f6-981f-a685146b9457 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:31.640509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8055bd7f-415e-42f6-981f-a685146b9457 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:31.641210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8055bd7f-415e-42f6-981f-a685146b9457 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:31.641643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8055bd7f-415e-42f6-981f-a685146b9457 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:31.642108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8055bd7f-415e-42f6-981f-a685146b9457 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:31.780591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8055bd7f-415e-42f6-981f-a685146b9457 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:31.789995 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8055bd7f-415e-42f6-981f-a685146b9457 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1690 microversion: 2.1 time: 0.171295 Oct 29 03:29:31.790790 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3242/6522] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:31 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:32.814541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5722a097-100b-4c34-802e-b65054f4f30b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:32.815614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5722a097-100b-4c34-802e-b65054f4f30b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:32.822706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5722a097-100b-4c34-802e-b65054f4f30b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:32.823272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5722a097-100b-4c34-802e-b65054f4f30b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:32.823804 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5722a097-100b-4c34-802e-b65054f4f30b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:32.824666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5722a097-100b-4c34-802e-b65054f4f30b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:32.825524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5722a097-100b-4c34-802e-b65054f4f30b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:32.826217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5722a097-100b-4c34-802e-b65054f4f30b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:32.968088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5722a097-100b-4c34-802e-b65054f4f30b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:32.976178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5722a097-100b-4c34-802e-b65054f4f30b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.165600 Oct 29 03:29:32.976753 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3281/6523] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:32 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:34.001564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d50e2de9-df8e-48e4-9600-fe7fc71c0ba2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:34.002221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d50e2de9-df8e-48e4-9600-fe7fc71c0ba2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:34.009502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d50e2de9-df8e-48e4-9600-fe7fc71c0ba2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:34.010016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d50e2de9-df8e-48e4-9600-fe7fc71c0ba2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:34.010449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d50e2de9-df8e-48e4-9600-fe7fc71c0ba2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:34.011144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d50e2de9-df8e-48e4-9600-fe7fc71c0ba2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:34.011595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d50e2de9-df8e-48e4-9600-fe7fc71c0ba2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:34.012013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d50e2de9-df8e-48e4-9600-fe7fc71c0ba2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:34.148159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d50e2de9-df8e-48e4-9600-fe7fc71c0ba2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:34.156367 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d50e2de9-df8e-48e4-9600-fe7fc71c0ba2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.158720 Oct 29 03:29:34.156949 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3243/6524] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:33 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:35.189658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45d59e9e-8ebe-4430-a1e7-8edf5deef5de tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:35.190308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-45d59e9e-8ebe-4430-a1e7-8edf5deef5de tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:35.197585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45d59e9e-8ebe-4430-a1e7-8edf5deef5de tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:35.198101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45d59e9e-8ebe-4430-a1e7-8edf5deef5de tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:35.198533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45d59e9e-8ebe-4430-a1e7-8edf5deef5de tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:35.199232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45d59e9e-8ebe-4430-a1e7-8edf5deef5de tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:35.199684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45d59e9e-8ebe-4430-a1e7-8edf5deef5de tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:35.200235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45d59e9e-8ebe-4430-a1e7-8edf5deef5de tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:35.337673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-45d59e9e-8ebe-4430-a1e7-8edf5deef5de tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:35.346152 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-45d59e9e-8ebe-4430-a1e7-8edf5deef5de tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.160526 Oct 29 03:29:35.346731 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3282/6525] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:35 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:36.372107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e8c6e7fc-3e17-42df-a142-1ab744cdcd61 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:36.373149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e8c6e7fc-3e17-42df-a142-1ab744cdcd61 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:36.379944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8c6e7fc-3e17-42df-a142-1ab744cdcd61 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:36.380439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8c6e7fc-3e17-42df-a142-1ab744cdcd61 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:36.380870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8c6e7fc-3e17-42df-a142-1ab744cdcd61 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:36.381601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8c6e7fc-3e17-42df-a142-1ab744cdcd61 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:36.382087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8c6e7fc-3e17-42df-a142-1ab744cdcd61 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:36.382508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8c6e7fc-3e17-42df-a142-1ab744cdcd61 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:36.531682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e8c6e7fc-3e17-42df-a142-1ab744cdcd61 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:36.539757 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e8c6e7fc-3e17-42df-a142-1ab744cdcd61 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.172917 Oct 29 03:29:36.540312 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3244/6526] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:36 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:37.565046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-537fc5da-2e96-4a58-bedf-3cf21a267db2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:37.566356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-537fc5da-2e96-4a58-bedf-3cf21a267db2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:37.573514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-537fc5da-2e96-4a58-bedf-3cf21a267db2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:37.574081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-537fc5da-2e96-4a58-bedf-3cf21a267db2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:37.574511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-537fc5da-2e96-4a58-bedf-3cf21a267db2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:37.575363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-537fc5da-2e96-4a58-bedf-3cf21a267db2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:37.575922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-537fc5da-2e96-4a58-bedf-3cf21a267db2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:37.576340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-537fc5da-2e96-4a58-bedf-3cf21a267db2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:37.738647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-537fc5da-2e96-4a58-bedf-3cf21a267db2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:37.748817 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-537fc5da-2e96-4a58-bedf-3cf21a267db2 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.189017 Oct 29 03:29:37.749402 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3283/6527] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:37 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:38.521346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-837cbccf-37d5-44c0-9ff4-a39b06b3ecff tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:38.522219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-837cbccf-37d5-44c0-9ff4-a39b06b3ecff tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:38.531428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-837cbccf-37d5-44c0-9ff4-a39b06b3ecff tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:38.531932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-837cbccf-37d5-44c0-9ff4-a39b06b3ecff tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:38.532357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-837cbccf-37d5-44c0-9ff4-a39b06b3ecff tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:38.533036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-837cbccf-37d5-44c0-9ff4-a39b06b3ecff tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:38.533478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-837cbccf-37d5-44c0-9ff4-a39b06b3ecff tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:38.533928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-837cbccf-37d5-44c0-9ff4-a39b06b3ecff tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:38.620340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-837cbccf-37d5-44c0-9ff4-a39b06b3ecff tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lazy-loading 'services' on Instance uuid 4493d14e-9576-4e96-833f-c378de6fb252 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:29:38.694942 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-837cbccf-37d5-44c0-9ff4-a39b06b3ecff tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252/os-volume_attachments/267173af-c7be-4540-81e5-7f7ca0363ad4" status: 202 len: 0 microversion: 2.1 time: 0.180358 Oct 29 03:29:38.695551 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3245/6528] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:29:38 2022] DELETE /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252/os-volume_attachments/267173af-c7be-4540-81e5-7f7ca0363ad4 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:29:38.772763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dd5b9974-bacb-450a-889a-b9f3418f2963 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:38.773364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd5b9974-bacb-450a-889a-b9f3418f2963 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:38.780653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd5b9974-bacb-450a-889a-b9f3418f2963 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:38.781172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd5b9974-bacb-450a-889a-b9f3418f2963 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:38.781601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd5b9974-bacb-450a-889a-b9f3418f2963 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:38.782320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd5b9974-bacb-450a-889a-b9f3418f2963 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:38.782807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd5b9974-bacb-450a-889a-b9f3418f2963 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:38.783292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd5b9974-bacb-450a-889a-b9f3418f2963 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:38.927909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd5b9974-bacb-450a-889a-b9f3418f2963 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:38.940985 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dd5b9974-bacb-450a-889a-b9f3418f2963 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.172014 Oct 29 03:29:38.941848 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3284/6529] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:38 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:39.966614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b5dc577-5e07-4534-b496-a1e4f8dac820 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:39.967334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4b5dc577-5e07-4534-b496-a1e4f8dac820 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:39.974228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b5dc577-5e07-4534-b496-a1e4f8dac820 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:39.974717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b5dc577-5e07-4534-b496-a1e4f8dac820 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:39.975271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b5dc577-5e07-4534-b496-a1e4f8dac820 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:39.975880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b5dc577-5e07-4534-b496-a1e4f8dac820 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:39.976326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b5dc577-5e07-4534-b496-a1e4f8dac820 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:39.976910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b5dc577-5e07-4534-b496-a1e4f8dac820 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:40.113768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b5dc577-5e07-4534-b496-a1e4f8dac820 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:40.122428 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4b5dc577-5e07-4534-b496-a1e4f8dac820 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.161518 Oct 29 03:29:40.122977 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3246/6530] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:39 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:41.146724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-15253764-6b43-4490-a08a-c05a239c74c7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:41.147620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-15253764-6b43-4490-a08a-c05a239c74c7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:41.155463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-15253764-6b43-4490-a08a-c05a239c74c7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:41.156108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-15253764-6b43-4490-a08a-c05a239c74c7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:41.156659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-15253764-6b43-4490-a08a-c05a239c74c7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:41.157585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-15253764-6b43-4490-a08a-c05a239c74c7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:41.158166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-15253764-6b43-4490-a08a-c05a239c74c7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:41.158676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-15253764-6b43-4490-a08a-c05a239c74c7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:41.312520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-15253764-6b43-4490-a08a-c05a239c74c7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:41.320797 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-15253764-6b43-4490-a08a-c05a239c74c7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.178240 Oct 29 03:29:41.321381 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3285/6531] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:41 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:42.344415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1f8e9dd5-959f-4462-a284-8df7915e0181 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:42.345070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1f8e9dd5-959f-4462-a284-8df7915e0181 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:42.352484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f8e9dd5-959f-4462-a284-8df7915e0181 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:42.352996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f8e9dd5-959f-4462-a284-8df7915e0181 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:42.353426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f8e9dd5-959f-4462-a284-8df7915e0181 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:42.354166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f8e9dd5-959f-4462-a284-8df7915e0181 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:42.354608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f8e9dd5-959f-4462-a284-8df7915e0181 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:42.355022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f8e9dd5-959f-4462-a284-8df7915e0181 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:42.502953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1f8e9dd5-959f-4462-a284-8df7915e0181 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:42.511166 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1f8e9dd5-959f-4462-a284-8df7915e0181 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.171027 Oct 29 03:29:42.511832 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3247/6532] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:42 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:43.539225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-96a1df73-45f7-4335-b915-ebe710ebfb9a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:43.540132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-96a1df73-45f7-4335-b915-ebe710ebfb9a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:43.548855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96a1df73-45f7-4335-b915-ebe710ebfb9a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:43.549369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96a1df73-45f7-4335-b915-ebe710ebfb9a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:43.549822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96a1df73-45f7-4335-b915-ebe710ebfb9a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:43.550532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96a1df73-45f7-4335-b915-ebe710ebfb9a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:43.550968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96a1df73-45f7-4335-b915-ebe710ebfb9a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:43.551389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96a1df73-45f7-4335-b915-ebe710ebfb9a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:43.685298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-96a1df73-45f7-4335-b915-ebe710ebfb9a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:43.693716 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-96a1df73-45f7-4335-b915-ebe710ebfb9a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.161181 Oct 29 03:29:43.694308 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3286/6533] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:43 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:44.076786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b4ca5dbf-344a-4dc4-b211-cd8035675f2f tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:44.077344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b4ca5dbf-344a-4dc4-b211-cd8035675f2f tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:44.087842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4ca5dbf-344a-4dc4-b211-cd8035675f2f tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:44.088530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4ca5dbf-344a-4dc4-b211-cd8035675f2f tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:44.089138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4ca5dbf-344a-4dc4-b211-cd8035675f2f tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:44.090153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4ca5dbf-344a-4dc4-b211-cd8035675f2f tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:44.090826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4ca5dbf-344a-4dc4-b211-cd8035675f2f tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:44.091243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b4ca5dbf-344a-4dc4-b211-cd8035675f2f tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:44.116682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b4ca5dbf-344a-4dc4-b211-cd8035675f2f tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:29:44.208356 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b4ca5dbf-344a-4dc4-b211-cd8035675f2f tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 204 len: 0 microversion: 2.1 time: 0.138179 Oct 29 03:29:44.209145 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3248/6534] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:29:44 2022] DELETE /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:29:44.217881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7cb17789-df78-4a51-8c13-68a859a297ad tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:44.218483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7cb17789-df78-4a51-8c13-68a859a297ad tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:44.224639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cb17789-df78-4a51-8c13-68a859a297ad tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:44.225117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cb17789-df78-4a51-8c13-68a859a297ad tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:44.225541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cb17789-df78-4a51-8c13-68a859a297ad tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:44.226249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cb17789-df78-4a51-8c13-68a859a297ad tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:44.226691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cb17789-df78-4a51-8c13-68a859a297ad tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:44.227103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cb17789-df78-4a51-8c13-68a859a297ad tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:44.356728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7cb17789-df78-4a51-8c13-68a859a297ad tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:44.364676 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7cb17789-df78-4a51-8c13-68a859a297ad tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1513 microversion: 2.1 time: 0.150989 Oct 29 03:29:44.365244 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3287/6535] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:44 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:44.721479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50b50a03-2778-4c32-b98d-e8ca761a7b91 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:44.722414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-50b50a03-2778-4c32-b98d-e8ca761a7b91 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:44.730364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b50a03-2778-4c32-b98d-e8ca761a7b91 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:44.731018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b50a03-2778-4c32-b98d-e8ca761a7b91 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:44.731917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b50a03-2778-4c32-b98d-e8ca761a7b91 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:44.732794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b50a03-2778-4c32-b98d-e8ca761a7b91 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:44.733360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b50a03-2778-4c32-b98d-e8ca761a7b91 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:44.733941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50b50a03-2778-4c32-b98d-e8ca761a7b91 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:44.882173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-50b50a03-2778-4c32-b98d-e8ca761a7b91 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:44.890279 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50b50a03-2778-4c32-b98d-e8ca761a7b91 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.174742 Oct 29 03:29:44.890857 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3249/6536] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:44 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:45.400554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2d7f4712-860f-4642-8623-b4c572b906bf tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:45.401623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2d7f4712-860f-4642-8623-b4c572b906bf tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:45.409573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f4712-860f-4642-8623-b4c572b906bf tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:45.410089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f4712-860f-4642-8623-b4c572b906bf tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:45.410528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f4712-860f-4642-8623-b4c572b906bf tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:45.411217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f4712-860f-4642-8623-b4c572b906bf tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:45.411703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f4712-860f-4642-8623-b4c572b906bf tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:45.412119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d7f4712-860f-4642-8623-b4c572b906bf tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:45.548544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d7f4712-860f-4642-8623-b4c572b906bf tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:45.556767 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2d7f4712-860f-4642-8623-b4c572b906bf tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1513 microversion: 2.1 time: 0.162767 Oct 29 03:29:45.557333 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3288/6537] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:45 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:45.914157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f911edb1-91eb-46a8-9507-3643536106f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:45.914732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f911edb1-91eb-46a8-9507-3643536106f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:45.922088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f911edb1-91eb-46a8-9507-3643536106f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:45.922576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f911edb1-91eb-46a8-9507-3643536106f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:45.923029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f911edb1-91eb-46a8-9507-3643536106f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:45.923856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f911edb1-91eb-46a8-9507-3643536106f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:45.924155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f911edb1-91eb-46a8-9507-3643536106f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:45.924573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f911edb1-91eb-46a8-9507-3643536106f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:46.156299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f911edb1-91eb-46a8-9507-3643536106f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:46.164540 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f911edb1-91eb-46a8-9507-3643536106f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.254431 Oct 29 03:29:46.165129 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3250/6538] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:45 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:46.439569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-c67c95b4-5791-4b78-b748-c58c3fa71fcb req-8bdce1de-b1bd-4e8a-9c6e-ba700a51e1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4493d14e-9576-4e96-833f-c378de6fb252", "name": "network-vif-deleted", "tag": "14adb051-715d-4755-ade1-332312c0d91b"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:46.450822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c67c95b4-5791-4b78-b748-c58c3fa71fcb req-8bdce1de-b1bd-4e8a-9c6e-ba700a51e1c3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:46.451298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c67c95b4-5791-4b78-b748-c58c3fa71fcb req-8bdce1de-b1bd-4e8a-9c6e-ba700a51e1c3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:46.451724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c67c95b4-5791-4b78-b748-c58c3fa71fcb req-8bdce1de-b1bd-4e8a-9c6e-ba700a51e1c3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:46.463280 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c67c95b4-5791-4b78-b748-c58c3fa71fcb req-8bdce1de-b1bd-4e8a-9c6e-ba700a51e1c3 service nova] Creating event network-vif-deleted:14adb051-715d-4755-ade1-332312c0d91b for instance 4493d14e-9576-4e96-833f-c378de6fb252 on n-h1-862964-4 Oct 29 03:29:46.468984 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-c67c95b4-5791-4b78-b748-c58c3fa71fcb req-8bdce1de-b1bd-4e8a-9c6e-ba700a51e1c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033219 Oct 29 03:29:46.469793 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3289/6539] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:29:46.580884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:46.582190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:46.589584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:46.590111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:46.590840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:46.591543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:46.591992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:46.592407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:46.628253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:46.628731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:46.629171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:46.629598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lazy-loading 'fault' on Instance uuid 4493d14e-9576-4e96-833f-c378de6fb252 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:29:46.672130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6164bf5a872d4a61affdfdc17ade47b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aae79e92fe04118abc223a15b0125c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:46.683325 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-53b68554-7f8d-4168-a452-e91f8b5b1267 tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 200 len: 1308 microversion: 2.1 time: 0.107123 Oct 29 03:29:46.693846 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3251/6540] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:46 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:47.193003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-df318c51-2487-4c5e-a8f2-e1eeff223f44 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:47.194049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-df318c51-2487-4c5e-a8f2-e1eeff223f44 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:47.202686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df318c51-2487-4c5e-a8f2-e1eeff223f44 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:47.203173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df318c51-2487-4c5e-a8f2-e1eeff223f44 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:47.203620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df318c51-2487-4c5e-a8f2-e1eeff223f44 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:47.204312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df318c51-2487-4c5e-a8f2-e1eeff223f44 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:47.204769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df318c51-2487-4c5e-a8f2-e1eeff223f44 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:47.205195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-df318c51-2487-4c5e-a8f2-e1eeff223f44 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:47.342829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-df318c51-2487-4c5e-a8f2-e1eeff223f44 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:47.351301 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-df318c51-2487-4c5e-a8f2-e1eeff223f44 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.165356 Oct 29 03:29:47.351880 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3290/6541] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:47 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:47.711196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:47.712138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] [instance: 4493d14e-9576-4e96-833f-c378de6fb252] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:47.720581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:47.721065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:47.721496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:47.722305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:47.722753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:47.723172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:47.727347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:47.738376 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] HTTP exception thrown: Instance 4493d14e-9576-4e96-833f-c378de6fb252 could not be found. Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Request method failure captured: Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 HTTP/1.1 Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ2I8XEycdhnQRwwx2RauraDMSCpVlKbCYrfDJFcvfsgGMxV3hvL4Fpj54HMwpr4SXc-4oziflaAdPMGxjb65qOpQ8cKOEzQdwgkbD4eDo6MYBJUvPXgxg2TFOfckk7gs2N_WTHlCurRuaGRaQsYWfwR40I-S_ITNETjIihDjc1bN_U Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2aae79e92fe04118abc223a15b0125c7 Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-VolumesSnapshotTestJSON-846137126 Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2aae79e92fe04118abc223a15b0125c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2aae79e92fe04118abc223a15b0125c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2aae79e92fe04118abc223a15b0125c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2aae79e92fe04118abc223a15b0125c7"}]}] Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-VolumesSnapshotTestJSON-846137126 Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2aae79e92fe04118abc223a15b0125c7 Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-846137126 Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-VolumesSnapshotTestJSON-846137126-project Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 6164bf5a872d4a61affdfdc17ade47b0 Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-VolumesSnapshotTestJSON-846137126-project Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 4493d14e-9576-4e96-833f-c378de6fb252 could not be found. Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '4493d14e-9576-4e96-833f-c378de6fb252'} Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4493d14e-9576-4e96-833f-c378de6fb252 could not be found. Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4493d14e-9576-4e96-833f-c378de6fb252 could not be found. Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:29:47.740155 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:29:47.745962 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:47.745962 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:29:47.745962 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:29:47.745962 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:29:47.745962 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:29:47.745962 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4493d14e-9576-4e96-833f-c378de6fb252 could not be found. Oct 29 03:29:47.745962 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:29:47.745962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] Returning 404 to user: Instance 4493d14e-9576-4e96-833f-c378de6fb252 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:29:47.745962 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fa065ab1-c0d4-442f-a502-2673131b002a tempest-VolumesSnapshotTestJSON-846137126 tempest-VolumesSnapshotTestJSON-846137126-project] 10.222.0.16 "GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252" status: 404 len: 111 microversion: 2.1 time: 0.037490 Oct 29 03:29:47.745962 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3252/6542] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:47 2022] GET /compute/v2.1/servers/4493d14e-9576-4e96-833f-c378de6fb252 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:29:48.376999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4cc54366-d4bb-42ce-ba24-8ff5394f1d51 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:48.377637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4cc54366-d4bb-42ce-ba24-8ff5394f1d51 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:48.384909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc54366-d4bb-42ce-ba24-8ff5394f1d51 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:48.385395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc54366-d4bb-42ce-ba24-8ff5394f1d51 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:48.385835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc54366-d4bb-42ce-ba24-8ff5394f1d51 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:48.386539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc54366-d4bb-42ce-ba24-8ff5394f1d51 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:48.387000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc54366-d4bb-42ce-ba24-8ff5394f1d51 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:48.387519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cc54366-d4bb-42ce-ba24-8ff5394f1d51 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:48.527301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cc54366-d4bb-42ce-ba24-8ff5394f1d51 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:48.535433 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4cc54366-d4bb-42ce-ba24-8ff5394f1d51 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.162510 Oct 29 03:29:48.536011 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3291/6543] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:48 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:49.559295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dec57ace-ae7a-4021-a81a-452a71a239f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:49.560350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dec57ace-ae7a-4021-a81a-452a71a239f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:49.568315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dec57ace-ae7a-4021-a81a-452a71a239f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:49.568796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dec57ace-ae7a-4021-a81a-452a71a239f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:49.569228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dec57ace-ae7a-4021-a81a-452a71a239f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:49.569964 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dec57ace-ae7a-4021-a81a-452a71a239f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:49.570396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dec57ace-ae7a-4021-a81a-452a71a239f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:49.570818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dec57ace-ae7a-4021-a81a-452a71a239f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:49.721717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dec57ace-ae7a-4021-a81a-452a71a239f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:49.730042 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dec57ace-ae7a-4021-a81a-452a71a239f3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.174830 Oct 29 03:29:49.730674 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3253/6544] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:49 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:50.753727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9a95da8a-e538-4bf9-bc38-20f0ff88498e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:50.754294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a95da8a-e538-4bf9-bc38-20f0ff88498e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:50.761788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a95da8a-e538-4bf9-bc38-20f0ff88498e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:50.762499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a95da8a-e538-4bf9-bc38-20f0ff88498e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:50.763011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a95da8a-e538-4bf9-bc38-20f0ff88498e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:50.763701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a95da8a-e538-4bf9-bc38-20f0ff88498e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:50.764163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a95da8a-e538-4bf9-bc38-20f0ff88498e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:50.764594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a95da8a-e538-4bf9-bc38-20f0ff88498e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:50.900173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9a95da8a-e538-4bf9-bc38-20f0ff88498e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:50.908651 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9a95da8a-e538-4bf9-bc38-20f0ff88498e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.158975 Oct 29 03:29:50.909238 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3292/6545] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:50 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:51.932766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9cb198ef-bda9-4c47-af0b-3dde0f6e9159 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:51.933405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9cb198ef-bda9-4c47-af0b-3dde0f6e9159 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:51.940905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb198ef-bda9-4c47-af0b-3dde0f6e9159 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:51.941386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb198ef-bda9-4c47-af0b-3dde0f6e9159 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:51.941918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb198ef-bda9-4c47-af0b-3dde0f6e9159 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:51.942614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb198ef-bda9-4c47-af0b-3dde0f6e9159 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:51.943057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb198ef-bda9-4c47-af0b-3dde0f6e9159 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:51.943470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb198ef-bda9-4c47-af0b-3dde0f6e9159 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:52.080023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9cb198ef-bda9-4c47-af0b-3dde0f6e9159 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:52.088326 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9cb198ef-bda9-4c47-af0b-3dde0f6e9159 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.159624 Oct 29 03:29:52.088953 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3254/6546] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:51 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:53.112039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-74b6e9d7-e52e-4a65-ad1a-0986bed37160 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:53.112592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-74b6e9d7-e52e-4a65-ad1a-0986bed37160 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:53.120292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74b6e9d7-e52e-4a65-ad1a-0986bed37160 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:53.120776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74b6e9d7-e52e-4a65-ad1a-0986bed37160 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:53.121205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74b6e9d7-e52e-4a65-ad1a-0986bed37160 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:53.122248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74b6e9d7-e52e-4a65-ad1a-0986bed37160 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:53.122706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74b6e9d7-e52e-4a65-ad1a-0986bed37160 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:53.123126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74b6e9d7-e52e-4a65-ad1a-0986bed37160 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:53.259471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-74b6e9d7-e52e-4a65-ad1a-0986bed37160 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:53.268011 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-74b6e9d7-e52e-4a65-ad1a-0986bed37160 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.159974 Oct 29 03:29:53.268631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3293/6547] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:53 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:54.292059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8ebf9033-759d-4fa0-987b-e54c32c6a9a5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:54.292672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8ebf9033-759d-4fa0-987b-e54c32c6a9a5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:54.299219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebf9033-759d-4fa0-987b-e54c32c6a9a5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:54.299696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebf9033-759d-4fa0-987b-e54c32c6a9a5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:54.300125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebf9033-759d-4fa0-987b-e54c32c6a9a5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:54.300819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebf9033-759d-4fa0-987b-e54c32c6a9a5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:54.301262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebf9033-759d-4fa0-987b-e54c32c6a9a5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:54.301662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ebf9033-759d-4fa0-987b-e54c32c6a9a5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:54.439635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8ebf9033-759d-4fa0-987b-e54c32c6a9a5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:54.447847 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8ebf9033-759d-4fa0-987b-e54c32c6a9a5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1695 microversion: 2.1 time: 0.160131 Oct 29 03:29:54.448431 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3255/6548] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:54 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:55.471488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2a01101-2786-4166-866a-c67af1169d88 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:55.475579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b2a01101-2786-4166-866a-c67af1169d88 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:55.485074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-2786-4166-866a-c67af1169d88 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:55.486110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-2786-4166-866a-c67af1169d88 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:55.486778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-2786-4166-866a-c67af1169d88 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:55.488663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-2786-4166-866a-c67af1169d88 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:55.489282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-2786-4166-866a-c67af1169d88 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:55.489889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-2786-4166-866a-c67af1169d88 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:55.660594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2a01101-2786-4166-866a-c67af1169d88 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:55.668802 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b2a01101-2786-4166-866a-c67af1169d88 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1694 microversion: 2.1 time: 0.201426 Oct 29 03:29:55.682544 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3294/6549] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:55 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1694 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:55.691221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d4d85fc4-30f0-40d7-b690-66871a8658b9 req-e021ba97-c2c2-498a-8b69-a2d39c750fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd", "name": "network-vif-unplugged", "status": "completed", "tag": "608c9b52-0f19-4678-95e0-4c0f52aa04f0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:55.704441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d4d85fc4-30f0-40d7-b690-66871a8658b9 req-e021ba97-c2c2-498a-8b69-a2d39c750fc0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:55.704882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d4d85fc4-30f0-40d7-b690-66871a8658b9 req-e021ba97-c2c2-498a-8b69-a2d39c750fc0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:55.705307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d4d85fc4-30f0-40d7-b690-66871a8658b9 req-e021ba97-c2c2-498a-8b69-a2d39c750fc0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:55.720679 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d4d85fc4-30f0-40d7-b690-66871a8658b9 req-e021ba97-c2c2-498a-8b69-a2d39c750fc0 service nova] Creating event network-vif-unplugged:608c9b52-0f19-4678-95e0-4c0f52aa04f0 for instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd on n-h1-862964-4 Oct 29 03:29:55.727183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-d4d85fc4-30f0-40d7-b690-66871a8658b9 req-e021ba97-c2c2-498a-8b69-a2d39c750fc0 service nova] Instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:29:55.739242 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d4d85fc4-30f0-40d7-b690-66871a8658b9 req-e021ba97-c2c2-498a-8b69-a2d39c750fc0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051585 Oct 29 03:29:55.740861 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3256/6550] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:29:56.697016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-18e65d3b-98af-4157-9b7f-52c4bd81b3bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:56.698285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-18e65d3b-98af-4157-9b7f-52c4bd81b3bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:56.706480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e65d3b-98af-4157-9b7f-52c4bd81b3bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:56.707045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e65d3b-98af-4157-9b7f-52c4bd81b3bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:56.707732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e65d3b-98af-4157-9b7f-52c4bd81b3bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:56.708670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e65d3b-98af-4157-9b7f-52c4bd81b3bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:56.709336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e65d3b-98af-4157-9b7f-52c4bd81b3bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:56.710019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18e65d3b-98af-4157-9b7f-52c4bd81b3bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:56.733375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:56.879346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-18e65d3b-98af-4157-9b7f-52c4bd81b3bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:56.888493 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-18e65d3b-98af-4157-9b7f-52c4bd81b3bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1694 microversion: 2.1 time: 0.197812 Oct 29 03:29:56.889436 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3295/6551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:56 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:57.775436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6b9ad919-7e87-41b0-b77a-d4b87ec22846 req-0d2ea034-c663-4f8c-abc7-2f7451e48a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd", "tag": "608c9b52-0f19-4678-95e0-4c0f52aa04f0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:57.786665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6b9ad919-7e87-41b0-b77a-d4b87ec22846 req-0d2ea034-c663-4f8c-abc7-2f7451e48a80 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:57.787352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6b9ad919-7e87-41b0-b77a-d4b87ec22846 req-0d2ea034-c663-4f8c-abc7-2f7451e48a80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:57.787785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6b9ad919-7e87-41b0-b77a-d4b87ec22846 req-0d2ea034-c663-4f8c-abc7-2f7451e48a80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:57.799786 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6b9ad919-7e87-41b0-b77a-d4b87ec22846 req-0d2ea034-c663-4f8c-abc7-2f7451e48a80 service nova] Creating event network-changed:608c9b52-0f19-4678-95e0-4c0f52aa04f0 for instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd on n-h1-862964-4 Oct 29 03:29:57.805178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-6b9ad919-7e87-41b0-b77a-d4b87ec22846 req-0d2ea034-c663-4f8c-abc7-2f7451e48a80 service nova] Instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:29:57.816741 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6b9ad919-7e87-41b0-b77a-d4b87ec22846 req-0d2ea034-c663-4f8c-abc7-2f7451e48a80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045363 Oct 29 03:29:57.817288 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3257/6552] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:29:57.912927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-690a5ee4-5200-425f-ad76-3286415fa08e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:57.914370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-690a5ee4-5200-425f-ad76-3286415fa08e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:57.922048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-690a5ee4-5200-425f-ad76-3286415fa08e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:57.922521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-690a5ee4-5200-425f-ad76-3286415fa08e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:57.923240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-690a5ee4-5200-425f-ad76-3286415fa08e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:57.924275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-690a5ee4-5200-425f-ad76-3286415fa08e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:57.925599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-690a5ee4-5200-425f-ad76-3286415fa08e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:57.926293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-690a5ee4-5200-425f-ad76-3286415fa08e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:58.152759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-690a5ee4-5200-425f-ad76-3286415fa08e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:58.160850 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-690a5ee4-5200-425f-ad76-3286415fa08e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1692 microversion: 2.1 time: 0.251948 Oct 29 03:29:58.174266 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3296/6553] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:57 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1692 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:59.188888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fd53338e-788c-4ffc-8de6-e3e64d134b2f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:59.189954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fd53338e-788c-4ffc-8de6-e3e64d134b2f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:59.206583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd53338e-788c-4ffc-8de6-e3e64d134b2f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:59.207085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd53338e-788c-4ffc-8de6-e3e64d134b2f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:59.207527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd53338e-788c-4ffc-8de6-e3e64d134b2f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:59.208225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd53338e-788c-4ffc-8de6-e3e64d134b2f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:59.208681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd53338e-788c-4ffc-8de6-e3e64d134b2f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:59.209308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fd53338e-788c-4ffc-8de6-e3e64d134b2f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:59.358992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fd53338e-788c-4ffc-8de6-e3e64d134b2f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:59.367241 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fd53338e-788c-4ffc-8de6-e3e64d134b2f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1689 microversion: 2.1 time: 0.185572 Oct 29 03:29:59.367799 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3258/6554] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:59 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:59.390398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3c2ea87d-6124-485d-9d1d-8ae2a58e2a42 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:59.390988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3c2ea87d-6124-485d-9d1d-8ae2a58e2a42 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:59.398317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c2ea87d-6124-485d-9d1d-8ae2a58e2a42 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:59.399500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c2ea87d-6124-485d-9d1d-8ae2a58e2a42 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:59.399931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c2ea87d-6124-485d-9d1d-8ae2a58e2a42 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:59.400620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c2ea87d-6124-485d-9d1d-8ae2a58e2a42 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:59.401098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c2ea87d-6124-485d-9d1d-8ae2a58e2a42 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:59.401624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c2ea87d-6124-485d-9d1d-8ae2a58e2a42 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:59.434818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=41 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:59.516175 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3c2ea87d-6124-485d-9d1d-8ae2a58e2a42 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd/action" status: 202 len: 0 microversion: 2.1 time: 0.129890 Oct 29 03:29:59.517076 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3297/6555] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:29:59 2022] POST /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:29:59.525340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f6bc6b38-ada4-4b6a-aa3c-e8f11ccbb3b8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:59.525967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f6bc6b38-ada4-4b6a-aa3c-e8f11ccbb3b8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:59.532372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6bc6b38-ada4-4b6a-aa3c-e8f11ccbb3b8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:59.533221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6bc6b38-ada4-4b6a-aa3c-e8f11ccbb3b8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:59.533532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6bc6b38-ada4-4b6a-aa3c-e8f11ccbb3b8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:59.534474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6bc6b38-ada4-4b6a-aa3c-e8f11ccbb3b8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:59.534900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6bc6b38-ada4-4b6a-aa3c-e8f11ccbb3b8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:59.535326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6bc6b38-ada4-4b6a-aa3c-e8f11ccbb3b8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:59.742635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f6bc6b38-ada4-4b6a-aa3c-e8f11ccbb3b8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:59.750864 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f6bc6b38-ada4-4b6a-aa3c-e8f11ccbb3b8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1688 microversion: 2.1 time: 0.229482 Oct 29 03:29:59.751441 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3259/6556] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:59 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1688 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:00.774850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d82b8250-bece-4748-bc9d-24e8b9484270 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:00.776331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d82b8250-bece-4748-bc9d-24e8b9484270 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:00.783972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82b8250-bece-4748-bc9d-24e8b9484270 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:00.784798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82b8250-bece-4748-bc9d-24e8b9484270 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:00.785488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82b8250-bece-4748-bc9d-24e8b9484270 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:00.786452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82b8250-bece-4748-bc9d-24e8b9484270 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:00.787116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82b8250-bece-4748-bc9d-24e8b9484270 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:00.787753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82b8250-bece-4748-bc9d-24e8b9484270 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:00.946661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d82b8250-bece-4748-bc9d-24e8b9484270 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:00.957440 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d82b8250-bece-4748-bc9d-24e8b9484270 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1688 microversion: 2.1 time: 0.186689 Oct 29 03:30:00.958786 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3298/6557] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:00 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:01.983883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3c955207-87f7-4db6-975f-c38c8d0cf408 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:01.985474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3c955207-87f7-4db6-975f-c38c8d0cf408 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:01.989606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:01.994162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c955207-87f7-4db6-975f-c38c8d0cf408 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:01.994652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c955207-87f7-4db6-975f-c38c8d0cf408 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:01.995258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c955207-87f7-4db6-975f-c38c8d0cf408 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:01.996049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c955207-87f7-4db6-975f-c38c8d0cf408 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:01.996564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c955207-87f7-4db6-975f-c38c8d0cf408 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:01.997078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c955207-87f7-4db6-975f-c38c8d0cf408 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:02.654985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3c955207-87f7-4db6-975f-c38c8d0cf408 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:02.669431 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3c955207-87f7-4db6-975f-c38c8d0cf408 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1688 microversion: 2.1 time: 0.689600 Oct 29 03:30:02.671456 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3260/6558] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:01 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1688 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:03.698929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7522a9bf-5885-48b8-8679-680f4062358a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:03.699653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7522a9bf-5885-48b8-8679-680f4062358a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:03.706884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7522a9bf-5885-48b8-8679-680f4062358a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:03.707705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7522a9bf-5885-48b8-8679-680f4062358a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:03.708367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7522a9bf-5885-48b8-8679-680f4062358a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:03.709072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7522a9bf-5885-48b8-8679-680f4062358a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:03.709726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7522a9bf-5885-48b8-8679-680f4062358a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:03.710382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7522a9bf-5885-48b8-8679-680f4062358a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:03.928956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7522a9bf-5885-48b8-8679-680f4062358a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:03.937378 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7522a9bf-5885-48b8-8679-680f4062358a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1688 microversion: 2.1 time: 0.242293 Oct 29 03:30:03.938149 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3299/6559] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:03 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1688 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:04.094483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-66a244e9-242d-4b21-ae13-227e6117bed5 req-dacd3e28-192b-49ec-8d8a-e953f4d8df1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd", "tag": "608c9b52-0f19-4678-95e0-4c0f52aa04f0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:04.111238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-66a244e9-242d-4b21-ae13-227e6117bed5 req-dacd3e28-192b-49ec-8d8a-e953f4d8df1e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:04.111731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-66a244e9-242d-4b21-ae13-227e6117bed5 req-dacd3e28-192b-49ec-8d8a-e953f4d8df1e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:04.112147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-66a244e9-242d-4b21-ae13-227e6117bed5 req-dacd3e28-192b-49ec-8d8a-e953f4d8df1e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:04.125325 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-66a244e9-242d-4b21-ae13-227e6117bed5 req-dacd3e28-192b-49ec-8d8a-e953f4d8df1e service nova] Creating event network-changed:608c9b52-0f19-4678-95e0-4c0f52aa04f0 for instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd on n-h2-862964-4 Oct 29 03:30:04.131397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-66a244e9-242d-4b21-ae13-227e6117bed5 req-dacd3e28-192b-49ec-8d8a-e953f4d8df1e service nova] Instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:30:04.143199 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-66a244e9-242d-4b21-ae13-227e6117bed5 req-dacd3e28-192b-49ec-8d8a-e953f4d8df1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056308 Oct 29 03:30:04.143972 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3261/6560] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:04.965584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-423b5765-3586-4f1c-8cd0-705be298c19c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:04.966280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-423b5765-3586-4f1c-8cd0-705be298c19c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:04.973473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-423b5765-3586-4f1c-8cd0-705be298c19c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:04.973991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-423b5765-3586-4f1c-8cd0-705be298c19c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:04.974422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-423b5765-3586-4f1c-8cd0-705be298c19c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:04.975180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-423b5765-3586-4f1c-8cd0-705be298c19c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:04.975559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-423b5765-3586-4f1c-8cd0-705be298c19c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:04.975975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-423b5765-3586-4f1c-8cd0-705be298c19c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:05.118924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-423b5765-3586-4f1c-8cd0-705be298c19c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:05.126989 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-423b5765-3586-4f1c-8cd0-705be298c19c tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1688 microversion: 2.1 time: 0.167876 Oct 29 03:30:05.127543 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3300/6561] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:04 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:06.153138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ca88db61-8fd7-4007-8782-8b520e0de7d9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:06.153937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ca88db61-8fd7-4007-8782-8b520e0de7d9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:06.161080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca88db61-8fd7-4007-8782-8b520e0de7d9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:06.161908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca88db61-8fd7-4007-8782-8b520e0de7d9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:06.162342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca88db61-8fd7-4007-8782-8b520e0de7d9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:06.163059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca88db61-8fd7-4007-8782-8b520e0de7d9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:06.163515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca88db61-8fd7-4007-8782-8b520e0de7d9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:06.163936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca88db61-8fd7-4007-8782-8b520e0de7d9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:06.303823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ca88db61-8fd7-4007-8782-8b520e0de7d9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:06.311824 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ca88db61-8fd7-4007-8782-8b520e0de7d9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1688 microversion: 2.1 time: 0.164760 Oct 29 03:30:06.312369 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3262/6562] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:06 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:07.335484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-46ac9ac6-8f16-4767-a4ca-974ab4fb0cda tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:07.336288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-46ac9ac6-8f16-4767-a4ca-974ab4fb0cda tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:07.344717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ac9ac6-8f16-4767-a4ca-974ab4fb0cda tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:07.345202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ac9ac6-8f16-4767-a4ca-974ab4fb0cda tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:07.345613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ac9ac6-8f16-4767-a4ca-974ab4fb0cda tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:07.346363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ac9ac6-8f16-4767-a4ca-974ab4fb0cda tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:07.346811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ac9ac6-8f16-4767-a4ca-974ab4fb0cda tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:07.347225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-46ac9ac6-8f16-4767-a4ca-974ab4fb0cda tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:07.496920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-46ac9ac6-8f16-4767-a4ca-974ab4fb0cda tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:07.496920 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-46ac9ac6-8f16-4767-a4ca-974ab4fb0cda tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1681 microversion: 2.1 time: 0.163809 Oct 29 03:30:07.497692 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3301/6563] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:07 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:09.847817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-87cbbbd8-90de-46f8-af6a-205ef420180c req-9025d8df-6fb0-4fc6-a5cc-40497c331a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd", "name": "network-vif-plugged", "status": "completed", "tag": "608c9b52-0f19-4678-95e0-4c0f52aa04f0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:09.861150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-87cbbbd8-90de-46f8-af6a-205ef420180c req-9025d8df-6fb0-4fc6-a5cc-40497c331a5a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:09.863462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-87cbbbd8-90de-46f8-af6a-205ef420180c req-9025d8df-6fb0-4fc6-a5cc-40497c331a5a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:09.864158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-87cbbbd8-90de-46f8-af6a-205ef420180c req-9025d8df-6fb0-4fc6-a5cc-40497c331a5a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:09.877200 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-87cbbbd8-90de-46f8-af6a-205ef420180c req-9025d8df-6fb0-4fc6-a5cc-40497c331a5a service nova] Creating event network-vif-plugged:608c9b52-0f19-4678-95e0-4c0f52aa04f0 for instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd on n-h2-862964-4 Oct 29 03:30:09.883666 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-87cbbbd8-90de-46f8-af6a-205ef420180c req-9025d8df-6fb0-4fc6-a5cc-40497c331a5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040103 Oct 29 03:30:09.884992 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3263/6564] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:33.715691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b47a9042-8ec1-4aae-9c60-4168be0d2c98 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:33.717884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b47a9042-8ec1-4aae-9c60-4168be0d2c98 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:33.721280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=11 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:33.721952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:33.728316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b47a9042-8ec1-4aae-9c60-4168be0d2c98 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:33.728748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b47a9042-8ec1-4aae-9c60-4168be0d2c98 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:33.729169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b47a9042-8ec1-4aae-9c60-4168be0d2c98 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:33.729925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b47a9042-8ec1-4aae-9c60-4168be0d2c98 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:33.730391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b47a9042-8ec1-4aae-9c60-4168be0d2c98 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:33.731059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b47a9042-8ec1-4aae-9c60-4168be0d2c98 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:33.789054 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b47a9042-8ec1-4aae-9c60-4168be0d2c98 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd/action" status: 200 len: 63058 microversion: 2.1 time: 0.076997 Oct 29 03:30:33.789823 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3302/6565] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:30:33 2022] POST /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd/action => generated 63058 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:30:36.468894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:36.469712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=56 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:36.593111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-2129550044", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "d49cc42a-924f-4b6d-87bf-fc5b4aa25c9f"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:36.654454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] validate_networks() for [('d49cc42a-924f-4b6d-87bf-fc5b4aa25c9f', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:30:37.052752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:30:37.053170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:30:37.053645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:30:37.054074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:30:37.054479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:30:37.064182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.064659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.065087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.065838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.066308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.066762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.084055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Getting quotas for project 7cd88f6886a243b58bd47c4dee34dde6. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:30:37.089712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Getting quotas for user a1d987daa2f040aba031549b0071e4c7 and project 7cd88f6886a243b58bd47c4dee34dde6. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:30:37.103108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:30:37.105569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:30:37.152751 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c291f9ff-caef-4407-b56f-8e9d9f7729ad tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685902 Oct 29 03:30:37.153465 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3264/6566] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:30:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:30:37.165335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f9c0812-eca3-4ae4-a259-2fc19b4303d4 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:37.166080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f9c0812-eca3-4ae4-a259-2fc19b4303d4 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:37.222608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f9c0812-eca3-4ae4-a259-2fc19b4303d4 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:37.229617 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f9c0812-eca3-4ae4-a259-2fc19b4303d4 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1215 microversion: 2.1 time: 0.068485 Oct 29 03:30:37.230513 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3303/6567] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:37 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:38.252798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6cb85c75-c506-466d-9d41-7256bbe5f156 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:38.253409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6cb85c75-c506-466d-9d41-7256bbe5f156 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:38.260786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb85c75-c506-466d-9d41-7256bbe5f156 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:38.261430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb85c75-c506-466d-9d41-7256bbe5f156 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:38.261875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb85c75-c506-466d-9d41-7256bbe5f156 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:38.262580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb85c75-c506-466d-9d41-7256bbe5f156 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:38.263091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb85c75-c506-466d-9d41-7256bbe5f156 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:38.263446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6cb85c75-c506-466d-9d41-7256bbe5f156 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:38.360885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6cb85c75-c506-466d-9d41-7256bbe5f156 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:38.370371 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6cb85c75-c506-466d-9d41-7256bbe5f156 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1275 microversion: 2.1 time: 0.121358 Oct 29 03:30:38.371338 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3265/6568] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:38 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1275 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:39.394523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f30f419-750a-45d6-a9f1-77ee19ce4772 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:39.395104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0f30f419-750a-45d6-a9f1-77ee19ce4772 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:39.402247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f30f419-750a-45d6-a9f1-77ee19ce4772 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:39.402725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f30f419-750a-45d6-a9f1-77ee19ce4772 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:39.403148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f30f419-750a-45d6-a9f1-77ee19ce4772 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:39.403833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f30f419-750a-45d6-a9f1-77ee19ce4772 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:39.404277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f30f419-750a-45d6-a9f1-77ee19ce4772 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:39.404709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f30f419-750a-45d6-a9f1-77ee19ce4772 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:39.546363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f30f419-750a-45d6-a9f1-77ee19ce4772 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:39.558162 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f30f419-750a-45d6-a9f1-77ee19ce4772 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1315 microversion: 2.1 time: 0.164140 Oct 29 03:30:39.558162 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3304/6569] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:39 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:39.768949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-e17ef83c-7d9e-4053-838b-94cd74c7ce4a req-58bbc9c6-8885-4716-8b99-8e34a42d0ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5c163e-c275-4f15-abed-4b6cc89048e2", "tag": "abba2514-df67-45ba-b043-57a50a7a43d9"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:39.781044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e17ef83c-7d9e-4053-838b-94cd74c7ce4a req-58bbc9c6-8885-4716-8b99-8e34a42d0ea7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:39.781587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e17ef83c-7d9e-4053-838b-94cd74c7ce4a req-58bbc9c6-8885-4716-8b99-8e34a42d0ea7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:39.782077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e17ef83c-7d9e-4053-838b-94cd74c7ce4a req-58bbc9c6-8885-4716-8b99-8e34a42d0ea7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:39.797176 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-e17ef83c-7d9e-4053-838b-94cd74c7ce4a req-58bbc9c6-8885-4716-8b99-8e34a42d0ea7 service nova] Creating event network-changed:abba2514-df67-45ba-b043-57a50a7a43d9 for instance cb5c163e-c275-4f15-abed-4b6cc89048e2 on n-h1-862964-4 Oct 29 03:30:39.802191 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-e17ef83c-7d9e-4053-838b-94cd74c7ce4a req-58bbc9c6-8885-4716-8b99-8e34a42d0ea7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036963 Oct 29 03:30:39.803130 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3266/6570] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:39.971501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8a08ea0b-46e9-4187-8c7f-69cc2b589893 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:39.972128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8a08ea0b-46e9-4187-8c7f-69cc2b589893 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:39.979440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a08ea0b-46e9-4187-8c7f-69cc2b589893 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:39.979974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a08ea0b-46e9-4187-8c7f-69cc2b589893 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:39.980412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a08ea0b-46e9-4187-8c7f-69cc2b589893 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:39.981190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a08ea0b-46e9-4187-8c7f-69cc2b589893 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:39.981633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a08ea0b-46e9-4187-8c7f-69cc2b589893 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:39.982098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8a08ea0b-46e9-4187-8c7f-69cc2b589893 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:40.109941 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8a08ea0b-46e9-4187-8c7f-69cc2b589893 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1832 microversion: 2.1 time: 0.143340 Oct 29 03:30:40.110595 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3305/6571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:39 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1832 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:40.580113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-83264c77-4d6d-4d23-81fc-7b260cb7ad04 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:40.580998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-83264c77-4d6d-4d23-81fc-7b260cb7ad04 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:40.588283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83264c77-4d6d-4d23-81fc-7b260cb7ad04 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:40.588965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83264c77-4d6d-4d23-81fc-7b260cb7ad04 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:40.589544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83264c77-4d6d-4d23-81fc-7b260cb7ad04 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:40.590423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83264c77-4d6d-4d23-81fc-7b260cb7ad04 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:40.590998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83264c77-4d6d-4d23-81fc-7b260cb7ad04 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:40.591557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-83264c77-4d6d-4d23-81fc-7b260cb7ad04 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:40.736037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-83264c77-4d6d-4d23-81fc-7b260cb7ad04 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:40.743896 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-83264c77-4d6d-4d23-81fc-7b260cb7ad04 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1315 microversion: 2.1 time: 0.169148 Oct 29 03:30:40.744472 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3267/6572] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:40 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:40.999945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a5f03b18-58cc-4e52-9ec3-41c74c5862ac tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:41.000525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a5f03b18-58cc-4e52-9ec3-41c74c5862ac tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:41.006842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-7c2ce931-93c7-4a56-8b3a-29e5205cb0be req-b1864611-7de8-4376-9bda-93a5fd2370f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd", "tag": "608c9b52-0f19-4678-95e0-4c0f52aa04f0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:41.019254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5f03b18-58cc-4e52-9ec3-41c74c5862ac tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:41.019737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5f03b18-58cc-4e52-9ec3-41c74c5862ac tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:41.020142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5f03b18-58cc-4e52-9ec3-41c74c5862ac tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:41.020837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5f03b18-58cc-4e52-9ec3-41c74c5862ac tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:41.021279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5f03b18-58cc-4e52-9ec3-41c74c5862ac tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:41.021691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5f03b18-58cc-4e52-9ec3-41c74c5862ac tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:41.030336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7c2ce931-93c7-4a56-8b3a-29e5205cb0be req-b1864611-7de8-4376-9bda-93a5fd2370f5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:41.030813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7c2ce931-93c7-4a56-8b3a-29e5205cb0be req-b1864611-7de8-4376-9bda-93a5fd2370f5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:41.031238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7c2ce931-93c7-4a56-8b3a-29e5205cb0be req-b1864611-7de8-4376-9bda-93a5fd2370f5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:41.057878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a5f03b18-58cc-4e52-9ec3-41c74c5862ac tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:30:41.058395 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-7c2ce931-93c7-4a56-8b3a-29e5205cb0be req-b1864611-7de8-4376-9bda-93a5fd2370f5 service nova] Creating event network-changed:608c9b52-0f19-4678-95e0-4c0f52aa04f0 for instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd on n-h2-862964-4 Oct 29 03:30:41.071570 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-7c2ce931-93c7-4a56-8b3a-29e5205cb0be req-b1864611-7de8-4376-9bda-93a5fd2370f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068238 Oct 29 03:30:41.072526 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3268/6573] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:41.206107 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a5f03b18-58cc-4e52-9ec3-41c74c5862ac tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 204 len: 0 microversion: 2.1 time: 0.210001 Oct 29 03:30:41.206751 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3306/6574] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:30:40 2022] DELETE /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:30:41.215652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15093677-72f9-4999-b530-0e93c86ccf96 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:41.216359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-15093677-72f9-4999-b530-0e93c86ccf96 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:41.233824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15093677-72f9-4999-b530-0e93c86ccf96 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:41.234319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15093677-72f9-4999-b530-0e93c86ccf96 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:41.234770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15093677-72f9-4999-b530-0e93c86ccf96 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:41.235460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15093677-72f9-4999-b530-0e93c86ccf96 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:41.235906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15093677-72f9-4999-b530-0e93c86ccf96 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:41.236324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15093677-72f9-4999-b530-0e93c86ccf96 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:41.538293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-15093677-72f9-4999-b530-0e93c86ccf96 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:41.546651 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-15093677-72f9-4999-b530-0e93c86ccf96 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1687 microversion: 2.1 time: 0.335168 Oct 29 03:30:41.547546 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3269/6575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:41 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1687 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:41.767170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f1da4d9f-117a-4893-8849-9fcafdd1e0b7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:41.768191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f1da4d9f-117a-4893-8849-9fcafdd1e0b7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:41.774994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1da4d9f-117a-4893-8849-9fcafdd1e0b7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:41.775747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1da4d9f-117a-4893-8849-9fcafdd1e0b7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:41.776528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1da4d9f-117a-4893-8849-9fcafdd1e0b7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:41.777210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1da4d9f-117a-4893-8849-9fcafdd1e0b7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:41.777698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1da4d9f-117a-4893-8849-9fcafdd1e0b7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:41.778418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1da4d9f-117a-4893-8849-9fcafdd1e0b7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:41.923942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f1da4d9f-117a-4893-8849-9fcafdd1e0b7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:41.936779 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f1da4d9f-117a-4893-8849-9fcafdd1e0b7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1315 microversion: 2.1 time: 0.173883 Oct 29 03:30:41.937371 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3307/6576] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:41 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:42.571537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50c6922a-f9e0-479b-aa83-e068613e5e6d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:42.572178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-50c6922a-f9e0-479b-aa83-e068613e5e6d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:42.579584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50c6922a-f9e0-479b-aa83-e068613e5e6d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:42.580067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50c6922a-f9e0-479b-aa83-e068613e5e6d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:42.580499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50c6922a-f9e0-479b-aa83-e068613e5e6d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:42.581190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50c6922a-f9e0-479b-aa83-e068613e5e6d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:42.581638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50c6922a-f9e0-479b-aa83-e068613e5e6d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:42.582074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50c6922a-f9e0-479b-aa83-e068613e5e6d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:42.722892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-50c6922a-f9e0-479b-aa83-e068613e5e6d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:42.731232 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50c6922a-f9e0-479b-aa83-e068613e5e6d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 200 len: 1687 microversion: 2.1 time: 0.163628 Oct 29 03:30:42.731963 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3270/6577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:42 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:42.960296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6060bf60-7840-4c06-8c51-bc1a64eaaec8 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:42.961624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6060bf60-7840-4c06-8c51-bc1a64eaaec8 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:42.968852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060bf60-7840-4c06-8c51-bc1a64eaaec8 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:42.969253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060bf60-7840-4c06-8c51-bc1a64eaaec8 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:42.969682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060bf60-7840-4c06-8c51-bc1a64eaaec8 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:42.970405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060bf60-7840-4c06-8c51-bc1a64eaaec8 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:42.971408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060bf60-7840-4c06-8c51-bc1a64eaaec8 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:42.971831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6060bf60-7840-4c06-8c51-bc1a64eaaec8 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:43.187328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6060bf60-7840-4c06-8c51-bc1a64eaaec8 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:43.195369 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6060bf60-7840-4c06-8c51-bc1a64eaaec8 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1315 microversion: 2.1 time: 0.239037 Oct 29 03:30:43.195954 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3308/6578] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:42 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:43.400279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-86dbb829-2596-4ba0-a44b-5edd143baa9c req-72530478-67ba-4aeb-b1f9-01efca7927d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd", "name": "network-vif-deleted", "tag": "608c9b52-0f19-4678-95e0-4c0f52aa04f0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:43.410659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-86dbb829-2596-4ba0-a44b-5edd143baa9c req-72530478-67ba-4aeb-b1f9-01efca7927d7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:43.411182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-86dbb829-2596-4ba0-a44b-5edd143baa9c req-72530478-67ba-4aeb-b1f9-01efca7927d7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:43.411600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-86dbb829-2596-4ba0-a44b-5edd143baa9c req-72530478-67ba-4aeb-b1f9-01efca7927d7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:43.423141 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-86dbb829-2596-4ba0-a44b-5edd143baa9c req-72530478-67ba-4aeb-b1f9-01efca7927d7 service nova] Creating event network-vif-deleted:608c9b52-0f19-4678-95e0-4c0f52aa04f0 for instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd on n-h2-862964-4 Oct 29 03:30:43.428408 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-86dbb829-2596-4ba0-a44b-5edd143baa9c req-72530478-67ba-4aeb-b1f9-01efca7927d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031715 Oct 29 03:30:43.429355 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3271/6579] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:30:43.755944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:43.756642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:43.763510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:43.763997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:43.764426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:43.765131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:43.765632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:43.766080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:43.781159 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] HTTP exception thrown: Instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd could not be found. Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Request method failure captured: Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd HTTP/1.1 Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ10LZQSVueycmVKmxTnPj3nUimr4sccneo7HLm8KXoelgnMvGdJN1ul4_Noy4qlMD9jBc7keg-hfhkO8RJdfVJEtLkxYJxm5hLDbYb4Zkhq0cAALSLv_Q2FcEk-lgwgLiCvqwRZD85031-7BUx5-jlERqTw0IWvFo1WnuKpY-yQSgQ Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 1d8e5b0759e64bc5a2118d6ab364bec3 Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d8e5b0759e64bc5a2118d6ab364bec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d8e5b0759e64bc5a2118d6ab364bec3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d8e5b0759e64bc5a2118d6ab364bec3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d8e5b0759e64bc5a2118d6ab364bec3"}]}] Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 1d8e5b0759e64bc5a2118d6ab364bec3 Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestNetworkAdvancedServerOps-841069215-project Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 6988b3809252496ca2f97a1f6eff5825 Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestNetworkAdvancedServerOps-841069215-project Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd could not be found. Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd'} Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd could not be found. Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd could not be found. Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:30:43.782864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:30:43.788682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:30:43.788682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:43.788682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:30:43.788682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:30:43.788682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:30:43.788682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:30:43.788682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd could not be found. Oct 29 03:30:43.788682 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:30:43.788682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Returning 404 to user: Instance 4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:30:43.788682 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-806dce8c-d4b5-43c7-a2b6-6848542d3790 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd" status: 404 len: 111 microversion: 2.1 time: 0.032292 Oct 29 03:30:43.788682 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3309/6580] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:43 2022] GET /compute/v2.1/servers/4a6c507d-9d4a-46b2-a473-a2cbc4fbbccd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:30:44.220429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0a7d1335-6ca6-4e7e-bdba-ebca271f830a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:44.221097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0a7d1335-6ca6-4e7e-bdba-ebca271f830a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:44.228374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a7d1335-6ca6-4e7e-bdba-ebca271f830a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:44.228848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a7d1335-6ca6-4e7e-bdba-ebca271f830a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:44.229608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a7d1335-6ca6-4e7e-bdba-ebca271f830a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:44.230409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a7d1335-6ca6-4e7e-bdba-ebca271f830a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:44.230868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a7d1335-6ca6-4e7e-bdba-ebca271f830a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:44.231287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0a7d1335-6ca6-4e7e-bdba-ebca271f830a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:44.367076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0a7d1335-6ca6-4e7e-bdba-ebca271f830a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:44.375127 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0a7d1335-6ca6-4e7e-bdba-ebca271f830a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1315 microversion: 2.1 time: 0.160369 Oct 29 03:30:44.375727 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3272/6581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:44 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:45.054400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-c3ce481f-9d91-407c-a447-10993d3e24f0 req-0e0bdaa8-2e90-43bc-92ab-4501efd46908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5c163e-c275-4f15-abed-4b6cc89048e2", "name": "network-vif-plugged", "status": "completed", "tag": "abba2514-df67-45ba-b043-57a50a7a43d9"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:45.066863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c3ce481f-9d91-407c-a447-10993d3e24f0 req-0e0bdaa8-2e90-43bc-92ab-4501efd46908 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:45.067685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c3ce481f-9d91-407c-a447-10993d3e24f0 req-0e0bdaa8-2e90-43bc-92ab-4501efd46908 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:45.068316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c3ce481f-9d91-407c-a447-10993d3e24f0 req-0e0bdaa8-2e90-43bc-92ab-4501efd46908 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:45.081048 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c3ce481f-9d91-407c-a447-10993d3e24f0 req-0e0bdaa8-2e90-43bc-92ab-4501efd46908 service nova] Creating event network-vif-plugged:abba2514-df67-45ba-b043-57a50a7a43d9 for instance cb5c163e-c275-4f15-abed-4b6cc89048e2 on n-h1-862964-4 Oct 29 03:30:45.086434 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-c3ce481f-9d91-407c-a447-10993d3e24f0 req-0e0bdaa8-2e90-43bc-92ab-4501efd46908 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036633 Oct 29 03:30:45.087642 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3310/6582] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:45.398769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e8570fdf-82ba-4c46-83aa-9c857a576adf tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:45.400284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e8570fdf-82ba-4c46-83aa-9c857a576adf tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:45.408378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8570fdf-82ba-4c46-83aa-9c857a576adf tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:45.409187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8570fdf-82ba-4c46-83aa-9c857a576adf tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:45.409972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8570fdf-82ba-4c46-83aa-9c857a576adf tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:45.410891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8570fdf-82ba-4c46-83aa-9c857a576adf tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:45.411517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8570fdf-82ba-4c46-83aa-9c857a576adf tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:45.412104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e8570fdf-82ba-4c46-83aa-9c857a576adf tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:45.590767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e8570fdf-82ba-4c46-83aa-9c857a576adf tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:45.599486 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e8570fdf-82ba-4c46-83aa-9c857a576adf tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1315 microversion: 2.1 time: 0.204749 Oct 29 03:30:45.600672 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3273/6583] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:45 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:46.624896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bc529fba-1fee-40cf-8391-ec979d6cd363 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:46.625738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bc529fba-1fee-40cf-8391-ec979d6cd363 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:46.633914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc529fba-1fee-40cf-8391-ec979d6cd363 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:46.634404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc529fba-1fee-40cf-8391-ec979d6cd363 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:46.634832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc529fba-1fee-40cf-8391-ec979d6cd363 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:46.635876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc529fba-1fee-40cf-8391-ec979d6cd363 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:46.636131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc529fba-1fee-40cf-8391-ec979d6cd363 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:46.636639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc529fba-1fee-40cf-8391-ec979d6cd363 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:46.846778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bc529fba-1fee-40cf-8391-ec979d6cd363 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:46.856390 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bc529fba-1fee-40cf-8391-ec979d6cd363 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1501 microversion: 2.1 time: 0.236660 Oct 29 03:30:46.857311 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3311/6584] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:46 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1501 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:46.882299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5bb4242-17f8-4165-9629-a829ea053a22 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:46.882917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5bb4242-17f8-4165-9629-a829ea053a22 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:46.890604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb4242-17f8-4165-9629-a829ea053a22 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:46.891364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb4242-17f8-4165-9629-a829ea053a22 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:46.891962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb4242-17f8-4165-9629-a829ea053a22 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:46.892841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb4242-17f8-4165-9629-a829ea053a22 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:46.893697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb4242-17f8-4165-9629-a829ea053a22 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:46.893997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5bb4242-17f8-4165-9629-a829ea053a22 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:47.073514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:47.097071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:47.382253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e5bb4242-17f8-4165-9629-a829ea053a22 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:47.390598 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e5bb4242-17f8-4165-9629-a829ea053a22 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1501 microversion: 2.1 time: 0.515638 Oct 29 03:30:47.391325 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3274/6585] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:46 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1501 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:47.413662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a35af22-ae16-400f-a83f-2c5dd0132ae5 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:47.414221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3a35af22-ae16-400f-a83f-2c5dd0132ae5 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:47.416270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:47.422080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a35af22-ae16-400f-a83f-2c5dd0132ae5 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:47.422588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a35af22-ae16-400f-a83f-2c5dd0132ae5 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:47.423012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a35af22-ae16-400f-a83f-2c5dd0132ae5 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:47.423679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a35af22-ae16-400f-a83f-2c5dd0132ae5 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:47.424138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a35af22-ae16-400f-a83f-2c5dd0132ae5 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:47.424537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a35af22-ae16-400f-a83f-2c5dd0132ae5 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:47.450174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-3a35af22-ae16-400f-a83f-2c5dd0132ae5 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lazy-loading 'flavor' on Instance uuid cb5c163e-c275-4f15-abed-4b6cc89048e2 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:30:47.535631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3a35af22-ae16-400f-a83f-2c5dd0132ae5 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "POST /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2/action" status: 202 len: 0 microversion: 2.1 time: 0.125661 Oct 29 03:30:47.536353 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3312/6586] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:30:47 2022] POST /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:30:47.549505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a75a46ca-ce5d-4cf0-a245-8df07fc315a7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:47.551188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a75a46ca-ce5d-4cf0-a245-8df07fc315a7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:47.564476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75a46ca-ce5d-4cf0-a245-8df07fc315a7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:47.566080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75a46ca-ce5d-4cf0-a245-8df07fc315a7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:47.566863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75a46ca-ce5d-4cf0-a245-8df07fc315a7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:47.568025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75a46ca-ce5d-4cf0-a245-8df07fc315a7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:47.568848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75a46ca-ce5d-4cf0-a245-8df07fc315a7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:47.569577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a75a46ca-ce5d-4cf0-a245-8df07fc315a7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:47.684447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a7cea4d-abfc-4eb7-8cbe-0dd85d63811b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '.version_select at 0x7fe1a3180940>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:47.706536 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3a7cea4d-abfc-4eb7-8cbe-0dd85d63811b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1671381355" status: 202 len: 0 microversion: 2.1 time: 0.027013 Oct 29 03:30:47.707101 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3313/6587] 10.222.0.16 () {58 vars in 1284 bytes} [Sat Oct 29 03:30:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1671381355 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:30:47.725783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a75a46ca-ce5d-4cf0-a245-8df07fc315a7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:47.736174 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a75a46ca-ce5d-4cf0-a245-8df07fc315a7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1509 microversion: 2.1 time: 0.194260 Oct 29 03:30:47.742543 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3275/6588] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:47 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:47.747367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-56457f1b-25bd-424f-86e5-4086f38dc266 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'create', calling method: .version_select at 0x7fe1a34f4040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1513299827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2w+crWZ1HDFJgDAGRRlZdp6oNcU8o0qgl+g6yJmQL99ihkdx6bntz2+uVKnWRD7pPvPngW/qMDRpsSeaAufwjZk639stpMSuKZ7d6jFCWi3y1i7Q8Gp2rA7OxX/nVo9w=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:47.763945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-56457f1b-25bd-424f-86e5-4086f38dc266 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:30:47.769294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-56457f1b-25bd-424f-86e5-4086f38dc266 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for user 6988b3809252496ca2f97a1f6eff5825 and project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:30:47.793744 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-56457f1b-25bd-424f-86e5-4086f38dc266 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050622 Oct 29 03:30:47.794360 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3314/6589] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:30:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:48.765353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7e3e0088-cb1d-463a-a5d6-0449ea82e67a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:48.766004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7e3e0088-cb1d-463a-a5d6-0449ea82e67a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:48.772273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e3e0088-cb1d-463a-a5d6-0449ea82e67a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:48.772731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e3e0088-cb1d-463a-a5d6-0449ea82e67a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:48.773347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e3e0088-cb1d-463a-a5d6-0449ea82e67a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:48.774361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e3e0088-cb1d-463a-a5d6-0449ea82e67a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:48.775002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e3e0088-cb1d-463a-a5d6-0449ea82e67a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:48.775409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7e3e0088-cb1d-463a-a5d6-0449ea82e67a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:49.023604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7e3e0088-cb1d-463a-a5d6-0449ea82e67a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:49.034801 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7e3e0088-cb1d-463a-a5d6-0449ea82e67a tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1492 microversion: 2.1 time: 0.274991 Oct 29 03:30:49.035613 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3276/6590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:48 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1492 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:49.059982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-39228e32-01ea-48b1-b4d9-a86178f08301 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:49.060657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-39228e32-01ea-48b1-b4d9-a86178f08301 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:49.069211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39228e32-01ea-48b1-b4d9-a86178f08301 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:49.070078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39228e32-01ea-48b1-b4d9-a86178f08301 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:49.070542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39228e32-01ea-48b1-b4d9-a86178f08301 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:49.071485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39228e32-01ea-48b1-b4d9-a86178f08301 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:49.071937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39228e32-01ea-48b1-b4d9-a86178f08301 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:49.072527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39228e32-01ea-48b1-b4d9-a86178f08301 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:49.147775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-39228e32-01ea-48b1-b4d9-a86178f08301 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "POST /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2/action" status: 202 len: 0 microversion: 2.1 time: 0.092990 Oct 29 03:30:49.148422 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3315/6591] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:30:49 2022] POST /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:30:49.157196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38f4e7ac-52b7-4c1a-bd25-6d8117604de7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:49.158185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-38f4e7ac-52b7-4c1a-bd25-6d8117604de7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:49.165109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38f4e7ac-52b7-4c1a-bd25-6d8117604de7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:49.165904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38f4e7ac-52b7-4c1a-bd25-6d8117604de7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:49.166631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38f4e7ac-52b7-4c1a-bd25-6d8117604de7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:49.167461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38f4e7ac-52b7-4c1a-bd25-6d8117604de7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:49.167916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38f4e7ac-52b7-4c1a-bd25-6d8117604de7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:49.168530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38f4e7ac-52b7-4c1a-bd25-6d8117604de7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:49.368502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-38f4e7ac-52b7-4c1a-bd25-6d8117604de7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:49.377003 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-38f4e7ac-52b7-4c1a-bd25-6d8117604de7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1498 microversion: 2.1 time: 0.223702 Oct 29 03:30:49.377699 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3277/6592] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:49 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1498 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:50.402476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8fa4788b-0593-40c1-8e00-8661f49b5834 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:50.403159 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8fa4788b-0593-40c1-8e00-8661f49b5834 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:50.410981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fa4788b-0593-40c1-8e00-8661f49b5834 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:50.411487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fa4788b-0593-40c1-8e00-8661f49b5834 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:50.411890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fa4788b-0593-40c1-8e00-8661f49b5834 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:50.412785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fa4788b-0593-40c1-8e00-8661f49b5834 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:50.413447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fa4788b-0593-40c1-8e00-8661f49b5834 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:50.413864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fa4788b-0593-40c1-8e00-8661f49b5834 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:50.576170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8fa4788b-0593-40c1-8e00-8661f49b5834 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:50.587939 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8fa4788b-0593-40c1-8e00-8661f49b5834 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1498 microversion: 2.1 time: 0.190871 Oct 29 03:30:50.588644 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3316/6593] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:50 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1498 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:51.612202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9d01819-1028-4cae-a9ab-c2cf3459dcff tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:51.613440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f9d01819-1028-4cae-a9ab-c2cf3459dcff tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:51.621054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d01819-1028-4cae-a9ab-c2cf3459dcff tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:51.621959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d01819-1028-4cae-a9ab-c2cf3459dcff tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:51.622306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d01819-1028-4cae-a9ab-c2cf3459dcff tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:51.623001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d01819-1028-4cae-a9ab-c2cf3459dcff tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:51.623450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d01819-1028-4cae-a9ab-c2cf3459dcff tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:51.623850 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9d01819-1028-4cae-a9ab-c2cf3459dcff tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:51.871635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f9d01819-1028-4cae-a9ab-c2cf3459dcff tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:51.885469 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f9d01819-1028-4cae-a9ab-c2cf3459dcff tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1501 microversion: 2.1 time: 0.277417 Oct 29 03:30:51.886477 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3278/6594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:51 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1501 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:51.908598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e5310bc5-1b16-41a4-a1ac-323622332111 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:51.909205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e5310bc5-1b16-41a4-a1ac-323622332111 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:51.916226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5310bc5-1b16-41a4-a1ac-323622332111 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:51.916801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5310bc5-1b16-41a4-a1ac-323622332111 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:51.917370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5310bc5-1b16-41a4-a1ac-323622332111 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:51.918098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5310bc5-1b16-41a4-a1ac-323622332111 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:51.918548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5310bc5-1b16-41a4-a1ac-323622332111 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:51.918967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5310bc5-1b16-41a4-a1ac-323622332111 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:51.943109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-e5310bc5-1b16-41a4-a1ac-323622332111 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lazy-loading 'flavor' on Instance uuid cb5c163e-c275-4f15-abed-4b6cc89048e2 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:30:51.994397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:52.021620 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e5310bc5-1b16-41a4-a1ac-323622332111 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "POST /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2/action" status: 202 len: 0 microversion: 2.1 time: 0.116837 Oct 29 03:30:52.025131 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3317/6595] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:30:51 2022] POST /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:30:52.032219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-de704e43-304c-476c-830d-e1b3515805ed tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:52.032830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-de704e43-304c-476c-830d-e1b3515805ed tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:52.044959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de704e43-304c-476c-830d-e1b3515805ed tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:52.050572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de704e43-304c-476c-830d-e1b3515805ed tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:52.052206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de704e43-304c-476c-830d-e1b3515805ed tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:52.053576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de704e43-304c-476c-830d-e1b3515805ed tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:52.054294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de704e43-304c-476c-830d-e1b3515805ed tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:52.055379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de704e43-304c-476c-830d-e1b3515805ed tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:52.249667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de704e43-304c-476c-830d-e1b3515805ed tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:52.260619 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-de704e43-304c-476c-830d-e1b3515805ed tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1509 microversion: 2.1 time: 0.232343 Oct 29 03:30:52.261339 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3279/6596] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:52 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:53.290012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a6eed838-c776-425f-9410-2e5903636c38 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:53.291368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a6eed838-c776-425f-9410-2e5903636c38 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:53.298213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6eed838-c776-425f-9410-2e5903636c38 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:53.299094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6eed838-c776-425f-9410-2e5903636c38 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:53.299784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6eed838-c776-425f-9410-2e5903636c38 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:53.300724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6eed838-c776-425f-9410-2e5903636c38 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:53.301392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6eed838-c776-425f-9410-2e5903636c38 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:53.305429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6eed838-c776-425f-9410-2e5903636c38 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:53.484308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6eed838-c776-425f-9410-2e5903636c38 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:53.492710 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a6eed838-c776-425f-9410-2e5903636c38 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1492 microversion: 2.1 time: 0.207816 Oct 29 03:30:53.493450 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3318/6597] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:53 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1492 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:53.516410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6883d21d-20a0-44f4-a277-6e33e155f77e tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:53.517006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6883d21d-20a0-44f4-a277-6e33e155f77e tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:53.523233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6883d21d-20a0-44f4-a277-6e33e155f77e tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:53.523724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6883d21d-20a0-44f4-a277-6e33e155f77e tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:53.524151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6883d21d-20a0-44f4-a277-6e33e155f77e tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:53.525077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6883d21d-20a0-44f4-a277-6e33e155f77e tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:53.525528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6883d21d-20a0-44f4-a277-6e33e155f77e tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:53.526046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6883d21d-20a0-44f4-a277-6e33e155f77e tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:53.622250 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6883d21d-20a0-44f4-a277-6e33e155f77e tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "POST /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2/action" status: 202 len: 0 microversion: 2.1 time: 0.109870 Oct 29 03:30:53.623347 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3280/6598] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:30:53 2022] POST /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:30:53.632582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5b5d6e74-e827-48d3-b622-800e429a493d tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:53.633517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5b5d6e74-e827-48d3-b622-800e429a493d tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:53.647274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5d6e74-e827-48d3-b622-800e429a493d tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:53.648674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5d6e74-e827-48d3-b622-800e429a493d tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:53.649776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5d6e74-e827-48d3-b622-800e429a493d tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:53.652211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5d6e74-e827-48d3-b622-800e429a493d tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:53.652976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5d6e74-e827-48d3-b622-800e429a493d tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:53.653664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b5d6e74-e827-48d3-b622-800e429a493d tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:53.867382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1434325091", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "e1955405-b374-46ca-a4e1-47946b31fb64"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1513299827", "security_groups": [{"name": "tempest-secgroup-smoke-1953854643"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:53.921363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5b5d6e74-e827-48d3-b622-800e429a493d tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:53.932395 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5b5d6e74-e827-48d3-b622-800e429a493d tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1498 microversion: 2.1 time: 0.303498 Oct 29 03:30:53.941102 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3319/6599] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:53 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1498 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:54.090617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] validate_networks() for [('e1955405-b374-46ca-a4e1-47946b31fb64', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:30:54.698834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:30:54.699419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:30:54.699893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:30:54.700307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:30:54.700715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:30:54.710340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:54.710824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:54.711290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:54.712249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:54.712704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:54.713124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:54.731073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:30:54.737542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for user 6988b3809252496ca2f97a1f6eff5825 and project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:30:54.753972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:30:54.756470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:30:54.813468 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dbd93556-b7ea-46ca-80b2-2727741f5f2d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.944702 Oct 29 03:30:54.813468 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3281/6600] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:30:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:30:54.819151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-744996d9-bcb6-4fea-8ed6-be930c04678b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:54.819770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-744996d9-bcb6-4fea-8ed6-be930c04678b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:54.894848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-744996d9-bcb6-4fea-8ed6-be930c04678b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:54.907806 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-744996d9-bcb6-4fea-8ed6-be930c04678b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1267 microversion: 2.1 time: 0.091029 Oct 29 03:30:54.921825 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3320/6601] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:54 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:54.963651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d587cbdc-a22a-4ea8-898c-02d7e4e7a8c7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:54.964307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d587cbdc-a22a-4ea8-898c-02d7e4e7a8c7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:54.971071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-a22a-4ea8-898c-02d7e4e7a8c7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:54.971567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-a22a-4ea8-898c-02d7e4e7a8c7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:54.972006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-a22a-4ea8-898c-02d7e4e7a8c7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:54.972715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-a22a-4ea8-898c-02d7e4e7a8c7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:54.973165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-a22a-4ea8-898c-02d7e4e7a8c7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:54.973580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-a22a-4ea8-898c-02d7e4e7a8c7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:55.139208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d587cbdc-a22a-4ea8-898c-02d7e4e7a8c7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:55.148421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:55.162402 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d587cbdc-a22a-4ea8-898c-02d7e4e7a8c7 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1498 microversion: 2.1 time: 0.202699 Oct 29 03:30:55.163391 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3282/6602] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:54 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1498 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:55.934121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d5a07690-13ab-4798-989f-4968d49f83e8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:55.935401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d5a07690-13ab-4798-989f-4968d49f83e8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:55.943821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a07690-13ab-4798-989f-4968d49f83e8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:55.944317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a07690-13ab-4798-989f-4968d49f83e8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:55.944750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a07690-13ab-4798-989f-4968d49f83e8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:55.945675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a07690-13ab-4798-989f-4968d49f83e8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:55.946324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a07690-13ab-4798-989f-4968d49f83e8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:55.946750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5a07690-13ab-4798-989f-4968d49f83e8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:56.019734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d5a07690-13ab-4798-989f-4968d49f83e8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:56.028673 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d5a07690-13ab-4798-989f-4968d49f83e8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1319 microversion: 2.1 time: 0.099506 Oct 29 03:30:56.029273 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3321/6603] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:55 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1319 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:56.187911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4bacc9f3-1d3d-4035-9751-b48827d84f68 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:56.188613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4bacc9f3-1d3d-4035-9751-b48827d84f68 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:56.197195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bacc9f3-1d3d-4035-9751-b48827d84f68 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:56.198011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bacc9f3-1d3d-4035-9751-b48827d84f68 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:56.198525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bacc9f3-1d3d-4035-9751-b48827d84f68 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:56.199472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bacc9f3-1d3d-4035-9751-b48827d84f68 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:56.200022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bacc9f3-1d3d-4035-9751-b48827d84f68 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:56.200521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bacc9f3-1d3d-4035-9751-b48827d84f68 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:56.344327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4bacc9f3-1d3d-4035-9751-b48827d84f68 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:56.353370 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4bacc9f3-1d3d-4035-9751-b48827d84f68 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1501 microversion: 2.1 time: 0.169776 Oct 29 03:30:56.354723 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3283/6604] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:56 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:56.377392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-42b6985f-3e6c-4c08-91be-34387f668128 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:56.378040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-42b6985f-3e6c-4c08-91be-34387f668128 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:56.384255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42b6985f-3e6c-4c08-91be-34387f668128 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:56.384818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42b6985f-3e6c-4c08-91be-34387f668128 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:56.385560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42b6985f-3e6c-4c08-91be-34387f668128 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:56.386387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42b6985f-3e6c-4c08-91be-34387f668128 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:56.387027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42b6985f-3e6c-4c08-91be-34387f668128 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:56.387685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42b6985f-3e6c-4c08-91be-34387f668128 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:56.420587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-42b6985f-3e6c-4c08-91be-34387f668128 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:30:56.505768 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-42b6985f-3e6c-4c08-91be-34387f668128 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 204 len: 0 microversion: 2.1 time: 0.132652 Oct 29 03:30:56.506560 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3322/6605] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:30:56 2022] DELETE /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:30:56.516037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59ce5aa3-55b0-4175-8174-f14deff64ffe tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:56.516741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59ce5aa3-55b0-4175-8174-f14deff64ffe tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:56.524052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59ce5aa3-55b0-4175-8174-f14deff64ffe tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:56.524993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59ce5aa3-55b0-4175-8174-f14deff64ffe tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:56.525435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59ce5aa3-55b0-4175-8174-f14deff64ffe tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:56.526244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59ce5aa3-55b0-4175-8174-f14deff64ffe tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:56.526706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59ce5aa3-55b0-4175-8174-f14deff64ffe tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:56.527130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59ce5aa3-55b0-4175-8174-f14deff64ffe tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:56.680146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59ce5aa3-55b0-4175-8174-f14deff64ffe tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:56.688132 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59ce5aa3-55b0-4175-8174-f14deff64ffe tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1507 microversion: 2.1 time: 0.176853 Oct 29 03:30:56.688815 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3284/6606] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:56 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:57.055709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-36116232-1a5d-40cf-b42d-8a59f8a2d539 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:57.057072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-36116232-1a5d-40cf-b42d-8a59f8a2d539 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:57.064792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36116232-1a5d-40cf-b42d-8a59f8a2d539 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:57.065278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36116232-1a5d-40cf-b42d-8a59f8a2d539 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:57.065716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36116232-1a5d-40cf-b42d-8a59f8a2d539 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:57.066427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36116232-1a5d-40cf-b42d-8a59f8a2d539 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:57.066868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36116232-1a5d-40cf-b42d-8a59f8a2d539 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:57.067281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36116232-1a5d-40cf-b42d-8a59f8a2d539 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:57.271066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-36116232-1a5d-40cf-b42d-8a59f8a2d539 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:57.279547 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-36116232-1a5d-40cf-b42d-8a59f8a2d539 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1393 microversion: 2.1 time: 0.229426 Oct 29 03:30:57.280127 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3323/6607] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:57 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1393 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:57.628796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8222b605-ea8a-4cea-b127-023ea7f7afcb req-de6b4714-9d21-4b08-8bb1-408d8b81fbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647e3fb0-b225-4c4e-8ca6-0285c51dd5f7", "tag": "e8cbd62c-f81d-467f-bdbf-e68e5e9895b8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:57.645035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8222b605-ea8a-4cea-b127-023ea7f7afcb req-de6b4714-9d21-4b08-8bb1-408d8b81fbf9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:57.645565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8222b605-ea8a-4cea-b127-023ea7f7afcb req-de6b4714-9d21-4b08-8bb1-408d8b81fbf9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:57.646030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8222b605-ea8a-4cea-b127-023ea7f7afcb req-de6b4714-9d21-4b08-8bb1-408d8b81fbf9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:57.657791 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8222b605-ea8a-4cea-b127-023ea7f7afcb req-de6b4714-9d21-4b08-8bb1-408d8b81fbf9 service nova] Creating event network-changed:e8cbd62c-f81d-467f-bdbf-e68e5e9895b8 for instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 on n-h2-862964-4 Oct 29 03:30:57.673223 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8222b605-ea8a-4cea-b127-023ea7f7afcb req-de6b4714-9d21-4b08-8bb1-408d8b81fbf9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037852 Oct 29 03:30:57.673223 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3285/6608] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:57.712009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-92aadf52-5726-4cfd-8a86-68a2c8321533 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:57.712607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-92aadf52-5726-4cfd-8a86-68a2c8321533 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:57.719088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92aadf52-5726-4cfd-8a86-68a2c8321533 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:57.719580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92aadf52-5726-4cfd-8a86-68a2c8321533 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:57.720010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92aadf52-5726-4cfd-8a86-68a2c8321533 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:57.720710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92aadf52-5726-4cfd-8a86-68a2c8321533 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:57.721158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92aadf52-5726-4cfd-8a86-68a2c8321533 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:57.721578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92aadf52-5726-4cfd-8a86-68a2c8321533 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:58.303699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-06fef0e5-5bf6-439b-a9af-1c3df15ef518 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:58.304486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-06fef0e5-5bf6-439b-a9af-1c3df15ef518 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:58.311225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fef0e5-5bf6-439b-a9af-1c3df15ef518 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:58.311789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fef0e5-5bf6-439b-a9af-1c3df15ef518 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:58.312289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fef0e5-5bf6-439b-a9af-1c3df15ef518 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:58.313061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fef0e5-5bf6-439b-a9af-1c3df15ef518 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:58.313570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fef0e5-5bf6-439b-a9af-1c3df15ef518 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:58.314077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06fef0e5-5bf6-439b-a9af-1c3df15ef518 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:58.333713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-92aadf52-5726-4cfd-8a86-68a2c8321533 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:58.343359 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-92aadf52-5726-4cfd-8a86-68a2c8321533 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1507 microversion: 2.1 time: 0.635283 Oct 29 03:30:58.343928 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3324/6609] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:57 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1507 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:58.456820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06fef0e5-5bf6-439b-a9af-1c3df15ef518 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:58.465444 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-06fef0e5-5bf6-439b-a9af-1c3df15ef518 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1393 microversion: 2.1 time: 0.166105 Oct 29 03:30:58.466048 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3286/6610] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:58 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:58.936608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f7197603-b933-4e8b-be78-f5e3b82d232c req-c747f5ea-807e-420a-b2e3-689d6b870c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5c163e-c275-4f15-abed-4b6cc89048e2", "name": "network-vif-deleted", "tag": "abba2514-df67-45ba-b043-57a50a7a43d9"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:58.946561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f7197603-b933-4e8b-be78-f5e3b82d232c req-c747f5ea-807e-420a-b2e3-689d6b870c0c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:58.948094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f7197603-b933-4e8b-be78-f5e3b82d232c req-c747f5ea-807e-420a-b2e3-689d6b870c0c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:58.948543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f7197603-b933-4e8b-be78-f5e3b82d232c req-c747f5ea-807e-420a-b2e3-689d6b870c0c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:58.960998 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f7197603-b933-4e8b-be78-f5e3b82d232c req-c747f5ea-807e-420a-b2e3-689d6b870c0c service nova] Creating event network-vif-deleted:abba2514-df67-45ba-b043-57a50a7a43d9 for instance cb5c163e-c275-4f15-abed-4b6cc89048e2 on n-h1-862964-4 Oct 29 03:30:58.966220 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f7197603-b933-4e8b-be78-f5e3b82d232c req-c747f5ea-807e-420a-b2e3-689d6b870c0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033558 Oct 29 03:30:58.967344 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3325/6611] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:59.371230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:59.372290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:59.386067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:59.386646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:59.387080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:59.387890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:59.388424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:59.388873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:59.422699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:59.423185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:59.423608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:59.424053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lazy-loading 'fault' on Instance uuid cb5c163e-c275-4f15-abed-4b6cc89048e2 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:30:59.467381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d987daa2f040aba031549b0071e4c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd88f6886a243b58bd47c4dee34dde6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:59.475169 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b126f2e6-aa62-44c6-8334-8268cc119a79 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 200 len: 1305 microversion: 2.1 time: 0.111975 Oct 29 03:30:59.475751 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3287/6612] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:59 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:59.490146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-780c1957-6713-40b3-b1c4-cbffebf8942e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:59.490959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-780c1957-6713-40b3-b1c4-cbffebf8942e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:59.498142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-780c1957-6713-40b3-b1c4-cbffebf8942e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:59.498625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-780c1957-6713-40b3-b1c4-cbffebf8942e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:59.499053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-780c1957-6713-40b3-b1c4-cbffebf8942e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:59.499694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-780c1957-6713-40b3-b1c4-cbffebf8942e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:59.500161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-780c1957-6713-40b3-b1c4-cbffebf8942e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:59.500553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-780c1957-6713-40b3-b1c4-cbffebf8942e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:59.647031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-780c1957-6713-40b3-b1c4-cbffebf8942e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:59.656713 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-780c1957-6713-40b3-b1c4-cbffebf8942e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1393 microversion: 2.1 time: 0.171824 Oct 29 03:30:59.657295 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3326/6613] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:59 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:00.498840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:00.499463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] [instance: cb5c163e-c275-4f15-abed-4b6cc89048e2] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:00.506918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:00.507417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:00.507844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:00.508551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:00.509015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:00.509427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:00.522829 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] HTTP exception thrown: Instance cb5c163e-c275-4f15-abed-4b6cc89048e2 could not be found. Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Request method failure captured: Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 HTTP/1.1 Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ5aDf1ElNr7bb7l-kBrqkt51ivu5Q_7LKY-CxNRu_F5wSLHq9HkYBbM_T7vAFduoh2ewBYKY1_p_kvf1iSAZ6e1AA76zzZ2WNlAqjulCIO-SmgQ0Q9I_ABYWGzPkobUBfXbcMTWfV1RMy1kM7Rlu_REOm9jL73h3L26IesOOjXj3Ag Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 7cd88f6886a243b58bd47c4dee34dde6 Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestServerAdvancedOps-123393055 Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7cd88f6886a243b58bd47c4dee34dde6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7cd88f6886a243b58bd47c4dee34dde6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7cd88f6886a243b58bd47c4dee34dde6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7cd88f6886a243b58bd47c4dee34dde6"}]}] Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestServerAdvancedOps-123393055 Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 7cd88f6886a243b58bd47c4dee34dde6 Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestServerAdvancedOps-123393055 Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestServerAdvancedOps-123393055-project Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a1d987daa2f040aba031549b0071e4c7 Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestServerAdvancedOps-123393055-project Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance cb5c163e-c275-4f15-abed-4b6cc89048e2 could not be found. Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'cb5c163e-c275-4f15-abed-4b6cc89048e2'} Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5c163e-c275-4f15-abed-4b6cc89048e2 could not be found. Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5c163e-c275-4f15-abed-4b6cc89048e2 could not be found. Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:31:00.526619 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:31:00.531994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:00.531994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:31:00.531994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:31:00.531994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:31:00.531994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:31:00.531994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5c163e-c275-4f15-abed-4b6cc89048e2 could not be found. Oct 29 03:31:00.531994 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:31:00.531994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] Returning 404 to user: Instance cb5c163e-c275-4f15-abed-4b6cc89048e2 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:31:00.531994 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f3b510bc-9564-4595-bd46-07e761b21a37 tempest-TestServerAdvancedOps-123393055 tempest-TestServerAdvancedOps-123393055-project] 10.222.0.16 "GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2" status: 404 len: 111 microversion: 2.1 time: 0.033238 Oct 29 03:31:00.531994 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3288/6614] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:00 2022] GET /compute/v2.1/servers/cb5c163e-c275-4f15-abed-4b6cc89048e2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:31:00.679737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-42fe2fb5-e6f3-4869-a46d-bf8e1c3a80c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:00.681070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-42fe2fb5-e6f3-4869-a46d-bf8e1c3a80c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:00.689064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fe2fb5-e6f3-4869-a46d-bf8e1c3a80c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:00.689609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fe2fb5-e6f3-4869-a46d-bf8e1c3a80c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:00.690270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fe2fb5-e6f3-4869-a46d-bf8e1c3a80c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:00.691045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fe2fb5-e6f3-4869-a46d-bf8e1c3a80c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:00.691711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fe2fb5-e6f3-4869-a46d-bf8e1c3a80c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:00.692123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-42fe2fb5-e6f3-4869-a46d-bf8e1c3a80c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:00.841415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-42fe2fb5-e6f3-4869-a46d-bf8e1c3a80c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:00.849582 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-42fe2fb5-e6f3-4869-a46d-bf8e1c3a80c9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1393 microversion: 2.1 time: 0.173838 Oct 29 03:31:00.850452 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3327/6615] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:00 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:31:01.873320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e193131f-2c21-4ae2-8d1d-487b0439d13b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:01.873981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e193131f-2c21-4ae2-8d1d-487b0439d13b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:01.880962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e193131f-2c21-4ae2-8d1d-487b0439d13b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:01.881553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e193131f-2c21-4ae2-8d1d-487b0439d13b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:01.882033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e193131f-2c21-4ae2-8d1d-487b0439d13b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:01.882735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e193131f-2c21-4ae2-8d1d-487b0439d13b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:01.883186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e193131f-2c21-4ae2-8d1d-487b0439d13b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:01.883611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e193131f-2c21-4ae2-8d1d-487b0439d13b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:02.052670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e193131f-2c21-4ae2-8d1d-487b0439d13b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:02.063841 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e193131f-2c21-4ae2-8d1d-487b0439d13b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1393 microversion: 2.1 time: 0.194456 Oct 29 03:31:02.064611 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3289/6616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:01 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1393 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:03.087468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6ae3b89e-d37c-4c01-97ff-b70e723cc8e1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:03.088104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6ae3b89e-d37c-4c01-97ff-b70e723cc8e1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:03.095685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae3b89e-d37c-4c01-97ff-b70e723cc8e1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:03.096245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae3b89e-d37c-4c01-97ff-b70e723cc8e1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:03.096612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae3b89e-d37c-4c01-97ff-b70e723cc8e1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:03.097334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae3b89e-d37c-4c01-97ff-b70e723cc8e1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:03.097756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae3b89e-d37c-4c01-97ff-b70e723cc8e1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:03.098202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ae3b89e-d37c-4c01-97ff-b70e723cc8e1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:03.252173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6ae3b89e-d37c-4c01-97ff-b70e723cc8e1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:03.260831 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6ae3b89e-d37c-4c01-97ff-b70e723cc8e1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1393 microversion: 2.1 time: 0.176755 Oct 29 03:31:03.261675 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3328/6617] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:03 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:04.077312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-51f7bb08-8735-4102-b111-30e6fa9a38bc req-1f7133fc-00f7-4bce-a087-0a20c231ee32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647e3fb0-b225-4c4e-8ca6-0285c51dd5f7", "name": "network-vif-plugged", "status": "completed", "tag": "e8cbd62c-f81d-467f-bdbf-e68e5e9895b8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:04.091458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-51f7bb08-8735-4102-b111-30e6fa9a38bc req-1f7133fc-00f7-4bce-a087-0a20c231ee32 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:04.092213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-51f7bb08-8735-4102-b111-30e6fa9a38bc req-1f7133fc-00f7-4bce-a087-0a20c231ee32 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:04.092854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-51f7bb08-8735-4102-b111-30e6fa9a38bc req-1f7133fc-00f7-4bce-a087-0a20c231ee32 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:04.105788 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-51f7bb08-8735-4102-b111-30e6fa9a38bc req-1f7133fc-00f7-4bce-a087-0a20c231ee32 service nova] Creating event network-vif-plugged:e8cbd62c-f81d-467f-bdbf-e68e5e9895b8 for instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 on n-h2-862964-4 Oct 29 03:31:04.112545 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-51f7bb08-8735-4102-b111-30e6fa9a38bc req-1f7133fc-00f7-4bce-a087-0a20c231ee32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039004 Oct 29 03:31:04.113160 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3290/6618] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:04.288545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cf274258-2055-48d5-a8c3-5d47aa9200ca tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:04.289142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cf274258-2055-48d5-a8c3-5d47aa9200ca tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:04.292089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:04.297453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf274258-2055-48d5-a8c3-5d47aa9200ca tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:04.298248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf274258-2055-48d5-a8c3-5d47aa9200ca tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:04.298670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf274258-2055-48d5-a8c3-5d47aa9200ca tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:04.299533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf274258-2055-48d5-a8c3-5d47aa9200ca tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:04.299973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf274258-2055-48d5-a8c3-5d47aa9200ca tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:04.300386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf274258-2055-48d5-a8c3-5d47aa9200ca tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:04.447548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cf274258-2055-48d5-a8c3-5d47aa9200ca tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:04.455618 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cf274258-2055-48d5-a8c3-5d47aa9200ca tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1393 microversion: 2.1 time: 0.170940 Oct 29 03:31:04.456200 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3329/6619] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:04 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:05.485874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-86567364-a544-403a-a3ce-3224a43e2268 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:05.487122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-86567364-a544-403a-a3ce-3224a43e2268 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:05.491896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:05.492833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:05.502992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86567364-a544-403a-a3ce-3224a43e2268 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:05.503559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86567364-a544-403a-a3ce-3224a43e2268 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:05.504059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86567364-a544-403a-a3ce-3224a43e2268 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:05.505394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86567364-a544-403a-a3ce-3224a43e2268 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:05.506104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86567364-a544-403a-a3ce-3224a43e2268 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:05.506618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-86567364-a544-403a-a3ce-3224a43e2268 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:05.753770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-86567364-a544-403a-a3ce-3224a43e2268 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:05.762481 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-86567364-a544-403a-a3ce-3224a43e2268 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1563 microversion: 2.1 time: 0.284324 Oct 29 03:31:05.763068 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3291/6620] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:05 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1563 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:05.785179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e2e32c02-1108-402a-9d57-71f04ea6e7c8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:05.786418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e2e32c02-1108-402a-9d57-71f04ea6e7c8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:05.789515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:05.795154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e32c02-1108-402a-9d57-71f04ea6e7c8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:05.795763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e32c02-1108-402a-9d57-71f04ea6e7c8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:05.796044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e32c02-1108-402a-9d57-71f04ea6e7c8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:05.796735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e32c02-1108-402a-9d57-71f04ea6e7c8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:05.797496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e32c02-1108-402a-9d57-71f04ea6e7c8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:05.798110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2e32c02-1108-402a-9d57-71f04ea6e7c8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:05.942178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e2e32c02-1108-402a-9d57-71f04ea6e7c8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:05.950598 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e2e32c02-1108-402a-9d57-71f04ea6e7c8 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1563 microversion: 2.1 time: 0.169230 Oct 29 03:31:05.969056 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3330/6621] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:05 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:07.833730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac6c9a55-5286-4136-9dbd-cc9f42aa5ff6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:07.835148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac6c9a55-5286-4136-9dbd-cc9f42aa5ff6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:07.842157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-485a2388-0dbf-410d-942d-9bcace2d371b req-822b5f0e-71bc-4a8b-81fb-1187a1b50d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647e3fb0-b225-4c4e-8ca6-0285c51dd5f7", "tag": "e8cbd62c-f81d-467f-bdbf-e68e5e9895b8"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:07.852334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:07.864441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac6c9a55-5286-4136-9dbd-cc9f42aa5ff6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:07.866650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-485a2388-0dbf-410d-942d-9bcace2d371b req-822b5f0e-71bc-4a8b-81fb-1187a1b50d66 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:07.874615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac6c9a55-5286-4136-9dbd-cc9f42aa5ff6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:07.874983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac6c9a55-5286-4136-9dbd-cc9f42aa5ff6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:07.875748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac6c9a55-5286-4136-9dbd-cc9f42aa5ff6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:07.876206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac6c9a55-5286-4136-9dbd-cc9f42aa5ff6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:07.876629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac6c9a55-5286-4136-9dbd-cc9f42aa5ff6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:07.878684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-485a2388-0dbf-410d-942d-9bcace2d371b req-822b5f0e-71bc-4a8b-81fb-1187a1b50d66 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:07.879112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-485a2388-0dbf-410d-942d-9bcace2d371b req-822b5f0e-71bc-4a8b-81fb-1187a1b50d66 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:07.908446 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-485a2388-0dbf-410d-942d-9bcace2d371b req-822b5f0e-71bc-4a8b-81fb-1187a1b50d66 service nova] Creating event network-changed:e8cbd62c-f81d-467f-bdbf-e68e5e9895b8 for instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 on n-h2-862964-4 Oct 29 03:31:07.914547 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-485a2388-0dbf-410d-942d-9bcace2d371b req-822b5f0e-71bc-4a8b-81fb-1187a1b50d66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076979 Oct 29 03:31:07.917088 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3331/6622] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:31:08.325724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac6c9a55-5286-4136-9dbd-cc9f42aa5ff6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:08.357670 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac6c9a55-5286-4136-9dbd-cc9f42aa5ff6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1563 microversion: 2.1 time: 0.528675 Oct 29 03:31:08.359736 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3292/6623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:07 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1563 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:13.751640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db4e3175-553c-491f-acd6-d5f2dc108921 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Action: 'create', calling method: .version_select at 0x7fe1a3180940>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1076888252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYpuFLQEKi/aDCSe9D0JQGGyOf3tao49NjLLjxLT35bdjQySONYiWsBDlBqq8hQI4t05QqnvfsrqijdGpvR+RJlToazNImiAxPLTIMpGSZ6eQ/CMBDlHzSy2n7RE4SdLw=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:13.767739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-db4e3175-553c-491f-acd6-d5f2dc108921 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Getting quotas for project b0e257e24d9845b187462412cbd149cf. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:31:13.773855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-db4e3175-553c-491f-acd6-d5f2dc108921 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Getting quotas for user 26167e7cffbe4f3d8e63b6ce0253af66 and project b0e257e24d9845b187462412cbd149cf. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:31:13.800692 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-db4e3175-553c-491f-acd6-d5f2dc108921 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.257067 Oct 29 03:31:13.801615 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3332/6624] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:31:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:14.826196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1604695185", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1076888252", "security_groups": [{"name": "tempest-secgroup-smoke-1930935337"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "e9c4c4ba-bc5b-45e1-bfe0-6af238125983"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:14.959050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] validate_networks() for [('e9c4c4ba-bc5b-45e1-bfe0-6af238125983', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:31:15.383190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Getting quotas for project b0e257e24d9845b187462412cbd149cf. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:31:15.389083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Getting quotas for user 26167e7cffbe4f3d8e63b6ce0253af66 and project b0e257e24d9845b187462412cbd149cf. Resources: dict_keys(['metadata_items']) {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:31:15.403695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:31:15.404121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:31:15.404777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:31:15.405186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:31:15.405595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:31:15.414678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:15.415091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:15.415524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:15.416427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:15.416878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:15.417296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:15.435377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Getting quotas for project b0e257e24d9845b187462412cbd149cf. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:31:15.441050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Getting quotas for user 26167e7cffbe4f3d8e63b6ce0253af66 and project b0e257e24d9845b187462412cbd149cf. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:31:15.454502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:31:15.456862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:31:15.505489 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6261fa16-89fc-4302-bfc3-edd5ab0ba53e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.683188 Oct 29 03:31:15.510532 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3293/6625] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:31:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:31:15.519267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7ecf499a-2d9e-40d2-b6b0-77a7265ff6d3 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:15.520656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7ecf499a-2d9e-40d2-b6b0-77a7265ff6d3 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:15.602162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7ecf499a-2d9e-40d2-b6b0-77a7265ff6d3 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:15.609575 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7ecf499a-2d9e-40d2-b6b0-77a7265ff6d3 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1303 microversion: 2.1 time: 0.095057 Oct 29 03:31:15.610680 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3333/6626] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:15 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:16.634060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-60381e41-ea2e-4d1c-9117-42e0ba92f934 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:16.634718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-60381e41-ea2e-4d1c-9117-42e0ba92f934 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:16.642134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60381e41-ea2e-4d1c-9117-42e0ba92f934 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:16.642931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60381e41-ea2e-4d1c-9117-42e0ba92f934 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:16.643561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60381e41-ea2e-4d1c-9117-42e0ba92f934 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:16.644508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60381e41-ea2e-4d1c-9117-42e0ba92f934 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:16.645141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60381e41-ea2e-4d1c-9117-42e0ba92f934 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:16.645732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60381e41-ea2e-4d1c-9117-42e0ba92f934 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:16.735720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-60381e41-ea2e-4d1c-9117-42e0ba92f934 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:16.753229 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-60381e41-ea2e-4d1c-9117-42e0ba92f934 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1363 microversion: 2.1 time: 0.124070 Oct 29 03:31:16.767474 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3294/6627] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:16 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1363 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:17.779753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cb18fd76-ac96-44ac-9b0b-dc6a96532fe8 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:17.780959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cb18fd76-ac96-44ac-9b0b-dc6a96532fe8 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:17.788522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb18fd76-ac96-44ac-9b0b-dc6a96532fe8 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:17.789270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb18fd76-ac96-44ac-9b0b-dc6a96532fe8 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:17.789686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb18fd76-ac96-44ac-9b0b-dc6a96532fe8 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:17.790572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb18fd76-ac96-44ac-9b0b-dc6a96532fe8 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:17.791263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb18fd76-ac96-44ac-9b0b-dc6a96532fe8 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:17.791840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb18fd76-ac96-44ac-9b0b-dc6a96532fe8 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:17.927392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cb18fd76-ac96-44ac-9b0b-dc6a96532fe8 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:17.936294 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cb18fd76-ac96-44ac-9b0b-dc6a96532fe8 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1429 microversion: 2.1 time: 0.160266 Oct 29 03:31:17.936882 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3334/6628] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:17 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1429 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:18.218440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-284b8e9b-e891-403d-a2b7-57d4ad18306c req-6f9da8c7-1994-41c4-8ace-a84d3886d256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e709155-9f5d-4d77-84de-4415e16a33f5", "tag": "305cfe0b-f120-4c76-889a-b8e8a4565e55"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:18.229623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-284b8e9b-e891-403d-a2b7-57d4ad18306c req-6f9da8c7-1994-41c4-8ace-a84d3886d256 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:18.230461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-284b8e9b-e891-403d-a2b7-57d4ad18306c req-6f9da8c7-1994-41c4-8ace-a84d3886d256 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:18.230890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-284b8e9b-e891-403d-a2b7-57d4ad18306c req-6f9da8c7-1994-41c4-8ace-a84d3886d256 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:18.242650 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-284b8e9b-e891-403d-a2b7-57d4ad18306c req-6f9da8c7-1994-41c4-8ace-a84d3886d256 service nova] Creating event network-changed:305cfe0b-f120-4c76-889a-b8e8a4565e55 for instance 9e709155-9f5d-4d77-84de-4415e16a33f5 on n-h1-862964-4 Oct 29 03:31:18.247859 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-284b8e9b-e891-403d-a2b7-57d4ad18306c req-6f9da8c7-1994-41c4-8ace-a84d3886d256 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033381 Oct 29 03:31:18.248843 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3295/6629] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:18.959792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e44b6e1-1524-4202-9b1d-fad1703d6ba4 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:18.961223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4e44b6e1-1524-4202-9b1d-fad1703d6ba4 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:18.969423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e44b6e1-1524-4202-9b1d-fad1703d6ba4 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:18.970116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e44b6e1-1524-4202-9b1d-fad1703d6ba4 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:18.970650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e44b6e1-1524-4202-9b1d-fad1703d6ba4 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:18.971442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e44b6e1-1524-4202-9b1d-fad1703d6ba4 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:18.971993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e44b6e1-1524-4202-9b1d-fad1703d6ba4 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:18.972508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e44b6e1-1524-4202-9b1d-fad1703d6ba4 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:19.119187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4e44b6e1-1524-4202-9b1d-fad1703d6ba4 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:19.127022 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4e44b6e1-1524-4202-9b1d-fad1703d6ba4 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1429 microversion: 2.1 time: 0.171281 Oct 29 03:31:19.127631 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3335/6630] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:18 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:20.154766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2c9a3da2-7781-458e-9d7c-595168afcc7d tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:20.155690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2c9a3da2-7781-458e-9d7c-595168afcc7d tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:20.165782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9a3da2-7781-458e-9d7c-595168afcc7d tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:20.166382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9a3da2-7781-458e-9d7c-595168afcc7d tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:20.166822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9a3da2-7781-458e-9d7c-595168afcc7d tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:20.167509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9a3da2-7781-458e-9d7c-595168afcc7d tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:20.167961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9a3da2-7781-458e-9d7c-595168afcc7d tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:20.168381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c9a3da2-7781-458e-9d7c-595168afcc7d tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:20.324275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c9a3da2-7781-458e-9d7c-595168afcc7d tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:20.332685 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2c9a3da2-7781-458e-9d7c-595168afcc7d tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1429 microversion: 2.1 time: 0.185877 Oct 29 03:31:20.333270 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3296/6631] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:20 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1429 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:21.359837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7742bae1-13d5-4d73-b123-fd45705e6454 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:21.360727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7742bae1-13d5-4d73-b123-fd45705e6454 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:21.371417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7742bae1-13d5-4d73-b123-fd45705e6454 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:21.371902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7742bae1-13d5-4d73-b123-fd45705e6454 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:21.372331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7742bae1-13d5-4d73-b123-fd45705e6454 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:21.373018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7742bae1-13d5-4d73-b123-fd45705e6454 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:21.373464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7742bae1-13d5-4d73-b123-fd45705e6454 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:21.373918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7742bae1-13d5-4d73-b123-fd45705e6454 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:21.392628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:21.525391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7742bae1-13d5-4d73-b123-fd45705e6454 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:21.533786 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7742bae1-13d5-4d73-b123-fd45705e6454 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1429 microversion: 2.1 time: 0.180789 Oct 29 03:31:21.534424 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3336/6632] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:21 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1429 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:22.561052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9946d1a-224f-41e6-b392-19df8a5eab68 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:22.562067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9946d1a-224f-41e6-b392-19df8a5eab68 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:22.572487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9946d1a-224f-41e6-b392-19df8a5eab68 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:22.573103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9946d1a-224f-41e6-b392-19df8a5eab68 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:22.573548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9946d1a-224f-41e6-b392-19df8a5eab68 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:22.574258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9946d1a-224f-41e6-b392-19df8a5eab68 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:22.574701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9946d1a-224f-41e6-b392-19df8a5eab68 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:22.575158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9946d1a-224f-41e6-b392-19df8a5eab68 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:22.716515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a9946d1a-224f-41e6-b392-19df8a5eab68 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:22.729395 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9946d1a-224f-41e6-b392-19df8a5eab68 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1429 microversion: 2.1 time: 0.175352 Oct 29 03:31:22.730327 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3297/6633] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:22 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1429 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:23.757635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-52cf72ce-166b-4e32-9748-7f69860d2c44 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:23.758353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-52cf72ce-166b-4e32-9748-7f69860d2c44 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:23.765759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52cf72ce-166b-4e32-9748-7f69860d2c44 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:23.766316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52cf72ce-166b-4e32-9748-7f69860d2c44 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:23.766789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52cf72ce-166b-4e32-9748-7f69860d2c44 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:23.767550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52cf72ce-166b-4e32-9748-7f69860d2c44 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:23.768035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52cf72ce-166b-4e32-9748-7f69860d2c44 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:23.768489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52cf72ce-166b-4e32-9748-7f69860d2c44 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:23.908277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52cf72ce-166b-4e32-9748-7f69860d2c44 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:23.917303 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-52cf72ce-166b-4e32-9748-7f69860d2c44 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1429 microversion: 2.1 time: 0.164257 Oct 29 03:31:23.917917 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3337/6634] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:23 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1429 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:24.942551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d080d28d-431d-4388-9db3-cf7da6f6607e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:24.944307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d080d28d-431d-4388-9db3-cf7da6f6607e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:24.952495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080d28d-431d-4388-9db3-cf7da6f6607e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:24.952986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080d28d-431d-4388-9db3-cf7da6f6607e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:24.953415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080d28d-431d-4388-9db3-cf7da6f6607e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:24.954158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080d28d-431d-4388-9db3-cf7da6f6607e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:24.954605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080d28d-431d-4388-9db3-cf7da6f6607e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:24.955022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d080d28d-431d-4388-9db3-cf7da6f6607e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:25.096989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d080d28d-431d-4388-9db3-cf7da6f6607e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:25.103671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d4295950-c2da-4ff3-a22e-bc6f2b47b945 req-f5a614cc-b762-40d2-baec-371ab3bab1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e709155-9f5d-4d77-84de-4415e16a33f5", "name": "network-vif-plugged", "status": "completed", "tag": "305cfe0b-f120-4c76-889a-b8e8a4565e55"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:25.105535 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d080d28d-431d-4388-9db3-cf7da6f6607e tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1429 microversion: 2.1 time: 0.168205 Oct 29 03:31:25.106531 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3298/6635] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:24 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1429 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:25.115215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d4295950-c2da-4ff3-a22e-bc6f2b47b945 req-f5a614cc-b762-40d2-baec-371ab3bab1c5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:25.115753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d4295950-c2da-4ff3-a22e-bc6f2b47b945 req-f5a614cc-b762-40d2-baec-371ab3bab1c5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:25.116565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d4295950-c2da-4ff3-a22e-bc6f2b47b945 req-f5a614cc-b762-40d2-baec-371ab3bab1c5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:25.130984 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d4295950-c2da-4ff3-a22e-bc6f2b47b945 req-f5a614cc-b762-40d2-baec-371ab3bab1c5 service nova] Creating event network-vif-plugged:305cfe0b-f120-4c76-889a-b8e8a4565e55 for instance 9e709155-9f5d-4d77-84de-4415e16a33f5 on n-h1-862964-4 Oct 29 03:31:25.136486 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d4295950-c2da-4ff3-a22e-bc6f2b47b945 req-f5a614cc-b762-40d2-baec-371ab3bab1c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036562 Oct 29 03:31:25.137200 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3338/6636] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:26.129109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c0b75edb-6e44-47fa-9da0-376255add084 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:26.129713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c0b75edb-6e44-47fa-9da0-376255add084 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:26.131758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:26.132444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=10 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:26.139172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0b75edb-6e44-47fa-9da0-376255add084 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:26.139656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0b75edb-6e44-47fa-9da0-376255add084 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:26.140085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0b75edb-6e44-47fa-9da0-376255add084 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:26.140776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0b75edb-6e44-47fa-9da0-376255add084 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:26.141226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0b75edb-6e44-47fa-9da0-376255add084 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:26.141646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0b75edb-6e44-47fa-9da0-376255add084 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:26.289649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c0b75edb-6e44-47fa-9da0-376255add084 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:26.291894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=83 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:26.298982 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c0b75edb-6e44-47fa-9da0-376255add084 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1429 microversion: 2.1 time: 0.174055 Oct 29 03:31:26.299618 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3299/6637] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:26 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1429 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:27.327483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b543fe16-9f41-44d2-85d8-34831704a2e0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:27.328613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b543fe16-9f41-44d2-85d8-34831704a2e0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:27.331844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:27.341316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b543fe16-9f41-44d2-85d8-34831704a2e0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:27.341794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b543fe16-9f41-44d2-85d8-34831704a2e0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:27.342255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b543fe16-9f41-44d2-85d8-34831704a2e0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:27.342945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b543fe16-9f41-44d2-85d8-34831704a2e0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:27.343389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b543fe16-9f41-44d2-85d8-34831704a2e0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:27.343803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b543fe16-9f41-44d2-85d8-34831704a2e0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:27.494919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b543fe16-9f41-44d2-85d8-34831704a2e0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:27.503644 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b543fe16-9f41-44d2-85d8-34831704a2e0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1608 microversion: 2.1 time: 0.183470 Oct 29 03:31:27.504203 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3339/6638] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:27 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1608 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:27.526111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a71ca42-0c3b-43a8-b747-b067500623b1 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:27.526786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5a71ca42-0c3b-43a8-b747-b067500623b1 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:27.534292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a71ca42-0c3b-43a8-b747-b067500623b1 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:27.534750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a71ca42-0c3b-43a8-b747-b067500623b1 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:27.535181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a71ca42-0c3b-43a8-b747-b067500623b1 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:27.535878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a71ca42-0c3b-43a8-b747-b067500623b1 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:27.536330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a71ca42-0c3b-43a8-b747-b067500623b1 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:27.536748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a71ca42-0c3b-43a8-b747-b067500623b1 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:27.680019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5a71ca42-0c3b-43a8-b747-b067500623b1 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:27.688393 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5a71ca42-0c3b-43a8-b747-b067500623b1 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1608 microversion: 2.1 time: 0.166149 Oct 29 03:31:27.688908 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3300/6639] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:27 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1608 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:27.710565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e0ef24e2-3d97-4fad-95f1-d2028ac41258 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:27.711167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e0ef24e2-3d97-4fad-95f1-d2028ac41258 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:27.717470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0ef24e2-3d97-4fad-95f1-d2028ac41258 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:27.717985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0ef24e2-3d97-4fad-95f1-d2028ac41258 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:27.718414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0ef24e2-3d97-4fad-95f1-d2028ac41258 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:27.719098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0ef24e2-3d97-4fad-95f1-d2028ac41258 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:27.719513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0ef24e2-3d97-4fad-95f1-d2028ac41258 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:27.720180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0ef24e2-3d97-4fad-95f1-d2028ac41258 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:27.857283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e0ef24e2-3d97-4fad-95f1-d2028ac41258 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:27.865543 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e0ef24e2-3d97-4fad-95f1-d2028ac41258 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1608 microversion: 2.1 time: 0.158939 Oct 29 03:31:27.866495 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3340/6640] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:27 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1608 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:31:30.060937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d8eae307-2af1-4403-bb7a-e572b946d491 req-0a814362-32b8-41a0-afca-57e7c7ffb8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e709155-9f5d-4d77-84de-4415e16a33f5", "tag": "305cfe0b-f120-4c76-889a-b8e8a4565e55"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:30.071558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d8eae307-2af1-4403-bb7a-e572b946d491 req-0a814362-32b8-41a0-afca-57e7c7ffb8f2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:30.072034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d8eae307-2af1-4403-bb7a-e572b946d491 req-0a814362-32b8-41a0-afca-57e7c7ffb8f2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:30.072466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d8eae307-2af1-4403-bb7a-e572b946d491 req-0a814362-32b8-41a0-afca-57e7c7ffb8f2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:30.083921 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d8eae307-2af1-4403-bb7a-e572b946d491 req-0a814362-32b8-41a0-afca-57e7c7ffb8f2 service nova] Creating event network-changed:305cfe0b-f120-4c76-889a-b8e8a4565e55 for instance 9e709155-9f5d-4d77-84de-4415e16a33f5 on n-h1-862964-4 Oct 29 03:31:30.089057 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d8eae307-2af1-4403-bb7a-e572b946d491 req-0a814362-32b8-41a0-afca-57e7c7ffb8f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031854 Oct 29 03:31:30.089608 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3301/6641] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:33.663307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-86a349de-258d-4bca-85fc-6eb52ce320bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:33.666877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86a349de-258d-4bca-85fc-6eb52ce320bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:33.674394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a349de-258d-4bca-85fc-6eb52ce320bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:33.674873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a349de-258d-4bca-85fc-6eb52ce320bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:33.675301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a349de-258d-4bca-85fc-6eb52ce320bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:33.675996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a349de-258d-4bca-85fc-6eb52ce320bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:33.676439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a349de-258d-4bca-85fc-6eb52ce320bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:33.676854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86a349de-258d-4bca-85fc-6eb52ce320bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:33.729107 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-86a349de-258d-4bca-85fc-6eb52ce320bf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7/action" status: 200 len: 24565 microversion: 2.1 time: 0.072312 Oct 29 03:31:33.729818 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3341/6642] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:31:33 2022] POST /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7/action => generated 24565 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:31:44.800978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:44.801726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=9 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:44.919647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-13aa7ca6-b2c0-4043-bb42-b1e21e7f9ef7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:44.920344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-13aa7ca6-b2c0-4043-bb42-b1e21e7f9ef7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:44.926684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13aa7ca6-b2c0-4043-bb42-b1e21e7f9ef7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:44.927155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13aa7ca6-b2c0-4043-bb42-b1e21e7f9ef7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:44.927580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13aa7ca6-b2c0-4043-bb42-b1e21e7f9ef7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:44.928258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13aa7ca6-b2c0-4043-bb42-b1e21e7f9ef7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:44.928697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13aa7ca6-b2c0-4043-bb42-b1e21e7f9ef7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:44.929105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13aa7ca6-b2c0-4043-bb42-b1e21e7f9ef7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:45.072260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-13aa7ca6-b2c0-4043-bb42-b1e21e7f9ef7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:45.080842 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-13aa7ca6-b2c0-4043-bb42-b1e21e7f9ef7 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1682 microversion: 2.1 time: 0.282057 Oct 29 03:31:45.081387 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3302/6643] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:44 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1682 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:45.183722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8b72938d-ba49-4a66-b0bd-f833b106b86f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:45.186119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8b72938d-ba49-4a66-b0bd-f833b106b86f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:45.189288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:45.189980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=26 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:45.198195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b72938d-ba49-4a66-b0bd-f833b106b86f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:45.198838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b72938d-ba49-4a66-b0bd-f833b106b86f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:45.199276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b72938d-ba49-4a66-b0bd-f833b106b86f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:45.199965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b72938d-ba49-4a66-b0bd-f833b106b86f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:45.200410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b72938d-ba49-4a66-b0bd-f833b106b86f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:45.200828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b72938d-ba49-4a66-b0bd-f833b106b86f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:45.253553 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8b72938d-ba49-4a66-b0bd-f833b106b86f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7/action" status: 200 len: 32636 microversion: 2.1 time: 0.074213 Oct 29 03:31:45.254253 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3342/6644] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:31:45 2022] POST /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7/action => generated 32636 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:31:45.438763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b870b24c-f8fc-489d-a372-6593bf53feb0 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:45.439347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b870b24c-f8fc-489d-a372-6593bf53feb0 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:45.446525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870b24c-f8fc-489d-a372-6593bf53feb0 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:45.447050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870b24c-f8fc-489d-a372-6593bf53feb0 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:45.447521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870b24c-f8fc-489d-a372-6593bf53feb0 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:45.448536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870b24c-f8fc-489d-a372-6593bf53feb0 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:45.449056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870b24c-f8fc-489d-a372-6593bf53feb0 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:45.449515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b870b24c-f8fc-489d-a372-6593bf53feb0 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:45.582177 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b870b24c-f8fc-489d-a372-6593bf53feb0 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1833 microversion: 2.1 time: 0.147570 Oct 29 03:31:45.582758 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3303/6645] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:45 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1833 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:45.612917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6ceaaaff-5557-4835-afa6-7e01eafab337 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:45.615464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6ceaaaff-5557-4835-afa6-7e01eafab337 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:45.622938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ceaaaff-5557-4835-afa6-7e01eafab337 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:45.623412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ceaaaff-5557-4835-afa6-7e01eafab337 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:45.623839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ceaaaff-5557-4835-afa6-7e01eafab337 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:45.624523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ceaaaff-5557-4835-afa6-7e01eafab337 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:45.624975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ceaaaff-5557-4835-afa6-7e01eafab337 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:45.625382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6ceaaaff-5557-4835-afa6-7e01eafab337 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:45.929835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-6ceaaaff-5557-4835-afa6-7e01eafab337 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lazy-loading 'flavor' on Instance uuid 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:31:45.943262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6ceaaaff-5557-4835-afa6-7e01eafab337 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Going to try to live migrate instance to another host {{(pid=127042) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 03:31:47.284038 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6ceaaaff-5557-4835-afa6-7e01eafab337 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7/action" status: 202 len: 0 microversion: 2.1 time: 1.675213 Oct 29 03:31:47.285023 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3343/6646] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:31:45 2022] POST /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7/action => generated 0 bytes in 1677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:31:47.296185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-499a99ca-9e71-4f63-b691-92ee159b1bcb tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:47.296795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-499a99ca-9e71-4f63-b691-92ee159b1bcb tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:47.299890 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:31:47.300044 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:31:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 (ip 10.222.0.16) !!! Oct 29 03:31:47.315425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-499a99ca-9e71-4f63-b691-92ee159b1bcb tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:47.317005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-499a99ca-9e71-4f63-b691-92ee159b1bcb tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:47.317450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-499a99ca-9e71-4f63-b691-92ee159b1bcb tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:47.318854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-499a99ca-9e71-4f63-b691-92ee159b1bcb tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:47.319323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-499a99ca-9e71-4f63-b691-92ee159b1bcb tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:47.319732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-499a99ca-9e71-4f63-b691-92ee159b1bcb tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:47.493120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-499a99ca-9e71-4f63-b691-92ee159b1bcb tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:47.501484 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-499a99ca-9e71-4f63-b691-92ee159b1bcb tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1692 microversion: 2.1 time: 0.209991 Oct 29 03:31:47.502084 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3304/6647] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:47 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1692 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:48.526535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c0660e3d-0b9d-4aa5-8135-881c92bb6ec5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:48.527138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c0660e3d-0b9d-4aa5-8135-881c92bb6ec5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:48.535082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0660e3d-0b9d-4aa5-8135-881c92bb6ec5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:48.535548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0660e3d-0b9d-4aa5-8135-881c92bb6ec5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:48.536013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0660e3d-0b9d-4aa5-8135-881c92bb6ec5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:48.536724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0660e3d-0b9d-4aa5-8135-881c92bb6ec5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:48.537171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0660e3d-0b9d-4aa5-8135-881c92bb6ec5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:48.537556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c0660e3d-0b9d-4aa5-8135-881c92bb6ec5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:48.684998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c0660e3d-0b9d-4aa5-8135-881c92bb6ec5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:48.693033 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c0660e3d-0b9d-4aa5-8135-881c92bb6ec5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1692 microversion: 2.1 time: 0.170576 Oct 29 03:31:48.693847 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3344/6648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:48 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:48.815246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-e8bd058e-0003-4e83-a46d-403fd2e44076 req-c214e043-af39-4919-b110-5770d5f8dd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647e3fb0-b225-4c4e-8ca6-0285c51dd5f7", "name": "network-vif-unplugged", "status": "completed", "tag": "e8cbd62c-f81d-467f-bdbf-e68e5e9895b8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:48.828592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e8bd058e-0003-4e83-a46d-403fd2e44076 req-c214e043-af39-4919-b110-5770d5f8dd80 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:48.829070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e8bd058e-0003-4e83-a46d-403fd2e44076 req-c214e043-af39-4919-b110-5770d5f8dd80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:48.829492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e8bd058e-0003-4e83-a46d-403fd2e44076 req-c214e043-af39-4919-b110-5770d5f8dd80 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:48.841467 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-e8bd058e-0003-4e83-a46d-403fd2e44076 req-c214e043-af39-4919-b110-5770d5f8dd80 service nova] Creating event network-vif-unplugged:e8cbd62c-f81d-467f-bdbf-e68e5e9895b8 for instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 on n-h2-862964-4 Oct 29 03:31:48.847193 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-e8bd058e-0003-4e83-a46d-403fd2e44076 req-c214e043-af39-4919-b110-5770d5f8dd80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037742 Oct 29 03:31:48.847969 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3305/6649] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:49.719957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a65d00ab-6388-4d7a-9254-2a1dc287048f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:49.720716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a65d00ab-6388-4d7a-9254-2a1dc287048f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:49.730044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a65d00ab-6388-4d7a-9254-2a1dc287048f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:49.730678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a65d00ab-6388-4d7a-9254-2a1dc287048f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:49.731244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a65d00ab-6388-4d7a-9254-2a1dc287048f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:49.732183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a65d00ab-6388-4d7a-9254-2a1dc287048f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:49.732773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a65d00ab-6388-4d7a-9254-2a1dc287048f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:49.733328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a65d00ab-6388-4d7a-9254-2a1dc287048f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:49.874226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a65d00ab-6388-4d7a-9254-2a1dc287048f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:49.882219 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a65d00ab-6388-4d7a-9254-2a1dc287048f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1692 microversion: 2.1 time: 0.167541 Oct 29 03:31:49.882782 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3345/6650] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:49 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:50.887190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3138660f-9d32-4ce4-aa4a-4cbe88cd3f1b req-65ca4233-bb17-46fa-9b12-deca84eec91c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647e3fb0-b225-4c4e-8ca6-0285c51dd5f7", "tag": "e8cbd62c-f81d-467f-bdbf-e68e5e9895b8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:50.897547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3138660f-9d32-4ce4-aa4a-4cbe88cd3f1b req-65ca4233-bb17-46fa-9b12-deca84eec91c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:50.898065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3138660f-9d32-4ce4-aa4a-4cbe88cd3f1b req-65ca4233-bb17-46fa-9b12-deca84eec91c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:50.898493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3138660f-9d32-4ce4-aa4a-4cbe88cd3f1b req-65ca4233-bb17-46fa-9b12-deca84eec91c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:50.906542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-56cac279-d030-4364-8339-555bf5a02724 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:50.907155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-56cac279-d030-4364-8339-555bf5a02724 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:50.910055 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3138660f-9d32-4ce4-aa4a-4cbe88cd3f1b req-65ca4233-bb17-46fa-9b12-deca84eec91c service nova] Creating event network-changed:e8cbd62c-f81d-467f-bdbf-e68e5e9895b8 for instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 on n-h2-862964-4 Oct 29 03:31:50.915027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56cac279-d030-4364-8339-555bf5a02724 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:50.915211 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3138660f-9d32-4ce4-aa4a-4cbe88cd3f1b req-65ca4233-bb17-46fa-9b12-deca84eec91c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033046 Oct 29 03:31:50.915527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56cac279-d030-4364-8339-555bf5a02724 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:50.915891 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3306/6651] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:50.916061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56cac279-d030-4364-8339-555bf5a02724 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:50.916763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56cac279-d030-4364-8339-555bf5a02724 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:50.917223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56cac279-d030-4364-8339-555bf5a02724 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:50.917728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56cac279-d030-4364-8339-555bf5a02724 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:51.206399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-56cac279-d030-4364-8339-555bf5a02724 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:51.215042 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-56cac279-d030-4364-8339-555bf5a02724 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1692 microversion: 2.1 time: 0.312518 Oct 29 03:31:51.215619 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3346/6652] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:50 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1692 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:52.241571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dcc76420-7eed-4952-8fad-f59d795c4054 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:52.242326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dcc76420-7eed-4952-8fad-f59d795c4054 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:52.249304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcc76420-7eed-4952-8fad-f59d795c4054 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:52.249786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcc76420-7eed-4952-8fad-f59d795c4054 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:52.250253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcc76420-7eed-4952-8fad-f59d795c4054 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:52.250948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcc76420-7eed-4952-8fad-f59d795c4054 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:52.251409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcc76420-7eed-4952-8fad-f59d795c4054 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:52.251801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcc76420-7eed-4952-8fad-f59d795c4054 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:52.457505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dcc76420-7eed-4952-8fad-f59d795c4054 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:52.467045 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dcc76420-7eed-4952-8fad-f59d795c4054 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1692 microversion: 2.1 time: 0.230230 Oct 29 03:31:52.467674 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3307/6653] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:52 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1692 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:53.495129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7a623373-7b2e-414b-a25a-8de4c4f872ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:53.495911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7a623373-7b2e-414b-a25a-8de4c4f872ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:53.503334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a623373-7b2e-414b-a25a-8de4c4f872ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:53.503829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a623373-7b2e-414b-a25a-8de4c4f872ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:53.504267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a623373-7b2e-414b-a25a-8de4c4f872ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:53.504975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a623373-7b2e-414b-a25a-8de4c4f872ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:53.505431 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a623373-7b2e-414b-a25a-8de4c4f872ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:53.505870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a623373-7b2e-414b-a25a-8de4c4f872ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:53.643644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7a623373-7b2e-414b-a25a-8de4c4f872ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:53.651885 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7a623373-7b2e-414b-a25a-8de4c4f872ee tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1692 microversion: 2.1 time: 0.162924 Oct 29 03:31:53.652426 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3347/6654] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:53 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:54.684445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29743ee2-e3b4-43f6-a7b2-77d3941780e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:54.685056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29743ee2-e3b4-43f6-a7b2-77d3941780e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:54.692657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29743ee2-e3b4-43f6-a7b2-77d3941780e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:54.693156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29743ee2-e3b4-43f6-a7b2-77d3941780e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:54.693565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29743ee2-e3b4-43f6-a7b2-77d3941780e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:54.694330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29743ee2-e3b4-43f6-a7b2-77d3941780e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:54.694798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29743ee2-e3b4-43f6-a7b2-77d3941780e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:54.695209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29743ee2-e3b4-43f6-a7b2-77d3941780e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:54.840904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29743ee2-e3b4-43f6-a7b2-77d3941780e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:54.850079 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29743ee2-e3b4-43f6-a7b2-77d3941780e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1692 microversion: 2.1 time: 0.169626 Oct 29 03:31:54.850672 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3308/6655] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:54 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:55.874407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-975db789-050a-4ed9-9503-a4fc2c3c6ed3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:55.875032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-975db789-050a-4ed9-9503-a4fc2c3c6ed3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:55.882106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-975db789-050a-4ed9-9503-a4fc2c3c6ed3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:55.882602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-975db789-050a-4ed9-9503-a4fc2c3c6ed3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:55.883046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-975db789-050a-4ed9-9503-a4fc2c3c6ed3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:55.883741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-975db789-050a-4ed9-9503-a4fc2c3c6ed3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:55.884193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-975db789-050a-4ed9-9503-a4fc2c3c6ed3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:55.884619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-975db789-050a-4ed9-9503-a4fc2c3c6ed3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:56.023763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-975db789-050a-4ed9-9503-a4fc2c3c6ed3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:56.032751 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-975db789-050a-4ed9-9503-a4fc2c3c6ed3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1692 microversion: 2.1 time: 0.161993 Oct 29 03:31:56.033580 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3348/6656] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:55 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:57.057644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dfa7f480-b315-482d-a5ee-dde9a4bcdcec tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:57.058518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dfa7f480-b315-482d-a5ee-dde9a4bcdcec tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:57.065722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa7f480-b315-482d-a5ee-dde9a4bcdcec tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:57.066251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa7f480-b315-482d-a5ee-dde9a4bcdcec tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:57.066686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa7f480-b315-482d-a5ee-dde9a4bcdcec tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:57.067417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa7f480-b315-482d-a5ee-dde9a4bcdcec tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:57.067870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa7f480-b315-482d-a5ee-dde9a4bcdcec tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:57.068298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dfa7f480-b315-482d-a5ee-dde9a4bcdcec tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:57.204376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dfa7f480-b315-482d-a5ee-dde9a4bcdcec tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:57.212257 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dfa7f480-b315-482d-a5ee-dde9a4bcdcec tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1682 microversion: 2.1 time: 0.158615 Oct 29 03:31:57.212839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3309/6657] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:57 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:57.235334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b333c6f8-4ecc-48bb-a5c5-e1db3fd17545 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:57.235969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b333c6f8-4ecc-48bb-a5c5-e1db3fd17545 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:57.243331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b333c6f8-4ecc-48bb-a5c5-e1db3fd17545 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:57.243818 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b333c6f8-4ecc-48bb-a5c5-e1db3fd17545 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:57.244248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b333c6f8-4ecc-48bb-a5c5-e1db3fd17545 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:57.244990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b333c6f8-4ecc-48bb-a5c5-e1db3fd17545 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:57.245533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b333c6f8-4ecc-48bb-a5c5-e1db3fd17545 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:57.245994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b333c6f8-4ecc-48bb-a5c5-e1db3fd17545 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:57.380534 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b333c6f8-4ecc-48bb-a5c5-e1db3fd17545 tempest-TestNetworkAdvancedServerOps-71796867 tempest-TestNetworkAdvancedServerOps-71796867-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1833 microversion: 2.1 time: 0.149109 Oct 29 03:31:57.381131 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3349/6658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:57 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1833 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:57.404604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-09bfbf74-e782-4b91-a945-75f21f14e314 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:57.405245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-09bfbf74-e782-4b91-a945-75f21f14e314 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:57.411494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09bfbf74-e782-4b91-a945-75f21f14e314 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:57.411978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09bfbf74-e782-4b91-a945-75f21f14e314 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:57.412412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09bfbf74-e782-4b91-a945-75f21f14e314 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:57.413104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09bfbf74-e782-4b91-a945-75f21f14e314 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:57.413551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09bfbf74-e782-4b91-a945-75f21f14e314 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:57.414002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09bfbf74-e782-4b91-a945-75f21f14e314 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:57.553663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-09bfbf74-e782-4b91-a945-75f21f14e314 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:57.565471 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-09bfbf74-e782-4b91-a945-75f21f14e314 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1682 microversion: 2.1 time: 0.164669 Oct 29 03:31:57.566410 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3310/6659] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:57 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:57.671974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-11e2bfa1-6e0e-452e-bb5d-435b1e96b679 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:57.674245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-11e2bfa1-6e0e-452e-bb5d-435b1e96b679 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:57.680672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11e2bfa1-6e0e-452e-bb5d-435b1e96b679 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:57.681169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11e2bfa1-6e0e-452e-bb5d-435b1e96b679 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:57.681609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11e2bfa1-6e0e-452e-bb5d-435b1e96b679 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:57.682403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11e2bfa1-6e0e-452e-bb5d-435b1e96b679 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:57.682990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11e2bfa1-6e0e-452e-bb5d-435b1e96b679 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:57.683407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-11e2bfa1-6e0e-452e-bb5d-435b1e96b679 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:57.746821 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-11e2bfa1-6e0e-452e-bb5d-435b1e96b679 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7/action" status: 200 len: 38662 microversion: 2.1 time: 0.078662 Oct 29 03:31:57.747465 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3350/6660] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:31:57 2022] POST /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7/action => generated 38662 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:31:58.764276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-2d0ca0ba-e691-4078-96f8-59edd735353d req-46b08111-585a-4b2a-8007-3d9b360eccf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647e3fb0-b225-4c4e-8ca6-0285c51dd5f7", "tag": "e8cbd62c-f81d-467f-bdbf-e68e5e9895b8"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:58.773055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eee6a9d2-e6f2-430d-9675-db2b4d77c777 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:58.773611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eee6a9d2-e6f2-430d-9675-db2b4d77c777 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:58.781083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eee6a9d2-e6f2-430d-9675-db2b4d77c777 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:58.781722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eee6a9d2-e6f2-430d-9675-db2b4d77c777 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:58.782636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eee6a9d2-e6f2-430d-9675-db2b4d77c777 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:58.783012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eee6a9d2-e6f2-430d-9675-db2b4d77c777 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:58.783343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2d0ca0ba-e691-4078-96f8-59edd735353d req-46b08111-585a-4b2a-8007-3d9b360eccf4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:58.783631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eee6a9d2-e6f2-430d-9675-db2b4d77c777 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:58.783827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2d0ca0ba-e691-4078-96f8-59edd735353d req-46b08111-585a-4b2a-8007-3d9b360eccf4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:58.784235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2d0ca0ba-e691-4078-96f8-59edd735353d req-46b08111-585a-4b2a-8007-3d9b360eccf4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:58.784677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eee6a9d2-e6f2-430d-9675-db2b4d77c777 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:58.795583 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-2d0ca0ba-e691-4078-96f8-59edd735353d req-46b08111-585a-4b2a-8007-3d9b360eccf4 service nova] Creating event network-changed:e8cbd62c-f81d-467f-bdbf-e68e5e9895b8 for instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 on n-h1-862964-4 Oct 29 03:31:58.800991 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-2d0ca0ba-e691-4078-96f8-59edd735353d req-46b08111-585a-4b2a-8007-3d9b360eccf4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040948 Oct 29 03:31:58.802141 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3351/6661] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:58.816064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eee6a9d2-e6f2-430d-9675-db2b4d77c777 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:31:58.913195 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eee6a9d2-e6f2-430d-9675-db2b4d77c777 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "DELETE /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 204 len: 0 microversion: 2.1 time: 0.155654 Oct 29 03:31:58.913814 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3311/6662] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:31:58 2022] DELETE /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:31:58.922953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7b855a8-909e-4896-8d8f-031aec69d9e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:58.923651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f7b855a8-909e-4896-8d8f-031aec69d9e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:58.930551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b855a8-909e-4896-8d8f-031aec69d9e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:58.931029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b855a8-909e-4896-8d8f-031aec69d9e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:58.931458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b855a8-909e-4896-8d8f-031aec69d9e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:58.932201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b855a8-909e-4896-8d8f-031aec69d9e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:58.932649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b855a8-909e-4896-8d8f-031aec69d9e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:58.933195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7b855a8-909e-4896-8d8f-031aec69d9e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:59.076688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f7b855a8-909e-4896-8d8f-031aec69d9e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:59.085095 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f7b855a8-909e-4896-8d8f-031aec69d9e5 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1688 microversion: 2.1 time: 0.166379 Oct 29 03:31:59.085677 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3352/6663] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:58 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:00.060740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1367219f-3fff-40d8-98ea-410fd723c16f req-7b1562e8-0167-4141-87f9-a9df41761475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647e3fb0-b225-4c4e-8ca6-0285c51dd5f7", "name": "network-vif-deleted", "tag": "e8cbd62c-f81d-467f-bdbf-e68e5e9895b8"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:00.074238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1367219f-3fff-40d8-98ea-410fd723c16f req-7b1562e8-0167-4141-87f9-a9df41761475 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:00.075050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1367219f-3fff-40d8-98ea-410fd723c16f req-7b1562e8-0167-4141-87f9-a9df41761475 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:00.075503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1367219f-3fff-40d8-98ea-410fd723c16f req-7b1562e8-0167-4141-87f9-a9df41761475 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:00.086609 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1367219f-3fff-40d8-98ea-410fd723c16f req-7b1562e8-0167-4141-87f9-a9df41761475 service nova] Creating event network-vif-deleted:e8cbd62c-f81d-467f-bdbf-e68e5e9895b8 for instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 on n-h1-862964-4 Oct 29 03:32:00.092985 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1367219f-3fff-40d8-98ea-410fd723c16f req-7b1562e8-0167-4141-87f9-a9df41761475 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036737 Oct 29 03:32:00.093593 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3312/6664] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:32:00.109787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6e76852b-83d8-414e-a6bb-9cf48071a4a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:00.110416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6e76852b-83d8-414e-a6bb-9cf48071a4a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:00.117751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e76852b-83d8-414e-a6bb-9cf48071a4a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:00.118280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e76852b-83d8-414e-a6bb-9cf48071a4a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:00.118718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e76852b-83d8-414e-a6bb-9cf48071a4a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:00.119437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e76852b-83d8-414e-a6bb-9cf48071a4a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:00.119874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e76852b-83d8-414e-a6bb-9cf48071a4a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:00.120311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6e76852b-83d8-414e-a6bb-9cf48071a4a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:00.188020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6e76852b-83d8-414e-a6bb-9cf48071a4a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:00.199982 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6e76852b-83d8-414e-a6bb-9cf48071a4a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 200 len: 1352 microversion: 2.1 time: 0.094098 Oct 29 03:32:00.200667 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3353/6665] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:00 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:01.227960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:01.229108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:01.241204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:01.242105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:01.242829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:01.243973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:01.244793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:01.245295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:01.259032 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] HTTP exception thrown: Instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 could not be found. Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Request method failure captured: Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 HTTP/1.1 Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ10LZQSVueycmVKmxTnPj3nUimr4sccneo7HLm8KXoelgnMvGdJN1ul4_Noy4qlMD9jBc7keg-hfhkO8RJdfVJEtLkxYJxm5hLDbYb4Zkhq0cAALSLv_Q2FcEk-lgwgLiCvqwRZD85031-7BUx5-jlERqTw0IWvFo1WnuKpY-yQSgQ Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 1d8e5b0759e64bc5a2118d6ab364bec3 Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d8e5b0759e64bc5a2118d6ab364bec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d8e5b0759e64bc5a2118d6ab364bec3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d8e5b0759e64bc5a2118d6ab364bec3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d8e5b0759e64bc5a2118d6ab364bec3"}]}] Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 1d8e5b0759e64bc5a2118d6ab364bec3 Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestNetworkAdvancedServerOps-841069215-project Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 6988b3809252496ca2f97a1f6eff5825 Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestNetworkAdvancedServerOps-841069215-project Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 could not be found. Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '647e3fb0-b225-4c4e-8ca6-0285c51dd5f7'} Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 could not be found. Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 could not be found. Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:32:01.260818 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:32:01.266190 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:32:01.266190 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:32:01.266190 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:32:01.266190 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:32:01.266190 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:32:01.266190 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:32:01.266190 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 could not be found. Oct 29 03:32:01.266190 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:32:01.266190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Returning 404 to user: Instance 647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:32:01.266190 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d3d76714-aa2d-4a06-a071-4e9eb466a1cd tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7" status: 404 len: 111 microversion: 2.1 time: 0.041382 Oct 29 03:32:01.266190 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3313/6666] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:01 2022] GET /compute/v2.1/servers/647e3fb0-b225-4c4e-8ca6-0285c51dd5f7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:32:05.094151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e7b936e3-78ef-4324-99b6-f28cf0125a3f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '.version_select at 0x7fe1a328f310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:05.120783 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e7b936e3-78ef-4324-99b6-f28cf0125a3f tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1513299827" status: 202 len: 0 microversion: 2.1 time: 0.031363 Oct 29 03:32:05.122414 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3354/6667] 10.222.0.16 () {58 vars in 1284 bytes} [Sat Oct 29 03:32:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1513299827 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:32:05.162831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5d66a25-2966-4a04-83dd-a5af0ccf448a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'create', calling method: .version_select at 0x7fe1a386f940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-979256399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6/YhWOYZAGXwthOBVfUkblWVGbFc81gtoBJ0tPFVsILGwPg5dxoKCmxjnZJwFr+4mJjlu3egLhkew+R3mCj4SEeqHwXzaFJOgVGvtRYYas/l3mRb82vtAQI2IeBc1DFA=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:05.190629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d5d66a25-2966-4a04-83dd-a5af0ccf448a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:32:05.197689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d5d66a25-2966-4a04-83dd-a5af0ccf448a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for user 6988b3809252496ca2f97a1f6eff5825 and project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:32:05.236114 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5d66a25-2966-4a04-83dd-a5af0ccf448a tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.079339 Oct 29 03:32:05.237035 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3314/6668] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:32:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:32:05.439934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bc4a1697-b94f-4c2b-abfb-058cb5f4ea12 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:05.440581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bc4a1697-b94f-4c2b-abfb-058cb5f4ea12 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:05.447674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc4a1697-b94f-4c2b-abfb-058cb5f4ea12 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:05.448271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc4a1697-b94f-4c2b-abfb-058cb5f4ea12 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:05.448762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc4a1697-b94f-4c2b-abfb-058cb5f4ea12 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:05.449465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc4a1697-b94f-4c2b-abfb-058cb5f4ea12 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:05.449940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc4a1697-b94f-4c2b-abfb-058cb5f4ea12 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:05.450356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc4a1697-b94f-4c2b-abfb-058cb5f4ea12 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:05.476907 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bc4a1697-b94f-4c2b-abfb-058cb5f4ea12 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.041082 Oct 29 03:32:05.477581 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3355/6669] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Oct 29 03:32:05 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5/os-server-password => generated 116 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:32:10.955575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-524912026", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "3ff4207c-94d6-45c1-8298-fcb4ec32842f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-979256399", "security_groups": [{"name": "tempest-secgroup-smoke-1347745711"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:11.081590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] validate_networks() for [('3ff4207c-94d6-45c1-8298-fcb4ec32842f', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:32:11.250403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:11.485083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:32:11.485542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:32:11.486060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:32:11.486496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:32:11.486909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:32:11.496778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:11.497263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:11.497697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:11.498468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:11.498923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:11.499344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:11.517099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:32:11.522185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Getting quotas for user 6988b3809252496ca2f97a1f6eff5825 and project 1d8e5b0759e64bc5a2118d6ab364bec3. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:32:11.535303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:32:11.537644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:32:11.586430 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-82fe1025-1c06-4c6e-9d78-dec74d041914 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.635683 Oct 29 03:32:11.587106 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3315/6670] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:32:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:32:11.599390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d31374bc-ecc3-4767-939d-c77702412918 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:11.600065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d31374bc-ecc3-4767-939d-c77702412918 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:11.672627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d31374bc-ecc3-4767-939d-c77702412918 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:11.680545 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d31374bc-ecc3-4767-939d-c77702412918 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1265 microversion: 2.1 time: 0.085468 Oct 29 03:32:11.682217 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3356/6671] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:11 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:32:12.706814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c50371f3-c08b-4e47-8b36-ed7bc2aa2cc3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:12.708557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c50371f3-c08b-4e47-8b36-ed7bc2aa2cc3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:12.722875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c50371f3-c08b-4e47-8b36-ed7bc2aa2cc3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:12.723610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c50371f3-c08b-4e47-8b36-ed7bc2aa2cc3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:12.724397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c50371f3-c08b-4e47-8b36-ed7bc2aa2cc3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:12.725405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c50371f3-c08b-4e47-8b36-ed7bc2aa2cc3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:12.726810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c50371f3-c08b-4e47-8b36-ed7bc2aa2cc3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:12.727436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c50371f3-c08b-4e47-8b36-ed7bc2aa2cc3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:12.810786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c50371f3-c08b-4e47-8b36-ed7bc2aa2cc3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:12.826806 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c50371f3-c08b-4e47-8b36-ed7bc2aa2cc3 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1335 microversion: 2.1 time: 0.126995 Oct 29 03:32:12.827416 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3316/6672] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:12 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1335 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:13.853272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-26bb762b-d7e7-4360-8e5e-861cf6f7d574 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:13.853994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-26bb762b-d7e7-4360-8e5e-861cf6f7d574 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:13.862339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26bb762b-d7e7-4360-8e5e-861cf6f7d574 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:13.862813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26bb762b-d7e7-4360-8e5e-861cf6f7d574 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:13.863434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26bb762b-d7e7-4360-8e5e-861cf6f7d574 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:13.864131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26bb762b-d7e7-4360-8e5e-861cf6f7d574 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:13.864576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26bb762b-d7e7-4360-8e5e-861cf6f7d574 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:13.864999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26bb762b-d7e7-4360-8e5e-861cf6f7d574 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:14.119168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-26bb762b-d7e7-4360-8e5e-861cf6f7d574 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:14.127399 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-26bb762b-d7e7-4360-8e5e-861cf6f7d574 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1391 microversion: 2.1 time: 0.279739 Oct 29 03:32:14.127958 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3357/6673] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:13 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1391 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:14.273379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-2bd94a56-7f68-4cf3-bdc2-37b3b20e3f4e req-3345de8c-b9c3-4db4-9dd5-f32e39e12867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8a0c90-bc9d-47a9-a41c-77432b1094fc", "tag": "947aae1c-2acc-4913-8d65-c047827ac9c3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:14.285047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2bd94a56-7f68-4cf3-bdc2-37b3b20e3f4e req-3345de8c-b9c3-4db4-9dd5-f32e39e12867 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:14.285589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2bd94a56-7f68-4cf3-bdc2-37b3b20e3f4e req-3345de8c-b9c3-4db4-9dd5-f32e39e12867 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:14.286274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2bd94a56-7f68-4cf3-bdc2-37b3b20e3f4e req-3345de8c-b9c3-4db4-9dd5-f32e39e12867 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:14.299019 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-2bd94a56-7f68-4cf3-bdc2-37b3b20e3f4e req-3345de8c-b9c3-4db4-9dd5-f32e39e12867 service nova] Creating event network-changed:947aae1c-2acc-4913-8d65-c047827ac9c3 for instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc on n-h2-862964-4 Oct 29 03:32:14.304075 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-2bd94a56-7f68-4cf3-bdc2-37b3b20e3f4e req-3345de8c-b9c3-4db4-9dd5-f32e39e12867 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034868 Oct 29 03:32:14.304698 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3317/6674] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:32:15.155345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c809323e-a82e-4084-8fea-9e84acd36f0e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:15.155989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c809323e-a82e-4084-8fea-9e84acd36f0e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:15.166306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c809323e-a82e-4084-8fea-9e84acd36f0e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:15.166786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c809323e-a82e-4084-8fea-9e84acd36f0e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:15.167217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c809323e-a82e-4084-8fea-9e84acd36f0e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:15.167906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c809323e-a82e-4084-8fea-9e84acd36f0e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:15.168353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c809323e-a82e-4084-8fea-9e84acd36f0e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:15.168773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c809323e-a82e-4084-8fea-9e84acd36f0e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:15.304246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c809323e-a82e-4084-8fea-9e84acd36f0e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:15.306751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:15.313439 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c809323e-a82e-4084-8fea-9e84acd36f0e tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1391 microversion: 2.1 time: 0.164844 Oct 29 03:32:15.314011 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3358/6675] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:15 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:16.343437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0fe74d60-fcc0-4158-8434-a6a581c76d97 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:16.344601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0fe74d60-fcc0-4158-8434-a6a581c76d97 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:16.347776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:16.356005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe74d60-fcc0-4158-8434-a6a581c76d97 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:16.356469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe74d60-fcc0-4158-8434-a6a581c76d97 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:16.357054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe74d60-fcc0-4158-8434-a6a581c76d97 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:16.357754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe74d60-fcc0-4158-8434-a6a581c76d97 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:16.358255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe74d60-fcc0-4158-8434-a6a581c76d97 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:16.358672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe74d60-fcc0-4158-8434-a6a581c76d97 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:16.499827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0fe74d60-fcc0-4158-8434-a6a581c76d97 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:16.507464 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0fe74d60-fcc0-4158-8434-a6a581c76d97 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1391 microversion: 2.1 time: 0.173037 Oct 29 03:32:16.508045 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3318/6676] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:16 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:17.535657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5c4b6a96-0a47-4069-98b8-a1feff601a50 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:17.536662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5c4b6a96-0a47-4069-98b8-a1feff601a50 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:17.540835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:17.552394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c4b6a96-0a47-4069-98b8-a1feff601a50 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:17.553203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c4b6a96-0a47-4069-98b8-a1feff601a50 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:17.554015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c4b6a96-0a47-4069-98b8-a1feff601a50 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:17.555150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c4b6a96-0a47-4069-98b8-a1feff601a50 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:17.555904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c4b6a96-0a47-4069-98b8-a1feff601a50 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:17.556759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c4b6a96-0a47-4069-98b8-a1feff601a50 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:17.688688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5c4b6a96-0a47-4069-98b8-a1feff601a50 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:17.696600 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5c4b6a96-0a47-4069-98b8-a1feff601a50 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1391 microversion: 2.1 time: 0.168429 Oct 29 03:32:17.697177 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3359/6677] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:17 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:18.508339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9e3071c1-20df-4394-9557-072a29886fa5 req-62de033e-8d1e-42e7-9545-33cdc24e756d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8a0c90-bc9d-47a9-a41c-77432b1094fc", "name": "network-vif-plugged", "status": "completed", "tag": "947aae1c-2acc-4913-8d65-c047827ac9c3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:18.518713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9e3071c1-20df-4394-9557-072a29886fa5 req-62de033e-8d1e-42e7-9545-33cdc24e756d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:18.519217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9e3071c1-20df-4394-9557-072a29886fa5 req-62de033e-8d1e-42e7-9545-33cdc24e756d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:18.519627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9e3071c1-20df-4394-9557-072a29886fa5 req-62de033e-8d1e-42e7-9545-33cdc24e756d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:18.533844 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9e3071c1-20df-4394-9557-072a29886fa5 req-62de033e-8d1e-42e7-9545-33cdc24e756d service nova] Creating event network-vif-plugged:947aae1c-2acc-4913-8d65-c047827ac9c3 for instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc on n-h2-862964-4 Oct 29 03:32:18.538852 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9e3071c1-20df-4394-9557-072a29886fa5 req-62de033e-8d1e-42e7-9545-33cdc24e756d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034333 Oct 29 03:32:18.539632 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3319/6678] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:32:18.723419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e6c1d3fb-c2de-4326-94d9-233fabdfbbd1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:18.724022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e6c1d3fb-c2de-4326-94d9-233fabdfbbd1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:18.732988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6c1d3fb-c2de-4326-94d9-233fabdfbbd1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:18.733475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6c1d3fb-c2de-4326-94d9-233fabdfbbd1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:18.733965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6c1d3fb-c2de-4326-94d9-233fabdfbbd1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:18.734657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6c1d3fb-c2de-4326-94d9-233fabdfbbd1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:18.735104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6c1d3fb-c2de-4326-94d9-233fabdfbbd1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:18.735520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6c1d3fb-c2de-4326-94d9-233fabdfbbd1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:18.868539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e6c1d3fb-c2de-4326-94d9-233fabdfbbd1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:18.876561 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e6c1d3fb-c2de-4326-94d9-233fabdfbbd1 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1391 microversion: 2.1 time: 0.159533 Oct 29 03:32:18.877142 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3360/6679] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:18 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:19.901420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-09cb8d40-2ea6-4d4c-aaf4-da7d16bc0ce6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:19.902306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-09cb8d40-2ea6-4d4c-aaf4-da7d16bc0ce6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:19.908782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09cb8d40-2ea6-4d4c-aaf4-da7d16bc0ce6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:19.909285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09cb8d40-2ea6-4d4c-aaf4-da7d16bc0ce6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:19.909699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09cb8d40-2ea6-4d4c-aaf4-da7d16bc0ce6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:19.910440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09cb8d40-2ea6-4d4c-aaf4-da7d16bc0ce6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:19.910889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09cb8d40-2ea6-4d4c-aaf4-da7d16bc0ce6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:19.911325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-09cb8d40-2ea6-4d4c-aaf4-da7d16bc0ce6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:20.048834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-09cb8d40-2ea6-4d4c-aaf4-da7d16bc0ce6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:20.061497 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-09cb8d40-2ea6-4d4c-aaf4-da7d16bc0ce6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1563 microversion: 2.1 time: 0.165252 Oct 29 03:32:20.062213 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3320/6680] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:19 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:20.086974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e3d0618-161c-480d-9898-a70d3121582b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:20.087727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e3d0618-161c-480d-9898-a70d3121582b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:20.099309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e3d0618-161c-480d-9898-a70d3121582b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:20.100087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e3d0618-161c-480d-9898-a70d3121582b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:20.100788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e3d0618-161c-480d-9898-a70d3121582b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:20.101947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e3d0618-161c-480d-9898-a70d3121582b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:20.102663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e3d0618-161c-480d-9898-a70d3121582b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:20.103314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e3d0618-161c-480d-9898-a70d3121582b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:20.249739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3e3d0618-161c-480d-9898-a70d3121582b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:20.261165 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3e3d0618-161c-480d-9898-a70d3121582b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1563 microversion: 2.1 time: 0.180629 Oct 29 03:32:20.261738 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3361/6681] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:20 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:22.153472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f6e15e26-efcd-4613-8756-03a0b674b990 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:22.154239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f6e15e26-efcd-4613-8756-03a0b674b990 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:22.157176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:22.157957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=10 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:22.158073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b6de1529-e8be-43d6-9558-b608dda9ed40 req-3c91d060-9f0b-421c-9ee2-b642e2fa17c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8a0c90-bc9d-47a9-a41c-77432b1094fc", "tag": "947aae1c-2acc-4913-8d65-c047827ac9c3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:22.163673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e15e26-efcd-4613-8756-03a0b674b990 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:22.164245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e15e26-efcd-4613-8756-03a0b674b990 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:22.164761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e15e26-efcd-4613-8756-03a0b674b990 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:22.165537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e15e26-efcd-4613-8756-03a0b674b990 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:22.166144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e15e26-efcd-4613-8756-03a0b674b990 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:22.166640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e15e26-efcd-4613-8756-03a0b674b990 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:22.172254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:22.175076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b6de1529-e8be-43d6-9558-b608dda9ed40 req-3c91d060-9f0b-421c-9ee2-b642e2fa17c8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:22.175589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b6de1529-e8be-43d6-9558-b608dda9ed40 req-3c91d060-9f0b-421c-9ee2-b642e2fa17c8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:22.176045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b6de1529-e8be-43d6-9558-b608dda9ed40 req-3c91d060-9f0b-421c-9ee2-b642e2fa17c8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:22.189154 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b6de1529-e8be-43d6-9558-b608dda9ed40 req-3c91d060-9f0b-421c-9ee2-b642e2fa17c8 service nova] Creating event network-changed:947aae1c-2acc-4913-8d65-c047827ac9c3 for instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc on n-h2-862964-4 Oct 29 03:32:22.195395 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b6de1529-e8be-43d6-9558-b608dda9ed40 req-3c91d060-9f0b-421c-9ee2-b642e2fa17c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043381 Oct 29 03:32:22.196847 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3362/6682] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:32:22.311904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f6e15e26-efcd-4613-8756-03a0b674b990 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:22.320432 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f6e15e26-efcd-4613-8756-03a0b674b990 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1563 microversion: 2.1 time: 0.171336 Oct 29 03:32:22.321035 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3321/6683] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:22 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:47.619979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-368a073e-1512-42d0-b43e-8b5224f6eecf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:47.622757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-368a073e-1512-42d0-b43e-8b5224f6eecf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:47.625412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=7 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:47.626142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=21 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:47.632610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368a073e-1512-42d0-b43e-8b5224f6eecf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:47.633100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368a073e-1512-42d0-b43e-8b5224f6eecf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:47.633575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368a073e-1512-42d0-b43e-8b5224f6eecf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:47.634293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368a073e-1512-42d0-b43e-8b5224f6eecf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:47.634744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368a073e-1512-42d0-b43e-8b5224f6eecf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:47.635158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368a073e-1512-42d0-b43e-8b5224f6eecf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:47.689265 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-368a073e-1512-42d0-b43e-8b5224f6eecf tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc/action" status: 200 len: 24563 microversion: 2.1 time: 0.074320 Oct 29 03:32:47.690292 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3363/6684] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:32:47 2022] POST /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc/action => generated 24563 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:32:58.799858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:58.803913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:58.806847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:58.807728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=30 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:58.814031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:58.814441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:58.814934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:58.815645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:58.816094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:58.816534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:58.895215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:32:58.895665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:32:58.896124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:32:58.896522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:32:58.896921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:32:58.958443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:58.964406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:58.964882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:58.965314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:58.966037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:58.966506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:58.966916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:58.995641 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-126cbf89-7b45-49b7-b2fd-adaf347a04aa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc/action" status: 202 len: 1137 microversion: 2.1 time: 0.200814 Oct 29 03:32:58.996602 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3322/6685] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:32:58 2022] POST /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc/action => generated 1137 bytes in 203 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 03:32:59.017106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8bc8eda3-51cb-4d10-a902-57bd52e85c25 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:59.018441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8bc8eda3-51cb-4d10-a902-57bd52e85c25 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:59.022212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:59.022862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:59.028554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8bc8eda3-51cb-4d10-a902-57bd52e85c25 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:59.028554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8bc8eda3-51cb-4d10-a902-57bd52e85c25 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:59.028554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8bc8eda3-51cb-4d10-a902-57bd52e85c25 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:59.029174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8bc8eda3-51cb-4d10-a902-57bd52e85c25 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:59.029621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8bc8eda3-51cb-4d10-a902-57bd52e85c25 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:59.030055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8bc8eda3-51cb-4d10-a902-57bd52e85c25 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:59.180087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8bc8eda3-51cb-4d10-a902-57bd52e85c25 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:59.188174 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8bc8eda3-51cb-4d10-a902-57bd52e85c25 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1691 microversion: 2.1 time: 0.175712 Oct 29 03:32:59.188742 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3364/6686] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:59 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:00.215038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f51c8a4b-775c-4c89-ae0d-fedfa9da57f6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:00.215714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f51c8a4b-775c-4c89-ae0d-fedfa9da57f6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:00.223363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f51c8a4b-775c-4c89-ae0d-fedfa9da57f6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:00.223854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f51c8a4b-775c-4c89-ae0d-fedfa9da57f6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:00.224287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f51c8a4b-775c-4c89-ae0d-fedfa9da57f6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:00.225016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f51c8a4b-775c-4c89-ae0d-fedfa9da57f6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:00.225470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f51c8a4b-775c-4c89-ae0d-fedfa9da57f6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:00.225924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f51c8a4b-775c-4c89-ae0d-fedfa9da57f6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:00.363278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f51c8a4b-775c-4c89-ae0d-fedfa9da57f6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:00.372056 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f51c8a4b-775c-4c89-ae0d-fedfa9da57f6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1691 microversion: 2.1 time: 0.162526 Oct 29 03:33:00.372659 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3323/6687] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:00 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:01.398486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a7b92dfb-a978-4e41-b59c-d6ac0399a0ef tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:01.399147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a7b92dfb-a978-4e41-b59c-d6ac0399a0ef tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:01.409330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b92dfb-a978-4e41-b59c-d6ac0399a0ef tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:01.410102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b92dfb-a978-4e41-b59c-d6ac0399a0ef tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:01.410707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b92dfb-a978-4e41-b59c-d6ac0399a0ef tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:01.411699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b92dfb-a978-4e41-b59c-d6ac0399a0ef tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:01.412324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b92dfb-a978-4e41-b59c-d6ac0399a0ef tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:01.412916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a7b92dfb-a978-4e41-b59c-d6ac0399a0ef tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:01.553369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a7b92dfb-a978-4e41-b59c-d6ac0399a0ef tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:01.565583 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a7b92dfb-a978-4e41-b59c-d6ac0399a0ef tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1691 microversion: 2.1 time: 0.172636 Oct 29 03:33:01.566457 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3365/6688] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:01 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:02.591856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f2b23cf7-1e77-4e5a-9a72-54bf94054ef0 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:02.592452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f2b23cf7-1e77-4e5a-9a72-54bf94054ef0 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:02.599181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b23cf7-1e77-4e5a-9a72-54bf94054ef0 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:02.599742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b23cf7-1e77-4e5a-9a72-54bf94054ef0 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:02.600237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b23cf7-1e77-4e5a-9a72-54bf94054ef0 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:02.601028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b23cf7-1e77-4e5a-9a72-54bf94054ef0 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:02.601505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b23cf7-1e77-4e5a-9a72-54bf94054ef0 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:02.601921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b23cf7-1e77-4e5a-9a72-54bf94054ef0 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:02.739886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f2b23cf7-1e77-4e5a-9a72-54bf94054ef0 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:02.748552 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f2b23cf7-1e77-4e5a-9a72-54bf94054ef0 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1691 microversion: 2.1 time: 0.160648 Oct 29 03:33:02.749108 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3324/6689] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:02 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:03.772859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-86711b02-79e4-4ab0-97ec-c75995971a24 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:03.773531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86711b02-79e4-4ab0-97ec-c75995971a24 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:03.781031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86711b02-79e4-4ab0-97ec-c75995971a24 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:03.781586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86711b02-79e4-4ab0-97ec-c75995971a24 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:03.782010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86711b02-79e4-4ab0-97ec-c75995971a24 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:03.782749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86711b02-79e4-4ab0-97ec-c75995971a24 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:03.783204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86711b02-79e4-4ab0-97ec-c75995971a24 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:03.783625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86711b02-79e4-4ab0-97ec-c75995971a24 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:03.922679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-86711b02-79e4-4ab0-97ec-c75995971a24 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:03.930517 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-86711b02-79e4-4ab0-97ec-c75995971a24 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1691 microversion: 2.1 time: 0.161721 Oct 29 03:33:03.931069 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3366/6690] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:03 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:04.955016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-43afa320-49cb-450e-8017-d8c307ce15ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:04.955734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-43afa320-49cb-450e-8017-d8c307ce15ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:04.967043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43afa320-49cb-450e-8017-d8c307ce15ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:04.967848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43afa320-49cb-450e-8017-d8c307ce15ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:04.968609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43afa320-49cb-450e-8017-d8c307ce15ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:04.969786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43afa320-49cb-450e-8017-d8c307ce15ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:04.970630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43afa320-49cb-450e-8017-d8c307ce15ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:04.971340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43afa320-49cb-450e-8017-d8c307ce15ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:05.119948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-43afa320-49cb-450e-8017-d8c307ce15ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:05.132139 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-43afa320-49cb-450e-8017-d8c307ce15ae tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1691 microversion: 2.1 time: 0.181560 Oct 29 03:33:05.132750 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3325/6691] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:04 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:06.158217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-034a537e-a7b0-49f2-8ae6-a84f5b0b4359 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:06.158801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-034a537e-a7b0-49f2-8ae6-a84f5b0b4359 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:06.167176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-034a537e-a7b0-49f2-8ae6-a84f5b0b4359 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:06.167780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-034a537e-a7b0-49f2-8ae6-a84f5b0b4359 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:06.168269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-034a537e-a7b0-49f2-8ae6-a84f5b0b4359 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:06.169258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-034a537e-a7b0-49f2-8ae6-a84f5b0b4359 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:06.169765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-034a537e-a7b0-49f2-8ae6-a84f5b0b4359 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:06.170245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-034a537e-a7b0-49f2-8ae6-a84f5b0b4359 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:06.304997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-034a537e-a7b0-49f2-8ae6-a84f5b0b4359 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:06.312965 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-034a537e-a7b0-49f2-8ae6-a84f5b0b4359 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1691 microversion: 2.1 time: 0.159735 Oct 29 03:33:06.313538 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3367/6692] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:06 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:07.336800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1e52a15a-0940-49b8-8216-79f09eaa42cc tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:07.337363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1e52a15a-0940-49b8-8216-79f09eaa42cc tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:07.344635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e52a15a-0940-49b8-8216-79f09eaa42cc tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:07.345117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e52a15a-0940-49b8-8216-79f09eaa42cc tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:07.345539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e52a15a-0940-49b8-8216-79f09eaa42cc tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:07.346278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e52a15a-0940-49b8-8216-79f09eaa42cc tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:07.346724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e52a15a-0940-49b8-8216-79f09eaa42cc tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:07.347126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1e52a15a-0940-49b8-8216-79f09eaa42cc tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:07.489385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1e52a15a-0940-49b8-8216-79f09eaa42cc tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:07.501891 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1e52a15a-0940-49b8-8216-79f09eaa42cc tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1691 microversion: 2.1 time: 0.168746 Oct 29 03:33:07.502714 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3326/6693] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:07 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:08.528254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-67ff1d74-5a47-40fa-977d-0ece42d81625 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:08.528820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-67ff1d74-5a47-40fa-977d-0ece42d81625 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:08.536080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67ff1d74-5a47-40fa-977d-0ece42d81625 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:08.536568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67ff1d74-5a47-40fa-977d-0ece42d81625 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:08.536998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67ff1d74-5a47-40fa-977d-0ece42d81625 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:08.537690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67ff1d74-5a47-40fa-977d-0ece42d81625 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:08.538198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67ff1d74-5a47-40fa-977d-0ece42d81625 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:08.538620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67ff1d74-5a47-40fa-977d-0ece42d81625 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:08.686334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-67ff1d74-5a47-40fa-977d-0ece42d81625 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:08.698113 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-67ff1d74-5a47-40fa-977d-0ece42d81625 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1691 microversion: 2.1 time: 0.174675 Oct 29 03:33:08.699134 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3368/6694] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:08 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:09.730325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a68cfcde-532c-4212-85ee-e342d2e6daaa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:09.730936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a68cfcde-532c-4212-85ee-e342d2e6daaa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:09.738461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a68cfcde-532c-4212-85ee-e342d2e6daaa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:09.738942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a68cfcde-532c-4212-85ee-e342d2e6daaa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:09.739399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a68cfcde-532c-4212-85ee-e342d2e6daaa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:09.740104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a68cfcde-532c-4212-85ee-e342d2e6daaa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:09.740865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a68cfcde-532c-4212-85ee-e342d2e6daaa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:09.741323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a68cfcde-532c-4212-85ee-e342d2e6daaa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:09.901985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a68cfcde-532c-4212-85ee-e342d2e6daaa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:09.910015 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a68cfcde-532c-4212-85ee-e342d2e6daaa tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1691 microversion: 2.1 time: 0.184962 Oct 29 03:33:09.910597 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3327/6695] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:09 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:10.935809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b3be9872-94f6-4271-84ff-6817af5c51a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:10.936393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b3be9872-94f6-4271-84ff-6817af5c51a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:10.943530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3be9872-94f6-4271-84ff-6817af5c51a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:10.944046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3be9872-94f6-4271-84ff-6817af5c51a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:10.944486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3be9872-94f6-4271-84ff-6817af5c51a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:10.945184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3be9872-94f6-4271-84ff-6817af5c51a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:10.945636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3be9872-94f6-4271-84ff-6817af5c51a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:10.946097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3be9872-94f6-4271-84ff-6817af5c51a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:11.079784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3be9872-94f6-4271-84ff-6817af5c51a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:11.091417 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b3be9872-94f6-4271-84ff-6817af5c51a6 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1709 microversion: 2.1 time: 0.159948 Oct 29 03:33:11.092156 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3369/6696] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:10 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:12.120350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d4c15a98-aed1-4aaa-8c27-f83a48bbd571 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:12.120993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d4c15a98-aed1-4aaa-8c27-f83a48bbd571 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:12.128364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4c15a98-aed1-4aaa-8c27-f83a48bbd571 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:12.128897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4c15a98-aed1-4aaa-8c27-f83a48bbd571 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:12.129338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4c15a98-aed1-4aaa-8c27-f83a48bbd571 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:12.130132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4c15a98-aed1-4aaa-8c27-f83a48bbd571 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:12.130581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4c15a98-aed1-4aaa-8c27-f83a48bbd571 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:12.131028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d4c15a98-aed1-4aaa-8c27-f83a48bbd571 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:12.267293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d4c15a98-aed1-4aaa-8c27-f83a48bbd571 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:12.275059 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d4c15a98-aed1-4aaa-8c27-f83a48bbd571 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1697 microversion: 2.1 time: 0.159356 Oct 29 03:33:12.275631 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3328/6697] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:12 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:13.298587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c161799-f93a-4ab3-aa42-9ef0107fc170 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:13.299268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9c161799-f93a-4ab3-aa42-9ef0107fc170 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:13.306519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c161799-f93a-4ab3-aa42-9ef0107fc170 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:13.307000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c161799-f93a-4ab3-aa42-9ef0107fc170 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:13.307493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c161799-f93a-4ab3-aa42-9ef0107fc170 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:13.308119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c161799-f93a-4ab3-aa42-9ef0107fc170 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:13.308565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c161799-f93a-4ab3-aa42-9ef0107fc170 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:13.308989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c161799-f93a-4ab3-aa42-9ef0107fc170 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:13.445766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9c161799-f93a-4ab3-aa42-9ef0107fc170 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:13.454683 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c161799-f93a-4ab3-aa42-9ef0107fc170 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1682 microversion: 2.1 time: 0.160139 Oct 29 03:33:13.455505 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3370/6698] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:13 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:14.899345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ead5bc1c-599e-4f5b-9668-145505d89892 req-dc0f8dd3-ff8b-4a2f-b36d-c441648d5c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8a0c90-bc9d-47a9-a41c-77432b1094fc", "name": "network-vif-plugged", "status": "completed", "tag": "947aae1c-2acc-4913-8d65-c047827ac9c3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:33:14.909143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ead5bc1c-599e-4f5b-9668-145505d89892 req-dc0f8dd3-ff8b-4a2f-b36d-c441648d5c0d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:14.909617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ead5bc1c-599e-4f5b-9668-145505d89892 req-dc0f8dd3-ff8b-4a2f-b36d-c441648d5c0d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:14.910066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ead5bc1c-599e-4f5b-9668-145505d89892 req-dc0f8dd3-ff8b-4a2f-b36d-c441648d5c0d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:14.921472 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ead5bc1c-599e-4f5b-9668-145505d89892 req-dc0f8dd3-ff8b-4a2f-b36d-c441648d5c0d service nova] Creating event network-vif-plugged:947aae1c-2acc-4913-8d65-c047827ac9c3 for instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc on n-h2-862964-4 Oct 29 03:33:14.926652 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ead5bc1c-599e-4f5b-9668-145505d89892 req-dc0f8dd3-ff8b-4a2f-b36d-c441648d5c0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099548 Oct 29 03:33:14.927257 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3329/6699] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:33:39.751368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-86fbcf9a-6a85-421b-a7fa-db7ff710cc0d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:33:39.754570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86fbcf9a-6a85-421b-a7fa-db7ff710cc0d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:39.757752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=14 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:39.759537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=42 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:39.765460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86fbcf9a-6a85-421b-a7fa-db7ff710cc0d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:39.765975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86fbcf9a-6a85-421b-a7fa-db7ff710cc0d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:39.766406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86fbcf9a-6a85-421b-a7fa-db7ff710cc0d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:39.767143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86fbcf9a-6a85-421b-a7fa-db7ff710cc0d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:39.767573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86fbcf9a-6a85-421b-a7fa-db7ff710cc0d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:39.767992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86fbcf9a-6a85-421b-a7fa-db7ff710cc0d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:39.823182 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-86fbcf9a-6a85-421b-a7fa-db7ff710cc0d tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "POST /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc/action" status: 200 len: 24559 microversion: 2.1 time: 0.078109 Oct 29 03:33:39.823838 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3371/6700] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:33:39 2022] POST /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc/action => generated 24559 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:33:51.918462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=20 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:51.920487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:51.926802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2b373f39-0eb0-4e85-81ed-10e13572d535 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:51.926911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:51.927958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2b373f39-0eb0-4e85-81ed-10e13572d535 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:51.928409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:51.935641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b373f39-0eb0-4e85-81ed-10e13572d535 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:51.936119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b373f39-0eb0-4e85-81ed-10e13572d535 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:51.936728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b373f39-0eb0-4e85-81ed-10e13572d535 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:51.937440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b373f39-0eb0-4e85-81ed-10e13572d535 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:51.937921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b373f39-0eb0-4e85-81ed-10e13572d535 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:51.938341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b373f39-0eb0-4e85-81ed-10e13572d535 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:51.967595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2b373f39-0eb0-4e85-81ed-10e13572d535 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:33:52.054449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-61278ba5-e5bc-4427-890c-0f9e9bbad3b0 req-3410baa1-a8ff-4035-88ac-6f00f9466df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8a0c90-bc9d-47a9-a41c-77432b1094fc", "tag": "947aae1c-2acc-4913-8d65-c047827ac9c3"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:33:52.067898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-61278ba5-e5bc-4427-890c-0f9e9bbad3b0 req-3410baa1-a8ff-4035-88ac-6f00f9466df4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:52.068644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-61278ba5-e5bc-4427-890c-0f9e9bbad3b0 req-3410baa1-a8ff-4035-88ac-6f00f9466df4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:52.069266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-61278ba5-e5bc-4427-890c-0f9e9bbad3b0 req-3410baa1-a8ff-4035-88ac-6f00f9466df4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:52.071627 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2b373f39-0eb0-4e85-81ed-10e13572d535 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 204 len: 0 microversion: 2.1 time: 0.155328 Oct 29 03:33:52.072365 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3330/6701] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:33:51 2022] DELETE /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:33:52.082199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-63052033-14a2-4901-9113-fd4a1daa0495 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:52.082615 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-61278ba5-e5bc-4427-890c-0f9e9bbad3b0 req-3410baa1-a8ff-4035-88ac-6f00f9466df4 service nova] Creating event network-changed:947aae1c-2acc-4913-8d65-c047827ac9c3 for instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc on n-h2-862964-4 Oct 29 03:33:52.083060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-63052033-14a2-4901-9113-fd4a1daa0495 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:52.088072 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-61278ba5-e5bc-4427-890c-0f9e9bbad3b0 req-3410baa1-a8ff-4035-88ac-6f00f9466df4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167937 Oct 29 03:33:52.089051 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3372/6702] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:33:52.090136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63052033-14a2-4901-9113-fd4a1daa0495 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:52.090747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63052033-14a2-4901-9113-fd4a1daa0495 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:52.091175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63052033-14a2-4901-9113-fd4a1daa0495 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:52.091928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63052033-14a2-4901-9113-fd4a1daa0495 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:52.092325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63052033-14a2-4901-9113-fd4a1daa0495 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:52.092777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63052033-14a2-4901-9113-fd4a1daa0495 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:52.234752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-63052033-14a2-4901-9113-fd4a1daa0495 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:52.243333 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-63052033-14a2-4901-9113-fd4a1daa0495 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1688 microversion: 2.1 time: 0.165717 Oct 29 03:33:52.244374 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3331/6703] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:52 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:53.276130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1b3dcd33-a27d-4e30-beb6-7e2c2f968354 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:53.277326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b3dcd33-a27d-4e30-beb6-7e2c2f968354 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:53.288091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3dcd33-a27d-4e30-beb6-7e2c2f968354 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:53.288894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3dcd33-a27d-4e30-beb6-7e2c2f968354 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:53.289622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3dcd33-a27d-4e30-beb6-7e2c2f968354 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:53.290838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3dcd33-a27d-4e30-beb6-7e2c2f968354 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:53.291644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3dcd33-a27d-4e30-beb6-7e2c2f968354 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:53.292319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b3dcd33-a27d-4e30-beb6-7e2c2f968354 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:53.518782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b3dcd33-a27d-4e30-beb6-7e2c2f968354 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:53.527964 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1b3dcd33-a27d-4e30-beb6-7e2c2f968354 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1688 microversion: 2.1 time: 0.260519 Oct 29 03:33:53.528485 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3373/6704] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:53 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1688 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:54.407944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-894b19ca-8efe-4915-b90c-c29fb76eaa91 req-5fe528eb-39af-496e-92f3-c00836c2f2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8a0c90-bc9d-47a9-a41c-77432b1094fc", "name": "network-vif-deleted", "tag": "947aae1c-2acc-4913-8d65-c047827ac9c3"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:33:54.417944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-894b19ca-8efe-4915-b90c-c29fb76eaa91 req-5fe528eb-39af-496e-92f3-c00836c2f2b3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:54.418417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-894b19ca-8efe-4915-b90c-c29fb76eaa91 req-5fe528eb-39af-496e-92f3-c00836c2f2b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:54.418837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-894b19ca-8efe-4915-b90c-c29fb76eaa91 req-5fe528eb-39af-496e-92f3-c00836c2f2b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:54.430385 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-894b19ca-8efe-4915-b90c-c29fb76eaa91 req-5fe528eb-39af-496e-92f3-c00836c2f2b3 service nova] Creating event network-vif-deleted:947aae1c-2acc-4913-8d65-c047827ac9c3 for instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc on n-h2-862964-4 Oct 29 03:33:54.435463 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-894b19ca-8efe-4915-b90c-c29fb76eaa91 req-5fe528eb-39af-496e-92f3-c00836c2f2b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127576 Oct 29 03:33:54.436061 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3332/6705] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:33:54.554760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:54.555677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:54.559138 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:33:54.559138 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:33:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc (ip 10.222.0.16) !!! Oct 29 03:33:54.569620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:54.570409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:54.571019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:54.572014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:54.572657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:54.573266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:54.609193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:54.609683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:54.610183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:54.610638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lazy-loading 'fault' on Instance uuid 9f8a0c90-bc9d-47a9-a41c-77432b1094fc {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:33:54.653420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6988b3809252496ca2f97a1f6eff5825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e5b0759e64bc5a2118d6ab364bec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:54.661866 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2af937a1-4e2d-41f8-a824-79bd801a5bd9 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 200 len: 1355 microversion: 2.1 time: 0.112738 Oct 29 03:33:54.662482 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3374/6706] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:54 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 1355 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:55.692268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:55.693400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] [instance: 9f8a0c90-bc9d-47a9-a41c-77432b1094fc] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:55.704157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:55.704948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:55.705665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:55.706843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:55.707597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:55.708293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:55.724639 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] HTTP exception thrown: Instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc could not be found. Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Request method failure captured: Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc HTTP/1.1 Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ10LZQSVueycmVKmxTnPj3nUimr4sccneo7HLm8KXoelgnMvGdJN1ul4_Noy4qlMD9jBc7keg-hfhkO8RJdfVJEtLkxYJxm5hLDbYb4Zkhq0cAALSLv_Q2FcEk-lgwgLiCvqwRZD85031-7BUx5-jlERqTw0IWvFo1WnuKpY-yQSgQ Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 1d8e5b0759e64bc5a2118d6ab364bec3 Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d8e5b0759e64bc5a2118d6ab364bec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d8e5b0759e64bc5a2118d6ab364bec3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d8e5b0759e64bc5a2118d6ab364bec3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d8e5b0759e64bc5a2118d6ab364bec3"}]}] Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 1d8e5b0759e64bc5a2118d6ab364bec3 Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-841069215 Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestNetworkAdvancedServerOps-841069215-project Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 6988b3809252496ca2f97a1f6eff5825 Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestNetworkAdvancedServerOps-841069215-project Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc could not be found. Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '9f8a0c90-bc9d-47a9-a41c-77432b1094fc'} Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc could not be found. Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc could not be found. Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:33:55.726318 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:55.730521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:33:55.730521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:55.730521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:55.730521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:55.730521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:33:55.730521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:33:55.730521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc could not be found. Oct 29 03:33:55.730521 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:33:55.730521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Returning 404 to user: Instance 9f8a0c90-bc9d-47a9-a41c-77432b1094fc could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:33:55.730521 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-65be01ab-7352-4141-91cd-3407857e9e4b tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc" status: 404 len: 111 microversion: 2.1 time: 0.043959 Oct 29 03:33:55.730521 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3333/6707] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:55 2022] GET /compute/v2.1/servers/9f8a0c90-bc9d-47a9-a41c-77432b1094fc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:33:59.105049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-91eec234-9e25-4665-9dcd-1a56887ebf39 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] Calling method '.version_select at 0x7fe1a31ada60>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:59.129441 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-91eec234-9e25-4665-9dcd-1a56887ebf39 tempest-TestNetworkAdvancedServerOps-841069215 tempest-TestNetworkAdvancedServerOps-841069215-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-979256399" status: 202 len: 0 microversion: 2.1 time: 0.028380 Oct 29 03:33:59.130436 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3375/6708] 10.222.0.16 () {58 vars in 1281 bytes} [Sat Oct 29 03:33:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-979256399 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:34:12.434821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1613266254", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5e37b46f-b191-4b2c-b9d6-b120dbe46df2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f5520295-9b65-428a-9f37-5ffc8779f39a"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:34:12.446945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:12.447595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:12.502407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] validate_networks() for [('f5520295-9b65-428a-9f37-5ffc8779f39a', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:34:12.898062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:34:12.898713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:34:12.899189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:34:12.899655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:34:12.900070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:34:12.912975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:12.913592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:12.914166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:12.914943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:12.915499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:12.915998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:12.937059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:34:12.948399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for user 3bf87a4bd94c45fa9b30f01267ec743d and project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:34:13.010963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:34:13.013461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e37b46f-b191-4b2c-b9d6-b120dbe46df2',volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:34:13.160007 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cfd9c8fd-93fe-4285-8c24-4357f1a380be tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729904 Oct 29 03:34:13.160668 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3334/6709] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:34:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:34:13.172723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6a1570a3-21b9-4d5c-a41f-94331784481e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:13.173334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6a1570a3-21b9-4d5c-a41f-94331784481e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:13.188277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=16 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:13.189599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:13.254108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6a1570a3-21b9-4d5c-a41f-94331784481e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:13.262010 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6a1570a3-21b9-4d5c-a41f-94331784481e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1057 microversion: 2.1 time: 0.093167 Oct 29 03:34:13.269849 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3376/6710] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:13 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1057 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:14.285931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-caf10d77-5cb2-4454-82d2-fe6a35f50aef tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:14.286640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-caf10d77-5cb2-4454-82d2-fe6a35f50aef tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:14.294930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf10d77-5cb2-4454-82d2-fe6a35f50aef tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:14.296009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf10d77-5cb2-4454-82d2-fe6a35f50aef tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:14.296605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf10d77-5cb2-4454-82d2-fe6a35f50aef tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:14.297663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf10d77-5cb2-4454-82d2-fe6a35f50aef tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:14.298316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf10d77-5cb2-4454-82d2-fe6a35f50aef tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:14.298735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf10d77-5cb2-4454-82d2-fe6a35f50aef tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:14.365947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-caf10d77-5cb2-4454-82d2-fe6a35f50aef tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:14.374840 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-caf10d77-5cb2-4454-82d2-fe6a35f50aef tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1155 microversion: 2.1 time: 0.093847 Oct 29 03:34:14.375427 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3335/6711] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:14 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1155 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:15.399488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b1ddf061-f8c1-432f-9792-657c64fbbc70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:15.400965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b1ddf061-f8c1-432f-9792-657c64fbbc70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:15.408993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1ddf061-f8c1-432f-9792-657c64fbbc70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:15.409939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1ddf061-f8c1-432f-9792-657c64fbbc70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:15.410429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1ddf061-f8c1-432f-9792-657c64fbbc70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:15.411236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1ddf061-f8c1-432f-9792-657c64fbbc70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:15.411865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1ddf061-f8c1-432f-9792-657c64fbbc70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:15.412507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b1ddf061-f8c1-432f-9792-657c64fbbc70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:15.627281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b1ddf061-f8c1-432f-9792-657c64fbbc70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:15.638331 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b1ddf061-f8c1-432f-9792-657c64fbbc70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1215 microversion: 2.1 time: 0.244232 Oct 29 03:34:15.639318 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3377/6712] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:15 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:34:15.955339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9fde9883-2310-46ac-b602-08ec7c94c2d5 req-8cf15052-87dd-4922-b08f-ec1f7111c0df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39aad702-4f7e-4b05-8e6f-24a6dde73b94", "tag": "d8a7d77e-3903-4f12-b955-ce3cac97cb9b"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:34:15.972835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9fde9883-2310-46ac-b602-08ec7c94c2d5 req-8cf15052-87dd-4922-b08f-ec1f7111c0df service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:15.974514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9fde9883-2310-46ac-b602-08ec7c94c2d5 req-8cf15052-87dd-4922-b08f-ec1f7111c0df service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:15.977034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9fde9883-2310-46ac-b602-08ec7c94c2d5 req-8cf15052-87dd-4922-b08f-ec1f7111c0df service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:16.000668 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9fde9883-2310-46ac-b602-08ec7c94c2d5 req-8cf15052-87dd-4922-b08f-ec1f7111c0df service nova] Creating event network-changed:d8a7d77e-3903-4f12-b955-ce3cac97cb9b for instance 39aad702-4f7e-4b05-8e6f-24a6dde73b94 on n-h2-862964-4 Oct 29 03:34:16.011146 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9fde9883-2310-46ac-b602-08ec7c94c2d5 req-8cf15052-87dd-4922-b08f-ec1f7111c0df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059224 Oct 29 03:34:16.014453 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3336/6713] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:34:16.662786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-33ad7531-667d-4bbb-94e8-1534ad10aebe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:16.663651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-33ad7531-667d-4bbb-94e8-1534ad10aebe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:16.670915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33ad7531-667d-4bbb-94e8-1534ad10aebe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:16.671404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33ad7531-667d-4bbb-94e8-1534ad10aebe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:16.671862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33ad7531-667d-4bbb-94e8-1534ad10aebe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:16.672560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33ad7531-667d-4bbb-94e8-1534ad10aebe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:16.673027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33ad7531-667d-4bbb-94e8-1534ad10aebe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:16.673446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-33ad7531-667d-4bbb-94e8-1534ad10aebe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:16.885758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-33ad7531-667d-4bbb-94e8-1534ad10aebe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:16.899451 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-33ad7531-667d-4bbb-94e8-1534ad10aebe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1215 microversion: 2.1 time: 0.241084 Oct 29 03:34:16.900971 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3378/6714] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:16 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1215 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:17.924269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4a254ba5-72ba-4639-9c29-dc96e88f8ed7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:17.924870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4a254ba5-72ba-4639-9c29-dc96e88f8ed7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:17.932838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a254ba5-72ba-4639-9c29-dc96e88f8ed7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:17.933318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a254ba5-72ba-4639-9c29-dc96e88f8ed7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:17.933749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a254ba5-72ba-4639-9c29-dc96e88f8ed7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:17.934483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a254ba5-72ba-4639-9c29-dc96e88f8ed7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:17.934932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a254ba5-72ba-4639-9c29-dc96e88f8ed7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:17.935347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a254ba5-72ba-4639-9c29-dc96e88f8ed7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:18.073924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4a254ba5-72ba-4639-9c29-dc96e88f8ed7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:18.082011 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4a254ba5-72ba-4639-9c29-dc96e88f8ed7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1215 microversion: 2.1 time: 0.162123 Oct 29 03:34:18.082591 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3337/6715] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:17 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:19.107539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-994017f4-aaa8-4eb4-8a61-88f8f9db25c6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:19.108092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-994017f4-aaa8-4eb4-8a61-88f8f9db25c6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:19.115743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-994017f4-aaa8-4eb4-8a61-88f8f9db25c6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:19.116273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-994017f4-aaa8-4eb4-8a61-88f8f9db25c6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:19.116712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-994017f4-aaa8-4eb4-8a61-88f8f9db25c6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:19.117423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-994017f4-aaa8-4eb4-8a61-88f8f9db25c6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:19.117913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-994017f4-aaa8-4eb4-8a61-88f8f9db25c6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:19.118359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-994017f4-aaa8-4eb4-8a61-88f8f9db25c6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:19.256945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-994017f4-aaa8-4eb4-8a61-88f8f9db25c6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:19.266716 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-994017f4-aaa8-4eb4-8a61-88f8f9db25c6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1215 microversion: 2.1 time: 0.163551 Oct 29 03:34:19.267425 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3379/6716] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:19 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:20.294957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-52eee75d-535c-4f14-806e-7b52899d1575 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:20.295524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-52eee75d-535c-4f14-806e-7b52899d1575 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:20.303258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52eee75d-535c-4f14-806e-7b52899d1575 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:20.303772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52eee75d-535c-4f14-806e-7b52899d1575 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:20.304179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52eee75d-535c-4f14-806e-7b52899d1575 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:20.304875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52eee75d-535c-4f14-806e-7b52899d1575 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:20.305332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52eee75d-535c-4f14-806e-7b52899d1575 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:20.305875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52eee75d-535c-4f14-806e-7b52899d1575 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:20.440018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-52eee75d-535c-4f14-806e-7b52899d1575 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:20.450129 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-52eee75d-535c-4f14-806e-7b52899d1575 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1203 microversion: 2.1 time: 0.160044 Oct 29 03:34:20.450721 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3338/6717] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:20 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:21.477361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f0634367-31e4-4be0-ad60-57ae55f225ce tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:21.478304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f0634367-31e4-4be0-ad60-57ae55f225ce tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:21.486180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0634367-31e4-4be0-ad60-57ae55f225ce tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:21.486640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0634367-31e4-4be0-ad60-57ae55f225ce tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:21.487072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0634367-31e4-4be0-ad60-57ae55f225ce tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:21.487746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0634367-31e4-4be0-ad60-57ae55f225ce tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:21.488197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0634367-31e4-4be0-ad60-57ae55f225ce tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:21.488612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0634367-31e4-4be0-ad60-57ae55f225ce tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:21.625486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f0634367-31e4-4be0-ad60-57ae55f225ce tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:21.636945 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f0634367-31e4-4be0-ad60-57ae55f225ce tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1203 microversion: 2.1 time: 0.166888 Oct 29 03:34:21.637534 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3380/6718] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:21 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:22.663878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-31f75975-a20c-4d45-ab86-a954318c8443 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:22.664488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-31f75975-a20c-4d45-ab86-a954318c8443 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:22.674142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31f75975-a20c-4d45-ab86-a954318c8443 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:22.674710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31f75975-a20c-4d45-ab86-a954318c8443 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:22.675307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31f75975-a20c-4d45-ab86-a954318c8443 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:22.676423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31f75975-a20c-4d45-ab86-a954318c8443 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:22.677034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31f75975-a20c-4d45-ab86-a954318c8443 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:22.677632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31f75975-a20c-4d45-ab86-a954318c8443 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:22.827740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-31f75975-a20c-4d45-ab86-a954318c8443 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:22.840209 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-31f75975-a20c-4d45-ab86-a954318c8443 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1203 microversion: 2.1 time: 0.182309 Oct 29 03:34:22.841035 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3339/6719] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:22 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1203 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:23.864999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ff340cf5-0f17-49b4-befd-5ef93765478e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:23.865973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ff340cf5-0f17-49b4-befd-5ef93765478e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:23.867993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:23.873974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff340cf5-0f17-49b4-befd-5ef93765478e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:23.874465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff340cf5-0f17-49b4-befd-5ef93765478e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:23.874897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff340cf5-0f17-49b4-befd-5ef93765478e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:23.875635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff340cf5-0f17-49b4-befd-5ef93765478e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:23.876092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff340cf5-0f17-49b4-befd-5ef93765478e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:23.876513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff340cf5-0f17-49b4-befd-5ef93765478e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:24.306067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ff340cf5-0f17-49b4-befd-5ef93765478e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:24.314956 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ff340cf5-0f17-49b4-befd-5ef93765478e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1203 microversion: 2.1 time: 0.454444 Oct 29 03:34:24.315528 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3381/6720] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:23 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1203 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:25.338486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8ce94b3f-d2b9-48fb-a3b2-87e15718c7b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:25.339057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8ce94b3f-d2b9-48fb-a3b2-87e15718c7b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:25.341100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:25.341757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:25.348330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce94b3f-d2b9-48fb-a3b2-87e15718c7b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:25.348801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce94b3f-d2b9-48fb-a3b2-87e15718c7b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:25.349226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce94b3f-d2b9-48fb-a3b2-87e15718c7b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:25.349939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce94b3f-d2b9-48fb-a3b2-87e15718c7b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:25.350382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce94b3f-d2b9-48fb-a3b2-87e15718c7b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:25.350794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ce94b3f-d2b9-48fb-a3b2-87e15718c7b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:25.499752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8ce94b3f-d2b9-48fb-a3b2-87e15718c7b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:25.507860 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8ce94b3f-d2b9-48fb-a3b2-87e15718c7b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1203 microversion: 2.1 time: 0.173345 Oct 29 03:34:25.508463 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3340/6721] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:25 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:26.535215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d44e35e-a9bb-49bb-a6ba-7dc4204440f8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:26.536254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d44e35e-a9bb-49bb-a6ba-7dc4204440f8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:26.548001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d44e35e-a9bb-49bb-a6ba-7dc4204440f8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:26.548800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d44e35e-a9bb-49bb-a6ba-7dc4204440f8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:26.549547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d44e35e-a9bb-49bb-a6ba-7dc4204440f8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:26.550753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d44e35e-a9bb-49bb-a6ba-7dc4204440f8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:26.551453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d44e35e-a9bb-49bb-a6ba-7dc4204440f8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:26.552122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d44e35e-a9bb-49bb-a6ba-7dc4204440f8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:26.686526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d44e35e-a9bb-49bb-a6ba-7dc4204440f8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:26.694331 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d44e35e-a9bb-49bb-a6ba-7dc4204440f8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1203 microversion: 2.1 time: 0.165836 Oct 29 03:34:26.694911 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3382/6722] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:26 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:27.718744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ed093125-e94a-4333-bd4e-6cb6c4fa4a25 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:27.719325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ed093125-e94a-4333-bd4e-6cb6c4fa4a25 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:27.728389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed093125-e94a-4333-bd4e-6cb6c4fa4a25 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:27.729066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed093125-e94a-4333-bd4e-6cb6c4fa4a25 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:27.729683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed093125-e94a-4333-bd4e-6cb6c4fa4a25 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:27.730930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed093125-e94a-4333-bd4e-6cb6c4fa4a25 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:27.731400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed093125-e94a-4333-bd4e-6cb6c4fa4a25 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:27.731834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed093125-e94a-4333-bd4e-6cb6c4fa4a25 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:27.878627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ed093125-e94a-4333-bd4e-6cb6c4fa4a25 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:27.890450 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ed093125-e94a-4333-bd4e-6cb6c4fa4a25 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1203 microversion: 2.1 time: 0.176285 Oct 29 03:34:27.891250 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3341/6723] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:27 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:28.914483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1532b451-7ee1-49c0-b5df-58d82b738785 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:28.915339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1532b451-7ee1-49c0-b5df-58d82b738785 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:28.924682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1532b451-7ee1-49c0-b5df-58d82b738785 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:28.925442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1532b451-7ee1-49c0-b5df-58d82b738785 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:28.926052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1532b451-7ee1-49c0-b5df-58d82b738785 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:28.926893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1532b451-7ee1-49c0-b5df-58d82b738785 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:28.927349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1532b451-7ee1-49c0-b5df-58d82b738785 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:28.927767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1532b451-7ee1-49c0-b5df-58d82b738785 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:29.072890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1532b451-7ee1-49c0-b5df-58d82b738785 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:29.081069 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1532b451-7ee1-49c0-b5df-58d82b738785 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1203 microversion: 2.1 time: 0.170971 Oct 29 03:34:29.081660 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3383/6724] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:28 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:29.176858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8a8152ca-5d1d-4e15-8acb-f872b993e6a4 req-3f6c276b-3e62-4d21-9dca-4134f80bdb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39aad702-4f7e-4b05-8e6f-24a6dde73b94", "name": "network-vif-plugged", "status": "completed", "tag": "d8a7d77e-3903-4f12-b955-ce3cac97cb9b"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:34:29.188302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8a8152ca-5d1d-4e15-8acb-f872b993e6a4 req-3f6c276b-3e62-4d21-9dca-4134f80bdb2c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:29.189481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8a8152ca-5d1d-4e15-8acb-f872b993e6a4 req-3f6c276b-3e62-4d21-9dca-4134f80bdb2c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:29.189481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8a8152ca-5d1d-4e15-8acb-f872b993e6a4 req-3f6c276b-3e62-4d21-9dca-4134f80bdb2c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:29.200812 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8a8152ca-5d1d-4e15-8acb-f872b993e6a4 req-3f6c276b-3e62-4d21-9dca-4134f80bdb2c service nova] Creating event network-vif-plugged:d8a7d77e-3903-4f12-b955-ce3cac97cb9b for instance 39aad702-4f7e-4b05-8e6f-24a6dde73b94 on n-h2-862964-4 Oct 29 03:34:29.206140 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8a8152ca-5d1d-4e15-8acb-f872b993e6a4 req-3f6c276b-3e62-4d21-9dca-4134f80bdb2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033002 Oct 29 03:34:29.206770 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3342/6725] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:34:30.104762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b92b88d-50e3-44b4-90ce-c9cd7761f8c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:30.105427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b92b88d-50e3-44b4-90ce-c9cd7761f8c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:30.112767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b92b88d-50e3-44b4-90ce-c9cd7761f8c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:30.113250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b92b88d-50e3-44b4-90ce-c9cd7761f8c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:30.113645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b92b88d-50e3-44b4-90ce-c9cd7761f8c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:30.114403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b92b88d-50e3-44b4-90ce-c9cd7761f8c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:30.114846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b92b88d-50e3-44b4-90ce-c9cd7761f8c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:30.115604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b92b88d-50e3-44b4-90ce-c9cd7761f8c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:30.253312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2b92b88d-50e3-44b4-90ce-c9cd7761f8c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:30.262120 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b92b88d-50e3-44b4-90ce-c9cd7761f8c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1203 microversion: 2.1 time: 0.161026 Oct 29 03:34:30.262646 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3384/6726] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:30 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:31.294814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-34a33b4f-63de-4827-9444-08cb6a980b42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:31.295509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-34a33b4f-63de-4827-9444-08cb6a980b42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:31.302320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a33b4f-63de-4827-9444-08cb6a980b42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:31.302808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a33b4f-63de-4827-9444-08cb6a980b42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:31.303241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a33b4f-63de-4827-9444-08cb6a980b42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:31.303937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a33b4f-63de-4827-9444-08cb6a980b42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:31.304384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a33b4f-63de-4827-9444-08cb6a980b42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:31.304803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-34a33b4f-63de-4827-9444-08cb6a980b42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:31.451344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-34a33b4f-63de-4827-9444-08cb6a980b42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:31.459742 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-34a33b4f-63de-4827-9444-08cb6a980b42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1390 microversion: 2.1 time: 0.170946 Oct 29 03:34:31.460312 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3343/6727] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:31 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:31.489643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e88d297-40c4-474f-8b77-6f51a51f52e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:31.490560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4e88d297-40c4-474f-8b77-6f51a51f52e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:31.497638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e88d297-40c4-474f-8b77-6f51a51f52e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:31.498150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e88d297-40c4-474f-8b77-6f51a51f52e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:31.498579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e88d297-40c4-474f-8b77-6f51a51f52e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:31.499270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e88d297-40c4-474f-8b77-6f51a51f52e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:31.499723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e88d297-40c4-474f-8b77-6f51a51f52e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:31.500138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e88d297-40c4-474f-8b77-6f51a51f52e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:31.636467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4e88d297-40c4-474f-8b77-6f51a51f52e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:31.648566 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4e88d297-40c4-474f-8b77-6f51a51f52e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1390 microversion: 2.1 time: 0.162565 Oct 29 03:34:31.649324 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3385/6728] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:31 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:31.672050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-22b6aaaa-92e4-490b-8b9b-f277852423f2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:31.672683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-22b6aaaa-92e4-490b-8b9b-f277852423f2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:31.678863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22b6aaaa-92e4-490b-8b9b-f277852423f2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:31.679346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22b6aaaa-92e4-490b-8b9b-f277852423f2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:31.679836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22b6aaaa-92e4-490b-8b9b-f277852423f2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:31.680531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22b6aaaa-92e4-490b-8b9b-f277852423f2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:31.681015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22b6aaaa-92e4-490b-8b9b-f277852423f2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:31.681437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-22b6aaaa-92e4-490b-8b9b-f277852423f2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:31.811709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-22b6aaaa-92e4-490b-8b9b-f277852423f2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:31.819898 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-22b6aaaa-92e4-490b-8b9b-f277852423f2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1390 microversion: 2.1 time: 0.151722 Oct 29 03:34:31.820479 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3344/6729] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:31 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:31.842256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-66434614-d7ac-4234-84a9-3964bddf3749 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:31.842740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-66434614-d7ac-4234-84a9-3964bddf3749 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:31.848840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66434614-d7ac-4234-84a9-3964bddf3749 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:31.849421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66434614-d7ac-4234-84a9-3964bddf3749 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:31.849945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66434614-d7ac-4234-84a9-3964bddf3749 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:31.850659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66434614-d7ac-4234-84a9-3964bddf3749 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:31.851080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66434614-d7ac-4234-84a9-3964bddf3749 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:31.851492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66434614-d7ac-4234-84a9-3964bddf3749 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:31.880532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-66434614-d7ac-4234-84a9-3964bddf3749 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:34:31.959238 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-66434614-d7ac-4234-84a9-3964bddf3749 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 204 len: 0 microversion: 2.1 time: 0.120757 Oct 29 03:34:31.959940 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3386/6730] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:34:31 2022] DELETE /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:34:31.968774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81143029-b952-4737-bd6a-091af175372e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:31.970115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81143029-b952-4737-bd6a-091af175372e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:31.978818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81143029-b952-4737-bd6a-091af175372e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:31.979525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81143029-b952-4737-bd6a-091af175372e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:31.980132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81143029-b952-4737-bd6a-091af175372e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:31.981325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81143029-b952-4737-bd6a-091af175372e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:31.981757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81143029-b952-4737-bd6a-091af175372e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:31.982197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81143029-b952-4737-bd6a-091af175372e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:32.135038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-81143029-b952-4737-bd6a-091af175372e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:32.143754 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81143029-b952-4737-bd6a-091af175372e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1396 microversion: 2.1 time: 0.179285 Oct 29 03:34:32.144360 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3345/6731] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:31 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1396 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:33.170527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8e762bcd-56bf-4631-8ad7-ea37aa895d5d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:33.171349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8e762bcd-56bf-4631-8ad7-ea37aa895d5d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:33.181689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e762bcd-56bf-4631-8ad7-ea37aa895d5d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:33.182377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e762bcd-56bf-4631-8ad7-ea37aa895d5d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:33.182956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e762bcd-56bf-4631-8ad7-ea37aa895d5d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:33.183896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e762bcd-56bf-4631-8ad7-ea37aa895d5d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:33.184469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e762bcd-56bf-4631-8ad7-ea37aa895d5d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:33.184891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e762bcd-56bf-4631-8ad7-ea37aa895d5d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:33.327277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8e762bcd-56bf-4631-8ad7-ea37aa895d5d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:33.335646 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8e762bcd-56bf-4631-8ad7-ea37aa895d5d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1396 microversion: 2.1 time: 0.171108 Oct 29 03:34:33.336229 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3387/6732] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:33 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1396 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:34.103992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3fd966a1-682f-493e-b00d-a6f8a04b9034 req-ed7ab9f5-baae-4aba-befc-0b16b8f4b5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39aad702-4f7e-4b05-8e6f-24a6dde73b94", "name": "network-vif-deleted", "tag": "d8a7d77e-3903-4f12-b955-ce3cac97cb9b"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:34:34.115520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3fd966a1-682f-493e-b00d-a6f8a04b9034 req-ed7ab9f5-baae-4aba-befc-0b16b8f4b5d5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:34.115878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3fd966a1-682f-493e-b00d-a6f8a04b9034 req-ed7ab9f5-baae-4aba-befc-0b16b8f4b5d5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:34.116296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3fd966a1-682f-493e-b00d-a6f8a04b9034 req-ed7ab9f5-baae-4aba-befc-0b16b8f4b5d5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:34.129120 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3fd966a1-682f-493e-b00d-a6f8a04b9034 req-ed7ab9f5-baae-4aba-befc-0b16b8f4b5d5 service nova] Creating event network-vif-deleted:d8a7d77e-3903-4f12-b955-ce3cac97cb9b for instance 39aad702-4f7e-4b05-8e6f-24a6dde73b94 on n-h2-862964-4 Oct 29 03:34:34.134805 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3fd966a1-682f-493e-b00d-a6f8a04b9034 req-ed7ab9f5-baae-4aba-befc-0b16b8f4b5d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038655 Oct 29 03:34:34.135695 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3346/6733] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:34:34.359948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3db64daf-2298-42c4-b43f-c10fab81f338 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:34.360466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3db64daf-2298-42c4-b43f-c10fab81f338 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:34.368387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3db64daf-2298-42c4-b43f-c10fab81f338 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:34.368813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3db64daf-2298-42c4-b43f-c10fab81f338 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:34.369384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3db64daf-2298-42c4-b43f-c10fab81f338 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:34.370156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3db64daf-2298-42c4-b43f-c10fab81f338 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:34.370600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3db64daf-2298-42c4-b43f-c10fab81f338 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:34.371197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3db64daf-2298-42c4-b43f-c10fab81f338 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:34.436041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3db64daf-2298-42c4-b43f-c10fab81f338 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:34.444332 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3db64daf-2298-42c4-b43f-c10fab81f338 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1188 microversion: 2.1 time: 0.089024 Oct 29 03:34:34.444986 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3388/6734] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:34 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:35.470622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7a8298a3-a249-46cd-8cfc-2fba02d051d4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:35.471335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7a8298a3-a249-46cd-8cfc-2fba02d051d4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:35.478447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8298a3-a249-46cd-8cfc-2fba02d051d4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:35.478930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8298a3-a249-46cd-8cfc-2fba02d051d4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:35.479368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8298a3-a249-46cd-8cfc-2fba02d051d4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:35.480086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8298a3-a249-46cd-8cfc-2fba02d051d4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:35.480583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8298a3-a249-46cd-8cfc-2fba02d051d4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:35.481034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a8298a3-a249-46cd-8cfc-2fba02d051d4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:35.546247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7a8298a3-a249-46cd-8cfc-2fba02d051d4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:35.554511 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7a8298a3-a249-46cd-8cfc-2fba02d051d4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1188 microversion: 2.1 time: 0.089706 Oct 29 03:34:35.555207 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3347/6735] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:35 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:36.578908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1603b839-f8be-4fc9-b705-2f975688e8ab tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:36.579603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1603b839-f8be-4fc9-b705-2f975688e8ab tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:36.587119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1603b839-f8be-4fc9-b705-2f975688e8ab tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:36.587632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1603b839-f8be-4fc9-b705-2f975688e8ab tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:36.588061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1603b839-f8be-4fc9-b705-2f975688e8ab tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:36.588789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1603b839-f8be-4fc9-b705-2f975688e8ab tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:36.589246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1603b839-f8be-4fc9-b705-2f975688e8ab tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:36.589665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1603b839-f8be-4fc9-b705-2f975688e8ab tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:36.653122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1603b839-f8be-4fc9-b705-2f975688e8ab tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:36.664580 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1603b839-f8be-4fc9-b705-2f975688e8ab tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1188 microversion: 2.1 time: 0.089934 Oct 29 03:34:36.665315 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3389/6736] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:36 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:37.688132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eefd788d-e1c0-4d05-84f8-74820ab901b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:37.688696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eefd788d-e1c0-4d05-84f8-74820ab901b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:37.696244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eefd788d-e1c0-4d05-84f8-74820ab901b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:37.696730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eefd788d-e1c0-4d05-84f8-74820ab901b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:37.697167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eefd788d-e1c0-4d05-84f8-74820ab901b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:37.697896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eefd788d-e1c0-4d05-84f8-74820ab901b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:37.698346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eefd788d-e1c0-4d05-84f8-74820ab901b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:37.698772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eefd788d-e1c0-4d05-84f8-74820ab901b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:37.765022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eefd788d-e1c0-4d05-84f8-74820ab901b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:37.773824 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eefd788d-e1c0-4d05-84f8-74820ab901b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 200 len: 1188 microversion: 2.1 time: 0.090101 Oct 29 03:34:37.774434 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3348/6737] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:37 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:38.797675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:38.798333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 39aad702-4f7e-4b05-8e6f-24a6dde73b94] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:38.806091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:38.806785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:38.807279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:38.808000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:38.808453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:38.809031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:38.825280 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance 39aad702-4f7e-4b05-8e6f-24a6dde73b94 could not be found. Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 HTTP/1.1 Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 39aad702-4f7e-4b05-8e6f-24a6dde73b94 could not be found. Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '39aad702-4f7e-4b05-8e6f-24a6dde73b94'} Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39aad702-4f7e-4b05-8e6f-24a6dde73b94 could not be found. Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39aad702-4f7e-4b05-8e6f-24a6dde73b94 could not be found. Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:34:38.827258 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:34:38.830724 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:34:38.830724 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:34:38.830724 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:34:38.830724 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:34:38.830724 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:34:38.830724 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39aad702-4f7e-4b05-8e6f-24a6dde73b94 could not be found. Oct 29 03:34:38.830724 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:34:38.830724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance 39aad702-4f7e-4b05-8e6f-24a6dde73b94 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:34:38.830724 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-75db311f-ad1a-4d8b-bbc2-beb4d1756534 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94" status: 404 len: 111 microversion: 2.1 time: 0.035750 Oct 29 03:34:38.830724 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3390/6738] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:38 2022] GET /compute/v2.1/servers/39aad702-4f7e-4b05-8e6f-24a6dde73b94 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:34:43.806487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1973056166", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9650d6ff-2923-402e-91f3-eca750afe8dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f5520295-9b65-428a-9f37-5ffc8779f39a"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:34:43.817379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:43.870312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] validate_networks() for [('f5520295-9b65-428a-9f37-5ffc8779f39a', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:34:44.399997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:34:44.400645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:34:44.401341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:34:44.401788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:34:44.402501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:34:44.412365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:44.412883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:44.413316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:44.414071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:44.414817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:44.414914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:44.420858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=75 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:44.433840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:34:44.439126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for user 3bf87a4bd94c45fa9b30f01267ec743d and project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:34:44.501878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:34:44.504638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9650d6ff-2923-402e-91f3-eca750afe8dd',volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:34:44.639115 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3bf964df-c3f6-4dd0-afe9-acab07fa071d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836506 Oct 29 03:34:44.639771 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3349/6739] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:34:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:34:44.651312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-537fb4fc-1786-49fa-9465-19feca4380d3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:44.651900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-537fb4fc-1786-49fa-9465-19feca4380d3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:44.655328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:44.710749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-537fb4fc-1786-49fa-9465-19feca4380d3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:44.717686 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-537fb4fc-1786-49fa-9465-19feca4380d3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1057 microversion: 2.1 time: 0.070302 Oct 29 03:34:44.718303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3391/6740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:44 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1057 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:45.742690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-acecf978-d2a2-4f9e-974d-74583b04ab63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:45.743395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-acecf978-d2a2-4f9e-974d-74583b04ab63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:45.750244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acecf978-d2a2-4f9e-974d-74583b04ab63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:45.750840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acecf978-d2a2-4f9e-974d-74583b04ab63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:45.751352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acecf978-d2a2-4f9e-974d-74583b04ab63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:45.752133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acecf978-d2a2-4f9e-974d-74583b04ab63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:45.752653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acecf978-d2a2-4f9e-974d-74583b04ab63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:45.753144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acecf978-d2a2-4f9e-974d-74583b04ab63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:45.816794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-acecf978-d2a2-4f9e-974d-74583b04ab63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:45.824993 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-acecf978-d2a2-4f9e-974d-74583b04ab63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1155 microversion: 2.1 time: 0.087706 Oct 29 03:34:45.825578 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3350/6741] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:45 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1155 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:46.850688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-73b44ebc-777d-4374-9921-d13b1cdbdfc8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:46.852259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-73b44ebc-777d-4374-9921-d13b1cdbdfc8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:46.863128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73b44ebc-777d-4374-9921-d13b1cdbdfc8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:46.864003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73b44ebc-777d-4374-9921-d13b1cdbdfc8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:46.864720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73b44ebc-777d-4374-9921-d13b1cdbdfc8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:46.865893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73b44ebc-777d-4374-9921-d13b1cdbdfc8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:46.866392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73b44ebc-777d-4374-9921-d13b1cdbdfc8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:46.867153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73b44ebc-777d-4374-9921-d13b1cdbdfc8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:46.870153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:47.101096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-73b44ebc-777d-4374-9921-d13b1cdbdfc8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:47.110167 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-73b44ebc-777d-4374-9921-d13b1cdbdfc8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1215 microversion: 2.1 time: 0.265452 Oct 29 03:34:47.110981 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3392/6742] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:46 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:47.312750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6038ec1e-d218-4953-86fb-79289530b66b req-236c4e00-c2a2-4589-bf2f-70651079a309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29836abc-1ee4-47e9-8acc-06411d2b000c", "tag": "1ad2f490-4696-4e6b-a631-602bc4702762"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:34:47.326045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6038ec1e-d218-4953-86fb-79289530b66b req-236c4e00-c2a2-4589-bf2f-70651079a309 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:47.326578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6038ec1e-d218-4953-86fb-79289530b66b req-236c4e00-c2a2-4589-bf2f-70651079a309 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:47.327452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6038ec1e-d218-4953-86fb-79289530b66b req-236c4e00-c2a2-4589-bf2f-70651079a309 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:47.342783 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6038ec1e-d218-4953-86fb-79289530b66b req-236c4e00-c2a2-4589-bf2f-70651079a309 service nova] Creating event network-changed:1ad2f490-4696-4e6b-a631-602bc4702762 for instance 29836abc-1ee4-47e9-8acc-06411d2b000c on n-h2-862964-4 Oct 29 03:34:47.349621 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6038ec1e-d218-4953-86fb-79289530b66b req-236c4e00-c2a2-4589-bf2f-70651079a309 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041537 Oct 29 03:34:47.350610 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3351/6743] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:34:48.134254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-549a6aa0-789a-48e9-b30b-19ba60823ef5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:48.135111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-549a6aa0-789a-48e9-b30b-19ba60823ef5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:48.142986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-549a6aa0-789a-48e9-b30b-19ba60823ef5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:48.143626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-549a6aa0-789a-48e9-b30b-19ba60823ef5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:48.144511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-549a6aa0-789a-48e9-b30b-19ba60823ef5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:48.146670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-549a6aa0-789a-48e9-b30b-19ba60823ef5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:48.146670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-549a6aa0-789a-48e9-b30b-19ba60823ef5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:48.146670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-549a6aa0-789a-48e9-b30b-19ba60823ef5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:48.355277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-549a6aa0-789a-48e9-b30b-19ba60823ef5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:48.363944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-549a6aa0-789a-48e9-b30b-19ba60823ef5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1215 microversion: 2.1 time: 0.233785 Oct 29 03:34:48.364573 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3393/6744] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:48 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1215 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:49.388702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8dba97d8-0b1d-463f-b28b-901c3b59f5ca tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:49.389331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8dba97d8-0b1d-463f-b28b-901c3b59f5ca tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:49.396272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dba97d8-0b1d-463f-b28b-901c3b59f5ca tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:49.396962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dba97d8-0b1d-463f-b28b-901c3b59f5ca tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:49.397408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dba97d8-0b1d-463f-b28b-901c3b59f5ca tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:49.398216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dba97d8-0b1d-463f-b28b-901c3b59f5ca tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:49.398661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dba97d8-0b1d-463f-b28b-901c3b59f5ca tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:49.399073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dba97d8-0b1d-463f-b28b-901c3b59f5ca tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:49.535952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8dba97d8-0b1d-463f-b28b-901c3b59f5ca tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:49.544080 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8dba97d8-0b1d-463f-b28b-901c3b59f5ca tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1215 microversion: 2.1 time: 0.160817 Oct 29 03:34:49.544666 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3352/6745] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:49 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:50.567580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f579b65-f185-4c22-b91b-742fe8d36865 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:50.568146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f579b65-f185-4c22-b91b-742fe8d36865 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:50.576060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f579b65-f185-4c22-b91b-742fe8d36865 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:50.576677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f579b65-f185-4c22-b91b-742fe8d36865 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:50.577115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f579b65-f185-4c22-b91b-742fe8d36865 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:50.577862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f579b65-f185-4c22-b91b-742fe8d36865 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:50.578317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f579b65-f185-4c22-b91b-742fe8d36865 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:50.578731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f579b65-f185-4c22-b91b-742fe8d36865 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:50.714325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8f579b65-f185-4c22-b91b-742fe8d36865 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:50.722654 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f579b65-f185-4c22-b91b-742fe8d36865 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1215 microversion: 2.1 time: 0.159102 Oct 29 03:34:50.723236 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3394/6746] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:50 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:51.747033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a5a2ea1-6eee-4a16-a69e-62b9627b564f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:51.747639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a5a2ea1-6eee-4a16-a69e-62b9627b564f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:51.755184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a5a2ea1-6eee-4a16-a69e-62b9627b564f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:51.755719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a5a2ea1-6eee-4a16-a69e-62b9627b564f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:51.756177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a5a2ea1-6eee-4a16-a69e-62b9627b564f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:51.756904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a5a2ea1-6eee-4a16-a69e-62b9627b564f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:51.757377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a5a2ea1-6eee-4a16-a69e-62b9627b564f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:51.757877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a5a2ea1-6eee-4a16-a69e-62b9627b564f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:51.898115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2a5a2ea1-6eee-4a16-a69e-62b9627b564f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:51.906423 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a5a2ea1-6eee-4a16-a69e-62b9627b564f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1203 microversion: 2.1 time: 0.163591 Oct 29 03:34:51.906994 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3353/6747] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:51 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:52.933731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cf75d647-3d48-42f7-b81c-1bdcd9f017f5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:52.934784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cf75d647-3d48-42f7-b81c-1bdcd9f017f5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:52.946708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf75d647-3d48-42f7-b81c-1bdcd9f017f5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:52.947511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf75d647-3d48-42f7-b81c-1bdcd9f017f5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:52.948224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf75d647-3d48-42f7-b81c-1bdcd9f017f5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:52.949385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf75d647-3d48-42f7-b81c-1bdcd9f017f5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:52.949836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf75d647-3d48-42f7-b81c-1bdcd9f017f5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:52.950272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cf75d647-3d48-42f7-b81c-1bdcd9f017f5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:53.087462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cf75d647-3d48-42f7-b81c-1bdcd9f017f5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:53.095452 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cf75d647-3d48-42f7-b81c-1bdcd9f017f5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1203 microversion: 2.1 time: 0.168302 Oct 29 03:34:53.096034 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3395/6748] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:52 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:54.123152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5f1925b1-57a1-4a24-94b6-8f5b164c2281 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:54.123806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5f1925b1-57a1-4a24-94b6-8f5b164c2281 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:54.131132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f1925b1-57a1-4a24-94b6-8f5b164c2281 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:54.131765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f1925b1-57a1-4a24-94b6-8f5b164c2281 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:54.132243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f1925b1-57a1-4a24-94b6-8f5b164c2281 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:54.133008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f1925b1-57a1-4a24-94b6-8f5b164c2281 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:54.133506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f1925b1-57a1-4a24-94b6-8f5b164c2281 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:54.134005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f1925b1-57a1-4a24-94b6-8f5b164c2281 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:54.271513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5f1925b1-57a1-4a24-94b6-8f5b164c2281 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:54.281409 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5f1925b1-57a1-4a24-94b6-8f5b164c2281 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1203 microversion: 2.1 time: 0.164550 Oct 29 03:34:54.282015 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3354/6749] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:54 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:55.309007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aec21896-c305-4696-8c6c-0a228f983d26 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:55.310143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aec21896-c305-4696-8c6c-0a228f983d26 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:55.313397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:55.322341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aec21896-c305-4696-8c6c-0a228f983d26 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:55.323130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aec21896-c305-4696-8c6c-0a228f983d26 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:55.323916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aec21896-c305-4696-8c6c-0a228f983d26 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:55.324821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aec21896-c305-4696-8c6c-0a228f983d26 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:55.325273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aec21896-c305-4696-8c6c-0a228f983d26 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:55.325691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aec21896-c305-4696-8c6c-0a228f983d26 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:55.460792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aec21896-c305-4696-8c6c-0a228f983d26 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:55.472763 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aec21896-c305-4696-8c6c-0a228f983d26 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1203 microversion: 2.1 time: 0.170283 Oct 29 03:34:55.473592 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3396/6750] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:55 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:56.499978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-caf490dc-6348-4dfe-aac8-99804fd61145 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:56.500633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-caf490dc-6348-4dfe-aac8-99804fd61145 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:56.502949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:56.503707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:56.511288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf490dc-6348-4dfe-aac8-99804fd61145 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:56.511884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf490dc-6348-4dfe-aac8-99804fd61145 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:56.512405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf490dc-6348-4dfe-aac8-99804fd61145 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:56.513197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf490dc-6348-4dfe-aac8-99804fd61145 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:56.513685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf490dc-6348-4dfe-aac8-99804fd61145 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:56.514210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-caf490dc-6348-4dfe-aac8-99804fd61145 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:56.653008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-caf490dc-6348-4dfe-aac8-99804fd61145 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:56.661355 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-caf490dc-6348-4dfe-aac8-99804fd61145 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1203 microversion: 2.1 time: 0.165976 Oct 29 03:34:56.661972 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3355/6751] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:56 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:57.685079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b7d0c66-e786-40e2-8add-6280a4804909 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:57.685635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0b7d0c66-e786-40e2-8add-6280a4804909 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:57.692885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d0c66-e786-40e2-8add-6280a4804909 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:57.693409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d0c66-e786-40e2-8add-6280a4804909 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:57.693840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d0c66-e786-40e2-8add-6280a4804909 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:57.694614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d0c66-e786-40e2-8add-6280a4804909 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:57.695069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d0c66-e786-40e2-8add-6280a4804909 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:57.695500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b7d0c66-e786-40e2-8add-6280a4804909 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:57.831082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b7d0c66-e786-40e2-8add-6280a4804909 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:57.841686 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b7d0c66-e786-40e2-8add-6280a4804909 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1203 microversion: 2.1 time: 0.161436 Oct 29 03:34:57.842278 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3397/6752] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:57 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:58.869490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-35e3ce9e-72f4-4357-bf97-7c6bc40e29a6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:58.870542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-35e3ce9e-72f4-4357-bf97-7c6bc40e29a6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:58.878259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e3ce9e-72f4-4357-bf97-7c6bc40e29a6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:58.878738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e3ce9e-72f4-4357-bf97-7c6bc40e29a6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:58.879164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e3ce9e-72f4-4357-bf97-7c6bc40e29a6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:58.879855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e3ce9e-72f4-4357-bf97-7c6bc40e29a6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:58.880301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e3ce9e-72f4-4357-bf97-7c6bc40e29a6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:58.880717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35e3ce9e-72f4-4357-bf97-7c6bc40e29a6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:59.030180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-35e3ce9e-72f4-4357-bf97-7c6bc40e29a6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:59.038269 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-35e3ce9e-72f4-4357-bf97-7c6bc40e29a6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1203 microversion: 2.1 time: 0.175839 Oct 29 03:34:59.038833 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3356/6753] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:58 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:59.356091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-27b669ab-f988-4759-a886-bbbbffaf9d67 req-865cb460-5d4d-4ad0-9255-13c6049477b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29836abc-1ee4-47e9-8acc-06411d2b000c", "name": "network-vif-plugged", "status": "completed", "tag": "1ad2f490-4696-4e6b-a631-602bc4702762"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:34:59.367292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-27b669ab-f988-4759-a886-bbbbffaf9d67 req-865cb460-5d4d-4ad0-9255-13c6049477b3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:59.367772 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-27b669ab-f988-4759-a886-bbbbffaf9d67 req-865cb460-5d4d-4ad0-9255-13c6049477b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:59.368202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-27b669ab-f988-4759-a886-bbbbffaf9d67 req-865cb460-5d4d-4ad0-9255-13c6049477b3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:59.380021 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-27b669ab-f988-4759-a886-bbbbffaf9d67 req-865cb460-5d4d-4ad0-9255-13c6049477b3 service nova] Creating event network-vif-plugged:1ad2f490-4696-4e6b-a631-602bc4702762 for instance 29836abc-1ee4-47e9-8acc-06411d2b000c on n-h2-862964-4 Oct 29 03:34:59.385174 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-27b669ab-f988-4759-a886-bbbbffaf9d67 req-865cb460-5d4d-4ad0-9255-13c6049477b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032846 Oct 29 03:34:59.385782 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3398/6754] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:35:00.060891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2dc8e48f-fa9f-4ae9-8da2-7de344e20d8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:00.061494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2dc8e48f-fa9f-4ae9-8da2-7de344e20d8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:00.068734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dc8e48f-fa9f-4ae9-8da2-7de344e20d8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:00.069221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dc8e48f-fa9f-4ae9-8da2-7de344e20d8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:00.069650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dc8e48f-fa9f-4ae9-8da2-7de344e20d8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:00.070380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dc8e48f-fa9f-4ae9-8da2-7de344e20d8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:00.070829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dc8e48f-fa9f-4ae9-8da2-7de344e20d8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:00.071243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2dc8e48f-fa9f-4ae9-8da2-7de344e20d8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:00.203080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2dc8e48f-fa9f-4ae9-8da2-7de344e20d8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:00.210970 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2dc8e48f-fa9f-4ae9-8da2-7de344e20d8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1203 microversion: 2.1 time: 0.154169 Oct 29 03:35:00.211561 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3357/6755] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:00 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:01.241058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7983f452-19e4-4714-bfd7-2448e28ce498 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:01.242272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7983f452-19e4-4714-bfd7-2448e28ce498 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:01.253152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7983f452-19e4-4714-bfd7-2448e28ce498 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:01.254006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7983f452-19e4-4714-bfd7-2448e28ce498 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:01.254736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7983f452-19e4-4714-bfd7-2448e28ce498 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:01.255877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7983f452-19e4-4714-bfd7-2448e28ce498 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:01.256625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7983f452-19e4-4714-bfd7-2448e28ce498 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:01.257338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7983f452-19e4-4714-bfd7-2448e28ce498 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:01.394848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7983f452-19e4-4714-bfd7-2448e28ce498 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:01.402792 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7983f452-19e4-4714-bfd7-2448e28ce498 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1390 microversion: 2.1 time: 0.170646 Oct 29 03:35:01.403366 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3399/6756] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:01 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:01.425446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5ddf5aa-ba5c-4206-bc85-78b451159ecf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:01.426096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f5ddf5aa-ba5c-4206-bc85-78b451159ecf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:01.433247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ddf5aa-ba5c-4206-bc85-78b451159ecf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:01.433723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ddf5aa-ba5c-4206-bc85-78b451159ecf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:01.434216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ddf5aa-ba5c-4206-bc85-78b451159ecf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:01.434907 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ddf5aa-ba5c-4206-bc85-78b451159ecf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:01.435353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ddf5aa-ba5c-4206-bc85-78b451159ecf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:01.435766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5ddf5aa-ba5c-4206-bc85-78b451159ecf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:01.570865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f5ddf5aa-ba5c-4206-bc85-78b451159ecf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:01.583320 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5ddf5aa-ba5c-4206-bc85-78b451159ecf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1390 microversion: 2.1 time: 0.161523 Oct 29 03:35:01.584227 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3358/6757] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:01 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:01.608169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-92720f6d-4e97-4a11-b761-aed2b9597373 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:01.608776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-92720f6d-4e97-4a11-b761-aed2b9597373 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:01.615526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92720f6d-4e97-4a11-b761-aed2b9597373 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:01.616006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92720f6d-4e97-4a11-b761-aed2b9597373 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:01.616436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92720f6d-4e97-4a11-b761-aed2b9597373 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:01.617128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92720f6d-4e97-4a11-b761-aed2b9597373 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:01.617577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92720f6d-4e97-4a11-b761-aed2b9597373 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:01.618031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92720f6d-4e97-4a11-b761-aed2b9597373 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:01.757131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-92720f6d-4e97-4a11-b761-aed2b9597373 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:01.769315 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-92720f6d-4e97-4a11-b761-aed2b9597373 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1390 microversion: 2.1 time: 0.164828 Oct 29 03:35:01.770006 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3400/6758] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:01 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:01.792195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e1288b74-10be-40bf-bf2c-9c4b23d8f927 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:01.792706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e1288b74-10be-40bf-bf2c-9c4b23d8f927 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:01.799103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1288b74-10be-40bf-bf2c-9c4b23d8f927 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:01.799584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1288b74-10be-40bf-bf2c-9c4b23d8f927 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:01.800016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1288b74-10be-40bf-bf2c-9c4b23d8f927 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:01.800709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1288b74-10be-40bf-bf2c-9c4b23d8f927 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:01.801143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1288b74-10be-40bf-bf2c-9c4b23d8f927 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:01.801565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1288b74-10be-40bf-bf2c-9c4b23d8f927 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:01.826056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e1288b74-10be-40bf-bf2c-9c4b23d8f927 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:35:01.904922 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e1288b74-10be-40bf-bf2c-9c4b23d8f927 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 204 len: 0 microversion: 2.1 time: 0.116445 Oct 29 03:35:01.905535 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3359/6759] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:35:01 2022] DELETE /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:35:01.915745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3bc40975-e889-4d0d-ab74-111a7b2544bb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:01.916349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3bc40975-e889-4d0d-ab74-111a7b2544bb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:01.922562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc40975-e889-4d0d-ab74-111a7b2544bb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:01.923044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc40975-e889-4d0d-ab74-111a7b2544bb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:01.923470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc40975-e889-4d0d-ab74-111a7b2544bb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:01.924158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc40975-e889-4d0d-ab74-111a7b2544bb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:01.924600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc40975-e889-4d0d-ab74-111a7b2544bb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:01.925012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3bc40975-e889-4d0d-ab74-111a7b2544bb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:02.065728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3bc40975-e889-4d0d-ab74-111a7b2544bb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:02.073634 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3bc40975-e889-4d0d-ab74-111a7b2544bb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1396 microversion: 2.1 time: 0.163527 Oct 29 03:35:02.074239 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3401/6760] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:01 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1396 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:03.102207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c25034f4-8f89-4335-b1a0-4a0c109acd57 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:03.103249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c25034f4-8f89-4335-b1a0-4a0c109acd57 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:03.116635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c25034f4-8f89-4335-b1a0-4a0c109acd57 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:03.117445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c25034f4-8f89-4335-b1a0-4a0c109acd57 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:03.118223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c25034f4-8f89-4335-b1a0-4a0c109acd57 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:03.119381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c25034f4-8f89-4335-b1a0-4a0c109acd57 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:03.120131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c25034f4-8f89-4335-b1a0-4a0c109acd57 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:03.120833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c25034f4-8f89-4335-b1a0-4a0c109acd57 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:03.259659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c25034f4-8f89-4335-b1a0-4a0c109acd57 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:03.271789 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c25034f4-8f89-4335-b1a0-4a0c109acd57 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1396 microversion: 2.1 time: 0.176835 Oct 29 03:35:03.272691 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3360/6761] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:03 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1396 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:04.295946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e759a5c2-99fe-43f5-95a6-297ca6ba54fb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:04.296547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e759a5c2-99fe-43f5-95a6-297ca6ba54fb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:04.305503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e759a5c2-99fe-43f5-95a6-297ca6ba54fb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:04.306307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e759a5c2-99fe-43f5-95a6-297ca6ba54fb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:04.306934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e759a5c2-99fe-43f5-95a6-297ca6ba54fb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:04.307716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e759a5c2-99fe-43f5-95a6-297ca6ba54fb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:04.308149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e759a5c2-99fe-43f5-95a6-297ca6ba54fb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:04.308544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e759a5c2-99fe-43f5-95a6-297ca6ba54fb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:04.332892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-06031259-2e6d-42c6-97ec-ad915ae5a52e req-05de2a5c-376a-44b9-8766-f6fa1d23ce10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29836abc-1ee4-47e9-8acc-06411d2b000c", "name": "network-vif-deleted", "tag": "1ad2f490-4696-4e6b-a631-602bc4702762"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:35:04.344040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-06031259-2e6d-42c6-97ec-ad915ae5a52e req-05de2a5c-376a-44b9-8766-f6fa1d23ce10 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:04.344845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-06031259-2e6d-42c6-97ec-ad915ae5a52e req-05de2a5c-376a-44b9-8766-f6fa1d23ce10 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:04.345612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-06031259-2e6d-42c6-97ec-ad915ae5a52e req-05de2a5c-376a-44b9-8766-f6fa1d23ce10 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:04.357874 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-06031259-2e6d-42c6-97ec-ad915ae5a52e req-05de2a5c-376a-44b9-8766-f6fa1d23ce10 service nova] Creating event network-vif-deleted:1ad2f490-4696-4e6b-a631-602bc4702762 for instance 29836abc-1ee4-47e9-8acc-06411d2b000c on n-h2-862964-4 Oct 29 03:35:04.363859 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-06031259-2e6d-42c6-97ec-ad915ae5a52e req-05de2a5c-376a-44b9-8766-f6fa1d23ce10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035079 Oct 29 03:35:04.365303 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3361/6762] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:35:04.381206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e759a5c2-99fe-43f5-95a6-297ca6ba54fb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:04.394350 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e759a5c2-99fe-43f5-95a6-297ca6ba54fb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1354 microversion: 2.1 time: 0.102045 Oct 29 03:35:04.395204 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3402/6763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:04 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:05.422669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-53fac123-852e-44a9-8c4c-d68134fec633 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:05.423457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-53fac123-852e-44a9-8c4c-d68134fec633 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:05.431385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53fac123-852e-44a9-8c4c-d68134fec633 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:05.432103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53fac123-852e-44a9-8c4c-d68134fec633 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:05.432497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53fac123-852e-44a9-8c4c-d68134fec633 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:05.433405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53fac123-852e-44a9-8c4c-d68134fec633 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:05.434127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53fac123-852e-44a9-8c4c-d68134fec633 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:05.434620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53fac123-852e-44a9-8c4c-d68134fec633 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:05.503311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-53fac123-852e-44a9-8c4c-d68134fec633 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:05.513281 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-53fac123-852e-44a9-8c4c-d68134fec633 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1188 microversion: 2.1 time: 0.095276 Oct 29 03:35:05.513897 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3362/6764] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:05 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:06.539884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-861cf75b-3af1-4306-837e-738e2662c2a4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:06.540496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-861cf75b-3af1-4306-837e-738e2662c2a4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:06.549186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861cf75b-3af1-4306-837e-738e2662c2a4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:06.549658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861cf75b-3af1-4306-837e-738e2662c2a4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:06.550142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861cf75b-3af1-4306-837e-738e2662c2a4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:06.550838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861cf75b-3af1-4306-837e-738e2662c2a4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:06.551285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861cf75b-3af1-4306-837e-738e2662c2a4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:06.551707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-861cf75b-3af1-4306-837e-738e2662c2a4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:06.619610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-861cf75b-3af1-4306-837e-738e2662c2a4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:06.628392 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-861cf75b-3af1-4306-837e-738e2662c2a4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1188 microversion: 2.1 time: 0.095255 Oct 29 03:35:06.628998 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3403/6765] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:06 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:07.654621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b66f04cc-03fa-4cac-8bff-7b004b776166 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:07.655221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b66f04cc-03fa-4cac-8bff-7b004b776166 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:07.662917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f04cc-03fa-4cac-8bff-7b004b776166 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:07.663412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f04cc-03fa-4cac-8bff-7b004b776166 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:07.663846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f04cc-03fa-4cac-8bff-7b004b776166 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:07.664560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f04cc-03fa-4cac-8bff-7b004b776166 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:07.665033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f04cc-03fa-4cac-8bff-7b004b776166 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:07.665447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66f04cc-03fa-4cac-8bff-7b004b776166 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:07.735692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b66f04cc-03fa-4cac-8bff-7b004b776166 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:07.744767 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b66f04cc-03fa-4cac-8bff-7b004b776166 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1188 microversion: 2.1 time: 0.095551 Oct 29 03:35:07.745348 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3363/6766] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:07 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:08.771822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:08.772320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:08.779917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:08.780408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:08.780844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:08.781545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:08.782036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:08.782461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:08.813502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:08.814018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:08.814410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:08.814885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lazy-loading 'fault' on Instance uuid 29836abc-1ee4-47e9-8acc-06411d2b000c {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:35:09.130530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:09.137921 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b156ebb-3851-4c64-a748-6ef3a2668622 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 200 len: 1147 microversion: 2.1 time: 0.370083 Oct 29 03:35:09.138577 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3404/6767] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:08 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 1147 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:10.166249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:10.167235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 29836abc-1ee4-47e9-8acc-06411d2b000c] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:10.175258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:10.175765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:10.176194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:10.176890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:10.177333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:10.177748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:10.191476 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance 29836abc-1ee4-47e9-8acc-06411d2b000c could not be found. Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c HTTP/1.1 Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 29836abc-1ee4-47e9-8acc-06411d2b000c could not be found. Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '29836abc-1ee4-47e9-8acc-06411d2b000c'} Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29836abc-1ee4-47e9-8acc-06411d2b000c could not be found. Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29836abc-1ee4-47e9-8acc-06411d2b000c could not be found. Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:35:10.193141 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:35:10.196563 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:35:10.196563 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:35:10.196563 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:35:10.196563 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:35:10.196563 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:35:10.196563 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29836abc-1ee4-47e9-8acc-06411d2b000c could not be found. Oct 29 03:35:10.196563 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:35:10.196563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance 29836abc-1ee4-47e9-8acc-06411d2b000c could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:35:10.196563 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8f2de71-a526-4333-8fa4-8bb087954bec tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c" status: 404 len: 111 microversion: 2.1 time: 0.034812 Oct 29 03:35:10.196563 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3364/6768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:10 2022] GET /compute/v2.1/servers/29836abc-1ee4-47e9-8acc-06411d2b000c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:35:31.225285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-65945369", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b5026db4-32af-4176-b50e-d9661d388774", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f5520295-9b65-428a-9f37-5ffc8779f39a"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:35:31.235910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=31 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:35:31.236633 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=75 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:35:31.318267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] validate_networks() for [('f5520295-9b65-428a-9f37-5ffc8779f39a', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:35:31.795626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:35:31.796181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:35:31.797130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:35:31.797742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:35:31.798304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:35:31.812029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:31.812503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:31.812924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:31.813645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:31.814115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:31.814531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:31.832555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:35:31.838335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for user 3bf87a4bd94c45fa9b30f01267ec743d and project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:35:31.851418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:35:31.853490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b5026db4-32af-4176-b50e-d9661d388774',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:35:31.942960 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3d5d99b-5478-4ccc-b557-306cc9ad14f0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721603 Oct 29 03:35:31.943616 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3405/6769] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:35:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:35:31.955250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-75efc418-e75a-48b0-ae2f-b74c81923c81 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:31.955852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-75efc418-e75a-48b0-ae2f-b74c81923c81 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:31.958470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:35:31.959107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:35:31.959910 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:35:31.960047 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:35:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 (ip 10.222.0.16) !!! Oct 29 03:35:32.024267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-75efc418-e75a-48b0-ae2f-b74c81923c81 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:32.031739 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-75efc418-e75a-48b0-ae2f-b74c81923c81 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1055 microversion: 2.1 time: 0.080524 Oct 29 03:35:32.032387 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3365/6770] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:31 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1055 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:33.061886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ddd934e8-571b-47a1-89b8-e363afeb3a4d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:33.062435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ddd934e8-571b-47a1-89b8-e363afeb3a4d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:33.069658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddd934e8-571b-47a1-89b8-e363afeb3a4d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:33.070173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddd934e8-571b-47a1-89b8-e363afeb3a4d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:33.070600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddd934e8-571b-47a1-89b8-e363afeb3a4d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:33.071328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddd934e8-571b-47a1-89b8-e363afeb3a4d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:33.071774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddd934e8-571b-47a1-89b8-e363afeb3a4d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:33.072193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddd934e8-571b-47a1-89b8-e363afeb3a4d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:33.147520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ddd934e8-571b-47a1-89b8-e363afeb3a4d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:33.156673 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ddd934e8-571b-47a1-89b8-e363afeb3a4d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1107 microversion: 2.1 time: 0.103616 Oct 29 03:35:33.156673 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3406/6771] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:33 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1107 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:34.179759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-262db742-e75b-4a0d-ac4e-dbb934496409 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:34.180578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-262db742-e75b-4a0d-ac4e-dbb934496409 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:34.188961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-262db742-e75b-4a0d-ac4e-dbb934496409 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:34.189544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-262db742-e75b-4a0d-ac4e-dbb934496409 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:34.190426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-262db742-e75b-4a0d-ac4e-dbb934496409 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:34.191304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-262db742-e75b-4a0d-ac4e-dbb934496409 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:34.191770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-262db742-e75b-4a0d-ac4e-dbb934496409 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:34.192510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-262db742-e75b-4a0d-ac4e-dbb934496409 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:34.332189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-262db742-e75b-4a0d-ac4e-dbb934496409 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:34.344031 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-262db742-e75b-4a0d-ac4e-dbb934496409 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.168104 Oct 29 03:35:34.347271 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3366/6772] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:34 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:34.541223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-eab53853-7bf5-477e-b726-4703fa3afef7 req-ad6174ac-e6ca-4520-a845-291f60a9064c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fba69b57-d519-4ca2-b022-3654c68feca7", "tag": "4dc2b7b6-8e9d-4d7f-bce8-862f1a6e7c5d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:35:34.555088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-eab53853-7bf5-477e-b726-4703fa3afef7 req-ad6174ac-e6ca-4520-a845-291f60a9064c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:34.555976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-eab53853-7bf5-477e-b726-4703fa3afef7 req-ad6174ac-e6ca-4520-a845-291f60a9064c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:34.556644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-eab53853-7bf5-477e-b726-4703fa3afef7 req-ad6174ac-e6ca-4520-a845-291f60a9064c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:34.571581 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-eab53853-7bf5-477e-b726-4703fa3afef7 req-ad6174ac-e6ca-4520-a845-291f60a9064c service nova] Creating event network-changed:4dc2b7b6-8e9d-4d7f-bce8-862f1a6e7c5d for instance fba69b57-d519-4ca2-b022-3654c68feca7 on n-h2-862964-4 Oct 29 03:35:34.577104 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-eab53853-7bf5-477e-b726-4703fa3afef7 req-ad6174ac-e6ca-4520-a845-291f60a9064c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040896 Oct 29 03:35:34.577925 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3407/6773] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:35:35.371448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f2f2583a-aa85-4197-926f-5fc0affde739 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:35.372136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f2f2583a-aa85-4197-926f-5fc0affde739 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:35.379671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f2583a-aa85-4197-926f-5fc0affde739 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:35.380279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f2583a-aa85-4197-926f-5fc0affde739 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:35.380824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f2583a-aa85-4197-926f-5fc0affde739 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:35.381629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f2583a-aa85-4197-926f-5fc0affde739 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:35.382207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f2583a-aa85-4197-926f-5fc0affde739 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:35.382754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2f2583a-aa85-4197-926f-5fc0affde739 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:35.518128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f2f2583a-aa85-4197-926f-5fc0affde739 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:35.528363 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f2f2583a-aa85-4197-926f-5fc0affde739 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.161001 Oct 29 03:35:35.529317 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3367/6774] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:35 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:36.552607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-69b4f183-e3e1-4892-bddf-a5c409c11cb4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:36.553307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-69b4f183-e3e1-4892-bddf-a5c409c11cb4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:36.560822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b4f183-e3e1-4892-bddf-a5c409c11cb4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:36.561038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b4f183-e3e1-4892-bddf-a5c409c11cb4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:36.561460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b4f183-e3e1-4892-bddf-a5c409c11cb4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:36.562191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b4f183-e3e1-4892-bddf-a5c409c11cb4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:36.562632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b4f183-e3e1-4892-bddf-a5c409c11cb4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:36.563046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69b4f183-e3e1-4892-bddf-a5c409c11cb4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:36.725934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69b4f183-e3e1-4892-bddf-a5c409c11cb4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:36.740247 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-69b4f183-e3e1-4892-bddf-a5c409c11cb4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.192599 Oct 29 03:35:36.740859 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3408/6775] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:36 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:37.765676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-75ce2493-15b9-4000-aa9b-f0d53f357d89 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:37.766289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-75ce2493-15b9-4000-aa9b-f0d53f357d89 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:37.774989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75ce2493-15b9-4000-aa9b-f0d53f357d89 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:37.775871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75ce2493-15b9-4000-aa9b-f0d53f357d89 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:37.776559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75ce2493-15b9-4000-aa9b-f0d53f357d89 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:37.777256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75ce2493-15b9-4000-aa9b-f0d53f357d89 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:37.777714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75ce2493-15b9-4000-aa9b-f0d53f357d89 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:37.778166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-75ce2493-15b9-4000-aa9b-f0d53f357d89 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:37.946938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-75ce2493-15b9-4000-aa9b-f0d53f357d89 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:37.956115 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-75ce2493-15b9-4000-aa9b-f0d53f357d89 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.194808 Oct 29 03:35:37.960840 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3368/6776] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:37 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:35:38.979289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-13536550-4e5d-45cf-8c48-c89f520573b4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:38.979947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-13536550-4e5d-45cf-8c48-c89f520573b4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:38.988269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13536550-4e5d-45cf-8c48-c89f520573b4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:38.988766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13536550-4e5d-45cf-8c48-c89f520573b4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:38.989250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13536550-4e5d-45cf-8c48-c89f520573b4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:38.990322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13536550-4e5d-45cf-8c48-c89f520573b4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:38.991045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13536550-4e5d-45cf-8c48-c89f520573b4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:38.991554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-13536550-4e5d-45cf-8c48-c89f520573b4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:39.144596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-13536550-4e5d-45cf-8c48-c89f520573b4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:39.155284 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-13536550-4e5d-45cf-8c48-c89f520573b4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.179915 Oct 29 03:35:39.156626 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3409/6777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:38 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:40.180738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1bacda0e-0bf1-4096-a05b-a0de0079b366 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:40.181452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1bacda0e-0bf1-4096-a05b-a0de0079b366 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:40.188408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bacda0e-0bf1-4096-a05b-a0de0079b366 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:40.188879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bacda0e-0bf1-4096-a05b-a0de0079b366 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:40.189308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bacda0e-0bf1-4096-a05b-a0de0079b366 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:40.190035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bacda0e-0bf1-4096-a05b-a0de0079b366 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:40.190466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bacda0e-0bf1-4096-a05b-a0de0079b366 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:40.190890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bacda0e-0bf1-4096-a05b-a0de0079b366 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:40.328383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1bacda0e-0bf1-4096-a05b-a0de0079b366 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:40.336401 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1bacda0e-0bf1-4096-a05b-a0de0079b366 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.159574 Oct 29 03:35:40.336979 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3369/6778] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:40 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:41.363203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-27b2b08f-3a69-4eb8-8edf-d55bebc045d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:41.364670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-27b2b08f-3a69-4eb8-8edf-d55bebc045d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:41.373669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b2b08f-3a69-4eb8-8edf-d55bebc045d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:41.374805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b2b08f-3a69-4eb8-8edf-d55bebc045d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:41.375454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b2b08f-3a69-4eb8-8edf-d55bebc045d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:41.376243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b2b08f-3a69-4eb8-8edf-d55bebc045d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:41.376960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b2b08f-3a69-4eb8-8edf-d55bebc045d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:41.377461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27b2b08f-3a69-4eb8-8edf-d55bebc045d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:41.520712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-27b2b08f-3a69-4eb8-8edf-d55bebc045d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:41.533226 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-27b2b08f-3a69-4eb8-8edf-d55bebc045d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.176961 Oct 29 03:35:41.533857 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3410/6779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:41 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:42.559515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-750e7284-34ec-4445-b400-e7c0c27a8ebb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:42.560418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-750e7284-34ec-4445-b400-e7c0c27a8ebb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:42.564815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:35:42.572470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-750e7284-34ec-4445-b400-e7c0c27a8ebb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:42.573091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-750e7284-34ec-4445-b400-e7c0c27a8ebb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:42.573734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-750e7284-34ec-4445-b400-e7c0c27a8ebb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:42.574811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-750e7284-34ec-4445-b400-e7c0c27a8ebb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:42.575461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-750e7284-34ec-4445-b400-e7c0c27a8ebb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:42.576109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-750e7284-34ec-4445-b400-e7c0c27a8ebb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:43.012764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-750e7284-34ec-4445-b400-e7c0c27a8ebb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:43.021819 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-750e7284-34ec-4445-b400-e7c0c27a8ebb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.466449 Oct 29 03:35:43.022412 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3370/6780] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:42 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:44.044946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-93c02101-58f1-4382-8f39-9fe217b4715e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:44.045487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-93c02101-58f1-4382-8f39-9fe217b4715e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:44.047580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:35:44.048258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:35:44.055437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93c02101-58f1-4382-8f39-9fe217b4715e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:44.055938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93c02101-58f1-4382-8f39-9fe217b4715e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:44.056368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93c02101-58f1-4382-8f39-9fe217b4715e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:44.057105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93c02101-58f1-4382-8f39-9fe217b4715e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:44.057553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93c02101-58f1-4382-8f39-9fe217b4715e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:44.058002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93c02101-58f1-4382-8f39-9fe217b4715e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:44.193078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-93c02101-58f1-4382-8f39-9fe217b4715e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:44.201148 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-93c02101-58f1-4382-8f39-9fe217b4715e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.160347 Oct 29 03:35:44.201733 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3411/6781] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:44 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:45.227046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e754bdb0-9435-4858-80c7-2dc0d7708dba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:45.227967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e754bdb0-9435-4858-80c7-2dc0d7708dba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:45.236811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e754bdb0-9435-4858-80c7-2dc0d7708dba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:45.237528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e754bdb0-9435-4858-80c7-2dc0d7708dba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:45.238029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e754bdb0-9435-4858-80c7-2dc0d7708dba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:45.238756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e754bdb0-9435-4858-80c7-2dc0d7708dba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:45.239204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e754bdb0-9435-4858-80c7-2dc0d7708dba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:45.239626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e754bdb0-9435-4858-80c7-2dc0d7708dba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:45.379010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e754bdb0-9435-4858-80c7-2dc0d7708dba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:45.387022 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e754bdb0-9435-4858-80c7-2dc0d7708dba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.165376 Oct 29 03:35:45.387603 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3371/6782] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:45 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:46.410667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b67bc2a-baaa-4a8f-b545-4504f37ecea9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:46.411246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b67bc2a-baaa-4a8f-b545-4504f37ecea9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:46.418865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b67bc2a-baaa-4a8f-b545-4504f37ecea9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:46.419349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b67bc2a-baaa-4a8f-b545-4504f37ecea9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:46.419756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b67bc2a-baaa-4a8f-b545-4504f37ecea9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:46.420467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b67bc2a-baaa-4a8f-b545-4504f37ecea9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:46.420917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b67bc2a-baaa-4a8f-b545-4504f37ecea9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:46.421361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b67bc2a-baaa-4a8f-b545-4504f37ecea9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:46.557439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9b67bc2a-baaa-4a8f-b545-4504f37ecea9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:46.566401 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b67bc2a-baaa-4a8f-b545-4504f37ecea9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.159967 Oct 29 03:35:46.566998 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3412/6783] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:46 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:47.588892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b82eadbf-94ff-4164-8b7a-1a94d6b3456a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:47.589497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b82eadbf-94ff-4164-8b7a-1a94d6b3456a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:47.597251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b82eadbf-94ff-4164-8b7a-1a94d6b3456a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:47.597733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b82eadbf-94ff-4164-8b7a-1a94d6b3456a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:47.598209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b82eadbf-94ff-4164-8b7a-1a94d6b3456a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:47.598896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b82eadbf-94ff-4164-8b7a-1a94d6b3456a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:47.599339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b82eadbf-94ff-4164-8b7a-1a94d6b3456a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:47.599752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b82eadbf-94ff-4164-8b7a-1a94d6b3456a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:47.737697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b82eadbf-94ff-4164-8b7a-1a94d6b3456a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:47.745916 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b82eadbf-94ff-4164-8b7a-1a94d6b3456a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1167 microversion: 2.1 time: 0.160935 Oct 29 03:35:47.746507 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3372/6784] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:47 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1167 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:48.773181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4677d126-492d-4de0-9497-9ee3462ef32d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:48.774232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4677d126-492d-4de0-9497-9ee3462ef32d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:48.784722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4677d126-492d-4de0-9497-9ee3462ef32d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:48.785203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4677d126-492d-4de0-9497-9ee3462ef32d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:48.785628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4677d126-492d-4de0-9497-9ee3462ef32d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:48.786356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4677d126-492d-4de0-9497-9ee3462ef32d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:48.786796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4677d126-492d-4de0-9497-9ee3462ef32d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:48.787215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4677d126-492d-4de0-9497-9ee3462ef32d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:48.925025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4677d126-492d-4de0-9497-9ee3462ef32d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:48.933003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4677d126-492d-4de0-9497-9ee3462ef32d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1201 microversion: 2.1 time: 0.166434 Oct 29 03:35:48.933608 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3413/6785] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:48 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1201 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:49.959457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-88d49ad0-28e8-4847-9649-be80ece862f6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:49.960178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-88d49ad0-28e8-4847-9649-be80ece862f6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:49.969344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88d49ad0-28e8-4847-9649-be80ece862f6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:49.969983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88d49ad0-28e8-4847-9649-be80ece862f6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:49.970523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88d49ad0-28e8-4847-9649-be80ece862f6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:49.971387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88d49ad0-28e8-4847-9649-be80ece862f6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:49.971951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88d49ad0-28e8-4847-9649-be80ece862f6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:49.972479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88d49ad0-28e8-4847-9649-be80ece862f6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:50.104166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-88d49ad0-28e8-4847-9649-be80ece862f6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:50.112537 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-88d49ad0-28e8-4847-9649-be80ece862f6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1201 microversion: 2.1 time: 0.157948 Oct 29 03:35:50.113126 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3373/6786] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:49 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1201 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:51.139779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-947443d2-42dc-4dea-ac59-fd05d3f187a7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:51.140972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-947443d2-42dc-4dea-ac59-fd05d3f187a7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:51.152459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-947443d2-42dc-4dea-ac59-fd05d3f187a7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:51.153285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-947443d2-42dc-4dea-ac59-fd05d3f187a7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:51.154062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-947443d2-42dc-4dea-ac59-fd05d3f187a7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:51.155223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-947443d2-42dc-4dea-ac59-fd05d3f187a7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:51.156139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-947443d2-42dc-4dea-ac59-fd05d3f187a7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:51.156722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-947443d2-42dc-4dea-ac59-fd05d3f187a7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:51.304422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-947443d2-42dc-4dea-ac59-fd05d3f187a7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:51.316160 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-947443d2-42dc-4dea-ac59-fd05d3f187a7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1201 microversion: 2.1 time: 0.182818 Oct 29 03:35:51.316870 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3414/6787] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:51 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1201 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:52.348441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dc414835-ebbd-4589-b887-076818d5eabb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:52.349399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dc414835-ebbd-4589-b887-076818d5eabb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:52.360084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc414835-ebbd-4589-b887-076818d5eabb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:52.360800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc414835-ebbd-4589-b887-076818d5eabb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:52.361246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc414835-ebbd-4589-b887-076818d5eabb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:52.361975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc414835-ebbd-4589-b887-076818d5eabb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:52.362433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc414835-ebbd-4589-b887-076818d5eabb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:52.362852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc414835-ebbd-4589-b887-076818d5eabb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:52.498004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dc414835-ebbd-4589-b887-076818d5eabb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:52.506646 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dc414835-ebbd-4589-b887-076818d5eabb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1201 microversion: 2.1 time: 0.165702 Oct 29 03:35:52.507190 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3374/6788] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:52 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1201 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:53.532731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c311b2d-41b8-4de5-a748-b588478ecc13 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:53.533643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4c311b2d-41b8-4de5-a748-b588478ecc13 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:53.543419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c311b2d-41b8-4de5-a748-b588478ecc13 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:53.544029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c311b2d-41b8-4de5-a748-b588478ecc13 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:53.544600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c311b2d-41b8-4de5-a748-b588478ecc13 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:53.545511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c311b2d-41b8-4de5-a748-b588478ecc13 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:53.546143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c311b2d-41b8-4de5-a748-b588478ecc13 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:53.546737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c311b2d-41b8-4de5-a748-b588478ecc13 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:53.683575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4c311b2d-41b8-4de5-a748-b588478ecc13 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:53.691513 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4c311b2d-41b8-4de5-a748-b588478ecc13 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1201 microversion: 2.1 time: 0.165403 Oct 29 03:35:53.692099 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3415/6789] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:53 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1201 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:54.719102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fda97fd5-a538-4fae-9bd0-40fb57b09787 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:54.720027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fda97fd5-a538-4fae-9bd0-40fb57b09787 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:54.728107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fda97fd5-a538-4fae-9bd0-40fb57b09787 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:54.728680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fda97fd5-a538-4fae-9bd0-40fb57b09787 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:54.729159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fda97fd5-a538-4fae-9bd0-40fb57b09787 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:54.729962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fda97fd5-a538-4fae-9bd0-40fb57b09787 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:54.730464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fda97fd5-a538-4fae-9bd0-40fb57b09787 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:54.730928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fda97fd5-a538-4fae-9bd0-40fb57b09787 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:54.886062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fda97fd5-a538-4fae-9bd0-40fb57b09787 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:54.894023 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fda97fd5-a538-4fae-9bd0-40fb57b09787 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1201 microversion: 2.1 time: 0.181391 Oct 29 03:35:54.894589 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3375/6790] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:54 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1201 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:55.916881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cb5f34e4-c929-4675-bcf3-ff1483f48793 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:55.917475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cb5f34e4-c929-4675-bcf3-ff1483f48793 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:55.926541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb5f34e4-c929-4675-bcf3-ff1483f48793 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:55.927025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb5f34e4-c929-4675-bcf3-ff1483f48793 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:55.927457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb5f34e4-c929-4675-bcf3-ff1483f48793 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:55.928188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb5f34e4-c929-4675-bcf3-ff1483f48793 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:55.928634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb5f34e4-c929-4675-bcf3-ff1483f48793 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:55.929052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb5f34e4-c929-4675-bcf3-ff1483f48793 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:56.066851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cb5f34e4-c929-4675-bcf3-ff1483f48793 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:56.074895 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cb5f34e4-c929-4675-bcf3-ff1483f48793 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1201 microversion: 2.1 time: 0.162034 Oct 29 03:35:56.075444 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3416/6791] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:55 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1201 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:57.099678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dbd7e7fc-1c89-480c-98ed-a40dfbbcd970 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:57.100408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dbd7e7fc-1c89-480c-98ed-a40dfbbcd970 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:57.110199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd7e7fc-1c89-480c-98ed-a40dfbbcd970 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:57.110842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd7e7fc-1c89-480c-98ed-a40dfbbcd970 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:57.111411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd7e7fc-1c89-480c-98ed-a40dfbbcd970 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:57.112333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd7e7fc-1c89-480c-98ed-a40dfbbcd970 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:57.113032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd7e7fc-1c89-480c-98ed-a40dfbbcd970 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:57.113587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dbd7e7fc-1c89-480c-98ed-a40dfbbcd970 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:57.265005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dbd7e7fc-1c89-480c-98ed-a40dfbbcd970 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:57.273750 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dbd7e7fc-1c89-480c-98ed-a40dfbbcd970 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1201 microversion: 2.1 time: 0.179649 Oct 29 03:35:57.274361 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3376/6792] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:57 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1201 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:57.780853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-bc780d40-ddea-4cf8-b5b6-fdfcefdd3e82 req-84b79349-ba9b-4993-945c-ebc645fe6d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fba69b57-d519-4ca2-b022-3654c68feca7", "name": "network-vif-plugged", "status": "completed", "tag": "4dc2b7b6-8e9d-4d7f-bce8-862f1a6e7c5d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:35:57.791743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bc780d40-ddea-4cf8-b5b6-fdfcefdd3e82 req-84b79349-ba9b-4993-945c-ebc645fe6d96 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:57.792220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bc780d40-ddea-4cf8-b5b6-fdfcefdd3e82 req-84b79349-ba9b-4993-945c-ebc645fe6d96 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:57.792638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-bc780d40-ddea-4cf8-b5b6-fdfcefdd3e82 req-84b79349-ba9b-4993-945c-ebc645fe6d96 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:57.804136 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-bc780d40-ddea-4cf8-b5b6-fdfcefdd3e82 req-84b79349-ba9b-4993-945c-ebc645fe6d96 service nova] Creating event network-vif-plugged:4dc2b7b6-8e9d-4d7f-bce8-862f1a6e7c5d for instance fba69b57-d519-4ca2-b022-3654c68feca7 on n-h2-862964-4 Oct 29 03:35:57.809348 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-bc780d40-ddea-4cf8-b5b6-fdfcefdd3e82 req-84b79349-ba9b-4993-945c-ebc645fe6d96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032350 Oct 29 03:35:57.810119 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3417/6793] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:35:58.300192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b5828f63-1a52-424c-b851-4693dede33ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:58.300948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b5828f63-1a52-424c-b851-4693dede33ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:58.309337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5828f63-1a52-424c-b851-4693dede33ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:58.309947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5828f63-1a52-424c-b851-4693dede33ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:58.310456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5828f63-1a52-424c-b851-4693dede33ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:58.311279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5828f63-1a52-424c-b851-4693dede33ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:58.311810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5828f63-1a52-424c-b851-4693dede33ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:58.312831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5828f63-1a52-424c-b851-4693dede33ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:58.451677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b5828f63-1a52-424c-b851-4693dede33ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:58.463598 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b5828f63-1a52-424c-b851-4693dede33ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1201 microversion: 2.1 time: 0.168771 Oct 29 03:35:58.464448 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3377/6794] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:58 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1201 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:59.494956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8646d016-a109-4817-a176-f9dd72459594 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:59.495795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8646d016-a109-4817-a176-f9dd72459594 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:59.505321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8646d016-a109-4817-a176-f9dd72459594 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:59.506066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8646d016-a109-4817-a176-f9dd72459594 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:59.506662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8646d016-a109-4817-a176-f9dd72459594 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:59.507662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8646d016-a109-4817-a176-f9dd72459594 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:59.508271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8646d016-a109-4817-a176-f9dd72459594 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:59.508852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8646d016-a109-4817-a176-f9dd72459594 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:59.644957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8646d016-a109-4817-a176-f9dd72459594 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:59.655613 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8646d016-a109-4817-a176-f9dd72459594 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1389 microversion: 2.1 time: 0.168691 Oct 29 03:35:59.656477 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3418/6795] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:59 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:59.678499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cc3eb33e-5572-446e-9c24-3d8e564a6abf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:59.679114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cc3eb33e-5572-446e-9c24-3d8e564a6abf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:59.686086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc3eb33e-5572-446e-9c24-3d8e564a6abf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:59.686582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc3eb33e-5572-446e-9c24-3d8e564a6abf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:59.687021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc3eb33e-5572-446e-9c24-3d8e564a6abf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:59.687710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc3eb33e-5572-446e-9c24-3d8e564a6abf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:59.688150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc3eb33e-5572-446e-9c24-3d8e564a6abf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:59.688580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc3eb33e-5572-446e-9c24-3d8e564a6abf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:59.819140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc3eb33e-5572-446e-9c24-3d8e564a6abf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:35:59.829023 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cc3eb33e-5572-446e-9c24-3d8e564a6abf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1389 microversion: 2.1 time: 0.154101 Oct 29 03:35:59.829599 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3378/6796] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:59 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:35:59.851270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b6d334b-509d-4239-812f-2e1c72aea9e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:35:59.851875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b6d334b-509d-4239-812f-2e1c72aea9e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:35:59.858169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b6d334b-509d-4239-812f-2e1c72aea9e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:59.858650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b6d334b-509d-4239-812f-2e1c72aea9e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:59.859088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b6d334b-509d-4239-812f-2e1c72aea9e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:59.859770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b6d334b-509d-4239-812f-2e1c72aea9e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:35:59.860266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b6d334b-509d-4239-812f-2e1c72aea9e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:35:59.860799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b6d334b-509d-4239-812f-2e1c72aea9e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:35:59.993179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2b6d334b-509d-4239-812f-2e1c72aea9e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:00.001269 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b6d334b-509d-4239-812f-2e1c72aea9e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1389 microversion: 2.1 time: 0.154047 Oct 29 03:36:00.001837 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3419/6797] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:35:59 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:00.084094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-da0132b1-767d-42c8-abdb-93dfd13811ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:00.084583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-da0132b1-767d-42c8-abdb-93dfd13811ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:00.090877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da0132b1-767d-42c8-abdb-93dfd13811ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:00.091349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da0132b1-767d-42c8-abdb-93dfd13811ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:00.091775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da0132b1-767d-42c8-abdb-93dfd13811ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:00.092448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da0132b1-767d-42c8-abdb-93dfd13811ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:00.092891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da0132b1-767d-42c8-abdb-93dfd13811ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:00.093305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da0132b1-767d-42c8-abdb-93dfd13811ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:00.119730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-da0132b1-767d-42c8-abdb-93dfd13811ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:36:00.199759 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-da0132b1-767d-42c8-abdb-93dfd13811ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 204 len: 0 microversion: 2.1 time: 0.119303 Oct 29 03:36:00.200363 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3379/6798] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:36:00 2022] DELETE /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:36:00.208598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-56d2dc25-2d79-4e3a-b4a8-d07760435b5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:00.209199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-56d2dc25-2d79-4e3a-b4a8-d07760435b5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:00.215244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56d2dc25-2d79-4e3a-b4a8-d07760435b5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:00.215725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56d2dc25-2d79-4e3a-b4a8-d07760435b5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:00.216157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56d2dc25-2d79-4e3a-b4a8-d07760435b5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:00.216841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56d2dc25-2d79-4e3a-b4a8-d07760435b5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:00.217287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56d2dc25-2d79-4e3a-b4a8-d07760435b5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:00.217725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-56d2dc25-2d79-4e3a-b4a8-d07760435b5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:00.353530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-56d2dc25-2d79-4e3a-b4a8-d07760435b5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:00.362111 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-56d2dc25-2d79-4e3a-b4a8-d07760435b5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1395 microversion: 2.1 time: 0.157301 Oct 29 03:36:00.362702 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3420/6799] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:00 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1395 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:01.399514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-04e48099-b09a-4a3a-80ea-80b402c2b627 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:01.400667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-04e48099-b09a-4a3a-80ea-80b402c2b627 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:01.410409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e48099-b09a-4a3a-80ea-80b402c2b627 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:01.410911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e48099-b09a-4a3a-80ea-80b402c2b627 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:01.411322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e48099-b09a-4a3a-80ea-80b402c2b627 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:01.412013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e48099-b09a-4a3a-80ea-80b402c2b627 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:01.412461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e48099-b09a-4a3a-80ea-80b402c2b627 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:01.412878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04e48099-b09a-4a3a-80ea-80b402c2b627 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:01.553086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-04e48099-b09a-4a3a-80ea-80b402c2b627 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:01.556717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:01.562210 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-04e48099-b09a-4a3a-80ea-80b402c2b627 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1395 microversion: 2.1 time: 0.170569 Oct 29 03:36:01.562786 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3380/6800] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:01 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1395 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:02.364299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-1ca2010f-2b02-465b-a008-985c377c6335 req-72c5c3ac-57be-4b84-a2d7-186e392e1fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fba69b57-d519-4ca2-b022-3654c68feca7", "name": "network-vif-deleted", "tag": "4dc2b7b6-8e9d-4d7f-bce8-862f1a6e7c5d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:02.370968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:02.377669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1ca2010f-2b02-465b-a008-985c377c6335 req-72c5c3ac-57be-4b84-a2d7-186e392e1fb2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:02.378241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1ca2010f-2b02-465b-a008-985c377c6335 req-72c5c3ac-57be-4b84-a2d7-186e392e1fb2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:02.378733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1ca2010f-2b02-465b-a008-985c377c6335 req-72c5c3ac-57be-4b84-a2d7-186e392e1fb2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:02.381929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=85 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:02.393573 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1ca2010f-2b02-465b-a008-985c377c6335 req-72c5c3ac-57be-4b84-a2d7-186e392e1fb2 service nova] Creating event network-vif-deleted:4dc2b7b6-8e9d-4d7f-bce8-862f1a6e7c5d for instance fba69b57-d519-4ca2-b022-3654c68feca7 on n-h2-862964-4 Oct 29 03:36:02.399791 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-1ca2010f-2b02-465b-a008-985c377c6335 req-72c5c3ac-57be-4b84-a2d7-186e392e1fb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039147 Oct 29 03:36:02.400625 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3421/6801] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:02.587036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37689dd9-effd-4dac-a940-3e3924e2cd96 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:02.587548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37689dd9-effd-4dac-a940-3e3924e2cd96 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:02.590230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:02.597083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37689dd9-effd-4dac-a940-3e3924e2cd96 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:02.597769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37689dd9-effd-4dac-a940-3e3924e2cd96 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:02.598190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37689dd9-effd-4dac-a940-3e3924e2cd96 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:02.598908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37689dd9-effd-4dac-a940-3e3924e2cd96 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:02.599361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37689dd9-effd-4dac-a940-3e3924e2cd96 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:02.599805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37689dd9-effd-4dac-a940-3e3924e2cd96 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:02.670271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37689dd9-effd-4dac-a940-3e3924e2cd96 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:02.678524 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37689dd9-effd-4dac-a940-3e3924e2cd96 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1186 microversion: 2.1 time: 0.096187 Oct 29 03:36:02.679108 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3381/6802] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:02 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1186 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:03.705192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-483fe851-17d7-479d-95e7-16b53b6a1ab9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:03.706301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-483fe851-17d7-479d-95e7-16b53b6a1ab9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:03.716184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-483fe851-17d7-479d-95e7-16b53b6a1ab9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:03.716887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-483fe851-17d7-479d-95e7-16b53b6a1ab9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:03.717435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-483fe851-17d7-479d-95e7-16b53b6a1ab9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:03.718574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-483fe851-17d7-479d-95e7-16b53b6a1ab9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:03.719342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-483fe851-17d7-479d-95e7-16b53b6a1ab9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:03.719860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-483fe851-17d7-479d-95e7-16b53b6a1ab9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:03.784145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-483fe851-17d7-479d-95e7-16b53b6a1ab9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:03.792256 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-483fe851-17d7-479d-95e7-16b53b6a1ab9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1186 microversion: 2.1 time: 0.094204 Oct 29 03:36:03.792861 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3422/6803] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:03 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:04.815734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a36e953-834e-43d2-99db-77feffbfb239 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:04.816327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a36e953-834e-43d2-99db-77feffbfb239 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:04.823371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a36e953-834e-43d2-99db-77feffbfb239 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:04.823855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a36e953-834e-43d2-99db-77feffbfb239 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:04.824281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a36e953-834e-43d2-99db-77feffbfb239 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:04.824973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a36e953-834e-43d2-99db-77feffbfb239 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:04.825415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a36e953-834e-43d2-99db-77feffbfb239 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:04.825839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a36e953-834e-43d2-99db-77feffbfb239 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:04.889234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2a36e953-834e-43d2-99db-77feffbfb239 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:04.897973 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a36e953-834e-43d2-99db-77feffbfb239 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1186 microversion: 2.1 time: 0.086604 Oct 29 03:36:04.898543 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3382/6804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:04 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:05.920909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ff7d7a99-4633-4ed5-88fa-7b85530ab22e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:05.921490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ff7d7a99-4633-4ed5-88fa-7b85530ab22e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:05.929052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff7d7a99-4633-4ed5-88fa-7b85530ab22e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:05.929532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff7d7a99-4633-4ed5-88fa-7b85530ab22e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:05.930000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff7d7a99-4633-4ed5-88fa-7b85530ab22e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:05.930694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff7d7a99-4633-4ed5-88fa-7b85530ab22e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:05.931142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff7d7a99-4633-4ed5-88fa-7b85530ab22e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:05.931711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff7d7a99-4633-4ed5-88fa-7b85530ab22e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:05.997379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ff7d7a99-4633-4ed5-88fa-7b85530ab22e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:06.005861 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ff7d7a99-4633-4ed5-88fa-7b85530ab22e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 200 len: 1186 microversion: 2.1 time: 0.089004 Oct 29 03:36:06.006487 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3423/6805] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:05 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:07.029166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:07.029759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:07.041281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:07.042839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:07.043541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:07.044461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:07.045248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:07.045940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:07.061401 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 HTTP/1.1 Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'fba69b57-d519-4ca2-b022-3654c68feca7'} Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:07.063280 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:07.069918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:07.069918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:07.069918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:07.069918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:36:07.069918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:36:07.069918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:07.069918 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:07.069918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:36:07.069918 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-242b0375-3afa-45c1-afad-7d03ea1b7448 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 404 len: 111 microversion: 2.1 time: 0.040006 Oct 29 03:36:07.069918 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3383/6806] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:07 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:36:08.836682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4c41aaa7-7a32-4a45-9b47-c09d040fb6d9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:08.837226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4c41aaa7-7a32-4a45-9b47-c09d040fb6d9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:08.845847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c41aaa7-7a32-4a45-9b47-c09d040fb6d9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:08.846373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c41aaa7-7a32-4a45-9b47-c09d040fb6d9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:08.847003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c41aaa7-7a32-4a45-9b47-c09d040fb6d9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:08.847987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c41aaa7-7a32-4a45-9b47-c09d040fb6d9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:08.848594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c41aaa7-7a32-4a45-9b47-c09d040fb6d9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:08.849229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4c41aaa7-7a32-4a45-9b47-c09d040fb6d9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:08.879737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4c41aaa7-7a32-4a45-9b47-c09d040fb6d9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:36:08.970481 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4c41aaa7-7a32-4a45-9b47-c09d040fb6d9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 204 len: 0 microversion: 2.1 time: 0.137814 Oct 29 03:36:08.971957 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3424/6807] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:36:08 2022] DELETE /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:36:08.981142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-05a59be5-8e3c-4a99-a5b1-e5130ca0e8c9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:08.981838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-05a59be5-8e3c-4a99-a5b1-e5130ca0e8c9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:08.990148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a59be5-8e3c-4a99-a5b1-e5130ca0e8c9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:08.990633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a59be5-8e3c-4a99-a5b1-e5130ca0e8c9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:08.991059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a59be5-8e3c-4a99-a5b1-e5130ca0e8c9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:08.991778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a59be5-8e3c-4a99-a5b1-e5130ca0e8c9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:08.992249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a59be5-8e3c-4a99-a5b1-e5130ca0e8c9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:08.992657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05a59be5-8e3c-4a99-a5b1-e5130ca0e8c9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:09.145834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-05a59be5-8e3c-4a99-a5b1-e5130ca0e8c9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:09.156726 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-05a59be5-8e3c-4a99-a5b1-e5130ca0e8c9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1733 microversion: 2.1 time: 0.179827 Oct 29 03:36:09.157855 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3384/6808] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:08 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:36:10.185331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa100346-5331-4360-bdb6-9f7ab99d0fbe tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:10.185923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fa100346-5331-4360-bdb6-9f7ab99d0fbe tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:10.193286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa100346-5331-4360-bdb6-9f7ab99d0fbe tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:10.193768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa100346-5331-4360-bdb6-9f7ab99d0fbe tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:10.194221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa100346-5331-4360-bdb6-9f7ab99d0fbe tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:10.194916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa100346-5331-4360-bdb6-9f7ab99d0fbe tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:10.195358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa100346-5331-4360-bdb6-9f7ab99d0fbe tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:10.195788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa100346-5331-4360-bdb6-9f7ab99d0fbe tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:10.271970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:10.272512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:10.279726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:10.280211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:10.280645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:10.281341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:10.281827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:10.282256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:10.296648 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 HTTP/1.1 Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'fba69b57-d519-4ca2-b022-3654c68feca7'} Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:36:10.298641 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:36:10.301868 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce6581a5-3afb-47be-b948-ac8423fe998e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 404 len: 111 microversion: 2.1 time: 0.032057 Oct 29 03:36:10.303785 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3385/6809] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:36:10 2022] DELETE /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:36:10.308633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:10.309290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: fba69b57-d519-4ca2-b022-3654c68feca7] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:10.315428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:10.315911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:10.316344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:10.317039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:10.317490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:10.317942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:10.331955 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 HTTP/1.1 Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'fba69b57-d519-4ca2-b022-3654c68feca7'} Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:10.333491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:10.337334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:10.337334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:10.337334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:10.337334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:36:10.337334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:36:10.337334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. Oct 29 03:36:10.337334 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:10.337334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance fba69b57-d519-4ca2-b022-3654c68feca7 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:36:10.337334 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4bfb7ab4-484a-4ef3-ac6f-07076afaf0fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7" status: 404 len: 111 microversion: 2.1 time: 0.029966 Oct 29 03:36:10.338681 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3386/6810] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:10 2022] GET /compute/v2.1/servers/fba69b57-d519-4ca2-b022-3654c68feca7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:36:10.347324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fa100346-5331-4360-bdb6-9f7ab99d0fbe tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:10.355546 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fa100346-5331-4360-bdb6-9f7ab99d0fbe tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1733 microversion: 2.1 time: 0.174637 Oct 29 03:36:10.356240 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3425/6811] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:10 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:11.379961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-55ca17fe-77c6-4ce1-9eb3-34a886006bc9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:11.380556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-55ca17fe-77c6-4ce1-9eb3-34a886006bc9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:11.389239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55ca17fe-77c6-4ce1-9eb3-34a886006bc9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:11.389796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55ca17fe-77c6-4ce1-9eb3-34a886006bc9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:11.390512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55ca17fe-77c6-4ce1-9eb3-34a886006bc9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:11.391409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55ca17fe-77c6-4ce1-9eb3-34a886006bc9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:11.392057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55ca17fe-77c6-4ce1-9eb3-34a886006bc9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:11.392698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-55ca17fe-77c6-4ce1-9eb3-34a886006bc9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:11.467393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-55ca17fe-77c6-4ce1-9eb3-34a886006bc9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26167e7cffbe4f3d8e63b6ce0253af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e257e24d9845b187462412cbd149cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:11.476684 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-55ca17fe-77c6-4ce1-9eb3-34a886006bc9 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 200 len: 1665 microversion: 2.1 time: 0.100392 Oct 29 03:36:11.477849 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3387/6812] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:11 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 1665 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:11.639579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-c5288eb4-1c01-4d27-8415-81ae1b535ec9 req-2638e479-157d-46b8-bec2-5de3b87deadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e709155-9f5d-4d77-84de-4415e16a33f5", "name": "network-vif-deleted", "tag": "305cfe0b-f120-4c76-889a-b8e8a4565e55"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:11.652625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c5288eb4-1c01-4d27-8415-81ae1b535ec9 req-2638e479-157d-46b8-bec2-5de3b87deadf service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:11.656229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c5288eb4-1c01-4d27-8415-81ae1b535ec9 req-2638e479-157d-46b8-bec2-5de3b87deadf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:11.656957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c5288eb4-1c01-4d27-8415-81ae1b535ec9 req-2638e479-157d-46b8-bec2-5de3b87deadf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:11.681668 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c5288eb4-1c01-4d27-8415-81ae1b535ec9 req-2638e479-157d-46b8-bec2-5de3b87deadf service nova] Creating event network-vif-deleted:305cfe0b-f120-4c76-889a-b8e8a4565e55 for instance 9e709155-9f5d-4d77-84de-4415e16a33f5 on n-h1-862964-4 Oct 29 03:36:11.698725 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-c5288eb4-1c01-4d27-8415-81ae1b535ec9 req-2638e479-157d-46b8-bec2-5de3b87deadf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064774 Oct 29 03:36:11.699838 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3426/6813] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:36:12.704706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:12.705316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:12.714578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:12.715413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:12.715879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:12.716594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:12.717098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:12.717527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:12.732621 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] HTTP exception thrown: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Request method failure captured: Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 HTTP/1.1 Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ583uq-hfS1MYnACBnXLOL5yjwP6DWWtF-3uJUWMzyUqjAe8SChhLsq8llTbNRQJ5_2P4jpsZ4CcuR_03eqAoI_7ufBgJ5NnJkXmltSEvfqaZJK2nUfJgQERG1WoKda4CRWxuTjNOzooFwVZFTp3Wzf1c13-JJqvR57l4lMdtMFHxs Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b0e257e24d9845b187462412cbd149cf Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestServerBasicOps-1407879203 Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0e257e24d9845b187462412cbd149cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0e257e24d9845b187462412cbd149cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0e257e24d9845b187462412cbd149cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0e257e24d9845b187462412cbd149cf"}]}] Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestServerBasicOps-1407879203 Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b0e257e24d9845b187462412cbd149cf Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestServerBasicOps-1407879203 Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestServerBasicOps-1407879203-project Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 26167e7cffbe4f3d8e63b6ce0253af66 Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestServerBasicOps-1407879203-project Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '9e709155-9f5d-4d77-84de-4415e16a33f5'} Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:12.734398 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:12.738528 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:12.738528 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:12.738528 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:12.738528 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:36:12.738528 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:36:12.738528 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:12.738528 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:12.738528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Returning 404 to user: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:36:12.738528 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6e8bba20-9eaf-4295-9270-4940fc1862d6 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 404 len: 111 microversion: 2.1 time: 0.240422 Oct 29 03:36:12.738528 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3388/6814] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:12 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:36:13.217052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:13.217643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:13.225425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:13.225944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:13.226374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:13.227068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:13.227519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:13.227939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:13.243236 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] HTTP exception thrown: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Request method failure captured: Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 HTTP/1.1 Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ583uq-hfS1MYnACBnXLOL5yjwP6DWWtF-3uJUWMzyUqjAe8SChhLsq8llTbNRQJ5_2P4jpsZ4CcuR_03eqAoI_7ufBgJ5NnJkXmltSEvfqaZJK2nUfJgQERG1WoKda4CRWxuTjNOzooFwVZFTp3Wzf1c13-JJqvR57l4lMdtMFHxs Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: b0e257e24d9845b187462412cbd149cf Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestServerBasicOps-1407879203 Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0e257e24d9845b187462412cbd149cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0e257e24d9845b187462412cbd149cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0e257e24d9845b187462412cbd149cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0e257e24d9845b187462412cbd149cf"}]}] Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestServerBasicOps-1407879203 Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: b0e257e24d9845b187462412cbd149cf Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestServerBasicOps-1407879203 Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestServerBasicOps-1407879203-project Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 26167e7cffbe4f3d8e63b6ce0253af66 Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestServerBasicOps-1407879203-project Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '9e709155-9f5d-4d77-84de-4415e16a33f5'} Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:36:13.244926 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Returning 404 to user: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-03bd2dac-5bd5-4251-a0e3-d1046cdad684 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 404 len: 111 microversion: 2.1 time: 0.033631 Oct 29 03:36:13.251943 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3427/6815] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:36:13 2022] DELETE /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:36:13.255505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:13.256120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] [instance: 9e709155-9f5d-4d77-84de-4415e16a33f5] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:13.262190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:13.262671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:13.263106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:13.263800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:13.264250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:13.264666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:13.278762 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] HTTP exception thrown: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Request method failure captured: Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 HTTP/1.1 Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ583uq-hfS1MYnACBnXLOL5yjwP6DWWtF-3uJUWMzyUqjAe8SChhLsq8llTbNRQJ5_2P4jpsZ4CcuR_03eqAoI_7ufBgJ5NnJkXmltSEvfqaZJK2nUfJgQERG1WoKda4CRWxuTjNOzooFwVZFTp3Wzf1c13-JJqvR57l4lMdtMFHxs Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: b0e257e24d9845b187462412cbd149cf Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestServerBasicOps-1407879203 Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0e257e24d9845b187462412cbd149cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0e257e24d9845b187462412cbd149cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0e257e24d9845b187462412cbd149cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0e257e24d9845b187462412cbd149cf"}]}] Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestServerBasicOps-1407879203 Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: b0e257e24d9845b187462412cbd149cf Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestServerBasicOps-1407879203 Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestServerBasicOps-1407879203-project Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 26167e7cffbe4f3d8e63b6ce0253af66 Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestServerBasicOps-1407879203-project Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '9e709155-9f5d-4d77-84de-4415e16a33f5'} Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:13.280274 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:13.284149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:13.284149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:13.284149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:13.284149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:36:13.284149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:36:13.284149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. Oct 29 03:36:13.284149 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:36:13.284149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Returning 404 to user: Instance 9e709155-9f5d-4d77-84de-4415e16a33f5 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:36:13.284149 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50525d32-822a-492a-bda7-f5fd5f0b51a0 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5" status: 404 len: 111 microversion: 2.1 time: 0.030127 Oct 29 03:36:13.284149 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3389/6816] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:13 2022] GET /compute/v2.1/servers/9e709155-9f5d-4d77-84de-4415e16a33f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:36:13.458023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ab90f170-c4a0-4e6f-ab62-293984bcf368 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] Calling method '.version_select at 0x7fe1a328f790>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:13.494494 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ab90f170-c4a0-4e6f-ab62-293984bcf368 tempest-TestServerBasicOps-1407879203 tempest-TestServerBasicOps-1407879203-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1076888252" status: 202 len: 0 microversion: 2.1 time: 0.041772 Oct 29 03:36:13.495088 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3428/6817] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 03:36:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1076888252 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:36:32.881155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=17 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:32.882186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=34 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:33.028726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0ce83892-1670-4b3e-8db4-45a5ae0db03b tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:33.030507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0ce83892-1670-4b3e-8db4-45a5ae0db03b tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:33.031039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0ce83892-1670-4b3e-8db4-45a5ae0db03b tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:33.031539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0ce83892-1670-4b3e-8db4-45a5ae0db03b tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:33.032258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0ce83892-1670-4b3e-8db4-45a5ae0db03b tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:33.032697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0ce83892-1670-4b3e-8db4-45a5ae0db03b tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:33.033266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0ce83892-1670-4b3e-8db4-45a5ae0db03b tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:33.061836 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0ce83892-1670-4b3e-8db4-45a5ae0db03b tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.193807 Oct 29 03:36:33.069899 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3390/6818] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Oct 29 03:36:32 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:33.174043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:33.175284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:33.179597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-595497677", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "availability_zone": "nova:n-h1-862964-4", "networks": [{"uuid": "3641ac7c-ad7d-402b-b9b9-ff6b55edf6bf"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:33.256338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] validate_networks() for [('3641ac7c-ad7d-402b-b9b9-ff6b55edf6bf', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:36:33.763212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:36:33.763926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:36:33.764396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:36:33.764797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:36:33.765199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:36:33.778386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:33.778872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:33.779322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:33.779993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:33.780847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:33.780847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:33.824579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Getting quotas for project d22b116efcf74cfaa4f1679b3d771106. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:36:33.830165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Getting quotas for user 5a1209d131484e9eaba0d6e63b0efd42 and project d22b116efcf74cfaa4f1679b3d771106. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:36:33.845397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:36:33.848012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:36:33.898513 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2ba5609e-b642-4bb1-8e87-012e46788e86 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726585 Oct 29 03:36:33.898993 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3429/6819] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:36:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:36:33.910521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0f3da835-07ff-4b37-b598-086e0e56d9a4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:33.911272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0f3da835-07ff-4b37-b598-086e0e56d9a4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:33.981532 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0f3da835-07ff-4b37-b598-086e0e56d9a4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1328 microversion: 2.1 time: 0.075091 Oct 29 03:36:33.982305 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3391/6820] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:33 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1328 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:34.810650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1214608007", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6c77cbb1-3aa9-4fb6-8e85-bc8c5dddb28a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f5520295-9b65-428a-9f37-5ffc8779f39a"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:34.875242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] validate_networks() for [('f5520295-9b65-428a-9f37-5ffc8779f39a', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:36:35.004988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5bb18506-f479-4549-b12c-0689afeb2ab6 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:35.005554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5bb18506-f479-4549-b12c-0689afeb2ab6 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:35.016061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bb18506-f479-4549-b12c-0689afeb2ab6 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:35.016547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bb18506-f479-4549-b12c-0689afeb2ab6 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:35.016948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bb18506-f479-4549-b12c-0689afeb2ab6 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:35.017917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bb18506-f479-4549-b12c-0689afeb2ab6 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:35.018367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bb18506-f479-4549-b12c-0689afeb2ab6 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:35.018785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bb18506-f479-4549-b12c-0689afeb2ab6 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:35.094889 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5bb18506-f479-4549-b12c-0689afeb2ab6 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1415 microversion: 2.1 time: 0.093579 Oct 29 03:36:35.095474 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3392/6821] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:34 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1415 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:35.340962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:36:35.341444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:36:35.342024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:36:35.342428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:36:35.342830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:36:35.352268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:35.352738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:35.353164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:35.353959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:35.354385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:35.354799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:35.377788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:36:35.385708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for user 3bf87a4bd94c45fa9b30f01267ec743d and project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:36:35.455677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:36:35.457769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c77cbb1-3aa9-4fb6-8e85-bc8c5dddb28a',volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:36:35.655222 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9a0de89a-f57d-4146-a407-1b82eaf4aadb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849271 Oct 29 03:36:35.656465 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3430/6822] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:36:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:36:35.670480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-465d27a9-8bdc-45d1-b683-2bc6f379d1c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:35.671126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-465d27a9-8bdc-45d1-b683-2bc6f379d1c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:35.741887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-465d27a9-8bdc-45d1-b683-2bc6f379d1c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:35.752595 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-465d27a9-8bdc-45d1-b683-2bc6f379d1c3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1071 microversion: 2.1 time: 0.086874 Oct 29 03:36:35.753590 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3393/6823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:35 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1071 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:36.119309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cadfd558-3d25-4349-9bbc-20a296f57c56 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:36.119926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cadfd558-3d25-4349-9bbc-20a296f57c56 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:36.133289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cadfd558-3d25-4349-9bbc-20a296f57c56 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:36.134035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cadfd558-3d25-4349-9bbc-20a296f57c56 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:36.134477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cadfd558-3d25-4349-9bbc-20a296f57c56 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:36.135206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cadfd558-3d25-4349-9bbc-20a296f57c56 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:36.138829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cadfd558-3d25-4349-9bbc-20a296f57c56 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:36.138829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cadfd558-3d25-4349-9bbc-20a296f57c56 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:36.414920 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cadfd558-3d25-4349-9bbc-20a296f57c56 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1463 microversion: 2.1 time: 0.300154 Oct 29 03:36:36.415932 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3431/6824] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:36 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1463 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:36.780376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3e82619b-d085-4202-9dfb-d0d459cb6657 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:36.781239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3e82619b-d085-4202-9dfb-d0d459cb6657 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:36.788435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e82619b-d085-4202-9dfb-d0d459cb6657 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:36.788924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e82619b-d085-4202-9dfb-d0d459cb6657 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:36.789347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e82619b-d085-4202-9dfb-d0d459cb6657 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:36.790265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e82619b-d085-4202-9dfb-d0d459cb6657 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:36.791412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e82619b-d085-4202-9dfb-d0d459cb6657 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:36.791830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e82619b-d085-4202-9dfb-d0d459cb6657 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:36.861310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-26f45cfb-2901-402d-bf0b-884be89e1f90 req-88e3dd9c-7fd6-4f3c-9708-0605de8e7d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247e5251-3eb0-402e-9748-58d243b099c1", "tag": "9c5d7a07-5c05-4092-96cf-7da426559566"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:36.866767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3e82619b-d085-4202-9dfb-d0d459cb6657 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:36.883015 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3e82619b-d085-4202-9dfb-d0d459cb6657 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1169 microversion: 2.1 time: 0.109133 Oct 29 03:36:36.893487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-26f45cfb-2901-402d-bf0b-884be89e1f90 req-88e3dd9c-7fd6-4f3c-9708-0605de8e7d94 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:36.894394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-26f45cfb-2901-402d-bf0b-884be89e1f90 req-88e3dd9c-7fd6-4f3c-9708-0605de8e7d94 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:36.895122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-26f45cfb-2901-402d-bf0b-884be89e1f90 req-88e3dd9c-7fd6-4f3c-9708-0605de8e7d94 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:36.902815 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3394/6825] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:36 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1169 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:36.912363 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-26f45cfb-2901-402d-bf0b-884be89e1f90 req-88e3dd9c-7fd6-4f3c-9708-0605de8e7d94 service nova] Creating event network-changed:9c5d7a07-5c05-4092-96cf-7da426559566 for instance 247e5251-3eb0-402e-9748-58d243b099c1 on n-h1-862964-4 Oct 29 03:36:36.919442 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-26f45cfb-2901-402d-bf0b-884be89e1f90 req-88e3dd9c-7fd6-4f3c-9708-0605de8e7d94 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069562 Oct 29 03:36:36.920102 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3432/6826] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:37.443296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-db6eac2f-25cd-4753-b0d9-cc02e6396d84 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:37.443938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db6eac2f-25cd-4753-b0d9-cc02e6396d84 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:37.461984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db6eac2f-25cd-4753-b0d9-cc02e6396d84 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:37.462868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db6eac2f-25cd-4753-b0d9-cc02e6396d84 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:37.463671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db6eac2f-25cd-4753-b0d9-cc02e6396d84 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:37.464535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db6eac2f-25cd-4753-b0d9-cc02e6396d84 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:37.465131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db6eac2f-25cd-4753-b0d9-cc02e6396d84 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:37.465760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db6eac2f-25cd-4753-b0d9-cc02e6396d84 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:37.665570 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-db6eac2f-25cd-4753-b0d9-cc02e6396d84 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1463 microversion: 2.1 time: 0.227614 Oct 29 03:36:37.667405 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3395/6827] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:37 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1463 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:37.910951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac5f3a65-1319-4029-8b18-53cfdf15d132 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:37.912289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ac5f3a65-1319-4029-8b18-53cfdf15d132 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:37.919964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f3a65-1319-4029-8b18-53cfdf15d132 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:37.920462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f3a65-1319-4029-8b18-53cfdf15d132 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:37.921071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f3a65-1319-4029-8b18-53cfdf15d132 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:37.922238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f3a65-1319-4029-8b18-53cfdf15d132 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:37.923100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f3a65-1319-4029-8b18-53cfdf15d132 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:37.923690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac5f3a65-1319-4029-8b18-53cfdf15d132 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:38.203915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ac5f3a65-1319-4029-8b18-53cfdf15d132 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:38.219338 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ac5f3a65-1319-4029-8b18-53cfdf15d132 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1187 microversion: 2.1 time: 0.312430 Oct 29 03:36:38.235133 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3433/6828] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:37 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1187 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:38.695821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a4034447-174f-4297-ab78-9fd048715529 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:38.697128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a4034447-174f-4297-ab78-9fd048715529 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:38.720290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4034447-174f-4297-ab78-9fd048715529 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:38.720791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4034447-174f-4297-ab78-9fd048715529 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:38.721266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4034447-174f-4297-ab78-9fd048715529 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:38.722251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4034447-174f-4297-ab78-9fd048715529 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:38.722898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4034447-174f-4297-ab78-9fd048715529 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:38.723506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4034447-174f-4297-ab78-9fd048715529 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:38.882574 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a4034447-174f-4297-ab78-9fd048715529 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1463 microversion: 2.1 time: 0.190956 Oct 29 03:36:38.883836 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3396/6829] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:38 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1463 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:39.247179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ceeb377e-37a1-4c30-accf-643193b50243 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:39.247908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ceeb377e-37a1-4c30-accf-643193b50243 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:39.257663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceeb377e-37a1-4c30-accf-643193b50243 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:39.258224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceeb377e-37a1-4c30-accf-643193b50243 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:39.258659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceeb377e-37a1-4c30-accf-643193b50243 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:39.259383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceeb377e-37a1-4c30-accf-643193b50243 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:39.259844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceeb377e-37a1-4c30-accf-643193b50243 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:39.260254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ceeb377e-37a1-4c30-accf-643193b50243 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:39.528462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ceeb377e-37a1-4c30-accf-643193b50243 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:39.539072 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ceeb377e-37a1-4c30-accf-643193b50243 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1229 microversion: 2.1 time: 0.296597 Oct 29 03:36:39.540706 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3434/6830] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:39 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1229 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:39.674000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-76342564-e0e4-4a06-a831-91aadec6b85e req-9c521ea1-a101-4615-8150-df19421b8c31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c25cb4a-f172-4e8b-ba81-b3a694d6c44b", "tag": "efd54e87-dd6d-47c4-9981-8b84937436af"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:39.686897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-76342564-e0e4-4a06-a831-91aadec6b85e req-9c521ea1-a101-4615-8150-df19421b8c31 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:39.688036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-76342564-e0e4-4a06-a831-91aadec6b85e req-9c521ea1-a101-4615-8150-df19421b8c31 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:39.688659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-76342564-e0e4-4a06-a831-91aadec6b85e req-9c521ea1-a101-4615-8150-df19421b8c31 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:39.705892 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-76342564-e0e4-4a06-a831-91aadec6b85e req-9c521ea1-a101-4615-8150-df19421b8c31 service nova] Creating event network-changed:efd54e87-dd6d-47c4-9981-8b84937436af for instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b on n-h2-862964-4 Oct 29 03:36:39.711963 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-76342564-e0e4-4a06-a831-91aadec6b85e req-9c521ea1-a101-4615-8150-df19421b8c31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044440 Oct 29 03:36:39.712973 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3397/6831] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:39.907293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3245658-cdcb-430c-b003-362178490a19 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:39.907902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a3245658-cdcb-430c-b003-362178490a19 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:39.914412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3245658-cdcb-430c-b003-362178490a19 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:39.914907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3245658-cdcb-430c-b003-362178490a19 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:39.915340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3245658-cdcb-430c-b003-362178490a19 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:39.916233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3245658-cdcb-430c-b003-362178490a19 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:39.916695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3245658-cdcb-430c-b003-362178490a19 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:39.917214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3245658-cdcb-430c-b003-362178490a19 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:40.143690 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a3245658-cdcb-430c-b003-362178490a19 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1463 microversion: 2.1 time: 0.240629 Oct 29 03:36:40.144518 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3435/6832] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:39 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1463 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:40.566656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2086887d-1259-4ff6-b0c2-25b94a199728 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:40.567582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2086887d-1259-4ff6-b0c2-25b94a199728 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:40.574270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2086887d-1259-4ff6-b0c2-25b94a199728 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:40.575037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2086887d-1259-4ff6-b0c2-25b94a199728 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:40.575626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2086887d-1259-4ff6-b0c2-25b94a199728 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:40.576485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2086887d-1259-4ff6-b0c2-25b94a199728 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:40.577082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2086887d-1259-4ff6-b0c2-25b94a199728 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:40.577718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2086887d-1259-4ff6-b0c2-25b94a199728 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:40.753418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2086887d-1259-4ff6-b0c2-25b94a199728 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:40.762122 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2086887d-1259-4ff6-b0c2-25b94a199728 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1229 microversion: 2.1 time: 0.199903 Oct 29 03:36:40.763156 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3398/6833] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:40 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1229 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:41.166485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17854f25-6736-47fb-bcbb-eb94773556cb tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:41.167065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-17854f25-6736-47fb-bcbb-eb94773556cb tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:41.174403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17854f25-6736-47fb-bcbb-eb94773556cb tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:41.174893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17854f25-6736-47fb-bcbb-eb94773556cb tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:41.175306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17854f25-6736-47fb-bcbb-eb94773556cb tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:41.176189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17854f25-6736-47fb-bcbb-eb94773556cb tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:41.176811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17854f25-6736-47fb-bcbb-eb94773556cb tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:41.177287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17854f25-6736-47fb-bcbb-eb94773556cb tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:41.311387 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-17854f25-6736-47fb-bcbb-eb94773556cb tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1463 microversion: 2.1 time: 0.148788 Oct 29 03:36:41.312024 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3436/6834] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:41 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:41.785022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fafb1af4-585b-422c-b4d1-6424a7103131 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:41.785625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fafb1af4-585b-422c-b4d1-6424a7103131 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:41.792900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fafb1af4-585b-422c-b4d1-6424a7103131 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:41.793386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fafb1af4-585b-422c-b4d1-6424a7103131 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:41.793841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fafb1af4-585b-422c-b4d1-6424a7103131 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:41.794558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fafb1af4-585b-422c-b4d1-6424a7103131 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:41.794991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fafb1af4-585b-422c-b4d1-6424a7103131 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:41.795419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fafb1af4-585b-422c-b4d1-6424a7103131 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:41.940332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fafb1af4-585b-422c-b4d1-6424a7103131 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:41.949061 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fafb1af4-585b-422c-b4d1-6424a7103131 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1229 microversion: 2.1 time: 0.168121 Oct 29 03:36:41.949984 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3399/6835] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:41 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1229 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:42.334810 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de398f11-3fcd-4295-b839-7672ec26d002 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:42.335396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-de398f11-3fcd-4295-b839-7672ec26d002 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:42.342833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de398f11-3fcd-4295-b839-7672ec26d002 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:42.343364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de398f11-3fcd-4295-b839-7672ec26d002 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:42.344016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de398f11-3fcd-4295-b839-7672ec26d002 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:42.344751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de398f11-3fcd-4295-b839-7672ec26d002 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:42.345219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de398f11-3fcd-4295-b839-7672ec26d002 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:42.345620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de398f11-3fcd-4295-b839-7672ec26d002 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:42.501183 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de398f11-3fcd-4295-b839-7672ec26d002 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1463 microversion: 2.1 time: 0.170323 Oct 29 03:36:42.501784 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3437/6836] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:42 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1463 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:42.591091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8715a894-596e-4a67-bee1-55f7fe24f7b9 req-0c2242ec-9619-4add-9858-fa2c0854fd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247e5251-3eb0-402e-9748-58d243b099c1", "name": "network-vif-plugged", "status": "completed", "tag": "9c5d7a07-5c05-4092-96cf-7da426559566"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:42.601051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8715a894-596e-4a67-bee1-55f7fe24f7b9 req-0c2242ec-9619-4add-9858-fa2c0854fd51 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:42.601517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8715a894-596e-4a67-bee1-55f7fe24f7b9 req-0c2242ec-9619-4add-9858-fa2c0854fd51 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:42.601965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8715a894-596e-4a67-bee1-55f7fe24f7b9 req-0c2242ec-9619-4add-9858-fa2c0854fd51 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:42.615687 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8715a894-596e-4a67-bee1-55f7fe24f7b9 req-0c2242ec-9619-4add-9858-fa2c0854fd51 service nova] Creating event network-vif-plugged:9c5d7a07-5c05-4092-96cf-7da426559566 for instance 247e5251-3eb0-402e-9748-58d243b099c1 on n-h1-862964-4 Oct 29 03:36:42.620829 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8715a894-596e-4a67-bee1-55f7fe24f7b9 req-0c2242ec-9619-4add-9858-fa2c0854fd51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033488 Oct 29 03:36:42.621514 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3400/6837] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:42.973891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-14423def-e4b7-46a2-9b82-6251a3ab7973 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:42.974501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-14423def-e4b7-46a2-9b82-6251a3ab7973 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:42.980930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14423def-e4b7-46a2-9b82-6251a3ab7973 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:42.981410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14423def-e4b7-46a2-9b82-6251a3ab7973 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:42.981827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14423def-e4b7-46a2-9b82-6251a3ab7973 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:42.982551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14423def-e4b7-46a2-9b82-6251a3ab7973 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:42.982999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14423def-e4b7-46a2-9b82-6251a3ab7973 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:42.983418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14423def-e4b7-46a2-9b82-6251a3ab7973 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:43.121199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-14423def-e4b7-46a2-9b82-6251a3ab7973 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:43.129426 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-14423def-e4b7-46a2-9b82-6251a3ab7973 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1217 microversion: 2.1 time: 0.159611 Oct 29 03:36:43.130024 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3438/6838] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:42 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:43.522640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:43.527229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a420720a-f289-418e-b8b0-d4e8bd83016d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:43.527958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a420720a-f289-418e-b8b0-d4e8bd83016d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:43.534638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a420720a-f289-418e-b8b0-d4e8bd83016d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:43.535116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a420720a-f289-418e-b8b0-d4e8bd83016d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:43.535543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a420720a-f289-418e-b8b0-d4e8bd83016d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:43.536226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a420720a-f289-418e-b8b0-d4e8bd83016d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:43.536670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a420720a-f289-418e-b8b0-d4e8bd83016d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:43.537087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a420720a-f289-418e-b8b0-d4e8bd83016d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:43.679319 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a420720a-f289-418e-b8b0-d4e8bd83016d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1463 microversion: 2.1 time: 0.158196 Oct 29 03:36:43.680080 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3401/6839] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:43 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:44.153313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f52af62f-3c36-4548-bd8e-ac3e88bdb2d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:44.153968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f52af62f-3c36-4548-bd8e-ac3e88bdb2d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:44.161902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f52af62f-3c36-4548-bd8e-ac3e88bdb2d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:44.162306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f52af62f-3c36-4548-bd8e-ac3e88bdb2d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:44.162744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f52af62f-3c36-4548-bd8e-ac3e88bdb2d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:44.163455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f52af62f-3c36-4548-bd8e-ac3e88bdb2d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:44.163906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f52af62f-3c36-4548-bd8e-ac3e88bdb2d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:44.164321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f52af62f-3c36-4548-bd8e-ac3e88bdb2d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:44.312056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f52af62f-3c36-4548-bd8e-ac3e88bdb2d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:44.320745 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f52af62f-3c36-4548-bd8e-ac3e88bdb2d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1217 microversion: 2.1 time: 0.171698 Oct 29 03:36:44.321308 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3439/6840] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:44 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:44.710461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3c5af260-52b5-4763-b488-e6f2c5256dd4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:44.711253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3c5af260-52b5-4763-b488-e6f2c5256dd4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:44.720884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c5af260-52b5-4763-b488-e6f2c5256dd4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:44.721504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c5af260-52b5-4763-b488-e6f2c5256dd4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:44.722143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c5af260-52b5-4763-b488-e6f2c5256dd4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:44.723062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c5af260-52b5-4763-b488-e6f2c5256dd4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:44.723656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c5af260-52b5-4763-b488-e6f2c5256dd4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:44.724209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3c5af260-52b5-4763-b488-e6f2c5256dd4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:44.865108 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3c5af260-52b5-4763-b488-e6f2c5256dd4 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1648 microversion: 2.1 time: 0.159881 Oct 29 03:36:44.866037 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3402/6841] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:44 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1648 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:44.887626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-16b2d412-b0a4-4adc-aec6-eb4c3c1a6173 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:44.888364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-16b2d412-b0a4-4adc-aec6-eb4c3c1a6173 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:44.894966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-16b2d412-b0a4-4adc-aec6-eb4c3c1a6173 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:44.895450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-16b2d412-b0a4-4adc-aec6-eb4c3c1a6173 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:44.895888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-16b2d412-b0a4-4adc-aec6-eb4c3c1a6173 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:44.896588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-16b2d412-b0a4-4adc-aec6-eb4c3c1a6173 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:44.897035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-16b2d412-b0a4-4adc-aec6-eb4c3c1a6173 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:44.897454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-16b2d412-b0a4-4adc-aec6-eb4c3c1a6173 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:45.040251 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-16b2d412-b0a4-4adc-aec6-eb4c3c1a6173 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1648 microversion: 2.1 time: 0.156360 Oct 29 03:36:45.040838 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3440/6842] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:44 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1648 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:45.061894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c49f296-8f5b-4386-a1cb-076fbaaa744a tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:45.062530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6c49f296-8f5b-4386-a1cb-076fbaaa744a tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:45.069303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c49f296-8f5b-4386-a1cb-076fbaaa744a tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:45.069787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c49f296-8f5b-4386-a1cb-076fbaaa744a tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:45.070276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c49f296-8f5b-4386-a1cb-076fbaaa744a tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:45.070966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c49f296-8f5b-4386-a1cb-076fbaaa744a tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:45.071411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c49f296-8f5b-4386-a1cb-076fbaaa744a tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:45.071823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c49f296-8f5b-4386-a1cb-076fbaaa744a tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:45.221872 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6c49f296-8f5b-4386-a1cb-076fbaaa744a tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1648 microversion: 2.1 time: 0.163651 Oct 29 03:36:45.222468 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3403/6843] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:45 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1648 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:45.344018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fea7aee4-e2dd-499e-8dac-92adb0676e77 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:45.344651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fea7aee4-e2dd-499e-8dac-92adb0676e77 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:45.352579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea7aee4-e2dd-499e-8dac-92adb0676e77 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:45.353048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea7aee4-e2dd-499e-8dac-92adb0676e77 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:45.353482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea7aee4-e2dd-499e-8dac-92adb0676e77 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:45.354220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea7aee4-e2dd-499e-8dac-92adb0676e77 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:45.354665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea7aee4-e2dd-499e-8dac-92adb0676e77 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:45.355084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fea7aee4-e2dd-499e-8dac-92adb0676e77 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:45.372551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:45.396645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=12 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:45.419391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1044148431", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "availability_zone": "nova:n-h2-862964-4", "networks": [{"uuid": "3641ac7c-ad7d-402b-b9b9-ff6b55edf6bf"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:45.484136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] validate_networks() for [('3641ac7c-ad7d-402b-b9b9-ff6b55edf6bf', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:36:45.504907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fea7aee4-e2dd-499e-8dac-92adb0676e77 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:45.513329 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fea7aee4-e2dd-499e-8dac-92adb0676e77 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1217 microversion: 2.1 time: 0.173735 Oct 29 03:36:45.514040 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3441/6844] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:45 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:45.750975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:45.885782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:36:45.886454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:36:45.887140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:36:45.887668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:36:45.888115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:36:45.901109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:45.901690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:45.902394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:45.903463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:45.904096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:45.904742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:45.924434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Getting quotas for project d22b116efcf74cfaa4f1679b3d771106. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:36:45.929945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Getting quotas for user 5a1209d131484e9eaba0d6e63b0efd42 and project d22b116efcf74cfaa4f1679b3d771106. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:36:45.943123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:36:45.945535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:36:45.992071 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [38acbc69-4d86-4244-a450-cb24e00484a9] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 03:36:46.539065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-169ca0ff-5166-4627-aeae-ce847ace54bd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:46.539687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-169ca0ff-5166-4627-aeae-ce847ace54bd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:46.547500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-169ca0ff-5166-4627-aeae-ce847ace54bd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:46.548005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-169ca0ff-5166-4627-aeae-ce847ace54bd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:46.548442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-169ca0ff-5166-4627-aeae-ce847ace54bd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:46.549172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-169ca0ff-5166-4627-aeae-ce847ace54bd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:46.549626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-169ca0ff-5166-4627-aeae-ce847ace54bd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:46.550093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-169ca0ff-5166-4627-aeae-ce847ace54bd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:46.688824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-169ca0ff-5166-4627-aeae-ce847ace54bd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:46.697406 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-169ca0ff-5166-4627-aeae-ce847ace54bd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1217 microversion: 2.1 time: 0.163462 Oct 29 03:36:46.698069 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3442/6845] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:46 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:47.001923 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [38acbc69-4d86-4244-a450-cb24e00484a9] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42392. Oct 29 03:36:47.007021 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-77d89856-defe-4fc1-9c97-123c986d4464 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.591664 Oct 29 03:36:47.007772 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3404/6846] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:36:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:36:47.019647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b22d087b-e572-4197-9286-ae597cff3fff tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:47.020250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b22d087b-e572-4197-9286-ae597cff3fff tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:47.082569 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b22d087b-e572-4197-9286-ae597cff3fff tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1329 microversion: 2.1 time: 0.066828 Oct 29 03:36:47.083150 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3443/6847] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:47 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1329 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:47.722351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b7d9f13f-f07f-416e-9a42-2e2f93eb09b0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:47.722961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b7d9f13f-f07f-416e-9a42-2e2f93eb09b0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:47.730719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7d9f13f-f07f-416e-9a42-2e2f93eb09b0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:47.731210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7d9f13f-f07f-416e-9a42-2e2f93eb09b0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:47.731648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7d9f13f-f07f-416e-9a42-2e2f93eb09b0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:47.732343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7d9f13f-f07f-416e-9a42-2e2f93eb09b0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:47.732788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7d9f13f-f07f-416e-9a42-2e2f93eb09b0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:47.733208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7d9f13f-f07f-416e-9a42-2e2f93eb09b0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:47.872789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b7d9f13f-f07f-416e-9a42-2e2f93eb09b0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:47.881255 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b7d9f13f-f07f-416e-9a42-2e2f93eb09b0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1217 microversion: 2.1 time: 0.164403 Oct 29 03:36:47.881997 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3405/6848] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:47 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:36:48.104888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-66bfe656-9b59-421a-b2f9-8c0f514ad821 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:48.105530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-66bfe656-9b59-421a-b2f9-8c0f514ad821 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:48.113576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66bfe656-9b59-421a-b2f9-8c0f514ad821 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:48.114101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66bfe656-9b59-421a-b2f9-8c0f514ad821 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:48.114539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66bfe656-9b59-421a-b2f9-8c0f514ad821 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:48.115551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66bfe656-9b59-421a-b2f9-8c0f514ad821 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:48.116011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66bfe656-9b59-421a-b2f9-8c0f514ad821 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:48.116574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66bfe656-9b59-421a-b2f9-8c0f514ad821 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:48.195600 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-66bfe656-9b59-421a-b2f9-8c0f514ad821 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1416 microversion: 2.1 time: 0.094280 Oct 29 03:36:48.196791 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3444/6849] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:48 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1416 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:48.904856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b48b6ea3-0ca8-4e62-9b3a-87d47c7aaf7f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:48.905692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b48b6ea3-0ca8-4e62-9b3a-87d47c7aaf7f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:48.913098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48b6ea3-0ca8-4e62-9b3a-87d47c7aaf7f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:48.913630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48b6ea3-0ca8-4e62-9b3a-87d47c7aaf7f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:48.914105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48b6ea3-0ca8-4e62-9b3a-87d47c7aaf7f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:48.914810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48b6ea3-0ca8-4e62-9b3a-87d47c7aaf7f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:48.915266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48b6ea3-0ca8-4e62-9b3a-87d47c7aaf7f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:48.915748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b48b6ea3-0ca8-4e62-9b3a-87d47c7aaf7f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:49.052943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b48b6ea3-0ca8-4e62-9b3a-87d47c7aaf7f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:49.061257 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b48b6ea3-0ca8-4e62-9b3a-87d47c7aaf7f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1217 microversion: 2.1 time: 0.160828 Oct 29 03:36:49.061840 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3406/6850] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:48 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:49.220398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f0973c72-0e3a-470a-b7e5-03ee10557770 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:49.221953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f0973c72-0e3a-470a-b7e5-03ee10557770 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:49.232282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0973c72-0e3a-470a-b7e5-03ee10557770 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:49.233039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0973c72-0e3a-470a-b7e5-03ee10557770 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:49.233506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0973c72-0e3a-470a-b7e5-03ee10557770 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:49.234675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0973c72-0e3a-470a-b7e5-03ee10557770 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:49.235198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0973c72-0e3a-470a-b7e5-03ee10557770 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:49.235688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f0973c72-0e3a-470a-b7e5-03ee10557770 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:49.471513 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f0973c72-0e3a-470a-b7e5-03ee10557770 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1464 microversion: 2.1 time: 0.255182 Oct 29 03:36:49.472211 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3445/6851] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:49 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1464 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:50.036235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4e95738f-9c0a-470e-b770-d69157006257 req-d195a591-b399-481e-9c84-82b63fe54578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d637d75-9f7f-437d-8b26-486b791bca2a", "tag": "ef633979-04da-4a35-bfa0-1c010de013ad"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:50.048075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4e95738f-9c0a-470e-b770-d69157006257 req-d195a591-b399-481e-9c84-82b63fe54578 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:50.048831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4e95738f-9c0a-470e-b770-d69157006257 req-d195a591-b399-481e-9c84-82b63fe54578 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:50.049258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4e95738f-9c0a-470e-b770-d69157006257 req-d195a591-b399-481e-9c84-82b63fe54578 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:50.084807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0ed0932b-5630-482f-ba9d-6540707e11c1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:50.085919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0ed0932b-5630-482f-ba9d-6540707e11c1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:50.093899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ed0932b-5630-482f-ba9d-6540707e11c1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:50.094592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ed0932b-5630-482f-ba9d-6540707e11c1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:50.095980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ed0932b-5630-482f-ba9d-6540707e11c1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:50.097073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ed0932b-5630-482f-ba9d-6540707e11c1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:50.097701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ed0932b-5630-482f-ba9d-6540707e11c1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:50.098327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ed0932b-5630-482f-ba9d-6540707e11c1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:50.322132 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4e95738f-9c0a-470e-b770-d69157006257 req-d195a591-b399-481e-9c84-82b63fe54578 service nova] Creating event network-changed:ef633979-04da-4a35-bfa0-1c010de013ad for instance 7d637d75-9f7f-437d-8b26-486b791bca2a on n-h2-862964-4 Oct 29 03:36:50.328259 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4e95738f-9c0a-470e-b770-d69157006257 req-d195a591-b399-481e-9c84-82b63fe54578 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297555 Oct 29 03:36:50.328880 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3407/6852] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:50.352981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0ed0932b-5630-482f-ba9d-6540707e11c1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:50.360961 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0ed0932b-5630-482f-ba9d-6540707e11c1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1217 microversion: 2.1 time: 0.280102 Oct 29 03:36:50.361550 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3446/6853] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:50 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1217 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:50.496304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e34b37d0-0be4-42f1-a325-4ce1215238f9 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:50.497029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e34b37d0-0be4-42f1-a325-4ce1215238f9 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:50.503646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34b37d0-0be4-42f1-a325-4ce1215238f9 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:50.504137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34b37d0-0be4-42f1-a325-4ce1215238f9 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:50.504567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34b37d0-0be4-42f1-a325-4ce1215238f9 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:50.505287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34b37d0-0be4-42f1-a325-4ce1215238f9 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:50.505742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34b37d0-0be4-42f1-a325-4ce1215238f9 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:50.506194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e34b37d0-0be4-42f1-a325-4ce1215238f9 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:50.638338 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e34b37d0-0be4-42f1-a325-4ce1215238f9 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1464 microversion: 2.1 time: 0.146261 Oct 29 03:36:50.638908 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3408/6854] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:50 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:51.385389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bd1a74f-8add-4292-93f1-822c889f1fa5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:51.385995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bd1a74f-8add-4292-93f1-822c889f1fa5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:51.393571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd1a74f-8add-4292-93f1-822c889f1fa5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:51.394164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd1a74f-8add-4292-93f1-822c889f1fa5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:51.395064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd1a74f-8add-4292-93f1-822c889f1fa5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:51.395274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd1a74f-8add-4292-93f1-822c889f1fa5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:51.395724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd1a74f-8add-4292-93f1-822c889f1fa5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:51.396170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd1a74f-8add-4292-93f1-822c889f1fa5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:51.661151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fab0235d-2e1b-4e56-a2e1-4043ed21ca01 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:51.661724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fab0235d-2e1b-4e56-a2e1-4043ed21ca01 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:51.669186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fab0235d-2e1b-4e56-a2e1-4043ed21ca01 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:51.669678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fab0235d-2e1b-4e56-a2e1-4043ed21ca01 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:51.670154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fab0235d-2e1b-4e56-a2e1-4043ed21ca01 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:51.670854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fab0235d-2e1b-4e56-a2e1-4043ed21ca01 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:51.671302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fab0235d-2e1b-4e56-a2e1-4043ed21ca01 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:51.671827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fab0235d-2e1b-4e56-a2e1-4043ed21ca01 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:51.781439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9bd1a74f-8add-4292-93f1-822c889f1fa5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:51.791382 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9bd1a74f-8add-4292-93f1-822c889f1fa5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1217 microversion: 2.1 time: 0.409751 Oct 29 03:36:51.806401 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3447/6855] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:51 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1217 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:51.823850 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fab0235d-2e1b-4e56-a2e1-4043ed21ca01 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1464 microversion: 2.1 time: 0.166750 Oct 29 03:36:51.824531 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3409/6856] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:51 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1464 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:52.067674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-cfb33f5f-b451-49dd-9fa3-16d54940799b req-ded7ee32-4567-485d-b9f8-6fed078838cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c25cb4a-f172-4e8b-ba81-b3a694d6c44b", "name": "network-vif-plugged", "status": "completed", "tag": "efd54e87-dd6d-47c4-9981-8b84937436af"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:52.079447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cfb33f5f-b451-49dd-9fa3-16d54940799b req-ded7ee32-4567-485d-b9f8-6fed078838cb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:52.079916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cfb33f5f-b451-49dd-9fa3-16d54940799b req-ded7ee32-4567-485d-b9f8-6fed078838cb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:52.080598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-cfb33f5f-b451-49dd-9fa3-16d54940799b req-ded7ee32-4567-485d-b9f8-6fed078838cb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:52.095711 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-cfb33f5f-b451-49dd-9fa3-16d54940799b req-ded7ee32-4567-485d-b9f8-6fed078838cb service nova] Creating event network-vif-plugged:efd54e87-dd6d-47c4-9981-8b84937436af for instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b on n-h2-862964-4 Oct 29 03:36:52.101552 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-cfb33f5f-b451-49dd-9fa3-16d54940799b req-ded7ee32-4567-485d-b9f8-6fed078838cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037782 Oct 29 03:36:52.102806 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3448/6857] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:52.818306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e6b434d7-7822-4878-b7bb-789b1ec25b6a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:52.818875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e6b434d7-7822-4878-b7bb-789b1ec25b6a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:52.825179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b434d7-7822-4878-b7bb-789b1ec25b6a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:52.825681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b434d7-7822-4878-b7bb-789b1ec25b6a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:52.826123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b434d7-7822-4878-b7bb-789b1ec25b6a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:52.826813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b434d7-7822-4878-b7bb-789b1ec25b6a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:52.827258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b434d7-7822-4878-b7bb-789b1ec25b6a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:52.827660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e6b434d7-7822-4878-b7bb-789b1ec25b6a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:52.850828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6fd3c2bf-2d9d-4cba-9f85-724d8c655b82 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:52.852290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6fd3c2bf-2d9d-4cba-9f85-724d8c655b82 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:52.860399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fd3c2bf-2d9d-4cba-9f85-724d8c655b82 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:52.860894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fd3c2bf-2d9d-4cba-9f85-724d8c655b82 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:52.861321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fd3c2bf-2d9d-4cba-9f85-724d8c655b82 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:52.862065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fd3c2bf-2d9d-4cba-9f85-724d8c655b82 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:52.862511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fd3c2bf-2d9d-4cba-9f85-724d8c655b82 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:52.862954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6fd3c2bf-2d9d-4cba-9f85-724d8c655b82 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:52.867500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=100 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:52.993171 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6fd3c2bf-2d9d-4cba-9f85-724d8c655b82 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1464 microversion: 2.1 time: 0.147284 Oct 29 03:36:52.993789 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3449/6858] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:52 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:53.025363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e6b434d7-7822-4878-b7bb-789b1ec25b6a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:53.033922 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e6b434d7-7822-4878-b7bb-789b1ec25b6a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1217 microversion: 2.1 time: 0.220103 Oct 29 03:36:53.034535 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3410/6859] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:52 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:54.017222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-93754b64-acc8-40f4-b6de-6f8ea6a1d6c7 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:54.017752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-93754b64-acc8-40f4-b6de-6f8ea6a1d6c7 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:54.024558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93754b64-acc8-40f4-b6de-6f8ea6a1d6c7 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:54.025047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93754b64-acc8-40f4-b6de-6f8ea6a1d6c7 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:54.025482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93754b64-acc8-40f4-b6de-6f8ea6a1d6c7 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:54.026209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93754b64-acc8-40f4-b6de-6f8ea6a1d6c7 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:54.026663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93754b64-acc8-40f4-b6de-6f8ea6a1d6c7 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:54.027087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-93754b64-acc8-40f4-b6de-6f8ea6a1d6c7 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:54.064656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f4fda9b3-c449-49d7-90e0-61628b972ab3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:54.065539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f4fda9b3-c449-49d7-90e0-61628b972ab3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:54.072785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fda9b3-c449-49d7-90e0-61628b972ab3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:54.073271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fda9b3-c449-49d7-90e0-61628b972ab3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:54.073700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fda9b3-c449-49d7-90e0-61628b972ab3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:54.074420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fda9b3-c449-49d7-90e0-61628b972ab3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:54.074867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fda9b3-c449-49d7-90e0-61628b972ab3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:54.075317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f4fda9b3-c449-49d7-90e0-61628b972ab3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:54.161412 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-93754b64-acc8-40f4-b6de-6f8ea6a1d6c7 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1464 microversion: 2.1 time: 0.148457 Oct 29 03:36:54.162140 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3450/6860] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:54 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:54.166715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b8e5d5e3-55f6-4037-a04a-a2b5b390caca req-1c895edf-d553-4b3d-881c-b499699e75af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d637d75-9f7f-437d-8b26-486b791bca2a", "name": "network-vif-plugged", "status": "completed", "tag": "ef633979-04da-4a35-bfa0-1c010de013ad"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:54.176504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b8e5d5e3-55f6-4037-a04a-a2b5b390caca req-1c895edf-d553-4b3d-881c-b499699e75af service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:54.177084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b8e5d5e3-55f6-4037-a04a-a2b5b390caca req-1c895edf-d553-4b3d-881c-b499699e75af service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:54.177585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b8e5d5e3-55f6-4037-a04a-a2b5b390caca req-1c895edf-d553-4b3d-881c-b499699e75af service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:54.189318 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b8e5d5e3-55f6-4037-a04a-a2b5b390caca req-1c895edf-d553-4b3d-881c-b499699e75af service nova] Creating event network-vif-plugged:ef633979-04da-4a35-bfa0-1c010de013ad for instance 7d637d75-9f7f-437d-8b26-486b791bca2a on n-h2-862964-4 Oct 29 03:36:54.194494 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b8e5d5e3-55f6-4037-a04a-a2b5b390caca req-1c895edf-d553-4b3d-881c-b499699e75af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031094 Oct 29 03:36:54.195349 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3451/6861] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:54.210550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f4fda9b3-c449-49d7-90e0-61628b972ab3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:54.214786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=100 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:54.220691 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f4fda9b3-c449-49d7-90e0-61628b972ab3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1405 microversion: 2.1 time: 0.159999 Oct 29 03:36:54.221292 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3411/6862] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:54 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:54.244511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6225db0-05e5-4d48-a3e5-b591d6395482 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:54.245265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c6225db0-05e5-4d48-a3e5-b591d6395482 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:54.252199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6225db0-05e5-4d48-a3e5-b591d6395482 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:54.252681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6225db0-05e5-4d48-a3e5-b591d6395482 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:54.253111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6225db0-05e5-4d48-a3e5-b591d6395482 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:54.253835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6225db0-05e5-4d48-a3e5-b591d6395482 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:54.254303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6225db0-05e5-4d48-a3e5-b591d6395482 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:54.254692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6225db0-05e5-4d48-a3e5-b591d6395482 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:54.427429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c6225db0-05e5-4d48-a3e5-b591d6395482 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:54.436401 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c6225db0-05e5-4d48-a3e5-b591d6395482 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1405 microversion: 2.1 time: 0.196539 Oct 29 03:36:54.436982 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3452/6863] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:54 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:36:54.459218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1121996433"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:54.461614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:54.468397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:54.468949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:54.469364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:54.470113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:54.470558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:54.470976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:54.570537 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.compute.api [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Attempting to quiesce instance before volume snapshot. Oct 29 03:36:54.659259 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.compute.api [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 29 03:36:54.736611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Creating snapshot from volume 6c77cbb1-3aa9-4fb6-8e85-bc8c5dddb28a. {{(pid=127041) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 29 03:36:55.186122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bd01b54c-b16e-471b-be14-c6fd042b48da tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:55.187008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bd01b54c-b16e-471b-be14-c6fd042b48da tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:55.196893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd01b54c-b16e-471b-be14-c6fd042b48da tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:55.197384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd01b54c-b16e-471b-be14-c6fd042b48da tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:55.197824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd01b54c-b16e-471b-be14-c6fd042b48da tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:55.198600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd01b54c-b16e-471b-be14-c6fd042b48da tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:55.199054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd01b54c-b16e-471b-be14-c6fd042b48da tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:55.199473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd01b54c-b16e-471b-be14-c6fd042b48da tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:55.354862 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bd01b54c-b16e-471b-be14-c6fd042b48da tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1464 microversion: 2.1 time: 0.174045 Oct 29 03:36:55.355665 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3453/6864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:55 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:55.688733 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c0252c83-1f74-4ad3-a1da-082787f23180 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "POST /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b/action" status: 202 len: 0 microversion: 2.1 time: 1.233398 Oct 29 03:36:55.689369 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3412/6865] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:36:54 2022] POST /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b/action => generated 0 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 03:36:56.379170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e2cb6861-9c6d-4bc1-888c-b07b9cff0378 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:56.379759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e2cb6861-9c6d-4bc1-888c-b07b9cff0378 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:56.387091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2cb6861-9c6d-4bc1-888c-b07b9cff0378 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:56.387549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2cb6861-9c6d-4bc1-888c-b07b9cff0378 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:56.387970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2cb6861-9c6d-4bc1-888c-b07b9cff0378 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:56.388657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2cb6861-9c6d-4bc1-888c-b07b9cff0378 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:56.389102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2cb6861-9c6d-4bc1-888c-b07b9cff0378 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:56.389516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e2cb6861-9c6d-4bc1-888c-b07b9cff0378 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:56.521261 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e2cb6861-9c6d-4bc1-888c-b07b9cff0378 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1650 microversion: 2.1 time: 0.146050 Oct 29 03:36:56.522082 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3454/6866] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:56 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1650 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:56.545189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:56.545986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:56.550632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ac09417-812d-4909-ad40-ee44961e7104 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:56.551371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ac09417-812d-4909-ad40-ee44961e7104 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:56.559197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac09417-812d-4909-ad40-ee44961e7104 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:56.559690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac09417-812d-4909-ad40-ee44961e7104 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:56.560129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac09417-812d-4909-ad40-ee44961e7104 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:56.560837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac09417-812d-4909-ad40-ee44961e7104 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:56.561303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac09417-812d-4909-ad40-ee44961e7104 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:56.561735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac09417-812d-4909-ad40-ee44961e7104 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:56.706460 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ac09417-812d-4909-ad40-ee44961e7104 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1650 microversion: 2.1 time: 0.162122 Oct 29 03:36:56.707087 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3413/6867] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:56 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1650 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:56.732565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3c0eaf0e-dd97-423e-b34d-c866ffa1f2a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:56.733196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3c0eaf0e-dd97-423e-b34d-c866ffa1f2a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:56.740244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0eaf0e-dd97-423e-b34d-c866ffa1f2a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:56.740790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0eaf0e-dd97-423e-b34d-c866ffa1f2a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:56.741168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0eaf0e-dd97-423e-b34d-c866ffa1f2a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:56.741896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0eaf0e-dd97-423e-b34d-c866ffa1f2a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:56.742375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0eaf0e-dd97-423e-b34d-c866ffa1f2a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:56.742816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0eaf0e-dd97-423e-b34d-c866ffa1f2a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:56.846511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1524226420", "imageRef": "069c952f-58d5-46c1-ae6e-2792dfc09067", "flavorRef": "452", "networks": [{"uuid": "f5520295-9b65-428a-9f37-5ffc8779f39a"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:56.875844 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3c0eaf0e-dd97-423e-b34d-c866ffa1f2a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1650 microversion: 2.1 time: 0.146801 Oct 29 03:36:56.876444 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3455/6868] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:56 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1650 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:56.898091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-adbc0615-7362-433b-855b-2580c956d639 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:56.898585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-adbc0615-7362-433b-855b-2580c956d639 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:56.903332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] validate_networks() for [('f5520295-9b65-428a-9f37-5ffc8779f39a', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:36:56.904673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-adbc0615-7362-433b-855b-2580c956d639 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:56.905153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-adbc0615-7362-433b-855b-2580c956d639 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:56.905579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-adbc0615-7362-433b-855b-2580c956d639 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:56.906642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-adbc0615-7362-433b-855b-2580c956d639 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:56.907094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-adbc0615-7362-433b-855b-2580c956d639 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:56.907531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-adbc0615-7362-433b-855b-2580c956d639 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:56.932846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-adbc0615-7362-433b-855b-2580c956d639 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:36:57.014150 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-adbc0615-7362-433b-855b-2580c956d639 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 204 len: 0 microversion: 2.1 time: 0.119385 Oct 29 03:36:57.018074 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3456/6869] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:36:56 2022] DELETE /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:36:57.023721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-57cb3ad9-4ae6-4cac-99c5-bc0a8fc05d44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:57.024511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-57cb3ad9-4ae6-4cac-99c5-bc0a8fc05d44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:57.031198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57cb3ad9-4ae6-4cac-99c5-bc0a8fc05d44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:57.031815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57cb3ad9-4ae6-4cac-99c5-bc0a8fc05d44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:57.032249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57cb3ad9-4ae6-4cac-99c5-bc0a8fc05d44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:57.032960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57cb3ad9-4ae6-4cac-99c5-bc0a8fc05d44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:57.033410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57cb3ad9-4ae6-4cac-99c5-bc0a8fc05d44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:57.033891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-57cb3ad9-4ae6-4cac-99c5-bc0a8fc05d44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:57.080182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:57.172100 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-57cb3ad9-4ae6-4cac-99c5-bc0a8fc05d44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1656 microversion: 2.1 time: 0.152371 Oct 29 03:36:57.172682 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3457/6870] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:57 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1656 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:57.559121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:36:57.559580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:36:57.560515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:36:57.560515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:36:57.560867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:36:57.570466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:57.570993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:57.571427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:57.572167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:57.572620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:57.573033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:57.590273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:36:57.596078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for user 3bf87a4bd94c45fa9b30f01267ec743d and project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:36:57.609619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:36:57.612235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='485b5fde-0127-49f4-8e41-4defbd65ac55',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:36:57.701130 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a6933219-d916-4bf3-9734-d505142eb2bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858839 Oct 29 03:36:57.701996 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3414/6871] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:36:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:36:57.713940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1908a542-b2a1-4ae4-9aa0-8749b2b2f929 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:57.714571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1908a542-b2a1-4ae4-9aa0-8749b2b2f929 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:57.723275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:57.770590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1908a542-b2a1-4ae4-9aa0-8749b2b2f929 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:57.777684 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1908a542-b2a1-4ae4-9aa0-8749b2b2f929 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1230 microversion: 2.1 time: 0.067899 Oct 29 03:36:57.778313 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3458/6872] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:57 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1230 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:58.195979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c6b858a4-3d0f-4679-bd4f-1265e8be23df tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:58.196605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c6b858a4-3d0f-4679-bd4f-1265e8be23df tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:58.203167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6b858a4-3d0f-4679-bd4f-1265e8be23df tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:58.203789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6b858a4-3d0f-4679-bd4f-1265e8be23df tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:58.204180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6b858a4-3d0f-4679-bd4f-1265e8be23df tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:58.204869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6b858a4-3d0f-4679-bd4f-1265e8be23df tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:58.205329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6b858a4-3d0f-4679-bd4f-1265e8be23df tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:58.205868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c6b858a4-3d0f-4679-bd4f-1265e8be23df tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:58.341446 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c6b858a4-3d0f-4679-bd4f-1265e8be23df tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1656 microversion: 2.1 time: 0.149281 Oct 29 03:36:58.342055 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3415/6873] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:58 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1656 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:58.801169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-304d8ce0-3927-43c9-ae18-25a9ce0f1a5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:58.801859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-304d8ce0-3927-43c9-ae18-25a9ce0f1a5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:58.809891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-304d8ce0-3927-43c9-ae18-25a9ce0f1a5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:58.810490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-304d8ce0-3927-43c9-ae18-25a9ce0f1a5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:58.810991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-304d8ce0-3927-43c9-ae18-25a9ce0f1a5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:58.811755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-304d8ce0-3927-43c9-ae18-25a9ce0f1a5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:58.812440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-304d8ce0-3927-43c9-ae18-25a9ce0f1a5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:58.812914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-304d8ce0-3927-43c9-ae18-25a9ce0f1a5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:58.904280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-304d8ce0-3927-43c9-ae18-25a9ce0f1a5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:58.912857 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-304d8ce0-3927-43c9-ae18-25a9ce0f1a5e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1282 microversion: 2.1 time: 0.115921 Oct 29 03:36:58.913467 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3459/6874] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:58 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:58.996548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9a4bafc5-cc49-40db-af5b-eb01e226dd00 req-86c4ffd7-d0e7-4abf-8dd2-eba66d277db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d637d75-9f7f-437d-8b26-486b791bca2a", "name": "network-vif-deleted", "tag": "ef633979-04da-4a35-bfa0-1c010de013ad"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:59.014139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9a4bafc5-cc49-40db-af5b-eb01e226dd00 req-86c4ffd7-d0e7-4abf-8dd2-eba66d277db2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:59.015366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9a4bafc5-cc49-40db-af5b-eb01e226dd00 req-86c4ffd7-d0e7-4abf-8dd2-eba66d277db2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:59.016346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9a4bafc5-cc49-40db-af5b-eb01e226dd00 req-86c4ffd7-d0e7-4abf-8dd2-eba66d277db2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:59.048750 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9a4bafc5-cc49-40db-af5b-eb01e226dd00 req-86c4ffd7-d0e7-4abf-8dd2-eba66d277db2 service nova] Creating event network-vif-deleted:ef633979-04da-4a35-bfa0-1c010de013ad for instance 7d637d75-9f7f-437d-8b26-486b791bca2a on n-h2-862964-4 Oct 29 03:36:59.063369 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9a4bafc5-cc49-40db-af5b-eb01e226dd00 req-86c4ffd7-d0e7-4abf-8dd2-eba66d277db2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071685 Oct 29 03:36:59.065242 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3416/6875] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:59.366860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:59.368062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:59.378316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:59.378813 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:59.379304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:59.380325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:59.380786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:59.381208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:59.417705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:59.418476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:59.418902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:59.419340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lazy-loading 'fault' on Instance uuid 7d637d75-9f7f-437d-8b26-486b791bca2a {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:36:59.479503 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a9f289ad-a92f-4449-8894-4fd3ccd987a8 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 200 len: 1454 microversion: 2.1 time: 0.117672 Oct 29 03:36:59.493828 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3460/6876] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:59 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:59.938035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44e7479e-0716-4046-adf3-53f33b7a5fdc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:59.939077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-44e7479e-0716-4046-adf3-53f33b7a5fdc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:59.947267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44e7479e-0716-4046-adf3-53f33b7a5fdc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:59.947867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44e7479e-0716-4046-adf3-53f33b7a5fdc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:59.948269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44e7479e-0716-4046-adf3-53f33b7a5fdc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:59.949208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44e7479e-0716-4046-adf3-53f33b7a5fdc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:59.958642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44e7479e-0716-4046-adf3-53f33b7a5fdc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:59.959414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44e7479e-0716-4046-adf3-53f33b7a5fdc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:00.125074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-44e7479e-0716-4046-adf3-53f33b7a5fdc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:00.134265 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-44e7479e-0716-4046-adf3-53f33b7a5fdc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.201879 Oct 29 03:37:00.135121 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3417/6877] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:59 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:00.506581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:00.507294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 7d637d75-9f7f-437d-8b26-486b791bca2a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:00.514616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:00.515137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:00.515643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:00.516347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:00.516834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:00.517255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:00.535935 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] HTTP exception thrown: Instance 7d637d75-9f7f-437d-8b26-486b791bca2a could not be found. Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Request method failure captured: Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a HTTP/1.1 Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ_AWScyhz_UkBLGgKIzXAVzpJZqWhMhm45J-1tvaokIc7IdlCsXV2YMxlDGjk4uwYiyDMApZ0m0xvtzeSnjyoBaiIU4Ja_1rO8SjuJX0Sg2rek3je0MZlngoCykVpNa7VEh9wbTS8cHYMnQlBEPvvVQ22YptAutkuGuVuJxumUdXJI Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: d22b116efcf74cfaa4f1679b3d771106 Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestServerMultinode-522210466 Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d22b116efcf74cfaa4f1679b3d771106"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22b116efcf74cfaa4f1679b3d771106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d22b116efcf74cfaa4f1679b3d771106", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22b116efcf74cfaa4f1679b3d771106"}]}] Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestServerMultinode-522210466 Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: d22b116efcf74cfaa4f1679b3d771106 Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestServerMultinode-522210466 Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestServerMultinode-522210466-project-admin Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 5a1209d131484e9eaba0d6e63b0efd42 Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestServerMultinode-522210466-project-admin Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 7d637d75-9f7f-437d-8b26-486b791bca2a could not be found. Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '7d637d75-9f7f-437d-8b26-486b791bca2a'} Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d637d75-9f7f-437d-8b26-486b791bca2a could not be found. Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d637d75-9f7f-437d-8b26-486b791bca2a could not be found. Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:00.537629 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:00.541269 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:00.541269 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:00.541269 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:00.541269 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:37:00.541269 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:37:00.541269 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d637d75-9f7f-437d-8b26-486b791bca2a could not be found. Oct 29 03:37:00.541269 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:00.541269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Returning 404 to user: Instance 7d637d75-9f7f-437d-8b26-486b791bca2a could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:37:00.541269 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3e06eb7c-7e26-410c-a64a-91a603be871e tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a" status: 404 len: 111 microversion: 2.1 time: 0.036496 Oct 29 03:37:00.542981 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3461/6878] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:00 2022] GET /compute/v2.1/servers/7d637d75-9f7f-437d-8b26-486b791bca2a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:37:00.549273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-367d3eb8-88c9-4206-8cd5-bb7966210836 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:00.550161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-367d3eb8-88c9-4206-8cd5-bb7966210836 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:00.557123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-367d3eb8-88c9-4206-8cd5-bb7966210836 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:00.558231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-367d3eb8-88c9-4206-8cd5-bb7966210836 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:00.558895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-367d3eb8-88c9-4206-8cd5-bb7966210836 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:00.559866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-367d3eb8-88c9-4206-8cd5-bb7966210836 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:00.560412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-367d3eb8-88c9-4206-8cd5-bb7966210836 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:00.560982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-367d3eb8-88c9-4206-8cd5-bb7966210836 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:00.589393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-367d3eb8-88c9-4206-8cd5-bb7966210836 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:37:00.665857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:00.684934 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-367d3eb8-88c9-4206-8cd5-bb7966210836 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 204 len: 0 microversion: 2.1 time: 0.139596 Oct 29 03:37:00.686427 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3418/6879] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:37:00 2022] DELETE /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:37:00.694776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fb58aa6c-5523-4cc9-b95d-d94e70ecf390 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:00.696329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fb58aa6c-5523-4cc9-b95d-d94e70ecf390 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:00.702855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb58aa6c-5523-4cc9-b95d-d94e70ecf390 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:00.703680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb58aa6c-5523-4cc9-b95d-d94e70ecf390 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:00.704306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb58aa6c-5523-4cc9-b95d-d94e70ecf390 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:00.705263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb58aa6c-5523-4cc9-b95d-d94e70ecf390 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:00.705974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb58aa6c-5523-4cc9-b95d-d94e70ecf390 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:00.706602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fb58aa6c-5523-4cc9-b95d-d94e70ecf390 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:00.835838 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fb58aa6c-5523-4cc9-b95d-d94e70ecf390 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1654 microversion: 2.1 time: 0.144969 Oct 29 03:37:00.836398 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3462/6880] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:00 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1654 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:37:01.082053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6c6320d5-2df7-4bc1-899d-616674d2ea22 req-14232a9f-d35f-4979-925f-60ca6e0734db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35253151-353a-48b4-b376-e82c3dfd498f", "tag": "c4d73254-0d92-4c02-8259-3a75861bbb68"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:37:01.097303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6c6320d5-2df7-4bc1-899d-616674d2ea22 req-14232a9f-d35f-4979-925f-60ca6e0734db service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:01.097846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6c6320d5-2df7-4bc1-899d-616674d2ea22 req-14232a9f-d35f-4979-925f-60ca6e0734db service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:01.098262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6c6320d5-2df7-4bc1-899d-616674d2ea22 req-14232a9f-d35f-4979-925f-60ca6e0734db service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:01.109192 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6c6320d5-2df7-4bc1-899d-616674d2ea22 req-14232a9f-d35f-4979-925f-60ca6e0734db service nova] Creating event network-changed:c4d73254-0d92-4c02-8259-3a75861bbb68 for instance 35253151-353a-48b4-b376-e82c3dfd498f on n-h1-862964-4 Oct 29 03:37:01.114300 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6c6320d5-2df7-4bc1-899d-616674d2ea22 req-14232a9f-d35f-4979-925f-60ca6e0734db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036525 Oct 29 03:37:01.115228 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3419/6881] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:37:01.158383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-50f90f24-79de-4fe6-b1c8-06699ca2ec42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:01.159231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-50f90f24-79de-4fe6-b1c8-06699ca2ec42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:01.165832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f90f24-79de-4fe6-b1c8-06699ca2ec42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:01.166482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f90f24-79de-4fe6-b1c8-06699ca2ec42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:01.167027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f90f24-79de-4fe6-b1c8-06699ca2ec42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:01.167755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f90f24-79de-4fe6-b1c8-06699ca2ec42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:01.168232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f90f24-79de-4fe6-b1c8-06699ca2ec42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:01.168647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50f90f24-79de-4fe6-b1c8-06699ca2ec42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:01.301987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-50f90f24-79de-4fe6-b1c8-06699ca2ec42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:01.310237 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-50f90f24-79de-4fe6-b1c8-06699ca2ec42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.156073 Oct 29 03:37:01.310910 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3463/6882] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:01 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:01.861194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4cf29f30-2bf4-4a03-8909-03583dbb3f44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:01.862008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4cf29f30-2bf4-4a03-8909-03583dbb3f44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:01.870246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf29f30-2bf4-4a03-8909-03583dbb3f44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:01.870913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf29f30-2bf4-4a03-8909-03583dbb3f44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:01.871462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf29f30-2bf4-4a03-8909-03583dbb3f44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:01.872080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf29f30-2bf4-4a03-8909-03583dbb3f44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:01.872551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf29f30-2bf4-4a03-8909-03583dbb3f44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:01.872987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4cf29f30-2bf4-4a03-8909-03583dbb3f44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:02.016286 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4cf29f30-2bf4-4a03-8909-03583dbb3f44 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1654 microversion: 2.1 time: 0.159559 Oct 29 03:37:02.017210 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3420/6883] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:01 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1654 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:02.332776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-29ee350a-9bd8-4d3a-8296-bfdad20be987 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:02.334085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-29ee350a-9bd8-4d3a-8296-bfdad20be987 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:02.341750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29ee350a-9bd8-4d3a-8296-bfdad20be987 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:02.342496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29ee350a-9bd8-4d3a-8296-bfdad20be987 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:02.342905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29ee350a-9bd8-4d3a-8296-bfdad20be987 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:02.343873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29ee350a-9bd8-4d3a-8296-bfdad20be987 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:02.344383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29ee350a-9bd8-4d3a-8296-bfdad20be987 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:02.344805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-29ee350a-9bd8-4d3a-8296-bfdad20be987 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:02.576681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-29ee350a-9bd8-4d3a-8296-bfdad20be987 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:02.589029 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-29ee350a-9bd8-4d3a-8296-bfdad20be987 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.260081 Oct 29 03:37:02.589984 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3464/6884] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:02 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:02.775664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-27c46177-96fa-4f23-b28a-cbf3a68d0371 req-989610e7-5564-4487-93ce-3f74d574d917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247e5251-3eb0-402e-9748-58d243b099c1", "name": "network-vif-deleted", "tag": "9c5d7a07-5c05-4092-96cf-7da426559566"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:37:02.815840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-27c46177-96fa-4f23-b28a-cbf3a68d0371 req-989610e7-5564-4487-93ce-3f74d574d917 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:02.819172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-27c46177-96fa-4f23-b28a-cbf3a68d0371 req-989610e7-5564-4487-93ce-3f74d574d917 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:02.819988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-27c46177-96fa-4f23-b28a-cbf3a68d0371 req-989610e7-5564-4487-93ce-3f74d574d917 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:02.837465 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-27c46177-96fa-4f23-b28a-cbf3a68d0371 req-989610e7-5564-4487-93ce-3f74d574d917 service nova] Creating event network-vif-deleted:9c5d7a07-5c05-4092-96cf-7da426559566 for instance 247e5251-3eb0-402e-9748-58d243b099c1 on n-h1-862964-4 Oct 29 03:37:02.849494 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-27c46177-96fa-4f23-b28a-cbf3a68d0371 req-989610e7-5564-4487-93ce-3f74d574d917 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104122 Oct 29 03:37:02.850678 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3421/6885] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:37:03.040376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:03.041002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:03.058083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:03.058579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:03.060500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:03.064677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:03.065374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:03.065834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:03.102121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:03.102604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:03.103042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:03.103486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lazy-loading 'fault' on Instance uuid 247e5251-3eb0-402e-9748-58d243b099c1 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:37:03.167403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:03.181147 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3311b26c-7f79-4706-95da-b0bf3e1b458d tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 200 len: 1453 microversion: 2.1 time: 0.144765 Oct 29 03:37:03.186020 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3465/6886] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:03 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:03.614833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-651bd234-8d69-4e69-8f0f-6c4aa5f790d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:03.615526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-651bd234-8d69-4e69-8f0f-6c4aa5f790d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:03.625349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-651bd234-8d69-4e69-8f0f-6c4aa5f790d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:03.625349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-651bd234-8d69-4e69-8f0f-6c4aa5f790d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:03.628809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-651bd234-8d69-4e69-8f0f-6c4aa5f790d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:03.628809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-651bd234-8d69-4e69-8f0f-6c4aa5f790d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:03.628809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-651bd234-8d69-4e69-8f0f-6c4aa5f790d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:03.628809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-651bd234-8d69-4e69-8f0f-6c4aa5f790d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:03.824750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-651bd234-8d69-4e69-8f0f-6c4aa5f790d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:03.841233 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-651bd234-8d69-4e69-8f0f-6c4aa5f790d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.230463 Oct 29 03:37:03.843443 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3422/6887] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:03 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:04.220373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:04.221097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] [instance: 247e5251-3eb0-402e-9748-58d243b099c1] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:04.231919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:04.232714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:04.233180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:04.234015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:04.234733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:04.235332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:04.256731 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] HTTP exception thrown: Instance 247e5251-3eb0-402e-9748-58d243b099c1 could not be found. Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Request method failure captured: Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 HTTP/1.1 Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ_AWScyhz_UkBLGgKIzXAVzpJZqWhMhm45J-1tvaokIc7IdlCsXV2YMxlDGjk4uwYiyDMApZ0m0xvtzeSnjyoBaiIU4Ja_1rO8SjuJX0Sg2rek3je0MZlngoCykVpNa7VEh9wbTS8cHYMnQlBEPvvVQ22YptAutkuGuVuJxumUdXJI Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: d22b116efcf74cfaa4f1679b3d771106 Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestServerMultinode-522210466 Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d22b116efcf74cfaa4f1679b3d771106"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22b116efcf74cfaa4f1679b3d771106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d22b116efcf74cfaa4f1679b3d771106", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22b116efcf74cfaa4f1679b3d771106"}]}] Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestServerMultinode-522210466 Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: d22b116efcf74cfaa4f1679b3d771106 Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestServerMultinode-522210466 Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestServerMultinode-522210466-project-admin Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 5a1209d131484e9eaba0d6e63b0efd42 Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestServerMultinode-522210466-project-admin Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 247e5251-3eb0-402e-9748-58d243b099c1 could not be found. Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '247e5251-3eb0-402e-9748-58d243b099c1'} Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 247e5251-3eb0-402e-9748-58d243b099c1 could not be found. Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 247e5251-3eb0-402e-9748-58d243b099c1 could not be found. Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:04.257946 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:04.264609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:04.264609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:04.264609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:04.264609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:37:04.264609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:37:04.264609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 247e5251-3eb0-402e-9748-58d243b099c1 could not be found. Oct 29 03:37:04.264609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:04.264609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] Returning 404 to user: Instance 247e5251-3eb0-402e-9748-58d243b099c1 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:37:04.264609 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-08862280-d00f-4321-a84a-d54aeb668658 tempest-TestServerMultinode-522210466 tempest-TestServerMultinode-522210466-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1" status: 404 len: 111 microversion: 2.1 time: 0.044955 Oct 29 03:37:04.264609 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3466/6888] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:04 2022] GET /compute/v2.1/servers/247e5251-3eb0-402e-9748-58d243b099c1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:37:04.902078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6df78131-98a9-4ca9-bdd2-9f80865d7042 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:04.905292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6df78131-98a9-4ca9-bdd2-9f80865d7042 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:04.913566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6df78131-98a9-4ca9-bdd2-9f80865d7042 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:04.914268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6df78131-98a9-4ca9-bdd2-9f80865d7042 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:04.914702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6df78131-98a9-4ca9-bdd2-9f80865d7042 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:04.915554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6df78131-98a9-4ca9-bdd2-9f80865d7042 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:04.916034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6df78131-98a9-4ca9-bdd2-9f80865d7042 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:04.916458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6df78131-98a9-4ca9-bdd2-9f80865d7042 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:05.240052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6df78131-98a9-4ca9-bdd2-9f80865d7042 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:05.251494 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6df78131-98a9-4ca9-bdd2-9f80865d7042 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.358525 Oct 29 03:37:05.263279 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3423/6889] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:04 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:06.289015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2eaae844-3fe9-4c9b-ba73-9e09bf40ad63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:06.289705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2eaae844-3fe9-4c9b-ba73-9e09bf40ad63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:06.297998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2eaae844-3fe9-4c9b-ba73-9e09bf40ad63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:06.298491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2eaae844-3fe9-4c9b-ba73-9e09bf40ad63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:06.299191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2eaae844-3fe9-4c9b-ba73-9e09bf40ad63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:06.300135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2eaae844-3fe9-4c9b-ba73-9e09bf40ad63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:06.300799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2eaae844-3fe9-4c9b-ba73-9e09bf40ad63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:06.301439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2eaae844-3fe9-4c9b-ba73-9e09bf40ad63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:06.572714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2eaae844-3fe9-4c9b-ba73-9e09bf40ad63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:06.591578 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2eaae844-3fe9-4c9b-ba73-9e09bf40ad63 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.313892 Oct 29 03:37:06.592365 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3467/6890] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:06 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:07.616851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ba8b033-8553-493e-849c-5d1f518dbec7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:07.620247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ba8b033-8553-493e-849c-5d1f518dbec7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:07.621641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:07.623035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:07.636667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ba8b033-8553-493e-849c-5d1f518dbec7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:07.637281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ba8b033-8553-493e-849c-5d1f518dbec7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:07.637847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ba8b033-8553-493e-849c-5d1f518dbec7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:07.638657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ba8b033-8553-493e-849c-5d1f518dbec7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:07.639359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ba8b033-8553-493e-849c-5d1f518dbec7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:07.643558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ba8b033-8553-493e-849c-5d1f518dbec7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:07.829626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ba8b033-8553-493e-849c-5d1f518dbec7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:07.838161 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ba8b033-8553-493e-849c-5d1f518dbec7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.225783 Oct 29 03:37:07.838756 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3424/6891] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:07 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:08.864157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-735ae3e1-e5a9-4941-b331-79aa4d61d693 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:08.865789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-735ae3e1-e5a9-4941-b331-79aa4d61d693 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:08.869247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:08.881221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735ae3e1-e5a9-4941-b331-79aa4d61d693 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:08.881655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735ae3e1-e5a9-4941-b331-79aa4d61d693 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:08.882216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735ae3e1-e5a9-4941-b331-79aa4d61d693 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:08.883024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735ae3e1-e5a9-4941-b331-79aa4d61d693 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:08.883587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735ae3e1-e5a9-4941-b331-79aa4d61d693 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:08.884233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-735ae3e1-e5a9-4941-b331-79aa4d61d693 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:09.056509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-735ae3e1-e5a9-4941-b331-79aa4d61d693 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:09.066097 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-735ae3e1-e5a9-4941-b331-79aa4d61d693 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.207204 Oct 29 03:37:09.066759 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3468/6892] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:08 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:10.091099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c78a8462-000f-4afd-ba00-13b32d852a49 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:10.091793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c78a8462-000f-4afd-ba00-13b32d852a49 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:10.101666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c78a8462-000f-4afd-ba00-13b32d852a49 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:10.102202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c78a8462-000f-4afd-ba00-13b32d852a49 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:10.102826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c78a8462-000f-4afd-ba00-13b32d852a49 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:10.103797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c78a8462-000f-4afd-ba00-13b32d852a49 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:10.104415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c78a8462-000f-4afd-ba00-13b32d852a49 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:10.105007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c78a8462-000f-4afd-ba00-13b32d852a49 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:10.372466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c78a8462-000f-4afd-ba00-13b32d852a49 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:10.381655 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c78a8462-000f-4afd-ba00-13b32d852a49 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.294466 Oct 29 03:37:10.382552 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3425/6893] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:10 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:11.404962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-666d6ff0-7b5c-4665-87b6-b8ff618b0fd8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:11.405758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-666d6ff0-7b5c-4665-87b6-b8ff618b0fd8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:11.416416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-666d6ff0-7b5c-4665-87b6-b8ff618b0fd8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:11.417050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-666d6ff0-7b5c-4665-87b6-b8ff618b0fd8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:11.417544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-666d6ff0-7b5c-4665-87b6-b8ff618b0fd8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:11.418309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-666d6ff0-7b5c-4665-87b6-b8ff618b0fd8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:11.418754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-666d6ff0-7b5c-4665-87b6-b8ff618b0fd8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:11.419699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-666d6ff0-7b5c-4665-87b6-b8ff618b0fd8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:11.674852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-666d6ff0-7b5c-4665-87b6-b8ff618b0fd8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:11.689723 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-666d6ff0-7b5c-4665-87b6-b8ff618b0fd8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.288898 Oct 29 03:37:11.691043 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3469/6894] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:11 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:12.718196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b70b20b7-4574-4915-aecb-fc1447ef8951 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:12.722007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b70b20b7-4574-4915-aecb-fc1447ef8951 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:12.734644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70b20b7-4574-4915-aecb-fc1447ef8951 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:12.735527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70b20b7-4574-4915-aecb-fc1447ef8951 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:12.736071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70b20b7-4574-4915-aecb-fc1447ef8951 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:12.736874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70b20b7-4574-4915-aecb-fc1447ef8951 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:12.737455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70b20b7-4574-4915-aecb-fc1447ef8951 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:12.737972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70b20b7-4574-4915-aecb-fc1447ef8951 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:12.904699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b70b20b7-4574-4915-aecb-fc1447ef8951 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:12.915981 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b70b20b7-4574-4915-aecb-fc1447ef8951 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.202508 Oct 29 03:37:12.918888 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3426/6895] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:12 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:13.941851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41d2e1ed-c15f-4d58-9ca5-21923cacadc5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:13.942849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-41d2e1ed-c15f-4d58-9ca5-21923cacadc5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:13.951332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d2e1ed-c15f-4d58-9ca5-21923cacadc5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:13.951875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d2e1ed-c15f-4d58-9ca5-21923cacadc5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:13.952869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d2e1ed-c15f-4d58-9ca5-21923cacadc5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:13.954546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d2e1ed-c15f-4d58-9ca5-21923cacadc5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:13.955492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d2e1ed-c15f-4d58-9ca5-21923cacadc5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:13.956047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41d2e1ed-c15f-4d58-9ca5-21923cacadc5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:14.115014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-41d2e1ed-c15f-4d58-9ca5-21923cacadc5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:14.124491 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-41d2e1ed-c15f-4d58-9ca5-21923cacadc5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1342 microversion: 2.1 time: 0.186915 Oct 29 03:37:14.129860 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3470/6896] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:13 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1342 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:15.151443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-428a6cab-4b1c-4698-878b-517ee5f4616b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:15.152269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-428a6cab-4b1c-4698-878b-517ee5f4616b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:15.162306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428a6cab-4b1c-4698-878b-517ee5f4616b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:15.162998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428a6cab-4b1c-4698-878b-517ee5f4616b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:15.163635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428a6cab-4b1c-4698-878b-517ee5f4616b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:15.164627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428a6cab-4b1c-4698-878b-517ee5f4616b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:15.165273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428a6cab-4b1c-4698-878b-517ee5f4616b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:15.165930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428a6cab-4b1c-4698-878b-517ee5f4616b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:15.183674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:15.315019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-428a6cab-4b1c-4698-878b-517ee5f4616b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:15.323532 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-428a6cab-4b1c-4698-878b-517ee5f4616b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1376 microversion: 2.1 time: 0.177683 Oct 29 03:37:15.324111 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3427/6897] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:15 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1376 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:16.349874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de9ff8da-9af5-461f-9a54-a0f424e83de7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:16.350761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-de9ff8da-9af5-461f-9a54-a0f424e83de7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:16.361610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9ff8da-9af5-461f-9a54-a0f424e83de7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:16.362385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9ff8da-9af5-461f-9a54-a0f424e83de7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:16.362971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9ff8da-9af5-461f-9a54-a0f424e83de7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:16.363966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9ff8da-9af5-461f-9a54-a0f424e83de7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:16.364993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9ff8da-9af5-461f-9a54-a0f424e83de7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:16.365592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de9ff8da-9af5-461f-9a54-a0f424e83de7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:16.502903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de9ff8da-9af5-461f-9a54-a0f424e83de7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:16.511537 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de9ff8da-9af5-461f-9a54-a0f424e83de7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1376 microversion: 2.1 time: 0.167459 Oct 29 03:37:16.512177 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3471/6898] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:16 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:17.535460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b66dd711-06be-42f7-8f2d-e8f1fb003820 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:17.536182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b66dd711-06be-42f7-8f2d-e8f1fb003820 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:17.544354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66dd711-06be-42f7-8f2d-e8f1fb003820 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:17.544908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66dd711-06be-42f7-8f2d-e8f1fb003820 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:17.545342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66dd711-06be-42f7-8f2d-e8f1fb003820 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:17.546092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66dd711-06be-42f7-8f2d-e8f1fb003820 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:17.546562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66dd711-06be-42f7-8f2d-e8f1fb003820 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:17.546996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b66dd711-06be-42f7-8f2d-e8f1fb003820 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:17.690521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b66dd711-06be-42f7-8f2d-e8f1fb003820 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:17.701763 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b66dd711-06be-42f7-8f2d-e8f1fb003820 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1376 microversion: 2.1 time: 0.170109 Oct 29 03:37:17.702588 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3428/6899] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:17 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:18.725485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f20fb20-2ff4-4604-90be-c4ecd9d45b95 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:18.726229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f20fb20-2ff4-4604-90be-c4ecd9d45b95 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:18.734834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20fb20-2ff4-4604-90be-c4ecd9d45b95 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:18.735341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20fb20-2ff4-4604-90be-c4ecd9d45b95 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:18.735778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20fb20-2ff4-4604-90be-c4ecd9d45b95 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:18.736490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20fb20-2ff4-4604-90be-c4ecd9d45b95 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:18.736933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20fb20-2ff4-4604-90be-c4ecd9d45b95 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:18.737370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f20fb20-2ff4-4604-90be-c4ecd9d45b95 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:18.890415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f20fb20-2ff4-4604-90be-c4ecd9d45b95 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:18.899469 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f20fb20-2ff4-4604-90be-c4ecd9d45b95 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1376 microversion: 2.1 time: 0.178153 Oct 29 03:37:18.900060 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3472/6900] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:18 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1376 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:19.924383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f47e1e6-0b52-4f72-ae2c-137b2e52114c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:19.924963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f47e1e6-0b52-4f72-ae2c-137b2e52114c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:19.932712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f47e1e6-0b52-4f72-ae2c-137b2e52114c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:19.933239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f47e1e6-0b52-4f72-ae2c-137b2e52114c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:19.933705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f47e1e6-0b52-4f72-ae2c-137b2e52114c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:19.934506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f47e1e6-0b52-4f72-ae2c-137b2e52114c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:19.934971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f47e1e6-0b52-4f72-ae2c-137b2e52114c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:19.935480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f47e1e6-0b52-4f72-ae2c-137b2e52114c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:20.077750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f47e1e6-0b52-4f72-ae2c-137b2e52114c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:20.086587 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f47e1e6-0b52-4f72-ae2c-137b2e52114c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1376 microversion: 2.1 time: 0.166759 Oct 29 03:37:20.087297 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3429/6901] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:19 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:21.115402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82b21569-ab10-4a8d-a8f7-933476f740fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:21.116505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-82b21569-ab10-4a8d-a8f7-933476f740fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:21.125479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b21569-ab10-4a8d-a8f7-933476f740fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:21.126220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b21569-ab10-4a8d-a8f7-933476f740fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:21.126757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b21569-ab10-4a8d-a8f7-933476f740fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:21.127846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b21569-ab10-4a8d-a8f7-933476f740fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:21.128461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b21569-ab10-4a8d-a8f7-933476f740fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:21.129085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82b21569-ab10-4a8d-a8f7-933476f740fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:21.282284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-82b21569-ab10-4a8d-a8f7-933476f740fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:21.292830 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-82b21569-ab10-4a8d-a8f7-933476f740fc tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1376 microversion: 2.1 time: 0.183570 Oct 29 03:37:21.293563 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3473/6902] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:21 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1376 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:37:22.317265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2caa9c87-adf3-42a4-8804-887be9526b1a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:22.317890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2caa9c87-adf3-42a4-8804-887be9526b1a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:22.325371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2caa9c87-adf3-42a4-8804-887be9526b1a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:22.325920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2caa9c87-adf3-42a4-8804-887be9526b1a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:22.326364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2caa9c87-adf3-42a4-8804-887be9526b1a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:22.327050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2caa9c87-adf3-42a4-8804-887be9526b1a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:22.327540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2caa9c87-adf3-42a4-8804-887be9526b1a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:22.327976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2caa9c87-adf3-42a4-8804-887be9526b1a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:22.471546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2caa9c87-adf3-42a4-8804-887be9526b1a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:22.481254 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2caa9c87-adf3-42a4-8804-887be9526b1a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1376 microversion: 2.1 time: 0.168265 Oct 29 03:37:22.481971 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3430/6903] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:22 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1376 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:23.508907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7e0ebc6a-8f2a-4a7e-995f-bbce0a355a2b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:23.509535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7e0ebc6a-8f2a-4a7e-995f-bbce0a355a2b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:23.517188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0ebc6a-8f2a-4a7e-995f-bbce0a355a2b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:23.517711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0ebc6a-8f2a-4a7e-995f-bbce0a355a2b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:23.518168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0ebc6a-8f2a-4a7e-995f-bbce0a355a2b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:23.518853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0ebc6a-8f2a-4a7e-995f-bbce0a355a2b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:23.519316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0ebc6a-8f2a-4a7e-995f-bbce0a355a2b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:23.519739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e0ebc6a-8f2a-4a7e-995f-bbce0a355a2b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:23.657703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7e0ebc6a-8f2a-4a7e-995f-bbce0a355a2b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:23.665742 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7e0ebc6a-8f2a-4a7e-995f-bbce0a355a2b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1376 microversion: 2.1 time: 0.160900 Oct 29 03:37:23.666363 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3474/6904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:23 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:24.689648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5179e2a7-faf6-43c8-98eb-3cb78a7a0713 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:24.690311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5179e2a7-faf6-43c8-98eb-3cb78a7a0713 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:24.698458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5179e2a7-faf6-43c8-98eb-3cb78a7a0713 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:24.699019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5179e2a7-faf6-43c8-98eb-3cb78a7a0713 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:24.699476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5179e2a7-faf6-43c8-98eb-3cb78a7a0713 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:24.700145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5179e2a7-faf6-43c8-98eb-3cb78a7a0713 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:24.700607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5179e2a7-faf6-43c8-98eb-3cb78a7a0713 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:24.701044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5179e2a7-faf6-43c8-98eb-3cb78a7a0713 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:24.808673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-21cfc4a9-266e-4297-946c-7c64306b9a5d req-b0806d5f-da5f-4837-9cb3-e2a443beaf52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35253151-353a-48b4-b376-e82c3dfd498f", "name": "network-vif-plugged", "status": "completed", "tag": "c4d73254-0d92-4c02-8259-3a75861bbb68"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:37:24.821536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-21cfc4a9-266e-4297-946c-7c64306b9a5d req-b0806d5f-da5f-4837-9cb3-e2a443beaf52 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:24.822302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-21cfc4a9-266e-4297-946c-7c64306b9a5d req-b0806d5f-da5f-4837-9cb3-e2a443beaf52 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:24.823413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-21cfc4a9-266e-4297-946c-7c64306b9a5d req-b0806d5f-da5f-4837-9cb3-e2a443beaf52 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:24.841042 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-21cfc4a9-266e-4297-946c-7c64306b9a5d req-b0806d5f-da5f-4837-9cb3-e2a443beaf52 service nova] Creating event network-vif-plugged:c4d73254-0d92-4c02-8259-3a75861bbb68 for instance 35253151-353a-48b4-b376-e82c3dfd498f on n-h1-862964-4 Oct 29 03:37:24.847326 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-21cfc4a9-266e-4297-946c-7c64306b9a5d req-b0806d5f-da5f-4837-9cb3-e2a443beaf52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043151 Oct 29 03:37:24.848072 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3475/6905] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:37:24.857164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5179e2a7-faf6-43c8-98eb-3cb78a7a0713 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:24.866967 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5179e2a7-faf6-43c8-98eb-3cb78a7a0713 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1376 microversion: 2.1 time: 0.181360 Oct 29 03:37:24.867573 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3431/6906] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:24 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1376 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:25.894599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b40ee959-979e-4991-b721-68e309983fc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:25.895408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b40ee959-979e-4991-b721-68e309983fc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:25.902880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b40ee959-979e-4991-b721-68e309983fc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:25.903491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b40ee959-979e-4991-b721-68e309983fc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:25.904032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b40ee959-979e-4991-b721-68e309983fc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:25.904757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b40ee959-979e-4991-b721-68e309983fc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:25.905276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b40ee959-979e-4991-b721-68e309983fc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:25.905751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b40ee959-979e-4991-b721-68e309983fc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:26.067760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b40ee959-979e-4991-b721-68e309983fc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:26.077093 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b40ee959-979e-4991-b721-68e309983fc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1376 microversion: 2.1 time: 0.188242 Oct 29 03:37:26.077822 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3476/6907] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:25 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1376 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:37:27.103560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b73bdd8-0fc6-462c-a985-29ead2bbb795 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:27.104476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8b73bdd8-0fc6-462c-a985-29ead2bbb795 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:27.112698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b73bdd8-0fc6-462c-a985-29ead2bbb795 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:27.113177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b73bdd8-0fc6-462c-a985-29ead2bbb795 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:27.113676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b73bdd8-0fc6-462c-a985-29ead2bbb795 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:27.114757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b73bdd8-0fc6-462c-a985-29ead2bbb795 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:27.115243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b73bdd8-0fc6-462c-a985-29ead2bbb795 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:27.115686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b73bdd8-0fc6-462c-a985-29ead2bbb795 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:27.262612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8b73bdd8-0fc6-462c-a985-29ead2bbb795 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:27.272299 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b73bdd8-0fc6-462c-a985-29ead2bbb795 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1563 microversion: 2.1 time: 0.174266 Oct 29 03:37:27.273050 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3432/6908] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:27 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:27.298573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-73a54009-96b7-4c18-a5c5-124e90ea4dc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:27.299206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-73a54009-96b7-4c18-a5c5-124e90ea4dc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:27.309201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73a54009-96b7-4c18-a5c5-124e90ea4dc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:27.309906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73a54009-96b7-4c18-a5c5-124e90ea4dc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:27.310595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73a54009-96b7-4c18-a5c5-124e90ea4dc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:27.311265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73a54009-96b7-4c18-a5c5-124e90ea4dc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:27.311741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73a54009-96b7-4c18-a5c5-124e90ea4dc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:27.312176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73a54009-96b7-4c18-a5c5-124e90ea4dc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:27.459347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-73a54009-96b7-4c18-a5c5-124e90ea4dc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:27.468182 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-73a54009-96b7-4c18-a5c5-124e90ea4dc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1563 microversion: 2.1 time: 0.175323 Oct 29 03:37:27.468761 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3477/6909] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:27 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:27.565767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ca7b4568-0235-4369-a83c-dda7098246a9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:27.566375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ca7b4568-0235-4369-a83c-dda7098246a9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:27.573009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7b4568-0235-4369-a83c-dda7098246a9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:27.573519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7b4568-0235-4369-a83c-dda7098246a9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:27.574007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7b4568-0235-4369-a83c-dda7098246a9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:27.574753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7b4568-0235-4369-a83c-dda7098246a9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:27.575221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7b4568-0235-4369-a83c-dda7098246a9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:27.575663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca7b4568-0235-4369-a83c-dda7098246a9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:27.602613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ca7b4568-0235-4369-a83c-dda7098246a9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:37:27.682700 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ca7b4568-0235-4369-a83c-dda7098246a9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 204 len: 0 microversion: 2.1 time: 0.120264 Oct 29 03:37:27.683432 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3433/6910] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:37:27 2022] DELETE /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:37:27.692448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7f243ede-2097-4d16-9738-afac7acd9e98 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:27.693041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7f243ede-2097-4d16-9738-afac7acd9e98 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:27.699307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f243ede-2097-4d16-9738-afac7acd9e98 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:27.699792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f243ede-2097-4d16-9738-afac7acd9e98 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:27.700218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f243ede-2097-4d16-9738-afac7acd9e98 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:27.701006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f243ede-2097-4d16-9738-afac7acd9e98 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:27.701593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f243ede-2097-4d16-9738-afac7acd9e98 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:27.702058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7f243ede-2097-4d16-9738-afac7acd9e98 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:27.850441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7f243ede-2097-4d16-9738-afac7acd9e98 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:27.858957 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7f243ede-2097-4d16-9738-afac7acd9e98 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1569 microversion: 2.1 time: 0.170609 Oct 29 03:37:27.859538 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3478/6911] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:27 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:28.893468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bfbffa1e-2dd7-43a0-9b34-67657b79c0d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:28.894284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bfbffa1e-2dd7-43a0-9b34-67657b79c0d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:28.904135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfbffa1e-2dd7-43a0-9b34-67657b79c0d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:28.904845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfbffa1e-2dd7-43a0-9b34-67657b79c0d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:28.905317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfbffa1e-2dd7-43a0-9b34-67657b79c0d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:28.906254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfbffa1e-2dd7-43a0-9b34-67657b79c0d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:28.906814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfbffa1e-2dd7-43a0-9b34-67657b79c0d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:28.907439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfbffa1e-2dd7-43a0-9b34-67657b79c0d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:29.067281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bfbffa1e-2dd7-43a0-9b34-67657b79c0d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:29.076553 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bfbffa1e-2dd7-43a0-9b34-67657b79c0d7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1569 microversion: 2.1 time: 0.189096 Oct 29 03:37:29.077261 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3434/6912] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:28 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:37:29.817781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-5dc03eba-358c-476f-8074-67dc1fa85d33 req-529adda3-137d-4a48-aae8-2188737b7155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35253151-353a-48b4-b376-e82c3dfd498f", "name": "network-vif-deleted", "tag": "c4d73254-0d92-4c02-8259-3a75861bbb68"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:37:29.828841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=45 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:29.835498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5dc03eba-358c-476f-8074-67dc1fa85d33 req-529adda3-137d-4a48-aae8-2188737b7155 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:29.836462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5dc03eba-358c-476f-8074-67dc1fa85d33 req-529adda3-137d-4a48-aae8-2188737b7155 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:29.837910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5dc03eba-358c-476f-8074-67dc1fa85d33 req-529adda3-137d-4a48-aae8-2188737b7155 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:29.855371 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-5dc03eba-358c-476f-8074-67dc1fa85d33 req-529adda3-137d-4a48-aae8-2188737b7155 service nova] Creating event network-vif-deleted:c4d73254-0d92-4c02-8259-3a75861bbb68 for instance 35253151-353a-48b4-b376-e82c3dfd498f on n-h1-862964-4 Oct 29 03:37:29.863892 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-5dc03eba-358c-476f-8074-67dc1fa85d33 req-529adda3-137d-4a48-aae8-2188737b7155 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052702 Oct 29 03:37:29.865081 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3479/6913] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:37:30.101836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c58e8186-816b-42d6-aa24-771cbc1f6715 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:30.102479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c58e8186-816b-42d6-aa24-771cbc1f6715 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:30.111571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c58e8186-816b-42d6-aa24-771cbc1f6715 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:30.112169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c58e8186-816b-42d6-aa24-771cbc1f6715 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:30.112815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c58e8186-816b-42d6-aa24-771cbc1f6715 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:30.113874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c58e8186-816b-42d6-aa24-771cbc1f6715 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:30.114849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c58e8186-816b-42d6-aa24-771cbc1f6715 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:30.115410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c58e8186-816b-42d6-aa24-771cbc1f6715 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:30.186744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c58e8186-816b-42d6-aa24-771cbc1f6715 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:30.197651 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c58e8186-816b-42d6-aa24-771cbc1f6715 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1361 microversion: 2.1 time: 0.100468 Oct 29 03:37:30.198882 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3435/6914] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:30 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1361 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:31.224419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-69592135-096b-44d4-9113-517b1e8683de tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:31.226863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-69592135-096b-44d4-9113-517b1e8683de tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:31.232589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69592135-096b-44d4-9113-517b1e8683de tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:31.233076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69592135-096b-44d4-9113-517b1e8683de tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:31.233526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69592135-096b-44d4-9113-517b1e8683de tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:31.234230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69592135-096b-44d4-9113-517b1e8683de tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:31.234679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69592135-096b-44d4-9113-517b1e8683de tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:31.235161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-69592135-096b-44d4-9113-517b1e8683de tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:31.303272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-69592135-096b-44d4-9113-517b1e8683de tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:31.311577 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-69592135-096b-44d4-9113-517b1e8683de tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1361 microversion: 2.1 time: 0.092087 Oct 29 03:37:31.312158 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3480/6915] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:31 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1361 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:32.339495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-24483ed4-db9b-444a-ac80-653250f82378 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:32.340506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-24483ed4-db9b-444a-ac80-653250f82378 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:32.344968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:32.350795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24483ed4-db9b-444a-ac80-653250f82378 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:32.351303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24483ed4-db9b-444a-ac80-653250f82378 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:32.351746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24483ed4-db9b-444a-ac80-653250f82378 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:32.352466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24483ed4-db9b-444a-ac80-653250f82378 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:32.352926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24483ed4-db9b-444a-ac80-653250f82378 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:32.353363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24483ed4-db9b-444a-ac80-653250f82378 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:32.418512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-24483ed4-db9b-444a-ac80-653250f82378 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:32.426910 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-24483ed4-db9b-444a-ac80-653250f82378 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1361 microversion: 2.1 time: 0.094627 Oct 29 03:37:32.427490 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3436/6916] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:32 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1361 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:33.451099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-73fa557a-2d7f-47d1-a52d-4ada584ddde6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:33.451692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-73fa557a-2d7f-47d1-a52d-4ada584ddde6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:33.459773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73fa557a-2d7f-47d1-a52d-4ada584ddde6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:33.460337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73fa557a-2d7f-47d1-a52d-4ada584ddde6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:33.460778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73fa557a-2d7f-47d1-a52d-4ada584ddde6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:33.461488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73fa557a-2d7f-47d1-a52d-4ada584ddde6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:33.462010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73fa557a-2d7f-47d1-a52d-4ada584ddde6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:33.462443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-73fa557a-2d7f-47d1-a52d-4ada584ddde6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:33.527263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-73fa557a-2d7f-47d1-a52d-4ada584ddde6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:33.535820 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-73fa557a-2d7f-47d1-a52d-4ada584ddde6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1361 microversion: 2.1 time: 0.088949 Oct 29 03:37:33.536427 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3481/6917] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:33 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1361 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:34.564309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:34.565040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:34.573067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:34.573615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:34.574373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:34.575743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:34.576244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:34.576770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:34.621155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:34.622071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:34.622527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:34.623356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lazy-loading 'fault' on Instance uuid 35253151-353a-48b4-b376-e82c3dfd498f {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:37:34.669337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:34.676915 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-56c54f74-b942-4735-aafd-9789a5efe879 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 200 len: 1320 microversion: 2.1 time: 0.119040 Oct 29 03:37:34.678567 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3437/6918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:34 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 1320 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:35.700910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:35.701491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:35.709099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:35.709597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:35.710063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:35.710751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:35.711198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:35.711618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:35.714403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=85 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:35.730138 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f HTTP/1.1 Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '35253151-353a-48b4-b376-e82c3dfd498f'} Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:35.731919 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:35.735949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:35.735949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:35.735949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:35.735949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:37:35.735949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:37:35.735949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:35.735949 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:35.735949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:37:35.735949 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1e09bf42-50af-4c64-9544-fbb7aef0556e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 404 len: 111 microversion: 2.1 time: 0.036520 Oct 29 03:37:35.735949 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3482/6919] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:35 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:37:38.978934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-002043d4-4a22-4e15-a8af-5ecae7858778 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:38.979477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-002043d4-4a22-4e15-a8af-5ecae7858778 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:38.991242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-002043d4-4a22-4e15-a8af-5ecae7858778 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:38.991802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-002043d4-4a22-4e15-a8af-5ecae7858778 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:38.992424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-002043d4-4a22-4e15-a8af-5ecae7858778 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:38.993496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-002043d4-4a22-4e15-a8af-5ecae7858778 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:38.994221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-002043d4-4a22-4e15-a8af-5ecae7858778 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:38.994815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-002043d4-4a22-4e15-a8af-5ecae7858778 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:39.025235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-002043d4-4a22-4e15-a8af-5ecae7858778 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:37:39.107215 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-002043d4-4a22-4e15-a8af-5ecae7858778 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 204 len: 0 microversion: 2.1 time: 0.133870 Oct 29 03:37:39.107994 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3438/6920] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:37:38 2022] DELETE /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:37:39.119594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-82a36e31-a996-44dd-8b0c-7abbdc81185c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:39.120297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-82a36e31-a996-44dd-8b0c-7abbdc81185c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:39.129992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82a36e31-a996-44dd-8b0c-7abbdc81185c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:39.130555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82a36e31-a996-44dd-8b0c-7abbdc81185c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:39.130983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82a36e31-a996-44dd-8b0c-7abbdc81185c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:39.131716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82a36e31-a996-44dd-8b0c-7abbdc81185c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:39.132161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82a36e31-a996-44dd-8b0c-7abbdc81185c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:39.132583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-82a36e31-a996-44dd-8b0c-7abbdc81185c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:39.280435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-82a36e31-a996-44dd-8b0c-7abbdc81185c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:39.288958 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-82a36e31-a996-44dd-8b0c-7abbdc81185c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1411 microversion: 2.1 time: 0.175802 Oct 29 03:37:39.289628 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3483/6921] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:39 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1411 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:40.316788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a1c232c3-b7f6-4cb5-b0d1-d85d10c998bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:40.317514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a1c232c3-b7f6-4cb5-b0d1-d85d10c998bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:40.325611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1c232c3-b7f6-4cb5-b0d1-d85d10c998bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:40.326141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1c232c3-b7f6-4cb5-b0d1-d85d10c998bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:40.326594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1c232c3-b7f6-4cb5-b0d1-d85d10c998bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:40.327282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1c232c3-b7f6-4cb5-b0d1-d85d10c998bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:40.327772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1c232c3-b7f6-4cb5-b0d1-d85d10c998bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:40.328204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a1c232c3-b7f6-4cb5-b0d1-d85d10c998bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:40.465785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a1c232c3-b7f6-4cb5-b0d1-d85d10c998bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:40.474420 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a1c232c3-b7f6-4cb5-b0d1-d85d10c998bf tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1411 microversion: 2.1 time: 0.164876 Oct 29 03:37:40.474992 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3439/6922] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:40 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1411 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:41.456326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-664fc4a4-591e-4d6a-99be-619187207533 req-3c372d42-9f0b-4bb0-b451-f1b939bd3ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c25cb4a-f172-4e8b-ba81-b3a694d6c44b", "name": "network-vif-deleted", "tag": "efd54e87-dd6d-47c4-9981-8b84937436af"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:37:41.471232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-664fc4a4-591e-4d6a-99be-619187207533 req-3c372d42-9f0b-4bb0-b451-f1b939bd3ce8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:41.471983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-664fc4a4-591e-4d6a-99be-619187207533 req-3c372d42-9f0b-4bb0-b451-f1b939bd3ce8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:41.472650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-664fc4a4-591e-4d6a-99be-619187207533 req-3c372d42-9f0b-4bb0-b451-f1b939bd3ce8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:41.485522 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-664fc4a4-591e-4d6a-99be-619187207533 req-3c372d42-9f0b-4bb0-b451-f1b939bd3ce8 service nova] Creating event network-vif-deleted:efd54e87-dd6d-47c4-9981-8b84937436af for instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b on n-h2-862964-4 Oct 29 03:37:41.492958 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-664fc4a4-591e-4d6a-99be-619187207533 req-3c372d42-9f0b-4bb0-b451-f1b939bd3ce8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039069 Oct 29 03:37:41.493582 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3484/6923] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:37:41.502871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-20f9aee9-6a9e-4bc9-918d-0e3f279a3a7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:41.503595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-20f9aee9-6a9e-4bc9-918d-0e3f279a3a7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:41.511872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20f9aee9-6a9e-4bc9-918d-0e3f279a3a7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:41.512511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20f9aee9-6a9e-4bc9-918d-0e3f279a3a7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:41.513119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20f9aee9-6a9e-4bc9-918d-0e3f279a3a7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:41.514096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20f9aee9-6a9e-4bc9-918d-0e3f279a3a7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:41.514632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20f9aee9-6a9e-4bc9-918d-0e3f279a3a7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:41.515145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20f9aee9-6a9e-4bc9-918d-0e3f279a3a7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:41.530584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:41.583712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-20f9aee9-6a9e-4bc9-918d-0e3f279a3a7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:41.593926 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-20f9aee9-6a9e-4bc9-918d-0e3f279a3a7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1202 microversion: 2.1 time: 0.099611 Oct 29 03:37:41.594543 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3440/6924] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:41 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:37:42.620117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-66866a1e-fc15-4235-ab71-a912c36aff78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:42.620913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-66866a1e-fc15-4235-ab71-a912c36aff78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:42.627853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66866a1e-fc15-4235-ab71-a912c36aff78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:42.628329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66866a1e-fc15-4235-ab71-a912c36aff78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:42.628763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66866a1e-fc15-4235-ab71-a912c36aff78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:42.629527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66866a1e-fc15-4235-ab71-a912c36aff78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:42.630027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66866a1e-fc15-4235-ab71-a912c36aff78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:42.630428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66866a1e-fc15-4235-ab71-a912c36aff78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:42.700155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-66866a1e-fc15-4235-ab71-a912c36aff78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:42.709091 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-66866a1e-fc15-4235-ab71-a912c36aff78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1202 microversion: 2.1 time: 0.094714 Oct 29 03:37:42.709670 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3485/6925] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:42 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1202 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:43.732908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7ff3ac3-bacb-4cde-9d54-4308b1c9b014 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:43.733702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7ff3ac3-bacb-4cde-9d54-4308b1c9b014 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:43.741787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7ff3ac3-bacb-4cde-9d54-4308b1c9b014 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:43.742330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7ff3ac3-bacb-4cde-9d54-4308b1c9b014 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:43.742790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7ff3ac3-bacb-4cde-9d54-4308b1c9b014 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:43.743510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7ff3ac3-bacb-4cde-9d54-4308b1c9b014 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:43.744014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7ff3ac3-bacb-4cde-9d54-4308b1c9b014 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:43.744454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7ff3ac3-bacb-4cde-9d54-4308b1c9b014 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:43.808610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c7ff3ac3-bacb-4cde-9d54-4308b1c9b014 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:43.817032 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7ff3ac3-bacb-4cde-9d54-4308b1c9b014 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1202 microversion: 2.1 time: 0.088263 Oct 29 03:37:43.817648 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3441/6926] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:43 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:44.840637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-18f19e4d-8abb-4151-a34d-a64e51c530c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:44.841188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-18f19e4d-8abb-4151-a34d-a64e51c530c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:44.848749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18f19e4d-8abb-4151-a34d-a64e51c530c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:44.849239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18f19e4d-8abb-4151-a34d-a64e51c530c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:44.849648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18f19e4d-8abb-4151-a34d-a64e51c530c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:44.850405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18f19e4d-8abb-4151-a34d-a64e51c530c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:44.850857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18f19e4d-8abb-4151-a34d-a64e51c530c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:44.851275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-18f19e4d-8abb-4151-a34d-a64e51c530c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:44.915770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-18f19e4d-8abb-4151-a34d-a64e51c530c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:44.923997 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-18f19e4d-8abb-4151-a34d-a64e51c530c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1202 microversion: 2.1 time: 0.087580 Oct 29 03:37:44.924556 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3486/6927] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:44 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:45.947112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:45.947704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:45.955090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:45.955553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:45.956000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:45.956727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:45.957364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:45.958022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:45.991452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:45.992013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:45.992584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:45.993098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lazy-loading 'fault' on Instance uuid 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:37:46.034250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:37:46.042617 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e89e799c-26db-4a10-8e84-75263a686c1d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 200 len: 1207 microversion: 2.1 time: 0.099444 Oct 29 03:37:46.043196 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3442/6928] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:45 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 1207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:37:47.066464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:47.067077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:47.074636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:47.075240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:47.075748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:47.076526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:47.077048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:47.077537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:47.092272 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b HTTP/1.1 Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2c25cb4a-f172-4e8b-ba81-b3a694d6c44b'} Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:47.094092 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:47.098055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:47.098055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:47.098055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:47.098055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:37:47.098055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:37:47.098055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:47.098055 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:47.098055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:37:47.098055 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-501f4f58-4ff5-457a-bb4d-611c280315d1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 404 len: 111 microversion: 2.1 time: 0.034364 Oct 29 03:37:47.098055 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3487/6929] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:47 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:37:49.242451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:49.242976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:49.250582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:49.251076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:49.251516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:49.252230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:49.252689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:49.253121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:49.267019 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f HTTP/1.1 Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '35253151-353a-48b4-b376-e82c3dfd498f'} Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:37:49.268707 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4bb0c0b1-b102-4675-a90b-ffd8d03d9c0f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 404 len: 111 microversion: 2.1 time: 0.032322 Oct 29 03:37:49.272978 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3443/6930] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:37:49 2022] DELETE /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:37:49.279360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:49.279973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 35253151-353a-48b4-b376-e82c3dfd498f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:49.287112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:49.287594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:49.288024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:49.288724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:49.289170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:49.289587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:49.303748 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f HTTP/1.1 Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '35253151-353a-48b4-b376-e82c3dfd498f'} Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:49.305213 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.308648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.308648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:49.308648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:49.308648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:37:49.308648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:37:49.308648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. Oct 29 03:37:49.308648 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.308648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance 35253151-353a-48b4-b376-e82c3dfd498f could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:37:49.308648 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d3c022e4-f1f2-4325-b0e8-f632b2cfb1c7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f" status: 404 len: 111 microversion: 2.1 time: 0.031296 Oct 29 03:37:49.308648 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3488/6931] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:49 2022] GET /compute/v2.1/servers/35253151-353a-48b4-b376-e82c3dfd498f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:37:49.839194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:49.839825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:49.845930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:49.846426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:49.846867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:49.847590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:49.848051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:49.848483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:49.862027 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b HTTP/1.1 Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '2c25cb4a-f172-4e8b-ba81-b3a694d6c44b'} Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:37:49.863654 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a7a5135-80f4-48db-97af-94814e6f10b2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 404 len: 111 microversion: 2.1 time: 0.030228 Oct 29 03:37:49.867942 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3444/6932] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:37:49 2022] DELETE /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:37:49.874359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:37:49.874973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:37:49.881212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:49.881699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:49.882157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:49.882849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:37:49.883329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:37:49.883732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:37:49.898337 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b HTTP/1.1 Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '2c25cb4a-f172-4e8b-ba81-b3a694d6c44b'} Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:37:49.899999 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.904456 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:37:49.904456 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:37:49.904456 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:37:49.904456 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:37:49.904456 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:37:49.904456 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. Oct 29 03:37:49.904456 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:37:49.904456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance 2c25cb4a-f172-4e8b-ba81-b3a694d6c44b could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:37:49.904456 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d6fca3a-bfc1-462e-a1cb-399d1b4ffa38 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b" status: 404 len: 111 microversion: 2.1 time: 0.031168 Oct 29 03:37:49.904456 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3489/6933] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:37:49 2022] GET /compute/v2.1/servers/2c25cb4a-f172-4e8b-ba81-b3a694d6c44b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:37:49.980410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5ab634a9-bfd9-43b6-98b5-6bc3bf5b86af tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Action: 'create', calling method: .version_select at 0x7fe1a3cf4a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1576760927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9skZ2Cl2WZ1IZv+KiRSMfo9ay1asY6dWuKYkEJJnp3han0XBImem5tdnTjr0WGxCV4yp7FQUjA8h/MOj5fd6EAMZPKtG5YON3l/7FJsw1AK9+ITwyZAotkRLxrdXOi2w=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:37:49.997685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5ab634a9-bfd9-43b6-98b5-6bc3bf5b86af tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:37:50.003021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-5ab634a9-bfd9-43b6-98b5-6bc3bf5b86af tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for user 3bf87a4bd94c45fa9b30f01267ec743d and project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:37:50.035351 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5ab634a9-bfd9-43b6-98b5-6bc3bf5b86af tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.058800 Oct 29 03:37:50.035960 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3445/6934] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:37:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:38:06.394684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-360353008", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1576760927", "security_groups": [{"name": "tempest-secgroup-smoke-758814000"}], "block_device_mapping_v2": [{"uuid": "45037d6a-393a-48c2-8472-2520c9368348", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f5520295-9b65-428a-9f37-5ffc8779f39a"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:38:06.405570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=21 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:06.406306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=27 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:06.521372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] validate_networks() for [('f5520295-9b65-428a-9f37-5ffc8779f39a', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:38:06.921516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:38:06.921974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:38:06.922447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:38:06.922850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:38:06.923256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:38:06.932910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:06.933370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:06.933790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:06.934526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:06.934969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:06.935385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:06.952371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:38:06.957832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for user 3bf87a4bd94c45fa9b30f01267ec743d and project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:38:07.018712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:38:07.020871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45037d6a-393a-48c2-8472-2520c9368348',volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:38:07.160689 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fa33b417-e7b2-4f8b-9ae5-ff301a4c5d54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.769934 Oct 29 03:38:07.161349 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3490/6935] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:38:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:38:07.170802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=21 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:07.171616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:07.172563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:07.176631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-93a75fc9-6b4f-4927-a414-dbe6f6e552d5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:07.177272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-93a75fc9-6b4f-4927-a414-dbe6f6e552d5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:07.237892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-93a75fc9-6b4f-4927-a414-dbe6f6e552d5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:07.246274 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-93a75fc9-6b4f-4927-a414-dbe6f6e552d5 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1094 microversion: 2.1 time: 0.077457 Oct 29 03:38:07.246873 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3446/6936] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:07 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:08.270311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-71ed8b94-ca18-44f2-ae73-0591d61cadf2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:08.271612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-71ed8b94-ca18-44f2-ae73-0591d61cadf2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:08.278443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71ed8b94-ca18-44f2-ae73-0591d61cadf2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:08.279207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71ed8b94-ca18-44f2-ae73-0591d61cadf2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:08.279641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71ed8b94-ca18-44f2-ae73-0591d61cadf2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:08.280375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71ed8b94-ca18-44f2-ae73-0591d61cadf2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:08.280824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71ed8b94-ca18-44f2-ae73-0591d61cadf2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:08.281242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71ed8b94-ca18-44f2-ae73-0591d61cadf2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:08.359330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-71ed8b94-ca18-44f2-ae73-0591d61cadf2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:08.383437 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-71ed8b94-ca18-44f2-ae73-0591d61cadf2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1200 microversion: 2.1 time: 0.118203 Oct 29 03:38:08.384031 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3491/6937] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:08 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:09.407711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e155f46b-6996-4f58-8266-8a717a7efd0b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:09.408540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e155f46b-6996-4f58-8266-8a717a7efd0b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:09.415822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e155f46b-6996-4f58-8266-8a717a7efd0b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:09.416312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e155f46b-6996-4f58-8266-8a717a7efd0b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:09.416762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e155f46b-6996-4f58-8266-8a717a7efd0b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:09.417672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e155f46b-6996-4f58-8266-8a717a7efd0b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:09.418176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e155f46b-6996-4f58-8266-8a717a7efd0b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:09.418797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e155f46b-6996-4f58-8266-8a717a7efd0b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:09.584812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e155f46b-6996-4f58-8266-8a717a7efd0b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:09.594198 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e155f46b-6996-4f58-8266-8a717a7efd0b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1277 microversion: 2.1 time: 0.190695 Oct 29 03:38:09.595149 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3447/6938] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:09 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:09.823937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9a49b56a-1de1-42ef-959d-1efc6cf3f797 req-e7134b47-0910-402f-a332-6a83ddacd60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8853d1-0492-4342-a7a2-98489e9f1135", "tag": "7122995d-a8d9-4425-aac6-faa3bd958a12"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:38:09.836771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9a49b56a-1de1-42ef-959d-1efc6cf3f797 req-e7134b47-0910-402f-a332-6a83ddacd60a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:09.837478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9a49b56a-1de1-42ef-959d-1efc6cf3f797 req-e7134b47-0910-402f-a332-6a83ddacd60a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:09.838152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9a49b56a-1de1-42ef-959d-1efc6cf3f797 req-e7134b47-0910-402f-a332-6a83ddacd60a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:09.850835 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9a49b56a-1de1-42ef-959d-1efc6cf3f797 req-e7134b47-0910-402f-a332-6a83ddacd60a service nova] Creating event network-changed:7122995d-a8d9-4425-aac6-faa3bd958a12 for instance cf8853d1-0492-4342-a7a2-98489e9f1135 on n-h1-862964-4 Oct 29 03:38:09.856274 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9a49b56a-1de1-42ef-959d-1efc6cf3f797 req-e7134b47-0910-402f-a332-6a83ddacd60a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036322 Oct 29 03:38:09.857583 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3492/6939] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:38:10.618812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1ab1cb7c-43c3-4d64-9ec2-f450aefbe4c0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:10.619423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1ab1cb7c-43c3-4d64-9ec2-f450aefbe4c0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:10.627615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab1cb7c-43c3-4d64-9ec2-f450aefbe4c0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:10.628104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab1cb7c-43c3-4d64-9ec2-f450aefbe4c0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:10.628591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab1cb7c-43c3-4d64-9ec2-f450aefbe4c0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:10.629329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab1cb7c-43c3-4d64-9ec2-f450aefbe4c0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:10.629817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab1cb7c-43c3-4d64-9ec2-f450aefbe4c0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:10.630282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ab1cb7c-43c3-4d64-9ec2-f450aefbe4c0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:10.781824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1ab1cb7c-43c3-4d64-9ec2-f450aefbe4c0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:10.791031 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1ab1cb7c-43c3-4d64-9ec2-f450aefbe4c0 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1277 microversion: 2.1 time: 0.176543 Oct 29 03:38:10.795039 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3448/6940] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:10 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:11.816183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-12857e9b-7364-4ee6-beab-f4bf8a36ddc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:11.816894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-12857e9b-7364-4ee6-beab-f4bf8a36ddc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:11.823727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12857e9b-7364-4ee6-beab-f4bf8a36ddc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:11.824208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12857e9b-7364-4ee6-beab-f4bf8a36ddc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:11.824630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12857e9b-7364-4ee6-beab-f4bf8a36ddc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:11.825322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12857e9b-7364-4ee6-beab-f4bf8a36ddc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:11.825762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12857e9b-7364-4ee6-beab-f4bf8a36ddc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:11.826178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12857e9b-7364-4ee6-beab-f4bf8a36ddc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:11.963603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-12857e9b-7364-4ee6-beab-f4bf8a36ddc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:11.972102 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-12857e9b-7364-4ee6-beab-f4bf8a36ddc4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1277 microversion: 2.1 time: 0.161161 Oct 29 03:38:11.972681 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3493/6941] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:11 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:12.995229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18253c58-9ac2-498a-a56e-f8eff0c1f23d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:12.995796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18253c58-9ac2-498a-a56e-f8eff0c1f23d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:13.003144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18253c58-9ac2-498a-a56e-f8eff0c1f23d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:13.003615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18253c58-9ac2-498a-a56e-f8eff0c1f23d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:13.004055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18253c58-9ac2-498a-a56e-f8eff0c1f23d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:13.004759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18253c58-9ac2-498a-a56e-f8eff0c1f23d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:13.005215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18253c58-9ac2-498a-a56e-f8eff0c1f23d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:13.005644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18253c58-9ac2-498a-a56e-f8eff0c1f23d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:13.148488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18253c58-9ac2-498a-a56e-f8eff0c1f23d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:13.157411 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18253c58-9ac2-498a-a56e-f8eff0c1f23d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1277 microversion: 2.1 time: 0.166083 Oct 29 03:38:13.164516 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3449/6942] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:12 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:14.184908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-686ac37c-fcd0-4a72-b165-5ea8cdf13190 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:14.185909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-686ac37c-fcd0-4a72-b165-5ea8cdf13190 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:14.196409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-686ac37c-fcd0-4a72-b165-5ea8cdf13190 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:14.196895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-686ac37c-fcd0-4a72-b165-5ea8cdf13190 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:14.197331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-686ac37c-fcd0-4a72-b165-5ea8cdf13190 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:14.198077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-686ac37c-fcd0-4a72-b165-5ea8cdf13190 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:14.198528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-686ac37c-fcd0-4a72-b165-5ea8cdf13190 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:14.198952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-686ac37c-fcd0-4a72-b165-5ea8cdf13190 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:14.347466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-686ac37c-fcd0-4a72-b165-5ea8cdf13190 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:14.355965 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-686ac37c-fcd0-4a72-b165-5ea8cdf13190 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1265 microversion: 2.1 time: 0.177926 Oct 29 03:38:14.356551 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3494/6943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:14 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:15.382999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-299795b7-5048-4de5-993f-fca6e08f0697 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:15.383905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-299795b7-5048-4de5-993f-fca6e08f0697 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:15.395258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299795b7-5048-4de5-993f-fca6e08f0697 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:15.396068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299795b7-5048-4de5-993f-fca6e08f0697 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:15.396999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299795b7-5048-4de5-993f-fca6e08f0697 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:15.397708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299795b7-5048-4de5-993f-fca6e08f0697 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:15.398197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299795b7-5048-4de5-993f-fca6e08f0697 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:15.398629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-299795b7-5048-4de5-993f-fca6e08f0697 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:15.542791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-299795b7-5048-4de5-993f-fca6e08f0697 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:15.551002 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-299795b7-5048-4de5-993f-fca6e08f0697 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1265 microversion: 2.1 time: 0.174691 Oct 29 03:38:15.551605 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3450/6944] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:15 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:16.574848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-542e2c5c-d10f-49d8-9a23-1a40b91de55a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:16.575451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-542e2c5c-d10f-49d8-9a23-1a40b91de55a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:16.583006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-542e2c5c-d10f-49d8-9a23-1a40b91de55a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:16.583487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-542e2c5c-d10f-49d8-9a23-1a40b91de55a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:16.583936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-542e2c5c-d10f-49d8-9a23-1a40b91de55a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:16.584630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-542e2c5c-d10f-49d8-9a23-1a40b91de55a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:16.585075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-542e2c5c-d10f-49d8-9a23-1a40b91de55a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:16.585490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-542e2c5c-d10f-49d8-9a23-1a40b91de55a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:16.732132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-542e2c5c-d10f-49d8-9a23-1a40b91de55a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:16.740665 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-542e2c5c-d10f-49d8-9a23-1a40b91de55a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1265 microversion: 2.1 time: 0.169831 Oct 29 03:38:16.741246 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3495/6945] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:16 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:17.767946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aa6f56bf-16f3-471b-8505-a56b9a1da1ba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:17.768967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aa6f56bf-16f3-471b-8505-a56b9a1da1ba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:17.773295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:17.782354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa6f56bf-16f3-471b-8505-a56b9a1da1ba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:17.783171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa6f56bf-16f3-471b-8505-a56b9a1da1ba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:17.783909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa6f56bf-16f3-471b-8505-a56b9a1da1ba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:17.785063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa6f56bf-16f3-471b-8505-a56b9a1da1ba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:17.785864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa6f56bf-16f3-471b-8505-a56b9a1da1ba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:17.786599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aa6f56bf-16f3-471b-8505-a56b9a1da1ba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:17.926038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aa6f56bf-16f3-471b-8505-a56b9a1da1ba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:17.934122 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aa6f56bf-16f3-471b-8505-a56b9a1da1ba tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1265 microversion: 2.1 time: 0.172880 Oct 29 03:38:17.934707 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3451/6946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:17 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:18.960555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6302bc8d-2a34-4d0f-9be8-048f7bbba944 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:18.961155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6302bc8d-2a34-4d0f-9be8-048f7bbba944 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:18.963171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:18.963837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:18.970367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6302bc8d-2a34-4d0f-9be8-048f7bbba944 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:18.970843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6302bc8d-2a34-4d0f-9be8-048f7bbba944 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:18.971272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6302bc8d-2a34-4d0f-9be8-048f7bbba944 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:18.971943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6302bc8d-2a34-4d0f-9be8-048f7bbba944 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:18.972389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6302bc8d-2a34-4d0f-9be8-048f7bbba944 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:18.972805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6302bc8d-2a34-4d0f-9be8-048f7bbba944 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:19.109957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6302bc8d-2a34-4d0f-9be8-048f7bbba944 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:19.118963 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6302bc8d-2a34-4d0f-9be8-048f7bbba944 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1265 microversion: 2.1 time: 0.164404 Oct 29 03:38:19.119542 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3496/6947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:18 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:20.144237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a74061be-ee6c-46e4-a23c-841cc6689d43 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:20.144943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a74061be-ee6c-46e4-a23c-841cc6689d43 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:20.155414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a74061be-ee6c-46e4-a23c-841cc6689d43 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:20.156068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a74061be-ee6c-46e4-a23c-841cc6689d43 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:20.156674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a74061be-ee6c-46e4-a23c-841cc6689d43 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:20.157667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a74061be-ee6c-46e4-a23c-841cc6689d43 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:20.158366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a74061be-ee6c-46e4-a23c-841cc6689d43 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:20.158962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a74061be-ee6c-46e4-a23c-841cc6689d43 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:20.302443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a74061be-ee6c-46e4-a23c-841cc6689d43 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:20.310750 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a74061be-ee6c-46e4-a23c-841cc6689d43 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1265 microversion: 2.1 time: 0.171595 Oct 29 03:38:20.311386 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3452/6948] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:20 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:21.337173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e20b38e6-28fb-412c-acc6-343896e96503 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:21.337733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e20b38e6-28fb-412c-acc6-343896e96503 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:21.345069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e20b38e6-28fb-412c-acc6-343896e96503 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:21.345558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e20b38e6-28fb-412c-acc6-343896e96503 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:21.346033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e20b38e6-28fb-412c-acc6-343896e96503 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:21.346733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e20b38e6-28fb-412c-acc6-343896e96503 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:21.347185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e20b38e6-28fb-412c-acc6-343896e96503 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:21.347609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e20b38e6-28fb-412c-acc6-343896e96503 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:21.491890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e20b38e6-28fb-412c-acc6-343896e96503 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:21.500622 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e20b38e6-28fb-412c-acc6-343896e96503 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1265 microversion: 2.1 time: 0.169193 Oct 29 03:38:21.501223 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3497/6949] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:21 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:22.524852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3d76b5a-6f83-4aba-acc6-f4f78a433925 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:22.525492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a3d76b5a-6f83-4aba-acc6-f4f78a433925 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:22.532219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d76b5a-6f83-4aba-acc6-f4f78a433925 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:22.532726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d76b5a-6f83-4aba-acc6-f4f78a433925 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:22.533171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d76b5a-6f83-4aba-acc6-f4f78a433925 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:22.533928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d76b5a-6f83-4aba-acc6-f4f78a433925 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:22.534393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d76b5a-6f83-4aba-acc6-f4f78a433925 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:22.534829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3d76b5a-6f83-4aba-acc6-f4f78a433925 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:22.691177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3d76b5a-6f83-4aba-acc6-f4f78a433925 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:22.704123 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3d76b5a-6f83-4aba-acc6-f4f78a433925 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1265 microversion: 2.1 time: 0.183309 Oct 29 03:38:22.704905 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3453/6950] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:22 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:23.159079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-53c20586-e77c-4dec-bf07-a0ab7b55c619 req-64f24bf3-8e90-400f-b47a-62e7c26212ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8853d1-0492-4342-a7a2-98489e9f1135", "name": "network-vif-plugged", "status": "completed", "tag": "7122995d-a8d9-4425-aac6-faa3bd958a12"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:38:23.169307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-53c20586-e77c-4dec-bf07-a0ab7b55c619 req-64f24bf3-8e90-400f-b47a-62e7c26212ed service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:23.169776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-53c20586-e77c-4dec-bf07-a0ab7b55c619 req-64f24bf3-8e90-400f-b47a-62e7c26212ed service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:23.170242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-53c20586-e77c-4dec-bf07-a0ab7b55c619 req-64f24bf3-8e90-400f-b47a-62e7c26212ed service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:23.181985 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-53c20586-e77c-4dec-bf07-a0ab7b55c619 req-64f24bf3-8e90-400f-b47a-62e7c26212ed service nova] Creating event network-vif-plugged:7122995d-a8d9-4425-aac6-faa3bd958a12 for instance cf8853d1-0492-4342-a7a2-98489e9f1135 on n-h1-862964-4 Oct 29 03:38:23.187451 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-53c20586-e77c-4dec-bf07-a0ab7b55c619 req-64f24bf3-8e90-400f-b47a-62e7c26212ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167126 Oct 29 03:38:23.188050 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3498/6951] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:38:23.731533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-46a8598f-0029-43c2-a7d9-a22662a2c981 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:23.732444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-46a8598f-0029-43c2-a7d9-a22662a2c981 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:23.743572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a8598f-0029-43c2-a7d9-a22662a2c981 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:23.744316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a8598f-0029-43c2-a7d9-a22662a2c981 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:23.744923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a8598f-0029-43c2-a7d9-a22662a2c981 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:23.745996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a8598f-0029-43c2-a7d9-a22662a2c981 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:23.746665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a8598f-0029-43c2-a7d9-a22662a2c981 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:23.747286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46a8598f-0029-43c2-a7d9-a22662a2c981 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:23.894718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-46a8598f-0029-43c2-a7d9-a22662a2c981 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:23.906504 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-46a8598f-0029-43c2-a7d9-a22662a2c981 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1265 microversion: 2.1 time: 0.180770 Oct 29 03:38:23.907247 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3454/6952] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:23 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:24.934483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bda1667-9807-4a30-86c6-c2d30f676f88 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:24.935115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bda1667-9807-4a30-86c6-c2d30f676f88 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:24.942138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bda1667-9807-4a30-86c6-c2d30f676f88 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:24.942619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bda1667-9807-4a30-86c6-c2d30f676f88 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:24.943050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bda1667-9807-4a30-86c6-c2d30f676f88 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:24.943741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bda1667-9807-4a30-86c6-c2d30f676f88 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:24.944164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bda1667-9807-4a30-86c6-c2d30f676f88 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:24.944597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bda1667-9807-4a30-86c6-c2d30f676f88 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:25.108797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9bda1667-9807-4a30-86c6-c2d30f676f88 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:25.117638 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9bda1667-9807-4a30-86c6-c2d30f676f88 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1452 microversion: 2.1 time: 0.189015 Oct 29 03:38:25.118284 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3499/6953] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:24 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:25.149134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ddc82de-9ba5-4080-8f1a-4cc9dbcccb45 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:25.149748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9ddc82de-9ba5-4080-8f1a-4cc9dbcccb45 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:25.157336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ddc82de-9ba5-4080-8f1a-4cc9dbcccb45 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:25.157842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ddc82de-9ba5-4080-8f1a-4cc9dbcccb45 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:25.158311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ddc82de-9ba5-4080-8f1a-4cc9dbcccb45 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:25.159024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ddc82de-9ba5-4080-8f1a-4cc9dbcccb45 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:25.159478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ddc82de-9ba5-4080-8f1a-4cc9dbcccb45 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:25.159915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ddc82de-9ba5-4080-8f1a-4cc9dbcccb45 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:25.302260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ddc82de-9ba5-4080-8f1a-4cc9dbcccb45 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:25.314088 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ddc82de-9ba5-4080-8f1a-4cc9dbcccb45 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1452 microversion: 2.1 time: 0.169078 Oct 29 03:38:25.314724 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3455/6954] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:25 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:27.295353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-40f054c6-3b29-4192-a841-c415ee716730 req-39c10106-b3e9-4d4b-b9db-ea613f2942a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8853d1-0492-4342-a7a2-98489e9f1135", "tag": "7122995d-a8d9-4425-aac6-faa3bd958a12"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:38:27.305895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-40f054c6-3b29-4192-a841-c415ee716730 req-39c10106-b3e9-4d4b-b9db-ea613f2942a6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:27.306371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-40f054c6-3b29-4192-a841-c415ee716730 req-39c10106-b3e9-4d4b-b9db-ea613f2942a6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:27.306791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-40f054c6-3b29-4192-a841-c415ee716730 req-39c10106-b3e9-4d4b-b9db-ea613f2942a6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:27.318246 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-40f054c6-3b29-4192-a841-c415ee716730 req-39c10106-b3e9-4d4b-b9db-ea613f2942a6 service nova] Creating event network-changed:7122995d-a8d9-4425-aac6-faa3bd958a12 for instance cf8853d1-0492-4342-a7a2-98489e9f1135 on n-h1-862964-4 Oct 29 03:38:27.323952 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-40f054c6-3b29-4192-a841-c415ee716730 req-39c10106-b3e9-4d4b-b9db-ea613f2942a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032392 Oct 29 03:38:27.325149 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3500/6955] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:40:24.695491 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:40:24.696623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=22 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:24.697762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=54 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:24.699301 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 03:40:24.699451 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:40:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 (ip 10.222.0.16) !!! Oct 29 03:40:24.700556 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:40:24.700708 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:40:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 (ip 10.222.0.16) !!! Oct 29 03:40:24.767977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f48a55ce-90a9-4a63-bfbe-21bf1242dcd1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:24.768503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f48a55ce-90a9-4a63-bfbe-21bf1242dcd1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:24.774870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f48a55ce-90a9-4a63-bfbe-21bf1242dcd1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:24.775364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f48a55ce-90a9-4a63-bfbe-21bf1242dcd1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:24.775806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f48a55ce-90a9-4a63-bfbe-21bf1242dcd1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:24.776548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f48a55ce-90a9-4a63-bfbe-21bf1242dcd1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:24.777013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f48a55ce-90a9-4a63-bfbe-21bf1242dcd1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:24.777442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f48a55ce-90a9-4a63-bfbe-21bf1242dcd1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:24.802702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f48a55ce-90a9-4a63-bfbe-21bf1242dcd1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:40:24.889433 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f48a55ce-90a9-4a63-bfbe-21bf1242dcd1 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 204 len: 0 microversion: 2.1 time: 0.197933 Oct 29 03:40:24.890044 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3456/6956] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:40:24 2022] DELETE /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:40:24.897939 n-d-862964-4 devstack@n-api.service[127042]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57dcae21-10f9-47d2-a254-51c1dd17cc94] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:40:24.898860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:24.899622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=50 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:24.900991 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:40:24.901164 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:40:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 (ip 10.222.0.16) !!! Oct 29 03:40:24.912884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d9fcc90-d250-462a-a8b0-66f36ccf9ae4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:24.913597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d9fcc90-d250-462a-a8b0-66f36ccf9ae4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:24.921210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9fcc90-d250-462a-a8b0-66f36ccf9ae4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:24.921684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9fcc90-d250-462a-a8b0-66f36ccf9ae4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:24.922132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9fcc90-d250-462a-a8b0-66f36ccf9ae4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:24.922812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9fcc90-d250-462a-a8b0-66f36ccf9ae4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:24.923253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9fcc90-d250-462a-a8b0-66f36ccf9ae4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:24.923769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d9fcc90-d250-462a-a8b0-66f36ccf9ae4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:25.071373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d9fcc90-d250-462a-a8b0-66f36ccf9ae4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:25.079642 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d9fcc90-d250-462a-a8b0-66f36ccf9ae4 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1577 microversion: 2.1 time: 0.184644 Oct 29 03:40:25.080204 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3501/6957] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:24 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:26.104099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d88e1242-07d0-4572-b489-7b02af3c4077 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:26.104889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d88e1242-07d0-4572-b489-7b02af3c4077 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:26.113327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d88e1242-07d0-4572-b489-7b02af3c4077 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:26.113840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d88e1242-07d0-4572-b489-7b02af3c4077 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:26.114620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d88e1242-07d0-4572-b489-7b02af3c4077 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:26.115329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d88e1242-07d0-4572-b489-7b02af3c4077 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:26.115795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d88e1242-07d0-4572-b489-7b02af3c4077 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:26.116227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d88e1242-07d0-4572-b489-7b02af3c4077 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:26.122500 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43020. Oct 29 03:40:26.254760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d88e1242-07d0-4572-b489-7b02af3c4077 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:26.267425 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d88e1242-07d0-4572-b489-7b02af3c4077 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1577 microversion: 2.1 time: 0.167459 Oct 29 03:40:26.268228 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3457/6958] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:26 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:27.293897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-31d57e68-9443-413c-b3c8-84b4133bd13d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:27.294657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-31d57e68-9443-413c-b3c8-84b4133bd13d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:27.303535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31d57e68-9443-413c-b3c8-84b4133bd13d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:27.304013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31d57e68-9443-413c-b3c8-84b4133bd13d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:27.304421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31d57e68-9443-413c-b3c8-84b4133bd13d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:27.305293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31d57e68-9443-413c-b3c8-84b4133bd13d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:27.305733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31d57e68-9443-413c-b3c8-84b4133bd13d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:27.306174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-31d57e68-9443-413c-b3c8-84b4133bd13d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:27.312640 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] [57dcae21-10f9-47d2-a254-51c1dd17cc94] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43026. Oct 29 03:40:27.381731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-31d57e68-9443-413c-b3c8-84b4133bd13d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:27.390545 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-31d57e68-9443-413c-b3c8-84b4133bd13d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1510 microversion: 2.1 time: 0.100241 Oct 29 03:40:27.390850 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3502/6959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:27 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1510 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:27.534311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-5d2f0f8f-99e2-41f8-840a-8831fbc111b0 req-cc6b8907-9bdc-4580-8e29-26e749967053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8853d1-0492-4342-a7a2-98489e9f1135", "name": "network-vif-deleted", "tag": "7122995d-a8d9-4425-aac6-faa3bd958a12"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:40:27.560663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5d2f0f8f-99e2-41f8-840a-8831fbc111b0 req-cc6b8907-9bdc-4580-8e29-26e749967053 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:27.561412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5d2f0f8f-99e2-41f8-840a-8831fbc111b0 req-cc6b8907-9bdc-4580-8e29-26e749967053 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:27.562104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5d2f0f8f-99e2-41f8-840a-8831fbc111b0 req-cc6b8907-9bdc-4580-8e29-26e749967053 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:27.575911 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-5d2f0f8f-99e2-41f8-840a-8831fbc111b0 req-cc6b8907-9bdc-4580-8e29-26e749967053 service nova] Creating event network-vif-deleted:7122995d-a8d9-4425-aac6-faa3bd958a12 for instance cf8853d1-0492-4342-a7a2-98489e9f1135 on n-h1-862964-4 Oct 29 03:40:27.582155 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-5d2f0f8f-99e2-41f8-840a-8831fbc111b0 req-cc6b8907-9bdc-4580-8e29-26e749967053 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136599 Oct 29 03:40:27.583240 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3458/6960] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:40:28.414733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4650f2f0-7f1d-4298-bbc1-3a1bc638ddb9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:28.415413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4650f2f0-7f1d-4298-bbc1-3a1bc638ddb9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:28.422495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4650f2f0-7f1d-4298-bbc1-3a1bc638ddb9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:28.422981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4650f2f0-7f1d-4298-bbc1-3a1bc638ddb9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:28.423409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4650f2f0-7f1d-4298-bbc1-3a1bc638ddb9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:28.424142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4650f2f0-7f1d-4298-bbc1-3a1bc638ddb9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:28.424588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4650f2f0-7f1d-4298-bbc1-3a1bc638ddb9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:28.425055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4650f2f0-7f1d-4298-bbc1-3a1bc638ddb9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:28.497035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4650f2f0-7f1d-4298-bbc1-3a1bc638ddb9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:28.505832 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4650f2f0-7f1d-4298-bbc1-3a1bc638ddb9 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1225 microversion: 2.1 time: 0.095083 Oct 29 03:40:28.506315 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3503/6961] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:28 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:29.530405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3eb910ed-26b2-4e0a-aada-0170fe827a90 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:29.531125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3eb910ed-26b2-4e0a-aada-0170fe827a90 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:29.538147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3eb910ed-26b2-4e0a-aada-0170fe827a90 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:29.538644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3eb910ed-26b2-4e0a-aada-0170fe827a90 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:29.539098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3eb910ed-26b2-4e0a-aada-0170fe827a90 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:29.540046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3eb910ed-26b2-4e0a-aada-0170fe827a90 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:29.540223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3eb910ed-26b2-4e0a-aada-0170fe827a90 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:29.540885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3eb910ed-26b2-4e0a-aada-0170fe827a90 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:29.608800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3eb910ed-26b2-4e0a-aada-0170fe827a90 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:29.617351 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3eb910ed-26b2-4e0a-aada-0170fe827a90 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1225 microversion: 2.1 time: 0.092521 Oct 29 03:40:29.617956 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3459/6962] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:29 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:30.640864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ca975a5f-cf22-4152-8b47-c0d7356215e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:30.641455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ca975a5f-cf22-4152-8b47-c0d7356215e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:30.648857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca975a5f-cf22-4152-8b47-c0d7356215e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:30.649347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca975a5f-cf22-4152-8b47-c0d7356215e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:30.649780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca975a5f-cf22-4152-8b47-c0d7356215e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:30.650518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca975a5f-cf22-4152-8b47-c0d7356215e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:30.651230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca975a5f-cf22-4152-8b47-c0d7356215e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:30.651422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca975a5f-cf22-4152-8b47-c0d7356215e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:30.723216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca975a5f-cf22-4152-8b47-c0d7356215e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:30.732401 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ca975a5f-cf22-4152-8b47-c0d7356215e6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1225 microversion: 2.1 time: 0.095459 Oct 29 03:40:30.732995 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3504/6963] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:30 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:31.755945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:31.756430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:31.763768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:31.764277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:31.764720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:31.765425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:31.765929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:31.766369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:31.798699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:31.799192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:31.799644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:31.800098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lazy-loading 'fault' on Instance uuid cf8853d1-0492-4342-a7a2-98489e9f1135 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:40:31.841929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:31.850163 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5a0a890e-092a-4bc5-834b-24033bf8ba7b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 200 len: 1230 microversion: 2.1 time: 0.098228 Oct 29 03:40:31.850746 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3460/6964] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:31 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:32.878340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:32.879223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:32.889147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:32.889693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:32.890162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:32.890861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:32.891310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:32.891728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:32.905925 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 HTTP/1.1 Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cf8853d1-0492-4342-a7a2-98489e9f1135'} Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:40:32.907683 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:40:32.912385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:32.912385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:40:32.912385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:40:32.912385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:40:32.912385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:40:32.912385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:40:32.912385 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:40:32.912385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:40:32.912385 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-af27459a-132d-4827-94ab-13d7ed1426cb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 404 len: 111 microversion: 2.1 time: 0.037478 Oct 29 03:40:32.912385 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3505/6965] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:32 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:40:32.959384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1310887408", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1576760927", "security_groups": [{"name": "tempest-secgroup-smoke-758814000"}], "block_device_mapping_v2": [{"uuid": "45037d6a-393a-48c2-8472-2520c9368348", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f5520295-9b65-428a-9f37-5ffc8779f39a"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:40:33.080023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] validate_networks() for [('f5520295-9b65-428a-9f37-5ffc8779f39a', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:40:33.576763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:40:33.577213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:40:33.577700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:40:33.578162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:40:33.578587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:40:33.588650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:33.589185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:33.589645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:33.590424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:33.590894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:33.591335 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:33.609642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:40:33.615532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for user 3bf87a4bd94c45fa9b30f01267ec743d and project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:40:33.676425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:40:33.678608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45037d6a-393a-48c2-8472-2520c9368348',volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:40:33.834906 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f2897569-bc8a-4048-bc2d-333027cc90e8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.879447 Oct 29 03:40:33.835529 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3461/6966] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:40:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:40:33.846981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0ff6a14f-deb9-4f83-9b75-f324b94a02b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:33.847591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0ff6a14f-deb9-4f83-9b75-f324b94a02b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:33.900249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0ff6a14f-deb9-4f83-9b75-f324b94a02b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:33.908574 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0ff6a14f-deb9-4f83-9b75-f324b94a02b3 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1095 microversion: 2.1 time: 0.065531 Oct 29 03:40:33.909592 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3506/6967] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:33 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:34.933155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7657f773-2be5-450d-9da3-a9afe5560e53 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:34.934459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7657f773-2be5-450d-9da3-a9afe5560e53 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:34.940972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7657f773-2be5-450d-9da3-a9afe5560e53 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:34.941490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7657f773-2be5-450d-9da3-a9afe5560e53 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:34.942249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7657f773-2be5-450d-9da3-a9afe5560e53 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:34.942739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7657f773-2be5-450d-9da3-a9afe5560e53 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:34.943246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7657f773-2be5-450d-9da3-a9afe5560e53 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:34.943653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7657f773-2be5-450d-9da3-a9afe5560e53 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:35.009479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7657f773-2be5-450d-9da3-a9afe5560e53 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:35.018608 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7657f773-2be5-450d-9da3-a9afe5560e53 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1201 microversion: 2.1 time: 0.090362 Oct 29 03:40:35.029575 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3462/6968] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:34 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:36.042586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e4a11be4-3b1d-442d-9d23-f6371c748e86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:36.043397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e4a11be4-3b1d-442d-9d23-f6371c748e86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:36.050883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4a11be4-3b1d-442d-9d23-f6371c748e86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:36.051429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4a11be4-3b1d-442d-9d23-f6371c748e86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:36.052172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4a11be4-3b1d-442d-9d23-f6371c748e86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:36.053040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4a11be4-3b1d-442d-9d23-f6371c748e86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:36.053572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4a11be4-3b1d-442d-9d23-f6371c748e86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:36.054070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4a11be4-3b1d-442d-9d23-f6371c748e86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:36.287109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e4a11be4-3b1d-442d-9d23-f6371c748e86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:36.296265 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e4a11be4-3b1d-442d-9d23-f6371c748e86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1278 microversion: 2.1 time: 0.257583 Oct 29 03:40:36.296704 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3507/6969] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:36 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:36.496510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1df530a1-5b8e-4f9b-b78f-6458ce419da7 req-b9e350bd-70ae-48e0-9e5a-2b0c997c13e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336ddc65-86fe-4cb8-97f0-3884eac45a7e", "tag": "838706b9-34e2-4bb0-95aa-6f3fc96b8b34"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:40:36.513516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1df530a1-5b8e-4f9b-b78f-6458ce419da7 req-b9e350bd-70ae-48e0-9e5a-2b0c997c13e7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:36.514136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1df530a1-5b8e-4f9b-b78f-6458ce419da7 req-b9e350bd-70ae-48e0-9e5a-2b0c997c13e7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:36.514555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1df530a1-5b8e-4f9b-b78f-6458ce419da7 req-b9e350bd-70ae-48e0-9e5a-2b0c997c13e7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:36.535254 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1df530a1-5b8e-4f9b-b78f-6458ce419da7 req-b9e350bd-70ae-48e0-9e5a-2b0c997c13e7 service nova] Creating event network-changed:838706b9-34e2-4bb0-95aa-6f3fc96b8b34 for instance 336ddc65-86fe-4cb8-97f0-3884eac45a7e on n-h1-862964-4 Oct 29 03:40:36.545693 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1df530a1-5b8e-4f9b-b78f-6458ce419da7 req-b9e350bd-70ae-48e0-9e5a-2b0c997c13e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061619 Oct 29 03:40:36.546729 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3463/6970] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:40:37.320575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e9c37398-b1d6-44de-a6c7-626f093e0f97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:37.322063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e9c37398-b1d6-44de-a6c7-626f093e0f97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:37.331391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9c37398-b1d6-44de-a6c7-626f093e0f97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:37.332194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9c37398-b1d6-44de-a6c7-626f093e0f97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:37.332809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9c37398-b1d6-44de-a6c7-626f093e0f97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:37.333577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9c37398-b1d6-44de-a6c7-626f093e0f97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:37.334088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9c37398-b1d6-44de-a6c7-626f093e0f97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:37.334509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e9c37398-b1d6-44de-a6c7-626f093e0f97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:37.592229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e9c37398-b1d6-44de-a6c7-626f093e0f97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:37.600870 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e9c37398-b1d6-44de-a6c7-626f093e0f97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1278 microversion: 2.1 time: 0.284600 Oct 29 03:40:37.601443 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3508/6971] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:37 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1278 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:38.624813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8d07db62-aba6-42da-8777-f436b352185a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:38.625516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8d07db62-aba6-42da-8777-f436b352185a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:38.633070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d07db62-aba6-42da-8777-f436b352185a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:38.633549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d07db62-aba6-42da-8777-f436b352185a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:38.634031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d07db62-aba6-42da-8777-f436b352185a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:38.634732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d07db62-aba6-42da-8777-f436b352185a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:38.635198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d07db62-aba6-42da-8777-f436b352185a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:38.635655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d07db62-aba6-42da-8777-f436b352185a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:38.769178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8d07db62-aba6-42da-8777-f436b352185a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:38.777434 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8d07db62-aba6-42da-8777-f436b352185a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1278 microversion: 2.1 time: 0.156923 Oct 29 03:40:38.778025 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3464/6972] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:38 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:39.804181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9629a8c4-bc34-4cf6-bfea-a4e58096345a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:39.804824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9629a8c4-bc34-4cf6-bfea-a4e58096345a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:39.812973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9629a8c4-bc34-4cf6-bfea-a4e58096345a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:39.813479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9629a8c4-bc34-4cf6-bfea-a4e58096345a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:39.813943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9629a8c4-bc34-4cf6-bfea-a4e58096345a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:39.814629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9629a8c4-bc34-4cf6-bfea-a4e58096345a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:39.815077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9629a8c4-bc34-4cf6-bfea-a4e58096345a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:39.815503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9629a8c4-bc34-4cf6-bfea-a4e58096345a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:39.955152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9629a8c4-bc34-4cf6-bfea-a4e58096345a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:39.963102 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9629a8c4-bc34-4cf6-bfea-a4e58096345a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1278 microversion: 2.1 time: 0.165190 Oct 29 03:40:39.963820 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3509/6973] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:39 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:40.991345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4b347485-7a3a-409f-b8ed-06d6c7969dfb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:40.992413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4b347485-7a3a-409f-b8ed-06d6c7969dfb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:41.004148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b347485-7a3a-409f-b8ed-06d6c7969dfb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:41.004973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b347485-7a3a-409f-b8ed-06d6c7969dfb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:41.005710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b347485-7a3a-409f-b8ed-06d6c7969dfb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:41.006919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b347485-7a3a-409f-b8ed-06d6c7969dfb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:41.007681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b347485-7a3a-409f-b8ed-06d6c7969dfb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:41.008410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4b347485-7a3a-409f-b8ed-06d6c7969dfb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:41.150101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4b347485-7a3a-409f-b8ed-06d6c7969dfb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:41.158325 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4b347485-7a3a-409f-b8ed-06d6c7969dfb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1266 microversion: 2.1 time: 0.173893 Oct 29 03:40:41.158884 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3465/6974] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:40 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:42.184215 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8e497567-651a-4a6f-8ce9-50b29e4cbcbd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:42.184819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8e497567-651a-4a6f-8ce9-50b29e4cbcbd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:42.191988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e497567-651a-4a6f-8ce9-50b29e4cbcbd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:42.192477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e497567-651a-4a6f-8ce9-50b29e4cbcbd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:42.192918 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e497567-651a-4a6f-8ce9-50b29e4cbcbd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:42.193631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e497567-651a-4a6f-8ce9-50b29e4cbcbd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:42.194103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e497567-651a-4a6f-8ce9-50b29e4cbcbd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:42.194521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e497567-651a-4a6f-8ce9-50b29e4cbcbd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:42.339274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8e497567-651a-4a6f-8ce9-50b29e4cbcbd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:42.347458 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8e497567-651a-4a6f-8ce9-50b29e4cbcbd tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1266 microversion: 2.1 time: 0.169665 Oct 29 03:40:42.348033 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3510/6975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:42 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:43.375172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c622445e-269e-4978-b52b-feb8a1c50d42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:43.376294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c622445e-269e-4978-b52b-feb8a1c50d42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:43.387720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c622445e-269e-4978-b52b-feb8a1c50d42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:43.388219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c622445e-269e-4978-b52b-feb8a1c50d42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:43.388668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c622445e-269e-4978-b52b-feb8a1c50d42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:43.389349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c622445e-269e-4978-b52b-feb8a1c50d42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:43.389832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c622445e-269e-4978-b52b-feb8a1c50d42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:43.390293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c622445e-269e-4978-b52b-feb8a1c50d42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:43.527056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c622445e-269e-4978-b52b-feb8a1c50d42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:43.535266 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c622445e-269e-4978-b52b-feb8a1c50d42 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1266 microversion: 2.1 time: 0.166642 Oct 29 03:40:43.535860 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3466/6976] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:43 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:44.563070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a0b0070-8599-4d33-9f7a-8317d9355241 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:44.563902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3a0b0070-8599-4d33-9f7a-8317d9355241 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:44.568261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:44.576912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0b0070-8599-4d33-9f7a-8317d9355241 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:44.577396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0b0070-8599-4d33-9f7a-8317d9355241 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:44.577831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0b0070-8599-4d33-9f7a-8317d9355241 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:44.578560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0b0070-8599-4d33-9f7a-8317d9355241 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:44.579045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0b0070-8599-4d33-9f7a-8317d9355241 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:44.579464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a0b0070-8599-4d33-9f7a-8317d9355241 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:44.724991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3a0b0070-8599-4d33-9f7a-8317d9355241 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:44.733083 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3a0b0070-8599-4d33-9f7a-8317d9355241 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1266 microversion: 2.1 time: 0.177215 Oct 29 03:40:44.733689 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3511/6977] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:44 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:45.760521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-21de9279-0663-4e9d-91d8-3086c22519fe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:45.761531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-21de9279-0663-4e9d-91d8-3086c22519fe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:45.765109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:45.766258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:45.776769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21de9279-0663-4e9d-91d8-3086c22519fe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:45.777592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21de9279-0663-4e9d-91d8-3086c22519fe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:45.778395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21de9279-0663-4e9d-91d8-3086c22519fe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:45.779096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21de9279-0663-4e9d-91d8-3086c22519fe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:45.779554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21de9279-0663-4e9d-91d8-3086c22519fe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:45.779968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21de9279-0663-4e9d-91d8-3086c22519fe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:45.925430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-21de9279-0663-4e9d-91d8-3086c22519fe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:45.936360 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-21de9279-0663-4e9d-91d8-3086c22519fe tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1266 microversion: 2.1 time: 0.182466 Oct 29 03:40:45.936973 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3467/6978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:45 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:46.958807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-198e2a58-6fff-4d84-a7dc-70e40e4ee50f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:46.959387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-198e2a58-6fff-4d84-a7dc-70e40e4ee50f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:46.966798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-198e2a58-6fff-4d84-a7dc-70e40e4ee50f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:46.967307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-198e2a58-6fff-4d84-a7dc-70e40e4ee50f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:46.967737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-198e2a58-6fff-4d84-a7dc-70e40e4ee50f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:46.968418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-198e2a58-6fff-4d84-a7dc-70e40e4ee50f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:46.968863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-198e2a58-6fff-4d84-a7dc-70e40e4ee50f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:46.969280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-198e2a58-6fff-4d84-a7dc-70e40e4ee50f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:47.104483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-198e2a58-6fff-4d84-a7dc-70e40e4ee50f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:47.113225 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-198e2a58-6fff-4d84-a7dc-70e40e4ee50f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1266 microversion: 2.1 time: 0.158394 Oct 29 03:40:47.113703 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3512/6979] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:46 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:48.136777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2c2e4ffc-dd1b-4943-8c1a-133a41d3eb7d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:48.137383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2c2e4ffc-dd1b-4943-8c1a-133a41d3eb7d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:48.144937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c2e4ffc-dd1b-4943-8c1a-133a41d3eb7d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:48.145440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c2e4ffc-dd1b-4943-8c1a-133a41d3eb7d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:48.145943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c2e4ffc-dd1b-4943-8c1a-133a41d3eb7d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:48.146656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c2e4ffc-dd1b-4943-8c1a-133a41d3eb7d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:48.147117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c2e4ffc-dd1b-4943-8c1a-133a41d3eb7d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:48.147549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c2e4ffc-dd1b-4943-8c1a-133a41d3eb7d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:48.280537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2c2e4ffc-dd1b-4943-8c1a-133a41d3eb7d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:48.288687 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2c2e4ffc-dd1b-4943-8c1a-133a41d3eb7d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1266 microversion: 2.1 time: 0.155921 Oct 29 03:40:48.289280 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3468/6980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:48 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:49.315716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2ddc9768-0878-4c07-89a8-49b9fb848949 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:49.316670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2ddc9768-0878-4c07-89a8-49b9fb848949 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:49.327316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ddc9768-0878-4c07-89a8-49b9fb848949 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:49.327826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ddc9768-0878-4c07-89a8-49b9fb848949 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:49.328255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ddc9768-0878-4c07-89a8-49b9fb848949 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:49.328936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ddc9768-0878-4c07-89a8-49b9fb848949 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:49.329383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ddc9768-0878-4c07-89a8-49b9fb848949 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:49.329823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2ddc9768-0878-4c07-89a8-49b9fb848949 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:49.475135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2ddc9768-0878-4c07-89a8-49b9fb848949 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:49.487617 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2ddc9768-0878-4c07-89a8-49b9fb848949 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1266 microversion: 2.1 time: 0.178429 Oct 29 03:40:49.488434 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3513/6981] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:49 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:49.805245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3826706c-0b72-45f0-be67-11e92a547e66 req-2983b3f0-1913-4fad-9540-7e35650edd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336ddc65-86fe-4cb8-97f0-3884eac45a7e", "name": "network-vif-plugged", "status": "completed", "tag": "838706b9-34e2-4bb0-95aa-6f3fc96b8b34"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:40:49.816089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3826706c-0b72-45f0-be67-11e92a547e66 req-2983b3f0-1913-4fad-9540-7e35650edd9a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:49.816586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3826706c-0b72-45f0-be67-11e92a547e66 req-2983b3f0-1913-4fad-9540-7e35650edd9a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:49.817022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3826706c-0b72-45f0-be67-11e92a547e66 req-2983b3f0-1913-4fad-9540-7e35650edd9a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:49.829369 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3826706c-0b72-45f0-be67-11e92a547e66 req-2983b3f0-1913-4fad-9540-7e35650edd9a service nova] Creating event network-vif-plugged:838706b9-34e2-4bb0-95aa-6f3fc96b8b34 for instance 336ddc65-86fe-4cb8-97f0-3884eac45a7e on n-h1-862964-4 Oct 29 03:40:49.834656 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3826706c-0b72-45f0-be67-11e92a547e66 req-2983b3f0-1913-4fad-9540-7e35650edd9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033149 Oct 29 03:40:49.835274 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3469/6982] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:40:50.514705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-06432a48-61fc-4521-b90a-b2314bcc9093 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:50.515505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-06432a48-61fc-4521-b90a-b2314bcc9093 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:50.525481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06432a48-61fc-4521-b90a-b2314bcc9093 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:50.526235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06432a48-61fc-4521-b90a-b2314bcc9093 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:50.526844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06432a48-61fc-4521-b90a-b2314bcc9093 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:50.527817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06432a48-61fc-4521-b90a-b2314bcc9093 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:50.528454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06432a48-61fc-4521-b90a-b2314bcc9093 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:50.529048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-06432a48-61fc-4521-b90a-b2314bcc9093 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:50.679907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-06432a48-61fc-4521-b90a-b2314bcc9093 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:50.691628 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-06432a48-61fc-4521-b90a-b2314bcc9093 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1266 microversion: 2.1 time: 0.182773 Oct 29 03:40:50.692394 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3514/6983] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:50 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:51.722858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e0dab0b2-a60e-4fc8-ad01-97e13f6b0d02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:51.723762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e0dab0b2-a60e-4fc8-ad01-97e13f6b0d02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:51.732108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0dab0b2-a60e-4fc8-ad01-97e13f6b0d02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:51.732769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0dab0b2-a60e-4fc8-ad01-97e13f6b0d02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:51.733446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0dab0b2-a60e-4fc8-ad01-97e13f6b0d02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:51.734377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0dab0b2-a60e-4fc8-ad01-97e13f6b0d02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:51.734966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0dab0b2-a60e-4fc8-ad01-97e13f6b0d02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:51.735518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e0dab0b2-a60e-4fc8-ad01-97e13f6b0d02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:51.882487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e0dab0b2-a60e-4fc8-ad01-97e13f6b0d02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:51.895098 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e0dab0b2-a60e-4fc8-ad01-97e13f6b0d02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1453 microversion: 2.1 time: 0.179078 Oct 29 03:40:51.895966 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3470/6984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:51 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:51.921539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5467695-54bc-48ad-bd6d-566f702e6cf7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:51.922321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b5467695-54bc-48ad-bd6d-566f702e6cf7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:51.929592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5467695-54bc-48ad-bd6d-566f702e6cf7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:51.930120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5467695-54bc-48ad-bd6d-566f702e6cf7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:51.930561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5467695-54bc-48ad-bd6d-566f702e6cf7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:51.931262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5467695-54bc-48ad-bd6d-566f702e6cf7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:51.931720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5467695-54bc-48ad-bd6d-566f702e6cf7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:51.932142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5467695-54bc-48ad-bd6d-566f702e6cf7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:52.076825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b5467695-54bc-48ad-bd6d-566f702e6cf7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:52.085069 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b5467695-54bc-48ad-bd6d-566f702e6cf7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1453 microversion: 2.1 time: 0.167686 Oct 29 03:40:52.085645 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3515/6985] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:51 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:53.918560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-14be302a-e60c-4df2-bbed-54986c9a6eee req-138b9111-7133-49bb-8ac4-6f480e18f141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336ddc65-86fe-4cb8-97f0-3884eac45a7e", "tag": "838706b9-34e2-4bb0-95aa-6f3fc96b8b34"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:40:53.928221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-14be302a-e60c-4df2-bbed-54986c9a6eee req-138b9111-7133-49bb-8ac4-6f480e18f141 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:53.928706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-14be302a-e60c-4df2-bbed-54986c9a6eee req-138b9111-7133-49bb-8ac4-6f480e18f141 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:53.929140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-14be302a-e60c-4df2-bbed-54986c9a6eee req-138b9111-7133-49bb-8ac4-6f480e18f141 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:53.940663 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-14be302a-e60c-4df2-bbed-54986c9a6eee req-138b9111-7133-49bb-8ac4-6f480e18f141 service nova] Creating event network-changed:838706b9-34e2-4bb0-95aa-6f3fc96b8b34 for instance 336ddc65-86fe-4cb8-97f0-3884eac45a7e on n-h1-862964-4 Oct 29 03:40:53.945790 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-14be302a-e60c-4df2-bbed-54986c9a6eee req-138b9111-7133-49bb-8ac4-6f480e18f141 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093060 Oct 29 03:40:53.946571 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3471/6986] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:42:32.509468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=32 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:32.510671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=80 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:32.511969 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:42:32.512208 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:42:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 29 03:42:32.514385 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:42:32.514513 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:42:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 29 03:42:32.530213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-858023409", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1576760927", "security_groups": [{"name": "tempest-secgroup-smoke-758814000"}], "block_device_mapping_v2": [{"uuid": "48c99d60-b112-440c-b643-c07d54d831e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f5520295-9b65-428a-9f37-5ffc8779f39a"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:32.821202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] validate_networks() for [('f5520295-9b65-428a-9f37-5ffc8779f39a', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:42:33.257404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:42:33.257958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:42:33.258441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:42:33.258855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:42:33.259265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:42:33.269076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:33.269577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:33.270055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:33.270780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:33.271237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:33.271661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:33.288826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:42:33.294106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Getting quotas for user 3bf87a4bd94c45fa9b30f01267ec743d and project 6ef2904fbf9e4666952c7f14bfb45c4e. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:42:33.367461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:42:33.369708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48c99d60-b112-440c-b643-c07d54d831e1',volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:42:33.510679 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9a1595b1-2df4-4f13-93a0-2326a7332b02 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.003139 Oct 29 03:42:33.511576 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3516/6987] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:42:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:42:33.522466 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 03:42:33.523103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:33.523873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:33.524690 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:42:33.524803 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:42:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 (ip 10.222.0.16) !!! Oct 29 03:42:33.532778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-806a1452-4f06-4837-84e2-ae7f97e8b4d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:33.533852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-806a1452-4f06-4837-84e2-ae7f97e8b4d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:33.654797 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-806a1452-4f06-4837-84e2-ae7f97e8b4d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:33.661971 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-806a1452-4f06-4837-84e2-ae7f97e8b4d6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1094 microversion: 2.1 time: 0.142909 Oct 29 03:42:33.662556 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3472/6988] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:33 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1094 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:34.685855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45b03c9c-fe13-477e-815f-60392ed7cc34 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:34.686467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-45b03c9c-fe13-477e-815f-60392ed7cc34 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:34.692773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b03c9c-fe13-477e-815f-60392ed7cc34 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:34.693253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b03c9c-fe13-477e-815f-60392ed7cc34 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:34.693679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b03c9c-fe13-477e-815f-60392ed7cc34 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:34.694400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b03c9c-fe13-477e-815f-60392ed7cc34 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:34.694849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b03c9c-fe13-477e-815f-60392ed7cc34 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:34.695270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45b03c9c-fe13-477e-815f-60392ed7cc34 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:34.789837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-45b03c9c-fe13-477e-815f-60392ed7cc34 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:34.799694 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-45b03c9c-fe13-477e-815f-60392ed7cc34 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1200 microversion: 2.1 time: 0.118334 Oct 29 03:42:34.800142 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3517/6989] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:34 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:35.823979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-871015a0-69ba-4d91-a005-b6e3ee6d1cde tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:35.824529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-871015a0-69ba-4d91-a005-b6e3ee6d1cde tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:35.834532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-871015a0-69ba-4d91-a005-b6e3ee6d1cde tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:35.835027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-871015a0-69ba-4d91-a005-b6e3ee6d1cde tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:35.835472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-871015a0-69ba-4d91-a005-b6e3ee6d1cde tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:35.836389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-871015a0-69ba-4d91-a005-b6e3ee6d1cde tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:35.836977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-871015a0-69ba-4d91-a005-b6e3ee6d1cde tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:35.837606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-871015a0-69ba-4d91-a005-b6e3ee6d1cde tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:35.857608 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43244. Oct 29 03:42:35.986545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-871015a0-69ba-4d91-a005-b6e3ee6d1cde tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:35.995170 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-871015a0-69ba-4d91-a005-b6e3ee6d1cde tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1277 microversion: 2.1 time: 0.175537 Oct 29 03:42:35.995768 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3473/6990] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:35 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:36.266619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-420d0d79-0b94-4942-ab64-2384775b205a req-87c3a6d9-3689-45d9-b65d-b772c5fb9809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a9ba5d-fd1b-4130-95d7-ae5842290007", "tag": "009b50e0-82f5-4f52-a282-9c3e0f02379c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:36.278436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-420d0d79-0b94-4942-ab64-2384775b205a req-87c3a6d9-3689-45d9-b65d-b772c5fb9809 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:36.278942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-420d0d79-0b94-4942-ab64-2384775b205a req-87c3a6d9-3689-45d9-b65d-b772c5fb9809 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:36.279366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-420d0d79-0b94-4942-ab64-2384775b205a req-87c3a6d9-3689-45d9-b65d-b772c5fb9809 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:36.291643 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-420d0d79-0b94-4942-ab64-2384775b205a req-87c3a6d9-3689-45d9-b65d-b772c5fb9809 service nova] Creating event network-changed:009b50e0-82f5-4f52-a282-9c3e0f02379c for instance b2a9ba5d-fd1b-4130-95d7-ae5842290007 on n-h2-862964-4 Oct 29 03:42:36.299643 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-420d0d79-0b94-4942-ab64-2384775b205a req-87c3a6d9-3689-45d9-b65d-b772c5fb9809 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036757 Oct 29 03:42:36.300251 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3518/6991] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:42:37.020792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb17ab57-2371-4961-8b36-af6db6f30899 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:37.021423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eb17ab57-2371-4961-8b36-af6db6f30899 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:37.028144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb17ab57-2371-4961-8b36-af6db6f30899 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.028649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb17ab57-2371-4961-8b36-af6db6f30899 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.029107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb17ab57-2371-4961-8b36-af6db6f30899 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.029842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb17ab57-2371-4961-8b36-af6db6f30899 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.030315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb17ab57-2371-4961-8b36-af6db6f30899 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.030752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb17ab57-2371-4961-8b36-af6db6f30899 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.173047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eb17ab57-2371-4961-8b36-af6db6f30899 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:37.182088 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eb17ab57-2371-4961-8b36-af6db6f30899 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1277 microversion: 2.1 time: 0.165501 Oct 29 03:42:37.182693 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3474/6992] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:37 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:38.206374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dfc1d436-cd55-4190-82d6-a3571361ca70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:38.207063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dfc1d436-cd55-4190-82d6-a3571361ca70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:38.213982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfc1d436-cd55-4190-82d6-a3571361ca70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:38.214472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfc1d436-cd55-4190-82d6-a3571361ca70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:38.214907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfc1d436-cd55-4190-82d6-a3571361ca70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:38.215607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfc1d436-cd55-4190-82d6-a3571361ca70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:38.216064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfc1d436-cd55-4190-82d6-a3571361ca70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:38.216518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfc1d436-cd55-4190-82d6-a3571361ca70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:38.352012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dfc1d436-cd55-4190-82d6-a3571361ca70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:38.360099 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dfc1d436-cd55-4190-82d6-a3571361ca70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1277 microversion: 2.1 time: 0.158976 Oct 29 03:42:38.360687 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3519/6993] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:38 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:39.384062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ac48ac4-4466-4bc9-b806-77e6615d0b41 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:39.384658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ac48ac4-4466-4bc9-b806-77e6615d0b41 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:39.392556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac48ac4-4466-4bc9-b806-77e6615d0b41 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:39.393059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac48ac4-4466-4bc9-b806-77e6615d0b41 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:39.393506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac48ac4-4466-4bc9-b806-77e6615d0b41 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:39.394252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac48ac4-4466-4bc9-b806-77e6615d0b41 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:39.394714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac48ac4-4466-4bc9-b806-77e6615d0b41 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:39.395148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ac48ac4-4466-4bc9-b806-77e6615d0b41 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:39.536278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ac48ac4-4466-4bc9-b806-77e6615d0b41 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:39.544941 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ac48ac4-4466-4bc9-b806-77e6615d0b41 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1277 microversion: 2.1 time: 0.164870 Oct 29 03:42:39.545580 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3475/6994] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:39 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:40.570125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5e2868e8-f589-425e-a27a-bfd5c3dfec0e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:40.570755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5e2868e8-f589-425e-a27a-bfd5c3dfec0e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:40.578313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e2868e8-f589-425e-a27a-bfd5c3dfec0e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:40.578806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e2868e8-f589-425e-a27a-bfd5c3dfec0e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:40.579281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e2868e8-f589-425e-a27a-bfd5c3dfec0e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:40.579924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e2868e8-f589-425e-a27a-bfd5c3dfec0e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:40.580542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e2868e8-f589-425e-a27a-bfd5c3dfec0e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:40.580975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5e2868e8-f589-425e-a27a-bfd5c3dfec0e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:40.722406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5e2868e8-f589-425e-a27a-bfd5c3dfec0e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:40.731019 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5e2868e8-f589-425e-a27a-bfd5c3dfec0e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1265 microversion: 2.1 time: 0.165000 Oct 29 03:42:40.731622 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3520/6995] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:40 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:41.755711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-62de4c90-70f1-47ce-9161-c88d9408bd54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:41.756305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-62de4c90-70f1-47ce-9161-c88d9408bd54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:41.763869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62de4c90-70f1-47ce-9161-c88d9408bd54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:41.764368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62de4c90-70f1-47ce-9161-c88d9408bd54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:41.764805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62de4c90-70f1-47ce-9161-c88d9408bd54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:41.765514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62de4c90-70f1-47ce-9161-c88d9408bd54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:41.766007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62de4c90-70f1-47ce-9161-c88d9408bd54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:41.766437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-62de4c90-70f1-47ce-9161-c88d9408bd54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:41.903836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-62de4c90-70f1-47ce-9161-c88d9408bd54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:41.912203 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-62de4c90-70f1-47ce-9161-c88d9408bd54 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1265 microversion: 2.1 time: 0.160818 Oct 29 03:42:41.913006 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3476/6996] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:41 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:42.936920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3793d88d-c151-48d6-baae-d0205af3bd86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:42.937475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3793d88d-c151-48d6-baae-d0205af3bd86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:42.945347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3793d88d-c151-48d6-baae-d0205af3bd86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:42.945848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3793d88d-c151-48d6-baae-d0205af3bd86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:42.946289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3793d88d-c151-48d6-baae-d0205af3bd86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:42.946984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3793d88d-c151-48d6-baae-d0205af3bd86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:42.947434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3793d88d-c151-48d6-baae-d0205af3bd86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:42.947854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3793d88d-c151-48d6-baae-d0205af3bd86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:43.096052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3793d88d-c151-48d6-baae-d0205af3bd86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:43.104317 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3793d88d-c151-48d6-baae-d0205af3bd86 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1265 microversion: 2.1 time: 0.172451 Oct 29 03:42:43.104928 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3521/6997] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:42 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:44.129260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-45093043-433f-4d26-b03b-96d7e63d528d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:44.130035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-45093043-433f-4d26-b03b-96d7e63d528d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:44.132895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:44.138870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45093043-433f-4d26-b03b-96d7e63d528d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:44.139364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45093043-433f-4d26-b03b-96d7e63d528d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:44.139849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45093043-433f-4d26-b03b-96d7e63d528d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:44.140529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45093043-433f-4d26-b03b-96d7e63d528d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:44.140978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45093043-433f-4d26-b03b-96d7e63d528d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:44.141416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45093043-433f-4d26-b03b-96d7e63d528d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:44.292305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-45093043-433f-4d26-b03b-96d7e63d528d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:44.303163 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-45093043-433f-4d26-b03b-96d7e63d528d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1265 microversion: 2.1 time: 0.178142 Oct 29 03:42:44.303874 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3477/6998] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:44 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:45.331593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6c6404b1-4cd4-496c-a3c4-d213fb4a2efb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:45.332538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6c6404b1-4cd4-496c-a3c4-d213fb4a2efb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:45.335087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:45.335743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:45.342530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c6404b1-4cd4-496c-a3c4-d213fb4a2efb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:45.343004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c6404b1-4cd4-496c-a3c4-d213fb4a2efb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:45.343430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c6404b1-4cd4-496c-a3c4-d213fb4a2efb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:45.344106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c6404b1-4cd4-496c-a3c4-d213fb4a2efb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:45.344549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c6404b1-4cd4-496c-a3c4-d213fb4a2efb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:45.344959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c6404b1-4cd4-496c-a3c4-d213fb4a2efb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:45.484175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6c6404b1-4cd4-496c-a3c4-d213fb4a2efb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:45.494650 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6c6404b1-4cd4-496c-a3c4-d213fb4a2efb tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1265 microversion: 2.1 time: 0.169598 Oct 29 03:42:45.495493 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3522/6999] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:45 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:46.518710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25f54230-c725-4cc3-9f8f-bdfb91010d78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:46.519344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25f54230-c725-4cc3-9f8f-bdfb91010d78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:46.526764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f54230-c725-4cc3-9f8f-bdfb91010d78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:46.527259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f54230-c725-4cc3-9f8f-bdfb91010d78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:46.527703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f54230-c725-4cc3-9f8f-bdfb91010d78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:46.528415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f54230-c725-4cc3-9f8f-bdfb91010d78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:46.528874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f54230-c725-4cc3-9f8f-bdfb91010d78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:46.529308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25f54230-c725-4cc3-9f8f-bdfb91010d78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:46.671447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25f54230-c725-4cc3-9f8f-bdfb91010d78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:46.679991 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25f54230-c725-4cc3-9f8f-bdfb91010d78 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1265 microversion: 2.1 time: 0.165333 Oct 29 03:42:46.680563 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3478/7000] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:46 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:47.707471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4ff45b34-624b-4c87-a8dd-e7e099915226 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:47.708502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4ff45b34-624b-4c87-a8dd-e7e099915226 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:47.717830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff45b34-624b-4c87-a8dd-e7e099915226 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:47.718310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff45b34-624b-4c87-a8dd-e7e099915226 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:47.718733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff45b34-624b-4c87-a8dd-e7e099915226 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:47.719422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff45b34-624b-4c87-a8dd-e7e099915226 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:47.719846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff45b34-624b-4c87-a8dd-e7e099915226 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:47.720254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4ff45b34-624b-4c87-a8dd-e7e099915226 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:47.865279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4ff45b34-624b-4c87-a8dd-e7e099915226 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:47.873601 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4ff45b34-624b-4c87-a8dd-e7e099915226 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1265 microversion: 2.1 time: 0.172825 Oct 29 03:42:47.874239 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3523/7001] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:47 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:48.899107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-808dbbe1-1de1-4568-8fbe-0eca7155ad92 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:48.899873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-808dbbe1-1de1-4568-8fbe-0eca7155ad92 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:48.909608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-808dbbe1-1de1-4568-8fbe-0eca7155ad92 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:48.910319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-808dbbe1-1de1-4568-8fbe-0eca7155ad92 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:48.910922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-808dbbe1-1de1-4568-8fbe-0eca7155ad92 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:48.911868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-808dbbe1-1de1-4568-8fbe-0eca7155ad92 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:48.912484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-808dbbe1-1de1-4568-8fbe-0eca7155ad92 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:48.913196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-808dbbe1-1de1-4568-8fbe-0eca7155ad92 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:49.064463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-808dbbe1-1de1-4568-8fbe-0eca7155ad92 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:49.072728 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-808dbbe1-1de1-4568-8fbe-0eca7155ad92 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1265 microversion: 2.1 time: 0.179172 Oct 29 03:42:49.073319 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3479/7002] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:48 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:49.498663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-333f1cf8-53f6-4de3-809b-b96cccfa5a7a req-1df8eba6-6467-4be1-9308-83ab510cd65d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a9ba5d-fd1b-4130-95d7-ae5842290007", "name": "network-vif-plugged", "status": "completed", "tag": "009b50e0-82f5-4f52-a282-9c3e0f02379c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:49.511320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-333f1cf8-53f6-4de3-809b-b96cccfa5a7a req-1df8eba6-6467-4be1-9308-83ab510cd65d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:49.511793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-333f1cf8-53f6-4de3-809b-b96cccfa5a7a req-1df8eba6-6467-4be1-9308-83ab510cd65d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:49.512228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-333f1cf8-53f6-4de3-809b-b96cccfa5a7a req-1df8eba6-6467-4be1-9308-83ab510cd65d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:49.527636 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-333f1cf8-53f6-4de3-809b-b96cccfa5a7a req-1df8eba6-6467-4be1-9308-83ab510cd65d service nova] Creating event network-vif-plugged:009b50e0-82f5-4f52-a282-9c3e0f02379c for instance b2a9ba5d-fd1b-4130-95d7-ae5842290007 on n-h2-862964-4 Oct 29 03:42:49.533018 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-333f1cf8-53f6-4de3-809b-b96cccfa5a7a req-1df8eba6-6467-4be1-9308-83ab510cd65d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038273 Oct 29 03:42:49.533959 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3524/7003] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:42:50.099288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0faae38f-e126-44b8-a745-cae5e96f28c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:50.100656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0faae38f-e126-44b8-a745-cae5e96f28c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:50.108029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0faae38f-e126-44b8-a745-cae5e96f28c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:50.108585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0faae38f-e126-44b8-a745-cae5e96f28c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:50.109029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0faae38f-e126-44b8-a745-cae5e96f28c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:50.109767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0faae38f-e126-44b8-a745-cae5e96f28c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:50.110263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0faae38f-e126-44b8-a745-cae5e96f28c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:50.110700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0faae38f-e126-44b8-a745-cae5e96f28c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:50.258307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0faae38f-e126-44b8-a745-cae5e96f28c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:50.266691 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0faae38f-e126-44b8-a745-cae5e96f28c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1265 microversion: 2.1 time: 0.174039 Oct 29 03:42:50.267286 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3480/7004] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:50 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:51.303905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2bd55a4c-eea1-47ef-80ed-1a140f05c62f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:51.304565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2bd55a4c-eea1-47ef-80ed-1a140f05c62f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:51.311467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd55a4c-eea1-47ef-80ed-1a140f05c62f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:51.311941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd55a4c-eea1-47ef-80ed-1a140f05c62f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:51.312365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd55a4c-eea1-47ef-80ed-1a140f05c62f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:51.313047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd55a4c-eea1-47ef-80ed-1a140f05c62f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:51.313492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd55a4c-eea1-47ef-80ed-1a140f05c62f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:51.313935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bd55a4c-eea1-47ef-80ed-1a140f05c62f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:51.460229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2bd55a4c-eea1-47ef-80ed-1a140f05c62f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:51.468441 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2bd55a4c-eea1-47ef-80ed-1a140f05c62f tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1452 microversion: 2.1 time: 0.173223 Oct 29 03:42:51.469024 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3525/7005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:51 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:51.491425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-35712b19-a007-4445-a7c1-a42076bda0d8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:51.492078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-35712b19-a007-4445-a7c1-a42076bda0d8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:51.499379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35712b19-a007-4445-a7c1-a42076bda0d8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:51.499874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35712b19-a007-4445-a7c1-a42076bda0d8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:51.500315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35712b19-a007-4445-a7c1-a42076bda0d8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:51.501020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35712b19-a007-4445-a7c1-a42076bda0d8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:51.501475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35712b19-a007-4445-a7c1-a42076bda0d8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:51.501928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-35712b19-a007-4445-a7c1-a42076bda0d8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:51.641955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-35712b19-a007-4445-a7c1-a42076bda0d8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:51.650570 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-35712b19-a007-4445-a7c1-a42076bda0d8 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1452 microversion: 2.1 time: 0.163516 Oct 29 03:42:51.651151 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3481/7006] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:51 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:53.604449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-976cacff-5d4c-4fae-ad18-c9bf7a358ccb req-c4d1a8e1-568f-4d88-a389-eac06ed77000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a9ba5d-fd1b-4130-95d7-ae5842290007", "tag": "009b50e0-82f5-4f52-a282-9c3e0f02379c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:53.614871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-976cacff-5d4c-4fae-ad18-c9bf7a358ccb req-c4d1a8e1-568f-4d88-a389-eac06ed77000 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:53.615341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-976cacff-5d4c-4fae-ad18-c9bf7a358ccb req-c4d1a8e1-568f-4d88-a389-eac06ed77000 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:53.615766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-976cacff-5d4c-4fae-ad18-c9bf7a358ccb req-c4d1a8e1-568f-4d88-a389-eac06ed77000 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:53.627626 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-976cacff-5d4c-4fae-ad18-c9bf7a358ccb req-c4d1a8e1-568f-4d88-a389-eac06ed77000 service nova] Creating event network-changed:009b50e0-82f5-4f52-a282-9c3e0f02379c for instance b2a9ba5d-fd1b-4130-95d7-ae5842290007 on n-h2-862964-4 Oct 29 03:42:53.632972 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-976cacff-5d4c-4fae-ad18-c9bf7a358ccb req-c4d1a8e1-568f-4d88-a389-eac06ed77000 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032633 Oct 29 03:42:53.633842 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3526/7007] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:44:33.421064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=22 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:33.422227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=54 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:33.423234 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:44:33.423632 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:44:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 (ip 10.222.0.16) !!! Oct 29 03:44:33.425297 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:44:33.425646 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:44:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 (ip 10.222.0.16) !!! Oct 29 03:44:33.440461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3aeadc30-1b53-439c-87d2-0df556e05c15 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:33.440966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3aeadc30-1b53-439c-87d2-0df556e05c15 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:33.453927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3aeadc30-1b53-439c-87d2-0df556e05c15 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:33.454424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3aeadc30-1b53-439c-87d2-0df556e05c15 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:33.454866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3aeadc30-1b53-439c-87d2-0df556e05c15 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:33.455586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3aeadc30-1b53-439c-87d2-0df556e05c15 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:33.456043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3aeadc30-1b53-439c-87d2-0df556e05c15 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:33.456670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3aeadc30-1b53-439c-87d2-0df556e05c15 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:33.486044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3aeadc30-1b53-439c-87d2-0df556e05c15 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:44:33.519194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:33.520835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=50 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:33.522335 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:44:33.522770 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:44:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 29 03:44:33.584625 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3aeadc30-1b53-439c-87d2-0df556e05c15 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 204 len: 0 microversion: 2.1 time: 0.165625 Oct 29 03:44:33.585571 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3482/7008] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:44:33 2022] DELETE /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:44:33.594938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5abecd48-8fde-4f00-92cb-9b9fe0d8be6d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:33.595742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5abecd48-8fde-4f00-92cb-9b9fe0d8be6d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:33.602407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5abecd48-8fde-4f00-92cb-9b9fe0d8be6d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:33.602975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5abecd48-8fde-4f00-92cb-9b9fe0d8be6d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:33.603517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5abecd48-8fde-4f00-92cb-9b9fe0d8be6d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:33.604341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5abecd48-8fde-4f00-92cb-9b9fe0d8be6d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:33.604872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5abecd48-8fde-4f00-92cb-9b9fe0d8be6d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:33.605387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5abecd48-8fde-4f00-92cb-9b9fe0d8be6d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:33.631767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-49e91863-6bc8-4bbf-8e0f-5d35402b2bff req-fda6748c-1a61-4d5e-b556-6ecc2097c1dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a9ba5d-fd1b-4130-95d7-ae5842290007", "tag": "009b50e0-82f5-4f52-a282-9c3e0f02379c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:33.643423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-49e91863-6bc8-4bbf-8e0f-5d35402b2bff req-fda6748c-1a61-4d5e-b556-6ecc2097c1dd service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:33.643932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-49e91863-6bc8-4bbf-8e0f-5d35402b2bff req-fda6748c-1a61-4d5e-b556-6ecc2097c1dd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:33.644356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-49e91863-6bc8-4bbf-8e0f-5d35402b2bff req-fda6748c-1a61-4d5e-b556-6ecc2097c1dd service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:33.655563 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-49e91863-6bc8-4bbf-8e0f-5d35402b2bff req-fda6748c-1a61-4d5e-b556-6ecc2097c1dd service nova] Creating event network-changed:009b50e0-82f5-4f52-a282-9c3e0f02379c for instance b2a9ba5d-fd1b-4130-95d7-ae5842290007 on n-h2-862964-4 Oct 29 03:44:33.660909 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-49e91863-6bc8-4bbf-8e0f-5d35402b2bff req-fda6748c-1a61-4d5e-b556-6ecc2097c1dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145503 Oct 29 03:44:33.661538 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3527/7009] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:44:33.878208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5abecd48-8fde-4f00-92cb-9b9fe0d8be6d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:33.886247 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5abecd48-8fde-4f00-92cb-9b9fe0d8be6d tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1577 microversion: 2.1 time: 0.295701 Oct 29 03:44:33.886794 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3483/7010] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:33 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1577 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:44:34.912259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-191c411c-8e45-4ec8-9c1f-ab8420311882 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:34.912961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-191c411c-8e45-4ec8-9c1f-ab8420311882 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:34.919972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-191c411c-8e45-4ec8-9c1f-ab8420311882 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:34.920492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-191c411c-8e45-4ec8-9c1f-ab8420311882 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:34.920932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-191c411c-8e45-4ec8-9c1f-ab8420311882 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:34.921636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-191c411c-8e45-4ec8-9c1f-ab8420311882 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:34.922118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-191c411c-8e45-4ec8-9c1f-ab8420311882 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:34.922540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-191c411c-8e45-4ec8-9c1f-ab8420311882 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:35.197461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-191c411c-8e45-4ec8-9c1f-ab8420311882 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:35.210087 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-191c411c-8e45-4ec8-9c1f-ab8420311882 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1577 microversion: 2.1 time: 0.302753 Oct 29 03:44:35.210987 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3528/7011] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:34 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1577 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:36.236385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cf6d6b02-77c7-429a-af40-d4a8348beff6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:36.237068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cf6d6b02-77c7-429a-af40-d4a8348beff6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:36.244758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6d6b02-77c7-429a-af40-d4a8348beff6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:36.245322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6d6b02-77c7-429a-af40-d4a8348beff6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:36.245796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6d6b02-77c7-429a-af40-d4a8348beff6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:36.246552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6d6b02-77c7-429a-af40-d4a8348beff6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:36.247021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6d6b02-77c7-429a-af40-d4a8348beff6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:36.247455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cf6d6b02-77c7-429a-af40-d4a8348beff6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:36.315638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-66eb89e5-9cfa-4df0-ab44-be3fc5c1b7b3 req-41a82b1a-4e04-4dcc-b90c-63a8c44fb228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a9ba5d-fd1b-4130-95d7-ae5842290007", "name": "network-vif-deleted", "tag": "009b50e0-82f5-4f52-a282-9c3e0f02379c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:36.326304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-66eb89e5-9cfa-4df0-ab44-be3fc5c1b7b3 req-41a82b1a-4e04-4dcc-b90c-63a8c44fb228 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:36.326754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-66eb89e5-9cfa-4df0-ab44-be3fc5c1b7b3 req-41a82b1a-4e04-4dcc-b90c-63a8c44fb228 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:36.327176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-66eb89e5-9cfa-4df0-ab44-be3fc5c1b7b3 req-41a82b1a-4e04-4dcc-b90c-63a8c44fb228 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:36.336300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cf6d6b02-77c7-429a-af40-d4a8348beff6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:36.340151 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-66eb89e5-9cfa-4df0-ab44-be3fc5c1b7b3 req-41a82b1a-4e04-4dcc-b90c-63a8c44fb228 service nova] Creating event network-vif-deleted:009b50e0-82f5-4f52-a282-9c3e0f02379c for instance b2a9ba5d-fd1b-4130-95d7-ae5842290007 on n-h2-862964-4 Oct 29 03:44:36.345607 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-66eb89e5-9cfa-4df0-ab44-be3fc5c1b7b3 req-41a82b1a-4e04-4dcc-b90c-63a8c44fb228 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033764 Oct 29 03:44:36.345907 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cf6d6b02-77c7-429a-af40-d4a8348beff6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1391 microversion: 2.1 time: 0.113910 Oct 29 03:44:36.346304 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3529/7012] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:44:36.359153 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3484/7013] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:36 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1391 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:37.371976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-743ac290-af26-414c-a886-832ac1391c6b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:37.372811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-743ac290-af26-414c-a886-832ac1391c6b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:37.379720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-743ac290-af26-414c-a886-832ac1391c6b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:37.380219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-743ac290-af26-414c-a886-832ac1391c6b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:37.380617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-743ac290-af26-414c-a886-832ac1391c6b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:37.381340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-743ac290-af26-414c-a886-832ac1391c6b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:37.381829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-743ac290-af26-414c-a886-832ac1391c6b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:37.382263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-743ac290-af26-414c-a886-832ac1391c6b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:37.448739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-743ac290-af26-414c-a886-832ac1391c6b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:37.457406 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-743ac290-af26-414c-a886-832ac1391c6b tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1225 microversion: 2.1 time: 0.091231 Oct 29 03:44:37.457948 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3530/7014] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:37 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:38.480574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a5c2f070-2dac-491c-afe1-d539845f5124 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:38.481204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a5c2f070-2dac-491c-afe1-d539845f5124 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:38.488950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5c2f070-2dac-491c-afe1-d539845f5124 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:38.489454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5c2f070-2dac-491c-afe1-d539845f5124 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:38.489927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5c2f070-2dac-491c-afe1-d539845f5124 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:38.490644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5c2f070-2dac-491c-afe1-d539845f5124 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:38.491114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5c2f070-2dac-491c-afe1-d539845f5124 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:38.491551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a5c2f070-2dac-491c-afe1-d539845f5124 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:38.556962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a5c2f070-2dac-491c-afe1-d539845f5124 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:38.565293 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a5c2f070-2dac-491c-afe1-d539845f5124 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1225 microversion: 2.1 time: 0.089032 Oct 29 03:44:38.565904 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3485/7015] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:38 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:39.589762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a35f044c-7534-4158-944e-ecfb4dfe2316 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:39.590409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a35f044c-7534-4158-944e-ecfb4dfe2316 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:39.598316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a35f044c-7534-4158-944e-ecfb4dfe2316 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:39.598809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a35f044c-7534-4158-944e-ecfb4dfe2316 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:39.599282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a35f044c-7534-4158-944e-ecfb4dfe2316 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:39.600153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a35f044c-7534-4158-944e-ecfb4dfe2316 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:39.600614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a35f044c-7534-4158-944e-ecfb4dfe2316 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:39.601030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a35f044c-7534-4158-944e-ecfb4dfe2316 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:39.671199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a35f044c-7534-4158-944e-ecfb4dfe2316 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:39.679397 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a35f044c-7534-4158-944e-ecfb4dfe2316 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1225 microversion: 2.1 time: 0.094299 Oct 29 03:44:39.680016 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3531/7016] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:39 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:40.702357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:40.702986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:40.710034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:40.710527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:40.710973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:40.711865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:40.712487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:40.712924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:40.745994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:40.746599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:40.747051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:40.747508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lazy-loading 'fault' on Instance uuid b2a9ba5d-fd1b-4130-95d7-ae5842290007 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:44:40.788906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:40.797271 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1b6b9dc4-937b-4a6f-8139-2df8ecbd66c2 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 200 len: 1230 microversion: 2.1 time: 0.099102 Oct 29 03:44:40.797864 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3486/7017] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:40 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:41.821129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:41.821676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: b2a9ba5d-fd1b-4130-95d7-ae5842290007] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:41.829220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:41.829711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:41.830184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:41.830889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:41.831341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:41.831778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:41.849196 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance b2a9ba5d-fd1b-4130-95d7-ae5842290007 could not be found. Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 HTTP/1.1 Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance b2a9ba5d-fd1b-4130-95d7-ae5842290007 could not be found. Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'b2a9ba5d-fd1b-4130-95d7-ae5842290007'} Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a9ba5d-fd1b-4130-95d7-ae5842290007 could not be found. Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a9ba5d-fd1b-4130-95d7-ae5842290007 could not be found. Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:41.850924 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:44:41.855126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:41.855126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:41.855126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:41.855126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:44:41.855126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:44:41.855126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a9ba5d-fd1b-4130-95d7-ae5842290007 could not be found. Oct 29 03:44:41.855126 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:44:41.855126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance b2a9ba5d-fd1b-4130-95d7-ae5842290007 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:44:41.855126 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a19892be-1376-4845-a785-9bc731940a70 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007" status: 404 len: 111 microversion: 2.1 time: 0.035421 Oct 29 03:44:41.855126 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3532/7018] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:41 2022] GET /compute/v2.1/servers/b2a9ba5d-fd1b-4130-95d7-ae5842290007 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:44:48.140911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dcd4b7f0-e0da-433e-8036-04f4c6cc788e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:48.141464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dcd4b7f0-e0da-433e-8036-04f4c6cc788e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:48.144590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-46afea64-8865-437c-a9e2-4c626352a72a req-bfd78a5b-be91-49bb-935e-f59b6ec767e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336ddc65-86fe-4cb8-97f0-3884eac45a7e", "tag": "838706b9-34e2-4bb0-95aa-6f3fc96b8b34"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:48.149117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd4b7f0-e0da-433e-8036-04f4c6cc788e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:48.149619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd4b7f0-e0da-433e-8036-04f4c6cc788e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:48.150083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd4b7f0-e0da-433e-8036-04f4c6cc788e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:48.150793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd4b7f0-e0da-433e-8036-04f4c6cc788e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:48.151254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd4b7f0-e0da-433e-8036-04f4c6cc788e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:48.152274 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd4b7f0-e0da-433e-8036-04f4c6cc788e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:48.156335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-46afea64-8865-437c-a9e2-4c626352a72a req-bfd78a5b-be91-49bb-935e-f59b6ec767e7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:48.156927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-46afea64-8865-437c-a9e2-4c626352a72a req-bfd78a5b-be91-49bb-935e-f59b6ec767e7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:48.157581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-46afea64-8865-437c-a9e2-4c626352a72a req-bfd78a5b-be91-49bb-935e-f59b6ec767e7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:48.172648 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-46afea64-8865-437c-a9e2-4c626352a72a req-bfd78a5b-be91-49bb-935e-f59b6ec767e7 service nova] Creating event network-changed:838706b9-34e2-4bb0-95aa-6f3fc96b8b34 for instance 336ddc65-86fe-4cb8-97f0-3884eac45a7e on n-h1-862964-4 Oct 29 03:44:48.178201 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-46afea64-8865-437c-a9e2-4c626352a72a req-bfd78a5b-be91-49bb-935e-f59b6ec767e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037747 Oct 29 03:44:48.178966 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3533/7019] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:44:48.182301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dcd4b7f0-e0da-433e-8036-04f4c6cc788e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:44:48.268208 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dcd4b7f0-e0da-433e-8036-04f4c6cc788e tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 204 len: 0 microversion: 2.1 time: 0.131154 Oct 29 03:44:48.270203 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3487/7020] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:44:48 2022] DELETE /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:44:48.278021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f274e48-6081-40ba-8cfc-0b2d560f2710 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:48.278743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f274e48-6081-40ba-8cfc-0b2d560f2710 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:48.285583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f274e48-6081-40ba-8cfc-0b2d560f2710 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:48.286241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f274e48-6081-40ba-8cfc-0b2d560f2710 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:48.286683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f274e48-6081-40ba-8cfc-0b2d560f2710 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:48.287390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f274e48-6081-40ba-8cfc-0b2d560f2710 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:48.287843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f274e48-6081-40ba-8cfc-0b2d560f2710 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:48.288264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f274e48-6081-40ba-8cfc-0b2d560f2710 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:48.426316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8f274e48-6081-40ba-8cfc-0b2d560f2710 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:48.434529 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f274e48-6081-40ba-8cfc-0b2d560f2710 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1577 microversion: 2.1 time: 0.161056 Oct 29 03:44:48.435116 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3534/7021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:48 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:49.459203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1ae82366-53a5-46f8-a221-611874537b47 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:49.459917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1ae82366-53a5-46f8-a221-611874537b47 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:49.467263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae82366-53a5-46f8-a221-611874537b47 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:49.467728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae82366-53a5-46f8-a221-611874537b47 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:49.468176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae82366-53a5-46f8-a221-611874537b47 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:49.468883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae82366-53a5-46f8-a221-611874537b47 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:49.469341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae82366-53a5-46f8-a221-611874537b47 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:49.469770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ae82366-53a5-46f8-a221-611874537b47 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:49.610703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1ae82366-53a5-46f8-a221-611874537b47 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:49.619368 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1ae82366-53a5-46f8-a221-611874537b47 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1577 microversion: 2.1 time: 0.165092 Oct 29 03:44:49.619925 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3488/7022] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:49 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:50.561196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-79dbc49b-0d17-47aa-8510-b0022e1fbf0e req-83757a37-9183-4e5e-b300-2c590a577622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336ddc65-86fe-4cb8-97f0-3884eac45a7e", "name": "network-vif-deleted", "tag": "838706b9-34e2-4bb0-95aa-6f3fc96b8b34"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:50.574913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-79dbc49b-0d17-47aa-8510-b0022e1fbf0e req-83757a37-9183-4e5e-b300-2c590a577622 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:50.574913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-79dbc49b-0d17-47aa-8510-b0022e1fbf0e req-83757a37-9183-4e5e-b300-2c590a577622 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:50.575148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-79dbc49b-0d17-47aa-8510-b0022e1fbf0e req-83757a37-9183-4e5e-b300-2c590a577622 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:50.587203 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-79dbc49b-0d17-47aa-8510-b0022e1fbf0e req-83757a37-9183-4e5e-b300-2c590a577622 service nova] Creating event network-vif-deleted:838706b9-34e2-4bb0-95aa-6f3fc96b8b34 for instance 336ddc65-86fe-4cb8-97f0-3884eac45a7e on n-h1-862964-4 Oct 29 03:44:50.592819 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-79dbc49b-0d17-47aa-8510-b0022e1fbf0e req-83757a37-9183-4e5e-b300-2c590a577622 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085271 Oct 29 03:44:50.593701 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3535/7023] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:44:50.643328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e3fe4558-a402-4c5f-b663-9df36a232afa tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:50.644316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e3fe4558-a402-4c5f-b663-9df36a232afa tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:50.652097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3fe4558-a402-4c5f-b663-9df36a232afa tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:50.652578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3fe4558-a402-4c5f-b663-9df36a232afa tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:50.653020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3fe4558-a402-4c5f-b663-9df36a232afa tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:50.653767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3fe4558-a402-4c5f-b663-9df36a232afa tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:50.654291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3fe4558-a402-4c5f-b663-9df36a232afa tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:50.654860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3fe4558-a402-4c5f-b663-9df36a232afa tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:50.729495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e3fe4558-a402-4c5f-b663-9df36a232afa tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:50.740678 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e3fe4558-a402-4c5f-b663-9df36a232afa tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1226 microversion: 2.1 time: 0.101236 Oct 29 03:44:50.741196 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3489/7024] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:50 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:51.765201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fe4946e5-b203-4eea-a592-5fe11e4fdab6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:51.766056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fe4946e5-b203-4eea-a592-5fe11e4fdab6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:51.773631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe4946e5-b203-4eea-a592-5fe11e4fdab6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:51.774149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe4946e5-b203-4eea-a592-5fe11e4fdab6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:51.774574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe4946e5-b203-4eea-a592-5fe11e4fdab6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:51.775265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe4946e5-b203-4eea-a592-5fe11e4fdab6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:51.775709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe4946e5-b203-4eea-a592-5fe11e4fdab6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:51.776124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe4946e5-b203-4eea-a592-5fe11e4fdab6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:51.840572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fe4946e5-b203-4eea-a592-5fe11e4fdab6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:51.848750 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fe4946e5-b203-4eea-a592-5fe11e4fdab6 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1226 microversion: 2.1 time: 0.088274 Oct 29 03:44:51.849328 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3536/7025] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:51 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:52.872941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59273d95-311c-4921-8f6e-896276351a97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:52.873568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59273d95-311c-4921-8f6e-896276351a97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:52.880658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59273d95-311c-4921-8f6e-896276351a97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:52.881163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59273d95-311c-4921-8f6e-896276351a97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:52.881594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59273d95-311c-4921-8f6e-896276351a97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:52.882373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59273d95-311c-4921-8f6e-896276351a97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:52.882836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59273d95-311c-4921-8f6e-896276351a97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:52.883272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59273d95-311c-4921-8f6e-896276351a97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:52.955854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59273d95-311c-4921-8f6e-896276351a97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:52.964284 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59273d95-311c-4921-8f6e-896276351a97 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1226 microversion: 2.1 time: 0.095683 Oct 29 03:44:52.964975 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3490/7026] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:52 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:44:53.988961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a6e2e07-aa9b-484e-8338-fdd08c98c5ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:53.989673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1a6e2e07-aa9b-484e-8338-fdd08c98c5ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:53.997041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6e2e07-aa9b-484e-8338-fdd08c98c5ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:53.997526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6e2e07-aa9b-484e-8338-fdd08c98c5ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:53.997994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6e2e07-aa9b-484e-8338-fdd08c98c5ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:53.998700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6e2e07-aa9b-484e-8338-fdd08c98c5ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:53.999147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6e2e07-aa9b-484e-8338-fdd08c98c5ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:53.999564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6e2e07-aa9b-484e-8338-fdd08c98c5ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:54.067631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1a6e2e07-aa9b-484e-8338-fdd08c98c5ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bf87a4bd94c45fa9b30f01267ec743d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2904fbf9e4666952c7f14bfb45c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:54.076195 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1a6e2e07-aa9b-484e-8338-fdd08c98c5ae tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 200 len: 1226 microversion: 2.1 time: 0.091662 Oct 29 03:44:54.076864 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3537/7027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:53 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:55.101689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:55.102392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: 336ddc65-86fe-4cb8-97f0-3884eac45a7e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:55.109646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:55.110182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:55.110629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:55.111338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:55.111805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:55.112235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:55.127035 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance 336ddc65-86fe-4cb8-97f0-3884eac45a7e could not be found. Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e HTTP/1.1 Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 336ddc65-86fe-4cb8-97f0-3884eac45a7e could not be found. Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '336ddc65-86fe-4cb8-97f0-3884eac45a7e'} Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336ddc65-86fe-4cb8-97f0-3884eac45a7e could not be found. Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336ddc65-86fe-4cb8-97f0-3884eac45a7e could not be found. Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:55.128741 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.133234 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:55.133234 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:55.133234 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:55.133234 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:44:55.133234 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:44:55.133234 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336ddc65-86fe-4cb8-97f0-3884eac45a7e could not be found. Oct 29 03:44:55.133234 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.133234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance 336ddc65-86fe-4cb8-97f0-3884eac45a7e could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:44:55.133234 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-77ba989e-2e5d-4f6c-9ca1-781b45b2ee8a tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e" status: 404 len: 111 microversion: 2.1 time: 0.033921 Oct 29 03:44:55.133234 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3491/7028] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:55 2022] GET /compute/v2.1/servers/336ddc65-86fe-4cb8-97f0-3884eac45a7e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:44:55.597825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:55.598374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:55.605835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:55.606637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:55.607077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:55.607788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:55.608250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:55.608671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:55.623786 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 HTTP/1.1 Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'cf8853d1-0492-4342-a7a2-98489e9f1135'} Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:44:55.625489 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-615750b2-bbf0-4910-8601-420d2bc002f7 tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 404 len: 111 microversion: 2.1 time: 0.033249 Oct 29 03:44:55.629795 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3538/7029] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:44:55 2022] DELETE /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:44:55.635864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:55.636500 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] [instance: cf8853d1-0492-4342-a7a2-98489e9f1135] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:55.643367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:55.643866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:55.644316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:55.645024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:55.645521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:55.645982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:55.660659 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] HTTP exception thrown: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Request method failure captured: Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 HTTP/1.1 Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXJ8tnIJx8Qu4zEXzpSY_KJAb_ctDMRy8k8QKIKvy9iVC2XzW_Ho3zbXzh7l69avVg3ixZFrRWKDffefMTnAyMKx1BBtGVJOJDerlQ3GiZrN0tWQIrgGmjlxJFA4ZWNh5WSoWRdEoCTczEINI_cshvSGa5pY5ECmXWWGVc3T8f6Puv3s Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ef2904fbf9e4666952c7f14bfb45c4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ef2904fbf9e4666952c7f14bfb45c4e"}]}] Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 6ef2904fbf9e4666952c7f14bfb45c4e Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestVolumeBootPattern-2142103406 Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 3bf87a4bd94c45fa9b30f01267ec743d Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestVolumeBootPattern-2142103406-project Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'cf8853d1-0492-4342-a7a2-98489e9f1135'} Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:55.662259 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.666894 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:55.666894 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:55.666894 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:55.666894 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:44:55.666894 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:44:55.666894 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. Oct 29 03:44:55.666894 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:44:55.666894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Returning 404 to user: Instance cf8853d1-0492-4342-a7a2-98489e9f1135 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:44:55.666894 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2845eb2a-4c30-4027-a4a2-a92b2d559e6c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135" status: 404 len: 111 microversion: 2.1 time: 0.031793 Oct 29 03:44:55.666894 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3492/7030] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:55 2022] GET /compute/v2.1/servers/cf8853d1-0492-4342-a7a2-98489e9f1135 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:44:59.097848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b6ce7e16-1485-499a-82d7-4eb4ca199d0c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] Calling method '.version_select at 0x7fe1a8c0b550>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:59.133664 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b6ce7e16-1485-499a-82d7-4eb4ca199d0c tempest-TestVolumeBootPattern-2142103406 tempest-TestVolumeBootPattern-2142103406-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1576760927" status: 202 len: 0 microversion: 2.1 time: 0.040304 Oct 29 03:44:59.134590 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3539/7031] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:44:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1576760927 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:45:17.795568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:17.796314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:17.909021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-594147811", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:17.964131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] validate_networks() for None {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:45:18.253478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:45:18.253934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:45:18.254447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:45:18.254932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:45:18.255287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:45:18.268112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:18.268610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:18.269058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:18.269796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:18.270295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:18.270732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:18.290544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Getting quotas for project 99bff39e69ff4791927279f6b5941930. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:45:18.296574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Getting quotas for user 740c8eda8ebe40ccaadc1fd0137f941e and project 99bff39e69ff4791927279f6b5941930. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:45:18.310449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:45:18.312772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:45:18.362877 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6f37d7a9-6bdb-46a1-80f3-b9d4212251a0 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572884 Oct 29 03:45:18.363887 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3493/7032] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:45:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:45:18.380162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d13e6eb8-b20b-4a0e-bec4-f8ca7dbdf05f tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:18.380888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d13e6eb8-b20b-4a0e-bec4-f8ca7dbdf05f tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:18.384865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=48 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:18.385712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:18.440021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d13e6eb8-b20b-4a0e-bec4-f8ca7dbdf05f tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:18.449365 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d13e6eb8-b20b-4a0e-bec4-f8ca7dbdf05f tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1221 microversion: 2.1 time: 0.073328 Oct 29 03:45:18.450039 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3540/7033] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:18 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:19.473501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cc70aea8-4cc0-4df6-b5ef-797d93483426 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:19.474169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cc70aea8-4cc0-4df6-b5ef-797d93483426 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:19.527880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc70aea8-4cc0-4df6-b5ef-797d93483426 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:19.535393 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cc70aea8-4cc0-4df6-b5ef-797d93483426 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1221 microversion: 2.1 time: 0.066671 Oct 29 03:45:19.535942 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3494/7034] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:19 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:20.558864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-71510763-1710-4f43-a507-9880a5ce9f83 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:20.559522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-71510763-1710-4f43-a507-9880a5ce9f83 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:20.616986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-71510763-1710-4f43-a507-9880a5ce9f83 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:20.624581 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-71510763-1710-4f43-a507-9880a5ce9f83 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1221 microversion: 2.1 time: 0.069767 Oct 29 03:45:20.625214 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3541/7035] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:20 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1221 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:21.652017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b4fe1c1-0768-47bb-b59a-9b7bc2fd9b3c tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:21.653232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8b4fe1c1-0768-47bb-b59a-9b7bc2fd9b3c tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:21.718037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8b4fe1c1-0768-47bb-b59a-9b7bc2fd9b3c tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:21.724830 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b4fe1c1-0768-47bb-b59a-9b7bc2fd9b3c tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1221 microversion: 2.1 time: 0.079483 Oct 29 03:45:21.725630 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3495/7036] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:21 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:22.751824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef0d25e2-43df-40fe-aa2c-3f7ca363a1c4 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:22.752502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ef0d25e2-43df-40fe-aa2c-3f7ca363a1c4 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:22.761765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef0d25e2-43df-40fe-aa2c-3f7ca363a1c4 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:22.762466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef0d25e2-43df-40fe-aa2c-3f7ca363a1c4 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:22.762957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef0d25e2-43df-40fe-aa2c-3f7ca363a1c4 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:22.763784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef0d25e2-43df-40fe-aa2c-3f7ca363a1c4 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:22.764315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef0d25e2-43df-40fe-aa2c-3f7ca363a1c4 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:22.764845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef0d25e2-43df-40fe-aa2c-3f7ca363a1c4 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:22.836471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ef0d25e2-43df-40fe-aa2c-3f7ca363a1c4 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:22.844596 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ef0d25e2-43df-40fe-aa2c-3f7ca363a1c4 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1225 microversion: 2.1 time: 0.098576 Oct 29 03:45:22.845202 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3542/7037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:22 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:23.867225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-793b0300-524b-4d01-81d8-85ebde61d79b tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:23.867830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-793b0300-524b-4d01-81d8-85ebde61d79b tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:23.875749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-793b0300-524b-4d01-81d8-85ebde61d79b tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:23.876288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-793b0300-524b-4d01-81d8-85ebde61d79b tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:23.876740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-793b0300-524b-4d01-81d8-85ebde61d79b tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:23.877464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-793b0300-524b-4d01-81d8-85ebde61d79b tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:23.877965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-793b0300-524b-4d01-81d8-85ebde61d79b tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:23.878406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-793b0300-524b-4d01-81d8-85ebde61d79b tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:23.947515 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-793b0300-524b-4d01-81d8-85ebde61d79b tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:23.957125 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-793b0300-524b-4d01-81d8-85ebde61d79b tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1279 microversion: 2.1 time: 0.094177 Oct 29 03:45:23.957714 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3496/7038] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:23 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:24.980862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ef4d07ed-10df-408b-a6e6-06f5bcac2387 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:24.981475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ef4d07ed-10df-408b-a6e6-06f5bcac2387 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:24.988226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef4d07ed-10df-408b-a6e6-06f5bcac2387 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:24.989055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef4d07ed-10df-408b-a6e6-06f5bcac2387 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:24.989477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef4d07ed-10df-408b-a6e6-06f5bcac2387 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:24.990198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef4d07ed-10df-408b-a6e6-06f5bcac2387 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:24.990671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef4d07ed-10df-408b-a6e6-06f5bcac2387 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:24.991084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ef4d07ed-10df-408b-a6e6-06f5bcac2387 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:25.127535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ef4d07ed-10df-408b-a6e6-06f5bcac2387 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:25.137647 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ef4d07ed-10df-408b-a6e6-06f5bcac2387 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1321 microversion: 2.1 time: 0.161007 Oct 29 03:45:25.138500 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3543/7039] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:24 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:25.165572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d61d36de-f3d1-415a-b700-dd7c2af212f8 req-d58a3fb6-66a2-47f8-85e3-757f144c423e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e138225-a52a-49b7-91d9-4a70fe170cee", "tag": "1dcfa488-8f05-4fb7-886a-f55cb9744db2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:25.176748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d61d36de-f3d1-415a-b700-dd7c2af212f8 req-d58a3fb6-66a2-47f8-85e3-757f144c423e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:25.177297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d61d36de-f3d1-415a-b700-dd7c2af212f8 req-d58a3fb6-66a2-47f8-85e3-757f144c423e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:25.177852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d61d36de-f3d1-415a-b700-dd7c2af212f8 req-d58a3fb6-66a2-47f8-85e3-757f144c423e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:25.190283 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d61d36de-f3d1-415a-b700-dd7c2af212f8 req-d58a3fb6-66a2-47f8-85e3-757f144c423e service nova] Creating event network-changed:1dcfa488-8f05-4fb7-886a-f55cb9744db2 for instance 9e138225-a52a-49b7-91d9-4a70fe170cee on n-h1-862964-4 Oct 29 03:45:25.195813 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d61d36de-f3d1-415a-b700-dd7c2af212f8 req-d58a3fb6-66a2-47f8-85e3-757f144c423e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034074 Oct 29 03:45:25.196496 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3497/7040] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:26.165947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-74bff0c6-a3ab-496a-805f-92257f2695aa tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:26.166770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-74bff0c6-a3ab-496a-805f-92257f2695aa tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:26.175806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74bff0c6-a3ab-496a-805f-92257f2695aa tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:26.176291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74bff0c6-a3ab-496a-805f-92257f2695aa tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:26.176717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74bff0c6-a3ab-496a-805f-92257f2695aa tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:26.177403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74bff0c6-a3ab-496a-805f-92257f2695aa tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:26.177845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74bff0c6-a3ab-496a-805f-92257f2695aa tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:26.178293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-74bff0c6-a3ab-496a-805f-92257f2695aa tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:26.320330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-74bff0c6-a3ab-496a-805f-92257f2695aa tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:26.328479 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-74bff0c6-a3ab-496a-805f-92257f2695aa tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1321 microversion: 2.1 time: 0.169484 Oct 29 03:45:26.329055 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3544/7041] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:26 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:27.352492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-31ad1ee8-9c69-48a3-a978-824373c7388e tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:27.353164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-31ad1ee8-9c69-48a3-a978-824373c7388e tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:27.360474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31ad1ee8-9c69-48a3-a978-824373c7388e tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:27.360963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31ad1ee8-9c69-48a3-a978-824373c7388e tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:27.361414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31ad1ee8-9c69-48a3-a978-824373c7388e tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:27.362184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31ad1ee8-9c69-48a3-a978-824373c7388e tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:27.362647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31ad1ee8-9c69-48a3-a978-824373c7388e tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:27.363078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-31ad1ee8-9c69-48a3-a978-824373c7388e tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:27.509846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-31ad1ee8-9c69-48a3-a978-824373c7388e tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:27.518403 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-31ad1ee8-9c69-48a3-a978-824373c7388e tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1321 microversion: 2.1 time: 0.171179 Oct 29 03:45:27.519002 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3498/7042] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:27 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:28.546301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8696c1e3-72e1-4515-a2a7-6205be3377f3 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:28.547267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8696c1e3-72e1-4515-a2a7-6205be3377f3 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:28.558351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8696c1e3-72e1-4515-a2a7-6205be3377f3 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:28.559163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8696c1e3-72e1-4515-a2a7-6205be3377f3 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:28.559886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8696c1e3-72e1-4515-a2a7-6205be3377f3 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:28.561042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8696c1e3-72e1-4515-a2a7-6205be3377f3 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:28.561872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8696c1e3-72e1-4515-a2a7-6205be3377f3 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:28.562599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8696c1e3-72e1-4515-a2a7-6205be3377f3 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:28.699917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8696c1e3-72e1-4515-a2a7-6205be3377f3 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:28.712138 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8696c1e3-72e1-4515-a2a7-6205be3377f3 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1321 microversion: 2.1 time: 0.172596 Oct 29 03:45:28.712924 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3545/7043] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:28 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:29.740127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-350b095f-8dea-41b4-bb08-dd1e80b86cc9 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:29.740767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-350b095f-8dea-41b4-bb08-dd1e80b86cc9 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:29.742837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:29.749390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-350b095f-8dea-41b4-bb08-dd1e80b86cc9 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:29.750084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-350b095f-8dea-41b4-bb08-dd1e80b86cc9 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:29.750516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-350b095f-8dea-41b4-bb08-dd1e80b86cc9 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:29.751240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-350b095f-8dea-41b4-bb08-dd1e80b86cc9 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:29.751695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-350b095f-8dea-41b4-bb08-dd1e80b86cc9 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:29.752125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-350b095f-8dea-41b4-bb08-dd1e80b86cc9 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:29.888940 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-350b095f-8dea-41b4-bb08-dd1e80b86cc9 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:29.897533 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-350b095f-8dea-41b4-bb08-dd1e80b86cc9 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1321 microversion: 2.1 time: 0.161993 Oct 29 03:45:29.898227 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3499/7044] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:29 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:30.925136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-59f6409e-e25c-4d6d-a84f-3d4b542fb384 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:30.926085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-59f6409e-e25c-4d6d-a84f-3d4b542fb384 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:30.930319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:30.941787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59f6409e-e25c-4d6d-a84f-3d4b542fb384 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:30.942387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59f6409e-e25c-4d6d-a84f-3d4b542fb384 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:30.942827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59f6409e-e25c-4d6d-a84f-3d4b542fb384 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:30.943722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59f6409e-e25c-4d6d-a84f-3d4b542fb384 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:30.944216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59f6409e-e25c-4d6d-a84f-3d4b542fb384 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:30.944694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-59f6409e-e25c-4d6d-a84f-3d4b542fb384 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:31.082539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-59f6409e-e25c-4d6d-a84f-3d4b542fb384 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:31.090334 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-59f6409e-e25c-4d6d-a84f-3d4b542fb384 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1321 microversion: 2.1 time: 0.171807 Oct 29 03:45:31.090882 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3546/7045] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:30 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:31.209004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-e4ff22cc-f229-4145-97ff-a50b63106a98 req-9d74b1f4-704a-4c6b-b6ba-2362a714df01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e138225-a52a-49b7-91d9-4a70fe170cee", "name": "network-vif-plugged", "status": "completed", "tag": "1dcfa488-8f05-4fb7-886a-f55cb9744db2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:31.221251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e4ff22cc-f229-4145-97ff-a50b63106a98 req-9d74b1f4-704a-4c6b-b6ba-2362a714df01 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:31.221737 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e4ff22cc-f229-4145-97ff-a50b63106a98 req-9d74b1f4-704a-4c6b-b6ba-2362a714df01 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:31.222214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-e4ff22cc-f229-4145-97ff-a50b63106a98 req-9d74b1f4-704a-4c6b-b6ba-2362a714df01 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:31.238147 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-e4ff22cc-f229-4145-97ff-a50b63106a98 req-9d74b1f4-704a-4c6b-b6ba-2362a714df01 service nova] Creating event network-vif-plugged:1dcfa488-8f05-4fb7-886a-f55cb9744db2 for instance 9e138225-a52a-49b7-91d9-4a70fe170cee on n-h1-862964-4 Oct 29 03:45:31.243861 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-e4ff22cc-f229-4145-97ff-a50b63106a98 req-9d74b1f4-704a-4c6b-b6ba-2362a714df01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088766 Oct 29 03:45:31.244570 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3500/7046] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:32.118795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3c18cebb-bf94-43fe-9a11-c8f0891ea281 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:32.119647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3c18cebb-bf94-43fe-9a11-c8f0891ea281 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:32.131424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c18cebb-bf94-43fe-9a11-c8f0891ea281 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:32.132250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c18cebb-bf94-43fe-9a11-c8f0891ea281 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:32.133208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c18cebb-bf94-43fe-9a11-c8f0891ea281 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:32.134438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c18cebb-bf94-43fe-9a11-c8f0891ea281 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:32.135202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c18cebb-bf94-43fe-9a11-c8f0891ea281 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:32.135911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c18cebb-bf94-43fe-9a11-c8f0891ea281 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:32.274026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3c18cebb-bf94-43fe-9a11-c8f0891ea281 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:32.282451 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3c18cebb-bf94-43fe-9a11-c8f0891ea281 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1321 microversion: 2.1 time: 0.170689 Oct 29 03:45:32.283035 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3547/7047] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:32 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:33.304728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=10 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:33.313270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6369f26b-1368-41b4-b4bc-97fe98c11587 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:33.314501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6369f26b-1368-41b4-b4bc-97fe98c11587 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:33.322555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6369f26b-1368-41b4-b4bc-97fe98c11587 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:33.323053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6369f26b-1368-41b4-b4bc-97fe98c11587 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:33.323503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6369f26b-1368-41b4-b4bc-97fe98c11587 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:33.324212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6369f26b-1368-41b4-b4bc-97fe98c11587 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:33.324676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6369f26b-1368-41b4-b4bc-97fe98c11587 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:33.325145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6369f26b-1368-41b4-b4bc-97fe98c11587 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:33.470096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6369f26b-1368-41b4-b4bc-97fe98c11587 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:33.478401 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6369f26b-1368-41b4-b4bc-97fe98c11587 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1470 microversion: 2.1 time: 0.175431 Oct 29 03:45:33.478983 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3501/7048] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:33 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:33.558904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2a12344d-de14-4347-9aaf-f102a85b474a tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Calling method '.version_select at 0x7fe1a8993d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:33.628523 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2a12344d-de14-4347-9aaf-f102a85b474a tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/1d14af6903dc483e9b0c51c876b6d670" status: 200 len: 371 microversion: 2.1 time: 0.128590 Oct 29 03:45:33.629131 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3548/7049] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 03:45:33 2022] GET /compute/v2.1/os-quota-sets/1d14af6903dc483e9b0c51c876b6d670 => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:33.641841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f366962d-9b31-41a3-a5f0-a9b3cdaf2272 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1922583667", "id": 2033535376, "os-flavor-access:is_public": "True"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:33.662586 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f366962d-9b31-41a3-a5f0-a9b3cdaf2272 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.024895 Oct 29 03:45:33.663165 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3502/7050] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:45:33 2022] POST /compute/v2.1/flavors => generated 438 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:33.675694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2033535376"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:33.678023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:33.686895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:33.687376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:33.687807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:33.688498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:33.688946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:33.689368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:33.918863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'aa137ece7b434678b23f2a4dacdcbd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d14af6903dc483e9b0c51c876b6d670', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:33.925457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1922583667 {{(pid=127042) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:45:33.932419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:33.932933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:33.933367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:33.934130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:33.934581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:33.934998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:33.959797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Getting quotas for project 99bff39e69ff4791927279f6b5941930. Resources: {'ram', 'cores'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:45:33.965065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Getting quotas for user 740c8eda8ebe40ccaadc1fd0137f941e and project 99bff39e69ff4791927279f6b5941930. Resources: {'ram', 'cores'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:45:33.977701 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.compute.api [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] ram quota exceeded for 1d14af6903dc483e9b0c51c876b6d670, tried to resize instance. Oct 29 03:45:33.978270 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Request method failure captured: Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee/action HTTP/1.1 Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 39 Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKHNvIqfimzXUVh2LwTN5cmutOYB_0ILGX3T4L7Qhs3Trnhr8CVihXZEIQYBGXx8zKxoq6UdSzcaIQjSwQGn6AaDOTZHdHQ6c1mQ1f_KCzMpTDLfMsl8UHXo23fWOGaw9L1ejZtMDd7TiU_pFmVEYJr1WHjnzKAPFxhdsPMKqQ46Fjo Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 1d14af6903dc483e9b0c51c876b6d670 Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1502500465 Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader,admin Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader,admin Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d14af6903dc483e9b0c51c876b6d670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d14af6903dc483e9b0c51c876b6d670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d14af6903dc483e9b0c51c876b6d670", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d14af6903dc483e9b0c51c876b6d670"}]}] Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1502500465 Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 1d14af6903dc483e9b0c51c876b6d670 Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1502500465 Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersAdminNegativeTestJSON-1502500465-project-admin Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: aa137ece7b434678b23f2a4dacdcbd93 Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1502500465-project-admin Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: {"resize": {"flavorRef": "2033535376"}} Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '9e138225-a52a-49b7-91d9-4a70fe170cee', 'body': {'resize': {'flavorRef': '2033535376'}}} Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:45:33.980237 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-da4283dc-4589-4415-943b-ca780c59bf9b tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee/action" status: 403 len: 118 microversion: 2.1 time: 0.309957 Oct 29 03:45:33.985109 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3549/7051] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:45:33 2022] POST /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee/action => generated 118 bytes in 311 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:45:33.991879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1ca25d2f-dd12-4b31-b186-a77060ebe5d5 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:34.011627 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1ca25d2f-dd12-4b31-b186-a77060ebe5d5 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2033535376" status: 202 len: 0 microversion: 2.1 time: 0.023839 Oct 29 03:45:34.012219 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3503/7052] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 03:45:33 2022] DELETE /compute/v2.1/flavors/2033535376 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:45:34.020671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-07e0bb78-4973-446e-a9c7-1eace23b4368 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:34.041352 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-07e0bb78-4973-446e-a9c7-1eace23b4368 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024369 Oct 29 03:45:34.041917 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3550/7053] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 03:45:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:45:34.064604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a5b9ec6c-7dbf-4b2f-9cbe-10731b449c96 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Calling method '.version_select at 0x7fe1a93a2040>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:34.144032 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a5b9ec6c-7dbf-4b2f-9cbe-10731b449c96 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/1d14af6903dc483e9b0c51c876b6d670" status: 200 len: 371 microversion: 2.1 time: 0.084516 Oct 29 03:45:34.144603 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3504/7054] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 03:45:34 2022] GET /compute/v2.1/os-quota-sets/1d14af6903dc483e9b0c51c876b6d670 => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:34.156877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-495d1e76-72b6-4400-a868-34d216c8d11a tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1920641213", "id": 2124781278, "os-flavor-access:is_public": "True"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:34.176984 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-495d1e76-72b6-4400-a868-34d216c8d11a tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.024300 Oct 29 03:45:34.177604 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3551/7055] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:45:34 2022] POST /compute/v2.1/flavors => generated 437 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:34.190105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2124781278"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:34.192509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:34.199037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:34.199530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:34.199973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:34.200686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:34.201124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:34.201574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:34.370018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'aa137ece7b434678b23f2a4dacdcbd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d14af6903dc483e9b0c51c876b6d670', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:34.376468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1920641213 {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:45:34.384319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:34.384845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:34.385287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:34.386074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:34.386551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:34.386983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:34.415291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Getting quotas for project 99bff39e69ff4791927279f6b5941930. Resources: {'ram', 'cores'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:45:34.420771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Getting quotas for user 740c8eda8ebe40ccaadc1fd0137f941e and project 99bff39e69ff4791927279f6b5941930. Resources: {'ram', 'cores'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:45:34.435248 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.compute.api [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] cores quota exceeded for 1d14af6903dc483e9b0c51c876b6d670, tried to resize instance. Oct 29 03:45:34.435800 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Request method failure captured: Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee/action HTTP/1.1 Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 39 Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKHNvIqfimzXUVh2LwTN5cmutOYB_0ILGX3T4L7Qhs3Trnhr8CVihXZEIQYBGXx8zKxoq6UdSzcaIQjSwQGn6AaDOTZHdHQ6c1mQ1f_KCzMpTDLfMsl8UHXo23fWOGaw9L1ejZtMDd7TiU_pFmVEYJr1WHjnzKAPFxhdsPMKqQ46Fjo Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 1d14af6903dc483e9b0c51c876b6d670 Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1502500465 Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader,admin Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader,admin Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d14af6903dc483e9b0c51c876b6d670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d14af6903dc483e9b0c51c876b6d670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d14af6903dc483e9b0c51c876b6d670", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d14af6903dc483e9b0c51c876b6d670"}]}] Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1502500465 Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 1d14af6903dc483e9b0c51c876b6d670 Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1502500465 Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersAdminNegativeTestJSON-1502500465-project-admin Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: aa137ece7b434678b23f2a4dacdcbd93 Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1502500465-project-admin Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: {"resize": {"flavorRef": "2124781278"}} Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '9e138225-a52a-49b7-91d9-4a70fe170cee', 'body': {'resize': {'flavorRef': '2124781278'}}} Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:45:34.438016 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-904707ce-6104-4d5c-8601-11f72993714d tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee/action" status: 403 len: 113 microversion: 2.1 time: 0.253807 Oct 29 03:45:34.442573 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3505/7056] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:45:34 2022] POST /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee/action => generated 113 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:45:34.448808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c79352b3-46d8-46c7-802c-5a1b05940406 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:34.468139 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c79352b3-46d8-46c7-802c-5a1b05940406 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2124781278" status: 202 len: 0 microversion: 2.1 time: 0.023120 Oct 29 03:45:34.468742 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3552/7057] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Oct 29 03:45:34 2022] DELETE /compute/v2.1/flavors/2124781278 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:45:34.477387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1bf5b1b0-b6d9-4f00-b509-260fa1880ef9 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:34.498066 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1bf5b1b0-b6d9-4f00-b509-260fa1880ef9 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024407 Oct 29 03:45:34.498640 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3506/7058] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 03:45:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:34.520330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f3a72100-91ec-4d66-9358-adc531cf5724 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:34.520822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f3a72100-91ec-4d66-9358-adc531cf5724 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:34.528768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3a72100-91ec-4d66-9358-adc531cf5724 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:34.529242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3a72100-91ec-4d66-9358-adc531cf5724 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:34.529671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3a72100-91ec-4d66-9358-adc531cf5724 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:34.530407 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3a72100-91ec-4d66-9358-adc531cf5724 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:34.530853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3a72100-91ec-4d66-9358-adc531cf5724 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:34.531255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f3a72100-91ec-4d66-9358-adc531cf5724 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:34.558246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f3a72100-91ec-4d66-9358-adc531cf5724 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:45:34.645521 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f3a72100-91ec-4d66-9358-adc531cf5724 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 204 len: 0 microversion: 2.1 time: 0.128792 Oct 29 03:45:34.646389 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3553/7059] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:45:34 2022] DELETE /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:45:34.654903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9441d2d9-098e-4188-a236-6cc326145fc8 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:34.655559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9441d2d9-098e-4188-a236-6cc326145fc8 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:34.662203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9441d2d9-098e-4188-a236-6cc326145fc8 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:34.662708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9441d2d9-098e-4188-a236-6cc326145fc8 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:34.663150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9441d2d9-098e-4188-a236-6cc326145fc8 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:34.663852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9441d2d9-098e-4188-a236-6cc326145fc8 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:34.664314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9441d2d9-098e-4188-a236-6cc326145fc8 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:34.664748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9441d2d9-098e-4188-a236-6cc326145fc8 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:34.804160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9441d2d9-098e-4188-a236-6cc326145fc8 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:34.812823 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9441d2d9-098e-4188-a236-6cc326145fc8 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1476 microversion: 2.1 time: 0.161870 Oct 29 03:45:34.813425 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3507/7060] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:34 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:35.842536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e17cda8b-8b32-40f8-a7a6-cd2d45635279 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:35.843138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e17cda8b-8b32-40f8-a7a6-cd2d45635279 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:35.850623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e17cda8b-8b32-40f8-a7a6-cd2d45635279 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:35.851109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e17cda8b-8b32-40f8-a7a6-cd2d45635279 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:35.851541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e17cda8b-8b32-40f8-a7a6-cd2d45635279 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:35.852245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e17cda8b-8b32-40f8-a7a6-cd2d45635279 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:35.852696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e17cda8b-8b32-40f8-a7a6-cd2d45635279 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:35.853115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e17cda8b-8b32-40f8-a7a6-cd2d45635279 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:35.993165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e17cda8b-8b32-40f8-a7a6-cd2d45635279 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:36.004172 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e17cda8b-8b32-40f8-a7a6-cd2d45635279 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1476 microversion: 2.1 time: 0.166182 Oct 29 03:45:36.004762 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3554/7061] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:35 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1476 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:36.526518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f4a5f790-d265-4e7d-8fa1-744d0cb9e9ce req-b77e6fab-fa50-482d-bd5a-67397601acec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e138225-a52a-49b7-91d9-4a70fe170cee", "name": "network-vif-deleted", "tag": "1dcfa488-8f05-4fb7-886a-f55cb9744db2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:36.539238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f4a5f790-d265-4e7d-8fa1-744d0cb9e9ce req-b77e6fab-fa50-482d-bd5a-67397601acec service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:36.539732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f4a5f790-d265-4e7d-8fa1-744d0cb9e9ce req-b77e6fab-fa50-482d-bd5a-67397601acec service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:36.540973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f4a5f790-d265-4e7d-8fa1-744d0cb9e9ce req-b77e6fab-fa50-482d-bd5a-67397601acec service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:36.559246 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f4a5f790-d265-4e7d-8fa1-744d0cb9e9ce req-b77e6fab-fa50-482d-bd5a-67397601acec service nova] Creating event network-vif-deleted:1dcfa488-8f05-4fb7-886a-f55cb9744db2 for instance 9e138225-a52a-49b7-91d9-4a70fe170cee on n-h1-862964-4 Oct 29 03:45:36.567309 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f4a5f790-d265-4e7d-8fa1-744d0cb9e9ce req-b77e6fab-fa50-482d-bd5a-67397601acec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045219 Oct 29 03:45:36.567928 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3508/7062] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:45:37.027983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:37.028806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:37.036501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:37.037001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:37.037473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:37.038234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:37.038682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:37.039101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:37.075305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:37.075829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:37.076278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:37.076708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lazy-loading 'fault' on Instance uuid 9e138225-a52a-49b7-91d9-4a70fe170cee {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:45:37.126451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740c8eda8ebe40ccaadc1fd0137f941e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bff39e69ff4791927279f6b5941930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:37.136694 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-570a85be-f218-4746-8745-dc3b3263b02d tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 200 len: 1311 microversion: 2.1 time: 0.112935 Oct 29 03:45:37.137301 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3555/7063] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:37 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:38.165704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:38.166963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] [instance: 9e138225-a52a-49b7-91d9-4a70fe170cee] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:38.179081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:38.179904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:38.180632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:38.181783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:38.182595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:38.183313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:38.199864 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] HTTP exception thrown: Instance 9e138225-a52a-49b7-91d9-4a70fe170cee could not be found. Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Request method failure captured: Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee HTTP/1.1 Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKHNT709gyU0Eexg5KtvSCFqQwECbi6NF4d_6i4hyiATBliexR5Qy5xKxJrsgZuCf7H46jylbXbv5a4g0b3NAJZg0pmVkKcJFtzFIbo73r7Ol4HzuwPQRkhNBu68_I7UZb7C5QS_HwQyuJHZGTw797NWe2yDX_mYcKcQE9Wh3uIUcmI Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 99bff39e69ff4791927279f6b5941930 Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-404881828 Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99bff39e69ff4791927279f6b5941930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bff39e69ff4791927279f6b5941930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99bff39e69ff4791927279f6b5941930", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bff39e69ff4791927279f6b5941930"}]}] Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersAdminNegativeTestJSON-404881828 Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 99bff39e69ff4791927279f6b5941930 Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-404881828 Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersAdminNegativeTestJSON-404881828-project Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 740c8eda8ebe40ccaadc1fd0137f941e Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersAdminNegativeTestJSON-404881828-project Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 9e138225-a52a-49b7-91d9-4a70fe170cee could not be found. Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '9e138225-a52a-49b7-91d9-4a70fe170cee'} Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e138225-a52a-49b7-91d9-4a70fe170cee could not be found. Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e138225-a52a-49b7-91d9-4a70fe170cee could not be found. Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:38.201603 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:38.206078 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:38.206078 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:38.206078 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:45:38.206078 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:45:38.206078 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:45:38.206078 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:45:38.206078 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e138225-a52a-49b7-91d9-4a70fe170cee could not be found. Oct 29 03:45:38.206078 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:45:38.206078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] Returning 404 to user: Instance 9e138225-a52a-49b7-91d9-4a70fe170cee could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:45:38.206078 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d007b28-0919-490e-8540-ec7ef33c9312 tempest-ServersAdminNegativeTestJSON-404881828 tempest-ServersAdminNegativeTestJSON-404881828-project] 10.222.0.16 "GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee" status: 404 len: 111 microversion: 2.1 time: 0.044841 Oct 29 03:45:38.206078 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3509/7064] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:38 2022] GET /compute/v2.1/servers/9e138225-a52a-49b7-91d9-4a70fe170cee => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:45:44.407643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:44.408520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:44.525619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-630544404", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "ac2bd240-06b6-4653-9bc8-518db15f68db"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:44.596413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] validate_networks() for [('ac2bd240-06b6-4653-9bc8-518db15f68db', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:45:45.004074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:45:45.004877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:45:45.006179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:45:45.007238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:45:45.007904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:45:45.030947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:45.031435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:45.031871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:45.032640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:45.033211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:45.033637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:45.051427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Getting quotas for project 657860e2093040a09e076ca960101296. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:45:45.060691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Getting quotas for user 9ce61d1e5eef44ecb4f571978ec72352 and project 657860e2093040a09e076ca960101296. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:45:45.076885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:45:45.079193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:45:45.127787 n-d-862964-4 devstack@n-api.service[127042]: ERROR oslo.messaging._drivers.impl_rabbit [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [fd2638de-0c1d-4f00-8ed0-3fe21cdde1b0] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 03:45:46.135347 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [fd2638de-0c1d-4f00-8ed0-3fe21cdde1b0] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43740. Oct 29 03:45:46.139915 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-047ccc31-6bfb-4386-9701-856c10dc7b44 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.738230 Oct 29 03:45:46.140607 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3556/7065] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:45:46.152504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7395ce0a-56ed-4045-b4f8-17d7e4d50c93 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:46.153268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7395ce0a-56ed-4045-b4f8-17d7e4d50c93 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:46.157143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:46.158286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:46.234534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7395ce0a-56ed-4045-b4f8-17d7e4d50c93 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:46.244451 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7395ce0a-56ed-4045-b4f8-17d7e4d50c93 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1214 microversion: 2.1 time: 0.095864 Oct 29 03:45:46.245056 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3510/7066] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:46 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:47.269365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cfd60f0a-cd39-4142-ac2b-d41705605162 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:47.270374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cfd60f0a-cd39-4142-ac2b-d41705605162 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:47.278297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd60f0a-cd39-4142-ac2b-d41705605162 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:47.278854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd60f0a-cd39-4142-ac2b-d41705605162 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:47.279255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd60f0a-cd39-4142-ac2b-d41705605162 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:47.280002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd60f0a-cd39-4142-ac2b-d41705605162 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:47.280842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd60f0a-cd39-4142-ac2b-d41705605162 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:47.281438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfd60f0a-cd39-4142-ac2b-d41705605162 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:47.360928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cfd60f0a-cd39-4142-ac2b-d41705605162 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:47.373066 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cfd60f0a-cd39-4142-ac2b-d41705605162 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1274 microversion: 2.1 time: 0.109443 Oct 29 03:45:47.374019 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3557/7067] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:47 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:45:48.398918 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-71c8e4f5-7cbc-4651-a42a-3e8df1039572 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:48.399646 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-71c8e4f5-7cbc-4651-a42a-3e8df1039572 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:48.403429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=53 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:48.404098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:48.410540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71c8e4f5-7cbc-4651-a42a-3e8df1039572 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:48.411039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71c8e4f5-7cbc-4651-a42a-3e8df1039572 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:48.411483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71c8e4f5-7cbc-4651-a42a-3e8df1039572 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:48.412191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71c8e4f5-7cbc-4651-a42a-3e8df1039572 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:48.412651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71c8e4f5-7cbc-4651-a42a-3e8df1039572 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:48.413079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-71c8e4f5-7cbc-4651-a42a-3e8df1039572 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:48.643417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-71c8e4f5-7cbc-4651-a42a-3e8df1039572 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:48.651749 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-71c8e4f5-7cbc-4651-a42a-3e8df1039572 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1314 microversion: 2.1 time: 0.256854 Oct 29 03:45:48.652351 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3511/7068] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:48 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:48.921415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b0dcde0d-54f4-42b6-ad00-d15ad78d5e3e req-fda1ce9e-5def-481f-9f58-ec6217c7f0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73d9191-3e93-4a97-a8a3-b1a2947814da", "tag": "1d1cad7d-22b9-4b91-b41e-843232fe1b08"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:48.927687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:48.933606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b0dcde0d-54f4-42b6-ad00-d15ad78d5e3e req-fda1ce9e-5def-481f-9f58-ec6217c7f0b8 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:48.934217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b0dcde0d-54f4-42b6-ad00-d15ad78d5e3e req-fda1ce9e-5def-481f-9f58-ec6217c7f0b8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:48.934826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b0dcde0d-54f4-42b6-ad00-d15ad78d5e3e req-fda1ce9e-5def-481f-9f58-ec6217c7f0b8 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:48.940274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:48.949339 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b0dcde0d-54f4-42b6-ad00-d15ad78d5e3e req-fda1ce9e-5def-481f-9f58-ec6217c7f0b8 service nova] Creating event network-changed:1d1cad7d-22b9-4b91-b41e-843232fe1b08 for instance d73d9191-3e93-4a97-a8a3-b1a2947814da on n-h1-862964-4 Oct 29 03:45:48.955206 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b0dcde0d-54f4-42b6-ad00-d15ad78d5e3e req-fda1ce9e-5def-481f-9f58-ec6217c7f0b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037527 Oct 29 03:45:48.956003 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3558/7069] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:49.680459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fa1f3841-721e-4e02-9c56-0f8a92374a4c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:49.681298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fa1f3841-721e-4e02-9c56-0f8a92374a4c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:49.691943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1f3841-721e-4e02-9c56-0f8a92374a4c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:49.692440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1f3841-721e-4e02-9c56-0f8a92374a4c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:49.692888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1f3841-721e-4e02-9c56-0f8a92374a4c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:49.693602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1f3841-721e-4e02-9c56-0f8a92374a4c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:49.694097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1f3841-721e-4e02-9c56-0f8a92374a4c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:49.694530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fa1f3841-721e-4e02-9c56-0f8a92374a4c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:49.827830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fa1f3841-721e-4e02-9c56-0f8a92374a4c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:49.835965 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fa1f3841-721e-4e02-9c56-0f8a92374a4c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1314 microversion: 2.1 time: 0.162492 Oct 29 03:45:49.836558 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3512/7070] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:49 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:50.862136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-380a7085-9e12-4af9-8557-c1effb5a2147 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:50.862852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-380a7085-9e12-4af9-8557-c1effb5a2147 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:50.870628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-380a7085-9e12-4af9-8557-c1effb5a2147 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:50.871125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-380a7085-9e12-4af9-8557-c1effb5a2147 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:50.871555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-380a7085-9e12-4af9-8557-c1effb5a2147 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:50.872264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-380a7085-9e12-4af9-8557-c1effb5a2147 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:50.872705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-380a7085-9e12-4af9-8557-c1effb5a2147 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:50.873114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-380a7085-9e12-4af9-8557-c1effb5a2147 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:51.012936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-380a7085-9e12-4af9-8557-c1effb5a2147 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:51.024728 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-380a7085-9e12-4af9-8557-c1effb5a2147 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1314 microversion: 2.1 time: 0.168968 Oct 29 03:45:51.025492 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3559/7071] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:50 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:52.050622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6e0ae11a-7385-405a-bfbc-340d9f4a266e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:52.051292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6e0ae11a-7385-405a-bfbc-340d9f4a266e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:52.059407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e0ae11a-7385-405a-bfbc-340d9f4a266e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:52.059977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e0ae11a-7385-405a-bfbc-340d9f4a266e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:52.060474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e0ae11a-7385-405a-bfbc-340d9f4a266e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:52.061243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e0ae11a-7385-405a-bfbc-340d9f4a266e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:52.061779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e0ae11a-7385-405a-bfbc-340d9f4a266e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:52.062317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6e0ae11a-7385-405a-bfbc-340d9f4a266e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:52.200223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6e0ae11a-7385-405a-bfbc-340d9f4a266e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:52.208896 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6e0ae11a-7385-405a-bfbc-340d9f4a266e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1314 microversion: 2.1 time: 0.162721 Oct 29 03:45:52.209488 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3513/7072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:52 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:53.234009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94bd3dba-c039-4dc3-90ac-1e6b700f1596 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:53.234730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-94bd3dba-c039-4dc3-90ac-1e6b700f1596 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:53.245189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94bd3dba-c039-4dc3-90ac-1e6b700f1596 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:53.245709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94bd3dba-c039-4dc3-90ac-1e6b700f1596 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:53.246255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94bd3dba-c039-4dc3-90ac-1e6b700f1596 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:53.247148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94bd3dba-c039-4dc3-90ac-1e6b700f1596 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:53.247798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94bd3dba-c039-4dc3-90ac-1e6b700f1596 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:53.248367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94bd3dba-c039-4dc3-90ac-1e6b700f1596 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:53.386496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-94bd3dba-c039-4dc3-90ac-1e6b700f1596 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:53.394935 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-94bd3dba-c039-4dc3-90ac-1e6b700f1596 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1314 microversion: 2.1 time: 0.166778 Oct 29 03:45:53.395513 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3560/7073] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:53 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:54.419076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a345f3fe-124b-48ae-8a06-65885fa4adf8 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:54.419734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a345f3fe-124b-48ae-8a06-65885fa4adf8 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:54.427014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a345f3fe-124b-48ae-8a06-65885fa4adf8 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:54.427511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a345f3fe-124b-48ae-8a06-65885fa4adf8 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:54.427959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a345f3fe-124b-48ae-8a06-65885fa4adf8 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:54.428666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a345f3fe-124b-48ae-8a06-65885fa4adf8 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:54.429133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a345f3fe-124b-48ae-8a06-65885fa4adf8 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:54.429571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a345f3fe-124b-48ae-8a06-65885fa4adf8 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:54.573942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a345f3fe-124b-48ae-8a06-65885fa4adf8 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:54.582045 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a345f3fe-124b-48ae-8a06-65885fa4adf8 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1314 microversion: 2.1 time: 0.167319 Oct 29 03:45:54.582604 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3514/7074] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:54 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:55.157075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b4a9d977-f1db-4828-88ce-e67b195bbd92 req-a285e4b9-fe4f-4e9e-86f3-2df3fe50f549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73d9191-3e93-4a97-a8a3-b1a2947814da", "name": "network-vif-plugged", "status": "completed", "tag": "1d1cad7d-22b9-4b91-b41e-843232fe1b08"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:55.163098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:55.163834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:55.169530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b4a9d977-f1db-4828-88ce-e67b195bbd92 req-a285e4b9-fe4f-4e9e-86f3-2df3fe50f549 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:55.170051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b4a9d977-f1db-4828-88ce-e67b195bbd92 req-a285e4b9-fe4f-4e9e-86f3-2df3fe50f549 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:55.170937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b4a9d977-f1db-4828-88ce-e67b195bbd92 req-a285e4b9-fe4f-4e9e-86f3-2df3fe50f549 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:55.182710 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b4a9d977-f1db-4828-88ce-e67b195bbd92 req-a285e4b9-fe4f-4e9e-86f3-2df3fe50f549 service nova] Creating event network-vif-plugged:1d1cad7d-22b9-4b91-b41e-843232fe1b08 for instance d73d9191-3e93-4a97-a8a3-b1a2947814da on n-h1-862964-4 Oct 29 03:45:55.187755 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b4a9d977-f1db-4828-88ce-e67b195bbd92 req-a285e4b9-fe4f-4e9e-86f3-2df3fe50f549 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034843 Oct 29 03:45:55.188369 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3561/7075] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:55.605785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5bbeccce-da14-4036-a43d-8b2a0f697974 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:55.606337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5bbeccce-da14-4036-a43d-8b2a0f697974 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:55.613948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbeccce-da14-4036-a43d-8b2a0f697974 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:55.614445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbeccce-da14-4036-a43d-8b2a0f697974 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:55.614884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbeccce-da14-4036-a43d-8b2a0f697974 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:55.615592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbeccce-da14-4036-a43d-8b2a0f697974 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:55.616051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbeccce-da14-4036-a43d-8b2a0f697974 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:55.616476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5bbeccce-da14-4036-a43d-8b2a0f697974 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:55.755205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5bbeccce-da14-4036-a43d-8b2a0f697974 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:55.763114 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5bbeccce-da14-4036-a43d-8b2a0f697974 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1314 microversion: 2.1 time: 0.161451 Oct 29 03:45:55.763691 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3515/7076] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:55 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:56.787929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f14ae8a-731f-4f19-add6-76598878f159 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:56.788741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0f14ae8a-731f-4f19-add6-76598878f159 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:56.795559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f14ae8a-731f-4f19-add6-76598878f159 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:56.795967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f14ae8a-731f-4f19-add6-76598878f159 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:56.796391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f14ae8a-731f-4f19-add6-76598878f159 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:56.797069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f14ae8a-731f-4f19-add6-76598878f159 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:56.797513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f14ae8a-731f-4f19-add6-76598878f159 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:56.797969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f14ae8a-731f-4f19-add6-76598878f159 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:56.943718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f14ae8a-731f-4f19-add6-76598878f159 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:56.951664 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f14ae8a-731f-4f19-add6-76598878f159 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1501 microversion: 2.1 time: 0.169230 Oct 29 03:45:56.952271 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3562/7077] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:56 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:56.975309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:56.977671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:56.979731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:56.986307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:56.986794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:56.987314 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:56.988014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:56.988806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:56.989259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:57.022000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:57.030866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Old instance type m1.heat2, new instance type m1.heat {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:45:57.037840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:45:57.038300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:45:57.038747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:45:57.039211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:45:57.039597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:45:57.109177 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-454eed1e-ca60-483d-8cd9-c1702dc99b3e tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "POST /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da/action" status: 202 len: 0 microversion: 2.1 time: 0.138326 Oct 29 03:45:57.109766 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3516/7078] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:45:56 2022] POST /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:45:57.118732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dd026359-887e-46e9-b4b5-e92e26e6aba0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:57.119381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dd026359-887e-46e9-b4b5-e92e26e6aba0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:57.125636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd026359-887e-46e9-b4b5-e92e26e6aba0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:57.126506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd026359-887e-46e9-b4b5-e92e26e6aba0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:57.126943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd026359-887e-46e9-b4b5-e92e26e6aba0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:57.127910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd026359-887e-46e9-b4b5-e92e26e6aba0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:57.128157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd026359-887e-46e9-b4b5-e92e26e6aba0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:57.128776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dd026359-887e-46e9-b4b5-e92e26e6aba0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:57.303023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dd026359-887e-46e9-b4b5-e92e26e6aba0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:57.311514 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dd026359-887e-46e9-b4b5-e92e26e6aba0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1510 microversion: 2.1 time: 0.196734 Oct 29 03:45:57.312317 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3563/7079] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:57 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:58.335998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b0dc4f4c-5ef0-49e0-be7f-08175ae835ef tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:58.336618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b0dc4f4c-5ef0-49e0-be7f-08175ae835ef tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:58.344859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0dc4f4c-5ef0-49e0-be7f-08175ae835ef tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:58.345349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0dc4f4c-5ef0-49e0-be7f-08175ae835ef tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:58.345789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0dc4f4c-5ef0-49e0-be7f-08175ae835ef tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:58.346536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0dc4f4c-5ef0-49e0-be7f-08175ae835ef tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:58.346991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0dc4f4c-5ef0-49e0-be7f-08175ae835ef tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:58.348235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b0dc4f4c-5ef0-49e0-be7f-08175ae835ef tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:58.487892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b0dc4f4c-5ef0-49e0-be7f-08175ae835ef tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:58.496492 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b0dc4f4c-5ef0-49e0-be7f-08175ae835ef tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1510 microversion: 2.1 time: 0.165568 Oct 29 03:45:58.497056 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3517/7080] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:58 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:59.522057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-98a2fa05-c0c0-463c-a6d9-9dee2d0e3ea7 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:59.522635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-98a2fa05-c0c0-463c-a6d9-9dee2d0e3ea7 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:59.529671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a2fa05-c0c0-463c-a6d9-9dee2d0e3ea7 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:59.530201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a2fa05-c0c0-463c-a6d9-9dee2d0e3ea7 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:59.530636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a2fa05-c0c0-463c-a6d9-9dee2d0e3ea7 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:59.531372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a2fa05-c0c0-463c-a6d9-9dee2d0e3ea7 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:59.531907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a2fa05-c0c0-463c-a6d9-9dee2d0e3ea7 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:59.532342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-98a2fa05-c0c0-463c-a6d9-9dee2d0e3ea7 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:59.667474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-98a2fa05-c0c0-463c-a6d9-9dee2d0e3ea7 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:59.675795 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-98a2fa05-c0c0-463c-a6d9-9dee2d0e3ea7 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.158980 Oct 29 03:45:59.676379 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3564/7081] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:59 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:00.703795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-08dfacec-1d89-44ed-9373-537fc68a5368 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:00.704781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-08dfacec-1d89-44ed-9373-537fc68a5368 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:00.716356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08dfacec-1d89-44ed-9373-537fc68a5368 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:00.717197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08dfacec-1d89-44ed-9373-537fc68a5368 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:00.717939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08dfacec-1d89-44ed-9373-537fc68a5368 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:00.719123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08dfacec-1d89-44ed-9373-537fc68a5368 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:00.719928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08dfacec-1d89-44ed-9373-537fc68a5368 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:00.720641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08dfacec-1d89-44ed-9373-537fc68a5368 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:00.854839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-08dfacec-1d89-44ed-9373-537fc68a5368 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:00.863046 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-08dfacec-1d89-44ed-9373-537fc68a5368 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.166050 Oct 29 03:46:00.863999 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3518/7082] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:00 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:01.891378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bdb480f-0f02-4bc2-9f09-1be116588f88 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:01.892224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bdb480f-0f02-4bc2-9f09-1be116588f88 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:01.900672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bdb480f-0f02-4bc2-9f09-1be116588f88 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:01.901146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bdb480f-0f02-4bc2-9f09-1be116588f88 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:01.901575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bdb480f-0f02-4bc2-9f09-1be116588f88 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:01.902299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bdb480f-0f02-4bc2-9f09-1be116588f88 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:01.902718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bdb480f-0f02-4bc2-9f09-1be116588f88 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:01.903161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bdb480f-0f02-4bc2-9f09-1be116588f88 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:02.036324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9bdb480f-0f02-4bc2-9f09-1be116588f88 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:02.047657 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9bdb480f-0f02-4bc2-9f09-1be116588f88 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.162832 Oct 29 03:46:02.048475 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3565/7083] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:01 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:03.074226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-573074da-5c13-47c5-81dd-e4a4f5a2901c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:03.075004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-573074da-5c13-47c5-81dd-e4a4f5a2901c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:03.083475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573074da-5c13-47c5-81dd-e4a4f5a2901c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:03.084076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573074da-5c13-47c5-81dd-e4a4f5a2901c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:03.084577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573074da-5c13-47c5-81dd-e4a4f5a2901c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:03.085427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573074da-5c13-47c5-81dd-e4a4f5a2901c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:03.086084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573074da-5c13-47c5-81dd-e4a4f5a2901c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:03.086592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-573074da-5c13-47c5-81dd-e4a4f5a2901c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:03.236394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-573074da-5c13-47c5-81dd-e4a4f5a2901c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:03.246735 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-573074da-5c13-47c5-81dd-e4a4f5a2901c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.177236 Oct 29 03:46:03.247291 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3519/7084] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:03 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:04.274375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9479e91f-c785-4b06-974f-d4bb30e896aa tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:04.275009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9479e91f-c785-4b06-974f-d4bb30e896aa tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:04.282717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9479e91f-c785-4b06-974f-d4bb30e896aa tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:04.283229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9479e91f-c785-4b06-974f-d4bb30e896aa tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:04.283677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9479e91f-c785-4b06-974f-d4bb30e896aa tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:04.284409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9479e91f-c785-4b06-974f-d4bb30e896aa tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:04.284887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9479e91f-c785-4b06-974f-d4bb30e896aa tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:04.285326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9479e91f-c785-4b06-974f-d4bb30e896aa tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:04.428132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9479e91f-c785-4b06-974f-d4bb30e896aa tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:04.441003 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9479e91f-c785-4b06-974f-d4bb30e896aa tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.172822 Oct 29 03:46:04.441788 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3566/7085] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:04 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:05.469002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ba22b927-a81f-4e13-9eed-e25dea5fdb40 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:05.470086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ba22b927-a81f-4e13-9eed-e25dea5fdb40 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:05.481674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba22b927-a81f-4e13-9eed-e25dea5fdb40 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:05.482546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba22b927-a81f-4e13-9eed-e25dea5fdb40 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:05.483285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba22b927-a81f-4e13-9eed-e25dea5fdb40 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:05.484442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba22b927-a81f-4e13-9eed-e25dea5fdb40 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:05.485204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba22b927-a81f-4e13-9eed-e25dea5fdb40 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:05.486049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba22b927-a81f-4e13-9eed-e25dea5fdb40 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:05.623170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ba22b927-a81f-4e13-9eed-e25dea5fdb40 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:05.631670 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ba22b927-a81f-4e13-9eed-e25dea5fdb40 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.169570 Oct 29 03:46:05.632250 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3520/7086] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:05 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:06.656983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40e345c0-2d73-4157-a603-cc11f9802fb1 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:06.657733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40e345c0-2d73-4157-a603-cc11f9802fb1 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:06.666872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e345c0-2d73-4157-a603-cc11f9802fb1 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:06.667354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e345c0-2d73-4157-a603-cc11f9802fb1 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:06.667780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e345c0-2d73-4157-a603-cc11f9802fb1 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:06.668462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e345c0-2d73-4157-a603-cc11f9802fb1 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:06.668901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e345c0-2d73-4157-a603-cc11f9802fb1 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:06.669310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e345c0-2d73-4157-a603-cc11f9802fb1 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:06.810109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40e345c0-2d73-4157-a603-cc11f9802fb1 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:06.818576 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40e345c0-2d73-4157-a603-cc11f9802fb1 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.166459 Oct 29 03:46:06.819311 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3567/7087] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:06 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:07.845046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f9a3170b-2a1b-416f-9911-8963a2395801 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:07.845705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f9a3170b-2a1b-416f-9911-8963a2395801 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:07.855147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9a3170b-2a1b-416f-9911-8963a2395801 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:07.855801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9a3170b-2a1b-416f-9911-8963a2395801 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:07.856386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9a3170b-2a1b-416f-9911-8963a2395801 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:07.857319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9a3170b-2a1b-416f-9911-8963a2395801 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:07.857971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9a3170b-2a1b-416f-9911-8963a2395801 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:07.858542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f9a3170b-2a1b-416f-9911-8963a2395801 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:08.002545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f9a3170b-2a1b-416f-9911-8963a2395801 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:08.011144 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f9a3170b-2a1b-416f-9911-8963a2395801 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.171636 Oct 29 03:46:08.011768 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3521/7088] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:07 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:09.038864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-07f72e84-5305-46d5-8723-9dd3f4bfc283 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:09.039998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-07f72e84-5305-46d5-8723-9dd3f4bfc283 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:09.048397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07f72e84-5305-46d5-8723-9dd3f4bfc283 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:09.048881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07f72e84-5305-46d5-8723-9dd3f4bfc283 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:09.049304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07f72e84-5305-46d5-8723-9dd3f4bfc283 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:09.050028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07f72e84-5305-46d5-8723-9dd3f4bfc283 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:09.050471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07f72e84-5305-46d5-8723-9dd3f4bfc283 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:09.050968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-07f72e84-5305-46d5-8723-9dd3f4bfc283 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:09.188277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-07f72e84-5305-46d5-8723-9dd3f4bfc283 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:09.196139 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-07f72e84-5305-46d5-8723-9dd3f4bfc283 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.164246 Oct 29 03:46:09.196725 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3568/7089] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:09 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:10.223858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f8e0b173-3bd2-4813-8f7d-37c3ca7b7ac6 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:10.224805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f8e0b173-3bd2-4813-8f7d-37c3ca7b7ac6 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:10.236376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8e0b173-3bd2-4813-8f7d-37c3ca7b7ac6 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:10.237177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8e0b173-3bd2-4813-8f7d-37c3ca7b7ac6 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:10.237963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8e0b173-3bd2-4813-8f7d-37c3ca7b7ac6 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:10.239485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8e0b173-3bd2-4813-8f7d-37c3ca7b7ac6 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:10.240240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8e0b173-3bd2-4813-8f7d-37c3ca7b7ac6 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:10.240950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f8e0b173-3bd2-4813-8f7d-37c3ca7b7ac6 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:10.393307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f8e0b173-3bd2-4813-8f7d-37c3ca7b7ac6 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:10.403357 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f8e0b173-3bd2-4813-8f7d-37c3ca7b7ac6 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.186233 Oct 29 03:46:10.403946 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3522/7090] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:10 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:11.430671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3c9785a1-2a89-4765-a6f1-a3439f77ae3a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:11.431672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3c9785a1-2a89-4765-a6f1-a3439f77ae3a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:11.439018 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c9785a1-2a89-4765-a6f1-a3439f77ae3a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:11.439501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c9785a1-2a89-4765-a6f1-a3439f77ae3a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:11.439924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c9785a1-2a89-4765-a6f1-a3439f77ae3a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:11.440618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c9785a1-2a89-4765-a6f1-a3439f77ae3a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:11.441063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c9785a1-2a89-4765-a6f1-a3439f77ae3a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:11.441476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c9785a1-2a89-4765-a6f1-a3439f77ae3a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:11.596196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3c9785a1-2a89-4765-a6f1-a3439f77ae3a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:11.609089 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3c9785a1-2a89-4765-a6f1-a3439f77ae3a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.184717 Oct 29 03:46:11.609967 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3569/7091] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:11 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:12.639929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0c9e29f4-33f0-44d9-b166-a65cb7fd1f43 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:12.640815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0c9e29f4-33f0-44d9-b166-a65cb7fd1f43 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:12.650545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c9e29f4-33f0-44d9-b166-a65cb7fd1f43 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:12.651203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c9e29f4-33f0-44d9-b166-a65cb7fd1f43 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:12.651798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c9e29f4-33f0-44d9-b166-a65cb7fd1f43 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:12.652747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c9e29f4-33f0-44d9-b166-a65cb7fd1f43 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:12.653366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c9e29f4-33f0-44d9-b166-a65cb7fd1f43 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:12.653991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c9e29f4-33f0-44d9-b166-a65cb7fd1f43 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:12.792818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0c9e29f4-33f0-44d9-b166-a65cb7fd1f43 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:12.800826 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0c9e29f4-33f0-44d9-b166-a65cb7fd1f43 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.166920 Oct 29 03:46:12.801639 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3523/7092] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:12 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:13.829030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-755b8788-ee96-4590-8df3-77618d04d949 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:13.829904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-755b8788-ee96-4590-8df3-77618d04d949 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:13.841588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-755b8788-ee96-4590-8df3-77618d04d949 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:13.842110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-755b8788-ee96-4590-8df3-77618d04d949 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:13.842543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-755b8788-ee96-4590-8df3-77618d04d949 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:13.843241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-755b8788-ee96-4590-8df3-77618d04d949 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:13.843687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-755b8788-ee96-4590-8df3-77618d04d949 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:13.844105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-755b8788-ee96-4590-8df3-77618d04d949 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:13.983719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-755b8788-ee96-4590-8df3-77618d04d949 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:13.992099 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-755b8788-ee96-4590-8df3-77618d04d949 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.170249 Oct 29 03:46:13.992688 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3570/7093] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:13 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:15.016982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-04ffa45e-9f74-4376-a54d-60d49f12d50a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:15.017593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-04ffa45e-9f74-4376-a54d-60d49f12d50a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:15.019938 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:46:15.020080 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:46:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da (ip 10.222.0.16) !!! Oct 29 03:46:15.027406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04ffa45e-9f74-4376-a54d-60d49f12d50a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:15.027922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04ffa45e-9f74-4376-a54d-60d49f12d50a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:15.028365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04ffa45e-9f74-4376-a54d-60d49f12d50a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:15.029077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04ffa45e-9f74-4376-a54d-60d49f12d50a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:15.029536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04ffa45e-9f74-4376-a54d-60d49f12d50a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:15.029985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04ffa45e-9f74-4376-a54d-60d49f12d50a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:15.169359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-04ffa45e-9f74-4376-a54d-60d49f12d50a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:15.182500 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-04ffa45e-9f74-4376-a54d-60d49f12d50a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.169069 Oct 29 03:46:15.183334 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3524/7094] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:15 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:16.209028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7e41962e-2de0-4326-aa7b-236b52a40129 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:16.210015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7e41962e-2de0-4326-aa7b-236b52a40129 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:16.220991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e41962e-2de0-4326-aa7b-236b52a40129 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:16.221484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e41962e-2de0-4326-aa7b-236b52a40129 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:16.221934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e41962e-2de0-4326-aa7b-236b52a40129 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:16.222642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e41962e-2de0-4326-aa7b-236b52a40129 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:16.223096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e41962e-2de0-4326-aa7b-236b52a40129 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:16.223651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e41962e-2de0-4326-aa7b-236b52a40129 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:16.380944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7e41962e-2de0-4326-aa7b-236b52a40129 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:16.390282 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7e41962e-2de0-4326-aa7b-236b52a40129 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.187282 Oct 29 03:46:16.390866 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3571/7095] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:16 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:17.425630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c16c120b-965a-41f4-9b7e-8d66b477991a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:17.426828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c16c120b-965a-41f4-9b7e-8d66b477991a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:17.438056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c16c120b-965a-41f4-9b7e-8d66b477991a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:17.438558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c16c120b-965a-41f4-9b7e-8d66b477991a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:17.439007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c16c120b-965a-41f4-9b7e-8d66b477991a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:17.439761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c16c120b-965a-41f4-9b7e-8d66b477991a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:17.440226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c16c120b-965a-41f4-9b7e-8d66b477991a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:17.440666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c16c120b-965a-41f4-9b7e-8d66b477991a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:17.578862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c16c120b-965a-41f4-9b7e-8d66b477991a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:17.587225 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c16c120b-965a-41f4-9b7e-8d66b477991a tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.168390 Oct 29 03:46:17.587803 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3525/7096] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:17 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:18.611275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9a80510f-37d7-4f59-8287-c0828e5143b4 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:18.611980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9a80510f-37d7-4f59-8287-c0828e5143b4 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:18.619875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a80510f-37d7-4f59-8287-c0828e5143b4 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:18.620356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a80510f-37d7-4f59-8287-c0828e5143b4 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:18.620796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a80510f-37d7-4f59-8287-c0828e5143b4 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:18.621458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a80510f-37d7-4f59-8287-c0828e5143b4 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:18.621936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a80510f-37d7-4f59-8287-c0828e5143b4 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:18.622345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9a80510f-37d7-4f59-8287-c0828e5143b4 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:18.768128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9a80510f-37d7-4f59-8287-c0828e5143b4 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:18.776253 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9a80510f-37d7-4f59-8287-c0828e5143b4 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.169127 Oct 29 03:46:18.776864 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3572/7097] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:18 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:19.800324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54163523-656d-44c9-b6ff-4bd006641d42 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:19.801024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54163523-656d-44c9-b6ff-4bd006641d42 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:19.804251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=34 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:19.810813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54163523-656d-44c9-b6ff-4bd006641d42 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:19.811359 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54163523-656d-44c9-b6ff-4bd006641d42 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:19.811852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54163523-656d-44c9-b6ff-4bd006641d42 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:19.812640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54163523-656d-44c9-b6ff-4bd006641d42 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:19.813155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54163523-656d-44c9-b6ff-4bd006641d42 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:19.813733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54163523-656d-44c9-b6ff-4bd006641d42 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:19.816914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:19.953244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-54163523-656d-44c9-b6ff-4bd006641d42 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:19.962074 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54163523-656d-44c9-b6ff-4bd006641d42 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.166262 Oct 29 03:46:19.962656 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3526/7098] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:19 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:20.985295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a21c11bd-4a9b-4996-b90e-4522d5c1e625 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:20.985953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a21c11bd-4a9b-4996-b90e-4522d5c1e625 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:20.989481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=30 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:20.995339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a21c11bd-4a9b-4996-b90e-4522d5c1e625 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:20.995848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a21c11bd-4a9b-4996-b90e-4522d5c1e625 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:20.996330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a21c11bd-4a9b-4996-b90e-4522d5c1e625 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:20.997092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a21c11bd-4a9b-4996-b90e-4522d5c1e625 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:20.997583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a21c11bd-4a9b-4996-b90e-4522d5c1e625 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:20.998040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a21c11bd-4a9b-4996-b90e-4522d5c1e625 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:21.000983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=82 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:21.140961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a21c11bd-4a9b-4996-b90e-4522d5c1e625 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:21.148977 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a21c11bd-4a9b-4996-b90e-4522d5c1e625 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.167947 Oct 29 03:46:21.149563 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3573/7099] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:20 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:22.176211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-26dfb826-4a05-443f-bf7f-00782bf5d469 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:22.176892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-26dfb826-4a05-443f-bf7f-00782bf5d469 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:22.185040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26dfb826-4a05-443f-bf7f-00782bf5d469 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:22.185594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26dfb826-4a05-443f-bf7f-00782bf5d469 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:22.186116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26dfb826-4a05-443f-bf7f-00782bf5d469 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:22.186927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26dfb826-4a05-443f-bf7f-00782bf5d469 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:22.187402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26dfb826-4a05-443f-bf7f-00782bf5d469 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:22.187910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26dfb826-4a05-443f-bf7f-00782bf5d469 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:22.335362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-26dfb826-4a05-443f-bf7f-00782bf5d469 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:22.343611 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-26dfb826-4a05-443f-bf7f-00782bf5d469 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.173632 Oct 29 03:46:22.344218 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3527/7100] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:22 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:23.371995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40d124bd-7b2c-4194-b837-3e7053f4c0df tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:23.373010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40d124bd-7b2c-4194-b837-3e7053f4c0df tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:23.382419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40d124bd-7b2c-4194-b837-3e7053f4c0df tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:23.382910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40d124bd-7b2c-4194-b837-3e7053f4c0df tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:23.383346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40d124bd-7b2c-4194-b837-3e7053f4c0df tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:23.384055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40d124bd-7b2c-4194-b837-3e7053f4c0df tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:23.384504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40d124bd-7b2c-4194-b837-3e7053f4c0df tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:23.384909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40d124bd-7b2c-4194-b837-3e7053f4c0df tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:23.521908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-40d124bd-7b2c-4194-b837-3e7053f4c0df tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:23.529980 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40d124bd-7b2c-4194-b837-3e7053f4c0df tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.164794 Oct 29 03:46:23.530564 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3574/7101] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:23 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:24.554430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59c9c6a8-b351-4a53-b163-149ad034baa0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:24.555023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59c9c6a8-b351-4a53-b163-149ad034baa0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:24.562480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c9c6a8-b351-4a53-b163-149ad034baa0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:24.562992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c9c6a8-b351-4a53-b163-149ad034baa0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:24.563425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c9c6a8-b351-4a53-b163-149ad034baa0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:24.564130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c9c6a8-b351-4a53-b163-149ad034baa0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:24.564588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c9c6a8-b351-4a53-b163-149ad034baa0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:24.565203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59c9c6a8-b351-4a53-b163-149ad034baa0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:24.702233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59c9c6a8-b351-4a53-b163-149ad034baa0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:24.712873 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59c9c6a8-b351-4a53-b163-149ad034baa0 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.162436 Oct 29 03:46:24.713464 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3528/7102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:24 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:25.741869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1382620f-f604-4512-833d-7ed95e2587cc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:25.743093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1382620f-f604-4512-833d-7ed95e2587cc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:25.753961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1382620f-f604-4512-833d-7ed95e2587cc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:25.754444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1382620f-f604-4512-833d-7ed95e2587cc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:25.754880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1382620f-f604-4512-833d-7ed95e2587cc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:25.755542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1382620f-f604-4512-833d-7ed95e2587cc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:25.756007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1382620f-f604-4512-833d-7ed95e2587cc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:25.756426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1382620f-f604-4512-833d-7ed95e2587cc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:25.900235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1382620f-f604-4512-833d-7ed95e2587cc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:25.908630 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1382620f-f604-4512-833d-7ed95e2587cc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1515 microversion: 2.1 time: 0.174657 Oct 29 03:46:25.909222 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3575/7103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:25 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:26.931664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-046774fc-f30c-4d73-8573-1156a64e25fc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:26.932287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-046774fc-f30c-4d73-8573-1156a64e25fc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:26.939311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046774fc-f30c-4d73-8573-1156a64e25fc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:26.939814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046774fc-f30c-4d73-8573-1156a64e25fc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:26.940427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046774fc-f30c-4d73-8573-1156a64e25fc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:26.941253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046774fc-f30c-4d73-8573-1156a64e25fc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:26.941729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046774fc-f30c-4d73-8573-1156a64e25fc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:26.942198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-046774fc-f30c-4d73-8573-1156a64e25fc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:26.948623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-8dfe698d-7e4a-4453-ab97-e4c7ddc8b98c req-bbd8b1a2-2dd4-416d-be2a-8f3f8bfb4db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73d9191-3e93-4a97-a8a3-b1a2947814da", "name": "network-vif-unplugged", "status": "completed", "tag": "1d1cad7d-22b9-4b91-b41e-843232fe1b08"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:26.960149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8dfe698d-7e4a-4453-ab97-e4c7ddc8b98c req-bbd8b1a2-2dd4-416d-be2a-8f3f8bfb4db6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:26.960636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8dfe698d-7e4a-4453-ab97-e4c7ddc8b98c req-bbd8b1a2-2dd4-416d-be2a-8f3f8bfb4db6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:26.961051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8dfe698d-7e4a-4453-ab97-e4c7ddc8b98c req-bbd8b1a2-2dd4-416d-be2a-8f3f8bfb4db6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:26.974647 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-8dfe698d-7e4a-4453-ab97-e4c7ddc8b98c req-bbd8b1a2-2dd4-416d-be2a-8f3f8bfb4db6 service nova] Creating event network-vif-unplugged:1d1cad7d-22b9-4b91-b41e-843232fe1b08 for instance d73d9191-3e93-4a97-a8a3-b1a2947814da on n-h2-862964-4 Oct 29 03:46:26.985440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-8dfe698d-7e4a-4453-ab97-e4c7ddc8b98c req-bbd8b1a2-2dd4-416d-be2a-8f3f8bfb4db6 service nova] Instance d73d9191-3e93-4a97-a8a3-b1a2947814da is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:46:27.000164 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-8dfe698d-7e4a-4453-ab97-e4c7ddc8b98c req-bbd8b1a2-2dd4-416d-be2a-8f3f8bfb4db6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056071 Oct 29 03:46:27.000811 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3576/7104] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:46:27.088888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-046774fc-f30c-4d73-8573-1156a64e25fc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:27.097638 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-046774fc-f30c-4d73-8573-1156a64e25fc tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1514 microversion: 2.1 time: 0.170085 Oct 29 03:46:27.098260 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3529/7105] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:26 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:28.126895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-326f8598-4142-4b6e-bd80-8eac2b4591ac tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:28.127722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-326f8598-4142-4b6e-bd80-8eac2b4591ac tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:28.137116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-326f8598-4142-4b6e-bd80-8eac2b4591ac tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:28.137789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-326f8598-4142-4b6e-bd80-8eac2b4591ac tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:28.138494 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-326f8598-4142-4b6e-bd80-8eac2b4591ac tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:28.139454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-326f8598-4142-4b6e-bd80-8eac2b4591ac tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:28.140084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-326f8598-4142-4b6e-bd80-8eac2b4591ac tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:28.140705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-326f8598-4142-4b6e-bd80-8eac2b4591ac tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:28.290649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-326f8598-4142-4b6e-bd80-8eac2b4591ac tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:28.298652 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-326f8598-4142-4b6e-bd80-8eac2b4591ac tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1512 microversion: 2.1 time: 0.179259 Oct 29 03:46:28.299234 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3577/7106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:28 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:29.021340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-81253f8f-4b1d-4f27-a939-559b7fe807ef req-a42b4032-e0f9-4638-960d-813ed01a48f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73d9191-3e93-4a97-a8a3-b1a2947814da", "tag": "1d1cad7d-22b9-4b91-b41e-843232fe1b08"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:29.031860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-81253f8f-4b1d-4f27-a939-559b7fe807ef req-a42b4032-e0f9-4638-960d-813ed01a48f9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:29.032404 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-81253f8f-4b1d-4f27-a939-559b7fe807ef req-a42b4032-e0f9-4638-960d-813ed01a48f9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:29.033061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-81253f8f-4b1d-4f27-a939-559b7fe807ef req-a42b4032-e0f9-4638-960d-813ed01a48f9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:29.045618 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-81253f8f-4b1d-4f27-a939-559b7fe807ef req-a42b4032-e0f9-4638-960d-813ed01a48f9 service nova] Creating event network-changed:1d1cad7d-22b9-4b91-b41e-843232fe1b08 for instance d73d9191-3e93-4a97-a8a3-b1a2947814da on n-h2-862964-4 Oct 29 03:46:29.051611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-81253f8f-4b1d-4f27-a939-559b7fe807ef req-a42b4032-e0f9-4638-960d-813ed01a48f9 service nova] Instance d73d9191-3e93-4a97-a8a3-b1a2947814da is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:46:29.062590 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-81253f8f-4b1d-4f27-a939-559b7fe807ef req-a42b4032-e0f9-4638-960d-813ed01a48f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045084 Oct 29 03:46:29.063353 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3530/7107] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:46:29.323149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5cc2520c-cd41-4164-b6ec-f23d8600c2c2 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:29.323738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5cc2520c-cd41-4164-b6ec-f23d8600c2c2 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:29.331208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc2520c-cd41-4164-b6ec-f23d8600c2c2 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:29.331947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc2520c-cd41-4164-b6ec-f23d8600c2c2 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:29.332805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc2520c-cd41-4164-b6ec-f23d8600c2c2 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:29.333630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc2520c-cd41-4164-b6ec-f23d8600c2c2 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:29.334182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc2520c-cd41-4164-b6ec-f23d8600c2c2 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:29.334735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cc2520c-cd41-4164-b6ec-f23d8600c2c2 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:29.525791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5cc2520c-cd41-4164-b6ec-f23d8600c2c2 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:29.537010 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5cc2520c-cd41-4164-b6ec-f23d8600c2c2 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1512 microversion: 2.1 time: 0.217220 Oct 29 03:46:29.554799 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3578/7108] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:29 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:30.565694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5cdafbde-941c-4f5d-aadf-edb7efddf936 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:30.566602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5cdafbde-941c-4f5d-aadf-edb7efddf936 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:30.573180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5cdafbde-941c-4f5d-aadf-edb7efddf936 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:30.573667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5cdafbde-941c-4f5d-aadf-edb7efddf936 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:30.574119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5cdafbde-941c-4f5d-aadf-edb7efddf936 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:30.574839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5cdafbde-941c-4f5d-aadf-edb7efddf936 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:30.575301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5cdafbde-941c-4f5d-aadf-edb7efddf936 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:30.575726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5cdafbde-941c-4f5d-aadf-edb7efddf936 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:30.714470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5cdafbde-941c-4f5d-aadf-edb7efddf936 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:30.722332 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5cdafbde-941c-4f5d-aadf-edb7efddf936 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1509 microversion: 2.1 time: 0.162849 Oct 29 03:46:30.722989 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3531/7109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:30 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:30.745140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-599a4af9-94c5-4265-81d0-da4f89d55846 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:30.745704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-599a4af9-94c5-4265-81d0-da4f89d55846 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:30.752574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-599a4af9-94c5-4265-81d0-da4f89d55846 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:30.753231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-599a4af9-94c5-4265-81d0-da4f89d55846 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:30.753554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-599a4af9-94c5-4265-81d0-da4f89d55846 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:30.754425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-599a4af9-94c5-4265-81d0-da4f89d55846 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:30.754877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-599a4af9-94c5-4265-81d0-da4f89d55846 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:30.755295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-599a4af9-94c5-4265-81d0-da4f89d55846 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:30.781883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-599a4af9-94c5-4265-81d0-da4f89d55846 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:46:30.834617 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.compute.api [None req-599a4af9-94c5-4265-81d0-da4f89d55846 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Found an unconfirmed migration during delete, id: 16, status: finished Oct 29 03:46:32.356630 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-599a4af9-94c5-4265-81d0-da4f89d55846 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 204 len: 0 microversion: 2.1 time: 1.615091 Oct 29 03:46:32.357647 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3579/7110] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:46:30 2022] DELETE /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 0 bytes in 1617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:46:32.366343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f6e4c481-d959-4ac0-adf3-76329e80019c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:32.366999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f6e4c481-d959-4ac0-adf3-76329e80019c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:32.374169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e4c481-d959-4ac0-adf3-76329e80019c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:32.374605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e4c481-d959-4ac0-adf3-76329e80019c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:32.375050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e4c481-d959-4ac0-adf3-76329e80019c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:32.375750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e4c481-d959-4ac0-adf3-76329e80019c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:32.376211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e4c481-d959-4ac0-adf3-76329e80019c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:32.376641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f6e4c481-d959-4ac0-adf3-76329e80019c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:32.515543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f6e4c481-d959-4ac0-adf3-76329e80019c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:32.523610 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f6e4c481-d959-4ac0-adf3-76329e80019c tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1501 microversion: 2.1 time: 0.161650 Oct 29 03:46:32.524188 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3532/7111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:32 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:32.626812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-47816cf4-386f-44d5-8751-7b0b82e09eee req-df83efc2-fdc8-4a1d-be61-4fecf5d8260a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73d9191-3e93-4a97-a8a3-b1a2947814da", "name": "network-vif-plugged", "status": "completed", "tag": "1d1cad7d-22b9-4b91-b41e-843232fe1b08"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:32.637485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-47816cf4-386f-44d5-8751-7b0b82e09eee req-df83efc2-fdc8-4a1d-be61-4fecf5d8260a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:32.638325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-47816cf4-386f-44d5-8751-7b0b82e09eee req-df83efc2-fdc8-4a1d-be61-4fecf5d8260a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:32.638749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-47816cf4-386f-44d5-8751-7b0b82e09eee req-df83efc2-fdc8-4a1d-be61-4fecf5d8260a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:32.650214 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-47816cf4-386f-44d5-8751-7b0b82e09eee req-df83efc2-fdc8-4a1d-be61-4fecf5d8260a service nova] Creating event network-vif-plugged:1d1cad7d-22b9-4b91-b41e-843232fe1b08 for instance d73d9191-3e93-4a97-a8a3-b1a2947814da on n-h2-862964-4 Oct 29 03:46:32.655343 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-47816cf4-386f-44d5-8751-7b0b82e09eee req-df83efc2-fdc8-4a1d-be61-4fecf5d8260a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033234 Oct 29 03:46:32.655964 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3580/7112] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:46:33.548540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b685db93-9ea3-4beb-961d-b1c183362c85 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:33.549138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b685db93-9ea3-4beb-961d-b1c183362c85 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:33.556695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b685db93-9ea3-4beb-961d-b1c183362c85 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:33.557194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b685db93-9ea3-4beb-961d-b1c183362c85 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:33.557625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b685db93-9ea3-4beb-961d-b1c183362c85 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:33.558386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b685db93-9ea3-4beb-961d-b1c183362c85 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:33.558832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b685db93-9ea3-4beb-961d-b1c183362c85 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:33.559269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b685db93-9ea3-4beb-961d-b1c183362c85 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:33.694735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b685db93-9ea3-4beb-961d-b1c183362c85 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce61d1e5eef44ecb4f571978ec72352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657860e2093040a09e076ca960101296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:33.703317 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b685db93-9ea3-4beb-961d-b1c183362c85 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 200 len: 1501 microversion: 2.1 time: 0.158721 Oct 29 03:46:33.703904 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3533/7113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:33 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:34.279733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ea19b2b6-2fc1-410a-bc67-487d55170ed2 req-8cadb4b6-83a1-4fc3-ab74-a3aec64f6fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73d9191-3e93-4a97-a8a3-b1a2947814da", "name": "network-vif-deleted", "tag": "1d1cad7d-22b9-4b91-b41e-843232fe1b08"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:34.290286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ea19b2b6-2fc1-410a-bc67-487d55170ed2 req-8cadb4b6-83a1-4fc3-ab74-a3aec64f6fac service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:34.290756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ea19b2b6-2fc1-410a-bc67-487d55170ed2 req-8cadb4b6-83a1-4fc3-ab74-a3aec64f6fac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:34.291179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ea19b2b6-2fc1-410a-bc67-487d55170ed2 req-8cadb4b6-83a1-4fc3-ab74-a3aec64f6fac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:34.303383 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ea19b2b6-2fc1-410a-bc67-487d55170ed2 req-8cadb4b6-83a1-4fc3-ab74-a3aec64f6fac service nova] Creating event network-vif-deleted:1d1cad7d-22b9-4b91-b41e-843232fe1b08 for instance d73d9191-3e93-4a97-a8a3-b1a2947814da on n-h2-862964-4 Oct 29 03:46:34.308626 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ea19b2b6-2fc1-410a-bc67-487d55170ed2 req-8cadb4b6-83a1-4fc3-ab74-a3aec64f6fac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034547 Oct 29 03:46:34.309230 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3581/7114] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:46:34.734503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:34.735139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:34.743056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:34.743550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:34.743993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:34.744697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:34.745148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:34.745576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:34.762379 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] HTTP exception thrown: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Request method failure captured: Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da HTTP/1.1 Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKHoXP3KGp1uBTZq4JbRAS_tPo43ielviKJdC7ed60vJYHb-W0EdE4KiqisP7Rgbv3cSBdGNeY_nBTJ_DZ92Mapdr050aXgyI6K1fI81kDQTRKIBcnygbHa4bfsrgbK8jc4mG7_EO-oLZcyEIMJcvcYvG729HYlAGA_MMOFazUCVnnk Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 657860e2093040a09e076ca960101296 Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-DeleteServersTestJSON-1574166604 Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/657860e2093040a09e076ca960101296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/657860e2093040a09e076ca960101296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_657860e2093040a09e076ca960101296", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/657860e2093040a09e076ca960101296"}]}] Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-DeleteServersTestJSON-1574166604 Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 657860e2093040a09e076ca960101296 Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-DeleteServersTestJSON-1574166604 Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-DeleteServersTestJSON-1574166604-project Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9ce61d1e5eef44ecb4f571978ec72352 Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-DeleteServersTestJSON-1574166604-project Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'd73d9191-3e93-4a97-a8a3-b1a2947814da'} Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:46:34.764053 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.768104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:34.768104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:46:34.768104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:46:34.768104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:46:34.768104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:46:34.768104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.768104 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.768104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Returning 404 to user: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:46:34.768104 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f5951248-c25e-4375-9fc0-c77933cd1ccd tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 404 len: 111 microversion: 2.1 time: 0.035069 Oct 29 03:46:34.768104 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3534/7115] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:34 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:46:34.783549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:34.784124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:34.790620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:34.791035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:34.791457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:34.792134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:34.792574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:34.792988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:34.809341 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] HTTP exception thrown: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Request method failure captured: Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da HTTP/1.1 Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKHoXP3KGp1uBTZq4JbRAS_tPo43ielviKJdC7ed60vJYHb-W0EdE4KiqisP7Rgbv3cSBdGNeY_nBTJ_DZ92Mapdr050aXgyI6K1fI81kDQTRKIBcnygbHa4bfsrgbK8jc4mG7_EO-oLZcyEIMJcvcYvG729HYlAGA_MMOFazUCVnnk Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 657860e2093040a09e076ca960101296 Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-DeleteServersTestJSON-1574166604 Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/657860e2093040a09e076ca960101296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/657860e2093040a09e076ca960101296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_657860e2093040a09e076ca960101296", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/657860e2093040a09e076ca960101296"}]}] Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-DeleteServersTestJSON-1574166604 Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 657860e2093040a09e076ca960101296 Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-DeleteServersTestJSON-1574166604 Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-DeleteServersTestJSON-1574166604-project Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 9ce61d1e5eef44ecb4f571978ec72352 Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-DeleteServersTestJSON-1574166604-project Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'd73d9191-3e93-4a97-a8a3-b1a2947814da'} Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:46:34.810948 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Returning 404 to user: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8cd00d10-9d65-4869-a90b-e82a40e7da83 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 404 len: 111 microversion: 2.1 time: 0.033658 Oct 29 03:46:34.815603 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3582/7116] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:46:34 2022] DELETE /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:46:34.820896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:34.821507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] [instance: d73d9191-3e93-4a97-a8a3-b1a2947814da] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:34.827935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:34.828429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:34.828868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:34.829559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:34.830050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:34.830473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:34.844338 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] HTTP exception thrown: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Request method failure captured: Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da HTTP/1.1 Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKHoXP3KGp1uBTZq4JbRAS_tPo43ielviKJdC7ed60vJYHb-W0EdE4KiqisP7Rgbv3cSBdGNeY_nBTJ_DZ92Mapdr050aXgyI6K1fI81kDQTRKIBcnygbHa4bfsrgbK8jc4mG7_EO-oLZcyEIMJcvcYvG729HYlAGA_MMOFazUCVnnk Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 657860e2093040a09e076ca960101296 Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-DeleteServersTestJSON-1574166604 Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/657860e2093040a09e076ca960101296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/657860e2093040a09e076ca960101296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_657860e2093040a09e076ca960101296", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/657860e2093040a09e076ca960101296"}]}] Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-DeleteServersTestJSON-1574166604 Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 657860e2093040a09e076ca960101296 Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-DeleteServersTestJSON-1574166604 Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-DeleteServersTestJSON-1574166604-project Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 9ce61d1e5eef44ecb4f571978ec72352 Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-DeleteServersTestJSON-1574166604-project Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'd73d9191-3e93-4a97-a8a3-b1a2947814da'} Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:46:34.845942 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.850893 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:34.850893 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:46:34.850893 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:46:34.850893 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:46:34.850893 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:46:34.850893 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. Oct 29 03:46:34.850893 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:46:34.850893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] Returning 404 to user: Instance d73d9191-3e93-4a97-a8a3-b1a2947814da could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:46:34.850893 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c57bdb4-a54e-4b0f-8383-4b8998a0bb27 tempest-DeleteServersTestJSON-1574166604 tempest-DeleteServersTestJSON-1574166604-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da" status: 404 len: 111 microversion: 2.1 time: 0.030318 Oct 29 03:46:34.850893 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3535/7117] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:34 2022] GET /compute/v2.1/servers/d73d9191-3e93-4a97-a8a3-b1a2947814da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:46:43.666588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1780615626", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "ff7ab03d-c37e-43b0-a321-a1e718623bd3"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:43.723621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] validate_networks() for [('ff7ab03d-c37e-43b0-a321-a1e718623bd3', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:46:44.416232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:46:44.416951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:46:44.417502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:46:44.418051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:46:44.418523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:46:44.428386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:44.428866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:44.429548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:44.430044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:44.430529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:44.430943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:44.449425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Getting quotas for project 676879256318463780dd131db996c8f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:46:44.454917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Getting quotas for user 20c5f53b760d49bf81a9377773210a24 and project 676879256318463780dd131db996c8f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:46:44.468013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:46:44.470436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:46:44.517617 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-abf317b1-2c9a-47f5-8152-a01580a30a8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.973684 Oct 29 03:46:44.518231 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3583/7118] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:46:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:46:44.529771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-71c15bb4-cc05-4206-b1b2-435e4edecd77 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:44.530426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-71c15bb4-cc05-4206-b1b2-435e4edecd77 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:44.591388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-71c15bb4-cc05-4206-b1b2-435e4edecd77 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:44.600251 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-71c15bb4-cc05-4206-b1b2-435e4edecd77 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1218 microversion: 2.1 time: 0.074517 Oct 29 03:46:44.601117 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3536/7119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:44 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:46:45.626304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-39668b86-4793-49ad-b801-bf19c6b764ec tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:45.627069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-39668b86-4793-49ad-b801-bf19c6b764ec tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:45.634319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39668b86-4793-49ad-b801-bf19c6b764ec tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:45.634797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39668b86-4793-49ad-b801-bf19c6b764ec tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:45.635528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39668b86-4793-49ad-b801-bf19c6b764ec tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:45.636238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39668b86-4793-49ad-b801-bf19c6b764ec tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:45.636660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39668b86-4793-49ad-b801-bf19c6b764ec tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:45.637406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39668b86-4793-49ad-b801-bf19c6b764ec tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:45.725777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-39668b86-4793-49ad-b801-bf19c6b764ec tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:45.744759 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-39668b86-4793-49ad-b801-bf19c6b764ec tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1270 microversion: 2.1 time: 0.124736 Oct 29 03:46:45.758059 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3584/7120] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:45 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1270 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:46.769640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ad9ced7-eefb-42dd-b797-a8eb5b22110c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:46.770530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ad9ced7-eefb-42dd-b797-a8eb5b22110c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:46.772776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=49 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:46.780007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ad9ced7-eefb-42dd-b797-a8eb5b22110c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:46.780503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ad9ced7-eefb-42dd-b797-a8eb5b22110c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:46.780960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ad9ced7-eefb-42dd-b797-a8eb5b22110c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:46.781657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ad9ced7-eefb-42dd-b797-a8eb5b22110c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:46.782156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ad9ced7-eefb-42dd-b797-a8eb5b22110c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:46.782592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ad9ced7-eefb-42dd-b797-a8eb5b22110c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:47.028248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ad9ced7-eefb-42dd-b797-a8eb5b22110c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:47.037486 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ad9ced7-eefb-42dd-b797-a8eb5b22110c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1318 microversion: 2.1 time: 0.272234 Oct 29 03:46:47.038229 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3537/7121] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:46 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:47.344275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-8c257bd6-bb60-4e7a-a693-739f57bfe08e req-6cda3df4-8102-4f9e-9606-b6967c209e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4832b8d3-9285-48e8-86b0-13f43735488f", "tag": "8ae77169-cdf9-409a-abaa-bfacb5fb6f53"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:47.356502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8c257bd6-bb60-4e7a-a693-739f57bfe08e req-6cda3df4-8102-4f9e-9606-b6967c209e45 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:47.357070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8c257bd6-bb60-4e7a-a693-739f57bfe08e req-6cda3df4-8102-4f9e-9606-b6967c209e45 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:47.357569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8c257bd6-bb60-4e7a-a693-739f57bfe08e req-6cda3df4-8102-4f9e-9606-b6967c209e45 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:47.369172 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-8c257bd6-bb60-4e7a-a693-739f57bfe08e req-6cda3df4-8102-4f9e-9606-b6967c209e45 service nova] Creating event network-changed:8ae77169-cdf9-409a-abaa-bfacb5fb6f53 for instance 4832b8d3-9285-48e8-86b0-13f43735488f on n-h1-862964-4 Oct 29 03:46:47.374968 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-8c257bd6-bb60-4e7a-a693-739f57bfe08e req-6cda3df4-8102-4f9e-9606-b6967c209e45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035055 Oct 29 03:46:47.375770 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3585/7122] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:46:48.065888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d2da37b3-dcc7-4bc2-a9d5-95a9a51a230a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:48.067472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d2da37b3-dcc7-4bc2-a9d5-95a9a51a230a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:48.074941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2da37b3-dcc7-4bc2-a9d5-95a9a51a230a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:48.075441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2da37b3-dcc7-4bc2-a9d5-95a9a51a230a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:48.075888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2da37b3-dcc7-4bc2-a9d5-95a9a51a230a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:48.076597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2da37b3-dcc7-4bc2-a9d5-95a9a51a230a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:48.077086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2da37b3-dcc7-4bc2-a9d5-95a9a51a230a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:48.077520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2da37b3-dcc7-4bc2-a9d5-95a9a51a230a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:48.214859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d2da37b3-dcc7-4bc2-a9d5-95a9a51a230a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:48.223079 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d2da37b3-dcc7-4bc2-a9d5-95a9a51a230a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1318 microversion: 2.1 time: 0.163629 Oct 29 03:46:48.223592 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3538/7123] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:48 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:49.251510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-566b7476-1381-4e41-8976-db5abe513b68 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:49.252681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-566b7476-1381-4e41-8976-db5abe513b68 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:49.264480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-566b7476-1381-4e41-8976-db5abe513b68 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:49.265278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-566b7476-1381-4e41-8976-db5abe513b68 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:49.266045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-566b7476-1381-4e41-8976-db5abe513b68 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:49.267176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-566b7476-1381-4e41-8976-db5abe513b68 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:49.267921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-566b7476-1381-4e41-8976-db5abe513b68 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:49.268614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-566b7476-1381-4e41-8976-db5abe513b68 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:49.406746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-566b7476-1381-4e41-8976-db5abe513b68 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:49.415161 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-566b7476-1381-4e41-8976-db5abe513b68 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1318 microversion: 2.1 time: 0.170746 Oct 29 03:46:49.415739 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3586/7124] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:49 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:50.450629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6bf8ed96-7456-4e96-9de4-53888954b396 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:50.451600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6bf8ed96-7456-4e96-9de4-53888954b396 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:50.456199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=28 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:50.465553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf8ed96-7456-4e96-9de4-53888954b396 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:50.466427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf8ed96-7456-4e96-9de4-53888954b396 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:50.467168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf8ed96-7456-4e96-9de4-53888954b396 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:50.468332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf8ed96-7456-4e96-9de4-53888954b396 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:50.469105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf8ed96-7456-4e96-9de4-53888954b396 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:50.469859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6bf8ed96-7456-4e96-9de4-53888954b396 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:50.607938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6bf8ed96-7456-4e96-9de4-53888954b396 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:50.616461 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6bf8ed96-7456-4e96-9de4-53888954b396 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1318 microversion: 2.1 time: 0.172385 Oct 29 03:46:50.617042 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3539/7125] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:50 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:51.640221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f1dba9f-b4a8-454a-b94b-62e3095737b0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:51.640960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f1dba9f-b4a8-454a-b94b-62e3095737b0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:51.644014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:51.649854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1dba9f-b4a8-454a-b94b-62e3095737b0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:51.650428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1dba9f-b4a8-454a-b94b-62e3095737b0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:51.650901 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1dba9f-b4a8-454a-b94b-62e3095737b0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:51.651650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1dba9f-b4a8-454a-b94b-62e3095737b0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:51.652142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1dba9f-b4a8-454a-b94b-62e3095737b0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:51.652603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f1dba9f-b4a8-454a-b94b-62e3095737b0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:51.656267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:51.792118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8f1dba9f-b4a8-454a-b94b-62e3095737b0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:51.803858 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f1dba9f-b4a8-454a-b94b-62e3095737b0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1318 microversion: 2.1 time: 0.167640 Oct 29 03:46:51.804648 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3587/7126] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:51 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:52.827233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ff97355-3926-4663-acc5-b29372e20b17 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:52.827853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9ff97355-3926-4663-acc5-b29372e20b17 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:52.835004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff97355-3926-4663-acc5-b29372e20b17 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:52.835611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff97355-3926-4663-acc5-b29372e20b17 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:52.836079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff97355-3926-4663-acc5-b29372e20b17 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:52.836759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff97355-3926-4663-acc5-b29372e20b17 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:52.837259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff97355-3926-4663-acc5-b29372e20b17 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:52.837690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff97355-3926-4663-acc5-b29372e20b17 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:52.972600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ff97355-3926-4663-acc5-b29372e20b17 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:52.980877 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ff97355-3926-4663-acc5-b29372e20b17 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1318 microversion: 2.1 time: 0.157681 Oct 29 03:46:52.981456 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3540/7127] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:52 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:53.352401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-1e49cf36-edde-480c-a0f8-610a9718599b req-fc6c5735-3456-4bc5-9b4e-0d3caacd0c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4832b8d3-9285-48e8-86b0-13f43735488f", "name": "network-vif-plugged", "status": "completed", "tag": "8ae77169-cdf9-409a-abaa-bfacb5fb6f53"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:53.363007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1e49cf36-edde-480c-a0f8-610a9718599b req-fc6c5735-3456-4bc5-9b4e-0d3caacd0c97 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:53.363815 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1e49cf36-edde-480c-a0f8-610a9718599b req-fc6c5735-3456-4bc5-9b4e-0d3caacd0c97 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:53.364209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1e49cf36-edde-480c-a0f8-610a9718599b req-fc6c5735-3456-4bc5-9b4e-0d3caacd0c97 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:53.376335 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1e49cf36-edde-480c-a0f8-610a9718599b req-fc6c5735-3456-4bc5-9b4e-0d3caacd0c97 service nova] Creating event network-vif-plugged:8ae77169-cdf9-409a-abaa-bfacb5fb6f53 for instance 4832b8d3-9285-48e8-86b0-13f43735488f on n-h1-862964-4 Oct 29 03:46:53.381482 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-1e49cf36-edde-480c-a0f8-610a9718599b req-fc6c5735-3456-4bc5-9b4e-0d3caacd0c97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032953 Oct 29 03:46:53.382216 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3588/7128] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:46:54.004880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7aa0b0cb-5cd0-4f18-91fe-937ff87254c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:54.005535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7aa0b0cb-5cd0-4f18-91fe-937ff87254c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:54.013562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0cb-5cd0-4f18-91fe-937ff87254c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:54.014096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0cb-5cd0-4f18-91fe-937ff87254c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:54.014542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0cb-5cd0-4f18-91fe-937ff87254c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:54.015249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0cb-5cd0-4f18-91fe-937ff87254c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:54.015718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0cb-5cd0-4f18-91fe-937ff87254c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:54.016148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0cb-5cd0-4f18-91fe-937ff87254c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:54.155667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7aa0b0cb-5cd0-4f18-91fe-937ff87254c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:54.163834 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7aa0b0cb-5cd0-4f18-91fe-937ff87254c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1318 microversion: 2.1 time: 0.163051 Oct 29 03:46:54.164410 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3541/7129] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:53 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:55.196577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:55.197853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:55.204656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2529e089-5576-4500-b607-933a26ba377f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:55.205826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2529e089-5576-4500-b607-933a26ba377f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:55.214942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529e089-5576-4500-b607-933a26ba377f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.215417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529e089-5576-4500-b607-933a26ba377f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.215846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529e089-5576-4500-b607-933a26ba377f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:55.216508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529e089-5576-4500-b607-933a26ba377f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.216954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529e089-5576-4500-b607-933a26ba377f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.217367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2529e089-5576-4500-b607-933a26ba377f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:55.359580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2529e089-5576-4500-b607-933a26ba377f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:55.368355 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2529e089-5576-4500-b607-933a26ba377f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1507 microversion: 2.1 time: 0.175270 Oct 29 03:46:55.368940 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3589/7130] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:55 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:55.391076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aae4b051-536e-4a02-9950-bd922adc2f45 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:55.391723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aae4b051-536e-4a02-9950-bd922adc2f45 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:55.393666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:55.399920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae4b051-536e-4a02-9950-bd922adc2f45 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.400420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae4b051-536e-4a02-9950-bd922adc2f45 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.400866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae4b051-536e-4a02-9950-bd922adc2f45 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:55.401560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae4b051-536e-4a02-9950-bd922adc2f45 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.402045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae4b051-536e-4a02-9950-bd922adc2f45 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.402477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aae4b051-536e-4a02-9950-bd922adc2f45 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:55.543562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-aae4b051-536e-4a02-9950-bd922adc2f45 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:55.553156 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aae4b051-536e-4a02-9950-bd922adc2f45 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1507 microversion: 2.1 time: 0.165875 Oct 29 03:46:55.553727 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3542/7131] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:55 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:55.575871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40e44200-cf62-4480-8758-fa1f8e724787 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:55.578282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40e44200-cf62-4480-8758-fa1f8e724787 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:55.584463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e44200-cf62-4480-8758-fa1f8e724787 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.584937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e44200-cf62-4480-8758-fa1f8e724787 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.585440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e44200-cf62-4480-8758-fa1f8e724787 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:55.586158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e44200-cf62-4480-8758-fa1f8e724787 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.586605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e44200-cf62-4480-8758-fa1f8e724787 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.587014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40e44200-cf62-4480-8758-fa1f8e724787 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:55.654360 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40e44200-cf62-4480-8758-fa1f8e724787 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "PUT /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1079 microversion: 2.1 time: 0.082451 Oct 29 03:46:55.655009 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3590/7132] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 03:46:55 2022] PUT /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1079 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:46:55.673631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-294ca9c0-5ea2-4833-b1a1-b1522084dcbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:55.674275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-294ca9c0-5ea2-4833-b1a1-b1522084dcbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:55.680910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294ca9c0-5ea2-4833-b1a1-b1522084dcbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.681409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294ca9c0-5ea2-4833-b1a1-b1522084dcbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.681922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294ca9c0-5ea2-4833-b1a1-b1522084dcbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:55.682615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294ca9c0-5ea2-4833-b1a1-b1522084dcbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.683069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294ca9c0-5ea2-4833-b1a1-b1522084dcbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.683495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-294ca9c0-5ea2-4833-b1a1-b1522084dcbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:55.827536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-294ca9c0-5ea2-4833-b1a1-b1522084dcbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:55.835787 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-294ca9c0-5ea2-4833-b1a1-b1522084dcbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1505 microversion: 2.1 time: 0.166083 Oct 29 03:46:55.836364 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3543/7133] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:55 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:55.857831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8e25ffc9-e1d5-4cb8-8c4d-891a991801be tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:55.858436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8e25ffc9-e1d5-4cb8-8c4d-891a991801be tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:55.865208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e25ffc9-e1d5-4cb8-8c4d-891a991801be tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.865683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e25ffc9-e1d5-4cb8-8c4d-891a991801be tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.866139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e25ffc9-e1d5-4cb8-8c4d-891a991801be tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:55.866880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e25ffc9-e1d5-4cb8-8c4d-891a991801be tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.867327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e25ffc9-e1d5-4cb8-8c4d-891a991801be tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.867724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8e25ffc9-e1d5-4cb8-8c4d-891a991801be tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:56.010635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8e25ffc9-e1d5-4cb8-8c4d-891a991801be tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:56.018819 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8e25ffc9-e1d5-4cb8-8c4d-891a991801be tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1505 microversion: 2.1 time: 0.164954 Oct 29 03:46:56.019370 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3591/7134] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:55 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:56.041038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:56.043485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:56.050051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:56.050547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:56.050992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:56.051693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:56.052159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:56.052593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:56.082669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:56.088405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Old instance type m1.heat2, new instance type m1.heat {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:46:56.095379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:46:56.095801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:46:56.096309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:46:56.096697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:46:56.097113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:46:56.168902 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7be10503-3d98-4d51-ac57-63f418d88247 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "POST /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f/action" status: 202 len: 0 microversion: 2.1 time: 0.131958 Oct 29 03:46:56.169541 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3544/7135] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:46:56 2022] POST /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:46:56.177825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c3632407-9539-4318-9a13-a40127ae5861 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:56.178461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c3632407-9539-4318-9a13-a40127ae5861 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:56.184648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3632407-9539-4318-9a13-a40127ae5861 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:56.185581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3632407-9539-4318-9a13-a40127ae5861 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:56.185581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3632407-9539-4318-9a13-a40127ae5861 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:56.186267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3632407-9539-4318-9a13-a40127ae5861 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:56.186714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3632407-9539-4318-9a13-a40127ae5861 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:56.187127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3632407-9539-4318-9a13-a40127ae5861 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:56.345656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c3632407-9539-4318-9a13-a40127ae5861 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:56.353448 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c3632407-9539-4318-9a13-a40127ae5861 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1516 microversion: 2.1 time: 0.179565 Oct 29 03:46:56.354190 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3592/7136] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:56 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:57.382082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2d11d205-8ab0-4a4f-a1bc-949ba60302c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:57.383264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2d11d205-8ab0-4a4f-a1bc-949ba60302c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:57.394168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d11d205-8ab0-4a4f-a1bc-949ba60302c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:57.394928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d11d205-8ab0-4a4f-a1bc-949ba60302c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:57.395611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d11d205-8ab0-4a4f-a1bc-949ba60302c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:57.396829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d11d205-8ab0-4a4f-a1bc-949ba60302c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:57.397545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d11d205-8ab0-4a4f-a1bc-949ba60302c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:57.398309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d11d205-8ab0-4a4f-a1bc-949ba60302c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:57.571383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2d11d205-8ab0-4a4f-a1bc-949ba60302c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:57.579703 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2d11d205-8ab0-4a4f-a1bc-949ba60302c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1516 microversion: 2.1 time: 0.205057 Oct 29 03:46:57.580283 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3545/7137] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:57 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1516 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:58.604959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-19344d39-88a8-495e-be3d-d9a4e1ff4749 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:58.605563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-19344d39-88a8-495e-be3d-d9a4e1ff4749 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:58.612597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19344d39-88a8-495e-be3d-d9a4e1ff4749 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:58.613081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19344d39-88a8-495e-be3d-d9a4e1ff4749 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:58.613846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19344d39-88a8-495e-be3d-d9a4e1ff4749 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:58.614568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19344d39-88a8-495e-be3d-d9a4e1ff4749 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:58.615011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19344d39-88a8-495e-be3d-d9a4e1ff4749 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:58.615423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-19344d39-88a8-495e-be3d-d9a4e1ff4749 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:58.761056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-19344d39-88a8-495e-be3d-d9a4e1ff4749 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:58.769530 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-19344d39-88a8-495e-be3d-d9a4e1ff4749 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.169600 Oct 29 03:46:58.770135 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3593/7138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:58 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:59.795241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-845f670c-0195-4b6d-bd87-1d8a75fd18fa tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:59.795889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-845f670c-0195-4b6d-bd87-1d8a75fd18fa tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:59.803125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845f670c-0195-4b6d-bd87-1d8a75fd18fa tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:59.803614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845f670c-0195-4b6d-bd87-1d8a75fd18fa tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:59.804055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845f670c-0195-4b6d-bd87-1d8a75fd18fa tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:59.804752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845f670c-0195-4b6d-bd87-1d8a75fd18fa tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:59.805211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845f670c-0195-4b6d-bd87-1d8a75fd18fa tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:59.805635 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-845f670c-0195-4b6d-bd87-1d8a75fd18fa tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:59.942643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-845f670c-0195-4b6d-bd87-1d8a75fd18fa tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:59.950816 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-845f670c-0195-4b6d-bd87-1d8a75fd18fa tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.159439 Oct 29 03:46:59.951438 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3546/7139] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:59 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:00.974823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c8cfcd68-4dd1-4b2a-bb38-871cf865defb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:00.975421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c8cfcd68-4dd1-4b2a-bb38-871cf865defb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:00.983049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8cfcd68-4dd1-4b2a-bb38-871cf865defb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:00.983526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8cfcd68-4dd1-4b2a-bb38-871cf865defb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:00.983952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8cfcd68-4dd1-4b2a-bb38-871cf865defb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:00.984638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8cfcd68-4dd1-4b2a-bb38-871cf865defb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:00.985080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8cfcd68-4dd1-4b2a-bb38-871cf865defb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:00.985491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8cfcd68-4dd1-4b2a-bb38-871cf865defb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:01.120163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c8cfcd68-4dd1-4b2a-bb38-871cf865defb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:01.128607 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c8cfcd68-4dd1-4b2a-bb38-871cf865defb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.157760 Oct 29 03:47:01.129190 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3594/7140] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:00 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:02.155895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-922cbb84-0ffa-4990-a6c6-7c3f2aa86656 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:02.156941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-922cbb84-0ffa-4990-a6c6-7c3f2aa86656 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:02.167735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-922cbb84-0ffa-4990-a6c6-7c3f2aa86656 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:02.168196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-922cbb84-0ffa-4990-a6c6-7c3f2aa86656 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:02.168641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-922cbb84-0ffa-4990-a6c6-7c3f2aa86656 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:02.169390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-922cbb84-0ffa-4990-a6c6-7c3f2aa86656 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:02.169906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-922cbb84-0ffa-4990-a6c6-7c3f2aa86656 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:02.170341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-922cbb84-0ffa-4990-a6c6-7c3f2aa86656 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:02.306720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-922cbb84-0ffa-4990-a6c6-7c3f2aa86656 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:02.318905 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-922cbb84-0ffa-4990-a6c6-7c3f2aa86656 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.169600 Oct 29 03:47:02.319715 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3547/7141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:02 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:03.346848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8997a1aa-5fe0-49d6-a286-9fe5a80e9d8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:03.347877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8997a1aa-5fe0-49d6-a286-9fe5a80e9d8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:03.359667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8997a1aa-5fe0-49d6-a286-9fe5a80e9d8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:03.360475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8997a1aa-5fe0-49d6-a286-9fe5a80e9d8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:03.361186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8997a1aa-5fe0-49d6-a286-9fe5a80e9d8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:03.362378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8997a1aa-5fe0-49d6-a286-9fe5a80e9d8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:03.363491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8997a1aa-5fe0-49d6-a286-9fe5a80e9d8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:03.364261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8997a1aa-5fe0-49d6-a286-9fe5a80e9d8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:03.501851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8997a1aa-5fe0-49d6-a286-9fe5a80e9d8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:03.512835 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8997a1aa-5fe0-49d6-a286-9fe5a80e9d8b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.172609 Oct 29 03:47:03.513421 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3595/7142] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:03 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:04.540452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ca17e17-2f3c-4e3e-a8f8-29ad7d96bccd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:04.541475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2ca17e17-2f3c-4e3e-a8f8-29ad7d96bccd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:04.549660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ca17e17-2f3c-4e3e-a8f8-29ad7d96bccd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:04.550418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ca17e17-2f3c-4e3e-a8f8-29ad7d96bccd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:04.550865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ca17e17-2f3c-4e3e-a8f8-29ad7d96bccd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:04.551572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ca17e17-2f3c-4e3e-a8f8-29ad7d96bccd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:04.552040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ca17e17-2f3c-4e3e-a8f8-29ad7d96bccd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:04.552462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ca17e17-2f3c-4e3e-a8f8-29ad7d96bccd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:04.694463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2ca17e17-2f3c-4e3e-a8f8-29ad7d96bccd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:04.705600 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ca17e17-2f3c-4e3e-a8f8-29ad7d96bccd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.171690 Oct 29 03:47:04.706484 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3548/7143] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:04 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:05.735456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c2d143d-ef13-47a1-b4bd-795ad3048e70 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:05.736205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c2d143d-ef13-47a1-b4bd-795ad3048e70 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:05.745578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c2d143d-ef13-47a1-b4bd-795ad3048e70 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:05.746222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c2d143d-ef13-47a1-b4bd-795ad3048e70 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:05.746827 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c2d143d-ef13-47a1-b4bd-795ad3048e70 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:05.747696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c2d143d-ef13-47a1-b4bd-795ad3048e70 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:05.748254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c2d143d-ef13-47a1-b4bd-795ad3048e70 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:05.748783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c2d143d-ef13-47a1-b4bd-795ad3048e70 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:05.894704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c2d143d-ef13-47a1-b4bd-795ad3048e70 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:05.907450 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c2d143d-ef13-47a1-b4bd-795ad3048e70 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.177325 Oct 29 03:47:05.908243 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3596/7144] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:05 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:06.938600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-179c91f8-43b9-4c71-9417-70af8a082693 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:06.939206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-179c91f8-43b9-4c71-9417-70af8a082693 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:06.946069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-179c91f8-43b9-4c71-9417-70af8a082693 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:06.946554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-179c91f8-43b9-4c71-9417-70af8a082693 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:06.946991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-179c91f8-43b9-4c71-9417-70af8a082693 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:06.947708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-179c91f8-43b9-4c71-9417-70af8a082693 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:06.948150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-179c91f8-43b9-4c71-9417-70af8a082693 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:06.948575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-179c91f8-43b9-4c71-9417-70af8a082693 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:07.080931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-179c91f8-43b9-4c71-9417-70af8a082693 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:07.089096 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-179c91f8-43b9-4c71-9417-70af8a082693 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.156690 Oct 29 03:47:07.089596 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3549/7145] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:06 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:47:08.112418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c1bb81a-8e5c-481e-b86c-6a946bb16a39 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:08.113037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9c1bb81a-8e5c-481e-b86c-6a946bb16a39 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:08.121084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c1bb81a-8e5c-481e-b86c-6a946bb16a39 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:08.121608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c1bb81a-8e5c-481e-b86c-6a946bb16a39 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:08.122047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c1bb81a-8e5c-481e-b86c-6a946bb16a39 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:08.122795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c1bb81a-8e5c-481e-b86c-6a946bb16a39 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:08.123235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c1bb81a-8e5c-481e-b86c-6a946bb16a39 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:08.123748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c1bb81a-8e5c-481e-b86c-6a946bb16a39 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:08.266392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9c1bb81a-8e5c-481e-b86c-6a946bb16a39 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:08.274414 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c1bb81a-8e5c-481e-b86c-6a946bb16a39 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.166172 Oct 29 03:47:08.275195 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3597/7146] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:08 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:09.302351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-acf89f16-ccbb-4925-841d-f4260f0c2b27 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:09.303170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-acf89f16-ccbb-4925-841d-f4260f0c2b27 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:09.313474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acf89f16-ccbb-4925-841d-f4260f0c2b27 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:09.314000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acf89f16-ccbb-4925-841d-f4260f0c2b27 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:09.314452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acf89f16-ccbb-4925-841d-f4260f0c2b27 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:09.315144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acf89f16-ccbb-4925-841d-f4260f0c2b27 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:09.315599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acf89f16-ccbb-4925-841d-f4260f0c2b27 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:09.316028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-acf89f16-ccbb-4925-841d-f4260f0c2b27 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:09.455177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-acf89f16-ccbb-4925-841d-f4260f0c2b27 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:09.466858 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-acf89f16-ccbb-4925-841d-f4260f0c2b27 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.170936 Oct 29 03:47:09.467817 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3550/7147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:09 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:10.495742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8fc1d1b4-f9d8-4cd9-b4b7-28ac094d737a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:10.496681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8fc1d1b4-f9d8-4cd9-b4b7-28ac094d737a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:10.504846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc1d1b4-f9d8-4cd9-b4b7-28ac094d737a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:10.505325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc1d1b4-f9d8-4cd9-b4b7-28ac094d737a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:10.505746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc1d1b4-f9d8-4cd9-b4b7-28ac094d737a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:10.506475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc1d1b4-f9d8-4cd9-b4b7-28ac094d737a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:10.506922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc1d1b4-f9d8-4cd9-b4b7-28ac094d737a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:10.507331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fc1d1b4-f9d8-4cd9-b4b7-28ac094d737a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:10.654022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8fc1d1b4-f9d8-4cd9-b4b7-28ac094d737a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:10.662182 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8fc1d1b4-f9d8-4cd9-b4b7-28ac094d737a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.173635 Oct 29 03:47:10.662751 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3598/7148] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:10 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:11.690557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1c75aa21-e778-4ea7-8302-86ab9e2551ce tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:11.691587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1c75aa21-e778-4ea7-8302-86ab9e2551ce tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:11.702679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c75aa21-e778-4ea7-8302-86ab9e2551ce tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:11.703171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c75aa21-e778-4ea7-8302-86ab9e2551ce tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:11.703619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c75aa21-e778-4ea7-8302-86ab9e2551ce tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:11.704328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c75aa21-e778-4ea7-8302-86ab9e2551ce tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:11.704788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c75aa21-e778-4ea7-8302-86ab9e2551ce tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:11.705223 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1c75aa21-e778-4ea7-8302-86ab9e2551ce tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:11.840075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1c75aa21-e778-4ea7-8302-86ab9e2551ce tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:11.852268 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1c75aa21-e778-4ea7-8302-86ab9e2551ce tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.168256 Oct 29 03:47:11.853048 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3551/7149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:11 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:12.882382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-47219b45-09fe-4451-b225-6f35c15d5914 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:12.883230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-47219b45-09fe-4451-b225-6f35c15d5914 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:12.895395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47219b45-09fe-4451-b225-6f35c15d5914 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:12.896209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47219b45-09fe-4451-b225-6f35c15d5914 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:12.896928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47219b45-09fe-4451-b225-6f35c15d5914 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:12.898146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47219b45-09fe-4451-b225-6f35c15d5914 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:12.898902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47219b45-09fe-4451-b225-6f35c15d5914 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:12.899626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47219b45-09fe-4451-b225-6f35c15d5914 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:13.043661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-47219b45-09fe-4451-b225-6f35c15d5914 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:13.055935 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-47219b45-09fe-4451-b225-6f35c15d5914 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.180095 Oct 29 03:47:13.056675 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3599/7150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:12 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:14.083591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-466868bb-7d1a-4117-8917-7162d5bdab21 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:14.084422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-466868bb-7d1a-4117-8917-7162d5bdab21 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:14.094361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-466868bb-7d1a-4117-8917-7162d5bdab21 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:14.095043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-466868bb-7d1a-4117-8917-7162d5bdab21 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:14.095638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-466868bb-7d1a-4117-8917-7162d5bdab21 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:14.096582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-466868bb-7d1a-4117-8917-7162d5bdab21 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:14.097208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-466868bb-7d1a-4117-8917-7162d5bdab21 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:14.097796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-466868bb-7d1a-4117-8917-7162d5bdab21 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:14.103313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:14.248992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-466868bb-7d1a-4117-8917-7162d5bdab21 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:14.259805 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-466868bb-7d1a-4117-8917-7162d5bdab21 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.181861 Oct 29 03:47:14.260386 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3552/7151] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:14 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:15.294716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e92fe36e-1c02-4efb-8e9a-36335c7e1831 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:15.295675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e92fe36e-1c02-4efb-8e9a-36335c7e1831 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:15.307255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92fe36e-1c02-4efb-8e9a-36335c7e1831 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:15.308048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92fe36e-1c02-4efb-8e9a-36335c7e1831 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:15.308757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92fe36e-1c02-4efb-8e9a-36335c7e1831 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:15.310098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92fe36e-1c02-4efb-8e9a-36335c7e1831 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:15.310842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92fe36e-1c02-4efb-8e9a-36335c7e1831 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:15.311537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e92fe36e-1c02-4efb-8e9a-36335c7e1831 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:15.455070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e92fe36e-1c02-4efb-8e9a-36335c7e1831 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:15.464212 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e92fe36e-1c02-4efb-8e9a-36335c7e1831 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.176177 Oct 29 03:47:15.468939 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3600/7152] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:15 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:16.490008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3bb73a78-21d4-4fb0-a256-c2826337013b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:16.490848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3bb73a78-21d4-4fb0-a256-c2826337013b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:16.500118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb73a78-21d4-4fb0-a256-c2826337013b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:16.500607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb73a78-21d4-4fb0-a256-c2826337013b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:16.501045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb73a78-21d4-4fb0-a256-c2826337013b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:16.501747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb73a78-21d4-4fb0-a256-c2826337013b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:16.502287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb73a78-21d4-4fb0-a256-c2826337013b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:16.502747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb73a78-21d4-4fb0-a256-c2826337013b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:16.659927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3bb73a78-21d4-4fb0-a256-c2826337013b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:16.668425 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3bb73a78-21d4-4fb0-a256-c2826337013b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.184066 Oct 29 03:47:16.669010 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3553/7153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:16 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:17.697292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20d20279-e795-4a27-981e-7a45f2726a4b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:17.697930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-20d20279-e795-4a27-981e-7a45f2726a4b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:17.705735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20d20279-e795-4a27-981e-7a45f2726a4b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:17.706247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20d20279-e795-4a27-981e-7a45f2726a4b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:17.706665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20d20279-e795-4a27-981e-7a45f2726a4b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:17.707357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20d20279-e795-4a27-981e-7a45f2726a4b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:17.707799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20d20279-e795-4a27-981e-7a45f2726a4b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:17.708209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20d20279-e795-4a27-981e-7a45f2726a4b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:17.853556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20d20279-e795-4a27-981e-7a45f2726a4b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:17.864142 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20d20279-e795-4a27-981e-7a45f2726a4b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.170996 Oct 29 03:47:17.864759 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3601/7154] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:17 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:18.892233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f659e85-7ad8-4bfb-895a-1f49d1430b32 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:18.893103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f659e85-7ad8-4bfb-895a-1f49d1430b32 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:18.904829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f659e85-7ad8-4bfb-895a-1f49d1430b32 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:18.905642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f659e85-7ad8-4bfb-895a-1f49d1430b32 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:18.906418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f659e85-7ad8-4bfb-895a-1f49d1430b32 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:18.907470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f659e85-7ad8-4bfb-895a-1f49d1430b32 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:18.907932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f659e85-7ad8-4bfb-895a-1f49d1430b32 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:18.908364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f659e85-7ad8-4bfb-895a-1f49d1430b32 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:19.055569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8f659e85-7ad8-4bfb-895a-1f49d1430b32 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:19.064106 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f659e85-7ad8-4bfb-895a-1f49d1430b32 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.178797 Oct 29 03:47:19.064707 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3554/7155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:18 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:20.091719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-86d8041e-ad50-4b46-a2f1-ccbd2578ffd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:20.092585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-86d8041e-ad50-4b46-a2f1-ccbd2578ffd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:20.103849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86d8041e-ad50-4b46-a2f1-ccbd2578ffd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:20.104605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86d8041e-ad50-4b46-a2f1-ccbd2578ffd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:20.105270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86d8041e-ad50-4b46-a2f1-ccbd2578ffd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:20.106428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86d8041e-ad50-4b46-a2f1-ccbd2578ffd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:20.107120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86d8041e-ad50-4b46-a2f1-ccbd2578ffd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:20.107767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-86d8041e-ad50-4b46-a2f1-ccbd2578ffd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:20.271877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-86d8041e-ad50-4b46-a2f1-ccbd2578ffd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:20.280320 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-86d8041e-ad50-4b46-a2f1-ccbd2578ffd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.195345 Oct 29 03:47:20.280927 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3602/7156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:20 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:21.307555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ea4f6127-10cb-4cb4-97a6-aac891911cf3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:21.308658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ea4f6127-10cb-4cb4-97a6-aac891911cf3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:21.313086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=36 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:21.322287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea4f6127-10cb-4cb4-97a6-aac891911cf3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:21.323106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea4f6127-10cb-4cb4-97a6-aac891911cf3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:21.323847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea4f6127-10cb-4cb4-97a6-aac891911cf3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:21.325012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea4f6127-10cb-4cb4-97a6-aac891911cf3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:21.325779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea4f6127-10cb-4cb4-97a6-aac891911cf3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:21.326543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea4f6127-10cb-4cb4-97a6-aac891911cf3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:21.466080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ea4f6127-10cb-4cb4-97a6-aac891911cf3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:21.474548 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ea4f6127-10cb-4cb4-97a6-aac891911cf3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.173640 Oct 29 03:47:21.475215 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3555/7157] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:21 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:22.499090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0116c934-3011-495d-a63a-a287b69cc485 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:22.499733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0116c934-3011-495d-a63a-a287b69cc485 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:22.502599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=32 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:22.508000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0116c934-3011-495d-a63a-a287b69cc485 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:22.508473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0116c934-3011-495d-a63a-a287b69cc485 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:22.508899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0116c934-3011-495d-a63a-a287b69cc485 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:22.509567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0116c934-3011-495d-a63a-a287b69cc485 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:22.510042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0116c934-3011-495d-a63a-a287b69cc485 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:22.510456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0116c934-3011-495d-a63a-a287b69cc485 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:22.513164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:22.645181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0116c934-3011-495d-a63a-a287b69cc485 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:22.653153 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0116c934-3011-495d-a63a-a287b69cc485 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.158279 Oct 29 03:47:22.653762 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3603/7158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:22 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:23.681707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e2c671b-1518-470b-b035-208d1b5d0dd5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:23.682601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e2c671b-1518-470b-b035-208d1b5d0dd5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:23.694249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2c671b-1518-470b-b035-208d1b5d0dd5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:23.695083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2c671b-1518-470b-b035-208d1b5d0dd5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:23.695820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2c671b-1518-470b-b035-208d1b5d0dd5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:23.696986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2c671b-1518-470b-b035-208d1b5d0dd5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:23.697754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2c671b-1518-470b-b035-208d1b5d0dd5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:23.698529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e2c671b-1518-470b-b035-208d1b5d0dd5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:23.837330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2e2c671b-1518-470b-b035-208d1b5d0dd5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:23.845441 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e2c671b-1518-470b-b035-208d1b5d0dd5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.170734 Oct 29 03:47:23.846084 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3556/7159] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:23 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:24.869786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-946cc54a-642e-4e03-bc94-3fa965a8fafb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:24.870446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-946cc54a-642e-4e03-bc94-3fa965a8fafb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:24.877906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-946cc54a-642e-4e03-bc94-3fa965a8fafb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:24.878395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-946cc54a-642e-4e03-bc94-3fa965a8fafb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:24.878801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-946cc54a-642e-4e03-bc94-3fa965a8fafb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:24.879530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-946cc54a-642e-4e03-bc94-3fa965a8fafb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:24.879974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-946cc54a-642e-4e03-bc94-3fa965a8fafb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:24.880384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-946cc54a-642e-4e03-bc94-3fa965a8fafb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:25.024760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-946cc54a-642e-4e03-bc94-3fa965a8fafb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:25.035297 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-946cc54a-642e-4e03-bc94-3fa965a8fafb tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.169904 Oct 29 03:47:25.035888 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3604/7160] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:24 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:26.062586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6da12ef1-02ac-4918-94b6-762316ffadbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:26.063566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6da12ef1-02ac-4918-94b6-762316ffadbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:26.075383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da12ef1-02ac-4918-94b6-762316ffadbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:26.076219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da12ef1-02ac-4918-94b6-762316ffadbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:26.077081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da12ef1-02ac-4918-94b6-762316ffadbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:26.078270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da12ef1-02ac-4918-94b6-762316ffadbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:26.079051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da12ef1-02ac-4918-94b6-762316ffadbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:26.079946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da12ef1-02ac-4918-94b6-762316ffadbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:26.219453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6da12ef1-02ac-4918-94b6-762316ffadbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:26.227591 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6da12ef1-02ac-4918-94b6-762316ffadbf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.171715 Oct 29 03:47:26.228213 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3557/7161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:26 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:27.252701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-698fd194-acd0-4db7-8614-dc832e3c130f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:27.253450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-698fd194-acd0-4db7-8614-dc832e3c130f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:27.260603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-698fd194-acd0-4db7-8614-dc832e3c130f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:27.261072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-698fd194-acd0-4db7-8614-dc832e3c130f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:27.261497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-698fd194-acd0-4db7-8614-dc832e3c130f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:27.262217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-698fd194-acd0-4db7-8614-dc832e3c130f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:27.262660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-698fd194-acd0-4db7-8614-dc832e3c130f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:27.263072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-698fd194-acd0-4db7-8614-dc832e3c130f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:27.409546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-698fd194-acd0-4db7-8614-dc832e3c130f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:27.421477 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-698fd194-acd0-4db7-8614-dc832e3c130f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.172488 Oct 29 03:47:27.422341 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3605/7162] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:27 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:28.447200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6ab6b34a-357f-49dc-93f2-7488bbe99f98 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:28.447914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6ab6b34a-357f-49dc-93f2-7488bbe99f98 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:28.458455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ab6b34a-357f-49dc-93f2-7488bbe99f98 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:28.459166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ab6b34a-357f-49dc-93f2-7488bbe99f98 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:28.459728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ab6b34a-357f-49dc-93f2-7488bbe99f98 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:28.460708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ab6b34a-357f-49dc-93f2-7488bbe99f98 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:28.461386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ab6b34a-357f-49dc-93f2-7488bbe99f98 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:28.462144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ab6b34a-357f-49dc-93f2-7488bbe99f98 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:28.607233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6ab6b34a-357f-49dc-93f2-7488bbe99f98 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:28.616184 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6ab6b34a-357f-49dc-93f2-7488bbe99f98 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.173431 Oct 29 03:47:28.616789 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3558/7163] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:28 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:29.647696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20c0dce0-319a-4c29-9015-9590c615b9bf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:29.648340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-20c0dce0-319a-4c29-9015-9590c615b9bf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:29.656766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c0dce0-319a-4c29-9015-9590c615b9bf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:29.657301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c0dce0-319a-4c29-9015-9590c615b9bf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:29.657780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c0dce0-319a-4c29-9015-9590c615b9bf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:29.658596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c0dce0-319a-4c29-9015-9590c615b9bf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:29.659097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c0dce0-319a-4c29-9015-9590c615b9bf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:29.659568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c0dce0-319a-4c29-9015-9590c615b9bf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:29.799603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20c0dce0-319a-4c29-9015-9590c615b9bf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:29.807925 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20c0dce0-319a-4c29-9015-9590c615b9bf tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1521 microversion: 2.1 time: 0.166451 Oct 29 03:47:29.808540 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3606/7164] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:29 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:30.831467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-012f57d5-2f9a-40d4-801c-e6e2e13165f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:30.832299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-012f57d5-2f9a-40d4-801c-e6e2e13165f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:30.839654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-012f57d5-2f9a-40d4-801c-e6e2e13165f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:30.840163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-012f57d5-2f9a-40d4-801c-e6e2e13165f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:30.840602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-012f57d5-2f9a-40d4-801c-e6e2e13165f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:30.841311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-012f57d5-2f9a-40d4-801c-e6e2e13165f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:30.841774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-012f57d5-2f9a-40d4-801c-e6e2e13165f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:30.842242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-012f57d5-2f9a-40d4-801c-e6e2e13165f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:30.864056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-3295bccf-f20c-4235-ab13-fbbf5599db8f req-ac186e6c-b27c-4373-a3d0-7871da26b17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4832b8d3-9285-48e8-86b0-13f43735488f", "name": "network-vif-unplugged", "status": "completed", "tag": "8ae77169-cdf9-409a-abaa-bfacb5fb6f53"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:30.875558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3295bccf-f20c-4235-ab13-fbbf5599db8f req-ac186e6c-b27c-4373-a3d0-7871da26b17d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:30.876164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3295bccf-f20c-4235-ab13-fbbf5599db8f req-ac186e6c-b27c-4373-a3d0-7871da26b17d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:30.876925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-3295bccf-f20c-4235-ab13-fbbf5599db8f req-ac186e6c-b27c-4373-a3d0-7871da26b17d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:30.892316 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-3295bccf-f20c-4235-ab13-fbbf5599db8f req-ac186e6c-b27c-4373-a3d0-7871da26b17d service nova] Creating event network-vif-unplugged:8ae77169-cdf9-409a-abaa-bfacb5fb6f53 for instance 4832b8d3-9285-48e8-86b0-13f43735488f on n-h2-862964-4 Oct 29 03:47:30.898590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-3295bccf-f20c-4235-ab13-fbbf5599db8f req-ac186e6c-b27c-4373-a3d0-7871da26b17d service nova] Instance 4832b8d3-9285-48e8-86b0-13f43735488f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:47:30.910282 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-3295bccf-f20c-4235-ab13-fbbf5599db8f req-ac186e6c-b27c-4373-a3d0-7871da26b17d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050636 Oct 29 03:47:30.911365 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3607/7165] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:47:30.989152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-012f57d5-2f9a-40d4-801c-e6e2e13165f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:30.997647 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-012f57d5-2f9a-40d4-801c-e6e2e13165f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1520 microversion: 2.1 time: 0.170254 Oct 29 03:47:30.998996 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3559/7166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:30 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:32.027746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-871e691e-4359-4239-bbb4-16942c60103f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:32.028555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-871e691e-4359-4239-bbb4-16942c60103f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:32.038115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-871e691e-4359-4239-bbb4-16942c60103f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:32.038895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-871e691e-4359-4239-bbb4-16942c60103f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:32.039531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-871e691e-4359-4239-bbb4-16942c60103f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:32.040655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-871e691e-4359-4239-bbb4-16942c60103f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:32.041377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-871e691e-4359-4239-bbb4-16942c60103f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:32.042029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-871e691e-4359-4239-bbb4-16942c60103f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:32.182805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-871e691e-4359-4239-bbb4-16942c60103f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:32.191034 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-871e691e-4359-4239-bbb4-16942c60103f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1518 microversion: 2.1 time: 0.171448 Oct 29 03:47:32.191659 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3608/7167] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:32 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:32.945041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ce00ec1e-fcb8-4caf-8010-38f0173e2aeb req-d88bd69a-c557-4637-b7bc-bc957f0720f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4832b8d3-9285-48e8-86b0-13f43735488f", "tag": "8ae77169-cdf9-409a-abaa-bfacb5fb6f53"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:32.956095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ce00ec1e-fcb8-4caf-8010-38f0173e2aeb req-d88bd69a-c557-4637-b7bc-bc957f0720f0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:32.956573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ce00ec1e-fcb8-4caf-8010-38f0173e2aeb req-d88bd69a-c557-4637-b7bc-bc957f0720f0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:32.957001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ce00ec1e-fcb8-4caf-8010-38f0173e2aeb req-d88bd69a-c557-4637-b7bc-bc957f0720f0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:32.969183 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ce00ec1e-fcb8-4caf-8010-38f0173e2aeb req-d88bd69a-c557-4637-b7bc-bc957f0720f0 service nova] Creating event network-changed:8ae77169-cdf9-409a-abaa-bfacb5fb6f53 for instance 4832b8d3-9285-48e8-86b0-13f43735488f on n-h2-862964-4 Oct 29 03:47:32.974838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-ce00ec1e-fcb8-4caf-8010-38f0173e2aeb req-d88bd69a-c557-4637-b7bc-bc957f0720f0 service nova] Instance 4832b8d3-9285-48e8-86b0-13f43735488f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:47:32.985770 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ce00ec1e-fcb8-4caf-8010-38f0173e2aeb req-d88bd69a-c557-4637-b7bc-bc957f0720f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045309 Oct 29 03:47:32.986408 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3560/7168] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:47:33.215164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7510eb5f-7ee0-4620-9798-e949bfbb3da2 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:33.215847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7510eb5f-7ee0-4620-9798-e949bfbb3da2 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:33.223507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7510eb5f-7ee0-4620-9798-e949bfbb3da2 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:33.223970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7510eb5f-7ee0-4620-9798-e949bfbb3da2 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:33.224400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7510eb5f-7ee0-4620-9798-e949bfbb3da2 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:33.225587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7510eb5f-7ee0-4620-9798-e949bfbb3da2 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:33.226071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7510eb5f-7ee0-4620-9798-e949bfbb3da2 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:33.226489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7510eb5f-7ee0-4620-9798-e949bfbb3da2 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:33.488912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7510eb5f-7ee0-4620-9798-e949bfbb3da2 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:33.497340 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7510eb5f-7ee0-4620-9798-e949bfbb3da2 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1518 microversion: 2.1 time: 0.286821 Oct 29 03:47:33.498255 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3609/7169] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:33 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1518 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:34.528502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4e364a46-8ff4-4937-a853-acc901553da5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:34.529694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4e364a46-8ff4-4937-a853-acc901553da5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:34.538524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e364a46-8ff4-4937-a853-acc901553da5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:34.539012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e364a46-8ff4-4937-a853-acc901553da5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:34.539455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e364a46-8ff4-4937-a853-acc901553da5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:34.540147 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e364a46-8ff4-4937-a853-acc901553da5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:34.540599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e364a46-8ff4-4937-a853-acc901553da5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:34.541029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e364a46-8ff4-4937-a853-acc901553da5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:34.680898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4e364a46-8ff4-4937-a853-acc901553da5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:34.688764 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4e364a46-8ff4-4937-a853-acc901553da5 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1515 microversion: 2.1 time: 0.168777 Oct 29 03:47:34.689352 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3561/7170] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:34 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:34.714857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c5e97ec6-eee8-4832-a075-5b5164ffcc9c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:34.715412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c5e97ec6-eee8-4832-a075-5b5164ffcc9c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:34.726115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e97ec6-eee8-4832-a075-5b5164ffcc9c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:34.726811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e97ec6-eee8-4832-a075-5b5164ffcc9c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:34.727439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e97ec6-eee8-4832-a075-5b5164ffcc9c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:34.728461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e97ec6-eee8-4832-a075-5b5164ffcc9c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:34.729048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e97ec6-eee8-4832-a075-5b5164ffcc9c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:34.729594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c5e97ec6-eee8-4832-a075-5b5164ffcc9c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:34.796144 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c5e97ec6-eee8-4832-a075-5b5164ffcc9c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "POST /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f/action" status: 204 len: 0 microversion: 2.1 time: 0.087672 Oct 29 03:47:34.796874 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3610/7171] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:47:34 2022] POST /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:47:34.805361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-74138059-82a5-4729-8af5-bd750cccef54 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:34.806002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-74138059-82a5-4729-8af5-bd750cccef54 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:34.812462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74138059-82a5-4729-8af5-bd750cccef54 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:34.812927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74138059-82a5-4729-8af5-bd750cccef54 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:34.813371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74138059-82a5-4729-8af5-bd750cccef54 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:34.814261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74138059-82a5-4729-8af5-bd750cccef54 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:34.814728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74138059-82a5-4729-8af5-bd750cccef54 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:34.815156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-74138059-82a5-4729-8af5-bd750cccef54 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:35.030021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-74138059-82a5-4729-8af5-bd750cccef54 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:35.038424 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-74138059-82a5-4729-8af5-bd750cccef54 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1515 microversion: 2.1 time: 0.237351 Oct 29 03:47:35.045841 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3562/7172] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:34 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:47:36.063354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-88d1cef6-70d8-4169-b3d2-4dc0db902fa7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:36.064490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-88d1cef6-70d8-4169-b3d2-4dc0db902fa7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:36.071568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d1cef6-70d8-4169-b3d2-4dc0db902fa7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:36.072039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d1cef6-70d8-4169-b3d2-4dc0db902fa7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:36.072466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d1cef6-70d8-4169-b3d2-4dc0db902fa7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:36.073153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d1cef6-70d8-4169-b3d2-4dc0db902fa7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:36.073618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d1cef6-70d8-4169-b3d2-4dc0db902fa7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:36.074400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88d1cef6-70d8-4169-b3d2-4dc0db902fa7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:36.215177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-88d1cef6-70d8-4169-b3d2-4dc0db902fa7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:36.223223 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-88d1cef6-70d8-4169-b3d2-4dc0db902fa7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1515 microversion: 2.1 time: 0.165074 Oct 29 03:47:36.223833 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3611/7173] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:36 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:36.945174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-c4b7bf73-3b8d-4c99-bb3d-39949d37912e req-3799645e-6a34-475c-88c7-cb836cf3bfb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4832b8d3-9285-48e8-86b0-13f43735488f", "name": "network-vif-plugged", "status": "completed", "tag": "8ae77169-cdf9-409a-abaa-bfacb5fb6f53"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:36.955684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c4b7bf73-3b8d-4c99-bb3d-39949d37912e req-3799645e-6a34-475c-88c7-cb836cf3bfb5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:36.956204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c4b7bf73-3b8d-4c99-bb3d-39949d37912e req-3799645e-6a34-475c-88c7-cb836cf3bfb5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:36.956700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-c4b7bf73-3b8d-4c99-bb3d-39949d37912e req-3799645e-6a34-475c-88c7-cb836cf3bfb5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:36.970680 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-c4b7bf73-3b8d-4c99-bb3d-39949d37912e req-3799645e-6a34-475c-88c7-cb836cf3bfb5 service nova] Creating event network-vif-plugged:8ae77169-cdf9-409a-abaa-bfacb5fb6f53 for instance 4832b8d3-9285-48e8-86b0-13f43735488f on n-h2-862964-4 Oct 29 03:47:36.976048 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-c4b7bf73-3b8d-4c99-bb3d-39949d37912e req-3799645e-6a34-475c-88c7-cb836cf3bfb5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035105 Oct 29 03:47:36.976897 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3563/7174] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:47:37.251718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-52652677-a800-4a29-bc80-d7ef01635229 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:37.252751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-52652677-a800-4a29-bc80-d7ef01635229 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:37.264321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52652677-a800-4a29-bc80-d7ef01635229 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:37.265111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52652677-a800-4a29-bc80-d7ef01635229 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:37.265856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52652677-a800-4a29-bc80-d7ef01635229 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:37.266984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52652677-a800-4a29-bc80-d7ef01635229 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:37.267743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52652677-a800-4a29-bc80-d7ef01635229 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:37.268434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-52652677-a800-4a29-bc80-d7ef01635229 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:37.412028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-52652677-a800-4a29-bc80-d7ef01635229 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:37.420415 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-52652677-a800-4a29-bc80-d7ef01635229 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1507 microversion: 2.1 time: 0.175205 Oct 29 03:47:37.420957 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3612/7175] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:37 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:37.443142 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-337349dc-1d1a-4f32-b5b1-71a0c990ec5b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:37.443844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-337349dc-1d1a-4f32-b5b1-71a0c990ec5b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:37.450144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-337349dc-1d1a-4f32-b5b1-71a0c990ec5b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:37.450633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-337349dc-1d1a-4f32-b5b1-71a0c990ec5b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:37.451071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-337349dc-1d1a-4f32-b5b1-71a0c990ec5b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:37.451801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-337349dc-1d1a-4f32-b5b1-71a0c990ec5b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:37.452254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-337349dc-1d1a-4f32-b5b1-71a0c990ec5b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:37.452681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-337349dc-1d1a-4f32-b5b1-71a0c990ec5b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:37.592057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-337349dc-1d1a-4f32-b5b1-71a0c990ec5b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:37.600261 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-337349dc-1d1a-4f32-b5b1-71a0c990ec5b tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1507 microversion: 2.1 time: 0.161373 Oct 29 03:47:37.600839 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3564/7176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:37 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:37.626201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c3099fe-6dde-4ef4-91b7-3902127ad211 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Action: 'create', calling method: .version_select at 0x7fe1a84e6c10>, body: {"keypair": {"name": "tempest-keypair-76130718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcqk+FaNra0rN/eU1PuoqkUNGsn4rSVD1A+0Mqtc4XEM6aT1inHIx+Dakg7OcI9949k31kFA6CGdJ4Z7+lWO3JI0wEKAcJ6KpeOy+qEmohw6dWRBYled+ZJH6KB3jaKGA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:37.643006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9c3099fe-6dde-4ef4-91b7-3902127ad211 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Getting quotas for project 676879256318463780dd131db996c8f3. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:47:37.648531 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9c3099fe-6dde-4ef4-91b7-3902127ad211 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Getting quotas for user 20c5f53b760d49bf81a9377773210a24 and project 676879256318463780dd131db996c8f3. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:47:37.662614 n-d-862964-4 devstack@n-api.service[127042]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9c3099fe-6dde-4ef4-91b7-3902127ad211 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [a0608d36-b941-4914-9d17-386377dc6131] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 03:47:38.675285 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [None req-9c3099fe-6dde-4ef4-91b7-3902127ad211 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [a0608d36-b941-4914-9d17-386377dc6131] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44130. Oct 29 03:47:38.699376 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c3099fe-6dde-4ef4-91b7-3902127ad211 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.076728 Oct 29 03:47:38.700198 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3613/7177] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:47:37 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:47:39.980050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ceaa6cb3-881d-4770-813d-d25524c2b234 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:39.980844 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ceaa6cb3-881d-4770-813d-d25524c2b234 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:39.987926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ceaa6cb3-881d-4770-813d-d25524c2b234 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:39.988814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ceaa6cb3-881d-4770-813d-d25524c2b234 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:39.989258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ceaa6cb3-881d-4770-813d-d25524c2b234 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:39.989997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ceaa6cb3-881d-4770-813d-d25524c2b234 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:39.990456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ceaa6cb3-881d-4770-813d-d25524c2b234 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:39.990887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ceaa6cb3-881d-4770-813d-d25524c2b234 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:40.139563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ceaa6cb3-881d-4770-813d-d25524c2b234 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:40.147903 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ceaa6cb3-881d-4770-813d-d25524c2b234 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 200 len: 1507 microversion: 2.1 time: 0.171979 Oct 29 03:47:40.148482 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3565/7178] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:39 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:40.171567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-65920c92-f21f-4043-ac20-4997eaad8593 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:40.172100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-65920c92-f21f-4043-ac20-4997eaad8593 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:40.178451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65920c92-f21f-4043-ac20-4997eaad8593 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:40.178923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65920c92-f21f-4043-ac20-4997eaad8593 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:40.179349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65920c92-f21f-4043-ac20-4997eaad8593 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:40.180034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65920c92-f21f-4043-ac20-4997eaad8593 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:40.180475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65920c92-f21f-4043-ac20-4997eaad8593 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:40.180891 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65920c92-f21f-4043-ac20-4997eaad8593 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:40.205726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-65920c92-f21f-4043-ac20-4997eaad8593 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:47:40.292321 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-65920c92-f21f-4043-ac20-4997eaad8593 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 204 len: 0 microversion: 2.1 time: 0.125335 Oct 29 03:47:40.292900 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3614/7179] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:47:40 2022] DELETE /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:47:40.353840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1787387349", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "ff7ab03d-c37e-43b0-a321-a1e718623bd3"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:40.409682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] validate_networks() for [('ff7ab03d-c37e-43b0-a321-a1e718623bd3', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:47:40.802029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:47:40.802455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:47:40.802922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:47:40.803478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:47:40.804208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:47:40.813991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:40.814477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:40.814917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:40.815649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:40.816107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:40.816746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:40.834838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Getting quotas for project 676879256318463780dd131db996c8f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:47:40.840275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Getting quotas for user 20c5f53b760d49bf81a9377773210a24 and project 676879256318463780dd131db996c8f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:47:40.853132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:47:40.855613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:47:40.901922 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9fb5eab7-d0d5-420e-9f21-15c9f4f28eb6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552037 Oct 29 03:47:40.902683 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3566/7180] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:47:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:47:40.914651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4d117783-5a2c-4122-ab09-f39d0a5ab312 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:40.915468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4d117783-5a2c-4122-ab09-f39d0a5ab312 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:40.971886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4d117783-5a2c-4122-ab09-f39d0a5ab312 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:40.979592 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4d117783-5a2c-4122-ab09-f39d0a5ab312 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1218 microversion: 2.1 time: 0.069354 Oct 29 03:47:40.980159 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3615/7181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:40 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:42.004394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c291ca3f-89df-41ad-b20e-e53ad02bc2f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:42.005163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c291ca3f-89df-41ad-b20e-e53ad02bc2f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:42.013339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291ca3f-89df-41ad-b20e-e53ad02bc2f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:42.013930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291ca3f-89df-41ad-b20e-e53ad02bc2f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:42.014459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291ca3f-89df-41ad-b20e-e53ad02bc2f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:42.015215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291ca3f-89df-41ad-b20e-e53ad02bc2f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:42.015895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291ca3f-89df-41ad-b20e-e53ad02bc2f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:42.016431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c291ca3f-89df-41ad-b20e-e53ad02bc2f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:42.083185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c291ca3f-89df-41ad-b20e-e53ad02bc2f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:42.091648 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c291ca3f-89df-41ad-b20e-e53ad02bc2f9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1270 microversion: 2.1 time: 0.091974 Oct 29 03:47:42.093859 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3567/7182] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:41 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:42.416544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4f65dd7c-4b37-47cf-a0f9-af2cfc2ed486 req-acafb41a-d10b-48c1-8edf-dafd91e3a644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4832b8d3-9285-48e8-86b0-13f43735488f", "name": "network-vif-deleted", "tag": "8ae77169-cdf9-409a-abaa-bfacb5fb6f53"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:42.453640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4f65dd7c-4b37-47cf-a0f9-af2cfc2ed486 req-acafb41a-d10b-48c1-8edf-dafd91e3a644 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:42.454250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4f65dd7c-4b37-47cf-a0f9-af2cfc2ed486 req-acafb41a-d10b-48c1-8edf-dafd91e3a644 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:42.454749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4f65dd7c-4b37-47cf-a0f9-af2cfc2ed486 req-acafb41a-d10b-48c1-8edf-dafd91e3a644 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:42.482989 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4f65dd7c-4b37-47cf-a0f9-af2cfc2ed486 req-acafb41a-d10b-48c1-8edf-dafd91e3a644 service nova] Creating event network-vif-deleted:8ae77169-cdf9-409a-abaa-bfacb5fb6f53 for instance 4832b8d3-9285-48e8-86b0-13f43735488f on n-h2-862964-4 Oct 29 03:47:42.490252 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4f65dd7c-4b37-47cf-a0f9-af2cfc2ed486 req-acafb41a-d10b-48c1-8edf-dafd91e3a644 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077169 Oct 29 03:47:42.491264 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3616/7183] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:47:43.116661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dc80ee35-33b2-4c21-9374-4330725775de tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:43.117261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dc80ee35-33b2-4c21-9374-4330725775de tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:43.125300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc80ee35-33b2-4c21-9374-4330725775de tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:43.126017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc80ee35-33b2-4c21-9374-4330725775de tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:43.126457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc80ee35-33b2-4c21-9374-4330725775de tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:43.127377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc80ee35-33b2-4c21-9374-4330725775de tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:43.127835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc80ee35-33b2-4c21-9374-4330725775de tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:43.128557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc80ee35-33b2-4c21-9374-4330725775de tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:43.274596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dc80ee35-33b2-4c21-9374-4330725775de tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:43.282752 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dc80ee35-33b2-4c21-9374-4330725775de tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1318 microversion: 2.1 time: 0.170640 Oct 29 03:47:43.283561 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3568/7184] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:43 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:44.308512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6faa6f7a-b2fa-4fc4-9a10-3ec77bac9918 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:44.309316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6faa6f7a-b2fa-4fc4-9a10-3ec77bac9918 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:44.315965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6faa6f7a-b2fa-4fc4-9a10-3ec77bac9918 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:44.316538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6faa6f7a-b2fa-4fc4-9a10-3ec77bac9918 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:44.316923 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6faa6f7a-b2fa-4fc4-9a10-3ec77bac9918 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:44.317624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6faa6f7a-b2fa-4fc4-9a10-3ec77bac9918 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:44.318115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6faa6f7a-b2fa-4fc4-9a10-3ec77bac9918 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:44.318541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6faa6f7a-b2fa-4fc4-9a10-3ec77bac9918 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:44.515531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-55e54c27-a2d5-4765-bddc-dc05e3854c56 req-5df4c049-6a5d-4297-aa19-0bb0e96feb3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea7e347-06c1-4011-80bd-553b841d2f68", "tag": "b41161aa-5eb2-49c4-ad80-7c9ef22b8163"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:44.526724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55e54c27-a2d5-4765-bddc-dc05e3854c56 req-5df4c049-6a5d-4297-aa19-0bb0e96feb3f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:44.527204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55e54c27-a2d5-4765-bddc-dc05e3854c56 req-5df4c049-6a5d-4297-aa19-0bb0e96feb3f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:44.527856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-55e54c27-a2d5-4765-bddc-dc05e3854c56 req-5df4c049-6a5d-4297-aa19-0bb0e96feb3f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:44.530763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=91 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:44.539154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6faa6f7a-b2fa-4fc4-9a10-3ec77bac9918 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:44.543529 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-55e54c27-a2d5-4765-bddc-dc05e3854c56 req-5df4c049-6a5d-4297-aa19-0bb0e96feb3f service nova] Creating event network-changed:b41161aa-5eb2-49c4-ad80-7c9ef22b8163 for instance 3ea7e347-06c1-4011-80bd-553b841d2f68 on n-h2-862964-4 Oct 29 03:47:44.548864 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-55e54c27-a2d5-4765-bddc-dc05e3854c56 req-5df4c049-6a5d-4297-aa19-0bb0e96feb3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037087 Oct 29 03:47:44.550258 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3569/7185] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:47:44.554277 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6faa6f7a-b2fa-4fc4-9a10-3ec77bac9918 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1318 microversion: 2.1 time: 0.250896 Oct 29 03:47:44.555018 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3617/7186] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:44 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:45.579799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-248066ca-09a0-4db6-944d-9d7f35ab8794 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:45.580548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-248066ca-09a0-4db6-944d-9d7f35ab8794 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:45.587400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-248066ca-09a0-4db6-944d-9d7f35ab8794 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:45.588094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-248066ca-09a0-4db6-944d-9d7f35ab8794 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:45.588555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-248066ca-09a0-4db6-944d-9d7f35ab8794 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:45.589270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-248066ca-09a0-4db6-944d-9d7f35ab8794 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:45.589871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-248066ca-09a0-4db6-944d-9d7f35ab8794 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:45.590506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-248066ca-09a0-4db6-944d-9d7f35ab8794 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:45.730636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-248066ca-09a0-4db6-944d-9d7f35ab8794 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:45.739969 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-248066ca-09a0-4db6-944d-9d7f35ab8794 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1318 microversion: 2.1 time: 0.165426 Oct 29 03:47:45.740703 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3570/7187] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:45 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:46.767015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dfd88aa6-bba4-4992-8d1c-b97d97bf3bfd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:46.768024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dfd88aa6-bba4-4992-8d1c-b97d97bf3bfd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:46.776515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd88aa6-bba4-4992-8d1c-b97d97bf3bfd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:46.776994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd88aa6-bba4-4992-8d1c-b97d97bf3bfd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:46.777422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd88aa6-bba4-4992-8d1c-b97d97bf3bfd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:46.778163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd88aa6-bba4-4992-8d1c-b97d97bf3bfd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:46.778605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd88aa6-bba4-4992-8d1c-b97d97bf3bfd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:46.779014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dfd88aa6-bba4-4992-8d1c-b97d97bf3bfd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:46.918269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dfd88aa6-bba4-4992-8d1c-b97d97bf3bfd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:46.928751 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dfd88aa6-bba4-4992-8d1c-b97d97bf3bfd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1318 microversion: 2.1 time: 0.168289 Oct 29 03:47:46.929341 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3618/7188] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:46 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:47.955939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-97801379-4ab7-4ce0-bfcc-024d1af47f7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:47.956983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-97801379-4ab7-4ce0-bfcc-024d1af47f7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:47.968351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97801379-4ab7-4ce0-bfcc-024d1af47f7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:47.969382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97801379-4ab7-4ce0-bfcc-024d1af47f7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:47.970162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97801379-4ab7-4ce0-bfcc-024d1af47f7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:47.971319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97801379-4ab7-4ce0-bfcc-024d1af47f7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:47.972092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97801379-4ab7-4ce0-bfcc-024d1af47f7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:47.972788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97801379-4ab7-4ce0-bfcc-024d1af47f7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:48.113684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-97801379-4ab7-4ce0-bfcc-024d1af47f7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:48.122186 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-97801379-4ab7-4ce0-bfcc-024d1af47f7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1318 microversion: 2.1 time: 0.172947 Oct 29 03:47:48.122788 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3571/7189] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:47 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:49.043573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-526eb796-0704-4050-bc1c-77c9de028818 req-2908cf0f-cf4b-4428-ac30-65e0f9f11b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea7e347-06c1-4011-80bd-553b841d2f68", "name": "network-vif-plugged", "status": "completed", "tag": "b41161aa-5eb2-49c4-ad80-7c9ef22b8163"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:49.054880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-526eb796-0704-4050-bc1c-77c9de028818 req-2908cf0f-cf4b-4428-ac30-65e0f9f11b88 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:49.055449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-526eb796-0704-4050-bc1c-77c9de028818 req-2908cf0f-cf4b-4428-ac30-65e0f9f11b88 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:49.055925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-526eb796-0704-4050-bc1c-77c9de028818 req-2908cf0f-cf4b-4428-ac30-65e0f9f11b88 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:49.068889 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-526eb796-0704-4050-bc1c-77c9de028818 req-2908cf0f-cf4b-4428-ac30-65e0f9f11b88 service nova] Creating event network-vif-plugged:b41161aa-5eb2-49c4-ad80-7c9ef22b8163 for instance 3ea7e347-06c1-4011-80bd-553b841d2f68 on n-h2-862964-4 Oct 29 03:47:49.074287 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-526eb796-0704-4050-bc1c-77c9de028818 req-2908cf0f-cf4b-4428-ac30-65e0f9f11b88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034486 Oct 29 03:47:49.075227 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3619/7190] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:47:49.147249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e28e6e4d-3a13-4f94-ad16-ed7bb179208a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:49.147814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e28e6e4d-3a13-4f94-ad16-ed7bb179208a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:49.155399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28e6e4d-3a13-4f94-ad16-ed7bb179208a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:49.155939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28e6e4d-3a13-4f94-ad16-ed7bb179208a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:49.156385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28e6e4d-3a13-4f94-ad16-ed7bb179208a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:49.157114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28e6e4d-3a13-4f94-ad16-ed7bb179208a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:49.157573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28e6e4d-3a13-4f94-ad16-ed7bb179208a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:49.158043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28e6e4d-3a13-4f94-ad16-ed7bb179208a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:49.292828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e28e6e4d-3a13-4f94-ad16-ed7bb179208a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:49.300813 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e28e6e4d-3a13-4f94-ad16-ed7bb179208a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1318 microversion: 2.1 time: 0.157960 Oct 29 03:47:49.301396 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3572/7191] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:49 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:50.325634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3c0cf04c-d660-4fb0-8ec6-055f6be174e8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:50.326327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3c0cf04c-d660-4fb0-8ec6-055f6be174e8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:50.334241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0cf04c-d660-4fb0-8ec6-055f6be174e8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:50.334721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0cf04c-d660-4fb0-8ec6-055f6be174e8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:50.335145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0cf04c-d660-4fb0-8ec6-055f6be174e8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:50.335834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0cf04c-d660-4fb0-8ec6-055f6be174e8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:50.336272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0cf04c-d660-4fb0-8ec6-055f6be174e8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:50.336686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3c0cf04c-d660-4fb0-8ec6-055f6be174e8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:50.355017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:50.475170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3c0cf04c-d660-4fb0-8ec6-055f6be174e8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:50.483023 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3c0cf04c-d660-4fb0-8ec6-055f6be174e8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1318 microversion: 2.1 time: 0.162416 Oct 29 03:47:50.483609 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3620/7192] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:50 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:51.510975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4f755d4a-44a5-4af9-963f-a1e943d3943c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:51.512005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4f755d4a-44a5-4af9-963f-a1e943d3943c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:51.516483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:51.517673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:51.518652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:51.525246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f755d4a-44a5-4af9-963f-a1e943d3943c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:51.525733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f755d4a-44a5-4af9-963f-a1e943d3943c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:51.526200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f755d4a-44a5-4af9-963f-a1e943d3943c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:51.526903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f755d4a-44a5-4af9-963f-a1e943d3943c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:51.527362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f755d4a-44a5-4af9-963f-a1e943d3943c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:51.527783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4f755d4a-44a5-4af9-963f-a1e943d3943c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:51.663810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4f755d4a-44a5-4af9-963f-a1e943d3943c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:51.671993 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4f755d4a-44a5-4af9-963f-a1e943d3943c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1508 microversion: 2.1 time: 0.167648 Oct 29 03:47:51.672540 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3573/7193] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:51 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:51.695224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2bb2af06-e6ff-4890-8d81-46b9a3b02d7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:51.695795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2bb2af06-e6ff-4890-8d81-46b9a3b02d7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:51.697677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:51.704055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bb2af06-e6ff-4890-8d81-46b9a3b02d7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:51.704532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bb2af06-e6ff-4890-8d81-46b9a3b02d7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:51.704964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bb2af06-e6ff-4890-8d81-46b9a3b02d7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:51.705649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bb2af06-e6ff-4890-8d81-46b9a3b02d7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:51.706145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bb2af06-e6ff-4890-8d81-46b9a3b02d7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:51.706564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2bb2af06-e6ff-4890-8d81-46b9a3b02d7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:51.845613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2bb2af06-e6ff-4890-8d81-46b9a3b02d7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:51.853763 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2bb2af06-e6ff-4890-8d81-46b9a3b02d7f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1508 microversion: 2.1 time: 0.162677 Oct 29 03:47:51.854372 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3621/7194] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:51 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:47:51.876340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:51.878782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:51.885117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:51.885610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:51.886083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:51.886785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:51.887247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:51.887678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:51.917319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:51.923586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Old instance type m1.heat2, new instance type m1.heat {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:47:51.930561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:47:51.930995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:47:51.931497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:47:51.931938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:47:51.932361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:47:52.005446 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29e5fd33-e0e4-4fc4-a855-4e3f8b5925c3 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "POST /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68/action" status: 202 len: 0 microversion: 2.1 time: 0.133105 Oct 29 03:47:52.006452 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3574/7195] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:47:51 2022] POST /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:47:52.014348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6acd89bd-5755-45e1-bb77-5a047e4a0305 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:52.015059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6acd89bd-5755-45e1-bb77-5a047e4a0305 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:52.021358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6acd89bd-5755-45e1-bb77-5a047e4a0305 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:52.021860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6acd89bd-5755-45e1-bb77-5a047e4a0305 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:52.022300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6acd89bd-5755-45e1-bb77-5a047e4a0305 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:52.022996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6acd89bd-5755-45e1-bb77-5a047e4a0305 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:52.023444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6acd89bd-5755-45e1-bb77-5a047e4a0305 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:52.023859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6acd89bd-5755-45e1-bb77-5a047e4a0305 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:52.183019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6acd89bd-5755-45e1-bb77-5a047e4a0305 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:52.191307 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6acd89bd-5755-45e1-bb77-5a047e4a0305 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1515 microversion: 2.1 time: 0.180827 Oct 29 03:47:52.191888 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3622/7196] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:52 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:53.222593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-32637f6b-095d-49b2-8e7d-197783f6ec72 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:53.223879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-32637f6b-095d-49b2-8e7d-197783f6ec72 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:53.234319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32637f6b-095d-49b2-8e7d-197783f6ec72 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:53.234818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32637f6b-095d-49b2-8e7d-197783f6ec72 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:53.235260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32637f6b-095d-49b2-8e7d-197783f6ec72 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:53.235982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32637f6b-095d-49b2-8e7d-197783f6ec72 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:53.236449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32637f6b-095d-49b2-8e7d-197783f6ec72 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:53.236886 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-32637f6b-095d-49b2-8e7d-197783f6ec72 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:53.382994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-32637f6b-095d-49b2-8e7d-197783f6ec72 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:53.390985 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-32637f6b-095d-49b2-8e7d-197783f6ec72 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1515 microversion: 2.1 time: 0.178277 Oct 29 03:47:53.391628 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3575/7197] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:53 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:54.416643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-62b154f5-d208-4d4f-8516-eb1e6d8fe1a6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:54.417474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-62b154f5-d208-4d4f-8516-eb1e6d8fe1a6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:54.421111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:54.428750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62b154f5-d208-4d4f-8516-eb1e6d8fe1a6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:54.429346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62b154f5-d208-4d4f-8516-eb1e6d8fe1a6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:54.430006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62b154f5-d208-4d4f-8516-eb1e6d8fe1a6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:54.430874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62b154f5-d208-4d4f-8516-eb1e6d8fe1a6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:54.431435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62b154f5-d208-4d4f-8516-eb1e6d8fe1a6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:54.431993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62b154f5-d208-4d4f-8516-eb1e6d8fe1a6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:54.585881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-62b154f5-d208-4d4f-8516-eb1e6d8fe1a6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:54.594126 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-62b154f5-d208-4d4f-8516-eb1e6d8fe1a6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.182923 Oct 29 03:47:54.594691 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3623/7198] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:54 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:55.619727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8d997957-5f32-4138-bc98-9cbcbd70c0d0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:55.620341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8d997957-5f32-4138-bc98-9cbcbd70c0d0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:55.628467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d997957-5f32-4138-bc98-9cbcbd70c0d0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:55.628967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d997957-5f32-4138-bc98-9cbcbd70c0d0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:55.629408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d997957-5f32-4138-bc98-9cbcbd70c0d0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:55.630226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d997957-5f32-4138-bc98-9cbcbd70c0d0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:55.630722 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d997957-5f32-4138-bc98-9cbcbd70c0d0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:55.631156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8d997957-5f32-4138-bc98-9cbcbd70c0d0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:55.769267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8d997957-5f32-4138-bc98-9cbcbd70c0d0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:55.778185 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8d997957-5f32-4138-bc98-9cbcbd70c0d0 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.162461 Oct 29 03:47:55.778761 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3576/7199] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:55 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:56.805359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cd789da2-6dc2-4590-93b1-243de6aa81c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:56.806358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cd789da2-6dc2-4590-93b1-243de6aa81c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:56.818094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd789da2-6dc2-4590-93b1-243de6aa81c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:56.818529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd789da2-6dc2-4590-93b1-243de6aa81c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:56.818959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd789da2-6dc2-4590-93b1-243de6aa81c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:56.819649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd789da2-6dc2-4590-93b1-243de6aa81c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:56.820104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd789da2-6dc2-4590-93b1-243de6aa81c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:56.820520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cd789da2-6dc2-4590-93b1-243de6aa81c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:56.954179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cd789da2-6dc2-4590-93b1-243de6aa81c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:56.962333 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cd789da2-6dc2-4590-93b1-243de6aa81c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.163597 Oct 29 03:47:56.962934 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3624/7200] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:56 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:57.985484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ba3495f0-9763-49d4-af4c-fad3341f549d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:57.986145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ba3495f0-9763-49d4-af4c-fad3341f549d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:57.993863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3495f0-9763-49d4-af4c-fad3341f549d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:57.994392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3495f0-9763-49d4-af4c-fad3341f549d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:57.994846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3495f0-9763-49d4-af4c-fad3341f549d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:57.995564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3495f0-9763-49d4-af4c-fad3341f549d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:57.996029 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3495f0-9763-49d4-af4c-fad3341f549d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:57.996465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ba3495f0-9763-49d4-af4c-fad3341f549d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:58.134110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ba3495f0-9763-49d4-af4c-fad3341f549d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:58.142647 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ba3495f0-9763-49d4-af4c-fad3341f549d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.161259 Oct 29 03:47:58.143371 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3577/7201] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:57 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:59.176016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7a854fe2-b84a-4839-a0c3-8a4b885a2667 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:59.176971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7a854fe2-b84a-4839-a0c3-8a4b885a2667 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:59.183875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a854fe2-b84a-4839-a0c3-8a4b885a2667 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:59.184353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a854fe2-b84a-4839-a0c3-8a4b885a2667 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:59.184784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a854fe2-b84a-4839-a0c3-8a4b885a2667 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:59.185470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a854fe2-b84a-4839-a0c3-8a4b885a2667 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:59.185946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a854fe2-b84a-4839-a0c3-8a4b885a2667 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:59.186363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7a854fe2-b84a-4839-a0c3-8a4b885a2667 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:59.326206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7a854fe2-b84a-4839-a0c3-8a4b885a2667 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:59.334167 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7a854fe2-b84a-4839-a0c3-8a4b885a2667 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.164457 Oct 29 03:47:59.334750 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3625/7202] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:59 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:00.361691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a99d3edd-3184-4990-ad25-4c1271b5076c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:00.362696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a99d3edd-3184-4990-ad25-4c1271b5076c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:00.375230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a99d3edd-3184-4990-ad25-4c1271b5076c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:00.376054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a99d3edd-3184-4990-ad25-4c1271b5076c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:00.376803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a99d3edd-3184-4990-ad25-4c1271b5076c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:00.378080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a99d3edd-3184-4990-ad25-4c1271b5076c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:00.378870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a99d3edd-3184-4990-ad25-4c1271b5076c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:00.379606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a99d3edd-3184-4990-ad25-4c1271b5076c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:00.517548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a99d3edd-3184-4990-ad25-4c1271b5076c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:00.525493 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a99d3edd-3184-4990-ad25-4c1271b5076c tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.170299 Oct 29 03:48:00.526098 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3578/7203] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:00 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:01.552367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-14bf577b-97e1-4ce1-8908-61f6ef722d86 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:01.553341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-14bf577b-97e1-4ce1-8908-61f6ef722d86 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:01.561731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bf577b-97e1-4ce1-8908-61f6ef722d86 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:01.562258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bf577b-97e1-4ce1-8908-61f6ef722d86 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:01.562695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bf577b-97e1-4ce1-8908-61f6ef722d86 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:01.563403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bf577b-97e1-4ce1-8908-61f6ef722d86 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:01.563853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bf577b-97e1-4ce1-8908-61f6ef722d86 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:01.564278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-14bf577b-97e1-4ce1-8908-61f6ef722d86 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:01.696425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-14bf577b-97e1-4ce1-8908-61f6ef722d86 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:01.704324 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-14bf577b-97e1-4ce1-8908-61f6ef722d86 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.158415 Oct 29 03:48:01.704924 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3626/7204] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:01 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:02.729377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3b18cc9d-e047-4b4d-941e-c6716e502294 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:02.730058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3b18cc9d-e047-4b4d-941e-c6716e502294 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:02.737545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b18cc9d-e047-4b4d-941e-c6716e502294 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:02.738396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b18cc9d-e047-4b4d-941e-c6716e502294 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:02.738869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b18cc9d-e047-4b4d-941e-c6716e502294 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:02.739625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b18cc9d-e047-4b4d-941e-c6716e502294 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:02.740081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b18cc9d-e047-4b4d-941e-c6716e502294 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:02.740506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3b18cc9d-e047-4b4d-941e-c6716e502294 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:02.879334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3b18cc9d-e047-4b4d-941e-c6716e502294 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:02.887562 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3b18cc9d-e047-4b4d-941e-c6716e502294 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.162734 Oct 29 03:48:02.888142 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3579/7205] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:02 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:03.914807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-db712137-d6a7-4478-9c24-82ef3e0f072e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:03.915556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-db712137-d6a7-4478-9c24-82ef3e0f072e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:03.922834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db712137-d6a7-4478-9c24-82ef3e0f072e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:03.923349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db712137-d6a7-4478-9c24-82ef3e0f072e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:03.923807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db712137-d6a7-4478-9c24-82ef3e0f072e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:03.924499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db712137-d6a7-4478-9c24-82ef3e0f072e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:03.924947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db712137-d6a7-4478-9c24-82ef3e0f072e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:03.925367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-db712137-d6a7-4478-9c24-82ef3e0f072e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:04.068474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-db712137-d6a7-4478-9c24-82ef3e0f072e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:04.077313 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-db712137-d6a7-4478-9c24-82ef3e0f072e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.168498 Oct 29 03:48:04.077995 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3627/7206] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:03 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:05.102526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-04a60ad1-dc94-4147-991a-8e6ae2603362 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:05.103277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-04a60ad1-dc94-4147-991a-8e6ae2603362 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:05.111682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04a60ad1-dc94-4147-991a-8e6ae2603362 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:05.112261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04a60ad1-dc94-4147-991a-8e6ae2603362 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:05.112773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04a60ad1-dc94-4147-991a-8e6ae2603362 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:05.113955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04a60ad1-dc94-4147-991a-8e6ae2603362 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:05.114496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04a60ad1-dc94-4147-991a-8e6ae2603362 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:05.115001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-04a60ad1-dc94-4147-991a-8e6ae2603362 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:05.264219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-04a60ad1-dc94-4147-991a-8e6ae2603362 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:05.273123 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-04a60ad1-dc94-4147-991a-8e6ae2603362 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.175407 Oct 29 03:48:05.273687 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3580/7207] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:05 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:06.300381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e043c2cd-e441-456b-a0cd-d3a68f221e69 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:06.301405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e043c2cd-e441-456b-a0cd-d3a68f221e69 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:06.313149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043c2cd-e441-456b-a0cd-d3a68f221e69 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:06.314011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043c2cd-e441-456b-a0cd-d3a68f221e69 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:06.314729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043c2cd-e441-456b-a0cd-d3a68f221e69 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:06.315864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043c2cd-e441-456b-a0cd-d3a68f221e69 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:06.316606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043c2cd-e441-456b-a0cd-d3a68f221e69 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:06.317300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e043c2cd-e441-456b-a0cd-d3a68f221e69 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:06.454508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e043c2cd-e441-456b-a0cd-d3a68f221e69 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:06.462968 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e043c2cd-e441-456b-a0cd-d3a68f221e69 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.169114 Oct 29 03:48:06.463549 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3628/7208] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:06 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:07.495195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9b56bf99-eb30-4696-acec-c8e3202cd3bc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:07.495934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9b56bf99-eb30-4696-acec-c8e3202cd3bc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:07.504689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b56bf99-eb30-4696-acec-c8e3202cd3bc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:07.505336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b56bf99-eb30-4696-acec-c8e3202cd3bc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:07.505929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b56bf99-eb30-4696-acec-c8e3202cd3bc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:07.506869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b56bf99-eb30-4696-acec-c8e3202cd3bc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:07.507870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b56bf99-eb30-4696-acec-c8e3202cd3bc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:07.508414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b56bf99-eb30-4696-acec-c8e3202cd3bc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:07.649842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9b56bf99-eb30-4696-acec-c8e3202cd3bc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:07.658204 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9b56bf99-eb30-4696-acec-c8e3202cd3bc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.168887 Oct 29 03:48:07.658823 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3581/7209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:07 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:08.690572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-156459b1-7a20-4618-ad93-108c8f1a49df tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:08.691521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-156459b1-7a20-4618-ad93-108c8f1a49df tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:08.699899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-156459b1-7a20-4618-ad93-108c8f1a49df tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:08.700380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-156459b1-7a20-4618-ad93-108c8f1a49df tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:08.700807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-156459b1-7a20-4618-ad93-108c8f1a49df tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:08.701558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-156459b1-7a20-4618-ad93-108c8f1a49df tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:08.701974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-156459b1-7a20-4618-ad93-108c8f1a49df tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:08.702401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-156459b1-7a20-4618-ad93-108c8f1a49df tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:08.847885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-156459b1-7a20-4618-ad93-108c8f1a49df tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:08.855834 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-156459b1-7a20-4618-ad93-108c8f1a49df tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.176334 Oct 29 03:48:08.856382 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3629/7210] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:08 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:09.879979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eac6f253-8339-4e5d-b579-7e3ec956d97a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:09.880616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eac6f253-8339-4e5d-b579-7e3ec956d97a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:09.888315 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eac6f253-8339-4e5d-b579-7e3ec956d97a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:09.888808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eac6f253-8339-4e5d-b579-7e3ec956d97a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:09.889249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eac6f253-8339-4e5d-b579-7e3ec956d97a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:09.889983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eac6f253-8339-4e5d-b579-7e3ec956d97a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:09.890448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eac6f253-8339-4e5d-b579-7e3ec956d97a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:09.890879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eac6f253-8339-4e5d-b579-7e3ec956d97a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:10.036892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eac6f253-8339-4e5d-b579-7e3ec956d97a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:10.045254 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eac6f253-8339-4e5d-b579-7e3ec956d97a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.169305 Oct 29 03:48:10.045826 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3582/7211] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:09 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:11.072966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d2f08230-7949-4514-9f56-e3e35e6504ba tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:11.074920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d2f08230-7949-4514-9f56-e3e35e6504ba tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:11.086173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f08230-7949-4514-9f56-e3e35e6504ba tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:11.086651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f08230-7949-4514-9f56-e3e35e6504ba tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:11.087080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f08230-7949-4514-9f56-e3e35e6504ba tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:11.087762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f08230-7949-4514-9f56-e3e35e6504ba tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:11.088186 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f08230-7949-4514-9f56-e3e35e6504ba tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:11.088620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f08230-7949-4514-9f56-e3e35e6504ba tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:11.226639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d2f08230-7949-4514-9f56-e3e35e6504ba tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:11.234911 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d2f08230-7949-4514-9f56-e3e35e6504ba tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.168786 Oct 29 03:48:11.235488 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3630/7212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:11 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:12.260998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e5e6279-7be9-4e1a-94b2-ecdf90e7188a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:12.261568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0e5e6279-7be9-4e1a-94b2-ecdf90e7188a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:12.270172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e5e6279-7be9-4e1a-94b2-ecdf90e7188a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:12.270745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e5e6279-7be9-4e1a-94b2-ecdf90e7188a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:12.271275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e5e6279-7be9-4e1a-94b2-ecdf90e7188a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:12.272105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e5e6279-7be9-4e1a-94b2-ecdf90e7188a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:12.272696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e5e6279-7be9-4e1a-94b2-ecdf90e7188a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:12.273192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e5e6279-7be9-4e1a-94b2-ecdf90e7188a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:12.412485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0e5e6279-7be9-4e1a-94b2-ecdf90e7188a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:12.420893 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e5e6279-7be9-4e1a-94b2-ecdf90e7188a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.165676 Oct 29 03:48:12.421441 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3583/7213] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:12 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:13.458498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b5c1f483-d6e4-447b-a136-c64cbef219cc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:13.459454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b5c1f483-d6e4-447b-a136-c64cbef219cc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:13.467178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c1f483-d6e4-447b-a136-c64cbef219cc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:13.467655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c1f483-d6e4-447b-a136-c64cbef219cc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:13.468078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c1f483-d6e4-447b-a136-c64cbef219cc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:13.468766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c1f483-d6e4-447b-a136-c64cbef219cc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:13.469206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c1f483-d6e4-447b-a136-c64cbef219cc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:13.469621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b5c1f483-d6e4-447b-a136-c64cbef219cc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:13.608581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b5c1f483-d6e4-447b-a136-c64cbef219cc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:13.617795 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b5c1f483-d6e4-447b-a136-c64cbef219cc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.166046 Oct 29 03:48:13.618423 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3631/7214] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:13 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:14.645330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2b50a8ea-86a2-4a0f-8a68-4542dde0e5ae tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:14.646517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2b50a8ea-86a2-4a0f-8a68-4542dde0e5ae tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:14.658149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b50a8ea-86a2-4a0f-8a68-4542dde0e5ae tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:14.658966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b50a8ea-86a2-4a0f-8a68-4542dde0e5ae tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:14.659693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b50a8ea-86a2-4a0f-8a68-4542dde0e5ae tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:14.660849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b50a8ea-86a2-4a0f-8a68-4542dde0e5ae tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:14.661612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b50a8ea-86a2-4a0f-8a68-4542dde0e5ae tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:14.662367 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b50a8ea-86a2-4a0f-8a68-4542dde0e5ae tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:14.665402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:14.797058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2b50a8ea-86a2-4a0f-8a68-4542dde0e5ae tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:14.807533 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2b50a8ea-86a2-4a0f-8a68-4542dde0e5ae tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.168691 Oct 29 03:48:14.808120 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3584/7215] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:14 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:15.835288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b8e06fa-9a71-4a2e-8ae0-02f96d0e3cbe tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:15.836149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b8e06fa-9a71-4a2e-8ae0-02f96d0e3cbe tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:15.843466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b8e06fa-9a71-4a2e-8ae0-02f96d0e3cbe tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:15.843951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b8e06fa-9a71-4a2e-8ae0-02f96d0e3cbe tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:15.844385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b8e06fa-9a71-4a2e-8ae0-02f96d0e3cbe tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:15.845083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b8e06fa-9a71-4a2e-8ae0-02f96d0e3cbe tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:15.845536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b8e06fa-9a71-4a2e-8ae0-02f96d0e3cbe tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:15.845982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9b8e06fa-9a71-4a2e-8ae0-02f96d0e3cbe tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:15.986036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9b8e06fa-9a71-4a2e-8ae0-02f96d0e3cbe tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:15.994585 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b8e06fa-9a71-4a2e-8ae0-02f96d0e3cbe tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.166276 Oct 29 03:48:15.995174 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3632/7216] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:15 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:17.018391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ae9282f9-c034-47d4-bbcb-1ccd379ebebc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:17.019002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ae9282f9-c034-47d4-bbcb-1ccd379ebebc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:17.026324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae9282f9-c034-47d4-bbcb-1ccd379ebebc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:17.026819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae9282f9-c034-47d4-bbcb-1ccd379ebebc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:17.027260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae9282f9-c034-47d4-bbcb-1ccd379ebebc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:17.027969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae9282f9-c034-47d4-bbcb-1ccd379ebebc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:17.028504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae9282f9-c034-47d4-bbcb-1ccd379ebebc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:17.028949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae9282f9-c034-47d4-bbcb-1ccd379ebebc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:17.165927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ae9282f9-c034-47d4-bbcb-1ccd379ebebc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:17.174402 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ae9282f9-c034-47d4-bbcb-1ccd379ebebc tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.159920 Oct 29 03:48:17.174986 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3585/7217] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:17 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:18.199958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6b20102-bdb9-4800-a8ec-da0e83aef5f8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:18.200563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c6b20102-bdb9-4800-a8ec-da0e83aef5f8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:18.208136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6b20102-bdb9-4800-a8ec-da0e83aef5f8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:18.208624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6b20102-bdb9-4800-a8ec-da0e83aef5f8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:18.209050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6b20102-bdb9-4800-a8ec-da0e83aef5f8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:18.209751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6b20102-bdb9-4800-a8ec-da0e83aef5f8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:18.210252 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6b20102-bdb9-4800-a8ec-da0e83aef5f8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:18.210696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6b20102-bdb9-4800-a8ec-da0e83aef5f8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:18.359959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c6b20102-bdb9-4800-a8ec-da0e83aef5f8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:18.373017 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c6b20102-bdb9-4800-a8ec-da0e83aef5f8 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.178028 Oct 29 03:48:18.373979 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3633/7218] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:18 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:19.404134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b6212d72-747d-4b8b-b13e-82c1fe4c02c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:19.405122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b6212d72-747d-4b8b-b13e-82c1fe4c02c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:19.416720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6212d72-747d-4b8b-b13e-82c1fe4c02c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:19.417536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6212d72-747d-4b8b-b13e-82c1fe4c02c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:19.418353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6212d72-747d-4b8b-b13e-82c1fe4c02c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:19.419511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6212d72-747d-4b8b-b13e-82c1fe4c02c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:19.420259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6212d72-747d-4b8b-b13e-82c1fe4c02c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:19.420979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6212d72-747d-4b8b-b13e-82c1fe4c02c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:19.558134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b6212d72-747d-4b8b-b13e-82c1fe4c02c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:19.569102 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b6212d72-747d-4b8b-b13e-82c1fe4c02c7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.171456 Oct 29 03:48:19.570241 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3586/7219] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:19 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:20.595979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0e0d871e-167c-46bd-88bc-8afcdf99b51d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:20.596597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0e0d871e-167c-46bd-88bc-8afcdf99b51d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:20.605419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e0d871e-167c-46bd-88bc-8afcdf99b51d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:20.605933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e0d871e-167c-46bd-88bc-8afcdf99b51d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:20.606363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e0d871e-167c-46bd-88bc-8afcdf99b51d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:20.607033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e0d871e-167c-46bd-88bc-8afcdf99b51d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:20.607501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e0d871e-167c-46bd-88bc-8afcdf99b51d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:20.607916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e0d871e-167c-46bd-88bc-8afcdf99b51d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:20.610514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=81 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:20.752449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0e0d871e-167c-46bd-88bc-8afcdf99b51d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:20.761035 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0e0d871e-167c-46bd-88bc-8afcdf99b51d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1520 microversion: 2.1 time: 0.171163 Oct 29 03:48:20.761662 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3634/7220] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:20 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:21.444929 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4efe52c0-247e-4cb3-9fb8-7cbe8454da31 req-589427ef-34c5-4257-9700-f2ef103d27c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea7e347-06c1-4011-80bd-553b841d2f68", "name": "network-vif-unplugged", "status": "completed", "tag": "b41161aa-5eb2-49c4-ad80-7c9ef22b8163"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:21.456179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4efe52c0-247e-4cb3-9fb8-7cbe8454da31 req-589427ef-34c5-4257-9700-f2ef103d27c4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:21.456755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4efe52c0-247e-4cb3-9fb8-7cbe8454da31 req-589427ef-34c5-4257-9700-f2ef103d27c4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:21.457250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4efe52c0-247e-4cb3-9fb8-7cbe8454da31 req-589427ef-34c5-4257-9700-f2ef103d27c4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:21.474787 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4efe52c0-247e-4cb3-9fb8-7cbe8454da31 req-589427ef-34c5-4257-9700-f2ef103d27c4 service nova] Creating event network-vif-unplugged:b41161aa-5eb2-49c4-ad80-7c9ef22b8163 for instance 3ea7e347-06c1-4011-80bd-553b841d2f68 on n-h1-862964-4 Oct 29 03:48:21.480874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-4efe52c0-247e-4cb3-9fb8-7cbe8454da31 req-589427ef-34c5-4257-9700-f2ef103d27c4 service nova] Instance 3ea7e347-06c1-4011-80bd-553b841d2f68 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:48:21.494218 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4efe52c0-247e-4cb3-9fb8-7cbe8454da31 req-589427ef-34c5-4257-9700-f2ef103d27c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054371 Oct 29 03:48:21.494860 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3587/7221] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:21.784787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f220f4c1-c909-433b-89a1-1e31ebf32692 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:21.785392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f220f4c1-c909-433b-89a1-1e31ebf32692 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:21.792819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f220f4c1-c909-433b-89a1-1e31ebf32692 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:21.793315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f220f4c1-c909-433b-89a1-1e31ebf32692 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:21.793737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f220f4c1-c909-433b-89a1-1e31ebf32692 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:21.794471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f220f4c1-c909-433b-89a1-1e31ebf32692 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:21.794945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f220f4c1-c909-433b-89a1-1e31ebf32692 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:21.795332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f220f4c1-c909-433b-89a1-1e31ebf32692 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:21.936327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f220f4c1-c909-433b-89a1-1e31ebf32692 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:21.944429 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f220f4c1-c909-433b-89a1-1e31ebf32692 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1519 microversion: 2.1 time: 0.163456 Oct 29 03:48:21.945046 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3635/7222] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:21 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:22.973585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7425cfe-d390-48c4-a356-d56318e5b35d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:22.975206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7425cfe-d390-48c4-a356-d56318e5b35d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:22.977853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=34 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:22.983662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7425cfe-d390-48c4-a356-d56318e5b35d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:22.984151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7425cfe-d390-48c4-a356-d56318e5b35d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:22.984617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7425cfe-d390-48c4-a356-d56318e5b35d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:22.985319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7425cfe-d390-48c4-a356-d56318e5b35d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:22.985773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7425cfe-d390-48c4-a356-d56318e5b35d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:22.986222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7425cfe-d390-48c4-a356-d56318e5b35d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:23.133574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c7425cfe-d390-48c4-a356-d56318e5b35d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:23.141536 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7425cfe-d390-48c4-a356-d56318e5b35d tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1517 microversion: 2.1 time: 0.175407 Oct 29 03:48:23.142151 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3588/7223] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:22 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:23.518873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a5ea4814-b987-43fd-9776-fb1dc368f608 req-c526d4db-1e43-4c66-b6fa-e34d926462fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea7e347-06c1-4011-80bd-553b841d2f68", "tag": "b41161aa-5eb2-49c4-ad80-7c9ef22b8163"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:23.529510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a5ea4814-b987-43fd-9776-fb1dc368f608 req-c526d4db-1e43-4c66-b6fa-e34d926462fb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:23.530035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a5ea4814-b987-43fd-9776-fb1dc368f608 req-c526d4db-1e43-4c66-b6fa-e34d926462fb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:23.530452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a5ea4814-b987-43fd-9776-fb1dc368f608 req-c526d4db-1e43-4c66-b6fa-e34d926462fb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:23.542674 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a5ea4814-b987-43fd-9776-fb1dc368f608 req-c526d4db-1e43-4c66-b6fa-e34d926462fb service nova] Creating event network-changed:b41161aa-5eb2-49c4-ad80-7c9ef22b8163 for instance 3ea7e347-06c1-4011-80bd-553b841d2f68 on n-h1-862964-4 Oct 29 03:48:23.548404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-a5ea4814-b987-43fd-9776-fb1dc368f608 req-c526d4db-1e43-4c66-b6fa-e34d926462fb service nova] Instance 3ea7e347-06c1-4011-80bd-553b841d2f68 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:48:23.559998 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a5ea4814-b987-43fd-9776-fb1dc368f608 req-c526d4db-1e43-4c66-b6fa-e34d926462fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044733 Oct 29 03:48:23.561059 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3636/7224] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:24.167009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ca1a866b-7c04-41e8-a0a5-3ae1415bfc81 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:24.167596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ca1a866b-7c04-41e8-a0a5-3ae1415bfc81 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:24.174831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca1a866b-7c04-41e8-a0a5-3ae1415bfc81 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:24.175385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca1a866b-7c04-41e8-a0a5-3ae1415bfc81 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:24.175833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca1a866b-7c04-41e8-a0a5-3ae1415bfc81 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:24.176627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca1a866b-7c04-41e8-a0a5-3ae1415bfc81 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:24.177093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca1a866b-7c04-41e8-a0a5-3ae1415bfc81 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:24.177533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca1a866b-7c04-41e8-a0a5-3ae1415bfc81 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:24.336489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ca1a866b-7c04-41e8-a0a5-3ae1415bfc81 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:24.344890 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ca1a866b-7c04-41e8-a0a5-3ae1415bfc81 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1514 microversion: 2.1 time: 0.182095 Oct 29 03:48:24.345466 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3589/7225] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:24 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:24.369037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-860f0688-3c9f-46f9-be6e-2472e76be4bd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:24.369683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-860f0688-3c9f-46f9-be6e-2472e76be4bd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:24.376015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860f0688-3c9f-46f9-be6e-2472e76be4bd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:24.376492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860f0688-3c9f-46f9-be6e-2472e76be4bd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:24.376953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860f0688-3c9f-46f9-be6e-2472e76be4bd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:24.377634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860f0688-3c9f-46f9-be6e-2472e76be4bd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:24.378102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860f0688-3c9f-46f9-be6e-2472e76be4bd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:24.378513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-860f0688-3c9f-46f9-be6e-2472e76be4bd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:24.445248 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-860f0688-3c9f-46f9-be6e-2472e76be4bd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "POST /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68/action" status: 204 len: 0 microversion: 2.1 time: 0.080468 Oct 29 03:48:24.445930 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3637/7226] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:48:24 2022] POST /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:48:24.454528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9b70a4fd-ee12-4971-9cd1-fdf90c43a72f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:24.455174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9b70a4fd-ee12-4971-9cd1-fdf90c43a72f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:24.461693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b70a4fd-ee12-4971-9cd1-fdf90c43a72f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:24.462234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b70a4fd-ee12-4971-9cd1-fdf90c43a72f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:24.462691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b70a4fd-ee12-4971-9cd1-fdf90c43a72f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:24.463400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b70a4fd-ee12-4971-9cd1-fdf90c43a72f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:24.463860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b70a4fd-ee12-4971-9cd1-fdf90c43a72f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:24.464297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b70a4fd-ee12-4971-9cd1-fdf90c43a72f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:24.598784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9b70a4fd-ee12-4971-9cd1-fdf90c43a72f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:24.606976 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9b70a4fd-ee12-4971-9cd1-fdf90c43a72f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1514 microversion: 2.1 time: 0.156523 Oct 29 03:48:24.607563 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3590/7227] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:24 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:48:25.632861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4409233b-c2cd-467b-b10d-be7229de98c1 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:25.633733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4409233b-c2cd-467b-b10d-be7229de98c1 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:25.635833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=30 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:25.643599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4409233b-c2cd-467b-b10d-be7229de98c1 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:25.644179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4409233b-c2cd-467b-b10d-be7229de98c1 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:25.644685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4409233b-c2cd-467b-b10d-be7229de98c1 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:25.645524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4409233b-c2cd-467b-b10d-be7229de98c1 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:25.646071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4409233b-c2cd-467b-b10d-be7229de98c1 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:25.646581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4409233b-c2cd-467b-b10d-be7229de98c1 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:25.788504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4409233b-c2cd-467b-b10d-be7229de98c1 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:25.797411 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4409233b-c2cd-467b-b10d-be7229de98c1 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1514 microversion: 2.1 time: 0.169785 Oct 29 03:48:25.798069 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3638/7228] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:25 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:26.823450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94eb5ed1-2580-4be7-a1e1-3888cc39d5c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:26.824058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-94eb5ed1-2580-4be7-a1e1-3888cc39d5c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:26.834002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94eb5ed1-2580-4be7-a1e1-3888cc39d5c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:26.834511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94eb5ed1-2580-4be7-a1e1-3888cc39d5c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:26.834961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94eb5ed1-2580-4be7-a1e1-3888cc39d5c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:26.835717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94eb5ed1-2580-4be7-a1e1-3888cc39d5c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:26.836158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94eb5ed1-2580-4be7-a1e1-3888cc39d5c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:26.837167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94eb5ed1-2580-4be7-a1e1-3888cc39d5c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:26.976927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-94eb5ed1-2580-4be7-a1e1-3888cc39d5c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:26.985054 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94eb5ed1-2580-4be7-a1e1-3888cc39d5c9 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1506 microversion: 2.1 time: 0.166618 Oct 29 03:48:26.985611 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3591/7229] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:26 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:27.016548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7793d6ae-b56e-4b0f-b202-4e9797b6498e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:27.017206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7793d6ae-b56e-4b0f-b202-4e9797b6498e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:27.025020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7793d6ae-b56e-4b0f-b202-4e9797b6498e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:27.025602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7793d6ae-b56e-4b0f-b202-4e9797b6498e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:27.026075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7793d6ae-b56e-4b0f-b202-4e9797b6498e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:27.026761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7793d6ae-b56e-4b0f-b202-4e9797b6498e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:27.027204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7793d6ae-b56e-4b0f-b202-4e9797b6498e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:27.027619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7793d6ae-b56e-4b0f-b202-4e9797b6498e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:27.161316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7793d6ae-b56e-4b0f-b202-4e9797b6498e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:27.173963 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7793d6ae-b56e-4b0f-b202-4e9797b6498e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1506 microversion: 2.1 time: 0.161322 Oct 29 03:48:27.174765 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3639/7230] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:27 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:27.196518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2a9d8d16-c490-4db4-ba21-905b1b38f7dd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:27.197192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2a9d8d16-c490-4db4-ba21-905b1b38f7dd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:27.203857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a9d8d16-c490-4db4-ba21-905b1b38f7dd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:27.204345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a9d8d16-c490-4db4-ba21-905b1b38f7dd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:27.204839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a9d8d16-c490-4db4-ba21-905b1b38f7dd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:27.205529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a9d8d16-c490-4db4-ba21-905b1b38f7dd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:27.206041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a9d8d16-c490-4db4-ba21-905b1b38f7dd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:27.206479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2a9d8d16-c490-4db4-ba21-905b1b38f7dd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:27.344400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2a9d8d16-c490-4db4-ba21-905b1b38f7dd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:27.356388 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2a9d8d16-c490-4db4-ba21-905b1b38f7dd tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1506 microversion: 2.1 time: 0.163596 Oct 29 03:48:27.357238 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3592/7231] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:27 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:27.383681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b32a5173-a0ef-4356-941a-d59ce2d36dd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:27.384184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b32a5173-a0ef-4356-941a-d59ce2d36dd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:27.390521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b32a5173-a0ef-4356-941a-d59ce2d36dd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:27.391031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b32a5173-a0ef-4356-941a-d59ce2d36dd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:27.391436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b32a5173-a0ef-4356-941a-d59ce2d36dd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:27.392116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b32a5173-a0ef-4356-941a-d59ce2d36dd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:27.392554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b32a5173-a0ef-4356-941a-d59ce2d36dd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:27.392964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b32a5173-a0ef-4356-941a-d59ce2d36dd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:27.418234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b32a5173-a0ef-4356-941a-d59ce2d36dd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:48:27.505413 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b32a5173-a0ef-4356-941a-d59ce2d36dd6 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 204 len: 0 microversion: 2.1 time: 0.125583 Oct 29 03:48:27.506513 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3640/7232] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:48:27 2022] DELETE /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:48:27.524893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a14896f5-2abf-410d-9b46-8bd0a7a47e64 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:27.525506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a14896f5-2abf-410d-9b46-8bd0a7a47e64 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:27.532130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14896f5-2abf-410d-9b46-8bd0a7a47e64 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:27.532628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14896f5-2abf-410d-9b46-8bd0a7a47e64 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:27.533063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14896f5-2abf-410d-9b46-8bd0a7a47e64 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:27.533780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14896f5-2abf-410d-9b46-8bd0a7a47e64 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:27.534294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14896f5-2abf-410d-9b46-8bd0a7a47e64 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:27.534719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14896f5-2abf-410d-9b46-8bd0a7a47e64 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:27.561384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a14896f5-2abf-410d-9b46-8bd0a7a47e64 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:48:27.613538 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.compute.api [None req-a14896f5-2abf-410d-9b46-8bd0a7a47e64 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Instance is already in deleting state, ignoring this request Oct 29 03:48:27.614246 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a14896f5-2abf-410d-9b46-8bd0a7a47e64 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 204 len: 0 microversion: 2.1 time: 0.093758 Oct 29 03:48:27.615157 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3593/7233] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:48:27 2022] DELETE /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:48:27.624042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f1b9fd7-d1c9-4b5d-aba0-99d71dec6c57 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:27.624833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0f1b9fd7-d1c9-4b5d-aba0-99d71dec6c57 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:27.631583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f1b9fd7-d1c9-4b5d-aba0-99d71dec6c57 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:27.632139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f1b9fd7-d1c9-4b5d-aba0-99d71dec6c57 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:27.632673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f1b9fd7-d1c9-4b5d-aba0-99d71dec6c57 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:27.633448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f1b9fd7-d1c9-4b5d-aba0-99d71dec6c57 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:27.633991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f1b9fd7-d1c9-4b5d-aba0-99d71dec6c57 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:27.634510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f1b9fd7-d1c9-4b5d-aba0-99d71dec6c57 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:27.640739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-745a360c-cc80-44f4-aa06-f26da2a47405 req-255244c2-1585-4da0-b6ad-0c215cb99d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea7e347-06c1-4011-80bd-553b841d2f68", "name": "network-vif-plugged", "status": "completed", "tag": "b41161aa-5eb2-49c4-ad80-7c9ef22b8163"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:27.651928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-745a360c-cc80-44f4-aa06-f26da2a47405 req-255244c2-1585-4da0-b6ad-0c215cb99d36 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:27.652552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-745a360c-cc80-44f4-aa06-f26da2a47405 req-255244c2-1585-4da0-b6ad-0c215cb99d36 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:27.653451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-745a360c-cc80-44f4-aa06-f26da2a47405 req-255244c2-1585-4da0-b6ad-0c215cb99d36 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:27.668215 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-745a360c-cc80-44f4-aa06-f26da2a47405 req-255244c2-1585-4da0-b6ad-0c215cb99d36 service nova] Creating event network-vif-plugged:b41161aa-5eb2-49c4-ad80-7c9ef22b8163 for instance 3ea7e347-06c1-4011-80bd-553b841d2f68 on n-h1-862964-4 Oct 29 03:48:27.674093 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-745a360c-cc80-44f4-aa06-f26da2a47405 req-255244c2-1585-4da0-b6ad-0c215cb99d36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038879 Oct 29 03:48:27.674801 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3594/7234] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:27.772711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f1b9fd7-d1c9-4b5d-aba0-99d71dec6c57 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:27.780779 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f1b9fd7-d1c9-4b5d-aba0-99d71dec6c57 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1512 microversion: 2.1 time: 0.161375 Oct 29 03:48:27.781365 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3641/7235] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:27 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:48:28.808456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3d70226a-72f2-4272-92d4-99bb19977a55 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:28.809165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3d70226a-72f2-4272-92d4-99bb19977a55 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:28.817096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d70226a-72f2-4272-92d4-99bb19977a55 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:28.817517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d70226a-72f2-4272-92d4-99bb19977a55 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:28.817997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d70226a-72f2-4272-92d4-99bb19977a55 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:28.818708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d70226a-72f2-4272-92d4-99bb19977a55 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:28.819163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d70226a-72f2-4272-92d4-99bb19977a55 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:28.819590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d70226a-72f2-4272-92d4-99bb19977a55 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:29.015730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3d70226a-72f2-4272-92d4-99bb19977a55 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:29.026486 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3d70226a-72f2-4272-92d4-99bb19977a55 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1512 microversion: 2.1 time: 0.224251 Oct 29 03:48:29.027314 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3595/7236] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:28 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1512 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:29.411696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-657958ba-30e9-467c-9c03-d9e88ecf01ca req-531700e3-c63f-47fc-8345-069ee9298607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea7e347-06c1-4011-80bd-553b841d2f68", "name": "network-vif-deleted", "tag": "b41161aa-5eb2-49c4-ad80-7c9ef22b8163"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:29.424164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-657958ba-30e9-467c-9c03-d9e88ecf01ca req-531700e3-c63f-47fc-8345-069ee9298607 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:29.425042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-657958ba-30e9-467c-9c03-d9e88ecf01ca req-531700e3-c63f-47fc-8345-069ee9298607 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:29.425625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-657958ba-30e9-467c-9c03-d9e88ecf01ca req-531700e3-c63f-47fc-8345-069ee9298607 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:29.441596 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-657958ba-30e9-467c-9c03-d9e88ecf01ca req-531700e3-c63f-47fc-8345-069ee9298607 service nova] Creating event network-vif-deleted:b41161aa-5eb2-49c4-ad80-7c9ef22b8163 for instance 3ea7e347-06c1-4011-80bd-553b841d2f68 on n-h1-862964-4 Oct 29 03:48:29.446921 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-657958ba-30e9-467c-9c03-d9e88ecf01ca req-531700e3-c63f-47fc-8345-069ee9298607 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039253 Oct 29 03:48:29.447594 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3642/7237] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:30.051621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:30.052530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:30.059659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:30.060163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:30.060610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:30.061332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:30.061818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:30.062265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:30.100422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:30.100948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:30.101398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:30.101867 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lazy-loading 'fault' on Instance uuid 3ea7e347-06c1-4011-80bd-553b841d2f68 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:48:30.147604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c5f53b760d49bf81a9377773210a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676879256318463780dd131db996c8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:30.156251 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1a639115-b226-487d-aa8b-77fa865b465e tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 200 len: 1306 microversion: 2.1 time: 0.109059 Oct 29 03:48:30.157085 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3596/7238] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:30 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:31.185837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:31.186537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 3ea7e347-06c1-4011-80bd-553b841d2f68] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:31.193237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:31.193714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:31.194168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:31.194847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:31.195284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:31.195697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:31.209447 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] HTTP exception thrown: Instance 3ea7e347-06c1-4011-80bd-553b841d2f68 could not be found. Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Request method failure captured: Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 HTTP/1.1 Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKIjvalvtjVO22OkFjBOS3WP2fNesk1pXOnuba6_wP7BUOixrWQuPgwOFCwOWUYpyO914vt3q4euuUEdYyYhd0AQbC4x44dX0x2kkTUC0m3upqfeiCHQ6uEkVpmuzy4MR38g_lZ6SOiiQ2Jf-wU77VOC6dSo3tP_fSxhfwDoIe_D6MQ Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 676879256318463780dd131db996c8f3 Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1550102239 Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/676879256318463780dd131db996c8f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/676879256318463780dd131db996c8f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_676879256318463780dd131db996c8f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/676879256318463780dd131db996c8f3"}]}] Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerDiskConfigTestJSON-1550102239 Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 676879256318463780dd131db996c8f3 Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1550102239 Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerDiskConfigTestJSON-1550102239-project Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 20c5f53b760d49bf81a9377773210a24 Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerDiskConfigTestJSON-1550102239-project Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3ea7e347-06c1-4011-80bd-553b841d2f68 could not be found. Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3ea7e347-06c1-4011-80bd-553b841d2f68'} Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ea7e347-06c1-4011-80bd-553b841d2f68 could not be found. Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ea7e347-06c1-4011-80bd-553b841d2f68 could not be found. Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:48:31.211181 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.218591 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:31.218591 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:48:31.218591 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:48:31.218591 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:48:31.218591 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:48:31.218591 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ea7e347-06c1-4011-80bd-553b841d2f68 could not be found. Oct 29 03:48:31.218591 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.218591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Returning 404 to user: Instance 3ea7e347-06c1-4011-80bd-553b841d2f68 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:48:31.218591 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fa9c1c98-49fe-46bb-90b5-85e3af44db0a tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68" status: 404 len: 111 microversion: 2.1 time: 0.034723 Oct 29 03:48:31.218591 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3643/7239] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:31 2022] GET /compute/v2.1/servers/3ea7e347-06c1-4011-80bd-553b841d2f68 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:48:31.221432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6dfb2886-1799-4ec3-a39c-a57d195c947f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '.version_select at 0x7fe1acc43310>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:31.250550 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6dfb2886-1799-4ec3-a39c-a57d195c947f tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-76130718" status: 202 len: 0 microversion: 2.1 time: 0.032969 Oct 29 03:48:31.251124 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3597/7240] 10.222.0.16 () {58 vars in 1215 bytes} [Sat Oct 29 03:48:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-76130718 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:48:31.860140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:31.860626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:31.867113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:31.867586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:31.868101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:31.868770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:31.869209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:31.869620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:31.883269 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] HTTP exception thrown: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Request method failure captured: Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f HTTP/1.1 Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKIjvalvtjVO22OkFjBOS3WP2fNesk1pXOnuba6_wP7BUOixrWQuPgwOFCwOWUYpyO914vt3q4euuUEdYyYhd0AQbC4x44dX0x2kkTUC0m3upqfeiCHQ6uEkVpmuzy4MR38g_lZ6SOiiQ2Jf-wU77VOC6dSo3tP_fSxhfwDoIe_D6MQ Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 676879256318463780dd131db996c8f3 Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1550102239 Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/676879256318463780dd131db996c8f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/676879256318463780dd131db996c8f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_676879256318463780dd131db996c8f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/676879256318463780dd131db996c8f3"}]}] Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerDiskConfigTestJSON-1550102239 Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 676879256318463780dd131db996c8f3 Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1550102239 Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerDiskConfigTestJSON-1550102239-project Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 20c5f53b760d49bf81a9377773210a24 Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerDiskConfigTestJSON-1550102239-project Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '4832b8d3-9285-48e8-86b0-13f43735488f'} Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:48:31.884864 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Returning 404 to user: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-771bc0d1-f8ae-4944-a19c-d73c4e1b22a7 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 404 len: 111 microversion: 2.1 time: 0.030258 Oct 29 03:48:31.889434 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3644/7241] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:48:31 2022] DELETE /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:48:31.894972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:31.895589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] [instance: 4832b8d3-9285-48e8-86b0-13f43735488f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:31.902360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:31.903022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:31.903468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:31.904163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:31.904624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:31.905053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:31.918332 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] HTTP exception thrown: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Request method failure captured: Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f HTTP/1.1 Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKIjvalvtjVO22OkFjBOS3WP2fNesk1pXOnuba6_wP7BUOixrWQuPgwOFCwOWUYpyO914vt3q4euuUEdYyYhd0AQbC4x44dX0x2kkTUC0m3upqfeiCHQ6uEkVpmuzy4MR38g_lZ6SOiiQ2Jf-wU77VOC6dSo3tP_fSxhfwDoIe_D6MQ Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 676879256318463780dd131db996c8f3 Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1550102239 Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/676879256318463780dd131db996c8f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/676879256318463780dd131db996c8f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_676879256318463780dd131db996c8f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/676879256318463780dd131db996c8f3"}]}] Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerDiskConfigTestJSON-1550102239 Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 676879256318463780dd131db996c8f3 Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1550102239 Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerDiskConfigTestJSON-1550102239-project Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 20c5f53b760d49bf81a9377773210a24 Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerDiskConfigTestJSON-1550102239-project Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '4832b8d3-9285-48e8-86b0-13f43735488f'} Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:48:31.919992 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.927176 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:31.927176 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:48:31.927176 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:48:31.927176 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:48:31.927176 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:48:31.927176 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. Oct 29 03:48:31.927176 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:48:31.927176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] Returning 404 to user: Instance 4832b8d3-9285-48e8-86b0-13f43735488f could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:48:31.927176 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-70c52038-2358-4197-8cd0-0a2e83965a82 tempest-ServerDiskConfigTestJSON-1550102239 tempest-ServerDiskConfigTestJSON-1550102239-project] 10.222.0.16 "GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f" status: 404 len: 111 microversion: 2.1 time: 0.030438 Oct 29 03:48:31.927176 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3598/7242] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:31 2022] GET /compute/v2.1/servers/4832b8d3-9285-48e8-86b0-13f43735488f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:48:40.960226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-383cb732-8824-4eae-9c53-2df626f988b3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'create', calling method: .version_select at 0x7fe1a8551310>, body: {"keypair": {"name": "tempest-keypair-2070687314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFubSNeg5eOnGZBinybdHyDEiJV7JKSYK3jxSwDTmund1e5+y0D7XbK2YnpdwoEKoudkoBTl+JclqRcNGKbPoXyYITYhgez0r6ikTdEr+mQPhEm5w0eS95GuLOc/+De5tA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:40.977133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-383cb732-8824-4eae-9c53-2df626f988b3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for project 4579636d272d407bae3af31a24201bb9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:48:40.982529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-383cb732-8824-4eae-9c53-2df626f988b3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for user d88f049383ec4971b8c92bfde389e873 and project 4579636d272d407bae3af31a24201bb9. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:48:41.010812 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-383cb732-8824-4eae-9c53-2df626f988b3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209227 Oct 29 03:48:41.011331 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3645/7243] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:48:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:42.362242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1395961951", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4aafb772-aedb-4bf4-bd4c-0aa7d4b31f9a"}], "security_groups": [{"name": "tempest-securitygroup--65035578"}], "key_name": "tempest-keypair-2070687314", "user_data": "}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:42.383518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:42.384679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:42.472088 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] validate_networks() for [('4aafb772-aedb-4bf4-bd4c-0aa7d4b31f9a', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:48:42.880361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:48:42.881118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:48:42.881663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:48:42.882171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:48:42.882632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:48:42.892459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:42.892965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:42.893412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:42.894206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:42.894676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:42.895113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:42.912457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:48:42.918157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for user d88f049383ec4971b8c92bfde389e873 and project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:48:42.931537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:48:42.933899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:48:42.984702 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d642e80f-81ff-402e-8005-c89d4a134559 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.627011 Oct 29 03:48:42.985668 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3599/7244] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:48:42 2022] POST /compute/v2.1/servers => generated 407 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:48:42.998176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-889d7af3-edcc-4f7f-9c4d-608d055ce14a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:42.998776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-889d7af3-edcc-4f7f-9c4d-608d055ce14a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:43.002934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:43.064990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-889d7af3-edcc-4f7f-9c4d-608d055ce14a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:43.072359 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-889d7af3-edcc-4f7f-9c4d-608d055ce14a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1239 microversion: 2.1 time: 0.078921 Oct 29 03:48:43.073560 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3646/7245] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:42 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:44.104333 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0976a8fc-46c8-4885-a4a9-daf83d8c07ed tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:44.105099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0976a8fc-46c8-4885-a4a9-daf83d8c07ed tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:44.113518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0976a8fc-46c8-4885-a4a9-daf83d8c07ed tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:44.114252 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0976a8fc-46c8-4885-a4a9-daf83d8c07ed tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:44.114694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0976a8fc-46c8-4885-a4a9-daf83d8c07ed tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:44.115411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0976a8fc-46c8-4885-a4a9-daf83d8c07ed tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:44.116047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0976a8fc-46c8-4885-a4a9-daf83d8c07ed tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:44.116460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0976a8fc-46c8-4885-a4a9-daf83d8c07ed tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:44.193782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0976a8fc-46c8-4885-a4a9-daf83d8c07ed tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:44.203471 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0976a8fc-46c8-4885-a4a9-daf83d8c07ed tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1291 microversion: 2.1 time: 0.111019 Oct 29 03:48:44.204188 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3600/7246] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:44 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1291 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:48:45.227972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eb912103-442b-4d73-b66f-58edc55aceb4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:45.228550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eb912103-442b-4d73-b66f-58edc55aceb4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:45.237739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb912103-442b-4d73-b66f-58edc55aceb4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:45.238601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb912103-442b-4d73-b66f-58edc55aceb4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:45.239029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb912103-442b-4d73-b66f-58edc55aceb4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:45.239952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb912103-442b-4d73-b66f-58edc55aceb4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:45.240399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb912103-442b-4d73-b66f-58edc55aceb4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:45.241246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eb912103-442b-4d73-b66f-58edc55aceb4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:45.378951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eb912103-442b-4d73-b66f-58edc55aceb4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:45.387274 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eb912103-442b-4d73-b66f-58edc55aceb4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1363 microversion: 2.1 time: 0.163630 Oct 29 03:48:45.387935 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3647/7247] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:45 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:45.771704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-cfbcb5f9-5560-4eb1-9fae-25cb8a4d5e52 req-9968cabd-1d42-49c9-9599-73c44c53afdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625b606e-742e-4546-832b-4b3006f5b08e", "tag": "e3b6e354-cc8e-4c14-a146-7c70500cd516"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:45.783449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cfbcb5f9-5560-4eb1-9fae-25cb8a4d5e52 req-9968cabd-1d42-49c9-9599-73c44c53afdb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:45.784011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cfbcb5f9-5560-4eb1-9fae-25cb8a4d5e52 req-9968cabd-1d42-49c9-9599-73c44c53afdb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:45.785438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cfbcb5f9-5560-4eb1-9fae-25cb8a4d5e52 req-9968cabd-1d42-49c9-9599-73c44c53afdb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:45.798169 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-cfbcb5f9-5560-4eb1-9fae-25cb8a4d5e52 req-9968cabd-1d42-49c9-9599-73c44c53afdb service nova] Creating event network-changed:e3b6e354-cc8e-4c14-a146-7c70500cd516 for instance 625b606e-742e-4546-832b-4b3006f5b08e on n-h1-862964-4 Oct 29 03:48:45.803626 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-cfbcb5f9-5560-4eb1-9fae-25cb8a4d5e52 req-9968cabd-1d42-49c9-9599-73c44c53afdb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037345 Oct 29 03:48:45.804273 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3601/7248] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:46.413437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a9c62906-10ac-404a-b37f-88562801a4ba tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:46.414205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a9c62906-10ac-404a-b37f-88562801a4ba tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:46.423246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c62906-10ac-404a-b37f-88562801a4ba tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:46.423737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c62906-10ac-404a-b37f-88562801a4ba tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:46.424176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c62906-10ac-404a-b37f-88562801a4ba tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:46.424864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c62906-10ac-404a-b37f-88562801a4ba tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:46.425323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c62906-10ac-404a-b37f-88562801a4ba tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:46.425748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a9c62906-10ac-404a-b37f-88562801a4ba tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:46.574095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a9c62906-10ac-404a-b37f-88562801a4ba tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:46.582427 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a9c62906-10ac-404a-b37f-88562801a4ba tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1363 microversion: 2.1 time: 0.174447 Oct 29 03:48:46.583022 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3648/7249] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:46 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:47.605649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0c4a7e8e-771e-4d96-a392-c25f31c95308 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:47.607271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0c4a7e8e-771e-4d96-a392-c25f31c95308 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:47.615165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c4a7e8e-771e-4d96-a392-c25f31c95308 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:47.615629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c4a7e8e-771e-4d96-a392-c25f31c95308 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:47.616273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c4a7e8e-771e-4d96-a392-c25f31c95308 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:47.617128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c4a7e8e-771e-4d96-a392-c25f31c95308 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:47.617628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c4a7e8e-771e-4d96-a392-c25f31c95308 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:47.618056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0c4a7e8e-771e-4d96-a392-c25f31c95308 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:47.839923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0c4a7e8e-771e-4d96-a392-c25f31c95308 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:47.848335 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0c4a7e8e-771e-4d96-a392-c25f31c95308 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1363 microversion: 2.1 time: 0.247169 Oct 29 03:48:47.848918 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3602/7250] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:47 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:48.875752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-99832b48-7596-4f87-a8ab-f550c6b11d6c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:48.876499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-99832b48-7596-4f87-a8ab-f550c6b11d6c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:48.885976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99832b48-7596-4f87-a8ab-f550c6b11d6c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:48.886625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99832b48-7596-4f87-a8ab-f550c6b11d6c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:48.887206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99832b48-7596-4f87-a8ab-f550c6b11d6c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:48.888129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99832b48-7596-4f87-a8ab-f550c6b11d6c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:48.888754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99832b48-7596-4f87-a8ab-f550c6b11d6c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:48.889317 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-99832b48-7596-4f87-a8ab-f550c6b11d6c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:49.033839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-99832b48-7596-4f87-a8ab-f550c6b11d6c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:49.042122 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-99832b48-7596-4f87-a8ab-f550c6b11d6c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1363 microversion: 2.1 time: 0.172565 Oct 29 03:48:49.042704 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3649/7251] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:48 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:49.730345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-7433b094-9ea0-4ced-a9e1-569af0804930 req-27e40256-51ac-485e-95e1-abe862b4d97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625b606e-742e-4546-832b-4b3006f5b08e", "name": "network-vif-plugged", "status": "completed", "tag": "e3b6e354-cc8e-4c14-a146-7c70500cd516"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:49.742944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7433b094-9ea0-4ced-a9e1-569af0804930 req-27e40256-51ac-485e-95e1-abe862b4d97f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:49.743424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7433b094-9ea0-4ced-a9e1-569af0804930 req-27e40256-51ac-485e-95e1-abe862b4d97f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:49.743864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-7433b094-9ea0-4ced-a9e1-569af0804930 req-27e40256-51ac-485e-95e1-abe862b4d97f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:49.755911 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-7433b094-9ea0-4ced-a9e1-569af0804930 req-27e40256-51ac-485e-95e1-abe862b4d97f service nova] Creating event network-vif-plugged:e3b6e354-cc8e-4c14-a146-7c70500cd516 for instance 625b606e-742e-4546-832b-4b3006f5b08e on n-h1-862964-4 Oct 29 03:48:49.761018 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-7433b094-9ea0-4ced-a9e1-569af0804930 req-27e40256-51ac-485e-95e1-abe862b4d97f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035952 Oct 29 03:48:49.761627 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3603/7252] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:50.073181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de00a9f0-cfdf-4013-b623-67b0889d0dae tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:50.073973 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-de00a9f0-cfdf-4013-b623-67b0889d0dae tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:50.081762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de00a9f0-cfdf-4013-b623-67b0889d0dae tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:50.082273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de00a9f0-cfdf-4013-b623-67b0889d0dae tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:50.082698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de00a9f0-cfdf-4013-b623-67b0889d0dae tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:50.083385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de00a9f0-cfdf-4013-b623-67b0889d0dae tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:50.083828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de00a9f0-cfdf-4013-b623-67b0889d0dae tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:50.084246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de00a9f0-cfdf-4013-b623-67b0889d0dae tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:50.230121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-de00a9f0-cfdf-4013-b623-67b0889d0dae tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:50.238662 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de00a9f0-cfdf-4013-b623-67b0889d0dae tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1363 microversion: 2.1 time: 0.170396 Oct 29 03:48:50.239242 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3650/7253] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:50 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:51.267036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ef7add95-5e40-4fe4-90d6-c68648ef9cfc tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:51.267980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ef7add95-5e40-4fe4-90d6-c68648ef9cfc tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:51.277401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef7add95-5e40-4fe4-90d6-c68648ef9cfc tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:51.278190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef7add95-5e40-4fe4-90d6-c68648ef9cfc tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:51.278897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef7add95-5e40-4fe4-90d6-c68648ef9cfc tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:51.279603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef7add95-5e40-4fe4-90d6-c68648ef9cfc tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:51.280060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef7add95-5e40-4fe4-90d6-c68648ef9cfc tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:51.280488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ef7add95-5e40-4fe4-90d6-c68648ef9cfc tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:51.427789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ef7add95-5e40-4fe4-90d6-c68648ef9cfc tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:51.439683 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ef7add95-5e40-4fe4-90d6-c68648ef9cfc tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1551 microversion: 2.1 time: 0.179883 Oct 29 03:48:51.440392 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3604/7254] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:51 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1551 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:51.463170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5a8674cc-045d-48de-8381-65e1910e013c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:51.463724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5a8674cc-045d-48de-8381-65e1910e013c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:51.471295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a8674cc-045d-48de-8381-65e1910e013c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:51.471773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a8674cc-045d-48de-8381-65e1910e013c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:51.472199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a8674cc-045d-48de-8381-65e1910e013c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:51.472882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a8674cc-045d-48de-8381-65e1910e013c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:51.473327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a8674cc-045d-48de-8381-65e1910e013c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:51.473743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a8674cc-045d-48de-8381-65e1910e013c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:51.557359 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5a8674cc-045d-48de-8381-65e1910e013c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098014 Oct 29 03:48:51.558162 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3651/7255] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:48:51 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:52.555957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3c3dfbdf-5645-4f90-ae88-b4b42ee586a7 req-901eca36-580e-433a-bda9-3790bf68b7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625b606e-742e-4546-832b-4b3006f5b08e", "tag": "e3b6e354-cc8e-4c14-a146-7c70500cd516"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:52.566517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c3dfbdf-5645-4f90-ae88-b4b42ee586a7 req-901eca36-580e-433a-bda9-3790bf68b7e0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:52.566999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c3dfbdf-5645-4f90-ae88-b4b42ee586a7 req-901eca36-580e-433a-bda9-3790bf68b7e0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:52.567435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3c3dfbdf-5645-4f90-ae88-b4b42ee586a7 req-901eca36-580e-433a-bda9-3790bf68b7e0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:52.579632 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3c3dfbdf-5645-4f90-ae88-b4b42ee586a7 req-901eca36-580e-433a-bda9-3790bf68b7e0 service nova] Creating event network-changed:e3b6e354-cc8e-4c14-a146-7c70500cd516 for instance 625b606e-742e-4546-832b-4b3006f5b08e on n-h1-862964-4 Oct 29 03:48:52.584646 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3c3dfbdf-5645-4f90-ae88-b4b42ee586a7 req-901eca36-580e-433a-bda9-3790bf68b7e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032695 Oct 29 03:48:52.585289 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3605/7256] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:21.742734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:21.744167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:21.745721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=28 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:21.753145 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0036e0e-0996-464b-918a-f59462e35185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:21.754350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b0036e0e-0996-464b-918a-f59462e35185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:21.764273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0036e0e-0996-464b-918a-f59462e35185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:21.764757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0036e0e-0996-464b-918a-f59462e35185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:21.765184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0036e0e-0996-464b-918a-f59462e35185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:21.765897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0036e0e-0996-464b-918a-f59462e35185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:21.766337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0036e0e-0996-464b-918a-f59462e35185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:21.766751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0036e0e-0996-464b-918a-f59462e35185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:21.914098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b0036e0e-0996-464b-918a-f59462e35185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:21.923434 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b0036e0e-0996-464b-918a-f59462e35185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1669 microversion: 2.1 time: 0.183373 Oct 29 03:49:21.924256 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3652/7257] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:21 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1669 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:21.944309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:21.945090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:21.947180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:21.947958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=26 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:21.952113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-29a7147e-14e8-4dae-a30a-96e43756afe0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:21.952819 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-29a7147e-14e8-4dae-a30a-96e43756afe0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:21.961174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29a7147e-14e8-4dae-a30a-96e43756afe0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:21.962031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29a7147e-14e8-4dae-a30a-96e43756afe0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:21.962480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29a7147e-14e8-4dae-a30a-96e43756afe0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:21.963184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29a7147e-14e8-4dae-a30a-96e43756afe0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:21.963642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29a7147e-14e8-4dae-a30a-96e43756afe0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:21.964070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-29a7147e-14e8-4dae-a30a-96e43756afe0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:22.111257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-29a7147e-14e8-4dae-a30a-96e43756afe0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:22.119956 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-29a7147e-14e8-4dae-a30a-96e43756afe0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1669 microversion: 2.1 time: 0.176599 Oct 29 03:49:22.120547 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3606/7258] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:21 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:22.142246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4f8b83ad-fdcc-4106-96b0-e4e2848de1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:22.142845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4f8b83ad-fdcc-4106-96b0-e4e2848de1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:22.149349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f8b83ad-fdcc-4106-96b0-e4e2848de1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:22.149884 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f8b83ad-fdcc-4106-96b0-e4e2848de1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:22.150288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f8b83ad-fdcc-4106-96b0-e4e2848de1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:22.150979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f8b83ad-fdcc-4106-96b0-e4e2848de1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:22.151427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f8b83ad-fdcc-4106-96b0-e4e2848de1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:22.151844 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4f8b83ad-fdcc-4106-96b0-e4e2848de1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:22.296233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4f8b83ad-fdcc-4106-96b0-e4e2848de1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:22.307182 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4f8b83ad-fdcc-4106-96b0-e4e2848de1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1669 microversion: 2.1 time: 0.168935 Oct 29 03:49:22.307767 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3653/7259] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:22 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:22.330286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:22.332608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:22.339431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:22.339977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:22.340428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:22.341149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:22.341617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:22.342084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:22.371557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:22.377300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Old instance type m1.heat2, new instance type m1.heat {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:49:22.384426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:49:22.384858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:49:22.385343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:49:22.385756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:49:22.386220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:49:22.460825 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81d78ef2-534f-43f1-8d3b-84e10e0ae7ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e/action" status: 202 len: 0 microversion: 2.1 time: 0.134608 Oct 29 03:49:22.461500 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3607/7260] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:49:22 2022] POST /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:49:22.470731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ddbd21e4-7b2d-4d1f-b03a-884bd8e53099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:22.471353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ddbd21e4-7b2d-4d1f-b03a-884bd8e53099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:22.477624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddbd21e4-7b2d-4d1f-b03a-884bd8e53099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:22.478150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddbd21e4-7b2d-4d1f-b03a-884bd8e53099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:22.478558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddbd21e4-7b2d-4d1f-b03a-884bd8e53099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:22.479284 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddbd21e4-7b2d-4d1f-b03a-884bd8e53099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:22.479749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddbd21e4-7b2d-4d1f-b03a-884bd8e53099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:22.480154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ddbd21e4-7b2d-4d1f-b03a-884bd8e53099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:22.645942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ddbd21e4-7b2d-4d1f-b03a-884bd8e53099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:22.655272 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ddbd21e4-7b2d-4d1f-b03a-884bd8e53099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1678 microversion: 2.1 time: 0.188720 Oct 29 03:49:22.655969 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3654/7261] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:22 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:23.680769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5c6b565c-e012-450a-9ede-1ccf30138242 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:23.681374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5c6b565c-e012-450a-9ede-1ccf30138242 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:23.688914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6b565c-e012-450a-9ede-1ccf30138242 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:23.689408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6b565c-e012-450a-9ede-1ccf30138242 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:23.689893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6b565c-e012-450a-9ede-1ccf30138242 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:23.690613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6b565c-e012-450a-9ede-1ccf30138242 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:23.691077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6b565c-e012-450a-9ede-1ccf30138242 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:23.691509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5c6b565c-e012-450a-9ede-1ccf30138242 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:23.826901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5c6b565c-e012-450a-9ede-1ccf30138242 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:23.836048 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5c6b565c-e012-450a-9ede-1ccf30138242 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1678 microversion: 2.1 time: 0.160216 Oct 29 03:49:23.836660 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3608/7262] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:23 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:24.864281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a5398ab1-3593-4d64-ae89-58f67f8fd978 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:24.865278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a5398ab1-3593-4d64-ae89-58f67f8fd978 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:24.873677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5398ab1-3593-4d64-ae89-58f67f8fd978 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:24.874203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5398ab1-3593-4d64-ae89-58f67f8fd978 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:24.874621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5398ab1-3593-4d64-ae89-58f67f8fd978 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:24.875319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5398ab1-3593-4d64-ae89-58f67f8fd978 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:24.875760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5398ab1-3593-4d64-ae89-58f67f8fd978 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:24.876172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5398ab1-3593-4d64-ae89-58f67f8fd978 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:25.021003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a5398ab1-3593-4d64-ae89-58f67f8fd978 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:25.029708 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a5398ab1-3593-4d64-ae89-58f67f8fd978 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1683 microversion: 2.1 time: 0.172726 Oct 29 03:49:25.030340 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3655/7263] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:24 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:26.063342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-afe4ff9d-2218-4115-bfc6-c2f7519da3ab tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:26.063990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-afe4ff9d-2218-4115-bfc6-c2f7519da3ab tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:26.071416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afe4ff9d-2218-4115-bfc6-c2f7519da3ab tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:26.071941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afe4ff9d-2218-4115-bfc6-c2f7519da3ab tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:26.072482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afe4ff9d-2218-4115-bfc6-c2f7519da3ab tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:26.073182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afe4ff9d-2218-4115-bfc6-c2f7519da3ab tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:26.073640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afe4ff9d-2218-4115-bfc6-c2f7519da3ab tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:26.074100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afe4ff9d-2218-4115-bfc6-c2f7519da3ab tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:26.216665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-afe4ff9d-2218-4115-bfc6-c2f7519da3ab tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:26.224735 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-afe4ff9d-2218-4115-bfc6-c2f7519da3ab tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1683 microversion: 2.1 time: 0.165658 Oct 29 03:49:26.225313 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3609/7264] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:26 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:27.250669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-39ce5515-61d1-4b4f-bc5b-daafa3911b03 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:27.251307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-39ce5515-61d1-4b4f-bc5b-daafa3911b03 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:27.258842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ce5515-61d1-4b4f-bc5b-daafa3911b03 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:27.259344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ce5515-61d1-4b4f-bc5b-daafa3911b03 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:27.259754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ce5515-61d1-4b4f-bc5b-daafa3911b03 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:27.260440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ce5515-61d1-4b4f-bc5b-daafa3911b03 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:27.260883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ce5515-61d1-4b4f-bc5b-daafa3911b03 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:27.261300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-39ce5515-61d1-4b4f-bc5b-daafa3911b03 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:27.403382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-39ce5515-61d1-4b4f-bc5b-daafa3911b03 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:27.411865 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-39ce5515-61d1-4b4f-bc5b-daafa3911b03 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1683 microversion: 2.1 time: 0.165443 Oct 29 03:49:27.412486 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3656/7265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:27 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:28.441002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-357c0822-a402-4fbc-9c62-18c381250739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:28.442104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-357c0822-a402-4fbc-9c62-18c381250739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:28.452181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-357c0822-a402-4fbc-9c62-18c381250739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:28.452688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-357c0822-a402-4fbc-9c62-18c381250739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:28.453134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-357c0822-a402-4fbc-9c62-18c381250739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:28.453853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-357c0822-a402-4fbc-9c62-18c381250739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:28.454336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-357c0822-a402-4fbc-9c62-18c381250739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:28.454749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-357c0822-a402-4fbc-9c62-18c381250739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:28.606626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-357c0822-a402-4fbc-9c62-18c381250739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:28.615655 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-357c0822-a402-4fbc-9c62-18c381250739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1683 microversion: 2.1 time: 0.182188 Oct 29 03:49:28.616255 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3610/7266] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:28 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:29.642664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5cea84bb-37b9-4318-9564-65381c20c15f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:29.643524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5cea84bb-37b9-4318-9564-65381c20c15f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:29.653371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cea84bb-37b9-4318-9564-65381c20c15f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:29.653852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cea84bb-37b9-4318-9564-65381c20c15f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:29.654306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cea84bb-37b9-4318-9564-65381c20c15f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:29.654999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cea84bb-37b9-4318-9564-65381c20c15f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:29.655446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cea84bb-37b9-4318-9564-65381c20c15f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:29.655861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5cea84bb-37b9-4318-9564-65381c20c15f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:29.791472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5cea84bb-37b9-4318-9564-65381c20c15f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:29.800196 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5cea84bb-37b9-4318-9564-65381c20c15f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1683 microversion: 2.1 time: 0.163320 Oct 29 03:49:29.800785 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3657/7267] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:29 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:30.826603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7bf6e843-4f86-4c6d-8f41-b18ce803b348 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:30.827571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7bf6e843-4f86-4c6d-8f41-b18ce803b348 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:30.837698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bf6e843-4f86-4c6d-8f41-b18ce803b348 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:30.838388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bf6e843-4f86-4c6d-8f41-b18ce803b348 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:30.838834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bf6e843-4f86-4c6d-8f41-b18ce803b348 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:30.839739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bf6e843-4f86-4c6d-8f41-b18ce803b348 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:30.840295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bf6e843-4f86-4c6d-8f41-b18ce803b348 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:30.840770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bf6e843-4f86-4c6d-8f41-b18ce803b348 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:30.975836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7bf6e843-4f86-4c6d-8f41-b18ce803b348 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:30.984263 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7bf6e843-4f86-4c6d-8f41-b18ce803b348 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1683 microversion: 2.1 time: 0.163881 Oct 29 03:49:30.985034 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3611/7268] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:30 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:32.010271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2dc4fded-9a57-4436-a3f0-a3269b2c31e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:32.010979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2dc4fded-9a57-4436-a3f0-a3269b2c31e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:32.018770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dc4fded-9a57-4436-a3f0-a3269b2c31e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:32.019263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dc4fded-9a57-4436-a3f0-a3269b2c31e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:32.019729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dc4fded-9a57-4436-a3f0-a3269b2c31e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:32.020430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dc4fded-9a57-4436-a3f0-a3269b2c31e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:32.020885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dc4fded-9a57-4436-a3f0-a3269b2c31e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:32.021309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2dc4fded-9a57-4436-a3f0-a3269b2c31e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:32.157890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2dc4fded-9a57-4436-a3f0-a3269b2c31e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:32.166797 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2dc4fded-9a57-4436-a3f0-a3269b2c31e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1683 microversion: 2.1 time: 0.161585 Oct 29 03:49:32.167389 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3658/7269] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:32 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:33.191199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-24314474-3424-499b-a355-e2cd716476c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:33.191822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-24314474-3424-499b-a355-e2cd716476c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:33.199151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24314474-3424-499b-a355-e2cd716476c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:33.199655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24314474-3424-499b-a355-e2cd716476c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:33.200176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24314474-3424-499b-a355-e2cd716476c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:33.200877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24314474-3424-499b-a355-e2cd716476c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:33.201353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24314474-3424-499b-a355-e2cd716476c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:33.201787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24314474-3424-499b-a355-e2cd716476c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:33.345714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-24314474-3424-499b-a355-e2cd716476c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:33.359000 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-24314474-3424-499b-a355-e2cd716476c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1683 microversion: 2.1 time: 0.171473 Oct 29 03:49:33.359606 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3612/7270] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:33 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:34.387144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-808e4dd8-e5ff-456c-b8c1-7a75e802b5ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:34.388124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-808e4dd8-e5ff-456c-b8c1-7a75e802b5ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:34.395790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-808e4dd8-e5ff-456c-b8c1-7a75e802b5ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:34.396268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-808e4dd8-e5ff-456c-b8c1-7a75e802b5ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:34.396675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-808e4dd8-e5ff-456c-b8c1-7a75e802b5ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:34.397370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-808e4dd8-e5ff-456c-b8c1-7a75e802b5ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:34.397826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-808e4dd8-e5ff-456c-b8c1-7a75e802b5ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:34.398261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-808e4dd8-e5ff-456c-b8c1-7a75e802b5ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:34.425226 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:49:34.425420 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e (ip 10.222.0.16) !!! Oct 29 03:49:34.600249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-808e4dd8-e5ff-456c-b8c1-7a75e802b5ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:34.608517 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-808e4dd8-e5ff-456c-b8c1-7a75e802b5ff tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1683 microversion: 2.1 time: 0.227820 Oct 29 03:49:34.609141 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3659/7271] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:34 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1683 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:35.637151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81de84ae-8e95-42d5-a9bb-836fb2a1652e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:35.638230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81de84ae-8e95-42d5-a9bb-836fb2a1652e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:35.646437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81de84ae-8e95-42d5-a9bb-836fb2a1652e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:35.646938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81de84ae-8e95-42d5-a9bb-836fb2a1652e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:35.647380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81de84ae-8e95-42d5-a9bb-836fb2a1652e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:35.648089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81de84ae-8e95-42d5-a9bb-836fb2a1652e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:35.648556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81de84ae-8e95-42d5-a9bb-836fb2a1652e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:35.648992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81de84ae-8e95-42d5-a9bb-836fb2a1652e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:35.839193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-81de84ae-8e95-42d5-a9bb-836fb2a1652e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:35.847457 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81de84ae-8e95-42d5-a9bb-836fb2a1652e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1683 microversion: 2.1 time: 0.217275 Oct 29 03:49:35.848065 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3613/7272] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:35 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1683 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:36.871832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a85972f1-3142-4bff-aad3-3e1b3f03c185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:36.872427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a85972f1-3142-4bff-aad3-3e1b3f03c185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:36.879826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a85972f1-3142-4bff-aad3-3e1b3f03c185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:36.880289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a85972f1-3142-4bff-aad3-3e1b3f03c185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:36.880755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a85972f1-3142-4bff-aad3-3e1b3f03c185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:36.881453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a85972f1-3142-4bff-aad3-3e1b3f03c185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:36.881931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a85972f1-3142-4bff-aad3-3e1b3f03c185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:36.882353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a85972f1-3142-4bff-aad3-3e1b3f03c185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:37.019816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1252811e-86c0-46ff-9d44-046f8581c2a6 req-4bc70a7e-677d-41c7-91e8-d3ca8840bef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625b606e-742e-4546-832b-4b3006f5b08e", "name": "network-vif-unplugged", "status": "completed", "tag": "e3b6e354-cc8e-4c14-a146-7c70500cd516"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:37.030111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1252811e-86c0-46ff-9d44-046f8581c2a6 req-4bc70a7e-677d-41c7-91e8-d3ca8840bef4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:37.030593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1252811e-86c0-46ff-9d44-046f8581c2a6 req-4bc70a7e-677d-41c7-91e8-d3ca8840bef4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:37.031027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1252811e-86c0-46ff-9d44-046f8581c2a6 req-4bc70a7e-677d-41c7-91e8-d3ca8840bef4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:37.043682 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1252811e-86c0-46ff-9d44-046f8581c2a6 req-4bc70a7e-677d-41c7-91e8-d3ca8840bef4 service nova] Creating event network-vif-unplugged:e3b6e354-cc8e-4c14-a146-7c70500cd516 for instance 625b606e-742e-4546-832b-4b3006f5b08e on n-h2-862964-4 Oct 29 03:49:37.049903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-1252811e-86c0-46ff-9d44-046f8581c2a6 req-4bc70a7e-677d-41c7-91e8-d3ca8840bef4 service nova] Instance 625b606e-742e-4546-832b-4b3006f5b08e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:49:37.061871 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1252811e-86c0-46ff-9d44-046f8581c2a6 req-4bc70a7e-677d-41c7-91e8-d3ca8840bef4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108089 Oct 29 03:49:37.062494 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3614/7273] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:37.145480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a85972f1-3142-4bff-aad3-3e1b3f03c185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:37.153678 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a85972f1-3142-4bff-aad3-3e1b3f03c185 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1682 microversion: 2.1 time: 0.285927 Oct 29 03:49:37.154319 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3660/7274] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:36 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1682 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:38.181641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a90c4245-f8c7-4486-b7fc-1b4f8d2e3c91 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:38.182790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a90c4245-f8c7-4486-b7fc-1b4f8d2e3c91 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:38.194283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a90c4245-f8c7-4486-b7fc-1b4f8d2e3c91 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:38.195034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a90c4245-f8c7-4486-b7fc-1b4f8d2e3c91 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:38.195718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a90c4245-f8c7-4486-b7fc-1b4f8d2e3c91 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:38.196839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a90c4245-f8c7-4486-b7fc-1b4f8d2e3c91 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:38.197555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a90c4245-f8c7-4486-b7fc-1b4f8d2e3c91 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:38.198269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a90c4245-f8c7-4486-b7fc-1b4f8d2e3c91 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:38.338434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a90c4245-f8c7-4486-b7fc-1b4f8d2e3c91 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:38.346708 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a90c4245-f8c7-4486-b7fc-1b4f8d2e3c91 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1680 microversion: 2.1 time: 0.171618 Oct 29 03:49:38.347348 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3615/7275] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:38 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:39.090015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ae5dbac8-e541-4541-b08e-85dc9d83bee4 req-5cacf586-9852-4b2b-99c4-458adb868f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625b606e-742e-4546-832b-4b3006f5b08e", "tag": "e3b6e354-cc8e-4c14-a146-7c70500cd516"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:39.102386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ae5dbac8-e541-4541-b08e-85dc9d83bee4 req-5cacf586-9852-4b2b-99c4-458adb868f26 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:39.103029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ae5dbac8-e541-4541-b08e-85dc9d83bee4 req-5cacf586-9852-4b2b-99c4-458adb868f26 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:39.103597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ae5dbac8-e541-4541-b08e-85dc9d83bee4 req-5cacf586-9852-4b2b-99c4-458adb868f26 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:39.122752 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ae5dbac8-e541-4541-b08e-85dc9d83bee4 req-5cacf586-9852-4b2b-99c4-458adb868f26 service nova] Creating event network-changed:e3b6e354-cc8e-4c14-a146-7c70500cd516 for instance 625b606e-742e-4546-832b-4b3006f5b08e on n-h2-862964-4 Oct 29 03:49:39.129150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-ae5dbac8-e541-4541-b08e-85dc9d83bee4 req-5cacf586-9852-4b2b-99c4-458adb868f26 service nova] Instance 625b606e-742e-4546-832b-4b3006f5b08e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:49:39.140322 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ae5dbac8-e541-4541-b08e-85dc9d83bee4 req-5cacf586-9852-4b2b-99c4-458adb868f26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056174 Oct 29 03:49:39.140915 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3661/7276] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:39.380503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2422d4ed-f090-4bcc-b929-26ffa6aca2a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:39.381084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2422d4ed-f090-4bcc-b929-26ffa6aca2a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:39.388050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2422d4ed-f090-4bcc-b929-26ffa6aca2a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:39.388512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2422d4ed-f090-4bcc-b929-26ffa6aca2a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:39.389264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2422d4ed-f090-4bcc-b929-26ffa6aca2a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:39.390204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2422d4ed-f090-4bcc-b929-26ffa6aca2a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:39.390667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2422d4ed-f090-4bcc-b929-26ffa6aca2a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:39.391087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2422d4ed-f090-4bcc-b929-26ffa6aca2a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:39.628930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2422d4ed-f090-4bcc-b929-26ffa6aca2a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:39.637710 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2422d4ed-f090-4bcc-b929-26ffa6aca2a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1680 microversion: 2.1 time: 0.261711 Oct 29 03:49:39.638823 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3616/7277] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:39 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:40.668400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a0f1c5cb-eed9-4410-804f-aaa148f5106b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:40.669542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a0f1c5cb-eed9-4410-804f-aaa148f5106b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:40.680462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0f1c5cb-eed9-4410-804f-aaa148f5106b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:40.681257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0f1c5cb-eed9-4410-804f-aaa148f5106b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:40.682103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0f1c5cb-eed9-4410-804f-aaa148f5106b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:40.683239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0f1c5cb-eed9-4410-804f-aaa148f5106b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:40.683991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0f1c5cb-eed9-4410-804f-aaa148f5106b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:40.684693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a0f1c5cb-eed9-4410-804f-aaa148f5106b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:40.824073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a0f1c5cb-eed9-4410-804f-aaa148f5106b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:40.832300 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a0f1c5cb-eed9-4410-804f-aaa148f5106b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1677 microversion: 2.1 time: 0.172611 Oct 29 03:49:40.832880 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3662/7278] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:40 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:40.855112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e1a2cbe8-897c-4bc7-8bf6-f0b0b7225a4d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:40.855663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e1a2cbe8-897c-4bc7-8bf6-f0b0b7225a4d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:40.862843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1a2cbe8-897c-4bc7-8bf6-f0b0b7225a4d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:40.863661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1a2cbe8-897c-4bc7-8bf6-f0b0b7225a4d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:40.864110 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1a2cbe8-897c-4bc7-8bf6-f0b0b7225a4d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:40.864825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1a2cbe8-897c-4bc7-8bf6-f0b0b7225a4d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:40.865295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1a2cbe8-897c-4bc7-8bf6-f0b0b7225a4d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:40.865731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1a2cbe8-897c-4bc7-8bf6-f0b0b7225a4d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:40.930866 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e1a2cbe8-897c-4bc7-8bf6-f0b0b7225a4d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e/action" status: 204 len: 0 microversion: 2.1 time: 0.079545 Oct 29 03:49:40.931528 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3617/7279] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:49:40 2022] POST /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:49:40.941190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a6f5e8a-9dda-487a-bf2d-7b344b8784db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:40.941796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1a6f5e8a-9dda-487a-bf2d-7b344b8784db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:40.948746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6f5e8a-9dda-487a-bf2d-7b344b8784db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:40.949609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6f5e8a-9dda-487a-bf2d-7b344b8784db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:40.950109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6f5e8a-9dda-487a-bf2d-7b344b8784db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:40.950798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6f5e8a-9dda-487a-bf2d-7b344b8784db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:40.952161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6f5e8a-9dda-487a-bf2d-7b344b8784db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:40.952787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a6f5e8a-9dda-487a-bf2d-7b344b8784db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:41.097609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1a6f5e8a-9dda-487a-bf2d-7b344b8784db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:41.106100 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1a6f5e8a-9dda-487a-bf2d-7b344b8784db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1677 microversion: 2.1 time: 0.170017 Oct 29 03:49:41.106880 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3663/7280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:40 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:41.505551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-3e78f07f-d31f-4f5a-8902-9fbb8a2dcea4 req-fa447238-a7fa-4e1a-8508-2d9fa677cba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625b606e-742e-4546-832b-4b3006f5b08e", "name": "network-vif-plugged", "status": "completed", "tag": "e3b6e354-cc8e-4c14-a146-7c70500cd516"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:41.520014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3e78f07f-d31f-4f5a-8902-9fbb8a2dcea4 req-fa447238-a7fa-4e1a-8508-2d9fa677cba9 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:41.520682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3e78f07f-d31f-4f5a-8902-9fbb8a2dcea4 req-fa447238-a7fa-4e1a-8508-2d9fa677cba9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:41.521349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-3e78f07f-d31f-4f5a-8902-9fbb8a2dcea4 req-fa447238-a7fa-4e1a-8508-2d9fa677cba9 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:41.536094 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-3e78f07f-d31f-4f5a-8902-9fbb8a2dcea4 req-fa447238-a7fa-4e1a-8508-2d9fa677cba9 service nova] Creating event network-vif-plugged:e3b6e354-cc8e-4c14-a146-7c70500cd516 for instance 625b606e-742e-4546-832b-4b3006f5b08e on n-h2-862964-4 Oct 29 03:49:41.550757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-3e78f07f-d31f-4f5a-8902-9fbb8a2dcea4 req-fa447238-a7fa-4e1a-8508-2d9fa677cba9 service nova] Instance 625b606e-742e-4546-832b-4b3006f5b08e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:49:41.567599 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-3e78f07f-d31f-4f5a-8902-9fbb8a2dcea4 req-fa447238-a7fa-4e1a-8508-2d9fa677cba9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067346 Oct 29 03:49:41.568607 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3618/7281] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:42.131046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-435c08b7-4bfb-4b46-8b1c-ae762e92bdfa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:42.131776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-435c08b7-4bfb-4b46-8b1c-ae762e92bdfa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:42.139133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-435c08b7-4bfb-4b46-8b1c-ae762e92bdfa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:42.139598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-435c08b7-4bfb-4b46-8b1c-ae762e92bdfa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:42.140025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-435c08b7-4bfb-4b46-8b1c-ae762e92bdfa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:42.140738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-435c08b7-4bfb-4b46-8b1c-ae762e92bdfa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:42.141356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-435c08b7-4bfb-4b46-8b1c-ae762e92bdfa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:42.141821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-435c08b7-4bfb-4b46-8b1c-ae762e92bdfa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:42.280446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-435c08b7-4bfb-4b46-8b1c-ae762e92bdfa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:42.289154 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-435c08b7-4bfb-4b46-8b1c-ae762e92bdfa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1677 microversion: 2.1 time: 0.162866 Oct 29 03:49:42.290308 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3664/7282] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:42 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:43.318298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-26114946-ed4c-4761-b479-58f1636439f4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:43.319479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-26114946-ed4c-4761-b479-58f1636439f4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:43.329791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26114946-ed4c-4761-b479-58f1636439f4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:43.330322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26114946-ed4c-4761-b479-58f1636439f4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:43.330771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26114946-ed4c-4761-b479-58f1636439f4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:43.331479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26114946-ed4c-4761-b479-58f1636439f4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:43.331941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26114946-ed4c-4761-b479-58f1636439f4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:43.332375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26114946-ed4c-4761-b479-58f1636439f4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:43.464681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-26114946-ed4c-4761-b479-58f1636439f4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:43.478086 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-26114946-ed4c-4761-b479-58f1636439f4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1669 microversion: 2.1 time: 0.166767 Oct 29 03:49:43.478890 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3619/7283] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:43 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:43.505197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-71409ba7-759f-47de-9d5b-22c75077a739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:43.506202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-71409ba7-759f-47de-9d5b-22c75077a739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:43.517086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71409ba7-759f-47de-9d5b-22c75077a739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:43.517885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71409ba7-759f-47de-9d5b-22c75077a739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:43.518467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71409ba7-759f-47de-9d5b-22c75077a739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:43.519540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71409ba7-759f-47de-9d5b-22c75077a739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:43.520183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71409ba7-759f-47de-9d5b-22c75077a739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:43.520816 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-71409ba7-759f-47de-9d5b-22c75077a739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:43.663045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-71409ba7-759f-47de-9d5b-22c75077a739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:43.674900 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-71409ba7-759f-47de-9d5b-22c75077a739 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1669 microversion: 2.1 time: 0.175849 Oct 29 03:49:43.675692 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3665/7284] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:43 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:43.698228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dcd129ed-4ba5-400b-9795-39d0223573cb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:43.698855 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dcd129ed-4ba5-400b-9795-39d0223573cb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:43.705174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd129ed-4ba5-400b-9795-39d0223573cb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:43.705674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd129ed-4ba5-400b-9795-39d0223573cb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:43.706151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd129ed-4ba5-400b-9795-39d0223573cb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:43.706854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd129ed-4ba5-400b-9795-39d0223573cb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:43.707354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd129ed-4ba5-400b-9795-39d0223573cb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:43.707791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcd129ed-4ba5-400b-9795-39d0223573cb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:43.846379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dcd129ed-4ba5-400b-9795-39d0223573cb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:43.850017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:43.860160 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dcd129ed-4ba5-400b-9795-39d0223573cb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1669 microversion: 2.1 time: 0.165453 Oct 29 03:49:43.860895 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3620/7285] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:43 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:43.882925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f26a533-5e43-4dc7-98a1-98e56c1d6a8e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:43.883408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f26a533-5e43-4dc7-98a1-98e56c1d6a8e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:43.889638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f26a533-5e43-4dc7-98a1-98e56c1d6a8e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:43.890151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f26a533-5e43-4dc7-98a1-98e56c1d6a8e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:43.890603 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f26a533-5e43-4dc7-98a1-98e56c1d6a8e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:43.891281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f26a533-5e43-4dc7-98a1-98e56c1d6a8e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:43.891720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f26a533-5e43-4dc7-98a1-98e56c1d6a8e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:43.892133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f26a533-5e43-4dc7-98a1-98e56c1d6a8e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:43.920598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f26a533-5e43-4dc7-98a1-98e56c1d6a8e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:49:43.999905 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f26a533-5e43-4dc7-98a1-98e56c1d6a8e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "DELETE /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 204 len: 0 microversion: 2.1 time: 0.120596 Oct 29 03:49:44.000541 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3666/7286] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:49:43 2022] DELETE /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:49:44.009734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bfc0b37c-89eb-4435-8294-1f8a4de07bea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:44.010431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bfc0b37c-89eb-4435-8294-1f8a4de07bea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:44.017743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfc0b37c-89eb-4435-8294-1f8a4de07bea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:44.018273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfc0b37c-89eb-4435-8294-1f8a4de07bea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:44.018729 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfc0b37c-89eb-4435-8294-1f8a4de07bea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:44.019446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfc0b37c-89eb-4435-8294-1f8a4de07bea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:44.019904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfc0b37c-89eb-4435-8294-1f8a4de07bea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:44.020343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bfc0b37c-89eb-4435-8294-1f8a4de07bea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:44.152898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bfc0b37c-89eb-4435-8294-1f8a4de07bea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:44.164893 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bfc0b37c-89eb-4435-8294-1f8a4de07bea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1675 microversion: 2.1 time: 0.159534 Oct 29 03:49:44.165700 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3621/7287] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:44 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:45.195364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-634cd65a-2ee1-4fdd-a468-e09b8709b951 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:45.196417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-634cd65a-2ee1-4fdd-a468-e09b8709b951 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:45.207911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-634cd65a-2ee1-4fdd-a468-e09b8709b951 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:45.208715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-634cd65a-2ee1-4fdd-a468-e09b8709b951 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:45.209425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-634cd65a-2ee1-4fdd-a468-e09b8709b951 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:45.210605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-634cd65a-2ee1-4fdd-a468-e09b8709b951 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:45.211338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-634cd65a-2ee1-4fdd-a468-e09b8709b951 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:45.212026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-634cd65a-2ee1-4fdd-a468-e09b8709b951 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:45.218190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:45.351023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-634cd65a-2ee1-4fdd-a468-e09b8709b951 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:45.359140 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-634cd65a-2ee1-4fdd-a468-e09b8709b951 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1675 microversion: 2.1 time: 0.171114 Oct 29 03:49:45.359721 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3667/7288] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:45 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:46.382764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c68e7721-7ad5-4be9-8e1d-6bf38e256a12 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:46.383292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c68e7721-7ad5-4be9-8e1d-6bf38e256a12 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:46.390711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c68e7721-7ad5-4be9-8e1d-6bf38e256a12 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:46.391265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c68e7721-7ad5-4be9-8e1d-6bf38e256a12 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:46.391713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c68e7721-7ad5-4be9-8e1d-6bf38e256a12 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:46.392450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c68e7721-7ad5-4be9-8e1d-6bf38e256a12 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:46.392913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c68e7721-7ad5-4be9-8e1d-6bf38e256a12 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:46.393345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c68e7721-7ad5-4be9-8e1d-6bf38e256a12 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:46.458904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c68e7721-7ad5-4be9-8e1d-6bf38e256a12 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:46.467544 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c68e7721-7ad5-4be9-8e1d-6bf38e256a12 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 200 len: 1609 microversion: 2.1 time: 0.088709 Oct 29 03:49:46.468427 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3622/7289] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:46 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 1609 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:46.477403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-824db3a7-1291-4487-a52e-953eb61c74a9 req-459c4694-182f-49d4-8ea2-13da9d1714ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625b606e-742e-4546-832b-4b3006f5b08e", "name": "network-vif-deleted", "tag": "e3b6e354-cc8e-4c14-a146-7c70500cd516"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:46.484318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-824db3a7-1291-4487-a52e-953eb61c74a9 req-459c4694-182f-49d4-8ea2-13da9d1714ac service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:46.484796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-824db3a7-1291-4487-a52e-953eb61c74a9 req-459c4694-182f-49d4-8ea2-13da9d1714ac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:46.485240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-824db3a7-1291-4487-a52e-953eb61c74a9 req-459c4694-182f-49d4-8ea2-13da9d1714ac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:46.497688 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-824db3a7-1291-4487-a52e-953eb61c74a9 req-459c4694-182f-49d4-8ea2-13da9d1714ac service nova] Creating event network-vif-deleted:e3b6e354-cc8e-4c14-a146-7c70500cd516 for instance 625b606e-742e-4546-832b-4b3006f5b08e on n-h2-862964-4 Oct 29 03:49:46.502873 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-824db3a7-1291-4487-a52e-953eb61c74a9 req-459c4694-182f-49d4-8ea2-13da9d1714ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032752 Oct 29 03:49:46.504005 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3668/7290] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:47.492382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:47.492997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:47.500603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:47.501278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:47.501688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:47.502441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:47.502901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:47.503329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:47.518154 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e HTTP/1.1 Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '625b606e-742e-4546-832b-4b3006f5b08e'} Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:49:47.519913 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:49:47.525491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:49:47.525491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:49:47.525491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:49:47.525491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:49:47.525491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:49:47.525491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:49:47.525491 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:49:47.525491 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:49:47.525491 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-97ded77a-e6f7-4556-b4ba-cda9cd91cd92 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 404 len: 111 microversion: 2.1 time: 0.033678 Oct 29 03:49:47.526642 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3623/7291] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:47 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:49:47.535414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:47.536111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:47.542434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:47.542921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:47.543349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:47.544036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:47.544484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:47.544906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:47.558836 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e HTTP/1.1 Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '625b606e-742e-4546-832b-4b3006f5b08e'} Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:49:47.560510 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:49:47.566256 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:49:47.566256 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:49:47.566256 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:49:47.566256 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:49:47.566256 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:49:47.566256 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:49:47.566256 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:49:47.566256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:49:47.566256 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a05bf296-842d-4352-8061-d03b18ec9c38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 404 len: 111 microversion: 2.1 time: 0.032274 Oct 29 03:49:47.566256 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3669/7292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:47 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:49:47.611071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2120101405", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "4aafb772-aedb-4bf4-bd4c-0aa7d4b31f9a"}], "security_groups": [{"name": "tempest-securitygroup--65035578"}], "key_name": "tempest-keypair-2070687314", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:47.722888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] validate_networks() for [('4aafb772-aedb-4bf4-bd4c-0aa7d4b31f9a', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:49:48.091883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:49:48.092317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:49:48.092899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:49:48.093413 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:49:48.093878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:49:48.103501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:48.104025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:48.104474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:48.105229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:48.105687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:48.106230 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:48.124870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:49:48.130825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for user d88f049383ec4971b8c92bfde389e873 and project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:49:48.145625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:49:48.148007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:49:48.197092 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-af7df9c7-21d3-4ecc-b794-dcf9a2144b9e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.590027 Oct 29 03:49:48.197726 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3624/7293] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:49:47 2022] POST /compute/v2.1/servers => generated 404 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:49:48.209620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9b8a2860-3107-4aa0-80c8-df7229e0cfb0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:48.210246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9b8a2860-3107-4aa0-80c8-df7229e0cfb0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:48.267953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9b8a2860-3107-4aa0-80c8-df7229e0cfb0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:48.275944 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9b8a2860-3107-4aa0-80c8-df7229e0cfb0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1239 microversion: 2.1 time: 0.070239 Oct 29 03:49:48.276518 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3670/7294] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:48 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:49.300976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7c169f2e-d9df-47fb-ae1d-0e6e44a802cf tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:49.301655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7c169f2e-d9df-47fb-ae1d-0e6e44a802cf tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:49.309122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c169f2e-d9df-47fb-ae1d-0e6e44a802cf tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:49.309617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c169f2e-d9df-47fb-ae1d-0e6e44a802cf tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:49.310091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c169f2e-d9df-47fb-ae1d-0e6e44a802cf tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:49.310806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c169f2e-d9df-47fb-ae1d-0e6e44a802cf tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:49.311299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c169f2e-d9df-47fb-ae1d-0e6e44a802cf tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:49.311710 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7c169f2e-d9df-47fb-ae1d-0e6e44a802cf tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:49.389840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7c169f2e-d9df-47fb-ae1d-0e6e44a802cf tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:49.398925 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7c169f2e-d9df-47fb-ae1d-0e6e44a802cf tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1291 microversion: 2.1 time: 0.102947 Oct 29 03:49:49.399770 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3625/7295] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:49 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1291 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:50.423894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-370fed5c-5964-4ee8-a7aa-f4413f888e02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:50.424457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-370fed5c-5964-4ee8-a7aa-f4413f888e02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:50.432296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-370fed5c-5964-4ee8-a7aa-f4413f888e02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:50.432744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-370fed5c-5964-4ee8-a7aa-f4413f888e02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:50.433389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-370fed5c-5964-4ee8-a7aa-f4413f888e02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:50.434124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-370fed5c-5964-4ee8-a7aa-f4413f888e02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:50.434572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-370fed5c-5964-4ee8-a7aa-f4413f888e02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:50.434991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-370fed5c-5964-4ee8-a7aa-f4413f888e02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:50.669374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-370fed5c-5964-4ee8-a7aa-f4413f888e02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:50.677744 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-370fed5c-5964-4ee8-a7aa-f4413f888e02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1363 microversion: 2.1 time: 0.258020 Oct 29 03:49:50.678303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3671/7296] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:50 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:50.871081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-2bb91803-4fec-4a73-8225-11a23de50c4e req-170572b7-20d1-4c98-9e06-bf7193665cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaecb16e-118a-4954-b28e-e98699ea7e92", "tag": "9f622f69-94e7-4043-b30b-c901058b5abb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:50.882049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2bb91803-4fec-4a73-8225-11a23de50c4e req-170572b7-20d1-4c98-9e06-bf7193665cd1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:50.882527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2bb91803-4fec-4a73-8225-11a23de50c4e req-170572b7-20d1-4c98-9e06-bf7193665cd1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:50.883154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2bb91803-4fec-4a73-8225-11a23de50c4e req-170572b7-20d1-4c98-9e06-bf7193665cd1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:50.895430 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-2bb91803-4fec-4a73-8225-11a23de50c4e req-170572b7-20d1-4c98-9e06-bf7193665cd1 service nova] Creating event network-changed:9f622f69-94e7-4043-b30b-c901058b5abb for instance aaecb16e-118a-4954-b28e-e98699ea7e92 on n-h2-862964-4 Oct 29 03:49:50.900290 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-2bb91803-4fec-4a73-8225-11a23de50c4e req-170572b7-20d1-4c98-9e06-bf7193665cd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032953 Oct 29 03:49:50.900883 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3626/7297] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:49:51.705334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cb249db1-9b44-4993-916c-11534a86601e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:51.706093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cb249db1-9b44-4993-916c-11534a86601e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:51.715093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb249db1-9b44-4993-916c-11534a86601e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:51.715693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb249db1-9b44-4993-916c-11534a86601e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:51.716234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb249db1-9b44-4993-916c-11534a86601e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:51.717088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb249db1-9b44-4993-916c-11534a86601e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:51.717649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb249db1-9b44-4993-916c-11534a86601e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:51.718206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cb249db1-9b44-4993-916c-11534a86601e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:51.860438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cb249db1-9b44-4993-916c-11534a86601e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:51.868765 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cb249db1-9b44-4993-916c-11534a86601e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1363 microversion: 2.1 time: 0.169420 Oct 29 03:49:51.869323 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3672/7298] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:51 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:52.901647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7d8da88f-4b6b-44d9-af37-d7ad73c31fe4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:52.902664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7d8da88f-4b6b-44d9-af37-d7ad73c31fe4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:52.905783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:52.915024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d8da88f-4b6b-44d9-af37-d7ad73c31fe4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:52.915852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d8da88f-4b6b-44d9-af37-d7ad73c31fe4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:52.916583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d8da88f-4b6b-44d9-af37-d7ad73c31fe4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:52.917739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d8da88f-4b6b-44d9-af37-d7ad73c31fe4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:52.918565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d8da88f-4b6b-44d9-af37-d7ad73c31fe4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:52.919284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7d8da88f-4b6b-44d9-af37-d7ad73c31fe4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:53.066224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7d8da88f-4b6b-44d9-af37-d7ad73c31fe4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:53.078354 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7d8da88f-4b6b-44d9-af37-d7ad73c31fe4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1363 microversion: 2.1 time: 0.185288 Oct 29 03:49:53.078942 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3627/7299] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:52 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:54.106660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8b27c5e0-42e2-4a6b-aa4c-480b2c85ceec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:54.107614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8b27c5e0-42e2-4a6b-aa4c-480b2c85ceec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:54.111917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:54.121415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b27c5e0-42e2-4a6b-aa4c-480b2c85ceec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:54.122155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b27c5e0-42e2-4a6b-aa4c-480b2c85ceec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:54.122871 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b27c5e0-42e2-4a6b-aa4c-480b2c85ceec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:54.124013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b27c5e0-42e2-4a6b-aa4c-480b2c85ceec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:54.124808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b27c5e0-42e2-4a6b-aa4c-480b2c85ceec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:54.125541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8b27c5e0-42e2-4a6b-aa4c-480b2c85ceec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:54.275359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8b27c5e0-42e2-4a6b-aa4c-480b2c85ceec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:54.283186 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8b27c5e0-42e2-4a6b-aa4c-480b2c85ceec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1363 microversion: 2.1 time: 0.183126 Oct 29 03:49:54.283742 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3673/7300] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:54 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:55.311428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cc25def3-f712-45d8-92be-cff7cd483594 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:55.312385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cc25def3-f712-45d8-92be-cff7cd483594 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:55.324469 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc25def3-f712-45d8-92be-cff7cd483594 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:55.325284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc25def3-f712-45d8-92be-cff7cd483594 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:55.326075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc25def3-f712-45d8-92be-cff7cd483594 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:55.328073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc25def3-f712-45d8-92be-cff7cd483594 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:55.328977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc25def3-f712-45d8-92be-cff7cd483594 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:55.329430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc25def3-f712-45d8-92be-cff7cd483594 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:55.464193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc25def3-f712-45d8-92be-cff7cd483594 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:55.472414 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cc25def3-f712-45d8-92be-cff7cd483594 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1363 microversion: 2.1 time: 0.167930 Oct 29 03:49:55.473004 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3628/7301] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:55 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:55.492643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d7a40bd3-862f-4544-9dd9-bc88f10a4681 req-171e6a98-a4d8-4fac-8524-bfeeee20a001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaecb16e-118a-4954-b28e-e98699ea7e92", "name": "network-vif-plugged", "status": "completed", "tag": "9f622f69-94e7-4043-b30b-c901058b5abb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:55.503619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7a40bd3-862f-4544-9dd9-bc88f10a4681 req-171e6a98-a4d8-4fac-8524-bfeeee20a001 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:55.504091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7a40bd3-862f-4544-9dd9-bc88f10a4681 req-171e6a98-a4d8-4fac-8524-bfeeee20a001 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:55.504519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7a40bd3-862f-4544-9dd9-bc88f10a4681 req-171e6a98-a4d8-4fac-8524-bfeeee20a001 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:55.515941 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d7a40bd3-862f-4544-9dd9-bc88f10a4681 req-171e6a98-a4d8-4fac-8524-bfeeee20a001 service nova] Creating event network-vif-plugged:9f622f69-94e7-4043-b30b-c901058b5abb for instance aaecb16e-118a-4954-b28e-e98699ea7e92 on n-h2-862964-4 Oct 29 03:49:55.520947 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d7a40bd3-862f-4544-9dd9-bc88f10a4681 req-171e6a98-a4d8-4fac-8524-bfeeee20a001 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032066 Oct 29 03:49:55.521737 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3674/7302] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:49:56.500753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-06e424c0-424f-4060-a974-d0d24d1c29d6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:56.501384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-06e424c0-424f-4060-a974-d0d24d1c29d6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:56.508765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06e424c0-424f-4060-a974-d0d24d1c29d6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:56.509292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06e424c0-424f-4060-a974-d0d24d1c29d6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:56.509705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06e424c0-424f-4060-a974-d0d24d1c29d6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:56.510455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06e424c0-424f-4060-a974-d0d24d1c29d6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:56.510920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06e424c0-424f-4060-a974-d0d24d1c29d6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:56.511351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-06e424c0-424f-4060-a974-d0d24d1c29d6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:56.652550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-06e424c0-424f-4060-a974-d0d24d1c29d6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:56.664340 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-06e424c0-424f-4060-a974-d0d24d1c29d6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1363 microversion: 2.1 time: 0.169833 Oct 29 03:49:56.665133 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3629/7303] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:56 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:57.695700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-194fc1c0-975b-4a83-b677-659a8784b46a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:57.696591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-194fc1c0-975b-4a83-b677-659a8784b46a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:57.705306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fc1c0-975b-4a83-b677-659a8784b46a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:57.706022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fc1c0-975b-4a83-b677-659a8784b46a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:57.706638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fc1c0-975b-4a83-b677-659a8784b46a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:57.707550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fc1c0-975b-4a83-b677-659a8784b46a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:57.708184 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fc1c0-975b-4a83-b677-659a8784b46a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:57.708745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-194fc1c0-975b-4a83-b677-659a8784b46a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:57.851580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-194fc1c0-975b-4a83-b677-659a8784b46a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:57.861361 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-194fc1c0-975b-4a83-b677-659a8784b46a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1551 microversion: 2.1 time: 0.172759 Oct 29 03:49:57.861982 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3675/7304] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:57 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1551 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:57.885191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b7c69120-e5ee-4994-a7d1-809071d69662 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:57.885728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b7c69120-e5ee-4994-a7d1-809071d69662 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:57.893331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c69120-e5ee-4994-a7d1-809071d69662 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:57.893831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c69120-e5ee-4994-a7d1-809071d69662 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:57.894302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c69120-e5ee-4994-a7d1-809071d69662 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:57.895017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c69120-e5ee-4994-a7d1-809071d69662 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:57.895485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c69120-e5ee-4994-a7d1-809071d69662 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:57.895900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b7c69120-e5ee-4994-a7d1-809071d69662 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:57.977388 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b7c69120-e5ee-4994-a7d1-809071d69662 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095786 Oct 29 03:49:57.978341 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3630/7305] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:49:57 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:58.956770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-77074b73-4f19-4863-a6ba-afa7266224e7 req-d8af1b94-477b-4d99-9a3d-e1b14dfbe307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaecb16e-118a-4954-b28e-e98699ea7e92", "tag": "9f622f69-94e7-4043-b30b-c901058b5abb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:58.961956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:58.969796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-77074b73-4f19-4863-a6ba-afa7266224e7 req-d8af1b94-477b-4d99-9a3d-e1b14dfbe307 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:58.970183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-77074b73-4f19-4863-a6ba-afa7266224e7 req-d8af1b94-477b-4d99-9a3d-e1b14dfbe307 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:58.970839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-77074b73-4f19-4863-a6ba-afa7266224e7 req-d8af1b94-477b-4d99-9a3d-e1b14dfbe307 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:58.982682 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-77074b73-4f19-4863-a6ba-afa7266224e7 req-d8af1b94-477b-4d99-9a3d-e1b14dfbe307 service nova] Creating event network-changed:9f622f69-94e7-4043-b30b-c901058b5abb for instance aaecb16e-118a-4954-b28e-e98699ea7e92 on n-h2-862964-4 Oct 29 03:49:58.988703 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-77074b73-4f19-4863-a6ba-afa7266224e7 req-d8af1b94-477b-4d99-9a3d-e1b14dfbe307 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035522 Oct 29 03:49:58.989335 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3676/7306] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:32.192473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:32.193599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:32.197015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:32.198188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=47 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:32.205386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9a6bb3d-4c69-4116-aaf6-ad1e83ca4c5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:32.218341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9a6bb3d-4c69-4116-aaf6-ad1e83ca4c5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:32.218838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9a6bb3d-4c69-4116-aaf6-ad1e83ca4c5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:32.219281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9a6bb3d-4c69-4116-aaf6-ad1e83ca4c5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:32.242885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9a6bb3d-4c69-4116-aaf6-ad1e83ca4c5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Going to try to stop instance {{(pid=127041) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:50:32.289957 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9a6bb3d-4c69-4116-aaf6-ad1e83ca4c5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92/action" status: 202 len: 0 microversion: 2.1 time: 0.098614 Oct 29 03:50:32.290560 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3631/7307] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:50:32 2022] POST /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:50:32.301312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ac581cef-f74a-46ab-bd13-7047a27595e9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:32.302168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ac581cef-f74a-46ab-bd13-7047a27595e9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:32.304693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=7 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:32.305408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=36 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:32.312606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac581cef-f74a-46ab-bd13-7047a27595e9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:32.313091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac581cef-f74a-46ab-bd13-7047a27595e9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:32.313524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac581cef-f74a-46ab-bd13-7047a27595e9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:32.314256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac581cef-f74a-46ab-bd13-7047a27595e9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:32.314698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac581cef-f74a-46ab-bd13-7047a27595e9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:32.315114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ac581cef-f74a-46ab-bd13-7047a27595e9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:32.452429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ac581cef-f74a-46ab-bd13-7047a27595e9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:32.461131 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ac581cef-f74a-46ab-bd13-7047a27595e9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1679 microversion: 2.1 time: 0.164260 Oct 29 03:50:32.461743 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3677/7308] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:32 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:33.489279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-afa1e493-3cb7-4545-9c9a-9215685f9a87 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:33.490094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-afa1e493-3cb7-4545-9c9a-9215685f9a87 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:33.497450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afa1e493-3cb7-4545-9c9a-9215685f9a87 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:33.498021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afa1e493-3cb7-4545-9c9a-9215685f9a87 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:33.498509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afa1e493-3cb7-4545-9c9a-9215685f9a87 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:33.499363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afa1e493-3cb7-4545-9c9a-9215685f9a87 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:33.499865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afa1e493-3cb7-4545-9c9a-9215685f9a87 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:33.500341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afa1e493-3cb7-4545-9c9a-9215685f9a87 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:33.639611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-afa1e493-3cb7-4545-9c9a-9215685f9a87 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:33.647711 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-afa1e493-3cb7-4545-9c9a-9215685f9a87 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1679 microversion: 2.1 time: 0.165085 Oct 29 03:50:33.648305 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3632/7309] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:33 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:50:34.684371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-35465965-7867-47ca-93ae-70c3f0501fe9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:34.685550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-35465965-7867-47ca-93ae-70c3f0501fe9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:34.693351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35465965-7867-47ca-93ae-70c3f0501fe9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:34.693841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35465965-7867-47ca-93ae-70c3f0501fe9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:34.694293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35465965-7867-47ca-93ae-70c3f0501fe9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:34.694988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35465965-7867-47ca-93ae-70c3f0501fe9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:34.695438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35465965-7867-47ca-93ae-70c3f0501fe9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:34.695859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35465965-7867-47ca-93ae-70c3f0501fe9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:34.828460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-35465965-7867-47ca-93ae-70c3f0501fe9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:34.836400 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-35465965-7867-47ca-93ae-70c3f0501fe9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1679 microversion: 2.1 time: 0.158604 Oct 29 03:50:34.836984 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3678/7310] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:34 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:35.863614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-049fdbe1-227b-4e46-a9f5-101829657112 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:35.864220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-049fdbe1-227b-4e46-a9f5-101829657112 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:35.871760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049fdbe1-227b-4e46-a9f5-101829657112 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:35.872300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049fdbe1-227b-4e46-a9f5-101829657112 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:35.872810 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049fdbe1-227b-4e46-a9f5-101829657112 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:35.873630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049fdbe1-227b-4e46-a9f5-101829657112 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:35.874324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049fdbe1-227b-4e46-a9f5-101829657112 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:35.874885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-049fdbe1-227b-4e46-a9f5-101829657112 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:36.022408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-049fdbe1-227b-4e46-a9f5-101829657112 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:36.030790 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-049fdbe1-227b-4e46-a9f5-101829657112 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1679 microversion: 2.1 time: 0.173038 Oct 29 03:50:36.031364 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3633/7311] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:35 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:37.056651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d979a740-bff0-4e18-9c27-4029f31823ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:37.057236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d979a740-bff0-4e18-9c27-4029f31823ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:37.064621 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d979a740-bff0-4e18-9c27-4029f31823ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:37.065104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d979a740-bff0-4e18-9c27-4029f31823ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:37.065524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d979a740-bff0-4e18-9c27-4029f31823ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:37.066240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d979a740-bff0-4e18-9c27-4029f31823ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:37.066680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d979a740-bff0-4e18-9c27-4029f31823ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:37.067092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d979a740-bff0-4e18-9c27-4029f31823ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:37.201535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d979a740-bff0-4e18-9c27-4029f31823ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:37.209487 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d979a740-bff0-4e18-9c27-4029f31823ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1679 microversion: 2.1 time: 0.156831 Oct 29 03:50:37.210074 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3679/7312] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:37 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:38.237200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1dd85673-da29-4856-88a3-b60d130a7e54 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:38.238683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1dd85673-da29-4856-88a3-b60d130a7e54 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:38.250100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dd85673-da29-4856-88a3-b60d130a7e54 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:38.250594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dd85673-da29-4856-88a3-b60d130a7e54 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:38.251020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dd85673-da29-4856-88a3-b60d130a7e54 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:38.251749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dd85673-da29-4856-88a3-b60d130a7e54 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:38.252209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dd85673-da29-4856-88a3-b60d130a7e54 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:38.252627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1dd85673-da29-4856-88a3-b60d130a7e54 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:38.384151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1dd85673-da29-4856-88a3-b60d130a7e54 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:38.392151 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1dd85673-da29-4856-88a3-b60d130a7e54 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1679 microversion: 2.1 time: 0.161591 Oct 29 03:50:38.392739 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3634/7313] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:38 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:39.424469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb6405ee-4f01-487c-91c4-206e51c849d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:39.425093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bb6405ee-4f01-487c-91c4-206e51c849d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:39.433508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6405ee-4f01-487c-91c4-206e51c849d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:39.434212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6405ee-4f01-487c-91c4-206e51c849d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:39.434724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6405ee-4f01-487c-91c4-206e51c849d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:39.435550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6405ee-4f01-487c-91c4-206e51c849d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:39.436084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6405ee-4f01-487c-91c4-206e51c849d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:39.436583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6405ee-4f01-487c-91c4-206e51c849d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:39.578046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bb6405ee-4f01-487c-91c4-206e51c849d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:39.586663 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb6405ee-4f01-487c-91c4-206e51c849d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1679 microversion: 2.1 time: 0.168400 Oct 29 03:50:39.587257 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3680/7314] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:39 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:40.615109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2ab84143-308e-4928-9f3e-1946ca721142 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:40.616089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2ab84143-308e-4928-9f3e-1946ca721142 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:40.626846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ab84143-308e-4928-9f3e-1946ca721142 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:40.627339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ab84143-308e-4928-9f3e-1946ca721142 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:40.627775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ab84143-308e-4928-9f3e-1946ca721142 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:40.628474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ab84143-308e-4928-9f3e-1946ca721142 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:40.628926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ab84143-308e-4928-9f3e-1946ca721142 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:40.629355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2ab84143-308e-4928-9f3e-1946ca721142 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:40.764874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2ab84143-308e-4928-9f3e-1946ca721142 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:40.773251 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2ab84143-308e-4928-9f3e-1946ca721142 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1679 microversion: 2.1 time: 0.165257 Oct 29 03:50:40.778471 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3635/7315] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:40 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:41.796928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-241de3d6-5a0f-4f30-a2e8-cd1a910b6aa0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:41.797572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-241de3d6-5a0f-4f30-a2e8-cd1a910b6aa0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:41.804953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-241de3d6-5a0f-4f30-a2e8-cd1a910b6aa0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:41.805434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-241de3d6-5a0f-4f30-a2e8-cd1a910b6aa0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:41.805860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-241de3d6-5a0f-4f30-a2e8-cd1a910b6aa0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:41.806573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-241de3d6-5a0f-4f30-a2e8-cd1a910b6aa0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:41.807020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-241de3d6-5a0f-4f30-a2e8-cd1a910b6aa0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:41.807428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-241de3d6-5a0f-4f30-a2e8-cd1a910b6aa0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:41.943588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-241de3d6-5a0f-4f30-a2e8-cd1a910b6aa0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:41.952270 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-241de3d6-5a0f-4f30-a2e8-cd1a910b6aa0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1679 microversion: 2.1 time: 0.159369 Oct 29 03:50:41.962990 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3681/7316] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:41 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:42.981468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-402990e7-90e6-4b0d-8469-cff41f58d281 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:42.982768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-402990e7-90e6-4b0d-8469-cff41f58d281 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:42.995044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-402990e7-90e6-4b0d-8469-cff41f58d281 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:42.995856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-402990e7-90e6-4b0d-8469-cff41f58d281 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:42.996598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-402990e7-90e6-4b0d-8469-cff41f58d281 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:42.997740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-402990e7-90e6-4b0d-8469-cff41f58d281 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:42.998573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-402990e7-90e6-4b0d-8469-cff41f58d281 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:42.999412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-402990e7-90e6-4b0d-8469-cff41f58d281 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:43.146437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-402990e7-90e6-4b0d-8469-cff41f58d281 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:43.154603 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-402990e7-90e6-4b0d-8469-cff41f58d281 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1656 microversion: 2.1 time: 0.180833 Oct 29 03:50:43.155156 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3636/7317] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:42 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1656 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:43.177595 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:43.179850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:43.187133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:43.187610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:43.188036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:43.188723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:43.189172 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:43.189590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:43.266272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:43.272211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Old instance type m1.heat2, new instance type m1.heat {{(pid=127042) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:50:43.279397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:50:43.279811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:50:43.280281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:50:43.280721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:50:43.281130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:50:43.395214 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b7651250-ed96-4c86-9491-b1a67bcc02d8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92/action" status: 202 len: 0 microversion: 2.1 time: 0.221564 Oct 29 03:50:43.395878 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3682/7318] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:50:43 2022] POST /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:50:43.404504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2643b36c-fd70-4c22-8a89-42931c068a36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:43.405179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2643b36c-fd70-4c22-8a89-42931c068a36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:43.411275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2643b36c-fd70-4c22-8a89-42931c068a36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:43.411854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2643b36c-fd70-4c22-8a89-42931c068a36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:43.412190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2643b36c-fd70-4c22-8a89-42931c068a36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:43.412920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2643b36c-fd70-4c22-8a89-42931c068a36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:43.413395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2643b36c-fd70-4c22-8a89-42931c068a36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:43.413857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2643b36c-fd70-4c22-8a89-42931c068a36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:43.553015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2643b36c-fd70-4c22-8a89-42931c068a36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:43.561378 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2643b36c-fd70-4c22-8a89-42931c068a36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1679 microversion: 2.1 time: 0.160840 Oct 29 03:50:43.562172 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3637/7319] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:43 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:44.587142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-056512b7-47a5-400f-befb-eab5cca89c4c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:44.587678 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-056512b7-47a5-400f-befb-eab5cca89c4c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:44.595087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-056512b7-47a5-400f-befb-eab5cca89c4c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:44.595522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-056512b7-47a5-400f-befb-eab5cca89c4c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:44.595968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-056512b7-47a5-400f-befb-eab5cca89c4c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:44.596651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-056512b7-47a5-400f-befb-eab5cca89c4c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:44.597093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-056512b7-47a5-400f-befb-eab5cca89c4c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:44.597507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-056512b7-47a5-400f-befb-eab5cca89c4c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:44.757882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-056512b7-47a5-400f-befb-eab5cca89c4c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:44.766274 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-056512b7-47a5-400f-befb-eab5cca89c4c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1679 microversion: 2.1 time: 0.184051 Oct 29 03:50:44.766892 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3683/7320] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:44 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:45.790854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e11a34cc-2ba2-46cd-a484-24356ae8afc3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:45.791579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e11a34cc-2ba2-46cd-a484-24356ae8afc3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:45.800063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11a34cc-2ba2-46cd-a484-24356ae8afc3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:45.800568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11a34cc-2ba2-46cd-a484-24356ae8afc3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:45.801016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11a34cc-2ba2-46cd-a484-24356ae8afc3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:45.801747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11a34cc-2ba2-46cd-a484-24356ae8afc3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:45.802245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11a34cc-2ba2-46cd-a484-24356ae8afc3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:45.802693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e11a34cc-2ba2-46cd-a484-24356ae8afc3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:45.942375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e11a34cc-2ba2-46cd-a484-24356ae8afc3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:45.950738 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e11a34cc-2ba2-46cd-a484-24356ae8afc3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1684 microversion: 2.1 time: 0.164507 Oct 29 03:50:45.951570 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3638/7321] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:45 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:46.976007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0feafc57-66dc-469f-b330-ab3641118de0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:46.976750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0feafc57-66dc-469f-b330-ab3641118de0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:46.983832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0feafc57-66dc-469f-b330-ab3641118de0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:46.984310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0feafc57-66dc-469f-b330-ab3641118de0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:46.984734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0feafc57-66dc-469f-b330-ab3641118de0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:46.985419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0feafc57-66dc-469f-b330-ab3641118de0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:46.985848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0feafc57-66dc-469f-b330-ab3641118de0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:46.986301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0feafc57-66dc-469f-b330-ab3641118de0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:47.124959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0feafc57-66dc-469f-b330-ab3641118de0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:47.134242 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0feafc57-66dc-469f-b330-ab3641118de0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1684 microversion: 2.1 time: 0.162665 Oct 29 03:50:47.134828 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3684/7322] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:46 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:47.969779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-a67ef8f1-c830-4888-8fdf-f08749398f9f req-344bf9ba-bc0e-42fc-9cb1-bb12d075f4fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaecb16e-118a-4954-b28e-e98699ea7e92", "name": "network-vif-unplugged", "status": "completed", "tag": "9f622f69-94e7-4043-b30b-c901058b5abb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:47.980302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a67ef8f1-c830-4888-8fdf-f08749398f9f req-344bf9ba-bc0e-42fc-9cb1-bb12d075f4fe service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:47.980799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a67ef8f1-c830-4888-8fdf-f08749398f9f req-344bf9ba-bc0e-42fc-9cb1-bb12d075f4fe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:47.981552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-a67ef8f1-c830-4888-8fdf-f08749398f9f req-344bf9ba-bc0e-42fc-9cb1-bb12d075f4fe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:47.994035 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-a67ef8f1-c830-4888-8fdf-f08749398f9f req-344bf9ba-bc0e-42fc-9cb1-bb12d075f4fe service nova] Creating event network-vif-unplugged:9f622f69-94e7-4043-b30b-c901058b5abb for instance aaecb16e-118a-4954-b28e-e98699ea7e92 on n-h1-862964-4 Oct 29 03:50:47.999784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-a67ef8f1-c830-4888-8fdf-f08749398f9f req-344bf9ba-bc0e-42fc-9cb1-bb12d075f4fe service nova] Instance aaecb16e-118a-4954-b28e-e98699ea7e92 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:50:48.011988 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-a67ef8f1-c830-4888-8fdf-f08749398f9f req-344bf9ba-bc0e-42fc-9cb1-bb12d075f4fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105008 Oct 29 03:50:48.012635 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3639/7323] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:48.167114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b84a8b34-d4a9-432b-953b-28ab2bb035f0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:48.167698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b84a8b34-d4a9-432b-953b-28ab2bb035f0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:48.177865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b84a8b34-d4a9-432b-953b-28ab2bb035f0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:48.178423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b84a8b34-d4a9-432b-953b-28ab2bb035f0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:48.178857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b84a8b34-d4a9-432b-953b-28ab2bb035f0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:48.179569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b84a8b34-d4a9-432b-953b-28ab2bb035f0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:48.180013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b84a8b34-d4a9-432b-953b-28ab2bb035f0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:48.180424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b84a8b34-d4a9-432b-953b-28ab2bb035f0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:48.320636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b84a8b34-d4a9-432b-953b-28ab2bb035f0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:48.328692 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b84a8b34-d4a9-432b-953b-28ab2bb035f0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1683 microversion: 2.1 time: 0.165710 Oct 29 03:50:48.329351 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3685/7324] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:48 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:49.355543 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0c51d89-eaa3-4d76-b152-61004fbf997b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:49.356289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d0c51d89-eaa3-4d76-b152-61004fbf997b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:49.363106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0c51d89-eaa3-4d76-b152-61004fbf997b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:49.363598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0c51d89-eaa3-4d76-b152-61004fbf997b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:49.364042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0c51d89-eaa3-4d76-b152-61004fbf997b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:49.364753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0c51d89-eaa3-4d76-b152-61004fbf997b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:49.365211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0c51d89-eaa3-4d76-b152-61004fbf997b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:49.365644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0c51d89-eaa3-4d76-b152-61004fbf997b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:49.505103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0c51d89-eaa3-4d76-b152-61004fbf997b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:49.513196 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d0c51d89-eaa3-4d76-b152-61004fbf997b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1681 microversion: 2.1 time: 0.163752 Oct 29 03:50:49.513788 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3640/7325] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:49 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:50.035766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a2dd6aca-df8f-46da-92ae-4bdeb116be47 req-f8c7eaea-6257-4238-b25f-5cbee22108fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaecb16e-118a-4954-b28e-e98699ea7e92", "tag": "9f622f69-94e7-4043-b30b-c901058b5abb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:50.051053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a2dd6aca-df8f-46da-92ae-4bdeb116be47 req-f8c7eaea-6257-4238-b25f-5cbee22108fc service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:50.051522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a2dd6aca-df8f-46da-92ae-4bdeb116be47 req-f8c7eaea-6257-4238-b25f-5cbee22108fc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:50.051941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a2dd6aca-df8f-46da-92ae-4bdeb116be47 req-f8c7eaea-6257-4238-b25f-5cbee22108fc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:50.063967 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a2dd6aca-df8f-46da-92ae-4bdeb116be47 req-f8c7eaea-6257-4238-b25f-5cbee22108fc service nova] Creating event network-changed:9f622f69-94e7-4043-b30b-c901058b5abb for instance aaecb16e-118a-4954-b28e-e98699ea7e92 on n-h1-862964-4 Oct 29 03:50:50.069689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-a2dd6aca-df8f-46da-92ae-4bdeb116be47 req-f8c7eaea-6257-4238-b25f-5cbee22108fc service nova] Instance aaecb16e-118a-4954-b28e-e98699ea7e92 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:50:50.080549 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a2dd6aca-df8f-46da-92ae-4bdeb116be47 req-f8c7eaea-6257-4238-b25f-5cbee22108fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051049 Oct 29 03:50:50.081230 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3686/7326] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:50.539653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-379c8715-f555-4569-b7b5-51df217ce2ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:50.542463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-379c8715-f555-4569-b7b5-51df217ce2ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:50.551300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-379c8715-f555-4569-b7b5-51df217ce2ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:50.552228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-379c8715-f555-4569-b7b5-51df217ce2ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:50.552905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-379c8715-f555-4569-b7b5-51df217ce2ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:50.554033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-379c8715-f555-4569-b7b5-51df217ce2ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:50.554736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-379c8715-f555-4569-b7b5-51df217ce2ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:50.555303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-379c8715-f555-4569-b7b5-51df217ce2ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:50.778665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-379c8715-f555-4569-b7b5-51df217ce2ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:50.793031 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-379c8715-f555-4569-b7b5-51df217ce2ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1677 microversion: 2.1 time: 0.260102 Oct 29 03:50:50.793828 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3641/7327] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:50 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1677 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:50.816955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5b46427c-62f3-49a7-a415-7520789d93ad tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:50.817665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5b46427c-62f3-49a7-a415-7520789d93ad tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:50.824173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b46427c-62f3-49a7-a415-7520789d93ad tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:50.824660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b46427c-62f3-49a7-a415-7520789d93ad tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:50.825075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b46427c-62f3-49a7-a415-7520789d93ad tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:50.825787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b46427c-62f3-49a7-a415-7520789d93ad tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:50.826298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b46427c-62f3-49a7-a415-7520789d93ad tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:50.826716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5b46427c-62f3-49a7-a415-7520789d93ad tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:50.887536 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5b46427c-62f3-49a7-a415-7520789d93ad tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92/action" status: 204 len: 0 microversion: 2.1 time: 0.074733 Oct 29 03:50:50.888501 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3687/7328] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:50:50 2022] POST /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:50:50.897517 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bf86a996-a536-4b32-ad80-fbf3c2505b74 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:50.898178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bf86a996-a536-4b32-ad80-fbf3c2505b74 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:50.904325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf86a996-a536-4b32-ad80-fbf3c2505b74 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:50.904915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf86a996-a536-4b32-ad80-fbf3c2505b74 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:50.905398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf86a996-a536-4b32-ad80-fbf3c2505b74 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:50.906472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf86a996-a536-4b32-ad80-fbf3c2505b74 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:50.907151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf86a996-a536-4b32-ad80-fbf3c2505b74 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:50.907883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bf86a996-a536-4b32-ad80-fbf3c2505b74 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:51.111564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bf86a996-a536-4b32-ad80-fbf3c2505b74 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:51.120704 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bf86a996-a536-4b32-ad80-fbf3c2505b74 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1677 microversion: 2.1 time: 0.228035 Oct 29 03:50:51.121300 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3642/7329] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:50 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:52.146474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-50c3a639-a705-4b26-9617-e3e21ea88e45 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:52.147074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-50c3a639-a705-4b26-9617-e3e21ea88e45 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:52.155354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c3a639-a705-4b26-9617-e3e21ea88e45 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:52.156017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c3a639-a705-4b26-9617-e3e21ea88e45 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:52.156910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c3a639-a705-4b26-9617-e3e21ea88e45 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:52.157834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c3a639-a705-4b26-9617-e3e21ea88e45 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:52.158509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c3a639-a705-4b26-9617-e3e21ea88e45 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:52.158950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c3a639-a705-4b26-9617-e3e21ea88e45 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:52.294219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-50c3a639-a705-4b26-9617-e3e21ea88e45 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:52.304198 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-50c3a639-a705-4b26-9617-e3e21ea88e45 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1677 microversion: 2.1 time: 0.163134 Oct 29 03:50:52.304781 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3688/7330] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:52 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:53.331303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2d8c438f-384a-4635-9a18-9bb45c24fdd8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:53.332426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2d8c438f-384a-4635-9a18-9bb45c24fdd8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:53.343814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d8c438f-384a-4635-9a18-9bb45c24fdd8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:53.344626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d8c438f-384a-4635-9a18-9bb45c24fdd8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:53.345368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d8c438f-384a-4635-9a18-9bb45c24fdd8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:53.346539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d8c438f-384a-4635-9a18-9bb45c24fdd8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:53.347212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d8c438f-384a-4635-9a18-9bb45c24fdd8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:53.347640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2d8c438f-384a-4635-9a18-9bb45c24fdd8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:53.492881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2d8c438f-384a-4635-9a18-9bb45c24fdd8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:53.500916 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2d8c438f-384a-4635-9a18-9bb45c24fdd8 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1656 microversion: 2.1 time: 0.176333 Oct 29 03:50:53.501493 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3643/7331] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:53 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1656 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:53.524111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d7c56fb-7f66-4c0e-a25d-8da8e73f9b99 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:53.524781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6d7c56fb-7f66-4c0e-a25d-8da8e73f9b99 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:53.531786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7c56fb-7f66-4c0e-a25d-8da8e73f9b99 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:53.532260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7c56fb-7f66-4c0e-a25d-8da8e73f9b99 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:53.532681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7c56fb-7f66-4c0e-a25d-8da8e73f9b99 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:53.533355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7c56fb-7f66-4c0e-a25d-8da8e73f9b99 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:53.533792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7c56fb-7f66-4c0e-a25d-8da8e73f9b99 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:53.534298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6d7c56fb-7f66-4c0e-a25d-8da8e73f9b99 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:53.673664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6d7c56fb-7f66-4c0e-a25d-8da8e73f9b99 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:53.682162 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d7c56fb-7f66-4c0e-a25d-8da8e73f9b99 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1656 microversion: 2.1 time: 0.161963 Oct 29 03:50:53.682757 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3689/7332] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:53 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:53.704742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b3c5756-bc16-4ce5-bbec-4ae0f8f1b946 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:53.711834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b3c5756-bc16-4ce5-bbec-4ae0f8f1b946 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:53.712338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b3c5756-bc16-4ce5-bbec-4ae0f8f1b946 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:53.712788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b3c5756-bc16-4ce5-bbec-4ae0f8f1b946 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:53.735888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8b3c5756-bc16-4ce5-bbec-4ae0f8f1b946 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Going to try to start instance {{(pid=127041) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:50:53.785156 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b3c5756-bc16-4ce5-bbec-4ae0f8f1b946 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92/action" status: 202 len: 0 microversion: 2.1 time: 0.083716 Oct 29 03:50:53.786033 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3644/7333] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:50:53 2022] POST /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:50:53.794659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cee5771f-fbeb-4acc-9c58-4205ef2c9f5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:53.795263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cee5771f-fbeb-4acc-9c58-4205ef2c9f5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:53.801774 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cee5771f-fbeb-4acc-9c58-4205ef2c9f5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:53.802421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cee5771f-fbeb-4acc-9c58-4205ef2c9f5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:53.802887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cee5771f-fbeb-4acc-9c58-4205ef2c9f5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:53.803584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cee5771f-fbeb-4acc-9c58-4205ef2c9f5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:53.804038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cee5771f-fbeb-4acc-9c58-4205ef2c9f5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:53.804458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cee5771f-fbeb-4acc-9c58-4205ef2c9f5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:53.941894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cee5771f-fbeb-4acc-9c58-4205ef2c9f5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:53.949787 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cee5771f-fbeb-4acc-9c58-4205ef2c9f5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1665 microversion: 2.1 time: 0.158985 Oct 29 03:50:53.950377 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3690/7334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:53 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:50:54.406270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-0df4cb15-2138-45f7-94a2-3b3b13d86955 req-842ebb84-b03e-4a10-a606-80289cdc4f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaecb16e-118a-4954-b28e-e98699ea7e92", "name": "network-vif-plugged", "status": "completed", "tag": "9f622f69-94e7-4043-b30b-c901058b5abb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:54.417767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0df4cb15-2138-45f7-94a2-3b3b13d86955 req-842ebb84-b03e-4a10-a606-80289cdc4f51 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:54.418224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0df4cb15-2138-45f7-94a2-3b3b13d86955 req-842ebb84-b03e-4a10-a606-80289cdc4f51 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:54.418662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0df4cb15-2138-45f7-94a2-3b3b13d86955 req-842ebb84-b03e-4a10-a606-80289cdc4f51 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:54.432420 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-0df4cb15-2138-45f7-94a2-3b3b13d86955 req-842ebb84-b03e-4a10-a606-80289cdc4f51 service nova] Creating event network-vif-plugged:9f622f69-94e7-4043-b30b-c901058b5abb for instance aaecb16e-118a-4954-b28e-e98699ea7e92 on n-h1-862964-4 Oct 29 03:50:54.437359 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-0df4cb15-2138-45f7-94a2-3b3b13d86955 req-842ebb84-b03e-4a10-a606-80289cdc4f51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100677 Oct 29 03:50:54.438000 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3645/7335] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:54.974206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-281232fb-acb1-499a-a4d1-d661f40a49c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:54.975153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-281232fb-acb1-499a-a4d1-d661f40a49c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:54.983083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-281232fb-acb1-499a-a4d1-d661f40a49c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:54.983581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-281232fb-acb1-499a-a4d1-d661f40a49c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:54.984020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-281232fb-acb1-499a-a4d1-d661f40a49c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:54.984767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-281232fb-acb1-499a-a4d1-d661f40a49c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:54.985241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-281232fb-acb1-499a-a4d1-d661f40a49c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:54.985658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-281232fb-acb1-499a-a4d1-d661f40a49c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:55.001482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:55.128914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-281232fb-acb1-499a-a4d1-d661f40a49c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:55.140998 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-281232fb-acb1-499a-a4d1-d661f40a49c7 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1669 microversion: 2.1 time: 0.170820 Oct 29 03:50:55.141833 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3691/7336] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:54 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:55.175671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-23db7719-7005-4c17-8070-1181c55409ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:55.176271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-23db7719-7005-4c17-8070-1181c55409ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:55.182821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db7719-7005-4c17-8070-1181c55409ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:55.183307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db7719-7005-4c17-8070-1181c55409ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:55.183712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db7719-7005-4c17-8070-1181c55409ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:55.184444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db7719-7005-4c17-8070-1181c55409ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:55.184901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db7719-7005-4c17-8070-1181c55409ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:55.185322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23db7719-7005-4c17-8070-1181c55409ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:55.208571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:55.215360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-23db7719-7005-4c17-8070-1181c55409ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:50:55.300599 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-23db7719-7005-4c17-8070-1181c55409ea tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 204 len: 0 microversion: 2.1 time: 0.129042 Oct 29 03:50:55.301071 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3646/7337] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:50:55 2022] DELETE /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:50:55.311448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b9774aaf-4776-46aa-93b1-ee6df4c67c28 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:55.312453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b9774aaf-4776-46aa-93b1-ee6df4c67c28 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:55.321242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9774aaf-4776-46aa-93b1-ee6df4c67c28 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:55.321983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9774aaf-4776-46aa-93b1-ee6df4c67c28 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:55.322413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9774aaf-4776-46aa-93b1-ee6df4c67c28 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:55.323376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9774aaf-4776-46aa-93b1-ee6df4c67c28 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:55.324012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9774aaf-4776-46aa-93b1-ee6df4c67c28 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:55.324634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9774aaf-4776-46aa-93b1-ee6df4c67c28 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:55.464462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b9774aaf-4776-46aa-93b1-ee6df4c67c28 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:55.472768 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b9774aaf-4776-46aa-93b1-ee6df4c67c28 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1675 microversion: 2.1 time: 0.167315 Oct 29 03:50:55.473384 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3692/7338] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:55 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:56.502467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2067effe-e27d-44f4-a5a8-009f6d802ec9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:56.503744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2067effe-e27d-44f4-a5a8-009f6d802ec9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:56.515407 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2067effe-e27d-44f4-a5a8-009f6d802ec9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.516214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2067effe-e27d-44f4-a5a8-009f6d802ec9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.516936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2067effe-e27d-44f4-a5a8-009f6d802ec9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.518176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2067effe-e27d-44f4-a5a8-009f6d802ec9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.518937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2067effe-e27d-44f4-a5a8-009f6d802ec9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.519687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2067effe-e27d-44f4-a5a8-009f6d802ec9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.651904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2067effe-e27d-44f4-a5a8-009f6d802ec9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:56.660320 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2067effe-e27d-44f4-a5a8-009f6d802ec9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1675 microversion: 2.1 time: 0.165284 Oct 29 03:50:56.660870 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3647/7339] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:56 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:57.605671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-aeffbeb6-016a-4b92-81b3-12dd3b507476 req-c662a91a-c4b2-4be8-b13d-7102287adc89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaecb16e-118a-4954-b28e-e98699ea7e92", "name": "network-vif-deleted", "tag": "9f622f69-94e7-4043-b30b-c901058b5abb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:57.617453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-aeffbeb6-016a-4b92-81b3-12dd3b507476 req-c662a91a-c4b2-4be8-b13d-7102287adc89 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:57.617955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-aeffbeb6-016a-4b92-81b3-12dd3b507476 req-c662a91a-c4b2-4be8-b13d-7102287adc89 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:57.618452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-aeffbeb6-016a-4b92-81b3-12dd3b507476 req-c662a91a-c4b2-4be8-b13d-7102287adc89 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:57.630885 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-aeffbeb6-016a-4b92-81b3-12dd3b507476 req-c662a91a-c4b2-4be8-b13d-7102287adc89 service nova] Creating event network-vif-deleted:9f622f69-94e7-4043-b30b-c901058b5abb for instance aaecb16e-118a-4954-b28e-e98699ea7e92 on n-h1-862964-4 Oct 29 03:50:57.637422 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-aeffbeb6-016a-4b92-81b3-12dd3b507476 req-c662a91a-c4b2-4be8-b13d-7102287adc89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035534 Oct 29 03:50:57.638156 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3693/7340] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:57.689779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e1fda8b-c5b1-4ad2-80b6-794bc746f82c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:57.690514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0e1fda8b-c5b1-4ad2-80b6-794bc746f82c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:57.697467 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1fda8b-c5b1-4ad2-80b6-794bc746f82c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:57.698123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1fda8b-c5b1-4ad2-80b6-794bc746f82c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:57.698793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1fda8b-c5b1-4ad2-80b6-794bc746f82c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:57.699580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1fda8b-c5b1-4ad2-80b6-794bc746f82c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:57.700125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1fda8b-c5b1-4ad2-80b6-794bc746f82c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:57.700633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e1fda8b-c5b1-4ad2-80b6-794bc746f82c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:57.769241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0e1fda8b-c5b1-4ad2-80b6-794bc746f82c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:57.779306 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e1fda8b-c5b1-4ad2-80b6-794bc746f82c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 200 len: 1324 microversion: 2.1 time: 0.093690 Oct 29 03:50:57.796861 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3648/7341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:57 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 1324 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:58.807053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:58.807755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:58.814486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:58.814970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:58.815405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:58.816190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:58.816611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:58.817061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:58.830806 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 HTTP/1.1 Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'aaecb16e-118a-4954-b28e-e98699ea7e92'} Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:58.832722 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:50:58.837518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:58.837518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:58.837518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:58.837518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:58.837518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:58.837518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:50:58.837518 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:50:58.837518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:58.837518 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-63cb23dd-d535-48a3-be36-8d056576de5a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 404 len: 111 microversion: 2.1 time: 0.032425 Oct 29 03:50:58.837518 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3694/7342] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:58 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:58.848574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:58.849324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:58.856424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:58.856922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:58.857372 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:58.858100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:58.858581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:58.858987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:58.873259 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 HTTP/1.1 Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'aaecb16e-118a-4954-b28e-e98699ea7e92'} Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:58.874985 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:50:58.879794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:58.879794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:58.879794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:58.879794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:58.879794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:58.879794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:50:58.879794 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:50:58.879794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:58.879794 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b7a2a7f-f867-440f-8b0a-7d53a5d22378 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 404 len: 111 microversion: 2.1 time: 0.032168 Oct 29 03:50:58.879794 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3649/7343] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:58 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:58.928124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1699606173", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "4aafb772-aedb-4bf4-bd4c-0aa7d4b31f9a"}], "security_groups": [{"name": "tempest-securitygroup--65035578"}], "key_name": "tempest-keypair-2070687314", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:59.045446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] validate_networks() for [('4aafb772-aedb-4bf4-bd4c-0aa7d4b31f9a', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:50:59.493408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:50:59.494028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:50:59.494696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:50:59.495274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:50:59.495787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:50:59.509861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:59.510631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:59.511322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:59.512347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:59.512997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:59.513575 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:59.533679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:50:59.539364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for user d88f049383ec4971b8c92bfde389e873 and project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:50:59.553339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:50:59.555712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:50:59.604719 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d0297684-dcec-4d3f-809a-ba2d08dcd717 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.680904 Oct 29 03:50:59.605360 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3695/7344] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:50:58 2022] POST /compute/v2.1/servers => generated 404 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:50:59.617346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-455bafb3-c692-4d63-ae35-addb66ee0167 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:59.618016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-455bafb3-c692-4d63-ae35-addb66ee0167 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:59.671854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-455bafb3-c692-4d63-ae35-addb66ee0167 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:59.678863 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-455bafb3-c692-4d63-ae35-addb66ee0167 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1239 microversion: 2.1 time: 0.065942 Oct 29 03:50:59.679433 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3650/7345] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:59 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:00.703610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b8325be4-bda3-44d8-80bb-9698727c4314 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:00.704255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b8325be4-bda3-44d8-80bb-9698727c4314 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:00.711320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8325be4-bda3-44d8-80bb-9698727c4314 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:00.711808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8325be4-bda3-44d8-80bb-9698727c4314 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:00.712240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8325be4-bda3-44d8-80bb-9698727c4314 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:00.712919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8325be4-bda3-44d8-80bb-9698727c4314 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:00.713559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8325be4-bda3-44d8-80bb-9698727c4314 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:00.714025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b8325be4-bda3-44d8-80bb-9698727c4314 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:00.791406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b8325be4-bda3-44d8-80bb-9698727c4314 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:00.799316 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b8325be4-bda3-44d8-80bb-9698727c4314 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1299 microversion: 2.1 time: 0.100582 Oct 29 03:51:00.800111 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3696/7346] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:00 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:01.825465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0014aaa3-4921-425c-8910-236449d08099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:01.826067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0014aaa3-4921-425c-8910-236449d08099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:01.834393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0014aaa3-4921-425c-8910-236449d08099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:01.834915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0014aaa3-4921-425c-8910-236449d08099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:01.835346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0014aaa3-4921-425c-8910-236449d08099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:01.836064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0014aaa3-4921-425c-8910-236449d08099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:01.836524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0014aaa3-4921-425c-8910-236449d08099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:01.836963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0014aaa3-4921-425c-8910-236449d08099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:01.973248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0014aaa3-4921-425c-8910-236449d08099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:01.983174 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0014aaa3-4921-425c-8910-236449d08099 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1363 microversion: 2.1 time: 0.161995 Oct 29 03:51:01.983753 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3651/7347] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:01 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:02.184934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-440f280f-162c-48d1-91eb-0722762a95b3 req-2ea9b696-77f9-4263-be8e-6c497ddffd06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5f0ec5-1780-445d-a4fd-9675632698a4", "tag": "36a138fe-ec96-4ad7-88bf-cd7fa22b6adc"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:51:02.196663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-440f280f-162c-48d1-91eb-0722762a95b3 req-2ea9b696-77f9-4263-be8e-6c497ddffd06 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:02.197131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-440f280f-162c-48d1-91eb-0722762a95b3 req-2ea9b696-77f9-4263-be8e-6c497ddffd06 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:02.197533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-440f280f-162c-48d1-91eb-0722762a95b3 req-2ea9b696-77f9-4263-be8e-6c497ddffd06 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:02.209573 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-440f280f-162c-48d1-91eb-0722762a95b3 req-2ea9b696-77f9-4263-be8e-6c497ddffd06 service nova] Creating event network-changed:36a138fe-ec96-4ad7-88bf-cd7fa22b6adc for instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 on n-h2-862964-4 Oct 29 03:51:02.214859 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-440f280f-162c-48d1-91eb-0722762a95b3 req-2ea9b696-77f9-4263-be8e-6c497ddffd06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033815 Oct 29 03:51:02.215835 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3697/7348] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:03.010408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d101d519-c524-412d-bc39-1b343d87f249 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:03.011113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d101d519-c524-412d-bc39-1b343d87f249 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:03.014616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:03.022115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d101d519-c524-412d-bc39-1b343d87f249 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:03.022720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d101d519-c524-412d-bc39-1b343d87f249 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:03.023270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d101d519-c524-412d-bc39-1b343d87f249 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:03.024138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d101d519-c524-412d-bc39-1b343d87f249 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:03.024704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d101d519-c524-412d-bc39-1b343d87f249 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:03.025240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d101d519-c524-412d-bc39-1b343d87f249 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:03.169292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d101d519-c524-412d-bc39-1b343d87f249 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:03.177635 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d101d519-c524-412d-bc39-1b343d87f249 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1363 microversion: 2.1 time: 0.172389 Oct 29 03:51:03.178248 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3652/7349] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:03 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:04.202803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ea0191bc-4ae1-4327-a662-317b93b091b4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:04.203514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ea0191bc-4ae1-4327-a662-317b93b091b4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:04.205560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:04.211944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0191bc-4ae1-4327-a662-317b93b091b4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:04.212536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0191bc-4ae1-4327-a662-317b93b091b4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:04.212912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0191bc-4ae1-4327-a662-317b93b091b4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:04.213620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0191bc-4ae1-4327-a662-317b93b091b4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:04.214101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0191bc-4ae1-4327-a662-317b93b091b4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:04.214519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ea0191bc-4ae1-4327-a662-317b93b091b4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:04.426430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ea0191bc-4ae1-4327-a662-317b93b091b4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:04.434745 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ea0191bc-4ae1-4327-a662-317b93b091b4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1363 microversion: 2.1 time: 0.237102 Oct 29 03:51:04.435349 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3698/7350] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:04 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:05.460718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dcecdb5b-d8a0-4deb-9ffe-6939789b04e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:05.461358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dcecdb5b-d8a0-4deb-9ffe-6939789b04e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:05.469497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcecdb5b-d8a0-4deb-9ffe-6939789b04e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:05.470083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcecdb5b-d8a0-4deb-9ffe-6939789b04e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:05.470571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcecdb5b-d8a0-4deb-9ffe-6939789b04e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:05.471347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcecdb5b-d8a0-4deb-9ffe-6939789b04e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:05.471859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcecdb5b-d8a0-4deb-9ffe-6939789b04e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:05.472329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcecdb5b-d8a0-4deb-9ffe-6939789b04e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:05.610977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dcecdb5b-d8a0-4deb-9ffe-6939789b04e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:05.621718 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dcecdb5b-d8a0-4deb-9ffe-6939789b04e6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1363 microversion: 2.1 time: 0.165738 Oct 29 03:51:05.622762 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3653/7351] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:05 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:05.971834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d7a6a329-5989-4506-94f1-9ccad932b240 req-fb258fa4-9272-4c90-9a21-bed1355e0991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5f0ec5-1780-445d-a4fd-9675632698a4", "name": "network-vif-plugged", "status": "completed", "tag": "36a138fe-ec96-4ad7-88bf-cd7fa22b6adc"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:51:05.982069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7a6a329-5989-4506-94f1-9ccad932b240 req-fb258fa4-9272-4c90-9a21-bed1355e0991 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:05.982536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7a6a329-5989-4506-94f1-9ccad932b240 req-fb258fa4-9272-4c90-9a21-bed1355e0991 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:05.982954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d7a6a329-5989-4506-94f1-9ccad932b240 req-fb258fa4-9272-4c90-9a21-bed1355e0991 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:05.994833 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d7a6a329-5989-4506-94f1-9ccad932b240 req-fb258fa4-9272-4c90-9a21-bed1355e0991 service nova] Creating event network-vif-plugged:36a138fe-ec96-4ad7-88bf-cd7fa22b6adc for instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 on n-h2-862964-4 Oct 29 03:51:05.999696 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d7a6a329-5989-4506-94f1-9ccad932b240 req-fb258fa4-9272-4c90-9a21-bed1355e0991 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031684 Oct 29 03:51:06.000568 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3699/7352] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:06.658096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ece31b86-97bf-41a5-a7c4-6d46f02ff280 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:06.659173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ece31b86-97bf-41a5-a7c4-6d46f02ff280 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:06.666547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ece31b86-97bf-41a5-a7c4-6d46f02ff280 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:06.667069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ece31b86-97bf-41a5-a7c4-6d46f02ff280 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:06.667516 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ece31b86-97bf-41a5-a7c4-6d46f02ff280 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:06.668212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ece31b86-97bf-41a5-a7c4-6d46f02ff280 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:06.668670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ece31b86-97bf-41a5-a7c4-6d46f02ff280 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:06.669103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ece31b86-97bf-41a5-a7c4-6d46f02ff280 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:06.812523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ece31b86-97bf-41a5-a7c4-6d46f02ff280 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:06.820622 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ece31b86-97bf-41a5-a7c4-6d46f02ff280 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1363 microversion: 2.1 time: 0.169411 Oct 29 03:51:06.821209 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3654/7353] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:06 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:07.848878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e4e74647-37b1-4126-b710-f512de2fc109 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:07.850012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e4e74647-37b1-4126-b710-f512de2fc109 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:07.861846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4e74647-37b1-4126-b710-f512de2fc109 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:07.862658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4e74647-37b1-4126-b710-f512de2fc109 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:07.863645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4e74647-37b1-4126-b710-f512de2fc109 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:07.864360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4e74647-37b1-4126-b710-f512de2fc109 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:07.864811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4e74647-37b1-4126-b710-f512de2fc109 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:07.865227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4e74647-37b1-4126-b710-f512de2fc109 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:08.009448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e4e74647-37b1-4126-b710-f512de2fc109 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:08.017448 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e4e74647-37b1-4126-b710-f512de2fc109 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1551 microversion: 2.1 time: 0.176110 Oct 29 03:51:08.018077 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3700/7354] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:07 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1551 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:08.041072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b6fc1dad-cd93-40f8-8c86-031c22813c63 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:08.041612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b6fc1dad-cd93-40f8-8c86-031c22813c63 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:08.049019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc1dad-cd93-40f8-8c86-031c22813c63 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:08.049527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc1dad-cd93-40f8-8c86-031c22813c63 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:08.050023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc1dad-cd93-40f8-8c86-031c22813c63 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:08.050830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc1dad-cd93-40f8-8c86-031c22813c63 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:08.051383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc1dad-cd93-40f8-8c86-031c22813c63 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:08.051826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b6fc1dad-cd93-40f8-8c86-031c22813c63 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:08.135933 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b6fc1dad-cd93-40f8-8c86-031c22813c63 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098890 Oct 29 03:51:08.136534 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3655/7355] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:51:08 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:09.085086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f158176c-0940-49f4-a1fe-3e9ec5eed16a req-56367399-3a80-436a-80b7-9e95fac6213f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5f0ec5-1780-445d-a4fd-9675632698a4", "tag": "36a138fe-ec96-4ad7-88bf-cd7fa22b6adc"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:51:09.095736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f158176c-0940-49f4-a1fe-3e9ec5eed16a req-56367399-3a80-436a-80b7-9e95fac6213f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:09.096085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f158176c-0940-49f4-a1fe-3e9ec5eed16a req-56367399-3a80-436a-80b7-9e95fac6213f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:09.096507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f158176c-0940-49f4-a1fe-3e9ec5eed16a req-56367399-3a80-436a-80b7-9e95fac6213f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:09.109912 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f158176c-0940-49f4-a1fe-3e9ec5eed16a req-56367399-3a80-436a-80b7-9e95fac6213f service nova] Creating event network-changed:36a138fe-ec96-4ad7-88bf-cd7fa22b6adc for instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 on n-h2-862964-4 Oct 29 03:51:09.117558 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f158176c-0940-49f4-a1fe-3e9ec5eed16a req-56367399-3a80-436a-80b7-9e95fac6213f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036186 Oct 29 03:51:09.118331 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3701/7356] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:49.915256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:49.916693 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:51:49.916866 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:51:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4/action (ip 10.222.0.16) !!! Oct 29 03:51:49.918756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:49.919486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:49.924941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:51:49.928544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:49.942141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:49.942702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:49.943263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:49.944126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:49.944586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:49.945016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:49.974539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:49.980193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Old instance type m1.heat2, new instance type m1.heat {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:51:49.987003 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:51:49.987448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:51:49.988245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:51:49.988673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:51:49.989084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:51:50.056535 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-db3775ec-3945-46d0-97b3-9e6bb5e9a95e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4/action" status: 202 len: 0 microversion: 2.1 time: 0.143704 Oct 29 03:51:50.057122 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3656/7357] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:51:49 2022] POST /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:51:50.062584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:50.063380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:50.065317 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:51:50.065441 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:51:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 (ip 10.222.0.16) !!! Oct 29 03:51:50.066928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=7 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:50.067643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=39 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:50.072635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-547dcc15-1218-4076-89fd-9879bbd12bfb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:50.073332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-547dcc15-1218-4076-89fd-9879bbd12bfb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:50.083584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-547dcc15-1218-4076-89fd-9879bbd12bfb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:50.084093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-547dcc15-1218-4076-89fd-9879bbd12bfb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:50.084578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-547dcc15-1218-4076-89fd-9879bbd12bfb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:50.085278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-547dcc15-1218-4076-89fd-9879bbd12bfb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:50.085726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-547dcc15-1218-4076-89fd-9879bbd12bfb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:50.086167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-547dcc15-1218-4076-89fd-9879bbd12bfb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:50.250199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-547dcc15-1218-4076-89fd-9879bbd12bfb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:50.258331 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-547dcc15-1218-4076-89fd-9879bbd12bfb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1678 microversion: 2.1 time: 0.196729 Oct 29 03:51:50.261925 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3702/7358] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:50 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:51.282904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f63cfb40-cf59-4055-a1b7-569566c92fe6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:51.283533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f63cfb40-cf59-4055-a1b7-569566c92fe6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:51.291196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f63cfb40-cf59-4055-a1b7-569566c92fe6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:51.291689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f63cfb40-cf59-4055-a1b7-569566c92fe6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:51.292134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f63cfb40-cf59-4055-a1b7-569566c92fe6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:51.292832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f63cfb40-cf59-4055-a1b7-569566c92fe6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:51.293286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f63cfb40-cf59-4055-a1b7-569566c92fe6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:51.293714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f63cfb40-cf59-4055-a1b7-569566c92fe6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:51.425851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f63cfb40-cf59-4055-a1b7-569566c92fe6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:51.434694 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f63cfb40-cf59-4055-a1b7-569566c92fe6 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1678 microversion: 2.1 time: 0.156853 Oct 29 03:51:51.435278 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3657/7359] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:51 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:52.461226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b7a867db-cf48-4bc4-b0c3-3b6427faf7be tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:52.461859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b7a867db-cf48-4bc4-b0c3-3b6427faf7be tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:52.469276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7a867db-cf48-4bc4-b0c3-3b6427faf7be tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:52.469757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7a867db-cf48-4bc4-b0c3-3b6427faf7be tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:52.470222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7a867db-cf48-4bc4-b0c3-3b6427faf7be tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:52.470908 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7a867db-cf48-4bc4-b0c3-3b6427faf7be tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:52.471353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7a867db-cf48-4bc4-b0c3-3b6427faf7be tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:52.471775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b7a867db-cf48-4bc4-b0c3-3b6427faf7be tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:52.616825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b7a867db-cf48-4bc4-b0c3-3b6427faf7be tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:52.625045 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b7a867db-cf48-4bc4-b0c3-3b6427faf7be tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1683 microversion: 2.1 time: 0.169317 Oct 29 03:51:52.625621 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3703/7360] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:52 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:53.652911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-13a4ea08-5656-4c3f-ad59-2add3c7ffb93 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:53.653739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-13a4ea08-5656-4c3f-ad59-2add3c7ffb93 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:53.663579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13a4ea08-5656-4c3f-ad59-2add3c7ffb93 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:53.664072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13a4ea08-5656-4c3f-ad59-2add3c7ffb93 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:53.664518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13a4ea08-5656-4c3f-ad59-2add3c7ffb93 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:53.665229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13a4ea08-5656-4c3f-ad59-2add3c7ffb93 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:53.665692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13a4ea08-5656-4c3f-ad59-2add3c7ffb93 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:53.666187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-13a4ea08-5656-4c3f-ad59-2add3c7ffb93 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:53.814982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-13a4ea08-5656-4c3f-ad59-2add3c7ffb93 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:53.823388 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-13a4ea08-5656-4c3f-ad59-2add3c7ffb93 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1683 microversion: 2.1 time: 0.176450 Oct 29 03:51:53.823983 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3658/7361] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:53 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:54.855835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b3fee8fa-ee5b-4409-87fa-924e36537d36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:54.856807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b3fee8fa-ee5b-4409-87fa-924e36537d36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:54.867654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3fee8fa-ee5b-4409-87fa-924e36537d36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:54.868133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3fee8fa-ee5b-4409-87fa-924e36537d36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:54.868553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3fee8fa-ee5b-4409-87fa-924e36537d36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:54.869240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3fee8fa-ee5b-4409-87fa-924e36537d36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:54.869677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3fee8fa-ee5b-4409-87fa-924e36537d36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:54.870126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b3fee8fa-ee5b-4409-87fa-924e36537d36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:55.014256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b3fee8fa-ee5b-4409-87fa-924e36537d36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:55.025391 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b3fee8fa-ee5b-4409-87fa-924e36537d36 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1683 microversion: 2.1 time: 0.176964 Oct 29 03:51:55.026261 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3704/7362] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:54 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:56.051968 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-91b10a12-1d8e-4a5e-b9fe-66ec1eb46315 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:56.052750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-91b10a12-1d8e-4a5e-b9fe-66ec1eb46315 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:56.060366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b10a12-1d8e-4a5e-b9fe-66ec1eb46315 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:56.061041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b10a12-1d8e-4a5e-b9fe-66ec1eb46315 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:56.061480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b10a12-1d8e-4a5e-b9fe-66ec1eb46315 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:56.062259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b10a12-1d8e-4a5e-b9fe-66ec1eb46315 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:56.062717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b10a12-1d8e-4a5e-b9fe-66ec1eb46315 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:56.063153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-91b10a12-1d8e-4a5e-b9fe-66ec1eb46315 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:56.196640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-91b10a12-1d8e-4a5e-b9fe-66ec1eb46315 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:56.204920 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-91b10a12-1d8e-4a5e-b9fe-66ec1eb46315 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1683 microversion: 2.1 time: 0.158333 Oct 29 03:51:56.205427 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3659/7363] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:56 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:57.231824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2badf0fd-a6b5-447e-8095-646d1ea07494 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:57.232635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2badf0fd-a6b5-447e-8095-646d1ea07494 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:57.244353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2badf0fd-a6b5-447e-8095-646d1ea07494 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:57.245100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2badf0fd-a6b5-447e-8095-646d1ea07494 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:57.245793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2badf0fd-a6b5-447e-8095-646d1ea07494 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:57.246922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2badf0fd-a6b5-447e-8095-646d1ea07494 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:57.247657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2badf0fd-a6b5-447e-8095-646d1ea07494 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:57.248322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2badf0fd-a6b5-447e-8095-646d1ea07494 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:57.380501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2badf0fd-a6b5-447e-8095-646d1ea07494 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:57.388604 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2badf0fd-a6b5-447e-8095-646d1ea07494 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1683 microversion: 2.1 time: 0.163154 Oct 29 03:51:57.389188 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3705/7364] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:57 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:58.416695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ce43752f-3f50-4b64-9493-f5376cdf10fa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:58.417548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ce43752f-3f50-4b64-9493-f5376cdf10fa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:58.428943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43752f-3f50-4b64-9493-f5376cdf10fa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:58.429441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43752f-3f50-4b64-9493-f5376cdf10fa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:58.429913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43752f-3f50-4b64-9493-f5376cdf10fa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:58.430626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43752f-3f50-4b64-9493-f5376cdf10fa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:58.431090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43752f-3f50-4b64-9493-f5376cdf10fa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:58.431521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ce43752f-3f50-4b64-9493-f5376cdf10fa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:58.575684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ce43752f-3f50-4b64-9493-f5376cdf10fa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:58.586661 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ce43752f-3f50-4b64-9493-f5376cdf10fa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1683 microversion: 2.1 time: 0.176833 Oct 29 03:51:58.587239 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3660/7365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:58 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:59.613158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-173e5238-5ae5-4f2d-b1d6-50138eafd1c9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:59.614049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-173e5238-5ae5-4f2d-b1d6-50138eafd1c9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:59.623956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-173e5238-5ae5-4f2d-b1d6-50138eafd1c9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:59.624639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-173e5238-5ae5-4f2d-b1d6-50138eafd1c9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:59.625250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-173e5238-5ae5-4f2d-b1d6-50138eafd1c9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:59.626277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-173e5238-5ae5-4f2d-b1d6-50138eafd1c9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:59.626914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-173e5238-5ae5-4f2d-b1d6-50138eafd1c9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:59.627509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-173e5238-5ae5-4f2d-b1d6-50138eafd1c9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:59.766465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-173e5238-5ae5-4f2d-b1d6-50138eafd1c9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:59.774449 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-173e5238-5ae5-4f2d-b1d6-50138eafd1c9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1683 microversion: 2.1 time: 0.167199 Oct 29 03:51:59.775034 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3706/7366] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:59 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:00.802055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d355afa1-9c1f-43ee-97e9-367f5a3d359b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:00.802830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d355afa1-9c1f-43ee-97e9-367f5a3d359b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:00.810384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d355afa1-9c1f-43ee-97e9-367f5a3d359b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:00.810881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d355afa1-9c1f-43ee-97e9-367f5a3d359b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:00.811325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d355afa1-9c1f-43ee-97e9-367f5a3d359b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:00.812033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d355afa1-9c1f-43ee-97e9-367f5a3d359b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:00.812499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d355afa1-9c1f-43ee-97e9-367f5a3d359b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:00.812932 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d355afa1-9c1f-43ee-97e9-367f5a3d359b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:00.949485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d355afa1-9c1f-43ee-97e9-367f5a3d359b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:00.957556 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d355afa1-9c1f-43ee-97e9-367f5a3d359b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1683 microversion: 2.1 time: 0.161989 Oct 29 03:52:00.958162 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3661/7367] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:00 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:01.982070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8c34b010-d481-4d56-ad4c-bd06e60ad905 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:01.982731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8c34b010-d481-4d56-ad4c-bd06e60ad905 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:01.991589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c34b010-d481-4d56-ad4c-bd06e60ad905 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:01.992068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c34b010-d481-4d56-ad4c-bd06e60ad905 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:01.992489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c34b010-d481-4d56-ad4c-bd06e60ad905 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:01.993175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c34b010-d481-4d56-ad4c-bd06e60ad905 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:01.993617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c34b010-d481-4d56-ad4c-bd06e60ad905 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:01.994128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8c34b010-d481-4d56-ad4c-bd06e60ad905 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:02.128230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8c34b010-d481-4d56-ad4c-bd06e60ad905 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:02.139630 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8c34b010-d481-4d56-ad4c-bd06e60ad905 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1683 microversion: 2.1 time: 0.161840 Oct 29 03:52:02.140538 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3707/7368] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:01 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:03.168334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-910f8bdf-350b-4da1-a59a-00b009860152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:03.169344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-910f8bdf-350b-4da1-a59a-00b009860152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:03.180741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910f8bdf-350b-4da1-a59a-00b009860152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:03.181586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910f8bdf-350b-4da1-a59a-00b009860152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:03.182290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910f8bdf-350b-4da1-a59a-00b009860152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:03.183484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910f8bdf-350b-4da1-a59a-00b009860152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:03.184254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910f8bdf-350b-4da1-a59a-00b009860152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:03.184963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-910f8bdf-350b-4da1-a59a-00b009860152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:03.327128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-910f8bdf-350b-4da1-a59a-00b009860152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:03.337767 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-910f8bdf-350b-4da1-a59a-00b009860152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1683 microversion: 2.1 time: 0.176002 Oct 29 03:52:03.338375 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3662/7369] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:03 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:04.364657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a5515935-0770-450c-9dc7-66ef8b5700c3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:04.365404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a5515935-0770-450c-9dc7-66ef8b5700c3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:04.374399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5515935-0770-450c-9dc7-66ef8b5700c3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:04.375210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5515935-0770-450c-9dc7-66ef8b5700c3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:04.375679 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5515935-0770-450c-9dc7-66ef8b5700c3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:04.376495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5515935-0770-450c-9dc7-66ef8b5700c3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:04.377000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5515935-0770-450c-9dc7-66ef8b5700c3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:04.377413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a5515935-0770-450c-9dc7-66ef8b5700c3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:04.515980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a5515935-0770-450c-9dc7-66ef8b5700c3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:04.524327 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a5515935-0770-450c-9dc7-66ef8b5700c3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1683 microversion: 2.1 time: 0.164350 Oct 29 03:52:04.525087 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3708/7370] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:04 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:04.943008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ccd006e5-f61e-4804-a410-79b9e2bafbb9 req-3a6410cb-d787-4e62-9898-ffc148a7ce8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5f0ec5-1780-445d-a4fd-9675632698a4", "name": "network-vif-unplugged", "status": "completed", "tag": "36a138fe-ec96-4ad7-88bf-cd7fa22b6adc"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:04.954427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ccd006e5-f61e-4804-a410-79b9e2bafbb9 req-3a6410cb-d787-4e62-9898-ffc148a7ce8e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:04.954917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ccd006e5-f61e-4804-a410-79b9e2bafbb9 req-3a6410cb-d787-4e62-9898-ffc148a7ce8e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:04.955598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ccd006e5-f61e-4804-a410-79b9e2bafbb9 req-3a6410cb-d787-4e62-9898-ffc148a7ce8e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:04.968161 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ccd006e5-f61e-4804-a410-79b9e2bafbb9 req-3a6410cb-d787-4e62-9898-ffc148a7ce8e service nova] Creating event network-vif-unplugged:36a138fe-ec96-4ad7-88bf-cd7fa22b6adc for instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 on n-h1-862964-4 Oct 29 03:52:04.974040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-ccd006e5-f61e-4804-a410-79b9e2bafbb9 req-3a6410cb-d787-4e62-9898-ffc148a7ce8e service nova] Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:52:04.986134 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ccd006e5-f61e-4804-a410-79b9e2bafbb9 req-3a6410cb-d787-4e62-9898-ffc148a7ce8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047380 Oct 29 03:52:04.987146 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3663/7371] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:52:05.547539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-61d86200-cefa-42d2-8ee0-08f21084ac4a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:05.548126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-61d86200-cefa-42d2-8ee0-08f21084ac4a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:05.555420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61d86200-cefa-42d2-8ee0-08f21084ac4a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:05.556409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61d86200-cefa-42d2-8ee0-08f21084ac4a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:05.557061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61d86200-cefa-42d2-8ee0-08f21084ac4a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:05.558056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61d86200-cefa-42d2-8ee0-08f21084ac4a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:05.558682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61d86200-cefa-42d2-8ee0-08f21084ac4a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:05.559141 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-61d86200-cefa-42d2-8ee0-08f21084ac4a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:05.703799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-61d86200-cefa-42d2-8ee0-08f21084ac4a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:05.712490 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-61d86200-cefa-42d2-8ee0-08f21084ac4a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1682 microversion: 2.1 time: 0.168833 Oct 29 03:52:05.713095 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3709/7372] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:05 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:06.742129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-41cdcf4d-e83c-47b2-9856-a1f8bd03b152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:06.742965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-41cdcf4d-e83c-47b2-9856-a1f8bd03b152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:06.751318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41cdcf4d-e83c-47b2-9856-a1f8bd03b152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:06.751895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41cdcf4d-e83c-47b2-9856-a1f8bd03b152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:06.752411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41cdcf4d-e83c-47b2-9856-a1f8bd03b152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:06.753229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41cdcf4d-e83c-47b2-9856-a1f8bd03b152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:06.753779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41cdcf4d-e83c-47b2-9856-a1f8bd03b152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:06.754304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-41cdcf4d-e83c-47b2-9856-a1f8bd03b152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:06.897001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-41cdcf4d-e83c-47b2-9856-a1f8bd03b152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:06.905115 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-41cdcf4d-e83c-47b2-9856-a1f8bd03b152 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1680 microversion: 2.1 time: 0.170567 Oct 29 03:52:06.905699 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3664/7373] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:06 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:07.026194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-51041556-ff43-4073-8475-8bc61ae5aa4e req-5f3ba659-1a4b-4ab3-8a62-b0dd220d71cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5f0ec5-1780-445d-a4fd-9675632698a4", "tag": "36a138fe-ec96-4ad7-88bf-cd7fa22b6adc"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:07.036940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-51041556-ff43-4073-8475-8bc61ae5aa4e req-5f3ba659-1a4b-4ab3-8a62-b0dd220d71cb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:07.037412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-51041556-ff43-4073-8475-8bc61ae5aa4e req-5f3ba659-1a4b-4ab3-8a62-b0dd220d71cb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:07.037853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-51041556-ff43-4073-8475-8bc61ae5aa4e req-5f3ba659-1a4b-4ab3-8a62-b0dd220d71cb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:07.050056 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-51041556-ff43-4073-8475-8bc61ae5aa4e req-5f3ba659-1a4b-4ab3-8a62-b0dd220d71cb service nova] Creating event network-changed:36a138fe-ec96-4ad7-88bf-cd7fa22b6adc for instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 on n-h1-862964-4 Oct 29 03:52:07.056142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-51041556-ff43-4073-8475-8bc61ae5aa4e req-5f3ba659-1a4b-4ab3-8a62-b0dd220d71cb service nova] Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:52:07.067190 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-51041556-ff43-4073-8475-8bc61ae5aa4e req-5f3ba659-1a4b-4ab3-8a62-b0dd220d71cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044875 Oct 29 03:52:07.067771 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3710/7374] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:07.929226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5953dd8a-9e05-428a-9118-3cc36ff3ed6a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:07.929851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5953dd8a-9e05-428a-9118-3cc36ff3ed6a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:07.937134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5953dd8a-9e05-428a-9118-3cc36ff3ed6a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:07.937632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5953dd8a-9e05-428a-9118-3cc36ff3ed6a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:07.938127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5953dd8a-9e05-428a-9118-3cc36ff3ed6a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:07.938866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5953dd8a-9e05-428a-9118-3cc36ff3ed6a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:07.939301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5953dd8a-9e05-428a-9118-3cc36ff3ed6a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:07.939733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5953dd8a-9e05-428a-9118-3cc36ff3ed6a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:08.396866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5953dd8a-9e05-428a-9118-3cc36ff3ed6a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:08.409135 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5953dd8a-9e05-428a-9118-3cc36ff3ed6a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1677 microversion: 2.1 time: 0.483816 Oct 29 03:52:08.409782 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3665/7375] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:07 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1677 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:08.434207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:08.434823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:08.441309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:08.441789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:08.442245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:08.442934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:08.443377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:08.443791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:08.482856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:08.483347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:08.483771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:08.484475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:08.484968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:08.485409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:08.506567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:52:08.511982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for user d88f049383ec4971b8c92bfde389e873 and project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:52:08.619735 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c41cb80-6551-4ee0-abcf-66f5743901aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4/action" status: 202 len: 0 microversion: 2.1 time: 0.190533 Oct 29 03:52:08.620641 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3711/7376] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:52:08 2022] POST /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:52:08.629433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a4af9345-f622-4ca7-a9b8-714ab104eaeb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:08.630757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a4af9345-f622-4ca7-a9b8-714ab104eaeb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:08.637535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4af9345-f622-4ca7-a9b8-714ab104eaeb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:08.638048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4af9345-f622-4ca7-a9b8-714ab104eaeb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:08.638523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4af9345-f622-4ca7-a9b8-714ab104eaeb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:08.639221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4af9345-f622-4ca7-a9b8-714ab104eaeb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:08.639679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4af9345-f622-4ca7-a9b8-714ab104eaeb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:08.640108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a4af9345-f622-4ca7-a9b8-714ab104eaeb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:08.841058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a4af9345-f622-4ca7-a9b8-714ab104eaeb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:08.849978 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a4af9345-f622-4ca7-a9b8-714ab104eaeb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1676 microversion: 2.1 time: 0.224840 Oct 29 03:52:08.850643 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3666/7377] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:08 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:09.882652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b28329af-127f-42e5-943c-5ba5962db1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:09.883291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b28329af-127f-42e5-943c-5ba5962db1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:09.890775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b28329af-127f-42e5-943c-5ba5962db1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:09.891253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b28329af-127f-42e5-943c-5ba5962db1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:09.891682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b28329af-127f-42e5-943c-5ba5962db1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:09.892401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b28329af-127f-42e5-943c-5ba5962db1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:09.892848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b28329af-127f-42e5-943c-5ba5962db1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:09.893265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b28329af-127f-42e5-943c-5ba5962db1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:10.034745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b28329af-127f-42e5-943c-5ba5962db1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:10.042771 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b28329af-127f-42e5-943c-5ba5962db1fb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1676 microversion: 2.1 time: 0.168707 Oct 29 03:52:10.043360 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3712/7378] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:09 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:10.671720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4565a50b-18fc-4485-8702-3c539aef56aa req-dc1a1fed-42a7-4718-9b4a-ed0765d11313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5f0ec5-1780-445d-a4fd-9675632698a4", "name": "network-vif-plugged", "status": "completed", "tag": "36a138fe-ec96-4ad7-88bf-cd7fa22b6adc"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:10.682965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4565a50b-18fc-4485-8702-3c539aef56aa req-dc1a1fed-42a7-4718-9b4a-ed0765d11313 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:10.683494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4565a50b-18fc-4485-8702-3c539aef56aa req-dc1a1fed-42a7-4718-9b4a-ed0765d11313 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:10.684084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4565a50b-18fc-4485-8702-3c539aef56aa req-dc1a1fed-42a7-4718-9b4a-ed0765d11313 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:10.696988 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4565a50b-18fc-4485-8702-3c539aef56aa req-dc1a1fed-42a7-4718-9b4a-ed0765d11313 service nova] Creating event network-vif-plugged:36a138fe-ec96-4ad7-88bf-cd7fa22b6adc for instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 on n-h1-862964-4 Oct 29 03:52:10.702627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-4565a50b-18fc-4485-8702-3c539aef56aa req-dc1a1fed-42a7-4718-9b4a-ed0765d11313 service nova] Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:52:10.713948 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4565a50b-18fc-4485-8702-3c539aef56aa req-dc1a1fed-42a7-4718-9b4a-ed0765d11313 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045960 Oct 29 03:52:10.714636 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3667/7379] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:11.068573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-88eb9770-37a3-4f4a-b731-74c864f5067e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:11.069358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-88eb9770-37a3-4f4a-b731-74c864f5067e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:11.079278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88eb9770-37a3-4f4a-b731-74c864f5067e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:11.079944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88eb9770-37a3-4f4a-b731-74c864f5067e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:11.080528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88eb9770-37a3-4f4a-b731-74c864f5067e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:11.081720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88eb9770-37a3-4f4a-b731-74c864f5067e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:11.082396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88eb9770-37a3-4f4a-b731-74c864f5067e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:11.083024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-88eb9770-37a3-4f4a-b731-74c864f5067e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:11.231807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-88eb9770-37a3-4f4a-b731-74c864f5067e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:11.240186 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-88eb9770-37a3-4f4a-b731-74c864f5067e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1676 microversion: 2.1 time: 0.177046 Oct 29 03:52:11.240802 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3713/7380] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:11 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:12.009657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b0a9a3b6-b458-42d5-9bf2-d43e207df0ef req-a768226e-4000-464a-a514-83f584fe460b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5f0ec5-1780-445d-a4fd-9675632698a4", "name": "network-vif-unplugged", "status": "completed", "tag": "36a138fe-ec96-4ad7-88bf-cd7fa22b6adc"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:12.021588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0a9a3b6-b458-42d5-9bf2-d43e207df0ef req-a768226e-4000-464a-a514-83f584fe460b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:12.022108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0a9a3b6-b458-42d5-9bf2-d43e207df0ef req-a768226e-4000-464a-a514-83f584fe460b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:12.022599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b0a9a3b6-b458-42d5-9bf2-d43e207df0ef req-a768226e-4000-464a-a514-83f584fe460b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:12.035012 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b0a9a3b6-b458-42d5-9bf2-d43e207df0ef req-a768226e-4000-464a-a514-83f584fe460b service nova] Creating event network-vif-unplugged:36a138fe-ec96-4ad7-88bf-cd7fa22b6adc for instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 on n-h2-862964-4 Oct 29 03:52:12.040838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-b0a9a3b6-b458-42d5-9bf2-d43e207df0ef req-a768226e-4000-464a-a514-83f584fe460b service nova] Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:52:12.051704 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b0a9a3b6-b458-42d5-9bf2-d43e207df0ef req-a768226e-4000-464a-a514-83f584fe460b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047480 Oct 29 03:52:12.052526 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3668/7381] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:12.264728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3fb0c7a9-bb5d-40ad-84cd-fa661b14001b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:12.265328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3fb0c7a9-bb5d-40ad-84cd-fa661b14001b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:12.272632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fb0c7a9-bb5d-40ad-84cd-fa661b14001b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:12.273118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fb0c7a9-bb5d-40ad-84cd-fa661b14001b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:12.273548 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fb0c7a9-bb5d-40ad-84cd-fa661b14001b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:12.274281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fb0c7a9-bb5d-40ad-84cd-fa661b14001b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:12.274723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fb0c7a9-bb5d-40ad-84cd-fa661b14001b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:12.275134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3fb0c7a9-bb5d-40ad-84cd-fa661b14001b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:12.775601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3fb0c7a9-bb5d-40ad-84cd-fa661b14001b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:12.784580 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3fb0c7a9-bb5d-40ad-84cd-fa661b14001b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1676 microversion: 2.1 time: 0.523666 Oct 29 03:52:12.785399 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3714/7382] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:12 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1676 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:13.813581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2fe5fbfc-27de-4510-8719-83d9bcda19db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:13.814735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2fe5fbfc-27de-4510-8719-83d9bcda19db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:13.823077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe5fbfc-27de-4510-8719-83d9bcda19db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:13.823568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe5fbfc-27de-4510-8719-83d9bcda19db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:13.824002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe5fbfc-27de-4510-8719-83d9bcda19db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:13.824697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe5fbfc-27de-4510-8719-83d9bcda19db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:13.825166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe5fbfc-27de-4510-8719-83d9bcda19db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:13.825584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2fe5fbfc-27de-4510-8719-83d9bcda19db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:13.959509 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2fe5fbfc-27de-4510-8719-83d9bcda19db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:13.968055 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2fe5fbfc-27de-4510-8719-83d9bcda19db tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1676 microversion: 2.1 time: 0.162929 Oct 29 03:52:13.968662 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3669/7383] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:13 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:14.091220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-f08d8d78-a72e-43de-a107-05245bbe6a05 req-bf5561a0-9523-41f7-b69f-fd4560bddfdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5f0ec5-1780-445d-a4fd-9675632698a4", "tag": "36a138fe-ec96-4ad7-88bf-cd7fa22b6adc"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:14.103034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f08d8d78-a72e-43de-a107-05245bbe6a05 req-bf5561a0-9523-41f7-b69f-fd4560bddfdf service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:14.103562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f08d8d78-a72e-43de-a107-05245bbe6a05 req-bf5561a0-9523-41f7-b69f-fd4560bddfdf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:14.104032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-f08d8d78-a72e-43de-a107-05245bbe6a05 req-bf5561a0-9523-41f7-b69f-fd4560bddfdf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:14.117828 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-f08d8d78-a72e-43de-a107-05245bbe6a05 req-bf5561a0-9523-41f7-b69f-fd4560bddfdf service nova] Creating event network-changed:36a138fe-ec96-4ad7-88bf-cd7fa22b6adc for instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 on n-h2-862964-4 Oct 29 03:52:14.123617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-f08d8d78-a72e-43de-a107-05245bbe6a05 req-bf5561a0-9523-41f7-b69f-fd4560bddfdf service nova] Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:52:14.135405 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-f08d8d78-a72e-43de-a107-05245bbe6a05 req-bf5561a0-9523-41f7-b69f-fd4560bddfdf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048899 Oct 29 03:52:14.136005 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3715/7384] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:14.993391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c9aac94d-5c5f-470e-90ce-516ef4ed4d16 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:14.994009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c9aac94d-5c5f-470e-90ce-516ef4ed4d16 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:15.001262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9aac94d-5c5f-470e-90ce-516ef4ed4d16 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:15.001772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9aac94d-5c5f-470e-90ce-516ef4ed4d16 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:15.002246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9aac94d-5c5f-470e-90ce-516ef4ed4d16 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:15.002934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9aac94d-5c5f-470e-90ce-516ef4ed4d16 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:15.003397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9aac94d-5c5f-470e-90ce-516ef4ed4d16 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:15.003827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c9aac94d-5c5f-470e-90ce-516ef4ed4d16 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:15.146724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c9aac94d-5c5f-470e-90ce-516ef4ed4d16 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:15.155988 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c9aac94d-5c5f-470e-90ce-516ef4ed4d16 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1676 microversion: 2.1 time: 0.166727 Oct 29 03:52:15.157905 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3670/7385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:14 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:16.181319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c51e4e2-af16-407d-85be-a5afe5fefa73 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:16.182030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c51e4e2-af16-407d-85be-a5afe5fefa73 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:16.188629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c51e4e2-af16-407d-85be-a5afe5fefa73 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.189108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c51e4e2-af16-407d-85be-a5afe5fefa73 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.189536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c51e4e2-af16-407d-85be-a5afe5fefa73 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.190253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c51e4e2-af16-407d-85be-a5afe5fefa73 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.190698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c51e4e2-af16-407d-85be-a5afe5fefa73 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.191117 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c51e4e2-af16-407d-85be-a5afe5fefa73 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.195289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:16.332776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c51e4e2-af16-407d-85be-a5afe5fefa73 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:16.341312 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c51e4e2-af16-407d-85be-a5afe5fefa73 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1669 microversion: 2.1 time: 0.165287 Oct 29 03:52:16.341950 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3716/7386] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:16 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:16.364284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-88544a81-2840-484d-af80-7811ee72728c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:16.364936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-88544a81-2840-484d-af80-7811ee72728c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:16.372324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88544a81-2840-484d-af80-7811ee72728c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.372823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88544a81-2840-484d-af80-7811ee72728c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.373272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88544a81-2840-484d-af80-7811ee72728c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.374014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88544a81-2840-484d-af80-7811ee72728c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.374479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88544a81-2840-484d-af80-7811ee72728c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.374912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-88544a81-2840-484d-af80-7811ee72728c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.512105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-88544a81-2840-484d-af80-7811ee72728c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:16.520149 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-88544a81-2840-484d-af80-7811ee72728c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1669 microversion: 2.1 time: 0.160243 Oct 29 03:52:16.520703 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3671/7387] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:16 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:16.542732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3282579f-2a36-478e-bacf-0b686ed986a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:16.543334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3282579f-2a36-478e-bacf-0b686ed986a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:16.549607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3282579f-2a36-478e-bacf-0b686ed986a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.550142 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3282579f-2a36-478e-bacf-0b686ed986a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.550570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3282579f-2a36-478e-bacf-0b686ed986a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.551260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3282579f-2a36-478e-bacf-0b686ed986a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.551708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3282579f-2a36-478e-bacf-0b686ed986a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.552126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3282579f-2a36-478e-bacf-0b686ed986a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.688463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3282579f-2a36-478e-bacf-0b686ed986a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:16.696772 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3282579f-2a36-478e-bacf-0b686ed986a1 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1669 microversion: 2.1 time: 0.157890 Oct 29 03:52:16.697563 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3717/7388] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:16 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:16.719416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-17e75e40-a038-4c1a-b802-986982f9ff8b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:16.720055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-17e75e40-a038-4c1a-b802-986982f9ff8b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:16.726499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17e75e40-a038-4c1a-b802-986982f9ff8b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.727100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17e75e40-a038-4c1a-b802-986982f9ff8b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.727541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17e75e40-a038-4c1a-b802-986982f9ff8b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.728215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17e75e40-a038-4c1a-b802-986982f9ff8b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.728674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17e75e40-a038-4c1a-b802-986982f9ff8b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.729115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17e75e40-a038-4c1a-b802-986982f9ff8b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.733357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:16.756696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-17e75e40-a038-4c1a-b802-986982f9ff8b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:52:16.841981 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-17e75e40-a038-4c1a-b802-986982f9ff8b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 204 len: 0 microversion: 2.1 time: 0.126310 Oct 29 03:52:16.842579 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3672/7389] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:52:16 2022] DELETE /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:52:16.851940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-707ffba2-f67c-4234-a158-364d9e6ab7aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:16.852578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-707ffba2-f67c-4234-a158-364d9e6ab7aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:16.858654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-707ffba2-f67c-4234-a158-364d9e6ab7aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.859136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-707ffba2-f67c-4234-a158-364d9e6ab7aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.859560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-707ffba2-f67c-4234-a158-364d9e6ab7aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.860257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-707ffba2-f67c-4234-a158-364d9e6ab7aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.860704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-707ffba2-f67c-4234-a158-364d9e6ab7aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.861118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-707ffba2-f67c-4234-a158-364d9e6ab7aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.994091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-707ffba2-f67c-4234-a158-364d9e6ab7aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:17.002106 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-707ffba2-f67c-4234-a158-364d9e6ab7aa tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1675 microversion: 2.1 time: 0.154344 Oct 29 03:52:17.002687 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3718/7390] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:16 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:52:18.026388 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2811625b-7346-441d-af40-8cc73df87426 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:18.027209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2811625b-7346-441d-af40-8cc73df87426 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:18.034604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2811625b-7346-441d-af40-8cc73df87426 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:18.035126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2811625b-7346-441d-af40-8cc73df87426 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:18.035547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2811625b-7346-441d-af40-8cc73df87426 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:18.036262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2811625b-7346-441d-af40-8cc73df87426 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:18.036720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2811625b-7346-441d-af40-8cc73df87426 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:18.037150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2811625b-7346-441d-af40-8cc73df87426 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:18.175571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2811625b-7346-441d-af40-8cc73df87426 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:18.184305 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2811625b-7346-441d-af40-8cc73df87426 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1675 microversion: 2.1 time: 0.162340 Oct 29 03:52:18.184885 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3673/7391] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:18 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:18.413715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a1af250b-7855-4cfd-ba46-07c6e7347146 req-8b83c159-ab68-4bf8-a4d9-8fa7916c2806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5f0ec5-1780-445d-a4fd-9675632698a4", "name": "network-vif-plugged", "status": "completed", "tag": "36a138fe-ec96-4ad7-88bf-cd7fa22b6adc"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:18.425562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a1af250b-7855-4cfd-ba46-07c6e7347146 req-8b83c159-ab68-4bf8-a4d9-8fa7916c2806 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:18.426073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a1af250b-7855-4cfd-ba46-07c6e7347146 req-8b83c159-ab68-4bf8-a4d9-8fa7916c2806 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:18.426703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a1af250b-7855-4cfd-ba46-07c6e7347146 req-8b83c159-ab68-4bf8-a4d9-8fa7916c2806 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:18.439063 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a1af250b-7855-4cfd-ba46-07c6e7347146 req-8b83c159-ab68-4bf8-a4d9-8fa7916c2806 service nova] Creating event network-vif-plugged:36a138fe-ec96-4ad7-88bf-cd7fa22b6adc for instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 on n-h2-862964-4 Oct 29 03:52:18.444668 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a1af250b-7855-4cfd-ba46-07c6e7347146 req-8b83c159-ab68-4bf8-a4d9-8fa7916c2806 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034859 Oct 29 03:52:18.445921 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3719/7392] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:19.184457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-54623cac-f5f4-4141-a6ff-b97cb57e63f7 req-05e14083-f15a-4491-b70d-98570f869de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5f0ec5-1780-445d-a4fd-9675632698a4", "name": "network-vif-deleted", "tag": "36a138fe-ec96-4ad7-88bf-cd7fa22b6adc"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:19.195376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-54623cac-f5f4-4141-a6ff-b97cb57e63f7 req-05e14083-f15a-4491-b70d-98570f869de1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:19.195851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-54623cac-f5f4-4141-a6ff-b97cb57e63f7 req-05e14083-f15a-4491-b70d-98570f869de1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:19.196298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-54623cac-f5f4-4141-a6ff-b97cb57e63f7 req-05e14083-f15a-4491-b70d-98570f869de1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:19.206087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:19.208975 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-54623cac-f5f4-4141-a6ff-b97cb57e63f7 req-05e14083-f15a-4491-b70d-98570f869de1 service nova] Creating event network-vif-deleted:36a138fe-ec96-4ad7-88bf-cd7fa22b6adc for instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 on n-h2-862964-4 Oct 29 03:52:19.213132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-770d61f1-dc05-4fb1-9949-54caceb96bc9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:19.214191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-770d61f1-dc05-4fb1-9949-54caceb96bc9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:19.215043 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-54623cac-f5f4-4141-a6ff-b97cb57e63f7 req-05e14083-f15a-4491-b70d-98570f869de1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034258 Oct 29 03:52:19.219124 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3674/7393] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:19.224234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770d61f1-dc05-4fb1-9949-54caceb96bc9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:19.224989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770d61f1-dc05-4fb1-9949-54caceb96bc9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:19.225738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770d61f1-dc05-4fb1-9949-54caceb96bc9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:19.226497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770d61f1-dc05-4fb1-9949-54caceb96bc9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:19.227121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770d61f1-dc05-4fb1-9949-54caceb96bc9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:19.228505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-770d61f1-dc05-4fb1-9949-54caceb96bc9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:19.303480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-770d61f1-dc05-4fb1-9949-54caceb96bc9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:19.313277 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-770d61f1-dc05-4fb1-9949-54caceb96bc9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 200 len: 1324 microversion: 2.1 time: 0.108197 Oct 29 03:52:19.314231 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3720/7394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:19 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 1324 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:52:20.343351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:20.344068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:20.346135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:20.351885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:20.352390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:20.352833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:20.353549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:20.354045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:20.354479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:20.370396 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 HTTP/1.1 Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1f5f0ec5-1780-445d-a4fd-9675632698a4'} Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:52:20.372096 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:52:20.380419 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:20.380419 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:52:20.380419 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:52:20.380419 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:52:20.380419 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:52:20.380419 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:52:20.380419 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:52:20.380419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:52:20.380419 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-aacca23c-2360-4791-989c-4cf31a0084c5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 404 len: 111 microversion: 2.1 time: 0.039553 Oct 29 03:52:20.380419 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3675/7395] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:20 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:52:20.390437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:20.391451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:20.394340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:20.400271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:20.400846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:20.401336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:20.402187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:20.402751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:20.403227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:20.418914 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 HTTP/1.1 Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1f5f0ec5-1780-445d-a4fd-9675632698a4'} Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:52:20.420703 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:52:20.425169 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:20.425169 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:52:20.425169 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:52:20.425169 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:52:20.425169 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:52:20.425169 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:52:20.425169 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:52:20.425169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:52:20.425169 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-21261675-b2d6-45e2-be03-9043244aa436 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 404 len: 111 microversion: 2.1 time: 0.037082 Oct 29 03:52:20.425754 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3721/7396] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:20 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:52:20.475596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1072345519", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "4aafb772-aedb-4bf4-bd4c-0aa7d4b31f9a"}], "security_groups": [{"name": "tempest-securitygroup--65035578"}], "key_name": "tempest-keypair-2070687314", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:20.588220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] validate_networks() for [('4aafb772-aedb-4bf4-bd4c-0aa7d4b31f9a', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:52:21.041204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:52:21.041866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:52:21.042558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:52:21.043095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:52:21.043658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:52:21.056422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:21.056913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:21.057360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:21.058129 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:21.058596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:21.059026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:21.076368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:52:21.081744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for user d88f049383ec4971b8c92bfde389e873 and project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:52:21.095024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:52:21.097351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:52:21.145836 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-17fc4b17-465a-4889-8010-38d02968ea94 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.674329 Oct 29 03:52:21.146501 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3676/7397] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:52:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:52:21.158568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be939122-6820-4891-9141-e8d2b6c8b97c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:21.159272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-be939122-6820-4891-9141-e8d2b6c8b97c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:21.219619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-be939122-6820-4891-9141-e8d2b6c8b97c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:21.226949 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be939122-6820-4891-9141-e8d2b6c8b97c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1239 microversion: 2.1 time: 0.072393 Oct 29 03:52:21.227638 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3722/7398] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:21 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:22.252548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-020a98d3-8a5f-40e2-86eb-0f8b92253d24 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:22.253221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-020a98d3-8a5f-40e2-86eb-0f8b92253d24 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:22.260699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-020a98d3-8a5f-40e2-86eb-0f8b92253d24 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:22.261244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-020a98d3-8a5f-40e2-86eb-0f8b92253d24 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:22.262086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-020a98d3-8a5f-40e2-86eb-0f8b92253d24 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:22.262961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-020a98d3-8a5f-40e2-86eb-0f8b92253d24 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:22.263604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-020a98d3-8a5f-40e2-86eb-0f8b92253d24 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:22.265789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-020a98d3-8a5f-40e2-86eb-0f8b92253d24 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:22.368498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-020a98d3-8a5f-40e2-86eb-0f8b92253d24 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:22.376697 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-020a98d3-8a5f-40e2-86eb-0f8b92253d24 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1299 microversion: 2.1 time: 0.129229 Oct 29 03:52:22.377443 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3677/7399] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:22 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:23.402415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-00edc0aa-9496-4d20-aab2-052345834b7d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:23.403652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-00edc0aa-9496-4d20-aab2-052345834b7d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:23.413342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00edc0aa-9496-4d20-aab2-052345834b7d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:23.414269 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00edc0aa-9496-4d20-aab2-052345834b7d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:23.414751 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00edc0aa-9496-4d20-aab2-052345834b7d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:23.415571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00edc0aa-9496-4d20-aab2-052345834b7d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:23.416025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00edc0aa-9496-4d20-aab2-052345834b7d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:23.416441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-00edc0aa-9496-4d20-aab2-052345834b7d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:23.558672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-00edc0aa-9496-4d20-aab2-052345834b7d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:23.567240 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-00edc0aa-9496-4d20-aab2-052345834b7d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1363 microversion: 2.1 time: 0.170172 Oct 29 03:52:23.568056 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3723/7400] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:23 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:23.714950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6db0dd9f-d2c0-4f34-81ab-dd8155a672f4 req-91242c9a-2d2a-4d27-a63e-08f5bdbdbdac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02f49d8-c410-4cbc-abea-3eb192c7f237", "tag": "f3d2c850-1b04-4573-b198-2447a4885614"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:23.727566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6db0dd9f-d2c0-4f34-81ab-dd8155a672f4 req-91242c9a-2d2a-4d27-a63e-08f5bdbdbdac service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:23.728060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6db0dd9f-d2c0-4f34-81ab-dd8155a672f4 req-91242c9a-2d2a-4d27-a63e-08f5bdbdbdac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:23.728504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6db0dd9f-d2c0-4f34-81ab-dd8155a672f4 req-91242c9a-2d2a-4d27-a63e-08f5bdbdbdac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:23.740489 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6db0dd9f-d2c0-4f34-81ab-dd8155a672f4 req-91242c9a-2d2a-4d27-a63e-08f5bdbdbdac service nova] Creating event network-changed:f3d2c850-1b04-4573-b198-2447a4885614 for instance f02f49d8-c410-4cbc-abea-3eb192c7f237 on n-h1-862964-4 Oct 29 03:52:23.745637 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6db0dd9f-d2c0-4f34-81ab-dd8155a672f4 req-91242c9a-2d2a-4d27-a63e-08f5bdbdbdac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035315 Oct 29 03:52:23.746571 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3678/7401] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:24.592113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3e1a85e2-b8b5-40d6-babb-98bb3b32b06f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:24.592698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3e1a85e2-b8b5-40d6-babb-98bb3b32b06f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:24.600121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1a85e2-b8b5-40d6-babb-98bb3b32b06f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:24.600643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1a85e2-b8b5-40d6-babb-98bb3b32b06f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:24.601072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1a85e2-b8b5-40d6-babb-98bb3b32b06f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:24.601767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1a85e2-b8b5-40d6-babb-98bb3b32b06f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:24.602248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1a85e2-b8b5-40d6-babb-98bb3b32b06f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:24.602672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3e1a85e2-b8b5-40d6-babb-98bb3b32b06f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:24.741953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3e1a85e2-b8b5-40d6-babb-98bb3b32b06f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:24.750178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3e1a85e2-b8b5-40d6-babb-98bb3b32b06f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1363 microversion: 2.1 time: 0.162168 Oct 29 03:52:24.750766 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3724/7402] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:24 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:25.790180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-82712800-5af2-4ecb-bc10-f93a70c853ca tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:25.790894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-82712800-5af2-4ecb-bc10-f93a70c853ca tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:25.798726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82712800-5af2-4ecb-bc10-f93a70c853ca tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:25.799216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82712800-5af2-4ecb-bc10-f93a70c853ca tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:25.799659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82712800-5af2-4ecb-bc10-f93a70c853ca tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:25.800363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82712800-5af2-4ecb-bc10-f93a70c853ca tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:25.800915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82712800-5af2-4ecb-bc10-f93a70c853ca tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:25.801353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-82712800-5af2-4ecb-bc10-f93a70c853ca tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:25.939439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-82712800-5af2-4ecb-bc10-f93a70c853ca tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:25.947848 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-82712800-5af2-4ecb-bc10-f93a70c853ca tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1363 microversion: 2.1 time: 0.167118 Oct 29 03:52:25.948450 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3679/7403] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:25 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:26.972286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f55fd392-874f-4e02-9b79-6f2ce8e6a756 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:26.972894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f55fd392-874f-4e02-9b79-6f2ce8e6a756 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:26.980561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f55fd392-874f-4e02-9b79-6f2ce8e6a756 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:26.981042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f55fd392-874f-4e02-9b79-6f2ce8e6a756 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:26.981469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f55fd392-874f-4e02-9b79-6f2ce8e6a756 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:26.982190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f55fd392-874f-4e02-9b79-6f2ce8e6a756 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:26.982635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f55fd392-874f-4e02-9b79-6f2ce8e6a756 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:26.983049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f55fd392-874f-4e02-9b79-6f2ce8e6a756 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:27.117108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f55fd392-874f-4e02-9b79-6f2ce8e6a756 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:27.125137 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f55fd392-874f-4e02-9b79-6f2ce8e6a756 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1363 microversion: 2.1 time: 0.156886 Oct 29 03:52:27.125720 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3725/7404] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:26 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:28.152647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-170e63b4-7d3e-44f3-ab8e-1ae0b3a4a3e4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:28.153294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-170e63b4-7d3e-44f3-ab8e-1ae0b3a4a3e4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:28.161603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-170e63b4-7d3e-44f3-ab8e-1ae0b3a4a3e4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:28.162199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-170e63b4-7d3e-44f3-ab8e-1ae0b3a4a3e4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:28.162695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-170e63b4-7d3e-44f3-ab8e-1ae0b3a4a3e4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:28.163484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-170e63b4-7d3e-44f3-ab8e-1ae0b3a4a3e4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:28.163993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-170e63b4-7d3e-44f3-ab8e-1ae0b3a4a3e4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:28.164477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-170e63b4-7d3e-44f3-ab8e-1ae0b3a4a3e4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:28.309111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-170e63b4-7d3e-44f3-ab8e-1ae0b3a4a3e4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:28.317737 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-170e63b4-7d3e-44f3-ab8e-1ae0b3a4a3e4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1363 microversion: 2.1 time: 0.170877 Oct 29 03:52:28.318360 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3680/7405] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:28 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:28.720268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d75eb0a2-e0e9-46de-b13a-209a1f971afe req-8f59487d-1f75-4072-b6be-19cfe1d95fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02f49d8-c410-4cbc-abea-3eb192c7f237", "name": "network-vif-plugged", "status": "completed", "tag": "f3d2c850-1b04-4573-b198-2447a4885614"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:28.730990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d75eb0a2-e0e9-46de-b13a-209a1f971afe req-8f59487d-1f75-4072-b6be-19cfe1d95fd1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:28.731392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d75eb0a2-e0e9-46de-b13a-209a1f971afe req-8f59487d-1f75-4072-b6be-19cfe1d95fd1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:28.731817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d75eb0a2-e0e9-46de-b13a-209a1f971afe req-8f59487d-1f75-4072-b6be-19cfe1d95fd1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:28.743757 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d75eb0a2-e0e9-46de-b13a-209a1f971afe req-8f59487d-1f75-4072-b6be-19cfe1d95fd1 service nova] Creating event network-vif-plugged:f3d2c850-1b04-4573-b198-2447a4885614 for instance f02f49d8-c410-4cbc-abea-3eb192c7f237 on n-h1-862964-4 Oct 29 03:52:28.751276 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d75eb0a2-e0e9-46de-b13a-209a1f971afe req-8f59487d-1f75-4072-b6be-19cfe1d95fd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034902 Oct 29 03:52:28.752029 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3726/7406] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:29.346373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1856e47f-a287-4cf2-b5ab-9766bc057a02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:29.347369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1856e47f-a287-4cf2-b5ab-9766bc057a02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:29.358084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1856e47f-a287-4cf2-b5ab-9766bc057a02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:29.358577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1856e47f-a287-4cf2-b5ab-9766bc057a02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:29.359016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1856e47f-a287-4cf2-b5ab-9766bc057a02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:29.359715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1856e47f-a287-4cf2-b5ab-9766bc057a02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:29.360172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1856e47f-a287-4cf2-b5ab-9766bc057a02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:29.360602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1856e47f-a287-4cf2-b5ab-9766bc057a02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:29.499483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1856e47f-a287-4cf2-b5ab-9766bc057a02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:29.507739 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1856e47f-a287-4cf2-b5ab-9766bc057a02 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1363 microversion: 2.1 time: 0.168451 Oct 29 03:52:29.508333 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3681/7407] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:29 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:30.533203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c1fae3c-a5d6-448a-9af3-76384bfef83b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:30.533926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c1fae3c-a5d6-448a-9af3-76384bfef83b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:30.540497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1fae3c-a5d6-448a-9af3-76384bfef83b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:30.540980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1fae3c-a5d6-448a-9af3-76384bfef83b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:30.541420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1fae3c-a5d6-448a-9af3-76384bfef83b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:30.542169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1fae3c-a5d6-448a-9af3-76384bfef83b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:30.542622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1fae3c-a5d6-448a-9af3-76384bfef83b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:30.543040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c1fae3c-a5d6-448a-9af3-76384bfef83b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:30.686246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c1fae3c-a5d6-448a-9af3-76384bfef83b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:30.694545 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c1fae3c-a5d6-448a-9af3-76384bfef83b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1550 microversion: 2.1 time: 0.166695 Oct 29 03:52:30.695130 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3727/7408] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:30 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:30.719703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-46f01e4f-d33b-4251-a7b8-a557ffb4494b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:30.720220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-46f01e4f-d33b-4251-a7b8-a557ffb4494b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:30.727196 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46f01e4f-d33b-4251-a7b8-a557ffb4494b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:30.727692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46f01e4f-d33b-4251-a7b8-a557ffb4494b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:30.728132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46f01e4f-d33b-4251-a7b8-a557ffb4494b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:30.728831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46f01e4f-d33b-4251-a7b8-a557ffb4494b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:30.729289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46f01e4f-d33b-4251-a7b8-a557ffb4494b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:30.729719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46f01e4f-d33b-4251-a7b8-a557ffb4494b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:30.818995 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-46f01e4f-d33b-4251-a7b8-a557ffb4494b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103567 Oct 29 03:52:30.819849 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3682/7409] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:52:30 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:31.793233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-235c5431-75df-42c1-b384-2cc487327276 req-94c3f913-69b3-40e5-b51a-9f9c613b8f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02f49d8-c410-4cbc-abea-3eb192c7f237", "tag": "f3d2c850-1b04-4573-b198-2447a4885614"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:31.799356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:31.804682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-235c5431-75df-42c1-b384-2cc487327276 req-94c3f913-69b3-40e5-b51a-9f9c613b8f39 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:31.805232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-235c5431-75df-42c1-b384-2cc487327276 req-94c3f913-69b3-40e5-b51a-9f9c613b8f39 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:31.805728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-235c5431-75df-42c1-b384-2cc487327276 req-94c3f913-69b3-40e5-b51a-9f9c613b8f39 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:31.817752 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-235c5431-75df-42c1-b384-2cc487327276 req-94c3f913-69b3-40e5-b51a-9f9c613b8f39 service nova] Creating event network-changed:f3d2c850-1b04-4573-b198-2447a4885614 for instance f02f49d8-c410-4cbc-abea-3eb192c7f237 on n-h1-862964-4 Oct 29 03:52:31.822788 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-235c5431-75df-42c1-b384-2cc487327276 req-94c3f913-69b3-40e5-b51a-9f9c613b8f39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033308 Oct 29 03:52:31.823385 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3728/7410] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:06.140647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:06.141723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:06.143676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:06.144496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:06.148941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-affb1f47-4c0f-4771-9bf8-314972bf02bd tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:06.149476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-affb1f47-4c0f-4771-9bf8-314972bf02bd tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:06.158654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-affb1f47-4c0f-4771-9bf8-314972bf02bd tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:06.159146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-affb1f47-4c0f-4771-9bf8-314972bf02bd tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:06.159587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-affb1f47-4c0f-4771-9bf8-314972bf02bd tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:06.160288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-affb1f47-4c0f-4771-9bf8-314972bf02bd tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:06.160746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-affb1f47-4c0f-4771-9bf8-314972bf02bd tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:06.161175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-affb1f47-4c0f-4771-9bf8-314972bf02bd tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:06.302041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-affb1f47-4c0f-4771-9bf8-314972bf02bd tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:06.313631 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-affb1f47-4c0f-4771-9bf8-314972bf02bd tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1668 microversion: 2.1 time: 0.174536 Oct 29 03:53:06.314278 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3683/7411] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:06 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:06.334606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=17 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:06.335403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=54 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:06.339672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8cbaca48-3aeb-4262-bb10-6e8201dcb8f2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31bb0a5d-15d3-431a-be1a-20662434fdf1"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:53:06.342120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8cbaca48-3aeb-4262-bb10-6e8201dcb8f2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:06.349207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cbaca48-3aeb-4262-bb10-6e8201dcb8f2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:06.349686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cbaca48-3aeb-4262-bb10-6e8201dcb8f2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:06.350137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cbaca48-3aeb-4262-bb10-6e8201dcb8f2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:06.350828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cbaca48-3aeb-4262-bb10-6e8201dcb8f2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:06.351283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cbaca48-3aeb-4262-bb10-6e8201dcb8f2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:06.351701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cbaca48-3aeb-4262-bb10-6e8201dcb8f2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:06.638378 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8cbaca48-3aeb-4262-bb10-6e8201dcb8f2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305757 Oct 29 03:53:06.639020 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3729/7412] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:53:06 2022] POST /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:17.441840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:53:17.444282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:17.447191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:17.447926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:17.454300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:17.454796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:17.455236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:17.455944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:17.456406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:17.456836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:17.487037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:17.493153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Old instance type m1.heat2, new instance type m1.heat {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:53:17.500942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:53:17.501370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:53:17.501851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:53:17.502292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:53:17.502705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:53:17.581739 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7104ae26-6b48-4208-8823-9f98c4801182 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/action" status: 202 len: 0 microversion: 2.1 time: 0.144220 Oct 29 03:53:17.582580 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3684/7413] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:53:17 2022] POST /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:53:17.589047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:17.589915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:17.594230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-65fa482f-53ff-4c70-a6d6-020311a85d3b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:17.594847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-65fa482f-53ff-4c70-a6d6-020311a85d3b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:17.602465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65fa482f-53ff-4c70-a6d6-020311a85d3b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:17.602953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65fa482f-53ff-4c70-a6d6-020311a85d3b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:17.603372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65fa482f-53ff-4c70-a6d6-020311a85d3b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:17.604083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65fa482f-53ff-4c70-a6d6-020311a85d3b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:17.604528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65fa482f-53ff-4c70-a6d6-020311a85d3b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:17.604942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-65fa482f-53ff-4c70-a6d6-020311a85d3b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:18.070822 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-65fa482f-53ff-4c70-a6d6-020311a85d3b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:18.079421 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-65fa482f-53ff-4c70-a6d6-020311a85d3b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1723 microversion: 2.1 time: 0.492374 Oct 29 03:53:18.080026 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3730/7414] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:17 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1723 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:19.103924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-53ad028d-9bc7-4e9f-aedf-3cb0ad842aa5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:19.104627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-53ad028d-9bc7-4e9f-aedf-3cb0ad842aa5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:19.113423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ad028d-9bc7-4e9f-aedf-3cb0ad842aa5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:19.113914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ad028d-9bc7-4e9f-aedf-3cb0ad842aa5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:19.114383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ad028d-9bc7-4e9f-aedf-3cb0ad842aa5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:19.115093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ad028d-9bc7-4e9f-aedf-3cb0ad842aa5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:19.115563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ad028d-9bc7-4e9f-aedf-3cb0ad842aa5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:19.115985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-53ad028d-9bc7-4e9f-aedf-3cb0ad842aa5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:19.314834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-53ad028d-9bc7-4e9f-aedf-3cb0ad842aa5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:19.324193 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-53ad028d-9bc7-4e9f-aedf-3cb0ad842aa5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1723 microversion: 2.1 time: 0.224369 Oct 29 03:53:19.324841 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3685/7415] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:19 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:20.348401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-37098945-ea24-44e6-879b-2db692e51a2a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:20.348989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-37098945-ea24-44e6-879b-2db692e51a2a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:20.356093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37098945-ea24-44e6-879b-2db692e51a2a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:20.356574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37098945-ea24-44e6-879b-2db692e51a2a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:20.357001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37098945-ea24-44e6-879b-2db692e51a2a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:20.357689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37098945-ea24-44e6-879b-2db692e51a2a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:20.358165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37098945-ea24-44e6-879b-2db692e51a2a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:20.358580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37098945-ea24-44e6-879b-2db692e51a2a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:20.493865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-37098945-ea24-44e6-879b-2db692e51a2a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:20.506053 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-37098945-ea24-44e6-879b-2db692e51a2a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.161638 Oct 29 03:53:20.506643 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3731/7416] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:20 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:21.534896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-56927039-8680-4fc7-a396-1daa32ab5024 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:21.535815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-56927039-8680-4fc7-a396-1daa32ab5024 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:21.543149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56927039-8680-4fc7-a396-1daa32ab5024 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:21.543650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56927039-8680-4fc7-a396-1daa32ab5024 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:21.544097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56927039-8680-4fc7-a396-1daa32ab5024 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:21.544965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56927039-8680-4fc7-a396-1daa32ab5024 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:21.545427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56927039-8680-4fc7-a396-1daa32ab5024 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:21.545896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56927039-8680-4fc7-a396-1daa32ab5024 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:21.707027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-56927039-8680-4fc7-a396-1daa32ab5024 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:21.716150 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-56927039-8680-4fc7-a396-1daa32ab5024 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.187892 Oct 29 03:53:21.716762 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3686/7417] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:21 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:22.747897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a6bfa0b7-ebbc-4858-8a04-a229b11c9696 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:22.748593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a6bfa0b7-ebbc-4858-8a04-a229b11c9696 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:22.756121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6bfa0b7-ebbc-4858-8a04-a229b11c9696 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:22.756703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6bfa0b7-ebbc-4858-8a04-a229b11c9696 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:22.757128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6bfa0b7-ebbc-4858-8a04-a229b11c9696 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:22.757843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6bfa0b7-ebbc-4858-8a04-a229b11c9696 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:22.758367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6bfa0b7-ebbc-4858-8a04-a229b11c9696 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:22.758784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a6bfa0b7-ebbc-4858-8a04-a229b11c9696 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:22.894521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a6bfa0b7-ebbc-4858-8a04-a229b11c9696 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:22.903818 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a6bfa0b7-ebbc-4858-8a04-a229b11c9696 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.159862 Oct 29 03:53:22.904393 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3732/7418] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:22 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:23.930524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1d19528e-12ab-4113-bf58-6b142c8a465f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:23.931192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1d19528e-12ab-4113-bf58-6b142c8a465f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:23.939724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d19528e-12ab-4113-bf58-6b142c8a465f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:23.940326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d19528e-12ab-4113-bf58-6b142c8a465f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:23.940868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d19528e-12ab-4113-bf58-6b142c8a465f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:23.941974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d19528e-12ab-4113-bf58-6b142c8a465f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:23.942559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d19528e-12ab-4113-bf58-6b142c8a465f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:23.943094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d19528e-12ab-4113-bf58-6b142c8a465f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:24.087576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1d19528e-12ab-4113-bf58-6b142c8a465f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:24.100480 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1d19528e-12ab-4113-bf58-6b142c8a465f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.175168 Oct 29 03:53:24.101367 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3687/7419] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:23 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:25.128992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e4579022-6b90-4825-a474-0c7e63563750 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:25.129626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e4579022-6b90-4825-a474-0c7e63563750 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:25.137312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4579022-6b90-4825-a474-0c7e63563750 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:25.137830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4579022-6b90-4825-a474-0c7e63563750 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:25.138311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4579022-6b90-4825-a474-0c7e63563750 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:25.139045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4579022-6b90-4825-a474-0c7e63563750 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:25.139519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4579022-6b90-4825-a474-0c7e63563750 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:25.139996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e4579022-6b90-4825-a474-0c7e63563750 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:25.280488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e4579022-6b90-4825-a474-0c7e63563750 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:25.289092 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e4579022-6b90-4825-a474-0c7e63563750 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.166907 Oct 29 03:53:25.289675 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3733/7420] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:25 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:26.317769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b1fc33d-ac9a-4865-9b6a-39ff1d9f4afe tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:26.318506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6b1fc33d-ac9a-4865-9b6a-39ff1d9f4afe tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:26.326930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b1fc33d-ac9a-4865-9b6a-39ff1d9f4afe tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:26.327510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b1fc33d-ac9a-4865-9b6a-39ff1d9f4afe tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:26.328033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b1fc33d-ac9a-4865-9b6a-39ff1d9f4afe tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:26.328865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b1fc33d-ac9a-4865-9b6a-39ff1d9f4afe tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:26.329410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b1fc33d-ac9a-4865-9b6a-39ff1d9f4afe tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:26.329959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b1fc33d-ac9a-4865-9b6a-39ff1d9f4afe tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:26.473519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b1fc33d-ac9a-4865-9b6a-39ff1d9f4afe tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:26.482040 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b1fc33d-ac9a-4865-9b6a-39ff1d9f4afe tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.169027 Oct 29 03:53:26.482618 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3688/7421] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:26 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:27.516135 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d2f25266-f2ba-4f4b-90f1-2bda542a51d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:27.517043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d2f25266-f2ba-4f4b-90f1-2bda542a51d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:27.527273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f25266-f2ba-4f4b-90f1-2bda542a51d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:27.528000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f25266-f2ba-4f4b-90f1-2bda542a51d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:27.528651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f25266-f2ba-4f4b-90f1-2bda542a51d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:27.529687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f25266-f2ba-4f4b-90f1-2bda542a51d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:27.530418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f25266-f2ba-4f4b-90f1-2bda542a51d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:27.531054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d2f25266-f2ba-4f4b-90f1-2bda542a51d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:27.670491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d2f25266-f2ba-4f4b-90f1-2bda542a51d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:27.679175 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d2f25266-f2ba-4f4b-90f1-2bda542a51d0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.169358 Oct 29 03:53:27.679735 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3734/7422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:27 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:28.706660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-484a8ee8-87e7-42f5-9a74-25fafb898f7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:28.707640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-484a8ee8-87e7-42f5-9a74-25fafb898f7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:28.719640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-484a8ee8-87e7-42f5-9a74-25fafb898f7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:28.720462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-484a8ee8-87e7-42f5-9a74-25fafb898f7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:28.721209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-484a8ee8-87e7-42f5-9a74-25fafb898f7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:28.722522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-484a8ee8-87e7-42f5-9a74-25fafb898f7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:28.723011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-484a8ee8-87e7-42f5-9a74-25fafb898f7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:28.723446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-484a8ee8-87e7-42f5-9a74-25fafb898f7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:28.864471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-484a8ee8-87e7-42f5-9a74-25fafb898f7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:28.878518 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-484a8ee8-87e7-42f5-9a74-25fafb898f7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.178121 Oct 29 03:53:28.879355 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3689/7423] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:28 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:29.907027 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7890bc5a-0f31-4703-b474-930247a7f5e5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:29.907883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7890bc5a-0f31-4703-b474-930247a7f5e5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:29.919626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7890bc5a-0f31-4703-b474-930247a7f5e5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:29.920430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7890bc5a-0f31-4703-b474-930247a7f5e5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:29.921152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7890bc5a-0f31-4703-b474-930247a7f5e5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:29.922359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7890bc5a-0f31-4703-b474-930247a7f5e5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:29.923118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7890bc5a-0f31-4703-b474-930247a7f5e5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:29.923823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7890bc5a-0f31-4703-b474-930247a7f5e5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:30.066319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7890bc5a-0f31-4703-b474-930247a7f5e5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:30.078196 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7890bc5a-0f31-4703-b474-930247a7f5e5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.177835 Oct 29 03:53:30.078959 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3735/7424] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:29 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:31.105643 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-521b1302-41e4-4708-ba3d-146a81576432 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:31.106440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-521b1302-41e4-4708-ba3d-146a81576432 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:31.117082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521b1302-41e4-4708-ba3d-146a81576432 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:31.117731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521b1302-41e4-4708-ba3d-146a81576432 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:31.118324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521b1302-41e4-4708-ba3d-146a81576432 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:31.119288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521b1302-41e4-4708-ba3d-146a81576432 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:31.119900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521b1302-41e4-4708-ba3d-146a81576432 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:31.120468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-521b1302-41e4-4708-ba3d-146a81576432 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:31.257280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-521b1302-41e4-4708-ba3d-146a81576432 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:31.265722 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-521b1302-41e4-4708-ba3d-146a81576432 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.165448 Oct 29 03:53:31.266333 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3690/7425] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:31 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:32.293629 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e0e49b7a-d592-416f-9e94-5e808cd9d3e2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:32.294615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e0e49b7a-d592-416f-9e94-5e808cd9d3e2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:32.304998 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e49b7a-d592-416f-9e94-5e808cd9d3e2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:32.305480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e49b7a-d592-416f-9e94-5e808cd9d3e2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:32.305947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e49b7a-d592-416f-9e94-5e808cd9d3e2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:32.306646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e49b7a-d592-416f-9e94-5e808cd9d3e2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:32.307091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e49b7a-d592-416f-9e94-5e808cd9d3e2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:32.307515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e0e49b7a-d592-416f-9e94-5e808cd9d3e2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:32.452467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e0e49b7a-d592-416f-9e94-5e808cd9d3e2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:32.461408 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e0e49b7a-d592-416f-9e94-5e808cd9d3e2 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.174250 Oct 29 03:53:32.462029 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3736/7426] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:32 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:33.488983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4190fd9f-7058-4d71-8f3e-ba12ed81e5b9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:33.490083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4190fd9f-7058-4d71-8f3e-ba12ed81e5b9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:33.501601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4190fd9f-7058-4d71-8f3e-ba12ed81e5b9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:33.502480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4190fd9f-7058-4d71-8f3e-ba12ed81e5b9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:33.503229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4190fd9f-7058-4d71-8f3e-ba12ed81e5b9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:33.504146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4190fd9f-7058-4d71-8f3e-ba12ed81e5b9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:33.504609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4190fd9f-7058-4d71-8f3e-ba12ed81e5b9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:33.505046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4190fd9f-7058-4d71-8f3e-ba12ed81e5b9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:33.946655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4190fd9f-7058-4d71-8f3e-ba12ed81e5b9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:33.960344 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4190fd9f-7058-4d71-8f3e-ba12ed81e5b9 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.478098 Oct 29 03:53:33.961216 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3691/7427] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:33 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:34.991838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-eab3f212-2152-48a9-83ae-792ea812139c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:34.992878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-eab3f212-2152-48a9-83ae-792ea812139c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:35.004860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eab3f212-2152-48a9-83ae-792ea812139c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:35.005341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eab3f212-2152-48a9-83ae-792ea812139c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:35.005794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eab3f212-2152-48a9-83ae-792ea812139c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:35.006510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eab3f212-2152-48a9-83ae-792ea812139c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:35.007003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eab3f212-2152-48a9-83ae-792ea812139c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:35.007446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-eab3f212-2152-48a9-83ae-792ea812139c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:35.142365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-eab3f212-2152-48a9-83ae-792ea812139c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:35.151475 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-eab3f212-2152-48a9-83ae-792ea812139c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.166542 Oct 29 03:53:35.152101 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3737/7428] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:34 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:36.179846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4179d1f0-bc2e-4ce1-8d59-f469bf064005 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:36.180853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4179d1f0-bc2e-4ce1-8d59-f469bf064005 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:36.191727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4179d1f0-bc2e-4ce1-8d59-f469bf064005 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:36.192203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4179d1f0-bc2e-4ce1-8d59-f469bf064005 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:36.192668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4179d1f0-bc2e-4ce1-8d59-f469bf064005 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:36.193371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4179d1f0-bc2e-4ce1-8d59-f469bf064005 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:36.193841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4179d1f0-bc2e-4ce1-8d59-f469bf064005 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:36.194285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4179d1f0-bc2e-4ce1-8d59-f469bf064005 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:36.344776 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4179d1f0-bc2e-4ce1-8d59-f469bf064005 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:36.353467 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4179d1f0-bc2e-4ce1-8d59-f469bf064005 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.180223 Oct 29 03:53:36.354077 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3692/7429] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:36 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:37.377060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a1dac4a9-f573-4b80-acf7-482cbfdccf38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:37.377643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a1dac4a9-f573-4b80-acf7-482cbfdccf38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:37.385044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1dac4a9-f573-4b80-acf7-482cbfdccf38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:37.385525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1dac4a9-f573-4b80-acf7-482cbfdccf38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:37.385991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1dac4a9-f573-4b80-acf7-482cbfdccf38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:37.386661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1dac4a9-f573-4b80-acf7-482cbfdccf38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:37.387101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1dac4a9-f573-4b80-acf7-482cbfdccf38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:37.387574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a1dac4a9-f573-4b80-acf7-482cbfdccf38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:37.520932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a1dac4a9-f573-4b80-acf7-482cbfdccf38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:37.529419 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a1dac4a9-f573-4b80-acf7-482cbfdccf38 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.156423 Oct 29 03:53:37.530028 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3738/7430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:37 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:38.554254 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c060fb87-7eef-4e1f-a0e0-a80063f6c34b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:38.554876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c060fb87-7eef-4e1f-a0e0-a80063f6c34b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:38.564155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060fb87-7eef-4e1f-a0e0-a80063f6c34b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:38.564849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060fb87-7eef-4e1f-a0e0-a80063f6c34b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:38.565408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060fb87-7eef-4e1f-a0e0-a80063f6c34b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:38.566305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060fb87-7eef-4e1f-a0e0-a80063f6c34b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:38.566765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060fb87-7eef-4e1f-a0e0-a80063f6c34b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:38.567363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c060fb87-7eef-4e1f-a0e0-a80063f6c34b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:38.718348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c060fb87-7eef-4e1f-a0e0-a80063f6c34b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:38.727228 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c060fb87-7eef-4e1f-a0e0-a80063f6c34b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1728 microversion: 2.1 time: 0.178367 Oct 29 03:53:38.727820 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3693/7431] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:38 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:39.370667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-1fb77c5b-f6ca-4eaa-bb28-b21b5dbbc1b9 req-be292d34-5dbf-4175-a787-1e686932d82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02f49d8-c410-4cbc-abea-3eb192c7f237", "name": "network-vif-unplugged", "status": "completed", "tag": "f3d2c850-1b04-4573-b198-2447a4885614"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:53:39.382951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1fb77c5b-f6ca-4eaa-bb28-b21b5dbbc1b9 req-be292d34-5dbf-4175-a787-1e686932d82d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:39.383461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1fb77c5b-f6ca-4eaa-bb28-b21b5dbbc1b9 req-be292d34-5dbf-4175-a787-1e686932d82d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:39.383913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1fb77c5b-f6ca-4eaa-bb28-b21b5dbbc1b9 req-be292d34-5dbf-4175-a787-1e686932d82d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:39.395905 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1fb77c5b-f6ca-4eaa-bb28-b21b5dbbc1b9 req-be292d34-5dbf-4175-a787-1e686932d82d service nova] Creating event network-vif-unplugged:f3d2c850-1b04-4573-b198-2447a4885614 for instance f02f49d8-c410-4cbc-abea-3eb192c7f237 on n-h2-862964-4 Oct 29 03:53:39.401326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-1fb77c5b-f6ca-4eaa-bb28-b21b5dbbc1b9 req-be292d34-5dbf-4175-a787-1e686932d82d service nova] Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:53:39.412655 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-1fb77c5b-f6ca-4eaa-bb28-b21b5dbbc1b9 req-be292d34-5dbf-4175-a787-1e686932d82d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046056 Oct 29 03:53:39.413276 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3739/7432] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:39.751992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8bcec89c-4011-42d9-89f6-fec6ccca0607 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:39.752567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8bcec89c-4011-42d9-89f6-fec6ccca0607 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:39.759439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bcec89c-4011-42d9-89f6-fec6ccca0607 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:39.759937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bcec89c-4011-42d9-89f6-fec6ccca0607 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:39.760392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bcec89c-4011-42d9-89f6-fec6ccca0607 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:39.761080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bcec89c-4011-42d9-89f6-fec6ccca0607 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:39.761536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bcec89c-4011-42d9-89f6-fec6ccca0607 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:39.762001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8bcec89c-4011-42d9-89f6-fec6ccca0607 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:39.903595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8bcec89c-4011-42d9-89f6-fec6ccca0607 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:39.912838 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8bcec89c-4011-42d9-89f6-fec6ccca0607 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1727 microversion: 2.1 time: 0.164837 Oct 29 03:53:39.913569 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3694/7433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:39 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:40.937562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1ffe678b-e83c-44b3-af5e-bd124c9a560d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:40.938169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1ffe678b-e83c-44b3-af5e-bd124c9a560d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:40.945975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffe678b-e83c-44b3-af5e-bd124c9a560d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:40.946464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffe678b-e83c-44b3-af5e-bd124c9a560d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:40.946894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffe678b-e83c-44b3-af5e-bd124c9a560d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:40.947592 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffe678b-e83c-44b3-af5e-bd124c9a560d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:40.948041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffe678b-e83c-44b3-af5e-bd124c9a560d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:40.948459 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1ffe678b-e83c-44b3-af5e-bd124c9a560d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:41.085987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1ffe678b-e83c-44b3-af5e-bd124c9a560d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:41.094466 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1ffe678b-e83c-44b3-af5e-bd124c9a560d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1725 microversion: 2.1 time: 0.161310 Oct 29 03:53:41.095257 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3740/7434] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:40 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:41.450184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8b133810-aeab-40a3-a0b5-8d8797778a9a req-33f2665c-d985-4445-b20f-1367416bddca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02f49d8-c410-4cbc-abea-3eb192c7f237", "tag": "f3d2c850-1b04-4573-b198-2447a4885614"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:53:41.461727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8b133810-aeab-40a3-a0b5-8d8797778a9a req-33f2665c-d985-4445-b20f-1367416bddca service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:41.462884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8b133810-aeab-40a3-a0b5-8d8797778a9a req-33f2665c-d985-4445-b20f-1367416bddca service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:41.463310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8b133810-aeab-40a3-a0b5-8d8797778a9a req-33f2665c-d985-4445-b20f-1367416bddca service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:41.475829 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8b133810-aeab-40a3-a0b5-8d8797778a9a req-33f2665c-d985-4445-b20f-1367416bddca service nova] Creating event network-changed:f3d2c850-1b04-4573-b198-2447a4885614 for instance f02f49d8-c410-4cbc-abea-3eb192c7f237 on n-h2-862964-4 Oct 29 03:53:41.481696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-8b133810-aeab-40a3-a0b5-8d8797778a9a req-33f2665c-d985-4445-b20f-1367416bddca service nova] Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:53:41.493207 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8b133810-aeab-40a3-a0b5-8d8797778a9a req-33f2665c-d985-4445-b20f-1367416bddca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047010 Oct 29 03:53:41.493834 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3695/7435] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:42.120110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ba70c934-907c-441b-8839-aa7ce5032d66 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:42.120726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ba70c934-907c-441b-8839-aa7ce5032d66 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:42.131463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba70c934-907c-441b-8839-aa7ce5032d66 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:42.131584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba70c934-907c-441b-8839-aa7ce5032d66 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:42.131958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba70c934-907c-441b-8839-aa7ce5032d66 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:42.132658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba70c934-907c-441b-8839-aa7ce5032d66 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:42.133107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba70c934-907c-441b-8839-aa7ce5032d66 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:42.133516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ba70c934-907c-441b-8839-aa7ce5032d66 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:42.294370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ba70c934-907c-441b-8839-aa7ce5032d66 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:42.303067 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ba70c934-907c-441b-8839-aa7ce5032d66 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1725 microversion: 2.1 time: 0.188226 Oct 29 03:53:42.303827 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3741/7436] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:42 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:43.328232 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-723347ab-619f-4a77-9bd2-f494bf8b1503 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:43.328898 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-723347ab-619f-4a77-9bd2-f494bf8b1503 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:43.336167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-723347ab-619f-4a77-9bd2-f494bf8b1503 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:43.336664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-723347ab-619f-4a77-9bd2-f494bf8b1503 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:43.337111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-723347ab-619f-4a77-9bd2-f494bf8b1503 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:43.337845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-723347ab-619f-4a77-9bd2-f494bf8b1503 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:43.338462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-723347ab-619f-4a77-9bd2-f494bf8b1503 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:43.339185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-723347ab-619f-4a77-9bd2-f494bf8b1503 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:43.480418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-723347ab-619f-4a77-9bd2-f494bf8b1503 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:43.489610 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-723347ab-619f-4a77-9bd2-f494bf8b1503 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1725 microversion: 2.1 time: 0.166582 Oct 29 03:53:43.490223 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3696/7437] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:43 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:44.512858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cfeea921-9b82-44ef-b1d6-57ff1876fd56 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:44.513512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cfeea921-9b82-44ef-b1d6-57ff1876fd56 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:44.520881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfeea921-9b82-44ef-b1d6-57ff1876fd56 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:44.521360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfeea921-9b82-44ef-b1d6-57ff1876fd56 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:44.521833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfeea921-9b82-44ef-b1d6-57ff1876fd56 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:44.522553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfeea921-9b82-44ef-b1d6-57ff1876fd56 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:44.522996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfeea921-9b82-44ef-b1d6-57ff1876fd56 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:44.523408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cfeea921-9b82-44ef-b1d6-57ff1876fd56 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:44.667560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cfeea921-9b82-44ef-b1d6-57ff1876fd56 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:44.676010 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cfeea921-9b82-44ef-b1d6-57ff1876fd56 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1725 microversion: 2.1 time: 0.167240 Oct 29 03:53:44.676577 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3742/7438] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:44 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:45.703506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ffc19f2-1b53-45b1-9808-8c8e0690ca88 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:45.704542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ffc19f2-1b53-45b1-9808-8c8e0690ca88 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:45.713207 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ffc19f2-1b53-45b1-9808-8c8e0690ca88 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:45.713713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ffc19f2-1b53-45b1-9808-8c8e0690ca88 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:45.714200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ffc19f2-1b53-45b1-9808-8c8e0690ca88 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:45.714911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ffc19f2-1b53-45b1-9808-8c8e0690ca88 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:45.715377 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ffc19f2-1b53-45b1-9808-8c8e0690ca88 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:45.715814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ffc19f2-1b53-45b1-9808-8c8e0690ca88 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:45.859624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ffc19f2-1b53-45b1-9808-8c8e0690ca88 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:45.869711 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ffc19f2-1b53-45b1-9808-8c8e0690ca88 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1725 microversion: 2.1 time: 0.172781 Oct 29 03:53:45.870323 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3697/7439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:45 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:46.893206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ff1982ff-1112-40c5-9819-19568c3fd610 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:46.893784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ff1982ff-1112-40c5-9819-19568c3fd610 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:46.901343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff1982ff-1112-40c5-9819-19568c3fd610 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:46.901829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff1982ff-1112-40c5-9819-19568c3fd610 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:46.902295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff1982ff-1112-40c5-9819-19568c3fd610 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:46.902992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff1982ff-1112-40c5-9819-19568c3fd610 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:46.903413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff1982ff-1112-40c5-9819-19568c3fd610 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:46.903880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ff1982ff-1112-40c5-9819-19568c3fd610 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:47.043139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ff1982ff-1112-40c5-9819-19568c3fd610 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:47.051775 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ff1982ff-1112-40c5-9819-19568c3fd610 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1725 microversion: 2.1 time: 0.162700 Oct 29 03:53:47.052354 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3743/7440] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:46 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:48.086744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4a2db894-836a-4a96-8bb0-a03873786a2d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:48.087723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4a2db894-836a-4a96-8bb0-a03873786a2d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:48.091856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=33 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:48.099817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2db894-836a-4a96-8bb0-a03873786a2d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:48.100591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2db894-836a-4a96-8bb0-a03873786a2d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:48.101268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2db894-836a-4a96-8bb0-a03873786a2d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:48.102379 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2db894-836a-4a96-8bb0-a03873786a2d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:48.103090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2db894-836a-4a96-8bb0-a03873786a2d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:48.103758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a2db894-836a-4a96-8bb0-a03873786a2d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:48.108452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:48.249261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4a2db894-836a-4a96-8bb0-a03873786a2d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:48.259495 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4a2db894-836a-4a96-8bb0-a03873786a2d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1725 microversion: 2.1 time: 0.179068 Oct 29 03:53:48.260075 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3698/7441] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:48 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:49.287144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-627837a3-9c2c-40a5-bbb9-d99446376b7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:49.287851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-627837a3-9c2c-40a5-bbb9-d99446376b7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:49.291041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=29 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:49.297523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-627837a3-9c2c-40a5-bbb9-d99446376b7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:49.298116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-627837a3-9c2c-40a5-bbb9-d99446376b7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:49.298623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-627837a3-9c2c-40a5-bbb9-d99446376b7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:49.299424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-627837a3-9c2c-40a5-bbb9-d99446376b7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:49.299967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-627837a3-9c2c-40a5-bbb9-d99446376b7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:49.300421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-627837a3-9c2c-40a5-bbb9-d99446376b7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:49.303672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=83 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:49.444328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-627837a3-9c2c-40a5-bbb9-d99446376b7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:49.456514 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-627837a3-9c2c-40a5-bbb9-d99446376b7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1725 microversion: 2.1 time: 0.175142 Oct 29 03:53:49.457333 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3744/7442] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:49 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:50.486599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5ec47146-21f0-49d7-b256-31bc9bc8aeda tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:50.488210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5ec47146-21f0-49d7-b256-31bc9bc8aeda tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:50.495076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ec47146-21f0-49d7-b256-31bc9bc8aeda tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:50.495569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ec47146-21f0-49d7-b256-31bc9bc8aeda tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:50.496010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ec47146-21f0-49d7-b256-31bc9bc8aeda tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:50.496715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ec47146-21f0-49d7-b256-31bc9bc8aeda tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:50.497173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ec47146-21f0-49d7-b256-31bc9bc8aeda tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:50.497599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5ec47146-21f0-49d7-b256-31bc9bc8aeda tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:50.639554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5ec47146-21f0-49d7-b256-31bc9bc8aeda tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:50.648603 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5ec47146-21f0-49d7-b256-31bc9bc8aeda tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1725 microversion: 2.1 time: 0.166019 Oct 29 03:53:50.649190 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3699/7443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:50 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:51.676190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-63f3db06-5f0a-4b70-aa4a-8d4f1a3fbef0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:51.677074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-63f3db06-5f0a-4b70-aa4a-8d4f1a3fbef0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:51.688237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63f3db06-5f0a-4b70-aa4a-8d4f1a3fbef0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:51.688996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63f3db06-5f0a-4b70-aa4a-8d4f1a3fbef0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:51.689651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63f3db06-5f0a-4b70-aa4a-8d4f1a3fbef0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:51.690755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63f3db06-5f0a-4b70-aa4a-8d4f1a3fbef0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:51.691470 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63f3db06-5f0a-4b70-aa4a-8d4f1a3fbef0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:51.692280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-63f3db06-5f0a-4b70-aa4a-8d4f1a3fbef0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:51.840577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-63f3db06-5f0a-4b70-aa4a-8d4f1a3fbef0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:51.851881 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-63f3db06-5f0a-4b70-aa4a-8d4f1a3fbef0 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1725 microversion: 2.1 time: 0.182064 Oct 29 03:53:51.852442 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3745/7444] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:51 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:52.876423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b345d8b-e5ae-4823-94a5-7a2643ae5100 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:52.877018 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6b345d8b-e5ae-4823-94a5-7a2643ae5100 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:52.884480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b345d8b-e5ae-4823-94a5-7a2643ae5100 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:52.884972 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b345d8b-e5ae-4823-94a5-7a2643ae5100 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:52.885419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b345d8b-e5ae-4823-94a5-7a2643ae5100 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:52.886156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b345d8b-e5ae-4823-94a5-7a2643ae5100 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:52.886621 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b345d8b-e5ae-4823-94a5-7a2643ae5100 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:52.887056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b345d8b-e5ae-4823-94a5-7a2643ae5100 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:53.034490 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b345d8b-e5ae-4823-94a5-7a2643ae5100 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:53.043726 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b345d8b-e5ae-4823-94a5-7a2643ae5100 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1722 microversion: 2.1 time: 0.171592 Oct 29 03:53:53.044307 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3700/7445] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:52 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:53.067134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:53:53.067722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:53.074882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:53.075430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:53.075977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:53.076780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:53.077227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:53.077642 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:53.115752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:53.116224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:53.116651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:53.117361 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:53.117826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:53.118244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:53.140134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:53:53.145685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Getting quotas for user d88f049383ec4971b8c92bfde389e873 and project 4579636d272d407bae3af31a24201bb9. Resources: {'ram', 'cores'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:53:53.277053 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-96d7909f-8310-4658-9c61-4c9d70d04582 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "POST /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/action" status: 202 len: 0 microversion: 2.1 time: 0.213529 Oct 29 03:53:53.277670 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3746/7446] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:53:53 2022] POST /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:53:53.286933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-87b20f80-c543-48d9-8acf-a23836eed8f3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:53.287588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-87b20f80-c543-48d9-8acf-a23836eed8f3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:53.293787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87b20f80-c543-48d9-8acf-a23836eed8f3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:53.294323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87b20f80-c543-48d9-8acf-a23836eed8f3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:53.294768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87b20f80-c543-48d9-8acf-a23836eed8f3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:53.295561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87b20f80-c543-48d9-8acf-a23836eed8f3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:53.296107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87b20f80-c543-48d9-8acf-a23836eed8f3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:53.296633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-87b20f80-c543-48d9-8acf-a23836eed8f3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:53.433720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-87b20f80-c543-48d9-8acf-a23836eed8f3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:53.442350 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-87b20f80-c543-48d9-8acf-a23836eed8f3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1721 microversion: 2.1 time: 0.160115 Oct 29 03:53:53.442907 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3701/7447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:53 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:54.470102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d328c94-3a54-456c-9513-3e507b5104d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:54.470974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d328c94-3a54-456c-9513-3e507b5104d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:54.480397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d328c94-3a54-456c-9513-3e507b5104d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:54.481015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d328c94-3a54-456c-9513-3e507b5104d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:54.481567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d328c94-3a54-456c-9513-3e507b5104d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:54.482557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d328c94-3a54-456c-9513-3e507b5104d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:54.483139 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d328c94-3a54-456c-9513-3e507b5104d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:54.483735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d328c94-3a54-456c-9513-3e507b5104d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:54.637666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d328c94-3a54-456c-9513-3e507b5104d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:54.646369 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d328c94-3a54-456c-9513-3e507b5104d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1721 microversion: 2.1 time: 0.182988 Oct 29 03:53:54.646949 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3747/7448] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:54 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:55.675561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:55.676599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:55.683871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:55.684362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:55.684807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:55.685502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:55.685993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:55.686423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:55.718561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:55.719041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:55.719452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:55.719923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lazy-loading 'fault' on Instance uuid f02f49d8-c410-4cbc-abea-3eb192c7f237 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:53:55.833176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:55.842092 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c01d3e71-69b6-408e-b763-3a17bd7ba28a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1879 microversion: 2.1 time: 0.170555 Oct 29 03:53:55.842676 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3702/7449] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:55 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1879 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:55.878041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:55.878890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:55.886538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:55.887047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:55.887586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:55.888492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:55.889165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:55.889858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:55.926007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:55.926690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:55.927152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:55.927626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lazy-loading 'fault' on Instance uuid f02f49d8-c410-4cbc-abea-3eb192c7f237 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:53:56.050060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:56.058572 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-079b6bc2-5d3d-4d68-819f-28bac0c021ec tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1879 microversion: 2.1 time: 0.186706 Oct 29 03:53:56.059143 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3748/7450] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:55 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1879 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:56.866456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-bef34332-c802-4868-8647-1a7063cf86df req-7ac57d83-5b62-47d2-90e2-4b4cdde35a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02f49d8-c410-4cbc-abea-3eb192c7f237", "name": "network-vif-plugged", "status": "completed", "tag": "f3d2c850-1b04-4573-b198-2447a4885614"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:53:56.877575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bef34332-c802-4868-8647-1a7063cf86df req-7ac57d83-5b62-47d2-90e2-4b4cdde35a27 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:56.878117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bef34332-c802-4868-8647-1a7063cf86df req-7ac57d83-5b62-47d2-90e2-4b4cdde35a27 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:56.878752 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bef34332-c802-4868-8647-1a7063cf86df req-7ac57d83-5b62-47d2-90e2-4b4cdde35a27 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:56.892363 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-bef34332-c802-4868-8647-1a7063cf86df req-7ac57d83-5b62-47d2-90e2-4b4cdde35a27 service nova] Creating event network-vif-plugged:f3d2c850-1b04-4573-b198-2447a4885614 for instance f02f49d8-c410-4cbc-abea-3eb192c7f237 on n-h2-862964-4 Oct 29 03:53:56.898316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-bef34332-c802-4868-8647-1a7063cf86df req-7ac57d83-5b62-47d2-90e2-4b4cdde35a27 service nova] Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:53:56.911280 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-bef34332-c802-4868-8647-1a7063cf86df req-7ac57d83-5b62-47d2-90e2-4b4cdde35a27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047989 Oct 29 03:53:56.911280 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3703/7451] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:57.087312 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:57.088165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:57.099315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:57.099792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:57.100234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:57.100927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:57.101374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:57.101795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:57.135046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:57.135527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:57.135983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:57.136451 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lazy-loading 'fault' on Instance uuid f02f49d8-c410-4cbc-abea-3eb192c7f237 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:53:57.250657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:57.263831 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f8da1293-9825-4a0d-9aea-93d8cab1d50d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1879 microversion: 2.1 time: 0.183138 Oct 29 03:53:57.264650 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3749/7452] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:57 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1879 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:57.292570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1ffd6d29-0dd0-48ad-8deb-8ce2c1f3403d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:57.293170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1ffd6d29-0dd0-48ad-8deb-8ce2c1f3403d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:57.299524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ffd6d29-0dd0-48ad-8deb-8ce2c1f3403d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:57.300021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ffd6d29-0dd0-48ad-8deb-8ce2c1f3403d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:57.300464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ffd6d29-0dd0-48ad-8deb-8ce2c1f3403d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:57.301165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ffd6d29-0dd0-48ad-8deb-8ce2c1f3403d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:57.301739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ffd6d29-0dd0-48ad-8deb-8ce2c1f3403d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:57.302200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ffd6d29-0dd0-48ad-8deb-8ce2c1f3403d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:57.328540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1ffd6d29-0dd0-48ad-8deb-8ce2c1f3403d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:53:57.412351 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1ffd6d29-0dd0-48ad-8deb-8ce2c1f3403d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 204 len: 0 microversion: 2.1 time: 0.123834 Oct 29 03:53:57.412848 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3704/7453] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:53:57 2022] DELETE /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:53:57.421771 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:57.422399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:57.428814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:57.429303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:57.429738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:57.430454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:57.430903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:57.431333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:57.464265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:57.464741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:57.465171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:57.465613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lazy-loading 'fault' on Instance uuid f02f49d8-c410-4cbc-abea-3eb192c7f237 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:53:57.580602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:57.589105 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-283893bb-4195-435b-9a94-b5c9220883a5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1885 microversion: 2.1 time: 0.171379 Oct 29 03:53:57.589687 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3750/7454] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:57 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1885 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:58.616457 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:58.617355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:58.626954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:58.627617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:58.628205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:58.629139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:58.629848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:58.630296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:58.665177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:58.665843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:58.666466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:58.666982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lazy-loading 'fault' on Instance uuid f02f49d8-c410-4cbc-abea-3eb192c7f237 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:53:58.785177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:58.793760 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-126635e0-1e80-4b39-afdc-c214874f9391 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1885 microversion: 2.1 time: 0.183909 Oct 29 03:53:58.794367 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3705/7455] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:58 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1885 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:58.817647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-efa6b11d-6ecb-44c7-ac0b-c4b0a52d0c55 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:58.818245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-efa6b11d-6ecb-44c7-ac0b-c4b0a52d0c55 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:58.825599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa6b11d-6ecb-44c7-ac0b-c4b0a52d0c55 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:58.826111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa6b11d-6ecb-44c7-ac0b-c4b0a52d0c55 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:58.826551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa6b11d-6ecb-44c7-ac0b-c4b0a52d0c55 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:58.827240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa6b11d-6ecb-44c7-ac0b-c4b0a52d0c55 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:58.827690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa6b11d-6ecb-44c7-ac0b-c4b0a52d0c55 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:58.828108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efa6b11d-6ecb-44c7-ac0b-c4b0a52d0c55 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:58.855200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-efa6b11d-6ecb-44c7-ac0b-c4b0a52d0c55 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:53:58.907446 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.compute.api [None req-efa6b11d-6ecb-44c7-ac0b-c4b0a52d0c55 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Instance is already in deleting state, ignoring this request Oct 29 03:53:58.908261 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-efa6b11d-6ecb-44c7-ac0b-c4b0a52d0c55 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 204 len: 0 microversion: 2.1 time: 0.094670 Oct 29 03:53:58.908844 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3751/7456] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:53:58 2022] DELETE /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:53:58.918408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:58.919045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:58.925173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:58.925677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:58.926169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:58.927198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:58.927671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:58.928107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:58.960730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:58.961226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:58.961672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:58.962161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lazy-loading 'fault' on Instance uuid f02f49d8-c410-4cbc-abea-3eb192c7f237 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:53:59.083173 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:59.091630 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d0040735-7dbf-4199-9dba-2e70396ff079 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1885 microversion: 2.1 time: 0.177934 Oct 29 03:53:59.092200 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3706/7457] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:58 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1885 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:00.115838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:00.116610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:00.123656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:00.124119 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:00.124587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:00.125285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:00.125737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:00.126189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:00.159863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:00.160348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:00.160993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:00.161537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lazy-loading 'fault' on Instance uuid f02f49d8-c410-4cbc-abea-3eb192c7f237 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:54:00.221632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-9d1c11f6-3be2-4747-a6d3-6dd6e3b7c9bb req-93ad7c1b-98a0-457a-a2df-67429cc6e5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02f49d8-c410-4cbc-abea-3eb192c7f237", "name": "network-vif-deleted", "tag": "f3d2c850-1b04-4573-b198-2447a4885614"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:00.223484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88f049383ec4971b8c92bfde389e873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4579636d272d407bae3af31a24201bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:00.234074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9d1c11f6-3be2-4747-a6d3-6dd6e3b7c9bb req-93ad7c1b-98a0-457a-a2df-67429cc6e5c6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:00.235133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9d1c11f6-3be2-4747-a6d3-6dd6e3b7c9bb req-93ad7c1b-98a0-457a-a2df-67429cc6e5c6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:00.235133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-9d1c11f6-3be2-4747-a6d3-6dd6e3b7c9bb req-93ad7c1b-98a0-457a-a2df-67429cc6e5c6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:00.239796 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dde48e64-2336-4d73-a3e0-907b91d9789f tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 200 len: 1819 microversion: 2.1 time: 0.128099 Oct 29 03:54:00.241155 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3752/7458] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:00 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 1819 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:00.263071 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-9d1c11f6-3be2-4747-a6d3-6dd6e3b7c9bb req-93ad7c1b-98a0-457a-a2df-67429cc6e5c6 service nova] Creating event network-vif-deleted:f3d2c850-1b04-4573-b198-2447a4885614 for instance f02f49d8-c410-4cbc-abea-3eb192c7f237 on n-h2-862964-4 Oct 29 03:54:00.269241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-9d1c11f6-3be2-4747-a6d3-6dd6e3b7c9bb req-93ad7c1b-98a0-457a-a2df-67429cc6e5c6 service nova] Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:54:00.282400 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-9d1c11f6-3be2-4747-a6d3-6dd6e3b7c9bb req-93ad7c1b-98a0-457a-a2df-67429cc6e5c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064224 Oct 29 03:54:00.283532 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3707/7459] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:54:00.341305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:00.341912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:00.348196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:00.348787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:00.349292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:00.350127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:00.350644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:00.351132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:00.441694 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Cannot 'detach_volume' instance f02f49d8-c410-4cbc-abea-3eb192c7f237 while it is in vm_state error Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments/31bb0a5d-15d3-431a-be1a-20662434fdf1 HTTP/1.1 Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: exception: Cannot 'detach_volume' instance f02f49d8-c410-4cbc-abea-3eb192c7f237 while it is in vm_state error Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': 'f02f49d8-c410-4cbc-abea-3eb192c7f237', 'id': '31bb0a5d-15d3-431a-be1a-20662434fdf1'} Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 in vm_state error. Cannot detach_volume while the instance is in this state. Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f02f49d8-c410-4cbc-abea-3eb192c7f237 while it is in vm_state error Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:00.443609 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:00.447765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:00.447765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:00.447765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:00.447765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:00.447765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f02f49d8-c410-4cbc-abea-3eb192c7f237 while it is in vm_state error Oct 29 03:54:00.447765 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:00.449442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 409 to user: Cannot 'detach_volume' instance f02f49d8-c410-4cbc-abea-3eb192c7f237 while it is in vm_state error {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:00.450402 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-692bf30f-491f-47e1-8b0e-dbdf3c581f78 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments/31bb0a5d-15d3-431a-be1a-20662434fdf1" status: 409 len: 150 microversion: 2.1 time: 0.113296 Oct 29 03:54:00.450990 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3753/7460] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:54:00 2022] DELETE /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments/31bb0a5d-15d3-431a-be1a-20662434fdf1 => generated 150 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:54:00.460883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dd5fb855-d188-4c48-9e24-86f79e7775d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:00.463385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dd5fb855-d188-4c48-9e24-86f79e7775d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:00.470627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd5fb855-d188-4c48-9e24-86f79e7775d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:00.471242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd5fb855-d188-4c48-9e24-86f79e7775d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:00.471793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd5fb855-d188-4c48-9e24-86f79e7775d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:00.472620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd5fb855-d188-4c48-9e24-86f79e7775d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:00.473185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd5fb855-d188-4c48-9e24-86f79e7775d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:00.473716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd5fb855-d188-4c48-9e24-86f79e7775d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:00.508875 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dd5fb855-d188-4c48-9e24-86f79e7775d4 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052710 Oct 29 03:54:00.510072 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3708/7461] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:54:00 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:01.523084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ad080a0-05d4-481c-8fba-0bdac11d9f82 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:01.525314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8ad080a0-05d4-481c-8fba-0bdac11d9f82 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:01.533405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad080a0-05d4-481c-8fba-0bdac11d9f82 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:01.533928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad080a0-05d4-481c-8fba-0bdac11d9f82 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:01.534359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad080a0-05d4-481c-8fba-0bdac11d9f82 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:01.535050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad080a0-05d4-481c-8fba-0bdac11d9f82 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:01.535501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad080a0-05d4-481c-8fba-0bdac11d9f82 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:01.535994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ad080a0-05d4-481c-8fba-0bdac11d9f82 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:01.567701 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8ad080a0-05d4-481c-8fba-0bdac11d9f82 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048665 Oct 29 03:54:01.568303 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3754/7462] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:54:01 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:02.580347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b70d029e-e942-4e02-a4f1-42c419028bf3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:02.582922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b70d029e-e942-4e02-a4f1-42c419028bf3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:02.590669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70d029e-e942-4e02-a4f1-42c419028bf3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:02.591170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70d029e-e942-4e02-a4f1-42c419028bf3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:02.591616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70d029e-e942-4e02-a4f1-42c419028bf3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:02.592343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70d029e-e942-4e02-a4f1-42c419028bf3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:02.592802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70d029e-e942-4e02-a4f1-42c419028bf3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:02.593229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b70d029e-e942-4e02-a4f1-42c419028bf3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:02.627184 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b70d029e-e942-4e02-a4f1-42c419028bf3 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051120 Oct 29 03:54:02.627790 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3709/7463] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:54:02 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:03.640556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ed59232d-e161-4c0f-a139-64592e3bca7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:03.642764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ed59232d-e161-4c0f-a139-64592e3bca7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:03.645991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:03.651971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed59232d-e161-4c0f-a139-64592e3bca7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:03.652457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed59232d-e161-4c0f-a139-64592e3bca7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:03.652889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed59232d-e161-4c0f-a139-64592e3bca7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:03.653588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed59232d-e161-4c0f-a139-64592e3bca7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:03.654070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed59232d-e161-4c0f-a139-64592e3bca7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:03.654491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed59232d-e161-4c0f-a139-64592e3bca7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:03.657232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:03.687631 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ed59232d-e161-4c0f-a139-64592e3bca7e tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051100 Oct 29 03:54:03.688222 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3755/7464] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:54:03 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:04.704840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:04.708434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:04.719896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:04.720716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:04.721458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:04.722684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:04.723429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:04.724099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:04.737847 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments HTTP/1.1 Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'server_id': 'f02f49d8-c410-4cbc-abea-3eb192c7f237'} Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:04.739688 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a2370068-63bf-4940-8f23-fb31804390d5 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043213 Oct 29 03:54:04.743640 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3710/7465] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:54:04 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:08.079498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:08.080070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:08.088116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.088628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.089066 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.089777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.090239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.090696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.105095 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 HTTP/1.1 Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'f02f49d8-c410-4cbc-abea-3eb192c7f237'} Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:08.106731 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-068018bf-f75c-49d8-8046-f365f688dc57 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 404 len: 111 microversion: 2.1 time: 0.032571 Oct 29 03:54:08.111156 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3756/7466] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:54:08 2022] DELETE /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:08.117842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:08.118465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: f02f49d8-c410-4cbc-abea-3eb192c7f237] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:08.125288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.125833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.126317 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.127058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.127495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.127933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.141868 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 HTTP/1.1 Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'f02f49d8-c410-4cbc-abea-3eb192c7f237'} Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.143412 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.148733 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.148733 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.148733 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.148733 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:08.148733 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:08.148733 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. Oct 29 03:54:08.148733 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.148733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance f02f49d8-c410-4cbc-abea-3eb192c7f237 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:08.148733 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9adc4985-5624-489b-b776-9502f9c1dabb tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237" status: 404 len: 111 microversion: 2.1 time: 0.031029 Oct 29 03:54:08.148733 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3711/7467] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:08 2022] GET /compute/v2.1/servers/f02f49d8-c410-4cbc-abea-3eb192c7f237 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:08.153505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:08.154121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:08.160334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.160853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.161275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.161992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.162437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.162851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.177636 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 HTTP/1.1 Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '1f5f0ec5-1780-445d-a4fd-9675632698a4'} Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:08.179282 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-369721f5-28a7-4a41-8e9d-967635210983 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 404 len: 111 microversion: 2.1 time: 0.031115 Oct 29 03:54:08.183955 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3757/7468] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:54:08 2022] DELETE /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:08.189833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:08.190488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 1f5f0ec5-1780-445d-a4fd-9675632698a4] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:08.197159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.197645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.198170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.198889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.199344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.199772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.215111 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 HTTP/1.1 Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '1f5f0ec5-1780-445d-a4fd-9675632698a4'} Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.216713 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.221745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.221745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.221745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.221745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:08.221745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:08.221745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. Oct 29 03:54:08.221745 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.221745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance 1f5f0ec5-1780-445d-a4fd-9675632698a4 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:08.221745 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4bbadced-1a4d-4a7f-8498-fd96623ecf7b tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4" status: 404 len: 111 microversion: 2.1 time: 0.032365 Oct 29 03:54:08.222756 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3712/7469] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:08 2022] GET /compute/v2.1/servers/1f5f0ec5-1780-445d-a4fd-9675632698a4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:08.227525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:08.228368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:08.234530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.235009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.235435 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.236127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.236567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.236979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.252179 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 HTTP/1.1 Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'aaecb16e-118a-4954-b28e-e98699ea7e92'} Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:08.253274 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bc279932-2107-4fc6-841f-fa994e67671d tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 404 len: 111 microversion: 2.1 time: 0.031238 Oct 29 03:54:08.257167 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3758/7470] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:54:08 2022] DELETE /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:54:08.263641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:08.264270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: aaecb16e-118a-4954-b28e-e98699ea7e92] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:08.270714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.271297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.271750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.272464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.272928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.273365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.287630 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 HTTP/1.1 Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'aaecb16e-118a-4954-b28e-e98699ea7e92'} Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.289151 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.293174 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.293174 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.293174 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.293174 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:08.293174 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:08.293174 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. Oct 29 03:54:08.293174 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.293174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance aaecb16e-118a-4954-b28e-e98699ea7e92 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:08.293174 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2b9d7d20-c766-4c21-b584-279a23900639 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92" status: 404 len: 111 microversion: 2.1 time: 0.030981 Oct 29 03:54:08.293174 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3713/7471] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:08 2022] GET /compute/v2.1/servers/aaecb16e-118a-4954-b28e-e98699ea7e92 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:08.299371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:08.299858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:08.306096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.306571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.306988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.307828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.308316 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.308800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.322569 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e HTTP/1.1 Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '625b606e-742e-4546-832b-4b3006f5b08e'} Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:08.324086 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-60e49435-c92c-4825-bcd9-78d187f61564 tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "DELETE /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 404 len: 111 microversion: 2.1 time: 0.029951 Oct 29 03:54:08.328155 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3759/7472] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:54:08 2022] DELETE /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:08.334251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:08.334873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] [instance: 625b606e-742e-4546-832b-4b3006f5b08e] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:08.341015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.341511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.341984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.342686 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:08.343152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:08.343587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:08.357521 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] HTTP exception thrown: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Request method failure captured: Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e HTTP/1.1 Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKKYZTsuHI0A_c5DrzbMtBqZ2ZmAWi96HPCqnySpE4i1_7TCd-jEEmAhclKkHZAwwN1oH1x1VPoTU-M_ZOex57IXvf_oCJJMcR0m4AQfOxaxGjoFZp_T4Avr936CbwIYZumtXJ--xhwko3L8aweW4iSsB_VyfPvQTMULaMybsfyId2g Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4579636d272d407bae3af31a24201bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4579636d272d407bae3af31a24201bb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4579636d272d407bae3af31a24201bb9"}]}] Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4579636d272d407bae3af31a24201bb9 Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServerActionsTestJSON-199638181 Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: d88f049383ec4971b8c92bfde389e873 Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServerActionsTestJSON-199638181-project Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '625b606e-742e-4546-832b-4b3006f5b08e'} Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:08.359157 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.363536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:08.363536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:08.363536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:08.363536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:08.363536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:08.363536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. Oct 29 03:54:08.363536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:08.363536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Returning 404 to user: Instance 625b606e-742e-4546-832b-4b3006f5b08e could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:08.363536 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-72420610-0a68-4018-bc08-37c35900cb1c tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e" status: 404 len: 111 microversion: 2.1 time: 0.030237 Oct 29 03:54:08.363536 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3714/7473] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:08 2022] GET /compute/v2.1/servers/625b606e-742e-4546-832b-4b3006f5b08e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:08.369836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4dd62e23-d78e-427a-9048-2bb50ed6004a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] Calling method '.version_select at 0x7fe1a3352940>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:08.395637 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4dd62e23-d78e-427a-9048-2bb50ed6004a tempest-ServerActionsTestJSON-199638181 tempest-ServerActionsTestJSON-199638181-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2070687314" status: 202 len: 0 microversion: 2.1 time: 0.029580 Oct 29 03:54:08.396245 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3760/7474] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:54:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2070687314 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:54:17.623768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-719567171", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "0c7a7b71-0a04-4198-8777-e5d4572ab983"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:17.680547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] validate_networks() for [('0c7a7b71-0a04-4198-8777-e5d4572ab983', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:54:18.076200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:54:18.076661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:54:18.077133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:54:18.077581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:54:18.078014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:54:18.087799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:18.088302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:18.088748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:18.089528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:18.090203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:18.090566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:18.108473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Getting quotas for project 2fa0fc78e7e6461484aa23de0f39e47e. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:54:18.110607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:18.116258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Getting quotas for user a5095343d28645f3b3cffd8830ca2419 and project 2fa0fc78e7e6461484aa23de0f39e47e. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:54:18.129951 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:54:18.132302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:54:18.181280 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-16a89a24-bde4-4e2f-9307-de1c19fb2fd1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680495 Oct 29 03:54:18.182173 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3715/7475] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:54:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:54:18.197791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f665c71f-9b4c-4312-9d8c-74ddc886b709 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:18.198506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f665c71f-9b4c-4312-9d8c-74ddc886b709 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:18.273690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f665c71f-9b4c-4312-9d8c-74ddc886b709 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:18.291444 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f665c71f-9b4c-4312-9d8c-74ddc886b709 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1216 microversion: 2.1 time: 0.091617 Oct 29 03:54:18.292419 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3761/7476] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:18 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:19.316562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-89734e7b-ce3e-4f61-b1c0-788b07f7644f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:19.317513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-89734e7b-ce3e-4f61-b1c0-788b07f7644f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:19.324826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89734e7b-ce3e-4f61-b1c0-788b07f7644f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:19.325307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89734e7b-ce3e-4f61-b1c0-788b07f7644f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:19.325759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89734e7b-ce3e-4f61-b1c0-788b07f7644f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:19.326494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89734e7b-ce3e-4f61-b1c0-788b07f7644f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:19.326950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89734e7b-ce3e-4f61-b1c0-788b07f7644f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:19.327424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-89734e7b-ce3e-4f61-b1c0-788b07f7644f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:19.330069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:19.394756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-89734e7b-ce3e-4f61-b1c0-788b07f7644f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:19.403791 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-89734e7b-ce3e-4f61-b1c0-788b07f7644f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1268 microversion: 2.1 time: 0.092102 Oct 29 03:54:19.412513 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3716/7477] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:19 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1268 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:54:20.428666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c9ffc449-6c0e-4687-90c8-435d32977fe8 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:20.429064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c9ffc449-6c0e-4687-90c8-435d32977fe8 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:20.432374 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=13 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:20.434048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:20.450511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9ffc449-6c0e-4687-90c8-435d32977fe8 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:20.451274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9ffc449-6c0e-4687-90c8-435d32977fe8 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:20.452847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9ffc449-6c0e-4687-90c8-435d32977fe8 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:20.461422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9ffc449-6c0e-4687-90c8-435d32977fe8 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:20.463096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9ffc449-6c0e-4687-90c8-435d32977fe8 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:20.463635 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c9ffc449-6c0e-4687-90c8-435d32977fe8 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:20.706878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c9ffc449-6c0e-4687-90c8-435d32977fe8 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:20.718178 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c9ffc449-6c0e-4687-90c8-435d32977fe8 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1316 microversion: 2.1 time: 0.294202 Oct 29 03:54:20.719869 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3762/7478] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:20 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:21.336611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b20bf142-ff4a-47e2-a1de-525d5a79b4e6 req-9003c05e-85f7-411e-a06e-131f7fca1ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4447c74e-29bf-4e3b-a011-d3310bac095b", "tag": "b9aa967d-7ed3-4dad-a657-a4682de07c92"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:21.349056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b20bf142-ff4a-47e2-a1de-525d5a79b4e6 req-9003c05e-85f7-411e-a06e-131f7fca1ffc service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:21.349694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b20bf142-ff4a-47e2-a1de-525d5a79b4e6 req-9003c05e-85f7-411e-a06e-131f7fca1ffc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:21.350257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b20bf142-ff4a-47e2-a1de-525d5a79b4e6 req-9003c05e-85f7-411e-a06e-131f7fca1ffc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:21.362450 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b20bf142-ff4a-47e2-a1de-525d5a79b4e6 req-9003c05e-85f7-411e-a06e-131f7fca1ffc service nova] Creating event network-changed:b9aa967d-7ed3-4dad-a657-a4682de07c92 for instance 4447c74e-29bf-4e3b-a011-d3310bac095b on n-h2-862964-4 Oct 29 03:54:21.368175 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b20bf142-ff4a-47e2-a1de-525d5a79b4e6 req-9003c05e-85f7-411e-a06e-131f7fca1ffc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037723 Oct 29 03:54:21.368797 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3717/7479] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:21.743524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-361ad614-459b-4199-ab39-a6c6293cde0e tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:21.744122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-361ad614-459b-4199-ab39-a6c6293cde0e tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:21.751356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-361ad614-459b-4199-ab39-a6c6293cde0e tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:21.751846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-361ad614-459b-4199-ab39-a6c6293cde0e tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:21.752263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-361ad614-459b-4199-ab39-a6c6293cde0e tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:21.752979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-361ad614-459b-4199-ab39-a6c6293cde0e tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:21.753426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-361ad614-459b-4199-ab39-a6c6293cde0e tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:21.753852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-361ad614-459b-4199-ab39-a6c6293cde0e tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:21.929397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-361ad614-459b-4199-ab39-a6c6293cde0e tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:21.940706 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-361ad614-459b-4199-ab39-a6c6293cde0e tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1316 microversion: 2.1 time: 0.200954 Oct 29 03:54:21.941497 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3763/7480] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:21 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:22.968363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-45fc5b6b-7616-4386-8ae9-c6aafc71be64 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:22.969137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-45fc5b6b-7616-4386-8ae9-c6aafc71be64 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:22.977419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45fc5b6b-7616-4386-8ae9-c6aafc71be64 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:22.977958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45fc5b6b-7616-4386-8ae9-c6aafc71be64 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:22.978406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45fc5b6b-7616-4386-8ae9-c6aafc71be64 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:22.979114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45fc5b6b-7616-4386-8ae9-c6aafc71be64 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:22.979583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45fc5b6b-7616-4386-8ae9-c6aafc71be64 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:22.980017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-45fc5b6b-7616-4386-8ae9-c6aafc71be64 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:23.121856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-45fc5b6b-7616-4386-8ae9-c6aafc71be64 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:23.130098 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-45fc5b6b-7616-4386-8ae9-c6aafc71be64 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1316 microversion: 2.1 time: 0.169370 Oct 29 03:54:23.130697 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3718/7481] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:22 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:24.158080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e55b17b5-8fda-44ae-a06f-1f3c1b596794 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:24.158990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e55b17b5-8fda-44ae-a06f-1f3c1b596794 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:24.170872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e55b17b5-8fda-44ae-a06f-1f3c1b596794 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:24.171667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e55b17b5-8fda-44ae-a06f-1f3c1b596794 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:24.172415 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e55b17b5-8fda-44ae-a06f-1f3c1b596794 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:24.173503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e55b17b5-8fda-44ae-a06f-1f3c1b596794 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:24.174276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e55b17b5-8fda-44ae-a06f-1f3c1b596794 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:24.174965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e55b17b5-8fda-44ae-a06f-1f3c1b596794 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:24.311084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e55b17b5-8fda-44ae-a06f-1f3c1b596794 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:24.319284 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e55b17b5-8fda-44ae-a06f-1f3c1b596794 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1316 microversion: 2.1 time: 0.167968 Oct 29 03:54:24.319866 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3764/7482] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:24 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:25.342982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-26d99fe2-e60a-4bc1-9593-c0729ff1cf86 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:25.343588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-26d99fe2-e60a-4bc1-9593-c0729ff1cf86 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:25.351042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26d99fe2-e60a-4bc1-9593-c0729ff1cf86 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:25.351532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26d99fe2-e60a-4bc1-9593-c0729ff1cf86 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:25.351967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26d99fe2-e60a-4bc1-9593-c0729ff1cf86 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:25.352683 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26d99fe2-e60a-4bc1-9593-c0729ff1cf86 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:25.353139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26d99fe2-e60a-4bc1-9593-c0729ff1cf86 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:25.353558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-26d99fe2-e60a-4bc1-9593-c0729ff1cf86 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:25.494963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-26d99fe2-e60a-4bc1-9593-c0729ff1cf86 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:25.503139 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-26d99fe2-e60a-4bc1-9593-c0729ff1cf86 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1316 microversion: 2.1 time: 0.164156 Oct 29 03:54:25.503706 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3719/7483] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:25 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:26.526903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bf49011a-d799-438c-b13b-c4a1581d623f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:26.527570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bf49011a-d799-438c-b13b-c4a1581d623f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:26.535275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf49011a-d799-438c-b13b-c4a1581d623f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:26.535782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf49011a-d799-438c-b13b-c4a1581d623f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:26.536229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf49011a-d799-438c-b13b-c4a1581d623f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:26.536942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf49011a-d799-438c-b13b-c4a1581d623f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:26.537500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf49011a-d799-438c-b13b-c4a1581d623f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:26.537951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bf49011a-d799-438c-b13b-c4a1581d623f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:26.683926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bf49011a-d799-438c-b13b-c4a1581d623f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:26.691976 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bf49011a-d799-438c-b13b-c4a1581d623f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1316 microversion: 2.1 time: 0.169321 Oct 29 03:54:26.692550 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3765/7484] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:26 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:27.055513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-722ef88a-4fcd-4961-b5b4-28e484b0970d req-8622eaf3-bbe2-49e9-9319-e58c73d7e628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4447c74e-29bf-4e3b-a011-d3310bac095b", "name": "network-vif-plugged", "status": "completed", "tag": "b9aa967d-7ed3-4dad-a657-a4682de07c92"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:27.066318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-722ef88a-4fcd-4961-b5b4-28e484b0970d req-8622eaf3-bbe2-49e9-9319-e58c73d7e628 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:27.066809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-722ef88a-4fcd-4961-b5b4-28e484b0970d req-8622eaf3-bbe2-49e9-9319-e58c73d7e628 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:27.067279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-722ef88a-4fcd-4961-b5b4-28e484b0970d req-8622eaf3-bbe2-49e9-9319-e58c73d7e628 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:27.079162 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-722ef88a-4fcd-4961-b5b4-28e484b0970d req-8622eaf3-bbe2-49e9-9319-e58c73d7e628 service nova] Creating event network-vif-plugged:b9aa967d-7ed3-4dad-a657-a4682de07c92 for instance 4447c74e-29bf-4e3b-a011-d3310bac095b on n-h2-862964-4 Oct 29 03:54:27.084553 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-722ef88a-4fcd-4961-b5b4-28e484b0970d req-8622eaf3-bbe2-49e9-9319-e58c73d7e628 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032758 Oct 29 03:54:27.085421 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3720/7485] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:27.717616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d8393f1-e172-4653-bdbf-41bd50345c32 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:27.718513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7d8393f1-e172-4653-bdbf-41bd50345c32 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:27.728143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8393f1-e172-4653-bdbf-41bd50345c32 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:27.728808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8393f1-e172-4653-bdbf-41bd50345c32 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:27.729402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8393f1-e172-4653-bdbf-41bd50345c32 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:27.730391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8393f1-e172-4653-bdbf-41bd50345c32 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:27.731014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8393f1-e172-4653-bdbf-41bd50345c32 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:27.731620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7d8393f1-e172-4653-bdbf-41bd50345c32 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:27.869662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7d8393f1-e172-4653-bdbf-41bd50345c32 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:27.882142 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7d8393f1-e172-4653-bdbf-41bd50345c32 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1316 microversion: 2.1 time: 0.169526 Oct 29 03:54:27.883054 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3766/7486] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:27 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:28.911577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:28.913057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:28.918698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8615ea0b-b0c1-48b8-99e6-f5320e25d2cc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:28.919544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8615ea0b-b0c1-48b8-99e6-f5320e25d2cc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:28.929935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8615ea0b-b0c1-48b8-99e6-f5320e25d2cc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:28.930624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8615ea0b-b0c1-48b8-99e6-f5320e25d2cc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:28.931227 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8615ea0b-b0c1-48b8-99e6-f5320e25d2cc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:28.932206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8615ea0b-b0c1-48b8-99e6-f5320e25d2cc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:28.932899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8615ea0b-b0c1-48b8-99e6-f5320e25d2cc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:28.933463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8615ea0b-b0c1-48b8-99e6-f5320e25d2cc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:29.386745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8615ea0b-b0c1-48b8-99e6-f5320e25d2cc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:29.396178 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8615ea0b-b0c1-48b8-99e6-f5320e25d2cc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1504 microversion: 2.1 time: 0.487448 Oct 29 03:54:29.396653 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3721/7487] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:28 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:29.460053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1290792376", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "0c7a7b71-0a04-4198-8777-e5d4572ab983"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:29.468624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:29.519044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] validate_networks() for [('0c7a7b71-0a04-4198-8777-e5d4572ab983', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:54:29.918933 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:54:29.919734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:54:29.920360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:54:29.920930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:54:29.921534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:54:29.933581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:29.934088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:29.934518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:29.935236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:29.935682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:29.936097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:29.954290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Getting quotas for project 2fa0fc78e7e6461484aa23de0f39e47e. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:54:29.960154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Getting quotas for user a5095343d28645f3b3cffd8830ca2419 and project 2fa0fc78e7e6461484aa23de0f39e47e. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:54:29.973259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:54:29.975588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:54:30.023620 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f5ed5a29-2799-4eae-a509-ac4bdf31c328 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569152 Oct 29 03:54:30.024274 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3767/7488] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:54:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:54:30.035531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cad890a5-957c-4eff-9bf8-76e699ae6e1c tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:30.036149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cad890a5-957c-4eff-9bf8-76e699ae6e1c tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:30.089132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cad890a5-957c-4eff-9bf8-76e699ae6e1c tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:30.096089 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cad890a5-957c-4eff-9bf8-76e699ae6e1c tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1217 microversion: 2.1 time: 0.064460 Oct 29 03:54:30.096661 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3722/7489] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:30 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:31.119097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4b3f07e2-dd6e-42c9-928d-463fa168eef6 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:31.119670 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4b3f07e2-dd6e-42c9-928d-463fa168eef6 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:31.127618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b3f07e2-dd6e-42c9-928d-463fa168eef6 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:31.128150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b3f07e2-dd6e-42c9-928d-463fa168eef6 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:31.128559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b3f07e2-dd6e-42c9-928d-463fa168eef6 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:31.129251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b3f07e2-dd6e-42c9-928d-463fa168eef6 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:31.129727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b3f07e2-dd6e-42c9-928d-463fa168eef6 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:31.130177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4b3f07e2-dd6e-42c9-928d-463fa168eef6 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:31.196586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4b3f07e2-dd6e-42c9-928d-463fa168eef6 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:31.205690 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4b3f07e2-dd6e-42c9-928d-463fa168eef6 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1277 microversion: 2.1 time: 0.090664 Oct 29 03:54:31.206511 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3768/7490] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:31 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:32.229228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-21009cdd-b952-48a8-b782-9f7b246b8531 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:32.229852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-21009cdd-b952-48a8-b782-9f7b246b8531 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:32.238216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21009cdd-b952-48a8-b782-9f7b246b8531 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:32.238709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21009cdd-b952-48a8-b782-9f7b246b8531 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:32.239125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21009cdd-b952-48a8-b782-9f7b246b8531 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:32.239885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21009cdd-b952-48a8-b782-9f7b246b8531 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:32.240434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21009cdd-b952-48a8-b782-9f7b246b8531 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:32.240868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-21009cdd-b952-48a8-b782-9f7b246b8531 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:32.464278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-21009cdd-b952-48a8-b782-9f7b246b8531 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:32.472403 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-21009cdd-b952-48a8-b782-9f7b246b8531 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1317 microversion: 2.1 time: 0.247407 Oct 29 03:54:32.472984 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3723/7491] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:32 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:32.643246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-434d52df-5e22-48c3-91c4-eaa3bd95a8fd req-95db3966-6b5c-40f5-92f6-8317034d13d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9148297b-3d39-4ad4-91b4-b29ac3a60b85", "tag": "1b955546-1071-4011-9630-545dd88438c2"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:32.658727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-434d52df-5e22-48c3-91c4-eaa3bd95a8fd req-95db3966-6b5c-40f5-92f6-8317034d13d3 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:32.659175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-434d52df-5e22-48c3-91c4-eaa3bd95a8fd req-95db3966-6b5c-40f5-92f6-8317034d13d3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:32.659625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-434d52df-5e22-48c3-91c4-eaa3bd95a8fd req-95db3966-6b5c-40f5-92f6-8317034d13d3 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:32.671523 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-434d52df-5e22-48c3-91c4-eaa3bd95a8fd req-95db3966-6b5c-40f5-92f6-8317034d13d3 service nova] Creating event network-changed:1b955546-1071-4011-9630-545dd88438c2 for instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 on n-h1-862964-4 Oct 29 03:54:32.677006 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-434d52df-5e22-48c3-91c4-eaa3bd95a8fd req-95db3966-6b5c-40f5-92f6-8317034d13d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038717 Oct 29 03:54:32.678288 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3769/7492] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:33.497677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-479c2333-b6cf-4da9-a938-3394bcbe86fc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:33.498328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-479c2333-b6cf-4da9-a938-3394bcbe86fc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:33.506291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-479c2333-b6cf-4da9-a938-3394bcbe86fc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:33.506792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-479c2333-b6cf-4da9-a938-3394bcbe86fc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:33.507236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-479c2333-b6cf-4da9-a938-3394bcbe86fc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:33.507942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-479c2333-b6cf-4da9-a938-3394bcbe86fc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:33.508409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-479c2333-b6cf-4da9-a938-3394bcbe86fc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:33.508842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-479c2333-b6cf-4da9-a938-3394bcbe86fc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:33.640444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-479c2333-b6cf-4da9-a938-3394bcbe86fc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:33.648523 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-479c2333-b6cf-4da9-a938-3394bcbe86fc tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1317 microversion: 2.1 time: 0.155273 Oct 29 03:54:33.649123 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3724/7493] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:33 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:34.672851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c3bae6ef-91a7-4e70-91e5-bead53a2fac0 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:34.673422 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c3bae6ef-91a7-4e70-91e5-bead53a2fac0 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:34.680611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3bae6ef-91a7-4e70-91e5-bead53a2fac0 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:34.681099 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3bae6ef-91a7-4e70-91e5-bead53a2fac0 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:34.681524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3bae6ef-91a7-4e70-91e5-bead53a2fac0 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:34.682268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3bae6ef-91a7-4e70-91e5-bead53a2fac0 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:34.682714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3bae6ef-91a7-4e70-91e5-bead53a2fac0 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:34.683131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c3bae6ef-91a7-4e70-91e5-bead53a2fac0 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:34.916619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c3bae6ef-91a7-4e70-91e5-bead53a2fac0 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:34.924757 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c3bae6ef-91a7-4e70-91e5-bead53a2fac0 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1317 microversion: 2.1 time: 0.257116 Oct 29 03:54:34.925276 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3770/7494] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:34 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:35.954828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5d508ca9-85d5-40c7-a2b0-f670d18be092 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:35.955419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5d508ca9-85d5-40c7-a2b0-f670d18be092 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:35.962704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d508ca9-85d5-40c7-a2b0-f670d18be092 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:35.963188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d508ca9-85d5-40c7-a2b0-f670d18be092 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:35.963630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d508ca9-85d5-40c7-a2b0-f670d18be092 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:35.964341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d508ca9-85d5-40c7-a2b0-f670d18be092 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:35.964799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d508ca9-85d5-40c7-a2b0-f670d18be092 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:35.965221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5d508ca9-85d5-40c7-a2b0-f670d18be092 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:36.158308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5d508ca9-85d5-40c7-a2b0-f670d18be092 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:36.167945 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5d508ca9-85d5-40c7-a2b0-f670d18be092 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1317 microversion: 2.1 time: 0.216839 Oct 29 03:54:36.168749 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3725/7495] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:35 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:37.194653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6eaa22cb-4b08-421f-80d4-e342416d0a57 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:37.195321 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6eaa22cb-4b08-421f-80d4-e342416d0a57 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:37.203279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eaa22cb-4b08-421f-80d4-e342416d0a57 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:37.203806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eaa22cb-4b08-421f-80d4-e342416d0a57 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:37.204275 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eaa22cb-4b08-421f-80d4-e342416d0a57 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:37.205028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eaa22cb-4b08-421f-80d4-e342416d0a57 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:37.205514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eaa22cb-4b08-421f-80d4-e342416d0a57 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:37.206009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6eaa22cb-4b08-421f-80d4-e342416d0a57 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:37.351718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6eaa22cb-4b08-421f-80d4-e342416d0a57 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:37.360269 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6eaa22cb-4b08-421f-80d4-e342416d0a57 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1317 microversion: 2.1 time: 0.171700 Oct 29 03:54:37.360843 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3771/7496] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:37 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:37.423336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-bf354303-213f-4051-84f9-380fb7c13b8f req-367074b5-bba0-4a84-a29c-388cb683717c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9148297b-3d39-4ad4-91b4-b29ac3a60b85", "name": "network-vif-plugged", "status": "completed", "tag": "1b955546-1071-4011-9630-545dd88438c2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:37.434369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bf354303-213f-4051-84f9-380fb7c13b8f req-367074b5-bba0-4a84-a29c-388cb683717c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:37.434973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bf354303-213f-4051-84f9-380fb7c13b8f req-367074b5-bba0-4a84-a29c-388cb683717c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:37.435442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-bf354303-213f-4051-84f9-380fb7c13b8f req-367074b5-bba0-4a84-a29c-388cb683717c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:37.450238 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-bf354303-213f-4051-84f9-380fb7c13b8f req-367074b5-bba0-4a84-a29c-388cb683717c service nova] Creating event network-vif-plugged:1b955546-1071-4011-9630-545dd88438c2 for instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 on n-h1-862964-4 Oct 29 03:54:37.455405 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-bf354303-213f-4051-84f9-380fb7c13b8f req-367074b5-bba0-4a84-a29c-388cb683717c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Oct 29 03:54:37.456060 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3726/7497] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:38.388501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-77ac68bb-ab4e-4649-9e1d-cd1c7d0bb56d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:38.389357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-77ac68bb-ab4e-4649-9e1d-cd1c7d0bb56d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:38.399461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac68bb-ab4e-4649-9e1d-cd1c7d0bb56d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:38.399940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac68bb-ab4e-4649-9e1d-cd1c7d0bb56d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:38.400364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac68bb-ab4e-4649-9e1d-cd1c7d0bb56d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:38.401050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac68bb-ab4e-4649-9e1d-cd1c7d0bb56d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:38.401491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac68bb-ab4e-4649-9e1d-cd1c7d0bb56d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:38.401932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac68bb-ab4e-4649-9e1d-cd1c7d0bb56d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:38.540841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77ac68bb-ab4e-4649-9e1d-cd1c7d0bb56d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:38.548731 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-77ac68bb-ab4e-4649-9e1d-cd1c7d0bb56d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1317 microversion: 2.1 time: 0.167121 Oct 29 03:54:38.549310 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3772/7498] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:38 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:39.578338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-52c09f03-f781-49db-af0c-42f8a170ec16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:39.579040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-52c09f03-f781-49db-af0c-42f8a170ec16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:39.586082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52c09f03-f781-49db-af0c-42f8a170ec16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:39.586570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52c09f03-f781-49db-af0c-42f8a170ec16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:39.587009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52c09f03-f781-49db-af0c-42f8a170ec16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:39.587699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52c09f03-f781-49db-af0c-42f8a170ec16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:39.588131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52c09f03-f781-49db-af0c-42f8a170ec16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:39.588563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-52c09f03-f781-49db-af0c-42f8a170ec16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:39.721579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-52c09f03-f781-49db-af0c-42f8a170ec16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:39.733645 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-52c09f03-f781-49db-af0c-42f8a170ec16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1505 microversion: 2.1 time: 0.160358 Oct 29 03:54:39.734514 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3727/7499] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:39 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:39.756743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e6b40ee3-43ce-4c5b-a50c-4ef9eded4936 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:39.757301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e6b40ee3-43ce-4c5b-a50c-4ef9eded4936 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:39.764392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b40ee3-43ce-4c5b-a50c-4ef9eded4936 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:39.764865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b40ee3-43ce-4c5b-a50c-4ef9eded4936 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:39.765292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b40ee3-43ce-4c5b-a50c-4ef9eded4936 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:39.766015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b40ee3-43ce-4c5b-a50c-4ef9eded4936 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:39.766462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b40ee3-43ce-4c5b-a50c-4ef9eded4936 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:39.766881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e6b40ee3-43ce-4c5b-a50c-4ef9eded4936 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:39.793676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e6b40ee3-43ce-4c5b-a50c-4ef9eded4936 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:54:39.873671 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e6b40ee3-43ce-4c5b-a50c-4ef9eded4936 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 204 len: 0 microversion: 2.1 time: 0.120717 Oct 29 03:54:39.874351 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3773/7500] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:54:39 2022] DELETE /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:54:39.884284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d24c6076-b71a-4217-a67e-4d0d283e5116 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:39.884895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d24c6076-b71a-4217-a67e-4d0d283e5116 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:39.891109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d24c6076-b71a-4217-a67e-4d0d283e5116 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:39.891603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d24c6076-b71a-4217-a67e-4d0d283e5116 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:39.892039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d24c6076-b71a-4217-a67e-4d0d283e5116 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:39.892726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d24c6076-b71a-4217-a67e-4d0d283e5116 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:39.893175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d24c6076-b71a-4217-a67e-4d0d283e5116 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:39.893600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d24c6076-b71a-4217-a67e-4d0d283e5116 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:40.030726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d24c6076-b71a-4217-a67e-4d0d283e5116 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:40.039594 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d24c6076-b71a-4217-a67e-4d0d283e5116 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1511 microversion: 2.1 time: 0.160086 Oct 29 03:54:40.040167 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3728/7501] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:39 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:41.064176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e57b1319-00d0-45c6-b911-6f31162cb93a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:41.064996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e57b1319-00d0-45c6-b911-6f31162cb93a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:41.067202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:41.067888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:41.076042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e57b1319-00d0-45c6-b911-6f31162cb93a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:41.076516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e57b1319-00d0-45c6-b911-6f31162cb93a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:41.076939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e57b1319-00d0-45c6-b911-6f31162cb93a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:41.077765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e57b1319-00d0-45c6-b911-6f31162cb93a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:41.078238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e57b1319-00d0-45c6-b911-6f31162cb93a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:41.078669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e57b1319-00d0-45c6-b911-6f31162cb93a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:41.217412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e57b1319-00d0-45c6-b911-6f31162cb93a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:41.226308 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e57b1319-00d0-45c6-b911-6f31162cb93a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1511 microversion: 2.1 time: 0.166455 Oct 29 03:54:41.226873 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3774/7502] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:41 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:41.766605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8ac4ed51-81db-4874-a7bc-f1674d3e106f req-043063da-c5a8-44f5-a23a-103458315617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9148297b-3d39-4ad4-91b4-b29ac3a60b85", "name": "network-vif-deleted", "tag": "1b955546-1071-4011-9630-545dd88438c2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:41.785791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:41.790872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8ac4ed51-81db-4874-a7bc-f1674d3e106f req-043063da-c5a8-44f5-a23a-103458315617 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:41.791627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8ac4ed51-81db-4874-a7bc-f1674d3e106f req-043063da-c5a8-44f5-a23a-103458315617 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:41.792695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8ac4ed51-81db-4874-a7bc-f1674d3e106f req-043063da-c5a8-44f5-a23a-103458315617 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:41.807496 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8ac4ed51-81db-4874-a7bc-f1674d3e106f req-043063da-c5a8-44f5-a23a-103458315617 service nova] Creating event network-vif-deleted:1b955546-1071-4011-9630-545dd88438c2 for instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 on n-h1-862964-4 Oct 29 03:54:41.815731 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8ac4ed51-81db-4874-a7bc-f1674d3e106f req-043063da-c5a8-44f5-a23a-103458315617 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052472 Oct 29 03:54:41.817012 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3729/7503] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:42.250855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:42.251606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:42.259157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:42.259630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:42.260054 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:42.260764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:42.261177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:42.261612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:42.297086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:42.297684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:42.298201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:42.299010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lazy-loading 'fault' on Instance uuid 9148297b-3d39-4ad4-91b4-b29ac3a60b85 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:54:42.348536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:42.357155 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1b081630-2b0c-4e32-b0b8-133d9e5bb7d3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 200 len: 1307 microversion: 2.1 time: 0.110211 Oct 29 03:54:42.357714 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3775/7504] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:42 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:43.386815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:43.387965 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:43.398127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:43.398620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:43.399066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:43.399770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:43.400228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:43.400661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:43.414831 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] HTTP exception thrown: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Request method failure captured: Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 HTTP/1.1 Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKPpM1b1u2tp344OKQYHNlzisluBWnBP-FZ-hMMFdGuZGwkEvN7wu4TbBjTKve3m4UTG3gpNdhny-fpYb_ZTUKUMp_pmVgqJ1KKW4ULT3jRj0Kgl0oJaZ4LmjiKUV5FautmPUNe6iHtBLERkxQ3C9fvW1Ue5STv5Iztc_lX0earaung Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2fa0fc78e7e6461484aa23de0f39e47e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}] Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a5095343d28645f3b3cffd8830ca2419 Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '9148297b-3d39-4ad4-91b4-b29ac3a60b85'} Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:43.416477 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:43.421263 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:43.421263 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:43.421263 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:43.421263 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:43.421263 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:43.421263 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:43.421263 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:43.421263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Returning 404 to user: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:43.421263 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-05b00bf0-af14-4df8-b8c1-968056391e16 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 404 len: 111 microversion: 2.1 time: 0.039766 Oct 29 03:54:43.421263 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3730/7505] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:43 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:43.427344 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2a68b9ab-0e11-48b4-9f0a-c12add6b5d14 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:43.427949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2a68b9ab-0e11-48b4-9f0a-c12add6b5d14 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:43.437198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a68b9ab-0e11-48b4-9f0a-c12add6b5d14 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:43.437709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a68b9ab-0e11-48b4-9f0a-c12add6b5d14 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:43.438696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a68b9ab-0e11-48b4-9f0a-c12add6b5d14 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:43.439449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a68b9ab-0e11-48b4-9f0a-c12add6b5d14 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:43.439896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a68b9ab-0e11-48b4-9f0a-c12add6b5d14 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:43.440298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2a68b9ab-0e11-48b4-9f0a-c12add6b5d14 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:43.582899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2a68b9ab-0e11-48b4-9f0a-c12add6b5d14 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:43.591817 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2a68b9ab-0e11-48b4-9f0a-c12add6b5d14 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1504 microversion: 2.1 time: 0.168404 Oct 29 03:54:43.592433 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3776/7506] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:43 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:43.615058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59602bcb-d443-45f0-a357-270f4fd0b170 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:43.617492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59602bcb-d443-45f0-a357-270f4fd0b170 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 3a07dd80-d6f0-4f87-b42d-b8731cfc7dbb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:43.623268 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-59602bcb-d443-45f0-a357-270f4fd0b170 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] HTTP exception thrown: Instance 3a07dd80-d6f0-4f87-b42d-b8731cfc7dbb could not be found. Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59602bcb-d443-45f0-a357-270f4fd0b170 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Request method failure captured: Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/3a07dd80-d6f0-4f87-b42d-b8731cfc7dbb/action HTTP/1.1 Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 32 Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKPpM1b1u2tp344OKQYHNlzisluBWnBP-FZ-hMMFdGuZGwkEvN7wu4TbBjTKve3m4UTG3gpNdhny-fpYb_ZTUKUMp_pmVgqJ1KKW4ULT3jRj0Kgl0oJaZ4LmjiKUV5FautmPUNe6iHtBLERkxQ3C9fvW1Ue5STv5Iztc_lX0earaung Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2fa0fc78e7e6461484aa23de0f39e47e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}] Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a5095343d28645f3b3cffd8830ca2419 Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: {"resize": {"flavorRef": "452"}} Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 3a07dd80-d6f0-4f87-b42d-b8731cfc7dbb could not be found. Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '3a07dd80-d6f0-4f87-b42d-b8731cfc7dbb', 'body': {'resize': {'flavorRef': '452'}}} Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a07dd80-d6f0-4f87-b42d-b8731cfc7dbb could not be found. Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:43.624828 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a07dd80-d6f0-4f87-b42d-b8731cfc7dbb could not be found. Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a07dd80-d6f0-4f87-b42d-b8731cfc7dbb could not be found. Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59602bcb-d443-45f0-a357-270f4fd0b170 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Returning 404 to user: Instance 3a07dd80-d6f0-4f87-b42d-b8731cfc7dbb could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59602bcb-d443-45f0-a357-270f4fd0b170 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "POST /compute/v2.1/servers/3a07dd80-d6f0-4f87-b42d-b8731cfc7dbb/action" status: 404 len: 111 microversion: 2.1 time: 0.016139 Oct 29 03:54:43.629536 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3731/7507] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:54:43 2022] POST /compute/v2.1/servers/3a07dd80-d6f0-4f87-b42d-b8731cfc7dbb/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:43.635718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f92f7930-bf24-4554-89df-ec0df711d5b5 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:43.636314 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f92f7930-bf24-4554-89df-ec0df711d5b5 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:43.642747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f92f7930-bf24-4554-89df-ec0df711d5b5 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:43.643162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f92f7930-bf24-4554-89df-ec0df711d5b5 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:43.643586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f92f7930-bf24-4554-89df-ec0df711d5b5 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:43.644264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f92f7930-bf24-4554-89df-ec0df711d5b5 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:43.644704 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f92f7930-bf24-4554-89df-ec0df711d5b5 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:43.645115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f92f7930-bf24-4554-89df-ec0df711d5b5 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:43.781483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f92f7930-bf24-4554-89df-ec0df711d5b5 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:43.785080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:43.790414 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f92f7930-bf24-4554-89df-ec0df711d5b5 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1504 microversion: 2.1 time: 0.158634 Oct 29 03:54:43.790997 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3777/7508] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:43 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:43.824924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-be73b040-b4e3-4757-b451-99ab316d774d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:43.824924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-be73b040-b4e3-4757-b451-99ab316d774d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:43.831626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be73b040-b4e3-4757-b451-99ab316d774d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:43.832127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be73b040-b4e3-4757-b451-99ab316d774d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:43.832582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be73b040-b4e3-4757-b451-99ab316d774d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:43.833294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be73b040-b4e3-4757-b451-99ab316d774d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:43.833757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be73b040-b4e3-4757-b451-99ab316d774d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:43.834218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-be73b040-b4e3-4757-b451-99ab316d774d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:43.969374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-be73b040-b4e3-4757-b451-99ab316d774d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:43.977672 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-be73b040-b4e3-4757-b451-99ab316d774d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1504 microversion: 2.1 time: 0.157669 Oct 29 03:54:43.978672 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3732/7509] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:43 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:44.001395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "8b972bd7-1d7c-49d6-a9cf-9529e2ffb271"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:44.003853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:44.013123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.013906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.014711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.015755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.016319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.016936 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.053785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:44.058837 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] HTTP exception thrown: Flavor 8b972bd7-1d7c-49d6-a9cf-9529e2ffb271 could not be found. Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Request method failure captured: Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: request: POST /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b/action HTTP/1.1 Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 65 Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKPpM1b1u2tp344OKQYHNlzisluBWnBP-FZ-hMMFdGuZGwkEvN7wu4TbBjTKve3m4UTG3gpNdhny-fpYb_ZTUKUMp_pmVgqJ1KKW4ULT3jRj0Kgl0oJaZ4LmjiKUV5FautmPUNe6iHtBLERkxQ3C9fvW1Ue5STv5Iztc_lX0earaung Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2fa0fc78e7e6461484aa23de0f39e47e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}] Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a5095343d28645f3b3cffd8830ca2419 Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: {"resize": {"flavorRef": "8b972bd7-1d7c-49d6-a9cf-9529e2ffb271"}} Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: exception: Flavor 8b972bd7-1d7c-49d6-a9cf-9529e2ffb271 could not be found. Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '4447c74e-29bf-4e3b-a011-d3310bac095b', 'body': {'resize': {'flavorRef': '8b972bd7-1d7c-49d6-a9cf-9529e2ffb271'}}} Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:44.060725 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 8b972bd7-1d7c-49d6-a9cf-9529e2ffb271 could not be found. Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 8b972bd7-1d7c-49d6-a9cf-9529e2ffb271 could not be found. Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 8b972bd7-1d7c-49d6-a9cf-9529e2ffb271 could not be found. Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Returning 400 to user: Flavor 8b972bd7-1d7c-49d6-a9cf-9529e2ffb271 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-75f972e7-b040-42b2-aaf8-5cbea3e43333 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "POST /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b/action" status: 400 len: 107 microversion: 2.1 time: 0.064864 Oct 29 03:54:44.065290 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3778/7510] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:54:43 2022] POST /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b/action => generated 107 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:54:44.071071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4013eaef-3d19-420a-bb03-d63d64207ba1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:44.071696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4013eaef-3d19-420a-bb03-d63d64207ba1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:44.077976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4013eaef-3d19-420a-bb03-d63d64207ba1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.078470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4013eaef-3d19-420a-bb03-d63d64207ba1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.078917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4013eaef-3d19-420a-bb03-d63d64207ba1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.079612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4013eaef-3d19-420a-bb03-d63d64207ba1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.080074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4013eaef-3d19-420a-bb03-d63d64207ba1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.080501 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4013eaef-3d19-420a-bb03-d63d64207ba1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.211739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4013eaef-3d19-420a-bb03-d63d64207ba1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:44.220171 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4013eaef-3d19-420a-bb03-d63d64207ba1 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1504 microversion: 2.1 time: 0.153028 Oct 29 03:54:44.220744 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3733/7511] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:44 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:54:44.244025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-10f0b62c-195b-4511-9501-ed7ad5dde6ac tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:44.244623 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-10f0b62c-195b-4511-9501-ed7ad5dde6ac tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:44.250915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f0b62c-195b-4511-9501-ed7ad5dde6ac tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.251398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f0b62c-195b-4511-9501-ed7ad5dde6ac tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.251826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f0b62c-195b-4511-9501-ed7ad5dde6ac tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.252514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f0b62c-195b-4511-9501-ed7ad5dde6ac tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.252962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f0b62c-195b-4511-9501-ed7ad5dde6ac tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.253379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10f0b62c-195b-4511-9501-ed7ad5dde6ac tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.393563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-10f0b62c-195b-4511-9501-ed7ad5dde6ac tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:44.402151 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-10f0b62c-195b-4511-9501-ed7ad5dde6ac tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1504 microversion: 2.1 time: 0.162087 Oct 29 03:54:44.402725 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3779/7512] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:44 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:44.425130 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5546df9-9431-4b57-81b7-7be233dc8155 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5546df9-9431-4b57-81b7-7be233dc8155 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Request method failure captured: Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: request: POST /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b/action HTTP/1.1 Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 29 Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKPpM1b1u2tp344OKQYHNlzisluBWnBP-FZ-hMMFdGuZGwkEvN7wu4TbBjTKve3m4UTG3gpNdhny-fpYb_ZTUKUMp_pmVgqJ1KKW4ULT3jRj0Kgl0oJaZ4LmjiKUV5FautmPUNe6iHtBLERkxQ3C9fvW1Ue5STv5Iztc_lX0earaung Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2fa0fc78e7e6461484aa23de0f39e47e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}] Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a5095343d28645f3b3cffd8830ca2419 Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: {"resize": {"flavorRef": ""}} Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '4447c74e-29bf-4e3b-a011-d3310bac095b', 'body': {'resize': {'flavorRef': ''}}} Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi '' Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.428896 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:44.434437 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.434437 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.434437 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:44.434437 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:44.434437 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:54:44.434437 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:54:44.434437 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 29 03:54:44.434437 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.434437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5546df9-9431-4b57-81b7-7be233dc8155 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:44.434437 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5546df9-9431-4b57-81b7-7be233dc8155 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "POST /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b/action" status: 400 len: 113 microversion: 2.1 time: 0.009252 Oct 29 03:54:44.434437 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3734/7513] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:54:44 2022] POST /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:54:44.439356 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-878ea0c0-51a5-4d53-bc94-b9c5da4a2292 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:44.439959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-878ea0c0-51a5-4d53-bc94-b9c5da4a2292 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:44.447398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-878ea0c0-51a5-4d53-bc94-b9c5da4a2292 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.447889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-878ea0c0-51a5-4d53-bc94-b9c5da4a2292 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.448319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-878ea0c0-51a5-4d53-bc94-b9c5da4a2292 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.449033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-878ea0c0-51a5-4d53-bc94-b9c5da4a2292 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.449483 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-878ea0c0-51a5-4d53-bc94-b9c5da4a2292 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.449934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-878ea0c0-51a5-4d53-bc94-b9c5da4a2292 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.592400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-878ea0c0-51a5-4d53-bc94-b9c5da4a2292 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:44.600905 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-878ea0c0-51a5-4d53-bc94-b9c5da4a2292 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1504 microversion: 2.1 time: 0.165360 Oct 29 03:54:44.601490 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3780/7514] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:44 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:44.631574 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:44.632096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:44.639544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.640033 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.640472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.641168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.641601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.642059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.655297 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] HTTP exception thrown: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Request method failure captured: Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 HTTP/1.1 Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKPpM1b1u2tp344OKQYHNlzisluBWnBP-FZ-hMMFdGuZGwkEvN7wu4TbBjTKve3m4UTG3gpNdhny-fpYb_ZTUKUMp_pmVgqJ1KKW4ULT3jRj0Kgl0oJaZ4LmjiKUV5FautmPUNe6iHtBLERkxQ3C9fvW1Ue5STv5Iztc_lX0earaung Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2fa0fc78e7e6461484aa23de0f39e47e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}] Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a5095343d28645f3b3cffd8830ca2419 Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '9148297b-3d39-4ad4-91b4-b29ac3a60b85'} Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:44.656857 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Returning 404 to user: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-10b0f206-6b95-4bb8-bd9e-2dc8d4ad1407 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 404 len: 111 microversion: 2.1 time: 0.034154 Oct 29 03:54:44.660727 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3735/7515] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:54:44 2022] DELETE /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:44.667067 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:44.667669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 9148297b-3d39-4ad4-91b4-b29ac3a60b85] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:44.674092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.674601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.675012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.675700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.676147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.676564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.690217 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] HTTP exception thrown: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Request method failure captured: Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 HTTP/1.1 Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKPpM1b1u2tp344OKQYHNlzisluBWnBP-FZ-hMMFdGuZGwkEvN7wu4TbBjTKve3m4UTG3gpNdhny-fpYb_ZTUKUMp_pmVgqJ1KKW4ULT3jRj0Kgl0oJaZ4LmjiKUV5FautmPUNe6iHtBLERkxQ3C9fvW1Ue5STv5Iztc_lX0earaung Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2fa0fc78e7e6461484aa23de0f39e47e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}] Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a5095343d28645f3b3cffd8830ca2419 Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '9148297b-3d39-4ad4-91b4-b29ac3a60b85'} Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:44.691769 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.696707 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:44.696707 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:44.696707 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:44.696707 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:44.696707 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:44.696707 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. Oct 29 03:54:44.696707 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:44.696707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Returning 404 to user: Instance 9148297b-3d39-4ad4-91b4-b29ac3a60b85 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:44.696707 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-40afb6ee-37a1-4497-9d94-33660a921e06 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85" status: 404 len: 111 microversion: 2.1 time: 0.030019 Oct 29 03:54:44.696707 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3781/7516] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:44 2022] GET /compute/v2.1/servers/9148297b-3d39-4ad4-91b4-b29ac3a60b85 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:54:44.701938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dcbad04b-e156-4121-a370-6d225013014f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:44.702451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dcbad04b-e156-4121-a370-6d225013014f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:44.709169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcbad04b-e156-4121-a370-6d225013014f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.709673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcbad04b-e156-4121-a370-6d225013014f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.710341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcbad04b-e156-4121-a370-6d225013014f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.711051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcbad04b-e156-4121-a370-6d225013014f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.711514 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcbad04b-e156-4121-a370-6d225013014f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.711949 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dcbad04b-e156-4121-a370-6d225013014f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.739337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dcbad04b-e156-4121-a370-6d225013014f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:54:44.821066 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dcbad04b-e156-4121-a370-6d225013014f tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 204 len: 0 microversion: 2.1 time: 0.122737 Oct 29 03:54:44.821679 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3736/7517] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:54:44 2022] DELETE /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:54:44.830709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ee98fa4d-2222-4367-967f-4c918d25694a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:44.831400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ee98fa4d-2222-4367-967f-4c918d25694a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:44.837742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee98fa4d-2222-4367-967f-4c918d25694a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.838264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee98fa4d-2222-4367-967f-4c918d25694a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.838698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee98fa4d-2222-4367-967f-4c918d25694a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.839388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee98fa4d-2222-4367-967f-4c918d25694a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:44.839841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee98fa4d-2222-4367-967f-4c918d25694a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:44.840261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ee98fa4d-2222-4367-967f-4c918d25694a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:44.984220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ee98fa4d-2222-4367-967f-4c918d25694a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:44.993044 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ee98fa4d-2222-4367-967f-4c918d25694a tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1510 microversion: 2.1 time: 0.166390 Oct 29 03:54:44.993624 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3782/7518] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:44 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:46.018589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cc45ccc8-7474-446b-93cf-4cbb5ff46d6d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:46.019410 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cc45ccc8-7474-446b-93cf-4cbb5ff46d6d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:46.027560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc45ccc8-7474-446b-93cf-4cbb5ff46d6d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:46.028114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc45ccc8-7474-446b-93cf-4cbb5ff46d6d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:46.028609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc45ccc8-7474-446b-93cf-4cbb5ff46d6d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:46.029401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc45ccc8-7474-446b-93cf-4cbb5ff46d6d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:46.029953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc45ccc8-7474-446b-93cf-4cbb5ff46d6d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:46.030462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc45ccc8-7474-446b-93cf-4cbb5ff46d6d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:46.170174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc45ccc8-7474-446b-93cf-4cbb5ff46d6d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:46.178141 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cc45ccc8-7474-446b-93cf-4cbb5ff46d6d tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1510 microversion: 2.1 time: 0.164501 Oct 29 03:54:46.178719 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3737/7519] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:46 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:46.878442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-5bcf2df2-f146-497c-a5dd-f43e688d34e1 req-02e8ca2e-b868-44c1-9de0-2a837fd54fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4447c74e-29bf-4e3b-a011-d3310bac095b", "name": "network-vif-deleted", "tag": "b9aa967d-7ed3-4dad-a657-a4682de07c92"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:46.891268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5bcf2df2-f146-497c-a5dd-f43e688d34e1 req-02e8ca2e-b868-44c1-9de0-2a837fd54fb7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:46.891817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5bcf2df2-f146-497c-a5dd-f43e688d34e1 req-02e8ca2e-b868-44c1-9de0-2a837fd54fb7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:46.892187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5bcf2df2-f146-497c-a5dd-f43e688d34e1 req-02e8ca2e-b868-44c1-9de0-2a837fd54fb7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:46.907420 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-5bcf2df2-f146-497c-a5dd-f43e688d34e1 req-02e8ca2e-b868-44c1-9de0-2a837fd54fb7 service nova] Creating event network-vif-deleted:b9aa967d-7ed3-4dad-a657-a4682de07c92 for instance 4447c74e-29bf-4e3b-a011-d3310bac095b on n-h2-862964-4 Oct 29 03:54:46.912728 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-5bcf2df2-f146-497c-a5dd-f43e688d34e1 req-02e8ca2e-b868-44c1-9de0-2a837fd54fb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100048 Oct 29 03:54:46.913368 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3783/7520] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:47.206132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:47.207107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:47.215960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:47.216451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:47.216889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:47.217617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:47.218107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:47.218534 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:47.221200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:47.258682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:47.259086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:47.259526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:47.259983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lazy-loading 'fault' on Instance uuid 4447c74e-29bf-4e3b-a011-d3310bac095b {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:54:47.301990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5095343d28645f3b3cffd8830ca2419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa0fc78e7e6461484aa23de0f39e47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:47.310113 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-229be5ab-c473-45d3-a71b-d441fae3b6f3 tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 200 len: 1306 microversion: 2.1 time: 0.110590 Oct 29 03:54:47.310870 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3738/7521] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:47 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 1306 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:48.340618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:48.341562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] [instance: 4447c74e-29bf-4e3b-a011-d3310bac095b] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:48.352217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:48.352696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:48.353132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:48.353832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:48.354311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:48.354728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:48.369067 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] HTTP exception thrown: Instance 4447c74e-29bf-4e3b-a011-d3310bac095b could not be found. Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Request method failure captured: Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b HTTP/1.1 Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKPpM1b1u2tp344OKQYHNlzisluBWnBP-FZ-hMMFdGuZGwkEvN7wu4TbBjTKve3m4UTG3gpNdhny-fpYb_ZTUKUMp_pmVgqJ1KKW4ULT3jRj0Kgl0oJaZ4LmjiKUV5FautmPUNe6iHtBLERkxQ3C9fvW1Ue5STv5Iztc_lX0earaung Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2fa0fc78e7e6461484aa23de0f39e47e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fa0fc78e7e6461484aa23de0f39e47e"}]}] Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 2fa0fc78e7e6461484aa23de0f39e47e Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1263415606 Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: a5095343d28645f3b3cffd8830ca2419 Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-ServersNegativeTestJSON-1263415606-project Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 4447c74e-29bf-4e3b-a011-d3310bac095b could not be found. Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '4447c74e-29bf-4e3b-a011-d3310bac095b'} Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4447c74e-29bf-4e3b-a011-d3310bac095b could not be found. Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4447c74e-29bf-4e3b-a011-d3310bac095b could not be found. Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:54:48.370748 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:48.375476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:54:48.375476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:54:48.375476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:54:48.375476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:54:48.375476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:54:48.375476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4447c74e-29bf-4e3b-a011-d3310bac095b could not be found. Oct 29 03:54:48.375476 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:54:48.375476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] Returning 404 to user: Instance 4447c74e-29bf-4e3b-a011-d3310bac095b could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:54:48.375476 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-38fdd2ee-7d9d-4f3f-a826-df82d5f8bffd tempest-ServersNegativeTestJSON-1263415606 tempest-ServersNegativeTestJSON-1263415606-project] 10.222.0.16 "GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b" status: 404 len: 111 microversion: 2.1 time: 0.040456 Oct 29 03:54:48.375476 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3784/7522] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:48 2022] GET /compute/v2.1/servers/4447c74e-29bf-4e3b-a011-d3310bac095b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:55:19.637838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:19.638655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=7 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:19.640191 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:55:19.640319 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:55:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Oct 29 03:55:19.807057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-655f5958-ef64-43c2-b0d1-8067decaf201 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Action: 'create', calling method: .version_select at 0x7fe1a3917a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1935423607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtgKIFHtCY3pWEL9SuP1MivJqxhscYz8l6kxmHawnfQJo3MxevbNRRdyqcWpLkuC1mKSYqWwVQHYs1U4JwMOgMcH7Siq+AMk6yWcuTy3iRZ7YaSOS0rdUD04/GkaEya7g=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:55:19.823105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-655f5958-ef64-43c2-b0d1-8067decaf201 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:55:19.829495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-655f5958-ef64-43c2-b0d1-8067decaf201 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for user 4e76321c46fb4c659cf81f6f5e319df7 and project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:55:19.861255 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-655f5958-ef64-43c2-b0d1-8067decaf201 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.228703 Oct 29 03:55:19.862977 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3739/7523] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:55:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:19.915305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-376516151", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1935423607", "networks": [{"uuid": "20a7a2d4-ec32-4247-a01b-8528771c76c2"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:55:19.924711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:19.925369 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=28 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:19.975611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] validate_networks() for [('20a7a2d4-ec32-4247-a01b-8528771c76c2', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:55:20.414698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:55:20.415112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:55:20.415608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:55:20.416003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:55:20.416450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:55:20.426247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:20.426741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:20.427322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:20.428411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:20.428872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:20.429293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:20.448940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:55:20.455677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for user 4e76321c46fb4c659cf81f6f5e319df7 and project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:55:20.469323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:55:20.471760 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:55:20.522870 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1f00ab75-53d7-4ccd-be6b-2da5cdd2f1fd tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611529 Oct 29 03:55:20.524645 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3785/7524] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:55:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:55:20.536111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d53cb005-ee54-4348-aa23-e7b144978ba9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:20.536758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d53cb005-ee54-4348-aa23-e7b144978ba9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:20.598369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d53cb005-ee54-4348-aa23-e7b144978ba9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:20.606746 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d53cb005-ee54-4348-aa23-e7b144978ba9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1262 microversion: 2.1 time: 0.075272 Oct 29 03:55:20.607414 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3740/7525] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:20 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1262 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:21.631896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-107a7385-714f-4648-bbad-edf950475691 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:21.632499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-107a7385-714f-4648-bbad-edf950475691 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:21.640617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-107a7385-714f-4648-bbad-edf950475691 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:21.641637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-107a7385-714f-4648-bbad-edf950475691 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:21.642315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-107a7385-714f-4648-bbad-edf950475691 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:21.643587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-107a7385-714f-4648-bbad-edf950475691 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:21.644032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-107a7385-714f-4648-bbad-edf950475691 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:21.644644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-107a7385-714f-4648-bbad-edf950475691 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:21.710221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-107a7385-714f-4648-bbad-edf950475691 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:21.719006 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-107a7385-714f-4648-bbad-edf950475691 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1314 microversion: 2.1 time: 0.092388 Oct 29 03:55:21.719601 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3786/7526] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:21 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1314 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:22.744634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-456493b2-ca4c-4b4d-a09d-293023ef6116 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:22.745256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-456493b2-ca4c-4b4d-a09d-293023ef6116 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:22.758229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-456493b2-ca4c-4b4d-a09d-293023ef6116 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:22.758734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-456493b2-ca4c-4b4d-a09d-293023ef6116 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:22.759172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-456493b2-ca4c-4b4d-a09d-293023ef6116 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:22.759887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-456493b2-ca4c-4b4d-a09d-293023ef6116 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:22.760362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-456493b2-ca4c-4b4d-a09d-293023ef6116 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:22.760789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-456493b2-ca4c-4b4d-a09d-293023ef6116 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:22.972628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-456493b2-ca4c-4b4d-a09d-293023ef6116 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:22.982081 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-456493b2-ca4c-4b4d-a09d-293023ef6116 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1362 microversion: 2.1 time: 0.241657 Oct 29 03:55:22.994067 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3741/7527] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:22 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:23.555108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-4251b298-1ada-43b9-a142-65a41e3af98f req-ace67e3f-30f9-4513-acbb-e76cd2354f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc418b2-30c5-43a3-8ede-6cde0734e128", "tag": "85c7b9b7-3fdd-4898-94a0-d853cff9e167"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:55:23.568865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4251b298-1ada-43b9-a142-65a41e3af98f req-ace67e3f-30f9-4513-acbb-e76cd2354f64 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:23.570123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4251b298-1ada-43b9-a142-65a41e3af98f req-ace67e3f-30f9-4513-acbb-e76cd2354f64 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:23.570932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-4251b298-1ada-43b9-a142-65a41e3af98f req-ace67e3f-30f9-4513-acbb-e76cd2354f64 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:23.583936 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-4251b298-1ada-43b9-a142-65a41e3af98f req-ace67e3f-30f9-4513-acbb-e76cd2354f64 service nova] Creating event network-changed:85c7b9b7-3fdd-4898-94a0-d853cff9e167 for instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 on n-h1-862964-4 Oct 29 03:55:23.589234 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-4251b298-1ada-43b9-a142-65a41e3af98f req-ace67e3f-30f9-4513-acbb-e76cd2354f64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038070 Oct 29 03:55:23.590226 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3787/7528] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:24.008204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-726fa6b5-ae4a-4202-b1a7-38458462f28e tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:24.010674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-726fa6b5-ae4a-4202-b1a7-38458462f28e tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:24.021378 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-726fa6b5-ae4a-4202-b1a7-38458462f28e tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:24.022247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-726fa6b5-ae4a-4202-b1a7-38458462f28e tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:24.022873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-726fa6b5-ae4a-4202-b1a7-38458462f28e tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:24.023645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-726fa6b5-ae4a-4202-b1a7-38458462f28e tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:24.024267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-726fa6b5-ae4a-4202-b1a7-38458462f28e tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:24.025056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-726fa6b5-ae4a-4202-b1a7-38458462f28e tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:24.189166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-726fa6b5-ae4a-4202-b1a7-38458462f28e tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:24.198741 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-726fa6b5-ae4a-4202-b1a7-38458462f28e tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1362 microversion: 2.1 time: 0.195419 Oct 29 03:55:24.199632 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3742/7529] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:24 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:25.230180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b9eedb6c-abf6-4c16-a423-d4e9d45e8e29 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:25.230861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b9eedb6c-abf6-4c16-a423-d4e9d45e8e29 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:25.238329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eedb6c-abf6-4c16-a423-d4e9d45e8e29 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:25.238791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eedb6c-abf6-4c16-a423-d4e9d45e8e29 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:25.239226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eedb6c-abf6-4c16-a423-d4e9d45e8e29 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:25.239938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eedb6c-abf6-4c16-a423-d4e9d45e8e29 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:25.240390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eedb6c-abf6-4c16-a423-d4e9d45e8e29 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:25.240791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9eedb6c-abf6-4c16-a423-d4e9d45e8e29 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:25.380778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b9eedb6c-abf6-4c16-a423-d4e9d45e8e29 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:25.388721 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b9eedb6c-abf6-4c16-a423-d4e9d45e8e29 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1362 microversion: 2.1 time: 0.163906 Oct 29 03:55:25.389329 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3788/7530] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:25 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:26.415967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1bfe7065-346c-4ac7-8801-fe800111308d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:26.416785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1bfe7065-346c-4ac7-8801-fe800111308d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:26.424784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bfe7065-346c-4ac7-8801-fe800111308d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:26.425271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bfe7065-346c-4ac7-8801-fe800111308d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:26.425709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bfe7065-346c-4ac7-8801-fe800111308d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:26.426441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bfe7065-346c-4ac7-8801-fe800111308d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:26.426901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bfe7065-346c-4ac7-8801-fe800111308d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:26.427324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1bfe7065-346c-4ac7-8801-fe800111308d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:26.564001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1bfe7065-346c-4ac7-8801-fe800111308d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:26.572343 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1bfe7065-346c-4ac7-8801-fe800111308d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1362 microversion: 2.1 time: 0.162695 Oct 29 03:55:26.572918 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3743/7531] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:26 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:27.596128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-35600771-3266-413d-b148-a2cb1e683321 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:27.596761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-35600771-3266-413d-b148-a2cb1e683321 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:27.603895 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35600771-3266-413d-b148-a2cb1e683321 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:27.604377 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35600771-3266-413d-b148-a2cb1e683321 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:27.604800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35600771-3266-413d-b148-a2cb1e683321 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:27.605513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35600771-3266-413d-b148-a2cb1e683321 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:27.605994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35600771-3266-413d-b148-a2cb1e683321 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:27.606439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-35600771-3266-413d-b148-a2cb1e683321 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:27.692202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-90d79ea9-2911-444b-9353-f851a079e106 req-07b41290-18a8-429e-a643-d21b82d854c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc418b2-30c5-43a3-8ede-6cde0734e128", "name": "network-vif-plugged", "status": "completed", "tag": "85c7b9b7-3fdd-4898-94a0-d853cff9e167"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:55:27.703613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-90d79ea9-2911-444b-9353-f851a079e106 req-07b41290-18a8-429e-a643-d21b82d854c2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:27.704178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-90d79ea9-2911-444b-9353-f851a079e106 req-07b41290-18a8-429e-a643-d21b82d854c2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:27.704620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-90d79ea9-2911-444b-9353-f851a079e106 req-07b41290-18a8-429e-a643-d21b82d854c2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:27.717219 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-90d79ea9-2911-444b-9353-f851a079e106 req-07b41290-18a8-429e-a643-d21b82d854c2 service nova] Creating event network-vif-plugged:85c7b9b7-3fdd-4898-94a0-d853cff9e167 for instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 on n-h1-862964-4 Oct 29 03:55:27.722495 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-90d79ea9-2911-444b-9353-f851a079e106 req-07b41290-18a8-429e-a643-d21b82d854c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034497 Oct 29 03:55:27.723577 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3744/7532] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:27.745286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-35600771-3266-413d-b148-a2cb1e683321 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:27.753205 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-35600771-3266-413d-b148-a2cb1e683321 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1362 microversion: 2.1 time: 0.161537 Oct 29 03:55:27.753987 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3789/7533] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:27 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:28.778733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-316451ce-4a5f-431f-a383-5e00e3a9e341 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:28.779506 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-316451ce-4a5f-431f-a383-5e00e3a9e341 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:28.787022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316451ce-4a5f-431f-a383-5e00e3a9e341 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:28.787537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316451ce-4a5f-431f-a383-5e00e3a9e341 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:28.788062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316451ce-4a5f-431f-a383-5e00e3a9e341 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:28.788837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316451ce-4a5f-431f-a383-5e00e3a9e341 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:28.789349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316451ce-4a5f-431f-a383-5e00e3a9e341 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:28.789847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-316451ce-4a5f-431f-a383-5e00e3a9e341 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:28.925993 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-316451ce-4a5f-431f-a383-5e00e3a9e341 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:28.935062 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-316451ce-4a5f-431f-a383-5e00e3a9e341 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1362 microversion: 2.1 time: 0.162266 Oct 29 03:55:28.936441 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3745/7534] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:28 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:29.963467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4a63e59e-ca10-4166-9b8a-3ccbba7406e6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:29.964458 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4a63e59e-ca10-4166-9b8a-3ccbba7406e6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:29.972381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a63e59e-ca10-4166-9b8a-3ccbba7406e6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:29.972855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a63e59e-ca10-4166-9b8a-3ccbba7406e6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:29.973280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a63e59e-ca10-4166-9b8a-3ccbba7406e6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:29.974007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a63e59e-ca10-4166-9b8a-3ccbba7406e6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:29.974447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a63e59e-ca10-4166-9b8a-3ccbba7406e6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:29.974862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4a63e59e-ca10-4166-9b8a-3ccbba7406e6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:30.113880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4a63e59e-ca10-4166-9b8a-3ccbba7406e6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:30.125150 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4a63e59e-ca10-4166-9b8a-3ccbba7406e6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1554 microversion: 2.1 time: 0.168494 Oct 29 03:55:30.125901 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3790/7535] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:29 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:30.152231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-680212e9-ad64-46c3-8b03-4ae508a589a4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:30.152823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-680212e9-ad64-46c3-8b03-4ae508a589a4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:30.160265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-680212e9-ad64-46c3-8b03-4ae508a589a4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:30.160733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-680212e9-ad64-46c3-8b03-4ae508a589a4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:30.161194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-680212e9-ad64-46c3-8b03-4ae508a589a4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:30.161954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-680212e9-ad64-46c3-8b03-4ae508a589a4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:30.162406 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-680212e9-ad64-46c3-8b03-4ae508a589a4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:30.162831 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-680212e9-ad64-46c3-8b03-4ae508a589a4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:30.299270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-680212e9-ad64-46c3-8b03-4ae508a589a4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:30.307871 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-680212e9-ad64-46c3-8b03-4ae508a589a4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1554 microversion: 2.1 time: 0.159465 Oct 29 03:55:30.308380 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3746/7536] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:30 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:31.939026 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8fd578e6-0409-49d1-88d9-86424a07c5f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "790907e3-b503-43dc-817a-d386687d9b69"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:55:31.941295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8fd578e6-0409-49d1-88d9-86424a07c5f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:31.943412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:31.944046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:31.951050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd578e6-0409-49d1-88d9-86424a07c5f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:31.951523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd578e6-0409-49d1-88d9-86424a07c5f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:31.951946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd578e6-0409-49d1-88d9-86424a07c5f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:31.952628 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd578e6-0409-49d1-88d9-86424a07c5f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:31.953070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd578e6-0409-49d1-88d9-86424a07c5f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:31.953479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8fd578e6-0409-49d1-88d9-86424a07c5f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:32.245500 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8fd578e6-0409-49d1-88d9-86424a07c5f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "POST /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310755 Oct 29 03:55:32.246232 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3791/7537] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:55:31 2022] POST /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:43.035069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f3517fed-71fe-42a5-a0ed-cc886860aa9d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:43.035606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f3517fed-71fe-42a5-a0ed-cc886860aa9d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:43.037587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:43.038947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:43.039533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=32 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:43.045158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3517fed-71fe-42a5-a0ed-cc886860aa9d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:43.045647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3517fed-71fe-42a5-a0ed-cc886860aa9d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:43.046210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3517fed-71fe-42a5-a0ed-cc886860aa9d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:43.047137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3517fed-71fe-42a5-a0ed-cc886860aa9d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:43.047601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3517fed-71fe-42a5-a0ed-cc886860aa9d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:43.048020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f3517fed-71fe-42a5-a0ed-cc886860aa9d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:43.133741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-f3517fed-71fe-42a5-a0ed-cc886860aa9d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lazy-loading 'services' on Instance uuid 3cc418b2-30c5-43a3-8ede-6cde0734e128 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:55:43.211922 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f3517fed-71fe-42a5-a0ed-cc886860aa9d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments/790907e3-b503-43dc-817a-d386687d9b69" status: 202 len: 0 microversion: 2.1 time: 0.181143 Oct 29 03:55:43.212507 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3747/7538] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:55:43 2022] DELETE /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments/790907e3-b503-43dc-817a-d386687d9b69 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:55:43.220997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:43.222010 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:43.226632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-504f4af3-e80a-410f-bf50-4e8dbc90f528 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:43.229032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-504f4af3-e80a-410f-bf50-4e8dbc90f528 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:43.238791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504f4af3-e80a-410f-bf50-4e8dbc90f528 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:43.239273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504f4af3-e80a-410f-bf50-4e8dbc90f528 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:43.239695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504f4af3-e80a-410f-bf50-4e8dbc90f528 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:43.240381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504f4af3-e80a-410f-bf50-4e8dbc90f528 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:43.240823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504f4af3-e80a-410f-bf50-4e8dbc90f528 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:43.241238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-504f4af3-e80a-410f-bf50-4e8dbc90f528 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:43.274159 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-504f4af3-e80a-410f-bf50-4e8dbc90f528 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054922 Oct 29 03:55:43.274754 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3792/7539] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:55:43 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:44.288374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5115e1f4-1b4f-4a6c-b9c8-461c74e7691f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:44.290799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5115e1f4-1b4f-4a6c-b9c8-461c74e7691f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:44.297913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5115e1f4-1b4f-4a6c-b9c8-461c74e7691f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:44.298438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5115e1f4-1b4f-4a6c-b9c8-461c74e7691f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:44.299004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5115e1f4-1b4f-4a6c-b9c8-461c74e7691f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:44.301465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5115e1f4-1b4f-4a6c-b9c8-461c74e7691f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:44.301998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5115e1f4-1b4f-4a6c-b9c8-461c74e7691f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:44.302441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5115e1f4-1b4f-4a6c-b9c8-461c74e7691f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:44.334344 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5115e1f4-1b4f-4a6c-b9c8-461c74e7691f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051002 Oct 29 03:55:44.334841 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3748/7540] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:55:44 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:45.346693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bd79c76f-e8d5-4c59-b1b0-f9ce193037b7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:45.349153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bd79c76f-e8d5-4c59-b1b0-f9ce193037b7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:45.356465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd79c76f-e8d5-4c59-b1b0-f9ce193037b7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:45.356952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd79c76f-e8d5-4c59-b1b0-f9ce193037b7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:45.357382 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd79c76f-e8d5-4c59-b1b0-f9ce193037b7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:45.358166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd79c76f-e8d5-4c59-b1b0-f9ce193037b7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:45.358615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd79c76f-e8d5-4c59-b1b0-f9ce193037b7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:45.359030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd79c76f-e8d5-4c59-b1b0-f9ce193037b7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:45.391932 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bd79c76f-e8d5-4c59-b1b0-f9ce193037b7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049540 Oct 29 03:55:45.392546 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3793/7541] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:55:45 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:46.405306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-565eef29-6cf8-412c-b34d-6af50c9f4b45 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:46.407528 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-565eef29-6cf8-412c-b34d-6af50c9f4b45 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:46.415442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-565eef29-6cf8-412c-b34d-6af50c9f4b45 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:46.415938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-565eef29-6cf8-412c-b34d-6af50c9f4b45 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:46.416373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-565eef29-6cf8-412c-b34d-6af50c9f4b45 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:46.417095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-565eef29-6cf8-412c-b34d-6af50c9f4b45 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:46.417576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-565eef29-6cf8-412c-b34d-6af50c9f4b45 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:46.418039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-565eef29-6cf8-412c-b34d-6af50c9f4b45 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:46.449693 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-565eef29-6cf8-412c-b34d-6af50c9f4b45 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048604 Oct 29 03:55:46.450308 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3749/7542] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:55:46 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:47.462931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5ca5de52-bb08-4e24-b944-4bef47d980c8 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:47.465228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5ca5de52-bb08-4e24-b944-4bef47d980c8 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:47.472616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5de52-bb08-4e24-b944-4bef47d980c8 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:47.473094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5de52-bb08-4e24-b944-4bef47d980c8 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:47.473543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5de52-bb08-4e24-b944-4bef47d980c8 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:47.474266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5de52-bb08-4e24-b944-4bef47d980c8 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:47.474705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5de52-bb08-4e24-b944-4bef47d980c8 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:47.475106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5ca5de52-bb08-4e24-b944-4bef47d980c8 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:47.505668 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5ca5de52-bb08-4e24-b944-4bef47d980c8 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046784 Oct 29 03:55:47.506274 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3794/7543] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:55:47 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:48.521793 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0347ca3b-6c13-4e6e-b3af-78c4f40a6e06 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:48.524068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0347ca3b-6c13-4e6e-b3af-78c4f40a6e06 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:48.531572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0347ca3b-6c13-4e6e-b3af-78c4f40a6e06 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:48.532131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0347ca3b-6c13-4e6e-b3af-78c4f40a6e06 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:48.532825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0347ca3b-6c13-4e6e-b3af-78c4f40a6e06 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:48.533601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0347ca3b-6c13-4e6e-b3af-78c4f40a6e06 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:48.534094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0347ca3b-6c13-4e6e-b3af-78c4f40a6e06 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:48.534519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0347ca3b-6c13-4e6e-b3af-78c4f40a6e06 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:48.567863 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0347ca3b-6c13-4e6e-b3af-78c4f40a6e06 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051858 Oct 29 03:55:48.568434 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3750/7544] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:55:48 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:55:48.579797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:48.580307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:48.587614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:48.588102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:48.588533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:48.589228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:48.589672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:48.590132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:48.671148 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] HTTP exception thrown: Instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 is not attached to volume 790907e3-b503-43dc-817a-d386687d9b69 Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Request method failure captured: Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments/790907e3-b503-43dc-817a-d386687d9b69 HTTP/1.1 Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKQiiq2k9QlbMdP6gIfuYuzoGPu6eAFPjMQUOzVVOzgLmaWYLfjimldTjztfxx0XUw1NYT0WDXfZIBmFeLsDXDNTnP3UFCIx2S-e6-tGqXG8syUywjMb7QXLSgoU7N72Y8k0mjevjO9UfrDsbuRfvU3HaAAeqVu58lkK9_Q2LxlO0Wk Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09aa2ca9146d4a69ac99e624f73339dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}] Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 4e76321c46fb4c659cf81f6f5e319df7 Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 is not attached to volume 790907e3-b503-43dc-817a-d386687d9b69 Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': '3cc418b2-30c5-43a3-8ede-6cde0734e128', 'id': '790907e3-b503-43dc-817a-d386687d9b69'} Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 790907e3-b503-43dc-817a-d386687d9b69. Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 is not attached to volume 790907e3-b503-43dc-817a-d386687d9b69 Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:55:48.682360 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:55:48.686993 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:55:48.686993 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:55:48.686993 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 is not attached to volume 790907e3-b503-43dc-817a-d386687d9b69 Oct 29 03:55:48.686993 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:55:48.686993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Returning 404 to user: Instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 is not attached to volume 790907e3-b503-43dc-817a-d386687d9b69 {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:55:48.686993 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-78f74035-2660-46a9-9fac-31a86abcc005 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments/790907e3-b503-43dc-817a-d386687d9b69" status: 404 len: 154 microversion: 2.1 time: 0.108266 Oct 29 03:55:48.686993 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3795/7545] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:55:48 2022] DELETE /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128/os-volume_attachments/790907e3-b503-43dc-817a-d386687d9b69 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:55:52.051751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e5d94e36-ca69-4e38-baad-77187440c7fc tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:52.052345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5d94e36-ca69-4e38-baad-77187440c7fc tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:52.059866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5d94e36-ca69-4e38-baad-77187440c7fc tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:52.060373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5d94e36-ca69-4e38-baad-77187440c7fc tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:52.060817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5d94e36-ca69-4e38-baad-77187440c7fc tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:52.061545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5d94e36-ca69-4e38-baad-77187440c7fc tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:52.062069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5d94e36-ca69-4e38-baad-77187440c7fc tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:52.062527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e5d94e36-ca69-4e38-baad-77187440c7fc tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:52.092034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e5d94e36-ca69-4e38-baad-77187440c7fc tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:55:52.173339 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e5d94e36-ca69-4e38-baad-77187440c7fc tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 204 len: 0 microversion: 2.1 time: 0.125351 Oct 29 03:55:52.174546 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3751/7546] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:55:52 2022] DELETE /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:55:52.183334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2e66187-8e77-4910-bd57-63625f6e7397 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:52.184638 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2e66187-8e77-4910-bd57-63625f6e7397 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:52.193013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e66187-8e77-4910-bd57-63625f6e7397 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:52.193499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e66187-8e77-4910-bd57-63625f6e7397 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:52.193994 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e66187-8e77-4910-bd57-63625f6e7397 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:52.194687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e66187-8e77-4910-bd57-63625f6e7397 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:52.195136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e66187-8e77-4910-bd57-63625f6e7397 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:52.195552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2e66187-8e77-4910-bd57-63625f6e7397 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:52.331302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2e66187-8e77-4910-bd57-63625f6e7397 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:52.339851 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2e66187-8e77-4910-bd57-63625f6e7397 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1560 microversion: 2.1 time: 0.160897 Oct 29 03:55:52.340415 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3796/7547] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:52 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:53.369217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1f83f723-bb32-41b0-95c5-0b2ca524ec7f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:53.370488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1f83f723-bb32-41b0-95c5-0b2ca524ec7f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:53.379991 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f83f723-bb32-41b0-95c5-0b2ca524ec7f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:53.380483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f83f723-bb32-41b0-95c5-0b2ca524ec7f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:53.380920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f83f723-bb32-41b0-95c5-0b2ca524ec7f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:53.381626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f83f723-bb32-41b0-95c5-0b2ca524ec7f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:53.382117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f83f723-bb32-41b0-95c5-0b2ca524ec7f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:53.382544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1f83f723-bb32-41b0-95c5-0b2ca524ec7f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:53.530849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1f83f723-bb32-41b0-95c5-0b2ca524ec7f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:53.539304 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1f83f723-bb32-41b0-95c5-0b2ca524ec7f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1560 microversion: 2.1 time: 0.177756 Oct 29 03:55:53.539905 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3752/7548] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:53 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:54.403732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-41f095a0-9623-47e2-940a-3f0d82062d76 req-185137b8-957b-4ba0-9f6f-e918fbee7350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc418b2-30c5-43a3-8ede-6cde0734e128", "name": "network-vif-deleted", "tag": "85c7b9b7-3fdd-4898-94a0-d853cff9e167"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:55:54.414072 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-41f095a0-9623-47e2-940a-3f0d82062d76 req-185137b8-957b-4ba0-9f6f-e918fbee7350 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:54.414574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-41f095a0-9623-47e2-940a-3f0d82062d76 req-185137b8-957b-4ba0-9f6f-e918fbee7350 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:54.414989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-41f095a0-9623-47e2-940a-3f0d82062d76 req-185137b8-957b-4ba0-9f6f-e918fbee7350 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:54.428020 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-41f095a0-9623-47e2-940a-3f0d82062d76 req-185137b8-957b-4ba0-9f6f-e918fbee7350 service nova] Creating event network-vif-deleted:85c7b9b7-3fdd-4898-94a0-d853cff9e167 for instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 on n-h1-862964-4 Oct 29 03:55:54.433134 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-41f095a0-9623-47e2-940a-3f0d82062d76 req-185137b8-957b-4ba0-9f6f-e918fbee7350 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096945 Oct 29 03:55:54.433744 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3797/7549] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:54.562857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:54.563547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:54.570875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:54.571567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:54.572010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:54.572747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:54.573168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:54.573588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:54.606508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:54.606879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:54.607309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:54.607798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lazy-loading 'fault' on Instance uuid 3cc418b2-30c5-43a3-8ede-6cde0734e128 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:55:54.652668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:54.661259 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8ba7788c-0230-46d2-9658-8bb01e09df23 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 200 len: 1352 microversion: 2.1 time: 0.102626 Oct 29 03:55:54.661832 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3753/7550] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:54 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:55.690976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:55.691618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 3cc418b2-30c5-43a3-8ede-6cde0734e128] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:55.698336 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:55.698817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:55.699247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:55.699946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:55.700392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:55.700806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:55.716908 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] HTTP exception thrown: Instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 could not be found. Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Request method failure captured: Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 HTTP/1.1 Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKQiiq2k9QlbMdP6gIfuYuzoGPu6eAFPjMQUOzVVOzgLmaWYLfjimldTjztfxx0XUw1NYT0WDXfZIBmFeLsDXDNTnP3UFCIx2S-e6-tGqXG8syUywjMb7QXLSgoU7N72Y8k0mjevjO9UfrDsbuRfvU3HaAAeqVu58lkK9_Q2LxlO0Wk Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09aa2ca9146d4a69ac99e624f73339dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}] Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 4e76321c46fb4c659cf81f6f5e319df7 Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 could not be found. Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '3cc418b2-30c5-43a3-8ede-6cde0734e128'} Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 could not be found. Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 could not be found. Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:55:55.718602 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:55:55.723569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:55:55.723569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:55:55.723569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:55:55.723569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:55:55.723569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:55:55.723569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 could not be found. Oct 29 03:55:55.723569 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:55:55.723569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Returning 404 to user: Instance 3cc418b2-30c5-43a3-8ede-6cde0734e128 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:55:55.723569 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9776e699-9563-4568-8d7f-7a009ce12d9b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128" status: 404 len: 111 microversion: 2.1 time: 0.037023 Oct 29 03:55:55.723569 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3798/7551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:55 2022] GET /compute/v2.1/servers/3cc418b2-30c5-43a3-8ede-6cde0734e128 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:55:55.729416 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4bb1f0f4-a134-4af7-981e-4da16d4fc348 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '.version_select at 0x7fe1a85c30d0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:55.753104 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4bb1f0f4-a134-4af7-981e-4da16d4fc348 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1935423607" status: 202 len: 0 microversion: 2.1 time: 0.027757 Oct 29 03:55:55.753693 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3754/7552] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Oct 29 03:55:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1935423607 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:55:55.770956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f016785-726c-4107-af19-bf6fc6661ded tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Action: 'create', calling method: .version_select at 0x7fe1a91f2790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1705381597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8ah5OFw1SsvpkxcoBNMNhScx/G4Fn/VM+bUqkZuD6MEuOU6nM0reCkvHzIwe3kspNkqBcHEDeIX0E8WIfbuHz37fUZG88apI8ZzqLhTBuWn2szw2hpQM54MjLirBFRrg=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:55:55.786888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-8f016785-726c-4107-af19-bf6fc6661ded tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:55:55.792223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-8f016785-726c-4107-af19-bf6fc6661ded tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for user 4e76321c46fb4c659cf81f6f5e319df7 and project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:55:55.820619 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f016785-726c-4107-af19-bf6fc6661ded tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.053733 Oct 29 03:55:55.821247 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3799/7553] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:55:55 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:55.874833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1709539294", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1705381597", "networks": [{"uuid": "20a7a2d4-ec32-4247-a01b-8528771c76c2"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:55:55.930585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] validate_networks() for [('20a7a2d4-ec32-4247-a01b-8528771c76c2', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:55:56.318349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:55:56.318778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:55:56.319259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:55:56.319672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:55:56.320093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:55:56.330460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:56.331038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:56.331586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:56.332334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:56.332848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:56.333219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:56.351750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:55:56.357443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for user 4e76321c46fb4c659cf81f6f5e319df7 and project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:55:56.371375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:55:56.373736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:55:56.423618 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-424fdfe4-b71e-4ebb-ae53-60e64a979546 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552863 Oct 29 03:55:56.424429 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3755/7554] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:55:56.436105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-153d0bf9-d3bb-4bfe-b4b8-3dee10c745f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:56.436720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-153d0bf9-d3bb-4bfe-b4b8-3dee10c745f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:56.495491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-153d0bf9-d3bb-4bfe-b4b8-3dee10c745f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:56.503439 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-153d0bf9-d3bb-4bfe-b4b8-3dee10c745f6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1263 microversion: 2.1 time: 0.071370 Oct 29 03:55:56.504782 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3800/7555] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:56 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:57.529573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-431ccd74-edd5-4ecb-8354-29e227f33007 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:57.530204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-431ccd74-edd5-4ecb-8354-29e227f33007 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:57.537575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-431ccd74-edd5-4ecb-8354-29e227f33007 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:57.538107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-431ccd74-edd5-4ecb-8354-29e227f33007 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:57.538575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-431ccd74-edd5-4ecb-8354-29e227f33007 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:57.539271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-431ccd74-edd5-4ecb-8354-29e227f33007 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:57.539732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-431ccd74-edd5-4ecb-8354-29e227f33007 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:57.540180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-431ccd74-edd5-4ecb-8354-29e227f33007 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:57.644976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-431ccd74-edd5-4ecb-8354-29e227f33007 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:57.655327 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-431ccd74-edd5-4ecb-8354-29e227f33007 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1323 microversion: 2.1 time: 0.130966 Oct 29 03:55:57.656161 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3756/7556] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:57 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1323 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:58.680457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-27175c92-1fb8-4278-a1db-3afb253fcd09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:58.681079 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-27175c92-1fb8-4278-a1db-3afb253fcd09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:58.687849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27175c92-1fb8-4278-a1db-3afb253fcd09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:58.688333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27175c92-1fb8-4278-a1db-3afb253fcd09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:58.688764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27175c92-1fb8-4278-a1db-3afb253fcd09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:58.689474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27175c92-1fb8-4278-a1db-3afb253fcd09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:58.689960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27175c92-1fb8-4278-a1db-3afb253fcd09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:58.690419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-27175c92-1fb8-4278-a1db-3afb253fcd09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:58.825053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-27175c92-1fb8-4278-a1db-3afb253fcd09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:55:58.833330 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-27175c92-1fb8-4278-a1db-3afb253fcd09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1363 microversion: 2.1 time: 0.157001 Oct 29 03:55:58.833948 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3801/7557] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:58 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:55:59.076922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-42a3d757-d78e-4094-81d1-d06a2db25340 req-4adb68c4-05f2-4853-bd74-e6c43191f299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380c7384-d46a-4f92-b098-4f55092fa32a", "tag": "d8ee6970-f640-475c-8a40-afb6bc43b8e1"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:55:59.090435 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-42a3d757-d78e-4094-81d1-d06a2db25340 req-4adb68c4-05f2-4853-bd74-e6c43191f299 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:59.090927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-42a3d757-d78e-4094-81d1-d06a2db25340 req-4adb68c4-05f2-4853-bd74-e6c43191f299 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:59.091364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-42a3d757-d78e-4094-81d1-d06a2db25340 req-4adb68c4-05f2-4853-bd74-e6c43191f299 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:59.106098 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-42a3d757-d78e-4094-81d1-d06a2db25340 req-4adb68c4-05f2-4853-bd74-e6c43191f299 service nova] Creating event network-changed:d8ee6970-f640-475c-8a40-afb6bc43b8e1 for instance 380c7384-d46a-4f92-b098-4f55092fa32a on n-h1-862964-4 Oct 29 03:55:59.110855 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-42a3d757-d78e-4094-81d1-d06a2db25340 req-4adb68c4-05f2-4853-bd74-e6c43191f299 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039992 Oct 29 03:55:59.111769 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3757/7558] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:55:59.859053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9f4a1ec5-2407-4248-95af-f80ad07ae721 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:55:59.859738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9f4a1ec5-2407-4248-95af-f80ad07ae721 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:55:59.868077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4a1ec5-2407-4248-95af-f80ad07ae721 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:59.868560 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4a1ec5-2407-4248-95af-f80ad07ae721 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:59.868988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4a1ec5-2407-4248-95af-f80ad07ae721 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:55:59.869682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4a1ec5-2407-4248-95af-f80ad07ae721 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:55:59.870164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4a1ec5-2407-4248-95af-f80ad07ae721 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:55:59.870582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9f4a1ec5-2407-4248-95af-f80ad07ae721 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:00.011060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9f4a1ec5-2407-4248-95af-f80ad07ae721 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:00.019374 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9f4a1ec5-2407-4248-95af-f80ad07ae721 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1363 microversion: 2.1 time: 0.165442 Oct 29 03:56:00.019964 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3802/7559] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:55:59 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:01.044421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8af71bce-47d1-411d-8484-14fa779ec710 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:01.045007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8af71bce-47d1-411d-8484-14fa779ec710 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:01.051921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af71bce-47d1-411d-8484-14fa779ec710 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:01.052446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af71bce-47d1-411d-8484-14fa779ec710 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:01.052884 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af71bce-47d1-411d-8484-14fa779ec710 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:01.053582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af71bce-47d1-411d-8484-14fa779ec710 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:01.054069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af71bce-47d1-411d-8484-14fa779ec710 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:01.054494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8af71bce-47d1-411d-8484-14fa779ec710 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:01.201036 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8af71bce-47d1-411d-8484-14fa779ec710 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:01.209424 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8af71bce-47d1-411d-8484-14fa779ec710 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1363 microversion: 2.1 time: 0.170353 Oct 29 03:56:01.210052 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3758/7560] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:01 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:02.232954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94ebc108-8641-44af-9731-c71439986e09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:02.233586 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-94ebc108-8641-44af-9731-c71439986e09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:02.241414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ebc108-8641-44af-9731-c71439986e09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:02.241922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ebc108-8641-44af-9731-c71439986e09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:02.242345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ebc108-8641-44af-9731-c71439986e09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:02.243033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ebc108-8641-44af-9731-c71439986e09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:02.243473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ebc108-8641-44af-9731-c71439986e09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:02.243880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94ebc108-8641-44af-9731-c71439986e09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:02.379910 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-94ebc108-8641-44af-9731-c71439986e09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:02.388101 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-94ebc108-8641-44af-9731-c71439986e09 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1363 microversion: 2.1 time: 0.159327 Oct 29 03:56:02.388667 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3803/7561] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:02 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:03.415590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eb89e8aa-e9bf-4b66-b664-a71b02503988 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:03.416602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eb89e8aa-e9bf-4b66-b664-a71b02503988 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:03.427665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb89e8aa-e9bf-4b66-b664-a71b02503988 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:03.428157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb89e8aa-e9bf-4b66-b664-a71b02503988 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:03.428598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb89e8aa-e9bf-4b66-b664-a71b02503988 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:03.429312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb89e8aa-e9bf-4b66-b664-a71b02503988 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:03.429769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb89e8aa-e9bf-4b66-b664-a71b02503988 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:03.430228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eb89e8aa-e9bf-4b66-b664-a71b02503988 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:03.572479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eb89e8aa-e9bf-4b66-b664-a71b02503988 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:03.581057 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eb89e8aa-e9bf-4b66-b664-a71b02503988 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1363 microversion: 2.1 time: 0.172234 Oct 29 03:56:03.581649 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3759/7562] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:03 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:03.948768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-318a13bc-746d-4a1c-8b87-78e5e6ad3a4b req-616fe707-aec9-4ffc-88bf-afb887ad6eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380c7384-d46a-4f92-b098-4f55092fa32a", "name": "network-vif-plugged", "status": "completed", "tag": "d8ee6970-f640-475c-8a40-afb6bc43b8e1"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:56:03.959938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-318a13bc-746d-4a1c-8b87-78e5e6ad3a4b req-616fe707-aec9-4ffc-88bf-afb887ad6eb0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:03.960445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-318a13bc-746d-4a1c-8b87-78e5e6ad3a4b req-616fe707-aec9-4ffc-88bf-afb887ad6eb0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:03.960869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-318a13bc-746d-4a1c-8b87-78e5e6ad3a4b req-616fe707-aec9-4ffc-88bf-afb887ad6eb0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:03.972205 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-318a13bc-746d-4a1c-8b87-78e5e6ad3a4b req-616fe707-aec9-4ffc-88bf-afb887ad6eb0 service nova] Creating event network-vif-plugged:d8ee6970-f640-475c-8a40-afb6bc43b8e1 for instance 380c7384-d46a-4f92-b098-4f55092fa32a on n-h1-862964-4 Oct 29 03:56:03.977385 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-318a13bc-746d-4a1c-8b87-78e5e6ad3a4b req-616fe707-aec9-4ffc-88bf-afb887ad6eb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088669 Oct 29 03:56:03.978047 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3804/7563] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:04.603727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3707178b-90be-4ca1-a484-0220bd4955c2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:04.604355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3707178b-90be-4ca1-a484-0220bd4955c2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:04.611753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3707178b-90be-4ca1-a484-0220bd4955c2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:04.612246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3707178b-90be-4ca1-a484-0220bd4955c2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:04.613026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3707178b-90be-4ca1-a484-0220bd4955c2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:04.613704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3707178b-90be-4ca1-a484-0220bd4955c2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:04.614218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3707178b-90be-4ca1-a484-0220bd4955c2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:04.614650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3707178b-90be-4ca1-a484-0220bd4955c2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:04.747759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3707178b-90be-4ca1-a484-0220bd4955c2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:04.755641 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3707178b-90be-4ca1-a484-0220bd4955c2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1363 microversion: 2.1 time: 0.155902 Oct 29 03:56:04.756223 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3760/7564] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:04 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:05.783803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5c42bee2-c869-47c6-a424-73a18da6be8f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:05.784948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5c42bee2-c869-47c6-a424-73a18da6be8f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:05.796861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c42bee2-c869-47c6-a424-73a18da6be8f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:05.797656 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c42bee2-c869-47c6-a424-73a18da6be8f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:05.798429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c42bee2-c869-47c6-a424-73a18da6be8f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:05.799562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c42bee2-c869-47c6-a424-73a18da6be8f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:05.800319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c42bee2-c869-47c6-a424-73a18da6be8f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:05.801004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5c42bee2-c869-47c6-a424-73a18da6be8f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:05.939929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5c42bee2-c869-47c6-a424-73a18da6be8f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:05.948610 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5c42bee2-c869-47c6-a424-73a18da6be8f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1555 microversion: 2.1 time: 0.172076 Oct 29 03:56:05.949214 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3805/7565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:05 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:05.974447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f7496169-aa34-4838-8000-2ba2b35c7e92 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:05.975055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f7496169-aa34-4838-8000-2ba2b35c7e92 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:05.981971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7496169-aa34-4838-8000-2ba2b35c7e92 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:05.982472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7496169-aa34-4838-8000-2ba2b35c7e92 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:05.982925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7496169-aa34-4838-8000-2ba2b35c7e92 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:05.983666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7496169-aa34-4838-8000-2ba2b35c7e92 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:05.984133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7496169-aa34-4838-8000-2ba2b35c7e92 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:05.984565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7496169-aa34-4838-8000-2ba2b35c7e92 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:06.127154 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f7496169-aa34-4838-8000-2ba2b35c7e92 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:06.135652 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f7496169-aa34-4838-8000-2ba2b35c7e92 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1555 microversion: 2.1 time: 0.167953 Oct 29 03:56:06.136260 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3761/7566] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:05 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:07.665909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb9a72a9-3ea8-4369-bf22-3df33923f8aa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "457cf39b-3a50-4273-a492-b41945a0f0a6"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:56:07.668318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bb9a72a9-3ea8-4369-bf22-3df33923f8aa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:07.670326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:07.676746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb9a72a9-3ea8-4369-bf22-3df33923f8aa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:07.677453 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb9a72a9-3ea8-4369-bf22-3df33923f8aa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:07.677919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb9a72a9-3ea8-4369-bf22-3df33923f8aa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:07.678618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb9a72a9-3ea8-4369-bf22-3df33923f8aa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:07.679061 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb9a72a9-3ea8-4369-bf22-3df33923f8aa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:07.679477 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb9a72a9-3ea8-4369-bf22-3df33923f8aa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:07.954270 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb9a72a9-3ea8-4369-bf22-3df33923f8aa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "POST /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292291 Oct 29 03:56:07.954941 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3806/7567] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:56:07 2022] POST /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:18.764182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a7c41ee9-027d-4b59-a4d7-42faa6ec2c17 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:18.764741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a7c41ee9-027d-4b59-a4d7-42faa6ec2c17 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:18.766944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:18.767668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:18.769511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:18.770303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:18.778297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7c41ee9-027d-4b59-a4d7-42faa6ec2c17 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:18.778950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7c41ee9-027d-4b59-a4d7-42faa6ec2c17 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:18.779402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7c41ee9-027d-4b59-a4d7-42faa6ec2c17 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:18.780116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7c41ee9-027d-4b59-a4d7-42faa6ec2c17 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:18.780575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7c41ee9-027d-4b59-a4d7-42faa6ec2c17 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:18.781007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a7c41ee9-027d-4b59-a4d7-42faa6ec2c17 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:18.866446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-a7c41ee9-027d-4b59-a4d7-42faa6ec2c17 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lazy-loading 'services' on Instance uuid 380c7384-d46a-4f92-b098-4f55092fa32a {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:56:18.959940 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a7c41ee9-027d-4b59-a4d7-42faa6ec2c17 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments/457cf39b-3a50-4273-a492-b41945a0f0a6" status: 202 len: 0 microversion: 2.1 time: 0.199656 Oct 29 03:56:18.960539 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3762/7568] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:56:18 2022] DELETE /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments/457cf39b-3a50-4273-a492-b41945a0f0a6 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:56:18.969748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-151d01af-da85-4156-a526-4a42ae5ecbfa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:18.972442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-151d01af-da85-4156-a526-4a42ae5ecbfa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:18.975606 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:18.976337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:18.982956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-151d01af-da85-4156-a526-4a42ae5ecbfa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:18.983444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-151d01af-da85-4156-a526-4a42ae5ecbfa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:18.983878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-151d01af-da85-4156-a526-4a42ae5ecbfa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:18.984581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-151d01af-da85-4156-a526-4a42ae5ecbfa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:18.985032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-151d01af-da85-4156-a526-4a42ae5ecbfa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:18.985455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-151d01af-da85-4156-a526-4a42ae5ecbfa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:19.018831 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-151d01af-da85-4156-a526-4a42ae5ecbfa tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053452 Oct 29 03:56:19.019406 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3807/7569] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:56:18 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:20.032616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e566090b-31bf-4601-a32f-d2aa4c4bb2d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:20.035224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e566090b-31bf-4601-a32f-d2aa4c4bb2d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:20.042945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e566090b-31bf-4601-a32f-d2aa4c4bb2d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:20.043448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e566090b-31bf-4601-a32f-d2aa4c4bb2d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:20.043895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e566090b-31bf-4601-a32f-d2aa4c4bb2d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:20.044764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e566090b-31bf-4601-a32f-d2aa4c4bb2d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:20.045225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e566090b-31bf-4601-a32f-d2aa4c4bb2d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:20.045655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e566090b-31bf-4601-a32f-d2aa4c4bb2d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:20.080099 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e566090b-31bf-4601-a32f-d2aa4c4bb2d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051847 Oct 29 03:56:20.080664 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3763/7570] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:56:20 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:21.093264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b0052e85-a52b-4101-aafb-72082d7d37c9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:21.095591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b0052e85-a52b-4101-aafb-72082d7d37c9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:21.103383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0052e85-a52b-4101-aafb-72082d7d37c9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:21.103882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0052e85-a52b-4101-aafb-72082d7d37c9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:21.104308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0052e85-a52b-4101-aafb-72082d7d37c9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:21.105015 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0052e85-a52b-4101-aafb-72082d7d37c9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:21.105457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0052e85-a52b-4101-aafb-72082d7d37c9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:21.105905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b0052e85-a52b-4101-aafb-72082d7d37c9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:21.139442 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b0052e85-a52b-4101-aafb-72082d7d37c9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050233 Oct 29 03:56:21.139985 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3808/7571] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:56:21 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:22.152715 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ffca7aa6-813b-410f-a739-083eddd24fb7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:22.154900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ffca7aa6-813b-410f-a739-083eddd24fb7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:22.162241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffca7aa6-813b-410f-a739-083eddd24fb7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:22.162742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffca7aa6-813b-410f-a739-083eddd24fb7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:22.163174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffca7aa6-813b-410f-a739-083eddd24fb7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:22.163875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffca7aa6-813b-410f-a739-083eddd24fb7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:22.164329 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffca7aa6-813b-410f-a739-083eddd24fb7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:22.164739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ffca7aa6-813b-410f-a739-083eddd24fb7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:22.197260 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ffca7aa6-813b-410f-a739-083eddd24fb7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048754 Oct 29 03:56:22.197854 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3764/7572] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:56:22 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:23.210521 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d547dca4-4318-40e2-8f3d-2ec29d2d118a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:23.212805 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d547dca4-4318-40e2-8f3d-2ec29d2d118a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:23.219968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d547dca4-4318-40e2-8f3d-2ec29d2d118a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:23.220456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d547dca4-4318-40e2-8f3d-2ec29d2d118a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:23.220880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d547dca4-4318-40e2-8f3d-2ec29d2d118a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:23.221572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d547dca4-4318-40e2-8f3d-2ec29d2d118a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:23.222059 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d547dca4-4318-40e2-8f3d-2ec29d2d118a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:23.222449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d547dca4-4318-40e2-8f3d-2ec29d2d118a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:23.252877 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d547dca4-4318-40e2-8f3d-2ec29d2d118a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046434 Oct 29 03:56:23.253461 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3809/7573] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:56:23 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:24.270376 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9928c0a4-73a4-4f63-8f01-7c965e641022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:24.273888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9928c0a4-73a4-4f63-8f01-7c965e641022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:24.285446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9928c0a4-73a4-4f63-8f01-7c965e641022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:24.286345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9928c0a4-73a4-4f63-8f01-7c965e641022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:24.287117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9928c0a4-73a4-4f63-8f01-7c965e641022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:24.288423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9928c0a4-73a4-4f63-8f01-7c965e641022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:24.289190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9928c0a4-73a4-4f63-8f01-7c965e641022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:24.289995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9928c0a4-73a4-4f63-8f01-7c965e641022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:24.319978 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9928c0a4-73a4-4f63-8f01-7c965e641022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056606 Oct 29 03:56:24.320540 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3765/7574] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:56:24 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:56:24.331798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:24.332326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:24.339698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:24.340179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:24.340613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:24.341296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:24.341743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:24.342189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:24.418623 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] HTTP exception thrown: Instance 380c7384-d46a-4f92-b098-4f55092fa32a is not attached to volume 457cf39b-3a50-4273-a492-b41945a0f0a6 Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Request method failure captured: Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments/457cf39b-3a50-4273-a492-b41945a0f0a6 HTTP/1.1 Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKQiiq2k9QlbMdP6gIfuYuzoGPu6eAFPjMQUOzVVOzgLmaWYLfjimldTjztfxx0XUw1NYT0WDXfZIBmFeLsDXDNTnP3UFCIx2S-e6-tGqXG8syUywjMb7QXLSgoU7N72Y8k0mjevjO9UfrDsbuRfvU3HaAAeqVu58lkK9_Q2LxlO0Wk Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09aa2ca9146d4a69ac99e624f73339dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}] Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 4e76321c46fb4c659cf81f6f5e319df7 Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 380c7384-d46a-4f92-b098-4f55092fa32a is not attached to volume 457cf39b-3a50-4273-a492-b41945a0f0a6 Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': '380c7384-d46a-4f92-b098-4f55092fa32a', 'id': '457cf39b-3a50-4273-a492-b41945a0f0a6'} Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 457cf39b-3a50-4273-a492-b41945a0f0a6. Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380c7384-d46a-4f92-b098-4f55092fa32a is not attached to volume 457cf39b-3a50-4273-a492-b41945a0f0a6 Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:56:24.420257 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:56:24.425325 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:56:24.425325 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:56:24.425325 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380c7384-d46a-4f92-b098-4f55092fa32a is not attached to volume 457cf39b-3a50-4273-a492-b41945a0f0a6 Oct 29 03:56:24.425325 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:56:24.425325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Returning 404 to user: Instance 380c7384-d46a-4f92-b098-4f55092fa32a is not attached to volume 457cf39b-3a50-4273-a492-b41945a0f0a6 {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:56:24.425325 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1a19c08f-a17c-461b-adf4-ab5a49ce554f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments/457cf39b-3a50-4273-a492-b41945a0f0a6" status: 404 len: 154 microversion: 2.1 time: 0.093973 Oct 29 03:56:24.425325 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3810/7575] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:56:24 2022] DELETE /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a/os-volume_attachments/457cf39b-3a50-4273-a492-b41945a0f0a6 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:56:27.805125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-da04f4d6-ab6e-43ad-8755-08ef9c2a05a0 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:27.805696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-da04f4d6-ab6e-43ad-8755-08ef9c2a05a0 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:27.813201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da04f4d6-ab6e-43ad-8755-08ef9c2a05a0 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:27.813584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da04f4d6-ab6e-43ad-8755-08ef9c2a05a0 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:27.814058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da04f4d6-ab6e-43ad-8755-08ef9c2a05a0 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:27.814769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da04f4d6-ab6e-43ad-8755-08ef9c2a05a0 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:27.815234 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da04f4d6-ab6e-43ad-8755-08ef9c2a05a0 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:27.815631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da04f4d6-ab6e-43ad-8755-08ef9c2a05a0 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:27.844246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-da04f4d6-ab6e-43ad-8755-08ef9c2a05a0 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:56:27.928248 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-da04f4d6-ab6e-43ad-8755-08ef9c2a05a0 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 204 len: 0 microversion: 2.1 time: 0.126864 Oct 29 03:56:27.928907 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3766/7576] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:56:27 2022] DELETE /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:56:27.937847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7cf3cf61-e396-4663-ac72-2483084f6fa7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:27.938442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7cf3cf61-e396-4663-ac72-2483084f6fa7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:27.944872 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3cf61-e396-4663-ac72-2483084f6fa7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:27.945567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3cf61-e396-4663-ac72-2483084f6fa7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:27.946021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3cf61-e396-4663-ac72-2483084f6fa7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:27.946809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3cf61-e396-4663-ac72-2483084f6fa7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:27.947260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3cf61-e396-4663-ac72-2483084f6fa7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:27.947668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7cf3cf61-e396-4663-ac72-2483084f6fa7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:28.081123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7cf3cf61-e396-4663-ac72-2483084f6fa7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:28.089340 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7cf3cf61-e396-4663-ac72-2483084f6fa7 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1561 microversion: 2.1 time: 0.155612 Oct 29 03:56:28.089903 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3811/7577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:27 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:29.114231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ecfeb75-3106-4a40-970f-9dbe5343d022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:29.114976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3ecfeb75-3106-4a40-970f-9dbe5343d022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:29.122493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ecfeb75-3106-4a40-970f-9dbe5343d022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:29.122960 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ecfeb75-3106-4a40-970f-9dbe5343d022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:29.123415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ecfeb75-3106-4a40-970f-9dbe5343d022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:29.124117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ecfeb75-3106-4a40-970f-9dbe5343d022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:29.124576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ecfeb75-3106-4a40-970f-9dbe5343d022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:29.125007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ecfeb75-3106-4a40-970f-9dbe5343d022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:29.260708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3ecfeb75-3106-4a40-970f-9dbe5343d022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:29.272926 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3ecfeb75-3106-4a40-970f-9dbe5343d022 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1561 microversion: 2.1 time: 0.163353 Oct 29 03:56:29.273661 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3767/7578] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:29 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:30.064825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-c54f97f8-6afc-4134-bafb-1856019a6197 req-f2b7f35d-6c13-48cc-8d8f-328f372197fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380c7384-d46a-4f92-b098-4f55092fa32a", "name": "network-vif-deleted", "tag": "d8ee6970-f640-475c-8a40-afb6bc43b8e1"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:56:30.075797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c54f97f8-6afc-4134-bafb-1856019a6197 req-f2b7f35d-6c13-48cc-8d8f-328f372197fc service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:30.076200 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c54f97f8-6afc-4134-bafb-1856019a6197 req-f2b7f35d-6c13-48cc-8d8f-328f372197fc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:30.076620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c54f97f8-6afc-4134-bafb-1856019a6197 req-f2b7f35d-6c13-48cc-8d8f-328f372197fc service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:30.088595 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c54f97f8-6afc-4134-bafb-1856019a6197 req-f2b7f35d-6c13-48cc-8d8f-328f372197fc service nova] Creating event network-vif-deleted:d8ee6970-f640-475c-8a40-afb6bc43b8e1 for instance 380c7384-d46a-4f92-b098-4f55092fa32a on n-h1-862964-4 Oct 29 03:56:30.094095 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-c54f97f8-6afc-4134-bafb-1856019a6197 req-f2b7f35d-6c13-48cc-8d8f-328f372197fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033011 Oct 29 03:56:30.094704 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3812/7579] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:30.297541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:30.298158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:30.305076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:30.305579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:30.306051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:30.306771 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:30.307229 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:30.307664 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:30.340829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:30.341627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:30.342100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:30.342568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lazy-loading 'fault' on Instance uuid 380c7384-d46a-4f92-b098-4f55092fa32a {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:56:30.392293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:30.400368 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7743e312-1a06-484f-9df0-abfff44cd0d6 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 200 len: 1353 microversion: 2.1 time: 0.107368 Oct 29 03:56:30.401222 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3768/7580] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:30 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 1353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:31.430967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:31.432070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: 380c7384-d46a-4f92-b098-4f55092fa32a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:31.439601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:31.440083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:31.440505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:31.441197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:31.441640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:31.442082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:31.455921 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] HTTP exception thrown: Instance 380c7384-d46a-4f92-b098-4f55092fa32a could not be found. Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Request method failure captured: Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a HTTP/1.1 Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKQiiq2k9QlbMdP6gIfuYuzoGPu6eAFPjMQUOzVVOzgLmaWYLfjimldTjztfxx0XUw1NYT0WDXfZIBmFeLsDXDNTnP3UFCIx2S-e6-tGqXG8syUywjMb7QXLSgoU7N72Y8k0mjevjO9UfrDsbuRfvU3HaAAeqVu58lkK9_Q2LxlO0Wk Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09aa2ca9146d4a69ac99e624f73339dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}] Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 4e76321c46fb4c659cf81f6f5e319df7 Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 380c7384-d46a-4f92-b098-4f55092fa32a could not be found. Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '380c7384-d46a-4f92-b098-4f55092fa32a'} Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380c7384-d46a-4f92-b098-4f55092fa32a could not be found. Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380c7384-d46a-4f92-b098-4f55092fa32a could not be found. Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:56:31.457692 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:56:31.462668 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:56:31.462668 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:56:31.462668 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:56:31.462668 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:56:31.462668 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:56:31.462668 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380c7384-d46a-4f92-b098-4f55092fa32a could not be found. Oct 29 03:56:31.462668 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:56:31.462668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Returning 404 to user: Instance 380c7384-d46a-4f92-b098-4f55092fa32a could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:56:31.462668 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-295a0dbd-e6d7-4715-b09b-c8b93032fde1 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a" status: 404 len: 111 microversion: 2.1 time: 0.036900 Oct 29 03:56:31.462668 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3813/7581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:31 2022] GET /compute/v2.1/servers/380c7384-d46a-4f92-b098-4f55092fa32a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:56:31.468294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e7b6f326-8a97-4f3f-a94d-db0e30397f6b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '.version_select at 0x7fe1a85c3d30>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:31.491881 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e7b6f326-8a97-4f3f-a94d-db0e30397f6b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1705381597" status: 202 len: 0 microversion: 2.1 time: 0.027615 Oct 29 03:56:31.492456 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3769/7582] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Oct 29 03:56:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1705381597 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:56:31.509596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2623b467-e640-4a3a-bb7f-5ec1027121ec tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Action: 'create', calling method: .version_select at 0x7fe1a301e670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-730255450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDng8YsXsnHwKtsLlk9y42hydLr8z+E8QX1upQj3dQU/z+keTG4Wh0VkLAN7/LaQ9LJHuVptoK6+2nAN/QnZaS1CdUllBEfOnC5cMrvKJIEbab/jEF61xTy3BJdZHLiomQ=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:56:31.526100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-2623b467-e640-4a3a-bb7f-5ec1027121ec tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:56:31.534881 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-2623b467-e640-4a3a-bb7f-5ec1027121ec tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for user 4e76321c46fb4c659cf81f6f5e319df7 and project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:56:31.562132 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2623b467-e640-4a3a-bb7f-5ec1027121ec tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.056349 Oct 29 03:56:31.562749 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3814/7583] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:56:31 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:31.614530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-418450247", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-730255450", "networks": [{"uuid": "20a7a2d4-ec32-4247-a01b-8528771c76c2"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:56:31.673726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] validate_networks() for [('20a7a2d4-ec32-4247-a01b-8528771c76c2', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:56:32.361067 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:56:32.361708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:56:32.362824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:56:32.363409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:56:32.364009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:56:32.377764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:32.378460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:32.379104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:32.380193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:32.380874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:32.381447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:32.405118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:56:32.410939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Getting quotas for user 4e76321c46fb4c659cf81f6f5e319df7 and project 09aa2ca9146d4a69ac99e624f73339dd. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:56:32.425109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:56:32.427561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:56:32.475852 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d0e61f1b-298e-4c70-a112-3590debfcc8a tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865580 Oct 29 03:56:32.476840 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3770/7584] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:56:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:56:32.488292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5243db82-7bd4-4da4-9dce-daf52dd7083f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:32.488875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5243db82-7bd4-4da4-9dce-daf52dd7083f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:32.551178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5243db82-7bd4-4da4-9dce-daf52dd7083f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:32.561138 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5243db82-7bd4-4da4-9dce-daf52dd7083f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1261 microversion: 2.1 time: 0.076897 Oct 29 03:56:32.561565 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3815/7585] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:32 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:33.584941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-de2e8f06-d4d0-4e2b-9203-af69b97f2754 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:33.586385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-de2e8f06-d4d0-4e2b-9203-af69b97f2754 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:33.594651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de2e8f06-d4d0-4e2b-9203-af69b97f2754 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:33.595165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de2e8f06-d4d0-4e2b-9203-af69b97f2754 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:33.595636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de2e8f06-d4d0-4e2b-9203-af69b97f2754 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:33.596342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de2e8f06-d4d0-4e2b-9203-af69b97f2754 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:33.596823 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de2e8f06-d4d0-4e2b-9203-af69b97f2754 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:33.597250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de2e8f06-d4d0-4e2b-9203-af69b97f2754 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:33.711982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de2e8f06-d4d0-4e2b-9203-af69b97f2754 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:33.720746 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-de2e8f06-d4d0-4e2b-9203-af69b97f2754 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1321 microversion: 2.1 time: 0.140366 Oct 29 03:56:33.721848 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3771/7586] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:33 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1321 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:34.744825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-05c67a01-d8ac-49a3-a5d3-6f84c4bef2ba tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:34.745544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-05c67a01-d8ac-49a3-a5d3-6f84c4bef2ba tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:34.753322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05c67a01-d8ac-49a3-a5d3-6f84c4bef2ba tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:34.753829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05c67a01-d8ac-49a3-a5d3-6f84c4bef2ba tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:34.754262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05c67a01-d8ac-49a3-a5d3-6f84c4bef2ba tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:34.754947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05c67a01-d8ac-49a3-a5d3-6f84c4bef2ba tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:34.755388 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05c67a01-d8ac-49a3-a5d3-6f84c4bef2ba tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:34.755789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05c67a01-d8ac-49a3-a5d3-6f84c4bef2ba tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:34.890553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-05c67a01-d8ac-49a3-a5d3-6f84c4bef2ba tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:34.899062 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-05c67a01-d8ac-49a3-a5d3-6f84c4bef2ba tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1361 microversion: 2.1 time: 0.158194 Oct 29 03:56:34.899903 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3816/7587] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:34 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:35.111427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-48056df5-9183-42e8-b01e-28f3b6a6263a req-bb63c7fe-18ac-454f-9a43-9821e8850be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b08cd7-6087-41a8-b4f7-7904e0200672", "tag": "e3a453d6-80d7-4478-a8ab-55f90a784bab"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:56:35.123355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-48056df5-9183-42e8-b01e-28f3b6a6263a req-bb63c7fe-18ac-454f-9a43-9821e8850be6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:35.123841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-48056df5-9183-42e8-b01e-28f3b6a6263a req-bb63c7fe-18ac-454f-9a43-9821e8850be6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:35.124271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-48056df5-9183-42e8-b01e-28f3b6a6263a req-bb63c7fe-18ac-454f-9a43-9821e8850be6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:35.136180 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-48056df5-9183-42e8-b01e-28f3b6a6263a req-bb63c7fe-18ac-454f-9a43-9821e8850be6 service nova] Creating event network-changed:e3a453d6-80d7-4478-a8ab-55f90a784bab for instance c9b08cd7-6087-41a8-b4f7-7904e0200672 on n-h1-862964-4 Oct 29 03:56:35.141493 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-48056df5-9183-42e8-b01e-28f3b6a6263a req-bb63c7fe-18ac-454f-9a43-9821e8850be6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034250 Oct 29 03:56:35.142335 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3772/7588] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:35.927924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a5dd531-58d8-44ae-a162-bd0383e9c317 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:35.928770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3a5dd531-58d8-44ae-a162-bd0383e9c317 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:35.939978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a5dd531-58d8-44ae-a162-bd0383e9c317 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:35.940461 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a5dd531-58d8-44ae-a162-bd0383e9c317 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:35.941020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a5dd531-58d8-44ae-a162-bd0383e9c317 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:35.941762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a5dd531-58d8-44ae-a162-bd0383e9c317 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:35.942234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a5dd531-58d8-44ae-a162-bd0383e9c317 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:35.942651 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a5dd531-58d8-44ae-a162-bd0383e9c317 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:36.079570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3a5dd531-58d8-44ae-a162-bd0383e9c317 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:36.087610 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3a5dd531-58d8-44ae-a162-bd0383e9c317 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1361 microversion: 2.1 time: 0.167135 Oct 29 03:56:36.088200 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3817/7589] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:35 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:37.116344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94c8893b-f04b-4696-8dcf-2d31d7957716 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:37.116989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-94c8893b-f04b-4696-8dcf-2d31d7957716 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:37.124276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c8893b-f04b-4696-8dcf-2d31d7957716 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:37.124770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c8893b-f04b-4696-8dcf-2d31d7957716 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:37.125213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c8893b-f04b-4696-8dcf-2d31d7957716 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:37.126076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c8893b-f04b-4696-8dcf-2d31d7957716 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:37.126428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c8893b-f04b-4696-8dcf-2d31d7957716 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:37.126835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94c8893b-f04b-4696-8dcf-2d31d7957716 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:37.345926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-94c8893b-f04b-4696-8dcf-2d31d7957716 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:37.354620 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94c8893b-f04b-4696-8dcf-2d31d7957716 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1361 microversion: 2.1 time: 0.245618 Oct 29 03:56:37.355633 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3773/7590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:37 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:38.382562 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d26c875d-01ce-4182-8c3a-9c030a2aa183 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:38.383233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d26c875d-01ce-4182-8c3a-9c030a2aa183 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:38.391216 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d26c875d-01ce-4182-8c3a-9c030a2aa183 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:38.391748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d26c875d-01ce-4182-8c3a-9c030a2aa183 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:38.392354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d26c875d-01ce-4182-8c3a-9c030a2aa183 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:38.393147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d26c875d-01ce-4182-8c3a-9c030a2aa183 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:38.393673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d26c875d-01ce-4182-8c3a-9c030a2aa183 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:38.394176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d26c875d-01ce-4182-8c3a-9c030a2aa183 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:38.528959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d26c875d-01ce-4182-8c3a-9c030a2aa183 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:38.537075 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d26c875d-01ce-4182-8c3a-9c030a2aa183 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1361 microversion: 2.1 time: 0.159561 Oct 29 03:56:38.537647 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3818/7591] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:38 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:39.561157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-43833755-eff5-45af-9447-ebcc370319e5 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:39.561861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-43833755-eff5-45af-9447-ebcc370319e5 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:39.572433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43833755-eff5-45af-9447-ebcc370319e5 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:39.573105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43833755-eff5-45af-9447-ebcc370319e5 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:39.573565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43833755-eff5-45af-9447-ebcc370319e5 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:39.574396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43833755-eff5-45af-9447-ebcc370319e5 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:39.574944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43833755-eff5-45af-9447-ebcc370319e5 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:39.575420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43833755-eff5-45af-9447-ebcc370319e5 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:39.715350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-43833755-eff5-45af-9447-ebcc370319e5 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:39.724081 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-43833755-eff5-45af-9447-ebcc370319e5 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1361 microversion: 2.1 time: 0.167372 Oct 29 03:56:39.724625 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3774/7592] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:39 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:40.259914 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9dab5239-f962-4484-9efb-5fae6f6f4759 req-41c46406-d9da-4eee-ac38-df5af45dc3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b08cd7-6087-41a8-b4f7-7904e0200672", "name": "network-vif-plugged", "status": "completed", "tag": "e3a453d6-80d7-4478-a8ab-55f90a784bab"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:56:40.272404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9dab5239-f962-4484-9efb-5fae6f6f4759 req-41c46406-d9da-4eee-ac38-df5af45dc3d5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:40.272943 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9dab5239-f962-4484-9efb-5fae6f6f4759 req-41c46406-d9da-4eee-ac38-df5af45dc3d5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:40.273375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9dab5239-f962-4484-9efb-5fae6f6f4759 req-41c46406-d9da-4eee-ac38-df5af45dc3d5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:40.284726 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9dab5239-f962-4484-9efb-5fae6f6f4759 req-41c46406-d9da-4eee-ac38-df5af45dc3d5 service nova] Creating event network-vif-plugged:e3a453d6-80d7-4478-a8ab-55f90a784bab for instance c9b08cd7-6087-41a8-b4f7-7904e0200672 on n-h1-862964-4 Oct 29 03:56:40.289729 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9dab5239-f962-4484-9efb-5fae6f6f4759 req-41c46406-d9da-4eee-ac38-df5af45dc3d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033887 Oct 29 03:56:40.290378 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3819/7593] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:40.754611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8572546a-c396-42a0-90ac-c1270d839b68 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:40.755148 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8572546a-c396-42a0-90ac-c1270d839b68 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:40.762486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8572546a-c396-42a0-90ac-c1270d839b68 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:40.762984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8572546a-c396-42a0-90ac-c1270d839b68 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:40.763428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8572546a-c396-42a0-90ac-c1270d839b68 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:40.764139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8572546a-c396-42a0-90ac-c1270d839b68 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:40.764602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8572546a-c396-42a0-90ac-c1270d839b68 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:40.765035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8572546a-c396-42a0-90ac-c1270d839b68 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:40.896623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8572546a-c396-42a0-90ac-c1270d839b68 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:40.904805 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8572546a-c396-42a0-90ac-c1270d839b68 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1361 microversion: 2.1 time: 0.159400 Oct 29 03:56:40.905356 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3775/7594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:40 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:41.930154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cbc18ae8-6aba-4f33-b518-c79e8ef2d81f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:41.930710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cbc18ae8-6aba-4f33-b518-c79e8ef2d81f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:41.937736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbc18ae8-6aba-4f33-b518-c79e8ef2d81f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:41.938257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbc18ae8-6aba-4f33-b518-c79e8ef2d81f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:41.938692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbc18ae8-6aba-4f33-b518-c79e8ef2d81f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:41.939376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbc18ae8-6aba-4f33-b518-c79e8ef2d81f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:41.939825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbc18ae8-6aba-4f33-b518-c79e8ef2d81f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:41.940246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cbc18ae8-6aba-4f33-b518-c79e8ef2d81f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:42.074834 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cbc18ae8-6aba-4f33-b518-c79e8ef2d81f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:42.083642 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cbc18ae8-6aba-4f33-b518-c79e8ef2d81f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1552 microversion: 2.1 time: 0.159105 Oct 29 03:56:42.084278 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3820/7595] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:41 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:42.106851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dc4596b6-3120-4e1b-a059-995b63bc9fc2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:42.107542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dc4596b6-3120-4e1b-a059-995b63bc9fc2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:42.115802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc4596b6-3120-4e1b-a059-995b63bc9fc2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:42.116305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc4596b6-3120-4e1b-a059-995b63bc9fc2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:42.116942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc4596b6-3120-4e1b-a059-995b63bc9fc2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:42.117673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc4596b6-3120-4e1b-a059-995b63bc9fc2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:42.118201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc4596b6-3120-4e1b-a059-995b63bc9fc2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:42.118632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dc4596b6-3120-4e1b-a059-995b63bc9fc2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:42.266091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dc4596b6-3120-4e1b-a059-995b63bc9fc2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:42.274899 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dc4596b6-3120-4e1b-a059-995b63bc9fc2 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1552 microversion: 2.1 time: 0.172050 Oct 29 03:56:42.275529 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3776/7596] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:42 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:43.815288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7bc3b6cb-b95b-4f0d-abb4-6f81c21f7a94 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21223767-a008-4e30-a794-f990b8e3fcec"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:56:43.817715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7bc3b6cb-b95b-4f0d-abb4-6f81c21f7a94 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:43.819739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:43.826401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc3b6cb-b95b-4f0d-abb4-6f81c21f7a94 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:43.826879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc3b6cb-b95b-4f0d-abb4-6f81c21f7a94 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:43.827308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc3b6cb-b95b-4f0d-abb4-6f81c21f7a94 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:43.828000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc3b6cb-b95b-4f0d-abb4-6f81c21f7a94 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:43.828443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc3b6cb-b95b-4f0d-abb4-6f81c21f7a94 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:43.828859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7bc3b6cb-b95b-4f0d-abb4-6f81c21f7a94 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:44.117478 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7bc3b6cb-b95b-4f0d-abb4-6f81c21f7a94 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "POST /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306027 Oct 29 03:56:44.118189 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3821/7597] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:56:43 2022] POST /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:54.892027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6813341c-4688-42ee-b48e-b2f0322bc855 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:54.892590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6813341c-4688-42ee-b48e-b2f0322bc855 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:54.894720 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:54.895423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:54.896607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:54.897283 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:54.903632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6813341c-4688-42ee-b48e-b2f0322bc855 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:54.904119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6813341c-4688-42ee-b48e-b2f0322bc855 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:54.904563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6813341c-4688-42ee-b48e-b2f0322bc855 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:54.905276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6813341c-4688-42ee-b48e-b2f0322bc855 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:54.905728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6813341c-4688-42ee-b48e-b2f0322bc855 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:54.906183 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6813341c-4688-42ee-b48e-b2f0322bc855 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:54.994453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-6813341c-4688-42ee-b48e-b2f0322bc855 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lazy-loading 'services' on Instance uuid c9b08cd7-6087-41a8-b4f7-7904e0200672 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:56:55.071828 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6813341c-4688-42ee-b48e-b2f0322bc855 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments/21223767-a008-4e30-a794-f990b8e3fcec" status: 202 len: 0 microversion: 2.1 time: 0.183540 Oct 29 03:56:55.072599 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3777/7598] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:56:54 2022] DELETE /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments/21223767-a008-4e30-a794-f990b8e3fcec => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:56:55.079319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:55.080154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:55.084543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-010337bd-0f0a-4f40-bb7d-d511825c3692 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:55.087230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-010337bd-0f0a-4f40-bb7d-d511825c3692 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:55.094779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-010337bd-0f0a-4f40-bb7d-d511825c3692 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:55.095300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-010337bd-0f0a-4f40-bb7d-d511825c3692 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:55.095746 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-010337bd-0f0a-4f40-bb7d-d511825c3692 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:55.096527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-010337bd-0f0a-4f40-bb7d-d511825c3692 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:55.096977 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-010337bd-0f0a-4f40-bb7d-d511825c3692 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:55.097386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-010337bd-0f0a-4f40-bb7d-d511825c3692 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:55.130520 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-010337bd-0f0a-4f40-bb7d-d511825c3692 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053143 Oct 29 03:56:55.131432 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3822/7599] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:56:55 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:56.145436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7540918e-83bf-4ea6-8ae5-2b2084f9bcd4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:56.147837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7540918e-83bf-4ea6-8ae5-2b2084f9bcd4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:56.154901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7540918e-83bf-4ea6-8ae5-2b2084f9bcd4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:56.155396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7540918e-83bf-4ea6-8ae5-2b2084f9bcd4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:56.155840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7540918e-83bf-4ea6-8ae5-2b2084f9bcd4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:56.156548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7540918e-83bf-4ea6-8ae5-2b2084f9bcd4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:56.157007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7540918e-83bf-4ea6-8ae5-2b2084f9bcd4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:56.157438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7540918e-83bf-4ea6-8ae5-2b2084f9bcd4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:56.189407 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7540918e-83bf-4ea6-8ae5-2b2084f9bcd4 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049285 Oct 29 03:56:56.189982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3778/7600] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:56:56 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:57.206379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ae77502-de8d-4ec9-a74b-ce251359074b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:57.209577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8ae77502-de8d-4ec9-a74b-ce251359074b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:57.218304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae77502-de8d-4ec9-a74b-ce251359074b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:57.218796 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae77502-de8d-4ec9-a74b-ce251359074b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:57.219229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae77502-de8d-4ec9-a74b-ce251359074b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:57.219950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae77502-de8d-4ec9-a74b-ce251359074b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:57.220380 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae77502-de8d-4ec9-a74b-ce251359074b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:57.220831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ae77502-de8d-4ec9-a74b-ce251359074b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:57.254446 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8ae77502-de8d-4ec9-a74b-ce251359074b tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054478 Oct 29 03:56:57.254954 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3823/7601] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:56:57 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:58.267579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-60b0d7aa-046e-4bfe-b157-b01f55a94773 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:58.269910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-60b0d7aa-046e-4bfe-b157-b01f55a94773 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:58.277177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60b0d7aa-046e-4bfe-b157-b01f55a94773 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:58.277680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60b0d7aa-046e-4bfe-b157-b01f55a94773 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:58.278164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60b0d7aa-046e-4bfe-b157-b01f55a94773 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:58.278870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60b0d7aa-046e-4bfe-b157-b01f55a94773 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:58.279324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60b0d7aa-046e-4bfe-b157-b01f55a94773 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:58.279751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-60b0d7aa-046e-4bfe-b157-b01f55a94773 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:58.310638 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-60b0d7aa-046e-4bfe-b157-b01f55a94773 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047088 Oct 29 03:56:58.311106 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3779/7602] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:56:58 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:59.325170 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8ce53269-3f91-4cd3-aca1-b3ff883eaed9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:59.327376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8ce53269-3f91-4cd3-aca1-b3ff883eaed9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:59.334471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ce53269-3f91-4cd3-aca1-b3ff883eaed9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:59.334983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ce53269-3f91-4cd3-aca1-b3ff883eaed9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:59.335413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ce53269-3f91-4cd3-aca1-b3ff883eaed9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:59.336508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ce53269-3f91-4cd3-aca1-b3ff883eaed9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:59.337013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ce53269-3f91-4cd3-aca1-b3ff883eaed9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:59.337493 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8ce53269-3f91-4cd3-aca1-b3ff883eaed9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:59.369301 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8ce53269-3f91-4cd3-aca1-b3ff883eaed9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049393 Oct 29 03:56:59.370154 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3824/7603] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:56:59 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:00.386426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f2b55104-3f9c-4979-ba5f-7450eb85450d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:00.389919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f2b55104-3f9c-4979-ba5f-7450eb85450d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:00.401532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b55104-3f9c-4979-ba5f-7450eb85450d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:00.402073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b55104-3f9c-4979-ba5f-7450eb85450d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:00.402518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b55104-3f9c-4979-ba5f-7450eb85450d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:00.403231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b55104-3f9c-4979-ba5f-7450eb85450d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:00.403694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b55104-3f9c-4979-ba5f-7450eb85450d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:00.404126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f2b55104-3f9c-4979-ba5f-7450eb85450d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:00.435112 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f2b55104-3f9c-4979-ba5f-7450eb85450d tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055781 Oct 29 03:57:00.435704 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3780/7604] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:57:00 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:57:00.452129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:00.452696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:00.463454 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:00.463932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:00.464354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:00.465040 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:00.465481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:00.465922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:00.548531 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] HTTP exception thrown: Instance c9b08cd7-6087-41a8-b4f7-7904e0200672 is not attached to volume 21223767-a008-4e30-a794-f990b8e3fcec Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Request method failure captured: Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments/21223767-a008-4e30-a794-f990b8e3fcec HTTP/1.1 Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKQiiq2k9QlbMdP6gIfuYuzoGPu6eAFPjMQUOzVVOzgLmaWYLfjimldTjztfxx0XUw1NYT0WDXfZIBmFeLsDXDNTnP3UFCIx2S-e6-tGqXG8syUywjMb7QXLSgoU7N72Y8k0mjevjO9UfrDsbuRfvU3HaAAeqVu58lkK9_Q2LxlO0Wk Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09aa2ca9146d4a69ac99e624f73339dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}] Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 4e76321c46fb4c659cf81f6f5e319df7 Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance c9b08cd7-6087-41a8-b4f7-7904e0200672 is not attached to volume 21223767-a008-4e30-a794-f990b8e3fcec Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': 'c9b08cd7-6087-41a8-b4f7-7904e0200672', 'id': '21223767-a008-4e30-a794-f990b8e3fcec'} Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 21223767-a008-4e30-a794-f990b8e3fcec. Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b08cd7-6087-41a8-b4f7-7904e0200672 is not attached to volume 21223767-a008-4e30-a794-f990b8e3fcec Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:57:00.550203 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:57:00.555155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:57:00.555155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:57:00.555155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b08cd7-6087-41a8-b4f7-7904e0200672 is not attached to volume 21223767-a008-4e30-a794-f990b8e3fcec Oct 29 03:57:00.555155 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:57:00.555155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Returning 404 to user: Instance c9b08cd7-6087-41a8-b4f7-7904e0200672 is not attached to volume 21223767-a008-4e30-a794-f990b8e3fcec {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:57:00.555155 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f5615787-6bf7-43a5-ad8a-e1e2e16024b9 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments/21223767-a008-4e30-a794-f990b8e3fcec" status: 404 len: 154 microversion: 2.1 time: 0.106435 Oct 29 03:57:00.555155 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3825/7605] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 03:57:00 2022] DELETE /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672/os-volume_attachments/21223767-a008-4e30-a794-f990b8e3fcec => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:57:03.910689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ea7885e8-dda3-45ba-9569-2a09905e0a07 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:03.911279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ea7885e8-dda3-45ba-9569-2a09905e0a07 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:03.918672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea7885e8-dda3-45ba-9569-2a09905e0a07 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:03.919170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea7885e8-dda3-45ba-9569-2a09905e0a07 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:03.919612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea7885e8-dda3-45ba-9569-2a09905e0a07 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:03.920302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea7885e8-dda3-45ba-9569-2a09905e0a07 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:03.920775 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea7885e8-dda3-45ba-9569-2a09905e0a07 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:03.921203 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ea7885e8-dda3-45ba-9569-2a09905e0a07 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:03.949731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ea7885e8-dda3-45ba-9569-2a09905e0a07 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:57:04.032952 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ea7885e8-dda3-45ba-9569-2a09905e0a07 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 204 len: 0 microversion: 2.1 time: 0.126003 Oct 29 03:57:04.036858 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3781/7606] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:57:03 2022] DELETE /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:57:04.042166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0acdc6c7-d5a4-4277-a8a2-26fdc8fedf78 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:04.042776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0acdc6c7-d5a4-4277-a8a2-26fdc8fedf78 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:04.050755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0acdc6c7-d5a4-4277-a8a2-26fdc8fedf78 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:04.051242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0acdc6c7-d5a4-4277-a8a2-26fdc8fedf78 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:04.051672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0acdc6c7-d5a4-4277-a8a2-26fdc8fedf78 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:04.052373 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0acdc6c7-d5a4-4277-a8a2-26fdc8fedf78 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:04.052819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0acdc6c7-d5a4-4277-a8a2-26fdc8fedf78 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:04.053232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0acdc6c7-d5a4-4277-a8a2-26fdc8fedf78 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:04.193304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0acdc6c7-d5a4-4277-a8a2-26fdc8fedf78 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:04.202246 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0acdc6c7-d5a4-4277-a8a2-26fdc8fedf78 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1558 microversion: 2.1 time: 0.163857 Oct 29 03:57:04.202728 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3826/7607] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:04 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:05.230863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3f3ac8e6-4de9-48fc-9bfa-3814f9d63648 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:05.231657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3f3ac8e6-4de9-48fc-9bfa-3814f9d63648 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:05.240598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3ac8e6-4de9-48fc-9bfa-3814f9d63648 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:05.241198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3ac8e6-4de9-48fc-9bfa-3814f9d63648 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:05.241698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3ac8e6-4de9-48fc-9bfa-3814f9d63648 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:05.242559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3ac8e6-4de9-48fc-9bfa-3814f9d63648 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:05.243101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3ac8e6-4de9-48fc-9bfa-3814f9d63648 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:05.243604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3f3ac8e6-4de9-48fc-9bfa-3814f9d63648 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:05.393608 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3f3ac8e6-4de9-48fc-9bfa-3814f9d63648 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:05.404572 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3f3ac8e6-4de9-48fc-9bfa-3814f9d63648 tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1558 microversion: 2.1 time: 0.180494 Oct 29 03:57:05.405192 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3782/7608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:05 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:06.202701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-2c27e48f-ab08-4ad1-a643-988925fdc640 req-31c7b6fd-dc1d-4411-b712-a772d76f8f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b08cd7-6087-41a8-b4f7-7904e0200672", "name": "network-vif-deleted", "tag": "e3a453d6-80d7-4478-a8ab-55f90a784bab"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:06.213331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2c27e48f-ab08-4ad1-a643-988925fdc640 req-31c7b6fd-dc1d-4411-b712-a772d76f8f1b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:06.213841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2c27e48f-ab08-4ad1-a643-988925fdc640 req-31c7b6fd-dc1d-4411-b712-a772d76f8f1b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:06.214263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-2c27e48f-ab08-4ad1-a643-988925fdc640 req-31c7b6fd-dc1d-4411-b712-a772d76f8f1b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:06.226625 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-2c27e48f-ab08-4ad1-a643-988925fdc640 req-31c7b6fd-dc1d-4411-b712-a772d76f8f1b service nova] Creating event network-vif-deleted:e3a453d6-80d7-4478-a8ab-55f90a784bab for instance c9b08cd7-6087-41a8-b4f7-7904e0200672 on n-h1-862964-4 Oct 29 03:57:06.231902 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-2c27e48f-ab08-4ad1-a643-988925fdc640 req-31c7b6fd-dc1d-4411-b712-a772d76f8f1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032849 Oct 29 03:57:06.232560 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3827/7609] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:57:06.428751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:06.429522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:06.437020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:06.437610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:06.438182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:06.438899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:06.439343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:06.439804 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:06.474996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:06.475588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:06.475703 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:06.476325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lazy-loading 'fault' on Instance uuid c9b08cd7-6087-41a8-b4f7-7904e0200672 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:57:06.519959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e76321c46fb4c659cf81f6f5e319df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09aa2ca9146d4a69ac99e624f73339dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:06.528257 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cb9eae22-8067-4d1d-8ae2-63963579b83f tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 200 len: 1351 microversion: 2.1 time: 0.104108 Oct 29 03:57:06.528856 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3783/7610] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:06 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:07.558782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:07.559763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] [instance: c9b08cd7-6087-41a8-b4f7-7904e0200672] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:07.566693 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:07.567174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:07.567665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:07.568297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:07.568748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:07.569185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:07.582973 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] HTTP exception thrown: Instance c9b08cd7-6087-41a8-b4f7-7904e0200672 could not be found. Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Request method failure captured: Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 HTTP/1.1 Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKQiiq2k9QlbMdP6gIfuYuzoGPu6eAFPjMQUOzVVOzgLmaWYLfjimldTjztfxx0XUw1NYT0WDXfZIBmFeLsDXDNTnP3UFCIx2S-e6-tGqXG8syUywjMb7QXLSgoU7N72Y8k0mjevjO9UfrDsbuRfvU3HaAAeqVu58lkK9_Q2LxlO0Wk Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09aa2ca9146d4a69ac99e624f73339dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09aa2ca9146d4a69ac99e624f73339dd"}]}] Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 09aa2ca9146d4a69ac99e624f73339dd Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-857806225 Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 4e76321c46fb4c659cf81f6f5e319df7 Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestEncryptedCinderVolumes-857806225-project Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance c9b08cd7-6087-41a8-b4f7-7904e0200672 could not be found. Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': 'c9b08cd7-6087-41a8-b4f7-7904e0200672'} Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b08cd7-6087-41a8-b4f7-7904e0200672 could not be found. Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b08cd7-6087-41a8-b4f7-7904e0200672 could not be found. Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:57:07.584647 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:57:07.589468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:07.589468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:57:07.589468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:57:07.589468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:57:07.589468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:57:07.589468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b08cd7-6087-41a8-b4f7-7904e0200672 could not be found. Oct 29 03:57:07.589468 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 03:57:07.589468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Returning 404 to user: Instance c9b08cd7-6087-41a8-b4f7-7904e0200672 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:57:07.589468 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bacb82db-411f-47cf-a75f-47032e0d470c tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672" status: 404 len: 111 microversion: 2.1 time: 0.036007 Oct 29 03:57:07.589468 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3828/7611] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:07 2022] GET /compute/v2.1/servers/c9b08cd7-6087-41a8-b4f7-7904e0200672 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:57:07.595606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-289baa96-4a16-4192-acb7-db529fb52adb tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] Calling method '.version_select at 0x7fe1a39ffb80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:07.619906 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-289baa96-4a16-4192-acb7-db529fb52adb tempest-TestEncryptedCinderVolumes-857806225 tempest-TestEncryptedCinderVolumes-857806225-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-730255450" status: 202 len: 0 microversion: 2.1 time: 0.028315 Oct 29 03:57:07.620647 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3784/7612] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:57:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-730255450 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:57:34.500757 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ed8d4d73-1a1a-4e03-b30e-83170573d2fa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'create', calling method: .version_select at 0x7fe1a3005a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1142078975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOG5C72zskxd0tW5ZsshFVcF/FNbi0UC0743NMfrk5IsNVOsuVLSvI6ht3vIIVoMER67F/Th+7iWu3ZQhPd7GaWQHSl+lF+e9IzxaKfy524nQbvAC0SiTO1M24YHKb0rEg=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:34.506466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=14 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:34.507123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=34 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:34.519809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-ed8d4d73-1a1a-4e03-b30e-83170573d2fa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Getting quotas for project 4fc370103a044e3a949046b97cc17243. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:57:34.525826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-ed8d4d73-1a1a-4e03-b30e-83170573d2fa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Getting quotas for user 62e5edf3a5e948189b7ef1bfa80ffef0 and project 4fc370103a044e3a949046b97cc17243. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:57:34.551570 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ed8d4d73-1a1a-4e03-b30e-83170573d2fa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054914 Oct 29 03:57:34.552173 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3829/7613] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 03:57:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:34.603095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:34.603901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:34.608255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1975407599", "imageRef": "98c703de-41b3-45f7-8526-49586c2c713f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1142078975", "networks": [{"uuid": "fb3fe9b4-854d-4800-a020-adee483c6974"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:34.662011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] validate_networks() for [('fb3fe9b4-854d-4800-a020-adee483c6974', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:57:35.142381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:57:35.142812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:57:35.143297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:57:35.143714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:57:35.144131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:57:35.154484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:35.154997 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:35.155441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:35.156176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:35.156637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:35.157069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:35.174746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Getting quotas for project 4fc370103a044e3a949046b97cc17243. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:57:35.180463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Getting quotas for user 62e5edf3a5e948189b7ef1bfa80ffef0 and project 4fc370103a044e3a949046b97cc17243. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:57:35.194021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:57:35.196269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98c703de-41b3-45f7-8526-49586c2c713f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:57:35.244306 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94b41c3c-0d37-4bb1-a614-41444a66e828 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643299 Oct 29 03:57:35.244953 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3785/7614] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:57:35.256960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d76c0ce-d430-4c20-9339-a5ee9d356186 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:35.257567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d76c0ce-d430-4c20-9339-a5ee9d356186 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:35.317488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d76c0ce-d430-4c20-9339-a5ee9d356186 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:35.326059 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d76c0ce-d430-4c20-9339-a5ee9d356186 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1259 microversion: 2.1 time: 0.073426 Oct 29 03:57:35.326774 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3830/7615] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:35 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:36.349689 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-351e759c-879a-4805-89df-2cf75449206d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:36.350399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-351e759c-879a-4805-89df-2cf75449206d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:36.359152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-351e759c-879a-4805-89df-2cf75449206d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:36.359766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-351e759c-879a-4805-89df-2cf75449206d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:36.360208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-351e759c-879a-4805-89df-2cf75449206d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:36.360952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-351e759c-879a-4805-89df-2cf75449206d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:36.361437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-351e759c-879a-4805-89df-2cf75449206d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:36.361859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-351e759c-879a-4805-89df-2cf75449206d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:36.428894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-351e759c-879a-4805-89df-2cf75449206d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:36.437185 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-351e759c-879a-4805-89df-2cf75449206d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1311 microversion: 2.1 time: 0.092269 Oct 29 03:57:36.450009 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3786/7616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:36 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:37.461304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a8748ec9-a732-4b37-b451-35527828b0de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:37.461928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a8748ec9-a732-4b37-b451-35527828b0de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:37.473735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8748ec9-a732-4b37-b451-35527828b0de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:37.474254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8748ec9-a732-4b37-b451-35527828b0de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:37.474687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8748ec9-a732-4b37-b451-35527828b0de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:37.475448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8748ec9-a732-4b37-b451-35527828b0de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:37.477655 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8748ec9-a732-4b37-b451-35527828b0de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:37.481447 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a8748ec9-a732-4b37-b451-35527828b0de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:37.652534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a8748ec9-a732-4b37-b451-35527828b0de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:37.664056 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a8748ec9-a732-4b37-b451-35527828b0de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.207136 Oct 29 03:57:37.665195 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3831/7617] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:37 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:38.688674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-66ac9f86-d44f-416f-8e3b-fd1c4d676c8f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:38.689577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-66ac9f86-d44f-416f-8e3b-fd1c4d676c8f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:38.697423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ac9f86-d44f-416f-8e3b-fd1c4d676c8f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:38.697936 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ac9f86-d44f-416f-8e3b-fd1c4d676c8f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:38.698408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ac9f86-d44f-416f-8e3b-fd1c4d676c8f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:38.699195 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ac9f86-d44f-416f-8e3b-fd1c4d676c8f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:38.699658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ac9f86-d44f-416f-8e3b-fd1c4d676c8f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:38.700092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-66ac9f86-d44f-416f-8e3b-fd1c4d676c8f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:38.848210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-66ac9f86-d44f-416f-8e3b-fd1c4d676c8f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:38.857356 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-66ac9f86-d44f-416f-8e3b-fd1c4d676c8f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.172788 Oct 29 03:57:38.858904 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3787/7618] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:38 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:39.880996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d7f51f36-2968-4411-aec9-f99f992dc785 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:39.881634 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d7f51f36-2968-4411-aec9-f99f992dc785 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:39.888740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7f51f36-2968-4411-aec9-f99f992dc785 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:39.889226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7f51f36-2968-4411-aec9-f99f992dc785 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:39.889681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7f51f36-2968-4411-aec9-f99f992dc785 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:39.890425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7f51f36-2968-4411-aec9-f99f992dc785 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:39.890873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7f51f36-2968-4411-aec9-f99f992dc785 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:39.891287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d7f51f36-2968-4411-aec9-f99f992dc785 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:40.038544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d7f51f36-2968-4411-aec9-f99f992dc785 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:40.046932 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d7f51f36-2968-4411-aec9-f99f992dc785 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.169909 Oct 29 03:57:40.047529 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3832/7619] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:39 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:41.070451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c60a992b-386d-420b-bfd9-74e6a5632db4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:41.071059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c60a992b-386d-420b-bfd9-74e6a5632db4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:41.079366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c60a992b-386d-420b-bfd9-74e6a5632db4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:41.079873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c60a992b-386d-420b-bfd9-74e6a5632db4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:41.080361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c60a992b-386d-420b-bfd9-74e6a5632db4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:41.081188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c60a992b-386d-420b-bfd9-74e6a5632db4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:41.081670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c60a992b-386d-420b-bfd9-74e6a5632db4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:41.082585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c60a992b-386d-420b-bfd9-74e6a5632db4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:41.251017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c60a992b-386d-420b-bfd9-74e6a5632db4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:41.259791 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c60a992b-386d-420b-bfd9-74e6a5632db4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.192727 Oct 29 03:57:41.260240 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3788/7620] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:41 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:42.282814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d19b536c-7d90-4e94-b119-078cffd3e201 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:42.284155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d19b536c-7d90-4e94-b119-078cffd3e201 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:42.297743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d19b536c-7d90-4e94-b119-078cffd3e201 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:42.298262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d19b536c-7d90-4e94-b119-078cffd3e201 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:42.298694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d19b536c-7d90-4e94-b119-078cffd3e201 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:42.299399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d19b536c-7d90-4e94-b119-078cffd3e201 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:42.299848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d19b536c-7d90-4e94-b119-078cffd3e201 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:42.300263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d19b536c-7d90-4e94-b119-078cffd3e201 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:42.450424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d19b536c-7d90-4e94-b119-078cffd3e201 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:42.459913 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d19b536c-7d90-4e94-b119-078cffd3e201 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.180953 Oct 29 03:57:42.471067 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3833/7621] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:42 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:43.484068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-46911e46-b103-4364-88df-3234a7ea19a2 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:43.484673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-46911e46-b103-4364-88df-3234a7ea19a2 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:43.492449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46911e46-b103-4364-88df-3234a7ea19a2 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:43.492942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46911e46-b103-4364-88df-3234a7ea19a2 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:43.493382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46911e46-b103-4364-88df-3234a7ea19a2 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:43.494115 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46911e46-b103-4364-88df-3234a7ea19a2 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:43.494571 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46911e46-b103-4364-88df-3234a7ea19a2 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:43.494998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46911e46-b103-4364-88df-3234a7ea19a2 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:43.630674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-46911e46-b103-4364-88df-3234a7ea19a2 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:43.641746 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-46911e46-b103-4364-88df-3234a7ea19a2 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.161805 Oct 29 03:57:43.642568 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3789/7622] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:43 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:44.665513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bd4960b-5a26-4b0a-805f-96c4f073fea6 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:44.666222 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bd4960b-5a26-4b0a-805f-96c4f073fea6 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:44.673776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd4960b-5a26-4b0a-805f-96c4f073fea6 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:44.674293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd4960b-5a26-4b0a-805f-96c4f073fea6 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:44.674728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd4960b-5a26-4b0a-805f-96c4f073fea6 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:44.675421 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd4960b-5a26-4b0a-805f-96c4f073fea6 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:44.675869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd4960b-5a26-4b0a-805f-96c4f073fea6 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:44.676285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bd4960b-5a26-4b0a-805f-96c4f073fea6 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:44.795256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d593d326-ab97-49be-87b8-c73b2da0b98b req-66f9500b-cc15-4175-9bac-cc614cc14602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7e6bea-f59d-4477-8abb-48cd090f8f28", "tag": "ae018ca8-616b-4177-94c9-2ff8b2c361eb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:44.814511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9bd4960b-5a26-4b0a-805f-96c4f073fea6 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:44.816045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d593d326-ab97-49be-87b8-c73b2da0b98b req-66f9500b-cc15-4175-9bac-cc614cc14602 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:44.816566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d593d326-ab97-49be-87b8-c73b2da0b98b req-66f9500b-cc15-4175-9bac-cc614cc14602 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:44.817240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d593d326-ab97-49be-87b8-c73b2da0b98b req-66f9500b-cc15-4175-9bac-cc614cc14602 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:44.822285 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9bd4960b-5a26-4b0a-805f-96c4f073fea6 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.161158 Oct 29 03:57:44.822880 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3834/7623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:44 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:44.829643 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d593d326-ab97-49be-87b8-c73b2da0b98b req-66f9500b-cc15-4175-9bac-cc614cc14602 service nova] Creating event network-changed:ae018ca8-616b-4177-94c9-2ff8b2c361eb for instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 on n-h1-862964-4 Oct 29 03:57:44.835120 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d593d326-ab97-49be-87b8-c73b2da0b98b req-66f9500b-cc15-4175-9bac-cc614cc14602 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045096 Oct 29 03:57:44.835800 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3790/7624] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:57:45.849192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-324f1b85-e6da-4681-a9f7-dfb3bdfe3dab tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:45.849925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-324f1b85-e6da-4681-a9f7-dfb3bdfe3dab tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:45.852206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:45.860262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-324f1b85-e6da-4681-a9f7-dfb3bdfe3dab tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:45.860865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-324f1b85-e6da-4681-a9f7-dfb3bdfe3dab tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:45.861399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-324f1b85-e6da-4681-a9f7-dfb3bdfe3dab tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:45.862616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-324f1b85-e6da-4681-a9f7-dfb3bdfe3dab tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:45.863210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-324f1b85-e6da-4681-a9f7-dfb3bdfe3dab tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:45.863729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-324f1b85-e6da-4681-a9f7-dfb3bdfe3dab tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:46.005571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-324f1b85-e6da-4681-a9f7-dfb3bdfe3dab tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:46.014747 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-324f1b85-e6da-4681-a9f7-dfb3bdfe3dab tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.170683 Oct 29 03:57:46.015329 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3835/7625] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:45 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:47.039262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2de5c3d8-19d0-48bb-bbb7-6fa266178e48 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:47.039945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2de5c3d8-19d0-48bb-bbb7-6fa266178e48 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:47.042035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:47.042890 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:47.051013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2de5c3d8-19d0-48bb-bbb7-6fa266178e48 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:47.051503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2de5c3d8-19d0-48bb-bbb7-6fa266178e48 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:47.052017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2de5c3d8-19d0-48bb-bbb7-6fa266178e48 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:47.052732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2de5c3d8-19d0-48bb-bbb7-6fa266178e48 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:47.053186 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2de5c3d8-19d0-48bb-bbb7-6fa266178e48 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:47.053614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2de5c3d8-19d0-48bb-bbb7-6fa266178e48 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:47.197278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2de5c3d8-19d0-48bb-bbb7-6fa266178e48 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:47.205505 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2de5c3d8-19d0-48bb-bbb7-6fa266178e48 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.170830 Oct 29 03:57:47.206118 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3791/7626] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:47 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:57:48.228013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-23f1352b-2b67-4c9d-9088-aab9137b3d30 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:48.228564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-23f1352b-2b67-4c9d-9088-aab9137b3d30 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:48.236050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f1352b-2b67-4c9d-9088-aab9137b3d30 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:48.236662 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f1352b-2b67-4c9d-9088-aab9137b3d30 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:48.237095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f1352b-2b67-4c9d-9088-aab9137b3d30 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:48.238144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f1352b-2b67-4c9d-9088-aab9137b3d30 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:48.238590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f1352b-2b67-4c9d-9088-aab9137b3d30 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:48.239007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23f1352b-2b67-4c9d-9088-aab9137b3d30 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:48.374024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-23f1352b-2b67-4c9d-9088-aab9137b3d30 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:48.381896 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-23f1352b-2b67-4c9d-9088-aab9137b3d30 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.157778 Oct 29 03:57:48.382499 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3836/7627] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:48 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:49.405390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b16535e-ae17-4091-808f-4183cdc317ef tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:49.406048 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6b16535e-ae17-4091-808f-4183cdc317ef tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:49.413265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16535e-ae17-4091-808f-4183cdc317ef tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:49.413765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16535e-ae17-4091-808f-4183cdc317ef tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:49.414240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16535e-ae17-4091-808f-4183cdc317ef tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:49.414948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16535e-ae17-4091-808f-4183cdc317ef tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:49.415412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16535e-ae17-4091-808f-4183cdc317ef tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:49.415842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b16535e-ae17-4091-808f-4183cdc317ef tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:49.546102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6b16535e-ae17-4091-808f-4183cdc317ef tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:49.554077 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b16535e-ae17-4091-808f-4183cdc317ef tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.152846 Oct 29 03:57:49.554658 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3792/7628] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:49 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:50.409101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-8bd5449c-0342-4e22-94ac-d30c540e5bc1 req-f81b4890-971a-42ae-8de4-91d0ba4d37e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7e6bea-f59d-4477-8abb-48cd090f8f28", "name": "network-vif-plugged", "status": "completed", "tag": "ae018ca8-616b-4177-94c9-2ff8b2c361eb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:50.420762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8bd5449c-0342-4e22-94ac-d30c540e5bc1 req-f81b4890-971a-42ae-8de4-91d0ba4d37e5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:50.421236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8bd5449c-0342-4e22-94ac-d30c540e5bc1 req-f81b4890-971a-42ae-8de4-91d0ba4d37e5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:50.421649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8bd5449c-0342-4e22-94ac-d30c540e5bc1 req-f81b4890-971a-42ae-8de4-91d0ba4d37e5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:50.437663 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-8bd5449c-0342-4e22-94ac-d30c540e5bc1 req-f81b4890-971a-42ae-8de4-91d0ba4d37e5 service nova] Creating event network-vif-plugged:ae018ca8-616b-4177-94c9-2ff8b2c361eb for instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 on n-h1-862964-4 Oct 29 03:57:50.442924 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-8bd5449c-0342-4e22-94ac-d30c540e5bc1 req-f81b4890-971a-42ae-8de4-91d0ba4d37e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037710 Oct 29 03:57:50.444009 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3837/7629] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:50.577660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ca01b0e4-5259-494f-a1d1-a72fcb620402 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:50.578318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ca01b0e4-5259-494f-a1d1-a72fcb620402 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:50.585783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca01b0e4-5259-494f-a1d1-a72fcb620402 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:50.586337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca01b0e4-5259-494f-a1d1-a72fcb620402 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:50.586758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca01b0e4-5259-494f-a1d1-a72fcb620402 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:50.587625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca01b0e4-5259-494f-a1d1-a72fcb620402 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:50.587925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca01b0e4-5259-494f-a1d1-a72fcb620402 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:50.588334 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ca01b0e4-5259-494f-a1d1-a72fcb620402 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:50.734187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ca01b0e4-5259-494f-a1d1-a72fcb620402 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:50.745298 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ca01b0e4-5259-494f-a1d1-a72fcb620402 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.172009 Oct 29 03:57:50.745934 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3793/7630] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:50 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:51.769338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dce78e36-021e-4810-bb6b-fee27d682a6c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:51.770055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dce78e36-021e-4810-bb6b-fee27d682a6c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:51.777501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dce78e36-021e-4810-bb6b-fee27d682a6c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:51.778016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dce78e36-021e-4810-bb6b-fee27d682a6c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:51.778443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dce78e36-021e-4810-bb6b-fee27d682a6c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:51.779111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dce78e36-021e-4810-bb6b-fee27d682a6c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:51.779572 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dce78e36-021e-4810-bb6b-fee27d682a6c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:51.779981 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dce78e36-021e-4810-bb6b-fee27d682a6c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:51.908972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dce78e36-021e-4810-bb6b-fee27d682a6c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:51.917343 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dce78e36-021e-4810-bb6b-fee27d682a6c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1359 microversion: 2.1 time: 0.152190 Oct 29 03:57:51.917946 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3838/7631] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:51 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:52.944128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6635900f-e6cd-4aca-804f-7e4e24f7e067 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:52.945047 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6635900f-e6cd-4aca-804f-7e4e24f7e067 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:52.953769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6635900f-e6cd-4aca-804f-7e4e24f7e067 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:52.954353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6635900f-e6cd-4aca-804f-7e4e24f7e067 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:52.954798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6635900f-e6cd-4aca-804f-7e4e24f7e067 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:52.955510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6635900f-e6cd-4aca-804f-7e4e24f7e067 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:52.955969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6635900f-e6cd-4aca-804f-7e4e24f7e067 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:52.956390 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6635900f-e6cd-4aca-804f-7e4e24f7e067 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:53.094953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6635900f-e6cd-4aca-804f-7e4e24f7e067 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:53.107875 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6635900f-e6cd-4aca-804f-7e4e24f7e067 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1550 microversion: 2.1 time: 0.170263 Oct 29 03:57:53.108660 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3794/7632] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:52 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1550 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:53.134828 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0f66ffbd-ae4b-48c5-ba45-62890f57b1fd tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:53.135401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0f66ffbd-ae4b-48c5-ba45-62890f57b1fd tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:53.143001 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f66ffbd-ae4b-48c5-ba45-62890f57b1fd tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:53.143482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f66ffbd-ae4b-48c5-ba45-62890f57b1fd tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:53.144221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f66ffbd-ae4b-48c5-ba45-62890f57b1fd tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:53.144907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f66ffbd-ae4b-48c5-ba45-62890f57b1fd tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:53.145352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f66ffbd-ae4b-48c5-ba45-62890f57b1fd tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:53.145765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0f66ffbd-ae4b-48c5-ba45-62890f57b1fd tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:53.286799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0f66ffbd-ae4b-48c5-ba45-62890f57b1fd tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:53.295160 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0f66ffbd-ae4b-48c5-ba45-62890f57b1fd tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1550 microversion: 2.1 time: 0.164185 Oct 29 03:57:53.295731 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3839/7633] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:53 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:53.320306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5984554d-a083-42ce-ad12-53a4030e5731 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:53.326189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5984554d-a083-42ce-ad12-53a4030e5731 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:53.326978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5984554d-a083-42ce-ad12-53a4030e5731 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Searching by: {'deleted': False, 'project_id': '4fc370103a044e3a949046b97cc17243'} {{(pid=127041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:57:53.332557 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5984554d-a083-42ce-ad12-53a4030e5731 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:53.333037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5984554d-a083-42ce-ad12-53a4030e5731 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:53.333475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5984554d-a083-42ce-ad12-53a4030e5731 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:53.334239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5984554d-a083-42ce-ad12-53a4030e5731 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:53.334697 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5984554d-a083-42ce-ad12-53a4030e5731 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:53.335120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5984554d-a083-42ce-ad12-53a4030e5731 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:53.361395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.multi_cell_list [None req-5984554d-a083-42ce-ad12-53a4030e5731 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:57:53.388948 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5984554d-a083-42ce-ad12-53a4030e5731 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.075046 Oct 29 03:57:53.389540 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3795/7634] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 03:57:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:53.401399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-58c12d22-a145-449d-817c-e13e32c21bcc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:53.402037 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-58c12d22-a145-449d-817c-e13e32c21bcc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:53.408738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c12d22-a145-449d-817c-e13e32c21bcc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:53.409249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c12d22-a145-449d-817c-e13e32c21bcc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:53.409676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c12d22-a145-449d-817c-e13e32c21bcc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:53.410427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c12d22-a145-449d-817c-e13e32c21bcc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:53.410876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c12d22-a145-449d-817c-e13e32c21bcc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:53.411289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-58c12d22-a145-449d-817c-e13e32c21bcc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:53.547758 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-58c12d22-a145-449d-817c-e13e32c21bcc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:53.555857 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-58c12d22-a145-449d-817c-e13e32c21bcc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1550 microversion: 2.1 time: 0.158377 Oct 29 03:57:53.556455 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3840/7635] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:53 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:55.122383 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c765deec-cab8-499c-8391-1e802f3abc5a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9c3569d-0551-48fa-9ccc-b63fcce5a1fc"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:55.124835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c765deec-cab8-499c-8391-1e802f3abc5a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:55.131869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c765deec-cab8-499c-8391-1e802f3abc5a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:55.132360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c765deec-cab8-499c-8391-1e802f3abc5a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:55.132798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c765deec-cab8-499c-8391-1e802f3abc5a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:55.133520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c765deec-cab8-499c-8391-1e802f3abc5a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:55.134017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c765deec-cab8-499c-8391-1e802f3abc5a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:55.134445 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c765deec-cab8-499c-8391-1e802f3abc5a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:55.415337 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c765deec-cab8-499c-8391-1e802f3abc5a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297158 Oct 29 03:57:55.415987 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3796/7636] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 03:57:55 2022] POST /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:58:08.558855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2d9871d7-63b8-41cd-9002-11d5f63ee10d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:08.559715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2d9871d7-63b8-41cd-9002-11d5f63ee10d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:08.562045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:08.562709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=56 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:08.569970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d9871d7-63b8-41cd-9002-11d5f63ee10d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:08.570536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d9871d7-63b8-41cd-9002-11d5f63ee10d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:08.570971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d9871d7-63b8-41cd-9002-11d5f63ee10d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:08.571673 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d9871d7-63b8-41cd-9002-11d5f63ee10d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:08.572121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d9871d7-63b8-41cd-9002-11d5f63ee10d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:08.572539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2d9871d7-63b8-41cd-9002-11d5f63ee10d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:08.709645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2d9871d7-63b8-41cd-9002-11d5f63ee10d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:08.720051 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2d9871d7-63b8-41cd-9002-11d5f63ee10d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1596 microversion: 2.1 time: 0.166289 Oct 29 03:58:08.720663 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3841/7637] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:08 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1596 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:10.744714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:10.745852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:10.746599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:10.751032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-330500f2-5b87-459c-9a8c-cee67a8fba29 req-73775dc4-8028-4f1f-923a-3cdca1f29360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7e6bea-f59d-4477-8abb-48cd090f8f28", "tag": "ae018ca8-616b-4177-94c9-2ff8b2c361eb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:58:10.762527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-330500f2-5b87-459c-9a8c-cee67a8fba29 req-73775dc4-8028-4f1f-923a-3cdca1f29360 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:10.763312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-330500f2-5b87-459c-9a8c-cee67a8fba29 req-73775dc4-8028-4f1f-923a-3cdca1f29360 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:10.763906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-330500f2-5b87-459c-9a8c-cee67a8fba29 req-73775dc4-8028-4f1f-923a-3cdca1f29360 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:10.777890 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-330500f2-5b87-459c-9a8c-cee67a8fba29 req-73775dc4-8028-4f1f-923a-3cdca1f29360 service nova] Creating event network-changed:ae018ca8-616b-4177-94c9-2ff8b2c361eb for instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 on n-h1-862964-4 Oct 29 03:58:10.783920 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-330500f2-5b87-459c-9a8c-cee67a8fba29 req-73775dc4-8028-4f1f-923a-3cdca1f29360 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049774 Oct 29 03:58:10.784660 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3797/7638] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:58:11.969245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-539bc4db-dc04-4529-880d-75689ea3564f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1735280006"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:58:11.969850 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-539bc4db-dc04-4529-880d-75689ea3564f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:11.976814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-539bc4db-dc04-4529-880d-75689ea3564f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:11.977303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-539bc4db-dc04-4529-880d-75689ea3564f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:11.977737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-539bc4db-dc04-4529-880d-75689ea3564f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:11.978658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-539bc4db-dc04-4529-880d-75689ea3564f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:11.979109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-539bc4db-dc04-4529-880d-75689ea3564f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:11.979528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-539bc4db-dc04-4529-880d-75689ea3564f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:12.110270 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.network.security_group_api [None req-539bc4db-dc04-4529-880d-75689ea3564f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Adding security group dab81702-44a1-4f48-8205-a646f8cb11d8 to port ae018ca8-616b-4177-94c9-2ff8b2c361eb Oct 29 03:58:12.444491 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-539bc4db-dc04-4529-880d-75689ea3564f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/action" status: 202 len: 0 microversion: 2.1 time: 0.480012 Oct 29 03:58:12.445173 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3842/7639] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:58:11 2022] POST /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:58:12.455546 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cb396a63-ad2f-4be9-8769-622e38378ba8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:12.456189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cb396a63-ad2f-4be9-8769-622e38378ba8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:12.463341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb396a63-ad2f-4be9-8769-622e38378ba8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:12.464241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb396a63-ad2f-4be9-8769-622e38378ba8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:12.464995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb396a63-ad2f-4be9-8769-622e38378ba8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:12.466874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb396a63-ad2f-4be9-8769-622e38378ba8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:12.467358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb396a63-ad2f-4be9-8769-622e38378ba8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:12.467802 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb396a63-ad2f-4be9-8769-622e38378ba8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:12.625448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cb396a63-ad2f-4be9-8769-622e38378ba8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:12.634127 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cb396a63-ad2f-4be9-8769-622e38378ba8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1761 microversion: 2.1 time: 0.184301 Oct 29 03:58:12.634727 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3798/7640] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:12 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1761 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:12.800463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-1afa765b-2b05-461b-a4f1-7b5026f12bce req-eaf8718d-1864-42ea-b453-fcd0db91fb8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7e6bea-f59d-4477-8abb-48cd090f8f28", "tag": "ae018ca8-616b-4177-94c9-2ff8b2c361eb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:58:12.810685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1afa765b-2b05-461b-a4f1-7b5026f12bce req-eaf8718d-1864-42ea-b453-fcd0db91fb8a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:12.811167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1afa765b-2b05-461b-a4f1-7b5026f12bce req-eaf8718d-1864-42ea-b453-fcd0db91fb8a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:12.811600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1afa765b-2b05-461b-a4f1-7b5026f12bce req-eaf8718d-1864-42ea-b453-fcd0db91fb8a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:12.823274 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1afa765b-2b05-461b-a4f1-7b5026f12bce req-eaf8718d-1864-42ea-b453-fcd0db91fb8a service nova] Creating event network-changed:ae018ca8-616b-4177-94c9-2ff8b2c361eb for instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 on n-h1-862964-4 Oct 29 03:58:12.828946 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-1afa765b-2b05-461b-a4f1-7b5026f12bce req-eaf8718d-1864-42ea-b453-fcd0db91fb8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032229 Oct 29 03:58:12.829456 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3843/7641] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 03:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:50.302372 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:59:50.303124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:50.303915 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=8 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:50.304858 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 03:59:50.305019 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 03:59:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/action (ip 10.222.0.16) !!! Oct 29 03:59:50.310459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cb3a43c8-4f24-4c23-9d92-7f7d5fd4003d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:59:50.312718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cb3a43c8-4f24-4c23-9d92-7f7d5fd4003d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:50.320783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb3a43c8-4f24-4c23-9d92-7f7d5fd4003d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:50.321278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb3a43c8-4f24-4c23-9d92-7f7d5fd4003d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:50.321724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb3a43c8-4f24-4c23-9d92-7f7d5fd4003d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:50.322462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb3a43c8-4f24-4c23-9d92-7f7d5fd4003d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:50.322925 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb3a43c8-4f24-4c23-9d92-7f7d5fd4003d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:50.323337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb3a43c8-4f24-4c23-9d92-7f7d5fd4003d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:50.403137 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cb3a43c8-4f24-4c23-9d92-7f7d5fd4003d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/action" status: 202 len: 0 microversion: 2.1 time: 0.102846 Oct 29 03:59:50.403768 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3799/7642] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 03:59:50 2022] POST /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:59:50.412433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:50.413176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=12 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:50.414196 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:59:50.414638 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:59:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 (ip 10.222.0.16) !!! Oct 29 03:59:50.415975 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 03:59:50.416277 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 03:59:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 (ip 10.222.0.16) !!! Oct 29 03:59:50.422883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90802e33-9daf-4649-807e-01d5cd0ad20c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:50.423639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-90802e33-9daf-4649-807e-01d5cd0ad20c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:50.434947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90802e33-9daf-4649-807e-01d5cd0ad20c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:50.435433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90802e33-9daf-4649-807e-01d5cd0ad20c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:50.435867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90802e33-9daf-4649-807e-01d5cd0ad20c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:50.436564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90802e33-9daf-4649-807e-01d5cd0ad20c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:50.437019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90802e33-9daf-4649-807e-01d5cd0ad20c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:50.437440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90802e33-9daf-4649-807e-01d5cd0ad20c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:50.727664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-90802e33-9daf-4649-807e-01d5cd0ad20c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:50.736322 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90802e33-9daf-4649-807e-01d5cd0ad20c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1763 microversion: 2.1 time: 0.326595 Oct 29 03:59:50.736910 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3844/7643] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:50 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1763 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:51.766442 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4d47270b-0ffa-45d2-b3d4-539b1d4bf235 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:51.767149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4d47270b-0ffa-45d2-b3d4-539b1d4bf235 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:51.774089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d47270b-0ffa-45d2-b3d4-539b1d4bf235 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:51.774583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d47270b-0ffa-45d2-b3d4-539b1d4bf235 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:51.775014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d47270b-0ffa-45d2-b3d4-539b1d4bf235 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:51.775718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d47270b-0ffa-45d2-b3d4-539b1d4bf235 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:51.776182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d47270b-0ffa-45d2-b3d4-539b1d4bf235 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:51.776630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4d47270b-0ffa-45d2-b3d4-539b1d4bf235 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:51.783040 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46436. Oct 29 03:59:51.974685 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4d47270b-0ffa-45d2-b3d4-539b1d4bf235 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:51.983881 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4d47270b-0ffa-45d2-b3d4-539b1d4bf235 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1761 microversion: 2.1 time: 0.226015 Oct 29 03:59:51.984465 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3800/7644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:51 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1761 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:04.559064 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:04.559867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:04.564163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-28e99f35-3fc6-4e30-8655-d547abf041d0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1735280006"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:04.564715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-28e99f35-3fc6-4e30-8655-d547abf041d0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:04.572077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28e99f35-3fc6-4e30-8655-d547abf041d0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:04.572559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28e99f35-3fc6-4e30-8655-d547abf041d0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:04.572990 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28e99f35-3fc6-4e30-8655-d547abf041d0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:04.573689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28e99f35-3fc6-4e30-8655-d547abf041d0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:04.574165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28e99f35-3fc6-4e30-8655-d547abf041d0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:04.574580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-28e99f35-3fc6-4e30-8655-d547abf041d0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:04.712525 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.network.security_group_api [None req-28e99f35-3fc6-4e30-8655-d547abf041d0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Removing security group dab81702-44a1-4f48-8205-a646f8cb11d8 from port ae018ca8-616b-4177-94c9-2ff8b2c361eb Oct 29 04:01:05.024956 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-28e99f35-3fc6-4e30-8655-d547abf041d0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/action" status: 202 len: 0 microversion: 2.1 time: 0.467890 Oct 29 04:01:05.034304 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3845/7645] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:01:04 2022] POST /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:01:05.036973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:05.038466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:05.134487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-29fee366-1353-4226-94ed-89b20d07006f req-3831d524-ba25-4e40-bfd9-81d582ae46b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7e6bea-f59d-4477-8abb-48cd090f8f28", "tag": "ae018ca8-616b-4177-94c9-2ff8b2c361eb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:05.149215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-29fee366-1353-4226-94ed-89b20d07006f req-3831d524-ba25-4e40-bfd9-81d582ae46b6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:05.150061 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-29fee366-1353-4226-94ed-89b20d07006f req-3831d524-ba25-4e40-bfd9-81d582ae46b6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:05.150673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-29fee366-1353-4226-94ed-89b20d07006f req-3831d524-ba25-4e40-bfd9-81d582ae46b6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:05.166096 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-29fee366-1353-4226-94ed-89b20d07006f req-3831d524-ba25-4e40-bfd9-81d582ae46b6 service nova] Creating event network-changed:ae018ca8-616b-4177-94c9-2ff8b2c361eb for instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 on n-h1-862964-4 Oct 29 04:01:05.174069 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-29fee366-1353-4226-94ed-89b20d07006f req-3831d524-ba25-4e40-bfd9-81d582ae46b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143322 Oct 29 04:01:05.175705 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3801/7646] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:06.173187 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:06.173797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:06.180682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:06.181188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:06.181602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:06.182337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:06.182776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:06.183196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:06.273880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lazy-loading 'services' on Instance uuid cc7e6bea-f59d-4477-8abb-48cd090f8f28 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:01:06.347884 n-d-862964-4 devstack@n-api.service[127042]: ERROR oslo.messaging._drivers.impl_rabbit [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [36a04592-1260-43b2-89fb-8dedb5aad3d2] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:01:07.190258 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ab2358e1-c7e7-4278-967f-9d01196f89bc req-9b93045f-fe1c-468a-a4df-106652809d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7e6bea-f59d-4477-8abb-48cd090f8f28", "tag": "ae018ca8-616b-4177-94c9-2ff8b2c361eb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:07.201474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ab2358e1-c7e7-4278-967f-9d01196f89bc req-9b93045f-fe1c-468a-a4df-106652809d7d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:07.201920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ab2358e1-c7e7-4278-967f-9d01196f89bc req-9b93045f-fe1c-468a-a4df-106652809d7d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:07.202304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ab2358e1-c7e7-4278-967f-9d01196f89bc req-9b93045f-fe1c-468a-a4df-106652809d7d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:07.214270 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ab2358e1-c7e7-4278-967f-9d01196f89bc req-9b93045f-fe1c-468a-a4df-106652809d7d service nova] Creating event network-changed:ae018ca8-616b-4177-94c9-2ff8b2c361eb for instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 on n-h1-862964-4 Oct 29 04:01:07.219487 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ab2358e1-c7e7-4278-967f-9d01196f89bc req-9b93045f-fe1c-468a-a4df-106652809d7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033571 Oct 29 04:01:07.220116 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3802/7647] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:07.357015 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [36a04592-1260-43b2-89fb-8dedb5aad3d2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46488. Oct 29 04:01:07.360818 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be3a9bd9-94f9-4dd7-a2fd-e819f7fe4bc1 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments/b9c3569d-0551-48fa-9ccc-b63fcce5a1fc" status: 202 len: 0 microversion: 2.1 time: 1.192895 Oct 29 04:01:07.361455 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3846/7648] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 04:01:06 2022] DELETE /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments/b9c3569d-0551-48fa-9ccc-b63fcce5a1fc => generated 0 bytes in 1194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:01:07.371417 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cb38863a-4f06-4efc-98c8-47d21129dad9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:07.373782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cb38863a-4f06-4efc-98c8-47d21129dad9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:07.380954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb38863a-4f06-4efc-98c8-47d21129dad9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:07.381473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb38863a-4f06-4efc-98c8-47d21129dad9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:07.381990 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb38863a-4f06-4efc-98c8-47d21129dad9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:07.382677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb38863a-4f06-4efc-98c8-47d21129dad9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:07.383182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb38863a-4f06-4efc-98c8-47d21129dad9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:07.383668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cb38863a-4f06-4efc-98c8-47d21129dad9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:07.415479 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cb38863a-4f06-4efc-98c8-47d21129dad9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048600 Oct 29 04:01:07.416082 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3803/7649] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:01:07 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:08.430723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ab5f257b-12cd-479f-b903-cba2b278f9fc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:08.433097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ab5f257b-12cd-479f-b903-cba2b278f9fc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:08.441143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab5f257b-12cd-479f-b903-cba2b278f9fc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:08.441625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab5f257b-12cd-479f-b903-cba2b278f9fc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:08.442082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab5f257b-12cd-479f-b903-cba2b278f9fc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:08.442765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab5f257b-12cd-479f-b903-cba2b278f9fc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:08.443208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab5f257b-12cd-479f-b903-cba2b278f9fc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:08.443617 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab5f257b-12cd-479f-b903-cba2b278f9fc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:08.473642 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ab5f257b-12cd-479f-b903-cba2b278f9fc tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048283 Oct 29 04:01:08.474269 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3847/7650] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:01:08 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:09.486869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bffb9669-3926-40fd-8e05-94c26fee94aa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:09.489566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bffb9669-3926-40fd-8e05-94c26fee94aa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:09.497402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bffb9669-3926-40fd-8e05-94c26fee94aa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:09.497958 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bffb9669-3926-40fd-8e05-94c26fee94aa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:09.498400 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bffb9669-3926-40fd-8e05-94c26fee94aa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:09.499165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bffb9669-3926-40fd-8e05-94c26fee94aa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:09.499637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bffb9669-3926-40fd-8e05-94c26fee94aa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:09.500064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bffb9669-3926-40fd-8e05-94c26fee94aa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:09.532910 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bffb9669-3926-40fd-8e05-94c26fee94aa tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049976 Oct 29 04:01:09.533483 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3804/7651] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:01:09 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:10.545481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-79bceca8-4e43-4c50-862e-4dfd93b8707e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:10.547803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-79bceca8-4e43-4c50-862e-4dfd93b8707e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:10.555554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79bceca8-4e43-4c50-862e-4dfd93b8707e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:10.556043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79bceca8-4e43-4c50-862e-4dfd93b8707e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:10.556472 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79bceca8-4e43-4c50-862e-4dfd93b8707e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:10.557191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79bceca8-4e43-4c50-862e-4dfd93b8707e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:10.557653 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79bceca8-4e43-4c50-862e-4dfd93b8707e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:10.558071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-79bceca8-4e43-4c50-862e-4dfd93b8707e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:10.588643 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-79bceca8-4e43-4c50-862e-4dfd93b8707e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047523 Oct 29 04:01:10.589227 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3848/7652] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:01:10 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:11.601827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d61a7c31-9ca1-4fd1-bd46-d75e7719424f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:11.604301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d61a7c31-9ca1-4fd1-bd46-d75e7719424f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:11.611714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d61a7c31-9ca1-4fd1-bd46-d75e7719424f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:11.612766 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d61a7c31-9ca1-4fd1-bd46-d75e7719424f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:11.613431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d61a7c31-9ca1-4fd1-bd46-d75e7719424f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:11.614194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d61a7c31-9ca1-4fd1-bd46-d75e7719424f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:11.614676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d61a7c31-9ca1-4fd1-bd46-d75e7719424f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:11.615107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d61a7c31-9ca1-4fd1-bd46-d75e7719424f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:11.646836 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d61a7c31-9ca1-4fd1-bd46-d75e7719424f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049069 Oct 29 04:01:11.647442 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3805/7653] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:01:11 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:12.660420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e3d92176-adeb-4e4b-8cb3-c309e8cf7171 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:12.662663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e3d92176-adeb-4e4b-8cb3-c309e8cf7171 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:12.670229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d92176-adeb-4e4b-8cb3-c309e8cf7171 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:12.670695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d92176-adeb-4e4b-8cb3-c309e8cf7171 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:12.671116 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d92176-adeb-4e4b-8cb3-c309e8cf7171 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:12.671793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d92176-adeb-4e4b-8cb3-c309e8cf7171 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:12.672220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d92176-adeb-4e4b-8cb3-c309e8cf7171 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:12.672789 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e3d92176-adeb-4e4b-8cb3-c309e8cf7171 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:12.702341 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e3d92176-adeb-4e4b-8cb3-c309e8cf7171 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046043 Oct 29 04:01:12.702963 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3849/7654] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:01:12 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 04:01:12.714983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:12.715548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:12.722735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:12.723242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:12.723690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:12.724394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:12.724852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:12.725290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:12.804959 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] HTTP exception thrown: Instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 is not attached to volume b9c3569d-0551-48fa-9ccc-b63fcce5a1fc Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Request method failure captured: Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: request: DELETE /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments/b9c3569d-0551-48fa-9ccc-b63fcce5a1fc HTTP/1.1 Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKSgRQWq7G_gfMATzHCSXWZ4igS7U9BhNx6gGZSFnRCqaxk1rkKQW-eOfmK-VhKvI1dPcY-xONDNsyEiMsTh7jZ0WDRX9hg8_lSflsndbarr3zjWd91EgVt5Ps_a58btiDL82DU_RSf7pQLDJjT-6SaiQCfFD10TFr32YmrU2g1c0Sw Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4fc370103a044e3a949046b97cc17243 Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4fc370103a044e3a949046b97cc17243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4fc370103a044e3a949046b97cc17243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4fc370103a044e3a949046b97cc17243", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4fc370103a044e3a949046b97cc17243"}]}] Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4fc370103a044e3a949046b97cc17243 Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestMinimumBasicScenario-122236160-project Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 62e5edf3a5e948189b7ef1bfa80ffef0 Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestMinimumBasicScenario-122236160-project Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 is not attached to volume b9c3569d-0551-48fa-9ccc-b63fcce5a1fc Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'server_id': 'cc7e6bea-f59d-4477-8abb-48cd090f8f28', 'id': 'b9c3569d-0551-48fa-9ccc-b63fcce5a1fc'} Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b9c3569d-0551-48fa-9ccc-b63fcce5a1fc. Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 is not attached to volume b9c3569d-0551-48fa-9ccc-b63fcce5a1fc Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:01:12.806944 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:01:12.811273 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:01:12.811273 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:01:12.811273 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 is not attached to volume b9c3569d-0551-48fa-9ccc-b63fcce5a1fc Oct 29 04:01:12.811273 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:01:12.811273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Returning 404 to user: Instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 is not attached to volume b9c3569d-0551-48fa-9ccc-b63fcce5a1fc {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:01:12.811273 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cd867af6-ab53-450c-834f-32bdfeef2b0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments/b9c3569d-0551-48fa-9ccc-b63fcce5a1fc" status: 404 len: 154 microversion: 2.1 time: 0.097795 Oct 29 04:01:12.811273 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3806/7655] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 04:01:12 2022] DELETE /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28/os-volume_attachments/b9c3569d-0551-48fa-9ccc-b63fcce5a1fc => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:01:16.073534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0daaad72-69fd-4316-9ebf-ca58d00fc26d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:16.074160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0daaad72-69fd-4316-9ebf-ca58d00fc26d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:16.081405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daaad72-69fd-4316-9ebf-ca58d00fc26d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:16.081921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daaad72-69fd-4316-9ebf-ca58d00fc26d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:16.082354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daaad72-69fd-4316-9ebf-ca58d00fc26d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:16.083083 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daaad72-69fd-4316-9ebf-ca58d00fc26d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:16.083530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daaad72-69fd-4316-9ebf-ca58d00fc26d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:16.083944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0daaad72-69fd-4316-9ebf-ca58d00fc26d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:16.109034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0daaad72-69fd-4316-9ebf-ca58d00fc26d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:01:16.202498 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0daaad72-69fd-4316-9ebf-ca58d00fc26d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 204 len: 0 microversion: 2.1 time: 0.132582 Oct 29 04:01:16.203375 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3850/7656] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 04:01:16 2022] DELETE /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:01:16.211935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ac27ea8c-b36f-49ae-a990-aaf7c472b59d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:16.212565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ac27ea8c-b36f-49ae-a990-aaf7c472b59d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:16.226107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac27ea8c-b36f-49ae-a990-aaf7c472b59d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:16.226609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac27ea8c-b36f-49ae-a990-aaf7c472b59d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:16.227092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac27ea8c-b36f-49ae-a990-aaf7c472b59d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:16.227764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac27ea8c-b36f-49ae-a990-aaf7c472b59d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:16.228233 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac27ea8c-b36f-49ae-a990-aaf7c472b59d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:16.228642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ac27ea8c-b36f-49ae-a990-aaf7c472b59d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:16.368631 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ac27ea8c-b36f-49ae-a990-aaf7c472b59d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:16.376968 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ac27ea8c-b36f-49ae-a990-aaf7c472b59d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1556 microversion: 2.1 time: 0.168947 Oct 29 04:01:16.377589 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3807/7657] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:16 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:17.404966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1d2aff20-9ca5-49c4-9a46-76ea1ad64988 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:17.406053 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1d2aff20-9ca5-49c4-9a46-76ea1ad64988 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:17.414619 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d2aff20-9ca5-49c4-9a46-76ea1ad64988 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:17.415109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d2aff20-9ca5-49c4-9a46-76ea1ad64988 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:17.415543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d2aff20-9ca5-49c4-9a46-76ea1ad64988 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:17.416241 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d2aff20-9ca5-49c4-9a46-76ea1ad64988 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:17.416691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d2aff20-9ca5-49c4-9a46-76ea1ad64988 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:17.417112 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1d2aff20-9ca5-49c4-9a46-76ea1ad64988 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:17.558490 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1d2aff20-9ca5-49c4-9a46-76ea1ad64988 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:17.567087 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1d2aff20-9ca5-49c4-9a46-76ea1ad64988 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1556 microversion: 2.1 time: 0.169224 Oct 29 04:01:17.567672 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3851/7658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:17 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:18.446327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-d7df1911-7aab-46fd-8c52-8cd04f2783a6 req-5ce1de2e-de4e-4a3d-ad73-2ef63771941e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7e6bea-f59d-4477-8abb-48cd090f8f28", "name": "network-vif-deleted", "tag": "ae018ca8-616b-4177-94c9-2ff8b2c361eb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:18.456206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d7df1911-7aab-46fd-8c52-8cd04f2783a6 req-5ce1de2e-de4e-4a3d-ad73-2ef63771941e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:18.456800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d7df1911-7aab-46fd-8c52-8cd04f2783a6 req-5ce1de2e-de4e-4a3d-ad73-2ef63771941e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:18.457265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-d7df1911-7aab-46fd-8c52-8cd04f2783a6 req-5ce1de2e-de4e-4a3d-ad73-2ef63771941e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:18.469182 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-d7df1911-7aab-46fd-8c52-8cd04f2783a6 req-5ce1de2e-de4e-4a3d-ad73-2ef63771941e service nova] Creating event network-vif-deleted:ae018ca8-616b-4177-94c9-2ff8b2c361eb for instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 on n-h1-862964-4 Oct 29 04:01:18.475116 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-d7df1911-7aab-46fd-8c52-8cd04f2783a6 req-5ce1de2e-de4e-4a3d-ad73-2ef63771941e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089898 Oct 29 04:01:18.475790 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3808/7659] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:18.591569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:18.592225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:18.599580 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:18.600062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:18.600491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:18.601178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:18.601615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:18.602058 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:18.633551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:18.634055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:18.634475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:18.634907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lazy-loading 'fault' on Instance uuid cc7e6bea-f59d-4477-8abb-48cd090f8f28 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:01:18.680906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:18.689543 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-62361e9d-a455-4509-83f6-3954db86c712 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 200 len: 1349 microversion: 2.1 time: 0.102496 Oct 29 04:01:18.690194 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3852/7660] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:18 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:19.718470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:19.719660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: cc7e6bea-f59d-4477-8abb-48cd090f8f28] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:19.728185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:19.728675 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:19.729118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:19.729842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:19.730311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:19.730740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:19.745291 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] HTTP exception thrown: Instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 could not be found. Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Request method failure captured: Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 HTTP/1.1 Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKSgRQWq7G_gfMATzHCSXWZ4igS7U9BhNx6gGZSFnRCqaxk1rkKQW-eOfmK-VhKvI1dPcY-xONDNsyEiMsTh7jZ0WDRX9hg8_lSflsndbarr3zjWd91EgVt5Ps_a58btiDL82DU_RSf7pQLDJjT-6SaiQCfFD10TFr32YmrU2g1c0Sw Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 4fc370103a044e3a949046b97cc17243 Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4fc370103a044e3a949046b97cc17243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4fc370103a044e3a949046b97cc17243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4fc370103a044e3a949046b97cc17243", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4fc370103a044e3a949046b97cc17243"}]}] Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 4fc370103a044e3a949046b97cc17243 Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestMinimumBasicScenario-122236160-project Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 62e5edf3a5e948189b7ef1bfa80ffef0 Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestMinimumBasicScenario-122236160-project Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 could not be found. Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'cc7e6bea-f59d-4477-8abb-48cd090f8f28'} Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 could not be found. Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 could not be found. Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:01:19.746959 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:01:19.752209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:01:19.752209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:01:19.752209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:01:19.752209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:01:19.752209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:01:19.752209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 could not be found. Oct 29 04:01:19.752209 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:01:19.752209 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Returning 404 to user: Instance cc7e6bea-f59d-4477-8abb-48cd090f8f28 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:01:19.752209 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-361f2ace-d7da-403e-b0ba-8a2d2db35b1a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28" status: 404 len: 111 microversion: 2.1 time: 0.037329 Oct 29 04:01:19.752209 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3809/7661] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:19 2022] GET /compute/v2.1/servers/cc7e6bea-f59d-4477-8abb-48cd090f8f28 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:01:19.757488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6f8075ae-7d1a-4ca0-8153-8767f6416fcb tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '.version_select at 0x7fe1a2fc1dc0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:19.791716 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6f8075ae-7d1a-4ca0-8153-8767f6416fcb tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1142078975" status: 202 len: 0 microversion: 2.1 time: 0.038179 Oct 29 04:01:19.792288 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3853/7662] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Oct 29 04:01:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1142078975 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:01:28.774756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a7ad676c-a998-42c6-9f1e-5fc7b01209ce tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'create', calling method: .version_select at 0x7fe1a85c3d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-266897238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbjLsdNR3LQB7xF9xSMELE/NswuMc/HsBZXk59UacgluGUVYzlevpfdtTFRipSsxKgRmHWH4R4QRme4aIFtLmUPx9eq21wa9DSbHjbyM++tybQAxGLjXD4dcTKPoYWPgw=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:28.794482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a7ad676c-a998-42c6-9f1e-5fc7b01209ce tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Getting quotas for project 4fc370103a044e3a949046b97cc17243. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:01:28.799812 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a7ad676c-a998-42c6-9f1e-5fc7b01209ce tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Getting quotas for user 62e5edf3a5e948189b7ef1bfa80ffef0 and project 4fc370103a044e3a949046b97cc17243. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:01:28.830104 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a7ad676c-a998-42c6-9f1e-5fc7b01209ce tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062149 Oct 29 04:01:28.830698 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3810/7663] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 04:01:28 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:28.882207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:28.886350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1337154796", "imageRef": "12637593-ca21-4382-8358-d396970fe9c4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-266897238", "networks": [{"uuid": "fb3fe9b4-854d-4800-a020-adee483c6974"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:28.953915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] validate_networks() for [('fb3fe9b4-854d-4800-a020-adee483c6974', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:01:29.422540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:01:29.422957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:01:29.423423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:01:29.423823 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:01:29.424224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:01:29.434304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:29.434778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:29.435206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:29.435915 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:29.436355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:29.436806 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:29.454569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Getting quotas for project 4fc370103a044e3a949046b97cc17243. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:01:29.459794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Getting quotas for user 62e5edf3a5e948189b7ef1bfa80ffef0 and project 4fc370103a044e3a949046b97cc17243. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:01:29.472425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:01:29.474682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12637593-ca21-4382-8358-d396970fe9c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:01:29.523887 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3a04b2e6-a6e3-4429-a7fc-45487588e314 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643557 Oct 29 04:01:29.524604 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3854/7664] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 04:01:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:01:29.536095 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cc4e4d09-4232-4372-9ba6-8184eedc6042 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:29.536730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cc4e4d09-4232-4372-9ba6-8184eedc6042 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:29.611464 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cc4e4d09-4232-4372-9ba6-8184eedc6042 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:29.620529 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cc4e4d09-4232-4372-9ba6-8184eedc6042 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1258 microversion: 2.1 time: 0.088559 Oct 29 04:01:29.621263 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3811/7665] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:29 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1258 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:30.648412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-030fffb8-02d0-4d59-adda-db9be0fc7b5e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:30.649016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-030fffb8-02d0-4d59-adda-db9be0fc7b5e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:30.658196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-030fffb8-02d0-4d59-adda-db9be0fc7b5e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:30.658675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-030fffb8-02d0-4d59-adda-db9be0fc7b5e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:30.659100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-030fffb8-02d0-4d59-adda-db9be0fc7b5e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:30.659782 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-030fffb8-02d0-4d59-adda-db9be0fc7b5e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:30.660220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-030fffb8-02d0-4d59-adda-db9be0fc7b5e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:30.660727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-030fffb8-02d0-4d59-adda-db9be0fc7b5e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:30.726800 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-030fffb8-02d0-4d59-adda-db9be0fc7b5e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:30.735221 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-030fffb8-02d0-4d59-adda-db9be0fc7b5e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1310 microversion: 2.1 time: 0.093065 Oct 29 04:01:30.735798 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3855/7666] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:30 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:31.761518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d635126d-e5d9-47af-b507-5f0d182d9028 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:31.762099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d635126d-e5d9-47af-b507-5f0d182d9028 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:31.764165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=38 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:31.766110 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:01:31.766620 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 04:01:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 (ip 10.222.0.16) !!! Oct 29 04:01:31.803814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d635126d-e5d9-47af-b507-5f0d182d9028 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:31.804651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d635126d-e5d9-47af-b507-5f0d182d9028 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:31.805217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d635126d-e5d9-47af-b507-5f0d182d9028 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:31.806109 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d635126d-e5d9-47af-b507-5f0d182d9028 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:31.807020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d635126d-e5d9-47af-b507-5f0d182d9028 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:31.808143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d635126d-e5d9-47af-b507-5f0d182d9028 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:32.013454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d635126d-e5d9-47af-b507-5f0d182d9028 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:32.023276 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d635126d-e5d9-47af-b507-5f0d182d9028 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.265772 Oct 29 04:01:32.024867 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3812/7667] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:31 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:33.053607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85d0c0c7-78d9-4ad6-84f1-cc7e857db99a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:33.055371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-85d0c0c7-78d9-4ad6-84f1-cc7e857db99a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:33.063469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85d0c0c7-78d9-4ad6-84f1-cc7e857db99a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:33.063961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85d0c0c7-78d9-4ad6-84f1-cc7e857db99a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:33.064395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85d0c0c7-78d9-4ad6-84f1-cc7e857db99a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:33.065443 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85d0c0c7-78d9-4ad6-84f1-cc7e857db99a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:33.065926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85d0c0c7-78d9-4ad6-84f1-cc7e857db99a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:33.066349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85d0c0c7-78d9-4ad6-84f1-cc7e857db99a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:33.203082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-85d0c0c7-78d9-4ad6-84f1-cc7e857db99a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:33.211244 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-85d0c0c7-78d9-4ad6-84f1-cc7e857db99a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.162604 Oct 29 04:01:33.211832 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3856/7668] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:33 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:34.235179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2965c839-524b-4402-bae9-f3f8b90b4943 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:34.235934 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2965c839-524b-4402-bae9-f3f8b90b4943 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:34.245475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2965c839-524b-4402-bae9-f3f8b90b4943 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:34.246019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2965c839-524b-4402-bae9-f3f8b90b4943 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:34.246463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2965c839-524b-4402-bae9-f3f8b90b4943 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:34.247201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2965c839-524b-4402-bae9-f3f8b90b4943 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:34.247663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2965c839-524b-4402-bae9-f3f8b90b4943 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:34.248097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2965c839-524b-4402-bae9-f3f8b90b4943 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:34.396592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2965c839-524b-4402-bae9-f3f8b90b4943 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:34.404438 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2965c839-524b-4402-bae9-f3f8b90b4943 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.173466 Oct 29 04:01:34.405249 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3813/7669] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:34 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:35.428297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-498c7457-608f-4e79-a7c6-df29fbe1ec57 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:35.428882 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-498c7457-608f-4e79-a7c6-df29fbe1ec57 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:35.431627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:35.437468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-498c7457-608f-4e79-a7c6-df29fbe1ec57 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:35.438034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-498c7457-608f-4e79-a7c6-df29fbe1ec57 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:35.438446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-498c7457-608f-4e79-a7c6-df29fbe1ec57 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:35.439158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-498c7457-608f-4e79-a7c6-df29fbe1ec57 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:35.439609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-498c7457-608f-4e79-a7c6-df29fbe1ec57 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:35.440028 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-498c7457-608f-4e79-a7c6-df29fbe1ec57 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:35.584245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-498c7457-608f-4e79-a7c6-df29fbe1ec57 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:35.592336 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-498c7457-608f-4e79-a7c6-df29fbe1ec57 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.168227 Oct 29 04:01:35.592961 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3857/7670] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:35 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:36.617584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6533ec47-fd57-424c-8792-e8ae69de2334 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:36.618340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6533ec47-fd57-424c-8792-e8ae69de2334 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:36.621119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:36.626656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6533ec47-fd57-424c-8792-e8ae69de2334 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:36.627144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6533ec47-fd57-424c-8792-e8ae69de2334 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:36.627583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6533ec47-fd57-424c-8792-e8ae69de2334 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:36.628294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6533ec47-fd57-424c-8792-e8ae69de2334 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:36.628795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6533ec47-fd57-424c-8792-e8ae69de2334 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:36.629224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6533ec47-fd57-424c-8792-e8ae69de2334 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:36.773597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6533ec47-fd57-424c-8792-e8ae69de2334 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:36.782395 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6533ec47-fd57-424c-8792-e8ae69de2334 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.168783 Oct 29 04:01:36.782973 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3814/7671] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:36 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:37.805075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b13d096b-7469-4772-98e9-e9cac4570dc9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:37.805694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b13d096b-7469-4772-98e9-e9cac4570dc9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:37.812947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b13d096b-7469-4772-98e9-e9cac4570dc9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:37.813357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b13d096b-7469-4772-98e9-e9cac4570dc9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:37.813785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b13d096b-7469-4772-98e9-e9cac4570dc9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:37.814516 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b13d096b-7469-4772-98e9-e9cac4570dc9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:37.814962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b13d096b-7469-4772-98e9-e9cac4570dc9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:37.815379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b13d096b-7469-4772-98e9-e9cac4570dc9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:37.959502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b13d096b-7469-4772-98e9-e9cac4570dc9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:37.969065 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b13d096b-7469-4772-98e9-e9cac4570dc9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.167467 Oct 29 04:01:37.984830 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3858/7672] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:37 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:38.992184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-19d6d459-9418-4953-9245-79e1de0f421b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:38.992871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-19d6d459-9418-4953-9245-79e1de0f421b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:39.000418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19d6d459-9418-4953-9245-79e1de0f421b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:39.000941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19d6d459-9418-4953-9245-79e1de0f421b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:39.001364 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19d6d459-9418-4953-9245-79e1de0f421b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:39.002117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19d6d459-9418-4953-9245-79e1de0f421b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:39.002591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19d6d459-9418-4953-9245-79e1de0f421b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:39.003023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19d6d459-9418-4953-9245-79e1de0f421b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:39.255131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-19d6d459-9418-4953-9245-79e1de0f421b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:39.263345 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-19d6d459-9418-4953-9245-79e1de0f421b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.275244 Oct 29 04:01:39.263942 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3815/7673] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:38 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:39.668394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-dadfec96-1940-4620-a8a3-f11737a96b96 req-c1dbb12e-e762-4aa9-b95b-bd472d1b8531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae01585-5bef-43cd-b6b4-ab2e2731d933", "tag": "faadfce5-9a1d-45a1-b415-6647dc36371c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:39.674755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:39.675759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:39.683833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-dadfec96-1940-4620-a8a3-f11737a96b96 req-c1dbb12e-e762-4aa9-b95b-bd472d1b8531 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:39.684303 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-dadfec96-1940-4620-a8a3-f11737a96b96 req-c1dbb12e-e762-4aa9-b95b-bd472d1b8531 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:39.684724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-dadfec96-1940-4620-a8a3-f11737a96b96 req-c1dbb12e-e762-4aa9-b95b-bd472d1b8531 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:39.696165 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-dadfec96-1940-4620-a8a3-f11737a96b96 req-c1dbb12e-e762-4aa9-b95b-bd472d1b8531 service nova] Creating event network-changed:faadfce5-9a1d-45a1-b415-6647dc36371c for instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 on n-h1-862964-4 Oct 29 04:01:39.702899 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-dadfec96-1940-4620-a8a3-f11737a96b96 req-c1dbb12e-e762-4aa9-b95b-bd472d1b8531 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040532 Oct 29 04:01:39.703686 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3859/7674] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:40.290829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b95c838b-9e9c-489f-8e69-d47fd097e37d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:40.291727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b95c838b-9e9c-489f-8e69-d47fd097e37d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:40.294263 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:40.302619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b95c838b-9e9c-489f-8e69-d47fd097e37d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:40.303114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b95c838b-9e9c-489f-8e69-d47fd097e37d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:40.303561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b95c838b-9e9c-489f-8e69-d47fd097e37d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:40.304268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b95c838b-9e9c-489f-8e69-d47fd097e37d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:40.304727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b95c838b-9e9c-489f-8e69-d47fd097e37d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:40.305160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b95c838b-9e9c-489f-8e69-d47fd097e37d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:40.447006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b95c838b-9e9c-489f-8e69-d47fd097e37d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:40.455093 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b95c838b-9e9c-489f-8e69-d47fd097e37d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.170283 Oct 29 04:01:40.455693 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3816/7675] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:40 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:41.479773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5bdf53ae-949d-435a-b77f-fe8fcbc7ddae tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:41.480498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5bdf53ae-949d-435a-b77f-fe8fcbc7ddae tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:41.488206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bdf53ae-949d-435a-b77f-fe8fcbc7ddae tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:41.488701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bdf53ae-949d-435a-b77f-fe8fcbc7ddae tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:41.489151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bdf53ae-949d-435a-b77f-fe8fcbc7ddae tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:41.489885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bdf53ae-949d-435a-b77f-fe8fcbc7ddae tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:41.490329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bdf53ae-949d-435a-b77f-fe8fcbc7ddae tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:41.490777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bdf53ae-949d-435a-b77f-fe8fcbc7ddae tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:41.639399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5bdf53ae-949d-435a-b77f-fe8fcbc7ddae tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:41.648657 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5bdf53ae-949d-435a-b77f-fe8fcbc7ddae tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.173044 Oct 29 04:01:41.649307 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3860/7676] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:41 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:42.673179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a12d1d4e-368e-4052-8c91-88fc84642aee tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:42.673816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a12d1d4e-368e-4052-8c91-88fc84642aee tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:42.681494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a12d1d4e-368e-4052-8c91-88fc84642aee tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:42.682038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a12d1d4e-368e-4052-8c91-88fc84642aee tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:42.682489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a12d1d4e-368e-4052-8c91-88fc84642aee tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:42.683201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a12d1d4e-368e-4052-8c91-88fc84642aee tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:42.683667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a12d1d4e-368e-4052-8c91-88fc84642aee tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:42.684102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a12d1d4e-368e-4052-8c91-88fc84642aee tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:42.822987 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a12d1d4e-368e-4052-8c91-88fc84642aee tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:42.831509 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a12d1d4e-368e-4052-8c91-88fc84642aee tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.162490 Oct 29 04:01:42.832102 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3817/7677] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:42 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:43.854080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4e684f97-b437-4dab-b988-cab41e7b9b0e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:43.854809 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4e684f97-b437-4dab-b988-cab41e7b9b0e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:43.863340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e684f97-b437-4dab-b988-cab41e7b9b0e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:43.863811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e684f97-b437-4dab-b988-cab41e7b9b0e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:43.864248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e684f97-b437-4dab-b988-cab41e7b9b0e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:43.864937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e684f97-b437-4dab-b988-cab41e7b9b0e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:43.865365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e684f97-b437-4dab-b988-cab41e7b9b0e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:43.865775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4e684f97-b437-4dab-b988-cab41e7b9b0e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:44.002729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4e684f97-b437-4dab-b988-cab41e7b9b0e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:44.010997 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4e684f97-b437-4dab-b988-cab41e7b9b0e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.160922 Oct 29 04:01:44.011578 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3861/7678] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:43 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:45.041288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-51e9727c-91b8-4a70-b572-ce605ab01045 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:45.042291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-51e9727c-91b8-4a70-b572-ce605ab01045 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:45.053733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51e9727c-91b8-4a70-b572-ce605ab01045 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:45.054290 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51e9727c-91b8-4a70-b572-ce605ab01045 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:45.054758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51e9727c-91b8-4a70-b572-ce605ab01045 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:45.055609 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51e9727c-91b8-4a70-b572-ce605ab01045 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:45.056101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51e9727c-91b8-4a70-b572-ce605ab01045 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:45.056596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-51e9727c-91b8-4a70-b572-ce605ab01045 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:45.198104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-51e9727c-91b8-4a70-b572-ce605ab01045 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:45.206426 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-51e9727c-91b8-4a70-b572-ce605ab01045 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.171752 Oct 29 04:01:45.207000 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3818/7679] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:45 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:45.426783 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-c354be21-c74c-4162-a936-eb567de02ec7 req-512f7713-e303-4f18-a171-c66a88c25e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae01585-5bef-43cd-b6b4-ab2e2731d933", "name": "network-vif-plugged", "status": "completed", "tag": "faadfce5-9a1d-45a1-b415-6647dc36371c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:45.436984 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c354be21-c74c-4162-a936-eb567de02ec7 req-512f7713-e303-4f18-a171-c66a88c25e27 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:45.437449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c354be21-c74c-4162-a936-eb567de02ec7 req-512f7713-e303-4f18-a171-c66a88c25e27 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:45.437921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-c354be21-c74c-4162-a936-eb567de02ec7 req-512f7713-e303-4f18-a171-c66a88c25e27 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:45.449190 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-c354be21-c74c-4162-a936-eb567de02ec7 req-512f7713-e303-4f18-a171-c66a88c25e27 service nova] Creating event network-vif-plugged:faadfce5-9a1d-45a1-b415-6647dc36371c for instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 on n-h1-862964-4 Oct 29 04:01:45.454507 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-c354be21-c74c-4162-a936-eb567de02ec7 req-512f7713-e303-4f18-a171-c66a88c25e27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096254 Oct 29 04:01:45.455122 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3862/7680] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:46.234256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-554ea48a-2c21-439f-b341-831f67670e85 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:46.235246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-554ea48a-2c21-439f-b341-831f67670e85 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:46.244881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-554ea48a-2c21-439f-b341-831f67670e85 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:46.245373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-554ea48a-2c21-439f-b341-831f67670e85 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:46.245839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-554ea48a-2c21-439f-b341-831f67670e85 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:46.246549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-554ea48a-2c21-439f-b341-831f67670e85 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:46.247006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-554ea48a-2c21-439f-b341-831f67670e85 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:46.247415 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-554ea48a-2c21-439f-b341-831f67670e85 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:46.379071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-554ea48a-2c21-439f-b341-831f67670e85 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:46.386989 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-554ea48a-2c21-439f-b341-831f67670e85 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1358 microversion: 2.1 time: 0.159555 Oct 29 04:01:46.387569 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3819/7681] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:46 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:47.415416 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e5748ba0-c0d0-4fb7-a734-c2d96abafc0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:47.416107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e5748ba0-c0d0-4fb7-a734-c2d96abafc0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:47.423218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5748ba0-c0d0-4fb7-a734-c2d96abafc0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:47.423713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5748ba0-c0d0-4fb7-a734-c2d96abafc0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:47.424157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5748ba0-c0d0-4fb7-a734-c2d96abafc0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:47.424899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5748ba0-c0d0-4fb7-a734-c2d96abafc0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:47.425360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5748ba0-c0d0-4fb7-a734-c2d96abafc0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:47.426106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e5748ba0-c0d0-4fb7-a734-c2d96abafc0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:47.574311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e5748ba0-c0d0-4fb7-a734-c2d96abafc0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:47.582269 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e5748ba0-c0d0-4fb7-a734-c2d96abafc0f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1549 microversion: 2.1 time: 0.174038 Oct 29 04:01:47.582856 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3863/7682] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:47 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:47.604633 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-93fb237a-e911-463b-8b5e-ca769effb6a7 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:47.605224 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-93fb237a-e911-463b-8b5e-ca769effb6a7 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:47.612978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fb237a-e911-463b-8b5e-ca769effb6a7 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:47.613470 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fb237a-e911-463b-8b5e-ca769effb6a7 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:47.613966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fb237a-e911-463b-8b5e-ca769effb6a7 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:47.614676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fb237a-e911-463b-8b5e-ca769effb6a7 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:47.615132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fb237a-e911-463b-8b5e-ca769effb6a7 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:47.615560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-93fb237a-e911-463b-8b5e-ca769effb6a7 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:47.758027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-93fb237a-e911-463b-8b5e-ca769effb6a7 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:47.770535 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-93fb237a-e911-463b-8b5e-ca769effb6a7 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1549 microversion: 2.1 time: 0.169539 Oct 29 04:01:47.771299 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3820/7683] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:47 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:47.804583 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f7ece47b-4377-49c0-8077-35d1af41e76b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:47.809300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f7ece47b-4377-49c0-8077-35d1af41e76b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:47.810097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f7ece47b-4377-49c0-8077-35d1af41e76b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Searching by: {'deleted': False, 'project_id': '4fc370103a044e3a949046b97cc17243'} {{(pid=127042) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 04:01:47.815856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7ece47b-4377-49c0-8077-35d1af41e76b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:47.816327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7ece47b-4377-49c0-8077-35d1af41e76b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:47.816750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7ece47b-4377-49c0-8077-35d1af41e76b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:47.817463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7ece47b-4377-49c0-8077-35d1af41e76b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:47.817940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7ece47b-4377-49c0-8077-35d1af41e76b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:47.818359 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f7ece47b-4377-49c0-8077-35d1af41e76b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:47.842612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.multi_cell_list [None req-f7ece47b-4377-49c0-8077-35d1af41e76b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127042) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 04:01:47.872196 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f7ece47b-4377-49c0-8077-35d1af41e76b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073026 Oct 29 04:01:47.872789 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3864/7684] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 04:01:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:47.887108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6f702078-2518-43c9-ac5c-79d1e973319c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:47.888012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6f702078-2518-43c9-ac5c-79d1e973319c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:47.897299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f702078-2518-43c9-ac5c-79d1e973319c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:47.897794 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f702078-2518-43c9-ac5c-79d1e973319c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:47.898265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f702078-2518-43c9-ac5c-79d1e973319c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:47.898955 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f702078-2518-43c9-ac5c-79d1e973319c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:47.899411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f702078-2518-43c9-ac5c-79d1e973319c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:47.899839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f702078-2518-43c9-ac5c-79d1e973319c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:48.034662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6f702078-2518-43c9-ac5c-79d1e973319c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:48.043407 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6f702078-2518-43c9-ac5c-79d1e973319c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1549 microversion: 2.1 time: 0.162171 Oct 29 04:01:48.043986 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3821/7685] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:47 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:49.594837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-340036e8-096f-4c80-bf1b-55da94113966 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e332981-4e1c-459e-ba01-bf39db352dea"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:49.597253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-340036e8-096f-4c80-bf1b-55da94113966 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:49.604278 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340036e8-096f-4c80-bf1b-55da94113966 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:49.604752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340036e8-096f-4c80-bf1b-55da94113966 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:49.605181 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340036e8-096f-4c80-bf1b-55da94113966 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:49.605867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340036e8-096f-4c80-bf1b-55da94113966 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:49.606328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340036e8-096f-4c80-bf1b-55da94113966 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:49.606730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-340036e8-096f-4c80-bf1b-55da94113966 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:49.891696 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-340036e8-096f-4c80-bf1b-55da94113966 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300759 Oct 29 04:01:49.892370 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3865/7686] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Oct 29 04:01:49 2022] POST /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:02:00.735550 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3640b49c-df75-45b0-9f42-eeffda4d3fa1] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:02:00.739397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-17b844af-3f7e-4502-9d1f-4221ccf0a216 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:00.740011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-17b844af-3f7e-4502-9d1f-4221ccf0a216 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:00.742152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=15 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:00.742818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=60 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:00.749064 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b844af-3f7e-4502-9d1f-4221ccf0a216 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:00.749556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b844af-3f7e-4502-9d1f-4221ccf0a216 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:00.750032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b844af-3f7e-4502-9d1f-4221ccf0a216 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:00.750727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b844af-3f7e-4502-9d1f-4221ccf0a216 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:00.751189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b844af-3f7e-4502-9d1f-4221ccf0a216 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:00.751613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-17b844af-3f7e-4502-9d1f-4221ccf0a216 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:00.900198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-17b844af-3f7e-4502-9d1f-4221ccf0a216 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:00.909406 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-17b844af-3f7e-4502-9d1f-4221ccf0a216 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1595 microversion: 2.1 time: 0.175430 Oct 29 04:02:00.910031 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3822/7687] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:00 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1595 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:02.885227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:02.886244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=17 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:02.886942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:02.891073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-6ab894a8-ba51-462d-924d-0d8840863d3d req-1dd48d1c-0726-4c0d-8403-8c62db4a0abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae01585-5bef-43cd-b6b4-ab2e2731d933", "tag": "faadfce5-9a1d-45a1-b415-6647dc36371c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:02.902826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6ab894a8-ba51-462d-924d-0d8840863d3d req-1dd48d1c-0726-4c0d-8403-8c62db4a0abe service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:02.903450 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6ab894a8-ba51-462d-924d-0d8840863d3d req-1dd48d1c-0726-4c0d-8403-8c62db4a0abe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:02.903889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-6ab894a8-ba51-462d-924d-0d8840863d3d req-1dd48d1c-0726-4c0d-8403-8c62db4a0abe service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:02.915844 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-6ab894a8-ba51-462d-924d-0d8840863d3d req-1dd48d1c-0726-4c0d-8403-8c62db4a0abe service nova] Creating event network-changed:faadfce5-9a1d-45a1-b415-6647dc36371c for instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 on n-h1-862964-4 Oct 29 04:02:02.921107 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-6ab894a8-ba51-462d-924d-0d8840863d3d req-1dd48d1c-0726-4c0d-8403-8c62db4a0abe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037658 Oct 29 04:02:02.921847 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3866/7688] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:02:04.047087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0362d12b-6a69-4de1-8108-e168a1ed0f67 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2085208068"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:04.047709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0362d12b-6a69-4de1-8108-e168a1ed0f67 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:04.059835 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [3640b49c-df75-45b0-9f42-eeffda4d3fa1] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46788. Oct 29 04:02:04.061704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0362d12b-6a69-4de1-8108-e168a1ed0f67 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:04.062249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0362d12b-6a69-4de1-8108-e168a1ed0f67 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:04.062660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0362d12b-6a69-4de1-8108-e168a1ed0f67 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:04.063365 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0362d12b-6a69-4de1-8108-e168a1ed0f67 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:04.063816 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0362d12b-6a69-4de1-8108-e168a1ed0f67 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:04.064236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0362d12b-6a69-4de1-8108-e168a1ed0f67 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:04.203925 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.network.security_group_api [None req-0362d12b-6a69-4de1-8108-e168a1ed0f67 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Adding security group 1dd8506f-b0b3-4796-8140-cd3f678819a5 to port faadfce5-9a1d-45a1-b415-6647dc36371c Oct 29 04:02:04.529142 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0362d12b-6a69-4de1-8108-e168a1ed0f67 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/action" status: 202 len: 0 microversion: 2.1 time: 0.486073 Oct 29 04:02:04.529787 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3823/7689] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:02:04 2022] POST /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 04:02:04.538527 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f216de75-bd0b-43e0-b9f0-80b1ba4604eb req-b6612c8b-c646-4fc8-a137-3cd0f3aca9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae01585-5bef-43cd-b6b4-ab2e2731d933", "tag": "faadfce5-9a1d-45a1-b415-6647dc36371c"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:04.540559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d8296fa8-c0e1-4abc-aace-b2b5004424e0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:04.541263 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d8296fa8-c0e1-4abc-aace-b2b5004424e0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:04.548681 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8296fa8-c0e1-4abc-aace-b2b5004424e0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:04.549522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8296fa8-c0e1-4abc-aace-b2b5004424e0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:04.550258 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8296fa8-c0e1-4abc-aace-b2b5004424e0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:04.551048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8296fa8-c0e1-4abc-aace-b2b5004424e0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:04.551563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8296fa8-c0e1-4abc-aace-b2b5004424e0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:04.552173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d8296fa8-c0e1-4abc-aace-b2b5004424e0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:04.575961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f216de75-bd0b-43e0-b9f0-80b1ba4604eb req-b6612c8b-c646-4fc8-a137-3cd0f3aca9d4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:04.576480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f216de75-bd0b-43e0-b9f0-80b1ba4604eb req-b6612c8b-c646-4fc8-a137-3cd0f3aca9d4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:04.576921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f216de75-bd0b-43e0-b9f0-80b1ba4604eb req-b6612c8b-c646-4fc8-a137-3cd0f3aca9d4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:04.590073 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f216de75-bd0b-43e0-b9f0-80b1ba4604eb req-b6612c8b-c646-4fc8-a137-3cd0f3aca9d4 service nova] Creating event network-changed:faadfce5-9a1d-45a1-b415-6647dc36371c for instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 on n-h1-862964-4 Oct 29 04:02:04.595268 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f216de75-bd0b-43e0-b9f0-80b1ba4604eb req-b6612c8b-c646-4fc8-a137-3cd0f3aca9d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060411 Oct 29 04:02:04.595893 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3824/7690] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:02:04.717206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d8296fa8-c0e1-4abc-aace-b2b5004424e0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:04.726439 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d8296fa8-c0e1-4abc-aace-b2b5004424e0 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1760 microversion: 2.1 time: 0.191373 Oct 29 04:02:04.729863 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3867/7691] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:04 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1760 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:18.706156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:18.707347 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=12 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:18.714601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0b55c35f-afd7-4a0d-85d5-9d869402af31 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:18.718536 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0b55c35f-afd7-4a0d-85d5-9d869402af31 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:18.730391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b55c35f-afd7-4a0d-85d5-9d869402af31 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:18.731220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b55c35f-afd7-4a0d-85d5-9d869402af31 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:18.732087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b55c35f-afd7-4a0d-85d5-9d869402af31 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:18.733243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b55c35f-afd7-4a0d-85d5-9d869402af31 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:18.734187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b55c35f-afd7-4a0d-85d5-9d869402af31 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:18.734625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0b55c35f-afd7-4a0d-85d5-9d869402af31 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:18.811466 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0b55c35f-afd7-4a0d-85d5-9d869402af31 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/action" status: 202 len: 0 microversion: 2.1 time: 0.108731 Oct 29 04:02:18.812292 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3825/7692] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:02:18 2022] POST /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:02:18.820618 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-26a35a67-270d-434e-942c-ca67a3122a14 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:18.821218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-26a35a67-270d-434e-942c-ca67a3122a14 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:18.824217 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:18.824855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=8 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:18.830964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a35a67-270d-434e-942c-ca67a3122a14 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:18.831442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a35a67-270d-434e-942c-ca67a3122a14 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:18.831870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a35a67-270d-434e-942c-ca67a3122a14 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:18.832555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a35a67-270d-434e-942c-ca67a3122a14 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:18.832996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a35a67-270d-434e-942c-ca67a3122a14 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:18.833487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-26a35a67-270d-434e-942c-ca67a3122a14 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:18.983709 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-26a35a67-270d-434e-942c-ca67a3122a14 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:18.992517 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-26a35a67-270d-434e-942c-ca67a3122a14 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1752 microversion: 2.1 time: 0.175741 Oct 29 04:02:18.993106 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3868/7693] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:18 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:20.022701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c2e97ea4-c851-4474-afc0-da116d8d0c84 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:20.023711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c2e97ea4-c851-4474-afc0-da116d8d0c84 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:20.032914 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e97ea4-c851-4474-afc0-da116d8d0c84 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:20.033408 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e97ea4-c851-4474-afc0-da116d8d0c84 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:20.033861 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e97ea4-c851-4474-afc0-da116d8d0c84 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:20.034594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e97ea4-c851-4474-afc0-da116d8d0c84 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:20.035055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e97ea4-c851-4474-afc0-da116d8d0c84 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:20.035485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c2e97ea4-c851-4474-afc0-da116d8d0c84 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:20.180655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c2e97ea4-c851-4474-afc0-da116d8d0c84 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:20.189746 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c2e97ea4-c851-4474-afc0-da116d8d0c84 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1757 microversion: 2.1 time: 0.175884 Oct 29 04:02:20.190347 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3826/7694] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:20 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:21.218899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-320078c5-baeb-42bc-97c3-7fd4641f5b3c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:21.219486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-320078c5-baeb-42bc-97c3-7fd4641f5b3c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:21.226787 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-320078c5-baeb-42bc-97c3-7fd4641f5b3c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:21.227273 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-320078c5-baeb-42bc-97c3-7fd4641f5b3c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:21.227731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-320078c5-baeb-42bc-97c3-7fd4641f5b3c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:21.228423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-320078c5-baeb-42bc-97c3-7fd4641f5b3c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:21.228873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-320078c5-baeb-42bc-97c3-7fd4641f5b3c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:21.229294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-320078c5-baeb-42bc-97c3-7fd4641f5b3c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:21.391526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-320078c5-baeb-42bc-97c3-7fd4641f5b3c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:21.400532 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-320078c5-baeb-42bc-97c3-7fd4641f5b3c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1757 microversion: 2.1 time: 0.185788 Oct 29 04:02:21.401127 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3869/7695] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:21 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:22.426880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-00d99ba2-6109-489d-83ed-0284c10cae7a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:22.427663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-00d99ba2-6109-489d-83ed-0284c10cae7a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:22.436145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00d99ba2-6109-489d-83ed-0284c10cae7a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:22.436761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00d99ba2-6109-489d-83ed-0284c10cae7a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:22.437313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00d99ba2-6109-489d-83ed-0284c10cae7a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:22.438375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00d99ba2-6109-489d-83ed-0284c10cae7a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:22.438943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00d99ba2-6109-489d-83ed-0284c10cae7a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:22.439482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00d99ba2-6109-489d-83ed-0284c10cae7a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:22.592996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-00d99ba2-6109-489d-83ed-0284c10cae7a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:22.601739 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-00d99ba2-6109-489d-83ed-0284c10cae7a tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1757 microversion: 2.1 time: 0.180217 Oct 29 04:02:22.602347 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3827/7696] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:22 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:23.626917 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-47d65e08-0aad-49c5-843d-f187b8840802 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:23.627558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-47d65e08-0aad-49c5-843d-f187b8840802 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:23.634563 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47d65e08-0aad-49c5-843d-f187b8840802 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:23.635043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47d65e08-0aad-49c5-843d-f187b8840802 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:23.635465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47d65e08-0aad-49c5-843d-f187b8840802 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:23.636150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47d65e08-0aad-49c5-843d-f187b8840802 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:23.636590 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47d65e08-0aad-49c5-843d-f187b8840802 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:23.637002 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-47d65e08-0aad-49c5-843d-f187b8840802 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:23.779614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-47d65e08-0aad-49c5-843d-f187b8840802 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:23.788133 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-47d65e08-0aad-49c5-843d-f187b8840802 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1757 microversion: 2.1 time: 0.165334 Oct 29 04:02:23.788685 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3870/7697] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:23 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:24.872539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0e144733-9142-492f-b74a-d0bf9c5e491e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:24.873160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0e144733-9142-492f-b74a-d0bf9c5e491e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:24.879754 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e144733-9142-492f-b74a-d0bf9c5e491e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:24.880247 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e144733-9142-492f-b74a-d0bf9c5e491e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:24.880691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e144733-9142-492f-b74a-d0bf9c5e491e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:24.881391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e144733-9142-492f-b74a-d0bf9c5e491e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:24.881837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e144733-9142-492f-b74a-d0bf9c5e491e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:24.882312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0e144733-9142-492f-b74a-d0bf9c5e491e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:25.037163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0e144733-9142-492f-b74a-d0bf9c5e491e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:25.049878 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0e144733-9142-492f-b74a-d0bf9c5e491e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1757 microversion: 2.1 time: 0.237339 Oct 29 04:02:25.050646 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3828/7698] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:24 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1757 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:26.078069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cde023b9-5d85-4b10-80ac-4278de9bb4de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:26.078669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-cde023b9-5d85-4b10-80ac-4278de9bb4de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:26.085835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cde023b9-5d85-4b10-80ac-4278de9bb4de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:26.086384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cde023b9-5d85-4b10-80ac-4278de9bb4de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:26.086829 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cde023b9-5d85-4b10-80ac-4278de9bb4de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:26.087492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cde023b9-5d85-4b10-80ac-4278de9bb4de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:26.087991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cde023b9-5d85-4b10-80ac-4278de9bb4de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:26.088351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-cde023b9-5d85-4b10-80ac-4278de9bb4de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:26.240898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-cde023b9-5d85-4b10-80ac-4278de9bb4de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:26.254532 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cde023b9-5d85-4b10-80ac-4278de9bb4de tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1757 microversion: 2.1 time: 0.180886 Oct 29 04:02:26.255452 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3871/7699] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:26 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:27.283708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d77253b4-b833-42f4-b701-f79d913024a5 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:27.284362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d77253b4-b833-42f4-b701-f79d913024a5 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:27.292262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d77253b4-b833-42f4-b701-f79d913024a5 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:27.292807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d77253b4-b833-42f4-b701-f79d913024a5 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:27.293291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d77253b4-b833-42f4-b701-f79d913024a5 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:27.294102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d77253b4-b833-42f4-b701-f79d913024a5 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:27.294606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d77253b4-b833-42f4-b701-f79d913024a5 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:27.295079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d77253b4-b833-42f4-b701-f79d913024a5 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:27.452526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d77253b4-b833-42f4-b701-f79d913024a5 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:27.460966 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d77253b4-b833-42f4-b701-f79d913024a5 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1757 microversion: 2.1 time: 0.181905 Oct 29 04:02:27.461587 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3829/7700] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:27 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:28.486419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-49b1e8b9-9eec-477b-b8ed-48bf9294613e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:28.487335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-49b1e8b9-9eec-477b-b8ed-48bf9294613e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:28.494306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49b1e8b9-9eec-477b-b8ed-48bf9294613e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:28.494786 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49b1e8b9-9eec-477b-b8ed-48bf9294613e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:28.495214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49b1e8b9-9eec-477b-b8ed-48bf9294613e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:28.495902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49b1e8b9-9eec-477b-b8ed-48bf9294613e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:28.496485 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49b1e8b9-9eec-477b-b8ed-48bf9294613e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:28.496904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-49b1e8b9-9eec-477b-b8ed-48bf9294613e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:28.641666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-49b1e8b9-9eec-477b-b8ed-48bf9294613e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:28.650745 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-49b1e8b9-9eec-477b-b8ed-48bf9294613e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1757 microversion: 2.1 time: 0.168947 Oct 29 04:02:28.651307 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3872/7701] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:28 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:29.677645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1ed2c672-647c-430b-8203-2957789dcd34 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:29.678644 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1ed2c672-647c-430b-8203-2957789dcd34 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:29.689362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ed2c672-647c-430b-8203-2957789dcd34 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:29.689857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ed2c672-647c-430b-8203-2957789dcd34 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:29.690325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ed2c672-647c-430b-8203-2957789dcd34 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:29.691027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ed2c672-647c-430b-8203-2957789dcd34 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:29.691486 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ed2c672-647c-430b-8203-2957789dcd34 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:29.691920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ed2c672-647c-430b-8203-2957789dcd34 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:29.842762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1ed2c672-647c-430b-8203-2957789dcd34 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:29.851728 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1ed2c672-647c-430b-8203-2957789dcd34 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1757 microversion: 2.1 time: 0.180866 Oct 29 04:02:29.852295 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3830/7702] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:29 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:30.879029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5bede36e-d373-4540-9bd9-0283fada12d3 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:30.880032 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5bede36e-d373-4540-9bd9-0283fada12d3 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:30.891228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bede36e-d373-4540-9bd9-0283fada12d3 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:30.891701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bede36e-d373-4540-9bd9-0283fada12d3 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:30.892124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bede36e-d373-4540-9bd9-0283fada12d3 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:30.892807 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bede36e-d373-4540-9bd9-0283fada12d3 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:30.893248 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bede36e-d373-4540-9bd9-0283fada12d3 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:30.893659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bede36e-d373-4540-9bd9-0283fada12d3 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:31.046707 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5bede36e-d373-4540-9bd9-0283fada12d3 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:31.055140 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5bede36e-d373-4540-9bd9-0283fada12d3 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1760 microversion: 2.1 time: 0.182571 Oct 29 04:02:31.055691 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3873/7703] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:30 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1760 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:03.407723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8dda4173-2930-4738-8064-21be47fec813 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2085208068"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:03.408749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8dda4173-2930-4738-8064-21be47fec813 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:03.412269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=12 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:03.413369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:03.422076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dda4173-2930-4738-8064-21be47fec813 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:03.422596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dda4173-2930-4738-8064-21be47fec813 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:03.423046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dda4173-2930-4738-8064-21be47fec813 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:03.423749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dda4173-2930-4738-8064-21be47fec813 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:03.424211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dda4173-2930-4738-8064-21be47fec813 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:03.424638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8dda4173-2930-4738-8064-21be47fec813 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:03.565985 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.network.security_group_api [None req-8dda4173-2930-4738-8064-21be47fec813 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Removing security group 1dd8506f-b0b3-4796-8140-cd3f678819a5 from port faadfce5-9a1d-45a1-b415-6647dc36371c Oct 29 04:03:03.890360 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8dda4173-2930-4738-8064-21be47fec813 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "POST /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/action" status: 202 len: 0 microversion: 2.1 time: 0.489619 Oct 29 04:03:03.890985 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3831/7704] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:03:03 2022] POST /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:03:03.900610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-a807199b-3bcb-42c5-9c06-ea3c7ecd5910 req-9738c548-9822-4b15-8545-a3a445d59c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae01585-5bef-43cd-b6b4-ab2e2731d933", "tag": "faadfce5-9a1d-45a1-b415-6647dc36371c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:03.905819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=12 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:03.906627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=36 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:03.922747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a807199b-3bcb-42c5-9c06-ea3c7ecd5910 req-9738c548-9822-4b15-8545-a3a445d59c73 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:03.924652 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a807199b-3bcb-42c5-9c06-ea3c7ecd5910 req-9738c548-9822-4b15-8545-a3a445d59c73 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:03.925348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-a807199b-3bcb-42c5-9c06-ea3c7ecd5910 req-9738c548-9822-4b15-8545-a3a445d59c73 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:03.942943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-a807199b-3bcb-42c5-9c06-ea3c7ecd5910 req-9738c548-9822-4b15-8545-a3a445d59c73 service nova] Creating event network-changed:faadfce5-9a1d-45a1-b415-6647dc36371c for instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 on n-h1-862964-4 Oct 29 04:03:03.950521 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-a807199b-3bcb-42c5-9c06-ea3c7ecd5910 req-9738c548-9822-4b15-8545-a3a445d59c73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053589 Oct 29 04:03:03.951913 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3874/7705] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:04.974941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2c3492a5-66a9-4bd3-bb53-8b5c46afc2b8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:04.976153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2c3492a5-66a9-4bd3-bb53-8b5c46afc2b8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:04.977596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-74e749aa-ef54-4978-bbaf-3546cdd135eb req-6e315a62-f080-410c-bec1-f823535d011d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae01585-5bef-43cd-b6b4-ab2e2731d933", "tag": "faadfce5-9a1d-45a1-b415-6647dc36371c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:04.985136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c3492a5-66a9-4bd3-bb53-8b5c46afc2b8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:04.985862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c3492a5-66a9-4bd3-bb53-8b5c46afc2b8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:04.986373 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c3492a5-66a9-4bd3-bb53-8b5c46afc2b8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:04.987856 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c3492a5-66a9-4bd3-bb53-8b5c46afc2b8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:04.988295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-74e749aa-ef54-4978-bbaf-3546cdd135eb req-6e315a62-f080-410c-bec1-f823535d011d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:04.988928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-74e749aa-ef54-4978-bbaf-3546cdd135eb req-6e315a62-f080-410c-bec1-f823535d011d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:04.989255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c3492a5-66a9-4bd3-bb53-8b5c46afc2b8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:04.989399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-74e749aa-ef54-4978-bbaf-3546cdd135eb req-6e315a62-f080-410c-bec1-f823535d011d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:04.990072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2c3492a5-66a9-4bd3-bb53-8b5c46afc2b8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:05.003285 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-74e749aa-ef54-4978-bbaf-3546cdd135eb req-6e315a62-f080-410c-bec1-f823535d011d service nova] Creating event network-changed:faadfce5-9a1d-45a1-b415-6647dc36371c for instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 on n-h1-862964-4 Oct 29 04:03:05.008478 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-74e749aa-ef54-4978-bbaf-3546cdd135eb req-6e315a62-f080-410c-bec1-f823535d011d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035849 Oct 29 04:03:05.009159 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3875/7706] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:05.083761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-2c3492a5-66a9-4bd3-bb53-8b5c46afc2b8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lazy-loading 'services' on Instance uuid 8ae01585-5bef-43cd-b6b4-ab2e2731d933 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:03:05.163822 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2c3492a5-66a9-4bd3-bb53-8b5c46afc2b8 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments/8e332981-4e1c-459e-ba01-bf39db352dea" status: 202 len: 0 microversion: 2.1 time: 0.193763 Oct 29 04:03:05.164439 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3832/7707] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 04:03:04 2022] DELETE /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments/8e332981-4e1c-459e-ba01-bf39db352dea => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:03:05.173764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c94e36e-b19f-4c7a-8d60-684a1005234c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:05.176676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9c94e36e-b19f-4c7a-8d60-684a1005234c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:05.183942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c94e36e-b19f-4c7a-8d60-684a1005234c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:05.184963 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c94e36e-b19f-4c7a-8d60-684a1005234c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:05.185566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c94e36e-b19f-4c7a-8d60-684a1005234c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:05.186750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c94e36e-b19f-4c7a-8d60-684a1005234c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:05.187202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c94e36e-b19f-4c7a-8d60-684a1005234c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:05.187795 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c94e36e-b19f-4c7a-8d60-684a1005234c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:05.517203 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c94e36e-b19f-4c7a-8d60-684a1005234c tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.347946 Oct 29 04:03:05.517778 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3876/7708] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:03:05 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments => generated 197 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:06.531342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c67b6e12-e81f-49bf-9380-3951f5c4fe60 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:06.533817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c67b6e12-e81f-49bf-9380-3951f5c4fe60 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:06.543139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c67b6e12-e81f-49bf-9380-3951f5c4fe60 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:06.543552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c67b6e12-e81f-49bf-9380-3951f5c4fe60 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:06.543984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c67b6e12-e81f-49bf-9380-3951f5c4fe60 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:06.544733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c67b6e12-e81f-49bf-9380-3951f5c4fe60 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:06.545264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c67b6e12-e81f-49bf-9380-3951f5c4fe60 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:06.545716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c67b6e12-e81f-49bf-9380-3951f5c4fe60 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:06.580150 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c67b6e12-e81f-49bf-9380-3951f5c4fe60 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053377 Oct 29 04:03:06.580702 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3833/7709] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:03:06 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:07.593922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9354b6eb-4d61-4925-bfe6-a7ed93818a4e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:07.595959 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9354b6eb-4d61-4925-bfe6-a7ed93818a4e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:07.603100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9354b6eb-4d61-4925-bfe6-a7ed93818a4e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:07.603587 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9354b6eb-4d61-4925-bfe6-a7ed93818a4e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:07.604014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9354b6eb-4d61-4925-bfe6-a7ed93818a4e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:07.604711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9354b6eb-4d61-4925-bfe6-a7ed93818a4e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:07.605161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9354b6eb-4d61-4925-bfe6-a7ed93818a4e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:07.605579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9354b6eb-4d61-4925-bfe6-a7ed93818a4e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:07.636330 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9354b6eb-4d61-4925-bfe6-a7ed93818a4e tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046656 Oct 29 04:03:07.636892 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3877/7710] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:03:07 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:08.649181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2910a8e8-a729-4f8a-a0a4-d708fd0fbc27 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:08.651573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2910a8e8-a729-4f8a-a0a4-d708fd0fbc27 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:08.659308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2910a8e8-a729-4f8a-a0a4-d708fd0fbc27 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:08.659862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2910a8e8-a729-4f8a-a0a4-d708fd0fbc27 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:08.660301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2910a8e8-a729-4f8a-a0a4-d708fd0fbc27 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:08.661004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2910a8e8-a729-4f8a-a0a4-d708fd0fbc27 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:08.661482 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2910a8e8-a729-4f8a-a0a4-d708fd0fbc27 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:08.661943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2910a8e8-a729-4f8a-a0a4-d708fd0fbc27 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:08.692280 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2910a8e8-a729-4f8a-a0a4-d708fd0fbc27 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047324 Oct 29 04:03:08.692825 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3834/7711] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:03:08 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:09.705474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-890a01db-1d36-45a0-99cf-e124707de31f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:09.707781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-890a01db-1d36-45a0-99cf-e124707de31f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:09.715292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890a01db-1d36-45a0-99cf-e124707de31f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:09.716082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890a01db-1d36-45a0-99cf-e124707de31f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:09.716510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890a01db-1d36-45a0-99cf-e124707de31f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:09.717438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890a01db-1d36-45a0-99cf-e124707de31f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:09.717950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890a01db-1d36-45a0-99cf-e124707de31f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:09.718352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-890a01db-1d36-45a0-99cf-e124707de31f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:09.750131 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-890a01db-1d36-45a0-99cf-e124707de31f tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048758 Oct 29 04:03:09.750945 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3878/7712] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:03:09 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:10.766942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ee61b6f-e078-40aa-979f-31b8927ffac9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:10.769433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ee61b6f-e078-40aa-979f-31b8927ffac9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:10.777709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee61b6f-e078-40aa-979f-31b8927ffac9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:10.778296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee61b6f-e078-40aa-979f-31b8927ffac9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:10.778800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee61b6f-e078-40aa-979f-31b8927ffac9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:10.779586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee61b6f-e078-40aa-979f-31b8927ffac9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:10.780108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee61b6f-e078-40aa-979f-31b8927ffac9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:10.780592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee61b6f-e078-40aa-979f-31b8927ffac9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:10.814915 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ee61b6f-e078-40aa-979f-31b8927ffac9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054425 Oct 29 04:03:10.815479 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3835/7713] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 04:03:10 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 04:03:10.830947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:10.831489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:10.839602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:10.840085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:10.840514 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:10.841201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:10.841650 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:10.842092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:10.924666 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] HTTP exception thrown: Instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 is not attached to volume 8e332981-4e1c-459e-ba01-bf39db352dea Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Request method failure captured: Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: request: DELETE /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments/8e332981-4e1c-459e-ba01-bf39db352dea HTTP/1.1 Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKSgRQWq7G_gfMATzHCSXWZ4igS7U9BhNx6gGZSFnRCqaxk1rkKQW-eOfmK-VhKvI1dPcY-xONDNsyEiMsTh7jZ0WDRX9hg8_lSflsndbarr3zjWd91EgVt5Ps_a58btiDL82DU_RSf7pQLDJjT-6SaiQCfFD10TFr32YmrU2g1c0Sw Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4fc370103a044e3a949046b97cc17243 Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4fc370103a044e3a949046b97cc17243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4fc370103a044e3a949046b97cc17243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4fc370103a044e3a949046b97cc17243", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4fc370103a044e3a949046b97cc17243"}]}] Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4fc370103a044e3a949046b97cc17243 Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestMinimumBasicScenario-122236160-project Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 62e5edf3a5e948189b7ef1bfa80ffef0 Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestMinimumBasicScenario-122236160-project Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 is not attached to volume 8e332981-4e1c-459e-ba01-bf39db352dea Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'server_id': '8ae01585-5bef-43cd-b6b4-ab2e2731d933', 'id': '8e332981-4e1c-459e-ba01-bf39db352dea'} Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8e332981-4e1c-459e-ba01-bf39db352dea. Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 is not attached to volume 8e332981-4e1c-459e-ba01-bf39db352dea Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:03:10.926329 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:03:10.930690 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:03:10.930690 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:03:10.930690 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 is not attached to volume 8e332981-4e1c-459e-ba01-bf39db352dea Oct 29 04:03:10.930690 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:03:10.930690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Returning 404 to user: Instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 is not attached to volume 8e332981-4e1c-459e-ba01-bf39db352dea {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:03:10.930690 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-85b62db1-abc1-4e9e-8b37-7c7af8c9f79d tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments/8e332981-4e1c-459e-ba01-bf39db352dea" status: 404 len: 154 microversion: 2.1 time: 0.101875 Oct 29 04:03:10.930690 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3879/7714] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Oct 29 04:03:10 2022] DELETE /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933/os-volume_attachments/8e332981-4e1c-459e-ba01-bf39db352dea => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:03:14.199902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4626283d-136d-4481-8cf6-a12b96b59cb4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:14.200471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4626283d-136d-4481-8cf6-a12b96b59cb4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:14.208502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4626283d-136d-4481-8cf6-a12b96b59cb4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:14.208996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4626283d-136d-4481-8cf6-a12b96b59cb4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:14.209438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4626283d-136d-4481-8cf6-a12b96b59cb4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:14.210217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4626283d-136d-4481-8cf6-a12b96b59cb4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:14.210679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4626283d-136d-4481-8cf6-a12b96b59cb4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:14.211099 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4626283d-136d-4481-8cf6-a12b96b59cb4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:14.238135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4626283d-136d-4481-8cf6-a12b96b59cb4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:03:14.322709 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4626283d-136d-4481-8cf6-a12b96b59cb4 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 204 len: 0 microversion: 2.1 time: 0.126403 Oct 29 04:03:14.323683 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3836/7715] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 04:03:14 2022] DELETE /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:03:14.332309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fc0e55bd-7e7d-4ab8-99c0-0e39503c7312 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:14.333086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fc0e55bd-7e7d-4ab8-99c0-0e39503c7312 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:14.341589 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc0e55bd-7e7d-4ab8-99c0-0e39503c7312 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:14.342136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc0e55bd-7e7d-4ab8-99c0-0e39503c7312 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:14.342588 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc0e55bd-7e7d-4ab8-99c0-0e39503c7312 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:14.343769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc0e55bd-7e7d-4ab8-99c0-0e39503c7312 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:14.343970 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc0e55bd-7e7d-4ab8-99c0-0e39503c7312 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:14.344593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fc0e55bd-7e7d-4ab8-99c0-0e39503c7312 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:14.482390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fc0e55bd-7e7d-4ab8-99c0-0e39503c7312 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:14.492040 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fc0e55bd-7e7d-4ab8-99c0-0e39503c7312 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1555 microversion: 2.1 time: 0.163788 Oct 29 04:03:14.492666 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3880/7716] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:14 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:15.518716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-db230e8d-04cb-401d-be68-e9df7271f4e9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:15.519463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db230e8d-04cb-401d-be68-e9df7271f4e9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:15.527104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db230e8d-04cb-401d-be68-e9df7271f4e9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:15.527620 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db230e8d-04cb-401d-be68-e9df7271f4e9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:15.528084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db230e8d-04cb-401d-be68-e9df7271f4e9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:15.528818 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db230e8d-04cb-401d-be68-e9df7271f4e9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:15.529299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db230e8d-04cb-401d-be68-e9df7271f4e9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:15.529747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db230e8d-04cb-401d-be68-e9df7271f4e9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:15.673127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-db230e8d-04cb-401d-be68-e9df7271f4e9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:15.684937 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-db230e8d-04cb-401d-be68-e9df7271f4e9 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1555 microversion: 2.1 time: 0.171228 Oct 29 04:03:15.685733 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3837/7717] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:15 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:16.556449 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-dfe3bbdb-a1f3-438a-895b-9850ebff48dc req-3531a881-0440-4ba8-81c3-f8b8f8773efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae01585-5bef-43cd-b6b4-ab2e2731d933", "name": "network-vif-deleted", "tag": "faadfce5-9a1d-45a1-b415-6647dc36371c"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:16.567853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-dfe3bbdb-a1f3-438a-895b-9850ebff48dc req-3531a881-0440-4ba8-81c3-f8b8f8773efb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:16.568354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-dfe3bbdb-a1f3-438a-895b-9850ebff48dc req-3531a881-0440-4ba8-81c3-f8b8f8773efb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:16.568791 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-dfe3bbdb-a1f3-438a-895b-9850ebff48dc req-3531a881-0440-4ba8-81c3-f8b8f8773efb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:16.583931 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-dfe3bbdb-a1f3-438a-895b-9850ebff48dc req-3531a881-0440-4ba8-81c3-f8b8f8773efb service nova] Creating event network-vif-deleted:faadfce5-9a1d-45a1-b415-6647dc36371c for instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 on n-h1-862964-4 Oct 29 04:03:16.590407 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-dfe3bbdb-a1f3-438a-895b-9850ebff48dc req-3531a881-0440-4ba8-81c3-f8b8f8773efb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037146 Oct 29 04:03:16.591270 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3881/7718] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:16.708838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:16.709505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:16.717107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:16.717613 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:16.718137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:16.719012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:16.719494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:16.719924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:16.752176 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:16.752650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:16.753076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:16.753530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lazy-loading 'fault' on Instance uuid 8ae01585-5bef-43cd-b6b4-ab2e2731d933 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:03:16.800269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e5edf3a5e948189b7ef1bfa80ffef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc370103a044e3a949046b97cc17243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:16.808281 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ee33630-4f50-4055-8cab-2efa25f52568 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 200 len: 1348 microversion: 2.1 time: 0.103525 Oct 29 04:03:16.808926 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3838/7719] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:16 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:17.838062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:17.839132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] [instance: 8ae01585-5bef-43cd-b6b4-ab2e2731d933] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:17.848442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:17.848921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:17.849345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:17.850075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:17.850524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:17.850944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:17.865027 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] HTTP exception thrown: Instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 could not be found. Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Request method failure captured: Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 HTTP/1.1 Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKSgRQWq7G_gfMATzHCSXWZ4igS7U9BhNx6gGZSFnRCqaxk1rkKQW-eOfmK-VhKvI1dPcY-xONDNsyEiMsTh7jZ0WDRX9hg8_lSflsndbarr3zjWd91EgVt5Ps_a58btiDL82DU_RSf7pQLDJjT-6SaiQCfFD10TFr32YmrU2g1c0Sw Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: 4fc370103a044e3a949046b97cc17243 Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4fc370103a044e3a949046b97cc17243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4fc370103a044e3a949046b97cc17243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4fc370103a044e3a949046b97cc17243", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4fc370103a044e3a949046b97cc17243"}]}] Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: 4fc370103a044e3a949046b97cc17243 Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestMinimumBasicScenario-122236160 Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestMinimumBasicScenario-122236160-project Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 62e5edf3a5e948189b7ef1bfa80ffef0 Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestMinimumBasicScenario-122236160-project Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 could not be found. Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '8ae01585-5bef-43cd-b6b4-ab2e2731d933'} Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 could not be found. Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 could not be found. Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:03:17.866716 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:03:17.871089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:03:17.871089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:03:17.871089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:03:17.871089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:03:17.871089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:03:17.871089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 could not be found. Oct 29 04:03:17.871089 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:03:17.871089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Returning 404 to user: Instance 8ae01585-5bef-43cd-b6b4-ab2e2731d933 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:03:17.871089 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f2c80bbd-b194-49b1-afb6-2550229c664b tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933" status: 404 len: 111 microversion: 2.1 time: 0.037433 Oct 29 04:03:17.871089 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3882/7720] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:17 2022] GET /compute/v2.1/servers/8ae01585-5bef-43cd-b6b4-ab2e2731d933 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:03:17.878162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9bcbaae8-4a27-435c-96d5-affa14313784 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] Calling method '.version_select at 0x7fe1accff8b0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:17.902143 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9bcbaae8-4a27-435c-96d5-affa14313784 tempest-TestMinimumBasicScenario-122236160 tempest-TestMinimumBasicScenario-122236160-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-266897238" status: 202 len: 0 microversion: 2.1 time: 0.028771 Oct 29 04:03:17.902726 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3839/7721] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 04:03:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-266897238 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:03:27.504428 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-004f7b76-f000-4e4f-b963-3835111aff47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'create', calling method: .version_select at 0x7fe1a2ff01f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1134677068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKibhakPA8AP1cYGb60T23z3O6JDYrKZHCjEf4yRKvHIiu2nuI2bflegkeQPyS/GswF6tFeRaZgxgxMLdLYKznb+7w1e76RoxQL/EOJgZ2J6XHgj5SwgG1CgIPiuHL8kBg=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:27.524188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-004f7b76-f000-4e4f-b963-3835111aff47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for project fef87f25af434ef59f486bcca46f43f3. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:03:27.529395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-004f7b76-f000-4e4f-b963-3835111aff47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for user 24c2655ccbad4be3b3d2fca5f3f01cf9 and project fef87f25af434ef59f486bcca46f43f3. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:03:27.562340 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-004f7b76-f000-4e4f-b963-3835111aff47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.239522 Oct 29 04:03:27.563265 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3883/7722] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 04:03:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:33.338974 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-836599892", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "5aaa2d79-088e-4cee-a15c-3e829b90cdee"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1134677068", "security_groups": [{"name": "tempest-secgroup-smoke-1415119792"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:33.349873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:33.350575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:33.470418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] validate_networks() for [('5aaa2d79-088e-4cee-a15c-3e829b90cdee', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:03:34.021698 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:03:34.022160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:03:34.022657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:03:34.023089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:03:34.023537 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:03:34.037082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:34.037582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:34.038897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:34.040017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:34.040817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:34.041441 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:34.066339 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for project fef87f25af434ef59f486bcca46f43f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:03:34.072966 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for user 24c2655ccbad4be3b3d2fca5f3f01cf9 and project fef87f25af434ef59f486bcca46f43f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:03:34.087806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:03:34.090786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:03:34.145340 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d01b8b19-39c9-4b0f-b0e3-a1386697e599 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810318 Oct 29 04:03:34.146414 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3840/7723] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 04:03:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:03:34.156125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=38 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:34.168250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5d21bfef-f323-480a-a5db-4dfbcdda6117 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:34.168519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5d21bfef-f323-480a-a5db-4dfbcdda6117 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:34.171530 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:34.257144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5d21bfef-f323-480a-a5db-4dfbcdda6117 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:34.265215 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5d21bfef-f323-480a-a5db-4dfbcdda6117 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1266 microversion: 2.1 time: 0.109929 Oct 29 04:03:34.266459 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3884/7724] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:34 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:35.295361 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-63ae120e-cdd4-4c29-8069-f41103ece959 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:35.295984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-63ae120e-cdd4-4c29-8069-f41103ece959 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:35.303360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63ae120e-cdd4-4c29-8069-f41103ece959 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:35.304531 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63ae120e-cdd4-4c29-8069-f41103ece959 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:35.305249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63ae120e-cdd4-4c29-8069-f41103ece959 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:35.306191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63ae120e-cdd4-4c29-8069-f41103ece959 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:35.306806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63ae120e-cdd4-4c29-8069-f41103ece959 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:35.307385 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-63ae120e-cdd4-4c29-8069-f41103ece959 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:35.381139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-63ae120e-cdd4-4c29-8069-f41103ece959 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:35.393170 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-63ae120e-cdd4-4c29-8069-f41103ece959 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1318 microversion: 2.1 time: 0.102890 Oct 29 04:03:35.394168 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3841/7725] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:35 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1318 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:36.416539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0a824bcb-114d-4043-b252-3a8bb1bd8805 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:36.417506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0a824bcb-114d-4043-b252-3a8bb1bd8805 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:36.425969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a824bcb-114d-4043-b252-3a8bb1bd8805 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:36.426799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a824bcb-114d-4043-b252-3a8bb1bd8805 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:36.427626 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a824bcb-114d-4043-b252-3a8bb1bd8805 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:36.428547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a824bcb-114d-4043-b252-3a8bb1bd8805 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:36.429257 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a824bcb-114d-4043-b252-3a8bb1bd8805 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:36.429907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0a824bcb-114d-4043-b252-3a8bb1bd8805 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:36.592627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0a824bcb-114d-4043-b252-3a8bb1bd8805 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:36.601246 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0a824bcb-114d-4043-b252-3a8bb1bd8805 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1392 microversion: 2.1 time: 0.188515 Oct 29 04:03:36.618844 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3885/7726] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:36 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1392 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:37.080008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b501c741-2b48-4fed-925c-553da254c5c9 req-899b2a80-d8ca-455b-9377-a4bdc55f6fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f17842f-151f-404b-8cc1-ba0e5928864a", "tag": "4fc1ab57-5685-4ed6-a982-47174de3f57a"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:37.093394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b501c741-2b48-4fed-925c-553da254c5c9 req-899b2a80-d8ca-455b-9377-a4bdc55f6fb6 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:37.093908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b501c741-2b48-4fed-925c-553da254c5c9 req-899b2a80-d8ca-455b-9377-a4bdc55f6fb6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:37.094337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b501c741-2b48-4fed-925c-553da254c5c9 req-899b2a80-d8ca-455b-9377-a4bdc55f6fb6 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:37.111415 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b501c741-2b48-4fed-925c-553da254c5c9 req-899b2a80-d8ca-455b-9377-a4bdc55f6fb6 service nova] Creating event network-changed:4fc1ab57-5685-4ed6-a982-47174de3f57a for instance 9f17842f-151f-404b-8cc1-ba0e5928864a on n-h1-862964-4 Oct 29 04:03:37.117270 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b501c741-2b48-4fed-925c-553da254c5c9 req-899b2a80-d8ca-455b-9377-a4bdc55f6fb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042027 Oct 29 04:03:37.118165 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3842/7727] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:37.629875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94d36e91-9004-4b44-837e-4dcd0c315926 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:37.630738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-94d36e91-9004-4b44-837e-4dcd0c315926 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:37.641574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94d36e91-9004-4b44-837e-4dcd0c315926 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:37.642703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94d36e91-9004-4b44-837e-4dcd0c315926 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:37.643149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94d36e91-9004-4b44-837e-4dcd0c315926 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:37.643864 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94d36e91-9004-4b44-837e-4dcd0c315926 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:37.644318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94d36e91-9004-4b44-837e-4dcd0c315926 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:37.644745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94d36e91-9004-4b44-837e-4dcd0c315926 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:37.786220 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-94d36e91-9004-4b44-837e-4dcd0c315926 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:37.794217 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-94d36e91-9004-4b44-837e-4dcd0c315926 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1392 microversion: 2.1 time: 0.170807 Oct 29 04:03:37.794782 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3886/7728] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:37 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:38.818319 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ed4c742f-d42b-42fa-ad91-ec3dd96ed387 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:38.819140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ed4c742f-d42b-42fa-ad91-ec3dd96ed387 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:38.825721 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed4c742f-d42b-42fa-ad91-ec3dd96ed387 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:38.826318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed4c742f-d42b-42fa-ad91-ec3dd96ed387 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:38.826778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed4c742f-d42b-42fa-ad91-ec3dd96ed387 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:38.827484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed4c742f-d42b-42fa-ad91-ec3dd96ed387 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:38.827935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed4c742f-d42b-42fa-ad91-ec3dd96ed387 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:38.828362 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ed4c742f-d42b-42fa-ad91-ec3dd96ed387 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:38.976497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ed4c742f-d42b-42fa-ad91-ec3dd96ed387 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:38.984956 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ed4c742f-d42b-42fa-ad91-ec3dd96ed387 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1392 microversion: 2.1 time: 0.171916 Oct 29 04:03:38.985876 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3843/7729] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:38 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:40.010129 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb6dbaf2-c6c7-426f-8bb2-7590173c7539 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:40.010712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bb6dbaf2-c6c7-426f-8bb2-7590173c7539 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:40.018047 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6dbaf2-c6c7-426f-8bb2-7590173c7539 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:40.018542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6dbaf2-c6c7-426f-8bb2-7590173c7539 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:40.018965 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6dbaf2-c6c7-426f-8bb2-7590173c7539 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:40.019657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6dbaf2-c6c7-426f-8bb2-7590173c7539 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:40.020107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6dbaf2-c6c7-426f-8bb2-7590173c7539 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:40.020544 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb6dbaf2-c6c7-426f-8bb2-7590173c7539 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:40.159637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bb6dbaf2-c6c7-426f-8bb2-7590173c7539 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:40.172642 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb6dbaf2-c6c7-426f-8bb2-7590173c7539 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1392 microversion: 2.1 time: 0.166608 Oct 29 04:03:40.173385 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3887/7730] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:40 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:41.196939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-27738d5c-dfd6-429f-880b-0e1723c5d45e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:41.197577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-27738d5c-dfd6-429f-880b-0e1723c5d45e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:41.204938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27738d5c-dfd6-429f-880b-0e1723c5d45e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:41.205433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27738d5c-dfd6-429f-880b-0e1723c5d45e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:41.205892 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27738d5c-dfd6-429f-880b-0e1723c5d45e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:41.206606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27738d5c-dfd6-429f-880b-0e1723c5d45e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:41.207062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27738d5c-dfd6-429f-880b-0e1723c5d45e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:41.207471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-27738d5c-dfd6-429f-880b-0e1723c5d45e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:41.351465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-27738d5c-dfd6-429f-880b-0e1723c5d45e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:41.359740 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-27738d5c-dfd6-429f-880b-0e1723c5d45e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1392 microversion: 2.1 time: 0.166809 Oct 29 04:03:41.360409 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3844/7731] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:41 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:41.995790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-573c8385-2ea0-4b51-8181-53fe8961f0bc req-8889e62d-3143-49b2-9a7f-c5b034b3cc0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f17842f-151f-404b-8cc1-ba0e5928864a", "name": "network-vif-plugged", "status": "completed", "tag": "4fc1ab57-5685-4ed6-a982-47174de3f57a"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:42.007238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-573c8385-2ea0-4b51-8181-53fe8961f0bc req-8889e62d-3143-49b2-9a7f-c5b034b3cc0a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:42.007825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-573c8385-2ea0-4b51-8181-53fe8961f0bc req-8889e62d-3143-49b2-9a7f-c5b034b3cc0a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:42.008354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-573c8385-2ea0-4b51-8181-53fe8961f0bc req-8889e62d-3143-49b2-9a7f-c5b034b3cc0a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:42.020323 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-573c8385-2ea0-4b51-8181-53fe8961f0bc req-8889e62d-3143-49b2-9a7f-c5b034b3cc0a service nova] Creating event network-vif-plugged:4fc1ab57-5685-4ed6-a982-47174de3f57a for instance 9f17842f-151f-404b-8cc1-ba0e5928864a on n-h1-862964-4 Oct 29 04:03:42.025734 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-573c8385-2ea0-4b51-8181-53fe8961f0bc req-8889e62d-3143-49b2-9a7f-c5b034b3cc0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034707 Oct 29 04:03:42.026688 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3888/7732] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:03:42.384040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-43832224-5f22-4b8c-8974-50394a9efc90 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:42.384673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-43832224-5f22-4b8c-8974-50394a9efc90 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:42.391957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43832224-5f22-4b8c-8974-50394a9efc90 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:42.392561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43832224-5f22-4b8c-8974-50394a9efc90 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:42.393010 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43832224-5f22-4b8c-8974-50394a9efc90 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:42.393718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43832224-5f22-4b8c-8974-50394a9efc90 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:42.394216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43832224-5f22-4b8c-8974-50394a9efc90 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:42.394652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-43832224-5f22-4b8c-8974-50394a9efc90 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:42.533430 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-43832224-5f22-4b8c-8974-50394a9efc90 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:42.541925 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-43832224-5f22-4b8c-8974-50394a9efc90 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1392 microversion: 2.1 time: 0.161826 Oct 29 04:03:42.542644 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3845/7733] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:42 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:43.568649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fe16fa43-97b4-408f-a5bf-e9560c49b972 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:43.569357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fe16fa43-97b4-408f-a5bf-e9560c49b972 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:43.576122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe16fa43-97b4-408f-a5bf-e9560c49b972 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:43.576600 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe16fa43-97b4-408f-a5bf-e9560c49b972 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:43.577021 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe16fa43-97b4-408f-a5bf-e9560c49b972 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:43.577706 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe16fa43-97b4-408f-a5bf-e9560c49b972 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:43.578163 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe16fa43-97b4-408f-a5bf-e9560c49b972 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:43.578597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fe16fa43-97b4-408f-a5bf-e9560c49b972 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:43.720856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-fe16fa43-97b4-408f-a5bf-e9560c49b972 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:43.733074 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fe16fa43-97b4-408f-a5bf-e9560c49b972 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1564 microversion: 2.1 time: 0.170838 Oct 29 04:03:43.733903 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3889/7734] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:43 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:43.756639 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c3817122-09d1-4ac8-9e4c-50f48386cc41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:43.757257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c3817122-09d1-4ac8-9e4c-50f48386cc41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:43.764458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3817122-09d1-4ac8-9e4c-50f48386cc41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:43.764954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3817122-09d1-4ac8-9e4c-50f48386cc41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:43.765394 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3817122-09d1-4ac8-9e4c-50f48386cc41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:43.766120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3817122-09d1-4ac8-9e4c-50f48386cc41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:43.766578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3817122-09d1-4ac8-9e4c-50f48386cc41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:43.767008 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c3817122-09d1-4ac8-9e4c-50f48386cc41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:43.902079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c3817122-09d1-4ac8-9e4c-50f48386cc41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:43.910145 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c3817122-09d1-4ac8-9e4c-50f48386cc41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1564 microversion: 2.1 time: 0.157528 Oct 29 04:03:43.910695 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3846/7735] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:43 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:45.886127 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-92029dbc-0b23-4086-a2b0-b1431f5e473c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:45.886750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-92029dbc-0b23-4086-a2b0-b1431f5e473c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:45.888808 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:45.890854 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-74c7b7e3-c2df-489f-8c77-fbb4cefcc044 req-7d10c802-7727-40fd-aaaf-ce048cf7bc8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f17842f-151f-404b-8cc1-ba0e5928864a", "tag": "4fc1ab57-5685-4ed6-a982-47174de3f57a"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:45.896043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92029dbc-0b23-4086-a2b0-b1431f5e473c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:45.896547 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92029dbc-0b23-4086-a2b0-b1431f5e473c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:45.897179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92029dbc-0b23-4086-a2b0-b1431f5e473c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:45.897909 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92029dbc-0b23-4086-a2b0-b1431f5e473c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:45.898351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92029dbc-0b23-4086-a2b0-b1431f5e473c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:45.898764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-92029dbc-0b23-4086-a2b0-b1431f5e473c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:45.901564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:45.902472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:45.908097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-74c7b7e3-c2df-489f-8c77-fbb4cefcc044 req-7d10c802-7727-40fd-aaaf-ce048cf7bc8c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:45.908728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-74c7b7e3-c2df-489f-8c77-fbb4cefcc044 req-7d10c802-7727-40fd-aaaf-ce048cf7bc8c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:45.909525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-74c7b7e3-c2df-489f-8c77-fbb4cefcc044 req-7d10c802-7727-40fd-aaaf-ce048cf7bc8c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:45.925887 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-74c7b7e3-c2df-489f-8c77-fbb4cefcc044 req-7d10c802-7727-40fd-aaaf-ce048cf7bc8c service nova] Creating event network-changed:4fc1ab57-5685-4ed6-a982-47174de3f57a for instance 9f17842f-151f-404b-8cc1-ba0e5928864a on n-h1-862964-4 Oct 29 04:03:45.931677 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-74c7b7e3-c2df-489f-8c77-fbb4cefcc044 req-7d10c802-7727-40fd-aaaf-ce048cf7bc8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046718 Oct 29 04:03:45.932495 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3847/7736] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:46.036689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-92029dbc-0b23-4086-a2b0-b1431f5e473c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:46.046530 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-92029dbc-0b23-4086-a2b0-b1431f5e473c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1564 microversion: 2.1 time: 0.164453 Oct 29 04:03:46.047166 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3890/7737] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:45 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:07.339842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:07.340628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=36 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:07.345039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ccc4ed83-f99d-43ed-a46d-9ec129481af5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:07.347468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ccc4ed83-f99d-43ed-a46d-9ec129481af5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:07.355255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccc4ed83-f99d-43ed-a46d-9ec129481af5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:07.355751 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccc4ed83-f99d-43ed-a46d-9ec129481af5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:07.356190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccc4ed83-f99d-43ed-a46d-9ec129481af5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:07.356889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccc4ed83-f99d-43ed-a46d-9ec129481af5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:07.357350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccc4ed83-f99d-43ed-a46d-9ec129481af5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:07.357781 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccc4ed83-f99d-43ed-a46d-9ec129481af5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:07.434934 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ccc4ed83-f99d-43ed-a46d-9ec129481af5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a/action" status: 200 len: 24571 microversion: 2.1 time: 0.097014 Oct 29 04:04:07.435591 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3848/7738] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:04:07 2022] POST /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a/action => generated 24571 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:04:18.490297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a4714966-41ce-466c-a660-c5e64a82fb17 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:18.490930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a4714966-41ce-466c-a660-c5e64a82fb17 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:18.493262 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=15 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:18.494036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=32 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:18.500444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4714966-41ce-466c-a660-c5e64a82fb17 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:18.500940 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4714966-41ce-466c-a660-c5e64a82fb17 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:18.501365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4714966-41ce-466c-a660-c5e64a82fb17 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:18.502096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4714966-41ce-466c-a660-c5e64a82fb17 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:18.502550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4714966-41ce-466c-a660-c5e64a82fb17 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:18.502964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a4714966-41ce-466c-a660-c5e64a82fb17 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:18.578608 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a4714966-41ce-466c-a660-c5e64a82fb17 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a/action" status: 202 len: 0 microversion: 2.1 time: 0.092595 Oct 29 04:04:18.579349 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3891/7739] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:04:18 2022] POST /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:04:18.589504 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e7280fa2-f2b5-48ed-acef-4b3633f2c90c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:18.590212 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e7280fa2-f2b5-48ed-acef-4b3633f2c90c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:18.593112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:18.593970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=4 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:18.605125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7280fa2-f2b5-48ed-acef-4b3633f2c90c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:18.605612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7280fa2-f2b5-48ed-acef-4b3633f2c90c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:18.606066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7280fa2-f2b5-48ed-acef-4b3633f2c90c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:18.606784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7280fa2-f2b5-48ed-acef-4b3633f2c90c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:18.607236 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7280fa2-f2b5-48ed-acef-4b3633f2c90c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:18.607663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e7280fa2-f2b5-48ed-acef-4b3633f2c90c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:18.753146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e7280fa2-f2b5-48ed-acef-4b3633f2c90c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:18.764811 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e7280fa2-f2b5-48ed-acef-4b3633f2c90c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1688 microversion: 2.1 time: 0.179304 Oct 29 04:04:18.765365 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3849/7740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:18 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:19.795932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7b3fd0fb-9117-4d6c-ba32-d7c1ded03679 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:19.796978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7b3fd0fb-9117-4d6c-ba32-d7c1ded03679 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:19.803865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b3fd0fb-9117-4d6c-ba32-d7c1ded03679 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:19.804353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b3fd0fb-9117-4d6c-ba32-d7c1ded03679 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:19.804780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b3fd0fb-9117-4d6c-ba32-d7c1ded03679 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:19.805467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b3fd0fb-9117-4d6c-ba32-d7c1ded03679 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:19.805948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b3fd0fb-9117-4d6c-ba32-d7c1ded03679 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:19.806365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7b3fd0fb-9117-4d6c-ba32-d7c1ded03679 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:19.948076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7b3fd0fb-9117-4d6c-ba32-d7c1ded03679 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:19.957731 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7b3fd0fb-9117-4d6c-ba32-d7c1ded03679 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1668 microversion: 2.1 time: 0.170417 Oct 29 04:04:19.958349 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3892/7741] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:19 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:21.065103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6b41a7ae-fba5-40f7-9c55-f63ce096df31 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:21.067753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6b41a7ae-fba5-40f7-9c55-f63ce096df31 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:21.075788 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b41a7ae-fba5-40f7-9c55-f63ce096df31 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:21.076313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b41a7ae-fba5-40f7-9c55-f63ce096df31 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:21.076755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b41a7ae-fba5-40f7-9c55-f63ce096df31 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:21.077456 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b41a7ae-fba5-40f7-9c55-f63ce096df31 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:21.078270 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b41a7ae-fba5-40f7-9c55-f63ce096df31 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:21.078708 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6b41a7ae-fba5-40f7-9c55-f63ce096df31 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:21.149788 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6b41a7ae-fba5-40f7-9c55-f63ce096df31 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a/action" status: 200 len: 32651 microversion: 2.1 time: 0.089183 Oct 29 04:04:21.151002 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3850/7742] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:04:21 2022] POST /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a/action => generated 32651 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:04:21.167228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a37ade7d-d058-4aa6-b39e-714d1f2fd6e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:21.167989 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a37ade7d-d058-4aa6-b39e-714d1f2fd6e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:21.176137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a37ade7d-d058-4aa6-b39e-714d1f2fd6e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:21.176616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a37ade7d-d058-4aa6-b39e-714d1f2fd6e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:21.177042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a37ade7d-d058-4aa6-b39e-714d1f2fd6e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:21.177720 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a37ade7d-d058-4aa6-b39e-714d1f2fd6e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:21.178195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a37ade7d-d058-4aa6-b39e-714d1f2fd6e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:21.178607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a37ade7d-d058-4aa6-b39e-714d1f2fd6e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:21.251903 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a37ade7d-d058-4aa6-b39e-714d1f2fd6e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a/action" status: 202 len: 0 microversion: 2.1 time: 0.089868 Oct 29 04:04:21.252709 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3893/7743] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:04:21 2022] POST /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:04:21.262320 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-97e6bb7c-110e-4c85-996d-5164bdc7d747 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:21.263787 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-97e6bb7c-110e-4c85-996d-5164bdc7d747 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:21.270529 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97e6bb7c-110e-4c85-996d-5164bdc7d747 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:21.271032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97e6bb7c-110e-4c85-996d-5164bdc7d747 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:21.271475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97e6bb7c-110e-4c85-996d-5164bdc7d747 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:21.272225 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97e6bb7c-110e-4c85-996d-5164bdc7d747 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:21.272693 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97e6bb7c-110e-4c85-996d-5164bdc7d747 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:21.273132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-97e6bb7c-110e-4c85-996d-5164bdc7d747 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:21.409343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-97e6bb7c-110e-4c85-996d-5164bdc7d747 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:21.417352 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-97e6bb7c-110e-4c85-996d-5164bdc7d747 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1675 microversion: 2.1 time: 0.159899 Oct 29 04:04:21.418022 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3851/7744] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:21 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:22.452471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0cc4aa6a-ceee-44c2-9ade-b6da66428546 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:22.453598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0cc4aa6a-ceee-44c2-9ade-b6da66428546 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:22.463935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc4aa6a-ceee-44c2-9ade-b6da66428546 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:22.464732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc4aa6a-ceee-44c2-9ade-b6da66428546 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:22.465475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc4aa6a-ceee-44c2-9ade-b6da66428546 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:22.466599 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc4aa6a-ceee-44c2-9ade-b6da66428546 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:22.467335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc4aa6a-ceee-44c2-9ade-b6da66428546 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:22.468025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0cc4aa6a-ceee-44c2-9ade-b6da66428546 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:22.605491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0cc4aa6a-ceee-44c2-9ade-b6da66428546 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:22.614173 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0cc4aa6a-ceee-44c2-9ade-b6da66428546 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1683 microversion: 2.1 time: 0.173634 Oct 29 04:04:22.614678 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3894/7745] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:22 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:22.715020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-15fc7b1b-98ae-435f-b636-9c32e94cdd36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:22.717221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-15fc7b1b-98ae-435f-b636-9c32e94cdd36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:22.724352 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15fc7b1b-98ae-435f-b636-9c32e94cdd36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:22.724845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15fc7b1b-98ae-435f-b636-9c32e94cdd36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:22.725285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15fc7b1b-98ae-435f-b636-9c32e94cdd36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:22.726014 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15fc7b1b-98ae-435f-b636-9c32e94cdd36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:22.726499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15fc7b1b-98ae-435f-b636-9c32e94cdd36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:22.726931 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-15fc7b1b-98ae-435f-b636-9c32e94cdd36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:22.791734 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-15fc7b1b-98ae-435f-b636-9c32e94cdd36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a/action" status: 200 len: 38436 microversion: 2.1 time: 0.080640 Oct 29 04:04:22.792378 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3852/7746] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:04:22 2022] POST /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a/action => generated 38436 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:04:23.815509 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-87028104-4f69-4b7e-b54e-2d81b895ac38 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:23.816741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-87028104-4f69-4b7e-b54e-2d81b895ac38 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:23.817676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-09889f9d-1069-4599-87d8-26babd719d0a req-ee8563e2-c3f3-4bb7-ac0f-fcfd5d505c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f17842f-151f-404b-8cc1-ba0e5928864a", "tag": "4fc1ab57-5685-4ed6-a982-47174de3f57a"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:23.823906 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87028104-4f69-4b7e-b54e-2d81b895ac38 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:23.824354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87028104-4f69-4b7e-b54e-2d81b895ac38 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:23.825044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87028104-4f69-4b7e-b54e-2d81b895ac38 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:23.825733 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87028104-4f69-4b7e-b54e-2d81b895ac38 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:23.826212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87028104-4f69-4b7e-b54e-2d81b895ac38 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:23.826761 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-87028104-4f69-4b7e-b54e-2d81b895ac38 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:23.829977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-09889f9d-1069-4599-87d8-26babd719d0a req-ee8563e2-c3f3-4bb7-ac0f-fcfd5d505c9e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:23.830545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-09889f9d-1069-4599-87d8-26babd719d0a req-ee8563e2-c3f3-4bb7-ac0f-fcfd5d505c9e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:23.831039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-09889f9d-1069-4599-87d8-26babd719d0a req-ee8563e2-c3f3-4bb7-ac0f-fcfd5d505c9e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:23.843467 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-09889f9d-1069-4599-87d8-26babd719d0a req-ee8563e2-c3f3-4bb7-ac0f-fcfd5d505c9e service nova] Creating event network-changed:4fc1ab57-5685-4ed6-a982-47174de3f57a for instance 9f17842f-151f-404b-8cc1-ba0e5928864a on n-h1-862964-4 Oct 29 04:04:23.849533 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-09889f9d-1069-4599-87d8-26babd719d0a req-ee8563e2-c3f3-4bb7-ac0f-fcfd5d505c9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036144 Oct 29 04:04:23.850457 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3853/7747] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:04:23.854929 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-87028104-4f69-4b7e-b54e-2d81b895ac38 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:04:23.946584 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-87028104-4f69-4b7e-b54e-2d81b895ac38 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 204 len: 0 microversion: 2.1 time: 0.134254 Oct 29 04:04:23.947414 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3895/7748] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 04:04:23 2022] DELETE /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:04:23.957380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7a0f292d-8e61-4663-851d-2b0964726658 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:23.958122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7a0f292d-8e61-4663-851d-2b0964726658 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:23.964520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a0f292d-8e61-4663-851d-2b0964726658 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:23.965015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a0f292d-8e61-4663-851d-2b0964726658 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:23.965460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a0f292d-8e61-4663-851d-2b0964726658 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:23.966189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a0f292d-8e61-4663-851d-2b0964726658 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:23.966653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a0f292d-8e61-4663-851d-2b0964726658 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:23.967092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7a0f292d-8e61-4663-851d-2b0964726658 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:24.104038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7a0f292d-8e61-4663-851d-2b0964726658 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:24.112839 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7a0f292d-8e61-4663-851d-2b0964726658 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1689 microversion: 2.1 time: 0.160787 Oct 29 04:04:24.113425 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3854/7749] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:23 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:25.142043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9dd3fb75-f72c-488b-ad6a-1c2177f1ccee tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:25.142904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9dd3fb75-f72c-488b-ad6a-1c2177f1ccee tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:25.150375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dd3fb75-f72c-488b-ad6a-1c2177f1ccee tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:25.150869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dd3fb75-f72c-488b-ad6a-1c2177f1ccee tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:25.151282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dd3fb75-f72c-488b-ad6a-1c2177f1ccee tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:25.151964 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dd3fb75-f72c-488b-ad6a-1c2177f1ccee tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:25.152411 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dd3fb75-f72c-488b-ad6a-1c2177f1ccee tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:25.152843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9dd3fb75-f72c-488b-ad6a-1c2177f1ccee tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:25.296345 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9dd3fb75-f72c-488b-ad6a-1c2177f1ccee tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:25.304897 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9dd3fb75-f72c-488b-ad6a-1c2177f1ccee tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1689 microversion: 2.1 time: 0.169227 Oct 29 04:04:25.305453 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3896/7750] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:25 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:26.047397 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-52efc7da-85bd-466b-9de0-7026f6f41d39 req-8ef2de30-0637-476e-b2d9-0acddaef91ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f17842f-151f-404b-8cc1-ba0e5928864a", "name": "network-vif-deleted", "tag": "4fc1ab57-5685-4ed6-a982-47174de3f57a"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:26.058139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-52efc7da-85bd-466b-9de0-7026f6f41d39 req-8ef2de30-0637-476e-b2d9-0acddaef91ea service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:26.058617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-52efc7da-85bd-466b-9de0-7026f6f41d39 req-8ef2de30-0637-476e-b2d9-0acddaef91ea service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:26.059041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-52efc7da-85bd-466b-9de0-7026f6f41d39 req-8ef2de30-0637-476e-b2d9-0acddaef91ea service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:26.070821 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-52efc7da-85bd-466b-9de0-7026f6f41d39 req-8ef2de30-0637-476e-b2d9-0acddaef91ea service nova] Creating event network-vif-deleted:4fc1ab57-5685-4ed6-a982-47174de3f57a for instance 9f17842f-151f-404b-8cc1-ba0e5928864a on n-h1-862964-4 Oct 29 04:04:26.075957 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-52efc7da-85bd-466b-9de0-7026f6f41d39 req-8ef2de30-0637-476e-b2d9-0acddaef91ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032191 Oct 29 04:04:26.076591 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3855/7751] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:26.329049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:26.329674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:26.336932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:26.337426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:26.337855 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:26.338604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:26.339060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:26.339502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:26.374167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:26.374658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:26.375113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:26.375559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lazy-loading 'fault' on Instance uuid 9f17842f-151f-404b-8cc1-ba0e5928864a {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:04:26.422803 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:26.431321 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5407df5c-a3c8-4c26-ab7f-38ce2f671495 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 200 len: 1356 microversion: 2.1 time: 0.106410 Oct 29 04:04:26.432228 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3897/7752] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:26 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:27.457488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:27.458221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 9f17842f-151f-404b-8cc1-ba0e5928864a] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:27.464988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:27.465505 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:27.466001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:27.466701 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:27.467161 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:27.467594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:27.484144 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] HTTP exception thrown: Instance 9f17842f-151f-404b-8cc1-ba0e5928864a could not be found. Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Request method failure captured: Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a HTTP/1.1 Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKYOzTcTPokSAkJ7f4XHySy1k6FHaxJt61hPLu98Qp40NEKP6gUTLVBNWeiqUtg8Y82ZOUB2ZECIZFhl-B-4mjTqs1i9qLrsG0sW5zEnSZXus52TZUc9XMx2uN5-V0PGULrAaaySwsvVPXqwaCtX4RO99Rzs4Vzmm9HTr1Qz2ff5DrE Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: fef87f25af434ef59f486bcca46f43f3 Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fef87f25af434ef59f486bcca46f43f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fef87f25af434ef59f486bcca46f43f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fef87f25af434ef59f486bcca46f43f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fef87f25af434ef59f486bcca46f43f3"}]}] Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: fef87f25af434ef59f486bcca46f43f3 Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestNetworkAdvancedServerOps-280428214-project Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 24c2655ccbad4be3b3d2fca5f3f01cf9 Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestNetworkAdvancedServerOps-280428214-project Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 9f17842f-151f-404b-8cc1-ba0e5928864a could not be found. Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '9f17842f-151f-404b-8cc1-ba0e5928864a'} Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f17842f-151f-404b-8cc1-ba0e5928864a could not be found. Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f17842f-151f-404b-8cc1-ba0e5928864a could not be found. Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:04:27.485998 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:04:27.491576 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:04:27.491576 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:04:27.491576 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:04:27.491576 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:04:27.491576 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:04:27.491576 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:04:27.491576 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f17842f-151f-404b-8cc1-ba0e5928864a could not be found. Oct 29 04:04:27.491576 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:04:27.491576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Returning 404 to user: Instance 9f17842f-151f-404b-8cc1-ba0e5928864a could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:04:27.491576 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-56056411-b1c9-4ee5-88e5-ef14412cf241 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a" status: 404 len: 111 microversion: 2.1 time: 0.036189 Oct 29 04:04:27.491576 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3856/7753] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:27 2022] GET /compute/v2.1/servers/9f17842f-151f-404b-8cc1-ba0e5928864a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:04:30.849466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e114c807-4a3b-4676-b812-ad406f0ac73a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '.version_select at 0x7fe1a81b5b80>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:30.873753 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e114c807-4a3b-4676-b812-ad406f0ac73a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1134677068" status: 202 len: 0 microversion: 2.1 time: 0.028260 Oct 29 04:04:30.874435 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3898/7754] 10.222.0.16 () {58 vars in 1284 bytes} [Sat Oct 29 04:04:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1134677068 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:04:30.905349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a017b04b-0762-4d75-9242-7e5105cb3c6d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'create', calling method: .version_select at 0x7fe1a96b6b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1457446946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwFjpDgmnkXFV/xPmbfEU4yhcQ6gYrp5z/8KmkKtcE8d0JZHrQj4zqZs4xSUSExhw1Fv+fj32zp6dOF7XN8TCiz8+7hCpy2A/KTSI6ZvjCFS7SipMHbbgujNwfnotVeUA=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:30.925271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a017b04b-0762-4d75-9242-7e5105cb3c6d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for project fef87f25af434ef59f486bcca46f43f3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:04:30.932616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-a017b04b-0762-4d75-9242-7e5105cb3c6d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for user 24c2655ccbad4be3b3d2fca5f3f01cf9 and project fef87f25af434ef59f486bcca46f43f3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:04:30.962631 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a017b04b-0762-4d75-9242-7e5105cb3c6d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.061368 Oct 29 04:04:30.963419 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3857/7755] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 04:04:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:36.673684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-652792208", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "74082896-60fe-4c33-a24f-b4f499916b8e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1457446946", "security_groups": [{"name": "tempest-secgroup-smoke-1857090933"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:36.698022 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:36.806554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] validate_networks() for [('74082896-60fe-4c33-a24f-b4f499916b8e', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:04:37.223346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:04:37.223773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:04:37.224292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:04:37.224699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:04:37.225110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:04:37.234550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:37.235031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:37.235465 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:37.236193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:37.236958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:37.237376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:37.255092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for project fef87f25af434ef59f486bcca46f43f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:04:37.260597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for user 24c2655ccbad4be3b3d2fca5f3f01cf9 and project fef87f25af434ef59f486bcca46f43f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:04:37.274332 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:04:37.276689 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:04:37.326058 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ed72b69d-11bb-48aa-9270-54edad622717 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.657147 Oct 29 04:04:37.327060 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3899/7756] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 04:04:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 04:04:37.340017 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5ad296a-cb74-4d1f-82b5-b121ee2db497 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:37.340576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d5ad296a-cb74-4d1f-82b5-b121ee2db497 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:37.402975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5ad296a-cb74-4d1f-82b5-b121ee2db497 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:37.411008 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5ad296a-cb74-4d1f-82b5-b121ee2db497 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1266 microversion: 2.1 time: 0.076142 Oct 29 04:04:37.412073 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3858/7757] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:37 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:38.449597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-67eb81ae-0f30-4042-97b5-34d78fd7a468 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:38.450867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-67eb81ae-0f30-4042-97b5-34d78fd7a468 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:38.459440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67eb81ae-0f30-4042-97b5-34d78fd7a468 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:38.460209 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67eb81ae-0f30-4042-97b5-34d78fd7a468 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:38.460648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67eb81ae-0f30-4042-97b5-34d78fd7a468 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:38.461346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67eb81ae-0f30-4042-97b5-34d78fd7a468 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:38.461849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67eb81ae-0f30-4042-97b5-34d78fd7a468 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:38.462270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-67eb81ae-0f30-4042-97b5-34d78fd7a468 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:38.550561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-67eb81ae-0f30-4042-97b5-34d78fd7a468 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:38.561419 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-67eb81ae-0f30-4042-97b5-34d78fd7a468 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1326 microversion: 2.1 time: 0.129765 Oct 29 04:04:38.563076 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3900/7758] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:38 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:39.587386 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4e2422c2-484a-4e74-b164-99524fdab7b9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:39.588004 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4e2422c2-484a-4e74-b164-99524fdab7b9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:39.590056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=32 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:39.597387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e2422c2-484a-4e74-b164-99524fdab7b9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:39.597961 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e2422c2-484a-4e74-b164-99524fdab7b9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:39.598583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e2422c2-484a-4e74-b164-99524fdab7b9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:39.599288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e2422c2-484a-4e74-b164-99524fdab7b9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:39.599755 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e2422c2-484a-4e74-b164-99524fdab7b9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:39.600156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e2422c2-484a-4e74-b164-99524fdab7b9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:39.740452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4e2422c2-484a-4e74-b164-99524fdab7b9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:39.748569 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4e2422c2-484a-4e74-b164-99524fdab7b9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1392 microversion: 2.1 time: 0.165167 Oct 29 04:04:39.749237 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3859/7759] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:39 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:40.110576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-974d6983-33e1-437b-8106-0d21c8481360 req-9de59924-e0a3-4547-9acf-6d1c8bb31096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38560daf-1077-497a-a2a8-3a2be9343680", "tag": "d72305df-58fa-451a-83a1-4b82cbcb6d2d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:40.123391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-974d6983-33e1-437b-8106-0d21c8481360 req-9de59924-e0a3-4547-9acf-6d1c8bb31096 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:40.123988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-974d6983-33e1-437b-8106-0d21c8481360 req-9de59924-e0a3-4547-9acf-6d1c8bb31096 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:40.124637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-974d6983-33e1-437b-8106-0d21c8481360 req-9de59924-e0a3-4547-9acf-6d1c8bb31096 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:40.136246 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-974d6983-33e1-437b-8106-0d21c8481360 req-9de59924-e0a3-4547-9acf-6d1c8bb31096 service nova] Creating event network-changed:d72305df-58fa-451a-83a1-4b82cbcb6d2d for instance 38560daf-1077-497a-a2a8-3a2be9343680 on n-h1-862964-4 Oct 29 04:04:40.141744 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-974d6983-33e1-437b-8106-0d21c8481360 req-9de59924-e0a3-4547-9acf-6d1c8bb31096 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036064 Oct 29 04:04:40.142371 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3901/7760] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:40.776769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-24604bb0-c19e-42a2-af61-bd1ad410644d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:40.777676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-24604bb0-c19e-42a2-af61-bd1ad410644d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:40.789665 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24604bb0-c19e-42a2-af61-bd1ad410644d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:40.790555 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24604bb0-c19e-42a2-af61-bd1ad410644d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:40.791306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24604bb0-c19e-42a2-af61-bd1ad410644d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:40.792481 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24604bb0-c19e-42a2-af61-bd1ad410644d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:40.793262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24604bb0-c19e-42a2-af61-bd1ad410644d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:40.794042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-24604bb0-c19e-42a2-af61-bd1ad410644d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:40.939670 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-24604bb0-c19e-42a2-af61-bd1ad410644d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:40.947722 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-24604bb0-c19e-42a2-af61-bd1ad410644d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1392 microversion: 2.1 time: 0.177994 Oct 29 04:04:40.948299 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3860/7761] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:40 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:41.973441 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0ef25a29-ea28-46a1-a7ff-175084b37d12 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:41.974155 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0ef25a29-ea28-46a1-a7ff-175084b37d12 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:41.981640 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ef25a29-ea28-46a1-a7ff-175084b37d12 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:41.982146 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ef25a29-ea28-46a1-a7ff-175084b37d12 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:41.982574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ef25a29-ea28-46a1-a7ff-175084b37d12 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:41.983267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ef25a29-ea28-46a1-a7ff-175084b37d12 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:41.983713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ef25a29-ea28-46a1-a7ff-175084b37d12 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:41.984230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ef25a29-ea28-46a1-a7ff-175084b37d12 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:42.122389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0ef25a29-ea28-46a1-a7ff-175084b37d12 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:42.132105 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0ef25a29-ea28-46a1-a7ff-175084b37d12 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1392 microversion: 2.1 time: 0.162751 Oct 29 04:04:42.132896 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3902/7762] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:41 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:43.162601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-184b7eeb-2a1f-44dc-84b8-55d7210f634b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:43.163626 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-184b7eeb-2a1f-44dc-84b8-55d7210f634b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:43.173759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184b7eeb-2a1f-44dc-84b8-55d7210f634b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:43.174280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184b7eeb-2a1f-44dc-84b8-55d7210f634b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:43.174726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184b7eeb-2a1f-44dc-84b8-55d7210f634b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:43.175426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184b7eeb-2a1f-44dc-84b8-55d7210f634b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:43.175881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184b7eeb-2a1f-44dc-84b8-55d7210f634b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:43.176310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-184b7eeb-2a1f-44dc-84b8-55d7210f634b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:43.316774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-184b7eeb-2a1f-44dc-84b8-55d7210f634b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:43.325349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-184b7eeb-2a1f-44dc-84b8-55d7210f634b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1392 microversion: 2.1 time: 0.169600 Oct 29 04:04:43.325939 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3861/7763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:43 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:44.348503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b9efe785-c72c-4555-8fe0-9d7d6a5fa0da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:44.349245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b9efe785-c72c-4555-8fe0-9d7d6a5fa0da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:44.356457 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9efe785-c72c-4555-8fe0-9d7d6a5fa0da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:44.357013 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9efe785-c72c-4555-8fe0-9d7d6a5fa0da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:44.357498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9efe785-c72c-4555-8fe0-9d7d6a5fa0da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:44.358348 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9efe785-c72c-4555-8fe0-9d7d6a5fa0da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:44.358902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9efe785-c72c-4555-8fe0-9d7d6a5fa0da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:44.359545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b9efe785-c72c-4555-8fe0-9d7d6a5fa0da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:44.497505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b9efe785-c72c-4555-8fe0-9d7d6a5fa0da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:44.506117 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b9efe785-c72c-4555-8fe0-9d7d6a5fa0da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1392 microversion: 2.1 time: 0.161822 Oct 29 04:04:44.506727 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3903/7764] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:44 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:45.532056 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-eda246a1-5fa7-4b3f-a222-261d5db0394d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:45.532702 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-eda246a1-5fa7-4b3f-a222-261d5db0394d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:45.540637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eda246a1-5fa7-4b3f-a222-261d5db0394d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:45.541140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eda246a1-5fa7-4b3f-a222-261d5db0394d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:45.541617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eda246a1-5fa7-4b3f-a222-261d5db0394d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:45.542653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eda246a1-5fa7-4b3f-a222-261d5db0394d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:45.543137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eda246a1-5fa7-4b3f-a222-261d5db0394d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:45.543579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-eda246a1-5fa7-4b3f-a222-261d5db0394d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:45.695637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-eda246a1-5fa7-4b3f-a222-261d5db0394d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:45.703969 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-eda246a1-5fa7-4b3f-a222-261d5db0394d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1392 microversion: 2.1 time: 0.177785 Oct 29 04:04:45.704554 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3862/7765] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:45 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:46.322744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-159e9b86-ef8c-40e8-95e4-1334c2fb75d4 req-3266fa2c-2263-413c-bb86-f1f66dbbe9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38560daf-1077-497a-a2a8-3a2be9343680", "name": "network-vif-plugged", "status": "completed", "tag": "d72305df-58fa-451a-83a1-4b82cbcb6d2d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:46.334302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-159e9b86-ef8c-40e8-95e4-1334c2fb75d4 req-3266fa2c-2263-413c-bb86-f1f66dbbe9bf service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:46.335092 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-159e9b86-ef8c-40e8-95e4-1334c2fb75d4 req-3266fa2c-2263-413c-bb86-f1f66dbbe9bf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:46.335210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-159e9b86-ef8c-40e8-95e4-1334c2fb75d4 req-3266fa2c-2263-413c-bb86-f1f66dbbe9bf service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:46.349958 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-159e9b86-ef8c-40e8-95e4-1334c2fb75d4 req-3266fa2c-2263-413c-bb86-f1f66dbbe9bf service nova] Creating event network-vif-plugged:d72305df-58fa-451a-83a1-4b82cbcb6d2d for instance 38560daf-1077-497a-a2a8-3a2be9343680 on n-h1-862964-4 Oct 29 04:04:46.355137 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-159e9b86-ef8c-40e8-95e4-1334c2fb75d4 req-3266fa2c-2263-413c-bb86-f1f66dbbe9bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036237 Oct 29 04:04:46.355729 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3904/7766] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:46.727369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-00a57e04-18a5-430c-b088-779155bb5d5d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:46.728817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-00a57e04-18a5-430c-b088-779155bb5d5d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:46.736564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00a57e04-18a5-430c-b088-779155bb5d5d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:46.737118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00a57e04-18a5-430c-b088-779155bb5d5d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:46.737566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00a57e04-18a5-430c-b088-779155bb5d5d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:46.738548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00a57e04-18a5-430c-b088-779155bb5d5d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:46.739013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00a57e04-18a5-430c-b088-779155bb5d5d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:46.739447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-00a57e04-18a5-430c-b088-779155bb5d5d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:46.884124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-00a57e04-18a5-430c-b088-779155bb5d5d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:46.896916 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-00a57e04-18a5-430c-b088-779155bb5d5d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1392 microversion: 2.1 time: 0.173556 Oct 29 04:04:46.897780 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3863/7767] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:46 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:47.921476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:47.922383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:47.927725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-365e1316-b441-4a4e-9e8b-7c57518fbcc2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:47.928438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-365e1316-b441-4a4e-9e8b-7c57518fbcc2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:47.935784 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-365e1316-b441-4a4e-9e8b-7c57518fbcc2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:47.936268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-365e1316-b441-4a4e-9e8b-7c57518fbcc2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:47.936703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-365e1316-b441-4a4e-9e8b-7c57518fbcc2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:47.937396 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-365e1316-b441-4a4e-9e8b-7c57518fbcc2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:47.937888 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-365e1316-b441-4a4e-9e8b-7c57518fbcc2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:47.938323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-365e1316-b441-4a4e-9e8b-7c57518fbcc2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:48.079488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-365e1316-b441-4a4e-9e8b-7c57518fbcc2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:48.088761 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-365e1316-b441-4a4e-9e8b-7c57518fbcc2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1564 microversion: 2.1 time: 0.168284 Oct 29 04:04:48.089342 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3905/7768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:47 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:48.111851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3144ef5b-ea7c-4dd7-bb0e-d393a4012aa1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:48.112471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3144ef5b-ea7c-4dd7-bb0e-d393a4012aa1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:48.114462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:48.120851 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3144ef5b-ea7c-4dd7-bb0e-d393a4012aa1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:48.121355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3144ef5b-ea7c-4dd7-bb0e-d393a4012aa1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:48.121796 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3144ef5b-ea7c-4dd7-bb0e-d393a4012aa1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:48.122549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3144ef5b-ea7c-4dd7-bb0e-d393a4012aa1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:48.123012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3144ef5b-ea7c-4dd7-bb0e-d393a4012aa1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:48.123439 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3144ef5b-ea7c-4dd7-bb0e-d393a4012aa1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:48.268028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3144ef5b-ea7c-4dd7-bb0e-d393a4012aa1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:48.276338 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3144ef5b-ea7c-4dd7-bb0e-d393a4012aa1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1564 microversion: 2.1 time: 0.168768 Oct 29 04:04:48.276860 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3864/7769] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:48 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:50.236714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ccd70b5c-9818-4cdc-b47d-ee716722741b req-32144dc0-b1cf-4138-9bea-056c361d2d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38560daf-1077-497a-a2a8-3a2be9343680", "tag": "d72305df-58fa-451a-83a1-4b82cbcb6d2d"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:50.239931 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6dc36d29-85e2-44ff-a080-9c30be11cc2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:50.240535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6dc36d29-85e2-44ff-a080-9c30be11cc2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:50.243349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:50.249355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6dc36d29-85e2-44ff-a080-9c30be11cc2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:50.249956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6dc36d29-85e2-44ff-a080-9c30be11cc2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:50.250127 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:50.251122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6dc36d29-85e2-44ff-a080-9c30be11cc2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:50.252125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6dc36d29-85e2-44ff-a080-9c30be11cc2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:50.252841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6dc36d29-85e2-44ff-a080-9c30be11cc2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:50.253513 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6dc36d29-85e2-44ff-a080-9c30be11cc2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:50.255561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ccd70b5c-9818-4cdc-b47d-ee716722741b req-32144dc0-b1cf-4138-9bea-056c361d2d4a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:50.256121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ccd70b5c-9818-4cdc-b47d-ee716722741b req-32144dc0-b1cf-4138-9bea-056c361d2d4a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:50.256706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ccd70b5c-9818-4cdc-b47d-ee716722741b req-32144dc0-b1cf-4138-9bea-056c361d2d4a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:50.270975 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ccd70b5c-9818-4cdc-b47d-ee716722741b req-32144dc0-b1cf-4138-9bea-056c361d2d4a service nova] Creating event network-changed:d72305df-58fa-451a-83a1-4b82cbcb6d2d for instance 38560daf-1077-497a-a2a8-3a2be9343680 on n-h1-862964-4 Oct 29 04:04:50.277701 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ccd70b5c-9818-4cdc-b47d-ee716722741b req-32144dc0-b1cf-4138-9bea-056c361d2d4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044876 Oct 29 04:04:50.279104 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3865/7770] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:50.585210 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6dc36d29-85e2-44ff-a080-9c30be11cc2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:50.593532 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6dc36d29-85e2-44ff-a080-9c30be11cc2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1564 microversion: 2.1 time: 0.365066 Oct 29 04:04:50.594382 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3906/7771] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:50 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1564 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:11.891132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-150eef07-760a-417b-9927-bfeac4caac47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:05:11.893368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-150eef07-760a-417b-9927-bfeac4caac47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:11.897123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=38 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:11.902939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150eef07-760a-417b-9927-bfeac4caac47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:11.903431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150eef07-760a-417b-9927-bfeac4caac47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:11.903868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150eef07-760a-417b-9927-bfeac4caac47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:11.904565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150eef07-760a-417b-9927-bfeac4caac47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:11.905022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150eef07-760a-417b-9927-bfeac4caac47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:11.905431 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-150eef07-760a-417b-9927-bfeac4caac47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:11.975266 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-150eef07-760a-417b-9927-bfeac4caac47 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680/action" status: 200 len: 24567 microversion: 2.1 time: 0.088423 Oct 29 04:05:11.975953 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3866/7772] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:05:11 2022] POST /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680/action => generated 24567 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:05:18.366036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-863fed19-728e-4f67-8d4f-435dee0bf67a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:05:18.369675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-863fed19-728e-4f67-8d4f-435dee0bf67a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:18.373250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:18.373928 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=36 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:18.379558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-863fed19-728e-4f67-8d4f-435dee0bf67a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:18.380043 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-863fed19-728e-4f67-8d4f-435dee0bf67a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:18.380473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-863fed19-728e-4f67-8d4f-435dee0bf67a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:18.381169 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-863fed19-728e-4f67-8d4f-435dee0bf67a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:18.381615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-863fed19-728e-4f67-8d4f-435dee0bf67a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:18.382042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-863fed19-728e-4f67-8d4f-435dee0bf67a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:18.460662 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-863fed19-728e-4f67-8d4f-435dee0bf67a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680/action" status: 202 len: 0 microversion: 2.1 time: 0.101504 Oct 29 04:05:18.461335 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3907/7773] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:05:18 2022] POST /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:05:18.470346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4824ff80-cc36-4275-b715-aa4adff2a105 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:18.471238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4824ff80-cc36-4275-b715-aa4adff2a105 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:18.478952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4824ff80-cc36-4275-b715-aa4adff2a105 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:18.479477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4824ff80-cc36-4275-b715-aa4adff2a105 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:18.479873 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4824ff80-cc36-4275-b715-aa4adff2a105 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:18.480595 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4824ff80-cc36-4275-b715-aa4adff2a105 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:18.481220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4824ff80-cc36-4275-b715-aa4adff2a105 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:18.481650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4824ff80-cc36-4275-b715-aa4adff2a105 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:18.692498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4824ff80-cc36-4275-b715-aa4adff2a105 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:18.700802 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4824ff80-cc36-4275-b715-aa4adff2a105 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1675 microversion: 2.1 time: 0.234769 Oct 29 04:05:18.701383 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3867/7774] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:18 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:19.731379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9e7c3bf9-e317-4b5c-a4ff-b30082ab7157 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:19.732442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9e7c3bf9-e317-4b5c-a4ff-b30082ab7157 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:19.743529 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e7c3bf9-e317-4b5c-a4ff-b30082ab7157 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:19.744324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e7c3bf9-e317-4b5c-a4ff-b30082ab7157 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:19.745039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e7c3bf9-e317-4b5c-a4ff-b30082ab7157 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:19.746231 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e7c3bf9-e317-4b5c-a4ff-b30082ab7157 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:19.746876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e7c3bf9-e317-4b5c-a4ff-b30082ab7157 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:19.747297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e7c3bf9-e317-4b5c-a4ff-b30082ab7157 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:19.895017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9e7c3bf9-e317-4b5c-a4ff-b30082ab7157 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:19.903155 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9e7c3bf9-e317-4b5c-a4ff-b30082ab7157 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1680 microversion: 2.1 time: 0.180463 Oct 29 04:05:19.903735 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3908/7775] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:19 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:20.943750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4e684529-a1c5-4354-96ec-72941d7ef564 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:20.944785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4e684529-a1c5-4354-96ec-72941d7ef564 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:20.954489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e684529-a1c5-4354-96ec-72941d7ef564 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:20.954994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e684529-a1c5-4354-96ec-72941d7ef564 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:20.955451 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e684529-a1c5-4354-96ec-72941d7ef564 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:20.956170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e684529-a1c5-4354-96ec-72941d7ef564 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:20.956638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e684529-a1c5-4354-96ec-72941d7ef564 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:20.957074 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4e684529-a1c5-4354-96ec-72941d7ef564 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:21.106525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4e684529-a1c5-4354-96ec-72941d7ef564 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:21.115508 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4e684529-a1c5-4354-96ec-72941d7ef564 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1680 microversion: 2.1 time: 0.178571 Oct 29 04:05:21.116085 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3868/7776] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:20 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:22.142333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e97cb501-e138-4c4e-8790-1d5206b1485e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:22.143136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e97cb501-e138-4c4e-8790-1d5206b1485e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:22.153351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e97cb501-e138-4c4e-8790-1d5206b1485e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:22.153831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e97cb501-e138-4c4e-8790-1d5206b1485e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:22.154295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e97cb501-e138-4c4e-8790-1d5206b1485e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:22.154986 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e97cb501-e138-4c4e-8790-1d5206b1485e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:22.155433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e97cb501-e138-4c4e-8790-1d5206b1485e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:22.155862 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e97cb501-e138-4c4e-8790-1d5206b1485e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:22.307100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e97cb501-e138-4c4e-8790-1d5206b1485e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:22.319838 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e97cb501-e138-4c4e-8790-1d5206b1485e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1680 microversion: 2.1 time: 0.183101 Oct 29 04:05:22.320612 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3909/7777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:22 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:23.349654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ff967239-04f2-4db7-a0ac-7df077f84c88 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:23.350688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ff967239-04f2-4db7-a0ac-7df077f84c88 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:23.360058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff967239-04f2-4db7-a0ac-7df077f84c88 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:23.360558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff967239-04f2-4db7-a0ac-7df077f84c88 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:23.361340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff967239-04f2-4db7-a0ac-7df077f84c88 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:23.362092 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff967239-04f2-4db7-a0ac-7df077f84c88 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:23.362564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff967239-04f2-4db7-a0ac-7df077f84c88 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:23.363001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ff967239-04f2-4db7-a0ac-7df077f84c88 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:23.513462 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ff967239-04f2-4db7-a0ac-7df077f84c88 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:23.521429 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ff967239-04f2-4db7-a0ac-7df077f84c88 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1680 microversion: 2.1 time: 0.179064 Oct 29 04:05:23.522023 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3869/7778] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:23 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:24.547150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-91736782-725a-4ecb-ac2a-c4fa6748b1e4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:24.547770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-91736782-725a-4ecb-ac2a-c4fa6748b1e4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:24.554941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91736782-725a-4ecb-ac2a-c4fa6748b1e4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:24.555543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91736782-725a-4ecb-ac2a-c4fa6748b1e4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:24.555979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91736782-725a-4ecb-ac2a-c4fa6748b1e4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:24.556697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91736782-725a-4ecb-ac2a-c4fa6748b1e4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:24.557150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91736782-725a-4ecb-ac2a-c4fa6748b1e4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:24.557570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91736782-725a-4ecb-ac2a-c4fa6748b1e4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:24.699016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-91736782-725a-4ecb-ac2a-c4fa6748b1e4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:24.707991 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-91736782-725a-4ecb-ac2a-c4fa6748b1e4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1680 microversion: 2.1 time: 0.165536 Oct 29 04:05:24.708623 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3910/7779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:24 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:25.736226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4ea77b20-b3f4-452e-8a1f-6d1cb81cfe56 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:25.737245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4ea77b20-b3f4-452e-8a1f-6d1cb81cfe56 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:25.748547 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea77b20-b3f4-452e-8a1f-6d1cb81cfe56 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:25.749039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea77b20-b3f4-452e-8a1f-6d1cb81cfe56 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:25.749476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea77b20-b3f4-452e-8a1f-6d1cb81cfe56 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:25.750211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea77b20-b3f4-452e-8a1f-6d1cb81cfe56 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:25.750662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea77b20-b3f4-452e-8a1f-6d1cb81cfe56 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:25.751089 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4ea77b20-b3f4-452e-8a1f-6d1cb81cfe56 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:25.895762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4ea77b20-b3f4-452e-8a1f-6d1cb81cfe56 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:25.904765 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4ea77b20-b3f4-452e-8a1f-6d1cb81cfe56 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1680 microversion: 2.1 time: 0.175683 Oct 29 04:05:25.905348 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3870/7780] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:25 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:26.931999 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-45edbe24-4d50-4bb4-b9a6-233504632a18 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:26.932896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-45edbe24-4d50-4bb4-b9a6-233504632a18 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:26.943896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45edbe24-4d50-4bb4-b9a6-233504632a18 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:26.944654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45edbe24-4d50-4bb4-b9a6-233504632a18 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:26.945308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45edbe24-4d50-4bb4-b9a6-233504632a18 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:26.946398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45edbe24-4d50-4bb4-b9a6-233504632a18 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:26.947086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45edbe24-4d50-4bb4-b9a6-233504632a18 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:26.947722 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-45edbe24-4d50-4bb4-b9a6-233504632a18 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:27.085365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-45edbe24-4d50-4bb4-b9a6-233504632a18 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:27.093964 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-45edbe24-4d50-4bb4-b9a6-233504632a18 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1680 microversion: 2.1 time: 0.168123 Oct 29 04:05:27.094699 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3911/7781] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:26 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:28.120475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-235d52b6-2548-4669-8c99-f004cca95482 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:28.121094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-235d52b6-2548-4669-8c99-f004cca95482 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:28.128581 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235d52b6-2548-4669-8c99-f004cca95482 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:28.129078 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235d52b6-2548-4669-8c99-f004cca95482 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:28.129524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235d52b6-2548-4669-8c99-f004cca95482 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:28.130267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235d52b6-2548-4669-8c99-f004cca95482 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:28.130731 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235d52b6-2548-4669-8c99-f004cca95482 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:28.131160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-235d52b6-2548-4669-8c99-f004cca95482 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:28.277944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-235d52b6-2548-4669-8c99-f004cca95482 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:28.286146 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-235d52b6-2548-4669-8c99-f004cca95482 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1680 microversion: 2.1 time: 0.170997 Oct 29 04:05:28.286730 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3871/7782] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:28 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:29.392843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5276eb59-bfaa-4aed-9fac-da79fea84440 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:29.393565 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5276eb59-bfaa-4aed-9fac-da79fea84440 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:29.403168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5276eb59-bfaa-4aed-9fac-da79fea84440 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:29.403659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5276eb59-bfaa-4aed-9fac-da79fea84440 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:29.404096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5276eb59-bfaa-4aed-9fac-da79fea84440 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:29.404790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5276eb59-bfaa-4aed-9fac-da79fea84440 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:29.405253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5276eb59-bfaa-4aed-9fac-da79fea84440 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:29.405671 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5276eb59-bfaa-4aed-9fac-da79fea84440 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:29.548609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5276eb59-bfaa-4aed-9fac-da79fea84440 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:29.557823 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5276eb59-bfaa-4aed-9fac-da79fea84440 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1680 microversion: 2.1 time: 0.170600 Oct 29 04:05:29.558753 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3912/7783] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:29 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:30.582424 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-504e6583-2d75-4531-a54a-3d2677d614cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:30.583044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-504e6583-2d75-4531-a54a-3d2677d614cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:30.590723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-504e6583-2d75-4531-a54a-3d2677d614cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:30.591215 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-504e6583-2d75-4531-a54a-3d2677d614cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:30.591654 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-504e6583-2d75-4531-a54a-3d2677d614cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:30.592357 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-504e6583-2d75-4531-a54a-3d2677d614cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:30.592813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-504e6583-2d75-4531-a54a-3d2677d614cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:30.593239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-504e6583-2d75-4531-a54a-3d2677d614cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:30.751239 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-504e6583-2d75-4531-a54a-3d2677d614cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:30.759563 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-504e6583-2d75-4531-a54a-3d2677d614cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1683 microversion: 2.1 time: 0.181145 Oct 29 04:05:30.760133 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3872/7784] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:30 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:54.989902 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4927002a-04eb-4d38-a9e1-074182586545 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:05:54.992574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4927002a-04eb-4d38-a9e1-074182586545 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:54.996034 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=12 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:54.996811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:55.003893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4927002a-04eb-4d38-a9e1-074182586545 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:55.004378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4927002a-04eb-4d38-a9e1-074182586545 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:55.004812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4927002a-04eb-4d38-a9e1-074182586545 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:55.005519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4927002a-04eb-4d38-a9e1-074182586545 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:55.006005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4927002a-04eb-4d38-a9e1-074182586545 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:55.006424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4927002a-04eb-4d38-a9e1-074182586545 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:55.084350 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4927002a-04eb-4d38-a9e1-074182586545 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680/action" status: 200 len: 69065 microversion: 2.1 time: 0.099570 Oct 29 04:05:55.085012 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3913/7785] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:05:54 2022] POST /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680/action => generated 69065 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:06:02.476179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-662cdd46-beda-48be-93ac-3b2172f448d6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:02.476744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-662cdd46-beda-48be-93ac-3b2172f448d6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:02.479036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-11b0a112-043b-439d-b6c0-425612b88339 req-9286ec7e-6a66-483e-a828-21a40ec0f683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38560daf-1077-497a-a2a8-3a2be9343680", "tag": "d72305df-58fa-451a-83a1-4b82cbcb6d2d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:02.479645 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=15 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:02.480282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=40 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:02.487833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-662cdd46-beda-48be-93ac-3b2172f448d6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:02.488753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-662cdd46-beda-48be-93ac-3b2172f448d6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:02.489421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-662cdd46-beda-48be-93ac-3b2172f448d6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:02.490194 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-662cdd46-beda-48be-93ac-3b2172f448d6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:02.490842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-662cdd46-beda-48be-93ac-3b2172f448d6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:02.491275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-662cdd46-beda-48be-93ac-3b2172f448d6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:02.491903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-11b0a112-043b-439d-b6c0-425612b88339 req-9286ec7e-6a66-483e-a828-21a40ec0f683 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:02.492455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-11b0a112-043b-439d-b6c0-425612b88339 req-9286ec7e-6a66-483e-a828-21a40ec0f683 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:02.493165 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-11b0a112-043b-439d-b6c0-425612b88339 req-9286ec7e-6a66-483e-a828-21a40ec0f683 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:02.506633 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-11b0a112-043b-439d-b6c0-425612b88339 req-9286ec7e-6a66-483e-a828-21a40ec0f683 service nova] Creating event network-changed:d72305df-58fa-451a-83a1-4b82cbcb6d2d for instance 38560daf-1077-497a-a2a8-3a2be9343680 on n-h1-862964-4 Oct 29 04:06:02.512184 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-11b0a112-043b-439d-b6c0-425612b88339 req-9286ec7e-6a66-483e-a828-21a40ec0f683 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037728 Oct 29 04:06:02.513065 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3914/7786] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:02.517741 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-662cdd46-beda-48be-93ac-3b2172f448d6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:06:02.609640 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-662cdd46-beda-48be-93ac-3b2172f448d6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "DELETE /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 204 len: 0 microversion: 2.1 time: 0.137385 Oct 29 04:06:02.611466 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3873/7787] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 04:06:02 2022] DELETE /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:06:02.621029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f1d75b82-16b1-4639-8aa5-8989ecd74249 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:02.621869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f1d75b82-16b1-4639-8aa5-8989ecd74249 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:02.628265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1d75b82-16b1-4639-8aa5-8989ecd74249 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:02.628825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1d75b82-16b1-4639-8aa5-8989ecd74249 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:02.629333 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1d75b82-16b1-4639-8aa5-8989ecd74249 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:02.630128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1d75b82-16b1-4639-8aa5-8989ecd74249 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:02.630737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1d75b82-16b1-4639-8aa5-8989ecd74249 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:02.631242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f1d75b82-16b1-4639-8aa5-8989ecd74249 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:02.774677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f1d75b82-16b1-4639-8aa5-8989ecd74249 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:02.782933 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f1d75b82-16b1-4639-8aa5-8989ecd74249 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1689 microversion: 2.1 time: 0.166778 Oct 29 04:06:02.783519 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3915/7788] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:02 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:03.812375 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3bb21c81-4f8b-4566-8451-487ecc440e5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:03.813419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3bb21c81-4f8b-4566-8451-487ecc440e5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:03.822948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb21c81-4f8b-4566-8451-487ecc440e5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:03.823438 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb21c81-4f8b-4566-8451-487ecc440e5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:03.823874 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb21c81-4f8b-4566-8451-487ecc440e5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:03.824567 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb21c81-4f8b-4566-8451-487ecc440e5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:03.825024 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb21c81-4f8b-4566-8451-487ecc440e5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:03.825449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bb21c81-4f8b-4566-8451-487ecc440e5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:03.968070 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3bb21c81-4f8b-4566-8451-487ecc440e5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:03.976410 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3bb21c81-4f8b-4566-8451-487ecc440e5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1689 microversion: 2.1 time: 0.171435 Oct 29 04:06:03.977017 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3874/7789] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:03 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:04.720573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ff0ba224-38c8-43e3-b80a-75e4002d574f req-b112ec5b-bbaa-49a1-b1d1-08ce7f948e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38560daf-1077-497a-a2a8-3a2be9343680", "name": "network-vif-deleted", "tag": "d72305df-58fa-451a-83a1-4b82cbcb6d2d"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:04.731390 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ff0ba224-38c8-43e3-b80a-75e4002d574f req-b112ec5b-bbaa-49a1-b1d1-08ce7f948e3d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:04.731866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ff0ba224-38c8-43e3-b80a-75e4002d574f req-b112ec5b-bbaa-49a1-b1d1-08ce7f948e3d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:04.732289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ff0ba224-38c8-43e3-b80a-75e4002d574f req-b112ec5b-bbaa-49a1-b1d1-08ce7f948e3d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:04.744334 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ff0ba224-38c8-43e3-b80a-75e4002d574f req-b112ec5b-bbaa-49a1-b1d1-08ce7f948e3d service nova] Creating event network-vif-deleted:d72305df-58fa-451a-83a1-4b82cbcb6d2d for instance 38560daf-1077-497a-a2a8-3a2be9343680 on n-h1-862964-4 Oct 29 04:06:04.749436 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ff0ba224-38c8-43e3-b80a-75e4002d574f req-b112ec5b-bbaa-49a1-b1d1-08ce7f948e3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032679 Oct 29 04:06:04.750078 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3916/7790] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:05.001471 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:05.002136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:05.009278 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:05.009786 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:05.010264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:05.010986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:05.011448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:05.011880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:05.045572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:05.046106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:05.046565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:05.047053 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lazy-loading 'fault' on Instance uuid 38560daf-1077-497a-a2a8-3a2be9343680 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:06:05.092096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:05.100561 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c7b6f6d4-97eb-44b2-8bbf-c6a5bb0d3b36 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 200 len: 1356 microversion: 2.1 time: 0.103359 Oct 29 04:06:05.101161 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3875/7791] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:04 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:06.130196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:06.130969 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 38560daf-1077-497a-a2a8-3a2be9343680] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:06.137781 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:06.138293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:06.138727 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:06.139426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:06.139849 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:06.140302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:06.154172 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] HTTP exception thrown: Instance 38560daf-1077-497a-a2a8-3a2be9343680 could not be found. Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Request method failure captured: Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 HTTP/1.1 Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKYOzTcTPokSAkJ7f4XHySy1k6FHaxJt61hPLu98Qp40NEKP6gUTLVBNWeiqUtg8Y82ZOUB2ZECIZFhl-B-4mjTqs1i9qLrsG0sW5zEnSZXus52TZUc9XMx2uN5-V0PGULrAaaySwsvVPXqwaCtX4RO99Rzs4Vzmm9HTr1Qz2ff5DrE Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: fef87f25af434ef59f486bcca46f43f3 Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fef87f25af434ef59f486bcca46f43f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fef87f25af434ef59f486bcca46f43f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fef87f25af434ef59f486bcca46f43f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fef87f25af434ef59f486bcca46f43f3"}]}] Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: fef87f25af434ef59f486bcca46f43f3 Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestNetworkAdvancedServerOps-280428214-project Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 24c2655ccbad4be3b3d2fca5f3f01cf9 Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestNetworkAdvancedServerOps-280428214-project Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 38560daf-1077-497a-a2a8-3a2be9343680 could not be found. Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '38560daf-1077-497a-a2a8-3a2be9343680'} Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38560daf-1077-497a-a2a8-3a2be9343680 could not be found. Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38560daf-1077-497a-a2a8-3a2be9343680 could not be found. Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:06:06.155820 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:06:06.160582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:06:06.160582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:06:06.160582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:06:06.160582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:06:06.160582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:06:06.160582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:06:06.160582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38560daf-1077-497a-a2a8-3a2be9343680 could not be found. Oct 29 04:06:06.160582 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:06:06.160582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Returning 404 to user: Instance 38560daf-1077-497a-a2a8-3a2be9343680 could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:06:06.160582 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-294a6562-f623-409c-8d62-cdfa4401b9c4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680" status: 404 len: 111 microversion: 2.1 time: 0.035586 Oct 29 04:06:06.160582 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3917/7792] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:06 2022] GET /compute/v2.1/servers/38560daf-1077-497a-a2a8-3a2be9343680 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:06:09.545072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-75ab3ec1-a9ee-4d61-ade9-1f40f2d54fab tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '.version_select at 0x7fe1a0672ca0>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:09.569142 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-75ab3ec1-a9ee-4d61-ade9-1f40f2d54fab tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1457446946" status: 202 len: 0 microversion: 2.1 time: 0.027565 Oct 29 04:06:09.569736 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3876/7793] 10.222.0.16 () {58 vars in 1284 bytes} [Sat Oct 29 04:06:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1457446946 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:06:09.603228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9ca314fb-4beb-423c-9b4f-dec42bc5e4e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'create', calling method: .version_select at 0x7fe1a306ca60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2012668739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTAPWGFvU8d2winF6gg3ixVG5zY4MX3iLinkkPdJ9c041fTnVIe4X6qQVQGfN9LxEEoNzscZ/S43/ROorlXm/XidR2LI2XPQxeqsX6r4247QKDl8p664b4lVSQYxDxwjA=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:09.621550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9ca314fb-4beb-423c-9b4f-dec42bc5e4e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for project fef87f25af434ef59f486bcca46f43f3. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:06:09.627138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-9ca314fb-4beb-423c-9b4f-dec42bc5e4e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for user 24c2655ccbad4be3b3d2fca5f3f01cf9 and project fef87f25af434ef59f486bcca46f43f3. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:06:09.652119 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9ca314fb-4beb-423c-9b4f-dec42bc5e4e9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053700 Oct 29 04:06:09.652729 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3918/7794] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 04:06:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:15.489303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-235603918", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "a6bf3a7c-60a0-4086-a052-a092d2865d2f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2012668739", "security_groups": [{"name": "tempest-secgroup-smoke-367509842"}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:15.502638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:15.623276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] validate_networks() for [('a6bf3a7c-60a0-4086-a052-a092d2865d2f', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:06:16.026565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:06:16.026983 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:06:16.027660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:06:16.028072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:06:16.028484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:06:16.043157 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:16.043758 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:16.044452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:16.045401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:16.046087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:16.046913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:16.066167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for project fef87f25af434ef59f486bcca46f43f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:06:16.071678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for user 24c2655ccbad4be3b3d2fca5f3f01cf9 and project fef87f25af434ef59f486bcca46f43f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:06:16.085666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:06:16.088059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:06:16.135960 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-649bbd85-a9c7-4919-96e4-182b93f8d76d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.650887 Oct 29 04:06:16.142860 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3877/7795] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 04:06:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:06:16.146118 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=16 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:16.150290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-56d2b359-7db2-49c0-b4ec-40a922d3e7db tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:16.150920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-56d2b359-7db2-49c0-b4ec-40a922d3e7db tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:16.233104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-56d2b359-7db2-49c0-b4ec-40a922d3e7db tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:16.241330 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-56d2b359-7db2-49c0-b4ec-40a922d3e7db tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1266 microversion: 2.1 time: 0.097102 Oct 29 04:06:16.242260 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3919/7796] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:16 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:17.263811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-754d3bf7-027d-4873-bc3e-8f7adcd0f19a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:17.264444 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-754d3bf7-027d-4873-bc3e-8f7adcd0f19a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:17.276306 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-754d3bf7-027d-4873-bc3e-8f7adcd0f19a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:17.276969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-754d3bf7-027d-4873-bc3e-8f7adcd0f19a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:17.277535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-754d3bf7-027d-4873-bc3e-8f7adcd0f19a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:17.279544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-754d3bf7-027d-4873-bc3e-8f7adcd0f19a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:17.280165 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-754d3bf7-027d-4873-bc3e-8f7adcd0f19a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:17.280676 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-754d3bf7-027d-4873-bc3e-8f7adcd0f19a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:17.627739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-754d3bf7-027d-4873-bc3e-8f7adcd0f19a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:17.637935 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-754d3bf7-027d-4873-bc3e-8f7adcd0f19a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1326 microversion: 2.1 time: 0.376972 Oct 29 04:06:17.638633 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3878/7797] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:17 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1326 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:18.662383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f6ad8fac-a7bb-4251-91fc-12f64b978e97 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:18.663585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f6ad8fac-a7bb-4251-91fc-12f64b978e97 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:18.674128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ad8fac-a7bb-4251-91fc-12f64b978e97 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:18.674762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ad8fac-a7bb-4251-91fc-12f64b978e97 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:18.675302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ad8fac-a7bb-4251-91fc-12f64b978e97 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:18.676087 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ad8fac-a7bb-4251-91fc-12f64b978e97 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:18.676620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ad8fac-a7bb-4251-91fc-12f64b978e97 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:18.677341 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6ad8fac-a7bb-4251-91fc-12f64b978e97 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:18.821696 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f6ad8fac-a7bb-4251-91fc-12f64b978e97 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:18.830357 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f6ad8fac-a7bb-4251-91fc-12f64b978e97 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1391 microversion: 2.1 time: 0.172160 Oct 29 04:06:18.830921 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3920/7798] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:18 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:18.961174 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-090e7b8c-14ee-4310-8ae5-0ce7e94cc560 req-19489329-0566-4d5d-8807-57f744db19d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060892ed-f669-472f-aa43-23b8ca74f45d", "tag": "07213c07-586a-42c7-8935-70b3497204c7"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:18.971100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-090e7b8c-14ee-4310-8ae5-0ce7e94cc560 req-19489329-0566-4d5d-8807-57f744db19d0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:18.971638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-090e7b8c-14ee-4310-8ae5-0ce7e94cc560 req-19489329-0566-4d5d-8807-57f744db19d0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:18.972102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-090e7b8c-14ee-4310-8ae5-0ce7e94cc560 req-19489329-0566-4d5d-8807-57f744db19d0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:18.983818 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-090e7b8c-14ee-4310-8ae5-0ce7e94cc560 req-19489329-0566-4d5d-8807-57f744db19d0 service nova] Creating event network-changed:07213c07-586a-42c7-8935-70b3497204c7 for instance 060892ed-f669-472f-aa43-23b8ca74f45d on n-h1-862964-4 Oct 29 04:06:18.989349 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-090e7b8c-14ee-4310-8ae5-0ce7e94cc560 req-19489329-0566-4d5d-8807-57f744db19d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100267 Oct 29 04:06:18.990032 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3879/7799] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:19.858250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9298e14d-d4ca-46d5-8e75-48ad08350afc tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:19.859242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9298e14d-d4ca-46d5-8e75-48ad08350afc tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:19.868927 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9298e14d-d4ca-46d5-8e75-48ad08350afc tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:19.869410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9298e14d-d4ca-46d5-8e75-48ad08350afc tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:19.869842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9298e14d-d4ca-46d5-8e75-48ad08350afc tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:19.870561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9298e14d-d4ca-46d5-8e75-48ad08350afc tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:19.871007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9298e14d-d4ca-46d5-8e75-48ad08350afc tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:19.871426 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9298e14d-d4ca-46d5-8e75-48ad08350afc tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:20.002817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9298e14d-d4ca-46d5-8e75-48ad08350afc tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:20.010889 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9298e14d-d4ca-46d5-8e75-48ad08350afc tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1391 microversion: 2.1 time: 0.159153 Oct 29 04:06:20.011463 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3921/7800] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:19 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:21.040805 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4911c0da-56d9-4297-b691-eeaef0863b65 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:21.042028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4911c0da-56d9-4297-b691-eeaef0863b65 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:21.052687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4911c0da-56d9-4297-b691-eeaef0863b65 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:21.053187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4911c0da-56d9-4297-b691-eeaef0863b65 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:21.053638 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4911c0da-56d9-4297-b691-eeaef0863b65 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:21.054382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4911c0da-56d9-4297-b691-eeaef0863b65 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:21.054849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4911c0da-56d9-4297-b691-eeaef0863b65 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:21.055260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4911c0da-56d9-4297-b691-eeaef0863b65 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:21.193570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-4911c0da-56d9-4297-b691-eeaef0863b65 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:21.201660 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4911c0da-56d9-4297-b691-eeaef0863b65 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1391 microversion: 2.1 time: 0.169733 Oct 29 04:06:21.202329 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3880/7801] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:21 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:22.227577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9e5ee0ad-81d5-43b7-8481-7ce9f24d72a9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:22.228294 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9e5ee0ad-81d5-43b7-8481-7ce9f24d72a9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:22.236982 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e5ee0ad-81d5-43b7-8481-7ce9f24d72a9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:22.237545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e5ee0ad-81d5-43b7-8481-7ce9f24d72a9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:22.238096 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e5ee0ad-81d5-43b7-8481-7ce9f24d72a9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:22.238899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e5ee0ad-81d5-43b7-8481-7ce9f24d72a9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:22.239436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e5ee0ad-81d5-43b7-8481-7ce9f24d72a9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:22.239911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9e5ee0ad-81d5-43b7-8481-7ce9f24d72a9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:22.375322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9e5ee0ad-81d5-43b7-8481-7ce9f24d72a9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:22.383514 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9e5ee0ad-81d5-43b7-8481-7ce9f24d72a9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1391 microversion: 2.1 time: 0.161281 Oct 29 04:06:22.384097 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3922/7802] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:22 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:23.407967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-663ed8c3-ff9d-4f98-8e1b-e74d8c655bfd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:23.408586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-663ed8c3-ff9d-4f98-8e1b-e74d8c655bfd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:23.415734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-663ed8c3-ff9d-4f98-8e1b-e74d8c655bfd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:23.416241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-663ed8c3-ff9d-4f98-8e1b-e74d8c655bfd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:23.416724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-663ed8c3-ff9d-4f98-8e1b-e74d8c655bfd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:23.417433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-663ed8c3-ff9d-4f98-8e1b-e74d8c655bfd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:23.418363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-663ed8c3-ff9d-4f98-8e1b-e74d8c655bfd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:23.418876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-663ed8c3-ff9d-4f98-8e1b-e74d8c655bfd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:23.556065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-663ed8c3-ff9d-4f98-8e1b-e74d8c655bfd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:23.564270 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-663ed8c3-ff9d-4f98-8e1b-e74d8c655bfd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1391 microversion: 2.1 time: 0.160569 Oct 29 04:06:23.564832 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3881/7803] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:23 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:24.588151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-461f288d-821f-41e6-988c-e0b3e34e6f82 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:24.588770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-461f288d-821f-41e6-988c-e0b3e34e6f82 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:24.596183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461f288d-821f-41e6-988c-e0b3e34e6f82 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:24.596687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461f288d-821f-41e6-988c-e0b3e34e6f82 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:24.597102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461f288d-821f-41e6-988c-e0b3e34e6f82 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:24.597794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461f288d-821f-41e6-988c-e0b3e34e6f82 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:24.598279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461f288d-821f-41e6-988c-e0b3e34e6f82 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:24.598732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-461f288d-821f-41e6-988c-e0b3e34e6f82 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:24.738149 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-461f288d-821f-41e6-988c-e0b3e34e6f82 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:24.746205 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-461f288d-821f-41e6-988c-e0b3e34e6f82 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1391 microversion: 2.1 time: 0.162112 Oct 29 04:06:24.761707 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3923/7804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:24 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:24.795846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-8be53989-bec5-4a60-93a5-db01b1098af7 req-35b9e274-a2e5-4c3b-a60f-3c4fd304314d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060892ed-f669-472f-aa43-23b8ca74f45d", "name": "network-vif-plugged", "status": "completed", "tag": "07213c07-586a-42c7-8935-70b3497204c7"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:24.806671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8be53989-bec5-4a60-93a5-db01b1098af7 req-35b9e274-a2e5-4c3b-a60f-3c4fd304314d service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:24.807166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8be53989-bec5-4a60-93a5-db01b1098af7 req-35b9e274-a2e5-4c3b-a60f-3c4fd304314d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:24.807606 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-8be53989-bec5-4a60-93a5-db01b1098af7 req-35b9e274-a2e5-4c3b-a60f-3c4fd304314d service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:24.819734 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-8be53989-bec5-4a60-93a5-db01b1098af7 req-35b9e274-a2e5-4c3b-a60f-3c4fd304314d service nova] Creating event network-vif-plugged:07213c07-586a-42c7-8935-70b3497204c7 for instance 060892ed-f669-472f-aa43-23b8ca74f45d on n-h1-862964-4 Oct 29 04:06:24.825441 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-8be53989-bec5-4a60-93a5-db01b1098af7 req-35b9e274-a2e5-4c3b-a60f-3c4fd304314d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033146 Oct 29 04:06:24.826316 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3882/7805] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:25.773604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-17e9314f-081d-4912-9a88-08d97f67eaf7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:25.774279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-17e9314f-081d-4912-9a88-08d97f67eaf7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:25.777121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:25.782983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17e9314f-081d-4912-9a88-08d97f67eaf7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:25.783496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17e9314f-081d-4912-9a88-08d97f67eaf7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:25.783958 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17e9314f-081d-4912-9a88-08d97f67eaf7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:25.784698 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17e9314f-081d-4912-9a88-08d97f67eaf7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:25.785174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17e9314f-081d-4912-9a88-08d97f67eaf7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:25.785654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-17e9314f-081d-4912-9a88-08d97f67eaf7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:25.932762 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-17e9314f-081d-4912-9a88-08d97f67eaf7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:25.941129 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-17e9314f-081d-4912-9a88-08d97f67eaf7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1391 microversion: 2.1 time: 0.173932 Oct 29 04:06:25.941998 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3924/7806] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:25 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:26.967449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3987a8bc-d905-4bfa-bf5a-4fa44f8dd3da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:26.968282 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3987a8bc-d905-4bfa-bf5a-4fa44f8dd3da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:26.971575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:26.972355 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:26.980126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3987a8bc-d905-4bfa-bf5a-4fa44f8dd3da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:26.980636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3987a8bc-d905-4bfa-bf5a-4fa44f8dd3da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:26.981205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3987a8bc-d905-4bfa-bf5a-4fa44f8dd3da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:26.982150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3987a8bc-d905-4bfa-bf5a-4fa44f8dd3da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:26.982717 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3987a8bc-d905-4bfa-bf5a-4fa44f8dd3da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:26.983221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3987a8bc-d905-4bfa-bf5a-4fa44f8dd3da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:27.124598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3987a8bc-d905-4bfa-bf5a-4fa44f8dd3da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:27.134194 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3987a8bc-d905-4bfa-bf5a-4fa44f8dd3da tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1563 microversion: 2.1 time: 0.172028 Oct 29 04:06:27.134796 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3883/7807] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:26 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:27.157073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-490073d1-4748-4f03-9da2-1a3826fad124 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:27.157687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-490073d1-4748-4f03-9da2-1a3826fad124 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:27.159741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:27.166070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-490073d1-4748-4f03-9da2-1a3826fad124 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:27.166556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-490073d1-4748-4f03-9da2-1a3826fad124 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:27.166993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-490073d1-4748-4f03-9da2-1a3826fad124 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:27.167695 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-490073d1-4748-4f03-9da2-1a3826fad124 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:27.168147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-490073d1-4748-4f03-9da2-1a3826fad124 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:27.168570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-490073d1-4748-4f03-9da2-1a3826fad124 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:27.313836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-490073d1-4748-4f03-9da2-1a3826fad124 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:27.321828 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-490073d1-4748-4f03-9da2-1a3826fad124 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1563 microversion: 2.1 time: 0.168714 Oct 29 04:06:27.322411 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3925/7808] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:27 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:28.965548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-64d29691-ce1a-40f6-866f-a7543009f33e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:28.966944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-64d29691-ce1a-40f6-866f-a7543009f33e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:28.974647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64d29691-ce1a-40f6-866f-a7543009f33e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:28.975494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64d29691-ce1a-40f6-866f-a7543009f33e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:28.975967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64d29691-ce1a-40f6-866f-a7543009f33e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:28.976704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64d29691-ce1a-40f6-866f-a7543009f33e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:28.977182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64d29691-ce1a-40f6-866f-a7543009f33e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:28.977622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-64d29691-ce1a-40f6-866f-a7543009f33e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:29.030173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-30efe4b1-b549-409e-a814-7c09753a9393 req-ac440f05-93ed-4cc6-a975-5976c0752c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060892ed-f669-472f-aa43-23b8ca74f45d", "tag": "07213c07-586a-42c7-8935-70b3497204c7"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:29.042647 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-30efe4b1-b549-409e-a814-7c09753a9393 req-ac440f05-93ed-4cc6-a975-5976c0752c10 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:29.043425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-30efe4b1-b549-409e-a814-7c09753a9393 req-ac440f05-93ed-4cc6-a975-5976c0752c10 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:29.044007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-30efe4b1-b549-409e-a814-7c09753a9393 req-ac440f05-93ed-4cc6-a975-5976c0752c10 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:29.064231 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-30efe4b1-b549-409e-a814-7c09753a9393 req-ac440f05-93ed-4cc6-a975-5976c0752c10 service nova] Creating event network-changed:07213c07-586a-42c7-8935-70b3497204c7 for instance 060892ed-f669-472f-aa43-23b8ca74f45d on n-h1-862964-4 Oct 29 04:06:29.072371 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-30efe4b1-b549-409e-a814-7c09753a9393 req-ac440f05-93ed-4cc6-a975-5976c0752c10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108491 Oct 29 04:06:29.073296 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3926/7809] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:29.136302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-64d29691-ce1a-40f6-866f-a7543009f33e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:29.144744 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-64d29691-ce1a-40f6-866f-a7543009f33e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1563 microversion: 2.1 time: 0.184448 Oct 29 04:06:29.145832 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3884/7810] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:28 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:50.425339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5edb8b81-13f6-4476-93d8-ef83c0d62656 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:50.427663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5edb8b81-13f6-4476-93d8-ef83c0d62656 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:50.430639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=5 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:50.431280 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=38 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:50.439346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5edb8b81-13f6-4476-93d8-ef83c0d62656 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:50.439838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5edb8b81-13f6-4476-93d8-ef83c0d62656 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:50.440266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5edb8b81-13f6-4476-93d8-ef83c0d62656 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:50.440966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5edb8b81-13f6-4476-93d8-ef83c0d62656 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:50.441410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5edb8b81-13f6-4476-93d8-ef83c0d62656 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:50.441845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5edb8b81-13f6-4476-93d8-ef83c0d62656 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:50.652382 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5edb8b81-13f6-4476-93d8-ef83c0d62656 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d/action" status: 200 len: 24575 microversion: 2.1 time: 0.232179 Oct 29 04:06:50.653074 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3927/7811] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:06:50 2022] POST /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d/action => generated 24575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:07:01.680532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:01.683568 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:01.686601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:01.687494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=36 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:01.695540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:01.696063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:01.696508 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:01.697216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:01.697680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:01.698143 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:01.742799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:01.748845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Old instance type m1.heat2, new instance type m1.heat {{(pid=127041) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 04:07:01.755943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:07:01.756392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:07:01.756843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:07:01.757256 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:07:01.757728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:07:01.830613 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-971f2724-69f9-4927-864a-c5a520d9c4ec tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d/action" status: 202 len: 0 microversion: 2.1 time: 0.156289 Oct 29 04:07:01.831295 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3885/7812] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:07:01 2022] POST /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:07:01.840705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-90d0cfb8-51b7-4338-a017-db4ba381ec5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:01.841833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-90d0cfb8-51b7-4338-a017-db4ba381ec5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:01.844537 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:07:01.844701 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 04:07:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d (ip 10.222.0.16) !!! Oct 29 04:07:01.846085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:01.846974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:01.856904 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0cfb8-51b7-4338-a017-db4ba381ec5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:01.857519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0cfb8-51b7-4338-a017-db4ba381ec5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:01.857996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0cfb8-51b7-4338-a017-db4ba381ec5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:01.858697 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0cfb8-51b7-4338-a017-db4ba381ec5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:01.859232 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0cfb8-51b7-4338-a017-db4ba381ec5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:01.859571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-90d0cfb8-51b7-4338-a017-db4ba381ec5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:02.001436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-90d0cfb8-51b7-4338-a017-db4ba381ec5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:02.009845 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-90d0cfb8-51b7-4338-a017-db4ba381ec5b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1690 microversion: 2.1 time: 0.173595 Oct 29 04:07:02.010443 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3928/7813] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:01 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:03.038304 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-03a161b7-6b10-487b-9ba9-2d9ba5207595 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:03.038986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-03a161b7-6b10-487b-9ba9-2d9ba5207595 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:03.047189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a161b7-6b10-487b-9ba9-2d9ba5207595 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:03.047746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a161b7-6b10-487b-9ba9-2d9ba5207595 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:03.048249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a161b7-6b10-487b-9ba9-2d9ba5207595 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:03.049071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a161b7-6b10-487b-9ba9-2d9ba5207595 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:03.049589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a161b7-6b10-487b-9ba9-2d9ba5207595 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:03.050085 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-03a161b7-6b10-487b-9ba9-2d9ba5207595 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:03.191742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-03a161b7-6b10-487b-9ba9-2d9ba5207595 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:03.204139 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-03a161b7-6b10-487b-9ba9-2d9ba5207595 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1690 microversion: 2.1 time: 0.171743 Oct 29 04:07:03.204903 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3886/7814] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:03 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:04.239355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0c873b41-6794-4a07-836a-4bcaec140e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:04.240062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0c873b41-6794-4a07-836a-4bcaec140e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:04.248337 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c873b41-6794-4a07-836a-4bcaec140e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:04.248879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c873b41-6794-4a07-836a-4bcaec140e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:04.249365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c873b41-6794-4a07-836a-4bcaec140e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:04.250188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c873b41-6794-4a07-836a-4bcaec140e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:04.250691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c873b41-6794-4a07-836a-4bcaec140e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:04.251161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0c873b41-6794-4a07-836a-4bcaec140e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:04.396876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0c873b41-6794-4a07-836a-4bcaec140e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:04.408303 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0c873b41-6794-4a07-836a-4bcaec140e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1690 microversion: 2.1 time: 0.175965 Oct 29 04:07:04.408974 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3929/7815] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:04 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:05.436870 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-59f8a764-f17b-417f-b7fe-d60e94bc0661 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:05.437926 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-59f8a764-f17b-417f-b7fe-d60e94bc0661 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:05.447020 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f8a764-f17b-417f-b7fe-d60e94bc0661 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:05.447523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f8a764-f17b-417f-b7fe-d60e94bc0661 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:05.447969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f8a764-f17b-417f-b7fe-d60e94bc0661 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:05.448688 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f8a764-f17b-417f-b7fe-d60e94bc0661 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:05.449151 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f8a764-f17b-417f-b7fe-d60e94bc0661 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:05.449593 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-59f8a764-f17b-417f-b7fe-d60e94bc0661 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:05.596068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-59f8a764-f17b-417f-b7fe-d60e94bc0661 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:05.604253 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-59f8a764-f17b-417f-b7fe-d60e94bc0661 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1690 microversion: 2.1 time: 0.174278 Oct 29 04:07:05.604834 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3887/7816] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:05 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:06.629069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-3583d4d2-32d3-41cc-b6ff-c2828377d2d5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:06.629630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-3583d4d2-32d3-41cc-b6ff-c2828377d2d5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:06.637930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3583d4d2-32d3-41cc-b6ff-c2828377d2d5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:06.638406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3583d4d2-32d3-41cc-b6ff-c2828377d2d5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:06.639098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3583d4d2-32d3-41cc-b6ff-c2828377d2d5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:06.639788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3583d4d2-32d3-41cc-b6ff-c2828377d2d5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:06.640234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3583d4d2-32d3-41cc-b6ff-c2828377d2d5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:06.640646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-3583d4d2-32d3-41cc-b6ff-c2828377d2d5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:06.784353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-3583d4d2-32d3-41cc-b6ff-c2828377d2d5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:06.792744 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-3583d4d2-32d3-41cc-b6ff-c2828377d2d5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1690 microversion: 2.1 time: 0.167974 Oct 29 04:07:06.793359 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3930/7817] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:06 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:07.817028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1fefc2d1-b524-4937-a021-5fe3f075c103 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:07.817578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1fefc2d1-b524-4937-a021-5fe3f075c103 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:07.824719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fefc2d1-b524-4937-a021-5fe3f075c103 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:07.825213 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fefc2d1-b524-4937-a021-5fe3f075c103 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:07.825659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fefc2d1-b524-4937-a021-5fe3f075c103 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:07.826409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fefc2d1-b524-4937-a021-5fe3f075c103 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:07.826864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fefc2d1-b524-4937-a021-5fe3f075c103 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:07.827277 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1fefc2d1-b524-4937-a021-5fe3f075c103 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:08.043091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1fefc2d1-b524-4937-a021-5fe3f075c103 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:08.051333 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1fefc2d1-b524-4937-a021-5fe3f075c103 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1690 microversion: 2.1 time: 0.238515 Oct 29 04:07:08.051891 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3888/7818] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:07 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1690 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:09.079055 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b2251a2d-84e3-4846-b607-e8e159a1bab1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:09.080219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b2251a2d-84e3-4846-b607-e8e159a1bab1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:09.093276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2251a2d-84e3-4846-b607-e8e159a1bab1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:09.094190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2251a2d-84e3-4846-b607-e8e159a1bab1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:09.095102 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2251a2d-84e3-4846-b607-e8e159a1bab1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:09.096301 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2251a2d-84e3-4846-b607-e8e159a1bab1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:09.097412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2251a2d-84e3-4846-b607-e8e159a1bab1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:09.098234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b2251a2d-84e3-4846-b607-e8e159a1bab1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:09.238206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b2251a2d-84e3-4846-b607-e8e159a1bab1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:09.246595 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b2251a2d-84e3-4846-b607-e8e159a1bab1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1695 microversion: 2.1 time: 0.174297 Oct 29 04:07:09.247245 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3931/7819] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:09 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:10.275519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-afc0807c-72c8-4a8d-bbe5-ece7c6243713 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:10.276499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-afc0807c-72c8-4a8d-bbe5-ece7c6243713 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:10.287995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afc0807c-72c8-4a8d-bbe5-ece7c6243713 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:10.288822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afc0807c-72c8-4a8d-bbe5-ece7c6243713 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:10.289579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afc0807c-72c8-4a8d-bbe5-ece7c6243713 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:10.290807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afc0807c-72c8-4a8d-bbe5-ece7c6243713 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:10.291586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afc0807c-72c8-4a8d-bbe5-ece7c6243713 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:10.292318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-afc0807c-72c8-4a8d-bbe5-ece7c6243713 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:10.438311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-afc0807c-72c8-4a8d-bbe5-ece7c6243713 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:10.446792 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-afc0807c-72c8-4a8d-bbe5-ece7c6243713 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1695 microversion: 2.1 time: 0.178395 Oct 29 04:07:10.447349 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3889/7820] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:10 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1695 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:11.483612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-efeacf2f-5ed5-4ce5-8faa-c49971138e83 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:11.484558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-efeacf2f-5ed5-4ce5-8faa-c49971138e83 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:11.496423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efeacf2f-5ed5-4ce5-8faa-c49971138e83 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:11.497244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efeacf2f-5ed5-4ce5-8faa-c49971138e83 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:11.498024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efeacf2f-5ed5-4ce5-8faa-c49971138e83 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:11.499164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efeacf2f-5ed5-4ce5-8faa-c49971138e83 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:11.499912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efeacf2f-5ed5-4ce5-8faa-c49971138e83 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:11.500614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-efeacf2f-5ed5-4ce5-8faa-c49971138e83 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:11.642683 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-efeacf2f-5ed5-4ce5-8faa-c49971138e83 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:11.652303 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-efeacf2f-5ed5-4ce5-8faa-c49971138e83 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1695 microversion: 2.1 time: 0.175265 Oct 29 04:07:11.652918 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3932/7821] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:11 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:12.679663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-5f2f4084-cec7-4c64-964f-3f0be267c4e1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:12.680716 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-5f2f4084-cec7-4c64-964f-3f0be267c4e1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:12.693318 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f2f4084-cec7-4c64-964f-3f0be267c4e1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:12.694198 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f2f4084-cec7-4c64-964f-3f0be267c4e1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:12.694865 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f2f4084-cec7-4c64-964f-3f0be267c4e1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:12.695650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f2f4084-cec7-4c64-964f-3f0be267c4e1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:12.696250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f2f4084-cec7-4c64-964f-3f0be267c4e1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:12.696554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-5f2f4084-cec7-4c64-964f-3f0be267c4e1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:12.837298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-5f2f4084-cec7-4c64-964f-3f0be267c4e1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:12.845325 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-5f2f4084-cec7-4c64-964f-3f0be267c4e1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1695 microversion: 2.1 time: 0.172564 Oct 29 04:07:12.845968 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3890/7822] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:12 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:13.872912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5afeb444-f70e-4201-b8b3-84ff487a461f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:13.873659 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5afeb444-f70e-4201-b8b3-84ff487a461f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:13.885041 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5afeb444-f70e-4201-b8b3-84ff487a461f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:13.885837 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5afeb444-f70e-4201-b8b3-84ff487a461f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:13.886556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5afeb444-f70e-4201-b8b3-84ff487a461f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:13.887675 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5afeb444-f70e-4201-b8b3-84ff487a461f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:13.888432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5afeb444-f70e-4201-b8b3-84ff487a461f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:13.889094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5afeb444-f70e-4201-b8b3-84ff487a461f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:14.035391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5afeb444-f70e-4201-b8b3-84ff487a461f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:14.044281 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5afeb444-f70e-4201-b8b3-84ff487a461f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1695 microversion: 2.1 time: 0.177336 Oct 29 04:07:14.044881 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3933/7823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:13 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:15.071848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-de41881a-7ea2-4ed9-8bb9-9479b84f4295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:15.072577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-de41881a-7ea2-4ed9-8bb9-9479b84f4295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:15.081783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de41881a-7ea2-4ed9-8bb9-9479b84f4295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:15.082450 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de41881a-7ea2-4ed9-8bb9-9479b84f4295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:15.082998 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de41881a-7ea2-4ed9-8bb9-9479b84f4295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:15.083942 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de41881a-7ea2-4ed9-8bb9-9479b84f4295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:15.084507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de41881a-7ea2-4ed9-8bb9-9479b84f4295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:15.085039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-de41881a-7ea2-4ed9-8bb9-9479b84f4295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:15.230668 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-de41881a-7ea2-4ed9-8bb9-9479b84f4295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:15.239410 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-de41881a-7ea2-4ed9-8bb9-9479b84f4295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1695 microversion: 2.1 time: 0.173282 Oct 29 04:07:15.239982 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3891/7824] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:15 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:16.267176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-feed8e31-3736-4db5-80c3-3cfd816903c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:16.268335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-feed8e31-3736-4db5-80c3-3cfd816903c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:16.276765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feed8e31-3736-4db5-80c3-3cfd816903c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:16.277243 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feed8e31-3736-4db5-80c3-3cfd816903c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:16.277668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feed8e31-3736-4db5-80c3-3cfd816903c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:16.278378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feed8e31-3736-4db5-80c3-3cfd816903c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:16.278819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feed8e31-3736-4db5-80c3-3cfd816903c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:16.279235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-feed8e31-3736-4db5-80c3-3cfd816903c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:16.419383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-feed8e31-3736-4db5-80c3-3cfd816903c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:16.427851 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-feed8e31-3736-4db5-80c3-3cfd816903c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1695 microversion: 2.1 time: 0.167171 Oct 29 04:07:16.428417 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3934/7825] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:16 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:17.453190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9e2fd37d-8913-4ac8-ad5e-03b54a7ceb78 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:17.454094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9e2fd37d-8913-4ac8-ad5e-03b54a7ceb78 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:17.463245 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e2fd37d-8913-4ac8-ad5e-03b54a7ceb78 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:17.463864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e2fd37d-8913-4ac8-ad5e-03b54a7ceb78 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:17.464420 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e2fd37d-8913-4ac8-ad5e-03b54a7ceb78 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:17.465295 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e2fd37d-8913-4ac8-ad5e-03b54a7ceb78 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:17.465858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e2fd37d-8913-4ac8-ad5e-03b54a7ceb78 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:17.466433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9e2fd37d-8913-4ac8-ad5e-03b54a7ceb78 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:17.605559 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9e2fd37d-8913-4ac8-ad5e-03b54a7ceb78 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:17.614076 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9e2fd37d-8913-4ac8-ad5e-03b54a7ceb78 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1695 microversion: 2.1 time: 0.165759 Oct 29 04:07:17.614712 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3892/7826] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:17 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:18.639153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6a24aed1-5d5a-4de9-adb8-24ac86a8b707 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:18.641080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6a24aed1-5d5a-4de9-adb8-24ac86a8b707 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:18.647050 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a24aed1-5d5a-4de9-adb8-24ac86a8b707 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:18.647543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a24aed1-5d5a-4de9-adb8-24ac86a8b707 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:18.647972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a24aed1-5d5a-4de9-adb8-24ac86a8b707 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:18.648676 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a24aed1-5d5a-4de9-adb8-24ac86a8b707 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:18.649128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a24aed1-5d5a-4de9-adb8-24ac86a8b707 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:18.649550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6a24aed1-5d5a-4de9-adb8-24ac86a8b707 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:18.786372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6a24aed1-5d5a-4de9-adb8-24ac86a8b707 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:18.794937 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6a24aed1-5d5a-4de9-adb8-24ac86a8b707 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1695 microversion: 2.1 time: 0.160806 Oct 29 04:07:18.795489 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3935/7827] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:18 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:19.823035 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-543f5980-8aa6-42d8-bf21-e39eaffe8777 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:19.823897 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-543f5980-8aa6-42d8-bf21-e39eaffe8777 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:19.834948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-543f5980-8aa6-42d8-bf21-e39eaffe8777 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:19.835447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-543f5980-8aa6-42d8-bf21-e39eaffe8777 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:19.835896 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-543f5980-8aa6-42d8-bf21-e39eaffe8777 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:19.836756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-543f5980-8aa6-42d8-bf21-e39eaffe8777 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:19.837216 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-543f5980-8aa6-42d8-bf21-e39eaffe8777 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:19.837653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-543f5980-8aa6-42d8-bf21-e39eaffe8777 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:19.973592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-543f5980-8aa6-42d8-bf21-e39eaffe8777 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:19.982034 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-543f5980-8aa6-42d8-bf21-e39eaffe8777 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1695 microversion: 2.1 time: 0.166215 Oct 29 04:07:19.982615 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3893/7828] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:19 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:20.696331 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-1a53db9d-fa35-40e3-a62c-3aded9201687 req-152f4741-367c-4be1-a47c-c30fa606d084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060892ed-f669-472f-aa43-23b8ca74f45d", "name": "network-vif-unplugged", "status": "completed", "tag": "07213c07-586a-42c7-8935-70b3497204c7"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:20.707199 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1a53db9d-fa35-40e3-a62c-3aded9201687 req-152f4741-367c-4be1-a47c-c30fa606d084 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:20.707705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1a53db9d-fa35-40e3-a62c-3aded9201687 req-152f4741-367c-4be1-a47c-c30fa606d084 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:20.708121 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1a53db9d-fa35-40e3-a62c-3aded9201687 req-152f4741-367c-4be1-a47c-c30fa606d084 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:20.720406 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1a53db9d-fa35-40e3-a62c-3aded9201687 req-152f4741-367c-4be1-a47c-c30fa606d084 service nova] Creating event network-vif-unplugged:07213c07-586a-42c7-8935-70b3497204c7 for instance 060892ed-f669-472f-aa43-23b8ca74f45d on n-h2-862964-4 Oct 29 04:07:20.726393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [req-1a53db9d-fa35-40e3-a62c-3aded9201687 req-152f4741-367c-4be1-a47c-c30fa606d084 service nova] Instance 060892ed-f669-472f-aa43-23b8ca74f45d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127042) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 04:07:20.738071 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-1a53db9d-fa35-40e3-a62c-3aded9201687 req-152f4741-367c-4be1-a47c-c30fa606d084 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045670 Oct 29 04:07:20.738681 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3936/7829] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:07:21.007770 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c665aa31-fa81-4410-89d9-c8d922e6aa28 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:21.008267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c665aa31-fa81-4410-89d9-c8d922e6aa28 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:21.015596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c665aa31-fa81-4410-89d9-c8d922e6aa28 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:21.016021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c665aa31-fa81-4410-89d9-c8d922e6aa28 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:21.016474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c665aa31-fa81-4410-89d9-c8d922e6aa28 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:21.017193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c665aa31-fa81-4410-89d9-c8d922e6aa28 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:21.017660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c665aa31-fa81-4410-89d9-c8d922e6aa28 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:21.018131 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c665aa31-fa81-4410-89d9-c8d922e6aa28 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:21.154340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c665aa31-fa81-4410-89d9-c8d922e6aa28 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:21.162524 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c665aa31-fa81-4410-89d9-c8d922e6aa28 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1694 microversion: 2.1 time: 0.159202 Oct 29 04:07:21.163115 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3894/7830] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:21 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:22.192419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a155bc0b-4980-40a4-a6c8-dfb69c8654f0 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:22.193557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a155bc0b-4980-40a4-a6c8-dfb69c8654f0 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:22.204006 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a155bc0b-4980-40a4-a6c8-dfb69c8654f0 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:22.204790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a155bc0b-4980-40a4-a6c8-dfb69c8654f0 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:22.205539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a155bc0b-4980-40a4-a6c8-dfb69c8654f0 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:22.206705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a155bc0b-4980-40a4-a6c8-dfb69c8654f0 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:22.207440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a155bc0b-4980-40a4-a6c8-dfb69c8654f0 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:22.208125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a155bc0b-4980-40a4-a6c8-dfb69c8654f0 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:22.354445 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a155bc0b-4980-40a4-a6c8-dfb69c8654f0 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:22.362816 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a155bc0b-4980-40a4-a6c8-dfb69c8654f0 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1692 microversion: 2.1 time: 0.179124 Oct 29 04:07:22.363359 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3937/7831] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:22 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:22.779913 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b5e8d96e-58df-4d74-abcc-b4936affe974 req-63ed7a92-02f5-403c-984e-6c1dbc42bb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060892ed-f669-472f-aa43-23b8ca74f45d", "tag": "07213c07-586a-42c7-8935-70b3497204c7"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:22.790271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b5e8d96e-58df-4d74-abcc-b4936affe974 req-63ed7a92-02f5-403c-984e-6c1dbc42bb39 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:22.790757 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b5e8d96e-58df-4d74-abcc-b4936affe974 req-63ed7a92-02f5-403c-984e-6c1dbc42bb39 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:22.791200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b5e8d96e-58df-4d74-abcc-b4936affe974 req-63ed7a92-02f5-403c-984e-6c1dbc42bb39 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:22.803661 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b5e8d96e-58df-4d74-abcc-b4936affe974 req-63ed7a92-02f5-403c-984e-6c1dbc42bb39 service nova] Creating event network-changed:07213c07-586a-42c7-8935-70b3497204c7 for instance 060892ed-f669-472f-aa43-23b8ca74f45d on n-h2-862964-4 Oct 29 04:07:22.809384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [req-b5e8d96e-58df-4d74-abcc-b4936affe974 req-63ed7a92-02f5-403c-984e-6c1dbc42bb39 service nova] Instance 060892ed-f669-472f-aa43-23b8ca74f45d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862964-4', 'n-h2-862964-4'} {{(pid=127041) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 04:07:22.821126 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b5e8d96e-58df-4d74-abcc-b4936affe974 req-63ed7a92-02f5-403c-984e-6c1dbc42bb39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045367 Oct 29 04:07:22.821723 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3895/7832] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:07:23.388246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7c7666df-5b9d-493c-8eec-b00fd3b229b2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:23.396308 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7c7666df-5b9d-493c-8eec-b00fd3b229b2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:23.403334 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7666df-5b9d-493c-8eec-b00fd3b229b2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:23.403926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7666df-5b9d-493c-8eec-b00fd3b229b2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:23.404365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7666df-5b9d-493c-8eec-b00fd3b229b2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:23.405221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7666df-5b9d-493c-8eec-b00fd3b229b2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:23.405658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7666df-5b9d-493c-8eec-b00fd3b229b2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:23.406108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7c7666df-5b9d-493c-8eec-b00fd3b229b2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:23.736754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7c7666df-5b9d-493c-8eec-b00fd3b229b2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:23.745031 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7c7666df-5b9d-493c-8eec-b00fd3b229b2 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1692 microversion: 2.1 time: 0.362130 Oct 29 04:07:23.745596 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3938/7833] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:23 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1692 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:24.777735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dd688cbc-67eb-4124-80a0-f8467841b6eb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:24.778847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dd688cbc-67eb-4124-80a0-f8467841b6eb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:24.788322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd688cbc-67eb-4124-80a0-f8467841b6eb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:24.788822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd688cbc-67eb-4124-80a0-f8467841b6eb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:24.789281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd688cbc-67eb-4124-80a0-f8467841b6eb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:24.790083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd688cbc-67eb-4124-80a0-f8467841b6eb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:24.790545 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd688cbc-67eb-4124-80a0-f8467841b6eb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:24.790976 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-dd688cbc-67eb-4124-80a0-f8467841b6eb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:24.941572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dd688cbc-67eb-4124-80a0-f8467841b6eb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:24.949993 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dd688cbc-67eb-4124-80a0-f8467841b6eb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1689 microversion: 2.1 time: 0.180834 Oct 29 04:07:24.950569 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3896/7834] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:24 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:24.973188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-de162648-083c-4cee-b2f9-ae23e704ae4a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:24.973767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-de162648-083c-4cee-b2f9-ae23e704ae4a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:24.981225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de162648-083c-4cee-b2f9-ae23e704ae4a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:24.981710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de162648-083c-4cee-b2f9-ae23e704ae4a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:24.982177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de162648-083c-4cee-b2f9-ae23e704ae4a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:24.982874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de162648-083c-4cee-b2f9-ae23e704ae4a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:24.983324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de162648-083c-4cee-b2f9-ae23e704ae4a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:24.983739 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-de162648-083c-4cee-b2f9-ae23e704ae4a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:25.056073 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-de162648-083c-4cee-b2f9-ae23e704ae4a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d/action" status: 204 len: 0 microversion: 2.1 time: 0.086621 Oct 29 04:07:25.056671 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3939/7835] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:07:24 2022] POST /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 04:07:25.065073 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e28b5124-e52a-46d6-8cc0-a4be75a05b1d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:25.065700 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e28b5124-e52a-46d6-8cc0-a4be75a05b1d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:25.072862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28b5124-e52a-46d6-8cc0-a4be75a05b1d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:25.073421 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28b5124-e52a-46d6-8cc0-a4be75a05b1d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:25.073910 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28b5124-e52a-46d6-8cc0-a4be75a05b1d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:25.074694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28b5124-e52a-46d6-8cc0-a4be75a05b1d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:25.075155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28b5124-e52a-46d6-8cc0-a4be75a05b1d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:25.075734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e28b5124-e52a-46d6-8cc0-a4be75a05b1d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:25.295989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e28b5124-e52a-46d6-8cc0-a4be75a05b1d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:25.304509 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e28b5124-e52a-46d6-8cc0-a4be75a05b1d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1689 microversion: 2.1 time: 0.243322 Oct 29 04:07:25.305124 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3897/7836] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:25 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:25.335480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4306b490-bbef-4527-a978-5c14241fcf1c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:25.336091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4306b490-bbef-4527-a978-5c14241fcf1c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:25.342684 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4306b490-bbef-4527-a978-5c14241fcf1c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:25.343166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4306b490-bbef-4527-a978-5c14241fcf1c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:25.343594 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4306b490-bbef-4527-a978-5c14241fcf1c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:25.344392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4306b490-bbef-4527-a978-5c14241fcf1c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:25.344867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4306b490-bbef-4527-a978-5c14241fcf1c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:25.345281 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4306b490-bbef-4527-a978-5c14241fcf1c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:25.482405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4306b490-bbef-4527-a978-5c14241fcf1c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:25.491295 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4306b490-bbef-4527-a978-5c14241fcf1c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1689 microversion: 2.1 time: 0.160317 Oct 29 04:07:25.491989 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3940/7837] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:25 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:26.514849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-20575dbb-7d41-4fe3-9a3d-115d05920fa5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:26.515458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-20575dbb-7d41-4fe3-9a3d-115d05920fa5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:26.522599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20575dbb-7d41-4fe3-9a3d-115d05920fa5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:26.523102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20575dbb-7d41-4fe3-9a3d-115d05920fa5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:26.523550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20575dbb-7d41-4fe3-9a3d-115d05920fa5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:26.524496 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20575dbb-7d41-4fe3-9a3d-115d05920fa5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:26.525032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20575dbb-7d41-4fe3-9a3d-115d05920fa5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:26.525474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-20575dbb-7d41-4fe3-9a3d-115d05920fa5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:26.675346 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-20575dbb-7d41-4fe3-9a3d-115d05920fa5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:26.683482 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-20575dbb-7d41-4fe3-9a3d-115d05920fa5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1681 microversion: 2.1 time: 0.172653 Oct 29 04:07:26.684062 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3898/7838] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:26 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:28.616188 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-16155561-73bf-4bec-99f5-fbc7dd91e3ee req-67ec6e0a-b9cc-42af-ad40-608242178b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060892ed-f669-472f-aa43-23b8ca74f45d", "name": "network-vif-plugged", "status": "completed", "tag": "07213c07-586a-42c7-8935-70b3497204c7"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:28.627265 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-16155561-73bf-4bec-99f5-fbc7dd91e3ee req-67ec6e0a-b9cc-42af-ad40-608242178b63 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:28.627734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-16155561-73bf-4bec-99f5-fbc7dd91e3ee req-67ec6e0a-b9cc-42af-ad40-608242178b63 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:28.628153 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-16155561-73bf-4bec-99f5-fbc7dd91e3ee req-67ec6e0a-b9cc-42af-ad40-608242178b63 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:28.639478 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-16155561-73bf-4bec-99f5-fbc7dd91e3ee req-67ec6e0a-b9cc-42af-ad40-608242178b63 service nova] Creating event network-vif-plugged:07213c07-586a-42c7-8935-70b3497204c7 for instance 060892ed-f669-472f-aa43-23b8ca74f45d on n-h2-862964-4 Oct 29 04:07:28.644716 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-16155561-73bf-4bec-99f5-fbc7dd91e3ee req-67ec6e0a-b9cc-42af-ad40-608242178b63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096039 Oct 29 04:07:28.645764 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3941/7839] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:07:50.912561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-81782fe7-2a7a-4a07-89b1-fc7a0d7c7cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:50.914772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-81782fe7-2a7a-4a07-89b1-fc7a0d7c7cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:50.917647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=32 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:50.918655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:50.925179 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81782fe7-2a7a-4a07-89b1-fc7a0d7c7cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:50.925681 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81782fe7-2a7a-4a07-89b1-fc7a0d7c7cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:50.926158 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81782fe7-2a7a-4a07-89b1-fc7a0d7c7cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:50.926871 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81782fe7-2a7a-4a07-89b1-fc7a0d7c7cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:50.927337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81782fe7-2a7a-4a07-89b1-fc7a0d7c7cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:50.927772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-81782fe7-2a7a-4a07-89b1-fc7a0d7c7cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:50.990501 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-81782fe7-2a7a-4a07-89b1-fc7a0d7c7cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d/action" status: 200 len: 24574 microversion: 2.1 time: 0.081862 Oct 29 04:07:50.991154 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3899/7840] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:07:50 2022] POST /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d/action => generated 24574 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:07:58.040448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-85868790-fa04-49a9-9799-8d67017f8168 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:58.041038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-85868790-fa04-49a9-9799-8d67017f8168 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:58.042013 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-30170a39-a5d3-4436-abf5-cb4a3bacbb8a req-3a06a950-0237-49e5-a43b-3cc4b5daf155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060892ed-f669-472f-aa43-23b8ca74f45d", "tag": "07213c07-586a-42c7-8935-70b3497204c7"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:58.044056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=28 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:58.044878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:58.051611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85868790-fa04-49a9-9799-8d67017f8168 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:58.052100 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85868790-fa04-49a9-9799-8d67017f8168 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:58.052614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85868790-fa04-49a9-9799-8d67017f8168 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:58.053238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-30170a39-a5d3-4436-abf5-cb4a3bacbb8a req-3a06a950-0237-49e5-a43b-3cc4b5daf155 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:58.053352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85868790-fa04-49a9-9799-8d67017f8168 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:58.053727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-30170a39-a5d3-4436-abf5-cb4a3bacbb8a req-3a06a950-0237-49e5-a43b-3cc4b5daf155 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:58.053873 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85868790-fa04-49a9-9799-8d67017f8168 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:58.054185 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-85868790-fa04-49a9-9799-8d67017f8168 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:58.054293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-30170a39-a5d3-4436-abf5-cb4a3bacbb8a req-3a06a950-0237-49e5-a43b-3cc4b5daf155 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:58.067139 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-30170a39-a5d3-4436-abf5-cb4a3bacbb8a req-3a06a950-0237-49e5-a43b-3cc4b5daf155 service nova] Creating event network-changed:07213c07-586a-42c7-8935-70b3497204c7 for instance 060892ed-f669-472f-aa43-23b8ca74f45d on n-h2-862964-4 Oct 29 04:07:58.073131 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-30170a39-a5d3-4436-abf5-cb4a3bacbb8a req-3a06a950-0237-49e5-a43b-3cc4b5daf155 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035204 Oct 29 04:07:58.074201 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3900/7841] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:07:58.083123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-85868790-fa04-49a9-9799-8d67017f8168 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:07:58.174173 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-85868790-fa04-49a9-9799-8d67017f8168 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "DELETE /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 204 len: 0 microversion: 2.1 time: 0.138209 Oct 29 04:07:58.175096 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3942/7842] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 04:07:58 2022] DELETE /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:07:58.184497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b17750f5-10ca-4e7d-9ec9-cd988d3a2834 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:58.185226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b17750f5-10ca-4e7d-9ec9-cd988d3a2834 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:58.191783 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b17750f5-10ca-4e7d-9ec9-cd988d3a2834 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:58.192291 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b17750f5-10ca-4e7d-9ec9-cd988d3a2834 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:58.192742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b17750f5-10ca-4e7d-9ec9-cd988d3a2834 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:58.193463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b17750f5-10ca-4e7d-9ec9-cd988d3a2834 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:58.193967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b17750f5-10ca-4e7d-9ec9-cd988d3a2834 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:58.194423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b17750f5-10ca-4e7d-9ec9-cd988d3a2834 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:58.338909 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b17750f5-10ca-4e7d-9ec9-cd988d3a2834 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:58.347767 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b17750f5-10ca-4e7d-9ec9-cd988d3a2834 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1687 microversion: 2.1 time: 0.168072 Oct 29 04:07:58.348335 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3901/7843] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:58 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:07:59.375352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d6c8c2ea-1735-4625-9663-0eec8d7b6d3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:59.376173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d6c8c2ea-1735-4625-9663-0eec8d7b6d3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:59.385568 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c8c2ea-1735-4625-9663-0eec8d7b6d3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:59.386256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c8c2ea-1735-4625-9663-0eec8d7b6d3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:59.386831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c8c2ea-1735-4625-9663-0eec8d7b6d3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:59.387752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c8c2ea-1735-4625-9663-0eec8d7b6d3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:59.388346 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c8c2ea-1735-4625-9663-0eec8d7b6d3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:59.388912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d6c8c2ea-1735-4625-9663-0eec8d7b6d3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:59.560120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d6c8c2ea-1735-4625-9663-0eec8d7b6d3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:59.568825 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d6c8c2ea-1735-4625-9663-0eec8d7b6d3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1687 microversion: 2.1 time: 0.199438 Oct 29 04:07:59.569391 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3943/7844] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:59 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1687 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:00.236106 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-5f45cfea-4c04-440c-85df-86c1deaabb6f req-4f2a1443-f563-4743-b85b-a59dd23b35c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060892ed-f669-472f-aa43-23b8ca74f45d", "name": "network-vif-deleted", "tag": "07213c07-586a-42c7-8935-70b3497204c7"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:08:00.247560 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5f45cfea-4c04-440c-85df-86c1deaabb6f req-4f2a1443-f563-4743-b85b-a59dd23b35c2 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:00.248065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5f45cfea-4c04-440c-85df-86c1deaabb6f req-4f2a1443-f563-4743-b85b-a59dd23b35c2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:00.248540 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-5f45cfea-4c04-440c-85df-86c1deaabb6f req-4f2a1443-f563-4743-b85b-a59dd23b35c2 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:00.261032 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-5f45cfea-4c04-440c-85df-86c1deaabb6f req-4f2a1443-f563-4743-b85b-a59dd23b35c2 service nova] Creating event network-vif-deleted:07213c07-586a-42c7-8935-70b3497204c7 for instance 060892ed-f669-472f-aa43-23b8ca74f45d on n-h2-862964-4 Oct 29 04:08:00.266896 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-5f45cfea-4c04-440c-85df-86c1deaabb6f req-4f2a1443-f563-4743-b85b-a59dd23b35c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035479 Oct 29 04:08:00.267552 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3902/7845] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:08:00.593086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:00.593949 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:00.601384 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:00.601897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:00.602325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:00.603023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:00.603467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:00.603877 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:00.638376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:00.638853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:00.639304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:00.639748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lazy-loading 'fault' on Instance uuid 060892ed-f669-472f-aa43-23b8ca74f45d {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:08:00.681824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:00.690383 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-368e3edb-7b57-4c3d-95f1-1afc03ccc621 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 200 len: 1356 microversion: 2.1 time: 0.101395 Oct 29 04:08:00.690994 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3944/7846] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:00 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:01.721222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:01.722448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: 060892ed-f669-472f-aa43-23b8ca74f45d] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:01.733184 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:01.734105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:01.734922 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:01.735982 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:01.736449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:01.736882 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:01.750714 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] HTTP exception thrown: Instance 060892ed-f669-472f-aa43-23b8ca74f45d could not be found. Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Request method failure captured: Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d HTTP/1.1 Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKYOzTcTPokSAkJ7f4XHySy1k6FHaxJt61hPLu98Qp40NEKP6gUTLVBNWeiqUtg8Y82ZOUB2ZECIZFhl-B-4mjTqs1i9qLrsG0sW5zEnSZXus52TZUc9XMx2uN5-V0PGULrAaaySwsvVPXqwaCtX4RO99Rzs4Vzmm9HTr1Qz2ff5DrE Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: fef87f25af434ef59f486bcca46f43f3 Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fef87f25af434ef59f486bcca46f43f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fef87f25af434ef59f486bcca46f43f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fef87f25af434ef59f486bcca46f43f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fef87f25af434ef59f486bcca46f43f3"}]}] Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: fef87f25af434ef59f486bcca46f43f3 Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestNetworkAdvancedServerOps-280428214-project Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 24c2655ccbad4be3b3d2fca5f3f01cf9 Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestNetworkAdvancedServerOps-280428214-project Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance 060892ed-f669-472f-aa43-23b8ca74f45d could not be found. Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': '060892ed-f669-472f-aa43-23b8ca74f45d'} Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 060892ed-f669-472f-aa43-23b8ca74f45d could not be found. Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 060892ed-f669-472f-aa43-23b8ca74f45d could not be found. Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:08:01.752374 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:08:01.756911 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:08:01.756911 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:08:01.756911 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:08:01.756911 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:08:01.756911 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:08:01.756911 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:08:01.756911 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 060892ed-f669-472f-aa43-23b8ca74f45d could not be found. Oct 29 04:08:01.756911 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:08:01.756911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Returning 404 to user: Instance 060892ed-f669-472f-aa43-23b8ca74f45d could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:08:01.756911 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-4a9499e7-0d47-4744-b40a-eb57dd108385 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d" status: 404 len: 111 microversion: 2.1 time: 0.041589 Oct 29 04:08:01.756911 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3903/7847] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:01 2022] GET /compute/v2.1/servers/060892ed-f669-472f-aa43-23b8ca74f45d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:08:05.146335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-176cd95f-47fa-459f-b9d7-b8973cab983d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '.version_select at 0x7fe1a333c5e0>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:05.172872 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-176cd95f-47fa-459f-b9d7-b8973cab983d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2012668739" status: 202 len: 0 microversion: 2.1 time: 0.030098 Oct 29 04:08:05.173736 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3945/7848] 10.222.0.16 () {58 vars in 1284 bytes} [Sat Oct 29 04:08:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2012668739 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:08:05.198747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c8d1647-661d-4a94-85ff-11fb304e3171 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'create', calling method: .version_select at 0x7fe1a3e41430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-895261684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7ZaZrTkMbq6I5Ri7ySJOrZvSwXPkvILdEPwkvXx2bCgSUsjaUh8/2yR5Cov/eS9vIwHSnw5kVk0NANolVKRKc9QEcOAJItRkHpejekxMGkRdgYKsf5sopgxy+t8k2CQg=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:08:05.217601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6c8d1647-661d-4a94-85ff-11fb304e3171 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for project fef87f25af434ef59f486bcca46f43f3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:08:05.223030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-6c8d1647-661d-4a94-85ff-11fb304e3171 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for user 24c2655ccbad4be3b3d2fca5f3f01cf9 and project fef87f25af434ef59f486bcca46f43f3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:08:05.248106 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6c8d1647-661d-4a94-85ff-11fb304e3171 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053386 Oct 29 04:08:05.248713 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3904/7849] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 04:08:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:08:10.914476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:10.919166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2115124628", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "1d0bc437-0619-46f2-aaeb-a5f8f86131a9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-895261684", "security_groups": [{"name": "tempest-secgroup-smoke-1271700467"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:08:11.054605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] validate_networks() for [('1d0bc437-0619-46f2-aaeb-a5f8f86131a9', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:08:11.507668 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:08:11.508158 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:08:11.508699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:08:11.509230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:08:11.509701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:08:11.519439 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:11.519987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:11.520487 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:11.521279 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:11.521831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:11.522372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:11.541011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for project fef87f25af434ef59f486bcca46f43f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:08:11.547051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for user 24c2655ccbad4be3b3d2fca5f3f01cf9 and project fef87f25af434ef59f486bcca46f43f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:08:11.561033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:08:11.563260 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:08:11.614729 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fba20cd0-4deb-409e-8279-9fcb3ae35e58 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.702186 Oct 29 04:08:11.616015 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3946/7850] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 04:08:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:08:11.627959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8b72dd0f-75f1-413a-9298-c6d0af81c727 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:11.628614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8b72dd0f-75f1-413a-9298-c6d0af81c727 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:11.692876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8b72dd0f-75f1-413a-9298-c6d0af81c727 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:11.700952 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8b72dd0f-75f1-413a-9298-c6d0af81c727 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1266 microversion: 2.1 time: 0.077431 Oct 29 04:08:11.701909 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3905/7851] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:11 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:12.725598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-529d8f9a-3dd2-4fc2-87b2-d743e871db2b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:12.727060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-529d8f9a-3dd2-4fc2-87b2-d743e871db2b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:12.735778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-529d8f9a-3dd2-4fc2-87b2-d743e871db2b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:12.737138 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-529d8f9a-3dd2-4fc2-87b2-d743e871db2b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:12.737939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-529d8f9a-3dd2-4fc2-87b2-d743e871db2b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:12.739419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-529d8f9a-3dd2-4fc2-87b2-d743e871db2b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:12.740173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-529d8f9a-3dd2-4fc2-87b2-d743e871db2b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:12.740868 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-529d8f9a-3dd2-4fc2-87b2-d743e871db2b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:12.840246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-529d8f9a-3dd2-4fc2-87b2-d743e871db2b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:12.850279 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-529d8f9a-3dd2-4fc2-87b2-d743e871db2b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1326 microversion: 2.1 time: 0.129646 Oct 29 04:08:12.851686 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3947/7852] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:12 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:13.874872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bc3c58ed-a2b6-4e11-a35c-26a0e76cc6c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:13.875774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bc3c58ed-a2b6-4e11-a35c-26a0e76cc6c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:13.878251 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=16 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:13.885764 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc3c58ed-a2b6-4e11-a35c-26a0e76cc6c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:13.886382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc3c58ed-a2b6-4e11-a35c-26a0e76cc6c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:13.886895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc3c58ed-a2b6-4e11-a35c-26a0e76cc6c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:13.887692 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc3c58ed-a2b6-4e11-a35c-26a0e76cc6c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:13.888253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc3c58ed-a2b6-4e11-a35c-26a0e76cc6c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:13.888753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bc3c58ed-a2b6-4e11-a35c-26a0e76cc6c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:14.111113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bc3c58ed-a2b6-4e11-a35c-26a0e76cc6c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:14.119838 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bc3c58ed-a2b6-4e11-a35c-26a0e76cc6c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1392 microversion: 2.1 time: 0.248970 Oct 29 04:08:14.130794 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3906/7853] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:13 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1392 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:08:14.412664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-d904f675-a4e5-4c0d-ae67-66f44b883937 req-c1332e5d-b3b1-46e7-8994-e2e31d094e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2dfb5c2-ebed-4c87-9be0-9214d1db6897", "tag": "d22ee3b6-24e3-4e5c-90f0-10ac72511eb2"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:08:14.424812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d904f675-a4e5-4c0d-ae67-66f44b883937 req-c1332e5d-b3b1-46e7-8994-e2e31d094e4a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:14.425392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d904f675-a4e5-4c0d-ae67-66f44b883937 req-c1332e5d-b3b1-46e7-8994-e2e31d094e4a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:14.425916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-d904f675-a4e5-4c0d-ae67-66f44b883937 req-c1332e5d-b3b1-46e7-8994-e2e31d094e4a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:14.438632 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-d904f675-a4e5-4c0d-ae67-66f44b883937 req-c1332e5d-b3b1-46e7-8994-e2e31d094e4a service nova] Creating event network-changed:d22ee3b6-24e3-4e5c-90f0-10ac72511eb2 for instance a2dfb5c2-ebed-4c87-9be0-9214d1db6897 on n-h1-862964-4 Oct 29 04:08:14.444140 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-d904f675-a4e5-4c0d-ae67-66f44b883937 req-c1332e5d-b3b1-46e7-8994-e2e31d094e4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036540 Oct 29 04:08:14.446129 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3948/7854] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:08:15.144080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3233ab98-7f69-44ba-84e9-59ee07522512 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:15.144730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3233ab98-7f69-44ba-84e9-59ee07522512 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:15.152087 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3233ab98-7f69-44ba-84e9-59ee07522512 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:15.152597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3233ab98-7f69-44ba-84e9-59ee07522512 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:15.153025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3233ab98-7f69-44ba-84e9-59ee07522512 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:15.153780 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3233ab98-7f69-44ba-84e9-59ee07522512 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:15.154250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3233ab98-7f69-44ba-84e9-59ee07522512 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:15.154979 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3233ab98-7f69-44ba-84e9-59ee07522512 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:15.292808 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3233ab98-7f69-44ba-84e9-59ee07522512 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:15.301345 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3233ab98-7f69-44ba-84e9-59ee07522512 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1392 microversion: 2.1 time: 0.161573 Oct 29 04:08:15.301977 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3907/7855] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:15 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:16.325208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-118c42e0-e745-4909-9dd6-49d75b014f32 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:16.326029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-118c42e0-e745-4909-9dd6-49d75b014f32 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:16.333996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-118c42e0-e745-4909-9dd6-49d75b014f32 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:16.334520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-118c42e0-e745-4909-9dd6-49d75b014f32 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:16.334957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-118c42e0-e745-4909-9dd6-49d75b014f32 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:16.335730 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-118c42e0-e745-4909-9dd6-49d75b014f32 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:16.336110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-118c42e0-e745-4909-9dd6-49d75b014f32 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:16.336532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-118c42e0-e745-4909-9dd6-49d75b014f32 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:16.475408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-118c42e0-e745-4909-9dd6-49d75b014f32 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:16.483293 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-118c42e0-e745-4909-9dd6-49d75b014f32 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1392 microversion: 2.1 time: 0.162533 Oct 29 04:08:16.483875 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3949/7856] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:16 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:17.507211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6f062b01-0f21-4184-af1e-0d9f23cb004b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:17.507840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6f062b01-0f21-4184-af1e-0d9f23cb004b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:17.515551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f062b01-0f21-4184-af1e-0d9f23cb004b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:17.515957 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f062b01-0f21-4184-af1e-0d9f23cb004b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:17.516412 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f062b01-0f21-4184-af1e-0d9f23cb004b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:17.517118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f062b01-0f21-4184-af1e-0d9f23cb004b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:17.517584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f062b01-0f21-4184-af1e-0d9f23cb004b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:17.518054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6f062b01-0f21-4184-af1e-0d9f23cb004b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:17.663499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6f062b01-0f21-4184-af1e-0d9f23cb004b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:17.671565 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6f062b01-0f21-4184-af1e-0d9f23cb004b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1392 microversion: 2.1 time: 0.168348 Oct 29 04:08:17.672111 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3908/7857] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:17 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:08:18.698143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6c0b2949-621d-4cd0-b161-0016abc490be tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:18.698890 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6c0b2949-621d-4cd0-b161-0016abc490be tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:18.707551 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0b2949-621d-4cd0-b161-0016abc490be tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:18.708132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0b2949-621d-4cd0-b161-0016abc490be tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:18.708557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0b2949-621d-4cd0-b161-0016abc490be tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:18.709251 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0b2949-621d-4cd0-b161-0016abc490be tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:18.709690 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0b2949-621d-4cd0-b161-0016abc490be tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:18.710132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6c0b2949-621d-4cd0-b161-0016abc490be tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:18.843938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6c0b2949-621d-4cd0-b161-0016abc490be tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:18.855928 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6c0b2949-621d-4cd0-b161-0016abc490be tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1392 microversion: 2.1 time: 0.162672 Oct 29 04:08:18.856690 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3950/7858] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:18 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:19.355656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-0602bba3-3f55-465d-8ffb-b7a303442042 req-0bf03a2a-e1bc-40ab-a2d3-231af568f9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2dfb5c2-ebed-4c87-9be0-9214d1db6897", "name": "network-vif-plugged", "status": "completed", "tag": "d22ee3b6-24e3-4e5c-90f0-10ac72511eb2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:08:19.368336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0602bba3-3f55-465d-8ffb-b7a303442042 req-0bf03a2a-e1bc-40ab-a2d3-231af568f9c4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:19.368839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0602bba3-3f55-465d-8ffb-b7a303442042 req-0bf03a2a-e1bc-40ab-a2d3-231af568f9c4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:19.369305 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-0602bba3-3f55-465d-8ffb-b7a303442042 req-0bf03a2a-e1bc-40ab-a2d3-231af568f9c4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:19.381218 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-0602bba3-3f55-465d-8ffb-b7a303442042 req-0bf03a2a-e1bc-40ab-a2d3-231af568f9c4 service nova] Creating event network-vif-plugged:d22ee3b6-24e3-4e5c-90f0-10ac72511eb2 for instance a2dfb5c2-ebed-4c87-9be0-9214d1db6897 on n-h1-862964-4 Oct 29 04:08:19.386368 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-0602bba3-3f55-465d-8ffb-b7a303442042 req-0bf03a2a-e1bc-40ab-a2d3-231af568f9c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034684 Oct 29 04:08:19.386978 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3909/7859] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:08:19.886438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1c31212d-e5bf-4818-80da-0358e402eb3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:19.887419 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1c31212d-e5bf-4818-80da-0358e402eb3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:19.899814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c31212d-e5bf-4818-80da-0358e402eb3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:19.900657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c31212d-e5bf-4818-80da-0358e402eb3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:19.901405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c31212d-e5bf-4818-80da-0358e402eb3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:19.902577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c31212d-e5bf-4818-80da-0358e402eb3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:19.903268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c31212d-e5bf-4818-80da-0358e402eb3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:19.903962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1c31212d-e5bf-4818-80da-0358e402eb3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:20.048838 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1c31212d-e5bf-4818-80da-0358e402eb3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:20.060385 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1c31212d-e5bf-4818-80da-0358e402eb3e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1392 microversion: 2.1 time: 0.180595 Oct 29 04:08:20.061114 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3951/7860] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:19 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:21.087889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7bc75010-8dba-4a16-934a-297af1ebd295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:21.088612 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7bc75010-8dba-4a16-934a-297af1ebd295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:21.090795 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:21.097488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bc75010-8dba-4a16-934a-297af1ebd295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:21.098140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bc75010-8dba-4a16-934a-297af1ebd295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:21.098575 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bc75010-8dba-4a16-934a-297af1ebd295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:21.099382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bc75010-8dba-4a16-934a-297af1ebd295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:21.099869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bc75010-8dba-4a16-934a-297af1ebd295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:21.100330 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7bc75010-8dba-4a16-934a-297af1ebd295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:21.235493 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7bc75010-8dba-4a16-934a-297af1ebd295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:21.244092 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7bc75010-8dba-4a16-934a-297af1ebd295 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1564 microversion: 2.1 time: 0.162636 Oct 29 04:08:21.244667 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3910/7861] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:21 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:21.271288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ca190542-7fba-4538-b786-94dfcbd70000 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:21.271952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ca190542-7fba-4538-b786-94dfcbd70000 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:21.279290 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca190542-7fba-4538-b786-94dfcbd70000 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:21.279769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca190542-7fba-4538-b786-94dfcbd70000 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:21.280221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca190542-7fba-4538-b786-94dfcbd70000 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:21.280907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca190542-7fba-4538-b786-94dfcbd70000 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:21.281352 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca190542-7fba-4538-b786-94dfcbd70000 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:21.281770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ca190542-7fba-4538-b786-94dfcbd70000 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:21.418889 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ca190542-7fba-4538-b786-94dfcbd70000 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:21.427142 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ca190542-7fba-4538-b786-94dfcbd70000 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1564 microversion: 2.1 time: 0.159945 Oct 29 04:08:21.427722 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3952/7862] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:21 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:23.084714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8711f11e-b6a6-4090-9a94-44306a717205 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:23.086090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8711f11e-b6a6-4090-9a94-44306a717205 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:23.086680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-1b8b4403-acb5-4d79-9fd9-7175b51c80b2 req-29680a8f-bda6-4f37-b1bf-2edef0af2249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2dfb5c2-ebed-4c87-9be0-9214d1db6897", "tag": "d22ee3b6-24e3-4e5c-90f0-10ac72511eb2"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:08:23.088289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:23.092620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:23.093631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:23.096989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8711f11e-b6a6-4090-9a94-44306a717205 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:23.097975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8711f11e-b6a6-4090-9a94-44306a717205 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:23.098784 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8711f11e-b6a6-4090-9a94-44306a717205 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:23.099779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8711f11e-b6a6-4090-9a94-44306a717205 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:23.100293 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8711f11e-b6a6-4090-9a94-44306a717205 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:23.100779 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8711f11e-b6a6-4090-9a94-44306a717205 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:23.103152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1b8b4403-acb5-4d79-9fd9-7175b51c80b2 req-29680a8f-bda6-4f37-b1bf-2edef0af2249 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:23.103703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1b8b4403-acb5-4d79-9fd9-7175b51c80b2 req-29680a8f-bda6-4f37-b1bf-2edef0af2249 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:23.104318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-1b8b4403-acb5-4d79-9fd9-7175b51c80b2 req-29680a8f-bda6-4f37-b1bf-2edef0af2249 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:23.117075 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-1b8b4403-acb5-4d79-9fd9-7175b51c80b2 req-29680a8f-bda6-4f37-b1bf-2edef0af2249 service nova] Creating event network-changed:d22ee3b6-24e3-4e5c-90f0-10ac72511eb2 for instance a2dfb5c2-ebed-4c87-9be0-9214d1db6897 on n-h1-862964-4 Oct 29 04:08:23.122444 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-1b8b4403-acb5-4d79-9fd9-7175b51c80b2 req-29680a8f-bda6-4f37-b1bf-2edef0af2249 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039880 Oct 29 04:08:23.123661 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3953/7863] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:08:23.334950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8711f11e-b6a6-4090-9a94-44306a717205 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:23.343868 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8711f11e-b6a6-4090-9a94-44306a717205 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1564 microversion: 2.1 time: 0.263536 Oct 29 04:08:23.344533 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3911/7864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:23 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1564 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:44.937104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:44.937854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=36 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:44.994080 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-05eaafd3-b4b0-42e9-a01e-0fe4554bc563 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:08:44.996713 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-05eaafd3-b4b0-42e9-a01e-0fe4554bc563 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:45.004126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05eaafd3-b4b0-42e9-a01e-0fe4554bc563 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:45.004612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05eaafd3-b4b0-42e9-a01e-0fe4554bc563 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:45.005045 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05eaafd3-b4b0-42e9-a01e-0fe4554bc563 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:45.005749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05eaafd3-b4b0-42e9-a01e-0fe4554bc563 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:45.006228 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05eaafd3-b4b0-42e9-a01e-0fe4554bc563 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:45.006645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-05eaafd3-b4b0-42e9-a01e-0fe4554bc563 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:45.081520 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-05eaafd3-b4b0-42e9-a01e-0fe4554bc563 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897/action" status: 200 len: 24571 microversion: 2.1 time: 0.146244 Oct 29 04:08:45.082222 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3954/7865] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:08:44 2022] POST /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897/action => generated 24571 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:08:51.496301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7abd5f83-918c-4a00-ab1f-b98a28a02ede tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:08:51.499124 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:51.499846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=32 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:51.506246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7abd5f83-918c-4a00-ab1f-b98a28a02ede tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:51.506746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7abd5f83-918c-4a00-ab1f-b98a28a02ede tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:51.507220 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7abd5f83-918c-4a00-ab1f-b98a28a02ede tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:51.530449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7abd5f83-918c-4a00-ab1f-b98a28a02ede tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Going to try to stop instance {{(pid=127041) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 04:08:51.577616 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7abd5f83-918c-4a00-ab1f-b98a28a02ede tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897/action" status: 202 len: 0 microversion: 2.1 time: 0.087533 Oct 29 04:08:51.578287 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3912/7866] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:08:51 2022] POST /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:08:51.587948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dc0ccb1a-4f6d-4b11-b4f6-01a166c7175e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:51.588666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dc0ccb1a-4f6d-4b11-b4f6-01a166c7175e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:51.597770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc0ccb1a-4f6d-4b11-b4f6-01a166c7175e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:51.599444 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc0ccb1a-4f6d-4b11-b4f6-01a166c7175e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:51.599932 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc0ccb1a-4f6d-4b11-b4f6-01a166c7175e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:51.601347 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc0ccb1a-4f6d-4b11-b4f6-01a166c7175e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:51.601826 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc0ccb1a-4f6d-4b11-b4f6-01a166c7175e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:51.602289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc0ccb1a-4f6d-4b11-b4f6-01a166c7175e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:51.758467 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dc0ccb1a-4f6d-4b11-b4f6-01a166c7175e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:51.770363 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dc0ccb1a-4f6d-4b11-b4f6-01a166c7175e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1693 microversion: 2.1 time: 0.187076 Oct 29 04:08:51.771166 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3955/7867] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:51 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1693 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:52.796903 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-25adfe95-21ed-4cee-9c89-2e4a0c801508 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:52.797591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-25adfe95-21ed-4cee-9c89-2e4a0c801508 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:52.804149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25adfe95-21ed-4cee-9c89-2e4a0c801508 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:52.804629 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25adfe95-21ed-4cee-9c89-2e4a0c801508 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:52.805076 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25adfe95-21ed-4cee-9c89-2e4a0c801508 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:52.805841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25adfe95-21ed-4cee-9c89-2e4a0c801508 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:52.806411 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25adfe95-21ed-4cee-9c89-2e4a0c801508 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:52.806947 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-25adfe95-21ed-4cee-9c89-2e4a0c801508 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:52.946760 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-25adfe95-21ed-4cee-9c89-2e4a0c801508 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:52.954953 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-25adfe95-21ed-4cee-9c89-2e4a0c801508 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1693 microversion: 2.1 time: 0.163856 Oct 29 04:08:52.955534 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3913/7868] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:52 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:53.987358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8d2d9143-fcfd-4b8d-b936-60a4e1e734c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:53.988403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8d2d9143-fcfd-4b8d-b936-60a4e1e734c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:53.998558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d2d9143-fcfd-4b8d-b936-60a4e1e734c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:53.999070 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d2d9143-fcfd-4b8d-b936-60a4e1e734c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:53.999503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d2d9143-fcfd-4b8d-b936-60a4e1e734c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:54.000198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d2d9143-fcfd-4b8d-b936-60a4e1e734c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:54.000646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d2d9143-fcfd-4b8d-b936-60a4e1e734c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:54.001065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8d2d9143-fcfd-4b8d-b936-60a4e1e734c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:54.147180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8d2d9143-fcfd-4b8d-b936-60a4e1e734c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:54.159119 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8d2d9143-fcfd-4b8d-b936-60a4e1e734c1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1693 microversion: 2.1 time: 0.178827 Oct 29 04:08:54.159896 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3956/7869] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:53 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:55.191642 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a14741e6-8948-432f-b56b-d835511ccd1f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:55.192548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a14741e6-8948-432f-b56b-d835511ccd1f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:55.202461 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14741e6-8948-432f-b56b-d835511ccd1f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:55.202948 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14741e6-8948-432f-b56b-d835511ccd1f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:55.203401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14741e6-8948-432f-b56b-d835511ccd1f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:55.204103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14741e6-8948-432f-b56b-d835511ccd1f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:55.204564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14741e6-8948-432f-b56b-d835511ccd1f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:55.204995 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a14741e6-8948-432f-b56b-d835511ccd1f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:55.344114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a14741e6-8948-432f-b56b-d835511ccd1f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:55.352032 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a14741e6-8948-432f-b56b-d835511ccd1f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1693 microversion: 2.1 time: 0.167155 Oct 29 04:08:55.352583 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3914/7870] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:55 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:56.380793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0ea752c4-75c0-42f8-a476-7a2b112af141 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:56.381719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0ea752c4-75c0-42f8-a476-7a2b112af141 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:56.391480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ea752c4-75c0-42f8-a476-7a2b112af141 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:56.391944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ea752c4-75c0-42f8-a476-7a2b112af141 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:56.392410 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ea752c4-75c0-42f8-a476-7a2b112af141 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:56.393114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ea752c4-75c0-42f8-a476-7a2b112af141 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:56.393555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ea752c4-75c0-42f8-a476-7a2b112af141 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:56.394124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0ea752c4-75c0-42f8-a476-7a2b112af141 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:56.527203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0ea752c4-75c0-42f8-a476-7a2b112af141 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:56.535978 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0ea752c4-75c0-42f8-a476-7a2b112af141 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1693 microversion: 2.1 time: 0.162058 Oct 29 04:08:56.536553 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3957/7871] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:56 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:57.560709 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9a4a9017-dba8-4691-be06-856eb92b2f5c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:57.561353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9a4a9017-dba8-4691-be06-856eb92b2f5c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:57.568782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a4a9017-dba8-4691-be06-856eb92b2f5c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:57.569294 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a4a9017-dba8-4691-be06-856eb92b2f5c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:57.569738 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a4a9017-dba8-4691-be06-856eb92b2f5c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:57.570476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a4a9017-dba8-4691-be06-856eb92b2f5c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:57.570939 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a4a9017-dba8-4691-be06-856eb92b2f5c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:57.571368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9a4a9017-dba8-4691-be06-856eb92b2f5c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:57.709371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9a4a9017-dba8-4691-be06-856eb92b2f5c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:57.717853 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9a4a9017-dba8-4691-be06-856eb92b2f5c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1693 microversion: 2.1 time: 0.161410 Oct 29 04:08:57.718446 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3915/7872] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:57 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:58.746264 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a34e63e8-3f8a-44b0-9a03-abc434fb2865 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:58.747330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a34e63e8-3f8a-44b0-9a03-abc434fb2865 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:58.758694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34e63e8-3f8a-44b0-9a03-abc434fb2865 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:58.759499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34e63e8-3f8a-44b0-9a03-abc434fb2865 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:58.760237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34e63e8-3f8a-44b0-9a03-abc434fb2865 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:58.761375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34e63e8-3f8a-44b0-9a03-abc434fb2865 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:58.762174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34e63e8-3f8a-44b0-9a03-abc434fb2865 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:58.763174 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a34e63e8-3f8a-44b0-9a03-abc434fb2865 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:58.901171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a34e63e8-3f8a-44b0-9a03-abc434fb2865 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:08:58.909618 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a34e63e8-3f8a-44b0-9a03-abc434fb2865 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1693 microversion: 2.1 time: 0.170409 Oct 29 04:08:58.910242 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3958/7873] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:58 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:08:59.940180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3d5e3f90-802e-40af-91d4-13c45cc09cce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:08:59.940880 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3d5e3f90-802e-40af-91d4-13c45cc09cce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:08:59.949919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f90-802e-40af-91d4-13c45cc09cce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:59.950577 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f90-802e-40af-91d4-13c45cc09cce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:59.951267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f90-802e-40af-91d4-13c45cc09cce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:08:59.952405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f90-802e-40af-91d4-13c45cc09cce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:08:59.953002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f90-802e-40af-91d4-13c45cc09cce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:08:59.953554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f90-802e-40af-91d4-13c45cc09cce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:00.098799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3d5e3f90-802e-40af-91d4-13c45cc09cce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:00.107665 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3d5e3f90-802e-40af-91d4-13c45cc09cce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1693 microversion: 2.1 time: 0.172950 Oct 29 04:09:00.108333 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3916/7874] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:08:59 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:01.132738 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-513b38cd-af1f-4747-9aaa-aab9add53190 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:01.133402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-513b38cd-af1f-4747-9aaa-aab9add53190 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:01.141140 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-513b38cd-af1f-4747-9aaa-aab9add53190 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:01.141627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-513b38cd-af1f-4747-9aaa-aab9add53190 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:01.142094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-513b38cd-af1f-4747-9aaa-aab9add53190 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:01.142769 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-513b38cd-af1f-4747-9aaa-aab9add53190 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:01.143242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-513b38cd-af1f-4747-9aaa-aab9add53190 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:01.143661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-513b38cd-af1f-4747-9aaa-aab9add53190 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:01.286536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-513b38cd-af1f-4747-9aaa-aab9add53190 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:01.294575 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-513b38cd-af1f-4747-9aaa-aab9add53190 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1693 microversion: 2.1 time: 0.165963 Oct 29 04:09:01.295368 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3959/7875] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:01 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:02.322863 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d049101e-a4a0-442b-b490-302618223cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:02.323835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d049101e-a4a0-442b-b490-302618223cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:02.332171 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d049101e-a4a0-442b-b490-302618223cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:02.332660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d049101e-a4a0-442b-b490-302618223cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:02.333112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d049101e-a4a0-442b-b490-302618223cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:02.333836 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d049101e-a4a0-442b-b490-302618223cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:02.334322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d049101e-a4a0-442b-b490-302618223cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:02.334759 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d049101e-a4a0-442b-b490-302618223cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:02.477996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d049101e-a4a0-442b-b490-302618223cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:02.486835 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d049101e-a4a0-442b-b490-302618223cd3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1670 microversion: 2.1 time: 0.170953 Oct 29 04:09:02.487413 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3917/7876] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:02 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:03.582878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9ad7fe0c-0afd-440a-8217-ee9a5afcc2d8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:03.585213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9ad7fe0c-0afd-440a-8217-ee9a5afcc2d8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:03.592742 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ad7fe0c-0afd-440a-8217-ee9a5afcc2d8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:03.593223 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ad7fe0c-0afd-440a-8217-ee9a5afcc2d8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:03.593648 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ad7fe0c-0afd-440a-8217-ee9a5afcc2d8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:03.594463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ad7fe0c-0afd-440a-8217-ee9a5afcc2d8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:03.594945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ad7fe0c-0afd-440a-8217-ee9a5afcc2d8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:03.595363 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9ad7fe0c-0afd-440a-8217-ee9a5afcc2d8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:03.665265 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9ad7fe0c-0afd-440a-8217-ee9a5afcc2d8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897/action" status: 200 len: 35118 microversion: 2.1 time: 0.086110 Oct 29 04:09:03.666119 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3960/7877] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:09:03 2022] POST /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897/action => generated 35118 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:09:03.681368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3eabd388-f293-4521-a34e-8cd0a9855f61 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:03.689944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3eabd388-f293-4521-a34e-8cd0a9855f61 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:03.690459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3eabd388-f293-4521-a34e-8cd0a9855f61 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:03.690911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3eabd388-f293-4521-a34e-8cd0a9855f61 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:03.714292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3eabd388-f293-4521-a34e-8cd0a9855f61 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Going to try to start instance {{(pid=127041) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 04:09:03.761200 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3eabd388-f293-4521-a34e-8cd0a9855f61 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897/action" status: 202 len: 0 microversion: 2.1 time: 0.084734 Oct 29 04:09:03.761791 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3918/7878] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:09:03 2022] POST /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:09:03.771515 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-60b89036-66a3-48f9-9d1b-3d7e565420c3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:03.772323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-60b89036-66a3-48f9-9d1b-3d7e565420c3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:03.780680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60b89036-66a3-48f9-9d1b-3d7e565420c3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:03.781161 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60b89036-66a3-48f9-9d1b-3d7e565420c3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:03.782591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60b89036-66a3-48f9-9d1b-3d7e565420c3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:03.783437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60b89036-66a3-48f9-9d1b-3d7e565420c3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:03.784480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60b89036-66a3-48f9-9d1b-3d7e565420c3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:03.784899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60b89036-66a3-48f9-9d1b-3d7e565420c3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:03.931233 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-60b89036-66a3-48f9-9d1b-3d7e565420c3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:03.939569 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-60b89036-66a3-48f9-9d1b-3d7e565420c3 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1679 microversion: 2.1 time: 0.172390 Oct 29 04:09:03.940443 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3961/7879] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:03 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:04.969602 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d2c5d698-5c28-4bc6-86cb-234f9dbd722c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:04.970344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d2c5d698-5c28-4bc6-86cb-234f9dbd722c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:04.977217 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c5d698-5c28-4bc6-86cb-234f9dbd722c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:04.977790 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c5d698-5c28-4bc6-86cb-234f9dbd722c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:04.978368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c5d698-5c28-4bc6-86cb-234f9dbd722c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:04.979097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c5d698-5c28-4bc6-86cb-234f9dbd722c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:04.979584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c5d698-5c28-4bc6-86cb-234f9dbd722c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:04.980072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d2c5d698-5c28-4bc6-86cb-234f9dbd722c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:05.123164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d2c5d698-5c28-4bc6-86cb-234f9dbd722c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:05.131364 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d2c5d698-5c28-4bc6-86cb-234f9dbd722c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1679 microversion: 2.1 time: 0.168884 Oct 29 04:09:05.131958 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3919/7880] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:04 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:06.158400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-aabf1374-972a-4719-b4f0-c1ac4d43e698 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:06.159292 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-aabf1374-972a-4719-b4f0-c1ac4d43e698 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:06.170353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aabf1374-972a-4719-b4f0-c1ac4d43e698 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:06.170876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aabf1374-972a-4719-b4f0-c1ac4d43e698 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:06.171310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aabf1374-972a-4719-b4f0-c1ac4d43e698 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:06.172005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aabf1374-972a-4719-b4f0-c1ac4d43e698 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:06.172455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aabf1374-972a-4719-b4f0-c1ac4d43e698 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:06.172896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-aabf1374-972a-4719-b4f0-c1ac4d43e698 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:06.313268 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-aabf1374-972a-4719-b4f0-c1ac4d43e698 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:06.321278 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-aabf1374-972a-4719-b4f0-c1ac4d43e698 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1683 microversion: 2.1 time: 0.169124 Oct 29 04:09:06.321858 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3962/7881] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:06 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:28.550999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3bbc3a07-57fa-4786-a3bb-7db0e57a40e7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:28.553530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3bbc3a07-57fa-4786-a3bb-7db0e57a40e7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:28.556292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=16 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:28.556962 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:28.562900 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bbc3a07-57fa-4786-a3bb-7db0e57a40e7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:28.563401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bbc3a07-57fa-4786-a3bb-7db0e57a40e7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:28.563853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bbc3a07-57fa-4786-a3bb-7db0e57a40e7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:28.564573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bbc3a07-57fa-4786-a3bb-7db0e57a40e7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:28.565040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bbc3a07-57fa-4786-a3bb-7db0e57a40e7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:28.565476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3bbc3a07-57fa-4786-a3bb-7db0e57a40e7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:28.636010 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3bbc3a07-57fa-4786-a3bb-7db0e57a40e7 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897/action" status: 200 len: 59683 microversion: 2.1 time: 0.089760 Oct 29 04:09:28.636654 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3920/7882] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:09:28 2022] POST /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897/action => generated 59683 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:09:35.690520 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d601fc82-4091-4ae6-a365-f64744b9630d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:35.691049 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d601fc82-4091-4ae6-a365-f64744b9630d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:35.692332 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f36db674-6107-47b7-ab02-2fb03b41eb9d req-62418fa9-3371-4b32-8bd9-f782d6809ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2dfb5c2-ebed-4c87-9be0-9214d1db6897", "tag": "d22ee3b6-24e3-4e5c-90f0-10ac72511eb2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:35.693919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=18 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:35.694622 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=50 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:35.700524 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d601fc82-4091-4ae6-a365-f64744b9630d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:35.701020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d601fc82-4091-4ae6-a365-f64744b9630d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:35.701456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d601fc82-4091-4ae6-a365-f64744b9630d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:35.702198 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d601fc82-4091-4ae6-a365-f64744b9630d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:35.702657 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d601fc82-4091-4ae6-a365-f64744b9630d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:35.703088 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d601fc82-4091-4ae6-a365-f64744b9630d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:35.704187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f36db674-6107-47b7-ab02-2fb03b41eb9d req-62418fa9-3371-4b32-8bd9-f782d6809ee0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:35.704679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f36db674-6107-47b7-ab02-2fb03b41eb9d req-62418fa9-3371-4b32-8bd9-f782d6809ee0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:35.705120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f36db674-6107-47b7-ab02-2fb03b41eb9d req-62418fa9-3371-4b32-8bd9-f782d6809ee0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:35.717539 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f36db674-6107-47b7-ab02-2fb03b41eb9d req-62418fa9-3371-4b32-8bd9-f782d6809ee0 service nova] Creating event network-changed:d22ee3b6-24e3-4e5c-90f0-10ac72511eb2 for instance a2dfb5c2-ebed-4c87-9be0-9214d1db6897 on n-h1-862964-4 Oct 29 04:09:35.722979 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f36db674-6107-47b7-ab02-2fb03b41eb9d req-62418fa9-3371-4b32-8bd9-f782d6809ee0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034628 Oct 29 04:09:35.723861 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3921/7883] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:09:35.731293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d601fc82-4091-4ae6-a365-f64744b9630d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:09:35.841362 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d601fc82-4091-4ae6-a365-f64744b9630d tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 204 len: 0 microversion: 2.1 time: 0.154472 Oct 29 04:09:35.845516 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3963/7884] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 04:09:35 2022] DELETE /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:09:35.854371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9bf5b9ed-6503-4738-9e16-5c7a7b5b69cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:35.855389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9bf5b9ed-6503-4738-9e16-5c7a7b5b69cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:35.865159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bf5b9ed-6503-4738-9e16-5c7a7b5b69cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:35.865905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bf5b9ed-6503-4738-9e16-5c7a7b5b69cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:35.866827 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bf5b9ed-6503-4738-9e16-5c7a7b5b69cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:35.868460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bf5b9ed-6503-4738-9e16-5c7a7b5b69cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:35.869483 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bf5b9ed-6503-4738-9e16-5c7a7b5b69cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:35.870107 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9bf5b9ed-6503-4738-9e16-5c7a7b5b69cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:36.034009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9bf5b9ed-6503-4738-9e16-5c7a7b5b69cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:36.042482 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9bf5b9ed-6503-4738-9e16-5c7a7b5b69cd tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1689 microversion: 2.1 time: 0.194625 Oct 29 04:09:36.042937 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3922/7885] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:35 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:37.070748 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9aa22a47-f77c-4a02-a251-d2daef1b8acf tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:37.071418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9aa22a47-f77c-4a02-a251-d2daef1b8acf tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:37.078852 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9aa22a47-f77c-4a02-a251-d2daef1b8acf tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:37.079338 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9aa22a47-f77c-4a02-a251-d2daef1b8acf tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:37.079780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9aa22a47-f77c-4a02-a251-d2daef1b8acf tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:37.080486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9aa22a47-f77c-4a02-a251-d2daef1b8acf tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:37.080934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9aa22a47-f77c-4a02-a251-d2daef1b8acf tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:37.081357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9aa22a47-f77c-4a02-a251-d2daef1b8acf tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:37.221151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9aa22a47-f77c-4a02-a251-d2daef1b8acf tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:37.229663 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9aa22a47-f77c-4a02-a251-d2daef1b8acf tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1689 microversion: 2.1 time: 0.164547 Oct 29 04:09:37.230290 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3964/7886] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:37 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:37.960877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-65a8d349-7f61-46d1-a533-156e7bba1779 req-87a5d8a2-61d3-4807-b66b-360d493ad202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2dfb5c2-ebed-4c87-9be0-9214d1db6897", "name": "network-vif-deleted", "tag": "d22ee3b6-24e3-4e5c-90f0-10ac72511eb2"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:37.973513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-65a8d349-7f61-46d1-a533-156e7bba1779 req-87a5d8a2-61d3-4807-b66b-360d493ad202 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:37.974116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-65a8d349-7f61-46d1-a533-156e7bba1779 req-87a5d8a2-61d3-4807-b66b-360d493ad202 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:37.974548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-65a8d349-7f61-46d1-a533-156e7bba1779 req-87a5d8a2-61d3-4807-b66b-360d493ad202 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:37.988723 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-65a8d349-7f61-46d1-a533-156e7bba1779 req-87a5d8a2-61d3-4807-b66b-360d493ad202 service nova] Creating event network-vif-deleted:d22ee3b6-24e3-4e5c-90f0-10ac72511eb2 for instance a2dfb5c2-ebed-4c87-9be0-9214d1db6897 on n-h1-862964-4 Oct 29 04:09:37.995783 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-65a8d349-7f61-46d1-a533-156e7bba1779 req-87a5d8a2-61d3-4807-b66b-360d493ad202 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039020 Oct 29 04:09:37.996390 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3923/7887] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:09:38.255430 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:38.256042 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:38.263632 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:38.264120 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:38.264545 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:38.265246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:38.265694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:38.266154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:38.300366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:38.300847 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:38.301270 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:38.301705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lazy-loading 'fault' on Instance uuid a2dfb5c2-ebed-4c87-9be0-9214d1db6897 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:09:38.345473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:38.354510 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-51c3ed63-7af1-4890-9322-ffef7085961c tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 200 len: 1356 microversion: 2.1 time: 0.103139 Oct 29 04:09:38.355123 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3965/7888] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:38 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:39.383287 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:39.384075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: a2dfb5c2-ebed-4c87-9be0-9214d1db6897] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:39.391744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:39.392368 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:39.392829 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:39.393552 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:39.394069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:39.394511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:39.408558 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] HTTP exception thrown: Instance a2dfb5c2-ebed-4c87-9be0-9214d1db6897 could not be found. Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Request method failure captured: Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 HTTP/1.1 Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKYOzTcTPokSAkJ7f4XHySy1k6FHaxJt61hPLu98Qp40NEKP6gUTLVBNWeiqUtg8Y82ZOUB2ZECIZFhl-B-4mjTqs1i9qLrsG0sW5zEnSZXus52TZUc9XMx2uN5-V0PGULrAaaySwsvVPXqwaCtX4RO99Rzs4Vzmm9HTr1Qz2ff5DrE Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: fef87f25af434ef59f486bcca46f43f3 Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fef87f25af434ef59f486bcca46f43f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fef87f25af434ef59f486bcca46f43f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fef87f25af434ef59f486bcca46f43f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fef87f25af434ef59f486bcca46f43f3"}]}] Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: fef87f25af434ef59f486bcca46f43f3 Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestNetworkAdvancedServerOps-280428214-project Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 24c2655ccbad4be3b3d2fca5f3f01cf9 Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestNetworkAdvancedServerOps-280428214-project Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance a2dfb5c2-ebed-4c87-9be0-9214d1db6897 could not be found. Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'a2dfb5c2-ebed-4c87-9be0-9214d1db6897'} Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2dfb5c2-ebed-4c87-9be0-9214d1db6897 could not be found. Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2dfb5c2-ebed-4c87-9be0-9214d1db6897 could not be found. Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:09:39.410268 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:09:39.415999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:09:39.415999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:09:39.415999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:09:39.415999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:09:39.415999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:09:39.415999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:09:39.415999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2dfb5c2-ebed-4c87-9be0-9214d1db6897 could not be found. Oct 29 04:09:39.415999 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:09:39.415999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Returning 404 to user: Instance a2dfb5c2-ebed-4c87-9be0-9214d1db6897 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:09:39.415999 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b31ebac9-446c-481d-8f43-5b6014043226 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897" status: 404 len: 111 microversion: 2.1 time: 0.035314 Oct 29 04:09:39.415999 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3924/7889] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:39 2022] GET /compute/v2.1/servers/a2dfb5c2-ebed-4c87-9be0-9214d1db6897 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:09:43.017708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb46b083-a58f-44e0-b215-1b4f276a68ca tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '.version_select at 0x7fe1a3352820>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:43.044032 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb46b083-a58f-44e0-b215-1b4f276a68ca tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-895261684" status: 202 len: 0 microversion: 2.1 time: 0.030382 Oct 29 04:09:43.044692 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3966/7890] 10.222.0.16 () {58 vars in 1281 bytes} [Sat Oct 29 04:09:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-895261684 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:09:43.075472 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-85f290a7-e89c-4d93-b8af-be9a7bad7e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'create', calling method: .version_select at 0x7fe1a061df70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2007629905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2qno20EMj9Ppd5oXBxQ8OW4z6ct9YCDBZnsM7tOFbEbnHrxq5vuShaDi5p/c8R0o3qD/zbF2aXjo9wcLpMWJGplX7EoxHhbHBhp4/aE/nh8SP/W4yVTcK/OBKAHcXMPA=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:43.093380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-85f290a7-e89c-4d93-b8af-be9a7bad7e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for project fef87f25af434ef59f486bcca46f43f3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:09:43.098523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-85f290a7-e89c-4d93-b8af-be9a7bad7e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for user 24c2655ccbad4be3b3d2fca5f3f01cf9 and project fef87f25af434ef59f486bcca46f43f3. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:09:43.125660 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-85f290a7-e89c-4d93-b8af-be9a7bad7e72 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054981 Oct 29 04:09:43.126316 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3925/7891] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 04:09:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:09:49.084898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:49.089608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1489271603", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "networks": [{"uuid": "b63f242b-9d18-439f-8ce0-a2b6a57959c4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2007629905", "security_groups": [{"name": "tempest-secgroup-smoke-232598596"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:49.211089 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] validate_networks() for [('b63f242b-9d18-439f-8ce0-a2b6a57959c4', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:09:49.711792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:09:49.714934 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:09:49.715518 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:09:49.716502 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:09:49.716983 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:09:49.728383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:49.729256 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:49.729953 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:49.730942 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:49.731811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:49.732481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:49.760091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for project fef87f25af434ef59f486bcca46f43f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:09:49.766196 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Getting quotas for user 24c2655ccbad4be3b3d2fca5f3f01cf9 and project fef87f25af434ef59f486bcca46f43f3. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:09:49.782939 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:09:49.787156 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:09:49.842713 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c51cf636-df69-4417-ac5b-3981a25ec164 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759460 Oct 29 04:09:49.843685 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3967/7892] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 04:09:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:09:49.854012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=16 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:49.858904 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-848069e4-c511-4db6-9900-9c3fcbc22632 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:49.860178 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-848069e4-c511-4db6-9900-9c3fcbc22632 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:49.938774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-848069e4-c511-4db6-9900-9c3fcbc22632 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:49.947731 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-848069e4-c511-4db6-9900-9c3fcbc22632 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1267 microversion: 2.1 time: 0.095885 Oct 29 04:09:49.950885 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3926/7893] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:49 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:50.981843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-719dc1fd-2f74-461f-9b6f-40e3da04cc7e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:50.982469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-719dc1fd-2f74-461f-9b6f-40e3da04cc7e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:50.989492 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-719dc1fd-2f74-461f-9b6f-40e3da04cc7e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:50.990030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-719dc1fd-2f74-461f-9b6f-40e3da04cc7e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:50.990464 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-719dc1fd-2f74-461f-9b6f-40e3da04cc7e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:50.991180 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-719dc1fd-2f74-461f-9b6f-40e3da04cc7e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:50.991853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-719dc1fd-2f74-461f-9b6f-40e3da04cc7e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:50.992436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-719dc1fd-2f74-461f-9b6f-40e3da04cc7e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:51.067853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-719dc1fd-2f74-461f-9b6f-40e3da04cc7e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:51.076993 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-719dc1fd-2f74-461f-9b6f-40e3da04cc7e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1319 microversion: 2.1 time: 0.099737 Oct 29 04:09:51.077759 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3968/7894] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:50 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1319 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:52.104358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-358d3971-df60-4c70-a33d-a429ba17ccce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:52.105763 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-358d3971-df60-4c70-a33d-a429ba17ccce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:52.118820 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-358d3971-df60-4c70-a33d-a429ba17ccce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:52.119622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-358d3971-df60-4c70-a33d-a429ba17ccce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:52.120075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-358d3971-df60-4c70-a33d-a429ba17ccce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:52.120826 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-358d3971-df60-4c70-a33d-a429ba17ccce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:52.121302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-358d3971-df60-4c70-a33d-a429ba17ccce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:52.122572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-358d3971-df60-4c70-a33d-a429ba17ccce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:52.282454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-358d3971-df60-4c70-a33d-a429ba17ccce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:52.290695 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-358d3971-df60-4c70-a33d-a429ba17ccce tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1392 microversion: 2.1 time: 0.192027 Oct 29 04:09:52.306715 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3927/7895] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:52 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1392 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:52.860225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-375f5efd-86f1-4a04-827a-f2f16f95e8d3 req-fd4ec3a6-9881-4e95-8c45-aca3346fae6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b79577-2689-48f9-8fe5-eb24dd406c41", "tag": "b1592928-954b-4468-a490-0c3df239fdfc"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:52.874274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-375f5efd-86f1-4a04-827a-f2f16f95e8d3 req-fd4ec3a6-9881-4e95-8c45-aca3346fae6c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:52.875048 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-375f5efd-86f1-4a04-827a-f2f16f95e8d3 req-fd4ec3a6-9881-4e95-8c45-aca3346fae6c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:52.875669 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-375f5efd-86f1-4a04-827a-f2f16f95e8d3 req-fd4ec3a6-9881-4e95-8c45-aca3346fae6c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:52.889065 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-375f5efd-86f1-4a04-827a-f2f16f95e8d3 req-fd4ec3a6-9881-4e95-8c45-aca3346fae6c service nova] Creating event network-changed:b1592928-954b-4468-a490-0c3df239fdfc for instance b7b79577-2689-48f9-8fe5-eb24dd406c41 on n-h1-862964-4 Oct 29 04:09:52.895117 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-375f5efd-86f1-4a04-827a-f2f16f95e8d3 req-fd4ec3a6-9881-4e95-8c45-aca3346fae6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039397 Oct 29 04:09:52.896099 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3969/7896] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:09:53.316585 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b2cde99b-6387-49c2-8144-1e1e43315da9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:53.317168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b2cde99b-6387-49c2-8144-1e1e43315da9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:53.325792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2cde99b-6387-49c2-8144-1e1e43315da9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:53.326302 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2cde99b-6387-49c2-8144-1e1e43315da9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:53.326782 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2cde99b-6387-49c2-8144-1e1e43315da9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:53.327622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2cde99b-6387-49c2-8144-1e1e43315da9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:53.328122 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2cde99b-6387-49c2-8144-1e1e43315da9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:53.328558 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2cde99b-6387-49c2-8144-1e1e43315da9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:53.464428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b2cde99b-6387-49c2-8144-1e1e43315da9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:53.473463 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b2cde99b-6387-49c2-8144-1e1e43315da9 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1392 microversion: 2.1 time: 0.161587 Oct 29 04:09:53.474333 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3928/7897] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:53 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:54.505399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-91ef8f47-5db0-4059-93bc-1e4522159238 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:54.506598 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-91ef8f47-5db0-4059-93bc-1e4522159238 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:54.514379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ef8f47-5db0-4059-93bc-1e4522159238 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:54.514867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ef8f47-5db0-4059-93bc-1e4522159238 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:54.515300 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ef8f47-5db0-4059-93bc-1e4522159238 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:54.515992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ef8f47-5db0-4059-93bc-1e4522159238 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:54.516440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ef8f47-5db0-4059-93bc-1e4522159238 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:54.516863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-91ef8f47-5db0-4059-93bc-1e4522159238 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:54.657726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-91ef8f47-5db0-4059-93bc-1e4522159238 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:54.665749 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-91ef8f47-5db0-4059-93bc-1e4522159238 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1392 microversion: 2.1 time: 0.169205 Oct 29 04:09:54.666427 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3970/7898] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:54 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:55.689030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7fbddfe8-97f4-4437-b880-d3425a521cb8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:55.689647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7fbddfe8-97f4-4437-b880-d3425a521cb8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:55.697792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fbddfe8-97f4-4437-b880-d3425a521cb8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:55.698275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fbddfe8-97f4-4437-b880-d3425a521cb8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:55.698975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fbddfe8-97f4-4437-b880-d3425a521cb8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:55.699684 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fbddfe8-97f4-4437-b880-d3425a521cb8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:55.700136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fbddfe8-97f4-4437-b880-d3425a521cb8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:55.700573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7fbddfe8-97f4-4437-b880-d3425a521cb8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:55.840132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7fbddfe8-97f4-4437-b880-d3425a521cb8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:55.852317 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7fbddfe8-97f4-4437-b880-d3425a521cb8 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1392 microversion: 2.1 time: 0.167071 Oct 29 04:09:55.852945 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3929/7899] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:55 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:56.877612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9c14fc4b-cf9c-497d-a1f9-f1f781f718fb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:56.878404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9c14fc4b-cf9c-497d-a1f9-f1f781f718fb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:56.885756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c14fc4b-cf9c-497d-a1f9-f1f781f718fb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:56.886283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c14fc4b-cf9c-497d-a1f9-f1f781f718fb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:56.886729 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c14fc4b-cf9c-497d-a1f9-f1f781f718fb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:56.887436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c14fc4b-cf9c-497d-a1f9-f1f781f718fb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:56.887897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c14fc4b-cf9c-497d-a1f9-f1f781f718fb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:56.888323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9c14fc4b-cf9c-497d-a1f9-f1f781f718fb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:57.029550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9c14fc4b-cf9c-497d-a1f9-f1f781f718fb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:57.037748 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9c14fc4b-cf9c-497d-a1f9-f1f781f718fb tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1392 microversion: 2.1 time: 0.164666 Oct 29 04:09:57.038369 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3971/7900] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:56 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:57.698777 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4ca94a5b-7c63-4c6d-a6c6-8e663dd28044 req-f01a233a-9d37-4b63-91b9-d9699132d5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b79577-2689-48f9-8fe5-eb24dd406c41", "name": "network-vif-plugged", "status": "completed", "tag": "b1592928-954b-4468-a490-0c3df239fdfc"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:57.712328 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4ca94a5b-7c63-4c6d-a6c6-8e663dd28044 req-f01a233a-9d37-4b63-91b9-d9699132d5d1 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:57.712806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4ca94a5b-7c63-4c6d-a6c6-8e663dd28044 req-f01a233a-9d37-4b63-91b9-d9699132d5d1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:57.713249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4ca94a5b-7c63-4c6d-a6c6-8e663dd28044 req-f01a233a-9d37-4b63-91b9-d9699132d5d1 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:57.724937 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4ca94a5b-7c63-4c6d-a6c6-8e663dd28044 req-f01a233a-9d37-4b63-91b9-d9699132d5d1 service nova] Creating event network-vif-plugged:b1592928-954b-4468-a490-0c3df239fdfc for instance b7b79577-2689-48f9-8fe5-eb24dd406c41 on n-h1-862964-4 Oct 29 04:09:57.730068 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4ca94a5b-7c63-4c6d-a6c6-8e663dd28044 req-f01a233a-9d37-4b63-91b9-d9699132d5d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035421 Oct 29 04:09:57.730670 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3930/7901] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:09:58.061469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6b27da55-8d41-42b6-ae7f-269b0bb812fa tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:58.062122 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6b27da55-8d41-42b6-ae7f-269b0bb812fa tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:58.069624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b27da55-8d41-42b6-ae7f-269b0bb812fa tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:58.070143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b27da55-8d41-42b6-ae7f-269b0bb812fa tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:58.070566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b27da55-8d41-42b6-ae7f-269b0bb812fa tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:58.071253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b27da55-8d41-42b6-ae7f-269b0bb812fa tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:58.071701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b27da55-8d41-42b6-ae7f-269b0bb812fa tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:58.072115 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6b27da55-8d41-42b6-ae7f-269b0bb812fa tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:58.228225 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6b27da55-8d41-42b6-ae7f-269b0bb812fa tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:58.237177 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6b27da55-8d41-42b6-ae7f-269b0bb812fa tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1392 microversion: 2.1 time: 0.180007 Oct 29 04:09:58.237737 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3972/7902] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:58 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:59.270941 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-10f066d2-44c7-49b2-90ba-13036e97f762 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:59.271911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-10f066d2-44c7-49b2-90ba-13036e97f762 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:59.274666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:59.283006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10f066d2-44c7-49b2-90ba-13036e97f762 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:59.283518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10f066d2-44c7-49b2-90ba-13036e97f762 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:59.283971 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10f066d2-44c7-49b2-90ba-13036e97f762 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:59.284705 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10f066d2-44c7-49b2-90ba-13036e97f762 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:59.285146 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10f066d2-44c7-49b2-90ba-13036e97f762 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:59.285578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-10f066d2-44c7-49b2-90ba-13036e97f762 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:59.419933 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-10f066d2-44c7-49b2-90ba-13036e97f762 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:59.428544 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-10f066d2-44c7-49b2-90ba-13036e97f762 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1563 microversion: 2.1 time: 0.165409 Oct 29 04:09:59.429118 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3931/7903] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:59 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:59.451517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ec1415a3-be2b-4298-a776-e9a88d9eed92 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:59.452157 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ec1415a3-be2b-4298-a776-e9a88d9eed92 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:59.459471 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1415a3-be2b-4298-a776-e9a88d9eed92 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:59.459962 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1415a3-be2b-4298-a776-e9a88d9eed92 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:59.460379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1415a3-be2b-4298-a776-e9a88d9eed92 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:59.461065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1415a3-be2b-4298-a776-e9a88d9eed92 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:59.461506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1415a3-be2b-4298-a776-e9a88d9eed92 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:59.461945 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ec1415a3-be2b-4298-a776-e9a88d9eed92 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:59.610389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ec1415a3-be2b-4298-a776-e9a88d9eed92 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:59.618507 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ec1415a3-be2b-4298-a776-e9a88d9eed92 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1563 microversion: 2.1 time: 0.170948 Oct 29 04:09:59.619088 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3973/7904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:59 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:01.607677 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ac52010b-cfe8-4332-b229-602ad0ae30b0 req-3c132c5c-b9d7-445c-9d30-b62e58f20bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b79577-2689-48f9-8fe5-eb24dd406c41", "tag": "b1592928-954b-4468-a490-0c3df239fdfc"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:10:01.613498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3e5bd5c2-2884-466c-8445-5cd028887e0f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:01.614152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3e5bd5c2-2884-466c-8445-5cd028887e0f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:01.616182 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:01.621311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:01.622005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:01.625847 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e5bd5c2-2884-466c-8445-5cd028887e0f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:01.626345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e5bd5c2-2884-466c-8445-5cd028887e0f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:01.626800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e5bd5c2-2884-466c-8445-5cd028887e0f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:01.627522 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e5bd5c2-2884-466c-8445-5cd028887e0f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:01.627986 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e5bd5c2-2884-466c-8445-5cd028887e0f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:01.628423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e5bd5c2-2884-466c-8445-5cd028887e0f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:01.640496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ac52010b-cfe8-4332-b229-602ad0ae30b0 req-3c132c5c-b9d7-445c-9d30-b62e58f20bc4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:01.641024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ac52010b-cfe8-4332-b229-602ad0ae30b0 req-3c132c5c-b9d7-445c-9d30-b62e58f20bc4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:01.641519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ac52010b-cfe8-4332-b229-602ad0ae30b0 req-3c132c5c-b9d7-445c-9d30-b62e58f20bc4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:01.656972 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ac52010b-cfe8-4332-b229-602ad0ae30b0 req-3c132c5c-b9d7-445c-9d30-b62e58f20bc4 service nova] Creating event network-changed:b1592928-954b-4468-a490-0c3df239fdfc for instance b7b79577-2689-48f9-8fe5-eb24dd406c41 on n-h1-862964-4 Oct 29 04:10:01.662313 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ac52010b-cfe8-4332-b229-602ad0ae30b0 req-3c132c5c-b9d7-445c-9d30-b62e58f20bc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058329 Oct 29 04:10:01.663353 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3974/7905] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:10:01.780699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3e5bd5c2-2884-466c-8445-5cd028887e0f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:01.790020 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3e5bd5c2-2884-466c-8445-5cd028887e0f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1563 microversion: 2.1 time: 0.189001 Oct 29 04:10:01.790526 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3932/7906] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:01 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:23.073033 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:23.073937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=36 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:23.078539 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-12a9be62-a18b-4f80-8e7a-7ed57e91fd6e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:10:23.080878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-12a9be62-a18b-4f80-8e7a-7ed57e91fd6e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:23.088898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12a9be62-a18b-4f80-8e7a-7ed57e91fd6e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:23.089370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12a9be62-a18b-4f80-8e7a-7ed57e91fd6e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:23.089835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12a9be62-a18b-4f80-8e7a-7ed57e91fd6e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:23.090542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12a9be62-a18b-4f80-8e7a-7ed57e91fd6e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:23.090993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12a9be62-a18b-4f80-8e7a-7ed57e91fd6e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:23.091414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-12a9be62-a18b-4f80-8e7a-7ed57e91fd6e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:23.162333 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-12a9be62-a18b-4f80-8e7a-7ed57e91fd6e tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41/action" status: 200 len: 24560 microversion: 2.1 time: 0.090994 Oct 29 04:10:23.162990 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3975/7907] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:10:23 2022] POST /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41/action => generated 24560 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:10:29.514391 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cca14808-acff-41fb-a73c-6e135f865189 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:10:29.515019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cca14808-acff-41fb-a73c-6e135f865189 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:29.516978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:29.517658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=32 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:29.524102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cca14808-acff-41fb-a73c-6e135f865189 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:29.524648 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cca14808-acff-41fb-a73c-6e135f865189 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:29.525097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cca14808-acff-41fb-a73c-6e135f865189 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:29.525821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cca14808-acff-41fb-a73c-6e135f865189 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:29.526292 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cca14808-acff-41fb-a73c-6e135f865189 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:29.526723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cca14808-acff-41fb-a73c-6e135f865189 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:29.551465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-cca14808-acff-41fb-a73c-6e135f865189 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lazy-loading 'flavor' on Instance uuid b7b79577-2689-48f9-8fe5-eb24dd406c41 {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:10:29.624805 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cca14808-acff-41fb-a73c-6e135f865189 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41/action" status: 202 len: 0 microversion: 2.1 time: 0.114676 Oct 29 04:10:29.625613 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3933/7908] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:10:29 2022] POST /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:10:29.635098 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4cee7916-5298-4304-83f2-87b1225f2c7b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:29.636230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4cee7916-5298-4304-83f2-87b1225f2c7b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:29.644663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cee7916-5298-4304-83f2-87b1225f2c7b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:29.645229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cee7916-5298-4304-83f2-87b1225f2c7b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:29.645777 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cee7916-5298-4304-83f2-87b1225f2c7b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:29.646630 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cee7916-5298-4304-83f2-87b1225f2c7b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:29.647227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cee7916-5298-4304-83f2-87b1225f2c7b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:29.647654 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4cee7916-5298-4304-83f2-87b1225f2c7b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:29.788665 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4cee7916-5298-4304-83f2-87b1225f2c7b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:29.797062 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4cee7916-5298-4304-83f2-87b1225f2c7b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1690 microversion: 2.1 time: 0.166790 Oct 29 04:10:29.797648 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3976/7909] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:29 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:30.826356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7ef754bd-a397-448e-8a33-774636c78aa4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:30.827325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7ef754bd-a397-448e-8a33-774636c78aa4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:30.839800 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef754bd-a397-448e-8a33-774636c78aa4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:30.840396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef754bd-a397-448e-8a33-774636c78aa4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:30.840822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef754bd-a397-448e-8a33-774636c78aa4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:30.841551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef754bd-a397-448e-8a33-774636c78aa4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:30.842054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef754bd-a397-448e-8a33-774636c78aa4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:30.842487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7ef754bd-a397-448e-8a33-774636c78aa4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:31.063331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7ef754bd-a397-448e-8a33-774636c78aa4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:31.075400 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7ef754bd-a397-448e-8a33-774636c78aa4 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1673 microversion: 2.1 time: 0.256755 Oct 29 04:10:31.075944 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3934/7910] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:30 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1673 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:32.179364 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d5ff3b34-d1d5-4cbe-8e99-c007b973f806 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:10:32.183152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d5ff3b34-d1d5-4cbe-8e99-c007b973f806 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:32.191489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5ff3b34-d1d5-4cbe-8e99-c007b973f806 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:32.191978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5ff3b34-d1d5-4cbe-8e99-c007b973f806 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:32.192413 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5ff3b34-d1d5-4cbe-8e99-c007b973f806 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:32.193105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5ff3b34-d1d5-4cbe-8e99-c007b973f806 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:32.193559 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5ff3b34-d1d5-4cbe-8e99-c007b973f806 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:32.194020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d5ff3b34-d1d5-4cbe-8e99-c007b973f806 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:32.254848 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d5ff3b34-d1d5-4cbe-8e99-c007b973f806 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41/action" status: 200 len: 35446 microversion: 2.1 time: 0.082184 Oct 29 04:10:32.255484 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3977/7911] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:10:32 2022] POST /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41/action => generated 35446 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:10:32.268887 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cc11ca7c-2ddf-485e-9134-a3f9b98c8ac5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:10:32.269433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cc11ca7c-2ddf-485e-9134-a3f9b98c8ac5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:32.272122 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:10:32.272313 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 04:10:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41/action (ip 10.222.0.16) !!! Oct 29 04:10:32.281852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc11ca7c-2ddf-485e-9134-a3f9b98c8ac5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:32.282371 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc11ca7c-2ddf-485e-9134-a3f9b98c8ac5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:32.282830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc11ca7c-2ddf-485e-9134-a3f9b98c8ac5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:32.283532 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc11ca7c-2ddf-485e-9134-a3f9b98c8ac5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:32.284060 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc11ca7c-2ddf-485e-9134-a3f9b98c8ac5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:32.284498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cc11ca7c-2ddf-485e-9134-a3f9b98c8ac5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:32.361429 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cc11ca7c-2ddf-485e-9134-a3f9b98c8ac5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41/action" status: 202 len: 0 microversion: 2.1 time: 0.096622 Oct 29 04:10:32.362233 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3935/7912] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:10:32 2022] POST /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:10:32.373323 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b850edae-dffc-4bc8-87d5-7e052292247b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:32.374147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b850edae-dffc-4bc8-87d5-7e052292247b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:32.381052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b850edae-dffc-4bc8-87d5-7e052292247b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:32.381597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b850edae-dffc-4bc8-87d5-7e052292247b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:32.382003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b850edae-dffc-4bc8-87d5-7e052292247b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:32.382753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b850edae-dffc-4bc8-87d5-7e052292247b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:32.383147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b850edae-dffc-4bc8-87d5-7e052292247b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:32.383564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b850edae-dffc-4bc8-87d5-7e052292247b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:32.603389 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b850edae-dffc-4bc8-87d5-7e052292247b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:32.612512 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b850edae-dffc-4bc8-87d5-7e052292247b tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1679 microversion: 2.1 time: 0.243577 Oct 29 04:10:32.613098 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3978/7913] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:32 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:33.642037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-38c7f058-91be-4ca1-8c79-2325b0e345f5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:33.642864 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-38c7f058-91be-4ca1-8c79-2325b0e345f5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:33.651327 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38c7f058-91be-4ca1-8c79-2325b0e345f5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:33.651959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38c7f058-91be-4ca1-8c79-2325b0e345f5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:33.652409 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38c7f058-91be-4ca1-8c79-2325b0e345f5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:33.653126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38c7f058-91be-4ca1-8c79-2325b0e345f5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:33.653628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38c7f058-91be-4ca1-8c79-2325b0e345f5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:33.654093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-38c7f058-91be-4ca1-8c79-2325b0e345f5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:33.803316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-38c7f058-91be-4ca1-8c79-2325b0e345f5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:33.811434 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-38c7f058-91be-4ca1-8c79-2325b0e345f5 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1679 microversion: 2.1 time: 0.176024 Oct 29 04:10:33.812014 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3936/7914] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:33 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:34.840324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0dd044bc-53e3-4c4a-8668-12bc771abf2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:34.840912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0dd044bc-53e3-4c4a-8668-12bc771abf2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:34.849076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dd044bc-53e3-4c4a-8668-12bc771abf2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:34.849607 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dd044bc-53e3-4c4a-8668-12bc771abf2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:34.850123 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dd044bc-53e3-4c4a-8668-12bc771abf2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:34.850886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dd044bc-53e3-4c4a-8668-12bc771abf2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:34.851404 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dd044bc-53e3-4c4a-8668-12bc771abf2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:34.851865 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0dd044bc-53e3-4c4a-8668-12bc771abf2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:34.987131 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0dd044bc-53e3-4c4a-8668-12bc771abf2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:34.995423 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0dd044bc-53e3-4c4a-8668-12bc771abf2f tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1682 microversion: 2.1 time: 0.161529 Oct 29 04:10:34.996005 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3979/7915] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:34 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:35.113045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1d55a059-1986-4139-8165-ec037f2eef48 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:10:35.115326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1d55a059-1986-4139-8165-ec037f2eef48 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:35.122524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d55a059-1986-4139-8165-ec037f2eef48 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:35.123027 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d55a059-1986-4139-8165-ec037f2eef48 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:35.123479 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d55a059-1986-4139-8165-ec037f2eef48 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:35.124205 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d55a059-1986-4139-8165-ec037f2eef48 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:35.124677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d55a059-1986-4139-8165-ec037f2eef48 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:35.125116 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d55a059-1986-4139-8165-ec037f2eef48 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:35.190252 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1d55a059-1986-4139-8165-ec037f2eef48 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "POST /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41/action" status: 200 len: 35446 microversion: 2.1 time: 0.081337 Oct 29 04:10:35.191239 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3937/7916] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:10:35 2022] POST /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41/action => generated 35446 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:10:36.538525 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-fdd4a81f-0ac2-47d2-ab29-4ee38ee29e96 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:36.539076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fdd4a81f-0ac2-47d2-ab29-4ee38ee29e96 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:36.545126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-dfde4ecf-f945-41e6-99b0-6874e503e1d7 req-4ebb9eda-b492-4e92-bc43-709063b651e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b79577-2689-48f9-8fe5-eb24dd406c41", "tag": "b1592928-954b-4468-a490-0c3df239fdfc"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:10:36.547391 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdd4a81f-0ac2-47d2-ab29-4ee38ee29e96 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:36.548109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdd4a81f-0ac2-47d2-ab29-4ee38ee29e96 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:36.548714 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdd4a81f-0ac2-47d2-ab29-4ee38ee29e96 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:36.549608 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdd4a81f-0ac2-47d2-ab29-4ee38ee29e96 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:36.550253 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdd4a81f-0ac2-47d2-ab29-4ee38ee29e96 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:36.550880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-fdd4a81f-0ac2-47d2-ab29-4ee38ee29e96 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:36.558618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-dfde4ecf-f945-41e6-99b0-6874e503e1d7 req-4ebb9eda-b492-4e92-bc43-709063b651e5 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:36.559112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-dfde4ecf-f945-41e6-99b0-6874e503e1d7 req-4ebb9eda-b492-4e92-bc43-709063b651e5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:36.559830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-dfde4ecf-f945-41e6-99b0-6874e503e1d7 req-4ebb9eda-b492-4e92-bc43-709063b651e5 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:36.572796 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-dfde4ecf-f945-41e6-99b0-6874e503e1d7 req-4ebb9eda-b492-4e92-bc43-709063b651e5 service nova] Creating event network-changed:b1592928-954b-4468-a490-0c3df239fdfc for instance b7b79577-2689-48f9-8fe5-eb24dd406c41 on n-h1-862964-4 Oct 29 04:10:36.577935 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-dfde4ecf-f945-41e6-99b0-6874e503e1d7 req-4ebb9eda-b492-4e92-bc43-709063b651e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040198 Oct 29 04:10:36.578556 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3938/7917] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:10:36.586667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-fdd4a81f-0ac2-47d2-ab29-4ee38ee29e96 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:10:36.675564 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-fdd4a81f-0ac2-47d2-ab29-4ee38ee29e96 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 204 len: 0 microversion: 2.1 time: 0.140625 Oct 29 04:10:36.676738 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3980/7918] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 04:10:36 2022] DELETE /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:10:36.686526 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2324f050-83ff-48ba-9812-5e3175d1ba41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:36.687712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2324f050-83ff-48ba-9812-5e3175d1ba41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:36.697434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2324f050-83ff-48ba-9812-5e3175d1ba41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:36.698062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2324f050-83ff-48ba-9812-5e3175d1ba41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:36.698598 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2324f050-83ff-48ba-9812-5e3175d1ba41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:36.699351 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2324f050-83ff-48ba-9812-5e3175d1ba41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:36.699814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2324f050-83ff-48ba-9812-5e3175d1ba41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:36.700246 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2324f050-83ff-48ba-9812-5e3175d1ba41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:36.839745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2324f050-83ff-48ba-9812-5e3175d1ba41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:36.848496 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2324f050-83ff-48ba-9812-5e3175d1ba41 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1688 microversion: 2.1 time: 0.167249 Oct 29 04:10:36.849129 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3939/7919] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:36 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:10:37.879756 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-66832cf0-e30d-4e77-9757-58c4dcc7010a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:37.880905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-66832cf0-e30d-4e77-9757-58c4dcc7010a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:37.892631 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66832cf0-e30d-4e77-9757-58c4dcc7010a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:37.893436 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66832cf0-e30d-4e77-9757-58c4dcc7010a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:37.894221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66832cf0-e30d-4e77-9757-58c4dcc7010a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:37.895412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66832cf0-e30d-4e77-9757-58c4dcc7010a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:37.896162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66832cf0-e30d-4e77-9757-58c4dcc7010a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:37.896857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-66832cf0-e30d-4e77-9757-58c4dcc7010a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:38.032937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-66832cf0-e30d-4e77-9757-58c4dcc7010a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:38.041303 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-66832cf0-e30d-4e77-9757-58c4dcc7010a tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1688 microversion: 2.1 time: 0.168860 Oct 29 04:10:38.041900 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3981/7920] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:37 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:38.957661 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-cdc049d2-c86f-49ce-b80d-171ebaa619eb req-00986b11-03cd-481a-88a8-ab533724963e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b79577-2689-48f9-8fe5-eb24dd406c41", "name": "network-vif-deleted", "tag": "b1592928-954b-4468-a490-0c3df239fdfc"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:10:38.969034 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cdc049d2-c86f-49ce-b80d-171ebaa619eb req-00986b11-03cd-481a-88a8-ab533724963e service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:38.969533 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cdc049d2-c86f-49ce-b80d-171ebaa619eb req-00986b11-03cd-481a-88a8-ab533724963e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:38.970006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-cdc049d2-c86f-49ce-b80d-171ebaa619eb req-00986b11-03cd-481a-88a8-ab533724963e service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:38.982063 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-cdc049d2-c86f-49ce-b80d-171ebaa619eb req-00986b11-03cd-481a-88a8-ab533724963e service nova] Creating event network-vif-deleted:b1592928-954b-4468-a490-0c3df239fdfc for instance b7b79577-2689-48f9-8fe5-eb24dd406c41 on n-h1-862964-4 Oct 29 04:10:38.987873 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-cdc049d2-c86f-49ce-b80d-171ebaa619eb req-00986b11-03cd-481a-88a8-ab533724963e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034050 Oct 29 04:10:38.988699 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3940/7921] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:10:39.065579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:39.066272 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:39.073793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:39.074383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:39.074817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:39.075511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:39.075957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:39.076376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:39.110038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:39.110567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:39.111060 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:39.111625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lazy-loading 'fault' on Instance uuid b7b79577-2689-48f9-8fe5-eb24dd406c41 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:10:39.157875 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c2655ccbad4be3b3d2fca5f3f01cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef87f25af434ef59f486bcca46f43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:39.165965 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-4fc5efea-a4d2-4849-ad4a-120b9cd60159 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 200 len: 1357 microversion: 2.1 time: 0.104381 Oct 29 04:10:39.166475 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3982/7922] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:39 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:40.194869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:40.195889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] [instance: b7b79577-2689-48f9-8fe5-eb24dd406c41] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:40.205144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:40.205852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:40.206525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:40.207512 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:40.208172 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:40.208822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:40.225202 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] HTTP exception thrown: Instance b7b79577-2689-48f9-8fe5-eb24dd406c41 could not be found. Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Request method failure captured: Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 HTTP/1.1 Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKYOzTcTPokSAkJ7f4XHySy1k6FHaxJt61hPLu98Qp40NEKP6gUTLVBNWeiqUtg8Y82ZOUB2ZECIZFhl-B-4mjTqs1i9qLrsG0sW5zEnSZXus52TZUc9XMx2uN5-V0PGULrAaaySwsvVPXqwaCtX4RO99Rzs4Vzmm9HTr1Qz2ff5DrE Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: fef87f25af434ef59f486bcca46f43f3 Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fef87f25af434ef59f486bcca46f43f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fef87f25af434ef59f486bcca46f43f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fef87f25af434ef59f486bcca46f43f3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fef87f25af434ef59f486bcca46f43f3"}]}] Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: fef87f25af434ef59f486bcca46f43f3 Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-280428214 Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestNetworkAdvancedServerOps-280428214-project Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 24c2655ccbad4be3b3d2fca5f3f01cf9 Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestNetworkAdvancedServerOps-280428214-project Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance b7b79577-2689-48f9-8fe5-eb24dd406c41 could not be found. Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'b7b79577-2689-48f9-8fe5-eb24dd406c41'} Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b79577-2689-48f9-8fe5-eb24dd406c41 could not be found. Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b79577-2689-48f9-8fe5-eb24dd406c41 could not be found. Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:10:40.226930 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:10:40.232354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:10:40.232354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:10:40.232354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:10:40.232354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:10:40.232354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:10:40.232354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:10:40.232354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b79577-2689-48f9-8fe5-eb24dd406c41 could not be found. Oct 29 04:10:40.232354 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:10:40.232354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Returning 404 to user: Instance b7b79577-2689-48f9-8fe5-eb24dd406c41 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:10:40.232354 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ec12a586-f313-406e-a81b-1f0916a09fe1 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41" status: 404 len: 111 microversion: 2.1 time: 0.041092 Oct 29 04:10:40.233425 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3941/7923] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:40 2022] GET /compute/v2.1/servers/b7b79577-2689-48f9-8fe5-eb24dd406c41 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:10:43.419593 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6d83dff4-34bd-4158-996c-24dce3ebf4b6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] Calling method '.version_select at 0x7fe1acb0f310>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:43.450216 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6d83dff4-34bd-4158-996c-24dce3ebf4b6 tempest-TestNetworkAdvancedServerOps-280428214 tempest-TestNetworkAdvancedServerOps-280428214-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2007629905" status: 202 len: 0 microversion: 2.1 time: 0.034542 Oct 29 04:10:43.450950 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3983/7924] 10.222.0.16 () {58 vars in 1284 bytes} [Sat Oct 29 04:10:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2007629905 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:10:55.015733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=18 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:55.020809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:55.244050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-11dbdcb0-644a-4a52-83a3-946e52b587de tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Action: 'create', calling method: .version_select at 0x7fe1a8094790>, body: {"keypair": {"name": "tempest-TestShelveInstance-2039614335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiVHlDGkYieTm7RWTxl/LIby/PprX4On22hENyO5heEgI/5FuGab0fx2WO1875nDv1rnHk6fjxPAJY9/LVJRCGi4q6q40cBCAf5q/3x/CowkSR2y1jG1zHW1NVmLcRHrA=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:10:55.261266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-11dbdcb0-644a-4a52-83a3-946e52b587de tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Getting quotas for project d1f0589e74da4bef8f38623954cb94ca. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:10:55.268140 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-11dbdcb0-644a-4a52-83a3-946e52b587de tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Getting quotas for user 533f2ae735974e27977c592a514e856e and project d1f0589e74da4bef8f38623954cb94ca. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:10:55.295684 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-11dbdcb0-644a-4a52-83a3-946e52b587de tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.287007 Oct 29 04:10:55.296306 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3942/7925] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 04:10:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:10:56.331455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-161136828", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2039614335", "security_groups": [{"name": "tempest-secgroup-smoke-307304093"}], "networks": [{"uuid": "75dc482c-cd7e-4992-8815-9bd1e8e9ee04"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:10:56.342412 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:56.343081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:56.445399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] validate_networks() for [('75dc482c-cd7e-4992-8815-9bd1e8e9ee04', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:10:56.845526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:10:56.845987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:10:56.846455 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:10:56.847078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:10:56.847486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:10:56.857660 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:56.858329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:56.858776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:56.859898 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:56.860381 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:56.860770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:56.880692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Getting quotas for project d1f0589e74da4bef8f38623954cb94ca. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:10:56.886095 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Getting quotas for user 533f2ae735974e27977c592a514e856e and project d1f0589e74da4bef8f38623954cb94ca. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:10:56.898820 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:10:56.901193 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:10:56.951873 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-557f286a-783c-4414-93a0-5a0b4d0e7811 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.624283 Oct 29 04:10:56.953294 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3984/7926] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 04:10:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:10:56.966156 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e288a9aa-7a08-4da1-b620-5c57a8afb0d5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:56.966765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e288a9aa-7a08-4da1-b620-5c57a8afb0d5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:57.056727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e288a9aa-7a08-4da1-b620-5c57a8afb0d5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:57.065156 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e288a9aa-7a08-4da1-b620-5c57a8afb0d5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1246 microversion: 2.1 time: 0.104621 Oct 29 04:10:57.065767 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3943/7927] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:56 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:58.091036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-b919370e-ab87-4336-9faa-f4d2be5be770 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:58.091645 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-b919370e-ab87-4336-9faa-f4d2be5be770 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:58.099749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b919370e-ab87-4336-9faa-f4d2be5be770 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:58.100245 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b919370e-ab87-4336-9faa-f4d2be5be770 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:58.100691 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b919370e-ab87-4336-9faa-f4d2be5be770 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:58.101425 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b919370e-ab87-4336-9faa-f4d2be5be770 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:58.101916 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b919370e-ab87-4336-9faa-f4d2be5be770 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:58.102330 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-b919370e-ab87-4336-9faa-f4d2be5be770 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:58.173506 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-b919370e-ab87-4336-9faa-f4d2be5be770 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:58.181704 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-b919370e-ab87-4336-9faa-f4d2be5be770 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1298 microversion: 2.1 time: 0.096592 Oct 29 04:10:58.182322 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3985/7928] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:58 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:59.205211 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f52e9331-fedb-4010-bf43-0ce468019c50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:59.205868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f52e9331-fedb-4010-bf43-0ce468019c50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:59.214083 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f52e9331-fedb-4010-bf43-0ce468019c50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:59.214696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f52e9331-fedb-4010-bf43-0ce468019c50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:59.215121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f52e9331-fedb-4010-bf43-0ce468019c50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:59.216114 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f52e9331-fedb-4010-bf43-0ce468019c50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:59.216590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f52e9331-fedb-4010-bf43-0ce468019c50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:59.217025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f52e9331-fedb-4010-bf43-0ce468019c50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:59.302589 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f52e9331-fedb-4010-bf43-0ce468019c50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:59.312025 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f52e9331-fedb-4010-bf43-0ce468019c50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1304 microversion: 2.1 time: 0.110746 Oct 29 04:10:59.312633 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3944/7929] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:59 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:11:00.170534 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-b3805035-fb0c-4d8c-ab5e-76a5bf449136 req-4cf8250d-4cd7-4986-af8d-8632dd0a207a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c490095-d7bb-48de-bb3d-6d17267ac9bf", "tag": "a7c18115-6db9-44c2-8cb3-ee22f6fd39e0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:11:00.184074 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b3805035-fb0c-4d8c-ab5e-76a5bf449136 req-4cf8250d-4cd7-4986-af8d-8632dd0a207a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:00.184578 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b3805035-fb0c-4d8c-ab5e-76a5bf449136 req-4cf8250d-4cd7-4986-af8d-8632dd0a207a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:00.184991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-b3805035-fb0c-4d8c-ab5e-76a5bf449136 req-4cf8250d-4cd7-4986-af8d-8632dd0a207a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:00.196554 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-b3805035-fb0c-4d8c-ab5e-76a5bf449136 req-4cf8250d-4cd7-4986-af8d-8632dd0a207a service nova] Creating event network-changed:a7c18115-6db9-44c2-8cb3-ee22f6fd39e0 for instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf on n-h1-862964-4 Oct 29 04:11:00.202986 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-b3805035-fb0c-4d8c-ab5e-76a5bf449136 req-4cf8250d-4cd7-4986-af8d-8632dd0a207a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037133 Oct 29 04:11:00.203815 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3986/7930] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:11:00.335674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a3577151-e5e0-4095-b5d5-3b266d489b58 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:00.336296 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a3577151-e5e0-4095-b5d5-3b266d489b58 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:00.343660 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3577151-e5e0-4095-b5d5-3b266d489b58 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:00.344169 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3577151-e5e0-4095-b5d5-3b266d489b58 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:00.344825 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3577151-e5e0-4095-b5d5-3b266d489b58 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:00.345605 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3577151-e5e0-4095-b5d5-3b266d489b58 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:00.346118 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3577151-e5e0-4095-b5d5-3b266d489b58 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:00.346562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a3577151-e5e0-4095-b5d5-3b266d489b58 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:00.568762 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a3577151-e5e0-4095-b5d5-3b266d489b58 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:00.577264 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a3577151-e5e0-4095-b5d5-3b266d489b58 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1371 microversion: 2.1 time: 0.245827 Oct 29 04:11:00.577852 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3945/7931] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:00 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:01.601182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c04702bf-0c6e-4ecd-aae9-e1fa545d48bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:01.602069 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c04702bf-0c6e-4ecd-aae9-e1fa545d48bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:01.611750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04702bf-0c6e-4ecd-aae9-e1fa545d48bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:01.611750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04702bf-0c6e-4ecd-aae9-e1fa545d48bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:01.611750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04702bf-0c6e-4ecd-aae9-e1fa545d48bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:01.611750 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04702bf-0c6e-4ecd-aae9-e1fa545d48bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:01.612309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04702bf-0c6e-4ecd-aae9-e1fa545d48bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:01.612636 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c04702bf-0c6e-4ecd-aae9-e1fa545d48bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:01.754029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c04702bf-0c6e-4ecd-aae9-e1fa545d48bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:01.762642 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c04702bf-0c6e-4ecd-aae9-e1fa545d48bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1371 microversion: 2.1 time: 0.165791 Oct 29 04:11:01.763482 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3987/7932] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:01 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:02.791588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d5e06156-a078-4574-a385-9091a76cce00 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:02.792657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d5e06156-a078-4574-a385-9091a76cce00 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:02.800241 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e06156-a078-4574-a385-9091a76cce00 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:02.800744 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e06156-a078-4574-a385-9091a76cce00 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:02.801187 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e06156-a078-4574-a385-9091a76cce00 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:02.801917 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e06156-a078-4574-a385-9091a76cce00 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:02.802384 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e06156-a078-4574-a385-9091a76cce00 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:02.802813 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d5e06156-a078-4574-a385-9091a76cce00 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:02.940969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d5e06156-a078-4574-a385-9091a76cce00 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:02.949080 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d5e06156-a078-4574-a385-9091a76cce00 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1371 microversion: 2.1 time: 0.164320 Oct 29 04:11:02.949657 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3946/7933] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:02 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:03.972566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1cdfa553-e27d-47a3-aca0-4a197d94093d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:03.973192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1cdfa553-e27d-47a3-aca0-4a197d94093d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:03.980596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cdfa553-e27d-47a3-aca0-4a197d94093d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:03.981071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cdfa553-e27d-47a3-aca0-4a197d94093d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:03.981503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cdfa553-e27d-47a3-aca0-4a197d94093d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:03.982234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cdfa553-e27d-47a3-aca0-4a197d94093d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:03.982685 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cdfa553-e27d-47a3-aca0-4a197d94093d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:03.983162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1cdfa553-e27d-47a3-aca0-4a197d94093d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:04.129355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1cdfa553-e27d-47a3-aca0-4a197d94093d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:04.137620 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1cdfa553-e27d-47a3-aca0-4a197d94093d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1371 microversion: 2.1 time: 0.169160 Oct 29 04:11:04.138378 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3988/7934] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:03 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:05.161695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6c7a48f3-b009-422c-a73a-cb4b9b66e29c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:05.162405 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6c7a48f3-b009-422c-a73a-cb4b9b66e29c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:05.170565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c7a48f3-b009-422c-a73a-cb4b9b66e29c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:05.171057 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c7a48f3-b009-422c-a73a-cb4b9b66e29c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:05.171502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c7a48f3-b009-422c-a73a-cb4b9b66e29c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:05.172210 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c7a48f3-b009-422c-a73a-cb4b9b66e29c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:05.172672 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c7a48f3-b009-422c-a73a-cb4b9b66e29c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:05.173100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6c7a48f3-b009-422c-a73a-cb4b9b66e29c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:05.320839 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6c7a48f3-b009-422c-a73a-cb4b9b66e29c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:05.330157 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6c7a48f3-b009-422c-a73a-cb4b9b66e29c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1371 microversion: 2.1 time: 0.172717 Oct 29 04:11:05.330741 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3947/7935] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:05 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:06.057541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-5853a7a5-838c-4227-9afc-667de974f397 req-c4091b9c-1020-4e20-bb4e-5de40e4b57b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c490095-d7bb-48de-bb3d-6d17267ac9bf", "name": "network-vif-plugged", "status": "completed", "tag": "a7c18115-6db9-44c2-8cb3-ee22f6fd39e0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:11:06.068845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5853a7a5-838c-4227-9afc-667de974f397 req-c4091b9c-1020-4e20-bb4e-5de40e4b57b4 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:06.070202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5853a7a5-838c-4227-9afc-667de974f397 req-c4091b9c-1020-4e20-bb4e-5de40e4b57b4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:06.070639 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-5853a7a5-838c-4227-9afc-667de974f397 req-c4091b9c-1020-4e20-bb4e-5de40e4b57b4 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:06.083458 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-5853a7a5-838c-4227-9afc-667de974f397 req-c4091b9c-1020-4e20-bb4e-5de40e4b57b4 service nova] Creating event network-vif-plugged:a7c18115-6db9-44c2-8cb3-ee22f6fd39e0 for instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf on n-h1-862964-4 Oct 29 04:11:06.089057 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-5853a7a5-838c-4227-9afc-667de974f397 req-c4091b9c-1020-4e20-bb4e-5de40e4b57b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035384 Oct 29 04:11:06.089624 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3989/7936] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:11:06.353185 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ccd00b20-733d-4914-95fd-417bf6fb7188 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:06.353743 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ccd00b20-733d-4914-95fd-417bf6fb7188 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:06.363580 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccd00b20-733d-4914-95fd-417bf6fb7188 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:06.364309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccd00b20-733d-4914-95fd-417bf6fb7188 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:06.364973 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccd00b20-733d-4914-95fd-417bf6fb7188 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:06.366160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccd00b20-733d-4914-95fd-417bf6fb7188 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:06.366877 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccd00b20-733d-4914-95fd-417bf6fb7188 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:06.367538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ccd00b20-733d-4914-95fd-417bf6fb7188 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:06.511432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ccd00b20-733d-4914-95fd-417bf6fb7188 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:06.520076 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ccd00b20-733d-4914-95fd-417bf6fb7188 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1371 microversion: 2.1 time: 0.170981 Oct 29 04:11:06.520651 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3948/7937] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:06 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:07.544708 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5279149c-253b-42b3-9c8c-003f5822cc0e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:07.545408 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5279149c-253b-42b3-9c8c-003f5822cc0e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:07.547573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:07.548370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:07.555646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5279149c-253b-42b3-9c8c-003f5822cc0e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:07.556212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5279149c-253b-42b3-9c8c-003f5822cc0e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:07.556749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5279149c-253b-42b3-9c8c-003f5822cc0e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:07.557610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5279149c-253b-42b3-9c8c-003f5822cc0e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:07.558075 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5279149c-253b-42b3-9c8c-003f5822cc0e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:07.558526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5279149c-253b-42b3-9c8c-003f5822cc0e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:07.701249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5279149c-253b-42b3-9c8c-003f5822cc0e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:07.709512 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5279149c-253b-42b3-9c8c-003f5822cc0e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1556 microversion: 2.1 time: 0.169527 Oct 29 04:11:07.710146 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3990/7938] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:07 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:07.735748 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-18ec49e5-6196-4677-a180-5470da3e98af tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:07.736427 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-18ec49e5-6196-4677-a180-5470da3e98af tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:07.739219 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:07.747392 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18ec49e5-6196-4677-a180-5470da3e98af tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:07.747872 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18ec49e5-6196-4677-a180-5470da3e98af tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:07.748310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18ec49e5-6196-4677-a180-5470da3e98af tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:07.749011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18ec49e5-6196-4677-a180-5470da3e98af tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:07.749468 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18ec49e5-6196-4677-a180-5470da3e98af tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:07.749923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-18ec49e5-6196-4677-a180-5470da3e98af tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:07.889591 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-18ec49e5-6196-4677-a180-5470da3e98af tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:07.901214 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-18ec49e5-6196-4677-a180-5470da3e98af tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1556 microversion: 2.1 time: 0.172091 Oct 29 04:11:07.901981 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3949/7939] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:07 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:09.654207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-9ddc5568-073a-48bf-96f8-041baaf94ec6 req-4d0e5f93-ec67-44ff-87b0-f0d8d4cc6c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c490095-d7bb-48de-bb3d-6d17267ac9bf", "tag": "a7c18115-6db9-44c2-8cb3-ee22f6fd39e0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:11:09.664860 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ddc5568-073a-48bf-96f8-041baaf94ec6 req-4d0e5f93-ec67-44ff-87b0-f0d8d4cc6c18 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:09.665319 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ddc5568-073a-48bf-96f8-041baaf94ec6 req-4d0e5f93-ec67-44ff-87b0-f0d8d4cc6c18 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:09.665740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-9ddc5568-073a-48bf-96f8-041baaf94ec6 req-4d0e5f93-ec67-44ff-87b0-f0d8d4cc6c18 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:09.678015 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-9ddc5568-073a-48bf-96f8-041baaf94ec6 req-4d0e5f93-ec67-44ff-87b0-f0d8d4cc6c18 service nova] Creating event network-changed:a7c18115-6db9-44c2-8cb3-ee22f6fd39e0 for instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf on n-h1-862964-4 Oct 29 04:11:09.683409 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-9ddc5568-073a-48bf-96f8-041baaf94ec6 req-4d0e5f93-ec67-44ff-87b0-f0d8d4cc6c18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032498 Oct 29 04:11:09.684017 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3991/7940] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:13:04.887292 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:13:04.888695 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3640b49c-df75-45b0-9f42-eeffda4d3fa1] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:13:04.889622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:04.890953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=36 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:04.898944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f7e882ef-68a5-47ca-b9a1-36351de89505 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:13:04.899848 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f7e882ef-68a5-47ca-b9a1-36351de89505 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:04.908773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7e882ef-68a5-47ca-b9a1-36351de89505 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:04.909281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7e882ef-68a5-47ca-b9a1-36351de89505 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:04.909728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7e882ef-68a5-47ca-b9a1-36351de89505 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:04.910466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7e882ef-68a5-47ca-b9a1-36351de89505 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:04.910928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7e882ef-68a5-47ca-b9a1-36351de89505 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:04.911358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f7e882ef-68a5-47ca-b9a1-36351de89505 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:04.939343 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-f7e882ef-68a5-47ca-b9a1-36351de89505 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lazy-loading 'flavor' on Instance uuid 9c490095-d7bb-48de-bb3d-6d17267ac9bf {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:13:05.141398 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f7e882ef-68a5-47ca-b9a1-36351de89505 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "POST /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf/action" status: 202 len: 0 microversion: 2.1 time: 0.257692 Oct 29 04:13:05.142064 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3950/7941] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:13:04 2022] POST /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:13:05.149564 n-d-862964-4 devstack@n-api.service[127042]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c94bedb-2bbe-465a-b30f-0cf9af7fe730] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:13:05.151448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:05.152552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=32 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:05.153887 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 04:13:05.154140 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 04:13:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf (ip 10.222.0.16) !!! Oct 29 04:13:05.155413 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 04:13:05.155549 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 04:13:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf (ip 10.222.0.16) !!! Oct 29 04:13:05.160354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-41acdd68-4373-4a93-8cab-bdf15b61a02d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:05.161189 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-41acdd68-4373-4a93-8cab-bdf15b61a02d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:05.173012 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41acdd68-4373-4a93-8cab-bdf15b61a02d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:05.173496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41acdd68-4373-4a93-8cab-bdf15b61a02d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:05.173967 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41acdd68-4373-4a93-8cab-bdf15b61a02d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:05.174666 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41acdd68-4373-4a93-8cab-bdf15b61a02d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:05.175108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41acdd68-4373-4a93-8cab-bdf15b61a02d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:05.175549 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-41acdd68-4373-4a93-8cab-bdf15b61a02d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:05.313234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-41acdd68-4373-4a93-8cab-bdf15b61a02d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:05.321644 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-41acdd68-4373-4a93-8cab-bdf15b61a02d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1681 microversion: 2.1 time: 0.174365 Oct 29 04:13:05.322277 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3992/7942] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:05 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:06.354214 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-934d351d-aff8-44fd-b42d-7d76b72ba956 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:06.355403 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-934d351d-aff8-44fd-b42d-7d76b72ba956 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:06.373647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-934d351d-aff8-44fd-b42d-7d76b72ba956 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:06.374418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-934d351d-aff8-44fd-b42d-7d76b72ba956 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:06.375054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-934d351d-aff8-44fd-b42d-7d76b72ba956 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:06.376063 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-934d351d-aff8-44fd-b42d-7d76b72ba956 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:06.376740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-934d351d-aff8-44fd-b42d-7d76b72ba956 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:06.377285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-934d351d-aff8-44fd-b42d-7d76b72ba956 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:06.384021 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [3640b49c-df75-45b0-9f42-eeffda4d3fa1] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48198. Oct 29 04:13:06.387625 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48196. Oct 29 04:13:06.535191 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-934d351d-aff8-44fd-b42d-7d76b72ba956 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:06.545373 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-934d351d-aff8-44fd-b42d-7d76b72ba956 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1681 microversion: 2.1 time: 0.202451 Oct 29 04:13:06.546076 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3951/7943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:06 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:07.570167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-37d53292-6924-4c1e-b514-5896acd27cff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:07.570812 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-37d53292-6924-4c1e-b514-5896acd27cff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:07.581755 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37d53292-6924-4c1e-b514-5896acd27cff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:07.582286 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37d53292-6924-4c1e-b514-5896acd27cff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:07.582712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37d53292-6924-4c1e-b514-5896acd27cff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:07.583420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37d53292-6924-4c1e-b514-5896acd27cff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:07.583866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37d53292-6924-4c1e-b514-5896acd27cff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:07.584282 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-37d53292-6924-4c1e-b514-5896acd27cff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:07.590037 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c94bedb-2bbe-465a-b30f-0cf9af7fe730] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48202. Oct 29 04:13:07.735832 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-37d53292-6924-4c1e-b514-5896acd27cff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:07.744262 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-37d53292-6924-4c1e-b514-5896acd27cff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1681 microversion: 2.1 time: 0.178578 Oct 29 04:13:07.744851 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3993/7944] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:07 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:08.771876 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-19f7929c-2930-4def-af4f-7604c5aaf951 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:08.772943 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-19f7929c-2930-4def-af4f-7604c5aaf951 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:08.784666 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19f7929c-2930-4def-af4f-7604c5aaf951 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:08.785487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19f7929c-2930-4def-af4f-7604c5aaf951 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:08.786268 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19f7929c-2930-4def-af4f-7604c5aaf951 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:08.787425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19f7929c-2930-4def-af4f-7604c5aaf951 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:08.788200 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19f7929c-2930-4def-af4f-7604c5aaf951 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:08.788920 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-19f7929c-2930-4def-af4f-7604c5aaf951 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:08.930324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-19f7929c-2930-4def-af4f-7604c5aaf951 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:08.942311 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-19f7929c-2930-4def-af4f-7604c5aaf951 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1681 microversion: 2.1 time: 0.176986 Oct 29 04:13:08.943099 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3952/7945] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:08 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:09.971997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5bd30b5b-6bef-4c67-b65b-91633716df34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:09.972718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5bd30b5b-6bef-4c67-b65b-91633716df34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:09.981842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bd30b5b-6bef-4c67-b65b-91633716df34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:09.982491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bd30b5b-6bef-4c67-b65b-91633716df34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:09.983030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bd30b5b-6bef-4c67-b65b-91633716df34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:09.984267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bd30b5b-6bef-4c67-b65b-91633716df34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:09.984976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bd30b5b-6bef-4c67-b65b-91633716df34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:09.985517 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5bd30b5b-6bef-4c67-b65b-91633716df34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:10.136357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5bd30b5b-6bef-4c67-b65b-91633716df34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:10.149347 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5bd30b5b-6bef-4c67-b65b-91633716df34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1681 microversion: 2.1 time: 0.183153 Oct 29 04:13:10.150504 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3994/7946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:09 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:11.174587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1d5cf94b-2615-4d84-8ebc-60e98f28dfdd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:11.175266 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1d5cf94b-2615-4d84-8ebc-60e98f28dfdd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:11.183623 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d5cf94b-2615-4d84-8ebc-60e98f28dfdd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:11.184175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d5cf94b-2615-4d84-8ebc-60e98f28dfdd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:11.184674 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d5cf94b-2615-4d84-8ebc-60e98f28dfdd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:11.185455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d5cf94b-2615-4d84-8ebc-60e98f28dfdd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:11.185999 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d5cf94b-2615-4d84-8ebc-60e98f28dfdd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:11.186478 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1d5cf94b-2615-4d84-8ebc-60e98f28dfdd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:11.324695 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1d5cf94b-2615-4d84-8ebc-60e98f28dfdd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:11.333504 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1d5cf94b-2615-4d84-8ebc-60e98f28dfdd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1681 microversion: 2.1 time: 0.164220 Oct 29 04:13:11.334126 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3953/7947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:11 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:12.361863 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9bec85a3-be01-42a5-97bc-43aa97436078 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:12.362861 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9bec85a3-be01-42a5-97bc-43aa97436078 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:12.374701 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bec85a3-be01-42a5-97bc-43aa97436078 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:12.375500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bec85a3-be01-42a5-97bc-43aa97436078 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:12.376203 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bec85a3-be01-42a5-97bc-43aa97436078 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:12.377084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bec85a3-be01-42a5-97bc-43aa97436078 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:12.377533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bec85a3-be01-42a5-97bc-43aa97436078 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:12.377988 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9bec85a3-be01-42a5-97bc-43aa97436078 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:12.525840 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9bec85a3-be01-42a5-97bc-43aa97436078 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:12.534406 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9bec85a3-be01-42a5-97bc-43aa97436078 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1681 microversion: 2.1 time: 0.179702 Oct 29 04:13:12.534990 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3995/7948] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:12 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:13.559792 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b89e4f90-2888-4d9b-b4e4-38dec1e1cf50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:13.560487 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b89e4f90-2888-4d9b-b4e4-38dec1e1cf50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:13.569050 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b89e4f90-2888-4d9b-b4e4-38dec1e1cf50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:13.569583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b89e4f90-2888-4d9b-b4e4-38dec1e1cf50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:13.570066 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b89e4f90-2888-4d9b-b4e4-38dec1e1cf50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:13.570789 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b89e4f90-2888-4d9b-b4e4-38dec1e1cf50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:13.571242 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b89e4f90-2888-4d9b-b4e4-38dec1e1cf50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:13.571690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b89e4f90-2888-4d9b-b4e4-38dec1e1cf50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:13.710669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b89e4f90-2888-4d9b-b4e4-38dec1e1cf50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:13.718745 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b89e4f90-2888-4d9b-b4e4-38dec1e1cf50 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1681 microversion: 2.1 time: 0.163741 Oct 29 04:13:13.719330 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3954/7949] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:13 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:14.743766 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0e511cd1-9f19-4180-9064-724497d3e1cd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:14.744351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0e511cd1-9f19-4180-9064-724497d3e1cd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:14.751851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e511cd1-9f19-4180-9064-724497d3e1cd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:14.752343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e511cd1-9f19-4180-9064-724497d3e1cd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:14.752775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e511cd1-9f19-4180-9064-724497d3e1cd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:14.753463 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e511cd1-9f19-4180-9064-724497d3e1cd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:14.753938 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e511cd1-9f19-4180-9064-724497d3e1cd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:14.754360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0e511cd1-9f19-4180-9064-724497d3e1cd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:14.896046 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0e511cd1-9f19-4180-9064-724497d3e1cd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:14.903922 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0e511cd1-9f19-4180-9064-724497d3e1cd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1681 microversion: 2.1 time: 0.164219 Oct 29 04:13:14.904714 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3996/7950] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:14 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:15.932105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-adb9eebe-dcbf-4927-8ed4-9201301f0ecd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:15.933040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-adb9eebe-dcbf-4927-8ed4-9201301f0ecd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:15.944299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adb9eebe-dcbf-4927-8ed4-9201301f0ecd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:15.944798 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adb9eebe-dcbf-4927-8ed4-9201301f0ecd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:15.945257 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adb9eebe-dcbf-4927-8ed4-9201301f0ecd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:15.946022 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adb9eebe-dcbf-4927-8ed4-9201301f0ecd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:15.946485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adb9eebe-dcbf-4927-8ed4-9201301f0ecd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:15.946924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-adb9eebe-dcbf-4927-8ed4-9201301f0ecd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:16.089551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-adb9eebe-dcbf-4927-8ed4-9201301f0ecd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:16.097727 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-adb9eebe-dcbf-4927-8ed4-9201301f0ecd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1702 microversion: 2.1 time: 0.172494 Oct 29 04:13:16.098358 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3955/7951] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:15 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1702 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:17.122211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c6d441a5-0d93-4abc-b4cf-17976680815c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:17.122836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c6d441a5-0d93-4abc-b4cf-17976680815c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:17.130499 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d441a5-0d93-4abc-b4cf-17976680815c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:17.130987 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d441a5-0d93-4abc-b4cf-17976680815c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:17.131440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d441a5-0d93-4abc-b4cf-17976680815c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:17.132370 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d441a5-0d93-4abc-b4cf-17976680815c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:17.132824 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d441a5-0d93-4abc-b4cf-17976680815c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:17.133242 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c6d441a5-0d93-4abc-b4cf-17976680815c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:17.279569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c6d441a5-0d93-4abc-b4cf-17976680815c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:17.288002 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c6d441a5-0d93-4abc-b4cf-17976680815c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1702 microversion: 2.1 time: 0.169914 Oct 29 04:13:17.288886 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3997/7952] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:17 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1702 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:18.312208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a839f41-8b00-447a-99a9-ba53c3aee9a6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:18.312838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6a839f41-8b00-447a-99a9-ba53c3aee9a6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:18.322046 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a839f41-8b00-447a-99a9-ba53c3aee9a6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:18.322549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a839f41-8b00-447a-99a9-ba53c3aee9a6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:18.323000 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a839f41-8b00-447a-99a9-ba53c3aee9a6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:18.323723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a839f41-8b00-447a-99a9-ba53c3aee9a6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:18.324192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a839f41-8b00-447a-99a9-ba53c3aee9a6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:18.324632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a839f41-8b00-447a-99a9-ba53c3aee9a6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:18.486125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a839f41-8b00-447a-99a9-ba53c3aee9a6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:18.498450 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a839f41-8b00-447a-99a9-ba53c3aee9a6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1697 microversion: 2.1 time: 0.189908 Oct 29 04:13:18.499392 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3956/7953] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:18 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:18.814082 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-660df3da-ceec-4c37-8c07-442a260a8198 req-79d1fefe-8e0d-4d40-8373-40c39edd83bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c490095-d7bb-48de-bb3d-6d17267ac9bf", "name": "network-vif-plugged", "status": "completed", "tag": "a7c18115-6db9-44c2-8cb3-ee22f6fd39e0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:13:18.833753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-660df3da-ceec-4c37-8c07-442a260a8198 req-79d1fefe-8e0d-4d40-8373-40c39edd83bb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:18.834535 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-660df3da-ceec-4c37-8c07-442a260a8198 req-79d1fefe-8e0d-4d40-8373-40c39edd83bb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:18.835175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-660df3da-ceec-4c37-8c07-442a260a8198 req-79d1fefe-8e0d-4d40-8373-40c39edd83bb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:18.850296 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-660df3da-ceec-4c37-8c07-442a260a8198 req-79d1fefe-8e0d-4d40-8373-40c39edd83bb service nova] Creating event network-vif-plugged:a7c18115-6db9-44c2-8cb3-ee22f6fd39e0 for instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf on n-h1-862964-4 Oct 29 04:13:18.855697 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-660df3da-ceec-4c37-8c07-442a260a8198 req-79d1fefe-8e0d-4d40-8373-40c39edd83bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125159 Oct 29 04:13:18.856371 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3998/7954] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:13:19.524006 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e3cf0581-2dbc-43bc-a21c-0e9f8f10abfb tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:19.524636 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e3cf0581-2dbc-43bc-a21c-0e9f8f10abfb tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:19.535177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3cf0581-2dbc-43bc-a21c-0e9f8f10abfb tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:19.535678 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3cf0581-2dbc-43bc-a21c-0e9f8f10abfb tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:19.536349 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3cf0581-2dbc-43bc-a21c-0e9f8f10abfb tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:19.537137 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3cf0581-2dbc-43bc-a21c-0e9f8f10abfb tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:19.537604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3cf0581-2dbc-43bc-a21c-0e9f8f10abfb tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:19.538054 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e3cf0581-2dbc-43bc-a21c-0e9f8f10abfb tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:19.709180 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e3cf0581-2dbc-43bc-a21c-0e9f8f10abfb tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:19.717683 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e3cf0581-2dbc-43bc-a21c-0e9f8f10abfb tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1697 microversion: 2.1 time: 0.198230 Oct 29 04:13:19.718777 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3957/7955] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:19 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1697 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:20.744905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-10c30ee7-d1ef-4ba7-8fb6-d7de8cf95dff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:20.745605 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-10c30ee7-d1ef-4ba7-8fb6-d7de8cf95dff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:20.752277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c30ee7-d1ef-4ba7-8fb6-d7de8cf95dff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:20.752694 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c30ee7-d1ef-4ba7-8fb6-d7de8cf95dff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:20.753179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c30ee7-d1ef-4ba7-8fb6-d7de8cf95dff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:20.753924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c30ee7-d1ef-4ba7-8fb6-d7de8cf95dff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:20.754371 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c30ee7-d1ef-4ba7-8fb6-d7de8cf95dff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:20.754856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10c30ee7-d1ef-4ba7-8fb6-d7de8cf95dff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:20.907851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-10c30ee7-d1ef-4ba7-8fb6-d7de8cf95dff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:20.916561 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-10c30ee7-d1ef-4ba7-8fb6-d7de8cf95dff tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1697 microversion: 2.1 time: 0.177464 Oct 29 04:13:20.917386 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 3999/7956] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:20 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:21.941276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-bb9715d5-6a07-4d9b-b9f3-9a6722f2eb3b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:21.942935 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-bb9715d5-6a07-4d9b-b9f3-9a6722f2eb3b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:21.952767 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb9715d5-6a07-4d9b-b9f3-9a6722f2eb3b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:21.953637 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb9715d5-6a07-4d9b-b9f3-9a6722f2eb3b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:21.954275 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb9715d5-6a07-4d9b-b9f3-9a6722f2eb3b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:21.955202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb9715d5-6a07-4d9b-b9f3-9a6722f2eb3b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:21.955647 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb9715d5-6a07-4d9b-b9f3-9a6722f2eb3b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:21.956300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-bb9715d5-6a07-4d9b-b9f3-9a6722f2eb3b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:22.106096 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-bb9715d5-6a07-4d9b-b9f3-9a6722f2eb3b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:22.117360 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-bb9715d5-6a07-4d9b-b9f3-9a6722f2eb3b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1697 microversion: 2.1 time: 0.180158 Oct 29 04:13:22.118374 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3958/7957] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:21 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:23.144124 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-dc8ab8a7-f928-4a7a-a5a3-1b16ac3190fe tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:23.144867 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-dc8ab8a7-f928-4a7a-a5a3-1b16ac3190fe tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:23.152084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc8ab8a7-f928-4a7a-a5a3-1b16ac3190fe tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:23.152564 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc8ab8a7-f928-4a7a-a5a3-1b16ac3190fe tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:23.152995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc8ab8a7-f928-4a7a-a5a3-1b16ac3190fe tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:23.153711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc8ab8a7-f928-4a7a-a5a3-1b16ac3190fe tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:23.154208 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc8ab8a7-f928-4a7a-a5a3-1b16ac3190fe tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:23.154616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-dc8ab8a7-f928-4a7a-a5a3-1b16ac3190fe tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:23.322310 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-dc8ab8a7-f928-4a7a-a5a3-1b16ac3190fe tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:23.334191 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-dc8ab8a7-f928-4a7a-a5a3-1b16ac3190fe tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1697 microversion: 2.1 time: 0.194049 Oct 29 04:13:23.335192 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4000/7958] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:23 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:24.358492 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-529500c2-39d6-4e4c-8a4c-6290a7c22f41 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:24.360565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-529500c2-39d6-4e4c-8a4c-6290a7c22f41 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:24.369345 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529500c2-39d6-4e4c-8a4c-6290a7c22f41 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:24.370262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529500c2-39d6-4e4c-8a4c-6290a7c22f41 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:24.370969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529500c2-39d6-4e4c-8a4c-6290a7c22f41 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:24.371930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529500c2-39d6-4e4c-8a4c-6290a7c22f41 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:24.372617 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529500c2-39d6-4e4c-8a4c-6290a7c22f41 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:24.373255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-529500c2-39d6-4e4c-8a4c-6290a7c22f41 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:24.528082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-529500c2-39d6-4e4c-8a4c-6290a7c22f41 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:24.547046 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-529500c2-39d6-4e4c-8a4c-6290a7c22f41 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1697 microversion: 2.1 time: 0.187009 Oct 29 04:13:24.547886 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3959/7959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:24 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:25.573171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-512a1581-7972-4c1d-a1f3-4840abe6d226 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:25.573993 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-512a1581-7972-4c1d-a1f3-4840abe6d226 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:25.582466 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-512a1581-7972-4c1d-a1f3-4840abe6d226 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:25.583025 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-512a1581-7972-4c1d-a1f3-4840abe6d226 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:25.583743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-512a1581-7972-4c1d-a1f3-4840abe6d226 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:25.584512 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-512a1581-7972-4c1d-a1f3-4840abe6d226 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:25.585204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-512a1581-7972-4c1d-a1f3-4840abe6d226 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:25.585715 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-512a1581-7972-4c1d-a1f3-4840abe6d226 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:25.754068 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-512a1581-7972-4c1d-a1f3-4840abe6d226 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:25.763867 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-512a1581-7972-4c1d-a1f3-4840abe6d226 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1697 microversion: 2.1 time: 0.194894 Oct 29 04:13:25.764771 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4001/7960] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:25 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:26.794868 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-273736e0-2932-494c-86c2-ad8fd0e70f2f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:26.795807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-273736e0-2932-494c-86c2-ad8fd0e70f2f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:26.806105 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-273736e0-2932-494c-86c2-ad8fd0e70f2f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:26.806610 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-273736e0-2932-494c-86c2-ad8fd0e70f2f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:26.807058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-273736e0-2932-494c-86c2-ad8fd0e70f2f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:26.807774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-273736e0-2932-494c-86c2-ad8fd0e70f2f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:26.808240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-273736e0-2932-494c-86c2-ad8fd0e70f2f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:26.808677 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-273736e0-2932-494c-86c2-ad8fd0e70f2f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:26.950068 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-273736e0-2932-494c-86c2-ad8fd0e70f2f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:26.958362 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-273736e0-2932-494c-86c2-ad8fd0e70f2f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1697 microversion: 2.1 time: 0.170677 Oct 29 04:13:26.958951 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3960/7961] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:26 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:27.986926 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f6d05250-0ec3-47d0-807e-6c7b8f84ae76 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:27.987893 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f6d05250-0ec3-47d0-807e-6c7b8f84ae76 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:27.999424 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d05250-0ec3-47d0-807e-6c7b8f84ae76 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:28.000178 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d05250-0ec3-47d0-807e-6c7b8f84ae76 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:28.000899 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d05250-0ec3-47d0-807e-6c7b8f84ae76 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:28.002091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d05250-0ec3-47d0-807e-6c7b8f84ae76 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:28.002830 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d05250-0ec3-47d0-807e-6c7b8f84ae76 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:28.003519 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6d05250-0ec3-47d0-807e-6c7b8f84ae76 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:28.148907 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f6d05250-0ec3-47d0-807e-6c7b8f84ae76 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:28.156857 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f6d05250-0ec3-47d0-807e-6c7b8f84ae76 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1679 microversion: 2.1 time: 0.177109 Oct 29 04:13:28.157486 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4002/7962] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:27 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:29.181300 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-e1ccb58e-1977-4c1f-b319-5230b8c7c618 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:29.181959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-e1ccb58e-1977-4c1f-b319-5230b8c7c618 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:29.189289 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1ccb58e-1977-4c1f-b319-5230b8c7c618 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:29.189791 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1ccb58e-1977-4c1f-b319-5230b8c7c618 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:29.190265 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1ccb58e-1977-4c1f-b319-5230b8c7c618 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:29.190984 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1ccb58e-1977-4c1f-b319-5230b8c7c618 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:29.191455 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1ccb58e-1977-4c1f-b319-5230b8c7c618 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:29.191889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-e1ccb58e-1977-4c1f-b319-5230b8c7c618 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:29.335331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-e1ccb58e-1977-4c1f-b319-5230b8c7c618 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:29.343444 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-e1ccb58e-1977-4c1f-b319-5230b8c7c618 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1682 microversion: 2.1 time: 0.166513 Oct 29 04:13:29.344026 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3961/7963] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:29 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:13:29.366528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bd50d84a-a3f9-4bc6-a3ac-3cc25ebd49bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:13:29.367128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bd50d84a-a3f9-4bc6-a3ac-3cc25ebd49bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:29.374429 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd50d84a-a3f9-4bc6-a3ac-3cc25ebd49bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:29.374900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd50d84a-a3f9-4bc6-a3ac-3cc25ebd49bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:29.375326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd50d84a-a3f9-4bc6-a3ac-3cc25ebd49bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:29.376003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd50d84a-a3f9-4bc6-a3ac-3cc25ebd49bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:29.376687 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd50d84a-a3f9-4bc6-a3ac-3cc25ebd49bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:29.376856 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bd50d84a-a3f9-4bc6-a3ac-3cc25ebd49bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:29.473029 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bd50d84a-a3f9-4bc6-a3ac-3cc25ebd49bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127042) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 04:13:29.551419 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bd50d84a-a3f9-4bc6-a3ac-3cc25ebd49bf tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "POST /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf/action" status: 202 len: 0 microversion: 2.1 time: 0.188572 Oct 29 04:13:29.552228 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4003/7964] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:13:29 2022] POST /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:13:29.562707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d06fb40c-9ae8-4a56-8e77-d7fffa258129 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:29.563586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d06fb40c-9ae8-4a56-8e77-d7fffa258129 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:29.574837 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d06fb40c-9ae8-4a56-8e77-d7fffa258129 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:29.575313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d06fb40c-9ae8-4a56-8e77-d7fffa258129 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:29.575894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d06fb40c-9ae8-4a56-8e77-d7fffa258129 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:29.576866 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d06fb40c-9ae8-4a56-8e77-d7fffa258129 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:29.577326 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d06fb40c-9ae8-4a56-8e77-d7fffa258129 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:29.577778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d06fb40c-9ae8-4a56-8e77-d7fffa258129 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:29.732271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d06fb40c-9ae8-4a56-8e77-d7fffa258129 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:29.745975 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d06fb40c-9ae8-4a56-8e77-d7fffa258129 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1690 microversion: 2.1 time: 0.187101 Oct 29 04:13:29.746924 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3962/7965] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:29 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:30.707152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-962f0118-4933-4089-a00e-da8c13b65f98 req-e54bed0a-0477-48ba-b008-ce6532541713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c490095-d7bb-48de-bb3d-6d17267ac9bf", "name": "network-vif-unplugged", "status": "completed", "tag": "a7c18115-6db9-44c2-8cb3-ee22f6fd39e0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:13:30.720173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-962f0118-4933-4089-a00e-da8c13b65f98 req-e54bed0a-0477-48ba-b008-ce6532541713 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:30.720692 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-962f0118-4933-4089-a00e-da8c13b65f98 req-e54bed0a-0477-48ba-b008-ce6532541713 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:30.721151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-962f0118-4933-4089-a00e-da8c13b65f98 req-e54bed0a-0477-48ba-b008-ce6532541713 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:30.733107 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-962f0118-4933-4089-a00e-da8c13b65f98 req-e54bed0a-0477-48ba-b008-ce6532541713 service nova] Creating event network-vif-unplugged:a7c18115-6db9-44c2-8cb3-ee22f6fd39e0 for instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf on n-h1-862964-4 Oct 29 04:13:30.738800 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-962f0118-4933-4089-a00e-da8c13b65f98 req-e54bed0a-0477-48ba-b008-ce6532541713 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036679 Oct 29 04:13:30.739439 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4004/7966] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:13:30.770262 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b5957d0e-6919-442c-be17-f2e016802c8e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:30.770953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b5957d0e-6919-442c-be17-f2e016802c8e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:30.779601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5957d0e-6919-442c-be17-f2e016802c8e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:30.780103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5957d0e-6919-442c-be17-f2e016802c8e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:30.780551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5957d0e-6919-442c-be17-f2e016802c8e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:30.781279 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5957d0e-6919-442c-be17-f2e016802c8e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:30.781739 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5957d0e-6919-442c-be17-f2e016802c8e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:30.782189 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b5957d0e-6919-442c-be17-f2e016802c8e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:30.918806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b5957d0e-6919-442c-be17-f2e016802c8e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:30.927205 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b5957d0e-6919-442c-be17-f2e016802c8e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.160960 Oct 29 04:13:30.927792 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3963/7967] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:30 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:31.956395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-733e20f3-e613-4152-9551-2ea1a9c51610 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:31.957090 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-733e20f3-e613-4152-9551-2ea1a9c51610 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:31.964946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-733e20f3-e613-4152-9551-2ea1a9c51610 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:31.965540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-733e20f3-e613-4152-9551-2ea1a9c51610 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:31.966076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-733e20f3-e613-4152-9551-2ea1a9c51610 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:31.966836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-733e20f3-e613-4152-9551-2ea1a9c51610 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:31.967546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-733e20f3-e613-4152-9551-2ea1a9c51610 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:31.968297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-733e20f3-e613-4152-9551-2ea1a9c51610 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:32.137327 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-733e20f3-e613-4152-9551-2ea1a9c51610 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:32.146454 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-733e20f3-e613-4152-9551-2ea1a9c51610 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.197392 Oct 29 04:13:32.162382 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4005/7968] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:31 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:33.175673 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-758168d4-d7ee-485e-a580-6dab493b6104 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:33.176473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-758168d4-d7ee-485e-a580-6dab493b6104 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:33.184494 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758168d4-d7ee-485e-a580-6dab493b6104 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:33.185094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758168d4-d7ee-485e-a580-6dab493b6104 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:33.185611 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758168d4-d7ee-485e-a580-6dab493b6104 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:33.186433 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758168d4-d7ee-485e-a580-6dab493b6104 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:33.187772 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758168d4-d7ee-485e-a580-6dab493b6104 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:33.188452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-758168d4-d7ee-485e-a580-6dab493b6104 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:33.212624 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:33.340811 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-758168d4-d7ee-485e-a580-6dab493b6104 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:33.354231 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-758168d4-d7ee-485e-a580-6dab493b6104 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.180913 Oct 29 04:13:33.354835 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3964/7969] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:33 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:34.382728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e8778c64-23f7-4960-8c41-7c1c9393cc22 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:34.383523 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e8778c64-23f7-4960-8c41-7c1c9393cc22 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:34.390664 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8778c64-23f7-4960-8c41-7c1c9393cc22 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:34.391147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8778c64-23f7-4960-8c41-7c1c9393cc22 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:34.391577 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8778c64-23f7-4960-8c41-7c1c9393cc22 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:34.392326 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8778c64-23f7-4960-8c41-7c1c9393cc22 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:34.392778 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8778c64-23f7-4960-8c41-7c1c9393cc22 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:34.393194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e8778c64-23f7-4960-8c41-7c1c9393cc22 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:34.537505 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e8778c64-23f7-4960-8c41-7c1c9393cc22 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:34.552600 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e8778c64-23f7-4960-8c41-7c1c9393cc22 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.173964 Oct 29 04:13:34.553841 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4006/7970] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:34 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:35.579730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6a3fddca-acac-44a1-bc90-e170764af9e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:35.580573 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6a3fddca-acac-44a1-bc90-e170764af9e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:35.584756 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=31 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:35.589525 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3fddca-acac-44a1-bc90-e170764af9e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:35.590069 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3fddca-acac-44a1-bc90-e170764af9e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:35.590518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3fddca-acac-44a1-bc90-e170764af9e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:35.591249 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3fddca-acac-44a1-bc90-e170764af9e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:35.591714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3fddca-acac-44a1-bc90-e170764af9e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:35.592145 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6a3fddca-acac-44a1-bc90-e170764af9e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:35.753204 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6a3fddca-acac-44a1-bc90-e170764af9e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:35.761423 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6a3fddca-acac-44a1-bc90-e170764af9e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.187761 Oct 29 04:13:35.762239 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3965/7971] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:35 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:36.787078 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0471338e-635a-41ab-a164-c0637843771b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:36.787851 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0471338e-635a-41ab-a164-c0637843771b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:36.792437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:36.797543 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0471338e-635a-41ab-a164-c0637843771b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:36.798511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0471338e-635a-41ab-a164-c0637843771b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:36.799266 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0471338e-635a-41ab-a164-c0637843771b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:36.800295 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0471338e-635a-41ab-a164-c0637843771b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:36.801094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0471338e-635a-41ab-a164-c0637843771b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:36.801836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0471338e-635a-41ab-a164-c0637843771b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:36.809108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:36.963005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0471338e-635a-41ab-a164-c0637843771b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:36.970974 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0471338e-635a-41ab-a164-c0637843771b tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.188012 Oct 29 04:13:36.971551 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4007/7972] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:36 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:38.000269 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-639e81f4-f10d-446c-85db-437bd8394ad9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:38.001260 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-639e81f4-f10d-446c-85db-437bd8394ad9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:38.010824 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-639e81f4-f10d-446c-85db-437bd8394ad9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:38.011322 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-639e81f4-f10d-446c-85db-437bd8394ad9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:38.011769 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-639e81f4-f10d-446c-85db-437bd8394ad9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:38.012485 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-639e81f4-f10d-446c-85db-437bd8394ad9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:38.012945 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-639e81f4-f10d-446c-85db-437bd8394ad9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:38.013398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-639e81f4-f10d-446c-85db-437bd8394ad9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:38.190950 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-639e81f4-f10d-446c-85db-437bd8394ad9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:38.200561 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-639e81f4-f10d-446c-85db-437bd8394ad9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.207844 Oct 29 04:13:38.201179 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3966/7973] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:37 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:39.225191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-faf809ca-6d2d-4c30-bf66-3be09f03640f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:39.225887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-faf809ca-6d2d-4c30-bf66-3be09f03640f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:39.233972 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf809ca-6d2d-4c30-bf66-3be09f03640f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:39.234480 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf809ca-6d2d-4c30-bf66-3be09f03640f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:39.234954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf809ca-6d2d-4c30-bf66-3be09f03640f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:39.235663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf809ca-6d2d-4c30-bf66-3be09f03640f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:39.236143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf809ca-6d2d-4c30-bf66-3be09f03640f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:39.236561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-faf809ca-6d2d-4c30-bf66-3be09f03640f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:39.409793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-faf809ca-6d2d-4c30-bf66-3be09f03640f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:39.419287 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-faf809ca-6d2d-4c30-bf66-3be09f03640f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.198364 Oct 29 04:13:39.420324 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4008/7974] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:39 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:13:40.444344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-08064491-aab2-45e7-8ff2-5890c2868dbc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:40.446123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-08064491-aab2-45e7-8ff2-5890c2868dbc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:40.454298 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08064491-aab2-45e7-8ff2-5890c2868dbc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:40.455101 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08064491-aab2-45e7-8ff2-5890c2868dbc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:40.456126 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08064491-aab2-45e7-8ff2-5890c2868dbc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:40.457062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08064491-aab2-45e7-8ff2-5890c2868dbc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:40.457707 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08064491-aab2-45e7-8ff2-5890c2868dbc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:40.458418 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-08064491-aab2-45e7-8ff2-5890c2868dbc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:40.611857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-08064491-aab2-45e7-8ff2-5890c2868dbc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:40.620043 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-08064491-aab2-45e7-8ff2-5890c2868dbc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.180145 Oct 29 04:13:40.620663 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3967/7975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:40 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:41.643611 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-10aa9461-50cd-4f3c-8867-f9dd22fc44d1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:41.644342 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-10aa9461-50cd-4f3c-8867-f9dd22fc44d1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:41.651821 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10aa9461-50cd-4f3c-8867-f9dd22fc44d1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:41.652307 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10aa9461-50cd-4f3c-8867-f9dd22fc44d1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:41.652743 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10aa9461-50cd-4f3c-8867-f9dd22fc44d1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:41.653538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10aa9461-50cd-4f3c-8867-f9dd22fc44d1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:41.654005 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10aa9461-50cd-4f3c-8867-f9dd22fc44d1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:41.654432 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-10aa9461-50cd-4f3c-8867-f9dd22fc44d1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:41.799227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-10aa9461-50cd-4f3c-8867-f9dd22fc44d1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:41.807466 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-10aa9461-50cd-4f3c-8867-f9dd22fc44d1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.168294 Oct 29 04:13:41.808434 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4009/7976] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:41 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:42.831135 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9cb7ec07-4390-4775-a48f-172ff77b1c16 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:42.831954 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9cb7ec07-4390-4775-a48f-172ff77b1c16 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:42.839094 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb7ec07-4390-4775-a48f-172ff77b1c16 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:42.839583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb7ec07-4390-4775-a48f-172ff77b1c16 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:42.840021 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb7ec07-4390-4775-a48f-172ff77b1c16 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:42.840726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb7ec07-4390-4775-a48f-172ff77b1c16 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:42.841181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb7ec07-4390-4775-a48f-172ff77b1c16 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:42.841690 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9cb7ec07-4390-4775-a48f-172ff77b1c16 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:43.036521 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9cb7ec07-4390-4775-a48f-172ff77b1c16 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:43.044922 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9cb7ec07-4390-4775-a48f-172ff77b1c16 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.217720 Oct 29 04:13:43.045517 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3968/7977] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:42 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:44.073367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20c2da90-256c-4259-8611-2dcc30d47262 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:44.074386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-20c2da90-256c-4259-8611-2dcc30d47262 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:44.086213 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c2da90-256c-4259-8611-2dcc30d47262 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:44.087011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c2da90-256c-4259-8611-2dcc30d47262 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:44.087728 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c2da90-256c-4259-8611-2dcc30d47262 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:44.088833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c2da90-256c-4259-8611-2dcc30d47262 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:44.089646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c2da90-256c-4259-8611-2dcc30d47262 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:44.090362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20c2da90-256c-4259-8611-2dcc30d47262 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:44.236318 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20c2da90-256c-4259-8611-2dcc30d47262 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:44.244782 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20c2da90-256c-4259-8611-2dcc30d47262 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.178061 Oct 29 04:13:44.245343 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4010/7978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:44 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:45.269023 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-d48ecd30-0ebe-4147-9bc8-3b3fe09c30ab tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:45.269650 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-d48ecd30-0ebe-4147-9bc8-3b3fe09c30ab tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:45.277996 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d48ecd30-0ebe-4147-9bc8-3b3fe09c30ab tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:45.278842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d48ecd30-0ebe-4147-9bc8-3b3fe09c30ab tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:45.279541 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d48ecd30-0ebe-4147-9bc8-3b3fe09c30ab tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:45.280414 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d48ecd30-0ebe-4147-9bc8-3b3fe09c30ab tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:45.280899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d48ecd30-0ebe-4147-9bc8-3b3fe09c30ab tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:45.281308 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-d48ecd30-0ebe-4147-9bc8-3b3fe09c30ab tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:45.421682 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-d48ecd30-0ebe-4147-9bc8-3b3fe09c30ab tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:45.430132 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-d48ecd30-0ebe-4147-9bc8-3b3fe09c30ab tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.165264 Oct 29 04:13:45.430724 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3969/7979] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:45 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:46.453581 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-96d4c86a-b3b9-4e9d-b22f-52a0731e937c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:46.454234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-96d4c86a-b3b9-4e9d-b22f-52a0731e937c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:46.461754 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d4c86a-b3b9-4e9d-b22f-52a0731e937c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:46.462283 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d4c86a-b3b9-4e9d-b22f-52a0731e937c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:46.462723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d4c86a-b3b9-4e9d-b22f-52a0731e937c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:46.463427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d4c86a-b3b9-4e9d-b22f-52a0731e937c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:46.463879 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d4c86a-b3b9-4e9d-b22f-52a0731e937c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:46.464304 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-96d4c86a-b3b9-4e9d-b22f-52a0731e937c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:46.613536 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-96d4c86a-b3b9-4e9d-b22f-52a0731e937c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:46.621906 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-96d4c86a-b3b9-4e9d-b22f-52a0731e937c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.172373 Oct 29 04:13:46.622487 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4011/7980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:46 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:46.820369 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-458c7b01-159c-48b7-9227-64cacee4807b req-aedc7947-e6b7-444b-8619-d6f332907b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c490095-d7bb-48de-bb3d-6d17267ac9bf", "name": "network-vif-plugged", "status": "completed", "tag": "a7c18115-6db9-44c2-8cb3-ee22f6fd39e0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:13:46.832434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-458c7b01-159c-48b7-9227-64cacee4807b req-aedc7947-e6b7-444b-8619-d6f332907b11 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:46.832924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-458c7b01-159c-48b7-9227-64cacee4807b req-aedc7947-e6b7-444b-8619-d6f332907b11 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:46.833356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-458c7b01-159c-48b7-9227-64cacee4807b req-aedc7947-e6b7-444b-8619-d6f332907b11 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:46.845783 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-458c7b01-159c-48b7-9227-64cacee4807b req-aedc7947-e6b7-444b-8619-d6f332907b11 service nova] Creating event network-vif-plugged:a7c18115-6db9-44c2-8cb3-ee22f6fd39e0 for instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf on n-h1-862964-4 Oct 29 04:13:46.851208 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-458c7b01-159c-48b7-9227-64cacee4807b req-aedc7947-e6b7-444b-8619-d6f332907b11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034750 Oct 29 04:13:46.851809 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3970/7981] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:13:47.646532 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ed5a46a2-cbd8-49c4-b32e-3849d8b23d6c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:47.647229 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ed5a46a2-cbd8-49c4-b32e-3849d8b23d6c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:47.655584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed5a46a2-cbd8-49c4-b32e-3849d8b23d6c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:47.656077 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed5a46a2-cbd8-49c4-b32e-3849d8b23d6c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:47.656498 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed5a46a2-cbd8-49c4-b32e-3849d8b23d6c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:47.657212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed5a46a2-cbd8-49c4-b32e-3849d8b23d6c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:47.657667 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed5a46a2-cbd8-49c4-b32e-3849d8b23d6c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:47.658212 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ed5a46a2-cbd8-49c4-b32e-3849d8b23d6c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:47.825702 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ed5a46a2-cbd8-49c4-b32e-3849d8b23d6c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:47.837990 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ed5a46a2-cbd8-49c4-b32e-3849d8b23d6c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1688 microversion: 2.1 time: 0.195261 Oct 29 04:13:47.838954 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4012/7982] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:47 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:13:48.867601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-097d2621-33f8-4c7a-bcbe-d93edd11b198 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:48.868303 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-097d2621-33f8-4c7a-bcbe-d93edd11b198 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:48.875026 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-097d2621-33f8-4c7a-bcbe-d93edd11b198 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:48.875524 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-097d2621-33f8-4c7a-bcbe-d93edd11b198 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:48.875967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-097d2621-33f8-4c7a-bcbe-d93edd11b198 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:48.876728 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-097d2621-33f8-4c7a-bcbe-d93edd11b198 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:48.877190 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-097d2621-33f8-4c7a-bcbe-d93edd11b198 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:48.877622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-097d2621-33f8-4c7a-bcbe-d93edd11b198 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:49.015323 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-097d2621-33f8-4c7a-bcbe-d93edd11b198 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:49.023702 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-097d2621-33f8-4c7a-bcbe-d93edd11b198 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1675 microversion: 2.1 time: 0.161481 Oct 29 04:13:49.024282 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3971/7983] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:48 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:59.243204 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=11 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:14:59.244397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=35 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:14:59.250126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c8be1701-c955-4364-bbb4-723cfcbc7d34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:59.250443 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=13 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:14:59.250897 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c8be1701-c955-4364-bbb4-723cfcbc7d34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:59.251726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=40 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:14:59.253080 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:14:59.253245 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 04:14:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 29 04:14:59.254345 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:14:59.254467 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 04:14:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 29 04:14:59.269324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8be1701-c955-4364-bbb4-723cfcbc7d34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:59.269911 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8be1701-c955-4364-bbb4-723cfcbc7d34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:59.270372 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8be1701-c955-4364-bbb4-723cfcbc7d34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:59.271576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8be1701-c955-4364-bbb4-723cfcbc7d34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:59.272081 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8be1701-c955-4364-bbb4-723cfcbc7d34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:59.272649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c8be1701-c955-4364-bbb4-723cfcbc7d34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:59.299479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c8be1701-c955-4364-bbb4-723cfcbc7d34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:14:59.381691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-36131906-b74b-4d8a-b758-9ce006e89b30 req-05f93d62-8490-40d0-82ed-b75dbe3e23bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c490095-d7bb-48de-bb3d-6d17267ac9bf", "tag": "a7c18115-6db9-44c2-8cb3-ee22f6fd39e0"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:14:59.390968 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c8be1701-c955-4364-bbb4-723cfcbc7d34 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 204 len: 0 microversion: 2.1 time: 0.149418 Oct 29 04:14:59.392279 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4013/7984] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 04:14:59 2022] DELETE /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:14:59.393586 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-36131906-b74b-4d8a-b758-9ce006e89b30 req-05f93d62-8490-40d0-82ed-b75dbe3e23bb service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:59.394117 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-36131906-b74b-4d8a-b758-9ce006e89b30 req-05f93d62-8490-40d0-82ed-b75dbe3e23bb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:59.394569 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-36131906-b74b-4d8a-b758-9ce006e89b30 req-05f93d62-8490-40d0-82ed-b75dbe3e23bb service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:59.402306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-858b0061-1cf5-4f6a-96e3-bbeb556772e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:59.403383 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-858b0061-1cf5-4f6a-96e3-bbeb556772e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:59.408927 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-36131906-b74b-4d8a-b758-9ce006e89b30 req-05f93d62-8490-40d0-82ed-b75dbe3e23bb service nova] Creating event network-changed:a7c18115-6db9-44c2-8cb3-ee22f6fd39e0 for instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf on n-h1-862964-4 Oct 29 04:14:59.410462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-858b0061-1cf5-4f6a-96e3-bbeb556772e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:59.410956 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-858b0061-1cf5-4f6a-96e3-bbeb556772e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:59.411401 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-858b0061-1cf5-4f6a-96e3-bbeb556772e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:59.412104 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-858b0061-1cf5-4f6a-96e3-bbeb556772e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:59.412554 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-858b0061-1cf5-4f6a-96e3-bbeb556772e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:59.412985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-858b0061-1cf5-4f6a-96e3-bbeb556772e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:59.414446 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-36131906-b74b-4d8a-b758-9ce006e89b30 req-05f93d62-8490-40d0-82ed-b75dbe3e23bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170892 Oct 29 04:14:59.415076 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3972/7985] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:14:59.632110 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-858b0061-1cf5-4f6a-96e3-bbeb556772e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:59.642475 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-858b0061-1cf5-4f6a-96e3-bbeb556772e0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1681 microversion: 2.1 time: 0.244322 Oct 29 04:14:59.643459 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4014/7986] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:59 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:00.674428 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-ae519a90-7870-49e4-a213-61a10c85b1f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:00.675009 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-ae519a90-7870-49e4-a213-61a10c85b1f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:00.682746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae519a90-7870-49e4-a213-61a10c85b1f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:00.683272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae519a90-7870-49e4-a213-61a10c85b1f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:00.683714 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae519a90-7870-49e4-a213-61a10c85b1f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:00.684425 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae519a90-7870-49e4-a213-61a10c85b1f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:00.684883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae519a90-7870-49e4-a213-61a10c85b1f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:00.685310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-ae519a90-7870-49e4-a213-61a10c85b1f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:00.827499 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-ae519a90-7870-49e4-a213-61a10c85b1f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:00.840486 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-ae519a90-7870-49e4-a213-61a10c85b1f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1681 microversion: 2.1 time: 0.174604 Oct 29 04:15:00.841395 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3973/7987] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:00 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:01.468183 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-30531a76-23c0-4226-b739-33299c5fad29 req-a7710f97-56d3-4c62-b05e-9fdc41c02b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c490095-d7bb-48de-bb3d-6d17267ac9bf", "name": "network-vif-deleted", "tag": "a7c18115-6db9-44c2-8cb3-ee22f6fd39e0"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:15:01.479719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-30531a76-23c0-4226-b739-33299c5fad29 req-a7710f97-56d3-4c62-b05e-9fdc41c02b31 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:01.480190 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-30531a76-23c0-4226-b739-33299c5fad29 req-a7710f97-56d3-4c62-b05e-9fdc41c02b31 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:01.480615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-30531a76-23c0-4226-b739-33299c5fad29 req-a7710f97-56d3-4c62-b05e-9fdc41c02b31 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:01.492484 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-30531a76-23c0-4226-b739-33299c5fad29 req-a7710f97-56d3-4c62-b05e-9fdc41c02b31 service nova] Creating event network-vif-deleted:a7c18115-6db9-44c2-8cb3-ee22f6fd39e0 for instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf on n-h1-862964-4 Oct 29 04:15:01.497796 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-30531a76-23c0-4226-b739-33299c5fad29 req-a7710f97-56d3-4c62-b05e-9fdc41c02b31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033561 Oct 29 04:15:01.498424 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4015/7988] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:15:01.867963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:01.868587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:01.875895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:01.876396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:01.876834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:01.877554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:01.878132 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:01.878564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:01.912166 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:01.912663 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:01.913100 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:01.913551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lazy-loading 'fault' on Instance uuid 9c490095-d7bb-48de-bb3d-6d17267ac9bf {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:15:01.954927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:01.963039 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8e68297a-28fb-4e2d-b1ba-2e6d8646879f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 200 len: 1336 microversion: 2.1 time: 0.099366 Oct 29 04:15:01.963611 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3974/7989] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:01 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:02.992036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:02.993175 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: 9c490095-d7bb-48de-bb3d-6d17267ac9bf] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:03.005255 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:03.006133 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:03.006905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:03.007613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:03.008057 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:03.008473 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:03.022943 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.wsgi [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] HTTP exception thrown: Instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf could not be found. Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Request method failure captured: Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: request: GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf HTTP/1.1 Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: Accept: application/json Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: Accept-Encoding: identity Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: Connection: close Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: Content-Length: 0 Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: Content-Type: application/json Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: Host: 10.222.0.16 Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: Openstack-System-Scope: None Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: User-Agent: python-urllib3/1.26.12 Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Auth-Token: gAAAAABjXKfJ5lf35E6QRidROLdYsI53oWHSjhYqxQjD4OHnOI8KlIsLLtfFIPMbyylTbnd_Z4v22d3Yb0bBwpRTDVGC3x3FgBj1PyUDUohrvwjF3jxdzjsyiJpbEKT2cpwzT2_xbr68USglYjPly2hPT2UfIPiaMbvZhjhrr8v7E8-ZH0LkN6Y Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Id: None Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Domain-Name: None Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Identity-Status: Confirmed Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Is-Admin-Project: True Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Id: default Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Domain-Name: Default Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Id: d1f0589e74da4bef8f38623954cb94ca Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Project-Name: tempest-TestShelveInstance-1857745218 Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Role: member,reader Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Roles: member,reader Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1f0589e74da4bef8f38623954cb94ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1f0589e74da4bef8f38623954cb94ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1f0589e74da4bef8f38623954cb94ca", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1f0589e74da4bef8f38623954cb94ca"}]}] Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant: tempest-TestShelveInstance-1857745218 Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Id: d1f0589e74da4bef8f38623954cb94ca Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-Tenant-Name: tempest-TestShelveInstance-1857745218 Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-User: tempest-TestShelveInstance-1857745218-project Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Id: default Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-User-Domain-Name: Default Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-User-Id: 533f2ae735974e27977c592a514e856e Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: X-User-Name: tempest-TestShelveInstance-1857745218-project Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: method: > Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: exception: Instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf could not be found. Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: action_args: {'id': '9c490095-d7bb-48de-bb3d-6d17267ac9bf'} Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf could not be found. Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf could not be found. Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:15:03.024610 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:15:03.033604 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:15:03.033604 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:15:03.033604 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:15:03.033604 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:15:03.033604 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:15:03.033604 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf could not be found. Oct 29 04:15:03.033604 n-d-862964-4 devstack@n-api.service[127042]: ERROR nova.api.openstack.wsgi Oct 29 04:15:03.033604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Returning 404 to user: Instance 9c490095-d7bb-48de-bb3d-6d17267ac9bf could not be found. {{(pid=127042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:15:03.033604 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a3da798c-7e9c-4d04-bea2-f1b70b9a8c31 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf" status: 404 len: 111 microversion: 2.1 time: 0.041390 Oct 29 04:15:03.033604 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4016/7990] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:02 2022] GET /compute/v2.1/servers/9c490095-d7bb-48de-bb3d-6d17267ac9bf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:15:03.199563 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-07b81a81-a809-463c-83ba-96e73b4b6608 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '.version_select at 0x7fe1a38a7b80>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:03.234298 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-07b81a81-a809-463c-83ba-96e73b4b6608 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2039614335" status: 202 len: 0 microversion: 2.1 time: 0.039487 Oct 29 04:15:03.235977 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3975/7991] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 04:15:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2039614335 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:15:03.258555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-cf34ddb0-189c-44af-9bab-04c65ae85e48 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Action: 'create', calling method: .version_select at 0x7fe1a8422a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-600403055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3k5wWTi2mhDZ6rAeDhRbK/pYtZA4eQTFwSYAdZaTDKPjvIOMUnGJIe09YDZmXp/JfhqHa8Jpxs1IiUmqWSHmw32OpbWLp+eJyaul0aojoVPdlu43m4ASiLUjBpDOCWDQ=="}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:15:03.274354 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cf34ddb0-189c-44af-9bab-04c65ae85e48 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Getting quotas for project d1f0589e74da4bef8f38623954cb94ca. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:15:03.279723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-cf34ddb0-189c-44af-9bab-04c65ae85e48 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Getting quotas for user 533f2ae735974e27977c592a514e856e and project d1f0589e74da4bef8f38623954cb94ca. Resources: {'key_pairs'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:15:03.310771 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-cf34ddb0-189c-44af-9bab-04c65ae85e48 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.056469 Oct 29 04:15:03.311411 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4017/7992] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 04:15:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:15:20.636072 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-587466521", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-600403055", "security_groups": [{"name": "tempest-secgroup-smoke-843518318"}], "networks": [{"uuid": "75dc482c-cd7e-4992-8815-9bd1e8e9ee04"}], "block_device_mapping_v2": [{"uuid": "039280c3-5929-4ff6-9f9c-27c3acb49007", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:15:20.647460 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=16 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:20.648155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:20.762150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.network.neutron [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] validate_networks() for [('75dc482c-cd7e-4992-8815-9bd1e8e9ee04', None, None, None, None, None)] {{(pid=127041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:15:21.224799 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Flavor limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:15:21.225513 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Image limits 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:15:21.226625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Flavor pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:15:21.227297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Image pref 0:0:0 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:15:21.228028 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.virt.hardware [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:15:21.238119 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:21.238615 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:21.239044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:21.239774 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:21.240231 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:21.240656 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:21.259452 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Getting quotas for project d1f0589e74da4bef8f38623954cb94ca. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:15:21.265086 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Getting quotas for user 533f2ae735974e27977c592a514e856e and project d1f0589e74da4bef8f38623954cb94ca. Resources: {'ram', 'cores', 'instances'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:15:21.332860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Going to run 1 instances... {{(pid=127041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:15:21.335228 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='039280c3-5929-4ff6-9f9c-27c3acb49007',volume_size=None,volume_type=None)] {{(pid=127041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:15:21.485073 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9b2d5322-2766-4328-8a40-21feb81af778 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.853230 Oct 29 04:15:21.485752 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3976/7993] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 04:15:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:15:21.495311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:21.496063 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=4 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:21.497086 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:21.501132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bf6eec3a-999d-4e7d-ad2f-19345e9fd2c1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:21.501745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bf6eec3a-999d-4e7d-ad2f-19345e9fd2c1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:21.566925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-bf6eec3a-999d-4e7d-ad2f-19345e9fd2c1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:21.574041 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bf6eec3a-999d-4e7d-ad2f-19345e9fd2c1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1087 microversion: 2.1 time: 0.080859 Oct 29 04:15:21.574620 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4018/7994] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:21 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1087 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:22.597725 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2cff525f-785c-4da5-bbbd-a7ce73e3f26d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:22.598358 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2cff525f-785c-4da5-bbbd-a7ce73e3f26d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:22.608747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cff525f-785c-4da5-bbbd-a7ce73e3f26d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:22.609177 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cff525f-785c-4da5-bbbd-a7ce73e3f26d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:22.609622 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cff525f-785c-4da5-bbbd-a7ce73e3f26d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:22.610353 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cff525f-785c-4da5-bbbd-a7ce73e3f26d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:22.610817 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cff525f-785c-4da5-bbbd-a7ce73e3f26d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:22.611248 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2cff525f-785c-4da5-bbbd-a7ce73e3f26d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:22.711747 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2cff525f-785c-4da5-bbbd-a7ce73e3f26d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:22.721051 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2cff525f-785c-4da5-bbbd-a7ce73e3f26d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1193 microversion: 2.1 time: 0.128133 Oct 29 04:15:22.722230 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3977/7995] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:22 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1193 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:23.746254 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-1a3ad8c9-fbc5-4f1b-a1bc-38348739b3c7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:23.747556 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-1a3ad8c9-fbc5-4f1b-a1bc-38348739b3c7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:23.755484 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3ad8c9-fbc5-4f1b-a1bc-38348739b3c7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:23.755978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3ad8c9-fbc5-4f1b-a1bc-38348739b3c7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:23.756409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3ad8c9-fbc5-4f1b-a1bc-38348739b3c7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:23.757125 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3ad8c9-fbc5-4f1b-a1bc-38348739b3c7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:23.757573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3ad8c9-fbc5-4f1b-a1bc-38348739b3c7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:23.758039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-1a3ad8c9-fbc5-4f1b-a1bc-38348739b3c7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:23.896948 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-1a3ad8c9-fbc5-4f1b-a1bc-38348739b3c7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:23.905953 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-1a3ad8c9-fbc5-4f1b-a1bc-38348739b3c7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1270 microversion: 2.1 time: 0.164030 Oct 29 04:15:23.906551 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4019/7996] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:23 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:24.528916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-4e09af60-ce36-4bdb-8a1a-044aad342666 req-4867b86e-cf89-41c7-99c9-aa5442c565b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc18f631-eb1b-4df1-a46a-7f98eb3ec56f", "tag": "69be1cdb-f7f3-4ed9-b05a-d804e45099fb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:15:24.539052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4e09af60-ce36-4bdb-8a1a-044aad342666 req-4867b86e-cf89-41c7-99c9-aa5442c565b0 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:24.539544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4e09af60-ce36-4bdb-8a1a-044aad342666 req-4867b86e-cf89-41c7-99c9-aa5442c565b0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:24.540059 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-4e09af60-ce36-4bdb-8a1a-044aad342666 req-4867b86e-cf89-41c7-99c9-aa5442c565b0 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:24.559897 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-4e09af60-ce36-4bdb-8a1a-044aad342666 req-4867b86e-cf89-41c7-99c9-aa5442c565b0 service nova] Creating event network-changed:69be1cdb-f7f3-4ed9-b05a-d804e45099fb for instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f on n-h1-862964-4 Oct 29 04:15:24.566003 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-4e09af60-ce36-4bdb-8a1a-044aad342666 req-4867b86e-cf89-41c7-99c9-aa5442c565b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117426 Oct 29 04:15:24.566620 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3978/7997] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:15:24.929328 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d82ef6fc-4c03-4077-b856-d0fb8e39f91a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:24.929957 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d82ef6fc-4c03-4077-b856-d0fb8e39f91a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:24.937585 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82ef6fc-4c03-4077-b856-d0fb8e39f91a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:24.938182 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82ef6fc-4c03-4077-b856-d0fb8e39f91a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:24.938616 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82ef6fc-4c03-4077-b856-d0fb8e39f91a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:24.939325 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82ef6fc-4c03-4077-b856-d0fb8e39f91a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:24.939833 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82ef6fc-4c03-4077-b856-d0fb8e39f91a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:24.940250 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d82ef6fc-4c03-4077-b856-d0fb8e39f91a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:25.092035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d82ef6fc-4c03-4077-b856-d0fb8e39f91a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:25.101092 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d82ef6fc-4c03-4077-b856-d0fb8e39f91a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1270 microversion: 2.1 time: 0.175770 Oct 29 04:15:25.101714 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4020/7998] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:24 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:26.130539 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-37ae7769-dad2-47b1-a95a-84f684e61077 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:26.131261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-37ae7769-dad2-47b1-a95a-84f684e61077 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:26.138128 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ae7769-dad2-47b1-a95a-84f684e61077 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:26.138658 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ae7769-dad2-47b1-a95a-84f684e61077 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:26.139113 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ae7769-dad2-47b1-a95a-84f684e61077 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:26.139821 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ae7769-dad2-47b1-a95a-84f684e61077 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:26.140286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ae7769-dad2-47b1-a95a-84f684e61077 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:26.140719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-37ae7769-dad2-47b1-a95a-84f684e61077 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:26.279895 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-37ae7769-dad2-47b1-a95a-84f684e61077 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:26.288097 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-37ae7769-dad2-47b1-a95a-84f684e61077 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1270 microversion: 2.1 time: 0.162869 Oct 29 04:15:26.288810 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3979/7999] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:26 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:27.311705 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21a2993d-f77c-4818-95ba-0381edac500a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:27.312376 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-21a2993d-f77c-4818-95ba-0381edac500a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:27.319641 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21a2993d-f77c-4818-95ba-0381edac500a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:27.320128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21a2993d-f77c-4818-95ba-0381edac500a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:27.320552 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21a2993d-f77c-4818-95ba-0381edac500a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:27.321240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21a2993d-f77c-4818-95ba-0381edac500a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:27.321686 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21a2993d-f77c-4818-95ba-0381edac500a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:27.322173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21a2993d-f77c-4818-95ba-0381edac500a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:27.461274 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-21a2993d-f77c-4818-95ba-0381edac500a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:27.470474 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-21a2993d-f77c-4818-95ba-0381edac500a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1270 microversion: 2.1 time: 0.162720 Oct 29 04:15:27.471200 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4021/8000] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:27 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:28.499037 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9727d8e8-3f32-4b46-a5ba-86448082fc96 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:28.500011 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9727d8e8-3f32-4b46-a5ba-86448082fc96 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:28.510761 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9727d8e8-3f32-4b46-a5ba-86448082fc96 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:28.511253 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9727d8e8-3f32-4b46-a5ba-86448082fc96 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:28.511696 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9727d8e8-3f32-4b46-a5ba-86448082fc96 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:28.512399 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9727d8e8-3f32-4b46-a5ba-86448082fc96 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:28.512857 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9727d8e8-3f32-4b46-a5ba-86448082fc96 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:28.513285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9727d8e8-3f32-4b46-a5ba-86448082fc96 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:28.655138 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9727d8e8-3f32-4b46-a5ba-86448082fc96 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:28.663658 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9727d8e8-3f32-4b46-a5ba-86448082fc96 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1258 microversion: 2.1 time: 0.171412 Oct 29 04:15:28.664230 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3980/8001] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:28 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:29.691740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0b644ff0-f7e2-4b85-9644-163ad2ed097e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:29.692614 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0b644ff0-f7e2-4b85-9644-163ad2ed097e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:29.704649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b644ff0-f7e2-4b85-9644-163ad2ed097e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:29.705456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b644ff0-f7e2-4b85-9644-163ad2ed097e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:29.706234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b644ff0-f7e2-4b85-9644-163ad2ed097e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:29.707442 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b644ff0-f7e2-4b85-9644-163ad2ed097e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:29.708173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b644ff0-f7e2-4b85-9644-163ad2ed097e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:29.708886 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0b644ff0-f7e2-4b85-9644-163ad2ed097e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:30.152780 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0b644ff0-f7e2-4b85-9644-163ad2ed097e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:30.161334 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0b644ff0-f7e2-4b85-9644-163ad2ed097e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1258 microversion: 2.1 time: 0.476543 Oct 29 04:15:30.161943 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4022/8002] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:29 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1258 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:31.186641 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-819575ca-ab11-4031-a046-da50216de8d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:31.187495 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-819575ca-ab11-4031-a046-da50216de8d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:31.197860 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-819575ca-ab11-4031-a046-da50216de8d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:31.198599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-819575ca-ab11-4031-a046-da50216de8d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:31.199243 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-819575ca-ab11-4031-a046-da50216de8d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:31.200261 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-819575ca-ab11-4031-a046-da50216de8d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:31.200928 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-819575ca-ab11-4031-a046-da50216de8d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:31.201553 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-819575ca-ab11-4031-a046-da50216de8d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:31.249657 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:31.271969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:31.392718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-819575ca-ab11-4031-a046-da50216de8d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:31.400855 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-819575ca-ab11-4031-a046-da50216de8d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1258 microversion: 2.1 time: 0.220085 Oct 29 04:15:31.401446 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3981/8003] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:31 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1258 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:32.427740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-77ac533f-0006-44db-9ebb-3eb384d47893 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:32.428801 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-77ac533f-0006-44db-9ebb-3eb384d47893 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:32.433311 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:32.439620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac533f-0006-44db-9ebb-3eb384d47893 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:32.440106 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac533f-0006-44db-9ebb-3eb384d47893 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:32.440538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac533f-0006-44db-9ebb-3eb384d47893 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:32.441236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac533f-0006-44db-9ebb-3eb384d47893 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:32.441682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac533f-0006-44db-9ebb-3eb384d47893 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:32.442113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-77ac533f-0006-44db-9ebb-3eb384d47893 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:32.588763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-77ac533f-0006-44db-9ebb-3eb384d47893 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:32.597295 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-77ac533f-0006-44db-9ebb-3eb384d47893 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1258 microversion: 2.1 time: 0.176230 Oct 29 04:15:32.597920 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4023/8004] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:32 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:33.624814 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-46d6b4a9-ee26-48c5-8bbe-622e78ce5722 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:33.625883 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-46d6b4a9-ee26-48c5-8bbe-622e78ce5722 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:33.637463 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46d6b4a9-ee26-48c5-8bbe-622e78ce5722 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:33.637994 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46d6b4a9-ee26-48c5-8bbe-622e78ce5722 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:33.638503 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46d6b4a9-ee26-48c5-8bbe-622e78ce5722 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:33.639221 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46d6b4a9-ee26-48c5-8bbe-622e78ce5722 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:33.639680 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46d6b4a9-ee26-48c5-8bbe-622e78ce5722 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:33.640112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-46d6b4a9-ee26-48c5-8bbe-622e78ce5722 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:33.782778 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-46d6b4a9-ee26-48c5-8bbe-622e78ce5722 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:33.790835 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-46d6b4a9-ee26-48c5-8bbe-622e78ce5722 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1258 microversion: 2.1 time: 0.172745 Oct 29 04:15:33.791402 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3982/8005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:33 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:34.814688 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-23b4ac26-c4bf-48b1-a522-d58736691cb3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:34.815288 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-23b4ac26-c4bf-48b1-a522-d58736691cb3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:34.822725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23b4ac26-c4bf-48b1-a522-d58736691cb3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:34.823211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23b4ac26-c4bf-48b1-a522-d58736691cb3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:34.823643 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23b4ac26-c4bf-48b1-a522-d58736691cb3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:34.824504 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23b4ac26-c4bf-48b1-a522-d58736691cb3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:34.824960 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23b4ac26-c4bf-48b1-a522-d58736691cb3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:34.825378 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-23b4ac26-c4bf-48b1-a522-d58736691cb3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:34.965051 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-23b4ac26-c4bf-48b1-a522-d58736691cb3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:34.973597 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-23b4ac26-c4bf-48b1-a522-d58736691cb3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1258 microversion: 2.1 time: 0.162985 Oct 29 04:15:34.974229 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4024/8006] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:34 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:36.004671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-f68ebe23-57e4-4d6e-8c45-b7fcf4a014a2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:36.005712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-f68ebe23-57e4-4d6e-8c45-b7fcf4a014a2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:36.015937 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ebe23-57e4-4d6e-8c45-b7fcf4a014a2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:36.016432 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ebe23-57e4-4d6e-8c45-b7fcf4a014a2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:36.016975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ebe23-57e4-4d6e-8c45-b7fcf4a014a2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:36.017694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ebe23-57e4-4d6e-8c45-b7fcf4a014a2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:36.018188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ebe23-57e4-4d6e-8c45-b7fcf4a014a2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:36.018640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-f68ebe23-57e4-4d6e-8c45-b7fcf4a014a2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:36.164336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-f68ebe23-57e4-4d6e-8c45-b7fcf4a014a2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:36.172432 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-f68ebe23-57e4-4d6e-8c45-b7fcf4a014a2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1258 microversion: 2.1 time: 0.177673 Oct 29 04:15:36.173025 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3983/8007] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:35 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:37.196244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-ab7f95f8-9dde-47ec-80c6-f7280fd5aaa1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:37.197148 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-ab7f95f8-9dde-47ec-80c6-f7280fd5aaa1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:37.204776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab7f95f8-9dde-47ec-80c6-f7280fd5aaa1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:37.205663 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab7f95f8-9dde-47ec-80c6-f7280fd5aaa1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:37.205793 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab7f95f8-9dde-47ec-80c6-f7280fd5aaa1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:37.206584 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab7f95f8-9dde-47ec-80c6-f7280fd5aaa1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:37.207000 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab7f95f8-9dde-47ec-80c6-f7280fd5aaa1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:37.207452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-ab7f95f8-9dde-47ec-80c6-f7280fd5aaa1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:37.262970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-1a6ceac8-67b3-4cdd-9738-7fb4515013eb req-bd8f2ac6-3985-49f4-a466-ca38cc43913c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc18f631-eb1b-4df1-a46a-7f98eb3ec56f", "name": "network-vif-plugged", "status": "completed", "tag": "69be1cdb-f7f3-4ed9-b05a-d804e45099fb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:15:37.273297 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a6ceac8-67b3-4cdd-9738-7fb4515013eb req-bd8f2ac6-3985-49f4-a466-ca38cc43913c service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:37.273952 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a6ceac8-67b3-4cdd-9738-7fb4515013eb req-bd8f2ac6-3985-49f4-a466-ca38cc43913c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:37.274488 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-1a6ceac8-67b3-4cdd-9738-7fb4515013eb req-bd8f2ac6-3985-49f4-a466-ca38cc43913c service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:37.286898 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-1a6ceac8-67b3-4cdd-9738-7fb4515013eb req-bd8f2ac6-3985-49f4-a466-ca38cc43913c service nova] Creating event network-vif-plugged:69be1cdb-f7f3-4ed9-b05a-d804e45099fb for instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f on n-h1-862964-4 Oct 29 04:15:37.292213 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-1a6ceac8-67b3-4cdd-9738-7fb4515013eb req-bd8f2ac6-3985-49f4-a466-ca38cc43913c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033027 Oct 29 04:15:37.292916 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3984/8008] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:15:37.354609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-ab7f95f8-9dde-47ec-80c6-f7280fd5aaa1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:37.364847 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-ab7f95f8-9dde-47ec-80c6-f7280fd5aaa1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1258 microversion: 2.1 time: 0.172760 Oct 29 04:15:37.365462 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4025/8009] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:37 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:38.391041 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-96979f17-b06b-481a-9f9b-683864dc0b65 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:38.392630 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-96979f17-b06b-481a-9f9b-683864dc0b65 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:38.400862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96979f17-b06b-481a-9f9b-683864dc0b65 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:38.401477 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96979f17-b06b-481a-9f9b-683864dc0b65 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:38.402038 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96979f17-b06b-481a-9f9b-683864dc0b65 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:38.402881 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96979f17-b06b-481a-9f9b-683864dc0b65 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:38.403419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96979f17-b06b-481a-9f9b-683864dc0b65 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:38.403919 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-96979f17-b06b-481a-9f9b-683864dc0b65 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:38.547765 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-96979f17-b06b-481a-9f9b-683864dc0b65 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:38.556389 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-96979f17-b06b-481a-9f9b-683864dc0b65 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1258 microversion: 2.1 time: 0.171510 Oct 29 04:15:38.556952 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3985/8010] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:38 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:39.580573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d00706f8-524d-45fe-b106-f2a4bbc6f32a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:39.581211 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d00706f8-524d-45fe-b106-f2a4bbc6f32a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:39.588486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d00706f8-524d-45fe-b106-f2a4bbc6f32a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:39.588968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d00706f8-524d-45fe-b106-f2a4bbc6f32a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:39.589423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d00706f8-524d-45fe-b106-f2a4bbc6f32a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:39.590147 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d00706f8-524d-45fe-b106-f2a4bbc6f32a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:39.590601 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d00706f8-524d-45fe-b106-f2a4bbc6f32a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:39.591016 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d00706f8-524d-45fe-b106-f2a4bbc6f32a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:39.736609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d00706f8-524d-45fe-b106-f2a4bbc6f32a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:39.745400 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d00706f8-524d-45fe-b106-f2a4bbc6f32a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1442 microversion: 2.1 time: 0.169497 Oct 29 04:15:39.746079 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4026/8011] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:39 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1442 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:39.772497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6da4c235-3f1c-4750-84a9-9509a1f76211 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:39.773080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6da4c235-3f1c-4750-84a9-9509a1f76211 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:39.784093 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da4c235-3f1c-4750-84a9-9509a1f76211 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:39.784736 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da4c235-3f1c-4750-84a9-9509a1f76211 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:39.785337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da4c235-3f1c-4750-84a9-9509a1f76211 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:39.786520 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da4c235-3f1c-4750-84a9-9509a1f76211 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:39.787188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da4c235-3f1c-4750-84a9-9509a1f76211 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:39.787807 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6da4c235-3f1c-4750-84a9-9509a1f76211 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:39.934953 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6da4c235-3f1c-4750-84a9-9509a1f76211 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:39.943991 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6da4c235-3f1c-4750-84a9-9509a1f76211 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1442 microversion: 2.1 time: 0.178057 Oct 29 04:15:39.944572 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3986/8012] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:39 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1442 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:41.615247 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-968a412f-d375-4487-b6f9-4bf6b704d832 req-6440936b-eb60-41ba-8fb8-1e474e6423ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc18f631-eb1b-4df1-a46a-7f98eb3ec56f", "tag": "69be1cdb-f7f3-4ed9-b05a-d804e45099fb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:15:41.625971 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-968a412f-d375-4487-b6f9-4bf6b704d832 req-6440936b-eb60-41ba-8fb8-1e474e6423ee service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:41.626448 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-968a412f-d375-4487-b6f9-4bf6b704d832 req-6440936b-eb60-41ba-8fb8-1e474e6423ee service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:41.626874 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-968a412f-d375-4487-b6f9-4bf6b704d832 req-6440936b-eb60-41ba-8fb8-1e474e6423ee service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:41.639068 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-968a412f-d375-4487-b6f9-4bf6b704d832 req-6440936b-eb60-41ba-8fb8-1e474e6423ee service nova] Creating event network-changed:69be1cdb-f7f3-4ed9-b05a-d804e45099fb for instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f on n-h1-862964-4 Oct 29 04:15:41.644194 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-968a412f-d375-4487-b6f9-4bf6b704d832 req-6440936b-eb60-41ba-8fb8-1e474e6423ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032803 Oct 29 04:15:41.644986 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4027/8013] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:17:37.181999 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3640b49c-df75-45b0-9f42-eeffda4d3fa1] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:17:37.183183 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:17:37.184436 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:17:37.185544 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=54 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:17:37.241387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2891b45b-b13f-4b0d-a0e8-39438fc80b87 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:17:37.241978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2891b45b-b13f-4b0d-a0e8-39438fc80b87 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:37.248244 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2891b45b-b13f-4b0d-a0e8-39438fc80b87 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:37.248745 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2891b45b-b13f-4b0d-a0e8-39438fc80b87 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:37.249192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2891b45b-b13f-4b0d-a0e8-39438fc80b87 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:37.249930 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2891b45b-b13f-4b0d-a0e8-39438fc80b87 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:37.250395 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2891b45b-b13f-4b0d-a0e8-39438fc80b87 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:37.250832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2891b45b-b13f-4b0d-a0e8-39438fc80b87 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:37.274727 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.objects.instance [None req-2891b45b-b13f-4b0d-a0e8-39438fc80b87 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lazy-loading 'flavor' on Instance uuid dc18f631-eb1b-4df1-a46a-7f98eb3ec56f {{(pid=127041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:17:37.352145 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2891b45b-b13f-4b0d-a0e8-39438fc80b87 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "POST /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f/action" status: 202 len: 0 microversion: 2.1 time: 0.173338 Oct 29 04:17:37.352742 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3987/8014] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:17:37 2022] POST /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:17:37.360060 n-d-862964-4 devstack@n-api.service[127042]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c94bedb-2bbe-465a-b30f-0cf9af7fe730] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:17:37.360886 n-d-862964-4 devstack@n-api.service[127042]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57dcae21-10f9-47d2-a254-51c1dd17cc94] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:17:37.361353 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=22 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:17:37.362298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=50 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:17:37.363475 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:17:37.363725 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 04:17:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f (ip 10.222.0.16) !!! Oct 29 04:17:37.364820 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 04:17:37.364973 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 04:17:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f (ip 10.222.0.16) !!! Oct 29 04:17:37.370297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8f7ffa9f-8699-4651-b146-88aa8f8dcd51 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:37.371038 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8f7ffa9f-8699-4651-b146-88aa8f8dcd51 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:37.381511 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f7ffa9f-8699-4651-b146-88aa8f8dcd51 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:37.382019 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f7ffa9f-8699-4651-b146-88aa8f8dcd51 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:37.382440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f7ffa9f-8699-4651-b146-88aa8f8dcd51 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:37.383151 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f7ffa9f-8699-4651-b146-88aa8f8dcd51 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:37.383576 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f7ffa9f-8699-4651-b146-88aa8f8dcd51 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:37.383991 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8f7ffa9f-8699-4651-b146-88aa8f8dcd51 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:37.525206 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8f7ffa9f-8699-4651-b146-88aa8f8dcd51 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:37.533772 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8f7ffa9f-8699-4651-b146-88aa8f8dcd51 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.176225 Oct 29 04:17:37.534402 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4028/8015] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:37 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:38.559888 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-28687064-19c2-4ecb-9e9c-a31c00a892b9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:38.560706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-28687064-19c2-4ecb-9e9c-a31c00a892b9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:38.570237 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28687064-19c2-4ecb-9e9c-a31c00a892b9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:38.570732 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28687064-19c2-4ecb-9e9c-a31c00a892b9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:38.571170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28687064-19c2-4ecb-9e9c-a31c00a892b9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:38.571879 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28687064-19c2-4ecb-9e9c-a31c00a892b9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:38.572473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28687064-19c2-4ecb-9e9c-a31c00a892b9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:38.572906 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-28687064-19c2-4ecb-9e9c-a31c00a892b9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:38.577723 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [3640b49c-df75-45b0-9f42-eeffda4d3fa1] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48728. Oct 29 04:17:38.580878 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48730. Oct 29 04:17:38.722380 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-28687064-19c2-4ecb-9e9c-a31c00a892b9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:38.736371 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-28687064-19c2-4ecb-9e9c-a31c00a892b9 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.181532 Oct 29 04:17:38.737159 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3988/8016] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:38 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:39.764700 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-24095b2e-7225-4427-b4d7-4148d5f9b42e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:39.765744 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-24095b2e-7225-4427-b4d7-4148d5f9b42e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:39.775479 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24095b2e-7225-4427-b4d7-4148d5f9b42e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:39.775976 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24095b2e-7225-4427-b4d7-4148d5f9b42e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:39.776394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24095b2e-7225-4427-b4d7-4148d5f9b42e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:39.777105 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24095b2e-7225-4427-b4d7-4148d5f9b42e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:39.777533 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24095b2e-7225-4427-b4d7-4148d5f9b42e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:39.777974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24095b2e-7225-4427-b4d7-4148d5f9b42e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:39.782681 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] [57dcae21-10f9-47d2-a254-51c1dd17cc94] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48736. Oct 29 04:17:39.786726 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c94bedb-2bbe-465a-b30f-0cf9af7fe730] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48734. Oct 29 04:17:39.926723 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-24095b2e-7225-4427-b4d7-4148d5f9b42e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:39.934909 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-24095b2e-7225-4427-b4d7-4148d5f9b42e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.176800 Oct 29 04:17:39.935520 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4029/8017] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:39 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:40.961669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-428c8a15-397f-4df3-be1f-7927910d3ca4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:40.962835 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-428c8a15-397f-4df3-be1f-7927910d3ca4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:40.974578 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428c8a15-397f-4df3-be1f-7927910d3ca4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:40.975310 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428c8a15-397f-4df3-be1f-7927910d3ca4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:40.975963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428c8a15-397f-4df3-be1f-7927910d3ca4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:40.977016 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428c8a15-397f-4df3-be1f-7927910d3ca4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:40.977662 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428c8a15-397f-4df3-be1f-7927910d3ca4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:40.978307 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-428c8a15-397f-4df3-be1f-7927910d3ca4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:41.125134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-428c8a15-397f-4df3-be1f-7927910d3ca4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:41.133424 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-428c8a15-397f-4df3-be1f-7927910d3ca4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.177472 Oct 29 04:17:41.134090 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3989/8018] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:40 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:42.159752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-d07c2d62-e776-41e9-9e42-0d90cd2cd750 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:42.160460 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-d07c2d62-e776-41e9-9e42-0d90cd2cd750 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:42.168267 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07c2d62-e776-41e9-9e42-0d90cd2cd750 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:42.168768 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07c2d62-e776-41e9-9e42-0d90cd2cd750 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:42.169202 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07c2d62-e776-41e9-9e42-0d90cd2cd750 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:42.169951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07c2d62-e776-41e9-9e42-0d90cd2cd750 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:42.170402 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07c2d62-e776-41e9-9e42-0d90cd2cd750 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:42.170825 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-d07c2d62-e776-41e9-9e42-0d90cd2cd750 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:42.311475 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-d07c2d62-e776-41e9-9e42-0d90cd2cd750 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:42.319886 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-d07c2d62-e776-41e9-9e42-0d90cd2cd750 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.166663 Oct 29 04:17:42.320441 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4030/8019] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:42 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:43.351706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-50f4dd80-f6c3-4cfd-b0cc-19e327110862 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:43.352694 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-50f4dd80-f6c3-4cfd-b0cc-19e327110862 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:43.364396 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f4dd80-f6c3-4cfd-b0cc-19e327110862 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:43.364893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f4dd80-f6c3-4cfd-b0cc-19e327110862 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:43.365336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f4dd80-f6c3-4cfd-b0cc-19e327110862 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:43.366082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f4dd80-f6c3-4cfd-b0cc-19e327110862 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:43.366542 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f4dd80-f6c3-4cfd-b0cc-19e327110862 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:43.367002 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-50f4dd80-f6c3-4cfd-b0cc-19e327110862 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:43.505040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-50f4dd80-f6c3-4cfd-b0cc-19e327110862 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:43.513363 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-50f4dd80-f6c3-4cfd-b0cc-19e327110862 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.168467 Oct 29 04:17:43.514010 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3990/8020] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:43 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:44.539541 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-70abe077-ecff-4b53-9a2a-033bb229b3b5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:44.540214 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-70abe077-ecff-4b53-9a2a-033bb229b3b5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:44.548357 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70abe077-ecff-4b53-9a2a-033bb229b3b5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:44.548900 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70abe077-ecff-4b53-9a2a-033bb229b3b5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:44.549379 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70abe077-ecff-4b53-9a2a-033bb229b3b5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:44.550486 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70abe077-ecff-4b53-9a2a-033bb229b3b5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:44.551226 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70abe077-ecff-4b53-9a2a-033bb229b3b5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:44.551418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-70abe077-ecff-4b53-9a2a-033bb229b3b5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:44.689979 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-70abe077-ecff-4b53-9a2a-033bb229b3b5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:44.703678 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-70abe077-ecff-4b53-9a2a-033bb229b3b5 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.168964 Oct 29 04:17:44.704452 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4031/8021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:44 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:45.733502 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-187aae45-87ad-45a4-a27a-fcd3bb709735 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:45.734538 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-187aae45-87ad-45a4-a27a-fcd3bb709735 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:45.743687 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-187aae45-87ad-45a4-a27a-fcd3bb709735 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:45.744181 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-187aae45-87ad-45a4-a27a-fcd3bb709735 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:45.744618 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-187aae45-87ad-45a4-a27a-fcd3bb709735 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:45.745350 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-187aae45-87ad-45a4-a27a-fcd3bb709735 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:45.745830 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-187aae45-87ad-45a4-a27a-fcd3bb709735 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:45.746267 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-187aae45-87ad-45a4-a27a-fcd3bb709735 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:45.883946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-187aae45-87ad-45a4-a27a-fcd3bb709735 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:45.893024 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-187aae45-87ad-45a4-a27a-fcd3bb709735 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.166389 Oct 29 04:17:45.893612 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3991/8022] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:45 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:46.917737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5d71782e-1d8d-4525-bf8f-e912d1a98066 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:46.918395 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5d71782e-1d8d-4525-bf8f-e912d1a98066 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:46.926003 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d71782e-1d8d-4525-bf8f-e912d1a98066 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:46.926496 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d71782e-1d8d-4525-bf8f-e912d1a98066 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:46.927612 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d71782e-1d8d-4525-bf8f-e912d1a98066 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:46.928340 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d71782e-1d8d-4525-bf8f-e912d1a98066 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:46.928788 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d71782e-1d8d-4525-bf8f-e912d1a98066 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:46.929201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5d71782e-1d8d-4525-bf8f-e912d1a98066 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:47.077349 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5d71782e-1d8d-4525-bf8f-e912d1a98066 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:47.085827 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5d71782e-1d8d-4525-bf8f-e912d1a98066 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.172146 Oct 29 04:17:47.086667 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4032/8023] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:46 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:48.111561 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-db977f0a-ffaf-4905-b0e3-c99939a765e6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:48.112901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-db977f0a-ffaf-4905-b0e3-c99939a765e6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:48.121044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db977f0a-ffaf-4905-b0e3-c99939a765e6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:48.121549 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db977f0a-ffaf-4905-b0e3-c99939a765e6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:48.122025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db977f0a-ffaf-4905-b0e3-c99939a765e6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:48.122735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db977f0a-ffaf-4905-b0e3-c99939a765e6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:48.123197 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db977f0a-ffaf-4905-b0e3-c99939a765e6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:48.123627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-db977f0a-ffaf-4905-b0e3-c99939a765e6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:48.258168 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-db977f0a-ffaf-4905-b0e3-c99939a765e6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:48.266654 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-db977f0a-ffaf-4905-b0e3-c99939a765e6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.159567 Oct 29 04:17:48.267230 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3992/8024] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:48 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:49.294699 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-36df9141-e42c-4202-b457-6d4d55a593b1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:49.295770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-36df9141-e42c-4202-b457-6d4d55a593b1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:49.307478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36df9141-e42c-4202-b457-6d4d55a593b1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:49.308313 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36df9141-e42c-4202-b457-6d4d55a593b1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:49.309017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36df9141-e42c-4202-b457-6d4d55a593b1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:49.310207 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36df9141-e42c-4202-b457-6d4d55a593b1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:49.310947 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36df9141-e42c-4202-b457-6d4d55a593b1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:49.311637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-36df9141-e42c-4202-b457-6d4d55a593b1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:49.453014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-36df9141-e42c-4202-b457-6d4d55a593b1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:49.462676 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-36df9141-e42c-4202-b457-6d4d55a593b1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.174732 Oct 29 04:17:49.463228 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4033/8025] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:49 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:50.487276 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1a897d70-c37f-4124-8d53-476c5dbd4282 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:50.488607 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1a897d70-c37f-4124-8d53-476c5dbd4282 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:50.496652 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a897d70-c37f-4124-8d53-476c5dbd4282 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:50.497149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a897d70-c37f-4124-8d53-476c5dbd4282 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:50.497590 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a897d70-c37f-4124-8d53-476c5dbd4282 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:50.498360 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a897d70-c37f-4124-8d53-476c5dbd4282 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:50.498843 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a897d70-c37f-4124-8d53-476c5dbd4282 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:50.499272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1a897d70-c37f-4124-8d53-476c5dbd4282 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:50.639356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1a897d70-c37f-4124-8d53-476c5dbd4282 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:50.647900 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1a897d70-c37f-4124-8d53-476c5dbd4282 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.164942 Oct 29 04:17:50.648482 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3993/8026] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:50 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:51.671764 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-60f5e1fd-c081-4708-a318-0d1a1ee4f74a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:51.672433 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-60f5e1fd-c081-4708-a318-0d1a1ee4f74a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:51.679950 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60f5e1fd-c081-4708-a318-0d1a1ee4f74a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:51.680414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60f5e1fd-c081-4708-a318-0d1a1ee4f74a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:51.680845 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60f5e1fd-c081-4708-a318-0d1a1ee4f74a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:51.681538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60f5e1fd-c081-4708-a318-0d1a1ee4f74a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:51.682017 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60f5e1fd-c081-4708-a318-0d1a1ee4f74a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:51.682434 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60f5e1fd-c081-4708-a318-0d1a1ee4f74a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:51.823166 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-60f5e1fd-c081-4708-a318-0d1a1ee4f74a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:51.834121 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-60f5e1fd-c081-4708-a318-0d1a1ee4f74a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1568 microversion: 2.1 time: 0.166022 Oct 29 04:17:51.834907 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4034/8027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:51 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:51.857465 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-8f4ba695-5b0c-46dd-bd4a-231356f5bc4a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:17:51.858440 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f4ba695-5b0c-46dd-bd4a-231356f5bc4a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:51.865889 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4ba695-5b0c-46dd-bd4a-231356f5bc4a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:51.866426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4ba695-5b0c-46dd-bd4a-231356f5bc4a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:51.866875 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4ba695-5b0c-46dd-bd4a-231356f5bc4a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:51.867619 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4ba695-5b0c-46dd-bd4a-231356f5bc4a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:51.868077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4ba695-5b0c-46dd-bd4a-231356f5bc4a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:51.868507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-8f4ba695-5b0c-46dd-bd4a-231356f5bc4a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:51.912908 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-8f4ba695-5b0c-46dd-bd4a-231356f5bc4a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127041) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 04:17:51.987687 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-8f4ba695-5b0c-46dd-bd4a-231356f5bc4a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "POST /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f/action" status: 202 len: 0 microversion: 2.1 time: 0.134227 Oct 29 04:17:51.988977 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3994/8028] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:17:51 2022] POST /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:17:51.997737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2c3285b2-90ea-493b-8ac5-2203e15d46a7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:51.998367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2c3285b2-90ea-493b-8ac5-2203e15d46a7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:52.004937 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3285b2-90ea-493b-8ac5-2203e15d46a7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:52.005405 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3285b2-90ea-493b-8ac5-2203e15d46a7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:52.005857 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3285b2-90ea-493b-8ac5-2203e15d46a7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:52.006604 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3285b2-90ea-493b-8ac5-2203e15d46a7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:52.007052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3285b2-90ea-493b-8ac5-2203e15d46a7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:52.007501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2c3285b2-90ea-493b-8ac5-2203e15d46a7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:52.147912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2c3285b2-90ea-493b-8ac5-2203e15d46a7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:52.156206 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2c3285b2-90ea-493b-8ac5-2203e15d46a7 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1516 microversion: 2.1 time: 0.162699 Oct 29 04:17:52.156812 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4035/8029] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:51 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:53.181978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-274f4bdf-ee3b-4318-88ca-8d305b6e95f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:53.182576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-274f4bdf-ee3b-4318-88ca-8d305b6e95f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:53.189348 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-274f4bdf-ee3b-4318-88ca-8d305b6e95f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:53.189858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-274f4bdf-ee3b-4318-88ca-8d305b6e95f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:53.190316 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-274f4bdf-ee3b-4318-88ca-8d305b6e95f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:53.191032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-274f4bdf-ee3b-4318-88ca-8d305b6e95f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:53.191489 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-274f4bdf-ee3b-4318-88ca-8d305b6e95f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:53.191927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-274f4bdf-ee3b-4318-88ca-8d305b6e95f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:53.332924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-274f4bdf-ee3b-4318-88ca-8d305b6e95f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:53.342095 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-274f4bdf-ee3b-4318-88ca-8d305b6e95f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1518 microversion: 2.1 time: 0.165103 Oct 29 04:17:53.342654 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3995/8030] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:53 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:53.706167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-fe926cee-0ece-4e62-8611-7969c1920ae5 req-de1c38dc-e8f1-447c-88e0-4c805b42ace7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc18f631-eb1b-4df1-a46a-7f98eb3ec56f", "name": "network-vif-unplugged", "status": "completed", "tag": "69be1cdb-f7f3-4ed9-b05a-d804e45099fb"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:17:53.717710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fe926cee-0ece-4e62-8611-7969c1920ae5 req-de1c38dc-e8f1-447c-88e0-4c805b42ace7 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:53.718489 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fe926cee-0ece-4e62-8611-7969c1920ae5 req-de1c38dc-e8f1-447c-88e0-4c805b42ace7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:53.718920 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fe926cee-0ece-4e62-8611-7969c1920ae5 req-de1c38dc-e8f1-447c-88e0-4c805b42ace7 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:53.731107 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.compute.server_external_events [req-fe926cee-0ece-4e62-8611-7969c1920ae5 req-de1c38dc-e8f1-447c-88e0-4c805b42ace7 service nova] Unable to find a host for instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f. Dropping event network-vif-unplugged {{(pid=127042) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 04:17:53.732015 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-fe926cee-0ece-4e62-8611-7969c1920ae5 req-de1c38dc-e8f1-447c-88e0-4c805b42ace7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030184 Oct 29 04:17:53.732623 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4036/8031] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 04:17:54.366734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-57bc24e7-0c95-4398-8a3d-877d0b2dc541 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:54.367354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-57bc24e7-0c95-4398-8a3d-877d0b2dc541 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:54.375208 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57bc24e7-0c95-4398-8a3d-877d0b2dc541 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:54.375992 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57bc24e7-0c95-4398-8a3d-877d0b2dc541 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:54.376719 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57bc24e7-0c95-4398-8a3d-877d0b2dc541 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:54.377535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57bc24e7-0c95-4398-8a3d-877d0b2dc541 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:54.378336 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57bc24e7-0c95-4398-8a3d-877d0b2dc541 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:54.379446 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-57bc24e7-0c95-4398-8a3d-877d0b2dc541 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:54.521579 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-57bc24e7-0c95-4398-8a3d-877d0b2dc541 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:54.529945 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-57bc24e7-0c95-4398-8a3d-877d0b2dc541 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1518 microversion: 2.1 time: 0.167249 Oct 29 04:17:54.530545 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3996/8032] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:54 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:55.554462 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-335152c4-6df3-4592-9d68-cf3efe27073c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:55.555710 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-335152c4-6df3-4592-9d68-cf3efe27073c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:55.563237 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-335152c4-6df3-4592-9d68-cf3efe27073c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:55.563721 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-335152c4-6df3-4592-9d68-cf3efe27073c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:55.564306 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-335152c4-6df3-4592-9d68-cf3efe27073c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:55.564944 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-335152c4-6df3-4592-9d68-cf3efe27073c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:55.565400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-335152c4-6df3-4592-9d68-cf3efe27073c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:55.566162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-335152c4-6df3-4592-9d68-cf3efe27073c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:55.700495 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-335152c4-6df3-4592-9d68-cf3efe27073c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:55.709076 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-335152c4-6df3-4592-9d68-cf3efe27073c tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1518 microversion: 2.1 time: 0.158559 Oct 29 04:17:55.710820 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4037/8033] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:55 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:56.733628 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-945f2811-9e30-4ec6-8d7f-c5f59d5131d2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:56.734273 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-945f2811-9e30-4ec6-8d7f-c5f59d5131d2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:56.741565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945f2811-9e30-4ec6-8d7f-c5f59d5131d2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:56.742125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945f2811-9e30-4ec6-8d7f-c5f59d5131d2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:56.742562 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945f2811-9e30-4ec6-8d7f-c5f59d5131d2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:56.743264 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945f2811-9e30-4ec6-8d7f-c5f59d5131d2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:56.743730 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945f2811-9e30-4ec6-8d7f-c5f59d5131d2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:56.744160 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-945f2811-9e30-4ec6-8d7f-c5f59d5131d2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:56.878750 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-945f2811-9e30-4ec6-8d7f-c5f59d5131d2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:56.887080 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-945f2811-9e30-4ec6-8d7f-c5f59d5131d2 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1518 microversion: 2.1 time: 0.157848 Oct 29 04:17:56.887741 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3997/8034] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:56 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:57.914794 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-003ca989-ed0e-4a75-b164-fccd9a298d5d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:57.915385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-003ca989-ed0e-4a75-b164-fccd9a298d5d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:57.925661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003ca989-ed0e-4a75-b164-fccd9a298d5d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:57.926309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003ca989-ed0e-4a75-b164-fccd9a298d5d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:57.926737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003ca989-ed0e-4a75-b164-fccd9a298d5d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:57.927438 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003ca989-ed0e-4a75-b164-fccd9a298d5d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:57.927887 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003ca989-ed0e-4a75-b164-fccd9a298d5d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:57.928343 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-003ca989-ed0e-4a75-b164-fccd9a298d5d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:58.069302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-003ca989-ed0e-4a75-b164-fccd9a298d5d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:58.078335 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-003ca989-ed0e-4a75-b164-fccd9a298d5d tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1574 microversion: 2.1 time: 0.169926 Oct 29 04:17:58.078934 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4038/8035] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:57 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:17:59.103497 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2040bca2-4bbc-43a9-905a-e4b94dd93bb1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:17:59.104077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2040bca2-4bbc-43a9-905a-e4b94dd93bb1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:17:59.111921 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2040bca2-4bbc-43a9-905a-e4b94dd93bb1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:59.112402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2040bca2-4bbc-43a9-905a-e4b94dd93bb1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:59.112841 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2040bca2-4bbc-43a9-905a-e4b94dd93bb1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:59.113550 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2040bca2-4bbc-43a9-905a-e4b94dd93bb1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:17:59.114144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2040bca2-4bbc-43a9-905a-e4b94dd93bb1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:17:59.114576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2040bca2-4bbc-43a9-905a-e4b94dd93bb1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:17:59.259031 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2040bca2-4bbc-43a9-905a-e4b94dd93bb1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:17:59.268886 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2040bca2-4bbc-43a9-905a-e4b94dd93bb1 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1574 microversion: 2.1 time: 0.169397 Oct 29 04:17:59.269503 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3998/8036] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:17:59 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:00.296224 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-e02cc591-fd18-4c04-a0da-5dab01cb2774 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:00.297234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-e02cc591-fd18-4c04-a0da-5dab01cb2774 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:00.309111 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e02cc591-fd18-4c04-a0da-5dab01cb2774 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:00.309961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e02cc591-fd18-4c04-a0da-5dab01cb2774 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:00.310740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e02cc591-fd18-4c04-a0da-5dab01cb2774 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:00.311817 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e02cc591-fd18-4c04-a0da-5dab01cb2774 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:00.312569 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e02cc591-fd18-4c04-a0da-5dab01cb2774 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:00.313259 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-e02cc591-fd18-4c04-a0da-5dab01cb2774 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:00.459440 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-e02cc591-fd18-4c04-a0da-5dab01cb2774 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:00.468231 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-e02cc591-fd18-4c04-a0da-5dab01cb2774 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1574 microversion: 2.1 time: 0.178736 Oct 29 04:18:00.468790 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4039/8037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:00 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:01.496803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a13f3bea-c98e-4409-8121-56a6982fb68a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:01.497893 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a13f3bea-c98e-4409-8121-56a6982fb68a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:01.509679 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a13f3bea-c98e-4409-8121-56a6982fb68a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:01.510548 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a13f3bea-c98e-4409-8121-56a6982fb68a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:01.511284 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a13f3bea-c98e-4409-8121-56a6982fb68a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:01.512454 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a13f3bea-c98e-4409-8121-56a6982fb68a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:01.513222 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a13f3bea-c98e-4409-8121-56a6982fb68a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:01.513978 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a13f3bea-c98e-4409-8121-56a6982fb68a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:01.657723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a13f3bea-c98e-4409-8121-56a6982fb68a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:01.666020 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a13f3bea-c98e-4409-8121-56a6982fb68a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1574 microversion: 2.1 time: 0.176155 Oct 29 04:18:01.666634 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 3999/8038] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:01 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:02.693711 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c714dd72-9d3b-4384-9db4-3d52ce52faf3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:02.694870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c714dd72-9d3b-4384-9db4-3d52ce52faf3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:02.702919 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c714dd72-9d3b-4384-9db4-3d52ce52faf3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:02.703406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c714dd72-9d3b-4384-9db4-3d52ce52faf3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:02.703842 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c714dd72-9d3b-4384-9db4-3d52ce52faf3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:02.704540 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c714dd72-9d3b-4384-9db4-3d52ce52faf3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:02.704995 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c714dd72-9d3b-4384-9db4-3d52ce52faf3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:02.705417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c714dd72-9d3b-4384-9db4-3d52ce52faf3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:02.854296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c714dd72-9d3b-4384-9db4-3d52ce52faf3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:02.862784 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c714dd72-9d3b-4384-9db4-3d52ce52faf3 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1574 microversion: 2.1 time: 0.175796 Oct 29 04:18:02.863374 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4040/8039] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:02 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:03.891015 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b81de121-8343-45aa-9103-2fd764d86997 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:03.891970 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b81de121-8343-45aa-9103-2fd764d86997 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:03.902218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81de121-8343-45aa-9103-2fd764d86997 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:03.902712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81de121-8343-45aa-9103-2fd764d86997 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:03.903149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81de121-8343-45aa-9103-2fd764d86997 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:03.903853 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81de121-8343-45aa-9103-2fd764d86997 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:03.904312 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81de121-8343-45aa-9103-2fd764d86997 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:03.904735 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b81de121-8343-45aa-9103-2fd764d86997 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:03.923967 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:04.045108 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b81de121-8343-45aa-9103-2fd764d86997 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:04.053287 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b81de121-8343-45aa-9103-2fd764d86997 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1574 microversion: 2.1 time: 0.169131 Oct 29 04:18:04.053889 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4000/8040] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:03 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:05.079291 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-2b3463c9-5db0-41e9-bb25-4c44ffad9467 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:05.080071 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-2b3463c9-5db0-41e9-bb25-4c44ffad9467 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:05.089734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b3463c9-5db0-41e9-bb25-4c44ffad9467 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:05.090423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b3463c9-5db0-41e9-bb25-4c44ffad9467 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:05.090992 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b3463c9-5db0-41e9-bb25-4c44ffad9467 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:05.091913 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b3463c9-5db0-41e9-bb25-4c44ffad9467 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:05.092510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b3463c9-5db0-41e9-bb25-4c44ffad9467 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:05.093114 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-2b3463c9-5db0-41e9-bb25-4c44ffad9467 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:05.242271 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-2b3463c9-5db0-41e9-bb25-4c44ffad9467 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:05.251113 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-2b3463c9-5db0-41e9-bb25-4c44ffad9467 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1574 microversion: 2.1 time: 0.177243 Oct 29 04:18:05.251737 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4041/8041] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:05 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:06.275634 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3e4fccb6-ccf6-4805-93ca-3a4145a010d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:06.277005 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3e4fccb6-ccf6-4805-93ca-3a4145a010d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:06.284437 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4fccb6-ccf6-4805-93ca-3a4145a010d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:06.284956 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4fccb6-ccf6-4805-93ca-3a4145a010d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:06.285401 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4fccb6-ccf6-4805-93ca-3a4145a010d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:06.286170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4fccb6-ccf6-4805-93ca-3a4145a010d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:06.286640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4fccb6-ccf6-4805-93ca-3a4145a010d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:06.287077 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3e4fccb6-ccf6-4805-93ca-3a4145a010d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:06.422139 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-3e4fccb6-ccf6-4805-93ca-3a4145a010d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:06.430173 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3e4fccb6-ccf6-4805-93ca-3a4145a010d6 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1574 microversion: 2.1 time: 0.158993 Oct 29 04:18:06.430837 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4001/8042] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:06 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:07.458858 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8cb32c25-765d-4f9a-8882-d5b6f8a2604a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:07.459831 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-8cb32c25-765d-4f9a-8882-d5b6f8a2604a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:07.464134 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=29 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:07.471773 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cb32c25-765d-4f9a-8882-d5b6f8a2604a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:07.472191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cb32c25-765d-4f9a-8882-d5b6f8a2604a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:07.472627 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cb32c25-765d-4f9a-8882-d5b6f8a2604a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:07.473553 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cb32c25-765d-4f9a-8882-d5b6f8a2604a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:07.474168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cb32c25-765d-4f9a-8882-d5b6f8a2604a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:07.474596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-8cb32c25-765d-4f9a-8882-d5b6f8a2604a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:07.477941 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=81 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:07.615474 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-8cb32c25-765d-4f9a-8882-d5b6f8a2604a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:07.627674 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8cb32c25-765d-4f9a-8882-d5b6f8a2604a tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1574 microversion: 2.1 time: 0.175826 Oct 29 04:18:07.628492 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4042/8043] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:07 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:07.861556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-fcd28022-b5b9-472c-9472-2761e100764e req-df55442c-5491-428d-9ad7-b985f042a551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc18f631-eb1b-4df1-a46a-7f98eb3ec56f", "name": "network-vif-plugged", "status": "completed", "tag": "69be1cdb-f7f3-4ed9-b05a-d804e45099fb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:18:07.867594 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:07.875366 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fcd28022-b5b9-472c-9472-2761e100764e req-df55442c-5491-428d-9ad7-b985f042a551 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:07.875885 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fcd28022-b5b9-472c-9472-2761e100764e req-df55442c-5491-428d-9ad7-b985f042a551 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:07.876325 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-fcd28022-b5b9-472c-9472-2761e100764e req-df55442c-5491-428d-9ad7-b985f042a551 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:07.893736 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-fcd28022-b5b9-472c-9472-2761e100764e req-df55442c-5491-428d-9ad7-b985f042a551 service nova] Creating event network-vif-plugged:69be1cdb-f7f3-4ed9-b05a-d804e45099fb for instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f on n-h1-862964-4 Oct 29 04:18:07.899265 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-fcd28022-b5b9-472c-9472-2761e100764e req-df55442c-5491-428d-9ad7-b985f042a551 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042469 Oct 29 04:18:07.899893 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4002/8044] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:18:08.655542 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-6730636b-490d-42d2-b1d9-5ed98e8c79f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:08.656546 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-6730636b-490d-42d2-b1d9-5ed98e8c79f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:08.668205 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6730636b-490d-42d2-b1d9-5ed98e8c79f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:08.669014 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6730636b-490d-42d2-b1d9-5ed98e8c79f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:08.669740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6730636b-490d-42d2-b1d9-5ed98e8c79f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:08.670836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6730636b-490d-42d2-b1d9-5ed98e8c79f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:08.671289 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6730636b-490d-42d2-b1d9-5ed98e8c79f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:08.671726 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-6730636b-490d-42d2-b1d9-5ed98e8c79f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:08.809176 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-6730636b-490d-42d2-b1d9-5ed98e8c79f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:08.818242 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-6730636b-490d-42d2-b1d9-5ed98e8c79f4 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1574 microversion: 2.1 time: 0.169594 Oct 29 04:18:08.818752 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4043/8045] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:08 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:09.845944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6aea6cf7-16b6-43ea-b73d-f135e8529009 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:09.846649 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6aea6cf7-16b6-43ea-b73d-f135e8529009 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:09.854616 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aea6cf7-16b6-43ea-b73d-f135e8529009 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:09.855163 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aea6cf7-16b6-43ea-b73d-f135e8529009 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:09.855653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aea6cf7-16b6-43ea-b73d-f135e8529009 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:09.856426 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aea6cf7-16b6-43ea-b73d-f135e8529009 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:09.856938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aea6cf7-16b6-43ea-b73d-f135e8529009 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:09.857422 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6aea6cf7-16b6-43ea-b73d-f135e8529009 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:10.000600 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6aea6cf7-16b6-43ea-b73d-f135e8529009 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:10.012829 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6aea6cf7-16b6-43ea-b73d-f135e8529009 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1561 microversion: 2.1 time: 0.172992 Oct 29 04:18:10.013641 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4003/8046] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:09 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:23.983997 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:23.984749 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=11 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:23.985759 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:19:23.986153 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 04:19:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f (ip 10.222.0.16) !!! Oct 29 04:19:23.991097 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=3 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:23.991610 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-94b55d30-024f-4217-aa88-61e87f6db966 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:23.992076 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-94b55d30-024f-4217-aa88-61e87f6db966 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:23.992458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=16 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:23.994744 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:19:23.995012 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 04:19:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 29 04:19:24.001883 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94b55d30-024f-4217-aa88-61e87f6db966 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:24.002625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94b55d30-024f-4217-aa88-61e87f6db966 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:24.002776 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94b55d30-024f-4217-aa88-61e87f6db966 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:24.003482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94b55d30-024f-4217-aa88-61e87f6db966 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:24.003935 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94b55d30-024f-4217-aa88-61e87f6db966 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:24.004350 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-94b55d30-024f-4217-aa88-61e87f6db966 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:24.010969 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-ab6079d4-3497-4454-bc08-7a2c5c964198 req-e8bf7e93-0d13-4e64-9a2e-4f10109cf039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc18f631-eb1b-4df1-a46a-7f98eb3ec56f", "tag": "69be1cdb-f7f3-4ed9-b05a-d804e45099fb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:19:24.022429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ab6079d4-3497-4454-bc08-7a2c5c964198 req-e8bf7e93-0d13-4e64-9a2e-4f10109cf039 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:24.023062 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ab6079d4-3497-4454-bc08-7a2c5c964198 req-e8bf7e93-0d13-4e64-9a2e-4f10109cf039 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:24.023815 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-ab6079d4-3497-4454-bc08-7a2c5c964198 req-e8bf7e93-0d13-4e64-9a2e-4f10109cf039 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:24.031132 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-94b55d30-024f-4217-aa88-61e87f6db966 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:19:24.035661 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-ab6079d4-3497-4454-bc08-7a2c5c964198 req-e8bf7e93-0d13-4e64-9a2e-4f10109cf039 service nova] Creating event network-changed:69be1cdb-f7f3-4ed9-b05a-d804e45099fb for instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f on n-h1-862964-4 Oct 29 04:19:24.041138 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-ab6079d4-3497-4454-bc08-7a2c5c964198 req-e8bf7e93-0d13-4e64-9a2e-4f10109cf039 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054427 Oct 29 04:19:24.042109 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4004/8047] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:19:24.118893 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-94b55d30-024f-4217-aa88-61e87f6db966 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 204 len: 0 microversion: 2.1 time: 0.136793 Oct 29 04:19:24.123637 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4044/8048] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 04:19:23 2022] DELETE /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:19:24.129206 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a9aac08b-6f6f-4ea1-a8b0-2db40dd8e8fd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:24.129963 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a9aac08b-6f6f-4ea1-a8b0-2db40dd8e8fd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:24.136429 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9aac08b-6f6f-4ea1-a8b0-2db40dd8e8fd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:24.137001 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9aac08b-6f6f-4ea1-a8b0-2db40dd8e8fd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:24.137507 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9aac08b-6f6f-4ea1-a8b0-2db40dd8e8fd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:24.138250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9aac08b-6f6f-4ea1-a8b0-2db40dd8e8fd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:24.138712 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9aac08b-6f6f-4ea1-a8b0-2db40dd8e8fd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:24.139141 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a9aac08b-6f6f-4ea1-a8b0-2db40dd8e8fd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:24.281845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a9aac08b-6f6f-4ea1-a8b0-2db40dd8e8fd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:24.289641 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a9aac08b-6f6f-4ea1-a8b0-2db40dd8e8fd tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.164826 Oct 29 04:19:24.290306 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4005/8049] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:24 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:19:25.317246 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-592954df-63c3-4459-8afb-e0976879821f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:25.318008 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-592954df-63c3-4459-8afb-e0976879821f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:25.327854 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-592954df-63c3-4459-8afb-e0976879821f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:25.328555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-592954df-63c3-4459-8afb-e0976879821f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:25.329113 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-592954df-63c3-4459-8afb-e0976879821f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:25.330085 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-592954df-63c3-4459-8afb-e0976879821f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:25.330680 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-592954df-63c3-4459-8afb-e0976879821f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:25.331197 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-592954df-63c3-4459-8afb-e0976879821f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:25.475736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-592954df-63c3-4459-8afb-e0976879821f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:25.484715 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-592954df-63c3-4459-8afb-e0976879821f tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1567 microversion: 2.1 time: 0.174497 Oct 29 04:19:25.485311 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4045/8050] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:25 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:26.300199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-2380ddde-e96a-4345-8d1d-7c365d92666c req-a7c5393a-bbc2-4501-8696-b4fa42f1a966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc18f631-eb1b-4df1-a46a-7f98eb3ec56f", "name": "network-vif-deleted", "tag": "69be1cdb-f7f3-4ed9-b05a-d804e45099fb"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:19:26.311434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2380ddde-e96a-4345-8d1d-7c365d92666c req-a7c5393a-bbc2-4501-8696-b4fa42f1a966 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:26.311923 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2380ddde-e96a-4345-8d1d-7c365d92666c req-a7c5393a-bbc2-4501-8696-b4fa42f1a966 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:26.312363 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-2380ddde-e96a-4345-8d1d-7c365d92666c req-a7c5393a-bbc2-4501-8696-b4fa42f1a966 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:26.323981 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-2380ddde-e96a-4345-8d1d-7c365d92666c req-a7c5393a-bbc2-4501-8696-b4fa42f1a966 service nova] Creating event network-vif-deleted:69be1cdb-f7f3-4ed9-b05a-d804e45099fb for instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f on n-h1-862964-4 Oct 29 04:19:26.329557 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-2380ddde-e96a-4345-8d1d-7c365d92666c req-a7c5393a-bbc2-4501-8696-b4fa42f1a966 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033229 Oct 29 04:19:26.330327 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4006/8051] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:19:26.508249 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7e24bf09-ebda-49db-a666-c6d98152b5cc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:26.508846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7e24bf09-ebda-49db-a666-c6d98152b5cc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:26.516661 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e24bf09-ebda-49db-a666-c6d98152b5cc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:26.517143 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e24bf09-ebda-49db-a666-c6d98152b5cc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:26.517571 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e24bf09-ebda-49db-a666-c6d98152b5cc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:26.518296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e24bf09-ebda-49db-a666-c6d98152b5cc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:26.518745 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e24bf09-ebda-49db-a666-c6d98152b5cc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:26.519167 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7e24bf09-ebda-49db-a666-c6d98152b5cc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:26.586109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7e24bf09-ebda-49db-a666-c6d98152b5cc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:26.595880 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7e24bf09-ebda-49db-a666-c6d98152b5cc tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1218 microversion: 2.1 time: 0.091846 Oct 29 04:19:26.596624 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4046/8052] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:26 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:27.620902 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-9ff1cd32-f5b0-4176-b7bc-28ae3a355e47 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:27.621627 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-9ff1cd32-f5b0-4176-b7bc-28ae3a355e47 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:27.630301 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff1cd32-f5b0-4176-b7bc-28ae3a355e47 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:27.630806 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff1cd32-f5b0-4176-b7bc-28ae3a355e47 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:27.631280 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff1cd32-f5b0-4176-b7bc-28ae3a355e47 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:27.631985 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff1cd32-f5b0-4176-b7bc-28ae3a355e47 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:27.632459 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff1cd32-f5b0-4176-b7bc-28ae3a355e47 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:27.632901 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-9ff1cd32-f5b0-4176-b7bc-28ae3a355e47 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:27.700912 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-9ff1cd32-f5b0-4176-b7bc-28ae3a355e47 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:27.709875 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-9ff1cd32-f5b0-4176-b7bc-28ae3a355e47 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1218 microversion: 2.1 time: 0.094273 Oct 29 04:19:27.710461 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4007/8053] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:27 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:28.734799 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-243cabd0-8df6-4bf3-93b5-1d92c4bfef33 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:28.735482 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-243cabd0-8df6-4bf3-93b5-1d92c4bfef33 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:28.743024 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-243cabd0-8df6-4bf3-93b5-1d92c4bfef33 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:28.743510 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-243cabd0-8df6-4bf3-93b5-1d92c4bfef33 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:28.743912 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-243cabd0-8df6-4bf3-93b5-1d92c4bfef33 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:28.744682 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-243cabd0-8df6-4bf3-93b5-1d92c4bfef33 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:28.745130 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-243cabd0-8df6-4bf3-93b5-1d92c4bfef33 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:28.745550 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-243cabd0-8df6-4bf3-93b5-1d92c4bfef33 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:28.814775 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-243cabd0-8df6-4bf3-93b5-1d92c4bfef33 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:28.823167 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-243cabd0-8df6-4bf3-93b5-1d92c4bfef33 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1218 microversion: 2.1 time: 0.092910 Oct 29 04:19:28.823792 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4047/8054] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:28 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:29.845916 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-2e040904-3fa1-4acf-8042-d54e596f8288 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:29.846556 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-2e040904-3fa1-4acf-8042-d54e596f8288 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:29.854152 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e040904-3fa1-4acf-8042-d54e596f8288 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:29.854653 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e040904-3fa1-4acf-8042-d54e596f8288 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:29.855103 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e040904-3fa1-4acf-8042-d54e596f8288 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:29.855977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e040904-3fa1-4acf-8042-d54e596f8288 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:29.856448 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e040904-3fa1-4acf-8042-d54e596f8288 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:29.857899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-2e040904-3fa1-4acf-8042-d54e596f8288 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:29.922572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-2e040904-3fa1-4acf-8042-d54e596f8288 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:29.931110 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-2e040904-3fa1-4acf-8042-d54e596f8288 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1218 microversion: 2.1 time: 0.089323 Oct 29 04:19:29.931782 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4008/8055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:29 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:30.955452 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:30.956073 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:30.963712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:30.964299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:30.964737 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:30.965469 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:30.965985 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:30.966537 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:31.005409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:31.005903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:31.006339 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:31.006814 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lazy-loading 'fault' on Instance uuid dc18f631-eb1b-4df1-a46a-7f98eb3ec56f {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:19:31.049385 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f2ae735974e27977c592a514e856e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f0589e74da4bef8f38623954cb94ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:31.058584 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-652691a6-3c76-4427-b20b-010856c9641e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 200 len: 1223 microversion: 2.1 time: 0.106979 Oct 29 04:19:31.060018 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4048/8056] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:30 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:32.083402 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:32.084007 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] [instance: dc18f631-eb1b-4df1-a46a-7f98eb3ec56f] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:32.091564 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:32.092071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:32.092518 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:32.093255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:32.093723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:32.094188 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:32.108821 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] HTTP exception thrown: Instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f could not be found. Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Request method failure captured: Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f HTTP/1.1 Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKfJ5lf35E6QRidROLdYsI53oWHSjhYqxQjD4OHnOI8KlIsLLtfFIPMbyylTbnd_Z4v22d3Yb0bBwpRTDVGC3x3FgBj1PyUDUohrvwjF3jxdzjsyiJpbEKT2cpwzT2_xbr68USglYjPly2hPT2UfIPiaMbvZhjhrr8v7E8-ZH0LkN6Y Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: d1f0589e74da4bef8f38623954cb94ca Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestShelveInstance-1857745218 Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1f0589e74da4bef8f38623954cb94ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1f0589e74da4bef8f38623954cb94ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1f0589e74da4bef8f38623954cb94ca", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1f0589e74da4bef8f38623954cb94ca"}]}] Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestShelveInstance-1857745218 Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: d1f0589e74da4bef8f38623954cb94ca Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestShelveInstance-1857745218 Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestShelveInstance-1857745218-project Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: 533f2ae735974e27977c592a514e856e Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestShelveInstance-1857745218-project Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f could not be found. Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'dc18f631-eb1b-4df1-a46a-7f98eb3ec56f'} Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f could not be found. Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f could not be found. Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:19:32.110604 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:19:32.115749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:19:32.115749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:19:32.115749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:19:32.115749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:19:32.115749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:19:32.115749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f could not be found. Oct 29 04:19:32.115749 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:19:32.115749 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Returning 404 to user: Instance dc18f631-eb1b-4df1-a46a-7f98eb3ec56f could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:19:32.115749 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-284ca4e6-82e8-44dd-9ae3-eb22c365b41e tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f" status: 404 len: 111 microversion: 2.1 time: 0.032826 Oct 29 04:19:32.115749 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4009/8057] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:32 2022] GET /compute/v2.1/servers/dc18f631-eb1b-4df1-a46a-7f98eb3ec56f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:19:32.280839 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7d26583d-3e41-4ecd-8748-27ce13d23ba0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] Calling method '.version_select at 0x7fe1a8594790>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:32.311402 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7d26583d-3e41-4ecd-8748-27ce13d23ba0 tempest-TestShelveInstance-1857745218 tempest-TestShelveInstance-1857745218-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-600403055" status: 202 len: 0 microversion: 2.1 time: 0.036247 Oct 29 04:19:32.312396 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4049/8058] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 04:19:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-600403055 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:19:49.978587 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=12 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:49.979840 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=24 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:50.197596 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-20e54271-5115-4163-a553-4b9f8cee1c89 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Action: 'create', calling method: .version_select at 0x7fe1a3ead790>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-970255199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc08e5v82bdQuRUlMexH6zyEXJGDLRe19Vc/wO1IHH4z1Y0xlk1ozLKTUC0nVSnIaqSQ7SSRMF4VMqdQchIQsid0bz4J5yehIteVgsmcuAi5ldWHqWA3t5/WS1WQkPC6Q=="}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:19:50.214944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-20e54271-5115-4163-a553-4b9f8cee1c89 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Getting quotas for project 0d4d73e96d1944a997cd6800e473d954. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:19:50.220733 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.quota [None req-20e54271-5115-4163-a553-4b9f8cee1c89 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Getting quotas for user a69bfc3664804c19867852340dfc2017 and project 0d4d73e96d1944a997cd6800e473d954. Resources: {'key_pairs'} {{(pid=127041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:19:50.259370 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-20e54271-5115-4163-a553-4b9f8cee1c89 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.292326 Oct 29 04:19:50.260474 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4010/8059] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Oct 29 04:19:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:19:51.619239 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:51.619996 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:51.624144 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-377829296", "imageRef": "c6777954-04bd-4ae1-b363-bbcd09a3f6ab", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-970255199", "security_groups": [{"name": "tempest-secgroup-smoke-355421196"}], "networks": [{"uuid": "5a4a9ffd-4eaa-4881-8da0-86b802472018"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:19:51.738885 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] validate_networks() for [('5a4a9ffd-4eaa-4881-8da0-86b802472018', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:19:52.247770 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:19:52.248409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:19:52.249173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:19:52.249716 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:19:52.250230 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:19:52.263101 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:52.263582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:52.264009 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:52.264734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:52.265192 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:52.265591 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:52.285227 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Getting quotas for project 0d4d73e96d1944a997cd6800e473d954. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:19:52.291137 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Getting quotas for user a69bfc3664804c19867852340dfc2017 and project 0d4d73e96d1944a997cd6800e473d954. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:19:52.304322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:19:52.307039 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6777954-04bd-4ae1-b363-bbcd09a3f6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:19:52.359002 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7757a198-5092-4980-8c53-15149fb89564 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.741747 Oct 29 04:19:52.359872 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4050/8060] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 04:19:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:19:52.372240 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a41ac243-5760-4d1d-9b8b-74bd305dc16d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:52.372862 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a41ac243-5760-4d1d-9b8b-74bd305dc16d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:52.434201 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a41ac243-5760-4d1d-9b8b-74bd305dc16d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:52.441413 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a41ac243-5760-4d1d-9b8b-74bd305dc16d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1247 microversion: 2.1 time: 0.074111 Oct 29 04:19:52.442013 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4011/8061] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:52 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1247 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:53.465896 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5fbc8ee4-6fe1-49bb-9d35-5116d1928bee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:53.466624 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5fbc8ee4-6fe1-49bb-9d35-5116d1928bee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:53.474403 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fbc8ee4-6fe1-49bb-9d35-5116d1928bee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:53.475052 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fbc8ee4-6fe1-49bb-9d35-5116d1928bee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:53.475846 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fbc8ee4-6fe1-49bb-9d35-5116d1928bee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:53.476194 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fbc8ee4-6fe1-49bb-9d35-5116d1928bee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:53.476644 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fbc8ee4-6fe1-49bb-9d35-5116d1928bee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:53.477056 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5fbc8ee4-6fe1-49bb-9d35-5116d1928bee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:53.553609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5fbc8ee4-6fe1-49bb-9d35-5116d1928bee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:53.571430 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5fbc8ee4-6fe1-49bb-9d35-5116d1928bee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1299 microversion: 2.1 time: 0.110711 Oct 29 04:19:53.572062 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4051/8062] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:53 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:54.595592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-94401699-27b9-49ad-9a80-825eadaaeec2 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:54.596309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-94401699-27b9-49ad-9a80-825eadaaeec2 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:54.604104 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94401699-27b9-49ad-9a80-825eadaaeec2 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:54.604711 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94401699-27b9-49ad-9a80-825eadaaeec2 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:54.605226 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94401699-27b9-49ad-9a80-825eadaaeec2 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:54.606052 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94401699-27b9-49ad-9a80-825eadaaeec2 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:54.606592 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94401699-27b9-49ad-9a80-825eadaaeec2 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:54.607121 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-94401699-27b9-49ad-9a80-825eadaaeec2 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:54.770475 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-94401699-27b9-49ad-9a80-825eadaaeec2 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:54.780919 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-94401699-27b9-49ad-9a80-825eadaaeec2 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1372 microversion: 2.1 time: 0.189142 Oct 29 04:19:54.781888 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4012/8063] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:54 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:55.220168 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-7b98c6f8-642a-4da4-beee-436586235e20 req-08fc0415-01c8-4721-9e14-61fb7274c103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0394e6-60f7-4a93-a9d0-81c257db7543", "tag": "f23578fc-7e4c-4074-835b-f1df7d53c032"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:19:55.237368 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7b98c6f8-642a-4da4-beee-436586235e20 req-08fc0415-01c8-4721-9e14-61fb7274c103 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:55.237876 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7b98c6f8-642a-4da4-beee-436586235e20 req-08fc0415-01c8-4721-9e14-61fb7274c103 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:55.238302 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-7b98c6f8-642a-4da4-beee-436586235e20 req-08fc0415-01c8-4721-9e14-61fb7274c103 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:55.253266 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-7b98c6f8-642a-4da4-beee-436586235e20 req-08fc0415-01c8-4721-9e14-61fb7274c103 service nova] Creating event network-changed:f23578fc-7e4c-4074-835b-f1df7d53c032 for instance db0394e6-60f7-4a93-a9d0-81c257db7543 on n-h1-862964-4 Oct 29 04:19:55.260797 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-7b98c6f8-642a-4da4-beee-436586235e20 req-08fc0415-01c8-4721-9e14-61fb7274c103 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048848 Oct 29 04:19:55.263007 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4052/8064] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:19:55.806055 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-1ff84c0f-70c9-433a-8215-4c23bfb0d2fa tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:55.806699 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-1ff84c0f-70c9-433a-8215-4c23bfb0d2fa tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:55.814340 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ff84c0f-70c9-433a-8215-4c23bfb0d2fa tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:55.814832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ff84c0f-70c9-433a-8215-4c23bfb0d2fa tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:55.815272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ff84c0f-70c9-433a-8215-4c23bfb0d2fa tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:55.815989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ff84c0f-70c9-433a-8215-4c23bfb0d2fa tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:55.816447 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ff84c0f-70c9-433a-8215-4c23bfb0d2fa tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:55.817079 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-1ff84c0f-70c9-433a-8215-4c23bfb0d2fa tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:55.959706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-1ff84c0f-70c9-433a-8215-4c23bfb0d2fa tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:55.969252 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-1ff84c0f-70c9-433a-8215-4c23bfb0d2fa tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1372 microversion: 2.1 time: 0.167134 Oct 29 04:19:55.970139 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4013/8065] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:55 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:56.993853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c2bf7ff0-4f16-4229-a295-8fbd54a132c7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:56.994526 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c2bf7ff0-4f16-4229-a295-8fbd54a132c7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:57.002218 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bf7ff0-4f16-4229-a295-8fbd54a132c7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:57.002732 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bf7ff0-4f16-4229-a295-8fbd54a132c7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:57.003171 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bf7ff0-4f16-4229-a295-8fbd54a132c7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:57.003954 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bf7ff0-4f16-4229-a295-8fbd54a132c7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:57.004397 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bf7ff0-4f16-4229-a295-8fbd54a132c7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:57.004853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c2bf7ff0-4f16-4229-a295-8fbd54a132c7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:57.168093 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c2bf7ff0-4f16-4229-a295-8fbd54a132c7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:57.176187 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c2bf7ff0-4f16-4229-a295-8fbd54a132c7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1372 microversion: 2.1 time: 0.186932 Oct 29 04:19:57.177154 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4053/8066] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:56 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:58.201473 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-0fe5deaf-0cbc-4039-a69c-d96c30c870c6 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:58.202098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-0fe5deaf-0cbc-4039-a69c-d96c30c870c6 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:58.209510 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe5deaf-0cbc-4039-a69c-d96c30c870c6 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:58.210032 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe5deaf-0cbc-4039-a69c-d96c30c870c6 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:58.210484 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe5deaf-0cbc-4039-a69c-d96c30c870c6 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:58.211167 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe5deaf-0cbc-4039-a69c-d96c30c870c6 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:58.211651 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe5deaf-0cbc-4039-a69c-d96c30c870c6 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:58.212091 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-0fe5deaf-0cbc-4039-a69c-d96c30c870c6 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:58.348773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-0fe5deaf-0cbc-4039-a69c-d96c30c870c6 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:58.356864 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-0fe5deaf-0cbc-4039-a69c-d96c30c870c6 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1372 microversion: 2.1 time: 0.159884 Oct 29 04:19:58.357838 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4014/8067] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:58 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:59.381507 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0eebfef4-9384-47cc-8383-d34b689e90ce tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:19:59.382154 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0eebfef4-9384-47cc-8383-d34b689e90ce tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:19:59.389848 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eebfef4-9384-47cc-8383-d34b689e90ce tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:59.390358 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eebfef4-9384-47cc-8383-d34b689e90ce tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:59.390798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eebfef4-9384-47cc-8383-d34b689e90ce tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:59.391488 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eebfef4-9384-47cc-8383-d34b689e90ce tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:59.391968 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eebfef4-9384-47cc-8383-d34b689e90ce tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:59.392393 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0eebfef4-9384-47cc-8383-d34b689e90ce tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:59.534162 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-0eebfef4-9384-47cc-8383-d34b689e90ce tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:19:59.542849 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0eebfef4-9384-47cc-8383-d34b689e90ce tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1372 microversion: 2.1 time: 0.165521 Oct 29 04:19:59.543455 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4054/8068] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:19:59 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:20:00.506773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-6f932ed5-bb4a-4048-9112-045fb76fb077 req-5f1ae37e-ee6e-4cee-9317-ca32d681e967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0394e6-60f7-4a93-a9d0-81c257db7543", "name": "network-vif-plugged", "status": "completed", "tag": "f23578fc-7e4c-4074-835b-f1df7d53c032"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:20:00.517852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6f932ed5-bb4a-4048-9112-045fb76fb077 req-5f1ae37e-ee6e-4cee-9317-ca32d681e967 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:00.517852 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6f932ed5-bb4a-4048-9112-045fb76fb077 req-5f1ae37e-ee6e-4cee-9317-ca32d681e967 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:00.518090 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-6f932ed5-bb4a-4048-9112-045fb76fb077 req-5f1ae37e-ee6e-4cee-9317-ca32d681e967 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:00.530358 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-6f932ed5-bb4a-4048-9112-045fb76fb077 req-5f1ae37e-ee6e-4cee-9317-ca32d681e967 service nova] Creating event network-vif-plugged:f23578fc-7e4c-4074-835b-f1df7d53c032 for instance db0394e6-60f7-4a93-a9d0-81c257db7543 on n-h1-862964-4 Oct 29 04:20:00.535366 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-6f932ed5-bb4a-4048-9112-045fb76fb077 req-5f1ae37e-ee6e-4cee-9317-ca32d681e967 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092441 Oct 29 04:20:00.535955 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4015/8069] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:20:00.566400 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-be4c0e56-e8ac-46b1-adb6-c9b039e0486f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:00.567011 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-be4c0e56-e8ac-46b1-adb6-c9b039e0486f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:00.575240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be4c0e56-e8ac-46b1-adb6-c9b039e0486f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:00.575703 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be4c0e56-e8ac-46b1-adb6-c9b039e0486f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:00.576136 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be4c0e56-e8ac-46b1-adb6-c9b039e0486f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:00.576843 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be4c0e56-e8ac-46b1-adb6-c9b039e0486f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:00.577299 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be4c0e56-e8ac-46b1-adb6-c9b039e0486f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:00.577725 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-be4c0e56-e8ac-46b1-adb6-c9b039e0486f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:00.795753 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-be4c0e56-e8ac-46b1-adb6-c9b039e0486f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:20:00.804063 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-be4c0e56-e8ac-46b1-adb6-c9b039e0486f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1372 microversion: 2.1 time: 0.241860 Oct 29 04:20:00.804683 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4055/8070] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:20:00 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1372 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:20:01.828288 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-fb454ee6-39dd-4331-9446-30a36042cb2e tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:01.829718 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-fb454ee6-39dd-4331-9446-30a36042cb2e tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:01.836098 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb454ee6-39dd-4331-9446-30a36042cb2e tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:01.836584 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb454ee6-39dd-4331-9446-30a36042cb2e tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:01.837025 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb454ee6-39dd-4331-9446-30a36042cb2e tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:01.837734 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb454ee6-39dd-4331-9446-30a36042cb2e tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:01.838235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb454ee6-39dd-4331-9446-30a36042cb2e tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:01.838667 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-fb454ee6-39dd-4331-9446-30a36042cb2e tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:01.982272 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-fb454ee6-39dd-4331-9446-30a36042cb2e tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:20:01.991052 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-fb454ee6-39dd-4331-9446-30a36042cb2e tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1558 microversion: 2.1 time: 0.168022 Oct 29 04:20:01.991716 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4016/8071] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:20:01 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:20:02.017195 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-7088dea1-33d9-4bda-b7e2-49ce841d2371 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:02.017853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-7088dea1-33d9-4bda-b7e2-49ce841d2371 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:02.027836 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7088dea1-33d9-4bda-b7e2-49ce841d2371 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:02.028320 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7088dea1-33d9-4bda-b7e2-49ce841d2371 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:02.028752 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7088dea1-33d9-4bda-b7e2-49ce841d2371 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:02.029446 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7088dea1-33d9-4bda-b7e2-49ce841d2371 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:02.029946 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7088dea1-33d9-4bda-b7e2-49ce841d2371 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:02.030367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-7088dea1-33d9-4bda-b7e2-49ce841d2371 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:02.176414 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-7088dea1-33d9-4bda-b7e2-49ce841d2371 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:20:02.185090 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-7088dea1-33d9-4bda-b7e2-49ce841d2371 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1558 microversion: 2.1 time: 0.173104 Oct 29 04:20:02.185686 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4056/8072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:20:02 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:20:03.872832 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=6 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:20:03.932671 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-db7a07f1-ee62-4bdf-a927-7a1dc3500aee req-c2d88bdc-7a32-4a7b-aa0e-42385cbec3fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0394e6-60f7-4a93-a9d0-81c257db7543", "tag": "f23578fc-7e4c-4074-835b-f1df7d53c032"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:20:03.942449 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-db7a07f1-ee62-4bdf-a927-7a1dc3500aee req-c2d88bdc-7a32-4a7b-aa0e-42385cbec3fa service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:03.942944 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-db7a07f1-ee62-4bdf-a927-7a1dc3500aee req-c2d88bdc-7a32-4a7b-aa0e-42385cbec3fa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:03.943387 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-db7a07f1-ee62-4bdf-a927-7a1dc3500aee req-c2d88bdc-7a32-4a7b-aa0e-42385cbec3fa service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:03.954782 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-db7a07f1-ee62-4bdf-a927-7a1dc3500aee req-c2d88bdc-7a32-4a7b-aa0e-42385cbec3fa service nova] Creating event network-changed:f23578fc-7e4c-4074-835b-f1df7d53c032 for instance db0394e6-60f7-4a93-a9d0-81c257db7543 on n-h1-862964-4 Oct 29 04:20:03.959960 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-db7a07f1-ee62-4bdf-a927-7a1dc3500aee req-c2d88bdc-7a32-4a7b-aa0e-42385cbec3fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092095 Oct 29 04:20:03.960865 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4017/8073] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:21:56.254598 n-d-862964-4 devstack@n-api.service[127042]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c94bedb-2bbe-465a-b30f-0cf9af7fe730] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:21:56.255415 n-d-862964-4 devstack@n-api.service[127042]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57dcae21-10f9-47d2-a254-51c1dd17cc94] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:21:56.255779 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:21:56.256574 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:21:56.257351 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:21:56.258128 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=34 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:21:56.259053 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 04:21:56.259246 n-d-862964-4 devstack@n-api.service[127042]: Sat Oct 29 04:21:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543/action (ip 10.222.0.16) !!! Oct 29 04:21:56.264417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-bb10f98e-6449-493b-8d2e-abfd3e34ffbd tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-179009818"}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:21:56.266980 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-bb10f98e-6449-493b-8d2e-abfd3e34ffbd tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:21:56.277724 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb10f98e-6449-493b-8d2e-abfd3e34ffbd tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:21:56.278277 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb10f98e-6449-493b-8d2e-abfd3e34ffbd tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:21:56.278712 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb10f98e-6449-493b-8d2e-abfd3e34ffbd tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:21:56.279420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb10f98e-6449-493b-8d2e-abfd3e34ffbd tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:21:56.279869 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb10f98e-6449-493b-8d2e-abfd3e34ffbd tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:21:56.280287 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-bb10f98e-6449-493b-8d2e-abfd3e34ffbd tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:21:56.493677 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-bb10f98e-6449-493b-8d2e-abfd3e34ffbd tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "POST /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543/action" status: 202 len: 0 microversion: 2.1 time: 0.242193 Oct 29 04:21:56.494373 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4057/8074] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:21:56 2022] POST /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 04:22:00.897847 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3640b49c-df75-45b0-9f42-eeffda4d3fa1] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:22:00.899507 n-d-862964-4 devstack@n-api.service[127041]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:22:00.900133 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:22:00.901565 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=28 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:22:00.903619 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:22:00.904352 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 04:22:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 29 04:22:00.911250 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-95974b25-63fb-4d67-aac1-8a7d7882094e req-368929f7-d129-4c0e-a378-5cc9f92b084b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0394e6-60f7-4a93-a9d0-81c257db7543", "name": "network-vif-plugged", "status": "completed", "tag": "f23578fc-7e4c-4074-835b-f1df7d53c032"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:22:00.932162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-95974b25-63fb-4d67-aac1-8a7d7882094e req-368929f7-d129-4c0e-a378-5cc9f92b084b service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:00.932946 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-95974b25-63fb-4d67-aac1-8a7d7882094e req-368929f7-d129-4c0e-a378-5cc9f92b084b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:00.933597 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-95974b25-63fb-4d67-aac1-8a7d7882094e req-368929f7-d129-4c0e-a378-5cc9f92b084b service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:00.946316 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-95974b25-63fb-4d67-aac1-8a7d7882094e req-368929f7-d129-4c0e-a378-5cc9f92b084b service nova] Creating event network-vif-plugged:f23578fc-7e4c-4074-835b-f1df7d53c032 for instance db0394e6-60f7-4a93-a9d0-81c257db7543 on n-h1-862964-4 Oct 29 04:22:00.952272 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-95974b25-63fb-4d67-aac1-8a7d7882094e req-368929f7-d129-4c0e-a378-5cc9f92b084b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056182 Oct 29 04:22:00.953745 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4018/8075] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:22:10.074366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:22:10.075150 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:22:10.079324 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-246289810", "imageRef": "5d4ff59a-001d-4779-82ed-ed8ecec9f1a0", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-970255199", "security_groups": [{"name": "tempest-secgroup-smoke-355421196"}], "networks": [{"uuid": "5a4a9ffd-4eaa-4881-8da0-86b802472018"}]}} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:22:10.107489 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] [57dcae21-10f9-47d2-a254-51c1dd17cc94] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49214. Oct 29 04:22:10.108183 n-d-862964-4 devstack@n-api.service[127042]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c94bedb-2bbe-465a-b30f-0cf9af7fe730] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49212. Oct 29 04:22:10.195478 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.network.neutron [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] validate_networks() for [('5a4a9ffd-4eaa-4881-8da0-86b802472018', None, None, None, None, None)] {{(pid=127042) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:22:10.591672 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Flavor limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:22:10.592094 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Image limits 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:22:10.592567 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Flavor pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:22:10.592975 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Image pref 0:0:0 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:22:10.593387 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.virt.hardware [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127042) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:22:10.603399 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:10.603878 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:10.604309 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:10.605030 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:10.605476 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:10.605922 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:10.623853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Getting quotas for project 0d4d73e96d1944a997cd6800e473d954. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:22:10.629219 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.quota [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Getting quotas for user a69bfc3664804c19867852340dfc2017 and project 0d4d73e96d1944a997cd6800e473d954. Resources: {'ram', 'cores', 'instances'} {{(pid=127042) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:22:10.642276 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Going to run 1 instances... {{(pid=127042) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:22:10.644734 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d4ff59a-001d-4779-82ed-ed8ecec9f1a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127042) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:22:10.695292 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-21584a9f-3b80-4fa8-8c6c-193201b94cd7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.623187 Oct 29 04:22:10.696206 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4058/8076] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 04:22:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:22:10.708309 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-dbe1cad5-c50f-4085-8e66-8a19feeb17b5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:10.709030 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-dbe1cad5-c50f-4085-8e66-8a19feeb17b5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:10.726053 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [f421aec7-7b53-45c0-a833-73128e0f4122] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49228. Oct 29 04:22:10.731202 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] [3640b49c-df75-45b0-9f42-eeffda4d3fa1] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49226. Oct 29 04:22:10.865175 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-dbe1cad5-c50f-4085-8e66-8a19feeb17b5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:10.873411 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-dbe1cad5-c50f-4085-8e66-8a19feeb17b5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1247 microversion: 2.1 time: 0.169614 Oct 29 04:22:10.874305 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4019/8077] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:10 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1247 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:11.897649 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f6bdc8d8-48c8-484e-a97e-218f10790de5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:11.898293 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f6bdc8d8-48c8-484e-a97e-218f10790de5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:11.905508 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6bdc8d8-48c8-484e-a97e-218f10790de5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:11.906296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6bdc8d8-48c8-484e-a97e-218f10790de5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:11.906792 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6bdc8d8-48c8-484e-a97e-218f10790de5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:11.907582 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6bdc8d8-48c8-484e-a97e-218f10790de5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:11.908031 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6bdc8d8-48c8-484e-a97e-218f10790de5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:11.908456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f6bdc8d8-48c8-484e-a97e-218f10790de5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:11.986925 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f6bdc8d8-48c8-484e-a97e-218f10790de5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:11.995922 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f6bdc8d8-48c8-484e-a97e-218f10790de5 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1307 microversion: 2.1 time: 0.103327 Oct 29 04:22:11.997681 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4059/8078] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:11 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:22:13.020599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-6ad8f6fd-7aac-4e7e-b717-e114d7d67341 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:13.021271 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-6ad8f6fd-7aac-4e7e-b717-e114d7d67341 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:13.031773 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:22:13.034833 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ad8f6fd-7aac-4e7e-b717-e114d7d67341 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:13.035337 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ad8f6fd-7aac-4e7e-b717-e114d7d67341 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:13.035989 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ad8f6fd-7aac-4e7e-b717-e114d7d67341 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:13.036905 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ad8f6fd-7aac-4e7e-b717-e114d7d67341 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:13.037530 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ad8f6fd-7aac-4e7e-b717-e114d7d67341 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:13.038155 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-6ad8f6fd-7aac-4e7e-b717-e114d7d67341 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:13.195382 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-6ad8f6fd-7aac-4e7e-b717-e114d7d67341 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:13.205651 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-6ad8f6fd-7aac-4e7e-b717-e114d7d67341 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.189158 Oct 29 04:22:13.207199 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4020/8079] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:13 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:22:14.229609 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-a922f0ec-125b-4fbd-8d34-fc371b480975 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:14.230427 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-a922f0ec-125b-4fbd-8d34-fc371b480975 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:14.238392 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a922f0ec-125b-4fbd-8d34-fc371b480975 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:14.238905 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a922f0ec-125b-4fbd-8d34-fc371b480975 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:14.239335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a922f0ec-125b-4fbd-8d34-fc371b480975 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:14.240036 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a922f0ec-125b-4fbd-8d34-fc371b480975 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:14.240481 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a922f0ec-125b-4fbd-8d34-fc371b480975 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:14.240892 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-a922f0ec-125b-4fbd-8d34-fc371b480975 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:14.395386 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-a922f0ec-125b-4fbd-8d34-fc371b480975 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:14.403457 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-a922f0ec-125b-4fbd-8d34-fc371b480975 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.178231 Oct 29 04:22:14.404067 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4060/8080] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:14 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:14.919120 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-082b2ace-c05c-4138-8115-8033b2150fef req-9d56a23a-3a7d-4b74-b36a-1fafae5bf0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0394e6-60f7-4a93-a9d0-81c257db7543", "name": "network-vif-unplugged", "status": "completed", "tag": "f23578fc-7e4c-4074-835b-f1df7d53c032"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:22:14.930019 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-082b2ace-c05c-4138-8115-8033b2150fef req-9d56a23a-3a7d-4b74-b36a-1fafae5bf0ac service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:14.930511 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-082b2ace-c05c-4138-8115-8033b2150fef req-9d56a23a-3a7d-4b74-b36a-1fafae5bf0ac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:14.931043 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-082b2ace-c05c-4138-8115-8033b2150fef req-9d56a23a-3a7d-4b74-b36a-1fafae5bf0ac service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:14.944231 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-082b2ace-c05c-4138-8115-8033b2150fef req-9d56a23a-3a7d-4b74-b36a-1fafae5bf0ac service nova] Creating event network-vif-unplugged:f23578fc-7e4c-4074-835b-f1df7d53c032 for instance db0394e6-60f7-4a93-a9d0-81c257db7543 on n-h1-862964-4 Oct 29 04:22:14.950147 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-082b2ace-c05c-4138-8115-8033b2150fef req-9d56a23a-3a7d-4b74-b36a-1fafae5bf0ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037737 Oct 29 04:22:14.951403 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4021/8081] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:22:15.428240 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-24716987-3f7c-49d7-a5b3-ff044c579935 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:15.428866 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-24716987-3f7c-49d7-a5b3-ff044c579935 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:15.435841 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24716987-3f7c-49d7-a5b3-ff044c579935 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:15.436315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24716987-3f7c-49d7-a5b3-ff044c579935 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:15.436741 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24716987-3f7c-49d7-a5b3-ff044c579935 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:15.437420 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24716987-3f7c-49d7-a5b3-ff044c579935 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:15.437903 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24716987-3f7c-49d7-a5b3-ff044c579935 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:15.438296 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-24716987-3f7c-49d7-a5b3-ff044c579935 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:15.599065 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-24716987-3f7c-49d7-a5b3-ff044c579935 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:15.608357 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-24716987-3f7c-49d7-a5b3-ff044c579935 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.184001 Oct 29 04:22:15.609210 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4061/8082] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:15 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:16.632453 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-b2a4a56d-fe58-4d58-9dfe-f765609b5edb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:16.633281 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-b2a4a56d-fe58-4d58-9dfe-f765609b5edb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:16.641192 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a4a56d-fe58-4d58-9dfe-f765609b5edb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:16.641988 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a4a56d-fe58-4d58-9dfe-f765609b5edb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:16.642601 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a4a56d-fe58-4d58-9dfe-f765609b5edb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:16.643632 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a4a56d-fe58-4d58-9dfe-f765609b5edb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:16.644255 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a4a56d-fe58-4d58-9dfe-f765609b5edb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:16.645102 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-b2a4a56d-fe58-4d58-9dfe-f765609b5edb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:16.791081 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-b2a4a56d-fe58-4d58-9dfe-f765609b5edb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:16.799360 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-b2a4a56d-fe58-4d58-9dfe-f765609b5edb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.171398 Oct 29 04:22:16.800195 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4022/8083] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:16 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:17.822747 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-60091957-8cfb-41ea-b144-26b871ddf6f7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:17.823437 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-60091957-8cfb-41ea-b144-26b871ddf6f7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:17.830527 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60091957-8cfb-41ea-b144-26b871ddf6f7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:17.831007 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60091957-8cfb-41ea-b144-26b871ddf6f7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:17.831418 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60091957-8cfb-41ea-b144-26b871ddf6f7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:17.832335 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60091957-8cfb-41ea-b144-26b871ddf6f7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:17.832785 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60091957-8cfb-41ea-b144-26b871ddf6f7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:17.833201 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-60091957-8cfb-41ea-b144-26b871ddf6f7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:17.978297 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-60091957-8cfb-41ea-b144-26b871ddf6f7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:17.989876 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-60091957-8cfb-41ea-b144-26b871ddf6f7 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.170201 Oct 29 04:22:17.989876 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4062/8084] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:17 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:19.016044 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-05d5a518-2eda-4d3b-8762-40979e9e704b tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:19.016742 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-05d5a518-2eda-4d3b-8762-40979e9e704b tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:19.031324 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5a518-2eda-4d3b-8762-40979e9e704b tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:19.031842 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5a518-2eda-4d3b-8762-40979e9e704b tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:19.032285 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5a518-2eda-4d3b-8762-40979e9e704b tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:19.033012 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5a518-2eda-4d3b-8762-40979e9e704b tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:19.033476 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5a518-2eda-4d3b-8762-40979e9e704b tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:19.033938 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-05d5a518-2eda-4d3b-8762-40979e9e704b tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:19.181582 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-05d5a518-2eda-4d3b-8762-40979e9e704b tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:19.190018 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-05d5a518-2eda-4d3b-8762-40979e9e704b tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.177958 Oct 29 04:22:19.190704 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4023/8085] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:19 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:20.217718 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-50c8ad5f-19b6-4324-b7d4-20e4d87b4e51 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:20.218503 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-50c8ad5f-19b6-4324-b7d4-20e4d87b4e51 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:20.229558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c8ad5f-19b6-4324-b7d4-20e4d87b4e51 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:20.229966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c8ad5f-19b6-4324-b7d4-20e4d87b4e51 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:20.230417 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c8ad5f-19b6-4324-b7d4-20e4d87b4e51 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:20.231109 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c8ad5f-19b6-4324-b7d4-20e4d87b4e51 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:20.231561 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c8ad5f-19b6-4324-b7d4-20e4d87b4e51 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:20.231978 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-50c8ad5f-19b6-4324-b7d4-20e4d87b4e51 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:20.370238 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-50c8ad5f-19b6-4324-b7d4-20e4d87b4e51 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:20.378102 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-50c8ad5f-19b6-4324-b7d4-20e4d87b4e51 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.166985 Oct 29 04:22:20.378680 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4063/8086] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:20 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:21.402150 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-c39240bf-66aa-4ffa-9d2a-f3545c070d63 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:21.402822 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-c39240bf-66aa-4ffa-9d2a-f3545c070d63 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:21.405838 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell0:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:22:21.411474 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c39240bf-66aa-4ffa-9d2a-f3545c070d63 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:21.411975 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c39240bf-66aa-4ffa-9d2a-f3545c070d63 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:21.412423 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c39240bf-66aa-4ffa-9d2a-f3545c070d63 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:21.413170 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c39240bf-66aa-4ffa-9d2a-f3545c070d63 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:21.413603 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c39240bf-66aa-4ffa-9d2a-f3545c070d63 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:21.414071 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-c39240bf-66aa-4ffa-9d2a-f3545c070d63 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:21.470620 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=2 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:22:21.471497 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell0:SELECT=6 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:22:21.536522 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-142fbc9c-8112-44d1-ae99-f2a8253f8914 req-eefccc00-fc78-42ee-a8f3-66949743d724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc19582b-7710-41ae-896e-cdfa1cc444eb", "tag": "118dc0c5-b219-4d2f-9dda-31f67d247555"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:22:21.546763 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-142fbc9c-8112-44d1-ae99-f2a8253f8914 req-eefccc00-fc78-42ee-a8f3-66949743d724 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:21.547285 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-142fbc9c-8112-44d1-ae99-f2a8253f8914 req-eefccc00-fc78-42ee-a8f3-66949743d724 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:21.547717 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-142fbc9c-8112-44d1-ae99-f2a8253f8914 req-eefccc00-fc78-42ee-a8f3-66949743d724 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:21.562863 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-142fbc9c-8112-44d1-ae99-f2a8253f8914 req-eefccc00-fc78-42ee-a8f3-66949743d724 service nova] Creating event network-changed:118dc0c5-b219-4d2f-9dda-31f67d247555 for instance fc19582b-7710-41ae-896e-cdfa1cc444eb on n-h2-862964-4 Oct 29 04:22:21.568159 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-142fbc9c-8112-44d1-ae99-f2a8253f8914 req-eefccc00-fc78-42ee-a8f3-66949743d724 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102261 Oct 29 04:22:21.568850 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4064/8087] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:22:21.708136 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-c39240bf-66aa-4ffa-9d2a-f3545c070d63 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:21.717152 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-c39240bf-66aa-4ffa-9d2a-f3545c070d63 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.319091 Oct 29 04:22:21.717612 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4024/8088] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:21 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:22.746375 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-c513d875-91f8-4f73-b88f-a5841847622d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:22.747191 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-c513d875-91f8-4f73-b88f-a5841847622d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:22.755234 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c513d875-91f8-4f73-b88f-a5841847622d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:22.755790 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c513d875-91f8-4f73-b88f-a5841847622d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:22.756298 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c513d875-91f8-4f73-b88f-a5841847622d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:22.757126 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c513d875-91f8-4f73-b88f-a5841847622d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:22.757658 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c513d875-91f8-4f73-b88f-a5841847622d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:22.758179 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-c513d875-91f8-4f73-b88f-a5841847622d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:22.899456 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-c513d875-91f8-4f73-b88f-a5841847622d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:22.907772 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-c513d875-91f8-4f73-b88f-a5841847622d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.169165 Oct 29 04:22:22.908394 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4065/8089] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:22 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:23.935111 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-a0f68efc-953c-4578-a86a-16e82b380237 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:23.936040 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-a0f68efc-953c-4578-a86a-16e82b380237 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:23.947706 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f68efc-953c-4578-a86a-16e82b380237 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:23.948393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f68efc-953c-4578-a86a-16e82b380237 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:23.948845 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f68efc-953c-4578-a86a-16e82b380237 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:23.949551 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f68efc-953c-4578-a86a-16e82b380237 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:23.950051 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f68efc-953c-4578-a86a-16e82b380237 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:23.950480 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-a0f68efc-953c-4578-a86a-16e82b380237 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:24.096058 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-a0f68efc-953c-4578-a86a-16e82b380237 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:24.104164 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-a0f68efc-953c-4578-a86a-16e82b380237 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.175711 Oct 29 04:22:24.104761 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4025/8090] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:23 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:25.127555 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-20902702-5cd1-4663-86d4-b3dc5ebe3b09 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:25.128160 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-20902702-5cd1-4663-86d4-b3dc5ebe3b09 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:25.135566 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20902702-5cd1-4663-86d4-b3dc5ebe3b09 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:25.136044 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20902702-5cd1-4663-86d4-b3dc5ebe3b09 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:25.136468 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20902702-5cd1-4663-86d4-b3dc5ebe3b09 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:25.137164 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20902702-5cd1-4663-86d4-b3dc5ebe3b09 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:25.137625 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20902702-5cd1-4663-86d4-b3dc5ebe3b09 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:25.138020 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-20902702-5cd1-4663-86d4-b3dc5ebe3b09 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:25.274236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-20902702-5cd1-4663-86d4-b3dc5ebe3b09 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:25.282653 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-20902702-5cd1-4663-86d4-b3dc5ebe3b09 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.159406 Oct 29 04:22:25.283268 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4066/8091] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:25 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:26.310959 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-23c620d5-e3e2-4172-9657-3f4c243e6cfc tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:26.311858 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-23c620d5-e3e2-4172-9657-3f4c243e6cfc tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:26.323519 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23c620d5-e3e2-4172-9657-3f4c243e6cfc tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:26.324381 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23c620d5-e3e2-4172-9657-3f4c243e6cfc tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:26.325065 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23c620d5-e3e2-4172-9657-3f4c243e6cfc tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:26.325981 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23c620d5-e3e2-4172-9657-3f4c243e6cfc tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:26.326458 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23c620d5-e3e2-4172-9657-3f4c243e6cfc tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:26.326899 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-23c620d5-e3e2-4172-9657-3f4c243e6cfc tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:26.791042 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-23c620d5-e3e2-4172-9657-3f4c243e6cfc tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:26.799278 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-23c620d5-e3e2-4172-9657-3f4c243e6cfc tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.495218 Oct 29 04:22:26.799891 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4026/8092] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:26 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:26.842355 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ebb48a61-39a5-42d8-a4fa-87d574819fca req-7f3cbfbb-e4c6-4216-85cd-c4b884b3181a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19582b-7710-41ae-896e-cdfa1cc444eb", "name": "network-vif-plugged", "status": "completed", "tag": "118dc0c5-b219-4d2f-9dda-31f67d247555"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:22:26.854924 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ebb48a61-39a5-42d8-a4fa-87d574819fca req-7f3cbfbb-e4c6-4216-85cd-c4b884b3181a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:26.855406 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ebb48a61-39a5-42d8-a4fa-87d574819fca req-7f3cbfbb-e4c6-4216-85cd-c4b884b3181a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:26.855835 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ebb48a61-39a5-42d8-a4fa-87d574819fca req-7f3cbfbb-e4c6-4216-85cd-c4b884b3181a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:26.867477 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ebb48a61-39a5-42d8-a4fa-87d574819fca req-7f3cbfbb-e4c6-4216-85cd-c4b884b3181a service nova] Creating event network-vif-plugged:118dc0c5-b219-4d2f-9dda-31f67d247555 for instance fc19582b-7710-41ae-896e-cdfa1cc444eb on n-h2-862964-4 Oct 29 04:22:26.872463 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ebb48a61-39a5-42d8-a4fa-87d574819fca req-7f3cbfbb-e4c6-4216-85cd-c4b884b3181a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034061 Oct 29 04:22:26.873078 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4067/8093] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:22:27.825726 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-54272e0d-f042-45ac-835e-8dd9be94845c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:27.826434 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-54272e0d-f042-45ac-835e-8dd9be94845c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:27.834576 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54272e0d-f042-45ac-835e-8dd9be94845c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:27.835162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54272e0d-f042-45ac-835e-8dd9be94845c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:27.835691 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54272e0d-f042-45ac-835e-8dd9be94845c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:27.836535 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54272e0d-f042-45ac-835e-8dd9be94845c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:27.837084 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54272e0d-f042-45ac-835e-8dd9be94845c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:27.837599 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-54272e0d-f042-45ac-835e-8dd9be94845c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:27.979768 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-54272e0d-f042-45ac-835e-8dd9be94845c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:27.988434 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-54272e0d-f042-45ac-835e-8dd9be94845c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1372 microversion: 2.1 time: 0.168497 Oct 29 04:22:27.989013 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4027/8094] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:27 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:29.016244 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-f799f77e-0e94-4520-a3ec-0677baa3494c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:29.017023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-f799f77e-0e94-4520-a3ec-0677baa3494c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:29.024557 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f799f77e-0e94-4520-a3ec-0677baa3494c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:29.025097 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f799f77e-0e94-4520-a3ec-0677baa3494c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:29.025579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f799f77e-0e94-4520-a3ec-0677baa3494c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:29.026394 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f799f77e-0e94-4520-a3ec-0677baa3494c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:29.026894 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f799f77e-0e94-4520-a3ec-0677baa3494c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:29.027362 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-f799f77e-0e94-4520-a3ec-0677baa3494c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:29.182735 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-f799f77e-0e94-4520-a3ec-0677baa3494c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:29.190798 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-f799f77e-0e94-4520-a3ec-0677baa3494c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1557 microversion: 2.1 time: 0.181236 Oct 29 04:22:29.191393 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4068/8095] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:29 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1557 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:29.215980 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-7f6913ff-3345-491e-b682-74315ce3f032 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:22:29.216570 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-7f6913ff-3345-491e-b682-74315ce3f032 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:22:29.226803 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f6913ff-3345-491e-b682-74315ce3f032 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:29.227498 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f6913ff-3345-491e-b682-74315ce3f032 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:29.228134 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f6913ff-3345-491e-b682-74315ce3f032 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:29.229259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f6913ff-3345-491e-b682-74315ce3f032 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:29.229849 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f6913ff-3345-491e-b682-74315ce3f032 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:29.230311 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-7f6913ff-3345-491e-b682-74315ce3f032 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:29.366878 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-7f6913ff-3345-491e-b682-74315ce3f032 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:22:29.377691 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-7f6913ff-3345-491e-b682-74315ce3f032 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1557 microversion: 2.1 time: 0.168068 Oct 29 04:22:29.378488 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4028/8096] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:22:29 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:22:31.009811 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-8f680d71-6baa-434d-b41e-800545aa6fe7 req-97a55428-3aea-4a1b-8800-9f3e04bc4cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc19582b-7710-41ae-896e-cdfa1cc444eb", "tag": "118dc0c5-b219-4d2f-9dda-31f67d247555"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:22:31.020409 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8f680d71-6baa-434d-b41e-800545aa6fe7 req-97a55428-3aea-4a1b-8800-9f3e04bc4cde service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:22:31.020880 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8f680d71-6baa-434d-b41e-800545aa6fe7 req-97a55428-3aea-4a1b-8800-9f3e04bc4cde service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:22:31.021322 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-8f680d71-6baa-434d-b41e-800545aa6fe7 req-97a55428-3aea-4a1b-8800-9f3e04bc4cde service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:22:31.033021 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-8f680d71-6baa-434d-b41e-800545aa6fe7 req-97a55428-3aea-4a1b-8800-9f3e04bc4cde service nova] Creating event network-changed:118dc0c5-b219-4d2f-9dda-31f67d247555 for instance fc19582b-7710-41ae-896e-cdfa1cc444eb on n-h2-862964-4 Oct 29 04:22:31.038210 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-8f680d71-6baa-434d-b41e-800545aa6fe7 req-97a55428-3aea-4a1b-8800-9f3e04bc4cde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032159 Oct 29 04:22:31.039037 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4069/8097] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:23:59.884640 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=24 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:23:59.885356 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=50 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:23:59.886655 n-d-862964-4 devstack@n-api.service[127041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:23:59.886839 n-d-862964-4 devstack@n-api.service[127041]: Sat Oct 29 04:23:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb/action (ip 10.222.0.16) !!! Oct 29 04:23:59.895162 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-3ae1be9e-0b8a-4a65-b2cc-64462c8614c4 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1981577864"}} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:23:59.898588 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-3ae1be9e-0b8a-4a65-b2cc-64462c8614c4 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:23:59.908655 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae1be9e-0b8a-4a65-b2cc-64462c8614c4 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:23:59.909144 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae1be9e-0b8a-4a65-b2cc-64462c8614c4 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:23:59.909583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae1be9e-0b8a-4a65-b2cc-64462c8614c4 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:23:59.910342 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae1be9e-0b8a-4a65-b2cc-64462c8614c4 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:23:59.910801 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae1be9e-0b8a-4a65-b2cc-64462c8614c4 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:23:59.911235 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-3ae1be9e-0b8a-4a65-b2cc-64462c8614c4 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:00.172535 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-3ae1be9e-0b8a-4a65-b2cc-64462c8614c4 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "POST /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb/action" status: 202 len: 0 microversion: 2.1 time: 0.289461 Oct 29 04:24:00.173127 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4029/8098] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Oct 29 04:23:59 2022] POST /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 04:24:05.420035 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:24:05.422637 n-d-862964-4 devstack@n-api.service[127042]: DEBUG dbcounter [-] [127042] Writing DB stats nova_cell1:SELECT=56 {{(pid=127042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:24:05.433719 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-ea4c3a2a-ec49-4483-ada9-10e9cbf2a1a6 req-1310a0de-0b2a-40b0-af20-73b43f1bf499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19582b-7710-41ae-896e-cdfa1cc444eb", "name": "network-vif-plugged", "status": "completed", "tag": "118dc0c5-b219-4d2f-9dda-31f67d247555"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:24:05.448602 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ea4c3a2a-ec49-4483-ada9-10e9cbf2a1a6 req-1310a0de-0b2a-40b0-af20-73b43f1bf499 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:05.449646 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ea4c3a2a-ec49-4483-ada9-10e9cbf2a1a6 req-1310a0de-0b2a-40b0-af20-73b43f1bf499 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:05.450398 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-ea4c3a2a-ec49-4483-ada9-10e9cbf2a1a6 req-1310a0de-0b2a-40b0-af20-73b43f1bf499 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:05.471064 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-ea4c3a2a-ec49-4483-ada9-10e9cbf2a1a6 req-1310a0de-0b2a-40b0-af20-73b43f1bf499 service nova] Creating event network-vif-plugged:118dc0c5-b219-4d2f-9dda-31f67d247555 for instance fc19582b-7710-41ae-896e-cdfa1cc444eb on n-h2-862964-4 Oct 29 04:24:05.477661 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-ea4c3a2a-ec49-4483-ada9-10e9cbf2a1a6 req-1310a0de-0b2a-40b0-af20-73b43f1bf499 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062318 Oct 29 04:24:05.479880 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4070/8099] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:24:13.855112 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_api:SELECT=2 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:24:13.855924 n-d-862964-4 devstack@n-api.service[127041]: DEBUG dbcounter [-] [127041] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:24:13.860869 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-47bbb278-ad4f-4bcf-a3f3-bd3cbf5b263c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:24:13.861558 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-e9fb5b8f-54b0-4f86-a5b3-a15723768dfb req-fa624bba-43e9-4870-8011-e426063b5512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc19582b-7710-41ae-896e-cdfa1cc444eb", "tag": "118dc0c5-b219-4d2f-9dda-31f67d247555"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:24:13.862080 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-47bbb278-ad4f-4bcf-a3f3-bd3cbf5b263c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:24:13.869398 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47bbb278-ad4f-4bcf-a3f3-bd3cbf5b263c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:13.869927 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47bbb278-ad4f-4bcf-a3f3-bd3cbf5b263c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:13.870370 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47bbb278-ad4f-4bcf-a3f3-bd3cbf5b263c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:13.871075 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47bbb278-ad4f-4bcf-a3f3-bd3cbf5b263c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:13.871740 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47bbb278-ad4f-4bcf-a3f3-bd3cbf5b263c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:13.872159 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-47bbb278-ad4f-4bcf-a3f3-bd3cbf5b263c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:13.872501 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e9fb5b8f-54b0-4f86-a5b3-a15723768dfb req-fa624bba-43e9-4870-8011-e426063b5512 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:13.872952 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e9fb5b8f-54b0-4f86-a5b3-a15723768dfb req-fa624bba-43e9-4870-8011-e426063b5512 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:13.873615 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-e9fb5b8f-54b0-4f86-a5b3-a15723768dfb req-fa624bba-43e9-4870-8011-e426063b5512 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:13.887004 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-e9fb5b8f-54b0-4f86-a5b3-a15723768dfb req-fa624bba-43e9-4870-8011-e426063b5512 service nova] Creating event network-changed:118dc0c5-b219-4d2f-9dda-31f67d247555 for instance fc19582b-7710-41ae-896e-cdfa1cc444eb on n-h2-862964-4 Oct 29 04:24:13.892793 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-e9fb5b8f-54b0-4f86-a5b3-a15723768dfb req-fa624bba-43e9-4870-8011-e426063b5512 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036651 Oct 29 04:24:13.893502 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4071/8100] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:24:13.902193 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-47bbb278-ad4f-4bcf-a3f3-bd3cbf5b263c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Going to try to terminate instance {{(pid=127041) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:24:13.990845 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-47bbb278-ad4f-4bcf-a3f3-bd3cbf5b263c tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 204 len: 0 microversion: 2.1 time: 0.138025 Oct 29 04:24:13.992569 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4030/8101] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 04:24:13 2022] DELETE /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:24:14.001023 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-9116b855-5eb7-431d-852a-2c7dc5f49f76 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:24:14.001819 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-9116b855-5eb7-431d-852a-2c7dc5f49f76 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:24:14.017329 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9116b855-5eb7-431d-852a-2c7dc5f49f76 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:14.017966 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9116b855-5eb7-431d-852a-2c7dc5f49f76 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:14.018500 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9116b855-5eb7-431d-852a-2c7dc5f49f76 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:14.019305 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9116b855-5eb7-431d-852a-2c7dc5f49f76 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:14.019853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9116b855-5eb7-431d-852a-2c7dc5f49f76 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:14.020367 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-9116b855-5eb7-431d-852a-2c7dc5f49f76 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:14.166731 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-9116b855-5eb7-431d-852a-2c7dc5f49f76 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:24:14.175205 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-9116b855-5eb7-431d-852a-2c7dc5f49f76 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1682 microversion: 2.1 time: 0.178842 Oct 29 04:24:14.175808 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4072/8102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:24:13 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:24:15.204164 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-cd892f96-2410-46e6-89f1-0307b62e6654 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:24:15.205466 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-cd892f96-2410-46e6-89f1-0307b62e6654 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:24:15.217259 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd892f96-2410-46e6-89f1-0307b62e6654 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:15.218149 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd892f96-2410-46e6-89f1-0307b62e6654 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:15.218894 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd892f96-2410-46e6-89f1-0307b62e6654 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:15.219846 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd892f96-2410-46e6-89f1-0307b62e6654 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:15.220313 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd892f96-2410-46e6-89f1-0307b62e6654 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:15.220746 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-cd892f96-2410-46e6-89f1-0307b62e6654 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:15.375238 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-cd892f96-2410-46e6-89f1-0307b62e6654 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:24:15.383700 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-cd892f96-2410-46e6-89f1-0307b62e6654 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1682 microversion: 2.1 time: 0.186706 Oct 29 04:24:15.384369 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4031/8103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:24:15 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:24:15.401674 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [req-fa83c2d3-205d-4432-ab1c-92f42f4e9dfd req-17c2f58d-f24a-4ca1-860d-d88060d3657a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19582b-7710-41ae-896e-cdfa1cc444eb", "name": "network-vif-unplugged", "status": "completed", "tag": "118dc0c5-b219-4d2f-9dda-31f67d247555"}]} {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:24:15.412062 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fa83c2d3-205d-4432-ab1c-92f42f4e9dfd req-17c2f58d-f24a-4ca1-860d-d88060d3657a service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:15.412538 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fa83c2d3-205d-4432-ab1c-92f42f4e9dfd req-17c2f58d-f24a-4ca1-860d-d88060d3657a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:15.412961 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [req-fa83c2d3-205d-4432-ab1c-92f42f4e9dfd req-17c2f58d-f24a-4ca1-860d-d88060d3657a service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:15.424649 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.compute.server_external_events [req-fa83c2d3-205d-4432-ab1c-92f42f4e9dfd req-17c2f58d-f24a-4ca1-860d-d88060d3657a service nova] Creating event network-vif-unplugged:118dc0c5-b219-4d2f-9dda-31f67d247555 for instance fc19582b-7710-41ae-896e-cdfa1cc444eb on n-h2-862964-4 Oct 29 04:24:15.429695 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [req-fa83c2d3-205d-4432-ab1c-92f42f4e9dfd req-17c2f58d-f24a-4ca1-860d-d88060d3657a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039568 Oct 29 04:24:15.430330 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4073/8104] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:24:16.356583 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-f6f78563-3d21-43b3-8822-8357ee3a2c74 req-c5e1ff33-079d-4ca3-a8dc-cb91ea966a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19582b-7710-41ae-896e-cdfa1cc444eb", "name": "network-vif-deleted", "tag": "118dc0c5-b219-4d2f-9dda-31f67d247555"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:24:16.367809 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f6f78563-3d21-43b3-8822-8357ee3a2c74 req-c5e1ff33-079d-4ca3-a8dc-cb91ea966a98 service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:16.368341 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f6f78563-3d21-43b3-8822-8357ee3a2c74 req-c5e1ff33-079d-4ca3-a8dc-cb91ea966a98 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:16.368785 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-f6f78563-3d21-43b3-8822-8357ee3a2c74 req-c5e1ff33-079d-4ca3-a8dc-cb91ea966a98 service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:16.381425 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-f6f78563-3d21-43b3-8822-8357ee3a2c74 req-c5e1ff33-079d-4ca3-a8dc-cb91ea966a98 service nova] Creating event network-vif-deleted:118dc0c5-b219-4d2f-9dda-31f67d247555 for instance fc19582b-7710-41ae-896e-cdfa1cc444eb on n-h2-862964-4 Oct 29 04:24:16.386409 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-f6f78563-3d21-43b3-8822-8357ee3a2c74 req-c5e1ff33-079d-4ca3-a8dc-cb91ea966a98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034407 Oct 29 04:24:16.387014 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4032/8105] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:24:16.409570 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-260c78e1-d77a-4192-b175-756b591f9c2f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:24:16.410596 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-260c78e1-d77a-4192-b175-756b591f9c2f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:24:16.418152 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260c78e1-d77a-4192-b175-756b591f9c2f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:16.418759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260c78e1-d77a-4192-b175-756b591f9c2f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:16.419261 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260c78e1-d77a-4192-b175-756b591f9c2f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:16.420091 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260c78e1-d77a-4192-b175-756b591f9c2f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:16.420613 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260c78e1-d77a-4192-b175-756b591f9c2f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:16.421103 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-260c78e1-d77a-4192-b175-756b591f9c2f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:16.488084 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-260c78e1-d77a-4192-b175-756b591f9c2f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:24:16.496970 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-260c78e1-d77a-4192-b175-756b591f9c2f tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 200 len: 1332 microversion: 2.1 time: 0.093519 Oct 29 04:24:16.497578 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4074/8106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:24:16 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:24:17.524199 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:24:17.524911 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: fc19582b-7710-41ae-896e-cdfa1cc444eb] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:24:17.531704 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:17.532202 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:17.532669 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:17.533354 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:17.533834 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:17.534286 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:17.548657 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] HTTP exception thrown: Instance fc19582b-7710-41ae-896e-cdfa1cc444eb could not be found. Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Request method failure captured: Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb HTTP/1.1 Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKnhToHasgRtYOnkqfXIKMdz5XE_OuO68HN6PNk7fQ5YhfomsUh1Tnn6ut4edJcSTEkpT_dcbtC92gE5zDVzUf1OQjKSKsEZqxSF5llUktOoO9M7ifLS6tLxjoOa7IqjWKfFfrx3POrI0ndECeFzImIsV7mn8RWudVtVh2YY_8LTjII Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 0d4d73e96d1944a997cd6800e473d954 Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestSnapshotPattern-1534613542 Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d4d73e96d1944a997cd6800e473d954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d4d73e96d1944a997cd6800e473d954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d4d73e96d1944a997cd6800e473d954", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d4d73e96d1944a997cd6800e473d954"}]}] Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestSnapshotPattern-1534613542 Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 0d4d73e96d1944a997cd6800e473d954 Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestSnapshotPattern-1534613542 Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestSnapshotPattern-1534613542-project Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a69bfc3664804c19867852340dfc2017 Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestSnapshotPattern-1534613542-project Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance fc19582b-7710-41ae-896e-cdfa1cc444eb could not be found. Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'fc19582b-7710-41ae-896e-cdfa1cc444eb'} Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc19582b-7710-41ae-896e-cdfa1cc444eb could not be found. Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc19582b-7710-41ae-896e-cdfa1cc444eb could not be found. Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:24:17.550393 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:24:17.556039 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:24:17.556039 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:24:17.556039 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:24:17.556039 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:24:17.556039 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:24:17.556039 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc19582b-7710-41ae-896e-cdfa1cc444eb could not be found. Oct 29 04:24:17.556039 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:24:17.556039 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Returning 404 to user: Instance fc19582b-7710-41ae-896e-cdfa1cc444eb could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:24:17.556039 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-da000044-37bd-43d7-aadb-9053cc00da06 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb" status: 404 len: 111 microversion: 2.1 time: 0.033499 Oct 29 04:24:17.556039 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4033/8107] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:24:17 2022] GET /compute/v2.1/servers/fc19582b-7710-41ae-896e-cdfa1cc444eb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:24:19.324374 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-aab482c1-d0de-48c7-8ed0-81604474f60b req-7d36f560-5d38-4e1c-8ec2-3dd8c3e63dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0394e6-60f7-4a93-a9d0-81c257db7543", "tag": "f23578fc-7e4c-4074-835b-f1df7d53c032"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:24:19.325759 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-0fead2a5-bcc3-4275-a080-39393245f7ee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:24:19.333736 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0fead2a5-bcc3-4275-a080-39393245f7ee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:24:19.341579 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fead2a5-bcc3-4275-a080-39393245f7ee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:19.342573 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fead2a5-bcc3-4275-a080-39393245f7ee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:19.342723 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-aab482c1-d0de-48c7-8ed0-81604474f60b req-7d36f560-5d38-4e1c-8ec2-3dd8c3e63dee service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:19.342853 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fead2a5-bcc3-4275-a080-39393245f7ee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:19.342977 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-aab482c1-d0de-48c7-8ed0-81604474f60b req-7d36f560-5d38-4e1c-8ec2-3dd8c3e63dee service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:19.343123 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-aab482c1-d0de-48c7-8ed0-81604474f60b req-7d36f560-5d38-4e1c-8ec2-3dd8c3e63dee service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:19.343859 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fead2a5-bcc3-4275-a080-39393245f7ee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:19.344491 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fead2a5-bcc3-4275-a080-39393245f7ee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:19.344974 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-0fead2a5-bcc3-4275-a080-39393245f7ee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:19.354659 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-aab482c1-d0de-48c7-8ed0-81604474f60b req-7d36f560-5d38-4e1c-8ec2-3dd8c3e63dee service nova] Creating event network-changed:f23578fc-7e4c-4074-835b-f1df7d53c032 for instance db0394e6-60f7-4a93-a9d0-81c257db7543 on n-h1-862964-4 Oct 29 04:24:19.360385 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-aab482c1-d0de-48c7-8ed0-81604474f60b req-7d36f560-5d38-4e1c-8ec2-3dd8c3e63dee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039634 Oct 29 04:24:19.360989 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4034/8108] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:24:19.375365 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-0fead2a5-bcc3-4275-a080-39393245f7ee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Going to try to terminate instance {{(pid=127042) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:24:19.469952 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-0fead2a5-bcc3-4275-a080-39393245f7ee tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 204 len: 0 microversion: 2.1 time: 0.154153 Oct 29 04:24:19.471586 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4075/8109] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 04:24:19 2022] DELETE /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:24:19.480724 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-189050ba-eb04-47c2-82df-ee89382fa4cb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:24:19.481625 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-189050ba-eb04-47c2-82df-ee89382fa4cb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:24:19.488331 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-189050ba-eb04-47c2-82df-ee89382fa4cb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:19.488859 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-189050ba-eb04-47c2-82df-ee89382fa4cb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:19.489419 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-189050ba-eb04-47c2-82df-ee89382fa4cb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:19.490153 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-189050ba-eb04-47c2-82df-ee89382fa4cb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:19.490614 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-189050ba-eb04-47c2-82df-ee89382fa4cb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:19.491045 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-189050ba-eb04-47c2-82df-ee89382fa4cb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:19.625572 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.policy [None req-189050ba-eb04-47c2-82df-ee89382fa4cb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127041) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:24:19.634088 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-189050ba-eb04-47c2-82df-ee89382fa4cb tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1683 microversion: 2.1 time: 0.157866 Oct 29 04:24:19.634674 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4035/8110] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:24:19 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:24:20.664108 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5a7bdac7-9c2e-42d5-b58d-c92b22fa4649 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:24:20.665235 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5a7bdac7-9c2e-42d5-b58d-c92b22fa4649 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:24:20.676870 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a7bdac7-9c2e-42d5-b58d-c92b22fa4649 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:20.677360 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a7bdac7-9c2e-42d5-b58d-c92b22fa4649 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:20.677797 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a7bdac7-9c2e-42d5-b58d-c92b22fa4649 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:20.678528 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a7bdac7-9c2e-42d5-b58d-c92b22fa4649 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:20.679004 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a7bdac7-9c2e-42d5-b58d-c92b22fa4649 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:20.679423 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5a7bdac7-9c2e-42d5-b58d-c92b22fa4649 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:20.902930 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5a7bdac7-9c2e-42d5-b58d-c92b22fa4649 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:24:20.911109 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5a7bdac7-9c2e-42d5-b58d-c92b22fa4649 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1683 microversion: 2.1 time: 0.254533 Oct 29 04:24:20.911693 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4076/8111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:24:20 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1683 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:24:21.667338 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [req-b04c77d3-fa0b-433a-8650-b117de197def req-43427569-367c-4329-aea2-ed7bfd5f447f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0394e6-60f7-4a93-a9d0-81c257db7543", "name": "network-vif-deleted", "tag": "f23578fc-7e4c-4074-835b-f1df7d53c032"}]} {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:24:21.678389 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b04c77d3-fa0b-433a-8650-b117de197def req-43427569-367c-4329-aea2-ed7bfd5f447f service nova] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:21.678891 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b04c77d3-fa0b-433a-8650-b117de197def req-43427569-367c-4329-aea2-ed7bfd5f447f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:21.679344 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [req-b04c77d3-fa0b-433a-8650-b117de197def req-43427569-367c-4329-aea2-ed7bfd5f447f service nova] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:21.692060 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.compute.server_external_events [req-b04c77d3-fa0b-433a-8650-b117de197def req-43427569-367c-4329-aea2-ed7bfd5f447f service nova] Creating event network-vif-deleted:f23578fc-7e4c-4074-835b-f1df7d53c032 for instance db0394e6-60f7-4a93-a9d0-81c257db7543 on n-h1-862964-4 Oct 29 04:24:21.697793 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [req-b04c77d3-fa0b-433a-8650-b117de197def req-43427569-367c-4329-aea2-ed7bfd5f447f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034190 Oct 29 04:24:21.701653 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4036/8112] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Oct 29 04:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:24:21.935173 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:24:21.935765 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.compute.api [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127042) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:24:21.943315 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:21.943798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:21.944221 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:21.944921 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:21.945366 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:21.945767 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:21.982236 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:21.982740 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:21.983177 n-d-862964-4 devstack@n-api.service[127042]: DEBUG oslo_concurrency.lockutils [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:21.983798 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.objects.instance [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lazy-loading 'fault' on Instance uuid db0394e6-60f7-4a93-a9d0-81c257db7543 {{(pid=127042) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:24:22.028951 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.policy [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69bfc3664804c19867852340dfc2017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4d73e96d1944a997cd6800e473d954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127042) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:24:22.037559 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-5dd1315a-a290-4d47-9d5b-4a6320540928 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 200 len: 1502 microversion: 2.1 time: 0.106663 Oct 29 04:24:22.038404 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4077/8113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:24:21 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 1502 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:24:23.068049 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '>' {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:24:23.069218 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.compute.api [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] [instance: db0394e6-60f7-4a93-a9d0-81c257db7543] Fetching instance by UUID {{(pid=127041) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:24:23.079753 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:23.080566 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:23.081299 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:23.082659 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Acquiring lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:24:23.083125 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:24:23.083554 n-d-862964-4 devstack@n-api.service[127041]: DEBUG oslo_concurrency.lockutils [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Lock "6e360a35-3f1b-44d0-a54d-47a31b18ebee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:24:23.097357 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.wsgi [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] HTTP exception thrown: Instance db0394e6-60f7-4a93-a9d0-81c257db7543 could not be found. Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Request method failure captured: Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: request: GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 HTTP/1.1 Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: Accept: application/json Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: Accept-Encoding: identity Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: Connection: close Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: Content-Length: 0 Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: Content-Type: application/json Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: Host: 10.222.0.16 Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: Openstack-System-Scope: None Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: User-Agent: python-urllib3/1.26.12 Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Auth-Token: gAAAAABjXKnhToHasgRtYOnkqfXIKMdz5XE_OuO68HN6PNk7fQ5YhfomsUh1Tnn6ut4edJcSTEkpT_dcbtC92gE5zDVzUf1OQjKSKsEZqxSF5llUktOoO9M7ifLS6tLxjoOa7IqjWKfFfrx3POrI0ndECeFzImIsV7mn8RWudVtVh2YY_8LTjII Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Id: None Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Domain-Name: None Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Identity-Status: Confirmed Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Is-Admin-Project: True Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Id: default Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Domain-Name: Default Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Id: 0d4d73e96d1944a997cd6800e473d954 Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Project-Name: tempest-TestSnapshotPattern-1534613542 Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Role: member,reader Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Roles: member,reader Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d4d73e96d1944a997cd6800e473d954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d4d73e96d1944a997cd6800e473d954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d4d73e96d1944a997cd6800e473d954", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d4d73e96d1944a997cd6800e473d954"}]}] Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant: tempest-TestSnapshotPattern-1534613542 Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Id: 0d4d73e96d1944a997cd6800e473d954 Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-Tenant-Name: tempest-TestSnapshotPattern-1534613542 Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-User: tempest-TestSnapshotPattern-1534613542-project Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Id: default Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-User-Domain-Name: Default Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-User-Id: a69bfc3664804c19867852340dfc2017 Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: X-User-Name: tempest-TestSnapshotPattern-1534613542-project Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: method: > Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: exception: Instance db0394e6-60f7-4a93-a9d0-81c257db7543 could not be found. Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: action_args: {'id': 'db0394e6-60f7-4a93-a9d0-81c257db7543'} Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: {{(pid=127041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0394e6-60f7-4a93-a9d0-81c257db7543 could not be found. Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0394e6-60f7-4a93-a9d0-81c257db7543 could not be found. Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:24:23.099082 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:24:23.104523 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:24:23.104523 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:24:23.104523 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:24:23.104523 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:24:23.104523 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:24:23.104523 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0394e6-60f7-4a93-a9d0-81c257db7543 could not be found. Oct 29 04:24:23.104523 n-d-862964-4 devstack@n-api.service[127041]: ERROR nova.api.openstack.wsgi Oct 29 04:24:23.104523 n-d-862964-4 devstack@n-api.service[127041]: DEBUG nova.api.openstack.wsgi [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Returning 404 to user: Instance db0394e6-60f7-4a93-a9d0-81c257db7543 could not be found. {{(pid=127041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:24:23.104523 n-d-862964-4 devstack@n-api.service[127041]: INFO nova.api.openstack.requestlog [None req-44a308c8-b322-4fda-a936-9ce1e225082d tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543" status: 404 len: 111 microversion: 2.1 time: 0.041136 Oct 29 04:24:23.104523 n-d-862964-4 devstack@n-api.service[127041]: [pid: 127041|app: 0|req: 4037/8114] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 04:24:23 2022] GET /compute/v2.1/servers/db0394e6-60f7-4a93-a9d0-81c257db7543 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:24:23.264597 n-d-862964-4 devstack@n-api.service[127042]: DEBUG nova.api.openstack.wsgi [None req-8acec7bc-035a-4824-9d64-07054d849231 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] Calling method '.version_select at 0x7fe1a8197d30>' {{(pid=127042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:24:23.290836 n-d-862964-4 devstack@n-api.service[127042]: INFO nova.api.openstack.requestlog [None req-8acec7bc-035a-4824-9d64-07054d849231 tempest-TestSnapshotPattern-1534613542 tempest-TestSnapshotPattern-1534613542-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-970255199" status: 202 len: 0 microversion: 2.1 time: 0.030015 Oct 29 04:24:23.291499 n-d-862964-4 devstack@n-api.service[127042]: [pid: 127042|app: 0|req: 4078/8115] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 04:24:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-970255199 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)